2024-04-25T08:46:58.676 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T08:46:58.676 DEBUG:teuthology.run:Teuthology command: teuthology --name neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi --archive /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} --owner scheduled_neesingh@teuthology --verbose -- /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001/orig.config.yaml 2024-04-25T08:46:58.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T08:46:58.799 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001 branch: wip-neesingh-testing-240416 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7673001' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-neesingh-testing-240416 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec kclient: syntax: v1 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62537 sha1: 5787d42d10024ba410e822a8aba474331cb9af02 owner: scheduled_neesingh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5869 sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-62537 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: 5787d42d10024ba410e822a8aba474331cb9af02 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLGVDBpqRGFbAl5fWAowyfq25cFVRSfAW1MVqaac06lmP8c5mBCfEOVMHBW9z1tbhJWDLg086BLHaTVcdC0yjCk= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuz4ZIFqnsr6K+0Mcq//lLrNEy0GLw+x3ZJdUqVt3u5hYPcPRV7E4zKY5QGfUPJ6NPo8Xd7iVHLlwBQacC9LlI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_08:15:18 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T08:46:58.799 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa; will attempt to use it 2024-04-25T08:46:58.800 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks 2024-04-25T08:46:58.800 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T08:46:58.801 INFO:teuthology.task.internal:Checking packages... 2024-04-25T08:46:58.825 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec' 2024-04-25T08:46:58.825 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T08:46:58.826 INFO:teuthology.packaging:ref: None 2024-04-25T08:46:58.826 INFO:teuthology.packaging:tag: None 2024-04-25T08:46:58.826 INFO:teuthology.packaging:branch: wip-neesingh-testing-240416 2024-04-25T08:46:58.826 INFO:teuthology.packaging:sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:46:58.826 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-neesingh-testing-240416 2024-04-25T08:46:59.022 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1628.g97ae6cc9 2024-04-25T08:46:59.023 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T08:46:59.029 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T08:46:59.029 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T08:46:59.062 INFO:teuthology.task.internal:Saving configuration 2024-04-25T08:46:59.078 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T08:46:59.084 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T08:46:59.109 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:41:50.848071', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLGVDBpqRGFbAl5fWAowyfq25cFVRSfAW1MVqaac06lmP8c5mBCfEOVMHBW9z1tbhJWDLg086BLHaTVcdC0yjCk='} 2024-04-25T08:46:59.130 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:41:50.849209', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuz4ZIFqnsr6K+0Mcq//lLrNEy0GLw+x3ZJdUqVt3u5hYPcPRV7E4zKY5QGfUPJ6NPo8Xd7iVHLlwBQacC9LlI='} 2024-04-25T08:46:59.130 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T08:46:59.137 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T08:46:59.137 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T08:46:59.137 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T08:46:59.218 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc5461e0160>, signals=[15]) 2024-04-25T08:46:59.219 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T08:46:59.225 INFO:teuthology.task.internal:Opening connections... 2024-04-25T08:46:59.225 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:46:59.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:46:59.304 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T08:46:59.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:46:59.379 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T08:46:59.385 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-04-25T08:46:59.403 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-04-25T08:46:59.404 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-04-25T08:46:59.460 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T08:46:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T08:46:59.462 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-04-25T08:46:59.480 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-04-25T08:46:59.497 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-04-25T08:46:59.497 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-04-25T08:46:59.554 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-04-25T08:46:59.554 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-04-25T08:46:59.554 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-04-25T08:46:59.554 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-04-25T08:46:59.554 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-04-25T08:46:59.554 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-04-25T08:46:59.554 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T08:46:59.554 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-04-25T08:46:59.555 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-04-25T08:46:59.555 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T08:46:59.555 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-04-25T08:46:59.555 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T08:46:59.555 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T08:46:59.555 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T08:46:59.555 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-04-25T08:46:59.579 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T08:46:59.588 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T08:46:59.655 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T08:46:59.655 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:46:59.657 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:46:59.673 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T08:46:59.680 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T08:46:59.680 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:46:59.714 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:46:59.908 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T08:46:59.964 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T08:46:59.978 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T08:46:59.978 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-25T08:46:59.978 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-25T08:46:59.979 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:46:59.979 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:46:59.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:46:59.995 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-04-25T08:46:59.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:46:59.996 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-04-25T08:47:00.053 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-437.el9.x86_64 2024-04-25T08:47:00.053 INFO:teuthology.task.kernel:Running kernel on smithi167: 5.14.0-437.el9.x86_64 2024-04-25T08:47:00.054 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum install -y kernel 2024-04-25T08:47:00.055 INFO:teuthology.orchestra.run.smithi055.stdout:5.14.0-437.el9.x86_64 2024-04-25T08:47:00.055 INFO:teuthology.task.kernel:Running kernel on smithi055: 5.14.0-437.el9.x86_64 2024-04-25T08:47:00.055 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum install -y kernel 2024-04-25T08:47:02.811 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.0 MB 00:01 2024-04-25T08:47:03.534 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.0 MB 00:01 2024-04-25T08:47:04.587 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-25T08:47:06.210 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-25T08:47:08.963 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.2 MB 00:00 2024-04-25T08:47:10.430 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 16 kB 00:00 2024-04-25T08:47:11.357 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 26 MB/s | 21 MB 00:00 2024-04-25T08:47:11.669 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.2 MB 00:01 2024-04-25T08:47:13.511 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-25T08:47:14.454 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-04-25T08:47:16.715 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-04-25T08:47:18.688 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T08:47:18.688 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T08:47:18.783 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-25T08:47:18.784 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-25T08:47:18.785 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-25T08:47:18.905 DEBUG:teuthology.orchestra.run.smithi055:> echo no | sudo yum reinstall kernel || true 2024-04-25T08:47:19.427 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 08:47:16 AM UTC. 2024-04-25T08:47:19.495 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-04-25T08:47:19.561 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-25T08:47:19.567 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T08:47:19.567 INFO:teuthology.orchestra.run.smithi055.stdout: Package Architecture Version Repository Size 2024-04-25T08:47:19.567 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T08:47:19.567 INFO:teuthology.orchestra.run.smithi055.stdout:Reinstalling: 2024-04-25T08:47:19.567 INFO:teuthology.orchestra.run.smithi055.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:47:19.567 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:47:19.567 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-25T08:47:19.567 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T08:47:19.567 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:47:19.568 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 255 k 2024-04-25T08:47:19.568 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 0 2024-04-25T08:47:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:Operation aborted. 2024-04-25T08:47:19.626 INFO:teuthology.orchestra.run.smithi055.stdout:Is this ok [y/N]: 2024-04-25T08:47:19.627 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum reinstall -y kernel || true 2024-04-25T08:47:20.146 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 08:47:16 AM UTC. 2024-04-25T08:47:20.267 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-25T08:47:20.268 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T08:47:20.268 INFO:teuthology.orchestra.run.smithi055.stdout: Package Architecture Version Repository Size 2024-04-25T08:47:20.268 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T08:47:20.268 INFO:teuthology.orchestra.run.smithi055.stdout:Reinstalling: 2024-04-25T08:47:20.268 INFO:teuthology.orchestra.run.smithi055.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:47:20.268 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:47:20.268 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-25T08:47:20.268 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T08:47:20.268 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:47:20.269 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 255 k 2024-04-25T08:47:20.269 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 0 2024-04-25T08:47:20.269 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-25T08:47:20.661 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.0 MB/s | 255 kB 00:00 2024-04-25T08:47:20.662 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:47:20.662 INFO:teuthology.orchestra.run.smithi055.stdout:Total 653 kB/s | 255 kB 00:00 2024-04-25T08:47:20.679 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-25T08:47:20.852 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-25T08:47:20.852 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-25T08:47:20.857 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-25T08:47:20.857 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-25T08:47:21.003 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-25T08:47:21.077 INFO:teuthology.orchestra.run.smithi055.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:47:21.077 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:47:21.402 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T08:47:21.402 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T08:47:21.488 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-04-25T08:47:21.489 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-04-25T08:47:21.489 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-04-25T08:47:21.615 DEBUG:teuthology.orchestra.run.smithi167:> echo no | sudo yum reinstall kernel || true 2024-04-25T08:47:21.891 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:47:21.891 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:47:22.155 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 08:47:19 AM UTC. 2024-04-25T08:47:22.282 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-04-25T08:47:22.292 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-04-25T08:47:22.292 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-04-25T08:47:22.292 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-04-25T08:47:22.292 INFO:teuthology.orchestra.run.smithi167.stdout:Reinstalling: 2024-04-25T08:47:22.292 INFO:teuthology.orchestra.run.smithi167.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:47:22.292 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:47:22.293 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-04-25T08:47:22.293 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-04-25T08:47:22.293 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:47:22.293 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 255 k 2024-04-25T08:47:22.293 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 0 2024-04-25T08:47:22.293 INFO:teuthology.orchestra.run.smithi167.stderr:Operation aborted. 2024-04-25T08:47:22.351 INFO:teuthology.orchestra.run.smithi167.stdout:Is this ok [y/N]: 2024-04-25T08:47:22.351 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum reinstall -y kernel || true 2024-04-25T08:47:22.625 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:47:22.625 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:47:22.625 INFO:teuthology.orchestra.run.smithi055.stdout:Reinstalled: 2024-04-25T08:47:22.625 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T08:47:22.626 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:47:22.626 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-25T08:47:22.779 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T08:47:22.826 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T08:47:22.827 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T08:47:22.827 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T08:47:22.827 DEBUG:teuthology.parallel:result is None 2024-04-25T08:47:22.844 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 08:47:19 AM UTC. 2024-04-25T08:47:22.960 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-04-25T08:47:22.961 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-04-25T08:47:22.961 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-04-25T08:47:22.961 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-04-25T08:47:22.961 INFO:teuthology.orchestra.run.smithi167.stdout:Reinstalling: 2024-04-25T08:47:22.961 INFO:teuthology.orchestra.run.smithi167.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:47:22.961 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:47:22.961 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-04-25T08:47:22.962 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-04-25T08:47:22.962 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:47:22.962 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 255 k 2024-04-25T08:47:22.962 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 0 2024-04-25T08:47:22.962 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-04-25T08:47:23.515 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-437.el9.x86_64.rpm 928 kB/s | 255 kB 00:00 2024-04-25T08:47:23.515 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:47:23.515 INFO:teuthology.orchestra.run.smithi167.stdout:Total 461 kB/s | 255 kB 00:00 2024-04-25T08:47:23.530 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-04-25T08:47:23.714 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-04-25T08:47:23.714 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-04-25T08:47:23.719 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-04-25T08:47:23.719 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-04-25T08:47:23.866 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-04-25T08:47:23.965 INFO:teuthology.orchestra.run.smithi167.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:47:23.966 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:47:24.728 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:47:24.728 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:47:25.446 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:47:25.447 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:47:25.447 INFO:teuthology.orchestra.run.smithi167.stdout:Reinstalled: 2024-04-25T08:47:25.447 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T08:47:25.447 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:47:25.447 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-04-25T08:47:25.638 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T08:47:25.726 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T08:47:25.726 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T08:47:25.726 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T08:47:25.726 DEBUG:teuthology.parallel:result is None 2024-04-25T08:47:25.727 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T08:47:25.734 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T08:47:25.734 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:47:25.737 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:47:25.755 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T08:47:25.771 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T08:47:25.793 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T08:47:25.793 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:47:25.810 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:47:25.847 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T08:47:25.857 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T08:47:25.858 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:47:25.880 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:47:25.910 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:47:25.930 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:47:25.933 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:47:25.947 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:47:25.949 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T08:47:25.956 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T08:47:25.956 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:47:25.959 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:47:25.997 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T08:47:26.006 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T08:47:26.007 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:47:26.027 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:47:26.052 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:47:26.122 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:47:26.173 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:47:26.255 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:47:26.297 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:47:26.297 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:47:26.363 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:47:26.403 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:47:26.446 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:47:26.524 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:47:26.566 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:47:26.566 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:47:26.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2024-04-25T08:47:26.631 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-04-25T08:47:26.668 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T08:47:26.701 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T08:47:27.149 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T08:47:27.157 INFO:teuthology.task.internal:Starting timer... 2024-04-25T08:47:27.157 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T08:47:27.177 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T08:47:27.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo service auditd rotate 2024-04-25T08:47:27.250 INFO:teuthology.orchestra.run.smithi055.stdout:Rotating logs: 2024-04-25T08:47:27.252 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2024-04-25T08:47:27.296 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2024-04-25T08:47:27.298 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T08:47:27.298 DEBUG:teuthology.orchestra.run.smithi055:> /usr/sbin/getenforce 2024-04-25T08:47:27.324 INFO:teuthology.orchestra.run.smithi055.stdout:Permissive 2024-04-25T08:47:27.324 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2024-04-25T08:47:27.356 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2024-04-25T08:47:27.356 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi055.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2024-04-25T08:47:27.356 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T08:47:27.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:47:27.390 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T08:47:27.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:47:27.420 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T08:47:27.420 DEBUG:teuthology.orchestra.run.smithi055:> sudo /usr/sbin/setenforce permissive 2024-04-25T08:47:27.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2024-04-25T08:47:27.492 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T08:47:27.502 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T08:47:27.517 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T08:47:27.518 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi055.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T08:50:56.027 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi055.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2024-04-25T08:50:56.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-25T08:50:56.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:50:56.104 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-04-25T08:50:56.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-25T08:50:56.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-25T08:50:56.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:50:56.265 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-04-25T08:50:56.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-25T08:50:56.356 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T08:50:56.366 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T08:50:56.366 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T08:50:56.366 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:50:56.368 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T08:50:56.369 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:50:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T08:50:56.410 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T08:50:56.422 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T08:50:56.434 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: ntpd: command not found 2024-04-25T08:50:56.435 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T08:50:56.445 INFO:teuthology.orchestra.run.smithi055.stdout:506 Cannot talk to daemon 2024-04-25T08:50:56.459 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T08:50:56.467 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2024-04-25T08:50:56.472 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T08:50:56.477 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2024-04-25T08:50:56.491 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T08:50:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T08:50:56.530 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-04-25T08:50:56.533 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T08:50:56.533 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-04-25T08:50:56.533 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:50:56.533 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:50:56.533 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:50:56.533 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:50:56.570 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-04-25T08:50:56.573 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T08:50:56.574 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-04-25T08:50:56.574 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:50:56.574 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:50:56.574 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:50:56.574 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:50:56.574 INFO:teuthology.run_tasks:Running task install... 2024-04-25T08:50:56.582 DEBUG:teuthology.task.install:project ceph 2024-04-25T08:50:56.582 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}} 2024-04-25T08:50:56.583 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'} 2024-04-25T08:50:56.583 INFO:teuthology.task.install:Using flavor: default 2024-04-25T08:50:56.588 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T08:50:56.588 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T08:50:56.589 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'tag': None, 'wait_for_package': False} 2024-04-25T08:50:56.589 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:50:56.591 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'tag': None, 'wait_for_package': False} 2024-04-25T08:50:56.591 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:50:56.728 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/ 2024-04-25T08:50:56.728 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1628.g97ae6cc9 2024-04-25T08:50:56.823 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/ 2024-04-25T08:50:56.823 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1628.g97ae6cc9 2024-04-25T08:50:56.892 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T08:50:56.892 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:50:56.892 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T08:50:56.918 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T08:50:56.918 DEBUG:teuthology.orchestra.run.smithi055:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T08:50:56.984 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T08:50:56.984 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:50:56.985 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T08:50:56.986 DEBUG:teuthology.orchestra.run.smithi055:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T08:50:57.011 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T08:50:57.011 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T08:50:57.061 DEBUG:teuthology.orchestra.run.smithi055:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T08:50:57.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T08:50:57.125 INFO:teuthology.orchestra.run.smithi055.stdout:check_obsoletes = 1 2024-04-25T08:50:57.127 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum clean all 2024-04-25T08:50:57.148 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T08:50:57.211 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2024-04-25T08:50:57.212 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2024-04-25T08:50:57.362 INFO:teuthology.orchestra.run.smithi055.stdout:48 files removed 2024-04-25T08:50:57.389 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T08:50:57.442 INFO:teuthology.orchestra.run.smithi167.stdout:48 files removed 2024-04-25T08:50:57.470 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T08:50:58.505 INFO:teuthology.orchestra.run.smithi055.stdout:ceph packages for x86_64 97 kB/s | 82 kB 00:00 2024-04-25T08:50:58.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 102 kB/s | 82 kB 00:00 2024-04-25T08:50:59.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 19 kB/s | 10 kB 00:00 2024-04-25T08:50:59.130 INFO:teuthology.orchestra.run.smithi055.stdout:ceph noarch packages 17 kB/s | 10 kB 00:00 2024-04-25T08:50:59.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 6.7 kB/s | 1.9 kB 00:00 2024-04-25T08:50:59.464 INFO:teuthology.orchestra.run.smithi055.stdout:ceph source packages 6.4 kB/s | 1.9 kB 00:00 2024-04-25T08:51:00.797 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.0 MB 00:01 2024-04-25T08:51:00.892 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.0 MB 00:01 2024-04-25T08:51:02.810 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-25T08:51:04.282 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 19 MB 00:02 2024-04-25T08:51:07.786 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.2 MB 00:01 2024-04-25T08:51:09.024 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.2 MB 00:01 2024-04-25T08:51:10.036 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-04-25T08:51:10.434 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 16 kB 00:00 2024-04-25T08:51:11.305 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-04-25T08:51:12.129 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-25T08:51:16.421 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-25T08:51:17.602 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-25T08:51:18.556 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:51:18.557 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:51:18.567 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T08:51:18.568 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T08:51:18.569 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T08:51:18.570 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T08:51:18.571 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T08:51:18.573 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T08:51:18.574 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T08:51:18.635 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-04-25T08:51:18.644 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-04-25T08:51:18.644 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-04-25T08:51:18.644 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-04-25T08:51:18.644 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-04-25T08:51:18.644 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T08:51:18.644 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 6.6 k 2024-04-25T08:51:18.644 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.3 M 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 887 k 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 145 k 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 1.5 M 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 138 k 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 1.8 M 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 7.4 M 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 49 k 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 9.8 M 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 47 M 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 264 k 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 748 k 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 220 k 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 27 k 2024-04-25T08:51:18.645 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 18 k 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 31 k 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 744 k 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 127 k 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T08:51:18.646 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 162 k 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 321 k 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 298 k 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 99 k 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 85 k 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 170 k 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.4 M 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T08:51:18.647 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 20 M 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 31 k 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 2.1 M 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 248 k 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 4.7 M 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 17 M 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 15 k 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 25 k 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T08:51:18.648 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 163 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 501 k 2024-04-25T08:51:18.649 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.1 M 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T08:51:18.650 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 45 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 131 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T08:51:18.651 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T08:51:18.652 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T08:51:18.653 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T08:51:18.654 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T08:51:18.655 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T08:51:18.656 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T08:51:18.656 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T08:51:18.656 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2024-04-25T08:51:18.656 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T08:51:18.656 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:51:18.656 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-04-25T08:51:18.656 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-04-25T08:51:18.656 INFO:teuthology.orchestra.run.smithi167.stdout:Install 148 Packages 2024-04-25T08:51:18.656 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 4 Packages 2024-04-25T08:51:18.656 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:51:18.657 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 215 M 2024-04-25T08:51:18.657 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-04-25T08:51:19.837 INFO:teuthology.orchestra.run.smithi055.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:51:19.837 INFO:teuthology.orchestra.run.smithi055.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:51:19.849 INFO:teuthology.orchestra.run.smithi055.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T08:51:19.849 INFO:teuthology.orchestra.run.smithi055.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T08:51:19.850 INFO:teuthology.orchestra.run.smithi055.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T08:51:19.851 INFO:teuthology.orchestra.run.smithi055.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T08:51:19.853 INFO:teuthology.orchestra.run.smithi055.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T08:51:19.855 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T08:51:19.856 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T08:51:19.914 INFO:teuthology.orchestra.run.smithi167.stdout:(1/152): ceph-19.0.0-1628.g97ae6cc9.el9.x86_64. 10 kB/s | 6.6 kB 00:00 2024-04-25T08:51:19.920 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-25T08:51:19.930 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-04-25T08:51:19.930 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-04-25T08:51:19.930 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-04-25T08:51:19.930 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-25T08:51:19.930 INFO:teuthology.orchestra.run.smithi055.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T08:51:19.930 INFO:teuthology.orchestra.run.smithi055.stdout: ceph x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 6.6 k 2024-04-25T08:51:19.930 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.3 M 2024-04-25T08:51:19.930 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 887 k 2024-04-25T08:51:19.930 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 145 k 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 1.5 M 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 138 k 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 1.8 M 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 7.4 M 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 49 k 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 9.8 M 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 47 M 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 264 k 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 748 k 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 220 k 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 27 k 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 18 k 2024-04-25T08:51:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 31 k 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 744 k 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 127 k 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 162 k 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 321 k 2024-04-25T08:51:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 298 k 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 99 k 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 85 k 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 170 k 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrading: 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: librados2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.4 M 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T08:51:19.933 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 20 M 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 31 k 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 2.1 M 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 248 k 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 4.7 M 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 17 M 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 15 k 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 25 k 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T08:51:19.934 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 163 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 501 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.1 M 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T08:51:19.935 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T08:51:19.936 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 45 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 131 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T08:51:19.937 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T08:51:19.938 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T08:51:19.939 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T08:51:19.940 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout:Installing weak dependencies: 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T08:51:19.941 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:51:19.942 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-25T08:51:19.942 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-04-25T08:51:19.942 INFO:teuthology.orchestra.run.smithi055.stdout:Install 148 Packages 2024-04-25T08:51:19.942 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrade 4 Packages 2024-04-25T08:51:19.942 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:51:19.942 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 215 M 2024-04-25T08:51:19.942 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-25T08:51:20.514 INFO:teuthology.orchestra.run.smithi167.stdout:(2/152): ceph-fuse-19.0.0-1628.g97ae6cc9.el9.x8 1.4 MB/s | 887 kB 00:00 2024-04-25T08:51:20.590 INFO:teuthology.orchestra.run.smithi167.stdout:(3/152): ceph-immutable-object-cache-19.0.0-162 1.9 MB/s | 145 kB 00:00 2024-04-25T08:51:20.945 INFO:teuthology.orchestra.run.smithi055.stdout:(1/152): ceph-19.0.0-1628.g97ae6cc9.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-04-25T08:51:21.065 INFO:teuthology.orchestra.run.smithi167.stdout:(4/152): ceph-base-19.0.0-1628.g97ae6cc9.el9.x8 3.0 MB/s | 5.3 MB 00:01 2024-04-25T08:51:21.190 INFO:teuthology.orchestra.run.smithi167.stdout:(5/152): ceph-mds-19.0.0-1628.g97ae6cc9.el9.x86 3.5 MB/s | 2.1 MB 00:00 2024-04-25T08:51:21.315 INFO:teuthology.orchestra.run.smithi167.stdout:(6/152): ceph-mgr-19.0.0-1628.g97ae6cc9.el9.x86 6.0 MB/s | 1.5 MB 00:00 2024-04-25T08:51:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:(2/152): ceph-fuse-19.0.0-1628.g97ae6cc9.el9.x8 1.8 MB/s | 887 kB 00:00 2024-04-25T08:51:21.495 INFO:teuthology.orchestra.run.smithi055.stdout:(3/152): ceph-immutable-object-cache-19.0.0-162 1.9 MB/s | 145 kB 00:00 2024-04-25T08:51:22.249 INFO:teuthology.orchestra.run.smithi167.stdout:(7/152): ceph-mon-19.0.0-1628.g97ae6cc9.el9.x86 4.4 MB/s | 4.7 MB 00:01 2024-04-25T08:51:22.412 INFO:teuthology.orchestra.run.smithi055.stdout:(4/152): ceph-mds-19.0.0-1628.g97ae6cc9.el9.x86 2.3 MB/s | 2.1 MB 00:00 2024-04-25T08:51:22.912 INFO:teuthology.orchestra.run.smithi055.stdout:(5/152): ceph-base-19.0.0-1628.g97ae6cc9.el9.x8 2.3 MB/s | 5.3 MB 00:02 2024-04-25T08:51:23.088 INFO:teuthology.orchestra.run.smithi055.stdout:(6/152): ceph-mgr-19.0.0-1628.g97ae6cc9.el9.x86 2.2 MB/s | 1.5 MB 00:00 2024-04-25T08:51:24.080 INFO:teuthology.orchestra.run.smithi055.stdout:(7/152): ceph-mon-19.0.0-1628.g97ae6cc9.el9.x86 4.0 MB/s | 4.7 MB 00:01 2024-04-25T08:51:24.249 INFO:teuthology.orchestra.run.smithi167.stdout:(8/152): ceph-osd-19.0.0-1628.g97ae6cc9.el9.x86 5.7 MB/s | 17 MB 00:02 2024-04-25T08:51:24.324 INFO:teuthology.orchestra.run.smithi167.stdout:(9/152): ceph-selinux-19.0.0-1628.g97ae6cc9.el9 336 kB/s | 25 kB 00:00 2024-04-25T08:51:24.783 INFO:teuthology.orchestra.run.smithi167.stdout:(10/152): ceph-radosgw-19.0.0-1628.g97ae6cc9.el 3.9 MB/s | 9.8 MB 00:02 2024-04-25T08:51:24.858 INFO:teuthology.orchestra.run.smithi167.stdout:(11/152): cephfs-mirror-19.0.0-1628.g97ae6cc9.e 2.9 MB/s | 220 kB 00:00 2024-04-25T08:51:24.925 INFO:teuthology.orchestra.run.smithi167.stdout:(12/152): cephfs-shell-19.0.0-1628.g97ae6cc9.el 405 kB/s | 27 kB 00:00 2024-04-25T08:51:25.000 INFO:teuthology.orchestra.run.smithi167.stdout:(13/152): libcephfs-devel-19.0.0-1628.g97ae6cc9 416 kB/s | 31 kB 00:00 2024-04-25T08:51:25.176 INFO:teuthology.orchestra.run.smithi167.stdout:(14/152): libcephfs2-19.0.0-1628.g97ae6cc9.el9. 4.2 MB/s | 744 kB 00:00 2024-04-25T08:51:25.246 INFO:teuthology.orchestra.run.smithi167.stdout:(15/152): libcephsqlite-19.0.0-1628.g97ae6cc9.e 2.4 MB/s | 163 kB 00:00 2024-04-25T08:51:25.310 INFO:teuthology.orchestra.run.smithi167.stdout:(16/152): librados-devel-19.0.0-1628.g97ae6cc9. 1.9 MB/s | 127 kB 00:00 2024-04-25T08:51:25.435 INFO:teuthology.orchestra.run.smithi167.stdout:(17/152): libradosstriper1-19.0.0-1628.g97ae6cc 3.9 MB/s | 501 kB 00:00 2024-04-25T08:51:25.905 INFO:teuthology.orchestra.run.smithi055.stdout:(8/152): ceph-radosgw-19.0.0-1628.g97ae6cc9.el9 5.4 MB/s | 9.8 MB 00:01 2024-04-25T08:51:25.955 INFO:teuthology.orchestra.run.smithi055.stdout:(9/152): ceph-selinux-19.0.0-1628.g97ae6cc9.el9 506 kB/s | 25 kB 00:00 2024-04-25T08:51:26.368 INFO:teuthology.orchestra.run.smithi167.stdout:(18/152): librgw2-19.0.0-1628.g97ae6cc9.el9.x86 5.5 MB/s | 5.1 MB 00:00 2024-04-25T08:51:26.435 INFO:teuthology.orchestra.run.smithi167.stdout:(19/152): python3-ceph-argparse-19.0.0-1628.g97 679 kB/s | 45 kB 00:00 2024-04-25T08:51:26.502 INFO:teuthology.orchestra.run.smithi167.stdout:(20/152): python3-ceph-common-19.0.0-1628.g97ae 1.9 MB/s | 131 kB 00:00 2024-04-25T08:51:26.578 INFO:teuthology.orchestra.run.smithi167.stdout:(21/152): python3-cephfs-19.0.0-1628.g97ae6cc9. 2.1 MB/s | 162 kB 00:00 2024-04-25T08:51:26.687 INFO:teuthology.orchestra.run.smithi167.stdout:(22/152): python3-rados-19.0.0-1628.g97ae6cc9.e 2.9 MB/s | 321 kB 00:00 2024-04-25T08:51:26.787 INFO:teuthology.orchestra.run.smithi167.stdout:(23/152): python3-rbd-19.0.0-1628.g97ae6cc9.el9 2.9 MB/s | 298 kB 00:00 2024-04-25T08:51:26.854 INFO:teuthology.orchestra.run.smithi167.stdout:(24/152): python3-rgw-19.0.0-1628.g97ae6cc9.el9 1.5 MB/s | 99 kB 00:00 2024-04-25T08:51:26.921 INFO:teuthology.orchestra.run.smithi167.stdout:(25/152): rbd-fuse-19.0.0-1628.g97ae6cc9.el9.x8 1.2 MB/s | 85 kB 00:00 2024-04-25T08:51:27.538 INFO:teuthology.orchestra.run.smithi167.stdout:(26/152): rbd-mirror-19.0.0-1628.g97ae6cc9.el9. 5.0 MB/s | 3.1 MB 00:00 2024-04-25T08:51:27.613 INFO:teuthology.orchestra.run.smithi167.stdout:(27/152): rbd-nbd-19.0.0-1628.g97ae6cc9.el9.x86 2.2 MB/s | 170 kB 00:00 2024-04-25T08:51:27.814 INFO:teuthology.orchestra.run.smithi167.stdout:(28/152): ceph-common-19.0.0-1628.g97ae6cc9.el9 2.3 MB/s | 20 MB 00:08 2024-04-25T08:51:27.847 INFO:teuthology.orchestra.run.smithi167.stdout:(29/152): ceph-grafana-dashboards-19.0.0-1628.g 134 kB/s | 31 kB 00:00 2024-04-25T08:51:27.881 INFO:teuthology.orchestra.run.smithi167.stdout:(30/152): ceph-mgr-cephadm-19.0.0-1628.g97ae6cc 2.0 MB/s | 138 kB 00:00 2024-04-25T08:51:28.273 INFO:teuthology.orchestra.run.smithi167.stdout:(31/152): ceph-mgr-dashboard-19.0.0-1628.g97ae6 4.2 MB/s | 1.8 MB 00:00 2024-04-25T08:51:28.348 INFO:teuthology.orchestra.run.smithi167.stdout:(32/152): ceph-mgr-modules-core-19.0.0-1628.g97 3.2 MB/s | 248 kB 00:00 2024-04-25T08:51:28.423 INFO:teuthology.orchestra.run.smithi167.stdout:(33/152): ceph-mgr-rook-19.0.0-1628.g97ae6cc9.e 658 kB/s | 49 kB 00:00 2024-04-25T08:51:28.482 INFO:teuthology.orchestra.run.smithi167.stdout:(34/152): ceph-prometheus-alerts-19.0.0-1628.g9 262 kB/s | 15 kB 00:00 2024-04-25T08:51:28.566 INFO:teuthology.orchestra.run.smithi167.stdout:(35/152): ceph-volume-19.0.0-1628.g97ae6cc9.el9 3.1 MB/s | 264 kB 00:00 2024-04-25T08:51:28.758 INFO:teuthology.orchestra.run.smithi167.stdout:(36/152): cephadm-19.0.0-1628.g97ae6cc9.el9.noa 3.8 MB/s | 748 kB 00:00 2024-04-25T08:51:28.858 INFO:teuthology.orchestra.run.smithi167.stdout:(37/152): cephfs-top-19.0.0-1628.g97ae6cc9.el9. 182 kB/s | 18 kB 00:00 2024-04-25T08:51:28.905 INFO:teuthology.orchestra.run.smithi055.stdout:(10/152): ceph-osd-19.0.0-1628.g97ae6cc9.el9.x8 2.9 MB/s | 17 MB 00:05 2024-04-25T08:51:28.988 INFO:teuthology.orchestra.run.smithi055.stdout:(11/152): cephfs-mirror-19.0.0-1628.g97ae6cc9.e 2.6 MB/s | 220 kB 00:00 2024-04-25T08:51:29.039 INFO:teuthology.orchestra.run.smithi055.stdout:(12/152): cephfs-shell-19.0.0-1628.g97ae6cc9.el 541 kB/s | 27 kB 00:00 2024-04-25T08:51:29.075 INFO:teuthology.orchestra.run.smithi167.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 371 kB/s | 80 kB 00:00 2024-04-25T08:51:29.091 INFO:teuthology.orchestra.run.smithi055.stdout:(13/152): libcephfs-devel-19.0.0-1628.g97ae6cc9 601 kB/s | 31 kB 00:00 2024-04-25T08:51:29.291 INFO:teuthology.orchestra.run.smithi055.stdout:(14/152): libcephfs2-19.0.0-1628.g97ae6cc9.el9. 3.6 MB/s | 744 kB 00:00 2024-04-25T08:51:29.350 INFO:teuthology.orchestra.run.smithi055.stdout:(15/152): libcephsqlite-19.0.0-1628.g97ae6cc9.e 2.7 MB/s | 163 kB 00:00 2024-04-25T08:51:29.410 INFO:teuthology.orchestra.run.smithi055.stdout:(16/152): librados-devel-19.0.0-1628.g97ae6cc9. 2.1 MB/s | 127 kB 00:00 2024-04-25T08:51:29.483 INFO:teuthology.orchestra.run.smithi167.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 803 kB 00:00 2024-04-25T08:51:29.550 INFO:teuthology.orchestra.run.smithi055.stdout:(17/152): libradosstriper1-19.0.0-1628.g97ae6cc 3.5 MB/s | 501 kB 00:00 2024-04-25T08:51:29.750 INFO:teuthology.orchestra.run.smithi167.stdout:(40/152): ceph-mgr-diskprediction-local-19.0.0- 4.0 MB/s | 7.4 MB 00:01 2024-04-25T08:51:29.775 INFO:teuthology.orchestra.run.smithi167.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 669 kB/s | 195 kB 00:00 2024-04-25T08:51:29.834 INFO:teuthology.orchestra.run.smithi055.stdout:(18/152): ceph-common-19.0.0-1628.g97ae6cc9.el9 2.2 MB/s | 20 MB 00:09 2024-04-25T08:51:29.884 INFO:teuthology.orchestra.run.smithi055.stdout:(19/152): python3-ceph-argparse-19.0.0-1628.g97 911 kB/s | 45 kB 00:00 2024-04-25T08:51:29.968 INFO:teuthology.orchestra.run.smithi055.stdout:(20/152): python3-ceph-common-19.0.0-1628.g97ae 1.5 MB/s | 131 kB 00:00 2024-04-25T08:51:30.001 INFO:teuthology.orchestra.run.smithi167.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-04-25T08:51:30.044 INFO:teuthology.orchestra.run.smithi055.stdout:(21/152): python3-cephfs-19.0.0-1628.g97ae6cc9. 2.1 MB/s | 162 kB 00:00 2024-04-25T08:51:30.144 INFO:teuthology.orchestra.run.smithi055.stdout:(22/152): python3-rados-19.0.0-1628.g97ae6cc9.e 3.1 MB/s | 321 kB 00:00 2024-04-25T08:51:30.218 INFO:teuthology.orchestra.run.smithi167.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 2.8 MB/s | 1.2 MB 00:00 2024-04-25T08:51:30.236 INFO:teuthology.orchestra.run.smithi055.stdout:(23/152): python3-rbd-19.0.0-1628.g97ae6cc9.el9 3.2 MB/s | 298 kB 00:00 2024-04-25T08:51:30.243 INFO:teuthology.orchestra.run.smithi167.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 440 kB/s | 106 kB 00:00 2024-04-25T08:51:30.295 INFO:teuthology.orchestra.run.smithi055.stdout:(24/152): python3-rgw-19.0.0-1628.g97ae6cc9.el9 1.7 MB/s | 99 kB 00:00 2024-04-25T08:51:30.435 INFO:teuthology.orchestra.run.smithi167.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 623 kB/s | 135 kB 00:00 2024-04-25T08:51:30.436 INFO:teuthology.orchestra.run.smithi055.stdout:(25/152): rbd-fuse-19.0.0-1628.g97ae6cc9.el9.x8 604 kB/s | 85 kB 00:00 2024-04-25T08:51:30.486 INFO:teuthology.orchestra.run.smithi167.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 515 kB/s | 125 kB 00:00 2024-04-25T08:51:30.687 INFO:teuthology.orchestra.run.smithi055.stdout:(26/152): librgw2-19.0.0-1628.g97ae6cc9.el9.x86 4.5 MB/s | 5.1 MB 00:01 2024-04-25T08:51:30.711 INFO:teuthology.orchestra.run.smithi167.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 779 kB/s | 215 kB 00:00 2024-04-25T08:51:30.745 INFO:teuthology.orchestra.run.smithi055.stdout:(27/152): rbd-nbd-19.0.0-1628.g97ae6cc9.el9.x86 2.9 MB/s | 170 kB 00:00 2024-04-25T08:51:30.804 INFO:teuthology.orchestra.run.smithi055.stdout:(28/152): ceph-grafana-dashboards-19.0.0-1628.g 538 kB/s | 31 kB 00:00 2024-04-25T08:51:30.861 INFO:teuthology.orchestra.run.smithi167.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-04-25T08:51:30.862 INFO:teuthology.orchestra.run.smithi055.stdout:(29/152): ceph-mgr-cephadm-19.0.0-1628.g97ae6cc 2.3 MB/s | 138 kB 00:00 2024-04-25T08:51:31.078 INFO:teuthology.orchestra.run.smithi167.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 494 kB/s | 107 kB 00:00 2024-04-25T08:51:31.112 INFO:teuthology.orchestra.run.smithi167.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-04-25T08:51:31.129 INFO:teuthology.orchestra.run.smithi055.stdout:(30/152): rbd-mirror-19.0.0-1628.g97ae6cc9.el9. 4.5 MB/s | 3.1 MB 00:00 2024-04-25T08:51:31.220 INFO:teuthology.orchestra.run.smithi167.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 152 kB/s | 21 kB 00:00 2024-04-25T08:51:31.246 INFO:teuthology.orchestra.run.smithi055.stdout:(31/152): ceph-mgr-dashboard-19.0.0-1628.g97ae6 4.6 MB/s | 1.8 MB 00:00 2024-04-25T08:51:31.338 INFO:teuthology.orchestra.run.smithi055.stdout:(32/152): ceph-mgr-modules-core-19.0.0-1628.g97 2.6 MB/s | 248 kB 00:00 2024-04-25T08:51:31.370 INFO:teuthology.orchestra.run.smithi167.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2024-04-25T08:51:31.380 INFO:teuthology.orchestra.run.smithi055.stdout:(33/152): ceph-mgr-rook-19.0.0-1628.g97ae6cc9.e 1.2 MB/s | 49 kB 00:00 2024-04-25T08:51:31.396 INFO:teuthology.orchestra.run.smithi167.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 186 kB/s | 33 kB 00:00 2024-04-25T08:51:31.426 INFO:teuthology.orchestra.run.smithi055.stdout:(34/152): ceph-prometheus-alerts-19.0.0-1628.g9 368 kB/s | 15 kB 00:00 2024-04-25T08:51:31.514 INFO:teuthology.orchestra.run.smithi055.stdout:(35/152): ceph-volume-19.0.0-1628.g97ae6cc9.el9 2.8 MB/s | 264 kB 00:00 2024-04-25T08:51:31.546 INFO:teuthology.orchestra.run.smithi167.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 121 kB/s | 18 kB 00:00 2024-04-25T08:51:31.646 INFO:teuthology.orchestra.run.smithi167.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-04-25T08:51:31.781 INFO:teuthology.orchestra.run.smithi055.stdout:(36/152): cephadm-19.0.0-1628.g97ae6cc9.el9.noa 2.7 MB/s | 748 kB 00:00 2024-04-25T08:51:31.823 INFO:teuthology.orchestra.run.smithi055.stdout:(37/152): cephfs-top-19.0.0-1628.g97ae6cc9.el9. 441 kB/s | 18 kB 00:00 2024-04-25T08:51:32.097 INFO:teuthology.orchestra.run.smithi167.stdout:(56/152): ceph-test-19.0.0-1628.g97ae6cc9.el9.x 6.1 MB/s | 47 MB 00:07 2024-04-25T08:51:32.280 INFO:teuthology.orchestra.run.smithi167.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 247 kB/s | 45 kB 00:00 2024-04-25T08:51:32.305 INFO:teuthology.orchestra.run.smithi167.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 243 kB/s | 160 kB 00:00 2024-04-25T08:51:32.332 INFO:teuthology.orchestra.run.smithi055.stdout:(38/152): ceph-test-19.0.0-1628.g97ae6cc9.el9.x 7.4 MB/s | 47 MB 00:06 2024-04-25T08:51:32.357 INFO:teuthology.orchestra.run.smithi055.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 151 kB/s | 80 kB 00:00 2024-04-25T08:51:32.539 INFO:teuthology.orchestra.run.smithi167.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-04-25T08:51:32.616 INFO:teuthology.orchestra.run.smithi055.stdout:(40/152): ceph-mgr-diskprediction-local-19.0.0- 5.0 MB/s | 7.4 MB 00:01 2024-04-25T08:51:32.631 INFO:teuthology.orchestra.run.smithi167.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-04-25T08:51:32.642 INFO:teuthology.orchestra.run.smithi055.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 688 kB/s | 195 kB 00:00 2024-04-25T08:51:32.664 INFO:teuthology.orchestra.run.smithi167.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 1.6 MB/s | 582 kB 00:00 2024-04-25T08:51:32.706 INFO:teuthology.orchestra.run.smithi167.stdout:(62/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 152 kB/s | 25 kB 00:00 2024-04-25T08:51:32.775 INFO:teuthology.orchestra.run.smithi055.stdout:(42/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 803 kB 00:00 2024-04-25T08:51:32.832 INFO:teuthology.orchestra.run.smithi167.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 237 kB/s | 47 kB 00:00 2024-04-25T08:51:32.908 INFO:teuthology.orchestra.run.smithi055.stdout:(43/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 868 kB/s | 253 kB 00:00 2024-04-25T08:51:32.941 INFO:teuthology.orchestra.run.smithi167.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.0 MB/s | 292 kB 00:00 2024-04-25T08:51:32.966 INFO:teuthology.orchestra.run.smithi167.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 727 kB/s | 188 kB 00:00 2024-04-25T08:51:32.983 INFO:teuthology.orchestra.run.smithi055.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 511 kB/s | 106 kB 00:00 2024-04-25T08:51:32.991 INFO:teuthology.orchestra.run.smithi167.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 221 kB/s | 35 kB 00:00 2024-04-25T08:51:33.059 INFO:teuthology.orchestra.run.smithi055.stdout:(45/152): python3-cryptography-36.0.1-4.el9.x86 2.9 MB/s | 1.2 MB 00:00 2024-04-25T08:51:33.151 INFO:teuthology.orchestra.run.smithi055.stdout:(46/152): python3-pycparser-2.20-6.el9.noarch.r 558 kB/s | 135 kB 00:00 2024-04-25T08:51:33.209 INFO:teuthology.orchestra.run.smithi055.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 554 kB/s | 125 kB 00:00 2024-04-25T08:51:33.376 INFO:teuthology.orchestra.run.smithi055.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 677 kB/s | 215 kB 00:00 2024-04-25T08:51:33.433 INFO:teuthology.orchestra.run.smithi167.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 3.6 MB/s | 1.6 MB 00:00 2024-04-25T08:51:33.527 INFO:teuthology.orchestra.run.smithi055.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-04-25T08:51:33.586 INFO:teuthology.orchestra.run.smithi055.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 2.5 MB/s | 943 kB 00:00 2024-04-25T08:51:33.610 INFO:teuthology.orchestra.run.smithi055.stdout:(51/152): boost-program-options-1.75.0-8.el9.x8 456 kB/s | 107 kB 00:00 2024-04-25T08:51:33.636 INFO:teuthology.orchestra.run.smithi055.stdout:(52/152): elfutils-libelf-devel-0.190-2.el9.x86 197 kB/s | 21 kB 00:00 2024-04-25T08:51:33.661 INFO:teuthology.orchestra.run.smithi055.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-04-25T08:51:33.686 INFO:teuthology.orchestra.run.smithi055.stdout:(54/152): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-04-25T08:51:33.712 INFO:teuthology.orchestra.run.smithi055.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-04-25T08:51:33.745 INFO:teuthology.orchestra.run.smithi055.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-04-25T08:51:33.770 INFO:teuthology.orchestra.run.smithi055.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-25T08:51:33.800 INFO:teuthology.orchestra.run.smithi167.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.3 MB/s | 4.4 MB 00:00 2024-04-25T08:51:33.804 INFO:teuthology.orchestra.run.smithi055.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-04-25T08:51:33.863 INFO:teuthology.orchestra.run.smithi055.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-04-25T08:51:33.884 INFO:teuthology.orchestra.run.smithi167.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 2.0 MB/s | 911 kB 00:00 2024-04-25T08:51:33.921 INFO:teuthology.orchestra.run.smithi055.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-04-25T08:51:33.938 INFO:teuthology.orchestra.run.smithi055.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 338 kB/s | 25 kB 00:00 2024-04-25T08:51:33.984 INFO:teuthology.orchestra.run.smithi167.stdout:(70/152): openblas-openmp-0.3.21-2.el9.x86_64.r 4.5 MB/s | 4.7 MB 00:01 2024-04-25T08:51:33.988 INFO:teuthology.orchestra.run.smithi055.stdout:(62/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2024-04-25T08:51:34.005 INFO:teuthology.orchestra.run.smithi055.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-04-25T08:51:34.031 INFO:teuthology.orchestra.run.smithi055.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-04-25T08:51:34.056 INFO:teuthology.orchestra.run.smithi055.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-04-25T08:51:34.059 INFO:teuthology.orchestra.run.smithi167.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 515 kB/s | 133 kB 00:00 2024-04-25T08:51:34.081 INFO:teuthology.orchestra.run.smithi055.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 467 kB/s | 35 kB 00:00 2024-04-25T08:51:34.232 INFO:teuthology.orchestra.run.smithi055.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-25T08:51:34.259 INFO:teuthology.orchestra.run.smithi167.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 437 kB/s | 87 kB 00:00 2024-04-25T08:51:34.352 INFO:teuthology.orchestra.run.smithi055.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 7.4 MB/s | 911 kB 00:00 2024-04-25T08:51:34.368 INFO:teuthology.orchestra.run.smithi167.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 2.6 MB/s | 1.0 MB 00:00 2024-04-25T08:51:34.432 INFO:teuthology.orchestra.run.smithi055.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-25T08:51:34.457 INFO:teuthology.orchestra.run.smithi055.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-04-25T08:51:34.524 INFO:teuthology.orchestra.run.smithi055.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 9.6 MB/s | 4.7 MB 00:00 2024-04-25T08:51:34.558 INFO:teuthology.orchestra.run.smithi055.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-25T08:51:34.584 INFO:teuthology.orchestra.run.smithi055.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T08:51:34.658 INFO:teuthology.orchestra.run.smithi055.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-04-25T08:51:34.668 INFO:teuthology.orchestra.run.smithi167.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 813 kB/s | 244 kB 00:00 2024-04-25T08:51:34.759 INFO:teuthology.orchestra.run.smithi055.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-25T08:51:34.876 INFO:teuthology.orchestra.run.smithi055.stdout:(76/152): postgresql-server-13.14-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-04-25T08:51:34.901 INFO:teuthology.orchestra.run.smithi055.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 181 kB/s | 26 kB 00:00 2024-04-25T08:51:34.943 INFO:teuthology.orchestra.run.smithi055.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 288 kB/s | 19 kB 00:00 2024-04-25T08:51:34.952 INFO:teuthology.orchestra.run.smithi167.stdout:(75/152): postgresql-server-13.14-1.el9.x86_64. 5.4 MB/s | 5.8 MB 00:01 2024-04-25T08:51:34.968 INFO:teuthology.orchestra.run.smithi055.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-25T08:51:34.977 INFO:teuthology.orchestra.run.smithi167.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 803 kB/s | 248 kB 00:00 2024-04-25T08:51:35.002 INFO:teuthology.orchestra.run.smithi055.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 592 kB/s | 35 kB 00:00 2024-04-25T08:51:35.077 INFO:teuthology.orchestra.run.smithi055.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-04-25T08:51:35.102 INFO:teuthology.orchestra.run.smithi167.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 170 kB/s | 26 kB 00:00 2024-04-25T08:51:35.103 INFO:teuthology.orchestra.run.smithi055.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-04-25T08:51:35.128 INFO:teuthology.orchestra.run.smithi167.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 127 kB/s | 19 kB 00:00 2024-04-25T08:51:35.144 INFO:teuthology.orchestra.run.smithi055.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-04-25T08:51:35.170 INFO:teuthology.orchestra.run.smithi055.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-04-25T08:51:35.203 INFO:teuthology.orchestra.run.smithi055.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-04-25T08:51:35.229 INFO:teuthology.orchestra.run.smithi055.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-04-25T08:51:35.262 INFO:teuthology.orchestra.run.smithi055.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-04-25T08:51:35.278 INFO:teuthology.orchestra.run.smithi167.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 232 kB/s | 35 kB 00:00 2024-04-25T08:51:35.287 INFO:teuthology.orchestra.run.smithi055.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-04-25T08:51:35.321 INFO:teuthology.orchestra.run.smithi055.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 876 kB/s | 51 kB 00:00 2024-04-25T08:51:35.346 INFO:teuthology.orchestra.run.smithi055.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 917 kB/s | 54 kB 00:00 2024-04-25T08:51:35.362 INFO:teuthology.orchestra.run.smithi167.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 665 kB/s | 172 kB 00:00 2024-04-25T08:51:35.421 INFO:teuthology.orchestra.run.smithi055.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-04-25T08:51:35.447 INFO:teuthology.orchestra.run.smithi055.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-04-25T08:51:35.480 INFO:teuthology.orchestra.run.smithi055.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-04-25T08:51:35.506 INFO:teuthology.orchestra.run.smithi055.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-25T08:51:35.539 INFO:teuthology.orchestra.run.smithi055.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-04-25T08:51:35.565 INFO:teuthology.orchestra.run.smithi055.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-04-25T08:51:35.606 INFO:teuthology.orchestra.run.smithi055.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-04-25T08:51:35.629 INFO:teuthology.orchestra.run.smithi167.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 939 kB/s | 250 kB 00:00 2024-04-25T08:51:35.632 INFO:teuthology.orchestra.run.smithi055.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 864 kB/s | 58 kB 00:00 2024-04-25T08:51:35.665 INFO:teuthology.orchestra.run.smithi055.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-25T08:51:35.699 INFO:teuthology.orchestra.run.smithi055.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 947 kB/s | 64 kB 00:00 2024-04-25T08:51:35.725 INFO:teuthology.orchestra.run.smithi055.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 760 kB/s | 45 kB 00:00 2024-04-25T08:51:35.817 INFO:teuthology.orchestra.run.smithi055.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-04-25T08:51:35.896 INFO:teuthology.orchestra.run.smithi167.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 833 kB/s | 222 kB 00:00 2024-04-25T08:51:36.067 INFO:teuthology.orchestra.run.smithi055.stdout:(103/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-04-25T08:51:36.109 INFO:teuthology.orchestra.run.smithi055.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-04-25T08:51:36.121 INFO:teuthology.orchestra.run.smithi167.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.1 MB/s | 5.1 MB 00:00 2024-04-25T08:51:36.134 INFO:teuthology.orchestra.run.smithi055.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-04-25T08:51:36.146 INFO:teuthology.orchestra.run.smithi167.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 308 kB/s | 77 kB 00:00 2024-04-25T08:51:36.184 INFO:teuthology.orchestra.run.smithi055.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-04-25T08:51:36.226 INFO:teuthology.orchestra.run.smithi055.stdout:(107/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.9 MB/s | 309 kB 00:00 2024-04-25T08:51:36.243 INFO:teuthology.orchestra.run.smithi055.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 443 kB/s | 26 kB 00:00 2024-04-25T08:51:36.260 INFO:teuthology.orchestra.run.smithi055.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-04-25T08:51:36.296 INFO:teuthology.orchestra.run.smithi167.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 241 kB/s | 42 kB 00:00 2024-04-25T08:51:36.302 INFO:teuthology.orchestra.run.smithi055.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-04-25T08:51:36.330 INFO:teuthology.orchestra.run.smithi055.stdout:(111/152): libunwind-1.6.2-1.el9.x86_64.rpm 802 kB/s | 67 kB 00:00 2024-04-25T08:51:36.394 INFO:teuthology.orchestra.run.smithi055.stdout:(112/152): libarrow-9.0.0-10.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-04-25T08:51:36.436 INFO:teuthology.orchestra.run.smithi055.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.1 MB/s | 838 kB 00:00 2024-04-25T08:51:36.438 INFO:teuthology.orchestra.run.smithi167.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 922 kB/s | 269 kB 00:00 2024-04-25T08:51:36.453 INFO:teuthology.orchestra.run.smithi055.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 743 kB/s | 43 kB 00:00 2024-04-25T08:51:36.470 INFO:teuthology.orchestra.run.smithi055.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 959 kB/s | 32 kB 00:00 2024-04-25T08:51:36.487 INFO:teuthology.orchestra.run.smithi055.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 445 kB/s | 15 kB 00:00 2024-04-25T08:51:36.521 INFO:teuthology.orchestra.run.smithi055.stdout:(117/152): python3-asyncssh-2.13.2-5.el9.noarch 2.8 MB/s | 548 kB 00:00 2024-04-25T08:51:36.546 INFO:teuthology.orchestra.run.smithi055.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-25T08:51:36.571 INFO:teuthology.orchestra.run.smithi055.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-04-25T08:51:36.588 INFO:teuthology.orchestra.run.smithi167.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 544 kB/s | 159 kB 00:00 2024-04-25T08:51:36.596 INFO:teuthology.orchestra.run.smithi055.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-04-25T08:51:36.622 INFO:teuthology.orchestra.run.smithi055.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 468 kB/s | 35 kB 00:00 2024-04-25T08:51:36.647 INFO:teuthology.orchestra.run.smithi055.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-25T08:51:36.672 INFO:teuthology.orchestra.run.smithi167.stdout:(88/152): python3-babel-2.9.1-2.el9.noarch.rpm 2.5 MB/s | 6.0 MB 00:02 2024-04-25T08:51:36.689 INFO:teuthology.orchestra.run.smithi055.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-04-25T08:51:36.714 INFO:teuthology.orchestra.run.smithi055.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-04-25T08:51:36.742 INFO:teuthology.orchestra.run.smithi055.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-04-25T08:51:36.747 INFO:teuthology.orchestra.run.smithi167.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 902 kB/s | 279 kB 00:00 2024-04-25T08:51:36.765 INFO:teuthology.orchestra.run.smithi055.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-04-25T08:51:36.790 INFO:teuthology.orchestra.run.smithi055.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-04-25T08:51:36.806 INFO:teuthology.orchestra.run.smithi167.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 234 kB/s | 51 kB 00:00 2024-04-25T08:51:36.815 INFO:teuthology.orchestra.run.smithi055.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-04-25T08:51:36.865 INFO:teuthology.orchestra.run.smithi167.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 279 kB/s | 54 kB 00:00 2024-04-25T08:51:36.866 INFO:teuthology.orchestra.run.smithi055.stdout:(129/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.6 MB/s | 2.0 MB 00:00 2024-04-25T08:51:36.891 INFO:teuthology.orchestra.run.smithi055.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-04-25T08:51:36.916 INFO:teuthology.orchestra.run.smithi055.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-25T08:51:36.942 INFO:teuthology.orchestra.run.smithi055.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-04-25T08:51:36.967 INFO:teuthology.orchestra.run.smithi055.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-04-25T08:51:36.973 INFO:teuthology.orchestra.run.smithi167.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 249 kB/s | 42 kB 00:00 2024-04-25T08:51:36.992 INFO:teuthology.orchestra.run.smithi055.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-04-25T08:51:37.017 INFO:teuthology.orchestra.run.smithi055.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-04-25T08:51:37.043 INFO:teuthology.orchestra.run.smithi055.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-04-25T08:51:37.068 INFO:teuthology.orchestra.run.smithi055.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-04-25T08:51:37.090 INFO:teuthology.orchestra.run.smithi167.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 196 kB/s | 44 kB 00:00 2024-04-25T08:51:37.101 INFO:teuthology.orchestra.run.smithi055.stdout:(138/152): python3-kubernetes-26.1.0-2.el9.noar 3.3 MB/s | 1.0 MB 00:00 2024-04-25T08:51:37.127 INFO:teuthology.orchestra.run.smithi055.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-04-25T08:51:37.154 INFO:teuthology.orchestra.run.smithi055.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 707 kB/s | 59 kB 00:00 2024-04-25T08:51:37.169 INFO:teuthology.orchestra.run.smithi055.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 532 kB/s | 36 kB 00:00 2024-04-25T08:51:37.194 INFO:teuthology.orchestra.run.smithi055.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 760 kB/s | 51 kB 00:00 2024-04-25T08:51:37.219 INFO:teuthology.orchestra.run.smithi055.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-04-25T08:51:37.224 INFO:teuthology.orchestra.run.smithi167.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 269 kB/s | 36 kB 00:00 2024-04-25T08:51:37.245 INFO:teuthology.orchestra.run.smithi055.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-25T08:51:37.257 INFO:teuthology.orchestra.run.smithi167.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 777 kB/s | 221 kB 00:00 2024-04-25T08:51:37.262 INFO:teuthology.orchestra.run.smithi055.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-04-25T08:51:37.295 INFO:teuthology.orchestra.run.smithi055.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-04-25T08:51:37.320 INFO:teuthology.orchestra.run.smithi055.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-25T08:51:37.408 INFO:teuthology.orchestra.run.smithi167.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 258 kB/s | 47 kB 00:00 2024-04-25T08:51:37.437 INFO:teuthology.orchestra.run.smithi055.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-04-25T08:51:37.550 INFO:teuthology.orchestra.run.smithi167.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 305 kB 00:00 2024-04-25T08:51:37.583 INFO:teuthology.orchestra.run.smithi167.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 329 kB/s | 58 kB 00:00 2024-04-25T08:51:37.680 INFO:teuthology.orchestra.run.smithi055.stdout:(149/152): librbd1-19.0.0-1628.g97ae6cc9.el9.x8 8.7 MB/s | 3.1 MB 00:00 2024-04-25T08:51:37.759 INFO:teuthology.orchestra.run.smithi167.stdout:(99/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 364 kB/s | 64 kB 00:00 2024-04-25T08:51:37.784 INFO:teuthology.orchestra.run.smithi167.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 401 kB/s | 94 kB 00:00 2024-04-25T08:51:37.813 INFO:teuthology.orchestra.run.smithi055.stdout:(150/152): librados2-19.0.0-1628.g97ae6cc9.el9. 6.5 MB/s | 3.4 MB 00:00 2024-04-25T08:51:37.913 INFO:teuthology.orchestra.run.smithi055.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 2.8 MB/s | 1.3 MB 00:00 2024-04-25T08:51:37.943 INFO:teuthology.orchestra.run.smithi167.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-04-25T08:51:37.968 INFO:teuthology.orchestra.run.smithi167.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 214 kB/s | 45 kB 00:00 2024-04-25T08:51:38.230 INFO:teuthology.orchestra.run.smithi055.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 4.4 MB/s | 2.4 MB 00:00 2024-04-25T08:51:38.233 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:51:38.233 INFO:teuthology.orchestra.run.smithi055.stdout:Total 12 MB/s | 215 MB 00:18 2024-04-25T08:51:38.260 INFO:teuthology.orchestra.run.smithi167.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-04-25T08:51:38.310 INFO:teuthology.orchestra.run.smithi167.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 6.1 MB/s | 309 kB 00:00 2024-04-25T08:51:38.344 INFO:teuthology.orchestra.run.smithi167.stdout:(105/152): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-04-25T08:51:38.394 INFO:teuthology.orchestra.run.smithi167.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 232 kB/s | 19 kB 00:00 2024-04-25T08:51:38.478 INFO:teuthology.orchestra.run.smithi167.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 313 kB/s | 26 kB 00:00 2024-04-25T08:51:38.603 INFO:teuthology.orchestra.run.smithi167.stdout:(108/152): libarrow-9.0.0-10.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-04-25T08:51:38.628 INFO:teuthology.orchestra.run.smithi167.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 326 kB/s | 49 kB 00:00 2024-04-25T08:51:38.654 INFO:teuthology.orchestra.run.smithi167.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-25T08:51:38.821 INFO:teuthology.orchestra.run.smithi167.stdout:(111/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.8 MB/s | 16 MB 00:02 2024-04-25T08:51:38.846 INFO:teuthology.orchestra.run.smithi167.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 695 kB/s | 151 kB 00:00 2024-04-25T08:51:38.880 INFO:teuthology.orchestra.run.smithi167.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2024-04-25T08:51:38.921 INFO:teuthology.orchestra.run.smithi167.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 5.4 MB/s | 548 kB 00:00 2024-04-25T08:51:38.947 INFO:teuthology.orchestra.run.smithi167.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 652 kB/s | 43 kB 00:00 2024-04-25T08:51:38.989 INFO:teuthology.orchestra.run.smithi167.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-04-25T08:51:39.047 INFO:teuthology.orchestra.run.smithi167.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 119 kB/s | 15 kB 00:00 2024-04-25T08:51:39.098 INFO:teuthology.orchestra.run.smithi167.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2024-04-25T08:51:39.123 INFO:teuthology.orchestra.run.smithi167.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-04-25T08:51:39.148 INFO:teuthology.orchestra.run.smithi167.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-04-25T08:51:39.165 INFO:teuthology.orchestra.run.smithi167.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 532 kB/s | 35 kB 00:00 2024-04-25T08:51:39.265 INFO:teuthology.orchestra.run.smithi167.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.4 MB/s | 206 kB 00:00 2024-04-25T08:51:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-25T08:51:39.399 INFO:teuthology.orchestra.run.smithi167.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-04-25T08:51:39.424 INFO:teuthology.orchestra.run.smithi167.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 558 kB/s | 144 kB 00:00 2024-04-25T08:51:39.441 INFO:teuthology.orchestra.run.smithi167.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 61 kB/s | 11 kB 00:00 2024-04-25T08:51:39.458 INFO:teuthology.orchestra.run.smithi167.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-04-25T08:51:39.500 INFO:teuthology.orchestra.run.smithi167.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-04-25T08:51:39.525 INFO:teuthology.orchestra.run.smithi167.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-04-25T08:51:39.527 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-25T08:51:39.527 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-25T08:51:39.550 INFO:teuthology.orchestra.run.smithi167.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-04-25T08:51:39.643 INFO:teuthology.orchestra.run.smithi167.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-04-25T08:51:39.676 INFO:teuthology.orchestra.run.smithi167.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 308 kB/s | 46 kB 00:00 2024-04-25T08:51:39.727 INFO:teuthology.orchestra.run.smithi167.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 448 kB/s | 79 kB 00:00 2024-04-25T08:51:39.760 INFO:teuthology.orchestra.run.smithi167.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 491 kB/s | 58 kB 00:00 2024-04-25T08:51:39.827 INFO:teuthology.orchestra.run.smithi167.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-04-25T08:51:39.869 INFO:teuthology.orchestra.run.smithi167.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 115 kB/s | 16 kB 00:00 2024-04-25T08:51:39.928 INFO:teuthology.orchestra.run.smithi167.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 538 kB/s | 90 kB 00:00 2024-04-25T08:51:39.953 INFO:teuthology.orchestra.run.smithi167.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 225 kB/s | 28 kB 00:00 2024-04-25T08:51:39.978 INFO:teuthology.orchestra.run.smithi167.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 283 kB/s | 31 kB 00:00 2024-04-25T08:51:40.003 INFO:teuthology.orchestra.run.smithi167.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T08:51:40.087 INFO:teuthology.orchestra.run.smithi167.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 547 kB/s | 59 kB 00:00 2024-04-25T08:51:40.129 INFO:teuthology.orchestra.run.smithi167.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 238 kB/s | 36 kB 00:00 2024-04-25T08:51:40.154 INFO:teuthology.orchestra.run.smithi167.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 338 kB/s | 51 kB 00:00 2024-04-25T08:51:40.188 INFO:teuthology.orchestra.run.smithi167.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-25T08:51:40.213 INFO:teuthology.orchestra.run.smithi167.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-25T08:51:40.239 INFO:teuthology.orchestra.run.smithi167.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-25T08:51:40.264 INFO:teuthology.orchestra.run.smithi167.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 269 kB/s | 20 kB 00:00 2024-04-25T08:51:40.339 INFO:teuthology.orchestra.run.smithi167.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-25T08:51:40.398 INFO:teuthology.orchestra.run.smithi167.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-04-25T08:51:40.690 INFO:teuthology.orchestra.run.smithi167.stdout:(149/152): librbd1-19.0.0-1628.g97ae6cc9.el9.x8 9.0 MB/s | 3.1 MB 00:00 2024-04-25T08:51:40.740 INFO:teuthology.orchestra.run.smithi167.stdout:(150/152): librados2-19.0.0-1628.g97ae6cc9.el9. 7.1 MB/s | 3.4 MB 00:00 2024-04-25T08:51:40.881 INFO:teuthology.orchestra.run.smithi167.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 2.8 MB/s | 1.3 MB 00:00 2024-04-25T08:51:41.315 INFO:teuthology.orchestra.run.smithi167.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 3.8 MB/s | 2.4 MB 00:00 2024-04-25T08:51:41.320 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:51:41.320 INFO:teuthology.orchestra.run.smithi167.stdout:Total 9.5 MB/s | 215 MB 00:22 2024-04-25T08:51:41.362 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-25T08:51:41.363 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-25T08:51:42.430 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-04-25T08:51:42.573 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-04-25T08:51:42.573 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-04-25T08:51:44.303 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-04-25T08:51:44.303 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-04-25T08:51:47.513 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-25T08:51:47.609 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T08:51:47.649 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T08:51:47.702 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T08:51:47.744 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T08:51:47.769 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T08:51:47.805 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T08:51:48.155 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T08:51:48.270 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:51:48.395 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:51:48.421 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:51:48.505 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:51:48.533 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:51:48.697 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T08:51:48.832 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T08:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:51:48.956 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:51:48.985 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:51:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:51:49.069 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:51:49.094 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:51:49.287 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:51:49.319 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:51:49.430 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T08:51:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T08:51:49.560 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T08:51:49.604 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T08:51:49.680 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T08:51:49.719 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T08:51:49.763 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T08:51:49.795 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T08:51:49.823 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T08:51:49.896 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T08:51:49.947 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T08:51:49.984 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T08:51:50.028 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T08:51:50.106 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T08:51:50.147 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 31/156 2024-04-25T08:51:50.191 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 32/156 2024-04-25T08:51:50.201 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-04-25T08:51:50.227 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 33/156 2024-04-25T08:51:50.302 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T08:51:50.319 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T08:51:50.351 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T08:51:50.430 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T08:51:50.534 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T08:51:50.585 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T08:51:50.588 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T08:51:50.629 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T08:51:50.646 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T08:51:50.654 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T08:51:50.698 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T08:51:51.025 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T08:51:51.130 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:51:51.218 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T08:51:51.252 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:51:51.281 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:51:51.318 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T08:51:51.353 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T08:51:51.372 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:51:51.396 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T08:51:51.410 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:51:51.434 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 43/156 2024-04-25T08:51:51.476 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T08:51:51.558 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T08:51:51.607 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T08:51:51.636 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:51:51.650 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T08:51:51.704 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T08:51:51.739 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:51:51.760 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T08:51:51.761 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:51:51.824 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:51:51.835 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T08:51:51.846 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:51:51.865 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:51:51.871 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T08:51:51.908 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T08:51:51.955 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T08:51:51.991 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T08:51:52.034 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T08:51:52.062 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:51:52.085 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T08:51:52.095 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:51:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T08:51:52.231 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T08:51:52.282 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T08:51:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T08:51:52.354 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T08:51:52.376 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T08:51:52.412 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T08:51:52.447 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T08:51:52.452 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T08:51:52.486 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T08:51:52.518 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T08:51:52.521 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T08:51:52.552 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T08:51:52.571 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T08:51:52.576 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T08:51:52.616 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T08:51:52.647 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T08:51:52.656 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T08:51:52.684 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T08:51:52.754 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T08:51:52.793 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T08:51:52.806 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T08:51:52.836 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T08:51:52.881 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T08:51:52.957 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T08:51:53.000 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 31/156 2024-04-25T08:51:53.018 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T08:51:53.035 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 32/156 2024-04-25T08:51:53.054 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T08:51:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 33/156 2024-04-25T08:51:53.089 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T08:51:53.129 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T08:51:53.132 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T08:51:53.169 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T08:51:53.178 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T08:51:53.198 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T08:51:53.233 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T08:51:53.252 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T08:51:53.266 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T08:51:53.309 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T08:51:53.342 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T08:51:53.385 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T08:51:53.439 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T08:51:53.439 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T08:51:53.490 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T08:51:53.545 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T08:51:53.594 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T08:51:53.707 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T08:51:53.756 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T08:51:53.965 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T08:51:54.043 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T08:51:54.072 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T08:51:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T08:51:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 43/156 2024-04-25T08:51:54.194 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T08:51:54.365 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T08:51:54.423 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T08:51:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T08:51:54.543 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T08:51:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T08:51:54.581 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T08:51:54.593 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T08:51:54.618 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T08:51:54.627 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T08:51:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T08:51:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T08:51:54.734 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T08:51:54.744 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T08:51:54.786 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T08:51:54.786 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T08:51:54.888 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T08:51:54.923 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T08:51:54.937 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T08:51:54.967 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T08:51:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T08:51:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T08:51:55.123 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T08:51:55.132 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T08:51:55.151 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T08:51:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T08:51:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T08:51:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T08:51:55.231 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T08:51:55.255 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T08:51:55.322 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T08:51:55.448 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T08:51:55.487 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T08:51:55.515 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T08:51:55.550 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T08:51:55.589 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T08:51:55.620 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T08:51:55.650 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T08:51:55.685 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T08:51:55.719 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T08:51:55.760 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T08:51:55.803 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T08:51:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T08:51:55.924 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T08:51:55.933 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T08:51:55.964 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T08:51:56.011 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T08:51:56.046 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T08:51:56.109 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T08:51:56.167 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T08:51:56.885 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T08:51:56.930 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T08:51:56.964 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T08:51:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T08:51:57.146 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T08:51:57.233 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T08:51:57.266 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T08:51:57.361 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T08:51:57.440 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T08:51:57.444 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T08:51:57.468 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T08:51:57.472 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T08:51:57.501 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T08:51:57.550 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T08:51:57.829 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T08:51:57.863 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:51:57.955 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:51:57.984 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 100/156 2024-04-25T08:51:58.021 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T08:51:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T08:51:58.312 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T08:51:58.499 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T08:51:58.532 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:51:58.596 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:51:58.626 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 104/156 2024-04-25T08:51:59.534 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T08:51:59.772 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T08:51:59.960 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T08:51:59.989 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T08:52:00.300 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T08:52:00.351 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:52:00.441 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:52:00.473 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 100/156 2024-04-25T08:52:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T08:52:00.872 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:52:00.914 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:52:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T08:52:00.996 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:52:01.108 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:52:01.131 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 104/156 2024-04-25T08:52:01.485 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:52:01.526 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:52:01.620 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:52:01.620 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T08:52:01.620 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T08:52:01.620 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:01.652 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:52:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:52:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:52:03.846 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:52:03.890 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:52:03.978 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:52:03.978 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T08:52:03.981 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T08:52:03.982 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:04.008 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:52:13.552 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:52:13.553 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /sys 2024-04-25T08:52:13.553 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /proc 2024-04-25T08:52:13.553 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /mnt 2024-04-25T08:52:13.553 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /var/tmp 2024-04-25T08:52:13.553 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /home 2024-04-25T08:52:13.553 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /root 2024-04-25T08:52:13.553 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /tmp 2024-04-25T08:52:13.553 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:13.724 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:52:13.740 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:52:13.740 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:13.740 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T08:52:13.741 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:15.269 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:52:15.296 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:52:15.296 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:15.296 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T08:52:15.296 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:52:15.296 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:52:15.296 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:15.511 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:52:15.534 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:52:15.534 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:15.535 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T08:52:15.535 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:52:15.535 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:52:15.535 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:15.668 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:52:15.668 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2024-04-25T08:52:15.669 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2024-04-25T08:52:15.669 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2024-04-25T08:52:15.669 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2024-04-25T08:52:15.669 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2024-04-25T08:52:15.669 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2024-04-25T08:52:15.669 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2024-04-25T08:52:15.669 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:15.839 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:52:15.854 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:52:15.855 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:15.855 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T08:52:15.855 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:16.003 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:52:16.027 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:52:16.027 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:16.028 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T08:52:16.028 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:52:16.028 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:52:16.028 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:16.143 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T08:52:16.202 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T08:52:16.265 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T08:52:16.463 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T08:52:16.514 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T08:52:16.596 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T08:52:16.694 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:52:16.839 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:52:16.888 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T08:52:16.920 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T08:52:16.947 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T08:52:17.334 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:52:17.359 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:52:17.359 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:17.359 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T08:52:17.359 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:52:17.359 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:52:17.359 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:17.419 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:52:17.446 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:52:17.478 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 124/156 2024-04-25T08:52:17.543 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 125/156 2024-04-25T08:52:17.559 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:52:17.569 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:52:17.581 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:52:17.590 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:17.590 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T08:52:17.590 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:52:17.590 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:52:17.590 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:17.813 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:52:17.853 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:52:18.035 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:52:18.057 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:52:18.057 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:18.058 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T08:52:18.058 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:52:18.058 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:52:18.058 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:18.166 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T08:52:18.222 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T08:52:18.278 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T08:52:18.463 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T08:52:18.519 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T08:52:18.597 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T08:52:18.686 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:52:18.819 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:52:18.868 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:52:18.870 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T08:52:18.901 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T08:52:18.903 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:52:18.930 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T08:52:19.012 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:52:19.182 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 129/156 2024-04-25T08:52:19.214 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:52:19.238 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:52:19.238 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:19.238 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T08:52:19.238 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:52:19.238 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:52:19.238 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:19.289 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:52:19.300 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:52:19.305 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:52:19.336 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:52:19.368 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 124/156 2024-04-25T08:52:19.402 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 132/156 2024-04-25T08:52:19.428 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 125/156 2024-04-25T08:52:19.451 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:52:19.456 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 133/156 2024-04-25T08:52:19.679 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:52:19.711 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:52:20.367 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T08:52:20.430 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:52:20.454 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:52:20.454 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:20.454 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T08:52:20.454 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:52:20.454 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:52:20.454 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:20.493 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:52:20.516 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:52:20.516 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:20.516 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T08:52:20.517 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:20.569 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:52:20.592 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:52:20.592 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:20.593 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T08:52:20.593 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:52:20.593 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:52:20.593 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:20.670 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:52:20.694 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:52:20.796 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:52:20.911 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:52:20.934 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:52:20.935 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:20.935 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T08:52:20.935 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:52:20.935 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:52:20.935 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 129/156 2024-04-25T08:52:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:52:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:52:21.011 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:21.012 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T08:52:21.012 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:52:21.012 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:52:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:21.055 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:52:21.066 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:52:21.165 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 132/156 2024-04-25T08:52:21.213 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 133/156 2024-04-25T08:52:22.064 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T08:52:22.091 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:52:22.114 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:52:22.114 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:22.114 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T08:52:22.114 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:52:22.114 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:52:22.114 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:22.159 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:52:22.181 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:52:22.181 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:22.181 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T08:52:22.181 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:22.226 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:52:22.248 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:52:22.248 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:22.248 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T08:52:22.248 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:52:22.248 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:52:22.248 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:52:22.585 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:52:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:52:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T08:52:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:52:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:52:22.585 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:25.614 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 139/156 2024-04-25T08:52:25.656 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 140/156 2024-04-25T08:52:25.698 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 141/156 2024-04-25T08:52:25.729 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T08:52:25.756 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T08:52:25.954 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 144/156 2024-04-25T08:52:26.002 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T08:52:26.024 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 146/156 2024-04-25T08:52:26.658 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:52:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:52:26.718 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:52:26.990 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 139/156 2024-04-25T08:52:27.031 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 140/156 2024-04-25T08:52:27.072 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 141/156 2024-04-25T08:52:27.106 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T08:52:27.132 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T08:52:27.314 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 144/156 2024-04-25T08:52:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T08:52:27.400 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 146/156 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 148/156 2024-04-25T08:52:27.735 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T08:52:27.778 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T08:52:27.874 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T08:52:27.955 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T08:52:27.956 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:52:28.023 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:52:28.039 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:52:28.042 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:52:28.081 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:52:28.081 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:52:28.170 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:52:28.241 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:52:28.884 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 148/156 2024-04-25T08:52:28.969 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T08:52:29.010 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T08:52:29.099 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T08:52:29.143 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T08:52:29.143 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:52:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:52:29.257 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:52:29.257 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:52:29.349 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:52:29.438 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:52:33.463 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 1/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 3/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 4/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 5/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 6/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 7/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 11/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 12/156 2024-04-25T08:52:33.464 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 14/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 15/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 16/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 17/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 18/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 19/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 20/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 21/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 22/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 23/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 24/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 25/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 26/156 2024-04-25T08:52:33.465 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 27/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 28/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 29/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 30/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 31/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 32/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 33/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 34/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 35/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 36/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 37/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 38/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 39/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T08:52:33.466 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T08:52:33.467 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T08:52:33.468 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T08:52:33.469 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T08:52:33.471 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:52:33.472 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T08:52:33.473 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T08:52:33.474 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T08:52:33.475 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 149/156 2024-04-25T08:52:33.475 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T08:52:33.475 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 151/156 2024-04-25T08:52:33.475 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T08:52:33.475 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T08:52:33.475 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:52:33.475 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T08:52:34.756 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:52:34.756 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 1/156 2024-04-25T08:52:34.756 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2/156 2024-04-25T08:52:34.756 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 3/156 2024-04-25T08:52:34.756 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 4/156 2024-04-25T08:52:34.756 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 5/156 2024-04-25T08:52:34.756 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 6/156 2024-04-25T08:52:34.756 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 7/156 2024-04-25T08:52:34.756 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 11/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 12/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 14/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 15/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 16/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 17/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 18/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 19/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 20/156 2024-04-25T08:52:34.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 21/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 22/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 23/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 24/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 25/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 26/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 27/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 28/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 29/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 30/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 31/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 32/156 2024-04-25T08:52:34.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 33/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 34/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 35/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 36/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 37/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 38/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 39/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T08:52:34.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T08:52:34.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T08:52:34.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T08:52:34.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T08:52:34.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 149/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 151/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:52:34.768 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T08:52:35.624 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout:Upgraded: 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T08:52:35.625 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:35.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T08:52:35.627 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T08:52:35.628 INFO:teuthology.orchestra.run.smithi055.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T08:52:35.629 INFO:teuthology.orchestra.run.smithi055.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T08:52:35.630 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T08:52:35.631 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T08:52:35.632 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T08:52:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T08:52:35.634 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T08:52:35.635 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T08:52:35.636 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T08:52:35.637 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T08:52:35.637 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:35.637 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-25T08:52:36.009 DEBUG:teuthology.parallel:result is None 2024-04-25T08:52:36.931 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:52:36.931 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:36.931 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-04-25T08:52:36.931 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.931 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.931 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T08:52:36.931 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T08:52:36.931 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-04-25T08:52:36.931 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.934 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T08:52:36.935 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T08:52:36.936 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T08:52:36.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T08:52:36.938 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T08:52:36.941 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T08:52:36.943 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:36.943 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-04-25T08:52:37.322 DEBUG:teuthology.parallel:result is None 2024-04-25T08:52:37.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:52:37.510 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T08:52:37.531 INFO:teuthology.orchestra.run.smithi055.stdout:19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:52:37.532 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:52:37.532 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628.g97ae6cc9 is installed. 2024-04-25T08:52:37.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:52:37.670 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T08:52:37.691 INFO:teuthology.orchestra.run.smithi167.stdout:19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:52:37.691 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:52:37.691 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628.g97ae6cc9 is installed. 2024-04-25T08:52:37.693 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T08:52:37.693 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:52:37.693 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T08:52:37.720 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:52:37.720 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T08:52:37.757 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T08:52:37.757 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:52:37.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T08:52:37.784 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T08:52:37.851 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:52:37.852 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T08:52:37.875 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T08:52:37.940 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T08:52:37.940 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:52:37.940 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T08:52:37.964 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T08:52:38.029 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:52:38.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T08:52:38.052 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T08:52:38.116 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T08:52:38.116 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:52:38.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T08:52:38.140 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T08:52:38.204 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:52:38.205 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T08:52:38.228 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T08:52:38.292 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T08:52:38.412 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T08:52:38.412 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /var/log/ceph 2024-04-25T08:52:38.415 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2024-04-25T08:52:38.438 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T08:52:38.439 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T08:52:38.480 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T08:52:38.504 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T08:52:38.504 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T08:52:38.545 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T08:52:38.577 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T08:52:38.578 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T08:52:38.578 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T08:52:38.578 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:52:38.578 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T08:52:38.623 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T08:52:38.737 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T08:52:38.761 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:52:38.761 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T08:52:38.776 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T08:52:38.885 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T08:52:38.914 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T08:52:38.914 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T08:52:38.914 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001', 'branch': 'wip-neesingh-testing-240416', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7673001', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-240416'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62537', 'sha1': '5787d42d10024ba410e822a8aba474331cb9af02'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5869, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-62537', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': '5787d42d10024ba410e822a8aba474331cb9af02', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi055.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLGVDBpqRGFbAl5fWAowyfq25cFVRSfAW1MVqaac06lmP8c5mBCfEOVMHBW9z1tbhJWDLg086BLHaTVcdC0yjCk=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuz4ZIFqnsr6K+0Mcq//lLrNEy0GLw+x3ZJdUqVt3u5hYPcPRV7E4zKY5QGfUPJ6NPo8Xd7iVHLlwBQacC9LlI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_08:15:18', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T08:52:38.915 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T08:52:38.918 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T08:52:38.964 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T08:52:38.973 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T08:52:39.028 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:52:39.028 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T08:52:39.052 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T08:52:39.052 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2024-04-25T08:52:39.107 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T08:52:39.107 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:52:39.107 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T08:52:39.107 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:52:39.107 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:52:39.107 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-25 08:52:28.629442496 +0000 2024-04-25T08:52:39.107 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-25 08:50:37.436934887 +0000 2024-04-25T08:52:39.108 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-25 08:50:37.436934887 +0000 2024-04-25T08:52:39.108 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-25 08:50:37.436934887 +0000 2024-04-25T08:52:39.108 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T08:52:39.170 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-25T08:52:39.170 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-25T08:52:39.170 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000292847 s, 1.7 MB/s 2024-04-25T08:52:39.171 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T08:52:39.228 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2024-04-25T08:52:39.284 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T08:52:39.284 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:52:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-25T08:52:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:52:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:52:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-25 08:52:28.630442476 +0000 2024-04-25T08:52:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-25 08:50:37.795927210 +0000 2024-04-25T08:52:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-25 08:50:37.795927210 +0000 2024-04-25T08:52:39.285 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-25 08:50:37.795927210 +0000 2024-04-25T08:52:39.285 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T08:52:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-25T08:52:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-25T08:52:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000275037 s, 1.9 MB/s 2024-04-25T08:52:39.349 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T08:52:39.405 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2024-04-25T08:52:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T08:52:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:52:39.461 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T08:52:39.461 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:52:39.461 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:52:39.461 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-25 08:52:28.630442476 +0000 2024-04-25T08:52:39.461 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-25 08:50:38.147919683 +0000 2024-04-25T08:52:39.461 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-25 08:50:38.147919683 +0000 2024-04-25T08:52:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-25 08:50:38.147919683 +0000 2024-04-25T08:52:39.462 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T08:52:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-25T08:52:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-25T08:52:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000276497 s, 1.9 MB/s 2024-04-25T08:52:39.524 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T08:52:39.580 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2024-04-25T08:52:39.636 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T08:52:39.636 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:52:39.636 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T08:52:39.636 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:52:39.636 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:52:39.637 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-25 08:52:28.630442476 +0000 2024-04-25T08:52:39.637 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-25 08:50:38.478912605 +0000 2024-04-25T08:52:39.637 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-25 08:50:38.478912605 +0000 2024-04-25T08:52:39.637 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-25 08:50:38.478912605 +0000 2024-04-25T08:52:39.637 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T08:52:39.698 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-25T08:52:39.698 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-25T08:52:39.698 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000289842 s, 1.8 MB/s 2024-04-25T08:52:39.700 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T08:52:39.756 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:52:39.756 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:52:39.756 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T08:52:39.772 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T08:52:39.772 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-04-25T08:52:39.828 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T08:52:39.828 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:52:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T08:52:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:52:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:52:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-25 08:52:29.798523330 +0000 2024-04-25T08:52:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-25 08:50:33.768962687 +0000 2024-04-25T08:52:39.829 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-25 08:50:33.768962687 +0000 2024-04-25T08:52:39.829 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-25 08:50:33.768962687 +0000 2024-04-25T08:52:39.829 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T08:52:39.891 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-25T08:52:39.891 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-25T08:52:39.891 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000208983 s, 2.4 MB/s 2024-04-25T08:52:39.893 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T08:52:39.948 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-04-25T08:52:40.003 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T08:52:40.003 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:52:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-25T08:52:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:52:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:52:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-25 08:52:29.798523330 +0000 2024-04-25T08:52:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-25 08:50:34.105956281 +0000 2024-04-25T08:52:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-25 08:50:34.105956281 +0000 2024-04-25T08:52:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-25 08:50:34.105956281 +0000 2024-04-25T08:52:40.004 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T08:52:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-25T08:52:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-25T08:52:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000213649 s, 2.4 MB/s 2024-04-25T08:52:40.067 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T08:52:40.123 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-04-25T08:52:40.178 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T08:52:40.178 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:52:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T08:52:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:52:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:52:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-25 08:52:29.799523313 +0000 2024-04-25T08:52:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-25 08:50:34.446949799 +0000 2024-04-25T08:52:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-25 08:50:34.446949799 +0000 2024-04-25T08:52:40.178 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-25 08:50:34.446949799 +0000 2024-04-25T08:52:40.179 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T08:52:40.240 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-25T08:52:40.240 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-25T08:52:40.240 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000224083 s, 2.3 MB/s 2024-04-25T08:52:40.241 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T08:52:40.296 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-04-25T08:52:40.351 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T08:52:40.351 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:52:40.351 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T08:52:40.351 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:52:40.351 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:52:40.351 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-25 08:52:29.799523313 +0000 2024-04-25T08:52:40.351 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-25 08:50:34.776943526 +0000 2024-04-25T08:52:40.352 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-25 08:50:34.776943526 +0000 2024-04-25T08:52:40.352 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-25 08:50:34.776943526 +0000 2024-04-25T08:52:40.352 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T08:52:40.413 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-25T08:52:40.414 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-25T08:52:40.414 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000257858 s, 2.0 MB/s 2024-04-25T08:52:40.415 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T08:52:40.470 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:52:40.471 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T08:52:40.471 INFO:tasks.ceph:Generating config... 2024-04-25T08:52:40.472 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T08:52:40.472 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T08:52:40.472 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T08:52:40.472 INFO:tasks.ceph:[client] pid file = 2024-04-25T08:52:40.472 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T08:52:40.472 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T08:52:40.472 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T08:52:40.472 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T08:52:40.473 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T08:52:40.474 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T08:52:40.475 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T08:52:40.475 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T08:52:40.475 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T08:52:40.475 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T08:52:40.528 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T08:52:40.531 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T08:52:40.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T08:52:40.601 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.55'), ('mon.b', '172.21.15.167'), ('mon.c', '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]')] 2024-04-25T08:52:40.601 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.55,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T08:52:40.602 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:52:40.602 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T08:52:40.657 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.55 --add b 172.21.15.167 --addv c '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:52:40.743 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:52:40.743 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: generated fsid c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T08:52:40.744 INFO:teuthology.orchestra.run.smithi055.stdout:setting min_mon_release = quincy 2024-04-25T08:52:40.744 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 0 2024-04-25T08:52:40.744 INFO:teuthology.orchestra.run.smithi055.stdout:fsid c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T08:52:40.744 INFO:teuthology.orchestra.run.smithi055.stdout:last_changed 2024-04-25T08:52:40.754584+0000 2024-04-25T08:52:40.744 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-25T08:52:40.754584+0000 2024-04-25T08:52:40.744 INFO:teuthology.orchestra.run.smithi055.stdout:min_mon_release 17 (quincy) 2024-04-25T08:52:40.744 INFO:teuthology.orchestra.run.smithi055.stdout:election_strategy: 1 2024-04-25T08:52:40.744 INFO:teuthology.orchestra.run.smithi055.stdout:0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.a 2024-04-25T08:52:40.744 INFO:teuthology.orchestra.run.smithi055.stdout:1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-04-25T08:52:40.744 INFO:teuthology.orchestra.run.smithi055.stdout:2: [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] mon.c 2024-04-25T08:52:40.744 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T08:52:40.745 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T08:52:40.760 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c39ac909-02b8-4b68-9f8d-b272de9b1a7b... 2024-04-25T08:52:40.761 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T08:52:40.802 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T08:52:40.842 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-25T08:52:40.843 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-25T08:52:40.844 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-25T08:52:40.845 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.846 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.847 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-25T08:52:40.848 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-04-25T08:52:40.849 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T08:52:40.849 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-25T08:52:40.849 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-25T08:52:40.849 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-25T08:52:40.849 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-25T08:52:40.849 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T08:52:40.849 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.849 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-25T08:52:40.849 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T08:52:40.849 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-25T08:52:40.849 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T08:52:40.850 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T08:52:40.850 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:52:40.850 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:52:40.850 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-25T08:52:40.850 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.850 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-25T08:52:40.850 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T08:52:40.850 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T08:52:40.850 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-25T08:52:40.850 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T08:52:40.851 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-25T08:52:40.851 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-25T08:52:40.851 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:52:40.851 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-25T08:52:40.851 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-25T08:52:40.852 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-25T08:52:40.853 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T08:52:40.854 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T08:52:40.855 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T08:52:40.862 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-04-25T08:52:40.862 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-04-25T08:52:40.862 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T08:52:40.862 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-04-25T08:52:40.862 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.862 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-04-25T08:52:40.862 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.863 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.864 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.55,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-04-25T08:52:40.865 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-04-25T08:52:40.866 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: bdev async discard = True 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: bdev enable discard = True 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore allocator = bitmap 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-04-25T08:52:40.867 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 1/20 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 1/20 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 4/10 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-04-25T08:52:40.868 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-04-25T08:52:40.869 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-04-25T08:52:40.870 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2024-04-25T08:52:40.871 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T08:52:40.872 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T08:52:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-04-25T08:52:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-04-25T08:52:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-04-25T08:52:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T08:52:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T08:52:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T08:52:40.873 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T08:52:40.874 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T08:52:40.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T08:52:40.950 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T08:52:40.950 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:52:40.950 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T08:52:40.966 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:52:40.966 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T08:52:41.022 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:52:41.022 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:52:41.022 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T08:52:41.023 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T08:52:41.095 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:52:41.096 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:52:41.151 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T08:52:41.151 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:52:41.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T08:52:41.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T08:52:41.183 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:52:41.184 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:52:41.238 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T08:52:41.238 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T08:52:41.238 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T08:52:41.288 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T08:52:41.291 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T08:52:41.345 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T08:52:41.348 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T08:52:41.348 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T08:52:41.397 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T08:52:41.400 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T08:52:41.424 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T08:52:41.514 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T08:52:41.516 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T08:52:41.540 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T08:52:41.589 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T08:52:41.592 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T08:52:41.615 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T08:52:41.703 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T08:52:41.705 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T08:52:41.728 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T08:52:41.729 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T08:52:41.769 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T08:52:41.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T08:52:41.861 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T08:52:41.874 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T08:52:41.912 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T08:52:41.924 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T08:52:42.004 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T08:52:42.016 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T08:52:42.016 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T08:52:42.016 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T08:52:42.041 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:52:42.041 INFO:tasks.ceph:role: osd.0 2024-04-25T08:52:42.041 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:52:42.041 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T08:52:42.133 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:52:42.133 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:52:42.133 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:52:42.133 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:52:42.133 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:52:42.133 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:52:42.133 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:52:42.133 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:52:42.133 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:52:42.133 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:52:43.462 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-25T08:52:43.465 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-25T08:52:43.465 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T08:52:43.511 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T08:52:43.583 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T08:52:43.650 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:52:43.650 INFO:tasks.ceph:role: osd.1 2024-04-25T08:52:43.651 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:52:43.651 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T08:52:43.747 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:52:43.747 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:52:43.747 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:52:43.747 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:52:43.747 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:52:43.747 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:52:43.747 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:52:43.748 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:52:43.748 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:52:43.748 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:52:45.075 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-25T08:52:45.077 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-25T08:52:45.078 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T08:52:45.114 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T08:52:45.183 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T08:52:45.248 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:52:45.248 INFO:tasks.ceph:role: osd.2 2024-04-25T08:52:45.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:52:45.248 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T08:52:45.340 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:52:45.340 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:52:45.340 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:52:45.340 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:52:45.340 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:52:45.340 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:52:45.341 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:52:45.341 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:52:45.341 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:52:45.341 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:52:46.659 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-25T08:52:46.661 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-25T08:52:46.661 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T08:52:46.697 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T08:52:46.770 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T08:52:46.837 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:52:46.837 INFO:tasks.ceph:role: osd.3 2024-04-25T08:52:46.837 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:52:46.837 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T08:52:46.932 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:52:46.932 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:52:46.932 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:52:46.933 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:52:46.933 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:52:46.933 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:52:46.933 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:52:46.933 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:52:46.933 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:52:46.933 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:52:48.281 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-25T08:52:48.283 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-25T08:52:48.283 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T08:52:48.318 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T08:52:48.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:52:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:48.497+0000 7f42aebbe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T08:52:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:48.497+0000 7f42aebbe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T08:52:48.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:48.497+0000 7f42aebbe640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T08:52:48.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:48.497+0000 7f42aebbe640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T08:52:48.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:48.497+0000 7f42aebbe640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T08:52:48.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:48.498+0000 7f42aebbe640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T08:52:51.358 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T08:52:51.387 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:52:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:51.487+0000 7f92c7814640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T08:52:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:51.488+0000 7f92c7814640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T08:52:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:51.488+0000 7f92c7814640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T08:52:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:51.488+0000 7f92c7814640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T08:52:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:51.488+0000 7f92c7814640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T08:52:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:51.488+0000 7f92c7814640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T08:52:54.350 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T08:52:54.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:52:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:54.478+0000 7fd713b53640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T08:52:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:54.478+0000 7fd713b53640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T08:52:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:54.478+0000 7fd713b53640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T08:52:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:54.478+0000 7fd713b53640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T08:52:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:54.478+0000 7fd713b53640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T08:52:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:54.479+0000 7fd713b53640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T08:52:57.347 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T08:52:57.376 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:52:57.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:57.476+0000 7f3b62e32640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T08:52:57.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:57.476+0000 7f3b62e32640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T08:52:57.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:57.476+0000 7f3b62e32640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T08:52:57.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:57.476+0000 7f3b62e32640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T08:52:57.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:57.476+0000 7f3b62e32640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T08:52:57.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:52:57.477+0000 7f3b62e32640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T08:53:00.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T08:53:00.370 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T08:53:00.399 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:53:00.399 INFO:tasks.ceph:role: osd.4 2024-04-25T08:53:00.399 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T08:53:00.399 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T08:53:00.475 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:53:00.475 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:53:00.475 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:53:00.475 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:53:00.475 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:53:00.475 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:53:00.475 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:53:00.476 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:53:00.476 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:53:00.476 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:53:00.983 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-04-25T08:53:00.985 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-04-25T08:53:00.985 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T08:53:01.121 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T08:53:01.152 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T08:53:01.216 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:53:01.216 INFO:tasks.ceph:role: osd.5 2024-04-25T08:53:01.216 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T08:53:01.216 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T08:53:01.287 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:53:01.287 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:53:01.287 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:53:01.287 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:53:01.287 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:53:01.287 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:53:01.287 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:53:01.287 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:53:01.287 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:53:01.287 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:53:01.735 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-04-25T08:53:01.737 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-04-25T08:53:01.737 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T08:53:01.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T08:53:01.888 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T08:53:01.951 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:53:01.951 INFO:tasks.ceph:role: osd.6 2024-04-25T08:53:01.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T08:53:01.952 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T08:53:02.022 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:53:02.022 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:53:02.023 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:53:02.023 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:53:02.023 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:53:02.023 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:53:02.023 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:53:02.023 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:53:02.023 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:53:02.023 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:53:02.521 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-04-25T08:53:02.523 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-04-25T08:53:02.523 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T08:53:02.636 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T08:53:02.665 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T08:53:02.730 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:53:02.730 INFO:tasks.ceph:role: osd.7 2024-04-25T08:53:02.730 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T08:53:02.730 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T08:53:02.802 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:53:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:53:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:53:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:53:02.802 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:53:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:53:02.802 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:53:02.802 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:53:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:53:02.803 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:53:03.300 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-04-25T08:53:03.303 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-04-25T08:53:03.303 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T08:53:03.432 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T08:53:03.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:53:03.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:03.565+0000 7f14f20f0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T08:53:03.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:03.565+0000 7f14f20f0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T08:53:03.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:03.565+0000 7f14f20f0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T08:53:03.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:03.565+0000 7f14f20f0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T08:53:03.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:03.565+0000 7f14f20f0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T08:53:03.556 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:03.566+0000 7f14f20f0640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T08:53:06.407 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T08:53:06.436 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:53:06.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:06.533+0000 7f675dd33640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T08:53:06.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:06.533+0000 7f675dd33640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T08:53:06.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:06.533+0000 7f675dd33640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T08:53:06.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:06.533+0000 7f675dd33640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T08:53:06.524 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:06.533+0000 7f675dd33640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T08:53:06.525 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:06.534+0000 7f675dd33640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T08:53:08.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:53:08.919 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:53:09.370 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T08:53:09.396 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:53:09.482 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:09.491+0000 7f7795814640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T08:53:09.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:09.492+0000 7f7795814640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T08:53:09.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:09.492+0000 7f7795814640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T08:53:09.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:09.492+0000 7f7795814640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T08:53:09.483 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:09.492+0000 7f7795814640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T08:53:09.484 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:09.492+0000 7f7795814640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T08:53:12.338 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T08:53:12.363 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:53:12.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:12.456+0000 7fb088015640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T08:53:12.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:12.457+0000 7fb088015640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T08:53:12.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:12.457+0000 7fb088015640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T08:53:12.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:12.457+0000 7fb088015640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T08:53:12.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:12.457+0000 7fb088015640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T08:53:12.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:12.457+0000 7fb088015640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T08:53:15.296 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T08:53:15.365 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T08:53:15.365 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:15.366 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T08:53:15.395 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:15.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T08:53:15.465 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:15.465 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T08:53:15.534 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:15.534 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T08:53:15.601 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:15.601 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T08:53:15.668 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:15.668 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T08:53:15.734 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:15.734 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T08:53:15.800 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:15.800 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T08:53:15.828 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:15.829 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T08:53:15.896 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:15.897 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T08:53:15.963 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:15.963 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T08:53:16.028 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:16.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T08:53:16.094 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:16.094 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T08:53:16.159 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:16.159 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T08:53:16.224 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:16.224 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T08:53:16.242 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:16.242 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T08:53:16.301 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:16.301 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T08:53:16.317 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:16.317 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T08:53:16.372 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T08:53:16.372 DEBUG:teuthology.orchestra.run.smithi055:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T08:53:16.374 DEBUG:teuthology.orchestra.run.smithi167:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T08:53:16.415 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.y] 2024-04-25T08:53:16.415 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpm6NfaERAAtb5ZheEavSDdOCOxeM0a2Q== 2024-04-25T08:53:16.415 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T08:53:16.415 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpm4IxeGBAAwuzfw8fkgBWLS/OHkVRPdA== 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmcJlOHxAAWRBqx21VaZdp7n+bG6QdjA== 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.0] 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDgGSpmMDqwHRAAte7ZpF14thK4VEsC4getWg== 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.1] 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDjGSpm7bEhHRAALQKewGfpKljGFsW75+h/Dg== 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.2] 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDmGSpmjg2RHBAA+DxXqJHuPIGUsVvwUirEwg== 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.3] 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDpGSpmxft1HBAAsIYtKh97QF4WhdL9kI2QeA== 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.x] 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmk2Q/FRAAwGHbq7UsFI+OdwcBOqLnlA== 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T08:53:16.416 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmz17MIxAAOjfHLP2pVtyOH1KkaFBdpw== 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmbKyTKhAARg7pgR8TeZKNHV38FuAv+g== 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.4] 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDvGSpm4QDFIRAAlMSvRI/gNR4p8BgQdRUcBA== 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.5] 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDyGSpmARfiHxAABn3CWZTkyRxXpTUxKGi71A== 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.6] 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQD1GSpmLHBmHRAA4xXuyYK95pq8g+DAXREvKQ== 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.7] 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQD4GSpmMbpPGxAAP7YWBUzcafaowcZG1ZWhDA== 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw== 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout:[client.2] 2024-04-25T08:53:16.417 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmpD8INBAA29l06IV/RnM5qxOD6VL3MA== 2024-04-25T08:53:16.418 INFO:teuthology.orchestra.run.smithi055.stdout:[client.1] 2024-04-25T08:53:16.418 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmcP0TNxAA02w2xuYx7fMlMbZpgy53hQ== 2024-04-25T08:53:16.418 INFO:teuthology.orchestra.run.smithi055.stdout:[client.3] 2024-04-25T08:53:16.418 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDaGSpm8xftABAADCQqbD2gknLM2w+MV/H29A== 2024-04-25T08:53:16.434 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.y] 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDZGSpm6NfaERAAtb5ZheEavSDdOCOxeM0a2Q== 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDZGSpm4IxeGBAAwuzfw8fkgBWLS/OHkVRPdA== 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDZGSpmcJlOHxAAWRBqx21VaZdp7n+bG6QdjA== 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.0] 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDgGSpmMDqwHRAAte7ZpF14thK4VEsC4getWg== 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.1] 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDjGSpm7bEhHRAALQKewGfpKljGFsW75+h/Dg== 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.2] 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDmGSpmjg2RHBAA+DxXqJHuPIGUsVvwUirEwg== 2024-04-25T08:53:16.435 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.3] 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDpGSpmxft1HBAAsIYtKh97QF4WhdL9kI2QeA== 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.x] 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDZGSpmk2Q/FRAAwGHbq7UsFI+OdwcBOqLnlA== 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDZGSpmz17MIxAAOjfHLP2pVtyOH1KkaFBdpw== 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDZGSpmbKyTKhAARg7pgR8TeZKNHV38FuAv+g== 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.4] 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDvGSpm4QDFIRAAlMSvRI/gNR4p8BgQdRUcBA== 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.5] 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDyGSpmARfiHxAABn3CWZTkyRxXpTUxKGi71A== 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.6] 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD1GSpmLHBmHRAA4xXuyYK95pq8g+DAXREvKQ== 2024-04-25T08:53:16.436 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.7] 2024-04-25T08:53:16.437 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQD4GSpmMbpPGxAAP7YWBUzcafaowcZG1ZWhDA== 2024-04-25T08:53:16.437 INFO:teuthology.orchestra.run.smithi167.stdout:[client.0] 2024-04-25T08:53:16.437 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw== 2024-04-25T08:53:16.437 INFO:teuthology.orchestra.run.smithi167.stdout:[client.2] 2024-04-25T08:53:16.437 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDZGSpmpD8INBAA29l06IV/RnM5qxOD6VL3MA== 2024-04-25T08:53:16.437 INFO:teuthology.orchestra.run.smithi167.stdout:[client.1] 2024-04-25T08:53:16.437 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDZGSpmcP0TNxAA02w2xuYx7fMlMbZpgy53hQ== 2024-04-25T08:53:16.437 INFO:teuthology.orchestra.run.smithi167.stdout:[client.3] 2024-04-25T08:53:16.437 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDaGSpm8xftABAADCQqbD2gknLM2w+MV/H29A== 2024-04-25T08:53:16.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:53:16.461 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:53:16.528 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:53:16.530 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:53:16.583 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:53:16.585 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:53:16.638 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:16.640 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:16.689 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:16.691 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:16.739 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:16.741 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:16.789 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:16.791 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:16.840 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:53:16.842 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:53:16.890 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:53:16.893 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:53:16.944 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:53:16.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:53:16.998 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:17.001 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:17.050 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:17.052 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:17.101 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:17.103 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:17.153 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:17.155 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:53:17.204 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:53:17.206 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:53:17.257 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:53:17.260 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:53:17.311 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:53:17.313 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:53:17.364 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:53:17.368 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:53:17.420 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T08:53:17.420 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T08:53:17.444 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T08:53:17.545 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T08:53:17.569 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T08:53:17.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T08:53:17.687 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T08:53:17.711 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T08:53:17.774 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T08:53:17.867 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T08:53:17.891 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:53:17.893 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:53:17.946 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T08:53:17.946 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T08:53:17.946 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T08:53:17.949 INFO:tasks.ceph.mon.a:Started 2024-04-25T08:53:17.949 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T08:53:17.949 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T08:53:17.988 INFO:tasks.ceph.mon.b:Started 2024-04-25T08:53:17.989 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T08:53:17.989 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T08:53:17.991 INFO:tasks.ceph.mon.c:Started 2024-04-25T08:53:17.991 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T08:53:17.991 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T08:53:17.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T08:53:17.993 INFO:tasks.ceph.mgr.y:Started 2024-04-25T08:53:17.993 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T08:53:17.994 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T08:53:17.995 INFO:tasks.ceph.mgr.x:Started 2024-04-25T08:53:17.996 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T08:53:17.996 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T08:53:18.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.107+0000 7efd9e607640 1 Processor -- start 2024-04-25T08:53:18.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.107+0000 7efd9e607640 1 -- start start 2024-04-25T08:53:18.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9e607640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 0x7efd980cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9e607640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd980cee20 0x7efd980cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9e607640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd980cb350 con 0x7efd9815e040 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9e607640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd980ce9d0 con 0x7efd980cee20 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9e607640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd980cb5f0 con 0x7efd980ce410 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9cba4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd980cee20 0x7efd980cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9cba4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd980cee20 0x7efd980cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60568/0 (socket says 172.21.15.55:60568) 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9cba4640 1 -- 172.21.15.55:0/655088991 learned_addr learned my addr 172.21.15.55:0/655088991 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9cba4640 1 -- 172.21.15.55:0/655088991 >> v2:172.21.15.55:3300/0 conn(0x7efd980cee20 msgr2=0x7efd980cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9cba4640 1 -- 172.21.15.55:0/655088991 >> v2:172.21.15.55:3300/0 conn(0x7efd980cee20 msgr2=0x7efd980cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9cba4640 1 --2- 172.21.15.55:0/655088991 >> v2:172.21.15.55:3300/0 conn(0x7efd980cee20 0x7efd980cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd9cba4640 1 --2- 172.21.15.55:0/655088991 >> v2:172.21.15.55:3300/0 conn(0x7efd980cee20 0x7efd980cf2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.108+0000 7efd977fe640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 0x7efd980cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.109+0000 7efd977fe640 1 -- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 msgr2=0x7efd980cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.109+0000 7efd977fe640 1 -- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 msgr2=0x7efd980cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T08:53:18.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.109+0000 7efd977fe640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 0x7efd980cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T08:53:18.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.109+0000 7efd977fe640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 0x7efd980cc0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T08:53:18.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.280+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396202843 0 0) 0x7efd980cb350 con 0x7efd9815e040 2024-04-25T08:53:18.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.280+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd84003520 con 0x7efd9815e040 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2473475701 0 0) 0x7efd84003520 con 0x7efd9815e040 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 msgr2=0x7efd980cc0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 0x7efd980cc0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 >> v2:172.21.15.55:3300/0 conn(0x7efd980cee20 msgr2=0x7efd980cf2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 --2- 172.21.15.55:0/655088991 >> v2:172.21.15.55:3300/0 conn(0x7efd980cee20 0x7efd980cf2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd980cb8d0 con 0x7efd9815e040 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7efd80001670 con 0x7efd9815e040 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 >> v1:172.21.15.167:6789/0 conn(0x7efd9815e040 legacy=0x7efd980cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 0x7efd840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd84004030 0x7efd84004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd84004d40 0x7efd840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd980ce9d0 con 0x7efd84004d40 2024-04-25T08:53:18.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd980cb5f0 con 0x7efd84004030 2024-04-25T08:53:18.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.284+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8400bb20 con 0x7efd980ce410 2024-04-25T08:53:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.285+0000 7efd977fe640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd84004030 0x7efd84004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.285+0000 7efd9cba4640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd84004d40 0x7efd840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.285+0000 7efd97fff640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 0x7efd840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.285+0000 7efd977fe640 1 -- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 msgr2=0x7efd840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.285+0000 7efd977fe640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd980ce410 0x7efd840039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.285+0000 7efd977fe640 1 -- 172.21.15.55:0/655088991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd84004d40 msgr2=0x7efd840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.285+0000 7efd977fe640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd84004d40 0x7efd840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.285+0000 7efd977fe640 1 -- 172.21.15.55:0/655088991 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84003520 con 0x7efd84004030 2024-04-25T08:53:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.286+0000 7efd977fe640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd84004030 0x7efd84004800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd8800b9e0 tx=0x7efd84005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9364f5c8c4f749d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.286+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88030070 con 0x7efd84004030 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.286+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8802ada0 con 0x7efd84004030 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.286+0000 7efd96ffd640 1 -- 172.21.15.55:0/655088991 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8800b5e0 con 0x7efd84004030 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.287+0000 7efd9e607640 1 -- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd84004030 msgr2=0x7efd84004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.287+0000 7efd9e607640 1 --2- 172.21.15.55:0/655088991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd84004030 0x7efd84004800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd8800b9e0 tx=0x7efd84005830 comp rx=0 tx=0).stop 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.287+0000 7efd9cba4640 1 -- 172.21.15.55:0/655088991 reap_dead start 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.287+0000 7efd9e607640 1 -- 172.21.15.55:0/655088991 shutdown_connections 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.287+0000 7efd9e607640 1 -- 172.21.15.55:0/655088991 >> 172.21.15.55:0/655088991 conn(0x7efd980b2390 msgr2=0x7efd980b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.287+0000 7efd9e607640 1 -- 172.21.15.55:0/655088991 shutdown_connections 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.287+0000 7efd9e607640 1 -- 172.21.15.55:0/655088991 wait complete. 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.288+0000 7efd9e607640 1 Processor -- start 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.289+0000 7efd9e607640 1 -- start start 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.289+0000 7efd9e607640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd84004030 0x7efd9814eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.289+0000 7efd9e607640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd980aede0 0x7efd980af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.289+0000 7efd9e607640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd980c4530 0x7efd980c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.289+0000 7efd9e607640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd980cc0d0 con 0x7efd980c4530 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.289+0000 7efd9e607640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9815e420 con 0x7efd980aede0 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.289+0000 7efd9e607640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd980cc250 con 0x7efd84004030 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd97fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd84004030 0x7efd9814eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd980aede0 0x7efd980af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd9cba4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd980c4530 0x7efd980c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd97fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd84004030 0x7efd9814eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:36054/0 (socket says 172.21.15.55:36054) 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd97fff640 1 -- 172.21.15.55:0/4141767783 learned_addr learned my addr 172.21.15.55:0/4141767783 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd97fff640 1 -- 172.21.15.55:0/4141767783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd980aede0 msgr2=0x7efd980af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd97fff640 1 --2- 172.21.15.55:0/4141767783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd980aede0 0x7efd980af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd97fff640 1 -- 172.21.15.55:0/4141767783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd980c4530 msgr2=0x7efd980c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:18.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd97fff640 1 --2- 172.21.15.55:0/4141767783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd980c4530 0x7efd980c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd97fff640 1 -- 172.21.15.55:0/4141767783 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd980c52a0 con 0x7efd84004030 2024-04-25T08:53:18.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd9cba4640 1 --2- 172.21.15.55:0/4141767783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd980c4530 0x7efd980c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:18.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd97fff640 1 --2- 172.21.15.55:0/4141767783 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd84004030 0x7efd9814eec0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd8000f880 tx=0x7efd8000fd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:18.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd94ff9640 1 -- 172.21.15.55:0/4141767783 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd800052e0 con 0x7efd84004030 2024-04-25T08:53:18.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd94ff9640 1 -- 172.21.15.55:0/4141767783 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd80018070 con 0x7efd84004030 2024-04-25T08:53:18.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd9e607640 1 -- 172.21.15.55:0/4141767783 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd980c5580 con 0x7efd84004030 2024-04-25T08:53:18.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd94ff9640 1 -- 172.21.15.55:0/4141767783 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8000d970 con 0x7efd84004030 2024-04-25T08:53:18.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.290+0000 7efd9e607640 1 -- 172.21.15.55:0/4141767783 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd980c5b40 con 0x7efd84004030 2024-04-25T08:53:18.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.291+0000 7efd94ff9640 1 -- 172.21.15.55:0/4141767783 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7efd8000db10 con 0x7efd84004030 2024-04-25T08:53:18.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.291+0000 7efd94ff9640 1 -- 172.21.15.55:0/4141767783 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efd8001d4a0 con 0x7efd84004030 2024-04-25T08:53:18.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.291+0000 7efd9e607640 1 -- 172.21.15.55:0/4141767783 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd980af7a0 con 0x7efd84004030 2024-04-25T08:53:18.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.294+0000 7efd94ff9640 1 -- 172.21.15.55:0/4141767783 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efd800035f0 con 0x7efd84004030 2024-04-25T08:53:18.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.361+0000 7efd9e607640 1 -- 172.21.15.55:0/4141767783 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7efd980d0620 con 0x7efd84004030 2024-04-25T08:53:18.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.367+0000 7efd94ff9640 1 -- 172.21.15.55:0/4141767783 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7efd800037d0 con 0x7efd84004030 2024-04-25T08:53:18.357 INFO:teuthology.orchestra.run.smithi055.stderr:adjusted tunables profile to default 2024-04-25T08:53:18.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.368+0000 7efd9e607640 1 -- 172.21.15.55:0/4141767783 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd84004030 msgr2=0x7efd9814eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:18.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.368+0000 7efd9e607640 1 --2- 172.21.15.55:0/4141767783 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd84004030 0x7efd9814eec0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd8000f880 tx=0x7efd8000fd40 comp rx=0 tx=0).stop 2024-04-25T08:53:18.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.368+0000 7efd9e607640 1 -- 172.21.15.55:0/4141767783 shutdown_connections 2024-04-25T08:53:18.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.368+0000 7efd9e607640 1 --2- 172.21.15.55:0/4141767783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd980c4530 0x7efd980c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.368+0000 7efd9e607640 1 --2- 172.21.15.55:0/4141767783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd980aede0 0x7efd980af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.368+0000 7efd9e607640 1 --2- 172.21.15.55:0/4141767783 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd84004030 0x7efd9814eec0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.368+0000 7efd9e607640 1 -- 172.21.15.55:0/4141767783 >> 172.21.15.55:0/4141767783 conn(0x7efd980b2390 msgr2=0x7efd980adc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:18.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.368+0000 7efd9e607640 1 -- 172.21.15.55:0/4141767783 shutdown_connections 2024-04-25T08:53:18.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:18.368+0000 7efd9e607640 1 -- 172.21.15.55:0/4141767783 wait complete. 2024-04-25T08:53:18.369 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T08:53:18.369 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T08:53:18.369 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:18.369 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T08:53:18.379 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:18.389+0000 7f947ef27040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T08:53:18.393 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:18.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T08:53:18.459 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:18.459 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T08:53:18.525 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:53:18.525 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T08:53:18.531 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:18.542+0000 7f947ef27040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:53:18.555 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:18.555 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T08:53:18.579 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:18.579 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T08:53:18.589 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:18.599+0000 7f947ef27040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T08:53:18.643 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:18.643 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T08:53:18.707 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:53:18.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T08:53:18.771 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 43a3f6b5-4714-409f-9f16-1413553399ac 0 2024-04-25T08:53:18.780 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:18.790+0000 7fd7719d3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T08:53:18.857 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:18.867+0000 7f947ef27040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T08:53:18.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.887+0000 7f7ae10f5640 1 Processor -- start 2024-04-25T08:53:18.878 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.887+0000 7f7ae10f5640 1 -- start start 2024-04-25T08:53:18.880 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7ae10f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7adc15bb20 0x7f7adc0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7ae10f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc06b5b0 0x7f7adc0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7ae10f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc0cc740 con 0x7f7adc0adab0 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7ae10f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc0cc510 con 0x7f7adc15bb20 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7ae10f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0cd350 con 0x7f7adc06b5b0 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7ada59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc06b5b0 0x7f7adc0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7adad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7adc15bb20 0x7f7adc0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7ada59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc06b5b0 0x7f7adc0cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:59862/0 (socket says 172.21.15.167:59862) 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7adad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7adc15bb20 0x7f7adc0ad570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42354/0 (socket says 172.21.15.167:42354) 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7ada59c640 1 -- 172.21.15.167:0/3196126060 learned_addr learned my addr 172.21.15.167:0/3196126060 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7adad9d640 1 -- 172.21.15.167:0/3196126060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc06b5b0 msgr2=0x7f7adc0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7adad9d640 1 --2- 172.21.15.167:0/3196126060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc06b5b0 0x7f7adc0cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7adad9d640 1 -- 172.21.15.167:0/3196126060 >> v1:172.21.15.55:6789/0 conn(0x7f7adc0adab0 legacy=0x7f7adc0b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7adad9d640 1 -- 172.21.15.167:0/3196126060 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc0cca20 con 0x7f7adc15bb20 2024-04-25T08:53:18.881 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.888+0000 7f7ada59c640 1 --2- 172.21.15.167:0/3196126060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc06b5b0 0x7f7adc0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.889+0000 7f7adad9d640 1 --2- 172.21.15.167:0/3196126060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc15bb20 0x7f7adc0ad570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00097a0 tx=0x7f7ad002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86a2b689ae7375e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.889+0000 7f7ad9d9b640 1 -- 172.21.15.167:0/3196126060 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0037070 con 0x7f7adc15bb20 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.889+0000 7f7ad9d9b640 1 -- 172.21.15.167:0/3196126060 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad0032440 con 0x7f7adc15bb20 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.889+0000 7f7ad9d9b640 1 -- 172.21.15.167:0/3196126060 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0032810 con 0x7f7adc15bb20 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.890+0000 7f7ae10f5640 1 -- 172.21.15.167:0/3196126060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc15bb20 msgr2=0x7f7adc0ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.890+0000 7f7ae10f5640 1 --2- 172.21.15.167:0/3196126060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc15bb20 0x7f7adc0ad570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00097a0 tx=0x7f7ad002a180 comp rx=0 tx=0).stop 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.890+0000 7f7ae10f5640 1 -- 172.21.15.167:0/3196126060 shutdown_connections 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.890+0000 7f7ae10f5640 1 --2- 172.21.15.167:0/3196126060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc06b5b0 0x7f7adc0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.890+0000 7f7ae10f5640 1 --2- 172.21.15.167:0/3196126060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc15bb20 0x7f7adc0ad570 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.890+0000 7f7ae10f5640 1 -- 172.21.15.167:0/3196126060 >> 172.21.15.167:0/3196126060 conn(0x7f7adc099a40 msgr2=0x7f7adc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.890+0000 7f7ae10f5640 1 -- 172.21.15.167:0/3196126060 shutdown_connections 2024-04-25T08:53:18.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.890+0000 7f7ae10f5640 1 -- 172.21.15.167:0/3196126060 wait complete. 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.891+0000 7f7ae10f5640 1 Processor -- start 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.891+0000 7f7ae10f5640 1 -- start start 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7ae10f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7adc06b5b0 0x7f7adc0b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7ae10f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc0adab0 0x7f7adc0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7ae10f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc15bb20 0x7f7adc1477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7ae10f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc15bf00 con 0x7f7adc06b5b0 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7ae10f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0ccfe0 con 0x7f7adc15bb20 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7ae10f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc09a010 con 0x7f7adc0adab0 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7adb59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc15bb20 0x7f7adc1477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7ada59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc0adab0 0x7f7adc0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7adb59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc15bb20 0x7f7adc1477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42356/0 (socket says 172.21.15.167:42356) 2024-04-25T08:53:18.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7ada59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc0adab0 0x7f7adc0c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:59864/0 (socket says 172.21.15.167:59864) 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7adb59e640 1 -- 172.21.15.167:0/2309460045 learned_addr learned my addr 172.21.15.167:0/2309460045 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7adad9d640 1 --2- 172.21.15.167:0/2309460045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7adc06b5b0 0x7f7adc0b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7adb59e640 1 -- 172.21.15.167:0/2309460045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc0adab0 msgr2=0x7f7adc0c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7adb59e640 1 --2- 172.21.15.167:0/2309460045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc0adab0 0x7f7adc0c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7adb59e640 1 -- 172.21.15.167:0/2309460045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7adc06b5b0 msgr2=0x7f7adc0b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7adb59e640 1 --2- 172.21.15.167:0/2309460045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7adc06b5b0 0x7f7adc0b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7adb59e640 1 -- 172.21.15.167:0/2309460045 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc156f40 con 0x7f7adc15bb20 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.892+0000 7f7ada59c640 1 --2- 172.21.15.167:0/2309460045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc0adab0 0x7f7adc0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.893+0000 7f7adb59e640 1 --2- 172.21.15.167:0/2309460045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc15bb20 0x7f7adc1477e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400c7a0 tx=0x7f7ad400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.893+0000 7f7ac37fe640 1 -- 172.21.15.167:0/2309460045 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4003b70 con 0x7f7adc15bb20 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.893+0000 7f7ae10f5640 1 -- 172.21.15.167:0/2309460045 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7adc157220 con 0x7f7adc15bb20 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.893+0000 7f7ac37fe640 1 -- 172.21.15.167:0/2309460045 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad4003d30 con 0x7f7adc15bb20 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.893+0000 7f7ac37fe640 1 -- 172.21.15.167:0/2309460045 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400aa90 con 0x7f7adc15bb20 2024-04-25T08:53:18.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.893+0000 7f7ae10f5640 1 -- 172.21.15.167:0/2309460045 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc1577e0 con 0x7f7adc15bb20 2024-04-25T08:53:18.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.893+0000 7f7ac37fe640 1 -- 172.21.15.167:0/2309460045 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7ad400ac30 con 0x7f7adc15bb20 2024-04-25T08:53:18.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.893+0000 7f7ac37fe640 1 -- 172.21.15.167:0/2309460045 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7ad40129e0 con 0x7f7adc15bb20 2024-04-25T08:53:18.887 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.894+0000 7f7ae10f5640 1 -- 172.21.15.167:0/2309460045 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc0750b0 con 0x7f7adc15bb20 2024-04-25T08:53:18.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.898+0000 7f7ac37fe640 1 -- 172.21.15.167:0/2309460045 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7ad4012c30 con 0x7f7adc15bb20 2024-04-25T08:53:18.905 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:18.915+0000 7f947ef27040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T08:53:18.931 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:18.940+0000 7fd7719d3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:53:18.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.971+0000 7f7ae10f5640 1 -- 172.21.15.167:0/2309460045 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43a3f6b5-4714-409f-9f16-1413553399ac", "id": 0} v 0) v1 -- 0x7f7adc0aebb0 con 0x7f7adc15bb20 2024-04-25T08:53:18.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.977+0000 7f7ac37fe640 1 -- 172.21.15.167:0/2309460045 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43a3f6b5-4714-409f-9f16-1413553399ac", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ad4012e10 con 0x7f7adc15bb20 2024-04-25T08:53:18.967 INFO:teuthology.orchestra.run.smithi167.stdout:0 2024-04-25T08:53:18.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.978+0000 7f7ae10f5640 1 -- 172.21.15.167:0/2309460045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc15bb20 msgr2=0x7f7adc1477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:18.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.978+0000 7f7ae10f5640 1 --2- 172.21.15.167:0/2309460045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc15bb20 0x7f7adc1477e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400c7a0 tx=0x7f7ad400cc60 comp rx=0 tx=0).stop 2024-04-25T08:53:18.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.978+0000 7f7ae10f5640 1 -- 172.21.15.167:0/2309460045 shutdown_connections 2024-04-25T08:53:18.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.978+0000 7f7ae10f5640 1 --2- 172.21.15.167:0/2309460045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc15bb20 0x7f7adc1477e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.978+0000 7f7ae10f5640 1 --2- 172.21.15.167:0/2309460045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7adc0adab0 0x7f7adc0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.978+0000 7f7ae10f5640 1 --2- 172.21.15.167:0/2309460045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7adc06b5b0 0x7f7adc0b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:18.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.978+0000 7f7ae10f5640 1 -- 172.21.15.167:0/2309460045 >> 172.21.15.167:0/2309460045 conn(0x7f7adc099a40 msgr2=0x7f7adc0cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:18.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.978+0000 7f7ae10f5640 1 -- 172.21.15.167:0/2309460045 shutdown_connections 2024-04-25T08:53:18.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:18.978+0000 7f7ae10f5640 1 -- 172.21.15.167:0/2309460045 wait complete. 2024-04-25T08:53:18.979 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 96ef6179-4eab-4b78-b4fe-b17fa7237792 1 2024-04-25T08:53:18.987 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:18.997+0000 7fd7719d3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T08:53:19.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.086+0000 7f6687a93640 1 Processor -- start 2024-04-25T08:53:19.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.086+0000 7f6687a93640 1 -- start start 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f6687a93640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f668015f1b0 0x7f66800d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f6687a93640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015e150 0x7f668006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f6687a93640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66800d0390 con 0x7f668015dd70 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f6687a93640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668015e6d0 con 0x7f668015f1b0 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f6687a93640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668015e9b0 con 0x7f668015e150 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f6686030640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015e150 0x7f668006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f6686030640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015e150 0x7f668006aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:59876/0 (socket says 172.21.15.167:59876) 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f6686030640 1 -- 172.21.15.167:0/3899666763 learned_addr learned my addr 172.21.15.167:0/3899666763 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f668502e640 1 --2- 172.21.15.167:0/3899666763 >> v2:172.21.15.167:3300/0 conn(0x7f668015f1b0 0x7f66800d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f668582f640 1 --1- 172.21.15.167:0/3899666763 >> v1:172.21.15.167:6789/0 conn(0x7f668015dd70 0x7f66800cfb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37062/0 (socket says 172.21.15.167:37062) 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f668502e640 1 -- 172.21.15.167:0/3899666763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015e150 msgr2=0x7f668006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:19.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f668502e640 1 --2- 172.21.15.167:0/3899666763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015e150 0x7f668006aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f668502e640 1 -- 172.21.15.167:0/3899666763 >> v1:172.21.15.167:6789/0 conn(0x7f668015dd70 legacy=0x7f66800cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f668502e640 1 -- 172.21.15.167:0/3899666763 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668015ec90 con 0x7f668015f1b0 2024-04-25T08:53:19.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f668482d640 1 -- 172.21.15.167:0/3899666763 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031846448 0 0) 0x7f66800d0390 con 0x7f668015dd70 2024-04-25T08:53:19.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.087+0000 7f6686030640 1 --2- 172.21.15.167:0/3899666763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015e150 0x7f668006aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:19.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.088+0000 7f668502e640 1 --2- 172.21.15.167:0/3899666763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668015f1b0 0x7f66800d1300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f667c0097a0 tx=0x7f667c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1eeca1ca076cc09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:19.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.088+0000 7f668482d640 1 -- 172.21.15.167:0/3899666763 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c037070 con 0x7f668015f1b0 2024-04-25T08:53:19.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.088+0000 7f668482d640 1 -- 172.21.15.167:0/3899666763 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c02ae50 con 0x7f668015f1b0 2024-04-25T08:53:19.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.088+0000 7f668482d640 1 -- 172.21.15.167:0/3899666763 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c032660 con 0x7f668015f1b0 2024-04-25T08:53:19.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.089+0000 7f6687a93640 1 -- 172.21.15.167:0/3899666763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668015f1b0 msgr2=0x7f66800d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.089+0000 7f6687a93640 1 --2- 172.21.15.167:0/3899666763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668015f1b0 0x7f66800d1300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f667c0097a0 tx=0x7f667c02a100 comp rx=0 tx=0).stop 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.089+0000 7f6687a93640 1 -- 172.21.15.167:0/3899666763 shutdown_connections 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.089+0000 7f6687a93640 1 --2- 172.21.15.167:0/3899666763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015e150 0x7f668006aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.089+0000 7f6687a93640 1 --2- 172.21.15.167:0/3899666763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668015f1b0 0x7f66800d1300 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.089+0000 7f6687a93640 1 -- 172.21.15.167:0/3899666763 >> 172.21.15.167:0/3899666763 conn(0x7f6680099a40 msgr2=0x7f66800d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.089+0000 7f6687a93640 1 -- 172.21.15.167:0/3899666763 shutdown_connections 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.089+0000 7f6687a93640 1 -- 172.21.15.167:0/3899666763 wait complete. 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.090+0000 7f6687a93640 1 Processor -- start 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.090+0000 7f6687a93640 1 -- start start 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f6687a93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f668015dd70 0x7f6680150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f6687a93640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668015e150 0x7f66800c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f6687a93640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015f1b0 0x7f668006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f6687a93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668006b4f0 con 0x7f668015dd70 2024-04-25T08:53:19.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f6687a93640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668006b370 con 0x7f668015e150 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f6687a93640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6680161a00 con 0x7f668015f1b0 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f6686030640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015f1b0 0x7f668006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f668502e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668015e150 0x7f66800c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f668502e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668015e150 0x7f66800c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42368/0 (socket says 172.21.15.167:42368) 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f6686030640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015f1b0 0x7f668006e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:59886/0 (socket says 172.21.15.167:59886) 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f668502e640 1 -- 172.21.15.167:0/1332814316 learned_addr learned my addr 172.21.15.167:0/1332814316 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f668502e640 1 -- 172.21.15.167:0/1332814316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015f1b0 msgr2=0x7f668006e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f668502e640 1 --2- 172.21.15.167:0/1332814316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015f1b0 0x7f668006e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f668502e640 1 -- 172.21.15.167:0/1332814316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f668015dd70 msgr2=0x7f6680150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f668502e640 1 --2- 172.21.15.167:0/1332814316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f668015dd70 0x7f6680150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f668502e640 1 -- 172.21.15.167:0/1332814316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66800c7030 con 0x7f668015e150 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f668502e640 1 --2- 172.21.15.167:0/1332814316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668015e150 0x7f66800c65b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f667c0098c0 tx=0x7f667c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.091+0000 7f66767fc640 1 -- 172.21.15.167:0/1332814316 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c041020 con 0x7f668015e150 2024-04-25T08:53:19.085 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.092+0000 7f66767fc640 1 -- 172.21.15.167:0/1332814316 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c03c670 con 0x7f668015e150 2024-04-25T08:53:19.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.092+0000 7f6687a93640 1 -- 172.21.15.167:0/1332814316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66800c7310 con 0x7f668015e150 2024-04-25T08:53:19.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.092+0000 7f66767fc640 1 -- 172.21.15.167:0/1332814316 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c037040 con 0x7f668015e150 2024-04-25T08:53:19.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.092+0000 7f6687a93640 1 -- 172.21.15.167:0/1332814316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66800c7b40 con 0x7f668015e150 2024-04-25T08:53:19.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.092+0000 7f66767fc640 1 -- 172.21.15.167:0/1332814316 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f667c044020 con 0x7f668015e150 2024-04-25T08:53:19.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.092+0000 7f66767fc640 1 -- 172.21.15.167:0/1332814316 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f667c03dda0 con 0x7f668015e150 2024-04-25T08:53:19.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.093+0000 7f6687a93640 1 -- 172.21.15.167:0/1332814316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66800750b0 con 0x7f668015e150 2024-04-25T08:53:19.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.095+0000 7f66767fc640 1 -- 172.21.15.167:0/1332814316 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f667c04b030 con 0x7f668015e150 2024-04-25T08:53:19.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.181+0000 7f6687a93640 1 -- 172.21.15.167:0/1332814316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96ef6179-4eab-4b78-b4fe-b17fa7237792", "id": 1} v 0) v1 -- 0x7f66800b6780 con 0x7f668015e150 2024-04-25T08:53:19.180 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.189+0000 7f66767fc640 1 -- 172.21.15.167:0/1332814316 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96ef6179-4eab-4b78-b4fe-b17fa7237792", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f667c03d4e0 con 0x7f668015e150 2024-04-25T08:53:19.180 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-04-25T08:53:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.190+0000 7f6687a93640 1 -- 172.21.15.167:0/1332814316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668015e150 msgr2=0x7f66800c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.190+0000 7f6687a93640 1 --2- 172.21.15.167:0/1332814316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668015e150 0x7f66800c65b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f667c0098c0 tx=0x7f667c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.190+0000 7f6687a93640 1 -- 172.21.15.167:0/1332814316 shutdown_connections 2024-04-25T08:53:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.190+0000 7f6687a93640 1 --2- 172.21.15.167:0/1332814316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f668015f1b0 0x7f668006e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.190+0000 7f6687a93640 1 --2- 172.21.15.167:0/1332814316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f668015e150 0x7f66800c65b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.190+0000 7f6687a93640 1 --2- 172.21.15.167:0/1332814316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f668015dd70 0x7f6680150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.191+0000 7f6687a93640 1 -- 172.21.15.167:0/1332814316 >> 172.21.15.167:0/1332814316 conn(0x7f6680099a40 msgr2=0x7f668015bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:19.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.191+0000 7f6687a93640 1 -- 172.21.15.167:0/1332814316 shutdown_connections 2024-04-25T08:53:19.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.191+0000 7f6687a93640 1 -- 172.21.15.167:0/1332814316 wait complete. 2024-04-25T08:53:19.191 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 58f32851-02c2-4eca-b308-9aaa0f8fbcea 2 2024-04-25T08:53:19.252 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:19.262+0000 7fd7719d3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T08:53:19.301 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:19.311+0000 7fd7719d3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T08:53:19.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.339+0000 7f9d5cfa9640 1 Processor -- start 2024-04-25T08:53:19.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.339+0000 7f9d5cfa9640 1 -- start start 2024-04-25T08:53:19.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.340+0000 7f9d5cfa9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9d5815dd70 0x7f9d580d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.340+0000 7f9d5cfa9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d580d0390 con 0x7f9d5815e150 2024-04-25T08:53:19.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.340+0000 7f9d5cfa9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5815e6d0 con 0x7f9d5815f1b0 2024-04-25T08:53:19.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.340+0000 7f9d5cfa9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5815e9b0 con 0x7f9d5815dd70 2024-04-25T08:53:19.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.340+0000 7f9d5659c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9d5815dd70 0x7f9d580d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.340+0000 7f9d4ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9d5815f1b0 0x7f9d580cfb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37066/0 (socket says 172.21.15.167:37066) 2024-04-25T08:53:19.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.340+0000 7f9d4ffff640 1 -- 172.21.15.167:0/2060347441 learned_addr learned my addr 172.21.15.167:0/2060347441 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-04-25T08:53:19.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.340+0000 7f9d5659c640 1 -- 172.21.15.167:0/2060347441 >> v1:172.21.15.167:6789/0 conn(0x7f9d5815f1b0 legacy=0x7f9d580cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.341+0000 7f9d5659c640 1 -- 172.21.15.167:0/2060347441 >> v1:172.21.15.55:6789/0 conn(0x7f9d5815e150 legacy=0x7f9d5806aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.341+0000 7f9d5659c640 1 -- 172.21.15.167:0/2060347441 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5815ec90 con 0x7f9d5815dd70 2024-04-25T08:53:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.341+0000 7f9d5659c640 1 --2- 172.21.15.167:0/2060347441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5815dd70 0x7f9d580d1300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d480097a0 tx=0x7f9d4802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=566c9fa8111a7dcf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.341+0000 7f9d55d9b640 1 -- 172.21.15.167:0/2060347441 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48037070 con 0x7f9d5815dd70 2024-04-25T08:53:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.341+0000 7f9d55d9b640 1 -- 172.21.15.167:0/2060347441 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48032440 con 0x7f9d5815dd70 2024-04-25T08:53:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.341+0000 7f9d55d9b640 1 -- 172.21.15.167:0/2060347441 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48032810 con 0x7f9d5815dd70 2024-04-25T08:53:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.342+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/2060347441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5815dd70 msgr2=0x7f9d580d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.342+0000 7f9d5cfa9640 1 --2- 172.21.15.167:0/2060347441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5815dd70 0x7f9d580d1300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d480097a0 tx=0x7f9d4802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.342+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/2060347441 shutdown_connections 2024-04-25T08:53:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.342+0000 7f9d5cfa9640 1 --2- 172.21.15.167:0/2060347441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5815dd70 0x7f9d580d1300 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.342+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/2060347441 >> 172.21.15.167:0/2060347441 conn(0x7f9d58099a40 msgr2=0x7f9d580d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.342+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/2060347441 shutdown_connections 2024-04-25T08:53:19.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.342+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/2060347441 wait complete. 2024-04-25T08:53:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.343+0000 7f9d5cfa9640 1 Processor -- start 2024-04-25T08:53:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.343+0000 7f9d5cfa9640 1 -- start start 2024-04-25T08:53:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5cfa9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5815dd70 0x7f9d5815c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5cfa9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5815e150 0x7f9d580c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5cfa9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d5815f1b0 0x7f9d580ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5cfa9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58168d90 con 0x7f9d5815e150 2024-04-25T08:53:19.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5cfa9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5806b500 con 0x7f9d5815dd70 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5cfa9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58168f10 con 0x7f9d5815f1b0 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5815dd70 0x7f9d5815c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5815dd70 0x7f9d5815c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42396/0 (socket says 172.21.15.167:42396) 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5659c640 1 -- 172.21.15.167:0/1029303023 learned_addr learned my addr 172.21.15.167:0/1029303023 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d56d9d640 1 --2- 172.21.15.167:0/1029303023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d5815f1b0 0x7f9d580ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d4ffff640 1 --2- 172.21.15.167:0/1029303023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5815e150 0x7f9d580c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5659c640 1 -- 172.21.15.167:0/1029303023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d5815f1b0 msgr2=0x7f9d580ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5659c640 1 --2- 172.21.15.167:0/1029303023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d5815f1b0 0x7f9d580ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5659c640 1 -- 172.21.15.167:0/1029303023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5815e150 msgr2=0x7f9d580c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5659c640 1 --2- 172.21.15.167:0/1029303023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5815e150 0x7f9d580c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.344+0000 7f9d5659c640 1 -- 172.21.15.167:0/1029303023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d580c62d0 con 0x7f9d5815dd70 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.345+0000 7f9d5659c640 1 --2- 172.21.15.167:0/1029303023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5815dd70 0x7f9d5815c520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9d48035040 tx=0x7f9d480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.345+0000 7f9d4effd640 1 -- 172.21.15.167:0/1029303023 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48037040 con 0x7f9d5815dd70 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.345+0000 7f9d4effd640 1 -- 172.21.15.167:0/1029303023 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48030770 con 0x7f9d5815dd70 2024-04-25T08:53:19.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.345+0000 7f9d4effd640 1 -- 172.21.15.167:0/1029303023 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48030b80 con 0x7f9d5815dd70 2024-04-25T08:53:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.345+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/1029303023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d580c6570 con 0x7f9d5815dd70 2024-04-25T08:53:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.345+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/1029303023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d580c6b30 con 0x7f9d5815dd70 2024-04-25T08:53:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.345+0000 7f9d4effd640 1 -- 172.21.15.167:0/1029303023 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9d48044020 con 0x7f9d5815dd70 2024-04-25T08:53:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.345+0000 7f9d4effd640 1 -- 172.21.15.167:0/1029303023 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9d4803dbf0 con 0x7f9d5815dd70 2024-04-25T08:53:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.346+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/1029303023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d580750b0 con 0x7f9d5815dd70 2024-04-25T08:53:19.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.348+0000 7f9d4effd640 1 -- 172.21.15.167:0/1029303023 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9d48032e20 con 0x7f9d5815dd70 2024-04-25T08:53:19.412 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.421+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/1029303023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "58f32851-02c2-4eca-b308-9aaa0f8fbcea", "id": 2} v 0) v1 -- 0x7f9d580caed0 con 0x7f9d5815dd70 2024-04-25T08:53:19.416 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.426+0000 7f9d4effd640 1 -- 172.21.15.167:0/1029303023 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58f32851-02c2-4eca-b308-9aaa0f8fbcea", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9d4803d7d0 con 0x7f9d5815dd70 2024-04-25T08:53:19.416 INFO:teuthology.orchestra.run.smithi167.stdout:2 2024-04-25T08:53:19.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.427+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/1029303023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5815dd70 msgr2=0x7f9d5815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.427+0000 7f9d5cfa9640 1 --2- 172.21.15.167:0/1029303023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5815dd70 0x7f9d5815c520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9d48035040 tx=0x7f9d480046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.427+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/1029303023 shutdown_connections 2024-04-25T08:53:19.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.427+0000 7f9d5cfa9640 1 --2- 172.21.15.167:0/1029303023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d5815f1b0 0x7f9d580ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.427+0000 7f9d5cfa9640 1 --2- 172.21.15.167:0/1029303023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5815e150 0x7f9d580c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.427+0000 7f9d5cfa9640 1 --2- 172.21.15.167:0/1029303023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5815dd70 0x7f9d5815c520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.427+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/1029303023 >> 172.21.15.167:0/1029303023 conn(0x7f9d58099a40 msgr2=0x7f9d580cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:19.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.427+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/1029303023 shutdown_connections 2024-04-25T08:53:19.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.427+0000 7f9d5cfa9640 1 -- 172.21.15.167:0/1029303023 wait complete. 2024-04-25T08:53:19.428 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new bc5cfff6-8dd5-4999-bd07-d5b173b92159 3 2024-04-25T08:53:19.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.575+0000 7f888ef77640 1 Processor -- start 2024-04-25T08:53:19.565 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.575+0000 7f888ef77640 1 -- start start 2024-04-25T08:53:19.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.575+0000 7f888ef77640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f888815f1b0 0x7f88880d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.576+0000 7f888ef77640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88880d0390 con 0x7f888815e150 2024-04-25T08:53:19.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.576+0000 7f888ef77640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888815e6d0 con 0x7f888815dd70 2024-04-25T08:53:19.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.576+0000 7f888ef77640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888815e9b0 con 0x7f888815f1b0 2024-04-25T08:53:19.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.576+0000 7f888cd13640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f888815dd70 0x7f88880cfb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37070/0 (socket says 172.21.15.167:37070) 2024-04-25T08:53:19.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.576+0000 7f888cd13640 1 -- 172.21.15.167:0/4287605220 learned_addr learned my addr 172.21.15.167:0/4287605220 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-04-25T08:53:19.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.576+0000 7f8887fff640 1 --2- 172.21.15.167:0/4287605220 >> v2:172.21.15.55:3300/0 conn(0x7f888815f1b0 0x7f88880d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.576+0000 7f88877fe640 1 -- 172.21.15.167:0/4287605220 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045276995 0 0) 0x7f888815e6d0 con 0x7f888815dd70 2024-04-25T08:53:19.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.576+0000 7f88877fe640 1 -- 172.21.15.167:0/4287605220 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8878003520 con 0x7f888815dd70 2024-04-25T08:53:19.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.576+0000 7f8887fff640 1 -- 172.21.15.167:0/4287605220 >> v1:172.21.15.167:6789/0 conn(0x7f888815dd70 legacy=0x7f88880cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.576+0000 7f8887fff640 1 -- 172.21.15.167:0/4287605220 >> v1:172.21.15.55:6789/0 conn(0x7f888815e150 legacy=0x7f888806aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.568 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.576+0000 7f8887fff640 1 -- 172.21.15.167:0/4287605220 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888815ec90 con 0x7f888815f1b0 2024-04-25T08:53:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.577+0000 7f8887fff640 1 --2- 172.21.15.167:0/4287605220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f888815f1b0 0x7f88880d1300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88740097a0 tx=0x7f887402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d9b2bc0f6538e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.577+0000 7f88877fe640 1 -- 172.21.15.167:0/4287605220 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874037070 con 0x7f888815f1b0 2024-04-25T08:53:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.577+0000 7f88877fe640 1 -- 172.21.15.167:0/4287605220 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8874032440 con 0x7f888815f1b0 2024-04-25T08:53:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.577+0000 7f88877fe640 1 -- 172.21.15.167:0/4287605220 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88740327f0 con 0x7f888815f1b0 2024-04-25T08:53:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.578+0000 7f888ef77640 1 -- 172.21.15.167:0/4287605220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f888815f1b0 msgr2=0x7f88880d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.578+0000 7f888ef77640 1 --2- 172.21.15.167:0/4287605220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f888815f1b0 0x7f88880d1300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88740097a0 tx=0x7f887402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.578+0000 7f888ef77640 1 -- 172.21.15.167:0/4287605220 shutdown_connections 2024-04-25T08:53:19.569 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.578+0000 7f888ef77640 1 --2- 172.21.15.167:0/4287605220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f888815f1b0 0x7f88880d1300 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.578+0000 7f888ef77640 1 -- 172.21.15.167:0/4287605220 >> 172.21.15.167:0/4287605220 conn(0x7f8888099a40 msgr2=0x7f88880d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:19.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.578+0000 7f888ef77640 1 -- 172.21.15.167:0/4287605220 shutdown_connections 2024-04-25T08:53:19.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.578+0000 7f888ef77640 1 -- 172.21.15.167:0/4287605220 wait complete. 2024-04-25T08:53:19.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.579+0000 7f888ef77640 1 Processor -- start 2024-04-25T08:53:19.570 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.579+0000 7f888ef77640 1 -- start start 2024-04-25T08:53:19.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888ef77640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f888815dd70 0x7f888814efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888ef77640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f888815e150 0x7f8888154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888ef77640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f888815f1b0 0x7f8888156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888ef77640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8888168d90 con 0x7f888815e150 2024-04-25T08:53:19.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888ef77640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888806b500 con 0x7f888815dd70 2024-04-25T08:53:19.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888ef77640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8888168f10 con 0x7f888815f1b0 2024-04-25T08:53:19.572 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888cd13640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f888815dd70 0x7f888814efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888cd13640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f888815dd70 0x7f888814efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42406/0 (socket says 172.21.15.167:42406) 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888cd13640 1 -- 172.21.15.167:0/1152418275 learned_addr learned my addr 172.21.15.167:0/1152418275 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888d514640 1 --2- 172.21.15.167:0/1152418275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f888815f1b0 0x7f8888156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f8887fff640 1 --2- 172.21.15.167:0/1152418275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f888815e150 0x7f8888154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888cd13640 1 -- 172.21.15.167:0/1152418275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f888815f1b0 msgr2=0x7f8888156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888cd13640 1 --2- 172.21.15.167:0/1152418275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f888815f1b0 0x7f8888156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888cd13640 1 -- 172.21.15.167:0/1152418275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f888815e150 msgr2=0x7f8888154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888cd13640 1 --2- 172.21.15.167:0/1152418275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f888815e150 0x7f8888154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888cd13640 1 -- 172.21.15.167:0/1152418275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888155490 con 0x7f888815dd70 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888cd13640 1 --2- 172.21.15.167:0/1152418275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f888815dd70 0x7f888814efa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f887c00c500 tx=0x7f887c00c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f88857fa640 1 -- 172.21.15.167:0/1152418275 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c017070 con 0x7f888815dd70 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f88857fa640 1 -- 172.21.15.167:0/1152418275 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c005ce0 con 0x7f888815dd70 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888ef77640 1 -- 172.21.15.167:0/1152418275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8888156150 con 0x7f888815dd70 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f88857fa640 1 -- 172.21.15.167:0/1152418275 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c007330 con 0x7f888815dd70 2024-04-25T08:53:19.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.580+0000 7f888ef77640 1 -- 172.21.15.167:0/1152418275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8888153ea0 con 0x7f888815dd70 2024-04-25T08:53:19.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.581+0000 7f88857fa640 1 -- 172.21.15.167:0/1152418275 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f887c01a070 con 0x7f888815dd70 2024-04-25T08:53:19.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.581+0000 7f88857fa640 1 -- 172.21.15.167:0/1152418275 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f887c012890 con 0x7f888815dd70 2024-04-25T08:53:19.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.582+0000 7f888ef77640 1 -- 172.21.15.167:0/1152418275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88880750b0 con 0x7f888815dd70 2024-04-25T08:53:19.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.583+0000 7f88857fa640 1 -- 172.21.15.167:0/1152418275 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f887c021070 con 0x7f888815dd70 2024-04-25T08:53:19.636 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:19.646+0000 7f947ef27040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T08:53:19.647 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.657+0000 7f888ef77640 1 -- 172.21.15.167:0/1152418275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bc5cfff6-8dd5-4999-bd07-d5b173b92159", "id": 3} v 0) v1 -- 0x7f88880b6780 con 0x7f888815dd70 2024-04-25T08:53:19.651 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.661+0000 7f88857fa640 1 -- 172.21.15.167:0/1152418275 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bc5cfff6-8dd5-4999-bd07-d5b173b92159", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f887c012400 con 0x7f888815dd70 2024-04-25T08:53:19.652 INFO:teuthology.orchestra.run.smithi167.stdout:3 2024-04-25T08:53:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.662+0000 7f888ef77640 1 -- 172.21.15.167:0/1152418275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f888815dd70 msgr2=0x7f888814efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.662+0000 7f888ef77640 1 --2- 172.21.15.167:0/1152418275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f888815dd70 0x7f888814efa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f887c00c500 tx=0x7f887c00c9c0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.662+0000 7f888ef77640 1 -- 172.21.15.167:0/1152418275 shutdown_connections 2024-04-25T08:53:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.662+0000 7f888ef77640 1 --2- 172.21.15.167:0/1152418275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f888815f1b0 0x7f8888156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.662+0000 7f888ef77640 1 --2- 172.21.15.167:0/1152418275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f888815e150 0x7f8888154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.662+0000 7f888ef77640 1 --2- 172.21.15.167:0/1152418275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f888815dd70 0x7f888814efa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.662+0000 7f888ef77640 1 -- 172.21.15.167:0/1152418275 >> 172.21.15.167:0/1152418275 conn(0x7f8888099a40 msgr2=0x7f88880d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.662+0000 7f888ef77640 1 -- 172.21.15.167:0/1152418275 shutdown_connections 2024-04-25T08:53:19.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.662+0000 7f888ef77640 1 -- 172.21.15.167:0/1152418275 wait complete. 2024-04-25T08:53:19.663 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new bb89cbf1-515c-437d-8c11-7e5db4a93bfe 4 2024-04-25T08:53:19.728 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:19.738+0000 7f947ef27040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T08:53:19.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.771+0000 7fe2f293b640 1 Processor -- start 2024-04-25T08:53:19.761 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.771+0000 7fe2f293b640 1 -- start start 2024-04-25T08:53:19.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.771+0000 7fe2f293b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2ec0b5550 0x7fe2ec0b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.771+0000 7fe2f293b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe2ec0d2560 0x7fe2ec0d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.771+0000 7fe2f293b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec161500 con 0x7fe2ec161120 2024-04-25T08:53:19.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.771+0000 7fe2f293b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec0b5ef0 con 0x7fe2ec0b5550 2024-04-25T08:53:19.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.771+0000 7fe2f293b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec162740 con 0x7fe2ec0d2560 2024-04-25T08:53:19.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.772+0000 7fe2f0ed8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe2ec0d2560 0x7fe2ec0d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.772+0000 7fe2f0ed8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe2ec0d2560 0x7fe2ec0d2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42416/0 (socket says 172.21.15.167:42416) 2024-04-25T08:53:19.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.772+0000 7fe2f0ed8640 1 -- 172.21.15.167:0/3127037327 learned_addr learned my addr 172.21.15.167:0/3127037327 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:19.763 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.772+0000 7fe2ebfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe2ec161120 0x7fe2ec1617a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37082/0 (socket says 172.21.15.167:37082) 2024-04-25T08:53:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.772+0000 7fe2eb7fe640 1 --2- 172.21.15.167:0/3127037327 >> v2:172.21.15.55:3300/0 conn(0x7fe2ec0b5550 0x7fe2ec0b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.772+0000 7fe2f0ed8640 1 -- 172.21.15.167:0/3127037327 >> v2:172.21.15.55:3300/0 conn(0x7fe2ec0b5550 msgr2=0x7fe2ec0b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.772+0000 7fe2f0ed8640 1 --2- 172.21.15.167:0/3127037327 >> v2:172.21.15.55:3300/0 conn(0x7fe2ec0b5550 0x7fe2ec0b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.772+0000 7fe2f0ed8640 1 -- 172.21.15.167:0/3127037327 >> v1:172.21.15.167:6789/0 conn(0x7fe2ec161120 legacy=0x7fe2ec1617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.772+0000 7fe2f0ed8640 1 -- 172.21.15.167:0/3127037327 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec161eb0 con 0x7fe2ec0d2560 2024-04-25T08:53:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.772+0000 7fe2eaffd640 1 -- 172.21.15.167:0/3127037327 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440655443 0 0) 0x7fe2ec161500 con 0x7fe2ec161120 2024-04-25T08:53:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2f0ed8640 1 --2- 172.21.15.167:0/3127037327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec0d2560 0x7fe2ec0d2980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0b34d0 tx=0x7fe2e402a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e00e97b83be0037 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2eaffd640 1 -- 172.21.15.167:0/3127037327 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4036070 con 0x7fe2ec0d2560 2024-04-25T08:53:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2eaffd640 1 -- 172.21.15.167:0/3127037327 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e4031600 con 0x7fe2ec0d2560 2024-04-25T08:53:19.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2eaffd640 1 -- 172.21.15.167:0/3127037327 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40319d0 con 0x7fe2ec0d2560 2024-04-25T08:53:19.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2f293b640 1 -- 172.21.15.167:0/3127037327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec0d2560 msgr2=0x7fe2ec0d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2f293b640 1 --2- 172.21.15.167:0/3127037327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec0d2560 0x7fe2ec0d2980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0b34d0 tx=0x7fe2e402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2f293b640 1 -- 172.21.15.167:0/3127037327 shutdown_connections 2024-04-25T08:53:19.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2f293b640 1 --2- 172.21.15.167:0/3127037327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec0d2560 0x7fe2ec0d2980 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2f293b640 1 --2- 172.21.15.167:0/3127037327 >> v2:172.21.15.55:3300/0 conn(0x7fe2ec0b5550 0x7fe2ec0b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2f293b640 1 -- 172.21.15.167:0/3127037327 >> 172.21.15.167:0/3127037327 conn(0x7fe2ec0d0550 msgr2=0x7fe2ec0d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:19.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2f293b640 1 -- 172.21.15.167:0/3127037327 shutdown_connections 2024-04-25T08:53:19.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.773+0000 7fe2f293b640 1 -- 172.21.15.167:0/3127037327 wait complete. 2024-04-25T08:53:19.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.774+0000 7fe2f293b640 1 Processor -- start 2024-04-25T08:53:19.766 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.775+0000 7fe2f293b640 1 -- start start 2024-04-25T08:53:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.775+0000 7fe2f293b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec0b5550 0x7fe2ec1f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.775+0000 7fe2f293b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2ec0d2560 0x7fe2ec1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.775+0000 7fe2f293b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2ec161120 0x7fe2ec157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.775+0000 7fe2f293b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0d1d60 con 0x7fe2ec0d2560 2024-04-25T08:53:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.775+0000 7fe2f293b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec162460 con 0x7fe2ec0b5550 2024-04-25T08:53:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.775+0000 7fe2f293b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0d2040 con 0x7fe2ec161120 2024-04-25T08:53:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2ebfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec0b5550 0x7fe2ec1f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2f0ed8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2ec161120 0x7fe2ec157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2ebfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec0b5550 0x7fe2ec1f6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42432/0 (socket says 172.21.15.167:42432) 2024-04-25T08:53:19.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2ebfff640 1 -- 172.21.15.167:0/3711680970 learned_addr learned my addr 172.21.15.167:0/3711680970 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2eb7fe640 1 --2- 172.21.15.167:0/3711680970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2ec0d2560 0x7fe2ec1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2ebfff640 1 -- 172.21.15.167:0/3711680970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2ec161120 msgr2=0x7fe2ec157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2ebfff640 1 --2- 172.21.15.167:0/3711680970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2ec161120 0x7fe2ec157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2ebfff640 1 -- 172.21.15.167:0/3711680970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2ec0d2560 msgr2=0x7fe2ec1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2ebfff640 1 --2- 172.21.15.167:0/3711680970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2ec0d2560 0x7fe2ec1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2ebfff640 1 -- 172.21.15.167:0/3711680970 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec155700 con 0x7fe2ec0b5550 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2f0ed8640 1 --2- 172.21.15.167:0/3711680970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2ec161120 0x7fe2ec157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2ebfff640 1 --2- 172.21.15.167:0/3711680970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec0b5550 0x7fe2ec1f6d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00c430 tx=0x7fe2dc00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2e8ff9640 1 -- 172.21.15.167:0/3711680970 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0074e0 con 0x7fe2ec0b5550 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2e8ff9640 1 -- 172.21.15.167:0/3711680970 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc0047e0 con 0x7fe2ec0b5550 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2e8ff9640 1 -- 172.21.15.167:0/3711680970 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc004bd0 con 0x7fe2ec0b5550 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2f293b640 1 -- 172.21.15.167:0/3711680970 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec1559e0 con 0x7fe2ec0b5550 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2f293b640 1 -- 172.21.15.167:0/3711680970 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec155fa0 con 0x7fe2ec0b5550 2024-04-25T08:53:19.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2e8ff9640 1 -- 172.21.15.167:0/3711680970 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe2dc011070 con 0x7fe2ec0b5550 2024-04-25T08:53:19.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.776+0000 7fe2e8ff9640 1 -- 172.21.15.167:0/3711680970 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe2dc0138d0 con 0x7fe2ec0b5550 2024-04-25T08:53:19.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.777+0000 7fe2f293b640 1 -- 172.21.15.167:0/3711680970 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec0750b0 con 0x7fe2ec0b5550 2024-04-25T08:53:19.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.779+0000 7fe2e8ff9640 1 -- 172.21.15.167:0/3711680970 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe2dc004d70 con 0x7fe2ec0b5550 2024-04-25T08:53:19.773 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:19.784+0000 7f947ef27040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T08:53:19.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.852+0000 7fe2f293b640 1 -- 172.21.15.167:0/3711680970 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bb89cbf1-515c-437d-8c11-7e5db4a93bfe", "id": 4} v 0) v1 -- 0x7fe2ec0ce020 con 0x7fe2ec0b5550 2024-04-25T08:53:19.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.856+0000 7fe2e8ff9640 1 -- 172.21.15.167:0/3711680970 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb89cbf1-515c-437d-8c11-7e5db4a93bfe", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe2dc013ba0 con 0x7fe2ec0b5550 2024-04-25T08:53:19.846 INFO:teuthology.orchestra.run.smithi167.stdout:4 2024-04-25T08:53:19.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.857+0000 7fe2f293b640 1 -- 172.21.15.167:0/3711680970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec0b5550 msgr2=0x7fe2ec1f6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.857+0000 7fe2f293b640 1 --2- 172.21.15.167:0/3711680970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec0b5550 0x7fe2ec1f6d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00c430 tx=0x7fe2dc00c8f0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.857+0000 7fe2f293b640 1 -- 172.21.15.167:0/3711680970 shutdown_connections 2024-04-25T08:53:19.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.857+0000 7fe2f293b640 1 --2- 172.21.15.167:0/3711680970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2ec161120 0x7fe2ec157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.857+0000 7fe2f293b640 1 --2- 172.21.15.167:0/3711680970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2ec0d2560 0x7fe2ec1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.857+0000 7fe2f293b640 1 --2- 172.21.15.167:0/3711680970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec0b5550 0x7fe2ec1f6d80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.857+0000 7fe2f293b640 1 -- 172.21.15.167:0/3711680970 >> 172.21.15.167:0/3711680970 conn(0x7fe2ec0d0550 msgr2=0x7fe2ec0b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:19.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.857+0000 7fe2f293b640 1 -- 172.21.15.167:0/3711680970 shutdown_connections 2024-04-25T08:53:19.848 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.857+0000 7fe2f293b640 1 -- 172.21.15.167:0/3711680970 wait complete. 2024-04-25T08:53:19.858 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 1e876c9c-a1d4-4dc0-a615-ee47696047fd 5 2024-04-25T08:53:19.948 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:19.958+0000 7f947ef27040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T08:53:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.965+0000 7fc902368640 1 Processor -- start 2024-04-25T08:53:19.955 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.965+0000 7fc902368640 1 -- start start 2024-04-25T08:53:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc902368640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8fc0b3890 0x7fc8fc0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc902368640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc06ac30 0x7fc8fc06b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc902368640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc06ebb0 con 0x7fc8fc15f9e0 2024-04-25T08:53:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc902368640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8fc06ee90 con 0x7fc8fc0b3890 2024-04-25T08:53:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc902368640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc06f170 con 0x7fc8fc06ac30 2024-04-25T08:53:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc900905640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc06ac30 0x7fc8fc06b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.957 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc8fbfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc8fc15f9e0 0x7fc8fc06e0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37094/0 (socket says 172.21.15.167:37094) 2024-04-25T08:53:19.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc8fbfff640 1 -- 172.21.15.167:0/2320058768 learned_addr learned my addr 172.21.15.167:0/2320058768 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-04-25T08:53:19.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc8fb7fe640 1 --2- 172.21.15.167:0/2320058768 >> v2:172.21.15.55:3300/0 conn(0x7fc8fc0b3890 0x7fc8fc0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc8faffd640 1 -- 172.21.15.167:0/2320058768 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203027785 0 0) 0x7fc8fc06ebb0 con 0x7fc8fc15f9e0 2024-04-25T08:53:19.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc900905640 1 -- 172.21.15.167:0/2320058768 >> v2:172.21.15.55:3300/0 conn(0x7fc8fc0b3890 msgr2=0x7fc8fc0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:19.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc900905640 1 --2- 172.21.15.167:0/2320058768 >> v2:172.21.15.55:3300/0 conn(0x7fc8fc0b3890 0x7fc8fc0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc900905640 1 -- 172.21.15.167:0/2320058768 >> v1:172.21.15.167:6789/0 conn(0x7fc8fc15f9e0 legacy=0x7fc8fc06e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.958 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.966+0000 7fc900905640 1 -- 172.21.15.167:0/2320058768 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc06f450 con 0x7fc8fc06ac30 2024-04-25T08:53:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.967+0000 7fc900905640 1 --2- 172.21.15.167:0/2320058768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc06ac30 0x7fc8fc06b040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009d90 tx=0x7fc8f402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee4cf52f43b9b328 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:19.959 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.967+0000 7fc8faffd640 1 -- 172.21.15.167:0/2320058768 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4007740 con 0x7fc8fc06ac30 2024-04-25T08:53:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.968+0000 7fc8faffd640 1 -- 172.21.15.167:0/2320058768 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f40078e0 con 0x7fc8fc06ac30 2024-04-25T08:53:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.968+0000 7fc8faffd640 1 -- 172.21.15.167:0/2320058768 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4007cb0 con 0x7fc8fc06ac30 2024-04-25T08:53:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.968+0000 7fc902368640 1 -- 172.21.15.167:0/2320058768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc06ac30 msgr2=0x7fc8fc06b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.968+0000 7fc902368640 1 --2- 172.21.15.167:0/2320058768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc06ac30 0x7fc8fc06b040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009d90 tx=0x7fc8f402a660 comp rx=0 tx=0).stop 2024-04-25T08:53:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.968+0000 7fc902368640 1 -- 172.21.15.167:0/2320058768 shutdown_connections 2024-04-25T08:53:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.968+0000 7fc902368640 1 --2- 172.21.15.167:0/2320058768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc06ac30 0x7fc8fc06b040 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.968+0000 7fc902368640 1 --2- 172.21.15.167:0/2320058768 >> v2:172.21.15.55:3300/0 conn(0x7fc8fc0b3890 0x7fc8fc0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.968+0000 7fc902368640 1 -- 172.21.15.167:0/2320058768 >> 172.21.15.167:0/2320058768 conn(0x7fc8fc0cff30 msgr2=0x7fc8fc0d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.968+0000 7fc902368640 1 -- 172.21.15.167:0/2320058768 shutdown_connections 2024-04-25T08:53:19.960 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.968+0000 7fc902368640 1 -- 172.21.15.167:0/2320058768 wait complete. 2024-04-25T08:53:19.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.970+0000 7fc902368640 1 Processor -- start 2024-04-25T08:53:19.961 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.970+0000 7fc902368640 1 -- start start 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.971+0000 7fc902368640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8fc06ac30 0x7fc8fc1fad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.971+0000 7fc902368640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc0b3890 0x7fc8fc163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc902368640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc15f9e0 0x7fc8fc1613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc902368640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc06e800 con 0x7fc8fc06ac30 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc902368640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc162850 con 0x7fc8fc0b3890 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc902368640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc1fb640 con 0x7fc8fc15f9e0 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8fb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc0b3890 0x7fc8fc163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8fb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc0b3890 0x7fc8fc163fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42434/0 (socket says 172.21.15.167:42434) 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8fb7fe640 1 -- 172.21.15.167:0/751616326 learned_addr learned my addr 172.21.15.167:0/751616326 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc900905640 1 --2- 172.21.15.167:0/751616326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc15f9e0 0x7fc8fc1613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8fbfff640 1 --2- 172.21.15.167:0/751616326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8fc06ac30 0x7fc8fc1fad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8fb7fe640 1 -- 172.21.15.167:0/751616326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc15f9e0 msgr2=0x7fc8fc1613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.964 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8fb7fe640 1 --2- 172.21.15.167:0/751616326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc15f9e0 0x7fc8fc1613b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8fb7fe640 1 -- 172.21.15.167:0/751616326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8fc06ac30 msgr2=0x7fc8fc1fad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8fb7fe640 1 --2- 172.21.15.167:0/751616326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8fc06ac30 0x7fc8fc1fad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8fb7fe640 1 -- 172.21.15.167:0/751616326 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc1fb920 con 0x7fc8fc0b3890 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc900905640 1 --2- 172.21.15.167:0/751616326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc15f9e0 0x7fc8fc1613b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8fbfff640 1 --2- 172.21.15.167:0/751616326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8fc06ac30 0x7fc8fc1fad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8fb7fe640 1 --2- 172.21.15.167:0/751616326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc0b3890 0x7fc8fc163fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000e9b0 tx=0x7fc8f000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8f8ff9640 1 -- 172.21.15.167:0/751616326 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0017070 con 0x7fc8fc0b3890 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8f8ff9640 1 -- 172.21.15.167:0/751616326 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f000c9a0 con 0x7fc8fc0b3890 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc8f8ff9640 1 -- 172.21.15.167:0/751616326 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f000cd90 con 0x7fc8fc0b3890 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc902368640 1 -- 172.21.15.167:0/751616326 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc1637b0 con 0x7fc8fc0b3890 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.972+0000 7fc902368640 1 -- 172.21.15.167:0/751616326 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc1fbc00 con 0x7fc8fc0b3890 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.973+0000 7fc8f8ff9640 1 -- 172.21.15.167:0/751616326 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc8f001a070 con 0x7fc8fc0b3890 2024-04-25T08:53:19.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.973+0000 7fc8f8ff9640 1 -- 172.21.15.167:0/751616326 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc8f0006660 con 0x7fc8fc0b3890 2024-04-25T08:53:19.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.974+0000 7fc902368640 1 -- 172.21.15.167:0/751616326 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc0b2c00 con 0x7fc8fc0b3890 2024-04-25T08:53:19.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:19.976+0000 7fc8f8ff9640 1 -- 172.21.15.167:0/751616326 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc8fc0b2c00 con 0x7fc8fc0b3890 2024-04-25T08:53:19.998 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:20.008+0000 7f947ef27040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T08:53:20.020 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:20.030+0000 7fd7719d3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T08:53:20.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.048+0000 7fc902368640 1 -- 172.21.15.167:0/751616326 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1e876c9c-a1d4-4dc0-a615-ee47696047fd", "id": 5} v 0) v1 -- 0x7fc8fc0750b0 con 0x7fc8fc0b3890 2024-04-25T08:53:20.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.051+0000 7fc8f8ff9640 1 -- 172.21.15.167:0/751616326 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e876c9c-a1d4-4dc0-a615-ee47696047fd", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc8f0005a60 con 0x7fc8fc0b3890 2024-04-25T08:53:20.042 INFO:teuthology.orchestra.run.smithi167.stdout:5 2024-04-25T08:53:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.052+0000 7fc902368640 1 -- 172.21.15.167:0/751616326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc0b3890 msgr2=0x7fc8fc163fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.052+0000 7fc902368640 1 --2- 172.21.15.167:0/751616326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc0b3890 0x7fc8fc163fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000e9b0 tx=0x7fc8f000ee70 comp rx=0 tx=0).stop 2024-04-25T08:53:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.052+0000 7fc902368640 1 -- 172.21.15.167:0/751616326 shutdown_connections 2024-04-25T08:53:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.052+0000 7fc902368640 1 --2- 172.21.15.167:0/751616326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc15f9e0 0x7fc8fc1613b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.052+0000 7fc902368640 1 --2- 172.21.15.167:0/751616326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc0b3890 0x7fc8fc163fb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.052+0000 7fc902368640 1 --2- 172.21.15.167:0/751616326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8fc06ac30 0x7fc8fc1fad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.052+0000 7fc902368640 1 -- 172.21.15.167:0/751616326 >> 172.21.15.167:0/751616326 conn(0x7fc8fc0cff30 msgr2=0x7fc8fc0b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.052+0000 7fc902368640 1 -- 172.21.15.167:0/751616326 shutdown_connections 2024-04-25T08:53:20.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.052+0000 7fc902368640 1 -- 172.21.15.167:0/751616326 wait complete. 2024-04-25T08:53:20.053 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new a9bd913f-c780-4e2a-a4c9-6eb958ac2d83 6 2024-04-25T08:53:20.054 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:20.063+0000 7f947ef27040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T08:53:20.113 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:20.122+0000 7fd7719d3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T08:53:20.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.160+0000 7f6d1e238640 1 Processor -- start 2024-04-25T08:53:20.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.160+0000 7f6d1e238640 1 -- start start 2024-04-25T08:53:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.161+0000 7f6d1e238640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1815bb20 0x7f6d180ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.161+0000 7f6d1e238640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d180cc740 con 0x7f6d1806b5b0 2024-04-25T08:53:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.161+0000 7f6d1e238640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d180cca20 con 0x7f6d180b10b0 2024-04-25T08:53:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.161+0000 7f6d1e238640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180cc510 con 0x7f6d1815bb20 2024-04-25T08:53:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.161+0000 7f6d177fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1815bb20 0x7f6d180ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.161+0000 7f6d17fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6d180b10b0 0x7f6d180b1770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37106/0 (socket says 172.21.15.167:37106) 2024-04-25T08:53:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.161+0000 7f6d177fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1815bb20 0x7f6d180ad570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:59934/0 (socket says 172.21.15.167:59934) 2024-04-25T08:53:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.161+0000 7f6d17fff640 1 -- 172.21.15.167:0/128483326 learned_addr learned my addr 172.21.15.167:0/128483326 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-04-25T08:53:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.162+0000 7f6d16ffd640 1 -- 172.21.15.167:0/128483326 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409188819 0 0) 0x7f6d180cca20 con 0x7f6d180b10b0 2024-04-25T08:53:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.162+0000 7f6d177fe640 1 -- 172.21.15.167:0/128483326 >> v1:172.21.15.167:6789/0 conn(0x7f6d180b10b0 legacy=0x7f6d180b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.162+0000 7f6d177fe640 1 -- 172.21.15.167:0/128483326 >> v1:172.21.15.55:6789/0 conn(0x7f6d1806b5b0 legacy=0x7f6d180cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.162+0000 7f6d177fe640 1 -- 172.21.15.167:0/128483326 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180ccd00 con 0x7f6d1815bb20 2024-04-25T08:53:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.162+0000 7f6d177fe640 1 --2- 172.21.15.167:0/128483326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1815bb20 0x7f6d180ad570 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d080097d0 tx=0x7f6d0802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63aa150757ee577f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.162+0000 7f6d16ffd640 1 -- 172.21.15.167:0/128483326 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08037070 con 0x7f6d1815bb20 2024-04-25T08:53:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.163+0000 7f6d16ffd640 1 -- 172.21.15.167:0/128483326 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d08032440 con 0x7f6d1815bb20 2024-04-25T08:53:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.163+0000 7f6d16ffd640 1 -- 172.21.15.167:0/128483326 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08032810 con 0x7f6d1815bb20 2024-04-25T08:53:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.163+0000 7f6d1e238640 1 -- 172.21.15.167:0/128483326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1815bb20 msgr2=0x7f6d180ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.163+0000 7f6d1e238640 1 --2- 172.21.15.167:0/128483326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1815bb20 0x7f6d180ad570 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d080097d0 tx=0x7f6d0802a210 comp rx=0 tx=0).stop 2024-04-25T08:53:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.163+0000 7f6d1e238640 1 -- 172.21.15.167:0/128483326 shutdown_connections 2024-04-25T08:53:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.163+0000 7f6d1e238640 1 --2- 172.21.15.167:0/128483326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1815bb20 0x7f6d180ad570 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.163+0000 7f6d1e238640 1 -- 172.21.15.167:0/128483326 >> 172.21.15.167:0/128483326 conn(0x7f6d18099a40 msgr2=0x7f6d180d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.163+0000 7f6d1e238640 1 -- 172.21.15.167:0/128483326 shutdown_connections 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.163+0000 7f6d1e238640 1 -- 172.21.15.167:0/128483326 wait complete. 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.164+0000 7f6d1e238640 1 Processor -- start 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.164+0000 7f6d1e238640 1 -- start start 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.165+0000 7f6d1e238640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d1806b5b0 0x7f6d1814bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.165+0000 7f6d1e238640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d180b10b0 0x7f6d1814c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.165+0000 7f6d1e238640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1815bb20 0x7f6d180c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.165+0000 7f6d1e238640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1815bf00 con 0x7f6d1806b5b0 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.165+0000 7f6d1e238640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180cd350 con 0x7f6d1815bb20 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.165+0000 7f6d1e238640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1809a010 con 0x7f6d180b10b0 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.165+0000 7f6d0ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d180b10b0 0x7f6d1814c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.165+0000 7f6d0ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d180b10b0 0x7f6d1814c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:59940/0 (socket says 172.21.15.167:59940) 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.165+0000 7f6d17fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1815bb20 0x7f6d180c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.165+0000 7f6d0ffff640 1 -- 172.21.15.167:0/774049709 learned_addr learned my addr 172.21.15.167:0/774049709 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.165+0000 7f6d177fe640 1 --2- 172.21.15.167:0/774049709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d1806b5b0 0x7f6d1814bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d0ffff640 1 -- 172.21.15.167:0/774049709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1815bb20 msgr2=0x7f6d180c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d0ffff640 1 --2- 172.21.15.167:0/774049709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1815bb20 0x7f6d180c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d0ffff640 1 -- 172.21.15.167:0/774049709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d1806b5b0 msgr2=0x7f6d1814bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d0ffff640 1 --2- 172.21.15.167:0/774049709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d1806b5b0 0x7f6d1814bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d0ffff640 1 -- 172.21.15.167:0/774049709 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180c7c90 con 0x7f6d180b10b0 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d17fff640 1 --2- 172.21.15.167:0/774049709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1815bb20 0x7f6d180c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d0ffff640 1 --2- 172.21.15.167:0/774049709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d180b10b0 0x7f6d1814c580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000c480 tx=0x7f6d0000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d14ff9640 1 -- 172.21.15.167:0/774049709 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000052d0 con 0x7f6d180b10b0 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d14ff9640 1 -- 172.21.15.167:0/774049709 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d00005470 con 0x7f6d180b10b0 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d14ff9640 1 -- 172.21.15.167:0/774049709 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00012870 con 0x7f6d180b10b0 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d1e238640 1 -- 172.21.15.167:0/774049709 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d180c7f70 con 0x7f6d180b10b0 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d1e238640 1 -- 172.21.15.167:0/774049709 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d180c8530 con 0x7f6d180b10b0 2024-04-25T08:53:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d14ff9640 1 -- 172.21.15.167:0/774049709 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6d00012a10 con 0x7f6d180b10b0 2024-04-25T08:53:20.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.166+0000 7f6d14ff9640 1 -- 172.21.15.167:0/774049709 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f6d0001ba90 con 0x7f6d180b10b0 2024-04-25T08:53:20.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.167+0000 7f6d1e238640 1 -- 172.21.15.167:0/774049709 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d180750b0 con 0x7f6d180b10b0 2024-04-25T08:53:20.161 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:20.168+0000 7fd7719d3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T08:53:20.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.171+0000 7f6d14ff9640 1 -- 172.21.15.167:0/774049709 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6d0001b4a0 con 0x7f6d180b10b0 2024-04-25T08:53:20.171 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:20.181+0000 7f947ef27040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:53:20.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.241+0000 7f6d1e238640 1 -- 172.21.15.167:0/774049709 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a9bd913f-c780-4e2a-a4c9-6eb958ac2d83", "id": 6} v 0) v1 -- 0x7f6d180af280 con 0x7f6d180b10b0 2024-04-25T08:53:20.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.249+0000 7f6d14ff9640 1 -- 172.21.15.167:0/774049709 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a9bd913f-c780-4e2a-a4c9-6eb958ac2d83", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6d0001b680 con 0x7f6d180b10b0 2024-04-25T08:53:20.240 INFO:teuthology.orchestra.run.smithi167.stdout:6 2024-04-25T08:53:20.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.250+0000 7f6d1e238640 1 -- 172.21.15.167:0/774049709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d180b10b0 msgr2=0x7f6d1814c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.250+0000 7f6d1e238640 1 --2- 172.21.15.167:0/774049709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d180b10b0 0x7f6d1814c580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000c480 tx=0x7f6d0000c940 comp rx=0 tx=0).stop 2024-04-25T08:53:20.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.250+0000 7f6d1e238640 1 -- 172.21.15.167:0/774049709 shutdown_connections 2024-04-25T08:53:20.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.250+0000 7f6d1e238640 1 --2- 172.21.15.167:0/774049709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1815bb20 0x7f6d180c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.250+0000 7f6d1e238640 1 --2- 172.21.15.167:0/774049709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d180b10b0 0x7f6d1814c580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.250+0000 7f6d1e238640 1 --2- 172.21.15.167:0/774049709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d1806b5b0 0x7f6d1814bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.250+0000 7f6d1e238640 1 -- 172.21.15.167:0/774049709 >> 172.21.15.167:0/774049709 conn(0x7f6d18099a40 msgr2=0x7f6d180b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:20.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.250+0000 7f6d1e238640 1 -- 172.21.15.167:0/774049709 shutdown_connections 2024-04-25T08:53:20.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.250+0000 7f6d1e238640 1 -- 172.21.15.167:0/774049709 wait complete. 2024-04-25T08:53:20.251 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new fafadc46-2e92-422f-bffa-2fbc3f6b978d 7 2024-04-25T08:53:20.332 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:20.342+0000 7fd7719d3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T08:53:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.359+0000 7ff69b8f5640 1 Processor -- start 2024-04-25T08:53:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.359+0000 7ff69b8f5640 1 -- start start 2024-04-25T08:53:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.360+0000 7ff69b8f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff6940cf590 0x7ff6940cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.360+0000 7ff69b8f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff694099b20 0x7ff694099f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.360+0000 7ff69b8f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6940cc820 con 0x7ff69415bb60 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.360+0000 7ff69b8f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69409a4d0 con 0x7ff694099b20 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.360+0000 7ff69b8f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6940cd430 con 0x7ff6940cf590 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.360+0000 7ff698e90640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff6940cf590 0x7ff6940cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.360+0000 7ff698e90640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff6940cf590 0x7ff6940cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42466/0 (socket says 172.21.15.167:42466) 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.360+0000 7ff698e90640 1 -- 172.21.15.167:0/1591126546 learned_addr learned my addr 172.21.15.167:0/1591126546 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.360+0000 7ff699e92640 1 --2- 172.21.15.167:0/1591126546 >> v2:172.21.15.55:3300/0 conn(0x7ff694099b20 0x7ff694099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.361+0000 7ff698e90640 1 -- 172.21.15.167:0/1591126546 >> v2:172.21.15.55:3300/0 conn(0x7ff694099b20 msgr2=0x7ff694099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.361+0000 7ff698e90640 1 --2- 172.21.15.167:0/1591126546 >> v2:172.21.15.55:3300/0 conn(0x7ff694099b20 0x7ff694099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.361+0000 7ff698e90640 1 -- 172.21.15.167:0/1591126546 >> v1:172.21.15.55:6789/0 conn(0x7ff69415bb60 legacy=0x7ff6940d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.361+0000 7ff698e90640 1 -- 172.21.15.167:0/1591126546 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6940ccb00 con 0x7ff6940cf590 2024-04-25T08:53:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.361+0000 7ff699e92640 1 --2- 172.21.15.167:0/1591126546 >> v2:172.21.15.55:3300/0 conn(0x7ff694099b20 0x7ff694099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.362+0000 7ff698e90640 1 --2- 172.21.15.167:0/1591126546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6940cf590 0x7ff6940cd8c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff69409ac30 tx=0x7ff68402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9ae5932640e7258 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.362+0000 7ff68bfff640 1 -- 172.21.15.167:0/1591126546 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684037070 con 0x7ff6940cf590 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.362+0000 7ff68bfff640 1 -- 172.21.15.167:0/1591126546 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff684032440 con 0x7ff6940cf590 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.362+0000 7ff68bfff640 1 -- 172.21.15.167:0/1591126546 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684032810 con 0x7ff6940cf590 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.363+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1591126546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6940cf590 msgr2=0x7ff6940cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.363+0000 7ff69b8f5640 1 --2- 172.21.15.167:0/1591126546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6940cf590 0x7ff6940cd8c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff69409ac30 tx=0x7ff68402a270 comp rx=0 tx=0).stop 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.363+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1591126546 shutdown_connections 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.363+0000 7ff69b8f5640 1 --2- 172.21.15.167:0/1591126546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6940cf590 0x7ff6940cd8c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.363+0000 7ff69b8f5640 1 --2- 172.21.15.167:0/1591126546 >> v2:172.21.15.55:3300/0 conn(0x7ff694099b20 0x7ff694099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.363+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1591126546 >> 172.21.15.167:0/1591126546 conn(0x7ff6940b33b0 msgr2=0x7ff6940b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.363+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1591126546 shutdown_connections 2024-04-25T08:53:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.363+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1591126546 wait complete. 2024-04-25T08:53:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.365+0000 7ff69b8f5640 1 Processor -- start 2024-04-25T08:53:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.365+0000 7ff69b8f5640 1 -- start start 2024-04-25T08:53:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff69b8f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff694099b20 0x7ff694156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff69b8f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6940cf590 0x7ff6941e5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff69b8f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff69415bb60 0x7ff6941e5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff69b8f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940cde00 con 0x7ff6940cf590 2024-04-25T08:53:20.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff69b8f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940cd0c0 con 0x7ff69415bb60 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff69b8f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940cc440 con 0x7ff694099b20 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699691640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff694099b20 0x7ff694156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699e92640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff69415bb60 0x7ff6941e5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699e92640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff69415bb60 0x7ff6941e5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42482/0 (socket says 172.21.15.167:42482) 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699691640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff694099b20 0x7ff694156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:59956/0 (socket says 172.21.15.167:59956) 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699e92640 1 -- 172.21.15.167:0/1428879250 learned_addr learned my addr 172.21.15.167:0/1428879250 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff698e90640 1 --2- 172.21.15.167:0/1428879250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6940cf590 0x7ff6941e5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699e92640 1 -- 172.21.15.167:0/1428879250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff694099b20 msgr2=0x7ff694156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699e92640 1 --2- 172.21.15.167:0/1428879250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff694099b20 0x7ff694156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699e92640 1 -- 172.21.15.167:0/1428879250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6940cf590 msgr2=0x7ff6941e5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699e92640 1 --2- 172.21.15.167:0/1428879250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6940cf590 0x7ff6941e5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699e92640 1 -- 172.21.15.167:0/1428879250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6940c5740 con 0x7ff69415bb60 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff698e90640 1 --2- 172.21.15.167:0/1428879250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6940cf590 0x7ff6941e5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699691640 1 --2- 172.21.15.167:0/1428879250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff694099b20 0x7ff694156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.366+0000 7ff699e92640 1 --2- 172.21.15.167:0/1428879250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff69415bb60 0x7ff6941e5ea0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00efc0 tx=0x7ff68c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.367+0000 7ff689ffb640 1 -- 172.21.15.167:0/1428879250 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c018030 con 0x7ff69415bb60 2024-04-25T08:53:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.367+0000 7ff689ffb640 1 -- 172.21.15.167:0/1428879250 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c00cdf0 con 0x7ff69415bb60 2024-04-25T08:53:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.367+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1428879250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6940ca3f0 con 0x7ff69415bb60 2024-04-25T08:53:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.367+0000 7ff689ffb640 1 -- 172.21.15.167:0/1428879250 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c003bb0 con 0x7ff69415bb60 2024-04-25T08:53:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.367+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1428879250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6940ca9b0 con 0x7ff69415bb60 2024-04-25T08:53:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.367+0000 7ff689ffb640 1 -- 172.21.15.167:0/1428879250 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff68c01b070 con 0x7ff69415bb60 2024-04-25T08:53:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.367+0000 7ff689ffb640 1 -- 172.21.15.167:0/1428879250 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ff68c01dac0 con 0x7ff69415bb60 2024-04-25T08:53:20.360 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.368+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1428879250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6940750b0 con 0x7ff69415bb60 2024-04-25T08:53:20.362 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.371+0000 7ff689ffb640 1 -- 172.21.15.167:0/1428879250 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff68c010040 con 0x7ff69415bb60 2024-04-25T08:53:20.397 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:20.407+0000 7fd7719d3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T08:53:20.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.444+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1428879250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fafadc46-2e92-422f-bffa-2fbc3f6b978d", "id": 7} v 0) v1 -- 0x7ff6940d1610 con 0x7ff69415bb60 2024-04-25T08:53:20.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.454+0000 7ff689ffb640 1 -- 172.21.15.167:0/1428879250 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fafadc46-2e92-422f-bffa-2fbc3f6b978d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff68c01d460 con 0x7ff69415bb60 2024-04-25T08:53:20.445 INFO:teuthology.orchestra.run.smithi167.stdout:7 2024-04-25T08:53:20.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.455+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1428879250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff69415bb60 msgr2=0x7ff6941e5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.455+0000 7ff69b8f5640 1 --2- 172.21.15.167:0/1428879250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff69415bb60 0x7ff6941e5ea0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00efc0 tx=0x7ff68c00c490 comp rx=0 tx=0).stop 2024-04-25T08:53:20.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.455+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1428879250 shutdown_connections 2024-04-25T08:53:20.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.456+0000 7ff69b8f5640 1 --2- 172.21.15.167:0/1428879250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff69415bb60 0x7ff6941e5ea0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.456+0000 7ff69b8f5640 1 --2- 172.21.15.167:0/1428879250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6940cf590 0x7ff6941e5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.456+0000 7ff69b8f5640 1 --2- 172.21.15.167:0/1428879250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff694099b20 0x7ff694156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.456+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1428879250 >> 172.21.15.167:0/1428879250 conn(0x7ff6940b33b0 msgr2=0x7ff6940ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:20.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.456+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1428879250 shutdown_connections 2024-04-25T08:53:20.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T08:53:20.456+0000 7ff69b8f5640 1 -- 172.21.15.167:0/1428879250 wait complete. 2024-04-25T08:53:20.452 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:20.462+0000 7fd7719d3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T08:53:20.456 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T08:53:20.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T08:53:20.459 INFO:tasks.ceph.osd.0:Started 2024-04-25T08:53:20.459 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T08:53:20.459 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T08:53:20.461 INFO:tasks.ceph.osd.1:Started 2024-04-25T08:53:20.461 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T08:53:20.461 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T08:53:20.463 INFO:tasks.ceph.osd.2:Started 2024-04-25T08:53:20.463 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T08:53:20.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T08:53:20.465 INFO:tasks.ceph.osd.3:Started 2024-04-25T08:53:20.465 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T08:53:20.465 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T08:53:20.467 INFO:tasks.ceph.osd.4:Started 2024-04-25T08:53:20.467 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T08:53:20.468 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T08:53:20.469 INFO:tasks.ceph.osd.5:Started 2024-04-25T08:53:20.469 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T08:53:20.469 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T08:53:20.471 INFO:tasks.ceph.osd.6:Started 2024-04-25T08:53:20.471 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T08:53:20.471 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T08:53:20.474 INFO:tasks.ceph.osd.7:Started 2024-04-25T08:53:20.474 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:20.591 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:20.601+0000 7fd7719d3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:53:20.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.603+0000 7f53e5110640 1 Processor -- start 2024-04-25T08:53:20.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.603+0000 7f53e5110640 1 -- start start 2024-04-25T08:53:20.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.604+0000 7f53e5110640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53e015f120 0x7f53e00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.604+0000 7f53e5110640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e00d0430 con 0x7f53e00ce830 2024-04-25T08:53:20.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.604+0000 7f53e5110640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e00d0710 con 0x7f53e00cfdb0 2024-04-25T08:53:20.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.604+0000 7f53e5110640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e00d09f0 con 0x7f53e015f120 2024-04-25T08:53:20.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.604+0000 7f53ded9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53e015f120 0x7f53e00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.604+0000 7f53de59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f53e00ce830 0x7f53e00cf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34736/0 (socket says 172.21.15.55:34736) 2024-04-25T08:53:20.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.604+0000 7f53de59c640 1 -- 172.21.15.55:0/718874877 learned_addr learned my addr 172.21.15.55:0/718874877 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:20.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.604+0000 7f53df59e640 1 --1- 172.21.15.55:0/718874877 >> v1:172.21.15.167:6789/0 conn(0x7f53e00cfdb0 0x7f53e00ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:57656/0 (socket says 172.21.15.55:57656) 2024-04-25T08:53:20.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.604+0000 7f53ddd9b640 1 -- 172.21.15.55:0/718874877 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187956031 0 0) 0x7f53e00d0430 con 0x7f53e00ce830 2024-04-25T08:53:20.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.605+0000 7f53ded9d640 1 -- 172.21.15.55:0/718874877 >> v1:172.21.15.167:6789/0 conn(0x7f53e00cfdb0 legacy=0x7f53e00ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.605+0000 7f53ded9d640 1 -- 172.21.15.55:0/718874877 >> v1:172.21.15.55:6789/0 conn(0x7f53e00ce830 legacy=0x7f53e00cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.605+0000 7f53ded9d640 1 -- 172.21.15.55:0/718874877 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e00cc7d0 con 0x7f53e015f120 2024-04-25T08:53:20.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.605+0000 7f53ded9d640 1 --2- 172.21.15.55:0/718874877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e015f120 0x7f53e00ce2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f53d00097a0 tx=0x7f53d002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67740bc84994722c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:20.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.605+0000 7f53ddd9b640 1 -- 172.21.15.55:0/718874877 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0037070 con 0x7f53e015f120 2024-04-25T08:53:20.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.605+0000 7f53ddd9b640 1 -- 172.21.15.55:0/718874877 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0032640 con 0x7f53e015f120 2024-04-25T08:53:20.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.606+0000 7f53ddd9b640 1 -- 172.21.15.55:0/718874877 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0032a10 con 0x7f53e015f120 2024-04-25T08:53:20.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.606+0000 7f53e5110640 1 -- 172.21.15.55:0/718874877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e015f120 msgr2=0x7f53e00ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.606+0000 7f53e5110640 1 --2- 172.21.15.55:0/718874877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e015f120 0x7f53e00ce2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f53d00097a0 tx=0x7f53d002a2c0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.606+0000 7f53e5110640 1 -- 172.21.15.55:0/718874877 shutdown_connections 2024-04-25T08:53:20.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.606+0000 7f53e5110640 1 --2- 172.21.15.55:0/718874877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e015f120 0x7f53e00ce2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.606+0000 7f53e5110640 1 -- 172.21.15.55:0/718874877 >> 172.21.15.55:0/718874877 conn(0x7f53e00d1900 msgr2=0x7f53e00d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:20.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.606+0000 7f53e5110640 1 -- 172.21.15.55:0/718874877 shutdown_connections 2024-04-25T08:53:20.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.606+0000 7f53e5110640 1 -- 172.21.15.55:0/718874877 wait complete. 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.608+0000 7f53e5110640 1 Processor -- start 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.608+0000 7f53e5110640 1 -- start start 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.608+0000 7f53e5110640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00ce830 0x7f53e00b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.608+0000 7f53e5110640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e00cfdb0 0x7f53e015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.608+0000 7f53e5110640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e015f120 0x7f53e00ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.608+0000 7f53e5110640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00cc480 con 0x7f53e00ce830 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.608+0000 7f53e5110640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00cec70 con 0x7f53e00cfdb0 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.608+0000 7f53e5110640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00c5450 con 0x7f53e015f120 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53ded9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00ce830 0x7f53e00b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53ded9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00ce830 0x7f53e00b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42042/0 (socket says 172.21.15.55:42042) 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53ded9d640 1 -- 172.21.15.55:0/1689390856 learned_addr learned my addr 172.21.15.55:0/1689390856 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:20.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53df59e640 1 --2- 172.21.15.55:0/1689390856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e015f120 0x7f53e00ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53de59c640 1 --2- 172.21.15.55:0/1689390856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e00cfdb0 0x7f53e015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53ded9d640 1 -- 172.21.15.55:0/1689390856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e015f120 msgr2=0x7f53e00ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53ded9d640 1 --2- 172.21.15.55:0/1689390856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e015f120 0x7f53e00ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53ded9d640 1 -- 172.21.15.55:0/1689390856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e00cfdb0 msgr2=0x7f53e015abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53ded9d640 1 --2- 172.21.15.55:0/1689390856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e00cfdb0 0x7f53e015abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53ded9d640 1 -- 172.21.15.55:0/1689390856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e00b6400 con 0x7f53e00ce830 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53ded9d640 1 --2- 172.21.15.55:0/1689390856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00ce830 0x7f53e00b5e20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f53d00098c0 tx=0x7f53d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53c77fe640 1 -- 172.21.15.55:0/1689390856 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0041020 con 0x7f53e00ce830 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53c77fe640 1 -- 172.21.15.55:0/1689390856 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0030970 con 0x7f53e00ce830 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53c77fe640 1 -- 172.21.15.55:0/1689390856 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0037040 con 0x7f53e00ce830 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53e5110640 1 -- 172.21.15.55:0/1689390856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e00b66e0 con 0x7f53e00ce830 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.609+0000 7f53e5110640 1 -- 172.21.15.55:0/1689390856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e00b6ca0 con 0x7f53e00ce830 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.610+0000 7f53c77fe640 1 -- 172.21.15.55:0/1689390856 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f53d0044020 con 0x7f53e00ce830 2024-04-25T08:53:20.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.610+0000 7f53c77fe640 1 -- 172.21.15.55:0/1689390856 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f53d00325f0 con 0x7f53e00ce830 2024-04-25T08:53:20.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.611+0000 7f53e5110640 1 -- 172.21.15.55:0/1689390856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e0067850 con 0x7f53e00ce830 2024-04-25T08:53:20.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.613+0000 7f53c77fe640 1 -- 172.21.15.55:0/1689390856 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f53d004b030 con 0x7f53e00ce830 2024-04-25T08:53:20.616 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:20.626+0000 7f947ef27040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T08:53:20.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.675+0000 7f53e5110640 1 -- 172.21.15.55:0/1689390856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53e00b6ee0 con 0x7f53e00ce830 2024-04-25T08:53:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.676+0000 7f53c77fe640 1 -- 172.21.15.55:0/1689390856 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f53d003d990 con 0x7f53e00ce830 2024-04-25T08:53:20.666 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:20.666 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":10,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:20.446747+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.676+0000 7f53e5110640 1 -- 172.21.15.55:0/1689390856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00ce830 msgr2=0x7f53e00b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.676+0000 7f53e5110640 1 --2- 172.21.15.55:0/1689390856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00ce830 0x7f53e00b5e20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f53d00098c0 tx=0x7f53d00046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.676+0000 7f53e5110640 1 -- 172.21.15.55:0/1689390856 shutdown_connections 2024-04-25T08:53:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.676+0000 7f53e5110640 1 --2- 172.21.15.55:0/1689390856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e015f120 0x7f53e00ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.677+0000 7f53e5110640 1 --2- 172.21.15.55:0/1689390856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e00cfdb0 0x7f53e015abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.677+0000 7f53e5110640 1 --2- 172.21.15.55:0/1689390856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00ce830 0x7f53e00b5e20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.677+0000 7f53e5110640 1 -- 172.21.15.55:0/1689390856 >> 172.21.15.55:0/1689390856 conn(0x7f53e00d1900 msgr2=0x7f53e00b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.677+0000 7f53e5110640 1 -- 172.21.15.55:0/1689390856 shutdown_connections 2024-04-25T08:53:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:20.677+0000 7f53e5110640 1 -- 172.21.15.55:0/1689390856 wait complete. 2024-04-25T08:53:20.677 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T08:53:20.677 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T08:53:20.889 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:20.899+0000 7f947ef27040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T08:53:20.944 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:20.954+0000 7f947ef27040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T08:53:20.972 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:20.982+0000 7fd7719d3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T08:53:21.062 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-04-25T08:53:21.071+0000 7fa867ba7640 -1 Falling back to public interface 2024-04-25T08:53:21.064 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-04-25T08:53:21.074+0000 7f7239bbe640 -1 Falling back to public interface 2024-04-25T08:53:21.065 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:21.075+0000 7f947ef27040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T08:53:21.066 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-04-25T08:53:21.075+0000 7fe24be18640 -1 Falling back to public interface 2024-04-25T08:53:21.081 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-04-25T08:53:21.091+0000 7f38edab5640 -1 Falling back to public interface 2024-04-25T08:53:21.089 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-04-25T08:53:21.099+0000 7fd54d43d640 -1 Falling back to public interface 2024-04-25T08:53:21.090 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-04-25T08:53:21.100+0000 7f82742dd640 -1 Falling back to public interface 2024-04-25T08:53:21.091 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-04-25T08:53:21.101+0000 7f1e60c19640 -1 Falling back to public interface 2024-04-25T08:53:21.093 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-04-25T08:53:21.103+0000 7f5bb189b640 -1 Falling back to public interface 2024-04-25T08:53:21.233 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:21.243+0000 7fd7719d3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T08:53:21.286 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:21.295+0000 7fd7719d3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T08:53:21.365 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:21.375+0000 7f947ef27040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T08:53:21.403 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:21.413+0000 7fd7719d3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T08:53:21.415 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:21.425+0000 7f947ef27040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T08:53:21.481 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:21.575 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.585+0000 7f3046c4d640 1 Processor -- start 2024-04-25T08:53:21.575 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.585+0000 7f3046c4d640 1 -- start start 2024-04-25T08:53:21.576 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.585+0000 7f3046c4d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304015f180 0x7f304006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:21.576 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.585+0000 7f3046c4d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3040071ba0 0x7f3040071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:21.576 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.585+0000 7f3046c4d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3040072990 con 0x7f3040072520 2024-04-25T08:53:21.576 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.585+0000 7f3046c4d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304006faa0 con 0x7f3040071ba0 2024-04-25T08:53:21.576 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.585+0000 7f3046c4d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304006f7c0 con 0x7f304015f180 2024-04-25T08:53:21.576 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.586+0000 7f303ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3040071ba0 0x7f3040071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:21.576 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.586+0000 7f303ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3040071ba0 0x7f3040071fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42052/0 (socket says 172.21.15.55:42052) 2024-04-25T08:53:21.577 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.586+0000 7f303ffff640 1 -- 172.21.15.55:0/3168936722 learned_addr learned my addr 172.21.15.55:0/3168936722 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:21.577 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.586+0000 7f30449e9640 1 --2- 172.21.15.55:0/3168936722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304015f180 0x7f304006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:21.577 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.586+0000 7f303ffff640 1 -- 172.21.15.55:0/3168936722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304015f180 msgr2=0x7f304006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:21.577 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.586+0000 7f303ffff640 1 --2- 172.21.15.55:0/3168936722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304015f180 0x7f304006dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:21.577 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.586+0000 7f303ffff640 1 -- 172.21.15.55:0/3168936722 >> v1:172.21.15.167:6789/0 conn(0x7f3040072520 legacy=0x7f304015f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:21.577 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.586+0000 7f303ffff640 1 -- 172.21.15.55:0/3168936722 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400adb90 con 0x7f3040071ba0 2024-04-25T08:53:21.578 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.587+0000 7f303ffff640 1 --2- 172.21.15.55:0/3168936722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3040071ba0 0x7f3040071fe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f302c009870 tx=0x7f302c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8744e53d5b66aad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:21.578 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.587+0000 7f303f7fe640 1 -- 172.21.15.55:0/3168936722 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c037070 con 0x7f3040071ba0 2024-04-25T08:53:21.578 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.587+0000 7f303f7fe640 1 -- 172.21.15.55:0/3168936722 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c032440 con 0x7f3040071ba0 2024-04-25T08:53:21.578 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.587+0000 7f303f7fe640 1 -- 172.21.15.55:0/3168936722 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c032810 con 0x7f3040071ba0 2024-04-25T08:53:21.578 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.588+0000 7f3046c4d640 1 -- 172.21.15.55:0/3168936722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3040071ba0 msgr2=0x7f3040071fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:21.579 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.588+0000 7f3046c4d640 1 --2- 172.21.15.55:0/3168936722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3040071ba0 0x7f3040071fe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f302c009870 tx=0x7f302c02a270 comp rx=0 tx=0).stop 2024-04-25T08:53:21.579 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.588+0000 7f3046c4d640 1 -- 172.21.15.55:0/3168936722 shutdown_connections 2024-04-25T08:53:21.579 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.588+0000 7f3046c4d640 1 --2- 172.21.15.55:0/3168936722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3040071ba0 0x7f3040071fe0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:21.579 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.588+0000 7f3046c4d640 1 --2- 172.21.15.55:0/3168936722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304015f180 0x7f304006dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:21.579 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.588+0000 7f3046c4d640 1 -- 172.21.15.55:0/3168936722 >> 172.21.15.55:0/3168936722 conn(0x7f30400af5a0 msgr2=0x7f30400b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:21.579 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.588+0000 7f3046c4d640 1 -- 172.21.15.55:0/3168936722 shutdown_connections 2024-04-25T08:53:21.579 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.588+0000 7f3046c4d640 1 -- 172.21.15.55:0/3168936722 wait complete. 2024-04-25T08:53:21.581 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.589+0000 7f3046c4d640 1 Processor -- start 2024-04-25T08:53:21.581 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.589+0000 7f3046c4d640 1 -- start start 2024-04-25T08:53:21.581 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f3046c4d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3040071ba0 0x7f304015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:21.581 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f3046c4d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3040072520 0x7f30401549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:21.581 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f3046c4d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304015f180 0x7f3040154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:21.581 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f3046c4d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304006ba80 con 0x7f3040072520 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f3046c4d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30400ae150 con 0x7f3040071ba0 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f3046c4d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30400ae670 con 0x7f304015f180 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f303ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3040072520 0x7f30401549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f303ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3040072520 0x7f30401549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42058/0 (socket says 172.21.15.55:42058) 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f303ffff640 1 -- 172.21.15.55:0/3287419296 learned_addr learned my addr 172.21.15.55:0/3287419296 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f30449e9640 1 --2- 172.21.15.55:0/3287419296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3040071ba0 0x7f304015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f30451ea640 1 --2- 172.21.15.55:0/3287419296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304015f180 0x7f3040154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f303ffff640 1 -- 172.21.15.55:0/3287419296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304015f180 msgr2=0x7f3040154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f303ffff640 1 --2- 172.21.15.55:0/3287419296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304015f180 0x7f3040154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f303ffff640 1 -- 172.21.15.55:0/3287419296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3040071ba0 msgr2=0x7f304015aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f303ffff640 1 --2- 172.21.15.55:0/3287419296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3040071ba0 0x7f304015aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f303ffff640 1 -- 172.21.15.55:0/3287419296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30401f8c60 con 0x7f3040072520 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.590+0000 7f303ffff640 1 --2- 172.21.15.55:0/3287419296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3040072520 0x7f30401549b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f302c000c00 tx=0x7f302c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:21.582 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.591+0000 7f303d7fa640 1 -- 172.21.15.55:0/3287419296 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c037040 con 0x7f3040072520 2024-04-25T08:53:21.583 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.591+0000 7f303d7fa640 1 -- 172.21.15.55:0/3287419296 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c042070 con 0x7f3040072520 2024-04-25T08:53:21.583 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.591+0000 7f3046c4d640 1 -- 172.21.15.55:0/3287419296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30401f7ea0 con 0x7f3040072520 2024-04-25T08:53:21.583 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.591+0000 7f303d7fa640 1 -- 172.21.15.55:0/3287419296 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c030880 con 0x7f3040072520 2024-04-25T08:53:21.583 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.591+0000 7f3046c4d640 1 -- 172.21.15.55:0/3287419296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30401f8460 con 0x7f3040072520 2024-04-25T08:53:21.583 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.591+0000 7f303d7fa640 1 -- 172.21.15.55:0/3287419296 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f302c030a20 con 0x7f3040072520 2024-04-25T08:53:21.583 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.591+0000 7f303d7fa640 1 -- 172.21.15.55:0/3287419296 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f302c047b40 con 0x7f3040072520 2024-04-25T08:53:21.583 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.592+0000 7f3046c4d640 1 -- 172.21.15.55:0/3287419296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3040072c90 con 0x7f3040072520 2024-04-25T08:53:21.584 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:21.592+0000 7f947ef27040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T08:53:21.584 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.594+0000 7f303d7fa640 1 -- 172.21.15.55:0/3287419296 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3040072c90 con 0x7f3040072520 2024-04-25T08:53:21.647 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.657+0000 7f3046c4d640 1 -- 172.21.15.55:0/3287419296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3040072e90 con 0x7f3040072520 2024-04-25T08:53:21.647 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.657+0000 7f303d7fa640 1 -- 172.21.15.55:0/3287419296 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f3040072e90 con 0x7f3040072520 2024-04-25T08:53:21.648 INFO:teuthology.misc.health.smithi055.stdout: 2024-04-25T08:53:21.648 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":10,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:20.446747+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:21.649 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.658+0000 7f3046c4d640 1 -- 172.21.15.55:0/3287419296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3040072520 msgr2=0x7f30401549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:21.649 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.658+0000 7f3046c4d640 1 --2- 172.21.15.55:0/3287419296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3040072520 0x7f30401549b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f302c000c00 tx=0x7f302c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:21.649 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.658+0000 7f3046c4d640 1 -- 172.21.15.55:0/3287419296 shutdown_connections 2024-04-25T08:53:21.649 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.658+0000 7f3046c4d640 1 --2- 172.21.15.55:0/3287419296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304015f180 0x7f3040154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:21.649 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.658+0000 7f3046c4d640 1 --2- 172.21.15.55:0/3287419296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3040072520 0x7f30401549b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:21.649 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.658+0000 7f3046c4d640 1 --2- 172.21.15.55:0/3287419296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3040071ba0 0x7f304015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:21.649 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.658+0000 7f3046c4d640 1 -- 172.21.15.55:0/3287419296 >> 172.21.15.55:0/3287419296 conn(0x7f30400af5a0 msgr2=0x7f304015b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:21.649 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.658+0000 7f3046c4d640 1 -- 172.21.15.55:0/3287419296 shutdown_connections 2024-04-25T08:53:21.649 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:21.658+0000 7f3046c4d640 1 -- 172.21.15.55:0/3287419296 wait complete. 2024-04-25T08:53:21.658 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T08:53:21.681 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:21.690+0000 7fd7719d3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T08:53:21.727 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:21.737+0000 7fd7719d3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T08:53:21.728 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:21.738+0000 7f947ef27040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T08:53:21.781 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:21.791+0000 7f947ef27040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T08:53:21.854 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:21.864+0000 7f947ef27040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T08:53:21.881 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:21.891+0000 7fd7719d3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T08:53:21.902 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:21.912+0000 7f947ef27040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T08:53:22.018 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:22.028+0000 7fd7719d3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T08:53:22.067 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:22.076+0000 7fd7719d3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T08:53:22.136 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:22.145+0000 7fd7719d3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T08:53:22.182 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:22.192+0000 7fd7719d3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T08:53:22.405 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:22.415+0000 7f947ef27040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T08:53:22.526 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:22.536+0000 7f947ef27040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T08:53:22.664 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:22.673+0000 7fd7719d3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T08:53:22.781 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T08:53:22.790+0000 7fd7719d3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T08:53:23.549 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:23.557+0000 7f942039b640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T08:53:23.549 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-25T08:53:23.558+0000 7f942039b640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T08:53:24.538 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-04-25T08:53:24.548+0000 7f7239bbe640 -1 osd.1 0 log_to_monitors true 2024-04-25T08:53:24.609 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-04-25T08:53:24.618+0000 7fd54d43d640 -1 osd.3 0 log_to_monitors true 2024-04-25T08:53:24.610 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-04-25T08:53:24.620+0000 7fe24be18640 -1 osd.4 0 log_to_monitors true 2024-04-25T08:53:24.614 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-04-25T08:53:24.624+0000 7f5bb189b640 -1 osd.2 0 log_to_monitors true 2024-04-25T08:53:24.614 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-04-25T08:53:24.624+0000 7f1e60c19640 -1 osd.6 0 log_to_monitors true 2024-04-25T08:53:24.618 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-04-25T08:53:24.628+0000 7fa867ba7640 -1 osd.5 0 log_to_monitors true 2024-04-25T08:53:24.620 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-04-25T08:53:24.630+0000 7f38edab5640 -1 osd.0 0 log_to_monitors true 2024-04-25T08:53:24.641 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-04-25T08:53:24.651+0000 7f82742dd640 -1 osd.7 0 log_to_monitors true 2024-04-25T08:53:26.554 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-04-25T08:53:26.564+0000 7f7235331640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T08:53:26.568 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-04-25T08:53:26.578+0000 7f722d963640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:53:28.010 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-04-25T08:53:28.020+0000 7f5bad00e640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T08:53:28.017 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-04-25T08:53:28.027+0000 7fd548bb0640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T08:53:28.022 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-04-25T08:53:28.032+0000 7f5ba5640640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:53:28.022 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-04-25T08:53:28.032+0000 7f38eaa60640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T08:53:28.035 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-04-25T08:53:28.045+0000 7fd5411e2640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:53:28.084 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-04-25T08:53:28.094+0000 7f38e185a640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:53:28.464 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:28.561 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.571+0000 7f768fe88640 1 Processor -- start 2024-04-25T08:53:28.561 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.571+0000 7f768fe88640 1 -- start start 2024-04-25T08:53:28.563 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.572+0000 7f768fe88640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f768815de50 0x7f76880d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:28.563 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.572+0000 7f768fe88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f76880d2590 0x7f76880b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:28.563 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.572+0000 7f768fe88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76880d2bf0 con 0x7f76880d0970 2024-04-25T08:53:28.563 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.572+0000 7f768fe88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76880d0dd0 con 0x7f76880d2590 2024-04-25T08:53:28.563 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.572+0000 7f768fe88640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76880d3800 con 0x7f768815de50 2024-04-25T08:53:28.563 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.572+0000 7f768e425640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f76880d2590 0x7f76880b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:28.563 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.572+0000 7f768d423640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f76880d0970 0x7f76880d1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34748/0 (socket says 172.21.15.55:34748) 2024-04-25T08:53:28.563 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.572+0000 7f768d423640 1 -- 172.21.15.55:0/3642891461 learned_addr learned my addr 172.21.15.55:0/3642891461 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:28.563 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.572+0000 7f768dc24640 1 --2- 172.21.15.55:0/3642891461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f768815de50 0x7f76880d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:28.563 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.573+0000 7f768e425640 1 -- 172.21.15.55:0/3642891461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f768815de50 msgr2=0x7f76880d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:28.564 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.573+0000 7f768e425640 1 --2- 172.21.15.55:0/3642891461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f768815de50 0x7f76880d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:28.564 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.573+0000 7f768e425640 1 -- 172.21.15.55:0/3642891461 >> v1:172.21.15.55:6789/0 conn(0x7f76880d0970 legacy=0x7f76880d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:28.564 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.573+0000 7f768e425640 1 -- 172.21.15.55:0/3642891461 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76880d2ed0 con 0x7f76880d2590 2024-04-25T08:53:28.564 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.573+0000 7f768cc22640 1 -- 172.21.15.55:0/3642891461 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413738482 0 0) 0x7f76880d2bf0 con 0x7f76880d0970 2024-04-25T08:53:28.564 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.573+0000 7f768dc24640 1 --2- 172.21.15.55:0/3642891461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f768815de50 0x7f76880d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:28.565 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.573+0000 7f768e425640 1 --2- 172.21.15.55:0/3642891461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76880d2590 0x7f76880b7080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f76800097a0 tx=0x7f768002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26f05a443fd4136 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:28.565 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.574+0000 7f768cc22640 1 -- 172.21.15.55:0/3642891461 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680037070 con 0x7f76880d2590 2024-04-25T08:53:28.565 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.574+0000 7f768cc22640 1 -- 172.21.15.55:0/3642891461 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680032440 con 0x7f76880d2590 2024-04-25T08:53:28.565 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.574+0000 7f768cc22640 1 -- 172.21.15.55:0/3642891461 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680032810 con 0x7f76880d2590 2024-04-25T08:53:28.565 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.574+0000 7f768fe88640 1 -- 172.21.15.55:0/3642891461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76880d2590 msgr2=0x7f76880b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:28.565 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.574+0000 7f768fe88640 1 --2- 172.21.15.55:0/3642891461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76880d2590 0x7f76880b7080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f76800097a0 tx=0x7f768002a180 comp rx=0 tx=0).stop 2024-04-25T08:53:28.566 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.574+0000 7f768fe88640 1 -- 172.21.15.55:0/3642891461 shutdown_connections 2024-04-25T08:53:28.566 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.574+0000 7f768fe88640 1 --2- 172.21.15.55:0/3642891461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76880d2590 0x7f76880b7080 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:28.566 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.574+0000 7f768fe88640 1 --2- 172.21.15.55:0/3642891461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f768815de50 0x7f76880d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:28.566 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.574+0000 7f768fe88640 1 -- 172.21.15.55:0/3642891461 >> 172.21.15.55:0/3642891461 conn(0x7f768806bfd0 msgr2=0x7f768806c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:28.566 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.574+0000 7f768fe88640 1 -- 172.21.15.55:0/3642891461 shutdown_connections 2024-04-25T08:53:28.566 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.574+0000 7f768fe88640 1 -- 172.21.15.55:0/3642891461 wait complete. 2024-04-25T08:53:28.566 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.575+0000 7f768fe88640 1 Processor -- start 2024-04-25T08:53:28.566 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.575+0000 7f768fe88640 1 -- start start 2024-04-25T08:53:28.568 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768fe88640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76880d0970 0x7f76880cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:28.568 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768fe88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76880d2590 0x7f7688158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:28.568 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768fe88640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f768815de50 0x7f76880b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:28.568 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768fe88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768815e230 con 0x7f76880d2590 2024-04-25T08:53:28.568 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768fe88640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880d3490 con 0x7f76880d0970 2024-04-25T08:53:28.568 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768fe88640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768815e3b0 con 0x7f768815de50 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768d423640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76880d2590 0x7f7688158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768d423640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76880d2590 0x7f7688158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42160/0 (socket says 172.21.15.55:42160) 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768d423640 1 -- 172.21.15.55:0/3959153154 learned_addr learned my addr 172.21.15.55:0/3959153154 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768e425640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f768815de50 0x7f76880b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768dc24640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76880d0970 0x7f76880cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768d423640 1 -- 172.21.15.55:0/3959153154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f768815de50 msgr2=0x7f76880b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768d423640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f768815de50 0x7f76880b7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768d423640 1 -- 172.21.15.55:0/3959153154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76880d0970 msgr2=0x7f76880cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768d423640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76880d0970 0x7f76880cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.576+0000 7f768d423640 1 -- 172.21.15.55:0/3959153154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76880ccb00 con 0x7f76880d2590 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.577+0000 7f768d423640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76880d2590 0x7f7688158a30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c4d0 tx=0x7f767c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.577+0000 7f76867fc640 1 -- 172.21.15.55:0/3959153154 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c018070 con 0x7f76880d2590 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.577+0000 7f76867fc640 1 -- 172.21.15.55:0/3959153154 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c007500 con 0x7f76880d2590 2024-04-25T08:53:28.569 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.577+0000 7f768fe88640 1 -- 172.21.15.55:0/3959153154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76880c9300 con 0x7f76880d2590 2024-04-25T08:53:28.570 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.577+0000 7f76867fc640 1 -- 172.21.15.55:0/3959153154 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c004a20 con 0x7f76880d2590 2024-04-25T08:53:28.570 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.577+0000 7f768fe88640 1 -- 172.21.15.55:0/3959153154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76880c98c0 con 0x7f76880d2590 2024-04-25T08:53:28.570 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.578+0000 7f768fe88640 1 -- 172.21.15.55:0/3959153154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7688068530 con 0x7f76880d2590 2024-04-25T08:53:28.570 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.578+0000 7f76867fc640 1 -- 172.21.15.55:0/3959153154 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f767c01b070 con 0x7f76880d2590 2024-04-25T08:53:28.570 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.579+0000 7f76867fc640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f767406b470 0x7f767406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:28.570 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.579+0000 7f768dc24640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f767406b470 0x7f767406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:28.571 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.579+0000 7f76867fc640 1 -- 172.21.15.55:0/3959153154 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f767c088710 con 0x7f76880d2590 2024-04-25T08:53:28.571 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.579+0000 7f768dc24640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f767406b470 0x7f767406d930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7678009fd0 tx=0x7f76780097f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:28.573 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.583+0000 7f76867fc640 1 -- 172.21.15.55:0/3959153154 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f767c057c00 con 0x7f76880d2590 2024-04-25T08:53:28.690 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-04-25T08:53:28.699+0000 7fa86331a640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T08:53:28.695 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-04-25T08:53:28.705+0000 7f826fa50640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T08:53:28.698 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-04-25T08:53:28.708+0000 7fe246f7d640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T08:53:28.700 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-04-25T08:53:28.710+0000 7fa85b94c640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:53:28.705 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-04-25T08:53:28.715+0000 7f1e5bde4640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T08:53:28.708 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-04-25T08:53:28.718+0000 7f8268082640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:53:28.710 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-04-25T08:53:28.720+0000 7fe23f5af640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:53:28.719 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-04-25T08:53:28.729+0000 7f1e54416640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:53:28.762 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.770+0000 7f768fe88640 1 -- 172.21.15.55:0/3959153154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76880b91c0 con 0x7f76880d2590 2024-04-25T08:53:28.762 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.770+0000 7f76867fc640 1 -- 172.21.15.55:0/3959153154 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7578 (secure 0 0 0) 0x7f767c05bca0 con 0x7f76880d2590 2024-04-25T08:53:28.762 INFO:teuthology.misc.health.smithi055.stdout: 2024-04-25T08:53:28.762 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":14,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:27.839378+0000","last_up_change":"2024-04-25T08:53:26.605834+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:28.763 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.772+0000 7f768fe88640 1 -- 172.21.15.55:0/3959153154 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f767406b470 msgr2=0x7f767406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:28.764 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.772+0000 7f768fe88640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f767406b470 0x7f767406d930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7678009fd0 tx=0x7f76780097f0 comp rx=0 tx=0).stop 2024-04-25T08:53:28.764 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.772+0000 7f768fe88640 1 -- 172.21.15.55:0/3959153154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76880d2590 msgr2=0x7f7688158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:28.764 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.772+0000 7f768fe88640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76880d2590 0x7f7688158a30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c4d0 tx=0x7f767c00c990 comp rx=0 tx=0).stop 2024-04-25T08:53:28.764 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.772+0000 7f768fe88640 1 -- 172.21.15.55:0/3959153154 shutdown_connections 2024-04-25T08:53:28.764 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.772+0000 7f768fe88640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f767406b470 0x7f767406d930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:28.764 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.772+0000 7f768fe88640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f768815de50 0x7f76880b7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:28.764 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.772+0000 7f768fe88640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76880d2590 0x7f7688158a30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:28.764 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.772+0000 7f768fe88640 1 --2- 172.21.15.55:0/3959153154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76880d0970 0x7f76880cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:28.764 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.772+0000 7f768fe88640 1 -- 172.21.15.55:0/3959153154 >> 172.21.15.55:0/3959153154 conn(0x7f768806bfd0 msgr2=0x7f768815ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:28.764 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.773+0000 7f768fe88640 1 -- 172.21.15.55:0/3959153154 shutdown_connections 2024-04-25T08:53:28.764 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:28.773+0000 7f768fe88640 1 -- 172.21.15.55:0/3959153154 wait complete. 2024-04-25T08:53:28.772 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-04-25T08:53:35.580 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:35.684 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.694+0000 7f903525a640 1 Processor -- start 2024-04-25T08:53:35.684 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.694+0000 7f903525a640 1 -- start start 2024-04-25T08:53:35.685 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.694+0000 7f903525a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90300ce730 0x7f90300ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:35.685 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.694+0000 7f903525a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f90300b96e0 0x7f90300b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:35.685 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.694+0000 7f903525a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90300b7420 con 0x7f90300d1aa0 2024-04-25T08:53:35.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.694+0000 7f903525a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90300b7700 con 0x7f90300ce730 2024-04-25T08:53:35.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.694+0000 7f903525a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90300b79e0 con 0x7f90300b96e0 2024-04-25T08:53:35.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.695+0000 7f902ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90300ce730 0x7f90300ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:35.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.695+0000 7f902ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90300ce730 0x7f90300ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37252/0 (socket says 172.21.15.55:37252) 2024-04-25T08:53:35.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.695+0000 7f902ed9d640 1 -- 172.21.15.55:0/1803345836 learned_addr learned my addr 172.21.15.55:0/1803345836 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:35.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.695+0000 7f9027fff640 1 --2- 172.21.15.55:0/1803345836 >> v2:172.21.15.167:3300/0 conn(0x7f90300b96e0 0x7f90300b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:35.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.695+0000 7f902ed9d640 1 -- 172.21.15.55:0/1803345836 >> v2:172.21.15.167:3300/0 conn(0x7f90300b96e0 msgr2=0x7f90300b6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:35.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.695+0000 7f902ed9d640 1 --2- 172.21.15.55:0/1803345836 >> v2:172.21.15.167:3300/0 conn(0x7f90300b96e0 0x7f90300b6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:35.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.695+0000 7f902ed9d640 1 -- 172.21.15.55:0/1803345836 >> v1:172.21.15.167:6789/0 conn(0x7f90300d1aa0 legacy=0x7f90300b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:35.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.695+0000 7f902ed9d640 1 -- 172.21.15.55:0/1803345836 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90300b7cc0 con 0x7f90300ce730 2024-04-25T08:53:35.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.696+0000 7f902ed9d640 1 --2- 172.21.15.55:0/1803345836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90300ce730 0x7f90300ceb10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f90300d4b60 tx=0x7f902002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafb7fc67f18f3fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:35.687 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.696+0000 7f902e59c640 1 -- 172.21.15.55:0/1803345836 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020037070 con 0x7f90300ce730 2024-04-25T08:53:35.687 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.696+0000 7f902e59c640 1 -- 172.21.15.55:0/1803345836 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020032440 con 0x7f90300ce730 2024-04-25T08:53:35.687 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.696+0000 7f902e59c640 1 -- 172.21.15.55:0/1803345836 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020032810 con 0x7f90300ce730 2024-04-25T08:53:35.688 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.696+0000 7f903525a640 1 -- 172.21.15.55:0/1803345836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90300ce730 msgr2=0x7f90300ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:35.688 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.696+0000 7f903525a640 1 --2- 172.21.15.55:0/1803345836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90300ce730 0x7f90300ceb10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f90300d4b60 tx=0x7f902002a2c0 comp rx=0 tx=0).stop 2024-04-25T08:53:35.688 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.696+0000 7f903525a640 1 -- 172.21.15.55:0/1803345836 shutdown_connections 2024-04-25T08:53:35.688 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.696+0000 7f903525a640 1 --2- 172.21.15.55:0/1803345836 >> v2:172.21.15.167:3300/0 conn(0x7f90300b96e0 0x7f90300b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:35.688 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.696+0000 7f903525a640 1 --2- 172.21.15.55:0/1803345836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90300ce730 0x7f90300ceb10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:35.688 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.696+0000 7f903525a640 1 -- 172.21.15.55:0/1803345836 >> 172.21.15.55:0/1803345836 conn(0x7f9030072590 msgr2=0x7f90300729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:35.688 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.696+0000 7f903525a640 1 -- 172.21.15.55:0/1803345836 shutdown_connections 2024-04-25T08:53:35.688 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.697+0000 7f903525a640 1 -- 172.21.15.55:0/1803345836 wait complete. 2024-04-25T08:53:35.690 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.698+0000 7f903525a640 1 Processor -- start 2024-04-25T08:53:35.690 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.698+0000 7f903525a640 1 -- start start 2024-04-25T08:53:35.690 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f903525a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90300b96e0 0x7f90301f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:35.690 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f903525a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90300ce730 0x7f90301463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f903525a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90300d1aa0 0x7f9030143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f903525a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90300b7010 con 0x7f90300ce730 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f903525a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90300cf050 con 0x7f90300d1aa0 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f903525a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90300b7190 con 0x7f90300b96e0 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f9027fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90300ce730 0x7f90301463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f9027fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90300ce730 0x7f90301463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37254/0 (socket says 172.21.15.55:37254) 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f9027fff640 1 -- 172.21.15.55:0/4141724817 learned_addr learned my addr 172.21.15.55:0/4141724817 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f902f59e640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90300d1aa0 0x7f9030143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f902ed9d640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90300b96e0 0x7f90301f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f9027fff640 1 -- 172.21.15.55:0/4141724817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90300b96e0 msgr2=0x7f90301f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f9027fff640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90300b96e0 0x7f90301f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f9027fff640 1 -- 172.21.15.55:0/4141724817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90300d1aa0 msgr2=0x7f9030143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f9027fff640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90300d1aa0 0x7f9030143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:35.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f9027fff640 1 -- 172.21.15.55:0/4141724817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90300ca410 con 0x7f90300ce730 2024-04-25T08:53:35.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f902ed9d640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90300b96e0 0x7f90301f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:35.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f9027fff640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90300ce730 0x7f90301463a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f901800c820 tx=0x7f901800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:35.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.699+0000 7f90277fe640 1 -- 172.21.15.55:0/4141724817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018015070 con 0x7f90300ce730 2024-04-25T08:53:35.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.700+0000 7f90277fe640 1 -- 172.21.15.55:0/4141724817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9018004240 con 0x7f90300ce730 2024-04-25T08:53:35.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.700+0000 7f903525a640 1 -- 172.21.15.55:0/4141724817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90300ca130 con 0x7f90300ce730 2024-04-25T08:53:35.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.700+0000 7f90277fe640 1 -- 172.21.15.55:0/4141724817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901800ce10 con 0x7f90300ce730 2024-04-25T08:53:35.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.700+0000 7f903525a640 1 -- 172.21.15.55:0/4141724817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90300cc910 con 0x7f90300ce730 2024-04-25T08:53:35.693 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.701+0000 7f903525a640 1 -- 172.21.15.55:0/4141724817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90300731b0 con 0x7f90300ce730 2024-04-25T08:53:35.693 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.701+0000 7f90277fe640 1 -- 172.21.15.55:0/4141724817 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9018007830 con 0x7f90300ce730 2024-04-25T08:53:35.693 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.702+0000 7f90277fe640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f901006b500 0x7f901006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:35.693 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.702+0000 7f90277fe640 1 -- 172.21.15.55:0/4141724817 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9018089e00 con 0x7f90300ce730 2024-04-25T08:53:35.693 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.702+0000 7f902ed9d640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f901006b500 0x7f901006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:35.693 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.702+0000 7f902ed9d640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f901006b500 0x7f901006d9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9020034000 tx=0x7f902002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:35.696 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.706+0000 7f90277fe640 1 -- 172.21.15.55:0/4141724817 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f90300731b0 con 0x7f90300ce730 2024-04-25T08:53:35.878 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.888+0000 7f903525a640 1 -- 172.21.15.55:0/4141724817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9030068530 con 0x7f90300ce730 2024-04-25T08:53:35.879 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.889+0000 7f90277fe640 1 -- 172.21.15.55:0/4141724817 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12884 (secure 0 0 0) 0x7f9018058f40 con 0x7f90300ce730 2024-04-25T08:53:35.879 INFO:teuthology.misc.health.smithi055.stdout: 2024-04-25T08:53:35.879 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":19,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:33.118557+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:35.881 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 -- 172.21.15.55:0/4141724817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f901006b500 msgr2=0x7f901006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:35.881 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f901006b500 0x7f901006d9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9020034000 tx=0x7f902002e000 comp rx=0 tx=0).stop 2024-04-25T08:53:35.881 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 -- 172.21.15.55:0/4141724817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90300ce730 msgr2=0x7f90301463a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:35.881 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90300ce730 0x7f90301463a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f901800c820 tx=0x7f901800cce0 comp rx=0 tx=0).stop 2024-04-25T08:53:35.881 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 -- 172.21.15.55:0/4141724817 shutdown_connections 2024-04-25T08:53:35.881 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f901006b500 0x7f901006d9c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:35.881 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90300d1aa0 0x7f9030143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:35.881 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90300ce730 0x7f90301463a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:35.881 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 --2- 172.21.15.55:0/4141724817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90300b96e0 0x7f90301f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:35.882 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 -- 172.21.15.55:0/4141724817 >> 172.21.15.55:0/4141724817 conn(0x7f9030072590 msgr2=0x7f903015a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:35.882 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 -- 172.21.15.55:0/4141724817 shutdown_connections 2024-04-25T08:53:35.882 INFO:teuthology.misc.health.smithi055.stderr:2024-04-25T08:53:35.891+0000 7f903525a640 1 -- 172.21.15.55:0/4141724817 wait complete. 2024-04-25T08:53:35.891 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T08:53:35.891 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T08:53:35.891 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:53:35.892 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:53:35.894 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:53:35.895 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:53:35.895 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:53:35.896 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:53:35.897 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:53:35.897 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:53:35.899 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:53:35.899 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:53:35.899 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:53:35.902 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:53:35.903 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T08:53:35.903 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:35.971 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T08:53:35.971 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-25T08:53:35.988 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T08:53:35.988 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T08:53:36.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.019+0000 7f687ba6f640 1 Processor -- start 2024-04-25T08:53:36.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.019+0000 7f687ba6f640 1 -- start start 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.020+0000 7f687ba6f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740d35b0 0x7f68740b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.020+0000 7f687ba6f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f68740b5990 0x7f68740b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.020+0000 7f687ba6f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687415e0c0 con 0x7f687415dce0 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.020+0000 7f687ba6f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68740b5de0 con 0x7f68740b5990 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.020+0000 7f687ba6f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68740d2510 con 0x7f68740d35b0 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.020+0000 7f687980b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f687415dce0 0x7f68740d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41446/0 (socket says 172.21.15.55:41446) 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.020+0000 7f687980b640 1 -- 172.21.15.55:0/3430197819 learned_addr learned my addr 172.21.15.55:0/3430197819 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.020+0000 7f687900a640 1 --2- 172.21.15.55:0/3430197819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740d35b0 0x7f68740b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.020+0000 7f687a00c640 1 --2- 172.21.15.55:0/3430197819 >> v2:172.21.15.167:3300/0 conn(0x7f68740b5990 0x7f68740b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.021+0000 7f6878809640 1 -- 172.21.15.55:0/3430197819 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949877626 0 0) 0x7f687415e0c0 con 0x7f687415dce0 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.021+0000 7f6878809640 1 -- 172.21.15.55:0/3430197819 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6860003520 con 0x7f687415dce0 2024-04-25T08:53:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.021+0000 7f687900a640 1 -- 172.21.15.55:0/3430197819 >> v2:172.21.15.167:3300/0 conn(0x7f68740b5990 msgr2=0x7f68740b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:36.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.021+0000 7f687900a640 1 --2- 172.21.15.55:0/3430197819 >> v2:172.21.15.167:3300/0 conn(0x7f68740b5990 0x7f68740b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.021+0000 7f687900a640 1 -- 172.21.15.55:0/3430197819 >> v1:172.21.15.55:6789/0 conn(0x7f687415dce0 legacy=0x7f68740d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.021+0000 7f687900a640 1 -- 172.21.15.55:0/3430197819 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740d27f0 con 0x7f68740d35b0 2024-04-25T08:53:36.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.021+0000 7f687a00c640 1 --2- 172.21.15.55:0/3430197819 >> v2:172.21.15.167:3300/0 conn(0x7f68740b5990 0x7f68740b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:36.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.022+0000 7f687900a640 1 --2- 172.21.15.55:0/3430197819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740d35b0 0x7f68740b5450 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f68640097a0 tx=0x7f686402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88d560dfbe42b701 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:36.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.022+0000 7f6878809640 1 -- 172.21.15.55:0/3430197819 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864037070 con 0x7f68740d35b0 2024-04-25T08:53:36.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.022+0000 7f6878809640 1 -- 172.21.15.55:0/3430197819 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6864032440 con 0x7f68740d35b0 2024-04-25T08:53:36.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.022+0000 7f6878809640 1 -- 172.21.15.55:0/3430197819 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864032810 con 0x7f68740d35b0 2024-04-25T08:53:36.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.022+0000 7f687ba6f640 1 -- 172.21.15.55:0/3430197819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740d35b0 msgr2=0x7f68740b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.022+0000 7f687ba6f640 1 --2- 172.21.15.55:0/3430197819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740d35b0 0x7f68740b5450 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f68640097a0 tx=0x7f686402a180 comp rx=0 tx=0).stop 2024-04-25T08:53:36.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.022+0000 7f687ba6f640 1 -- 172.21.15.55:0/3430197819 shutdown_connections 2024-04-25T08:53:36.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.022+0000 7f687ba6f640 1 --2- 172.21.15.55:0/3430197819 >> v2:172.21.15.167:3300/0 conn(0x7f68740b5990 0x7f68740b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.022+0000 7f687ba6f640 1 --2- 172.21.15.55:0/3430197819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740d35b0 0x7f68740b5450 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.022+0000 7f687ba6f640 1 -- 172.21.15.55:0/3430197819 >> 172.21.15.55:0/3430197819 conn(0x7f6874072900 msgr2=0x7f68740d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:36.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.022+0000 7f687ba6f640 1 -- 172.21.15.55:0/3430197819 shutdown_connections 2024-04-25T08:53:36.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.023+0000 7f687ba6f640 1 -- 172.21.15.55:0/3430197819 wait complete. 2024-04-25T08:53:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.024+0000 7f687ba6f640 1 Processor -- start 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.024+0000 7f687ba6f640 1 -- start start 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.024+0000 7f687ba6f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740b5990 0x7f68741f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687ba6f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740d35b0 0x7f68740cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687ba6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687415dce0 0x7f687415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687ba6f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68740d3090 con 0x7f687415dce0 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687ba6f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68740d2db0 con 0x7f68740d35b0 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687a00c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687415dce0 0x7f687415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687ba6f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68740d2160 con 0x7f68740b5990 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687a00c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687415dce0 0x7f687415e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37304/0 (socket says 172.21.15.55:37304) 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687a00c640 1 -- 172.21.15.55:0/4190555152 learned_addr learned my addr 172.21.15.55:0/4190555152 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687900a640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740d35b0 0x7f68740cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687980b640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740b5990 0x7f68741f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687a00c640 1 -- 172.21.15.55:0/4190555152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740b5990 msgr2=0x7f68741f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687a00c640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740b5990 0x7f68741f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687a00c640 1 -- 172.21.15.55:0/4190555152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740d35b0 msgr2=0x7f68740cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687a00c640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740d35b0 0x7f68740cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687a00c640 1 -- 172.21.15.55:0/4190555152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740cc4b0 con 0x7f687415dce0 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687900a640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740d35b0 0x7f68740cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687980b640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740b5990 0x7f68741f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687a00c640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687415dce0 0x7f687415e520 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f686c00efc0 tx=0x7f686c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f686a7fc640 1 -- 172.21.15.55:0/4190555152 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c018030 con 0x7f687415dce0 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f686a7fc640 1 -- 172.21.15.55:0/4190555152 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c00cde0 con 0x7f687415dce0 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f686a7fc640 1 -- 172.21.15.55:0/4190555152 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c003bb0 con 0x7f687415dce0 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687ba6f640 1 -- 172.21.15.55:0/4190555152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68740cc790 con 0x7f687415dce0 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.025+0000 7f687ba6f640 1 -- 172.21.15.55:0/4190555152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68741f4d80 con 0x7f687415dce0 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.026+0000 7f687ba6f640 1 -- 172.21.15.55:0/4190555152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68740749b0 con 0x7f687415dce0 2024-04-25T08:53:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.027+0000 7f686a7fc640 1 -- 172.21.15.55:0/4190555152 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f686c01b070 con 0x7f687415dce0 2024-04-25T08:53:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.027+0000 7f686a7fc640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f685806b4d0 0x7f685806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.027+0000 7f686a7fc640 1 -- 172.21.15.55:0/4190555152 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f686c08a940 con 0x7f687415dce0 2024-04-25T08:53:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.027+0000 7f687980b640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f685806b4d0 0x7f685806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.028+0000 7f687980b640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f685806b4d0 0x7f685806d990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6870007fd0 tx=0x7f6870009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.031+0000 7f686a7fc640 1 -- 172.21.15.55:0/4190555152 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f686c010040 con 0x7f687415dce0 2024-04-25T08:53:36.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.212+0000 7f687ba6f640 1 -- 172.21.15.55:0/4190555152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68741f4f50 con 0x7f687415dce0 2024-04-25T08:53:36.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.213+0000 7f686a7fc640 1 -- 172.21.15.55:0/4190555152 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12884 (secure 0 0 0) 0x7f686c059b10 con 0x7f687415dce0 2024-04-25T08:53:36.203 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:36.203 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:33.118557+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:36.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 -- 172.21.15.55:0/4190555152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f685806b4d0 msgr2=0x7f685806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f685806b4d0 0x7f685806d990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6870007fd0 tx=0x7f6870009040 comp rx=0 tx=0).stop 2024-04-25T08:53:36.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 -- 172.21.15.55:0/4190555152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687415dce0 msgr2=0x7f687415e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687415dce0 0x7f687415e520 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f686c00efc0 tx=0x7f686c009f90 comp rx=0 tx=0).stop 2024-04-25T08:53:36.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 -- 172.21.15.55:0/4190555152 shutdown_connections 2024-04-25T08:53:36.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f685806b4d0 0x7f685806d990 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687415dce0 0x7f687415e520 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740d35b0 0x7f68740cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 --2- 172.21.15.55:0/4190555152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68740b5990 0x7f68741f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 -- 172.21.15.55:0/4190555152 >> 172.21.15.55:0/4190555152 conn(0x7f6874072900 msgr2=0x7f68740b8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:36.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 -- 172.21.15.55:0/4190555152 shutdown_connections 2024-04-25T08:53:36.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.215+0000 7f687ba6f640 1 -- 172.21.15.55:0/4190555152 wait complete. 2024-04-25T08:53:36.216 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:53:36.217 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:53:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.330+0000 7f88823b0640 1 Processor -- start 2024-04-25T08:53:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.330+0000 7f88823b0640 1 -- start start 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f88823b0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f887c0b9720 0x7f887c0b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f88823b0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c0d2670 con 0x7f887c0b5aa0 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f88823b0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c0d2950 con 0x7f887c15dbb0 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f88823b0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887c0d2c30 con 0x7f887c0b9720 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f888094d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f887c0b5aa0 0x7f887c0b6b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41450/0 (socket says 172.21.15.55:41450) 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f888094d640 1 -- 172.21.15.55:0/480704350 learned_addr learned my addr 172.21.15.55:0/480704350 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f887b7fe640 1 --2- 172.21.15.55:0/480704350 >> v2:172.21.15.167:3300/0 conn(0x7f887c0b9720 0x7f887c0b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f887affd640 1 -- 172.21.15.55:0/480704350 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95116344 0 0) 0x7f887c0d2670 con 0x7f887c0b5aa0 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f887affd640 1 -- 172.21.15.55:0/480704350 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8868003520 con 0x7f887c0b5aa0 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f887affd640 1 -- 172.21.15.55:0/480704350 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008238977 0 0) 0x7f887c0d2950 con 0x7f887c15dbb0 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f887affd640 1 -- 172.21.15.55:0/480704350 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f887c0d2670 con 0x7f887c15dbb0 2024-04-25T08:53:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f887b7fe640 1 -- 172.21.15.55:0/480704350 >> v1:172.21.15.167:6789/0 conn(0x7f887c15dbb0 legacy=0x7f887c0d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f887b7fe640 1 -- 172.21.15.55:0/480704350 >> v1:172.21.15.55:6789/0 conn(0x7f887c0b5aa0 legacy=0x7f887c0b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.331+0000 7f887b7fe640 1 -- 172.21.15.55:0/480704350 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c0d2f10 con 0x7f887c0b9720 2024-04-25T08:53:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.332+0000 7f887b7fe640 1 --2- 172.21.15.55:0/480704350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c0b9720 0x7f887c0b5560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f886c0097a0 tx=0x7f886c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c49c1afe36f32195 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.332+0000 7f887affd640 1 -- 172.21.15.55:0/480704350 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c037070 con 0x7f887c0b9720 2024-04-25T08:53:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.332+0000 7f887affd640 1 -- 172.21.15.55:0/480704350 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c032440 con 0x7f887c0b9720 2024-04-25T08:53:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.332+0000 7f887affd640 1 -- 172.21.15.55:0/480704350 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0327f0 con 0x7f887c0b9720 2024-04-25T08:53:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.333+0000 7f88823b0640 1 -- 172.21.15.55:0/480704350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c0b9720 msgr2=0x7f887c0b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.333+0000 7f88823b0640 1 --2- 172.21.15.55:0/480704350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c0b9720 0x7f887c0b5560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f886c0097a0 tx=0x7f886c02a230 comp rx=0 tx=0).stop 2024-04-25T08:53:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.333+0000 7f88823b0640 1 -- 172.21.15.55:0/480704350 shutdown_connections 2024-04-25T08:53:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.333+0000 7f88823b0640 1 --2- 172.21.15.55:0/480704350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c0b9720 0x7f887c0b5560 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.333+0000 7f88823b0640 1 -- 172.21.15.55:0/480704350 >> 172.21.15.55:0/480704350 conn(0x7f887c0d0560 msgr2=0x7f887c0d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.333+0000 7f88823b0640 1 -- 172.21.15.55:0/480704350 shutdown_connections 2024-04-25T08:53:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.333+0000 7f88823b0640 1 -- 172.21.15.55:0/480704350 wait complete. 2024-04-25T08:53:36.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.334+0000 7f88823b0640 1 Processor -- start 2024-04-25T08:53:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.334+0000 7f88823b0640 1 -- start start 2024-04-25T08:53:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f88823b0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c0b5aa0 0x7f887c146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f88823b0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f887c0b9720 0x7f887c144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f88823b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f887c15dbb0 0x7f887c144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f88823b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c15e110 con 0x7f887c15dbb0 2024-04-25T08:53:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f88823b0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c15df90 con 0x7f887c0b5aa0 2024-04-25T08:53:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f88823b0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0d3710 con 0x7f887c0b9720 2024-04-25T08:53:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f888094d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f887c15dbb0 0x7f887c144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f888094d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f887c15dbb0 0x7f887c144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37312/0 (socket says 172.21.15.55:37312) 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f888094d640 1 -- 172.21.15.55:0/3139312118 learned_addr learned my addr 172.21.15.55:0/3139312118 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f887b7fe640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f887c0b9720 0x7f887c144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f887bfff640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c0b5aa0 0x7f887c146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f888094d640 1 -- 172.21.15.55:0/3139312118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f887c0b9720 msgr2=0x7f887c144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.335+0000 7f888094d640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f887c0b9720 0x7f887c144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.336+0000 7f888094d640 1 -- 172.21.15.55:0/3139312118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c0b5aa0 msgr2=0x7f887c146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.336+0000 7f888094d640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c0b5aa0 0x7f887c146810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.336+0000 7f888094d640 1 -- 172.21.15.55:0/3139312118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c145310 con 0x7f887c15dbb0 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.336+0000 7f888094d640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f887c15dbb0 0x7f887c144dd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f887400cba0 tx=0x7f887400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.336+0000 7f8878ff9640 1 -- 172.21.15.55:0/3139312118 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874017070 con 0x7f887c15dbb0 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.336+0000 7f8878ff9640 1 -- 172.21.15.55:0/3139312118 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887400ace0 con 0x7f887c15dbb0 2024-04-25T08:53:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.336+0000 7f88823b0640 1 -- 172.21.15.55:0/3139312118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c1455c0 con 0x7f887c15dbb0 2024-04-25T08:53:36.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.336+0000 7f8878ff9640 1 -- 172.21.15.55:0/3139312118 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874012600 con 0x7f887c15dbb0 2024-04-25T08:53:36.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.336+0000 7f88823b0640 1 -- 172.21.15.55:0/3139312118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c145b80 con 0x7f887c15dbb0 2024-04-25T08:53:36.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.337+0000 7f88823b0640 1 -- 172.21.15.55:0/3139312118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c0750b0 con 0x7f887c15dbb0 2024-04-25T08:53:36.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.337+0000 7f8878ff9640 1 -- 172.21.15.55:0/3139312118 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f887401a070 con 0x7f887c15dbb0 2024-04-25T08:53:36.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.338+0000 7f8878ff9640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f885c06b4d0 0x7f885c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.338+0000 7f8878ff9640 1 -- 172.21.15.55:0/3139312118 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8874089b70 con 0x7f887c15dbb0 2024-04-25T08:53:36.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.338+0000 7f887bfff640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f885c06b4d0 0x7f885c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.338+0000 7f887bfff640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f885c06b4d0 0x7f885c06d990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88640011e0 tx=0x7f8864009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:36.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.342+0000 7f8878ff9640 1 -- 172.21.15.55:0/3139312118 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8874058780 con 0x7f887c15dbb0 2024-04-25T08:53:36.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.522+0000 7f88823b0640 1 -- 172.21.15.55:0/3139312118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f887c0b6cf0 con 0x7f887c15dbb0 2024-04-25T08:53:36.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.522+0000 7f8878ff9640 1 -- 172.21.15.55:0/3139312118 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f887405c820 con 0x7f887c15dbb0 2024-04-25T08:53:36.513 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:53:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 -- 172.21.15.55:0/3139312118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f885c06b4d0 msgr2=0x7f885c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f885c06b4d0 0x7f885c06d990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88640011e0 tx=0x7f8864009040 comp rx=0 tx=0).stop 2024-04-25T08:53:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 -- 172.21.15.55:0/3139312118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f887c15dbb0 msgr2=0x7f887c144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f887c15dbb0 0x7f887c144dd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f887400cba0 tx=0x7f887400a430 comp rx=0 tx=0).stop 2024-04-25T08:53:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 -- 172.21.15.55:0/3139312118 shutdown_connections 2024-04-25T08:53:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f885c06b4d0 0x7f885c06d990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f887c15dbb0 0x7f887c144dd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f887c0b9720 0x7f887c144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 --2- 172.21.15.55:0/3139312118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c0b5aa0 0x7f887c146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 -- 172.21.15.55:0/3139312118 >> 172.21.15.55:0/3139312118 conn(0x7f887c0d0560 msgr2=0x7f887c0b8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 -- 172.21.15.55:0/3139312118 shutdown_connections 2024-04-25T08:53:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.524+0000 7f88823b0640 1 -- 172.21.15.55:0/3139312118 wait complete. 2024-04-25T08:53:36.525 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:53:36.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.636+0000 7f3eeb722640 1 Processor -- start 2024-04-25T08:53:36.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.636+0000 7f3eeb722640 1 -- start start 2024-04-25T08:53:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3eeb722640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ee415ded0 0x7f3ee40cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3eeb722640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ee406fab0 0x7f3ee4070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3eeb722640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40c6540 con 0x7f3ee406ff10 2024-04-25T08:53:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3eeb722640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee4072bc0 con 0x7f3ee406fab0 2024-04-25T08:53:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3eeb722640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40ccfc0 con 0x7f3ee415ded0 2024-04-25T08:53:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3ee8cbd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ee406fab0 0x7f3ee4070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3ee9cbf640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3ee406ff10 0x7f3ee40cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41454/0 (socket says 172.21.15.55:41454) 2024-04-25T08:53:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3ee9cbf640 1 -- 172.21.15.55:0/2636875209 learned_addr learned my addr 172.21.15.55:0/2636875209 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3ee94be640 1 --2- 172.21.15.55:0/2636875209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ee415ded0 0x7f3ee40cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3ee8cbd640 1 -- 172.21.15.55:0/2636875209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ee415ded0 msgr2=0x7f3ee40cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3ee8cbd640 1 --2- 172.21.15.55:0/2636875209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ee415ded0 0x7f3ee40cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3ee8cbd640 1 -- 172.21.15.55:0/2636875209 >> v1:172.21.15.55:6789/0 conn(0x7f3ee406ff10 legacy=0x7f3ee40cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3ee8cbd640 1 -- 172.21.15.55:0/2636875209 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4072e10 con 0x7f3ee406fab0 2024-04-25T08:53:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.637+0000 7f3ee3fff640 1 -- 172.21.15.55:0/2636875209 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401686966 0 0) 0x7f3ee40c6540 con 0x7f3ee406ff10 2024-04-25T08:53:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.638+0000 7f3ee8cbd640 1 --2- 172.21.15.55:0/2636875209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ee406fab0 0x7f3ee4070320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80097a0 tx=0x7f3ed802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6631a80cf507f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.638+0000 7f3ee3fff640 1 -- 172.21.15.55:0/2636875209 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8037070 con 0x7f3ee406fab0 2024-04-25T08:53:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.638+0000 7f3ee3fff640 1 -- 172.21.15.55:0/2636875209 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed8032440 con 0x7f3ee406fab0 2024-04-25T08:53:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.638+0000 7f3ee3fff640 1 -- 172.21.15.55:0/2636875209 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8032810 con 0x7f3ee406fab0 2024-04-25T08:53:36.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.639+0000 7f3eeb722640 1 -- 172.21.15.55:0/2636875209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ee406fab0 msgr2=0x7f3ee4070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.639+0000 7f3eeb722640 1 --2- 172.21.15.55:0/2636875209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ee406fab0 0x7f3ee4070320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80097a0 tx=0x7f3ed802a210 comp rx=0 tx=0).stop 2024-04-25T08:53:36.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.639+0000 7f3eeb722640 1 -- 172.21.15.55:0/2636875209 shutdown_connections 2024-04-25T08:53:36.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.639+0000 7f3eeb722640 1 --2- 172.21.15.55:0/2636875209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ee406fab0 0x7f3ee4070320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.639+0000 7f3eeb722640 1 --2- 172.21.15.55:0/2636875209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ee415ded0 0x7f3ee40cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.639+0000 7f3eeb722640 1 -- 172.21.15.55:0/2636875209 >> 172.21.15.55:0/2636875209 conn(0x7f3ee40b2370 msgr2=0x7f3ee40b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.639+0000 7f3eeb722640 1 -- 172.21.15.55:0/2636875209 shutdown_connections 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.639+0000 7f3eeb722640 1 -- 172.21.15.55:0/2636875209 wait complete. 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.640+0000 7f3eeb722640 1 Processor -- start 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.640+0000 7f3eeb722640 1 -- start start 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3eeb722640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ee406fab0 0x7f3ee4146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3eeb722640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ee415ded0 0x7f3ee41580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3eeb722640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4159bc0 0x7f3ee40b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3eeb722640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40cd4f0 con 0x7f3ee415ded0 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3eeb722640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40cd210 con 0x7f3ee4159bc0 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3eeb722640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40cdf50 con 0x7f3ee406fab0 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee8cbd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ee415ded0 0x7f3ee41580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee8cbd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ee415ded0 0x7f3ee41580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37332/0 (socket says 172.21.15.55:37332) 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee8cbd640 1 -- 172.21.15.55:0/753570591 learned_addr learned my addr 172.21.15.55:0/753570591 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee94be640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ee406fab0 0x7f3ee4146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee9cbf640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4159bc0 0x7f3ee40b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee8cbd640 1 -- 172.21.15.55:0/753570591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ee406fab0 msgr2=0x7f3ee4146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee8cbd640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ee406fab0 0x7f3ee4146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee8cbd640 1 -- 172.21.15.55:0/753570591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4159bc0 msgr2=0x7f3ee40b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee8cbd640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4159bc0 0x7f3ee40b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee8cbd640 1 -- 172.21.15.55:0/753570591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4158b20 con 0x7f3ee415ded0 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee9cbf640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4159bc0 0x7f3ee40b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee94be640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ee406fab0 0x7f3ee4146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.641+0000 7f3ee8cbd640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ee415ded0 0x7f3ee41580d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8000c00 tx=0x7f3ed80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.642+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/753570591 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8037040 con 0x7f3ee415ded0 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.642+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/753570591 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed8042070 con 0x7f3ee415ded0 2024-04-25T08:53:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.642+0000 7f3eeb722640 1 -- 172.21.15.55:0/753570591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee4158e00 con 0x7f3ee415ded0 2024-04-25T08:53:36.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.642+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/753570591 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8030bb0 con 0x7f3ee415ded0 2024-04-25T08:53:36.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.642+0000 7f3eeb722640 1 -- 172.21.15.55:0/753570591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee41593c0 con 0x7f3ee415ded0 2024-04-25T08:53:36.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.643+0000 7f3eeb722640 1 -- 172.21.15.55:0/753570591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee40749b0 con 0x7f3ee415ded0 2024-04-25T08:53:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.643+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/753570591 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3ed8047460 con 0x7f3ee415ded0 2024-04-25T08:53:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.644+0000 7f3ee1ffb640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ed006b4d0 0x7f3ed006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.644+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/753570591 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3ed80aaa70 con 0x7f3ee415ded0 2024-04-25T08:53:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.644+0000 7f3ee94be640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ed006b4d0 0x7f3ed006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.644+0000 7f3ee94be640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ed006b4d0 0x7f3ed006d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3edc006fd0 tx=0x7f3edc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:36.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.648+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/753570591 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ed8032e20 con 0x7f3ee415ded0 2024-04-25T08:53:36.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.865+0000 7f3eeb722640 1 -- 172.21.15.55:0/753570591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ee40caf50 con 0x7f3ee415ded0 2024-04-25T08:53:36.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.866+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/753570591 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f3ed8079c30 con 0x7f3ee415ded0 2024-04-25T08:53:36.856 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:36.856 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3883943704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3883943704},{"type":"v1","addr":"172.21.15.55:6836","nonce":3883943704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-04-25T08:53:36.857 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 2 2024-04-25T08:53:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 -- 172.21.15.55:0/753570591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ed006b4d0 msgr2=0x7f3ed006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ed006b4d0 0x7f3ed006d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3edc006fd0 tx=0x7f3edc008040 comp rx=0 tx=0).stop 2024-04-25T08:53:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 -- 172.21.15.55:0/753570591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ee415ded0 msgr2=0x7f3ee41580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ee415ded0 0x7f3ee41580d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8000c00 tx=0x7f3ed80046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 -- 172.21.15.55:0/753570591 shutdown_connections 2024-04-25T08:53:36.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ed006b4d0 0x7f3ed006d990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4159bc0 0x7f3ee40b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ee415ded0 0x7f3ee41580d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 --2- 172.21.15.55:0/753570591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ee406fab0 0x7f3ee4146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:36.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 -- 172.21.15.55:0/753570591 >> 172.21.15.55:0/753570591 conn(0x7f3ee40b2370 msgr2=0x7f3ee40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:36.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 -- 172.21.15.55:0/753570591 shutdown_connections 2024-04-25T08:53:36.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:36.868+0000 7f3eeb722640 1 -- 172.21.15.55:0/753570591 wait complete. 2024-04-25T08:53:38.870 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:53:38.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.993+0000 7f4055f9e640 1 Processor -- start 2024-04-25T08:53:38.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.993+0000 7f4055f9e640 1 -- start start 2024-04-25T08:53:38.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f4055f9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f405006e8f0 0x7f405015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f4055f9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f405015c820 0x7f40501654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f4055f9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40500ce6c0 con 0x7f405015bf00 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f4055f9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40501455e0 con 0x7f405006e8f0 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f4055f9e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405006d450 con 0x7f405015c820 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f404f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f405015bf00 0x7f40500cbdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56786/0 (socket says 172.21.15.55:56786) 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f404effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f405006e8f0 0x7f405015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f404f7fe640 1 -- 172.21.15.55:0/154240925 learned_addr learned my addr 172.21.15.55:0/154240925 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f404ffff640 1 --2- 172.21.15.55:0/154240925 >> v2:172.21.15.167:3300/0 conn(0x7f405015c820 0x7f40501654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f404e7fc640 1 -- 172.21.15.55:0/154240925 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102343929 0 0) 0x7f4040001110 con 0x7f405015bf00 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f404e7fc640 1 -- 172.21.15.55:0/154240925 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4038003520 con 0x7f405015bf00 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f404effd640 1 -- 172.21.15.55:0/154240925 >> v2:172.21.15.167:3300/0 conn(0x7f405015c820 msgr2=0x7f40501654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f404effd640 1 --2- 172.21.15.55:0/154240925 >> v2:172.21.15.167:3300/0 conn(0x7f405015c820 0x7f40501654b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f404effd640 1 -- 172.21.15.55:0/154240925 >> v1:172.21.15.55:6789/0 conn(0x7f405015bf00 legacy=0x7f40500cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:38.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.994+0000 7f404effd640 1 -- 172.21.15.55:0/154240925 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40500cc4e0 con 0x7f405006e8f0 2024-04-25T08:53:38.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.995+0000 7f404effd640 1 --2- 172.21.15.55:0/154240925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f405006e8f0 0x7f405015c2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40500cdf50 tx=0x7f404402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef932dbb911957 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:38.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.995+0000 7f404e7fc640 1 -- 172.21.15.55:0/154240925 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044037070 con 0x7f405006e8f0 2024-04-25T08:53:38.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.995+0000 7f404e7fc640 1 -- 172.21.15.55:0/154240925 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4044032440 con 0x7f405006e8f0 2024-04-25T08:53:38.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.995+0000 7f404e7fc640 1 -- 172.21.15.55:0/154240925 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044032810 con 0x7f405006e8f0 2024-04-25T08:53:38.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.996+0000 7f4055f9e640 1 -- 172.21.15.55:0/154240925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f405006e8f0 msgr2=0x7f405015c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:38.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.996+0000 7f4055f9e640 1 --2- 172.21.15.55:0/154240925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f405006e8f0 0x7f405015c2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40500cdf50 tx=0x7f404402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:53:38.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.996+0000 7f4055f9e640 1 -- 172.21.15.55:0/154240925 shutdown_connections 2024-04-25T08:53:38.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.996+0000 7f4055f9e640 1 --2- 172.21.15.55:0/154240925 >> v2:172.21.15.167:3300/0 conn(0x7f405015c820 0x7f40501654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.996+0000 7f4055f9e640 1 --2- 172.21.15.55:0/154240925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f405006e8f0 0x7f405015c2e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.996+0000 7f4055f9e640 1 -- 172.21.15.55:0/154240925 >> 172.21.15.55:0/154240925 conn(0x7f405006aba0 msgr2=0x7f405006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.996+0000 7f4055f9e640 1 -- 172.21.15.55:0/154240925 shutdown_connections 2024-04-25T08:53:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.996+0000 7f4055f9e640 1 -- 172.21.15.55:0/154240925 wait complete. 2024-04-25T08:53:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.997+0000 7f4055f9e640 1 Processor -- start 2024-04-25T08:53:38.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.997+0000 7f4055f9e640 1 -- start start 2024-04-25T08:53:38.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.998+0000 7f4055f9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f405006e8f0 0x7f40501f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:38.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.998+0000 7f4055f9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f405015bf00 0x7f405015dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:38.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.998+0000 7f4055f9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f405015c820 0x7f405015e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:38.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.998+0000 7f4055f9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40500ccd70 con 0x7f405015c820 2024-04-25T08:53:38.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.998+0000 7f4055f9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40500cca90 con 0x7f405015bf00 2024-04-25T08:53:38.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.998+0000 7f4055f9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40500cd050 con 0x7f405006e8f0 2024-04-25T08:53:38.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.998+0000 7f404ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f405015c820 0x7f405015e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:38.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.998+0000 7f404ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f405015c820 0x7f405015e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41986/0 (socket says 172.21.15.55:41986) 2024-04-25T08:53:38.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.998+0000 7f404ffff640 1 -- 172.21.15.55:0/2211558243 learned_addr learned my addr 172.21.15.55:0/2211558243 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:38.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.998+0000 7f404f7fe640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f405006e8f0 0x7f40501f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:38.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.998+0000 7f404effd640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f405015bf00 0x7f405015dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:38.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.999+0000 7f404ffff640 1 -- 172.21.15.55:0/2211558243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f405006e8f0 msgr2=0x7f40501f14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.999+0000 7f404ffff640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f405006e8f0 0x7f40501f14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.999+0000 7f404ffff640 1 -- 172.21.15.55:0/2211558243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f405015bf00 msgr2=0x7f405015dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.999+0000 7f404ffff640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f405015bf00 0x7f405015dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.999+0000 7f404ffff640 1 -- 172.21.15.55:0/2211558243 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405013c0d0 con 0x7f405015c820 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.999+0000 7f404ffff640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f405015c820 0x7f405015e240 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f404800efc0 tx=0x7f404800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.999+0000 7f4037fff640 1 -- 172.21.15.55:0/2211558243 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048018020 con 0x7f405015c820 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.999+0000 7f4037fff640 1 -- 172.21.15.55:0/2211558243 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4048014480 con 0x7f405015c820 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.999+0000 7f4055f9e640 1 -- 172.21.15.55:0/2211558243 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40501f1dd0 con 0x7f405015c820 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.999+0000 7f4037fff640 1 -- 172.21.15.55:0/2211558243 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048014870 con 0x7f405015c820 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:38.999+0000 7f4055f9e640 1 -- 172.21.15.55:0/2211558243 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40501f2390 con 0x7f405015c820 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.000+0000 7f4055f9e640 1 -- 172.21.15.55:0/2211558243 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405006bb30 con 0x7f405015c820 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.000+0000 7f4037fff640 1 -- 172.21.15.55:0/2211558243 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4048005d10 con 0x7f405015c820 2024-04-25T08:53:38.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.001+0000 7f4037fff640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f403c06b4d0 0x7f403c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:38.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.001+0000 7f404f7fe640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f403c06b4d0 0x7f403c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:38.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.001+0000 7f4037fff640 1 -- 172.21.15.55:0/2211558243 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f404808a700 con 0x7f405015c820 2024-04-25T08:53:38.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.001+0000 7f404f7fe640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f403c06b4d0 0x7f403c06d990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4040005880 tx=0x7f4040009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:38.994 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:53:38.996 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:53:38.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.005+0000 7f4037fff640 1 -- 172.21.15.55:0/2211558243 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4048022070 con 0x7f405015c820 2024-04-25T08:53:39.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.226+0000 7f4055f9e640 1 -- 172.21.15.55:0/2211558243 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f405015ba30 con 0x7f405015c820 2024-04-25T08:53:39.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.227+0000 7f4037fff640 1 -- 172.21.15.55:0/2211558243 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f405015ba30 con 0x7f405015c820 2024-04-25T08:53:39.217 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:39.217 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1710920573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1710920573},{"type":"v1","addr":"172.21.15.167:6834","nonce":1710920573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3883943704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3883943704},{"type":"v1","addr":"172.21.15.55:6836","nonce":3883943704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1410084850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1410084850},{"type":"v1","addr":"172.21.15.55:6837","nonce":1410084850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3753268738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3753268738},{"type":"v1","addr":"172.21.15.167:6835","nonce":3753268738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-04-25T08:53:39.218 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 3 2024-04-25T08:53:39.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 -- 172.21.15.55:0/2211558243 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f403c06b4d0 msgr2=0x7f403c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f403c06b4d0 0x7f403c06d990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4040005880 tx=0x7f4040009040 comp rx=0 tx=0).stop 2024-04-25T08:53:39.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 -- 172.21.15.55:0/2211558243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f405015c820 msgr2=0x7f405015e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f405015c820 0x7f405015e240 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f404800efc0 tx=0x7f404800c490 comp rx=0 tx=0).stop 2024-04-25T08:53:39.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 -- 172.21.15.55:0/2211558243 shutdown_connections 2024-04-25T08:53:39.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f403c06b4d0 0x7f403c06d990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f405015c820 0x7f405015e240 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f405015bf00 0x7f405015dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 --2- 172.21.15.55:0/2211558243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f405006e8f0 0x7f40501f14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 -- 172.21.15.55:0/2211558243 >> 172.21.15.55:0/2211558243 conn(0x7f405006aba0 msgr2=0x7f405013b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 -- 172.21.15.55:0/2211558243 shutdown_connections 2024-04-25T08:53:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.229+0000 7f4055f9e640 1 -- 172.21.15.55:0/2211558243 wait complete. 2024-04-25T08:53:39.230 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:39.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.340+0000 7f3c40b9e640 1 Processor -- start 2024-04-25T08:53:39.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.340+0000 7f3c40b9e640 1 -- start start 2024-04-25T08:53:39.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.341+0000 7f3c40b9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3c15dce0 0x7f3c3c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.341+0000 7f3c40b9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3c3c0d35b0 0x7f3c3c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.341+0000 7f3c40b9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c15e0c0 con 0x7f3c3c0d1f90 2024-04-25T08:53:39.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.341+0000 7f3c40b9e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c0b7b10 con 0x7f3c3c0d35b0 2024-04-25T08:53:39.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.341+0000 7f3c40b9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0d2510 con 0x7f3c3c15dce0 2024-04-25T08:53:39.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.341+0000 7f3c3ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3c3c0d1f90 0x7f3c3c06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56800/0 (socket says 172.21.15.55:56800) 2024-04-25T08:53:39.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.341+0000 7f3c3ad9d640 1 -- 172.21.15.55:0/3928631731 learned_addr learned my addr 172.21.15.55:0/3928631731 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:39.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.341+0000 7f3c39d9b640 1 --2- 172.21.15.55:0/3928631731 >> v2:172.21.15.167:3300/0 conn(0x7f3c3c0d35b0 0x7f3c3c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.341+0000 7f3c3a59c640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3c15dce0 0x7f3c3c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.341+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364562896 0 0) 0x7f3c3c15e0c0 con 0x7f3c3c0d1f90 2024-04-25T08:53:39.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.341+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c24003520 con 0x7f3c3c0d1f90 2024-04-25T08:53:39.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3998670881 0 0) 0x7f3c24003520 con 0x7f3c3c0d1f90 2024-04-25T08:53:39.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3c15dce0 msgr2=0x7f3c3c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:39.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3c15dce0 0x7f3c3c0d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 >> v2:172.21.15.167:3300/0 conn(0x7f3c3c0d35b0 msgr2=0x7f3c3c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:39.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 --2- 172.21.15.55:0/3928631731 >> v2:172.21.15.167:3300/0 conn(0x7f3c3c0d35b0 0x7f3c3c0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c0d27f0 con 0x7f3c3c0d1f90 2024-04-25T08:53:39.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f3c340019f0 con 0x7f3c3c0d1f90 2024-04-25T08:53:39.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 >> v1:172.21.15.55:6789/0 conn(0x7f3c3c0d1f90 legacy=0x7f3c3c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c240039b0 0x7f3c24003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c24004800 0x7f3c24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3c15dce0 0x7f3c240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0b7b10 con 0x7f3c24004800 2024-04-25T08:53:39.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0d2510 con 0x7f3c240039b0 2024-04-25T08:53:39.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2400b9c0 con 0x7f3c3c15dce0 2024-04-25T08:53:39.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c39d9b640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c24004800 0x7f3c24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3a59c640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c240039b0 0x7f3c24003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c3ad9d640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3c15dce0 0x7f3c240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c39d9b640 1 -- 172.21.15.55:0/3928631731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3c15dce0 msgr2=0x7f3c240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:39.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c39d9b640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3c15dce0 0x7f3c240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c39d9b640 1 -- 172.21.15.55:0/3928631731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c240039b0 msgr2=0x7f3c24003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:39.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c39d9b640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c240039b0 0x7f3c24003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.342+0000 7f3c39d9b640 1 -- 172.21.15.55:0/3928631731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24003520 con 0x7f3c24004800 2024-04-25T08:53:39.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.343+0000 7f3c39d9b640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c24004800 0x7f3c24004c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009af0 tx=0x7f3c24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b60dac2f9f269b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:39.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.343+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30036070 con 0x7f3c24004800 2024-04-25T08:53:39.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.343+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c30031400 con 0x7f3c24004800 2024-04-25T08:53:39.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.343+0000 7f3c3959a640 1 -- 172.21.15.55:0/3928631731 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30009690 con 0x7f3c24004800 2024-04-25T08:53:39.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.343+0000 7f3c40b9e640 1 -- 172.21.15.55:0/3928631731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c24004800 msgr2=0x7f3c24004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.343+0000 7f3c40b9e640 1 --2- 172.21.15.55:0/3928631731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c24004800 0x7f3c24004c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009af0 tx=0x7f3c24005830 comp rx=0 tx=0).stop 2024-04-25T08:53:39.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.343+0000 7f3c3ad9d640 1 -- 172.21.15.55:0/3928631731 reap_dead start 2024-04-25T08:53:39.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.343+0000 7f3c40b9e640 1 -- 172.21.15.55:0/3928631731 shutdown_connections 2024-04-25T08:53:39.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.343+0000 7f3c40b9e640 1 -- 172.21.15.55:0/3928631731 >> 172.21.15.55:0/3928631731 conn(0x7f3c3c072900 msgr2=0x7f3c3c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.343+0000 7f3c40b9e640 1 -- 172.21.15.55:0/3928631731 shutdown_connections 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.344+0000 7f3c40b9e640 1 -- 172.21.15.55:0/3928631731 wait complete. 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.345+0000 7f3c40b9e640 1 Processor -- start 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.345+0000 7f3c40b9e640 1 -- start start 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.345+0000 7f3c40b9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c24004800 0x7f3c3c0ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c40b9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3c1f4660 0x7f3c3c0aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c40b9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c3c15ece0 0x7f3c3c15f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c40b9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0d3090 con 0x7f3c3c1f4660 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c40b9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0d2db0 con 0x7f3c3c15ece0 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c40b9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0b9820 con 0x7f3c24004800 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c39d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3c1f4660 0x7f3c3c0aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c39d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3c1f4660 0x7f3c3c0aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42004/0 (socket says 172.21.15.55:42004) 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c39d9b640 1 -- 172.21.15.55:0/1714123498 learned_addr learned my addr 172.21.15.55:0/1714123498 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c3a59c640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c24004800 0x7f3c3c0ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c3ad9d640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c3c15ece0 0x7f3c3c15f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c39d9b640 1 -- 172.21.15.55:0/1714123498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c24004800 msgr2=0x7f3c3c0ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c39d9b640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c24004800 0x7f3c3c0ac500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c39d9b640 1 -- 172.21.15.55:0/1714123498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c3c15ece0 msgr2=0x7f3c3c15f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c39d9b640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c3c15ece0 0x7f3c3c15f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c39d9b640 1 -- 172.21.15.55:0/1714123498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c15fa80 con 0x7f3c3c1f4660 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c39d9b640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3c1f4660 0x7f3c3c0aca40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009af0 tx=0x7f3c30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c2affd640 1 -- 172.21.15.55:0/1714123498 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30040020 con 0x7f3c3c1f4660 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c2affd640 1 -- 172.21.15.55:0/1714123498 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c30003830 con 0x7f3c3c1f4660 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c40b9e640 1 -- 172.21.15.55:0/1714123498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c0aa600 con 0x7f3c3c1f4660 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c2affd640 1 -- 172.21.15.55:0/1714123498 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30036040 con 0x7f3c3c1f4660 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.346+0000 7f3c40b9e640 1 -- 172.21.15.55:0/1714123498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c0aabc0 con 0x7f3c3c1f4660 2024-04-25T08:53:39.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.347+0000 7f3c40b9e640 1 -- 172.21.15.55:0/1714123498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c0749b0 con 0x7f3c3c1f4660 2024-04-25T08:53:39.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.348+0000 7f3c2affd640 1 -- 172.21.15.55:0/1714123498 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3c30043020 con 0x7f3c3c1f4660 2024-04-25T08:53:39.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.348+0000 7f3c2affd640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1c06b4d0 0x7f3c1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.348+0000 7f3c2affd640 1 -- 172.21.15.55:0/1714123498 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3c300a9e80 con 0x7f3c3c1f4660 2024-04-25T08:53:39.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.348+0000 7f3c3a59c640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1c06b4d0 0x7f3c1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.348+0000 7f3c3a59c640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1c06b4d0 0x7f3c1c06d990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0099c0 tx=0x7f3c2c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:39.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.352+0000 7f3c2affd640 1 -- 172.21.15.55:0/1714123498 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3c3004a070 con 0x7f3c3c1f4660 2024-04-25T08:53:39.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.535+0000 7f3c40b9e640 1 -- 172.21.15.55:0/1714123498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c3c0d1ae0 con 0x7f3c3c1f4660 2024-04-25T08:53:39.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.536+0000 7f3c2affd640 1 -- 172.21.15.55:0/1714123498 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12884 (secure 0 0 0) 0x7f3c300790e0 con 0x7f3c3c1f4660 2024-04-25T08:53:39.527 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:39.527 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:33.118557+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:39.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 -- 172.21.15.55:0/1714123498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1c06b4d0 msgr2=0x7f3c1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1c06b4d0 0x7f3c1c06d990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0099c0 tx=0x7f3c2c008040 comp rx=0 tx=0).stop 2024-04-25T08:53:39.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 -- 172.21.15.55:0/1714123498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3c1f4660 msgr2=0x7f3c3c0aca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3c1f4660 0x7f3c3c0aca40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009af0 tx=0x7f3c30004730 comp rx=0 tx=0).stop 2024-04-25T08:53:39.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 -- 172.21.15.55:0/1714123498 shutdown_connections 2024-04-25T08:53:39.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1c06b4d0 0x7f3c1c06d990 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c3c15ece0 0x7f3c3c15f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3c1f4660 0x7f3c3c0aca40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 --2- 172.21.15.55:0/1714123498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c24004800 0x7f3c3c0ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 -- 172.21.15.55:0/1714123498 >> 172.21.15.55:0/1714123498 conn(0x7f3c3c072900 msgr2=0x7f3c3c0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:39.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 -- 172.21.15.55:0/1714123498 shutdown_connections 2024-04-25T08:53:39.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.538+0000 7f3c40b9e640 1 -- 172.21.15.55:0/1714123498 wait complete. 2024-04-25T08:53:39.540 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:53:39.540 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:53:39.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.653+0000 7f52088bc640 1 Processor -- start 2024-04-25T08:53:39.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.653+0000 7f52088bc640 1 -- start start 2024-04-25T08:53:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.654+0000 7f52088bc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52040cf4f0 0x7f520409a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.654+0000 7f52088bc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520409ae20 con 0x7f520415bcc0 2024-04-25T08:53:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.654+0000 7f52088bc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52040cc430 con 0x7f52040cff00 2024-04-25T08:53:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.654+0000 7f52088bc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52040cfad0 con 0x7f52040cf4f0 2024-04-25T08:53:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.654+0000 7f520259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f520415bcc0 0x7f52040cd190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56802/0 (socket says 172.21.15.55:56802) 2024-04-25T08:53:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.654+0000 7f520259c640 1 -- 172.21.15.55:0/618931962 learned_addr learned my addr 172.21.15.55:0/618931962 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.654+0000 7f5201d9b640 1 --2- 172.21.15.55:0/618931962 >> v2:172.21.15.167:3300/0 conn(0x7f52040cf4f0 0x7f520409a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.654+0000 7f520159a640 1 -- 172.21.15.55:0/618931962 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438514668 0 0) 0x7f520409ae20 con 0x7f520415bcc0 2024-04-25T08:53:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.654+0000 7f520159a640 1 -- 172.21.15.55:0/618931962 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f0003520 con 0x7f520415bcc0 2024-04-25T08:53:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.655+0000 7f5201d9b640 1 -- 172.21.15.55:0/618931962 >> v1:172.21.15.167:6789/0 conn(0x7f52040cff00 legacy=0x7f52040d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.655+0000 7f5201d9b640 1 -- 172.21.15.55:0/618931962 >> v1:172.21.15.55:6789/0 conn(0x7f520415bcc0 legacy=0x7f52040cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.655+0000 7f5201d9b640 1 -- 172.21.15.55:0/618931962 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040cc6b0 con 0x7f52040cf4f0 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.655+0000 7f5201d9b640 1 --2- 172.21.15.55:0/618931962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040cf4f0 0x7f520409a530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0097a0 tx=0x7f51ec02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=252ecc503214a890 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.656+0000 7f520159a640 1 -- 172.21.15.55:0/618931962 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec037070 con 0x7f52040cf4f0 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.656+0000 7f520159a640 1 -- 172.21.15.55:0/618931962 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec032440 con 0x7f52040cf4f0 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.656+0000 7f520159a640 1 -- 172.21.15.55:0/618931962 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec032810 con 0x7f52040cf4f0 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.656+0000 7f52088bc640 1 -- 172.21.15.55:0/618931962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040cf4f0 msgr2=0x7f520409a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.656+0000 7f52088bc640 1 --2- 172.21.15.55:0/618931962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040cf4f0 0x7f520409a530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0097a0 tx=0x7f51ec02a230 comp rx=0 tx=0).stop 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.656+0000 7f52088bc640 1 -- 172.21.15.55:0/618931962 shutdown_connections 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.656+0000 7f52088bc640 1 --2- 172.21.15.55:0/618931962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040cf4f0 0x7f520409a530 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.656+0000 7f52088bc640 1 -- 172.21.15.55:0/618931962 >> 172.21.15.55:0/618931962 conn(0x7f52040b3410 msgr2=0x7f52040b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.656+0000 7f52088bc640 1 -- 172.21.15.55:0/618931962 shutdown_connections 2024-04-25T08:53:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.656+0000 7f52088bc640 1 -- 172.21.15.55:0/618931962 wait complete. 2024-04-25T08:53:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.658+0000 7f52088bc640 1 Processor -- start 2024-04-25T08:53:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.658+0000 7f52088bc640 1 -- start start 2024-04-25T08:53:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.658+0000 7f52088bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52040cf4f0 0x7f5204156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.658+0000 7f52088bc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52040cff00 0x7f5204152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.658+0000 7f52088bc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f520415bcc0 0x7f520415e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.658+0000 7f52088bc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040ae570 con 0x7f52040cf4f0 2024-04-25T08:53:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.658+0000 7f52088bc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040ccc70 con 0x7f520415bcc0 2024-04-25T08:53:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.658+0000 7f52088bc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52040ae6f0 con 0x7f52040cff00 2024-04-25T08:53:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.658+0000 7f520259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52040cf4f0 0x7f5204156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.658+0000 7f520259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52040cf4f0 0x7f5204156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42012/0 (socket says 172.21.15.55:42012) 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f520259c640 1 -- 172.21.15.55:0/493350509 learned_addr learned my addr 172.21.15.55:0/493350509 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f5202d9d640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f520415bcc0 0x7f520415e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f5201d9b640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52040cff00 0x7f5204152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f520259c640 1 -- 172.21.15.55:0/493350509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52040cff00 msgr2=0x7f5204152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f520259c640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52040cff00 0x7f5204152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f520259c640 1 -- 172.21.15.55:0/493350509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f520415bcc0 msgr2=0x7f520415e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f520259c640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f520415bcc0 0x7f520415e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f520259c640 1 -- 172.21.15.55:0/493350509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040c8b90 con 0x7f52040cf4f0 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f520259c640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52040cf4f0 0x7f5204156f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c430 tx=0x7f51fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f51faffd640 1 -- 172.21.15.55:0/493350509 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc017070 con 0x7f52040cf4f0 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f51faffd640 1 -- 172.21.15.55:0/493350509 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc005ce0 con 0x7f52040cf4f0 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f52088bc640 1 -- 172.21.15.55:0/493350509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52040c8e70 con 0x7f52040cf4f0 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f51faffd640 1 -- 172.21.15.55:0/493350509 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0072d0 con 0x7f52040cf4f0 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.659+0000 7f52088bc640 1 -- 172.21.15.55:0/493350509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52040c9430 con 0x7f52040cf4f0 2024-04-25T08:53:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.660+0000 7f52088bc640 1 -- 172.21.15.55:0/493350509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52040750b0 con 0x7f52040cf4f0 2024-04-25T08:53:39.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.661+0000 7f51faffd640 1 -- 172.21.15.55:0/493350509 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f51fc01a070 con 0x7f52040cf4f0 2024-04-25T08:53:39.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.661+0000 7f51faffd640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51e406b4d0 0x7f51e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.661+0000 7f51faffd640 1 -- 172.21.15.55:0/493350509 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f51fc089150 con 0x7f52040cf4f0 2024-04-25T08:53:39.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.661+0000 7f5201d9b640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51e406b4d0 0x7f51e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.662+0000 7f5201d9b640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51e406b4d0 0x7f51e406d990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f51ec034000 tx=0x7f51ec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:39.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.665+0000 7f51faffd640 1 -- 172.21.15.55:0/493350509 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51fc057cd0 con 0x7f52040cf4f0 2024-04-25T08:53:39.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.845+0000 7f52088bc640 1 -- 172.21.15.55:0/493350509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52040b54a0 con 0x7f52040cf4f0 2024-04-25T08:53:39.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.845+0000 7f51faffd640 1 -- 172.21.15.55:0/493350509 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51fc05bd70 con 0x7f52040cf4f0 2024-04-25T08:53:39.837 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:53:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 -- 172.21.15.55:0/493350509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51e406b4d0 msgr2=0x7f51e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51e406b4d0 0x7f51e406d990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f51ec034000 tx=0x7f51ec02e000 comp rx=0 tx=0).stop 2024-04-25T08:53:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 -- 172.21.15.55:0/493350509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52040cf4f0 msgr2=0x7f5204156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52040cf4f0 0x7f5204156f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c430 tx=0x7f51fc00c8f0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 -- 172.21.15.55:0/493350509 shutdown_connections 2024-04-25T08:53:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51e406b4d0 0x7f51e406d990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f520415bcc0 0x7f520415e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52040cff00 0x7f5204152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 --2- 172.21.15.55:0/493350509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52040cf4f0 0x7f5204156f50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 -- 172.21.15.55:0/493350509 >> 172.21.15.55:0/493350509 conn(0x7f52040b3410 msgr2=0x7f520415af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 -- 172.21.15.55:0/493350509 shutdown_connections 2024-04-25T08:53:39.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.847+0000 7f52088bc640 1 -- 172.21.15.55:0/493350509 wait complete. 2024-04-25T08:53:39.849 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:53:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.960+0000 7f4c5b2bd640 1 Processor -- start 2024-04-25T08:53:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.960+0000 7f4c5b2bd640 1 -- start start 2024-04-25T08:53:39.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.960+0000 7f4c5b2bd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c540d35b0 0x7f4c540b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.960+0000 7f4c5b2bd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c540b5990 0x7f4c540b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.960+0000 7f4c5b2bd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5415e0c0 con 0x7f4c5415dce0 2024-04-25T08:53:39.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.960+0000 7f4c5b2bd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c540d2510 con 0x7f4c540d35b0 2024-04-25T08:53:39.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.960+0000 7f4c5b2bd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c540d27f0 con 0x7f4c540b5990 2024-04-25T08:53:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.961+0000 7f4c58858640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c540d35b0 0x7f4c540b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.961+0000 7f4c58858640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c540d35b0 0x7f4c540b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42014/0 (socket says 172.21.15.55:42014) 2024-04-25T08:53:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.961+0000 7f4c58858640 1 -- 172.21.15.55:0/1007216441 learned_addr learned my addr 172.21.15.55:0/1007216441 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.961+0000 7f4c5985a640 1 --2- 172.21.15.55:0/1007216441 >> v2:172.21.15.167:3300/0 conn(0x7f4c540b5990 0x7f4c540b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.961+0000 7f4c58858640 1 -- 172.21.15.55:0/1007216441 >> v2:172.21.15.167:3300/0 conn(0x7f4c540b5990 msgr2=0x7f4c540b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.961+0000 7f4c58858640 1 --2- 172.21.15.55:0/1007216441 >> v2:172.21.15.167:3300/0 conn(0x7f4c540b5990 0x7f4c540b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.961+0000 7f4c58858640 1 -- 172.21.15.55:0/1007216441 >> v1:172.21.15.167:6789/0 conn(0x7f4c5415dce0 legacy=0x7f4c540d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.961+0000 7f4c58858640 1 -- 172.21.15.55:0/1007216441 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c540d2ad0 con 0x7f4c540d35b0 2024-04-25T08:53:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c58858640 1 --2- 172.21.15.55:0/1007216441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c540d35b0 0x7f4c540b5450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c540b3390 tx=0x7f4c4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b66c738e3bbcdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c4bfff640 1 -- 172.21.15.55:0/1007216441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c44037070 con 0x7f4c540d35b0 2024-04-25T08:53:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c4bfff640 1 -- 172.21.15.55:0/1007216441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c44032440 con 0x7f4c540d35b0 2024-04-25T08:53:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c4bfff640 1 -- 172.21.15.55:0/1007216441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c44032810 con 0x7f4c540d35b0 2024-04-25T08:53:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/1007216441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c540d35b0 msgr2=0x7f4c540b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c5b2bd640 1 --2- 172.21.15.55:0/1007216441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c540d35b0 0x7f4c540b5450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c540b3390 tx=0x7f4c4402a270 comp rx=0 tx=0).stop 2024-04-25T08:53:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/1007216441 shutdown_connections 2024-04-25T08:53:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c5b2bd640 1 --2- 172.21.15.55:0/1007216441 >> v2:172.21.15.167:3300/0 conn(0x7f4c540b5990 0x7f4c540b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c5b2bd640 1 --2- 172.21.15.55:0/1007216441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c540d35b0 0x7f4c540b5450 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/1007216441 >> 172.21.15.55:0/1007216441 conn(0x7f4c54072900 msgr2=0x7f4c540d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/1007216441 shutdown_connections 2024-04-25T08:53:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.962+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/1007216441 wait complete. 2024-04-25T08:53:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c5b2bd640 1 Processor -- start 2024-04-25T08:53:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c5b2bd640 1 -- start start 2024-04-25T08:53:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c5b2bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c540b5990 0x7f4c541f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c5b2bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c540d35b0 0x7f4c5415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c5b2bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c5415dce0 0x7f4c540c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c5b2bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540d2160 con 0x7f4c540b5990 2024-04-25T08:53:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c5b2bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540d3090 con 0x7f4c540d35b0 2024-04-25T08:53:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c5b2bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540c9fb0 con 0x7f4c5415dce0 2024-04-25T08:53:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c59059640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c540b5990 0x7f4c541f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c59059640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c540b5990 0x7f4c541f3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42028/0 (socket says 172.21.15.55:42028) 2024-04-25T08:53:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c59059640 1 -- 172.21.15.55:0/2336161235 learned_addr learned my addr 172.21.15.55:0/2336161235 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c5985a640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c5415dce0 0x7f4c540c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c58858640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c540d35b0 0x7f4c5415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c59059640 1 -- 172.21.15.55:0/2336161235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c5415dce0 msgr2=0x7f4c540c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c59059640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c5415dce0 0x7f4c540c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c59059640 1 -- 172.21.15.55:0/2336161235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c540d35b0 msgr2=0x7f4c5415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c59059640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c540d35b0 0x7f4c5415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c59059640 1 -- 172.21.15.55:0/2336161235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c541f4500 con 0x7f4c540b5990 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c59059640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c540b5990 0x7f4c541f3fc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c3c0 tx=0x7f4c5000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c49ffb640 1 -- 172.21.15.55:0/2336161235 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500052d0 con 0x7f4c540b5990 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c49ffb640 1 -- 172.21.15.55:0/2336161235 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50005490 con 0x7f4c540b5990 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/2336161235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c540c8c70 con 0x7f4c540b5990 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c49ffb640 1 -- 172.21.15.55:0/2336161235 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50007260 con 0x7f4c540b5990 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.965+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/2336161235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c540c91f0 con 0x7f4c540b5990 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.966+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/2336161235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c540749b0 con 0x7f4c540b5990 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.967+0000 7f4c49ffb640 1 -- 172.21.15.55:0/2336161235 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4c50007400 con 0x7f4c540b5990 2024-04-25T08:53:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.967+0000 7f4c49ffb640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3806b500 0x7f4c3806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.967+0000 7f4c49ffb640 1 -- 172.21.15.55:0/2336161235 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4c500892c0 con 0x7f4c540b5990 2024-04-25T08:53:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.967+0000 7f4c58858640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3806b500 0x7f4c3806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.968+0000 7f4c58858640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3806b500 0x7f4c3806d9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c44034000 tx=0x7f4c4402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:39.971+0000 7f4c49ffb640 1 -- 172.21.15.55:0/2336161235 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c541f4500 con 0x7f4c540b5990 2024-04-25T08:53:40.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.156+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/2336161235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4c540b27d0 con 0x7f4c540b5990 2024-04-25T08:53:40.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.156+0000 7f4c49ffb640 1 -- 172.21.15.55:0/2336161235 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4c50058520 con 0x7f4c540b5990 2024-04-25T08:53:40.148 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:40.148 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T08:53:40.148 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:53:40.148 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-25T08:53:40.148 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-25T08:53:40.148 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:53:40.148 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/2336161235 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3806b500 msgr2=0x7f4c3806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3806b500 0x7f4c3806d9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c44034000 tx=0x7f4c4402e000 comp rx=0 tx=0).stop 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/2336161235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c540b5990 msgr2=0x7f4c541f3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c540b5990 0x7f4c541f3fc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c3c0 tx=0x7f4c5000c880 comp rx=0 tx=0).stop 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/2336161235 shutdown_connections 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3806b500 0x7f4c3806d9c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c5415dce0 0x7f4c540c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c540d35b0 0x7f4c5415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 --2- 172.21.15.55:0/2336161235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c540b5990 0x7f4c541f3fc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/2336161235 >> 172.21.15.55:0/2336161235 conn(0x7f4c54072900 msgr2=0x7f4c540b7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/2336161235 shutdown_connections 2024-04-25T08:53:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.158+0000 7f4c5b2bd640 1 -- 172.21.15.55:0/2336161235 wait complete. 2024-04-25T08:53:40.160 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:53:40.160 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:53:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.273+0000 7f0d4b49e640 1 Processor -- start 2024-04-25T08:53:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.273+0000 7f0d4b49e640 1 -- start start 2024-04-25T08:53:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.274+0000 7f0d4b49e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0d440b35e0 0x7f0d44162350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.274+0000 7f0d4b49e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d440b3f80 0x7f0d44160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.274+0000 7f0d4b49e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d440b39c0 0x7f0d44161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.274+0000 7f0d4b49e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d44162890 con 0x7f0d440b39c0 2024-04-25T08:53:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.274+0000 7f0d4b49e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d440cfed0 con 0x7f0d440b35e0 2024-04-25T08:53:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.274+0000 7f0d4b49e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440cf850 con 0x7f0d440b3f80 2024-04-25T08:53:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.274+0000 7f0d49a3b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d440b39c0 0x7f0d44161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.274+0000 7f0d49a3b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d440b39c0 0x7f0d44161230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42044/0 (socket says 172.21.15.55:42044) 2024-04-25T08:53:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.274+0000 7f0d49a3b640 1 -- 172.21.15.55:0/2223629261 learned_addr learned my addr 172.21.15.55:0/2223629261 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.275+0000 7f0d4923a640 1 --2- 172.21.15.55:0/2223629261 >> v2:172.21.15.167:3300/0 conn(0x7f0d440b35e0 0x7f0d44162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:40.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.275+0000 7f0d48a39640 1 --2- 172.21.15.55:0/2223629261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d440b3f80 0x7f0d44160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:40.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.275+0000 7f0d49a3b640 1 -- 172.21.15.55:0/2223629261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d440b3f80 msgr2=0x7f0d44160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:40.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.275+0000 7f0d49a3b640 1 --2- 172.21.15.55:0/2223629261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d440b3f80 0x7f0d44160cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:40.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.275+0000 7f0d49a3b640 1 -- 172.21.15.55:0/2223629261 >> v2:172.21.15.167:3300/0 conn(0x7f0d440b35e0 msgr2=0x7f0d44162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:40.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.275+0000 7f0d49a3b640 1 --2- 172.21.15.55:0/2223629261 >> v2:172.21.15.167:3300/0 conn(0x7f0d440b35e0 0x7f0d44162350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:40.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.275+0000 7f0d49a3b640 1 -- 172.21.15.55:0/2223629261 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d440cfb30 con 0x7f0d440b39c0 2024-04-25T08:53:40.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.275+0000 7f0d48a39640 1 --2- 172.21.15.55:0/2223629261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d440b3f80 0x7f0d44160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:40.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.275+0000 7f0d49a3b640 1 --2- 172.21.15.55:0/2223629261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d440b39c0 0x7f0d44161230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d44070140 tx=0x7f0d3402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2676646fb46aa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:40.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d43fff640 1 -- 172.21.15.55:0/2223629261 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34036070 con 0x7f0d440b39c0 2024-04-25T08:53:40.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d43fff640 1 -- 172.21.15.55:0/2223629261 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d34031600 con 0x7f0d440b39c0 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d43fff640 1 -- 172.21.15.55:0/2223629261 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340319d0 con 0x7f0d440b39c0 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d4b49e640 1 -- 172.21.15.55:0/2223629261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d440b39c0 msgr2=0x7f0d44161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d4b49e640 1 --2- 172.21.15.55:0/2223629261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d440b39c0 0x7f0d44161230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d44070140 tx=0x7f0d3402a610 comp rx=0 tx=0).stop 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d4b49e640 1 -- 172.21.15.55:0/2223629261 shutdown_connections 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d4b49e640 1 --2- 172.21.15.55:0/2223629261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d440b39c0 0x7f0d44161230 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d4b49e640 1 --2- 172.21.15.55:0/2223629261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d440b3f80 0x7f0d44160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d4b49e640 1 --2- 172.21.15.55:0/2223629261 >> v2:172.21.15.167:3300/0 conn(0x7f0d440b35e0 0x7f0d44162350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d4b49e640 1 -- 172.21.15.55:0/2223629261 >> 172.21.15.55:0/2223629261 conn(0x7f0d4406f4c0 msgr2=0x7f0d4406f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d4b49e640 1 -- 172.21.15.55:0/2223629261 shutdown_connections 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.276+0000 7f0d4b49e640 1 -- 172.21.15.55:0/2223629261 wait complete. 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.277+0000 7f0d4b49e640 1 Processor -- start 2024-04-25T08:53:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.277+0000 7f0d4b49e640 1 -- start start 2024-04-25T08:53:40.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d4b49e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d440b35e0 0x7f0d441f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:40.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d4b49e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d440b39c0 0x7f0d441f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:40.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d4b49e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d440b3f80 0x7f0d440b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:40.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d4b49e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440d05d0 con 0x7f0d440b3f80 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d4b49e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440d0450 con 0x7f0d440b39c0 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d4b49e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440cdef0 con 0x7f0d440b35e0 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d49a3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d440b3f80 0x7f0d440b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d49a3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d440b3f80 0x7f0d440b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42046/0 (socket says 172.21.15.55:42046) 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d49a3b640 1 -- 172.21.15.55:0/3050124367 learned_addr learned my addr 172.21.15.55:0/3050124367 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d48a39640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d440b39c0 0x7f0d441f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d4923a640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d440b35e0 0x7f0d441f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d49a3b640 1 -- 172.21.15.55:0/3050124367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d440b35e0 msgr2=0x7f0d441f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d49a3b640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d440b35e0 0x7f0d441f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d49a3b640 1 -- 172.21.15.55:0/3050124367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d440b39c0 msgr2=0x7f0d441f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d49a3b640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d440b39c0 0x7f0d441f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d49a3b640 1 -- 172.21.15.55:0/3050124367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d440b5d00 con 0x7f0d440b3f80 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.278+0000 7f0d48a39640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d440b39c0 0x7f0d441f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.279+0000 7f0d49a3b640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d440b3f80 0x7f0d440b5420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0d3402ac00 tx=0x7f0d34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.279+0000 7f0d41ffb640 1 -- 172.21.15.55:0/3050124367 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3403f020 con 0x7f0d440b3f80 2024-04-25T08:53:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.279+0000 7f0d41ffb640 1 -- 172.21.15.55:0/3050124367 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d34037040 con 0x7f0d440b3f80 2024-04-25T08:53:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.279+0000 7f0d41ffb640 1 -- 172.21.15.55:0/3050124367 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34036070 con 0x7f0d440b3f80 2024-04-25T08:53:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.279+0000 7f0d4b49e640 1 -- 172.21.15.55:0/3050124367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d440b5fe0 con 0x7f0d440b3f80 2024-04-25T08:53:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.279+0000 7f0d4b49e640 1 -- 172.21.15.55:0/3050124367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d440b65a0 con 0x7f0d440b3f80 2024-04-25T08:53:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.280+0000 7f0d4b49e640 1 -- 172.21.15.55:0/3050124367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d440c5480 con 0x7f0d440b3f80 2024-04-25T08:53:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.281+0000 7f0d41ffb640 1 -- 172.21.15.55:0/3050124367 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d34042020 con 0x7f0d440b3f80 2024-04-25T08:53:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.281+0000 7f0d41ffb640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d3006b550 0x7f0d3006da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.281+0000 7f0d41ffb640 1 -- 172.21.15.55:0/3050124367 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0d340aa510 con 0x7f0d440b3f80 2024-04-25T08:53:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.281+0000 7f0d4923a640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d3006b550 0x7f0d3006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.281+0000 7f0d4923a640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d3006b550 0x7f0d3006da10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:40.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.286+0000 7f0d41ffb640 1 -- 172.21.15.55:0/3050124367 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0d440c5480 con 0x7f0d440b3f80 2024-04-25T08:53:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:40.465+0000 7f0d4b49e640 1 -- 172.21.15.55:0/3050124367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0d440750b0 con 0x7f0d440b3f80 2024-04-25T08:53:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.183+0000 7f0d41ffb640 1 -- 172.21.15.55:0/3050124367 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0d34049020 con 0x7f0d440b3f80 2024-04-25T08:53:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-25T08:53:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 -- 172.21.15.55:0/3050124367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d3006b550 msgr2=0x7f0d3006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d3006b550 0x7f0d3006da10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c008040 comp rx=0 tx=0).stop 2024-04-25T08:53:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 -- 172.21.15.55:0/3050124367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d440b3f80 msgr2=0x7f0d440b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d440b3f80 0x7f0d440b5420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0d3402ac00 tx=0x7f0d34004a40 comp rx=0 tx=0).stop 2024-04-25T08:53:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 -- 172.21.15.55:0/3050124367 shutdown_connections 2024-04-25T08:53:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d3006b550 0x7f0d3006da10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d440b3f80 0x7f0d440b5420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d440b39c0 0x7f0d441f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:41.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 --2- 172.21.15.55:0/3050124367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d440b35e0 0x7f0d441f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:41.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 -- 172.21.15.55:0/3050124367 >> 172.21.15.55:0/3050124367 conn(0x7f0d4406f4c0 msgr2=0x7f0d4415f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:41.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 -- 172.21.15.55:0/3050124367 shutdown_connections 2024-04-25T08:53:41.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.186+0000 7f0d4b49e640 1 -- 172.21.15.55:0/3050124367 wait complete. 2024-04-25T08:53:41.194 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:53:41.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.317+0000 7f60578bd640 1 Processor -- start 2024-04-25T08:53:41.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.318+0000 7f60578bd640 1 -- start start 2024-04-25T08:53:41.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.318+0000 7f60578bd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f605015dc90 0x7f60500d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:41.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.318+0000 7f60578bd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60500d0b30 0x7f60500b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:41.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.318+0000 7f60578bd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60500d30f0 con 0x7f60500b9290 2024-04-25T08:53:41.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.318+0000 7f60578bd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605015e070 con 0x7f605015dc90 2024-04-25T08:53:41.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.318+0000 7f60578bd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60500d1b10 con 0x7f60500d0b30 2024-04-25T08:53:41.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.319+0000 7f6055659640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f605015dc90 0x7f60500d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:41.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.319+0000 7f6055659640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f605015dc90 0x7f60500d2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42056/0 (socket says 172.21.15.55:42056) 2024-04-25T08:53:41.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.319+0000 7f6055659640 1 -- 172.21.15.55:0/1560792019 learned_addr learned my addr 172.21.15.55:0/1560792019 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:41.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.319+0000 7f6055e5a640 1 --2- 172.21.15.55:0/1560792019 >> v2:172.21.15.167:3300/0 conn(0x7f60500d0b30 0x7f60500b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:41.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.319+0000 7f6055659640 1 -- 172.21.15.55:0/1560792019 >> v2:172.21.15.167:3300/0 conn(0x7f60500d0b30 msgr2=0x7f60500b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:41.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.319+0000 7f6055659640 1 --2- 172.21.15.55:0/1560792019 >> v2:172.21.15.167:3300/0 conn(0x7f60500d0b30 0x7f60500b6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:41.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.319+0000 7f6055659640 1 -- 172.21.15.55:0/1560792019 >> v1:172.21.15.167:6789/0 conn(0x7f60500b9290 legacy=0x7f60500d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:41.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.319+0000 7f6055659640 1 -- 172.21.15.55:0/1560792019 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60500d1df0 con 0x7f605015dc90 2024-04-25T08:53:41.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.319+0000 7f6055e5a640 1 --2- 172.21.15.55:0/1560792019 >> v2:172.21.15.167:3300/0 conn(0x7f60500d0b30 0x7f60500b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:41.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f6055659640 1 --2- 172.21.15.55:0/1560792019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605015dc90 0x7f60500d2bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f60500b65a0 tx=0x7f604c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd56fb143dd8fcb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:41.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f6047fff640 1 -- 172.21.15.55:0/1560792019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c037070 con 0x7f605015dc90 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f6047fff640 1 -- 172.21.15.55:0/1560792019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c032440 con 0x7f605015dc90 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f6047fff640 1 -- 172.21.15.55:0/1560792019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c032810 con 0x7f605015dc90 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f60578bd640 1 -- 172.21.15.55:0/1560792019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605015dc90 msgr2=0x7f60500d2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f60578bd640 1 --2- 172.21.15.55:0/1560792019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605015dc90 0x7f60500d2bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f60500b65a0 tx=0x7f604c02a270 comp rx=0 tx=0).stop 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f60578bd640 1 -- 172.21.15.55:0/1560792019 shutdown_connections 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f60578bd640 1 --2- 172.21.15.55:0/1560792019 >> v2:172.21.15.167:3300/0 conn(0x7f60500d0b30 0x7f60500b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f60578bd640 1 --2- 172.21.15.55:0/1560792019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605015dc90 0x7f60500d2bb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f60578bd640 1 -- 172.21.15.55:0/1560792019 >> 172.21.15.55:0/1560792019 conn(0x7f6050072900 msgr2=0x7f605006c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f60578bd640 1 -- 172.21.15.55:0/1560792019 shutdown_connections 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.320+0000 7f60578bd640 1 -- 172.21.15.55:0/1560792019 wait complete. 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.321+0000 7f60578bd640 1 Processor -- start 2024-04-25T08:53:41.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.322+0000 7f60578bd640 1 -- start start 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.322+0000 7f60578bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60500b9290 0x7f60500cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.322+0000 7f60578bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60500d0b30 0x7f6050152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.322+0000 7f60578bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605015dc90 0x7f60500b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.322+0000 7f60578bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60500d2690 con 0x7f605015dc90 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.322+0000 7f60578bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60500d23b0 con 0x7f60500b9290 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.322+0000 7f60578bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60500d3480 con 0x7f60500d0b30 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.322+0000 7f6055e5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605015dc90 0x7f60500b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.322+0000 7f6055e5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605015dc90 0x7f60500b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42068/0 (socket says 172.21.15.55:42068) 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.322+0000 7f6055e5a640 1 -- 172.21.15.55:0/1755475360 learned_addr learned my addr 172.21.15.55:0/1755475360 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f6054e58640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60500d0b30 0x7f6050152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f6055659640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60500b9290 0x7f60500cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f6055e5a640 1 -- 172.21.15.55:0/1755475360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60500d0b30 msgr2=0x7f6050152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f6055e5a640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60500d0b30 0x7f6050152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f6055e5a640 1 -- 172.21.15.55:0/1755475360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60500b9290 msgr2=0x7f60500cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:41.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f6055e5a640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60500b9290 0x7f60500cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:41.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f6055e5a640 1 -- 172.21.15.55:0/1755475360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60500b4bf0 con 0x7f605015dc90 2024-04-25T08:53:41.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f6055e5a640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605015dc90 0x7f60500b5c90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6048009fd0 tx=0x7f604800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:41.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f6045ffb640 1 -- 172.21.15.55:0/1755475360 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604801a070 con 0x7f605015dc90 2024-04-25T08:53:41.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f6045ffb640 1 -- 172.21.15.55:0/1755475360 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6048003bb0 con 0x7f605015dc90 2024-04-25T08:53:41.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f6045ffb640 1 -- 172.21.15.55:0/1755475360 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048004030 con 0x7f605015dc90 2024-04-25T08:53:41.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f60578bd640 1 -- 172.21.15.55:0/1755475360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60500b4ed0 con 0x7f605015dc90 2024-04-25T08:53:41.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.323+0000 7f60578bd640 1 -- 172.21.15.55:0/1755475360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60500b5490 con 0x7f605015dc90 2024-04-25T08:53:41.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.324+0000 7f60578bd640 1 -- 172.21.15.55:0/1755475360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60500749b0 con 0x7f605015dc90 2024-04-25T08:53:41.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.325+0000 7f6045ffb640 1 -- 172.21.15.55:0/1755475360 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f604801d070 con 0x7f605015dc90 2024-04-25T08:53:41.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.325+0000 7f6045ffb640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f603406b4d0 0x7f603406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:41.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.325+0000 7f6045ffb640 1 -- 172.21.15.55:0/1755475360 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f604808a360 con 0x7f605015dc90 2024-04-25T08:53:41.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.325+0000 7f6055659640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f603406b4d0 0x7f603406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:41.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.325+0000 7f6055659640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f603406b4d0 0x7f603406d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f604c034000 tx=0x7f604c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:41.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.329+0000 7f6045ffb640 1 -- 172.21.15.55:0/1755475360 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6048010070 con 0x7f605015dc90 2024-04-25T08:53:41.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:41.511+0000 7f60578bd640 1 -- 172.21.15.55:0/1755475360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f60500cec30 con 0x7f605015dc90 2024-04-25T08:53:42.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.185+0000 7f6045ffb640 1 -- 172.21.15.55:0/1755475360 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f60480593d0 con 0x7f605015dc90 2024-04-25T08:53:42.175 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-25T08:53:42.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.188+0000 7f60578bd640 1 -- 172.21.15.55:0/1755475360 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f603406b4d0 msgr2=0x7f603406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:42.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.188+0000 7f60578bd640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f603406b4d0 0x7f603406d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f604c034000 tx=0x7f604c02e000 comp rx=0 tx=0).stop 2024-04-25T08:53:42.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.188+0000 7f60578bd640 1 -- 172.21.15.55:0/1755475360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605015dc90 msgr2=0x7f60500b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:42.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.189+0000 7f60578bd640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605015dc90 0x7f60500b5c90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6048009fd0 tx=0x7f604800d560 comp rx=0 tx=0).stop 2024-04-25T08:53:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.189+0000 7f60578bd640 1 -- 172.21.15.55:0/1755475360 shutdown_connections 2024-04-25T08:53:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.189+0000 7f60578bd640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f603406b4d0 0x7f603406d990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.189+0000 7f60578bd640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605015dc90 0x7f60500b5c90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.189+0000 7f60578bd640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60500d0b30 0x7f6050152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.189+0000 7f60578bd640 1 --2- 172.21.15.55:0/1755475360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60500b9290 0x7f60500cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.189+0000 7f60578bd640 1 -- 172.21.15.55:0/1755475360 >> 172.21.15.55:0/1755475360 conn(0x7f6050072900 msgr2=0x7f605006c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.189+0000 7f60578bd640 1 -- 172.21.15.55:0/1755475360 shutdown_connections 2024-04-25T08:53:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.189+0000 7f60578bd640 1 -- 172.21.15.55:0/1755475360 wait complete. 2024-04-25T08:53:42.206 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:53:42.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.324+0000 7fb6b0948640 1 Processor -- start 2024-04-25T08:53:42.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.324+0000 7fb6b0948640 1 -- start start 2024-04-25T08:53:42.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.325+0000 7fb6b0948640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6ac15bbe0 0x7fb6ac0cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.325+0000 7fb6b0948640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6ac0cf510 0x7fb6ac0cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.325+0000 7fb6b0948640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac0cc830 con 0x7fb6ac0cff00 2024-04-25T08:53:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.325+0000 7fb6b0948640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac0ccb10 con 0x7fb6ac15bbe0 2024-04-25T08:53:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.325+0000 7fb6b0948640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0ccdf0 con 0x7fb6ac0cf510 2024-04-25T08:53:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.325+0000 7fb6aa59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6ac15bbe0 0x7fb6ac0cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.325+0000 7fb6aa59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6ac15bbe0 0x7fb6ac0cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42078/0 (socket says 172.21.15.55:42078) 2024-04-25T08:53:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.325+0000 7fb6aa59c640 1 -- 172.21.15.55:0/4095742286 learned_addr learned my addr 172.21.15.55:0/4095742286 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.326+0000 7fb6a9d9b640 1 --2- 172.21.15.55:0/4095742286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6ac0cf510 0x7fb6ac0cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.326+0000 7fb6aa59c640 1 -- 172.21.15.55:0/4095742286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6ac0cf510 msgr2=0x7fb6ac0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.326+0000 7fb6aa59c640 1 --2- 172.21.15.55:0/4095742286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6ac0cf510 0x7fb6ac0cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.326+0000 7fb6aa59c640 1 -- 172.21.15.55:0/4095742286 >> v1:172.21.15.167:6789/0 conn(0x7fb6ac0cff00 legacy=0x7fb6ac0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:42.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.326+0000 7fb6aa59c640 1 -- 172.21.15.55:0/4095742286 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac0cd0d0 con 0x7fb6ac15bbe0 2024-04-25T08:53:42.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.326+0000 7fb6a9d9b640 1 --2- 172.21.15.55:0/4095742286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6ac0cf510 0x7fb6ac0cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.326+0000 7fb6aa59c640 1 --2- 172.21.15.55:0/4095742286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac15bbe0 0x7fb6ac0cd8d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009e50 tx=0x7fb69c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52af96afc0defa4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.327+0000 7fb6a959a640 1 -- 172.21.15.55:0/4095742286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c036070 con 0x7fb6ac15bbe0 2024-04-25T08:53:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.327+0000 7fb6a959a640 1 -- 172.21.15.55:0/4095742286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c031600 con 0x7fb6ac15bbe0 2024-04-25T08:53:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.327+0000 7fb6a959a640 1 -- 172.21.15.55:0/4095742286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0319d0 con 0x7fb6ac15bbe0 2024-04-25T08:53:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.327+0000 7fb6b0948640 1 -- 172.21.15.55:0/4095742286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac15bbe0 msgr2=0x7fb6ac0cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.327+0000 7fb6b0948640 1 --2- 172.21.15.55:0/4095742286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac15bbe0 0x7fb6ac0cd8d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009e50 tx=0x7fb69c02a6c0 comp rx=0 tx=0).stop 2024-04-25T08:53:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.327+0000 7fb6b0948640 1 -- 172.21.15.55:0/4095742286 shutdown_connections 2024-04-25T08:53:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.327+0000 7fb6b0948640 1 --2- 172.21.15.55:0/4095742286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6ac0cf510 0x7fb6ac0cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.327+0000 7fb6b0948640 1 --2- 172.21.15.55:0/4095742286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac15bbe0 0x7fb6ac0cd8d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.327+0000 7fb6b0948640 1 -- 172.21.15.55:0/4095742286 >> 172.21.15.55:0/4095742286 conn(0x7fb6ac0b3430 msgr2=0x7fb6ac0b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.327+0000 7fb6b0948640 1 -- 172.21.15.55:0/4095742286 shutdown_connections 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.327+0000 7fb6b0948640 1 -- 172.21.15.55:0/4095742286 wait complete. 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.329+0000 7fb6b0948640 1 Processor -- start 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.329+0000 7fb6b0948640 1 -- start start 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.329+0000 7fb6b0948640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0cf510 0x7fb6ac1e43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.329+0000 7fb6b0948640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6ac0cff00 0x7fb6ac14aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.329+0000 7fb6b0948640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6ac15bbe0 0x7fb6ac14c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.329+0000 7fb6b0948640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0cde10 con 0x7fb6ac0cf510 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.329+0000 7fb6b0948640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac15bfc0 con 0x7fb6ac0cff00 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.329+0000 7fb6b0948640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0cc450 con 0x7fb6ac15bbe0 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.329+0000 7fb6aa59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0cf510 0x7fb6ac1e43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.329+0000 7fb6aa59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0cf510 0x7fb6ac1e43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42080/0 (socket says 172.21.15.55:42080) 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.329+0000 7fb6aa59c640 1 -- 172.21.15.55:0/2950719763 learned_addr learned my addr 172.21.15.55:0/2950719763 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6a9d9b640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6ac0cff00 0x7fb6ac14aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6aad9d640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6ac15bbe0 0x7fb6ac14c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6aa59c640 1 -- 172.21.15.55:0/2950719763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6ac15bbe0 msgr2=0x7fb6ac14c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6aa59c640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6ac15bbe0 0x7fb6ac14c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6aa59c640 1 -- 172.21.15.55:0/2950719763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6ac0cff00 msgr2=0x7fb6ac14aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6aa59c640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6ac0cff00 0x7fb6ac14aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6aa59c640 1 -- 172.21.15.55:0/2950719763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac14b900 con 0x7fb6ac0cf510 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6aa59c640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0cf510 0x7fb6ac1e43e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb69c034040 tx=0x7fb69c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6a2ffd640 1 -- 172.21.15.55:0/2950719763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c03f020 con 0x7fb6ac0cf510 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6a2ffd640 1 -- 172.21.15.55:0/2950719763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c037040 con 0x7fb6ac0cf510 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6b0948640 1 -- 172.21.15.55:0/2950719763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac14bbe0 con 0x7fb6ac0cf510 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6a2ffd640 1 -- 172.21.15.55:0/2950719763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c036070 con 0x7fb6ac0cf510 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.330+0000 7fb6b0948640 1 -- 172.21.15.55:0/2950719763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac14c1a0 con 0x7fb6ac0cf510 2024-04-25T08:53:42.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.331+0000 7fb6b0948640 1 -- 172.21.15.55:0/2950719763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ac0750b0 con 0x7fb6ac0cf510 2024-04-25T08:53:42.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.332+0000 7fb6a2ffd640 1 -- 172.21.15.55:0/2950719763 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb69c042020 con 0x7fb6ac0cf510 2024-04-25T08:53:42.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.332+0000 7fb6a2ffd640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb68c06b4d0 0x7fb68c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.332+0000 7fb6a2ffd640 1 -- 172.21.15.55:0/2950719763 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb69c0aa730 con 0x7fb6ac0cf510 2024-04-25T08:53:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.332+0000 7fb6a9d9b640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb68c06b4d0 0x7fb68c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.333+0000 7fb6a9d9b640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb68c06b4d0 0x7fb68c06d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac15b410 tx=0x7fb694008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:42.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.337+0000 7fb6a2ffd640 1 -- 172.21.15.55:0/2950719763 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb69c049030 con 0x7fb6ac0cf510 2024-04-25T08:53:42.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:42.556+0000 7fb6b0948640 1 -- 172.21.15.55:0/2950719763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb6ac0b4a90 con 0x7fb6ac0cf510 2024-04-25T08:53:43.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.204+0000 7fb6a2ffd640 1 -- 172.21.15.55:0/2950719763 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb69c079050 con 0x7fb6ac0cf510 2024-04-25T08:53:43.195 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T08:53:43.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.210+0000 7fb6b0948640 1 -- 172.21.15.55:0/2950719763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb68c06b4d0 msgr2=0x7fb68c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.210+0000 7fb6b0948640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb68c06b4d0 0x7fb68c06d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac15b410 tx=0x7fb694008040 comp rx=0 tx=0).stop 2024-04-25T08:53:43.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.210+0000 7fb6b0948640 1 -- 172.21.15.55:0/2950719763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0cf510 msgr2=0x7fb6ac1e43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.210+0000 7fb6b0948640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0cf510 0x7fb6ac1e43e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb69c034040 tx=0x7fb69c004a40 comp rx=0 tx=0).stop 2024-04-25T08:53:43.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.211+0000 7fb6b0948640 1 -- 172.21.15.55:0/2950719763 shutdown_connections 2024-04-25T08:53:43.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.211+0000 7fb6b0948640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb68c06b4d0 0x7fb68c06d990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.211+0000 7fb6b0948640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6ac15bbe0 0x7fb6ac14c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.211+0000 7fb6b0948640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6ac0cff00 0x7fb6ac14aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.212+0000 7fb6b0948640 1 --2- 172.21.15.55:0/2950719763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0cf510 0x7fb6ac1e43e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.212+0000 7fb6b0948640 1 -- 172.21.15.55:0/2950719763 >> 172.21.15.55:0/2950719763 conn(0x7fb6ac0b3430 msgr2=0x7fb6ac0c5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.215+0000 7fb6b0948640 1 -- 172.21.15.55:0/2950719763 shutdown_connections 2024-04-25T08:53:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.216+0000 7fb6b0948640 1 -- 172.21.15.55:0/2950719763 wait complete. 2024-04-25T08:53:43.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:43.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.345+0000 7fbdf4e1f640 1 Processor -- start 2024-04-25T08:53:43.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.345+0000 7fbdf4e1f640 1 -- start start 2024-04-25T08:53:43.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.345+0000 7fbdf4e1f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbdf015ba10 0x7fbdf0099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.345+0000 7fbdf4e1f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf006c900 con 0x7fbdf006c3c0 2024-04-25T08:53:43.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.345+0000 7fbdf4e1f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf006cbe0 con 0x7fbdf0099f80 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.345+0000 7fbdf4e1f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf00cbe50 con 0x7fbdf015ba10 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdeed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbdf006c3c0 0x7fbdf00cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56804/0 (socket says 172.21.15.55:56804) 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdeed9d640 1 -- 172.21.15.55:0/1398773856 learned_addr learned my addr 172.21.15.55:0/1398773856 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdee59c640 1 --2- 172.21.15.55:0/1398773856 >> v2:172.21.15.167:3300/0 conn(0x7fbdf015ba10 0x7fbdf0099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623592856 0 0) 0x7fbdf006c900 con 0x7fbdf006c3c0 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbddc003520 con 0x7fbdf006c3c0 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4211519513 0 0) 0x7fbddc003520 con 0x7fbdf006c3c0 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 >> v2:172.21.15.167:3300/0 conn(0x7fbdf015ba10 msgr2=0x7fbdf0099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 --2- 172.21.15.55:0/1398773856 >> v2:172.21.15.167:3300/0 conn(0x7fbdf015ba10 0x7fbdf0099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 >> v1:172.21.15.167:6789/0 conn(0x7fbdf0099f80 legacy=0x7fbdf006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf006cec0 con 0x7fbdf006c3c0 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fbde80019f0 con 0x7fbdf006c3c0 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 >> v1:172.21.15.55:6789/0 conn(0x7fbdf006c3c0 legacy=0x7fbdf00cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 --2- 172.21.15.55:0/1398773856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbddc0039b0 0x7fbddc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 --2- 172.21.15.55:0/1398773856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbddc004800 0x7fbddc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 --2- 172.21.15.55:0/1398773856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0051c0 0x7fbddc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc00c030 con 0x7fbddc0039b0 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc00c1e0 con 0x7fbddc0051c0 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc00c3e0 con 0x7fbddc004800 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdee59c640 1 --2- 172.21.15.55:0/1398773856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbddc0039b0 0x7fbddc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbde7fff640 1 --2- 172.21.15.55:0/1398773856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbddc004800 0x7fbddc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.346+0000 7fbdeed9d640 1 --2- 172.21.15.55:0/1398773856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0051c0 0x7fbddc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.347+0000 7fbdee59c640 1 -- 172.21.15.55:0/1398773856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbddc004800 msgr2=0x7fbddc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.347+0000 7fbdee59c640 1 --2- 172.21.15.55:0/1398773856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbddc004800 0x7fbddc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.347+0000 7fbdee59c640 1 -- 172.21.15.55:0/1398773856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0051c0 msgr2=0x7fbddc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.347+0000 7fbdee59c640 1 --2- 172.21.15.55:0/1398773856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0051c0 0x7fbddc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.347+0000 7fbdee59c640 1 -- 172.21.15.55:0/1398773856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc003520 con 0x7fbddc0039b0 2024-04-25T08:53:43.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.347+0000 7fbdeed9d640 1 -- 172.21.15.55:0/1398773856 reap_dead start 2024-04-25T08:53:43.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.347+0000 7fbdee59c640 1 --2- 172.21.15.55:0/1398773856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbddc0039b0 0x7fbddc003dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009ac0 tx=0x7fbddc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11b9e2d53efc483 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:43.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.347+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0036070 con 0x7fbddc0039b0 2024-04-25T08:53:43.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.347+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0031400 con 0x7fbddc0039b0 2024-04-25T08:53:43.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.347+0000 7fbdedd9b640 1 -- 172.21.15.55:0/1398773856 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0009690 con 0x7fbddc0039b0 2024-04-25T08:53:43.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.348+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/1398773856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbddc0039b0 msgr2=0x7fbddc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.348+0000 7fbdf4e1f640 1 --2- 172.21.15.55:0/1398773856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbddc0039b0 0x7fbddc003dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009ac0 tx=0x7fbddc005830 comp rx=0 tx=0).stop 2024-04-25T08:53:43.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.348+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/1398773856 shutdown_connections 2024-04-25T08:53:43.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.348+0000 7fbdf4e1f640 1 --2- 172.21.15.55:0/1398773856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbddc0039b0 0x7fbddc003dd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.348+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/1398773856 >> 172.21.15.55:0/1398773856 conn(0x7fbdf00b32f0 msgr2=0x7fbdf00b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.348+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/1398773856 shutdown_connections 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.348+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/1398773856 wait complete. 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.349+0000 7fbdf4e1f640 1 Processor -- start 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.349+0000 7fbdf4e1f640 1 -- start start 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.350+0000 7fbdf4e1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0039b0 0x7fbdf015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.350+0000 7fbdf4e1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf00c6720 0x7fbdf00c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.350+0000 7fbdf4e1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf00c5870 0x7fbdf015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.350+0000 7fbdf4e1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0099dd0 con 0x7fbdf00c6720 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.350+0000 7fbdf4e1f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0099c50 con 0x7fbddc0039b0 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.350+0000 7fbdf4e1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf009a3d0 con 0x7fbdf00c5870 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.350+0000 7fbde7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf00c6720 0x7fbdf00c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.350+0000 7fbde7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf00c6720 0x7fbdf00c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42094/0 (socket says 172.21.15.55:42094) 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.350+0000 7fbde7fff640 1 -- 172.21.15.55:0/3927498438 learned_addr learned my addr 172.21.15.55:0/3927498438 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.350+0000 7fbdee59c640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0039b0 0x7fbdf015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.350+0000 7fbdeed9d640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf00c5870 0x7fbdf015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.351+0000 7fbde7fff640 1 -- 172.21.15.55:0/3927498438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf00c5870 msgr2=0x7fbdf015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.351+0000 7fbde7fff640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf00c5870 0x7fbdf015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.351+0000 7fbde7fff640 1 -- 172.21.15.55:0/3927498438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0039b0 msgr2=0x7fbdf015a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.351+0000 7fbde7fff640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0039b0 0x7fbdf015a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.351+0000 7fbde7fff640 1 -- 172.21.15.55:0/3927498438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf00c5d10 con 0x7fbdf00c6720 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.351+0000 7fbde7fff640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf00c6720 0x7fbdf00c5330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800f5f0 tx=0x7fbdd800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.351+0000 7fbde6ffd640 1 -- 172.21.15.55:0/3927498438 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80052e0 con 0x7fbdf00c6720 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.351+0000 7fbde6ffd640 1 -- 172.21.15.55:0/3927498438 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd8018070 con 0x7fbdf00c6720 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.351+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/3927498438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf00c5ff0 con 0x7fbdf00c6720 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.351+0000 7fbde6ffd640 1 -- 172.21.15.55:0/3927498438 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8003810 con 0x7fbdf00c6720 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.351+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/3927498438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf01f4500 con 0x7fbdf00c6720 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.352+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/3927498438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf006dba0 con 0x7fbdf00c6720 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.352+0000 7fbde6ffd640 1 -- 172.21.15.55:0/3927498438 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbdd80039b0 con 0x7fbdf00c6720 2024-04-25T08:53:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.353+0000 7fbde6ffd640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbdd006b4d0 0x7fbdd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.353+0000 7fbde6ffd640 1 -- 172.21.15.55:0/3927498438 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdd8089df0 con 0x7fbdf00c6720 2024-04-25T08:53:43.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.353+0000 7fbdee59c640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbdd006b4d0 0x7fbdd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.353+0000 7fbdee59c640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbdd006b4d0 0x7fbdd006d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbde0033000 tx=0x7fbde0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:43.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.357+0000 7fbde6ffd640 1 -- 172.21.15.55:0/3927498438 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbdf006dba0 con 0x7fbdf00c6720 2024-04-25T08:53:43.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.538+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/3927498438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdf00749b0 con 0x7fbdf00c6720 2024-04-25T08:53:43.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.539+0000 7fbde6ffd640 1 -- 172.21.15.55:0/3927498438 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16618 (secure 0 0 0) 0x7fbdd8058610 con 0x7fbdf00c6720 2024-04-25T08:53:43.529 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:43.529 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:42.557732+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.540+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/3927498438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbdd006b4d0 msgr2=0x7fbdd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.540+0000 7fbdf4e1f640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbdd006b4d0 0x7fbdd006d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbde0033000 tx=0x7fbde0008030 comp rx=0 tx=0).stop 2024-04-25T08:53:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.540+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/3927498438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf00c6720 msgr2=0x7fbdf00c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.540+0000 7fbdf4e1f640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf00c6720 0x7fbdf00c5330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800f5f0 tx=0x7fbdd800fab0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.541+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/3927498438 shutdown_connections 2024-04-25T08:53:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.541+0000 7fbdf4e1f640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbdd006b4d0 0x7fbdd006d990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.541+0000 7fbdf4e1f640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf00c5870 0x7fbdf015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.541+0000 7fbdf4e1f640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf00c6720 0x7fbdf00c5330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.541+0000 7fbdf4e1f640 1 --2- 172.21.15.55:0/3927498438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0039b0 0x7fbdf015a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.541+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/3927498438 >> 172.21.15.55:0/3927498438 conn(0x7fbdf00b32f0 msgr2=0x7fbdf00b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:43.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.541+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/3927498438 shutdown_connections 2024-04-25T08:53:43.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.541+0000 7fbdf4e1f640 1 -- 172.21.15.55:0/3927498438 wait complete. 2024-04-25T08:53:43.542 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:43.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.653+0000 7f682e21b640 1 Processor -- start 2024-04-25T08:53:43.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.653+0000 7f682e21b640 1 -- start start 2024-04-25T08:53:43.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.653+0000 7f682e21b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68280b5b60 0x7f68281687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.653+0000 7f682e21b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682815e0c0 con 0x7f68280d35b0 2024-04-25T08:53:43.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.653+0000 7f682e21b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68280d2510 con 0x7f682815dce0 2024-04-25T08:53:43.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.653+0000 7f682e21b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68280b7b10 con 0x7f68280b5b60 2024-04-25T08:53:43.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.653+0000 7f6826ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f68280d35b0 0x7f68280b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56812/0 (socket says 172.21.15.55:56812) 2024-04-25T08:53:43.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.653+0000 7f6826ffd640 1 -- 172.21.15.55:0/1299953508 learned_addr learned my addr 172.21.15.55:0/1299953508 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:43.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.654+0000 7f6827fff640 1 --2- 172.21.15.55:0/1299953508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68280b5b60 0x7f68281687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.654+0000 7f68267fc640 1 -- 172.21.15.55:0/1299953508 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077595754 0 0) 0x7f682815e0c0 con 0x7f68280d35b0 2024-04-25T08:53:43.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.654+0000 7f68267fc640 1 -- 172.21.15.55:0/1299953508 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6810003520 con 0x7f68280d35b0 2024-04-25T08:53:43.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.654+0000 7f68267fc640 1 -- 172.21.15.55:0/1299953508 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703068021 0 0) 0x7f68280d2510 con 0x7f682815dce0 2024-04-25T08:53:43.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.654+0000 7f68267fc640 1 -- 172.21.15.55:0/1299953508 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f682815e0c0 con 0x7f682815dce0 2024-04-25T08:53:43.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.654+0000 7f6827fff640 1 -- 172.21.15.55:0/1299953508 >> v1:172.21.15.167:6789/0 conn(0x7f682815dce0 legacy=0x7f68280d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.654+0000 7f6827fff640 1 -- 172.21.15.55:0/1299953508 >> v1:172.21.15.55:6789/0 conn(0x7f68280d35b0 legacy=0x7f68280b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.654+0000 7f6827fff640 1 -- 172.21.15.55:0/1299953508 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68280d27f0 con 0x7f68280b5b60 2024-04-25T08:53:43.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.655+0000 7f6827fff640 1 --2- 172.21.15.55:0/1299953508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68280b5b60 0x7f68281687f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6820009dc0 tx=0x7f682002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f683d40eb7a2c856 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:43.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.655+0000 7f68267fc640 1 -- 172.21.15.55:0/1299953508 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820007740 con 0x7f68280b5b60 2024-04-25T08:53:43.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.655+0000 7f68267fc640 1 -- 172.21.15.55:0/1299953508 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68200078e0 con 0x7f68280b5b60 2024-04-25T08:53:43.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.655+0000 7f68267fc640 1 -- 172.21.15.55:0/1299953508 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820007c90 con 0x7f68280b5b60 2024-04-25T08:53:43.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.655+0000 7f682e21b640 1 -- 172.21.15.55:0/1299953508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68280b5b60 msgr2=0x7f68281687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.655+0000 7f682e21b640 1 --2- 172.21.15.55:0/1299953508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68280b5b60 0x7f68281687f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6820009dc0 tx=0x7f682002a6d0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.656+0000 7f682e21b640 1 -- 172.21.15.55:0/1299953508 shutdown_connections 2024-04-25T08:53:43.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.656+0000 7f682e21b640 1 --2- 172.21.15.55:0/1299953508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68280b5b60 0x7f68281687f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.656+0000 7f682e21b640 1 -- 172.21.15.55:0/1299953508 >> 172.21.15.55:0/1299953508 conn(0x7f6828072900 msgr2=0x7f68280d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:43.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.656+0000 7f682e21b640 1 -- 172.21.15.55:0/1299953508 shutdown_connections 2024-04-25T08:53:43.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.656+0000 7f682e21b640 1 -- 172.21.15.55:0/1299953508 wait complete. 2024-04-25T08:53:43.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.657+0000 7f682e21b640 1 Processor -- start 2024-04-25T08:53:43.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.657+0000 7f682e21b640 1 -- start start 2024-04-25T08:53:43.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f682e21b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68280b5b60 0x7f68281f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f682e21b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68280d35b0 0x7f682815b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f682e21b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f682815dce0 0x7f6828160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f682e21b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68280d3090 con 0x7f68280d35b0 2024-04-25T08:53:43.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f682e21b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68280d2db0 con 0x7f682815dce0 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f682e21b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68280d2160 con 0x7f68280b5b60 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f6826ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68280d35b0 0x7f682815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f6826ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68280d35b0 0x7f682815b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42106/0 (socket says 172.21.15.55:42106) 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f6826ffd640 1 -- 172.21.15.55:0/375521182 learned_addr learned my addr 172.21.15.55:0/375521182 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f68277fe640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68280b5b60 0x7f68281f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f6827fff640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f682815dce0 0x7f6828160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f6826ffd640 1 -- 172.21.15.55:0/375521182 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68280b5b60 msgr2=0x7f68281f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f6826ffd640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68280b5b60 0x7f68281f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f6826ffd640 1 -- 172.21.15.55:0/375521182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f682815dce0 msgr2=0x7f6828160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f6826ffd640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f682815dce0 0x7f6828160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f6826ffd640 1 -- 172.21.15.55:0/375521182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68281f3cd0 con 0x7f68280d35b0 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f6826ffd640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68280d35b0 0x7f682815b850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c4d0 tx=0x7f681c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f680ffff640 1 -- 172.21.15.55:0/375521182 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c017070 con 0x7f68280d35b0 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f680ffff640 1 -- 172.21.15.55:0/375521182 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c005ce0 con 0x7f68280d35b0 2024-04-25T08:53:43.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f682e21b640 1 -- 172.21.15.55:0/375521182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68281f3fb0 con 0x7f68280d35b0 2024-04-25T08:53:43.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f680ffff640 1 -- 172.21.15.55:0/375521182 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c007270 con 0x7f68280d35b0 2024-04-25T08:53:43.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.658+0000 7f682e21b640 1 -- 172.21.15.55:0/375521182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68281f4570 con 0x7f68280d35b0 2024-04-25T08:53:43.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.659+0000 7f682e21b640 1 -- 172.21.15.55:0/375521182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68281f48b0 con 0x7f68280d35b0 2024-04-25T08:53:43.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.660+0000 7f680ffff640 1 -- 172.21.15.55:0/375521182 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f681c01a070 con 0x7f68280d35b0 2024-04-25T08:53:43.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.660+0000 7f680ffff640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f681406b4d0 0x7f681406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.660+0000 7f680ffff640 1 -- 172.21.15.55:0/375521182 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f681c0894b0 con 0x7f68280d35b0 2024-04-25T08:53:43.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.660+0000 7f68277fe640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f681406b4d0 0x7f681406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.661+0000 7f68277fe640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f681406b4d0 0x7f681406d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6818007fd0 tx=0x7f6818009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:43.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.664+0000 7f680ffff640 1 -- 172.21.15.55:0/375521182 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f68281f48b0 con 0x7f68280d35b0 2024-04-25T08:53:43.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.849+0000 7f682e21b640 1 -- 172.21.15.55:0/375521182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68280749b0 con 0x7f68280d35b0 2024-04-25T08:53:43.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.850+0000 7f680ffff640 1 -- 172.21.15.55:0/375521182 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16618 (secure 0 0 0) 0x7f681c057ce0 con 0x7f68280d35b0 2024-04-25T08:53:43.840 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:43.841 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:42.557732+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 -- 172.21.15.55:0/375521182 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f681406b4d0 msgr2=0x7f681406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f681406b4d0 0x7f681406d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6818007fd0 tx=0x7f6818009040 comp rx=0 tx=0).stop 2024-04-25T08:53:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 -- 172.21.15.55:0/375521182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68280d35b0 msgr2=0x7f682815b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68280d35b0 0x7f682815b850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c4d0 tx=0x7f681c00c990 comp rx=0 tx=0).stop 2024-04-25T08:53:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 -- 172.21.15.55:0/375521182 shutdown_connections 2024-04-25T08:53:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f681406b4d0 0x7f681406d990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f682815dce0 0x7f6828160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68280d35b0 0x7f682815b850 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 --2- 172.21.15.55:0/375521182 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68280b5b60 0x7f68281f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 -- 172.21.15.55:0/375521182 >> 172.21.15.55:0/375521182 conn(0x7f6828072900 msgr2=0x7f68280ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 -- 172.21.15.55:0/375521182 shutdown_connections 2024-04-25T08:53:43.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.852+0000 7f682e21b640 1 -- 172.21.15.55:0/375521182 wait complete. 2024-04-25T08:53:43.853 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:53:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.966+0000 7f2176329640 1 Processor -- start 2024-04-25T08:53:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.966+0000 7f2176329640 1 -- start start 2024-04-25T08:53:43.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.967+0000 7f2176329640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21700cf510 0x7f21700cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.967+0000 7f2176329640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f21700cff00 0x7f21700d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.967+0000 7f2176329640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21700cc830 con 0x7f217015bbe0 2024-04-25T08:53:43.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.967+0000 7f2176329640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700ccb10 con 0x7f21700cf510 2024-04-25T08:53:43.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.967+0000 7f2176329640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700ccdf0 con 0x7f21700cff00 2024-04-25T08:53:43.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.967+0000 7f216f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21700cf510 0x7f21700cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.967+0000 7f216f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21700cf510 0x7f21700cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42116/0 (socket says 172.21.15.55:42116) 2024-04-25T08:53:43.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.967+0000 7f216f7fe640 1 -- 172.21.15.55:0/3631529288 learned_addr learned my addr 172.21.15.55:0/3631529288 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:43.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.967+0000 7f216ffff640 1 --1- 172.21.15.55:0/3631529288 >> v1:172.21.15.55:6789/0 conn(0x7f217015bbe0 0x7f21700cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56824/0 (socket says 172.21.15.55:56824) 2024-04-25T08:53:43.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.968+0000 7f21748c6640 1 --2- 172.21.15.55:0/3631529288 >> v2:172.21.15.167:3300/0 conn(0x7f21700cff00 0x7f21700d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.968+0000 7f216f7fe640 1 -- 172.21.15.55:0/3631529288 >> v2:172.21.15.167:3300/0 conn(0x7f21700cff00 msgr2=0x7f21700d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:43.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.968+0000 7f216f7fe640 1 --2- 172.21.15.55:0/3631529288 >> v2:172.21.15.167:3300/0 conn(0x7f21700cff00 0x7f21700d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.968+0000 7f216f7fe640 1 -- 172.21.15.55:0/3631529288 >> v1:172.21.15.55:6789/0 conn(0x7f217015bbe0 legacy=0x7f21700cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.968+0000 7f216effd640 1 -- 172.21.15.55:0/3631529288 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935943749 0 0) 0x7f21700cc830 con 0x7f217015bbe0 2024-04-25T08:53:43.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.968+0000 7f216f7fe640 1 -- 172.21.15.55:0/3631529288 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700cd0d0 con 0x7f21700cf510 2024-04-25T08:53:43.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.968+0000 7f21748c6640 1 --2- 172.21.15.55:0/3631529288 >> v2:172.21.15.167:3300/0 conn(0x7f21700cff00 0x7f21700d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:43.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.968+0000 7f216f7fe640 1 --2- 172.21.15.55:0/3631529288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21700cf510 0x7f21700cf970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21700723f0 tx=0x7f216402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367f2d1e54da6184 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:43.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.968+0000 7f216effd640 1 -- 172.21.15.55:0/3631529288 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164037070 con 0x7f21700cf510 2024-04-25T08:53:43.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.968+0000 7f216effd640 1 -- 172.21.15.55:0/3631529288 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164032440 con 0x7f21700cf510 2024-04-25T08:53:43.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.968+0000 7f216effd640 1 -- 172.21.15.55:0/3631529288 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164032810 con 0x7f21700cf510 2024-04-25T08:53:43.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.969+0000 7f2176329640 1 -- 172.21.15.55:0/3631529288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21700cf510 msgr2=0x7f21700cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.969+0000 7f2176329640 1 --2- 172.21.15.55:0/3631529288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21700cf510 0x7f21700cf970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21700723f0 tx=0x7f216402a270 comp rx=0 tx=0).stop 2024-04-25T08:53:43.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.969+0000 7f2176329640 1 -- 172.21.15.55:0/3631529288 shutdown_connections 2024-04-25T08:53:43.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.969+0000 7f2176329640 1 --2- 172.21.15.55:0/3631529288 >> v2:172.21.15.167:3300/0 conn(0x7f21700cff00 0x7f21700d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.969+0000 7f2176329640 1 --2- 172.21.15.55:0/3631529288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21700cf510 0x7f21700cf970 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.969+0000 7f2176329640 1 -- 172.21.15.55:0/3631529288 >> 172.21.15.55:0/3631529288 conn(0x7f21700b3430 msgr2=0x7f21700b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:43.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.969+0000 7f2176329640 1 -- 172.21.15.55:0/3631529288 shutdown_connections 2024-04-25T08:53:43.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.969+0000 7f2176329640 1 -- 172.21.15.55:0/3631529288 wait complete. 2024-04-25T08:53:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.970+0000 7f2176329640 1 Processor -- start 2024-04-25T08:53:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.970+0000 7f2176329640 1 -- start start 2024-04-25T08:53:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f2176329640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21700cf510 0x7f217014b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f2176329640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21700cff00 0x7f217015c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f2176329640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f217015bbe0 0x7f21701583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f2176329640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700cc450 con 0x7f21700cff00 2024-04-25T08:53:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f2176329640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217015bfc0 con 0x7f217015bbe0 2024-04-25T08:53:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f2176329640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21700cc5d0 con 0x7f21700cf510 2024-04-25T08:53:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f216f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21700cff00 0x7f217015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f216f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21700cff00 0x7f217015c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42124/0 (socket says 172.21.15.55:42124) 2024-04-25T08:53:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f216f7fe640 1 -- 172.21.15.55:0/924926271 learned_addr learned my addr 172.21.15.55:0/924926271 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f216ffff640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21700cf510 0x7f217014b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f21748c6640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f217015bbe0 0x7f21701583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f216f7fe640 1 -- 172.21.15.55:0/924926271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21700cf510 msgr2=0x7f217014b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f216f7fe640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21700cf510 0x7f217014b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f216f7fe640 1 -- 172.21.15.55:0/924926271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f217015bbe0 msgr2=0x7f21701583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f216f7fe640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f217015bbe0 0x7f21701583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.971+0000 7f216f7fe640 1 -- 172.21.15.55:0/924926271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700b5a50 con 0x7f21700cff00 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.972+0000 7f21748c6640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f217015bbe0 0x7f21701583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.972+0000 7f216ffff640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21700cf510 0x7f217014b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.972+0000 7f216f7fe640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21700cff00 0x7f217015c140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2164000c00 tx=0x7f21640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.972+0000 7f216cff9640 1 -- 172.21.15.55:0/924926271 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164041070 con 0x7f21700cff00 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.972+0000 7f216cff9640 1 -- 172.21.15.55:0/924926271 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216403c870 con 0x7f21700cff00 2024-04-25T08:53:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.972+0000 7f2176329640 1 -- 172.21.15.55:0/924926271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21700b5d30 con 0x7f21700cff00 2024-04-25T08:53:43.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.972+0000 7f216cff9640 1 -- 172.21.15.55:0/924926271 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164037040 con 0x7f21700cff00 2024-04-25T08:53:43.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.972+0000 7f2176329640 1 -- 172.21.15.55:0/924926271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21700b62f0 con 0x7f21700cff00 2024-04-25T08:53:43.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.973+0000 7f2176329640 1 -- 172.21.15.55:0/924926271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21700750b0 con 0x7f21700cff00 2024-04-25T08:53:43.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.973+0000 7f216cff9640 1 -- 172.21.15.55:0/924926271 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2164044070 con 0x7f21700cff00 2024-04-25T08:53:43.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.974+0000 7f216cff9640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f215c06b500 0x7f215c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:43.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.974+0000 7f216cff9640 1 -- 172.21.15.55:0/924926271 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21640aad60 con 0x7f21700cff00 2024-04-25T08:53:43.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.974+0000 7f216ffff640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f215c06b500 0x7f215c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:43.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.974+0000 7f216ffff640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f215c06b500 0x7f215c06d9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2160000f60 tx=0x7f2160009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:43.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:43.978+0000 7f216cff9640 1 -- 172.21.15.55:0/924926271 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2164079d90 con 0x7f21700cff00 2024-04-25T08:53:44.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.196+0000 7f2176329640 1 -- 172.21.15.55:0/924926271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f217015b0c0 con 0x7f21700cff00 2024-04-25T08:53:44.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.215+0000 7f216cff9640 1 -- 172.21.15.55:0/924926271 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2164079690 con 0x7f21700cff00 2024-04-25T08:53:44.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 -- 172.21.15.55:0/924926271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f215c06b500 msgr2=0x7f215c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:44.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f215c06b500 0x7f215c06d9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2160000f60 tx=0x7f2160009040 comp rx=0 tx=0).stop 2024-04-25T08:53:44.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 -- 172.21.15.55:0/924926271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21700cff00 msgr2=0x7f217015c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:44.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21700cff00 0x7f217015c140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2164000c00 tx=0x7f21640046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:44.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 -- 172.21.15.55:0/924926271 shutdown_connections 2024-04-25T08:53:44.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f215c06b500 0x7f215c06d9c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:44.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f217015bbe0 0x7f21701583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21700cff00 0x7f217015c140 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 --2- 172.21.15.55:0/924926271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21700cf510 0x7f217014b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 -- 172.21.15.55:0/924926271 >> 172.21.15.55:0/924926271 conn(0x7f21700b3430 msgr2=0x7f21700ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 -- 172.21.15.55:0/924926271 shutdown_connections 2024-04-25T08:53:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.217+0000 7f2176329640 1 -- 172.21.15.55:0/924926271 wait complete. 2024-04-25T08:53:44.218 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:53:44.218 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:53:44.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.332+0000 7f7c8b5b0640 1 Processor -- start 2024-04-25T08:53:44.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.332+0000 7f7c8b5b0640 1 -- start start 2024-04-25T08:53:44.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.333+0000 7f7c8b5b0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c840b9720 0x7f7c840b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:44.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.333+0000 7f7c8b5b0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c840b5aa0 0x7f7c840b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:44.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.333+0000 7f7c8b5b0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c840d2670 con 0x7f7c8415dbb0 2024-04-25T08:53:44.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.333+0000 7f7c8b5b0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c840d2950 con 0x7f7c840b5aa0 2024-04-25T08:53:44.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.333+0000 7f7c8b5b0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c840d2c30 con 0x7f7c840b9720 2024-04-25T08:53:44.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.333+0000 7f7c89b4d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c840b5aa0 0x7f7c840b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:44.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.333+0000 7f7c88b4b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c840b9720 0x7f7c840b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:44.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.333+0000 7f7c8934c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7c8415dbb0 0x7f7c840d1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:35928/0 (socket says 172.21.15.55:35928) 2024-04-25T08:53:44.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.333+0000 7f7c89b4d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c840b5aa0 0x7f7c840b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:34786/0 (socket says 172.21.15.55:34786) 2024-04-25T08:53:44.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.333+0000 7f7c8934c640 1 -- 172.21.15.55:0/1177780260 learned_addr learned my addr 172.21.15.55:0/1177780260 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:44.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.334+0000 7f7c88b4b640 1 -- 172.21.15.55:0/1177780260 >> v2:172.21.15.167:3300/0 conn(0x7f7c840b5aa0 msgr2=0x7f7c840b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:44.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.334+0000 7f7c88b4b640 1 --2- 172.21.15.55:0/1177780260 >> v2:172.21.15.167:3300/0 conn(0x7f7c840b5aa0 0x7f7c840b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:44.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.334+0000 7f7c88b4b640 1 -- 172.21.15.55:0/1177780260 >> v1:172.21.15.167:6789/0 conn(0x7f7c8415dbb0 legacy=0x7f7c840d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:44.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.334+0000 7f7c88b4b640 1 -- 172.21.15.55:0/1177780260 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c840d2f10 con 0x7f7c840b9720 2024-04-25T08:53:44.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.334+0000 7f7c89b4d640 1 --2- 172.21.15.55:0/1177780260 >> v2:172.21.15.167:3300/0 conn(0x7f7c840b5aa0 0x7f7c840b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:44.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.334+0000 7f7c88b4b640 1 --2- 172.21.15.55:0/1177780260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c840b9720 0x7f7c840b5560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7c780097a0 tx=0x7f7c7802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5e5bee1251aa1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:44.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.335+0000 7f7c83fff640 1 -- 172.21.15.55:0/1177780260 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78037070 con 0x7f7c840b9720 2024-04-25T08:53:44.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.335+0000 7f7c83fff640 1 -- 172.21.15.55:0/1177780260 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c78032440 con 0x7f7c840b9720 2024-04-25T08:53:44.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.335+0000 7f7c83fff640 1 -- 172.21.15.55:0/1177780260 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78032810 con 0x7f7c840b9720 2024-04-25T08:53:44.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.335+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1177780260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c840b9720 msgr2=0x7f7c840b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:44.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.335+0000 7f7c8b5b0640 1 --2- 172.21.15.55:0/1177780260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c840b9720 0x7f7c840b5560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7c780097a0 tx=0x7f7c7802a180 comp rx=0 tx=0).stop 2024-04-25T08:53:44.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.335+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1177780260 shutdown_connections 2024-04-25T08:53:44.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.335+0000 7f7c8b5b0640 1 --2- 172.21.15.55:0/1177780260 >> v2:172.21.15.167:3300/0 conn(0x7f7c840b5aa0 0x7f7c840b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:44.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.335+0000 7f7c8b5b0640 1 --2- 172.21.15.55:0/1177780260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c840b9720 0x7f7c840b5560 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:44.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.335+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1177780260 >> 172.21.15.55:0/1177780260 conn(0x7f7c840d0560 msgr2=0x7f7c840d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:44.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.335+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1177780260 shutdown_connections 2024-04-25T08:53:44.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.335+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1177780260 wait complete. 2024-04-25T08:53:44.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.337+0000 7f7c8b5b0640 1 Processor -- start 2024-04-25T08:53:44.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.337+0000 7f7c8b5b0640 1 -- start start 2024-04-25T08:53:44.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.337+0000 7f7c8b5b0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c840b5aa0 0x7f7c840cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:44.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.337+0000 7f7c8b5b0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c840b9720 0x7f7c840c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:44.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.337+0000 7f7c8b5b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c8415dbb0 0x7f7c840ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:44.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.337+0000 7f7c8b5b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415e110 con 0x7f7c8415dbb0 2024-04-25T08:53:44.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.337+0000 7f7c8b5b0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415df90 con 0x7f7c840b5aa0 2024-04-25T08:53:44.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.337+0000 7f7c8b5b0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c840d3710 con 0x7f7c840b9720 2024-04-25T08:53:44.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.337+0000 7f7c89b4d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c8415dbb0 0x7f7c840ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.337+0000 7f7c89b4d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c8415dbb0 0x7f7c840ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42136/0 (socket says 172.21.15.55:42136) 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.337+0000 7f7c89b4d640 1 -- 172.21.15.55:0/1069812312 learned_addr learned my addr 172.21.15.55:0/1069812312 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c8934c640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c840b5aa0 0x7f7c840cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c88b4b640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c840b9720 0x7f7c840c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c89b4d640 1 -- 172.21.15.55:0/1069812312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c840b9720 msgr2=0x7f7c840c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c89b4d640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c840b9720 0x7f7c840c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c89b4d640 1 -- 172.21.15.55:0/1069812312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c840b5aa0 msgr2=0x7f7c840cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c89b4d640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c840b5aa0 0x7f7c840cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c89b4d640 1 -- 172.21.15.55:0/1069812312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c84147570 con 0x7f7c8415dbb0 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c89b4d640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c8415dbb0 0x7f7c840ca040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400efc0 tx=0x7f7c74009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c81ffb640 1 -- 172.21.15.55:0/1069812312 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74018030 con 0x7f7c8415dbb0 2024-04-25T08:53:44.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c81ffb640 1 -- 172.21.15.55:0/1069812312 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7400cde0 con 0x7f7c8415dbb0 2024-04-25T08:53:44.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1069812312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c84147850 con 0x7f7c8415dbb0 2024-04-25T08:53:44.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c81ffb640 1 -- 172.21.15.55:0/1069812312 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74003bb0 con 0x7f7c8415dbb0 2024-04-25T08:53:44.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.338+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1069812312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c84144c50 con 0x7f7c8415dbb0 2024-04-25T08:53:44.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.339+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1069812312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c840750b0 con 0x7f7c8415dbb0 2024-04-25T08:53:44.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.340+0000 7f7c81ffb640 1 -- 172.21.15.55:0/1069812312 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c74005d10 con 0x7f7c8415dbb0 2024-04-25T08:53:44.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.340+0000 7f7c81ffb640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c7006b4d0 0x7f7c7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:44.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.340+0000 7f7c81ffb640 1 -- 172.21.15.55:0/1069812312 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c7408aab0 con 0x7f7c8415dbb0 2024-04-25T08:53:44.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.340+0000 7f7c8934c640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c7006b4d0 0x7f7c7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:44.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.341+0000 7f7c8934c640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c7006b4d0 0x7f7c7006d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7c841e4ef0 tx=0x7f7c7c007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:44.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.344+0000 7f7c81ffb640 1 -- 172.21.15.55:0/1069812312 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c74022070 con 0x7f7c8415dbb0 2024-04-25T08:53:44.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:44.565+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1069812312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7c8406b080 con 0x7f7c8415dbb0 2024-04-25T08:53:45.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.226+0000 7f7c81ffb640 1 -- 172.21.15.55:0/1069812312 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7c74010040 con 0x7f7c8415dbb0 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.229+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1069812312 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c7006b4d0 msgr2=0x7f7c7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.229+0000 7f7c8b5b0640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c7006b4d0 0x7f7c7006d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7c841e4ef0 tx=0x7f7c7c007e80 comp rx=0 tx=0).stop 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.229+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1069812312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c8415dbb0 msgr2=0x7f7c840ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.229+0000 7f7c8b5b0640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c8415dbb0 0x7f7c840ca040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400efc0 tx=0x7f7c74009f90 comp rx=0 tx=0).stop 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.229+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1069812312 shutdown_connections 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.229+0000 7f7c8b5b0640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c7006b4d0 0x7f7c7006d990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.229+0000 7f7c8b5b0640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c8415dbb0 0x7f7c840ca040 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.229+0000 7f7c8b5b0640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c840b9720 0x7f7c840c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.229+0000 7f7c8b5b0640 1 --2- 172.21.15.55:0/1069812312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c840b5aa0 0x7f7c840cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.229+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1069812312 >> 172.21.15.55:0/1069812312 conn(0x7f7c840d0560 msgr2=0x7f7c841596b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.230+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1069812312 shutdown_connections 2024-04-25T08:53:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.230+0000 7f7c8b5b0640 1 -- 172.21.15.55:0/1069812312 wait complete. 2024-04-25T08:53:45.233 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:53:45.233 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:53:45.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.350+0000 7fc0f7ae4640 1 Processor -- start 2024-04-25T08:53:45.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.350+0000 7fc0f7ae4640 1 -- start start 2024-04-25T08:53:45.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.351+0000 7fc0f7ae4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0f015dce0 0x7fc0f00d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.351+0000 7fc0f7ae4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc0f00d35b0 0x7fc0f00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.351+0000 7fc0f7ae4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 0x7fc0f00b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.351+0000 7fc0f7ae4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f015e0c0 con 0x7fc0f015dce0 2024-04-25T08:53:45.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.351+0000 7fc0f7ae4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f00d2510 con 0x7fc0f00d35b0 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.351+0000 7fc0f7ae4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00d27f0 con 0x7fc0f00d1f90 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.351+0000 7fc0f5880640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0f015dce0 0x7fc0f00d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.351+0000 7fc0f5880640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0f015dce0 0x7fc0f00d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42144/0 (socket says 172.21.15.55:42144) 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.351+0000 7fc0f5880640 1 -- 172.21.15.55:0/2411380482 learned_addr learned my addr 172.21.15.55:0/2411380482 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.352+0000 7fc0f507f640 1 --2- 172.21.15.55:0/2411380482 >> v2:172.21.15.167:3300/0 conn(0x7fc0f00d35b0 0x7fc0f00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.352+0000 7fc0f6081640 1 --2- 172.21.15.55:0/2411380482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 0x7fc0f00b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.352+0000 7fc0f5880640 1 -- 172.21.15.55:0/2411380482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 msgr2=0x7fc0f00b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.352+0000 7fc0f5880640 1 --2- 172.21.15.55:0/2411380482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 0x7fc0f00b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.352+0000 7fc0f5880640 1 -- 172.21.15.55:0/2411380482 >> v2:172.21.15.167:3300/0 conn(0x7fc0f00d35b0 msgr2=0x7fc0f00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.352+0000 7fc0f5880640 1 --2- 172.21.15.55:0/2411380482 >> v2:172.21.15.167:3300/0 conn(0x7fc0f00d35b0 0x7fc0f00b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.352+0000 7fc0f5880640 1 -- 172.21.15.55:0/2411380482 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f00d2ad0 con 0x7fc0f015dce0 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.352+0000 7fc0f507f640 1 --2- 172.21.15.55:0/2411380482 >> v2:172.21.15.167:3300/0 conn(0x7fc0f00d35b0 0x7fc0f00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.352+0000 7fc0f6081640 1 --2- 172.21.15.55:0/2411380482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 0x7fc0f00b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:45.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.353+0000 7fc0f5880640 1 --2- 172.21.15.55:0/2411380482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f015dce0 0x7fc0f00d1a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00cdfa0 tx=0x7fc0e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13657fab0babbdfa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:45.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.353+0000 7fc0f487e640 1 -- 172.21.15.55:0/2411380482 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8037070 con 0x7fc0f015dce0 2024-04-25T08:53:45.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.353+0000 7fc0f487e640 1 -- 172.21.15.55:0/2411380482 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e8032440 con 0x7fc0f015dce0 2024-04-25T08:53:45.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.353+0000 7fc0f487e640 1 -- 172.21.15.55:0/2411380482 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8032810 con 0x7fc0f015dce0 2024-04-25T08:53:45.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.354+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/2411380482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f015dce0 msgr2=0x7fc0f00d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.354+0000 7fc0f7ae4640 1 --2- 172.21.15.55:0/2411380482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f015dce0 0x7fc0f00d1a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00cdfa0 tx=0x7fc0e802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.354+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/2411380482 shutdown_connections 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.354+0000 7fc0f7ae4640 1 --2- 172.21.15.55:0/2411380482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 0x7fc0f00b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.354+0000 7fc0f7ae4640 1 --2- 172.21.15.55:0/2411380482 >> v2:172.21.15.167:3300/0 conn(0x7fc0f00d35b0 0x7fc0f00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.354+0000 7fc0f7ae4640 1 --2- 172.21.15.55:0/2411380482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f015dce0 0x7fc0f00d1a50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.354+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/2411380482 >> 172.21.15.55:0/2411380482 conn(0x7fc0f0072900 msgr2=0x7fc0f00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.354+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/2411380482 shutdown_connections 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.354+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/2411380482 wait complete. 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.356+0000 7fc0f7ae4640 1 Processor -- start 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.356+0000 7fc0f7ae4640 1 -- start start 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.356+0000 7fc0f7ae4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 0x7fc0f0152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.356+0000 7fc0f7ae4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f00d35b0 0x7fc0f01f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.356+0000 7fc0f7ae4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f015dce0 0x7fc0f0155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.356+0000 7fc0f7ae4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00b9820 con 0x7fc0f015dce0 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.356+0000 7fc0f7ae4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00d3090 con 0x7fc0f00d35b0 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.356+0000 7fc0f7ae4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00b99a0 con 0x7fc0f00d1f90 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f6081640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f015dce0 0x7fc0f0155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f6081640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f015dce0 0x7fc0f0155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42146/0 (socket says 172.21.15.55:42146) 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f6081640 1 -- 172.21.15.55:0/1556423089 learned_addr learned my addr 172.21.15.55:0/1556423089 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f507f640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f00d35b0 0x7fc0f01f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f5880640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 0x7fc0f0152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f6081640 1 -- 172.21.15.55:0/1556423089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 msgr2=0x7fc0f0152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f6081640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 0x7fc0f0152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f6081640 1 -- 172.21.15.55:0/1556423089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f00d35b0 msgr2=0x7fc0f01f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f6081640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f00d35b0 0x7fc0f01f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f6081640 1 -- 172.21.15.55:0/1556423089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f01f4cc0 con 0x7fc0f015dce0 2024-04-25T08:53:45.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f5880640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 0x7fc0f0152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:45.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f6081640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f015dce0 0x7fc0f0155fd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0007de0 tx=0x7fc0e000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:45.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0ee7fc640 1 -- 172.21.15.55:0/1556423089 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e001a070 con 0x7fc0f015dce0 2024-04-25T08:53:45.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0ee7fc640 1 -- 172.21.15.55:0/1556423089 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e0003990 con 0x7fc0f015dce0 2024-04-25T08:53:45.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/1556423089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f0159cc0 con 0x7fc0f015dce0 2024-04-25T08:53:45.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0ee7fc640 1 -- 172.21.15.55:0/1556423089 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0003d80 con 0x7fc0f015dce0 2024-04-25T08:53:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.357+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/1556423089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f0154570 con 0x7fc0f015dce0 2024-04-25T08:53:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.358+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/1556423089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f00749b0 con 0x7fc0f015dce0 2024-04-25T08:53:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.359+0000 7fc0ee7fc640 1 -- 172.21.15.55:0/1556423089 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc0e001d070 con 0x7fc0f015dce0 2024-04-25T08:53:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.359+0000 7fc0ee7fc640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0dc06b4d0 0x7fc0dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.359+0000 7fc0ee7fc640 1 -- 172.21.15.55:0/1556423089 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0e008a450 con 0x7fc0f015dce0 2024-04-25T08:53:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.359+0000 7fc0f5880640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0dc06b4d0 0x7fc0dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.360+0000 7fc0f5880640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0dc06b4d0 0x7fc0dc06d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8034000 tx=0x7fc0e802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:45.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.364+0000 7fc0ee7fc640 1 -- 172.21.15.55:0/1556423089 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc0f01f4cc0 con 0x7fc0f015dce0 2024-04-25T08:53:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.583+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/1556423089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0f00b90e0 con 0x7fc0f015dce0 2024-04-25T08:53:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.583+0000 7fc0ee7fc640 1 -- 172.21.15.55:0/1556423089 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4938 (secure 0 0 0) 0x7fc0e0010070 con 0x7fc0f015dce0 2024-04-25T08:53:45.574 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:45.574 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1710920573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1710920573},{"type":"v1","addr":"172.21.15.167:6834","nonce":1710920573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3883943704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3883943704},{"type":"v1","addr":"172.21.15.55:6836","nonce":3883943704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1410084850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1410084850},{"type":"v1","addr":"172.21.15.55:6837","nonce":1410084850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:53:42.558115+0000","modified":"2024-04-25T08:53:44.566698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/3753268738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3753268738},{"type":"v1","addr":"172.21.15.167:6835","nonce":3753268738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:53:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-04-25T08:53:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/1556423089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0dc06b4d0 msgr2=0x7fc0dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0dc06b4d0 0x7fc0dc06d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8034000 tx=0x7fc0e802e000 comp rx=0 tx=0).stop 2024-04-25T08:53:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/1556423089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f015dce0 msgr2=0x7fc0f0155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f015dce0 0x7fc0f0155fd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0007de0 tx=0x7fc0e000d4a0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/1556423089 shutdown_connections 2024-04-25T08:53:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0dc06b4d0 0x7fc0dc06d990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f015dce0 0x7fc0f0155fd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f00d35b0 0x7fc0f01f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 --2- 172.21.15.55:0/1556423089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f00d1f90 0x7fc0f0152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/1556423089 >> 172.21.15.55:0/1556423089 conn(0x7fc0f0072900 msgr2=0x7fc0f00d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/1556423089 shutdown_connections 2024-04-25T08:53:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.585+0000 7fc0f7ae4640 1 -- 172.21.15.55:0/1556423089 wait complete. 2024-04-25T08:53:45.586 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:45.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.696+0000 7fe27733b640 1 Processor -- start 2024-04-25T08:53:45.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.696+0000 7fe27733b640 1 -- start start 2024-04-25T08:53:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.697+0000 7fe27733b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2700b5b60 0x7fe2701687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.697+0000 7fe27733b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27015e0c0 con 0x7fe2700d35b0 2024-04-25T08:53:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.697+0000 7fe27733b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2700d2510 con 0x7fe27015dce0 2024-04-25T08:53:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.697+0000 7fe27733b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700b7b10 con 0x7fe2700b5b60 2024-04-25T08:53:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.697+0000 7fe2758d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2700b5b60 0x7fe2701687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.697+0000 7fe2748d6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe2700d35b0 0x7fe2700b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56832/0 (socket says 172.21.15.55:56832) 2024-04-25T08:53:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.697+0000 7fe2748d6640 1 -- 172.21.15.55:0/1596269442 learned_addr learned my addr 172.21.15.55:0/1596269442 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.698+0000 7fe2758d8640 1 -- 172.21.15.55:0/1596269442 >> v1:172.21.15.167:6789/0 conn(0x7fe27015dce0 legacy=0x7fe2700d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.698+0000 7fe2758d8640 1 -- 172.21.15.55:0/1596269442 >> v1:172.21.15.55:6789/0 conn(0x7fe2700d35b0 legacy=0x7fe2700b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.698+0000 7fe2758d8640 1 -- 172.21.15.55:0/1596269442 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2700d27f0 con 0x7fe2700b5b60 2024-04-25T08:53:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.698+0000 7fe26ffff640 1 -- 172.21.15.55:0/1596269442 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014960044 0 0) 0x7fe27015e0c0 con 0x7fe2700d35b0 2024-04-25T08:53:45.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.698+0000 7fe2758d8640 1 --2- 172.21.15.55:0/1596269442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2700b5b60 0x7fe2701687f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe260009d90 tx=0x7fe26002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175d2a4aed92f44c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:45.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.698+0000 7fe26ffff640 1 -- 172.21.15.55:0/1596269442 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260007740 con 0x7fe2700b5b60 2024-04-25T08:53:45.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.698+0000 7fe26ffff640 1 -- 172.21.15.55:0/1596269442 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2600078e0 con 0x7fe2700b5b60 2024-04-25T08:53:45.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.698+0000 7fe26ffff640 1 -- 172.21.15.55:0/1596269442 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260007cb0 con 0x7fe2700b5b60 2024-04-25T08:53:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.699+0000 7fe27733b640 1 -- 172.21.15.55:0/1596269442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2700b5b60 msgr2=0x7fe2701687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.699+0000 7fe27733b640 1 --2- 172.21.15.55:0/1596269442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2700b5b60 0x7fe2701687f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe260009d90 tx=0x7fe26002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.699+0000 7fe27733b640 1 -- 172.21.15.55:0/1596269442 shutdown_connections 2024-04-25T08:53:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.699+0000 7fe27733b640 1 --2- 172.21.15.55:0/1596269442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2700b5b60 0x7fe2701687f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.699+0000 7fe27733b640 1 -- 172.21.15.55:0/1596269442 >> 172.21.15.55:0/1596269442 conn(0x7fe270072900 msgr2=0x7fe2700d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.699+0000 7fe27733b640 1 -- 172.21.15.55:0/1596269442 shutdown_connections 2024-04-25T08:53:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.699+0000 7fe27733b640 1 -- 172.21.15.55:0/1596269442 wait complete. 2024-04-25T08:53:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.700+0000 7fe27733b640 1 Processor -- start 2024-04-25T08:53:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.700+0000 7fe27733b640 1 -- start start 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe27733b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2700b5b60 0x7fe27015a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe27733b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2700d35b0 0x7fe270157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe27733b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe27015dce0 0x7fe2700b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe27733b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700d3090 con 0x7fe2700b5b60 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe27733b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700d2db0 con 0x7fe2700d35b0 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe27733b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700d2160 con 0x7fe27015dce0 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe2750d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2700b5b60 0x7fe27015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe2750d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2700b5b60 0x7fe27015a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42162/0 (socket says 172.21.15.55:42162) 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe2750d7640 1 -- 172.21.15.55:0/3791768797 learned_addr learned my addr 172.21.15.55:0/3791768797 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe2748d6640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2700d35b0 0x7fe270157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe2758d8640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe27015dce0 0x7fe2700b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe2750d7640 1 -- 172.21.15.55:0/3791768797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe27015dce0 msgr2=0x7fe2700b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe2750d7640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe27015dce0 0x7fe2700b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe2750d7640 1 -- 172.21.15.55:0/3791768797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2700d35b0 msgr2=0x7fe270157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe2750d7640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2700d35b0 0x7fe270157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe2750d7640 1 -- 172.21.15.55:0/3791768797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270157a30 con 0x7fe2700b5b60 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.701+0000 7fe2748d6640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2700d35b0 0x7fe270157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.702+0000 7fe2750d7640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2700b5b60 0x7fe27015a610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe26800b420 tx=0x7fe26800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.702+0000 7fe26dffb640 1 -- 172.21.15.55:0/3791768797 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268011830 con 0x7fe2700b5b60 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.702+0000 7fe26dffb640 1 -- 172.21.15.55:0/3791768797 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe268016070 con 0x7fe2700b5b60 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.702+0000 7fe27733b640 1 -- 172.21.15.55:0/3791768797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe270158260 con 0x7fe2700b5b60 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.702+0000 7fe26dffb640 1 -- 172.21.15.55:0/3791768797 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268011c10 con 0x7fe2700b5b60 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.702+0000 7fe27733b640 1 -- 172.21.15.55:0/3791768797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe270157650 con 0x7fe2700b5b60 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.703+0000 7fe27733b640 1 -- 172.21.15.55:0/3791768797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2700749b0 con 0x7fe2700b5b60 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.703+0000 7fe26dffb640 1 -- 172.21.15.55:0/3791768797 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe26801b460 con 0x7fe2700b5b60 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.704+0000 7fe26dffb640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe25c06b500 0x7fe25c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.704+0000 7fe26dffb640 1 -- 172.21.15.55:0/3791768797 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe268089cb0 con 0x7fe2700b5b60 2024-04-25T08:53:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.704+0000 7fe2748d6640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe25c06b500 0x7fe25c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.704+0000 7fe2748d6640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe25c06b500 0x7fe25c06d9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe2700b9190 tx=0x7fe264007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:45.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.708+0000 7fe26dffb640 1 -- 172.21.15.55:0/3791768797 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe268020020 con 0x7fe2700b5b60 2024-04-25T08:53:45.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.890+0000 7fe27733b640 1 -- 172.21.15.55:0/3791768797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2700c9910 con 0x7fe2700b5b60 2024-04-25T08:53:45.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.892+0000 7fe26dffb640 1 -- 172.21.15.55:0/3791768797 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fe268058b30 con 0x7fe2700b5b60 2024-04-25T08:53:45.882 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:45.882 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:45.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 -- 172.21.15.55:0/3791768797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe25c06b500 msgr2=0x7fe25c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe25c06b500 0x7fe25c06d9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe2700b9190 tx=0x7fe264007c10 comp rx=0 tx=0).stop 2024-04-25T08:53:45.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 -- 172.21.15.55:0/3791768797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2700b5b60 msgr2=0x7fe27015a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2700b5b60 0x7fe27015a610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe26800b420 tx=0x7fe26800b8e0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 -- 172.21.15.55:0/3791768797 shutdown_connections 2024-04-25T08:53:45.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe25c06b500 0x7fe25c06d9c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe27015dce0 0x7fe2700b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2700d35b0 0x7fe270157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 --2- 172.21.15.55:0/3791768797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2700b5b60 0x7fe27015a610 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 -- 172.21.15.55:0/3791768797 >> 172.21.15.55:0/3791768797 conn(0x7fe270072900 msgr2=0x7fe2700d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:45.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 -- 172.21.15.55:0/3791768797 shutdown_connections 2024-04-25T08:53:45.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:45.894+0000 7fe27733b640 1 -- 172.21.15.55:0/3791768797 wait complete. 2024-04-25T08:53:45.895 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:53:45.895 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:53:45.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.006+0000 7f23c551d640 1 Processor -- start 2024-04-25T08:53:45.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.006+0000 7f23c551d640 1 -- start start 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23c551d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f23c00d35b0 0x7f23c00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23c551d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23c00b5990 0x7f23c00b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23c551d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c015e0c0 con 0x7f23c015dce0 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23c551d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c00d2510 con 0x7f23c00b5990 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23c551d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c00d27f0 con 0x7f23c00d35b0 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23beffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f23c015dce0 0x7f23c00d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56846/0 (socket says 172.21.15.55:56846) 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23beffd640 1 -- 172.21.15.55:0/927864835 learned_addr learned my addr 172.21.15.55:0/927864835 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23bf7fe640 1 --2- 172.21.15.55:0/927864835 >> v2:172.21.15.55:3300/0 conn(0x7f23c00b5990 0x7f23c00b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23be7fc640 1 --2- 172.21.15.55:0/927864835 >> v2:172.21.15.167:3300/0 conn(0x7f23c00d35b0 0x7f23c00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23bf7fe640 1 -- 172.21.15.55:0/927864835 >> v2:172.21.15.167:3300/0 conn(0x7f23c00d35b0 msgr2=0x7f23c00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23bf7fe640 1 --2- 172.21.15.55:0/927864835 >> v2:172.21.15.167:3300/0 conn(0x7f23c00d35b0 0x7f23c00b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23bf7fe640 1 -- 172.21.15.55:0/927864835 >> v1:172.21.15.55:6789/0 conn(0x7f23c015dce0 legacy=0x7f23c00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:45.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.008+0000 7f23bf7fe640 1 -- 172.21.15.55:0/927864835 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c00d2ad0 con 0x7f23c00b5990 2024-04-25T08:53:45.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.007+0000 7f23bdffb640 1 -- 172.21.15.55:0/927864835 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913993600 0 0) 0x7f23c015e0c0 con 0x7f23c015dce0 2024-04-25T08:53:45.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.008+0000 7f23be7fc640 1 --2- 172.21.15.55:0/927864835 >> v2:172.21.15.167:3300/0 conn(0x7f23c00d35b0 0x7f23c00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:46.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.008+0000 7f23bf7fe640 1 --2- 172.21.15.55:0/927864835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c00b5990 0x7f23c00b6b00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23c00cdfa0 tx=0x7f23b002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ab09668b40d1fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:46.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.008+0000 7f23bdffb640 1 -- 172.21.15.55:0/927864835 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0007740 con 0x7f23c00b5990 2024-04-25T08:53:46.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.008+0000 7f23bdffb640 1 -- 172.21.15.55:0/927864835 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b00078e0 con 0x7f23c00b5990 2024-04-25T08:53:46.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.008+0000 7f23bdffb640 1 -- 172.21.15.55:0/927864835 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0007cb0 con 0x7f23c00b5990 2024-04-25T08:53:46.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.009+0000 7f23c551d640 1 -- 172.21.15.55:0/927864835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c00b5990 msgr2=0x7f23c00b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.009+0000 7f23c551d640 1 --2- 172.21.15.55:0/927864835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c00b5990 0x7f23c00b6b00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23c00cdfa0 tx=0x7f23b002a680 comp rx=0 tx=0).stop 2024-04-25T08:53:46.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.009+0000 7f23c551d640 1 -- 172.21.15.55:0/927864835 shutdown_connections 2024-04-25T08:53:46.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.009+0000 7f23c551d640 1 --2- 172.21.15.55:0/927864835 >> v2:172.21.15.167:3300/0 conn(0x7f23c00d35b0 0x7f23c00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.009+0000 7f23c551d640 1 --2- 172.21.15.55:0/927864835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c00b5990 0x7f23c00b6b00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.009+0000 7f23c551d640 1 -- 172.21.15.55:0/927864835 >> 172.21.15.55:0/927864835 conn(0x7f23c0072900 msgr2=0x7f23c00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:46.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.009+0000 7f23c551d640 1 -- 172.21.15.55:0/927864835 shutdown_connections 2024-04-25T08:53:46.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.009+0000 7f23c551d640 1 -- 172.21.15.55:0/927864835 wait complete. 2024-04-25T08:53:46.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.010+0000 7f23c551d640 1 Processor -- start 2024-04-25T08:53:46.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.010+0000 7f23c551d640 1 -- start start 2024-04-25T08:53:46.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23c551d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c00b5990 0x7f23c015b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23c551d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23c00d35b0 0x7f23c015fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23c551d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23c015dce0 0x7f23c01f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23c551d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00d2160 con 0x7f23c00b5990 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23c551d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00d3090 con 0x7f23c015dce0 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23c551d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c01f4280 con 0x7f23c00d35b0 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23beffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c00b5990 0x7f23c015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23beffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c00b5990 0x7f23c015b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42176/0 (socket says 172.21.15.55:42176) 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23beffd640 1 -- 172.21.15.55:0/53991675 learned_addr learned my addr 172.21.15.55:0/53991675 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23be7fc640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23c00d35b0 0x7f23c015fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23bf7fe640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23c015dce0 0x7f23c01f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23beffd640 1 -- 172.21.15.55:0/53991675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23c00d35b0 msgr2=0x7f23c015fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23beffd640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23c00d35b0 0x7f23c015fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23beffd640 1 -- 172.21.15.55:0/53991675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23c015dce0 msgr2=0x7f23c01f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23beffd640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23c015dce0 0x7f23c01f3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23beffd640 1 -- 172.21.15.55:0/53991675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c01f3cc0 con 0x7f23c00b5990 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.011+0000 7f23be7fc640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23c00d35b0 0x7f23c015fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.012+0000 7f23beffd640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c00b5990 0x7f23c015b530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23b800c430 tx=0x7f23b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.012+0000 7f23b77fe640 1 -- 172.21.15.55:0/53991675 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b80074e0 con 0x7f23c00b5990 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.012+0000 7f23b77fe640 1 -- 172.21.15.55:0/53991675 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b80047e0 con 0x7f23c00b5990 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.012+0000 7f23c551d640 1 -- 172.21.15.55:0/53991675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c01f3fa0 con 0x7f23c00b5990 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.012+0000 7f23b77fe640 1 -- 172.21.15.55:0/53991675 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8004bd0 con 0x7f23c00b5990 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.012+0000 7f23c551d640 1 -- 172.21.15.55:0/53991675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c015f840 con 0x7f23c00b5990 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.013+0000 7f23c551d640 1 -- 172.21.15.55:0/53991675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c00749b0 con 0x7f23c00b5990 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.013+0000 7f23b77fe640 1 -- 172.21.15.55:0/53991675 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f23b8011070 con 0x7f23c00b5990 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.014+0000 7f23b77fe640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f23a006b4d0 0x7f23a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.014+0000 7f23b77fe640 1 -- 172.21.15.55:0/53991675 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23b8089d80 con 0x7f23c00b5990 2024-04-25T08:53:46.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.014+0000 7f23be7fc640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f23a006b4d0 0x7f23a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.014+0000 7f23be7fc640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f23a006b4d0 0x7f23a006d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23c00ac240 tx=0x7f23a8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.018+0000 7f23b77fe640 1 -- 172.21.15.55:0/53991675 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f23b800e280 con 0x7f23c00b5990 2024-04-25T08:53:46.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.195+0000 7f23c551d640 1 -- 172.21.15.55:0/53991675 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23c00b6ca0 con 0x7f23a006b4d0 2024-04-25T08:53:46.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.201+0000 7f23b77fe640 1 -- 172.21.15.55:0/53991675 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237536 (secure 0 0 0) 0x7f23c00b6ca0 con 0x7f23a006b4d0 2024-04-25T08:53:46.193 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:46.195 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:53:46.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 -- 172.21.15.55:0/53991675 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f23a006b4d0 msgr2=0x7f23a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f23a006b4d0 0x7f23a006d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23c00ac240 tx=0x7f23a8008040 comp rx=0 tx=0).stop 2024-04-25T08:53:46.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 -- 172.21.15.55:0/53991675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c00b5990 msgr2=0x7f23c015b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c00b5990 0x7f23c015b530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23b800c430 tx=0x7f23b800c8f0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 -- 172.21.15.55:0/53991675 shutdown_connections 2024-04-25T08:53:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f23a006b4d0 0x7f23a006d990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23c015dce0 0x7f23c01f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23c00d35b0 0x7f23c015fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 --2- 172.21.15.55:0/53991675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c00b5990 0x7f23c015b530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 -- 172.21.15.55:0/53991675 >> 172.21.15.55:0/53991675 conn(0x7f23c0072900 msgr2=0x7f23c00b74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 -- 172.21.15.55:0/53991675 shutdown_connections 2024-04-25T08:53:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.204+0000 7f23c551d640 1 -- 172.21.15.55:0/53991675 wait complete. 2024-04-25T08:53:46.205 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T08:53:44.550960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":14,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":236184,"kb_used_data":2612,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738536,"statfs":{"total":773094113280,"available":772852260864,"internally_reserved":0,"allocated":2674688,"data_stored":1635097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000550"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.194636+0000","last_change":"2024-04-25T08:53:41.194636+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.194636+0000","last_undegraded":"2024-04-25T08:53:41.194636+0000","last_fullsized":"2024-04-25T08:53:41.194636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193644+0000","last_change":"2024-04-25T08:53:41.193644+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193644+0000","last_undegraded":"2024-04-25T08:53:41.193644+0000","last_fullsized":"2024-04-25T08:53:41.193644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":162,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T08:53:33.867270+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:53:33.867270+0000","last_peered":"2024-04-25T08:53:33.867270+0000","last_clean":"2024-04-25T08:53:33.867270+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:53:33.867270+0000","last_undegraded":"2024-04-25T08:53:33.867270+0000","last_fullsized":"2024-04-25T08:53:33.867270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193951+0000","last_change":"2024-04-25T08:53:41.193951+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193951+0000","last_undegraded":"2024-04-25T08:53:41.193951+0000","last_fullsized":"2024-04-25T08:53:41.193951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193905+0000","last_change":"2024-04-25T08:53:41.193905+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193905+0000","last_undegraded":"2024-04-25T08:53:41.193905+0000","last_fullsized":"2024-04-25T08:53:41.193905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193599+0000","last_change":"2024-04-25T08:53:41.193599+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193599+0000","last_undegraded":"2024-04-25T08:53:41.193599+0000","last_fullsized":"2024-04-25T08:53:41.193599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.195506+0000","last_change":"2024-04-25T08:53:41.195506+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.195506+0000","last_undegraded":"2024-04-25T08:53:41.195506+0000","last_fullsized":"2024-04-25T08:53:41.195506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28400,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343440,"statfs":{"total":96636764160,"available":96607682560,"internally_reserved":0,"allocated":778240,"data_stored":646436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31360,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":778240,"data_stored":646436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:53:46.210 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:53:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.356+0000 7f9b47edd640 1 Processor -- start 2024-04-25T08:53:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.356+0000 7f9b47edd640 1 -- start start 2024-04-25T08:53:46.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b47edd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9b400d35b0 0x7f9b400b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b47edd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b400b5990 0x7f9b400b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b47edd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4015e0c0 con 0x7f9b4015dce0 2024-04-25T08:53:46.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b47edd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b400d2510 con 0x7f9b400b5990 2024-04-25T08:53:46.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b47edd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b400d27f0 con 0x7f9b400d35b0 2024-04-25T08:53:46.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b4647a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b400b5990 0x7f9b400b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b4647a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b400b5990 0x7f9b400b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42188/0 (socket says 172.21.15.55:42188) 2024-04-25T08:53:46.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b4647a640 1 -- 172.21.15.55:0/2358145782 learned_addr learned my addr 172.21.15.55:0/2358145782 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:46.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b45478640 1 --2- 172.21.15.55:0/2358145782 >> v2:172.21.15.167:3300/0 conn(0x7f9b400d35b0 0x7f9b400b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b4647a640 1 -- 172.21.15.55:0/2358145782 >> v2:172.21.15.167:3300/0 conn(0x7f9b400d35b0 msgr2=0x7f9b400b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:46.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b4647a640 1 --2- 172.21.15.55:0/2358145782 >> v2:172.21.15.167:3300/0 conn(0x7f9b400d35b0 0x7f9b400b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b4647a640 1 -- 172.21.15.55:0/2358145782 >> v1:172.21.15.167:6789/0 conn(0x7f9b4015dce0 legacy=0x7f9b400d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.357+0000 7f9b4647a640 1 -- 172.21.15.55:0/2358145782 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b400d2ad0 con 0x7f9b400b5990 2024-04-25T08:53:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.358+0000 7f9b4647a640 1 --2- 172.21.15.55:0/2358145782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b400b5990 0x7f9b400b6b00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b400cdfa0 tx=0x7f9b3802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d90bbcbbbf123f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.358+0000 7f9b44c77640 1 -- 172.21.15.55:0/2358145782 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38036070 con 0x7f9b400b5990 2024-04-25T08:53:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.358+0000 7f9b44c77640 1 -- 172.21.15.55:0/2358145782 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b38031600 con 0x7f9b400b5990 2024-04-25T08:53:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.358+0000 7f9b44c77640 1 -- 172.21.15.55:0/2358145782 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b380319d0 con 0x7f9b400b5990 2024-04-25T08:53:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.359+0000 7f9b47edd640 1 -- 172.21.15.55:0/2358145782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b400b5990 msgr2=0x7f9b400b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.359+0000 7f9b47edd640 1 --2- 172.21.15.55:0/2358145782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b400b5990 0x7f9b400b6b00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b400cdfa0 tx=0x7f9b3802a730 comp rx=0 tx=0).stop 2024-04-25T08:53:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.359+0000 7f9b47edd640 1 -- 172.21.15.55:0/2358145782 shutdown_connections 2024-04-25T08:53:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.359+0000 7f9b47edd640 1 --2- 172.21.15.55:0/2358145782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b400b5990 0x7f9b400b6b00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.359+0000 7f9b47edd640 1 --2- 172.21.15.55:0/2358145782 >> v2:172.21.15.167:3300/0 conn(0x7f9b400d35b0 0x7f9b400b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.359+0000 7f9b47edd640 1 -- 172.21.15.55:0/2358145782 >> 172.21.15.55:0/2358145782 conn(0x7f9b40072900 msgr2=0x7f9b400d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.359+0000 7f9b47edd640 1 -- 172.21.15.55:0/2358145782 shutdown_connections 2024-04-25T08:53:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.359+0000 7f9b47edd640 1 -- 172.21.15.55:0/2358145782 wait complete. 2024-04-25T08:53:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.360+0000 7f9b47edd640 1 Processor -- start 2024-04-25T08:53:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.360+0000 7f9b47edd640 1 -- start start 2024-04-25T08:53:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b47edd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b400b5990 0x7f9b401f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b47edd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b400d35b0 0x7f9b400c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b47edd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b4015dce0 0x7f9b400ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b47edd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b400d2160 con 0x7f9b4015dce0 2024-04-25T08:53:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b47edd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b400d3090 con 0x7f9b400b5990 2024-04-25T08:53:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b47edd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b400ca360 con 0x7f9b400d35b0 2024-04-25T08:53:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b4647a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b4015dce0 0x7f9b400ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b4647a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b4015dce0 0x7f9b400ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42202/0 (socket says 172.21.15.55:42202) 2024-04-25T08:53:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b4647a640 1 -- 172.21.15.55:0/1784257902 learned_addr learned my addr 172.21.15.55:0/1784257902 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b45478640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b400d35b0 0x7f9b400c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b45c79640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b400b5990 0x7f9b401f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b4647a640 1 -- 172.21.15.55:0/1784257902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b400d35b0 msgr2=0x7f9b400c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b4647a640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b400d35b0 0x7f9b400c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b4647a640 1 -- 172.21.15.55:0/1784257902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b400b5990 msgr2=0x7f9b401f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b4647a640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b400b5990 0x7f9b401f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b4647a640 1 -- 172.21.15.55:0/1784257902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4015e870 con 0x7f9b4015dce0 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b45c79640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b400b5990 0x7f9b401f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b4647a640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b4015dce0 0x7f9b400ccab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b3802ad20 tx=0x7f9b38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b367fc640 1 -- 172.21.15.55:0/1784257902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3803f020 con 0x7f9b4015dce0 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b367fc640 1 -- 172.21.15.55:0/1784257902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b38037040 con 0x7f9b4015dce0 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b47edd640 1 -- 172.21.15.55:0/1784257902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4015eb50 con 0x7f9b4015dce0 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b367fc640 1 -- 172.21.15.55:0/1784257902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38036070 con 0x7f9b4015dce0 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.361+0000 7f9b47edd640 1 -- 172.21.15.55:0/1784257902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4015f110 con 0x7f9b4015dce0 2024-04-25T08:53:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.363+0000 7f9b47edd640 1 -- 172.21.15.55:0/1784257902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b400749b0 con 0x7f9b4015dce0 2024-04-25T08:53:46.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.363+0000 7f9b367fc640 1 -- 172.21.15.55:0/1784257902 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b38042020 con 0x7f9b4015dce0 2024-04-25T08:53:46.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.363+0000 7f9b367fc640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b2406b4d0 0x7f9b2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.364+0000 7f9b367fc640 1 -- 172.21.15.55:0/1784257902 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b380aa580 con 0x7f9b4015dce0 2024-04-25T08:53:46.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.364+0000 7f9b45c79640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b2406b4d0 0x7f9b2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.364+0000 7f9b45c79640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b2406b4d0 0x7f9b2406d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0015e0 tx=0x7f9b3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.368+0000 7f9b367fc640 1 -- 172.21.15.55:0/1784257902 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b38049030 con 0x7f9b4015dce0 2024-04-25T08:53:46.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.546+0000 7f9b47edd640 1 -- 172.21.15.55:0/1784257902 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b4006b080 con 0x7f9b2406b4d0 2024-04-25T08:53:46.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.551+0000 7f9b367fc640 1 -- 172.21.15.55:0/1784257902 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237536 (secure 0 0 0) 0x7f9b4006b080 con 0x7f9b2406b4d0 2024-04-25T08:53:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:46.544 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:53:46.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 -- 172.21.15.55:0/1784257902 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b2406b4d0 msgr2=0x7f9b2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b2406b4d0 0x7f9b2406d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0015e0 tx=0x7f9b3c009040 comp rx=0 tx=0).stop 2024-04-25T08:53:46.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 -- 172.21.15.55:0/1784257902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b4015dce0 msgr2=0x7f9b400ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b4015dce0 0x7f9b400ccab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b3802ad20 tx=0x7f9b38004a40 comp rx=0 tx=0).stop 2024-04-25T08:53:46.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 -- 172.21.15.55:0/1784257902 shutdown_connections 2024-04-25T08:53:46.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b2406b4d0 0x7f9b2406d990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b4015dce0 0x7f9b400ccab0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b400d35b0 0x7f9b400c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 --2- 172.21.15.55:0/1784257902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b400b5990 0x7f9b401f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 -- 172.21.15.55:0/1784257902 >> 172.21.15.55:0/1784257902 conn(0x7f9b40072900 msgr2=0x7f9b400d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:46.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 -- 172.21.15.55:0/1784257902 shutdown_connections 2024-04-25T08:53:46.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.554+0000 7f9b47edd640 1 -- 172.21.15.55:0/1784257902 wait complete. 2024-04-25T08:53:46.555 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T08:53:44.550960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":14,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":236184,"kb_used_data":2612,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738536,"statfs":{"total":773094113280,"available":772852260864,"internally_reserved":0,"allocated":2674688,"data_stored":1635097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000550"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.194636+0000","last_change":"2024-04-25T08:53:41.194636+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.194636+0000","last_undegraded":"2024-04-25T08:53:41.194636+0000","last_fullsized":"2024-04-25T08:53:41.194636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193644+0000","last_change":"2024-04-25T08:53:41.193644+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193644+0000","last_undegraded":"2024-04-25T08:53:41.193644+0000","last_fullsized":"2024-04-25T08:53:41.193644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":162,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T08:53:33.867270+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:53:33.867270+0000","last_peered":"2024-04-25T08:53:33.867270+0000","last_clean":"2024-04-25T08:53:33.867270+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:53:33.867270+0000","last_undegraded":"2024-04-25T08:53:33.867270+0000","last_fullsized":"2024-04-25T08:53:33.867270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193951+0000","last_change":"2024-04-25T08:53:41.193951+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193951+0000","last_undegraded":"2024-04-25T08:53:41.193951+0000","last_fullsized":"2024-04-25T08:53:41.193951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193905+0000","last_change":"2024-04-25T08:53:41.193905+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193905+0000","last_undegraded":"2024-04-25T08:53:41.193905+0000","last_fullsized":"2024-04-25T08:53:41.193905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193599+0000","last_change":"2024-04-25T08:53:41.193599+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193599+0000","last_undegraded":"2024-04-25T08:53:41.193599+0000","last_fullsized":"2024-04-25T08:53:41.193599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.195506+0000","last_change":"2024-04-25T08:53:41.195506+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.195506+0000","last_undegraded":"2024-04-25T08:53:41.195506+0000","last_fullsized":"2024-04-25T08:53:41.195506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:41.174011+0000","last_change":"2024-04-25T08:53:41.174011+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.174011+0000","last_undegraded":"2024-04-25T08:53:41.174011+0000","last_fullsized":"2024-04-25T08:53:41.174011+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28400,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343440,"statfs":{"total":96636764160,"available":96607682560,"internally_reserved":0,"allocated":778240,"data_stored":646436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31360,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":778240,"data_stored":646436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:53:46.559 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:53:46.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.706+0000 7fb83c76a640 1 Processor -- start 2024-04-25T08:53:46.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.706+0000 7fb83c76a640 1 -- start start 2024-04-25T08:53:46.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.707+0000 7fb83c76a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8340cea00 0x7fb8340cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.707+0000 7fb83c76a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340d0430 con 0x7fb83415f120 2024-04-25T08:53:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.707+0000 7fb83c76a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340d0710 con 0x7fb8340cfbe0 2024-04-25T08:53:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.707+0000 7fb83c76a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8340d09f0 con 0x7fb8340cea00 2024-04-25T08:53:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.707+0000 7fb83a506640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb83415f120 0x7fb8340ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56856/0 (socket says 172.21.15.55:56856) 2024-04-25T08:53:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.707+0000 7fb83a506640 1 -- 172.21.15.55:0/2752347418 learned_addr learned my addr 172.21.15.55:0/2752347418 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.707+0000 7fb839d05640 1 --2- 172.21.15.55:0/2752347418 >> v2:172.21.15.55:3300/0 conn(0x7fb8340cea00 0x7fb8340cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.708+0000 7fb839504640 1 -- 172.21.15.55:0/2752347418 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830699785 0 0) 0x7fb8340d0430 con 0x7fb83415f120 2024-04-25T08:53:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.708+0000 7fb839504640 1 -- 172.21.15.55:0/2752347418 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb81c003520 con 0x7fb83415f120 2024-04-25T08:53:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.708+0000 7fb839d05640 1 -- 172.21.15.55:0/2752347418 >> v1:172.21.15.167:6789/0 conn(0x7fb8340cfbe0 legacy=0x7fb8340ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.708+0000 7fb839d05640 1 -- 172.21.15.55:0/2752347418 >> v1:172.21.15.55:6789/0 conn(0x7fb83415f120 legacy=0x7fb8340ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.708+0000 7fb839d05640 1 -- 172.21.15.55:0/2752347418 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8340cc7d0 con 0x7fb8340cea00 2024-04-25T08:53:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.708+0000 7fb839d05640 1 --2- 172.21.15.55:0/2752347418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8340cea00 0x7fb8340cf6a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb8280097a0 tx=0x7fb82802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292ab7d7c26d1851 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.708+0000 7fb839504640 1 -- 172.21.15.55:0/2752347418 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828037070 con 0x7fb8340cea00 2024-04-25T08:53:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.709+0000 7fb839504640 1 -- 172.21.15.55:0/2752347418 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb828032640 con 0x7fb8340cea00 2024-04-25T08:53:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.709+0000 7fb839504640 1 -- 172.21.15.55:0/2752347418 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828032a10 con 0x7fb8340cea00 2024-04-25T08:53:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.709+0000 7fb83c76a640 1 -- 172.21.15.55:0/2752347418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8340cea00 msgr2=0x7fb8340cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.709+0000 7fb83c76a640 1 --2- 172.21.15.55:0/2752347418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8340cea00 0x7fb8340cf6a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb8280097a0 tx=0x7fb82802a2c0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.709+0000 7fb83c76a640 1 -- 172.21.15.55:0/2752347418 shutdown_connections 2024-04-25T08:53:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.709+0000 7fb83c76a640 1 --2- 172.21.15.55:0/2752347418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8340cea00 0x7fb8340cf6a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.709+0000 7fb83c76a640 1 -- 172.21.15.55:0/2752347418 >> 172.21.15.55:0/2752347418 conn(0x7fb8340d1900 msgr2=0x7fb8340d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.709+0000 7fb83c76a640 1 -- 172.21.15.55:0/2752347418 shutdown_connections 2024-04-25T08:53:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.709+0000 7fb83c76a640 1 -- 172.21.15.55:0/2752347418 wait complete. 2024-04-25T08:53:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.710+0000 7fb83c76a640 1 Processor -- start 2024-04-25T08:53:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.710+0000 7fb83c76a640 1 -- start start 2024-04-25T08:53:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83c76a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8340cea00 0x7fb8340b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83c76a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8340cfbe0 0x7fb8341f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83c76a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb83415f120 0x7fb8341f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83c76a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340c5450 con 0x7fb83415f120 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83c76a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340cc480 con 0x7fb8340cfbe0 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83c76a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340d0070 con 0x7fb8340cea00 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83ad07640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb83415f120 0x7fb8341f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83ad07640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb83415f120 0x7fb8341f50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42226/0 (socket says 172.21.15.55:42226) 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83ad07640 1 -- 172.21.15.55:0/604131273 learned_addr learned my addr 172.21.15.55:0/604131273 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83a506640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8340cea00 0x7fb8340b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb839d05640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8340cfbe0 0x7fb8341f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83ad07640 1 -- 172.21.15.55:0/604131273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8340cea00 msgr2=0x7fb8340b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83ad07640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8340cea00 0x7fb8340b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83ad07640 1 -- 172.21.15.55:0/604131273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8340cfbe0 msgr2=0x7fb8341f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83ad07640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8340cfbe0 0x7fb8341f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83ad07640 1 -- 172.21.15.55:0/604131273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8340b4e20 con 0x7fb83415f120 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.711+0000 7fb83a506640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8340cea00 0x7fb8340b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.712+0000 7fb83ad07640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb83415f120 0x7fb8341f50b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb82400c7a0 tx=0x7fb82400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.712+0000 7fb832ffd640 1 -- 172.21.15.55:0/604131273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824003b70 con 0x7fb83415f120 2024-04-25T08:53:46.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.712+0000 7fb832ffd640 1 -- 172.21.15.55:0/604131273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb824003d30 con 0x7fb83415f120 2024-04-25T08:53:46.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.712+0000 7fb83c76a640 1 -- 172.21.15.55:0/604131273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8340b5100 con 0x7fb83415f120 2024-04-25T08:53:46.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.712+0000 7fb832ffd640 1 -- 172.21.15.55:0/604131273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82400aa90 con 0x7fb83415f120 2024-04-25T08:53:46.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.712+0000 7fb83c76a640 1 -- 172.21.15.55:0/604131273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8340b56c0 con 0x7fb83415f120 2024-04-25T08:53:46.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.713+0000 7fb83c76a640 1 -- 172.21.15.55:0/604131273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8340749b0 con 0x7fb83415f120 2024-04-25T08:53:46.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.713+0000 7fb832ffd640 1 -- 172.21.15.55:0/604131273 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb82400ac30 con 0x7fb83415f120 2024-04-25T08:53:46.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.714+0000 7fb832ffd640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb82006b4d0 0x7fb82006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:46.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.714+0000 7fb83a506640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb82006b4d0 0x7fb82006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:46.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.714+0000 7fb832ffd640 1 -- 172.21.15.55:0/604131273 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb82408a0b0 con 0x7fb83415f120 2024-04-25T08:53:46.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.714+0000 7fb83a506640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb82006b4d0 0x7fb82006d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb82c007fd0 tx=0x7fb82c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.718+0000 7fb832ffd640 1 -- 172.21.15.55:0/604131273 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb824058fc0 con 0x7fb83415f120 2024-04-25T08:53:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.896+0000 7fb83c76a640 1 -- 172.21.15.55:0/604131273 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8340c75e0 con 0x7fb82006b4d0 2024-04-25T08:53:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.902+0000 7fb832ffd640 1 -- 172.21.15.55:0/604131273 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250519 (secure 0 0 0) 0x7fb8340c75e0 con 0x7fb82006b4d0 2024-04-25T08:53:46.895 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:46.896 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:53:46.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 -- 172.21.15.55:0/604131273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb82006b4d0 msgr2=0x7fb82006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb82006b4d0 0x7fb82006d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb82c007fd0 tx=0x7fb82c009040 comp rx=0 tx=0).stop 2024-04-25T08:53:46.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 -- 172.21.15.55:0/604131273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb83415f120 msgr2=0x7fb8341f50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:46.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb83415f120 0x7fb8341f50b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb82400c7a0 tx=0x7fb82400cc60 comp rx=0 tx=0).stop 2024-04-25T08:53:46.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 -- 172.21.15.55:0/604131273 shutdown_connections 2024-04-25T08:53:46.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb82006b4d0 0x7fb82006d990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb83415f120 0x7fb8341f50b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8340cfbe0 0x7fb8341f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 --2- 172.21.15.55:0/604131273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8340cea00 0x7fb8340b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:46.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 -- 172.21.15.55:0/604131273 >> 172.21.15.55:0/604131273 conn(0x7fb8340d1900 msgr2=0x7fb83415d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:46.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 -- 172.21.15.55:0/604131273 shutdown_connections 2024-04-25T08:53:46.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:46.905+0000 7fb83c76a640 1 -- 172.21.15.55:0/604131273 wait complete. 2024-04-25T08:53:46.905 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-25T08:53:46.552231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235768,"kb_used_data":2944,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738952,"statfs":{"total":773094113280,"available":772852686848,"internally_reserved":0,"allocated":3014656,"data_stored":1784426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.363209"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458904+0000","last_change":"2024-04-25T08:53:43.226040+0000","last_active":"2024-04-25T08:53:44.458904+0000","last_peered":"2024-04-25T08:53:44.458904+0000","last_clean":"2024-04-25T08:53:44.458904+0000","last_became_active":"2024-04-25T08:53:43.225773+0000","last_became_peered":"2024-04-25T08:53:43.225773+0000","last_unstale":"2024-04-25T08:53:44.458904+0000","last_undegraded":"2024-04-25T08:53:44.458904+0000","last_fullsized":"2024-04-25T08:53:44.458904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:25.482497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.225595+0000","last_change":"2024-04-25T08:53:43.222988+0000","last_active":"2024-04-25T08:53:43.225595+0000","last_peered":"2024-04-25T08:53:43.225595+0000","last_clean":"2024-04-25T08:53:43.225595+0000","last_became_active":"2024-04-25T08:53:43.222683+0000","last_became_peered":"2024-04-25T08:53:43.222683+0000","last_unstale":"2024-04-25T08:53:43.225595+0000","last_undegraded":"2024-04-25T08:53:43.225595+0000","last_fullsized":"2024-04-25T08:53:43.225595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:36.391147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336369+0000","last_change":"2024-04-25T08:53:43.227764+0000","last_active":"2024-04-25T08:53:44.336369+0000","last_peered":"2024-04-25T08:53:44.336369+0000","last_clean":"2024-04-25T08:53:44.336369+0000","last_became_active":"2024-04-25T08:53:43.227462+0000","last_became_peered":"2024-04-25T08:53:43.227462+0000","last_unstale":"2024-04-25T08:53:44.336369+0000","last_undegraded":"2024-04-25T08:53:44.336369+0000","last_fullsized":"2024-04-25T08:53:44.336369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458562+0000","last_change":"2024-04-25T08:53:43.222336+0000","last_active":"2024-04-25T08:53:44.458562+0000","last_peered":"2024-04-25T08:53:44.458562+0000","last_clean":"2024-04-25T08:53:44.458562+0000","last_became_active":"2024-04-25T08:53:43.222046+0000","last_became_peered":"2024-04-25T08:53:43.222046+0000","last_unstale":"2024-04-25T08:53:44.458562+0000","last_undegraded":"2024-04-25T08:53:44.458562+0000","last_fullsized":"2024-04-25T08:53:44.458562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336385+0000","last_change":"2024-04-25T08:53:43.226820+0000","last_active":"2024-04-25T08:53:44.336385+0000","last_peered":"2024-04-25T08:53:44.336385+0000","last_clean":"2024-04-25T08:53:44.336385+0000","last_became_active":"2024-04-25T08:53:43.226533+0000","last_became_peered":"2024-04-25T08:53:43.226533+0000","last_unstale":"2024-04-25T08:53:44.336385+0000","last_undegraded":"2024-04-25T08:53:44.336385+0000","last_fullsized":"2024-04-25T08:53:44.336385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:59.064691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458308+0000","last_change":"2024-04-25T08:53:43.226661+0000","last_active":"2024-04-25T08:53:44.458308+0000","last_peered":"2024-04-25T08:53:44.458308+0000","last_clean":"2024-04-25T08:53:44.458308+0000","last_became_active":"2024-04-25T08:53:43.226353+0000","last_became_peered":"2024-04-25T08:53:43.226353+0000","last_unstale":"2024-04-25T08:53:44.458308+0000","last_undegraded":"2024-04-25T08:53:44.458308+0000","last_fullsized":"2024-04-25T08:53:44.458308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209304+0000","last_change":"2024-04-25T08:53:43.217719+0000","last_active":"2024-04-25T08:53:44.209304+0000","last_peered":"2024-04-25T08:53:44.209304+0000","last_clean":"2024-04-25T08:53:44.209304+0000","last_became_active":"2024-04-25T08:53:43.217440+0000","last_became_peered":"2024-04-25T08:53:43.217440+0000","last_unstale":"2024-04-25T08:53:44.209304+0000","last_undegraded":"2024-04-25T08:53:44.209304+0000","last_fullsized":"2024-04-25T08:53:44.209304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458926+0000","last_change":"2024-04-25T08:53:43.219775+0000","last_active":"2024-04-25T08:53:44.458926+0000","last_peered":"2024-04-25T08:53:44.458926+0000","last_clean":"2024-04-25T08:53:44.458926+0000","last_became_active":"2024-04-25T08:53:43.219463+0000","last_became_peered":"2024-04-25T08:53:43.219463+0000","last_unstale":"2024-04-25T08:53:44.458926+0000","last_undegraded":"2024-04-25T08:53:44.458926+0000","last_fullsized":"2024-04-25T08:53:44.458926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.064857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214552+0000","last_change":"2024-04-25T08:53:43.216899+0000","last_active":"2024-04-25T08:53:44.214552+0000","last_peered":"2024-04-25T08:53:44.214552+0000","last_clean":"2024-04-25T08:53:44.214552+0000","last_became_active":"2024-04-25T08:53:43.216571+0000","last_became_peered":"2024-04-25T08:53:43.216571+0000","last_unstale":"2024-04-25T08:53:44.214552+0000","last_undegraded":"2024-04-25T08:53:44.214552+0000","last_fullsized":"2024-04-25T08:53:44.214552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214373+0000","last_change":"2024-04-25T08:53:43.220978+0000","last_active":"2024-04-25T08:53:44.214373+0000","last_peered":"2024-04-25T08:53:44.214373+0000","last_clean":"2024-04-25T08:53:44.214373+0000","last_became_active":"2024-04-25T08:53:43.219635+0000","last_became_peered":"2024-04-25T08:53:43.219635+0000","last_unstale":"2024-04-25T08:53:44.214373+0000","last_undegraded":"2024-04-25T08:53:44.214373+0000","last_fullsized":"2024-04-25T08:53:44.214373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215612+0000","last_change":"2024-04-25T08:53:43.224429+0000","last_active":"2024-04-25T08:53:44.215612+0000","last_peered":"2024-04-25T08:53:44.215612+0000","last_clean":"2024-04-25T08:53:44.215612+0000","last_became_active":"2024-04-25T08:53:43.224174+0000","last_became_peered":"2024-04-25T08:53:43.224174+0000","last_unstale":"2024-04-25T08:53:44.215612+0000","last_undegraded":"2024-04-25T08:53:44.215612+0000","last_fullsized":"2024-04-25T08:53:44.215612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:46.648651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209560+0000","last_change":"2024-04-25T08:53:43.216375+0000","last_active":"2024-04-25T08:53:44.209560+0000","last_peered":"2024-04-25T08:53:44.209560+0000","last_clean":"2024-04-25T08:53:44.209560+0000","last_became_active":"2024-04-25T08:53:43.216099+0000","last_became_peered":"2024-04-25T08:53:43.216099+0000","last_unstale":"2024-04-25T08:53:44.209560+0000","last_undegraded":"2024-04-25T08:53:44.209560+0000","last_fullsized":"2024-04-25T08:53:44.209560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.225593+0000","last_change":"2024-04-25T08:53:43.223032+0000","last_active":"2024-04-25T08:53:43.225593+0000","last_peered":"2024-04-25T08:53:43.225593+0000","last_clean":"2024-04-25T08:53:43.225593+0000","last_became_active":"2024-04-25T08:53:43.222624+0000","last_became_peered":"2024-04-25T08:53:43.222624+0000","last_unstale":"2024-04-25T08:53:43.225593+0000","last_undegraded":"2024-04-25T08:53:43.225593+0000","last_fullsized":"2024-04-25T08:53:43.225593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:04.077055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.335931+0000","last_change":"2024-04-25T08:53:43.228001+0000","last_active":"2024-04-25T08:53:44.335931+0000","last_peered":"2024-04-25T08:53:44.335931+0000","last_clean":"2024-04-25T08:53:44.335931+0000","last_became_active":"2024-04-25T08:53:43.227703+0000","last_became_peered":"2024-04-25T08:53:43.227703+0000","last_unstale":"2024-04-25T08:53:44.335931+0000","last_undegraded":"2024-04-25T08:53:44.335931+0000","last_fullsized":"2024-04-25T08:53:44.335931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336584+0000","last_change":"2024-04-25T08:53:43.226726+0000","last_active":"2024-04-25T08:53:44.336584+0000","last_peered":"2024-04-25T08:53:44.336584+0000","last_clean":"2024-04-25T08:53:44.336584+0000","last_became_active":"2024-04-25T08:53:43.226448+0000","last_became_peered":"2024-04-25T08:53:43.226448+0000","last_unstale":"2024-04-25T08:53:44.336584+0000","last_undegraded":"2024-04-25T08:53:44.336584+0000","last_fullsized":"2024-04-25T08:53:44.336584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.064857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.219560+0000","last_change":"2024-04-25T08:53:43.216437+0000","last_active":"2024-04-25T08:53:43.219560+0000","last_peered":"2024-04-25T08:53:43.219560+0000","last_clean":"2024-04-25T08:53:43.219560+0000","last_became_active":"2024-04-25T08:53:43.216118+0000","last_became_peered":"2024-04-25T08:53:43.216118+0000","last_unstale":"2024-04-25T08:53:43.219560+0000","last_undegraded":"2024-04-25T08:53:43.219560+0000","last_fullsized":"2024-04-25T08:53:43.219560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:33.206100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458878+0000","last_change":"2024-04-25T08:53:43.222245+0000","last_active":"2024-04-25T08:53:44.458878+0000","last_peered":"2024-04-25T08:53:44.458878+0000","last_clean":"2024-04-25T08:53:44.458878+0000","last_became_active":"2024-04-25T08:53:43.221954+0000","last_became_peered":"2024-04-25T08:53:43.221954+0000","last_unstale":"2024-04-25T08:53:44.458878+0000","last_undegraded":"2024-04-25T08:53:44.458878+0000","last_fullsized":"2024-04-25T08:53:44.458878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:46.272432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214280+0000","last_change":"2024-04-25T08:53:43.208966+0000","last_active":"2024-04-25T08:53:44.214280+0000","last_peered":"2024-04-25T08:53:44.214280+0000","last_clean":"2024-04-25T08:53:44.214280+0000","last_became_active":"2024-04-25T08:53:43.208694+0000","last_became_peered":"2024-04-25T08:53:43.208694+0000","last_unstale":"2024-04-25T08:53:44.214280+0000","last_undegraded":"2024-04-25T08:53:44.214280+0000","last_fullsized":"2024-04-25T08:53:44.214280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.230314+0000","last_change":"2024-04-25T08:53:43.227774+0000","last_active":"2024-04-25T08:53:43.230314+0000","last_peered":"2024-04-25T08:53:43.230314+0000","last_clean":"2024-04-25T08:53:43.230314+0000","last_became_active":"2024-04-25T08:53:43.227471+0000","last_became_peered":"2024-04-25T08:53:43.227471+0000","last_unstale":"2024-04-25T08:53:43.230314+0000","last_undegraded":"2024-04-25T08:53:43.230314+0000","last_fullsized":"2024-04-25T08:53:43.230314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:56.649442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336129+0000","last_change":"2024-04-25T08:53:43.225757+0000","last_active":"2024-04-25T08:53:44.336129+0000","last_peered":"2024-04-25T08:53:44.336129+0000","last_clean":"2024-04-25T08:53:44.336129+0000","last_became_active":"2024-04-25T08:53:43.225482+0000","last_became_peered":"2024-04-25T08:53:43.225482+0000","last_unstale":"2024-04-25T08:53:44.336129+0000","last_undegraded":"2024-04-25T08:53:44.336129+0000","last_fullsized":"2024-04-25T08:53:44.336129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209673+0000","last_change":"2024-04-25T08:53:43.213773+0000","last_active":"2024-04-25T08:53:44.209673+0000","last_peered":"2024-04-25T08:53:44.209673+0000","last_clean":"2024-04-25T08:53:44.209673+0000","last_became_active":"2024-04-25T08:53:43.211924+0000","last_became_peered":"2024-04-25T08:53:43.211924+0000","last_unstale":"2024-04-25T08:53:44.209673+0000","last_undegraded":"2024-04-25T08:53:44.209673+0000","last_fullsized":"2024-04-25T08:53:44.209673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336156+0000","last_change":"2024-04-25T08:53:43.221087+0000","last_active":"2024-04-25T08:53:44.336156+0000","last_peered":"2024-04-25T08:53:44.336156+0000","last_clean":"2024-04-25T08:53:44.336156+0000","last_became_active":"2024-04-25T08:53:43.219503+0000","last_became_peered":"2024-04-25T08:53:43.219503+0000","last_unstale":"2024-04-25T08:53:44.336156+0000","last_undegraded":"2024-04-25T08:53:44.336156+0000","last_fullsized":"2024-04-25T08:53:44.336156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209695+0000","last_change":"2024-04-25T08:53:43.215393+0000","last_active":"2024-04-25T08:53:44.209695+0000","last_peered":"2024-04-25T08:53:44.209695+0000","last_clean":"2024-04-25T08:53:44.209695+0000","last_became_active":"2024-04-25T08:53:43.214671+0000","last_became_peered":"2024-04-25T08:53:43.214671+0000","last_unstale":"2024-04-25T08:53:44.209695+0000","last_undegraded":"2024-04-25T08:53:44.209695+0000","last_fullsized":"2024-04-25T08:53:44.209695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214588+0000","last_change":"2024-04-25T08:53:43.218493+0000","last_active":"2024-04-25T08:53:44.214588+0000","last_peered":"2024-04-25T08:53:44.214588+0000","last_clean":"2024-04-25T08:53:44.214588+0000","last_became_active":"2024-04-25T08:53:43.218199+0000","last_became_peered":"2024-04-25T08:53:43.218199+0000","last_unstale":"2024-04-25T08:53:44.214588+0000","last_undegraded":"2024-04-25T08:53:44.214588+0000","last_fullsized":"2024-04-25T08:53:44.214588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209813+0000","last_change":"2024-04-25T08:53:43.214059+0000","last_active":"2024-04-25T08:53:44.209813+0000","last_peered":"2024-04-25T08:53:44.209813+0000","last_clean":"2024-04-25T08:53:44.209813+0000","last_became_active":"2024-04-25T08:53:43.211412+0000","last_became_peered":"2024-04-25T08:53:43.211412+0000","last_unstale":"2024-04-25T08:53:44.209813+0000","last_undegraded":"2024-04-25T08:53:44.209813+0000","last_fullsized":"2024-04-25T08:53:44.209813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.226206+0000","last_change":"2024-04-25T08:53:43.224899+0000","last_active":"2024-04-25T08:53:43.226206+0000","last_peered":"2024-04-25T08:53:43.226206+0000","last_clean":"2024-04-25T08:53:43.226206+0000","last_became_active":"2024-04-25T08:53:43.224532+0000","last_became_peered":"2024-04-25T08:53:43.224532+0000","last_unstale":"2024-04-25T08:53:43.226206+0000","last_undegraded":"2024-04-25T08:53:43.226206+0000","last_fullsized":"2024-04-25T08:53:43.226206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:46.648651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336482+0000","last_change":"2024-04-25T08:53:43.225133+0000","last_active":"2024-04-25T08:53:44.336482+0000","last_peered":"2024-04-25T08:53:44.336482+0000","last_clean":"2024-04-25T08:53:44.336482+0000","last_became_active":"2024-04-25T08:53:43.224687+0000","last_became_peered":"2024-04-25T08:53:43.224687+0000","last_unstale":"2024-04-25T08:53:44.336482+0000","last_undegraded":"2024-04-25T08:53:44.336482+0000","last_fullsized":"2024-04-25T08:53:44.336482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:46.272432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.219651+0000","last_change":"2024-04-25T08:53:43.215307+0000","last_active":"2024-04-25T08:53:43.219651+0000","last_peered":"2024-04-25T08:53:43.219651+0000","last_clean":"2024-04-25T08:53:43.219651+0000","last_became_active":"2024-04-25T08:53:43.215014+0000","last_became_peered":"2024-04-25T08:53:43.215014+0000","last_unstale":"2024-04-25T08:53:43.219651+0000","last_undegraded":"2024-04-25T08:53:43.219651+0000","last_fullsized":"2024-04-25T08:53:43.219651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:04.077055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214040+0000","last_change":"2024-04-25T08:53:43.226428+0000","last_active":"2024-04-25T08:53:44.214040+0000","last_peered":"2024-04-25T08:53:44.214040+0000","last_clean":"2024-04-25T08:53:44.214040+0000","last_became_active":"2024-04-25T08:53:43.225678+0000","last_became_peered":"2024-04-25T08:53:43.225678+0000","last_unstale":"2024-04-25T08:53:44.214040+0000","last_undegraded":"2024-04-25T08:53:44.214040+0000","last_fullsized":"2024-04-25T08:53:44.214040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215161+0000","last_change":"2024-04-25T08:53:43.210436+0000","last_active":"2024-04-25T08:53:44.215161+0000","last_peered":"2024-04-25T08:53:44.215161+0000","last_clean":"2024-04-25T08:53:44.215161+0000","last_became_active":"2024-04-25T08:53:43.210150+0000","last_became_peered":"2024-04-25T08:53:43.210150+0000","last_unstale":"2024-04-25T08:53:44.215161+0000","last_undegraded":"2024-04-25T08:53:44.215161+0000","last_fullsized":"2024-04-25T08:53:44.215161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:36.391147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209779+0000","last_change":"2024-04-25T08:53:42.207162+0000","last_active":"2024-04-25T08:53:44.209779+0000","last_peered":"2024-04-25T08:53:44.209779+0000","last_clean":"2024-04-25T08:53:44.209779+0000","last_became_active":"2024-04-25T08:53:42.206827+0000","last_became_peered":"2024-04-25T08:53:42.206827+0000","last_unstale":"2024-04-25T08:53:44.209779+0000","last_undegraded":"2024-04-25T08:53:44.209779+0000","last_fullsized":"2024-04-25T08:53:44.209779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.222127+0000","last_change":"2024-04-25T08:53:43.219024+0000","last_active":"2024-04-25T08:53:43.222127+0000","last_peered":"2024-04-25T08:53:43.222127+0000","last_clean":"2024-04-25T08:53:43.222127+0000","last_became_active":"2024-04-25T08:53:43.218674+0000","last_became_peered":"2024-04-25T08:53:43.218674+0000","last_unstale":"2024-04-25T08:53:43.222127+0000","last_undegraded":"2024-04-25T08:53:43.222127+0000","last_fullsized":"2024-04-25T08:53:43.222127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:39.473137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214016+0000","last_change":"2024-04-25T08:53:42.202321+0000","last_active":"2024-04-25T08:53:44.214016+0000","last_peered":"2024-04-25T08:53:44.214016+0000","last_clean":"2024-04-25T08:53:44.214016+0000","last_became_active":"2024-04-25T08:53:42.202063+0000","last_became_peered":"2024-04-25T08:53:42.202063+0000","last_unstale":"2024-04-25T08:53:44.214016+0000","last_undegraded":"2024-04-25T08:53:44.214016+0000","last_fullsized":"2024-04-25T08:53:44.214016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209484+0000","last_change":"2024-04-25T08:53:42.210884+0000","last_active":"2024-04-25T08:53:44.209484+0000","last_peered":"2024-04-25T08:53:44.209484+0000","last_clean":"2024-04-25T08:53:44.209484+0000","last_became_active":"2024-04-25T08:53:42.210568+0000","last_became_peered":"2024-04-25T08:53:42.210568+0000","last_unstale":"2024-04-25T08:53:44.209484+0000","last_undegraded":"2024-04-25T08:53:44.209484+0000","last_fullsized":"2024-04-25T08:53:44.209484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:51.480879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209351+0000","last_change":"2024-04-25T08:53:43.225401+0000","last_active":"2024-04-25T08:53:44.209351+0000","last_peered":"2024-04-25T08:53:44.209351+0000","last_clean":"2024-04-25T08:53:44.209351+0000","last_became_active":"2024-04-25T08:53:43.224926+0000","last_became_peered":"2024-04-25T08:53:43.224926+0000","last_unstale":"2024-04-25T08:53:44.209351+0000","last_undegraded":"2024-04-25T08:53:44.209351+0000","last_fullsized":"2024-04-25T08:53:44.209351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336053+0000","last_change":"2024-04-25T08:53:42.201897+0000","last_active":"2024-04-25T08:53:44.336053+0000","last_peered":"2024-04-25T08:53:44.336053+0000","last_clean":"2024-04-25T08:53:44.336053+0000","last_became_active":"2024-04-25T08:53:42.201641+0000","last_became_peered":"2024-04-25T08:53:42.201641+0000","last_unstale":"2024-04-25T08:53:44.336053+0000","last_undegraded":"2024-04-25T08:53:44.336053+0000","last_fullsized":"2024-04-25T08:53:44.336053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214230+0000","last_change":"2024-04-25T08:53:42.209416+0000","last_active":"2024-04-25T08:53:44.214230+0000","last_peered":"2024-04-25T08:53:44.214230+0000","last_clean":"2024-04-25T08:53:44.214230+0000","last_became_active":"2024-04-25T08:53:42.209094+0000","last_became_peered":"2024-04-25T08:53:42.209094+0000","last_unstale":"2024-04-25T08:53:44.214230+0000","last_undegraded":"2024-04-25T08:53:44.214230+0000","last_fullsized":"2024-04-25T08:53:44.214230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336418+0000","last_change":"2024-04-25T08:53:43.221170+0000","last_active":"2024-04-25T08:53:44.336418+0000","last_peered":"2024-04-25T08:53:44.336418+0000","last_clean":"2024-04-25T08:53:44.336418+0000","last_became_active":"2024-04-25T08:53:43.220913+0000","last_became_peered":"2024-04-25T08:53:43.220913+0000","last_unstale":"2024-04-25T08:53:44.336418+0000","last_undegraded":"2024-04-25T08:53:44.336418+0000","last_fullsized":"2024-04-25T08:53:44.336418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:22.702870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336314+0000","last_change":"2024-04-25T08:53:42.209519+0000","last_active":"2024-04-25T08:53:44.336314+0000","last_peered":"2024-04-25T08:53:44.336314+0000","last_clean":"2024-04-25T08:53:44.336314+0000","last_became_active":"2024-04-25T08:53:42.209218+0000","last_became_peered":"2024-04-25T08:53:42.209218+0000","last_unstale":"2024-04-25T08:53:44.336314+0000","last_undegraded":"2024-04-25T08:53:44.336314+0000","last_fullsized":"2024-04-25T08:53:44.336314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.223692+0000","last_change":"2024-04-25T08:53:43.216391+0000","last_active":"2024-04-25T08:53:43.223692+0000","last_peered":"2024-04-25T08:53:43.223692+0000","last_clean":"2024-04-25T08:53:43.223692+0000","last_became_active":"2024-04-25T08:53:43.216117+0000","last_became_peered":"2024-04-25T08:53:43.216117+0000","last_unstale":"2024-04-25T08:53:43.223692+0000","last_undegraded":"2024-04-25T08:53:43.223692+0000","last_fullsized":"2024-04-25T08:53:43.223692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:02.604483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.194636+0000","last_change":"2024-04-25T08:53:41.194636+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.194636+0000","last_undegraded":"2024-04-25T08:53:41.194636+0000","last_fullsized":"2024-04-25T08:53:41.194636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215673+0000","last_change":"2024-04-25T08:53:43.222934+0000","last_active":"2024-04-25T08:53:44.215673+0000","last_peered":"2024-04-25T08:53:44.215673+0000","last_clean":"2024-04-25T08:53:44.215673+0000","last_became_active":"2024-04-25T08:53:43.222610+0000","last_became_peered":"2024-04-25T08:53:43.222610+0000","last_unstale":"2024-04-25T08:53:44.215673+0000","last_undegraded":"2024-04-25T08:53:44.215673+0000","last_fullsized":"2024-04-25T08:53:44.215673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:30.574790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214410+0000","last_change":"2024-04-25T08:53:42.205189+0000","last_active":"2024-04-25T08:53:44.214410+0000","last_peered":"2024-04-25T08:53:44.214410+0000","last_clean":"2024-04-25T08:53:44.214410+0000","last_became_active":"2024-04-25T08:53:42.204876+0000","last_became_peered":"2024-04-25T08:53:42.204876+0000","last_unstale":"2024-04-25T08:53:44.214410+0000","last_undegraded":"2024-04-25T08:53:44.214410+0000","last_fullsized":"2024-04-25T08:53:44.214410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458651+0000","last_change":"2024-04-25T08:53:43.229049+0000","last_active":"2024-04-25T08:53:44.458651+0000","last_peered":"2024-04-25T08:53:44.458651+0000","last_clean":"2024-04-25T08:53:44.458651+0000","last_became_active":"2024-04-25T08:53:43.228659+0000","last_became_peered":"2024-04-25T08:53:43.228659+0000","last_unstale":"2024-04-25T08:53:44.458651+0000","last_undegraded":"2024-04-25T08:53:44.458651+0000","last_fullsized":"2024-04-25T08:53:44.458651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:59.064691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.235081+0000","last_change":"2024-04-25T08:53:42.205092+0000","last_active":"2024-04-25T08:53:43.235081+0000","last_peered":"2024-04-25T08:53:43.235081+0000","last_clean":"2024-04-25T08:53:43.235081+0000","last_became_active":"2024-04-25T08:53:42.204784+0000","last_became_peered":"2024-04-25T08:53:42.204784+0000","last_unstale":"2024-04-25T08:53:43.235081+0000","last_undegraded":"2024-04-25T08:53:43.235081+0000","last_fullsized":"2024-04-25T08:53:43.235081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:17.160891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.228174+0000","last_change":"2024-04-25T08:53:43.227057+0000","last_active":"2024-04-25T08:53:43.228174+0000","last_peered":"2024-04-25T08:53:43.228174+0000","last_clean":"2024-04-25T08:53:43.228174+0000","last_became_active":"2024-04-25T08:53:43.226484+0000","last_became_peered":"2024-04-25T08:53:43.226484+0000","last_unstale":"2024-04-25T08:53:43.228174+0000","last_undegraded":"2024-04-25T08:53:43.228174+0000","last_fullsized":"2024-04-25T08:53:43.228174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:09.421533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336568+0000","last_change":"2024-04-25T08:53:42.204014+0000","last_active":"2024-04-25T08:53:44.336568+0000","last_peered":"2024-04-25T08:53:44.336568+0000","last_clean":"2024-04-25T08:53:44.336568+0000","last_became_active":"2024-04-25T08:53:42.203751+0000","last_became_peered":"2024-04-25T08:53:42.203751+0000","last_unstale":"2024-04-25T08:53:44.336568+0000","last_undegraded":"2024-04-25T08:53:44.336568+0000","last_fullsized":"2024-04-25T08:53:44.336568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458574+0000","last_change":"2024-04-25T08:53:43.231009+0000","last_active":"2024-04-25T08:53:44.458574+0000","last_peered":"2024-04-25T08:53:44.458574+0000","last_clean":"2024-04-25T08:53:44.458574+0000","last_became_active":"2024-04-25T08:53:43.230705+0000","last_became_peered":"2024-04-25T08:53:43.230705+0000","last_unstale":"2024-04-25T08:53:44.458574+0000","last_undegraded":"2024-04-25T08:53:44.458574+0000","last_fullsized":"2024-04-25T08:53:44.458574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.213930+0000","last_change":"2024-04-25T08:53:42.205489+0000","last_active":"2024-04-25T08:53:44.213930+0000","last_peered":"2024-04-25T08:53:44.213930+0000","last_clean":"2024-04-25T08:53:44.213930+0000","last_became_active":"2024-04-25T08:53:42.204328+0000","last_became_peered":"2024-04-25T08:53:42.204328+0000","last_unstale":"2024-04-25T08:53:44.213930+0000","last_undegraded":"2024-04-25T08:53:44.213930+0000","last_fullsized":"2024-04-25T08:53:44.213930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214069+0000","last_change":"2024-04-25T08:53:43.225273+0000","last_active":"2024-04-25T08:53:44.214069+0000","last_peered":"2024-04-25T08:53:44.214069+0000","last_clean":"2024-04-25T08:53:44.214069+0000","last_became_active":"2024-04-25T08:53:43.225014+0000","last_became_peered":"2024-04-25T08:53:43.225014+0000","last_unstale":"2024-04-25T08:53:44.214069+0000","last_undegraded":"2024-04-25T08:53:44.214069+0000","last_fullsized":"2024-04-25T08:53:44.214069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.228582+0000","last_change":"2024-04-25T08:53:42.206147+0000","last_active":"2024-04-25T08:53:43.228582+0000","last_peered":"2024-04-25T08:53:43.228582+0000","last_clean":"2024-04-25T08:53:43.228582+0000","last_became_active":"2024-04-25T08:53:42.205676+0000","last_became_peered":"2024-04-25T08:53:42.205676+0000","last_unstale":"2024-04-25T08:53:43.228582+0000","last_undegraded":"2024-04-25T08:53:43.228582+0000","last_fullsized":"2024-04-25T08:53:43.228582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458337+0000","last_change":"2024-04-25T08:53:43.224941+0000","last_active":"2024-04-25T08:53:44.458337+0000","last_peered":"2024-04-25T08:53:44.458337+0000","last_clean":"2024-04-25T08:53:44.458337+0000","last_became_active":"2024-04-25T08:53:43.224690+0000","last_became_peered":"2024-04-25T08:53:43.224690+0000","last_unstale":"2024-04-25T08:53:44.458337+0000","last_undegraded":"2024-04-25T08:53:44.458337+0000","last_fullsized":"2024-04-25T08:53:44.458337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215685+0000","last_change":"2024-04-25T08:53:42.208945+0000","last_active":"2024-04-25T08:53:44.215685+0000","last_peered":"2024-04-25T08:53:44.215685+0000","last_clean":"2024-04-25T08:53:44.215685+0000","last_became_active":"2024-04-25T08:53:42.208669+0000","last_became_peered":"2024-04-25T08:53:42.208669+0000","last_unstale":"2024-04-25T08:53:44.215685+0000","last_undegraded":"2024-04-25T08:53:44.215685+0000","last_fullsized":"2024-04-25T08:53:44.215685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458850+0000","last_change":"2024-04-25T08:53:43.228967+0000","last_active":"2024-04-25T08:53:44.458850+0000","last_peered":"2024-04-25T08:53:44.458850+0000","last_clean":"2024-04-25T08:53:44.458850+0000","last_became_active":"2024-04-25T08:53:43.228689+0000","last_became_peered":"2024-04-25T08:53:43.228689+0000","last_unstale":"2024-04-25T08:53:44.458850+0000","last_undegraded":"2024-04-25T08:53:44.458850+0000","last_fullsized":"2024-04-25T08:53:44.458850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:15.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.229992+0000","last_change":"2024-04-25T08:53:42.208039+0000","last_active":"2024-04-25T08:53:43.229992+0000","last_peered":"2024-04-25T08:53:43.229992+0000","last_clean":"2024-04-25T08:53:43.229992+0000","last_became_active":"2024-04-25T08:53:42.207680+0000","last_became_peered":"2024-04-25T08:53:42.207680+0000","last_unstale":"2024-04-25T08:53:43.229992+0000","last_undegraded":"2024-04-25T08:53:43.229992+0000","last_fullsized":"2024-04-25T08:53:43.229992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.459007+0000","last_change":"2024-04-25T08:53:43.230110+0000","last_active":"2024-04-25T08:53:44.459007+0000","last_peered":"2024-04-25T08:53:44.459007+0000","last_clean":"2024-04-25T08:53:44.459007+0000","last_became_active":"2024-04-25T08:53:43.229539+0000","last_became_peered":"2024-04-25T08:53:43.229539+0000","last_unstale":"2024-04-25T08:53:44.459007+0000","last_undegraded":"2024-04-25T08:53:44.459007+0000","last_fullsized":"2024-04-25T08:53:44.459007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193644+0000","last_change":"2024-04-25T08:53:41.193644+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193644+0000","last_undegraded":"2024-04-25T08:53:41.193644+0000","last_fullsized":"2024-04-25T08:53:41.193644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336537+0000","last_change":"2024-04-25T08:53:43.227532+0000","last_active":"2024-04-25T08:53:44.336537+0000","last_peered":"2024-04-25T08:53:44.336537+0000","last_clean":"2024-04-25T08:53:44.336537+0000","last_became_active":"2024-04-25T08:53:43.227269+0000","last_became_peered":"2024-04-25T08:53:43.227269+0000","last_unstale":"2024-04-25T08:53:44.336537+0000","last_undegraded":"2024-04-25T08:53:44.336537+0000","last_fullsized":"2024-04-25T08:53:44.336537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:25.482497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.204368+0000","last_change":"2024-04-25T08:53:42.210667+0000","last_active":"2024-04-25T08:53:43.204368+0000","last_peered":"2024-04-25T08:53:43.204368+0000","last_clean":"2024-04-25T08:53:43.204368+0000","last_became_active":"2024-04-25T08:53:42.210367+0000","last_became_peered":"2024-04-25T08:53:42.210367+0000","last_unstale":"2024-04-25T08:53:43.204368+0000","last_undegraded":"2024-04-25T08:53:43.204368+0000","last_fullsized":"2024-04-25T08:53:43.204368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:06.737038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458667+0000","last_change":"2024-04-25T08:53:43.223897+0000","last_active":"2024-04-25T08:53:44.458667+0000","last_peered":"2024-04-25T08:53:44.458667+0000","last_clean":"2024-04-25T08:53:44.458667+0000","last_became_active":"2024-04-25T08:53:43.223610+0000","last_became_peered":"2024-04-25T08:53:43.223610+0000","last_unstale":"2024-04-25T08:53:44.458667+0000","last_undegraded":"2024-04-25T08:53:44.458667+0000","last_fullsized":"2024-04-25T08:53:44.458667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:22.702870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458346+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:53:44.458346+0000","last_peered":"2024-04-25T08:53:44.458346+0000","last_clean":"2024-04-25T08:53:44.458346+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:53:44.458346+0000","last_undegraded":"2024-04-25T08:53:44.458346+0000","last_fullsized":"2024-04-25T08:53:44.458346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336073+0000","last_change":"2024-04-25T08:53:42.204756+0000","last_active":"2024-04-25T08:53:44.336073+0000","last_peered":"2024-04-25T08:53:44.336073+0000","last_clean":"2024-04-25T08:53:44.336073+0000","last_became_active":"2024-04-25T08:53:42.204433+0000","last_became_peered":"2024-04-25T08:53:42.204433+0000","last_unstale":"2024-04-25T08:53:44.336073+0000","last_undegraded":"2024-04-25T08:53:44.336073+0000","last_fullsized":"2024-04-25T08:53:44.336073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209533+0000","last_change":"2024-04-25T08:53:43.217690+0000","last_active":"2024-04-25T08:53:44.209533+0000","last_peered":"2024-04-25T08:53:44.209533+0000","last_clean":"2024-04-25T08:53:44.209533+0000","last_became_active":"2024-04-25T08:53:43.217338+0000","last_became_peered":"2024-04-25T08:53:43.217338+0000","last_unstale":"2024-04-25T08:53:44.209533+0000","last_undegraded":"2024-04-25T08:53:44.209533+0000","last_fullsized":"2024-04-25T08:53:44.209533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458262+0000","last_change":"2024-04-25T08:53:42.205644+0000","last_active":"2024-04-25T08:53:44.458262+0000","last_peered":"2024-04-25T08:53:44.458262+0000","last_clean":"2024-04-25T08:53:44.458262+0000","last_became_active":"2024-04-25T08:53:42.205370+0000","last_became_peered":"2024-04-25T08:53:42.205370+0000","last_unstale":"2024-04-25T08:53:44.458262+0000","last_undegraded":"2024-04-25T08:53:44.458262+0000","last_fullsized":"2024-04-25T08:53:44.458262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:29.564869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.225554+0000","last_change":"2024-04-25T08:53:43.223276+0000","last_active":"2024-04-25T08:53:43.225554+0000","last_peered":"2024-04-25T08:53:43.225554+0000","last_clean":"2024-04-25T08:53:43.225554+0000","last_became_active":"2024-04-25T08:53:43.222289+0000","last_became_peered":"2024-04-25T08:53:43.222289+0000","last_unstale":"2024-04-25T08:53:43.225554+0000","last_undegraded":"2024-04-25T08:53:43.225554+0000","last_fullsized":"2024-04-25T08:53:43.225554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:33.206100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.205047+0000","last_change":"2024-04-25T08:53:42.208356+0000","last_active":"2024-04-25T08:53:43.205047+0000","last_peered":"2024-04-25T08:53:43.205047+0000","last_clean":"2024-04-25T08:53:43.205047+0000","last_became_active":"2024-04-25T08:53:42.207946+0000","last_became_peered":"2024-04-25T08:53:42.207946+0000","last_unstale":"2024-04-25T08:53:43.205047+0000","last_undegraded":"2024-04-25T08:53:43.205047+0000","last_fullsized":"2024-04-25T08:53:43.205047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336592+0000","last_change":"2024-04-25T08:53:42.200507+0000","last_active":"2024-04-25T08:53:44.336592+0000","last_peered":"2024-04-25T08:53:44.336592+0000","last_clean":"2024-04-25T08:53:44.336592+0000","last_became_active":"2024-04-25T08:53:42.200202+0000","last_became_peered":"2024-04-25T08:53:42.200202+0000","last_unstale":"2024-04-25T08:53:44.336592+0000","last_undegraded":"2024-04-25T08:53:44.336592+0000","last_fullsized":"2024-04-25T08:53:44.336592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215336+0000","last_change":"2024-04-25T08:53:43.223144+0000","last_active":"2024-04-25T08:53:44.215336+0000","last_peered":"2024-04-25T08:53:44.215336+0000","last_clean":"2024-04-25T08:53:44.215336+0000","last_became_active":"2024-04-25T08:53:43.222867+0000","last_became_peered":"2024-04-25T08:53:43.222867+0000","last_unstale":"2024-04-25T08:53:44.215336+0000","last_undegraded":"2024-04-25T08:53:44.215336+0000","last_fullsized":"2024-04-25T08:53:44.215336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:33.206100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193951+0000","last_change":"2024-04-25T08:53:41.193951+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193951+0000","last_undegraded":"2024-04-25T08:53:41.193951+0000","last_fullsized":"2024-04-25T08:53:41.193951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336639+0000","last_change":"2024-04-25T08:53:43.224224+0000","last_active":"2024-04-25T08:53:44.336639+0000","last_peered":"2024-04-25T08:53:44.336639+0000","last_clean":"2024-04-25T08:53:44.336639+0000","last_became_active":"2024-04-25T08:53:43.223968+0000","last_became_peered":"2024-04-25T08:53:43.223968+0000","last_unstale":"2024-04-25T08:53:44.336639+0000","last_undegraded":"2024-04-25T08:53:44.336639+0000","last_fullsized":"2024-04-25T08:53:44.336639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458861+0000","last_change":"2024-04-25T08:53:42.212251+0000","last_active":"2024-04-25T08:53:44.458861+0000","last_peered":"2024-04-25T08:53:44.458861+0000","last_clean":"2024-04-25T08:53:44.458861+0000","last_became_active":"2024-04-25T08:53:42.212014+0000","last_became_peered":"2024-04-25T08:53:42.212014+0000","last_unstale":"2024-04-25T08:53:44.458861+0000","last_undegraded":"2024-04-25T08:53:44.458861+0000","last_fullsized":"2024-04-25T08:53:44.458861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193905+0000","last_change":"2024-04-25T08:53:41.193905+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193905+0000","last_undegraded":"2024-04-25T08:53:41.193905+0000","last_fullsized":"2024-04-25T08:53:41.193905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209997+0000","last_change":"2024-04-25T08:53:43.222064+0000","last_active":"2024-04-25T08:53:44.209997+0000","last_peered":"2024-04-25T08:53:44.209997+0000","last_clean":"2024-04-25T08:53:44.209997+0000","last_became_active":"2024-04-25T08:53:43.220696+0000","last_became_peered":"2024-04-25T08:53:43.220696+0000","last_unstale":"2024-04-25T08:53:44.209997+0000","last_undegraded":"2024-04-25T08:53:44.209997+0000","last_fullsized":"2024-04-25T08:53:44.209997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214303+0000","last_change":"2024-04-25T08:53:42.203104+0000","last_active":"2024-04-25T08:53:44.214303+0000","last_peered":"2024-04-25T08:53:44.214303+0000","last_clean":"2024-04-25T08:53:44.214303+0000","last_became_active":"2024-04-25T08:53:42.202822+0000","last_became_peered":"2024-04-25T08:53:42.202822+0000","last_unstale":"2024-04-25T08:53:44.214303+0000","last_undegraded":"2024-04-25T08:53:44.214303+0000","last_fullsized":"2024-04-25T08:53:44.214303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.222273+0000","last_change":"2024-04-25T08:53:43.214747+0000","last_active":"2024-04-25T08:53:43.222273+0000","last_peered":"2024-04-25T08:53:43.222273+0000","last_clean":"2024-04-25T08:53:43.222273+0000","last_became_active":"2024-04-25T08:53:43.214410+0000","last_became_peered":"2024-04-25T08:53:43.214410+0000","last_unstale":"2024-04-25T08:53:43.222273+0000","last_undegraded":"2024-04-25T08:53:43.222273+0000","last_fullsized":"2024-04-25T08:53:43.222273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:07.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458260+0000","last_change":"2024-04-25T08:53:42.212258+0000","last_active":"2024-04-25T08:53:44.458260+0000","last_peered":"2024-04-25T08:53:44.458260+0000","last_clean":"2024-04-25T08:53:44.458260+0000","last_became_active":"2024-04-25T08:53:42.212025+0000","last_became_peered":"2024-04-25T08:53:42.212025+0000","last_unstale":"2024-04-25T08:53:44.458260+0000","last_undegraded":"2024-04-25T08:53:44.458260+0000","last_fullsized":"2024-04-25T08:53:44.458260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:45.638730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215251+0000","last_change":"2024-04-25T08:53:43.216186+0000","last_active":"2024-04-25T08:53:44.215251+0000","last_peered":"2024-04-25T08:53:44.215251+0000","last_clean":"2024-04-25T08:53:44.215251+0000","last_became_active":"2024-04-25T08:53:43.215899+0000","last_became_peered":"2024-04-25T08:53:43.215899+0000","last_unstale":"2024-04-25T08:53:44.215251+0000","last_undegraded":"2024-04-25T08:53:44.215251+0000","last_fullsized":"2024-04-25T08:53:44.215251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:04.077055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193599+0000","last_change":"2024-04-25T08:53:41.193599+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193599+0000","last_undegraded":"2024-04-25T08:53:41.193599+0000","last_fullsized":"2024-04-25T08:53:41.193599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209486+0000","last_change":"2024-04-25T08:53:43.217644+0000","last_active":"2024-04-25T08:53:44.209486+0000","last_peered":"2024-04-25T08:53:44.209486+0000","last_clean":"2024-04-25T08:53:44.209486+0000","last_became_active":"2024-04-25T08:53:43.217347+0000","last_became_peered":"2024-04-25T08:53:43.217347+0000","last_unstale":"2024-04-25T08:53:44.209486+0000","last_undegraded":"2024-04-25T08:53:44.209486+0000","last_fullsized":"2024-04-25T08:53:44.209486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.195506+0000","last_change":"2024-04-25T08:53:41.195506+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.195506+0000","last_undegraded":"2024-04-25T08:53:41.195506+0000","last_fullsized":"2024-04-25T08:53:41.195506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209913+0000","last_change":"2024-04-25T08:53:43.215719+0000","last_active":"2024-04-25T08:53:44.209913+0000","last_peered":"2024-04-25T08:53:44.209913+0000","last_clean":"2024-04-25T08:53:44.209913+0000","last_became_active":"2024-04-25T08:53:43.215453+0000","last_became_peered":"2024-04-25T08:53:43.215453+0000","last_unstale":"2024-04-25T08:53:44.209913+0000","last_undegraded":"2024-04-25T08:53:44.209913+0000","last_fullsized":"2024-04-25T08:53:44.209913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458715+0000","last_change":"2024-04-25T08:53:42.207288+0000","last_active":"2024-04-25T08:53:44.458715+0000","last_peered":"2024-04-25T08:53:44.458715+0000","last_clean":"2024-04-25T08:53:44.458715+0000","last_became_active":"2024-04-25T08:53:42.207012+0000","last_became_peered":"2024-04-25T08:53:42.207012+0000","last_unstale":"2024-04-25T08:53:44.458715+0000","last_undegraded":"2024-04-25T08:53:44.458715+0000","last_fullsized":"2024-04-25T08:53:44.458715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214055+0000","last_change":"2024-04-25T08:53:43.209633+0000","last_active":"2024-04-25T08:53:44.214055+0000","last_peered":"2024-04-25T08:53:44.214055+0000","last_clean":"2024-04-25T08:53:44.214055+0000","last_became_active":"2024-04-25T08:53:43.209378+0000","last_became_peered":"2024-04-25T08:53:43.209378+0000","last_unstale":"2024-04-25T08:53:44.214055+0000","last_undegraded":"2024-04-25T08:53:44.214055+0000","last_fullsized":"2024-04-25T08:53:44.214055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336439+0000","last_change":"2024-04-25T08:53:43.220635+0000","last_active":"2024-04-25T08:53:44.336439+0000","last_peered":"2024-04-25T08:53:44.336439+0000","last_clean":"2024-04-25T08:53:44.336439+0000","last_became_active":"2024-04-25T08:53:43.220373+0000","last_became_peered":"2024-04-25T08:53:43.220373+0000","last_unstale":"2024-04-25T08:53:44.336439+0000","last_undegraded":"2024-04-25T08:53:44.336439+0000","last_fullsized":"2024-04-25T08:53:44.336439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458542+0000","last_change":"2024-04-25T08:53:42.207788+0000","last_active":"2024-04-25T08:53:44.458542+0000","last_peered":"2024-04-25T08:53:44.458542+0000","last_clean":"2024-04-25T08:53:44.458542+0000","last_became_active":"2024-04-25T08:53:42.207521+0000","last_became_peered":"2024-04-25T08:53:42.207521+0000","last_unstale":"2024-04-25T08:53:44.458542+0000","last_undegraded":"2024-04-25T08:53:44.458542+0000","last_fullsized":"2024-04-25T08:53:44.458542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336474+0000","last_change":"2024-04-25T08:53:43.219991+0000","last_active":"2024-04-25T08:53:44.336474+0000","last_peered":"2024-04-25T08:53:44.336474+0000","last_clean":"2024-04-25T08:53:44.336474+0000","last_became_active":"2024-04-25T08:53:43.219715+0000","last_became_peered":"2024-04-25T08:53:43.219715+0000","last_unstale":"2024-04-25T08:53:44.336474+0000","last_undegraded":"2024-04-25T08:53:44.336474+0000","last_fullsized":"2024-04-25T08:53:44.336474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:15.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458764+0000","last_change":"2024-04-25T08:53:42.206350+0000","last_active":"2024-04-25T08:53:44.458764+0000","last_peered":"2024-04-25T08:53:44.458764+0000","last_clean":"2024-04-25T08:53:44.458764+0000","last_became_active":"2024-04-25T08:53:42.206045+0000","last_became_peered":"2024-04-25T08:53:42.206045+0000","last_unstale":"2024-04-25T08:53:44.458764+0000","last_undegraded":"2024-04-25T08:53:44.458764+0000","last_fullsized":"2024-04-25T08:53:44.458764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.226262+0000","last_change":"2024-04-25T08:53:43.225375+0000","last_active":"2024-04-25T08:53:43.226262+0000","last_peered":"2024-04-25T08:53:43.226262+0000","last_clean":"2024-04-25T08:53:43.226262+0000","last_became_active":"2024-04-25T08:53:43.225062+0000","last_became_peered":"2024-04-25T08:53:43.225062+0000","last_unstale":"2024-04-25T08:53:43.226262+0000","last_undegraded":"2024-04-25T08:53:43.226262+0000","last_fullsized":"2024-04-25T08:53:43.226262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:30.574790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209778+0000","last_change":"2024-04-25T08:53:42.209070+0000","last_active":"2024-04-25T08:53:44.209778+0000","last_peered":"2024-04-25T08:53:44.209778+0000","last_clean":"2024-04-25T08:53:44.209778+0000","last_became_active":"2024-04-25T08:53:42.208670+0000","last_became_peered":"2024-04-25T08:53:42.208670+0000","last_unstale":"2024-04-25T08:53:44.209778+0000","last_undegraded":"2024-04-25T08:53:44.209778+0000","last_fullsized":"2024-04-25T08:53:44.209778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:06.737038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.210018+0000","last_change":"2024-04-25T08:53:43.224397+0000","last_active":"2024-04-25T08:53:44.210018+0000","last_peered":"2024-04-25T08:53:44.210018+0000","last_clean":"2024-04-25T08:53:44.210018+0000","last_became_active":"2024-04-25T08:53:43.224037+0000","last_became_peered":"2024-04-25T08:53:43.224037+0000","last_unstale":"2024-04-25T08:53:44.210018+0000","last_undegraded":"2024-04-25T08:53:44.210018+0000","last_fullsized":"2024-04-25T08:53:44.210018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.235074+0000","last_change":"2024-04-25T08:53:42.209220+0000","last_active":"2024-04-25T08:53:43.235074+0000","last_peered":"2024-04-25T08:53:43.235074+0000","last_clean":"2024-04-25T08:53:43.235074+0000","last_became_active":"2024-04-25T08:53:42.208936+0000","last_became_peered":"2024-04-25T08:53:42.208936+0000","last_unstale":"2024-04-25T08:53:43.235074+0000","last_undegraded":"2024-04-25T08:53:43.235074+0000","last_fullsized":"2024-04-25T08:53:43.235074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:51.480879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":665885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":75061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:53:46.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-04-25T08:53:46.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:53:42.183932+0000', 'last_change': '2024-04-25T08:53:42.183932+0000', 'last_active': '2024-04-25T08:53:42.183932+0000', 'last_peered': '2024-04-25T08:53:42.183932+0000', 'last_clean': '2024-04-25T08:53:42.183932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:42.183932+0000', 'last_undegraded': '2024-04-25T08:53:42.183932+0000', 'last_fullsized': '2024-04-25T08:53:42.183932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:53:46.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-04-25T08:53:46.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:53:42.183932+0000', 'last_change': '2024-04-25T08:53:42.183932+0000', 'last_active': '2024-04-25T08:53:42.183932+0000', 'last_peered': '2024-04-25T08:53:42.183932+0000', 'last_clean': '2024-04-25T08:53:42.183932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:42.183932+0000', 'last_undegraded': '2024-04-25T08:53:42.183932+0000', 'last_fullsized': '2024-04-25T08:53:42.183932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:53:46.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-04-25T08:53:46.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:53:42.183932+0000', 'last_change': '2024-04-25T08:53:42.183932+0000', 'last_active': '2024-04-25T08:53:42.183932+0000', 'last_peered': '2024-04-25T08:53:42.183932+0000', 'last_clean': '2024-04-25T08:53:42.183932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:42.183932+0000', 'last_undegraded': '2024-04-25T08:53:42.183932+0000', 'last_fullsized': '2024-04-25T08:53:42.183932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:53:46.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-25T08:53:46.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:53:42.183932+0000', 'last_change': '2024-04-25T08:53:42.183932+0000', 'last_active': '2024-04-25T08:53:42.183932+0000', 'last_peered': '2024-04-25T08:53:42.183932+0000', 'last_clean': '2024-04-25T08:53:42.183932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:42.183932+0000', 'last_undegraded': '2024-04-25T08:53:42.183932+0000', 'last_fullsized': '2024-04-25T08:53:42.183932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:53:46.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-04-25T08:53:46.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:53:41.194636+0000', 'last_change': '2024-04-25T08:53:41.194636+0000', 'last_active': '2024-04-25T08:53:41.174011+0000', 'last_peered': '2024-04-25T08:53:41.174011+0000', 'last_clean': '2024-04-25T08:53:41.174011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:41.194636+0000', 'last_undegraded': '2024-04-25T08:53:41.194636+0000', 'last_fullsized': '2024-04-25T08:53:41.194636+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:53:46.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-04-25T08:53:46.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:53:41.193644+0000', 'last_change': '2024-04-25T08:53:41.193644+0000', 'last_active': '2024-04-25T08:53:41.174011+0000', 'last_peered': '2024-04-25T08:53:41.174011+0000', 'last_clean': '2024-04-25T08:53:41.174011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:41.193644+0000', 'last_undegraded': '2024-04-25T08:53:41.193644+0000', 'last_fullsized': '2024-04-25T08:53:41.193644+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:53:46.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-25T08:53:46.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:53:42.183932+0000', 'last_change': '2024-04-25T08:53:42.183932+0000', 'last_active': '2024-04-25T08:53:42.183932+0000', 'last_peered': '2024-04-25T08:53:42.183932+0000', 'last_clean': '2024-04-25T08:53:42.183932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:42.183932+0000', 'last_undegraded': '2024-04-25T08:53:42.183932+0000', 'last_fullsized': '2024-04-25T08:53:42.183932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:53:46.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-04-25T08:53:46.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:53:41.193951+0000', 'last_change': '2024-04-25T08:53:41.193951+0000', 'last_active': '2024-04-25T08:53:41.174011+0000', 'last_peered': '2024-04-25T08:53:41.174011+0000', 'last_clean': '2024-04-25T08:53:41.174011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:41.193951+0000', 'last_undegraded': '2024-04-25T08:53:41.193951+0000', 'last_fullsized': '2024-04-25T08:53:41.193951+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:53:46.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-25T08:53:46.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:53:42.183932+0000', 'last_change': '2024-04-25T08:53:42.183932+0000', 'last_active': '2024-04-25T08:53:42.183932+0000', 'last_peered': '2024-04-25T08:53:42.183932+0000', 'last_clean': '2024-04-25T08:53:42.183932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:42.183932+0000', 'last_undegraded': '2024-04-25T08:53:42.183932+0000', 'last_fullsized': '2024-04-25T08:53:42.183932+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:42.183932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:53:46.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-04-25T08:53:46.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:53:41.193905+0000', 'last_change': '2024-04-25T08:53:41.193905+0000', 'last_active': '2024-04-25T08:53:41.174011+0000', 'last_peered': '2024-04-25T08:53:41.174011+0000', 'last_clean': '2024-04-25T08:53:41.174011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:41.193905+0000', 'last_undegraded': '2024-04-25T08:53:41.193905+0000', 'last_fullsized': '2024-04-25T08:53:41.193905+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:53:46.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-04-25T08:53:46.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:53:41.193599+0000', 'last_change': '2024-04-25T08:53:41.193599+0000', 'last_active': '2024-04-25T08:53:41.174011+0000', 'last_peered': '2024-04-25T08:53:41.174011+0000', 'last_clean': '2024-04-25T08:53:41.174011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:41.193599+0000', 'last_undegraded': '2024-04-25T08:53:41.193599+0000', 'last_fullsized': '2024-04-25T08:53:41.193599+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:53:46.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-04-25T08:53:46.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:53:41.195506+0000', 'last_change': '2024-04-25T08:53:41.195506+0000', 'last_active': '2024-04-25T08:53:41.174011+0000', 'last_peered': '2024-04-25T08:53:41.174011+0000', 'last_clean': '2024-04-25T08:53:41.174011+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:53:41.195506+0000', 'last_undegraded': '2024-04-25T08:53:41.195506+0000', 'last_fullsized': '2024-04-25T08:53:41.195506+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'last_clean_scrub_stamp': '2024-04-25T08:53:41.174011+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:53:46.912 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:53:46.992 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T08:53:47.003+0000 7f5e677b4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:53:47.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.056+0000 7f0754b0a640 1 Processor -- start 2024-04-25T08:53:47.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.057+0000 7f0754b0a640 1 -- start start 2024-04-25T08:53:47.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.057+0000 7f0754b0a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f07500b5b60 0x7f07501687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.057+0000 7f0754b0a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075015e0c0 con 0x7f075015dce0 2024-04-25T08:53:47.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.057+0000 7f0754b0a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07500d2510 con 0x7f07500d35b0 2024-04-25T08:53:47.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.057+0000 7f0754b0a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07500b7b10 con 0x7f07500b5b60 2024-04-25T08:53:47.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.057+0000 7f074e59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f075015dce0 0x7f07500d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56872/0 (socket says 172.21.15.55:56872) 2024-04-25T08:53:47.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.057+0000 7f074e59c640 1 -- 172.21.15.55:0/3360547842 learned_addr learned my addr 172.21.15.55:0/3360547842 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:47.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074ed9d640 1 --2- 172.21.15.55:0/3360547842 >> v2:172.21.15.167:3300/0 conn(0x7f07500b5b60 0x7f07501687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172385038 0 0) 0x7f075015e0c0 con 0x7f075015dce0 2024-04-25T08:53:47.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f073c003520 con 0x7f075015dce0 2024-04-25T08:53:47.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3950354774 0 0) 0x7f073c003520 con 0x7f075015dce0 2024-04-25T08:53:47.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 >> v2:172.21.15.167:3300/0 conn(0x7f07500b5b60 msgr2=0x7f07501687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 --2- 172.21.15.55:0/3360547842 >> v2:172.21.15.167:3300/0 conn(0x7f07500b5b60 0x7f07501687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 >> v1:172.21.15.167:6789/0 conn(0x7f07500d35b0 legacy=0x7f07500b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500d27f0 con 0x7f075015dce0 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f0740001670 con 0x7f075015dce0 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 >> v1:172.21.15.55:6789/0 conn(0x7f075015dce0 legacy=0x7f07500d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 --2- 172.21.15.55:0/3360547842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073c0039b0 0x7f073c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 --2- 172.21.15.55:0/3360547842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f073c004800 0x7f073c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 --2- 172.21.15.55:0/3360547842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f073c0051c0 0x7f073c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07500b7b10 con 0x7f073c0039b0 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c00c060 con 0x7f073c004800 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c00c260 con 0x7f073c0051c0 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074e59c640 1 --2- 172.21.15.55:0/3360547842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073c0039b0 0x7f073c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f0747fff640 1 --2- 172.21.15.55:0/3360547842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f073c004800 0x7f073c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074ed9d640 1 --2- 172.21.15.55:0/3360547842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f073c0051c0 0x7f073c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074e59c640 1 -- 172.21.15.55:0/3360547842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f073c0051c0 msgr2=0x7f073c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074e59c640 1 --2- 172.21.15.55:0/3360547842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f073c0051c0 0x7f073c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074e59c640 1 -- 172.21.15.55:0/3360547842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f073c004800 msgr2=0x7f073c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074e59c640 1 --2- 172.21.15.55:0/3360547842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f073c004800 0x7f073c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.058+0000 7f074ed9d640 1 -- 172.21.15.55:0/3360547842 reap_dead start 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.059+0000 7f074e59c640 1 -- 172.21.15.55:0/3360547842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c003520 con 0x7f073c0039b0 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.059+0000 7f074e59c640 1 --2- 172.21.15.55:0/3360547842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073c0039b0 0x7f073c003dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f074000c240 tx=0x7f073c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8075d50cee174a6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.059+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0740007d10 con 0x7f073c0039b0 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.059+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07400058d0 con 0x7f073c0039b0 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.059+0000 7f074dd9b640 1 -- 172.21.15.55:0/3360547842 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0740005d40 con 0x7f073c0039b0 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.060+0000 7f0754b0a640 1 -- 172.21.15.55:0/3360547842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073c0039b0 msgr2=0x7f073c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.060+0000 7f0754b0a640 1 --2- 172.21.15.55:0/3360547842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073c0039b0 0x7f073c003dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f074000c240 tx=0x7f073c005830 comp rx=0 tx=0).stop 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.060+0000 7f0754b0a640 1 -- 172.21.15.55:0/3360547842 shutdown_connections 2024-04-25T08:53:47.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.060+0000 7f0754b0a640 1 --2- 172.21.15.55:0/3360547842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073c0039b0 0x7f073c003dd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.060+0000 7f0754b0a640 1 -- 172.21.15.55:0/3360547842 >> 172.21.15.55:0/3360547842 conn(0x7f0750072900 msgr2=0x7f07500d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:47.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.060+0000 7f0754b0a640 1 -- 172.21.15.55:0/3360547842 shutdown_connections 2024-04-25T08:53:47.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.060+0000 7f0754b0a640 1 -- 172.21.15.55:0/3360547842 wait complete. 2024-04-25T08:53:47.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.061+0000 7f0754b0a640 1 Processor -- start 2024-04-25T08:53:47.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.061+0000 7f0754b0a640 1 -- start start 2024-04-25T08:53:47.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.062+0000 7f0754b0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f073c0039b0 0x7f0750160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.062+0000 7f0754b0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07500c9a50 0x7f075015be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.062+0000 7f0754b0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075015c350 0x7f07500cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.062+0000 7f0754b0a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07500d3090 con 0x7f075015c350 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.062+0000 7f0754b0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07500d2db0 con 0x7f07500c9a50 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.062+0000 7f0754b0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07500b9820 con 0x7f073c0039b0 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.062+0000 7f074ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075015c350 0x7f07500cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.062+0000 7f074ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075015c350 0x7f07500cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42238/0 (socket says 172.21.15.55:42238) 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.062+0000 7f074ed9d640 1 -- 172.21.15.55:0/2390852241 learned_addr learned my addr 172.21.15.55:0/2390852241 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.062+0000 7f074e59c640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f073c0039b0 0x7f0750160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.062+0000 7f0747fff640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07500c9a50 0x7f075015be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f074ed9d640 1 -- 172.21.15.55:0/2390852241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f073c0039b0 msgr2=0x7f0750160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f074ed9d640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f073c0039b0 0x7f0750160ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f074ed9d640 1 -- 172.21.15.55:0/2390852241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07500c9a50 msgr2=0x7f075015be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f074ed9d640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07500c9a50 0x7f075015be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f074ed9d640 1 -- 172.21.15.55:0/2390852241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07501466c0 con 0x7f075015c350 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f0747fff640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07500c9a50 0x7f075015be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f074e59c640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f073c0039b0 0x7f0750160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f074ed9d640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075015c350 0x7f07500cbaf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0750161710 tx=0x7f074800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f0746ffd640 1 -- 172.21.15.55:0/2390852241 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800fc80 con 0x7f075015c350 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f0746ffd640 1 -- 172.21.15.55:0/2390852241 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074800fe20 con 0x7f075015c350 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f0754b0a640 1 -- 172.21.15.55:0/2390852241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075015e2f0 con 0x7f075015c350 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f0746ffd640 1 -- 172.21.15.55:0/2390852241 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748015670 con 0x7f075015c350 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.063+0000 7f0754b0a640 1 -- 172.21.15.55:0/2390852241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075015e8b0 con 0x7f075015c350 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.064+0000 7f0754b0a640 1 -- 172.21.15.55:0/2390852241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07500749b0 con 0x7f075015c350 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.064+0000 7f0746ffd640 1 -- 172.21.15.55:0/2390852241 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0748015810 con 0x7f075015c350 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.065+0000 7f0746ffd640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f073006b4d0 0x7f073006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.065+0000 7f0746ffd640 1 -- 172.21.15.55:0/2390852241 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f074808aec0 con 0x7f075015c350 2024-04-25T08:53:47.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.065+0000 7f074e59c640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f073006b4d0 0x7f073006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.065+0000 7f074e59c640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f073006b4d0 0x7f073006d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0740033000 tx=0x7f0740035040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:47.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.069+0000 7f0746ffd640 1 -- 172.21.15.55:0/2390852241 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0748019030 con 0x7f075015c350 2024-04-25T08:53:47.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.320+0000 7f0754b0a640 1 -- 172.21.15.55:0/2390852241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f07500b9460 con 0x7f075015c350 2024-04-25T08:53:47.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.320+0000 7f0746ffd640 1 -- 172.21.15.55:0/2390852241 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1173 (secure 0 0 0) 0x7f0748010040 con 0x7f075015c350 2024-04-25T08:53:47.310 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:47.310 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035209,"num_in_osds":8,"osd_in_since":1714035200,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"unknown","count":6},{"state_name":"creating+peering","count":6}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592618,"bytes_used":241426432,"bytes_avail":772852686848,"bytes_total":773094113280,"unknown_pgs_ratio":0.061855670064687729,"inactive_pgs_ratio":0.061855670064687729,"write_bytes_sec":2291,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4284}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-25T08:53:18.266611+0000","services":{}},"progress_events":{}} 2024-04-25T08:53:47.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 -- 172.21.15.55:0/2390852241 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f073006b4d0 msgr2=0x7f073006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f073006b4d0 0x7f073006d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0740033000 tx=0x7f0740035040 comp rx=0 tx=0).stop 2024-04-25T08:53:47.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 -- 172.21.15.55:0/2390852241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075015c350 msgr2=0x7f07500cbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075015c350 0x7f07500cbaf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0750161710 tx=0x7f074800f1b0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 -- 172.21.15.55:0/2390852241 shutdown_connections 2024-04-25T08:53:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f073006b4d0 0x7f073006d990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075015c350 0x7f07500cbaf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07500c9a50 0x7f075015be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 --2- 172.21.15.55:0/2390852241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f073c0039b0 0x7f0750160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 -- 172.21.15.55:0/2390852241 >> 172.21.15.55:0/2390852241 conn(0x7f0750072900 msgr2=0x7f07500d3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 -- 172.21.15.55:0/2390852241 shutdown_connections 2024-04-25T08:53:47.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.322+0000 7f0754b0a640 1 -- 172.21.15.55:0/2390852241 wait complete. 2024-04-25T08:53:47.323 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:53:47.323 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:53:47.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.434+0000 7fbcaaa9a640 1 Processor -- start 2024-04-25T08:53:47.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.434+0000 7fbcaaa9a640 1 -- start start 2024-04-25T08:53:47.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.435+0000 7fbcaaa9a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbca415dce0 0x7fbca40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.435+0000 7fbcaaa9a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbca40d35b0 0x7fbca40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.435+0000 7fbcaaa9a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca415e0c0 con 0x7fbca40d1f90 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.435+0000 7fbcaaa9a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca40b7b10 con 0x7fbca40d35b0 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.435+0000 7fbcaaa9a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40d2510 con 0x7fbca415dce0 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.435+0000 7fbca3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbca40d35b0 0x7fbca40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.435+0000 7fbca9037640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbca40d1f90 0x7fbca406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56884/0 (socket says 172.21.15.55:56884) 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.435+0000 7fbca9037640 1 -- 172.21.15.55:0/2332213730 learned_addr learned my addr 172.21.15.55:0/2332213730 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.436+0000 7fbca8836640 1 --2- 172.21.15.55:0/2332213730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbca415dce0 0x7fbca40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.436+0000 7fbca3fff640 1 -- 172.21.15.55:0/2332213730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbca415dce0 msgr2=0x7fbca40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.436+0000 7fbca3fff640 1 --2- 172.21.15.55:0/2332213730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbca415dce0 0x7fbca40d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.436+0000 7fbca3fff640 1 -- 172.21.15.55:0/2332213730 >> v1:172.21.15.55:6789/0 conn(0x7fbca40d1f90 legacy=0x7fbca406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.436+0000 7fbca3fff640 1 -- 172.21.15.55:0/2332213730 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca40d27f0 con 0x7fbca40d35b0 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.436+0000 7fbca3fff640 1 --2- 172.21.15.55:0/2332213730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbca40d35b0 0x7fbca40b5450 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbc940097a0 tx=0x7fbc9402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9a942fc886ea16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.436+0000 7fbca37fe640 1 -- 172.21.15.55:0/2332213730 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94037070 con 0x7fbca40d35b0 2024-04-25T08:53:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.436+0000 7fbca37fe640 1 -- 172.21.15.55:0/2332213730 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9402ae50 con 0x7fbca40d35b0 2024-04-25T08:53:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.436+0000 7fbca37fe640 1 -- 172.21.15.55:0/2332213730 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94032660 con 0x7fbca40d35b0 2024-04-25T08:53:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.437+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2332213730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbca40d35b0 msgr2=0x7fbca40b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.437+0000 7fbcaaa9a640 1 --2- 172.21.15.55:0/2332213730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbca40d35b0 0x7fbca40b5450 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbc940097a0 tx=0x7fbc9402a100 comp rx=0 tx=0).stop 2024-04-25T08:53:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.437+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2332213730 shutdown_connections 2024-04-25T08:53:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.437+0000 7fbcaaa9a640 1 --2- 172.21.15.55:0/2332213730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbca40d35b0 0x7fbca40b5450 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.437+0000 7fbcaaa9a640 1 --2- 172.21.15.55:0/2332213730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbca415dce0 0x7fbca40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.437+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2332213730 >> 172.21.15.55:0/2332213730 conn(0x7fbca4072900 msgr2=0x7fbca40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.437+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2332213730 shutdown_connections 2024-04-25T08:53:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.437+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2332213730 wait complete. 2024-04-25T08:53:47.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.438+0000 7fbcaaa9a640 1 Processor -- start 2024-04-25T08:53:47.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.438+0000 7fbcaaa9a640 1 -- start start 2024-04-25T08:53:47.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbcaaa9a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbca40d1f90 0x7fbca4160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbcaaa9a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbca40d35b0 0x7fbca415e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbcaaa9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbca415dce0 0x7fbca41527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbcaaa9a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40d3090 con 0x7fbca40d35b0 2024-04-25T08:53:47.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbcaaa9a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40d2db0 con 0x7fbca415dce0 2024-04-25T08:53:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbcaaa9a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40b9820 con 0x7fbca40d1f90 2024-04-25T08:53:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbca3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbca40d35b0 0x7fbca415e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbca3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbca40d35b0 0x7fbca415e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42258/0 (socket says 172.21.15.55:42258) 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbca3fff640 1 -- 172.21.15.55:0/2852453169 learned_addr learned my addr 172.21.15.55:0/2852453169 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbca9037640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbca415dce0 0x7fbca41527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbca8836640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbca40d1f90 0x7fbca4160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbca3fff640 1 -- 172.21.15.55:0/2852453169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbca40d1f90 msgr2=0x7fbca4160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbca3fff640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbca40d1f90 0x7fbca4160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbca3fff640 1 -- 172.21.15.55:0/2852453169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbca415dce0 msgr2=0x7fbca41527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.439+0000 7fbca3fff640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbca415dce0 0x7fbca41527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.440+0000 7fbca3fff640 1 -- 172.21.15.55:0/2852453169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4161270 con 0x7fbca40d35b0 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.440+0000 7fbca9037640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbca415dce0 0x7fbca41527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.440+0000 7fbca8836640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbca40d1f90 0x7fbca4160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.440+0000 7fbca3fff640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbca40d35b0 0x7fbca415e650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbc94035040 tx=0x7fbc940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.440+0000 7fbca17fa640 1 -- 172.21.15.55:0/2852453169 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94041070 con 0x7fbca40d35b0 2024-04-25T08:53:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.440+0000 7fbca17fa640 1 -- 172.21.15.55:0/2852453169 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9403c670 con 0x7fbca40d35b0 2024-04-25T08:53:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.440+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2852453169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca4153eb0 con 0x7fbca40d35b0 2024-04-25T08:53:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.440+0000 7fbca17fa640 1 -- 172.21.15.55:0/2852453169 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94037040 con 0x7fbca40d35b0 2024-04-25T08:53:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.440+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2852453169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca4152ce0 con 0x7fbca40d35b0 2024-04-25T08:53:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.441+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2852453169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca40749b0 con 0x7fbca40d35b0 2024-04-25T08:53:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.441+0000 7fbca17fa640 1 -- 172.21.15.55:0/2852453169 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbc9403a070 con 0x7fbca40d35b0 2024-04-25T08:53:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.442+0000 7fbca17fa640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc8406b4d0 0x7fbc8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.442+0000 7fbca17fa640 1 -- 172.21.15.55:0/2852453169 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc940aa2d0 con 0x7fbca40d35b0 2024-04-25T08:53:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.442+0000 7fbca8836640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc8406b4d0 0x7fbc8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.442+0000 7fbca8836640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc8406b4d0 0x7fbc8406d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c007330 tx=0x7fbc9c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:47.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.446+0000 7fbca17fa640 1 -- 172.21.15.55:0/2852453169 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc940791e0 con 0x7fbca40d35b0 2024-04-25T08:53:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.623+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2852453169 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbca40d1580 con 0x7fbc8406b4d0 2024-04-25T08:53:47.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.629+0000 7fbca17fa640 1 -- 172.21.15.55:0/2852453169 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250519 (secure 0 0 0) 0x7fbc9c0582b0 con 0x7fbc8406b4d0 2024-04-25T08:53:47.622 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:53:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2852453169 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc8406b4d0 msgr2=0x7fbc8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc8406b4d0 0x7fbc8406d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c007330 tx=0x7fbc9c00b040 comp rx=0 tx=0).stop 2024-04-25T08:53:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2852453169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbca40d35b0 msgr2=0x7fbca415e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbca40d35b0 0x7fbca415e650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbc94035040 tx=0x7fbc940046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2852453169 shutdown_connections 2024-04-25T08:53:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc8406b4d0 0x7fbc8406d990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbca415dce0 0x7fbca41527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbca40d35b0 0x7fbca415e650 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 --2- 172.21.15.55:0/2852453169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbca40d1f90 0x7fbca4160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:47.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2852453169 >> 172.21.15.55:0/2852453169 conn(0x7fbca4072900 msgr2=0x7fbca40b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:47.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2852453169 shutdown_connections 2024-04-25T08:53:47.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:47.632+0000 7fbcaaa9a640 1 -- 172.21.15.55:0/2852453169 wait complete. 2024-04-25T08:53:47.633 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-25T08:53:46.552231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235768,"kb_used_data":2944,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738952,"statfs":{"total":773094113280,"available":772852686848,"internally_reserved":0,"allocated":3014656,"data_stored":1784426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.363209"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458904+0000","last_change":"2024-04-25T08:53:43.226040+0000","last_active":"2024-04-25T08:53:44.458904+0000","last_peered":"2024-04-25T08:53:44.458904+0000","last_clean":"2024-04-25T08:53:44.458904+0000","last_became_active":"2024-04-25T08:53:43.225773+0000","last_became_peered":"2024-04-25T08:53:43.225773+0000","last_unstale":"2024-04-25T08:53:44.458904+0000","last_undegraded":"2024-04-25T08:53:44.458904+0000","last_fullsized":"2024-04-25T08:53:44.458904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:25.482497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.225595+0000","last_change":"2024-04-25T08:53:43.222988+0000","last_active":"2024-04-25T08:53:43.225595+0000","last_peered":"2024-04-25T08:53:43.225595+0000","last_clean":"2024-04-25T08:53:43.225595+0000","last_became_active":"2024-04-25T08:53:43.222683+0000","last_became_peered":"2024-04-25T08:53:43.222683+0000","last_unstale":"2024-04-25T08:53:43.225595+0000","last_undegraded":"2024-04-25T08:53:43.225595+0000","last_fullsized":"2024-04-25T08:53:43.225595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:36.391147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336369+0000","last_change":"2024-04-25T08:53:43.227764+0000","last_active":"2024-04-25T08:53:44.336369+0000","last_peered":"2024-04-25T08:53:44.336369+0000","last_clean":"2024-04-25T08:53:44.336369+0000","last_became_active":"2024-04-25T08:53:43.227462+0000","last_became_peered":"2024-04-25T08:53:43.227462+0000","last_unstale":"2024-04-25T08:53:44.336369+0000","last_undegraded":"2024-04-25T08:53:44.336369+0000","last_fullsized":"2024-04-25T08:53:44.336369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458562+0000","last_change":"2024-04-25T08:53:43.222336+0000","last_active":"2024-04-25T08:53:44.458562+0000","last_peered":"2024-04-25T08:53:44.458562+0000","last_clean":"2024-04-25T08:53:44.458562+0000","last_became_active":"2024-04-25T08:53:43.222046+0000","last_became_peered":"2024-04-25T08:53:43.222046+0000","last_unstale":"2024-04-25T08:53:44.458562+0000","last_undegraded":"2024-04-25T08:53:44.458562+0000","last_fullsized":"2024-04-25T08:53:44.458562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336385+0000","last_change":"2024-04-25T08:53:43.226820+0000","last_active":"2024-04-25T08:53:44.336385+0000","last_peered":"2024-04-25T08:53:44.336385+0000","last_clean":"2024-04-25T08:53:44.336385+0000","last_became_active":"2024-04-25T08:53:43.226533+0000","last_became_peered":"2024-04-25T08:53:43.226533+0000","last_unstale":"2024-04-25T08:53:44.336385+0000","last_undegraded":"2024-04-25T08:53:44.336385+0000","last_fullsized":"2024-04-25T08:53:44.336385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:59.064691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458308+0000","last_change":"2024-04-25T08:53:43.226661+0000","last_active":"2024-04-25T08:53:44.458308+0000","last_peered":"2024-04-25T08:53:44.458308+0000","last_clean":"2024-04-25T08:53:44.458308+0000","last_became_active":"2024-04-25T08:53:43.226353+0000","last_became_peered":"2024-04-25T08:53:43.226353+0000","last_unstale":"2024-04-25T08:53:44.458308+0000","last_undegraded":"2024-04-25T08:53:44.458308+0000","last_fullsized":"2024-04-25T08:53:44.458308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209304+0000","last_change":"2024-04-25T08:53:43.217719+0000","last_active":"2024-04-25T08:53:44.209304+0000","last_peered":"2024-04-25T08:53:44.209304+0000","last_clean":"2024-04-25T08:53:44.209304+0000","last_became_active":"2024-04-25T08:53:43.217440+0000","last_became_peered":"2024-04-25T08:53:43.217440+0000","last_unstale":"2024-04-25T08:53:44.209304+0000","last_undegraded":"2024-04-25T08:53:44.209304+0000","last_fullsized":"2024-04-25T08:53:44.209304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458926+0000","last_change":"2024-04-25T08:53:43.219775+0000","last_active":"2024-04-25T08:53:44.458926+0000","last_peered":"2024-04-25T08:53:44.458926+0000","last_clean":"2024-04-25T08:53:44.458926+0000","last_became_active":"2024-04-25T08:53:43.219463+0000","last_became_peered":"2024-04-25T08:53:43.219463+0000","last_unstale":"2024-04-25T08:53:44.458926+0000","last_undegraded":"2024-04-25T08:53:44.458926+0000","last_fullsized":"2024-04-25T08:53:44.458926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.064857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214552+0000","last_change":"2024-04-25T08:53:43.216899+0000","last_active":"2024-04-25T08:53:44.214552+0000","last_peered":"2024-04-25T08:53:44.214552+0000","last_clean":"2024-04-25T08:53:44.214552+0000","last_became_active":"2024-04-25T08:53:43.216571+0000","last_became_peered":"2024-04-25T08:53:43.216571+0000","last_unstale":"2024-04-25T08:53:44.214552+0000","last_undegraded":"2024-04-25T08:53:44.214552+0000","last_fullsized":"2024-04-25T08:53:44.214552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214373+0000","last_change":"2024-04-25T08:53:43.220978+0000","last_active":"2024-04-25T08:53:44.214373+0000","last_peered":"2024-04-25T08:53:44.214373+0000","last_clean":"2024-04-25T08:53:44.214373+0000","last_became_active":"2024-04-25T08:53:43.219635+0000","last_became_peered":"2024-04-25T08:53:43.219635+0000","last_unstale":"2024-04-25T08:53:44.214373+0000","last_undegraded":"2024-04-25T08:53:44.214373+0000","last_fullsized":"2024-04-25T08:53:44.214373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215612+0000","last_change":"2024-04-25T08:53:43.224429+0000","last_active":"2024-04-25T08:53:44.215612+0000","last_peered":"2024-04-25T08:53:44.215612+0000","last_clean":"2024-04-25T08:53:44.215612+0000","last_became_active":"2024-04-25T08:53:43.224174+0000","last_became_peered":"2024-04-25T08:53:43.224174+0000","last_unstale":"2024-04-25T08:53:44.215612+0000","last_undegraded":"2024-04-25T08:53:44.215612+0000","last_fullsized":"2024-04-25T08:53:44.215612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:46.648651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209560+0000","last_change":"2024-04-25T08:53:43.216375+0000","last_active":"2024-04-25T08:53:44.209560+0000","last_peered":"2024-04-25T08:53:44.209560+0000","last_clean":"2024-04-25T08:53:44.209560+0000","last_became_active":"2024-04-25T08:53:43.216099+0000","last_became_peered":"2024-04-25T08:53:43.216099+0000","last_unstale":"2024-04-25T08:53:44.209560+0000","last_undegraded":"2024-04-25T08:53:44.209560+0000","last_fullsized":"2024-04-25T08:53:44.209560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.225593+0000","last_change":"2024-04-25T08:53:43.223032+0000","last_active":"2024-04-25T08:53:43.225593+0000","last_peered":"2024-04-25T08:53:43.225593+0000","last_clean":"2024-04-25T08:53:43.225593+0000","last_became_active":"2024-04-25T08:53:43.222624+0000","last_became_peered":"2024-04-25T08:53:43.222624+0000","last_unstale":"2024-04-25T08:53:43.225593+0000","last_undegraded":"2024-04-25T08:53:43.225593+0000","last_fullsized":"2024-04-25T08:53:43.225593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:04.077055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.335931+0000","last_change":"2024-04-25T08:53:43.228001+0000","last_active":"2024-04-25T08:53:44.335931+0000","last_peered":"2024-04-25T08:53:44.335931+0000","last_clean":"2024-04-25T08:53:44.335931+0000","last_became_active":"2024-04-25T08:53:43.227703+0000","last_became_peered":"2024-04-25T08:53:43.227703+0000","last_unstale":"2024-04-25T08:53:44.335931+0000","last_undegraded":"2024-04-25T08:53:44.335931+0000","last_fullsized":"2024-04-25T08:53:44.335931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336584+0000","last_change":"2024-04-25T08:53:43.226726+0000","last_active":"2024-04-25T08:53:44.336584+0000","last_peered":"2024-04-25T08:53:44.336584+0000","last_clean":"2024-04-25T08:53:44.336584+0000","last_became_active":"2024-04-25T08:53:43.226448+0000","last_became_peered":"2024-04-25T08:53:43.226448+0000","last_unstale":"2024-04-25T08:53:44.336584+0000","last_undegraded":"2024-04-25T08:53:44.336584+0000","last_fullsized":"2024-04-25T08:53:44.336584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.064857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.219560+0000","last_change":"2024-04-25T08:53:43.216437+0000","last_active":"2024-04-25T08:53:43.219560+0000","last_peered":"2024-04-25T08:53:43.219560+0000","last_clean":"2024-04-25T08:53:43.219560+0000","last_became_active":"2024-04-25T08:53:43.216118+0000","last_became_peered":"2024-04-25T08:53:43.216118+0000","last_unstale":"2024-04-25T08:53:43.219560+0000","last_undegraded":"2024-04-25T08:53:43.219560+0000","last_fullsized":"2024-04-25T08:53:43.219560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:33.206100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458878+0000","last_change":"2024-04-25T08:53:43.222245+0000","last_active":"2024-04-25T08:53:44.458878+0000","last_peered":"2024-04-25T08:53:44.458878+0000","last_clean":"2024-04-25T08:53:44.458878+0000","last_became_active":"2024-04-25T08:53:43.221954+0000","last_became_peered":"2024-04-25T08:53:43.221954+0000","last_unstale":"2024-04-25T08:53:44.458878+0000","last_undegraded":"2024-04-25T08:53:44.458878+0000","last_fullsized":"2024-04-25T08:53:44.458878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:46.272432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214280+0000","last_change":"2024-04-25T08:53:43.208966+0000","last_active":"2024-04-25T08:53:44.214280+0000","last_peered":"2024-04-25T08:53:44.214280+0000","last_clean":"2024-04-25T08:53:44.214280+0000","last_became_active":"2024-04-25T08:53:43.208694+0000","last_became_peered":"2024-04-25T08:53:43.208694+0000","last_unstale":"2024-04-25T08:53:44.214280+0000","last_undegraded":"2024-04-25T08:53:44.214280+0000","last_fullsized":"2024-04-25T08:53:44.214280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.230314+0000","last_change":"2024-04-25T08:53:43.227774+0000","last_active":"2024-04-25T08:53:43.230314+0000","last_peered":"2024-04-25T08:53:43.230314+0000","last_clean":"2024-04-25T08:53:43.230314+0000","last_became_active":"2024-04-25T08:53:43.227471+0000","last_became_peered":"2024-04-25T08:53:43.227471+0000","last_unstale":"2024-04-25T08:53:43.230314+0000","last_undegraded":"2024-04-25T08:53:43.230314+0000","last_fullsized":"2024-04-25T08:53:43.230314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:56.649442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336129+0000","last_change":"2024-04-25T08:53:43.225757+0000","last_active":"2024-04-25T08:53:44.336129+0000","last_peered":"2024-04-25T08:53:44.336129+0000","last_clean":"2024-04-25T08:53:44.336129+0000","last_became_active":"2024-04-25T08:53:43.225482+0000","last_became_peered":"2024-04-25T08:53:43.225482+0000","last_unstale":"2024-04-25T08:53:44.336129+0000","last_undegraded":"2024-04-25T08:53:44.336129+0000","last_fullsized":"2024-04-25T08:53:44.336129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209673+0000","last_change":"2024-04-25T08:53:43.213773+0000","last_active":"2024-04-25T08:53:44.209673+0000","last_peered":"2024-04-25T08:53:44.209673+0000","last_clean":"2024-04-25T08:53:44.209673+0000","last_became_active":"2024-04-25T08:53:43.211924+0000","last_became_peered":"2024-04-25T08:53:43.211924+0000","last_unstale":"2024-04-25T08:53:44.209673+0000","last_undegraded":"2024-04-25T08:53:44.209673+0000","last_fullsized":"2024-04-25T08:53:44.209673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336156+0000","last_change":"2024-04-25T08:53:43.221087+0000","last_active":"2024-04-25T08:53:44.336156+0000","last_peered":"2024-04-25T08:53:44.336156+0000","last_clean":"2024-04-25T08:53:44.336156+0000","last_became_active":"2024-04-25T08:53:43.219503+0000","last_became_peered":"2024-04-25T08:53:43.219503+0000","last_unstale":"2024-04-25T08:53:44.336156+0000","last_undegraded":"2024-04-25T08:53:44.336156+0000","last_fullsized":"2024-04-25T08:53:44.336156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209695+0000","last_change":"2024-04-25T08:53:43.215393+0000","last_active":"2024-04-25T08:53:44.209695+0000","last_peered":"2024-04-25T08:53:44.209695+0000","last_clean":"2024-04-25T08:53:44.209695+0000","last_became_active":"2024-04-25T08:53:43.214671+0000","last_became_peered":"2024-04-25T08:53:43.214671+0000","last_unstale":"2024-04-25T08:53:44.209695+0000","last_undegraded":"2024-04-25T08:53:44.209695+0000","last_fullsized":"2024-04-25T08:53:44.209695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214588+0000","last_change":"2024-04-25T08:53:43.218493+0000","last_active":"2024-04-25T08:53:44.214588+0000","last_peered":"2024-04-25T08:53:44.214588+0000","last_clean":"2024-04-25T08:53:44.214588+0000","last_became_active":"2024-04-25T08:53:43.218199+0000","last_became_peered":"2024-04-25T08:53:43.218199+0000","last_unstale":"2024-04-25T08:53:44.214588+0000","last_undegraded":"2024-04-25T08:53:44.214588+0000","last_fullsized":"2024-04-25T08:53:44.214588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209813+0000","last_change":"2024-04-25T08:53:43.214059+0000","last_active":"2024-04-25T08:53:44.209813+0000","last_peered":"2024-04-25T08:53:44.209813+0000","last_clean":"2024-04-25T08:53:44.209813+0000","last_became_active":"2024-04-25T08:53:43.211412+0000","last_became_peered":"2024-04-25T08:53:43.211412+0000","last_unstale":"2024-04-25T08:53:44.209813+0000","last_undegraded":"2024-04-25T08:53:44.209813+0000","last_fullsized":"2024-04-25T08:53:44.209813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.226206+0000","last_change":"2024-04-25T08:53:43.224899+0000","last_active":"2024-04-25T08:53:43.226206+0000","last_peered":"2024-04-25T08:53:43.226206+0000","last_clean":"2024-04-25T08:53:43.226206+0000","last_became_active":"2024-04-25T08:53:43.224532+0000","last_became_peered":"2024-04-25T08:53:43.224532+0000","last_unstale":"2024-04-25T08:53:43.226206+0000","last_undegraded":"2024-04-25T08:53:43.226206+0000","last_fullsized":"2024-04-25T08:53:43.226206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:46.648651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336482+0000","last_change":"2024-04-25T08:53:43.225133+0000","last_active":"2024-04-25T08:53:44.336482+0000","last_peered":"2024-04-25T08:53:44.336482+0000","last_clean":"2024-04-25T08:53:44.336482+0000","last_became_active":"2024-04-25T08:53:43.224687+0000","last_became_peered":"2024-04-25T08:53:43.224687+0000","last_unstale":"2024-04-25T08:53:44.336482+0000","last_undegraded":"2024-04-25T08:53:44.336482+0000","last_fullsized":"2024-04-25T08:53:44.336482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:46.272432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.219651+0000","last_change":"2024-04-25T08:53:43.215307+0000","last_active":"2024-04-25T08:53:43.219651+0000","last_peered":"2024-04-25T08:53:43.219651+0000","last_clean":"2024-04-25T08:53:43.219651+0000","last_became_active":"2024-04-25T08:53:43.215014+0000","last_became_peered":"2024-04-25T08:53:43.215014+0000","last_unstale":"2024-04-25T08:53:43.219651+0000","last_undegraded":"2024-04-25T08:53:43.219651+0000","last_fullsized":"2024-04-25T08:53:43.219651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:04.077055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214040+0000","last_change":"2024-04-25T08:53:43.226428+0000","last_active":"2024-04-25T08:53:44.214040+0000","last_peered":"2024-04-25T08:53:44.214040+0000","last_clean":"2024-04-25T08:53:44.214040+0000","last_became_active":"2024-04-25T08:53:43.225678+0000","last_became_peered":"2024-04-25T08:53:43.225678+0000","last_unstale":"2024-04-25T08:53:44.214040+0000","last_undegraded":"2024-04-25T08:53:44.214040+0000","last_fullsized":"2024-04-25T08:53:44.214040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215161+0000","last_change":"2024-04-25T08:53:43.210436+0000","last_active":"2024-04-25T08:53:44.215161+0000","last_peered":"2024-04-25T08:53:44.215161+0000","last_clean":"2024-04-25T08:53:44.215161+0000","last_became_active":"2024-04-25T08:53:43.210150+0000","last_became_peered":"2024-04-25T08:53:43.210150+0000","last_unstale":"2024-04-25T08:53:44.215161+0000","last_undegraded":"2024-04-25T08:53:44.215161+0000","last_fullsized":"2024-04-25T08:53:44.215161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:36.391147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209779+0000","last_change":"2024-04-25T08:53:42.207162+0000","last_active":"2024-04-25T08:53:44.209779+0000","last_peered":"2024-04-25T08:53:44.209779+0000","last_clean":"2024-04-25T08:53:44.209779+0000","last_became_active":"2024-04-25T08:53:42.206827+0000","last_became_peered":"2024-04-25T08:53:42.206827+0000","last_unstale":"2024-04-25T08:53:44.209779+0000","last_undegraded":"2024-04-25T08:53:44.209779+0000","last_fullsized":"2024-04-25T08:53:44.209779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.222127+0000","last_change":"2024-04-25T08:53:43.219024+0000","last_active":"2024-04-25T08:53:43.222127+0000","last_peered":"2024-04-25T08:53:43.222127+0000","last_clean":"2024-04-25T08:53:43.222127+0000","last_became_active":"2024-04-25T08:53:43.218674+0000","last_became_peered":"2024-04-25T08:53:43.218674+0000","last_unstale":"2024-04-25T08:53:43.222127+0000","last_undegraded":"2024-04-25T08:53:43.222127+0000","last_fullsized":"2024-04-25T08:53:43.222127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:39.473137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214016+0000","last_change":"2024-04-25T08:53:42.202321+0000","last_active":"2024-04-25T08:53:44.214016+0000","last_peered":"2024-04-25T08:53:44.214016+0000","last_clean":"2024-04-25T08:53:44.214016+0000","last_became_active":"2024-04-25T08:53:42.202063+0000","last_became_peered":"2024-04-25T08:53:42.202063+0000","last_unstale":"2024-04-25T08:53:44.214016+0000","last_undegraded":"2024-04-25T08:53:44.214016+0000","last_fullsized":"2024-04-25T08:53:44.214016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209484+0000","last_change":"2024-04-25T08:53:42.210884+0000","last_active":"2024-04-25T08:53:44.209484+0000","last_peered":"2024-04-25T08:53:44.209484+0000","last_clean":"2024-04-25T08:53:44.209484+0000","last_became_active":"2024-04-25T08:53:42.210568+0000","last_became_peered":"2024-04-25T08:53:42.210568+0000","last_unstale":"2024-04-25T08:53:44.209484+0000","last_undegraded":"2024-04-25T08:53:44.209484+0000","last_fullsized":"2024-04-25T08:53:44.209484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:51.480879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209351+0000","last_change":"2024-04-25T08:53:43.225401+0000","last_active":"2024-04-25T08:53:44.209351+0000","last_peered":"2024-04-25T08:53:44.209351+0000","last_clean":"2024-04-25T08:53:44.209351+0000","last_became_active":"2024-04-25T08:53:43.224926+0000","last_became_peered":"2024-04-25T08:53:43.224926+0000","last_unstale":"2024-04-25T08:53:44.209351+0000","last_undegraded":"2024-04-25T08:53:44.209351+0000","last_fullsized":"2024-04-25T08:53:44.209351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336053+0000","last_change":"2024-04-25T08:53:42.201897+0000","last_active":"2024-04-25T08:53:44.336053+0000","last_peered":"2024-04-25T08:53:44.336053+0000","last_clean":"2024-04-25T08:53:44.336053+0000","last_became_active":"2024-04-25T08:53:42.201641+0000","last_became_peered":"2024-04-25T08:53:42.201641+0000","last_unstale":"2024-04-25T08:53:44.336053+0000","last_undegraded":"2024-04-25T08:53:44.336053+0000","last_fullsized":"2024-04-25T08:53:44.336053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214230+0000","last_change":"2024-04-25T08:53:42.209416+0000","last_active":"2024-04-25T08:53:44.214230+0000","last_peered":"2024-04-25T08:53:44.214230+0000","last_clean":"2024-04-25T08:53:44.214230+0000","last_became_active":"2024-04-25T08:53:42.209094+0000","last_became_peered":"2024-04-25T08:53:42.209094+0000","last_unstale":"2024-04-25T08:53:44.214230+0000","last_undegraded":"2024-04-25T08:53:44.214230+0000","last_fullsized":"2024-04-25T08:53:44.214230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336418+0000","last_change":"2024-04-25T08:53:43.221170+0000","last_active":"2024-04-25T08:53:44.336418+0000","last_peered":"2024-04-25T08:53:44.336418+0000","last_clean":"2024-04-25T08:53:44.336418+0000","last_became_active":"2024-04-25T08:53:43.220913+0000","last_became_peered":"2024-04-25T08:53:43.220913+0000","last_unstale":"2024-04-25T08:53:44.336418+0000","last_undegraded":"2024-04-25T08:53:44.336418+0000","last_fullsized":"2024-04-25T08:53:44.336418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:22.702870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336314+0000","last_change":"2024-04-25T08:53:42.209519+0000","last_active":"2024-04-25T08:53:44.336314+0000","last_peered":"2024-04-25T08:53:44.336314+0000","last_clean":"2024-04-25T08:53:44.336314+0000","last_became_active":"2024-04-25T08:53:42.209218+0000","last_became_peered":"2024-04-25T08:53:42.209218+0000","last_unstale":"2024-04-25T08:53:44.336314+0000","last_undegraded":"2024-04-25T08:53:44.336314+0000","last_fullsized":"2024-04-25T08:53:44.336314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.223692+0000","last_change":"2024-04-25T08:53:43.216391+0000","last_active":"2024-04-25T08:53:43.223692+0000","last_peered":"2024-04-25T08:53:43.223692+0000","last_clean":"2024-04-25T08:53:43.223692+0000","last_became_active":"2024-04-25T08:53:43.216117+0000","last_became_peered":"2024-04-25T08:53:43.216117+0000","last_unstale":"2024-04-25T08:53:43.223692+0000","last_undegraded":"2024-04-25T08:53:43.223692+0000","last_fullsized":"2024-04-25T08:53:43.223692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:02.604483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.194636+0000","last_change":"2024-04-25T08:53:41.194636+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.194636+0000","last_undegraded":"2024-04-25T08:53:41.194636+0000","last_fullsized":"2024-04-25T08:53:41.194636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215673+0000","last_change":"2024-04-25T08:53:43.222934+0000","last_active":"2024-04-25T08:53:44.215673+0000","last_peered":"2024-04-25T08:53:44.215673+0000","last_clean":"2024-04-25T08:53:44.215673+0000","last_became_active":"2024-04-25T08:53:43.222610+0000","last_became_peered":"2024-04-25T08:53:43.222610+0000","last_unstale":"2024-04-25T08:53:44.215673+0000","last_undegraded":"2024-04-25T08:53:44.215673+0000","last_fullsized":"2024-04-25T08:53:44.215673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:30.574790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214410+0000","last_change":"2024-04-25T08:53:42.205189+0000","last_active":"2024-04-25T08:53:44.214410+0000","last_peered":"2024-04-25T08:53:44.214410+0000","last_clean":"2024-04-25T08:53:44.214410+0000","last_became_active":"2024-04-25T08:53:42.204876+0000","last_became_peered":"2024-04-25T08:53:42.204876+0000","last_unstale":"2024-04-25T08:53:44.214410+0000","last_undegraded":"2024-04-25T08:53:44.214410+0000","last_fullsized":"2024-04-25T08:53:44.214410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458651+0000","last_change":"2024-04-25T08:53:43.229049+0000","last_active":"2024-04-25T08:53:44.458651+0000","last_peered":"2024-04-25T08:53:44.458651+0000","last_clean":"2024-04-25T08:53:44.458651+0000","last_became_active":"2024-04-25T08:53:43.228659+0000","last_became_peered":"2024-04-25T08:53:43.228659+0000","last_unstale":"2024-04-25T08:53:44.458651+0000","last_undegraded":"2024-04-25T08:53:44.458651+0000","last_fullsized":"2024-04-25T08:53:44.458651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:59.064691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.235081+0000","last_change":"2024-04-25T08:53:42.205092+0000","last_active":"2024-04-25T08:53:43.235081+0000","last_peered":"2024-04-25T08:53:43.235081+0000","last_clean":"2024-04-25T08:53:43.235081+0000","last_became_active":"2024-04-25T08:53:42.204784+0000","last_became_peered":"2024-04-25T08:53:42.204784+0000","last_unstale":"2024-04-25T08:53:43.235081+0000","last_undegraded":"2024-04-25T08:53:43.235081+0000","last_fullsized":"2024-04-25T08:53:43.235081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:17.160891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.228174+0000","last_change":"2024-04-25T08:53:43.227057+0000","last_active":"2024-04-25T08:53:43.228174+0000","last_peered":"2024-04-25T08:53:43.228174+0000","last_clean":"2024-04-25T08:53:43.228174+0000","last_became_active":"2024-04-25T08:53:43.226484+0000","last_became_peered":"2024-04-25T08:53:43.226484+0000","last_unstale":"2024-04-25T08:53:43.228174+0000","last_undegraded":"2024-04-25T08:53:43.228174+0000","last_fullsized":"2024-04-25T08:53:43.228174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:09.421533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336568+0000","last_change":"2024-04-25T08:53:42.204014+0000","last_active":"2024-04-25T08:53:44.336568+0000","last_peered":"2024-04-25T08:53:44.336568+0000","last_clean":"2024-04-25T08:53:44.336568+0000","last_became_active":"2024-04-25T08:53:42.203751+0000","last_became_peered":"2024-04-25T08:53:42.203751+0000","last_unstale":"2024-04-25T08:53:44.336568+0000","last_undegraded":"2024-04-25T08:53:44.336568+0000","last_fullsized":"2024-04-25T08:53:44.336568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458574+0000","last_change":"2024-04-25T08:53:43.231009+0000","last_active":"2024-04-25T08:53:44.458574+0000","last_peered":"2024-04-25T08:53:44.458574+0000","last_clean":"2024-04-25T08:53:44.458574+0000","last_became_active":"2024-04-25T08:53:43.230705+0000","last_became_peered":"2024-04-25T08:53:43.230705+0000","last_unstale":"2024-04-25T08:53:44.458574+0000","last_undegraded":"2024-04-25T08:53:44.458574+0000","last_fullsized":"2024-04-25T08:53:44.458574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.213930+0000","last_change":"2024-04-25T08:53:42.205489+0000","last_active":"2024-04-25T08:53:44.213930+0000","last_peered":"2024-04-25T08:53:44.213930+0000","last_clean":"2024-04-25T08:53:44.213930+0000","last_became_active":"2024-04-25T08:53:42.204328+0000","last_became_peered":"2024-04-25T08:53:42.204328+0000","last_unstale":"2024-04-25T08:53:44.213930+0000","last_undegraded":"2024-04-25T08:53:44.213930+0000","last_fullsized":"2024-04-25T08:53:44.213930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214069+0000","last_change":"2024-04-25T08:53:43.225273+0000","last_active":"2024-04-25T08:53:44.214069+0000","last_peered":"2024-04-25T08:53:44.214069+0000","last_clean":"2024-04-25T08:53:44.214069+0000","last_became_active":"2024-04-25T08:53:43.225014+0000","last_became_peered":"2024-04-25T08:53:43.225014+0000","last_unstale":"2024-04-25T08:53:44.214069+0000","last_undegraded":"2024-04-25T08:53:44.214069+0000","last_fullsized":"2024-04-25T08:53:44.214069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.228582+0000","last_change":"2024-04-25T08:53:42.206147+0000","last_active":"2024-04-25T08:53:43.228582+0000","last_peered":"2024-04-25T08:53:43.228582+0000","last_clean":"2024-04-25T08:53:43.228582+0000","last_became_active":"2024-04-25T08:53:42.205676+0000","last_became_peered":"2024-04-25T08:53:42.205676+0000","last_unstale":"2024-04-25T08:53:43.228582+0000","last_undegraded":"2024-04-25T08:53:43.228582+0000","last_fullsized":"2024-04-25T08:53:43.228582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458337+0000","last_change":"2024-04-25T08:53:43.224941+0000","last_active":"2024-04-25T08:53:44.458337+0000","last_peered":"2024-04-25T08:53:44.458337+0000","last_clean":"2024-04-25T08:53:44.458337+0000","last_became_active":"2024-04-25T08:53:43.224690+0000","last_became_peered":"2024-04-25T08:53:43.224690+0000","last_unstale":"2024-04-25T08:53:44.458337+0000","last_undegraded":"2024-04-25T08:53:44.458337+0000","last_fullsized":"2024-04-25T08:53:44.458337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215685+0000","last_change":"2024-04-25T08:53:42.208945+0000","last_active":"2024-04-25T08:53:44.215685+0000","last_peered":"2024-04-25T08:53:44.215685+0000","last_clean":"2024-04-25T08:53:44.215685+0000","last_became_active":"2024-04-25T08:53:42.208669+0000","last_became_peered":"2024-04-25T08:53:42.208669+0000","last_unstale":"2024-04-25T08:53:44.215685+0000","last_undegraded":"2024-04-25T08:53:44.215685+0000","last_fullsized":"2024-04-25T08:53:44.215685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458850+0000","last_change":"2024-04-25T08:53:43.228967+0000","last_active":"2024-04-25T08:53:44.458850+0000","last_peered":"2024-04-25T08:53:44.458850+0000","last_clean":"2024-04-25T08:53:44.458850+0000","last_became_active":"2024-04-25T08:53:43.228689+0000","last_became_peered":"2024-04-25T08:53:43.228689+0000","last_unstale":"2024-04-25T08:53:44.458850+0000","last_undegraded":"2024-04-25T08:53:44.458850+0000","last_fullsized":"2024-04-25T08:53:44.458850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:15.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.229992+0000","last_change":"2024-04-25T08:53:42.208039+0000","last_active":"2024-04-25T08:53:43.229992+0000","last_peered":"2024-04-25T08:53:43.229992+0000","last_clean":"2024-04-25T08:53:43.229992+0000","last_became_active":"2024-04-25T08:53:42.207680+0000","last_became_peered":"2024-04-25T08:53:42.207680+0000","last_unstale":"2024-04-25T08:53:43.229992+0000","last_undegraded":"2024-04-25T08:53:43.229992+0000","last_fullsized":"2024-04-25T08:53:43.229992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.459007+0000","last_change":"2024-04-25T08:53:43.230110+0000","last_active":"2024-04-25T08:53:44.459007+0000","last_peered":"2024-04-25T08:53:44.459007+0000","last_clean":"2024-04-25T08:53:44.459007+0000","last_became_active":"2024-04-25T08:53:43.229539+0000","last_became_peered":"2024-04-25T08:53:43.229539+0000","last_unstale":"2024-04-25T08:53:44.459007+0000","last_undegraded":"2024-04-25T08:53:44.459007+0000","last_fullsized":"2024-04-25T08:53:44.459007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193644+0000","last_change":"2024-04-25T08:53:41.193644+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193644+0000","last_undegraded":"2024-04-25T08:53:41.193644+0000","last_fullsized":"2024-04-25T08:53:41.193644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336537+0000","last_change":"2024-04-25T08:53:43.227532+0000","last_active":"2024-04-25T08:53:44.336537+0000","last_peered":"2024-04-25T08:53:44.336537+0000","last_clean":"2024-04-25T08:53:44.336537+0000","last_became_active":"2024-04-25T08:53:43.227269+0000","last_became_peered":"2024-04-25T08:53:43.227269+0000","last_unstale":"2024-04-25T08:53:44.336537+0000","last_undegraded":"2024-04-25T08:53:44.336537+0000","last_fullsized":"2024-04-25T08:53:44.336537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:25.482497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.204368+0000","last_change":"2024-04-25T08:53:42.210667+0000","last_active":"2024-04-25T08:53:43.204368+0000","last_peered":"2024-04-25T08:53:43.204368+0000","last_clean":"2024-04-25T08:53:43.204368+0000","last_became_active":"2024-04-25T08:53:42.210367+0000","last_became_peered":"2024-04-25T08:53:42.210367+0000","last_unstale":"2024-04-25T08:53:43.204368+0000","last_undegraded":"2024-04-25T08:53:43.204368+0000","last_fullsized":"2024-04-25T08:53:43.204368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:06.737038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458667+0000","last_change":"2024-04-25T08:53:43.223897+0000","last_active":"2024-04-25T08:53:44.458667+0000","last_peered":"2024-04-25T08:53:44.458667+0000","last_clean":"2024-04-25T08:53:44.458667+0000","last_became_active":"2024-04-25T08:53:43.223610+0000","last_became_peered":"2024-04-25T08:53:43.223610+0000","last_unstale":"2024-04-25T08:53:44.458667+0000","last_undegraded":"2024-04-25T08:53:44.458667+0000","last_fullsized":"2024-04-25T08:53:44.458667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:22.702870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458346+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:53:44.458346+0000","last_peered":"2024-04-25T08:53:44.458346+0000","last_clean":"2024-04-25T08:53:44.458346+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:53:44.458346+0000","last_undegraded":"2024-04-25T08:53:44.458346+0000","last_fullsized":"2024-04-25T08:53:44.458346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336073+0000","last_change":"2024-04-25T08:53:42.204756+0000","last_active":"2024-04-25T08:53:44.336073+0000","last_peered":"2024-04-25T08:53:44.336073+0000","last_clean":"2024-04-25T08:53:44.336073+0000","last_became_active":"2024-04-25T08:53:42.204433+0000","last_became_peered":"2024-04-25T08:53:42.204433+0000","last_unstale":"2024-04-25T08:53:44.336073+0000","last_undegraded":"2024-04-25T08:53:44.336073+0000","last_fullsized":"2024-04-25T08:53:44.336073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209533+0000","last_change":"2024-04-25T08:53:43.217690+0000","last_active":"2024-04-25T08:53:44.209533+0000","last_peered":"2024-04-25T08:53:44.209533+0000","last_clean":"2024-04-25T08:53:44.209533+0000","last_became_active":"2024-04-25T08:53:43.217338+0000","last_became_peered":"2024-04-25T08:53:43.217338+0000","last_unstale":"2024-04-25T08:53:44.209533+0000","last_undegraded":"2024-04-25T08:53:44.209533+0000","last_fullsized":"2024-04-25T08:53:44.209533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458262+0000","last_change":"2024-04-25T08:53:42.205644+0000","last_active":"2024-04-25T08:53:44.458262+0000","last_peered":"2024-04-25T08:53:44.458262+0000","last_clean":"2024-04-25T08:53:44.458262+0000","last_became_active":"2024-04-25T08:53:42.205370+0000","last_became_peered":"2024-04-25T08:53:42.205370+0000","last_unstale":"2024-04-25T08:53:44.458262+0000","last_undegraded":"2024-04-25T08:53:44.458262+0000","last_fullsized":"2024-04-25T08:53:44.458262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:29.564869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.225554+0000","last_change":"2024-04-25T08:53:43.223276+0000","last_active":"2024-04-25T08:53:43.225554+0000","last_peered":"2024-04-25T08:53:43.225554+0000","last_clean":"2024-04-25T08:53:43.225554+0000","last_became_active":"2024-04-25T08:53:43.222289+0000","last_became_peered":"2024-04-25T08:53:43.222289+0000","last_unstale":"2024-04-25T08:53:43.225554+0000","last_undegraded":"2024-04-25T08:53:43.225554+0000","last_fullsized":"2024-04-25T08:53:43.225554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:33.206100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.205047+0000","last_change":"2024-04-25T08:53:42.208356+0000","last_active":"2024-04-25T08:53:43.205047+0000","last_peered":"2024-04-25T08:53:43.205047+0000","last_clean":"2024-04-25T08:53:43.205047+0000","last_became_active":"2024-04-25T08:53:42.207946+0000","last_became_peered":"2024-04-25T08:53:42.207946+0000","last_unstale":"2024-04-25T08:53:43.205047+0000","last_undegraded":"2024-04-25T08:53:43.205047+0000","last_fullsized":"2024-04-25T08:53:43.205047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336592+0000","last_change":"2024-04-25T08:53:42.200507+0000","last_active":"2024-04-25T08:53:44.336592+0000","last_peered":"2024-04-25T08:53:44.336592+0000","last_clean":"2024-04-25T08:53:44.336592+0000","last_became_active":"2024-04-25T08:53:42.200202+0000","last_became_peered":"2024-04-25T08:53:42.200202+0000","last_unstale":"2024-04-25T08:53:44.336592+0000","last_undegraded":"2024-04-25T08:53:44.336592+0000","last_fullsized":"2024-04-25T08:53:44.336592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215336+0000","last_change":"2024-04-25T08:53:43.223144+0000","last_active":"2024-04-25T08:53:44.215336+0000","last_peered":"2024-04-25T08:53:44.215336+0000","last_clean":"2024-04-25T08:53:44.215336+0000","last_became_active":"2024-04-25T08:53:43.222867+0000","last_became_peered":"2024-04-25T08:53:43.222867+0000","last_unstale":"2024-04-25T08:53:44.215336+0000","last_undegraded":"2024-04-25T08:53:44.215336+0000","last_fullsized":"2024-04-25T08:53:44.215336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:33.206100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193951+0000","last_change":"2024-04-25T08:53:41.193951+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193951+0000","last_undegraded":"2024-04-25T08:53:41.193951+0000","last_fullsized":"2024-04-25T08:53:41.193951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336639+0000","last_change":"2024-04-25T08:53:43.224224+0000","last_active":"2024-04-25T08:53:44.336639+0000","last_peered":"2024-04-25T08:53:44.336639+0000","last_clean":"2024-04-25T08:53:44.336639+0000","last_became_active":"2024-04-25T08:53:43.223968+0000","last_became_peered":"2024-04-25T08:53:43.223968+0000","last_unstale":"2024-04-25T08:53:44.336639+0000","last_undegraded":"2024-04-25T08:53:44.336639+0000","last_fullsized":"2024-04-25T08:53:44.336639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458861+0000","last_change":"2024-04-25T08:53:42.212251+0000","last_active":"2024-04-25T08:53:44.458861+0000","last_peered":"2024-04-25T08:53:44.458861+0000","last_clean":"2024-04-25T08:53:44.458861+0000","last_became_active":"2024-04-25T08:53:42.212014+0000","last_became_peered":"2024-04-25T08:53:42.212014+0000","last_unstale":"2024-04-25T08:53:44.458861+0000","last_undegraded":"2024-04-25T08:53:44.458861+0000","last_fullsized":"2024-04-25T08:53:44.458861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:53:42.183932+0000","last_change":"2024-04-25T08:53:42.183932+0000","last_active":"2024-04-25T08:53:42.183932+0000","last_peered":"2024-04-25T08:53:42.183932+0000","last_clean":"2024-04-25T08:53:42.183932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:42.183932+0000","last_undegraded":"2024-04-25T08:53:42.183932+0000","last_fullsized":"2024-04-25T08:53:42.183932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193905+0000","last_change":"2024-04-25T08:53:41.193905+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193905+0000","last_undegraded":"2024-04-25T08:53:41.193905+0000","last_fullsized":"2024-04-25T08:53:41.193905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209997+0000","last_change":"2024-04-25T08:53:43.222064+0000","last_active":"2024-04-25T08:53:44.209997+0000","last_peered":"2024-04-25T08:53:44.209997+0000","last_clean":"2024-04-25T08:53:44.209997+0000","last_became_active":"2024-04-25T08:53:43.220696+0000","last_became_peered":"2024-04-25T08:53:43.220696+0000","last_unstale":"2024-04-25T08:53:44.209997+0000","last_undegraded":"2024-04-25T08:53:44.209997+0000","last_fullsized":"2024-04-25T08:53:44.209997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214303+0000","last_change":"2024-04-25T08:53:42.203104+0000","last_active":"2024-04-25T08:53:44.214303+0000","last_peered":"2024-04-25T08:53:44.214303+0000","last_clean":"2024-04-25T08:53:44.214303+0000","last_became_active":"2024-04-25T08:53:42.202822+0000","last_became_peered":"2024-04-25T08:53:42.202822+0000","last_unstale":"2024-04-25T08:53:44.214303+0000","last_undegraded":"2024-04-25T08:53:44.214303+0000","last_fullsized":"2024-04-25T08:53:44.214303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.222273+0000","last_change":"2024-04-25T08:53:43.214747+0000","last_active":"2024-04-25T08:53:43.222273+0000","last_peered":"2024-04-25T08:53:43.222273+0000","last_clean":"2024-04-25T08:53:43.222273+0000","last_became_active":"2024-04-25T08:53:43.214410+0000","last_became_peered":"2024-04-25T08:53:43.214410+0000","last_unstale":"2024-04-25T08:53:43.222273+0000","last_undegraded":"2024-04-25T08:53:43.222273+0000","last_fullsized":"2024-04-25T08:53:43.222273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:07.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458260+0000","last_change":"2024-04-25T08:53:42.212258+0000","last_active":"2024-04-25T08:53:44.458260+0000","last_peered":"2024-04-25T08:53:44.458260+0000","last_clean":"2024-04-25T08:53:44.458260+0000","last_became_active":"2024-04-25T08:53:42.212025+0000","last_became_peered":"2024-04-25T08:53:42.212025+0000","last_unstale":"2024-04-25T08:53:44.458260+0000","last_undegraded":"2024-04-25T08:53:44.458260+0000","last_fullsized":"2024-04-25T08:53:44.458260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:45.638730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215251+0000","last_change":"2024-04-25T08:53:43.216186+0000","last_active":"2024-04-25T08:53:44.215251+0000","last_peered":"2024-04-25T08:53:44.215251+0000","last_clean":"2024-04-25T08:53:44.215251+0000","last_became_active":"2024-04-25T08:53:43.215899+0000","last_became_peered":"2024-04-25T08:53:43.215899+0000","last_unstale":"2024-04-25T08:53:44.215251+0000","last_undegraded":"2024-04-25T08:53:44.215251+0000","last_fullsized":"2024-04-25T08:53:44.215251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:04.077055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.193599+0000","last_change":"2024-04-25T08:53:41.193599+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.193599+0000","last_undegraded":"2024-04-25T08:53:41.193599+0000","last_fullsized":"2024-04-25T08:53:41.193599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209486+0000","last_change":"2024-04-25T08:53:43.217644+0000","last_active":"2024-04-25T08:53:44.209486+0000","last_peered":"2024-04-25T08:53:44.209486+0000","last_clean":"2024-04-25T08:53:44.209486+0000","last_became_active":"2024-04-25T08:53:43.217347+0000","last_became_peered":"2024-04-25T08:53:43.217347+0000","last_unstale":"2024-04-25T08:53:44.209486+0000","last_undegraded":"2024-04-25T08:53:44.209486+0000","last_fullsized":"2024-04-25T08:53:44.209486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-25T08:53:41.195506+0000","last_change":"2024-04-25T08:53:41.195506+0000","last_active":"2024-04-25T08:53:41.174011+0000","last_peered":"2024-04-25T08:53:41.174011+0000","last_clean":"2024-04-25T08:53:41.174011+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:53:41.195506+0000","last_undegraded":"2024-04-25T08:53:41.195506+0000","last_fullsized":"2024-04-25T08:53:41.195506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209913+0000","last_change":"2024-04-25T08:53:43.215719+0000","last_active":"2024-04-25T08:53:44.209913+0000","last_peered":"2024-04-25T08:53:44.209913+0000","last_clean":"2024-04-25T08:53:44.209913+0000","last_became_active":"2024-04-25T08:53:43.215453+0000","last_became_peered":"2024-04-25T08:53:43.215453+0000","last_unstale":"2024-04-25T08:53:44.209913+0000","last_undegraded":"2024-04-25T08:53:44.209913+0000","last_fullsized":"2024-04-25T08:53:44.209913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458715+0000","last_change":"2024-04-25T08:53:42.207288+0000","last_active":"2024-04-25T08:53:44.458715+0000","last_peered":"2024-04-25T08:53:44.458715+0000","last_clean":"2024-04-25T08:53:44.458715+0000","last_became_active":"2024-04-25T08:53:42.207012+0000","last_became_peered":"2024-04-25T08:53:42.207012+0000","last_unstale":"2024-04-25T08:53:44.458715+0000","last_undegraded":"2024-04-25T08:53:44.458715+0000","last_fullsized":"2024-04-25T08:53:44.458715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214055+0000","last_change":"2024-04-25T08:53:43.209633+0000","last_active":"2024-04-25T08:53:44.214055+0000","last_peered":"2024-04-25T08:53:44.214055+0000","last_clean":"2024-04-25T08:53:44.214055+0000","last_became_active":"2024-04-25T08:53:43.209378+0000","last_became_peered":"2024-04-25T08:53:43.209378+0000","last_unstale":"2024-04-25T08:53:44.214055+0000","last_undegraded":"2024-04-25T08:53:44.214055+0000","last_fullsized":"2024-04-25T08:53:44.214055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336439+0000","last_change":"2024-04-25T08:53:43.220635+0000","last_active":"2024-04-25T08:53:44.336439+0000","last_peered":"2024-04-25T08:53:44.336439+0000","last_clean":"2024-04-25T08:53:44.336439+0000","last_became_active":"2024-04-25T08:53:43.220373+0000","last_became_peered":"2024-04-25T08:53:43.220373+0000","last_unstale":"2024-04-25T08:53:44.336439+0000","last_undegraded":"2024-04-25T08:53:44.336439+0000","last_fullsized":"2024-04-25T08:53:44.336439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458542+0000","last_change":"2024-04-25T08:53:42.207788+0000","last_active":"2024-04-25T08:53:44.458542+0000","last_peered":"2024-04-25T08:53:44.458542+0000","last_clean":"2024-04-25T08:53:44.458542+0000","last_became_active":"2024-04-25T08:53:42.207521+0000","last_became_peered":"2024-04-25T08:53:42.207521+0000","last_unstale":"2024-04-25T08:53:44.458542+0000","last_undegraded":"2024-04-25T08:53:44.458542+0000","last_fullsized":"2024-04-25T08:53:44.458542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336474+0000","last_change":"2024-04-25T08:53:43.219991+0000","last_active":"2024-04-25T08:53:44.336474+0000","last_peered":"2024-04-25T08:53:44.336474+0000","last_clean":"2024-04-25T08:53:44.336474+0000","last_became_active":"2024-04-25T08:53:43.219715+0000","last_became_peered":"2024-04-25T08:53:43.219715+0000","last_unstale":"2024-04-25T08:53:44.336474+0000","last_undegraded":"2024-04-25T08:53:44.336474+0000","last_fullsized":"2024-04-25T08:53:44.336474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:15.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458764+0000","last_change":"2024-04-25T08:53:42.206350+0000","last_active":"2024-04-25T08:53:44.458764+0000","last_peered":"2024-04-25T08:53:44.458764+0000","last_clean":"2024-04-25T08:53:44.458764+0000","last_became_active":"2024-04-25T08:53:42.206045+0000","last_became_peered":"2024-04-25T08:53:42.206045+0000","last_unstale":"2024-04-25T08:53:44.458764+0000","last_undegraded":"2024-04-25T08:53:44.458764+0000","last_fullsized":"2024-04-25T08:53:44.458764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.226262+0000","last_change":"2024-04-25T08:53:43.225375+0000","last_active":"2024-04-25T08:53:43.226262+0000","last_peered":"2024-04-25T08:53:43.226262+0000","last_clean":"2024-04-25T08:53:43.226262+0000","last_became_active":"2024-04-25T08:53:43.225062+0000","last_became_peered":"2024-04-25T08:53:43.225062+0000","last_unstale":"2024-04-25T08:53:43.226262+0000","last_undegraded":"2024-04-25T08:53:43.226262+0000","last_fullsized":"2024-04-25T08:53:43.226262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:30.574790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209778+0000","last_change":"2024-04-25T08:53:42.209070+0000","last_active":"2024-04-25T08:53:44.209778+0000","last_peered":"2024-04-25T08:53:44.209778+0000","last_clean":"2024-04-25T08:53:44.209778+0000","last_became_active":"2024-04-25T08:53:42.208670+0000","last_became_peered":"2024-04-25T08:53:42.208670+0000","last_unstale":"2024-04-25T08:53:44.209778+0000","last_undegraded":"2024-04-25T08:53:44.209778+0000","last_fullsized":"2024-04-25T08:53:44.209778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:06.737038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.210018+0000","last_change":"2024-04-25T08:53:43.224397+0000","last_active":"2024-04-25T08:53:44.210018+0000","last_peered":"2024-04-25T08:53:44.210018+0000","last_clean":"2024-04-25T08:53:44.210018+0000","last_became_active":"2024-04-25T08:53:43.224037+0000","last_became_peered":"2024-04-25T08:53:43.224037+0000","last_unstale":"2024-04-25T08:53:44.210018+0000","last_undegraded":"2024-04-25T08:53:44.210018+0000","last_fullsized":"2024-04-25T08:53:44.210018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T08:53:43.235074+0000","last_change":"2024-04-25T08:53:42.209220+0000","last_active":"2024-04-25T08:53:43.235074+0000","last_peered":"2024-04-25T08:53:43.235074+0000","last_clean":"2024-04-25T08:53:43.235074+0000","last_became_active":"2024-04-25T08:53:42.208936+0000","last_became_peered":"2024-04-25T08:53:42.208936+0000","last_unstale":"2024-04-25T08:53:43.235074+0000","last_undegraded":"2024-04-25T08:53:43.235074+0000","last_fullsized":"2024-04-25T08:53:43.235074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:51.480879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":665885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":75061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:53:50.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:53:50.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.764+0000 7f967c2cb640 1 Processor -- start 2024-04-25T08:53:50.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.764+0000 7f967c2cb640 1 -- start start 2024-04-25T08:53:50.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f967c2cb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f967415dce0 0x7f96740d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:50.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f967c2cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96740d35b0 0x7f96740b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:50.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f967c2cb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967415e0c0 con 0x7f96740d1f90 2024-04-25T08:53:50.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f967c2cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96740b7b10 con 0x7f96740d35b0 2024-04-25T08:53:50.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f967c2cb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96740d2510 con 0x7f967415dce0 2024-04-25T08:53:50.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f9679866640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96740d35b0 0x7f96740b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:50.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f9679866640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96740d35b0 0x7f96740b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47798/0 (socket says 172.21.15.55:47798) 2024-04-25T08:53:50.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f9679866640 1 -- 172.21.15.55:0/1948226289 learned_addr learned my addr 172.21.15.55:0/1948226289 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:50.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f967a067640 1 --2- 172.21.15.55:0/1948226289 >> v2:172.21.15.167:3300/0 conn(0x7f967415dce0 0x7f96740d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:50.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f9679866640 1 -- 172.21.15.55:0/1948226289 >> v2:172.21.15.167:3300/0 conn(0x7f967415dce0 msgr2=0x7f96740d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:50.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f9679866640 1 --2- 172.21.15.55:0/1948226289 >> v2:172.21.15.167:3300/0 conn(0x7f967415dce0 0x7f96740d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:50.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f9679866640 1 -- 172.21.15.55:0/1948226289 >> v1:172.21.15.167:6789/0 conn(0x7f96740d1f90 legacy=0x7f967406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:50.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.765+0000 7f9679866640 1 -- 172.21.15.55:0/1948226289 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740d27f0 con 0x7f96740d35b0 2024-04-25T08:53:50.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.766+0000 7f9679866640 1 --2- 172.21.15.55:0/1948226289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96740d35b0 0x7f96740b5450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96740ce220 tx=0x7f967002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8a27e4125aeb7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:50.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.766+0000 7f9679065640 1 -- 172.21.15.55:0/1948226289 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670037070 con 0x7f96740d35b0 2024-04-25T08:53:50.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.766+0000 7f9679065640 1 -- 172.21.15.55:0/1948226289 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9670032440 con 0x7f96740d35b0 2024-04-25T08:53:50.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.766+0000 7f9679065640 1 -- 172.21.15.55:0/1948226289 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670032810 con 0x7f96740d35b0 2024-04-25T08:53:50.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.767+0000 7f967c2cb640 1 -- 172.21.15.55:0/1948226289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96740d35b0 msgr2=0x7f96740b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:50.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.767+0000 7f967c2cb640 1 --2- 172.21.15.55:0/1948226289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96740d35b0 0x7f96740b5450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96740ce220 tx=0x7f967002a230 comp rx=0 tx=0).stop 2024-04-25T08:53:50.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.767+0000 7f967c2cb640 1 -- 172.21.15.55:0/1948226289 shutdown_connections 2024-04-25T08:53:50.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.767+0000 7f967c2cb640 1 --2- 172.21.15.55:0/1948226289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96740d35b0 0x7f96740b5450 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:50.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.767+0000 7f967c2cb640 1 --2- 172.21.15.55:0/1948226289 >> v2:172.21.15.167:3300/0 conn(0x7f967415dce0 0x7f96740d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:50.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.767+0000 7f967c2cb640 1 -- 172.21.15.55:0/1948226289 >> 172.21.15.55:0/1948226289 conn(0x7f9674072900 msgr2=0x7f96740d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:50.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.767+0000 7f967c2cb640 1 -- 172.21.15.55:0/1948226289 shutdown_connections 2024-04-25T08:53:50.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.767+0000 7f967c2cb640 1 -- 172.21.15.55:0/1948226289 wait complete. 2024-04-25T08:53:50.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.768+0000 7f967c2cb640 1 Processor -- start 2024-04-25T08:53:50.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.768+0000 7f967c2cb640 1 -- start start 2024-04-25T08:53:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967c2cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96740d1f90 0x7f96740c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967c2cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96740d35b0 0x7f9674152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967c2cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f967415dce0 0x7f96740cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967c2cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96740d3090 con 0x7f96740d1f90 2024-04-25T08:53:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967c2cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96740d2db0 con 0x7f96740d35b0 2024-04-25T08:53:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967c2cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96740b9820 con 0x7f967415dce0 2024-04-25T08:53:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967a067640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96740d1f90 0x7f96740c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967a067640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96740d1f90 0x7f96740c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47814/0 (socket says 172.21.15.55:47814) 2024-04-25T08:53:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967a067640 1 -- 172.21.15.55:0/2738142560 learned_addr learned my addr 172.21.15.55:0/2738142560 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f9679866640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96740d35b0 0x7f9674152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967a868640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f967415dce0 0x7f96740cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967a067640 1 -- 172.21.15.55:0/2738142560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f967415dce0 msgr2=0x7f96740cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967a067640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f967415dce0 0x7f96740cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967a067640 1 -- 172.21.15.55:0/2738142560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96740d35b0 msgr2=0x7f9674152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967a067640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96740d35b0 0x7f9674152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.769+0000 7f967a067640 1 -- 172.21.15.55:0/2738142560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740ca320 con 0x7f96740d1f90 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.770+0000 7f967a067640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96740d1f90 0x7f96740c9de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f966800d5f0 tx=0x7f966800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.770+0000 7f9666ffd640 1 -- 172.21.15.55:0/2738142560 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96680125f0 con 0x7f96740d1f90 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.770+0000 7f9666ffd640 1 -- 172.21.15.55:0/2738142560 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9668019070 con 0x7f96740d1f90 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.770+0000 7f9666ffd640 1 -- 172.21.15.55:0/2738142560 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96680129d0 con 0x7f96740d1f90 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.770+0000 7f967c2cb640 1 -- 172.21.15.55:0/2738142560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96740c7a30 con 0x7f96740d1f90 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.770+0000 7f967c2cb640 1 -- 172.21.15.55:0/2738142560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967415f6d0 con 0x7f96740d1f90 2024-04-25T08:53:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.771+0000 7f967c2cb640 1 -- 172.21.15.55:0/2738142560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96740749b0 con 0x7f96740d1f90 2024-04-25T08:53:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.772+0000 7f9666ffd640 1 -- 172.21.15.55:0/2738142560 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9668012b70 con 0x7f96740d1f90 2024-04-25T08:53:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.772+0000 7f9666ffd640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f965806b4d0 0x7f965806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.772+0000 7f9666ffd640 1 -- 172.21.15.55:0/2738142560 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f966808a3e0 con 0x7f96740d1f90 2024-04-25T08:53:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.772+0000 7f9679866640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f965806b4d0 0x7f965806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:50.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.773+0000 7f9679866640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f965806b4d0 0x7f965806d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9670034000 tx=0x7f967002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:50.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.777+0000 7f9666ffd640 1 -- 172.21.15.55:0/2738142560 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9668058ca0 con 0x7f96740d1f90 2024-04-25T08:53:50.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.953+0000 7f967c2cb640 1 -- 172.21.15.55:0/2738142560 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96740b5dd0 con 0x7f965806b4d0 2024-04-25T08:53:50.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.959+0000 7f9666ffd640 1 -- 172.21.15.55:0/2738142560 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251884 (secure 0 0 0) 0x7f96740b5dd0 con 0x7f965806b4d0 2024-04-25T08:53:50.952 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:50.953 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:53:50.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 -- 172.21.15.55:0/2738142560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f965806b4d0 msgr2=0x7f965806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f965806b4d0 0x7f965806d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9670034000 tx=0x7f967002e000 comp rx=0 tx=0).stop 2024-04-25T08:53:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 -- 172.21.15.55:0/2738142560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96740d1f90 msgr2=0x7f96740c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96740d1f90 0x7f96740c9de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f966800d5f0 tx=0x7f966800dab0 comp rx=0 tx=0).stop 2024-04-25T08:53:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 -- 172.21.15.55:0/2738142560 shutdown_connections 2024-04-25T08:53:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f965806b4d0 0x7f965806d990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f967415dce0 0x7f96740cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96740d35b0 0x7f9674152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 --2- 172.21.15.55:0/2738142560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96740d1f90 0x7f96740c9de0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 -- 172.21.15.55:0/2738142560 >> 172.21.15.55:0/2738142560 conn(0x7f9674072900 msgr2=0x7f96740b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 -- 172.21.15.55:0/2738142560 shutdown_connections 2024-04-25T08:53:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:50.962+0000 7f967c2cb640 1 -- 172.21.15.55:0/2738142560 wait complete. 2024-04-25T08:53:50.963 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-25T08:53:50.553206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235868,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738852,"statfs":{"total":773094113280,"available":772852584448,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002532"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458904+0000","last_change":"2024-04-25T08:53:43.226040+0000","last_active":"2024-04-25T08:53:44.458904+0000","last_peered":"2024-04-25T08:53:44.458904+0000","last_clean":"2024-04-25T08:53:44.458904+0000","last_became_active":"2024-04-25T08:53:43.225773+0000","last_became_peered":"2024-04-25T08:53:43.225773+0000","last_unstale":"2024-04-25T08:53:44.458904+0000","last_undegraded":"2024-04-25T08:53:44.458904+0000","last_fullsized":"2024-04-25T08:53:44.458904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:25.482497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214380+0000","last_change":"2024-04-25T08:53:43.213215+0000","last_active":"2024-04-25T08:53:45.214380+0000","last_peered":"2024-04-25T08:53:45.214380+0000","last_clean":"2024-04-25T08:53:45.214380+0000","last_became_active":"2024-04-25T08:53:43.212906+0000","last_became_peered":"2024-04-25T08:53:43.212906+0000","last_unstale":"2024-04-25T08:53:45.214380+0000","last_undegraded":"2024-04-25T08:53:45.214380+0000","last_fullsized":"2024-04-25T08:53:45.214380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:49.492910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356331+0000","last_change":"2024-04-25T08:53:43.222988+0000","last_active":"2024-04-25T08:53:45.356331+0000","last_peered":"2024-04-25T08:53:45.356331+0000","last_clean":"2024-04-25T08:53:45.356331+0000","last_became_active":"2024-04-25T08:53:43.222683+0000","last_became_peered":"2024-04-25T08:53:43.222683+0000","last_unstale":"2024-04-25T08:53:45.356331+0000","last_undegraded":"2024-04-25T08:53:45.356331+0000","last_fullsized":"2024-04-25T08:53:45.356331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336369+0000","last_change":"2024-04-25T08:53:43.227764+0000","last_active":"2024-04-25T08:53:44.336369+0000","last_peered":"2024-04-25T08:53:44.336369+0000","last_clean":"2024-04-25T08:53:44.336369+0000","last_became_active":"2024-04-25T08:53:43.227462+0000","last_became_peered":"2024-04-25T08:53:43.227462+0000","last_unstale":"2024-04-25T08:53:44.336369+0000","last_undegraded":"2024-04-25T08:53:44.336369+0000","last_fullsized":"2024-04-25T08:53:44.336369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458562+0000","last_change":"2024-04-25T08:53:43.222336+0000","last_active":"2024-04-25T08:53:44.458562+0000","last_peered":"2024-04-25T08:53:44.458562+0000","last_clean":"2024-04-25T08:53:44.458562+0000","last_became_active":"2024-04-25T08:53:43.222046+0000","last_became_peered":"2024-04-25T08:53:43.222046+0000","last_unstale":"2024-04-25T08:53:44.458562+0000","last_undegraded":"2024-04-25T08:53:44.458562+0000","last_fullsized":"2024-04-25T08:53:44.458562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336385+0000","last_change":"2024-04-25T08:53:43.226820+0000","last_active":"2024-04-25T08:53:44.336385+0000","last_peered":"2024-04-25T08:53:44.336385+0000","last_clean":"2024-04-25T08:53:44.336385+0000","last_became_active":"2024-04-25T08:53:43.226533+0000","last_became_peered":"2024-04-25T08:53:43.226533+0000","last_unstale":"2024-04-25T08:53:44.336385+0000","last_undegraded":"2024-04-25T08:53:44.336385+0000","last_fullsized":"2024-04-25T08:53:44.336385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:59.064691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458308+0000","last_change":"2024-04-25T08:53:43.226661+0000","last_active":"2024-04-25T08:53:44.458308+0000","last_peered":"2024-04-25T08:53:44.458308+0000","last_clean":"2024-04-25T08:53:44.458308+0000","last_became_active":"2024-04-25T08:53:43.226353+0000","last_became_peered":"2024-04-25T08:53:43.226353+0000","last_unstale":"2024-04-25T08:53:44.458308+0000","last_undegraded":"2024-04-25T08:53:44.458308+0000","last_fullsized":"2024-04-25T08:53:44.458308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209304+0000","last_change":"2024-04-25T08:53:43.217719+0000","last_active":"2024-04-25T08:53:44.209304+0000","last_peered":"2024-04-25T08:53:44.209304+0000","last_clean":"2024-04-25T08:53:44.209304+0000","last_became_active":"2024-04-25T08:53:43.217440+0000","last_became_peered":"2024-04-25T08:53:43.217440+0000","last_unstale":"2024-04-25T08:53:44.209304+0000","last_undegraded":"2024-04-25T08:53:44.209304+0000","last_fullsized":"2024-04-25T08:53:44.209304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458926+0000","last_change":"2024-04-25T08:53:43.219775+0000","last_active":"2024-04-25T08:53:44.458926+0000","last_peered":"2024-04-25T08:53:44.458926+0000","last_clean":"2024-04-25T08:53:44.458926+0000","last_became_active":"2024-04-25T08:53:43.219463+0000","last_became_peered":"2024-04-25T08:53:43.219463+0000","last_unstale":"2024-04-25T08:53:44.458926+0000","last_undegraded":"2024-04-25T08:53:44.458926+0000","last_fullsized":"2024-04-25T08:53:44.458926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.064857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214552+0000","last_change":"2024-04-25T08:53:43.216899+0000","last_active":"2024-04-25T08:53:44.214552+0000","last_peered":"2024-04-25T08:53:44.214552+0000","last_clean":"2024-04-25T08:53:44.214552+0000","last_became_active":"2024-04-25T08:53:43.216571+0000","last_became_peered":"2024-04-25T08:53:43.216571+0000","last_unstale":"2024-04-25T08:53:44.214552+0000","last_undegraded":"2024-04-25T08:53:44.214552+0000","last_fullsized":"2024-04-25T08:53:44.214552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214373+0000","last_change":"2024-04-25T08:53:43.220978+0000","last_active":"2024-04-25T08:53:44.214373+0000","last_peered":"2024-04-25T08:53:44.214373+0000","last_clean":"2024-04-25T08:53:44.214373+0000","last_became_active":"2024-04-25T08:53:43.219635+0000","last_became_peered":"2024-04-25T08:53:43.219635+0000","last_unstale":"2024-04-25T08:53:44.214373+0000","last_undegraded":"2024-04-25T08:53:44.214373+0000","last_fullsized":"2024-04-25T08:53:44.214373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215612+0000","last_change":"2024-04-25T08:53:43.224429+0000","last_active":"2024-04-25T08:53:44.215612+0000","last_peered":"2024-04-25T08:53:44.215612+0000","last_clean":"2024-04-25T08:53:44.215612+0000","last_became_active":"2024-04-25T08:53:43.224174+0000","last_became_peered":"2024-04-25T08:53:43.224174+0000","last_unstale":"2024-04-25T08:53:44.215612+0000","last_undegraded":"2024-04-25T08:53:44.215612+0000","last_fullsized":"2024-04-25T08:53:44.215612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:46.648651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209560+0000","last_change":"2024-04-25T08:53:43.216375+0000","last_active":"2024-04-25T08:53:44.209560+0000","last_peered":"2024-04-25T08:53:44.209560+0000","last_clean":"2024-04-25T08:53:44.209560+0000","last_became_active":"2024-04-25T08:53:43.216099+0000","last_became_peered":"2024-04-25T08:53:43.216099+0000","last_unstale":"2024-04-25T08:53:44.209560+0000","last_undegraded":"2024-04-25T08:53:44.209560+0000","last_fullsized":"2024-04-25T08:53:44.209560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356516+0000","last_change":"2024-04-25T08:53:43.223032+0000","last_active":"2024-04-25T08:53:45.356516+0000","last_peered":"2024-04-25T08:53:45.356516+0000","last_clean":"2024-04-25T08:53:45.356516+0000","last_became_active":"2024-04-25T08:53:43.222624+0000","last_became_peered":"2024-04-25T08:53:43.222624+0000","last_unstale":"2024-04-25T08:53:45.356516+0000","last_undegraded":"2024-04-25T08:53:45.356516+0000","last_fullsized":"2024-04-25T08:53:45.356516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214028+0000","last_change":"2024-04-25T08:53:43.210727+0000","last_active":"2024-04-25T08:53:45.214028+0000","last_peered":"2024-04-25T08:53:45.214028+0000","last_clean":"2024-04-25T08:53:45.214028+0000","last_became_active":"2024-04-25T08:53:43.208919+0000","last_became_peered":"2024-04-25T08:53:43.208919+0000","last_unstale":"2024-04-25T08:53:45.214028+0000","last_undegraded":"2024-04-25T08:53:45.214028+0000","last_fullsized":"2024-04-25T08:53:45.214028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:34.911186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.335931+0000","last_change":"2024-04-25T08:53:43.228001+0000","last_active":"2024-04-25T08:53:44.335931+0000","last_peered":"2024-04-25T08:53:44.335931+0000","last_clean":"2024-04-25T08:53:44.335931+0000","last_became_active":"2024-04-25T08:53:43.227703+0000","last_became_peered":"2024-04-25T08:53:43.227703+0000","last_unstale":"2024-04-25T08:53:44.335931+0000","last_undegraded":"2024-04-25T08:53:44.335931+0000","last_fullsized":"2024-04-25T08:53:44.335931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336584+0000","last_change":"2024-04-25T08:53:43.226726+0000","last_active":"2024-04-25T08:53:44.336584+0000","last_peered":"2024-04-25T08:53:44.336584+0000","last_clean":"2024-04-25T08:53:44.336584+0000","last_became_active":"2024-04-25T08:53:43.226448+0000","last_became_peered":"2024-04-25T08:53:43.226448+0000","last_unstale":"2024-04-25T08:53:44.336584+0000","last_undegraded":"2024-04-25T08:53:44.336584+0000","last_fullsized":"2024-04-25T08:53:44.336584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.064857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356481+0000","last_change":"2024-04-25T08:53:43.216437+0000","last_active":"2024-04-25T08:53:45.356481+0000","last_peered":"2024-04-25T08:53:45.356481+0000","last_clean":"2024-04-25T08:53:45.356481+0000","last_became_active":"2024-04-25T08:53:43.216118+0000","last_became_peered":"2024-04-25T08:53:43.216118+0000","last_unstale":"2024-04-25T08:53:45.356481+0000","last_undegraded":"2024-04-25T08:53:45.356481+0000","last_fullsized":"2024-04-25T08:53:45.356481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:30.574790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458878+0000","last_change":"2024-04-25T08:53:43.222245+0000","last_active":"2024-04-25T08:53:44.458878+0000","last_peered":"2024-04-25T08:53:44.458878+0000","last_clean":"2024-04-25T08:53:44.458878+0000","last_became_active":"2024-04-25T08:53:43.221954+0000","last_became_peered":"2024-04-25T08:53:43.221954+0000","last_unstale":"2024-04-25T08:53:44.458878+0000","last_undegraded":"2024-04-25T08:53:44.458878+0000","last_fullsized":"2024-04-25T08:53:44.458878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:46.272432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214280+0000","last_change":"2024-04-25T08:53:43.208966+0000","last_active":"2024-04-25T08:53:44.214280+0000","last_peered":"2024-04-25T08:53:44.214280+0000","last_clean":"2024-04-25T08:53:44.214280+0000","last_became_active":"2024-04-25T08:53:43.208694+0000","last_became_peered":"2024-04-25T08:53:43.208694+0000","last_unstale":"2024-04-25T08:53:44.214280+0000","last_undegraded":"2024-04-25T08:53:44.214280+0000","last_fullsized":"2024-04-25T08:53:44.214280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356228+0000","last_change":"2024-04-25T08:53:43.227774+0000","last_active":"2024-04-25T08:53:45.356228+0000","last_peered":"2024-04-25T08:53:45.356228+0000","last_clean":"2024-04-25T08:53:45.356228+0000","last_became_active":"2024-04-25T08:53:43.227471+0000","last_became_peered":"2024-04-25T08:53:43.227471+0000","last_unstale":"2024-04-25T08:53:45.356228+0000","last_undegraded":"2024-04-25T08:53:45.356228+0000","last_fullsized":"2024-04-25T08:53:45.356228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:28.340979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336129+0000","last_change":"2024-04-25T08:53:43.225757+0000","last_active":"2024-04-25T08:53:44.336129+0000","last_peered":"2024-04-25T08:53:44.336129+0000","last_clean":"2024-04-25T08:53:44.336129+0000","last_became_active":"2024-04-25T08:53:43.225482+0000","last_became_peered":"2024-04-25T08:53:43.225482+0000","last_unstale":"2024-04-25T08:53:44.336129+0000","last_undegraded":"2024-04-25T08:53:44.336129+0000","last_fullsized":"2024-04-25T08:53:44.336129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209673+0000","last_change":"2024-04-25T08:53:43.213773+0000","last_active":"2024-04-25T08:53:44.209673+0000","last_peered":"2024-04-25T08:53:44.209673+0000","last_clean":"2024-04-25T08:53:44.209673+0000","last_became_active":"2024-04-25T08:53:43.211924+0000","last_became_peered":"2024-04-25T08:53:43.211924+0000","last_unstale":"2024-04-25T08:53:44.209673+0000","last_undegraded":"2024-04-25T08:53:44.209673+0000","last_fullsized":"2024-04-25T08:53:44.209673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336156+0000","last_change":"2024-04-25T08:53:43.221087+0000","last_active":"2024-04-25T08:53:44.336156+0000","last_peered":"2024-04-25T08:53:44.336156+0000","last_clean":"2024-04-25T08:53:44.336156+0000","last_became_active":"2024-04-25T08:53:43.219503+0000","last_became_peered":"2024-04-25T08:53:43.219503+0000","last_unstale":"2024-04-25T08:53:44.336156+0000","last_undegraded":"2024-04-25T08:53:44.336156+0000","last_fullsized":"2024-04-25T08:53:44.336156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209695+0000","last_change":"2024-04-25T08:53:43.215393+0000","last_active":"2024-04-25T08:53:44.209695+0000","last_peered":"2024-04-25T08:53:44.209695+0000","last_clean":"2024-04-25T08:53:44.209695+0000","last_became_active":"2024-04-25T08:53:43.214671+0000","last_became_peered":"2024-04-25T08:53:43.214671+0000","last_unstale":"2024-04-25T08:53:44.209695+0000","last_undegraded":"2024-04-25T08:53:44.209695+0000","last_fullsized":"2024-04-25T08:53:44.209695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214588+0000","last_change":"2024-04-25T08:53:43.218493+0000","last_active":"2024-04-25T08:53:44.214588+0000","last_peered":"2024-04-25T08:53:44.214588+0000","last_clean":"2024-04-25T08:53:44.214588+0000","last_became_active":"2024-04-25T08:53:43.218199+0000","last_became_peered":"2024-04-25T08:53:43.218199+0000","last_unstale":"2024-04-25T08:53:44.214588+0000","last_undegraded":"2024-04-25T08:53:44.214588+0000","last_fullsized":"2024-04-25T08:53:44.214588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214156+0000","last_change":"2024-04-25T08:53:43.218908+0000","last_active":"2024-04-25T08:53:45.214156+0000","last_peered":"2024-04-25T08:53:45.214156+0000","last_clean":"2024-04-25T08:53:45.214156+0000","last_became_active":"2024-04-25T08:53:43.218580+0000","last_became_peered":"2024-04-25T08:53:43.218580+0000","last_unstale":"2024-04-25T08:53:45.214156+0000","last_undegraded":"2024-04-25T08:53:45.214156+0000","last_fullsized":"2024-04-25T08:53:45.214156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:13.572873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209813+0000","last_change":"2024-04-25T08:53:43.214059+0000","last_active":"2024-04-25T08:53:44.209813+0000","last_peered":"2024-04-25T08:53:44.209813+0000","last_clean":"2024-04-25T08:53:44.209813+0000","last_became_active":"2024-04-25T08:53:43.211412+0000","last_became_peered":"2024-04-25T08:53:43.211412+0000","last_unstale":"2024-04-25T08:53:44.209813+0000","last_undegraded":"2024-04-25T08:53:44.209813+0000","last_fullsized":"2024-04-25T08:53:44.209813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356366+0000","last_change":"2024-04-25T08:53:43.224899+0000","last_active":"2024-04-25T08:53:45.356366+0000","last_peered":"2024-04-25T08:53:45.356366+0000","last_clean":"2024-04-25T08:53:45.356366+0000","last_became_active":"2024-04-25T08:53:43.224532+0000","last_became_peered":"2024-04-25T08:53:43.224532+0000","last_unstale":"2024-04-25T08:53:45.356366+0000","last_undegraded":"2024-04-25T08:53:45.356366+0000","last_fullsized":"2024-04-25T08:53:45.356366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336482+0000","last_change":"2024-04-25T08:53:43.225133+0000","last_active":"2024-04-25T08:53:44.336482+0000","last_peered":"2024-04-25T08:53:44.336482+0000","last_clean":"2024-04-25T08:53:44.336482+0000","last_became_active":"2024-04-25T08:53:43.224687+0000","last_became_peered":"2024-04-25T08:53:43.224687+0000","last_unstale":"2024-04-25T08:53:44.336482+0000","last_undegraded":"2024-04-25T08:53:44.336482+0000","last_fullsized":"2024-04-25T08:53:44.336482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:46.272432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356080+0000","last_change":"2024-04-25T08:53:43.215307+0000","last_active":"2024-04-25T08:53:45.356080+0000","last_peered":"2024-04-25T08:53:45.356080+0000","last_clean":"2024-04-25T08:53:45.356080+0000","last_became_active":"2024-04-25T08:53:43.215014+0000","last_became_peered":"2024-04-25T08:53:43.215014+0000","last_unstale":"2024-04-25T08:53:45.356080+0000","last_undegraded":"2024-04-25T08:53:45.356080+0000","last_fullsized":"2024-04-25T08:53:45.356080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:46.648651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214040+0000","last_change":"2024-04-25T08:53:43.226428+0000","last_active":"2024-04-25T08:53:44.214040+0000","last_peered":"2024-04-25T08:53:44.214040+0000","last_clean":"2024-04-25T08:53:44.214040+0000","last_became_active":"2024-04-25T08:53:43.225678+0000","last_became_peered":"2024-04-25T08:53:43.225678+0000","last_unstale":"2024-04-25T08:53:44.214040+0000","last_undegraded":"2024-04-25T08:53:44.214040+0000","last_fullsized":"2024-04-25T08:53:44.214040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215161+0000","last_change":"2024-04-25T08:53:43.210436+0000","last_active":"2024-04-25T08:53:44.215161+0000","last_peered":"2024-04-25T08:53:44.215161+0000","last_clean":"2024-04-25T08:53:44.215161+0000","last_became_active":"2024-04-25T08:53:43.210150+0000","last_became_peered":"2024-04-25T08:53:43.210150+0000","last_unstale":"2024-04-25T08:53:44.215161+0000","last_undegraded":"2024-04-25T08:53:44.215161+0000","last_fullsized":"2024-04-25T08:53:44.215161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:36.391147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209779+0000","last_change":"2024-04-25T08:53:42.207162+0000","last_active":"2024-04-25T08:53:44.209779+0000","last_peered":"2024-04-25T08:53:44.209779+0000","last_clean":"2024-04-25T08:53:44.209779+0000","last_became_active":"2024-04-25T08:53:42.206827+0000","last_became_peered":"2024-04-25T08:53:42.206827+0000","last_unstale":"2024-04-25T08:53:44.209779+0000","last_undegraded":"2024-04-25T08:53:44.209779+0000","last_fullsized":"2024-04-25T08:53:44.209779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356472+0000","last_change":"2024-04-25T08:53:43.219024+0000","last_active":"2024-04-25T08:53:45.356472+0000","last_peered":"2024-04-25T08:53:45.356472+0000","last_clean":"2024-04-25T08:53:45.356472+0000","last_became_active":"2024-04-25T08:53:43.218674+0000","last_became_peered":"2024-04-25T08:53:43.218674+0000","last_unstale":"2024-04-25T08:53:45.356472+0000","last_undegraded":"2024-04-25T08:53:45.356472+0000","last_fullsized":"2024-04-25T08:53:45.356472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214016+0000","last_change":"2024-04-25T08:53:42.202321+0000","last_active":"2024-04-25T08:53:44.214016+0000","last_peered":"2024-04-25T08:53:44.214016+0000","last_clean":"2024-04-25T08:53:44.214016+0000","last_became_active":"2024-04-25T08:53:42.202063+0000","last_became_peered":"2024-04-25T08:53:42.202063+0000","last_unstale":"2024-04-25T08:53:44.214016+0000","last_undegraded":"2024-04-25T08:53:44.214016+0000","last_fullsized":"2024-04-25T08:53:44.214016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209484+0000","last_change":"2024-04-25T08:53:42.210884+0000","last_active":"2024-04-25T08:53:44.209484+0000","last_peered":"2024-04-25T08:53:44.209484+0000","last_clean":"2024-04-25T08:53:44.209484+0000","last_became_active":"2024-04-25T08:53:42.210568+0000","last_became_peered":"2024-04-25T08:53:42.210568+0000","last_unstale":"2024-04-25T08:53:44.209484+0000","last_undegraded":"2024-04-25T08:53:44.209484+0000","last_fullsized":"2024-04-25T08:53:44.209484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:51.480879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209351+0000","last_change":"2024-04-25T08:53:43.225401+0000","last_active":"2024-04-25T08:53:44.209351+0000","last_peered":"2024-04-25T08:53:44.209351+0000","last_clean":"2024-04-25T08:53:44.209351+0000","last_became_active":"2024-04-25T08:53:43.224926+0000","last_became_peered":"2024-04-25T08:53:43.224926+0000","last_unstale":"2024-04-25T08:53:44.209351+0000","last_undegraded":"2024-04-25T08:53:44.209351+0000","last_fullsized":"2024-04-25T08:53:44.209351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336053+0000","last_change":"2024-04-25T08:53:42.201897+0000","last_active":"2024-04-25T08:53:44.336053+0000","last_peered":"2024-04-25T08:53:44.336053+0000","last_clean":"2024-04-25T08:53:44.336053+0000","last_became_active":"2024-04-25T08:53:42.201641+0000","last_became_peered":"2024-04-25T08:53:42.201641+0000","last_unstale":"2024-04-25T08:53:44.336053+0000","last_undegraded":"2024-04-25T08:53:44.336053+0000","last_fullsized":"2024-04-25T08:53:44.336053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.213983+0000","last_change":"2024-04-25T08:53:43.209001+0000","last_active":"2024-04-25T08:53:45.213983+0000","last_peered":"2024-04-25T08:53:45.213983+0000","last_clean":"2024-04-25T08:53:45.213983+0000","last_became_active":"2024-04-25T08:53:43.207746+0000","last_became_peered":"2024-04-25T08:53:43.207746+0000","last_unstale":"2024-04-25T08:53:45.213983+0000","last_undegraded":"2024-04-25T08:53:45.213983+0000","last_fullsized":"2024-04-25T08:53:45.213983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:16.959076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214230+0000","last_change":"2024-04-25T08:53:42.209416+0000","last_active":"2024-04-25T08:53:44.214230+0000","last_peered":"2024-04-25T08:53:44.214230+0000","last_clean":"2024-04-25T08:53:44.214230+0000","last_became_active":"2024-04-25T08:53:42.209094+0000","last_became_peered":"2024-04-25T08:53:42.209094+0000","last_unstale":"2024-04-25T08:53:44.214230+0000","last_undegraded":"2024-04-25T08:53:44.214230+0000","last_fullsized":"2024-04-25T08:53:44.214230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336418+0000","last_change":"2024-04-25T08:53:43.221170+0000","last_active":"2024-04-25T08:53:44.336418+0000","last_peered":"2024-04-25T08:53:44.336418+0000","last_clean":"2024-04-25T08:53:44.336418+0000","last_became_active":"2024-04-25T08:53:43.220913+0000","last_became_peered":"2024-04-25T08:53:43.220913+0000","last_unstale":"2024-04-25T08:53:44.336418+0000","last_undegraded":"2024-04-25T08:53:44.336418+0000","last_fullsized":"2024-04-25T08:53:44.336418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:22.702870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336314+0000","last_change":"2024-04-25T08:53:42.209519+0000","last_active":"2024-04-25T08:53:44.336314+0000","last_peered":"2024-04-25T08:53:44.336314+0000","last_clean":"2024-04-25T08:53:44.336314+0000","last_became_active":"2024-04-25T08:53:42.209218+0000","last_became_peered":"2024-04-25T08:53:42.209218+0000","last_unstale":"2024-04-25T08:53:44.336314+0000","last_undegraded":"2024-04-25T08:53:44.336314+0000","last_fullsized":"2024-04-25T08:53:44.336314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356635+0000","last_change":"2024-04-25T08:53:43.216391+0000","last_active":"2024-04-25T08:53:45.356635+0000","last_peered":"2024-04-25T08:53:45.356635+0000","last_clean":"2024-04-25T08:53:45.356635+0000","last_became_active":"2024-04-25T08:53:43.216117+0000","last_became_peered":"2024-04-25T08:53:43.216117+0000","last_unstale":"2024-04-25T08:53:45.356635+0000","last_undegraded":"2024-04-25T08:53:45.356635+0000","last_fullsized":"2024-04-25T08:53:45.356635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214200+0000","last_change":"2024-04-25T08:53:42.199430+0000","last_active":"2024-04-25T08:53:45.214200+0000","last_peered":"2024-04-25T08:53:45.214200+0000","last_clean":"2024-04-25T08:53:45.214200+0000","last_became_active":"2024-04-25T08:53:42.199063+0000","last_became_peered":"2024-04-25T08:53:42.199063+0000","last_unstale":"2024-04-25T08:53:45.214200+0000","last_undegraded":"2024-04-25T08:53:45.214200+0000","last_fullsized":"2024-04-25T08:53:45.214200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:02.408782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215673+0000","last_change":"2024-04-25T08:53:43.222934+0000","last_active":"2024-04-25T08:53:44.215673+0000","last_peered":"2024-04-25T08:53:44.215673+0000","last_clean":"2024-04-25T08:53:44.215673+0000","last_became_active":"2024-04-25T08:53:43.222610+0000","last_became_peered":"2024-04-25T08:53:43.222610+0000","last_unstale":"2024-04-25T08:53:44.215673+0000","last_undegraded":"2024-04-25T08:53:44.215673+0000","last_fullsized":"2024-04-25T08:53:44.215673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:30.574790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214410+0000","last_change":"2024-04-25T08:53:42.205189+0000","last_active":"2024-04-25T08:53:44.214410+0000","last_peered":"2024-04-25T08:53:44.214410+0000","last_clean":"2024-04-25T08:53:44.214410+0000","last_became_active":"2024-04-25T08:53:42.204876+0000","last_became_peered":"2024-04-25T08:53:42.204876+0000","last_unstale":"2024-04-25T08:53:44.214410+0000","last_undegraded":"2024-04-25T08:53:44.214410+0000","last_fullsized":"2024-04-25T08:53:44.214410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458651+0000","last_change":"2024-04-25T08:53:43.229049+0000","last_active":"2024-04-25T08:53:44.458651+0000","last_peered":"2024-04-25T08:53:44.458651+0000","last_clean":"2024-04-25T08:53:44.458651+0000","last_became_active":"2024-04-25T08:53:43.228659+0000","last_became_peered":"2024-04-25T08:53:43.228659+0000","last_unstale":"2024-04-25T08:53:44.458651+0000","last_undegraded":"2024-04-25T08:53:44.458651+0000","last_fullsized":"2024-04-25T08:53:44.458651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:59.064691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356524+0000","last_change":"2024-04-25T08:53:42.205092+0000","last_active":"2024-04-25T08:53:45.356524+0000","last_peered":"2024-04-25T08:53:45.356524+0000","last_clean":"2024-04-25T08:53:45.356524+0000","last_became_active":"2024-04-25T08:53:42.204784+0000","last_became_peered":"2024-04-25T08:53:42.204784+0000","last_unstale":"2024-04-25T08:53:45.356524+0000","last_undegraded":"2024-04-25T08:53:45.356524+0000","last_fullsized":"2024-04-25T08:53:45.356524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:17.160891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356056+0000","last_change":"2024-04-25T08:53:43.227057+0000","last_active":"2024-04-25T08:53:45.356056+0000","last_peered":"2024-04-25T08:53:45.356056+0000","last_clean":"2024-04-25T08:53:45.356056+0000","last_became_active":"2024-04-25T08:53:43.226484+0000","last_became_peered":"2024-04-25T08:53:43.226484+0000","last_unstale":"2024-04-25T08:53:45.356056+0000","last_undegraded":"2024-04-25T08:53:45.356056+0000","last_fullsized":"2024-04-25T08:53:45.356056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:35.064000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336568+0000","last_change":"2024-04-25T08:53:42.204014+0000","last_active":"2024-04-25T08:53:44.336568+0000","last_peered":"2024-04-25T08:53:44.336568+0000","last_clean":"2024-04-25T08:53:44.336568+0000","last_became_active":"2024-04-25T08:53:42.203751+0000","last_became_peered":"2024-04-25T08:53:42.203751+0000","last_unstale":"2024-04-25T08:53:44.336568+0000","last_undegraded":"2024-04-25T08:53:44.336568+0000","last_fullsized":"2024-04-25T08:53:44.336568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458574+0000","last_change":"2024-04-25T08:53:43.231009+0000","last_active":"2024-04-25T08:53:44.458574+0000","last_peered":"2024-04-25T08:53:44.458574+0000","last_clean":"2024-04-25T08:53:44.458574+0000","last_became_active":"2024-04-25T08:53:43.230705+0000","last_became_peered":"2024-04-25T08:53:43.230705+0000","last_unstale":"2024-04-25T08:53:44.458574+0000","last_undegraded":"2024-04-25T08:53:44.458574+0000","last_fullsized":"2024-04-25T08:53:44.458574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.213930+0000","last_change":"2024-04-25T08:53:42.205489+0000","last_active":"2024-04-25T08:53:44.213930+0000","last_peered":"2024-04-25T08:53:44.213930+0000","last_clean":"2024-04-25T08:53:44.213930+0000","last_became_active":"2024-04-25T08:53:42.204328+0000","last_became_peered":"2024-04-25T08:53:42.204328+0000","last_unstale":"2024-04-25T08:53:44.213930+0000","last_undegraded":"2024-04-25T08:53:44.213930+0000","last_fullsized":"2024-04-25T08:53:44.213930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214069+0000","last_change":"2024-04-25T08:53:43.225273+0000","last_active":"2024-04-25T08:53:44.214069+0000","last_peered":"2024-04-25T08:53:44.214069+0000","last_clean":"2024-04-25T08:53:44.214069+0000","last_became_active":"2024-04-25T08:53:43.225014+0000","last_became_peered":"2024-04-25T08:53:43.225014+0000","last_unstale":"2024-04-25T08:53:44.214069+0000","last_undegraded":"2024-04-25T08:53:44.214069+0000","last_fullsized":"2024-04-25T08:53:44.214069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.355754+0000","last_change":"2024-04-25T08:53:42.206147+0000","last_active":"2024-04-25T08:53:45.355754+0000","last_peered":"2024-04-25T08:53:45.355754+0000","last_clean":"2024-04-25T08:53:45.355754+0000","last_became_active":"2024-04-25T08:53:42.205676+0000","last_became_peered":"2024-04-25T08:53:42.205676+0000","last_unstale":"2024-04-25T08:53:45.355754+0000","last_undegraded":"2024-04-25T08:53:45.355754+0000","last_fullsized":"2024-04-25T08:53:45.355754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458337+0000","last_change":"2024-04-25T08:53:43.224941+0000","last_active":"2024-04-25T08:53:44.458337+0000","last_peered":"2024-04-25T08:53:44.458337+0000","last_clean":"2024-04-25T08:53:44.458337+0000","last_became_active":"2024-04-25T08:53:43.224690+0000","last_became_peered":"2024-04-25T08:53:43.224690+0000","last_unstale":"2024-04-25T08:53:44.458337+0000","last_undegraded":"2024-04-25T08:53:44.458337+0000","last_fullsized":"2024-04-25T08:53:44.458337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215685+0000","last_change":"2024-04-25T08:53:42.208945+0000","last_active":"2024-04-25T08:53:44.215685+0000","last_peered":"2024-04-25T08:53:44.215685+0000","last_clean":"2024-04-25T08:53:44.215685+0000","last_became_active":"2024-04-25T08:53:42.208669+0000","last_became_peered":"2024-04-25T08:53:42.208669+0000","last_unstale":"2024-04-25T08:53:44.215685+0000","last_undegraded":"2024-04-25T08:53:44.215685+0000","last_fullsized":"2024-04-25T08:53:44.215685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458850+0000","last_change":"2024-04-25T08:53:43.228967+0000","last_active":"2024-04-25T08:53:44.458850+0000","last_peered":"2024-04-25T08:53:44.458850+0000","last_clean":"2024-04-25T08:53:44.458850+0000","last_became_active":"2024-04-25T08:53:43.228689+0000","last_became_peered":"2024-04-25T08:53:43.228689+0000","last_unstale":"2024-04-25T08:53:44.458850+0000","last_undegraded":"2024-04-25T08:53:44.458850+0000","last_fullsized":"2024-04-25T08:53:44.458850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:15.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356577+0000","last_change":"2024-04-25T08:53:42.208039+0000","last_active":"2024-04-25T08:53:45.356577+0000","last_peered":"2024-04-25T08:53:45.356577+0000","last_clean":"2024-04-25T08:53:45.356577+0000","last_became_active":"2024-04-25T08:53:42.207680+0000","last_became_peered":"2024-04-25T08:53:42.207680+0000","last_unstale":"2024-04-25T08:53:45.356577+0000","last_undegraded":"2024-04-25T08:53:45.356577+0000","last_fullsized":"2024-04-25T08:53:45.356577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.459007+0000","last_change":"2024-04-25T08:53:43.230110+0000","last_active":"2024-04-25T08:53:44.459007+0000","last_peered":"2024-04-25T08:53:44.459007+0000","last_clean":"2024-04-25T08:53:44.459007+0000","last_became_active":"2024-04-25T08:53:43.229539+0000","last_became_peered":"2024-04-25T08:53:43.229539+0000","last_unstale":"2024-04-25T08:53:44.459007+0000","last_undegraded":"2024-04-25T08:53:44.459007+0000","last_fullsized":"2024-04-25T08:53:44.459007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214243+0000","last_change":"2024-04-25T08:53:42.202509+0000","last_active":"2024-04-25T08:53:45.214243+0000","last_peered":"2024-04-25T08:53:45.214243+0000","last_clean":"2024-04-25T08:53:45.214243+0000","last_became_active":"2024-04-25T08:53:42.202223+0000","last_became_peered":"2024-04-25T08:53:42.202223+0000","last_unstale":"2024-04-25T08:53:45.214243+0000","last_undegraded":"2024-04-25T08:53:45.214243+0000","last_fullsized":"2024-04-25T08:53:45.214243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:39.125739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336537+0000","last_change":"2024-04-25T08:53:43.227532+0000","last_active":"2024-04-25T08:53:44.336537+0000","last_peered":"2024-04-25T08:53:44.336537+0000","last_clean":"2024-04-25T08:53:44.336537+0000","last_became_active":"2024-04-25T08:53:43.227269+0000","last_became_peered":"2024-04-25T08:53:43.227269+0000","last_unstale":"2024-04-25T08:53:44.336537+0000","last_undegraded":"2024-04-25T08:53:44.336537+0000","last_fullsized":"2024-04-25T08:53:44.336537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:25.482497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356340+0000","last_change":"2024-04-25T08:53:42.210667+0000","last_active":"2024-04-25T08:53:45.356340+0000","last_peered":"2024-04-25T08:53:45.356340+0000","last_clean":"2024-04-25T08:53:45.356340+0000","last_became_active":"2024-04-25T08:53:42.210367+0000","last_became_peered":"2024-04-25T08:53:42.210367+0000","last_unstale":"2024-04-25T08:53:45.356340+0000","last_undegraded":"2024-04-25T08:53:45.356340+0000","last_fullsized":"2024-04-25T08:53:45.356340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:06.737038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458667+0000","last_change":"2024-04-25T08:53:43.223897+0000","last_active":"2024-04-25T08:53:44.458667+0000","last_peered":"2024-04-25T08:53:44.458667+0000","last_clean":"2024-04-25T08:53:44.458667+0000","last_became_active":"2024-04-25T08:53:43.223610+0000","last_became_peered":"2024-04-25T08:53:43.223610+0000","last_unstale":"2024-04-25T08:53:44.458667+0000","last_undegraded":"2024-04-25T08:53:44.458667+0000","last_fullsized":"2024-04-25T08:53:44.458667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:22.702870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458346+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:53:44.458346+0000","last_peered":"2024-04-25T08:53:44.458346+0000","last_clean":"2024-04-25T08:53:44.458346+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:53:44.458346+0000","last_undegraded":"2024-04-25T08:53:44.458346+0000","last_fullsized":"2024-04-25T08:53:44.458346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336073+0000","last_change":"2024-04-25T08:53:42.204756+0000","last_active":"2024-04-25T08:53:44.336073+0000","last_peered":"2024-04-25T08:53:44.336073+0000","last_clean":"2024-04-25T08:53:44.336073+0000","last_became_active":"2024-04-25T08:53:42.204433+0000","last_became_peered":"2024-04-25T08:53:42.204433+0000","last_unstale":"2024-04-25T08:53:44.336073+0000","last_undegraded":"2024-04-25T08:53:44.336073+0000","last_fullsized":"2024-04-25T08:53:44.336073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209533+0000","last_change":"2024-04-25T08:53:43.217690+0000","last_active":"2024-04-25T08:53:44.209533+0000","last_peered":"2024-04-25T08:53:44.209533+0000","last_clean":"2024-04-25T08:53:44.209533+0000","last_became_active":"2024-04-25T08:53:43.217338+0000","last_became_peered":"2024-04-25T08:53:43.217338+0000","last_unstale":"2024-04-25T08:53:44.209533+0000","last_undegraded":"2024-04-25T08:53:44.209533+0000","last_fullsized":"2024-04-25T08:53:44.209533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458262+0000","last_change":"2024-04-25T08:53:42.205644+0000","last_active":"2024-04-25T08:53:44.458262+0000","last_peered":"2024-04-25T08:53:44.458262+0000","last_clean":"2024-04-25T08:53:44.458262+0000","last_became_active":"2024-04-25T08:53:42.205370+0000","last_became_peered":"2024-04-25T08:53:42.205370+0000","last_unstale":"2024-04-25T08:53:44.458262+0000","last_undegraded":"2024-04-25T08:53:44.458262+0000","last_fullsized":"2024-04-25T08:53:44.458262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:29.564869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.355926+0000","last_change":"2024-04-25T08:53:43.223276+0000","last_active":"2024-04-25T08:53:45.355926+0000","last_peered":"2024-04-25T08:53:45.355926+0000","last_clean":"2024-04-25T08:53:45.355926+0000","last_became_active":"2024-04-25T08:53:43.222289+0000","last_became_peered":"2024-04-25T08:53:43.222289+0000","last_unstale":"2024-04-25T08:53:45.355926+0000","last_undegraded":"2024-04-25T08:53:45.355926+0000","last_fullsized":"2024-04-25T08:53:45.355926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:21.260139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356060+0000","last_change":"2024-04-25T08:53:42.208356+0000","last_active":"2024-04-25T08:53:45.356060+0000","last_peered":"2024-04-25T08:53:45.356060+0000","last_clean":"2024-04-25T08:53:45.356060+0000","last_became_active":"2024-04-25T08:53:42.207946+0000","last_became_peered":"2024-04-25T08:53:42.207946+0000","last_unstale":"2024-04-25T08:53:45.356060+0000","last_undegraded":"2024-04-25T08:53:45.356060+0000","last_fullsized":"2024-04-25T08:53:45.356060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214265+0000","last_change":"2024-04-25T08:53:43.212295+0000","last_active":"2024-04-25T08:53:45.214265+0000","last_peered":"2024-04-25T08:53:45.214265+0000","last_clean":"2024-04-25T08:53:45.214265+0000","last_became_active":"2024-04-25T08:53:43.211966+0000","last_became_peered":"2024-04-25T08:53:43.211966+0000","last_unstale":"2024-04-25T08:53:45.214265+0000","last_undegraded":"2024-04-25T08:53:45.214265+0000","last_fullsized":"2024-04-25T08:53:45.214265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:14.026600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336592+0000","last_change":"2024-04-25T08:53:42.200507+0000","last_active":"2024-04-25T08:53:44.336592+0000","last_peered":"2024-04-25T08:53:44.336592+0000","last_clean":"2024-04-25T08:53:44.336592+0000","last_became_active":"2024-04-25T08:53:42.200202+0000","last_became_peered":"2024-04-25T08:53:42.200202+0000","last_unstale":"2024-04-25T08:53:44.336592+0000","last_undegraded":"2024-04-25T08:53:44.336592+0000","last_fullsized":"2024-04-25T08:53:44.336592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215336+0000","last_change":"2024-04-25T08:53:43.223144+0000","last_active":"2024-04-25T08:53:44.215336+0000","last_peered":"2024-04-25T08:53:44.215336+0000","last_clean":"2024-04-25T08:53:44.215336+0000","last_became_active":"2024-04-25T08:53:43.222867+0000","last_became_peered":"2024-04-25T08:53:43.222867+0000","last_unstale":"2024-04-25T08:53:44.215336+0000","last_undegraded":"2024-04-25T08:53:44.215336+0000","last_fullsized":"2024-04-25T08:53:44.215336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:33.206100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214034+0000","last_change":"2024-04-25T08:53:42.209304+0000","last_active":"2024-04-25T08:53:45.214034+0000","last_peered":"2024-04-25T08:53:45.214034+0000","last_clean":"2024-04-25T08:53:45.214034+0000","last_became_active":"2024-04-25T08:53:42.209028+0000","last_became_peered":"2024-04-25T08:53:42.209028+0000","last_unstale":"2024-04-25T08:53:45.214034+0000","last_undegraded":"2024-04-25T08:53:45.214034+0000","last_fullsized":"2024-04-25T08:53:45.214034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:00.557461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336639+0000","last_change":"2024-04-25T08:53:43.224224+0000","last_active":"2024-04-25T08:53:44.336639+0000","last_peered":"2024-04-25T08:53:44.336639+0000","last_clean":"2024-04-25T08:53:44.336639+0000","last_became_active":"2024-04-25T08:53:43.223968+0000","last_became_peered":"2024-04-25T08:53:43.223968+0000","last_unstale":"2024-04-25T08:53:44.336639+0000","last_undegraded":"2024-04-25T08:53:44.336639+0000","last_fullsized":"2024-04-25T08:53:44.336639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458861+0000","last_change":"2024-04-25T08:53:42.212251+0000","last_active":"2024-04-25T08:53:44.458861+0000","last_peered":"2024-04-25T08:53:44.458861+0000","last_clean":"2024-04-25T08:53:44.458861+0000","last_became_active":"2024-04-25T08:53:42.212014+0000","last_became_peered":"2024-04-25T08:53:42.212014+0000","last_unstale":"2024-04-25T08:53:44.458861+0000","last_undegraded":"2024-04-25T08:53:44.458861+0000","last_fullsized":"2024-04-25T08:53:44.458861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214213+0000","last_change":"2024-04-25T08:53:43.211702+0000","last_active":"2024-04-25T08:53:45.214213+0000","last_peered":"2024-04-25T08:53:45.214213+0000","last_clean":"2024-04-25T08:53:45.214213+0000","last_became_active":"2024-04-25T08:53:43.211273+0000","last_became_peered":"2024-04-25T08:53:43.211273+0000","last_unstale":"2024-04-25T08:53:45.214213+0000","last_undegraded":"2024-04-25T08:53:45.214213+0000","last_fullsized":"2024-04-25T08:53:45.214213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:04.627746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214358+0000","last_change":"2024-04-25T08:53:42.205102+0000","last_active":"2024-04-25T08:53:45.214358+0000","last_peered":"2024-04-25T08:53:45.214358+0000","last_clean":"2024-04-25T08:53:45.214358+0000","last_became_active":"2024-04-25T08:53:42.204781+0000","last_became_peered":"2024-04-25T08:53:42.204781+0000","last_unstale":"2024-04-25T08:53:45.214358+0000","last_undegraded":"2024-04-25T08:53:45.214358+0000","last_fullsized":"2024-04-25T08:53:45.214358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:26.598180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209997+0000","last_change":"2024-04-25T08:53:43.222064+0000","last_active":"2024-04-25T08:53:44.209997+0000","last_peered":"2024-04-25T08:53:44.209997+0000","last_clean":"2024-04-25T08:53:44.209997+0000","last_became_active":"2024-04-25T08:53:43.220696+0000","last_became_peered":"2024-04-25T08:53:43.220696+0000","last_unstale":"2024-04-25T08:53:44.209997+0000","last_undegraded":"2024-04-25T08:53:44.209997+0000","last_fullsized":"2024-04-25T08:53:44.209997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214303+0000","last_change":"2024-04-25T08:53:42.203104+0000","last_active":"2024-04-25T08:53:44.214303+0000","last_peered":"2024-04-25T08:53:44.214303+0000","last_clean":"2024-04-25T08:53:44.214303+0000","last_became_active":"2024-04-25T08:53:42.202822+0000","last_became_peered":"2024-04-25T08:53:42.202822+0000","last_unstale":"2024-04-25T08:53:44.214303+0000","last_undegraded":"2024-04-25T08:53:44.214303+0000","last_fullsized":"2024-04-25T08:53:44.214303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356308+0000","last_change":"2024-04-25T08:53:43.214747+0000","last_active":"2024-04-25T08:53:45.356308+0000","last_peered":"2024-04-25T08:53:45.356308+0000","last_clean":"2024-04-25T08:53:45.356308+0000","last_became_active":"2024-04-25T08:53:43.214410+0000","last_became_peered":"2024-04-25T08:53:43.214410+0000","last_unstale":"2024-04-25T08:53:45.356308+0000","last_undegraded":"2024-04-25T08:53:45.356308+0000","last_fullsized":"2024-04-25T08:53:45.356308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458260+0000","last_change":"2024-04-25T08:53:42.212258+0000","last_active":"2024-04-25T08:53:44.458260+0000","last_peered":"2024-04-25T08:53:44.458260+0000","last_clean":"2024-04-25T08:53:44.458260+0000","last_became_active":"2024-04-25T08:53:42.212025+0000","last_became_peered":"2024-04-25T08:53:42.212025+0000","last_unstale":"2024-04-25T08:53:44.458260+0000","last_undegraded":"2024-04-25T08:53:44.458260+0000","last_fullsized":"2024-04-25T08:53:44.458260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:45.638730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215251+0000","last_change":"2024-04-25T08:53:43.216186+0000","last_active":"2024-04-25T08:53:44.215251+0000","last_peered":"2024-04-25T08:53:44.215251+0000","last_clean":"2024-04-25T08:53:44.215251+0000","last_became_active":"2024-04-25T08:53:43.215899+0000","last_became_peered":"2024-04-25T08:53:43.215899+0000","last_unstale":"2024-04-25T08:53:44.215251+0000","last_undegraded":"2024-04-25T08:53:44.215251+0000","last_fullsized":"2024-04-25T08:53:44.215251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:04.077055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214051+0000","last_change":"2024-04-25T08:53:42.201324+0000","last_active":"2024-04-25T08:53:45.214051+0000","last_peered":"2024-04-25T08:53:45.214051+0000","last_clean":"2024-04-25T08:53:45.214051+0000","last_became_active":"2024-04-25T08:53:42.201017+0000","last_became_peered":"2024-04-25T08:53:42.201017+0000","last_unstale":"2024-04-25T08:53:45.214051+0000","last_undegraded":"2024-04-25T08:53:45.214051+0000","last_fullsized":"2024-04-25T08:53:45.214051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:23.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209486+0000","last_change":"2024-04-25T08:53:43.217644+0000","last_active":"2024-04-25T08:53:44.209486+0000","last_peered":"2024-04-25T08:53:44.209486+0000","last_clean":"2024-04-25T08:53:44.209486+0000","last_became_active":"2024-04-25T08:53:43.217347+0000","last_became_peered":"2024-04-25T08:53:43.217347+0000","last_unstale":"2024-04-25T08:53:44.209486+0000","last_undegraded":"2024-04-25T08:53:44.209486+0000","last_fullsized":"2024-04-25T08:53:44.209486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214070+0000","last_change":"2024-04-25T08:53:42.207935+0000","last_active":"2024-04-25T08:53:45.214070+0000","last_peered":"2024-04-25T08:53:45.214070+0000","last_clean":"2024-04-25T08:53:45.214070+0000","last_became_active":"2024-04-25T08:53:42.207643+0000","last_became_peered":"2024-04-25T08:53:42.207643+0000","last_unstale":"2024-04-25T08:53:45.214070+0000","last_undegraded":"2024-04-25T08:53:45.214070+0000","last_fullsized":"2024-04-25T08:53:45.214070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:58.628169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209913+0000","last_change":"2024-04-25T08:53:43.215719+0000","last_active":"2024-04-25T08:53:44.209913+0000","last_peered":"2024-04-25T08:53:44.209913+0000","last_clean":"2024-04-25T08:53:44.209913+0000","last_became_active":"2024-04-25T08:53:43.215453+0000","last_became_peered":"2024-04-25T08:53:43.215453+0000","last_unstale":"2024-04-25T08:53:44.209913+0000","last_undegraded":"2024-04-25T08:53:44.209913+0000","last_fullsized":"2024-04-25T08:53:44.209913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458715+0000","last_change":"2024-04-25T08:53:42.207288+0000","last_active":"2024-04-25T08:53:44.458715+0000","last_peered":"2024-04-25T08:53:44.458715+0000","last_clean":"2024-04-25T08:53:44.458715+0000","last_became_active":"2024-04-25T08:53:42.207012+0000","last_became_peered":"2024-04-25T08:53:42.207012+0000","last_unstale":"2024-04-25T08:53:44.458715+0000","last_undegraded":"2024-04-25T08:53:44.458715+0000","last_fullsized":"2024-04-25T08:53:44.458715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214055+0000","last_change":"2024-04-25T08:53:43.209633+0000","last_active":"2024-04-25T08:53:44.214055+0000","last_peered":"2024-04-25T08:53:44.214055+0000","last_clean":"2024-04-25T08:53:44.214055+0000","last_became_active":"2024-04-25T08:53:43.209378+0000","last_became_peered":"2024-04-25T08:53:43.209378+0000","last_unstale":"2024-04-25T08:53:44.214055+0000","last_undegraded":"2024-04-25T08:53:44.214055+0000","last_fullsized":"2024-04-25T08:53:44.214055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336439+0000","last_change":"2024-04-25T08:53:43.220635+0000","last_active":"2024-04-25T08:53:44.336439+0000","last_peered":"2024-04-25T08:53:44.336439+0000","last_clean":"2024-04-25T08:53:44.336439+0000","last_became_active":"2024-04-25T08:53:43.220373+0000","last_became_peered":"2024-04-25T08:53:43.220373+0000","last_unstale":"2024-04-25T08:53:44.336439+0000","last_undegraded":"2024-04-25T08:53:44.336439+0000","last_fullsized":"2024-04-25T08:53:44.336439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458542+0000","last_change":"2024-04-25T08:53:42.207788+0000","last_active":"2024-04-25T08:53:44.458542+0000","last_peered":"2024-04-25T08:53:44.458542+0000","last_clean":"2024-04-25T08:53:44.458542+0000","last_became_active":"2024-04-25T08:53:42.207521+0000","last_became_peered":"2024-04-25T08:53:42.207521+0000","last_unstale":"2024-04-25T08:53:44.458542+0000","last_undegraded":"2024-04-25T08:53:44.458542+0000","last_fullsized":"2024-04-25T08:53:44.458542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336474+0000","last_change":"2024-04-25T08:53:43.219991+0000","last_active":"2024-04-25T08:53:44.336474+0000","last_peered":"2024-04-25T08:53:44.336474+0000","last_clean":"2024-04-25T08:53:44.336474+0000","last_became_active":"2024-04-25T08:53:43.219715+0000","last_became_peered":"2024-04-25T08:53:43.219715+0000","last_unstale":"2024-04-25T08:53:44.336474+0000","last_undegraded":"2024-04-25T08:53:44.336474+0000","last_fullsized":"2024-04-25T08:53:44.336474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:15.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458764+0000","last_change":"2024-04-25T08:53:42.206350+0000","last_active":"2024-04-25T08:53:44.458764+0000","last_peered":"2024-04-25T08:53:44.458764+0000","last_clean":"2024-04-25T08:53:44.458764+0000","last_became_active":"2024-04-25T08:53:42.206045+0000","last_became_peered":"2024-04-25T08:53:42.206045+0000","last_unstale":"2024-04-25T08:53:44.458764+0000","last_undegraded":"2024-04-25T08:53:44.458764+0000","last_fullsized":"2024-04-25T08:53:44.458764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356482+0000","last_change":"2024-04-25T08:53:43.225375+0000","last_active":"2024-04-25T08:53:45.356482+0000","last_peered":"2024-04-25T08:53:45.356482+0000","last_clean":"2024-04-25T08:53:45.356482+0000","last_became_active":"2024-04-25T08:53:43.225062+0000","last_became_peered":"2024-04-25T08:53:43.225062+0000","last_unstale":"2024-04-25T08:53:45.356482+0000","last_undegraded":"2024-04-25T08:53:45.356482+0000","last_fullsized":"2024-04-25T08:53:45.356482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209778+0000","last_change":"2024-04-25T08:53:42.209070+0000","last_active":"2024-04-25T08:53:44.209778+0000","last_peered":"2024-04-25T08:53:44.209778+0000","last_clean":"2024-04-25T08:53:44.209778+0000","last_became_active":"2024-04-25T08:53:42.208670+0000","last_became_peered":"2024-04-25T08:53:42.208670+0000","last_unstale":"2024-04-25T08:53:44.209778+0000","last_undegraded":"2024-04-25T08:53:44.209778+0000","last_fullsized":"2024-04-25T08:53:44.209778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:06.737038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.210018+0000","last_change":"2024-04-25T08:53:43.224397+0000","last_active":"2024-04-25T08:53:44.210018+0000","last_peered":"2024-04-25T08:53:44.210018+0000","last_clean":"2024-04-25T08:53:44.210018+0000","last_became_active":"2024-04-25T08:53:43.224037+0000","last_became_peered":"2024-04-25T08:53:43.224037+0000","last_unstale":"2024-04-25T08:53:44.210018+0000","last_undegraded":"2024-04-25T08:53:44.210018+0000","last_fullsized":"2024-04-25T08:53:44.210018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356649+0000","last_change":"2024-04-25T08:53:42.209220+0000","last_active":"2024-04-25T08:53:45.356649+0000","last_peered":"2024-04-25T08:53:45.356649+0000","last_clean":"2024-04-25T08:53:45.356649+0000","last_became_active":"2024-04-25T08:53:42.208936+0000","last_became_peered":"2024-04-25T08:53:42.208936+0000","last_unstale":"2024-04-25T08:53:45.356649+0000","last_undegraded":"2024-04-25T08:53:45.356649+0000","last_fullsized":"2024-04-25T08:53:45.356649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:51.480879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:53:50.966 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:53:50.967 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T08:53:50.967 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T08:53:50.967 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T08:53:50.967 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T08:53:51.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.114+0000 7f63366e1640 1 Processor -- start 2024-04-25T08:53:51.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.114+0000 7f63366e1640 1 -- start start 2024-04-25T08:53:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.114+0000 7f63366e1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f633015dce0 0x7f63300d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.114+0000 7f63366e1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63300b5b60 0x7f63300b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.114+0000 7f63366e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633015e0c0 con 0x7f63300d35b0 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.114+0000 7f63366e1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63300d2510 con 0x7f633015dce0 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.114+0000 7f63366e1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63300d27f0 con 0x7f63300b5b60 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f63300d35b0 0x7f63300b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56854/0 (socket says 172.21.15.55:56854) 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632f7fe640 1 -- 172.21.15.55:0/2717561810 learned_addr learned my addr 172.21.15.55:0/2717561810 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f6334c7e640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63300b5b60 0x7f63300b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632ffff640 1 --2- 172.21.15.55:0/2717561810 >> v2:172.21.15.167:3300/0 conn(0x7f633015dce0 0x7f63300d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191530374 0 0) 0x7f633015e0c0 con 0x7f63300d35b0 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6318003520 con 0x7f63300d35b0 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3494914530 0 0) 0x7f6318003520 con 0x7f63300d35b0 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63300b5b60 msgr2=0x7f63300b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63300b5b60 0x7f63300b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 >> v2:172.21.15.167:3300/0 conn(0x7f633015dce0 msgr2=0x7f63300d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 --2- 172.21.15.55:0/2717561810 >> v2:172.21.15.167:3300/0 conn(0x7f633015dce0 0x7f63300d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63300d2ad0 con 0x7f63300d35b0 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f6324001670 con 0x7f63300d35b0 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 >> v1:172.21.15.55:6789/0 conn(0x7f63300d35b0 legacy=0x7f63300b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63180039b0 0x7f6318003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6318004800 0x7f6318004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63300b5b60 0x7f63180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63300d2510 con 0x7f63180039b0 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63300d27f0 con 0x7f6318004800 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631800b9c0 con 0x7f63300b5b60 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632ffff640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63180039b0 0x7f6318003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f632f7fe640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6318004800 0x7f6318004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.115+0000 7f6334c7e640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63300b5b60 0x7f63180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.116+0000 7f632ffff640 1 -- 172.21.15.55:0/2717561810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63300b5b60 msgr2=0x7f63180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.116+0000 7f632ffff640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63300b5b60 0x7f63180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.116+0000 7f632ffff640 1 -- 172.21.15.55:0/2717561810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6318004800 msgr2=0x7f6318004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.116+0000 7f632ffff640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6318004800 0x7f6318004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.116+0000 7f632ffff640 1 -- 172.21.15.55:0/2717561810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6318003520 con 0x7f63180039b0 2024-04-25T08:53:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.116+0000 7f632ffff640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63180039b0 0x7f6318003dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6320009ac0 tx=0x7f6318005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957d23043f19d1af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.116+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320036070 con 0x7f63180039b0 2024-04-25T08:53:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.117+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6320031400 con 0x7f63180039b0 2024-04-25T08:53:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.117+0000 7f632effd640 1 -- 172.21.15.55:0/2717561810 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320009690 con 0x7f63180039b0 2024-04-25T08:53:51.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.117+0000 7f63366e1640 1 -- 172.21.15.55:0/2717561810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63180039b0 msgr2=0x7f6318003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.117+0000 7f63366e1640 1 --2- 172.21.15.55:0/2717561810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63180039b0 0x7f6318003dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6320009ac0 tx=0x7f6318005830 comp rx=0 tx=0).stop 2024-04-25T08:53:51.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.117+0000 7f6334c7e640 1 -- 172.21.15.55:0/2717561810 reap_dead start 2024-04-25T08:53:51.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.117+0000 7f63366e1640 1 -- 172.21.15.55:0/2717561810 shutdown_connections 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.117+0000 7f63366e1640 1 -- 172.21.15.55:0/2717561810 >> 172.21.15.55:0/2717561810 conn(0x7f6330072900 msgr2=0x7f63300d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.117+0000 7f63366e1640 1 -- 172.21.15.55:0/2717561810 shutdown_connections 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.117+0000 7f63366e1640 1 -- 172.21.15.55:0/2717561810 wait complete. 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.118+0000 7f63366e1640 1 Processor -- start 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.119+0000 7f63366e1640 1 -- start start 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.119+0000 7f63366e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63180039b0 0x7f63300b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.119+0000 7f63366e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63300ccd40 0x7f63301f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.119+0000 7f63366e1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63301f3bf0 0x7f6330154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.119+0000 7f63366e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63300b9820 con 0x7f63300ccd40 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.119+0000 7f63366e1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63300d3090 con 0x7f63180039b0 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.119+0000 7f63366e1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63300b99a0 con 0x7f63301f3bf0 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.119+0000 7f632f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63300ccd40 0x7f63301f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.119+0000 7f632f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63300ccd40 0x7f63301f36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47828/0 (socket says 172.21.15.55:47828) 2024-04-25T08:53:51.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.119+0000 7f632f7fe640 1 -- 172.21.15.55:0/3165207185 learned_addr learned my addr 172.21.15.55:0/3165207185 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.119+0000 7f6334c7e640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63301f3bf0 0x7f6330154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f632ffff640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63180039b0 0x7f63300b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f632f7fe640 1 -- 172.21.15.55:0/3165207185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63301f3bf0 msgr2=0x7f6330154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f632f7fe640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63301f3bf0 0x7f6330154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f632f7fe640 1 -- 172.21.15.55:0/3165207185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63180039b0 msgr2=0x7f63300b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f632f7fe640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63180039b0 0x7f63300b7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f632f7fe640 1 -- 172.21.15.55:0/3165207185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63301f46b0 con 0x7f63300ccd40 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f632f7fe640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63300ccd40 0x7f63301f36b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6324007340 tx=0x7f6324007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f632cff9640 1 -- 172.21.15.55:0/3165207185 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632400f9c0 con 0x7f63300ccd40 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f632cff9640 1 -- 172.21.15.55:0/3165207185 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6324018070 con 0x7f63300ccd40 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f63366e1640 1 -- 172.21.15.55:0/3165207185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63301f40f0 con 0x7f63300ccd40 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f632cff9640 1 -- 172.21.15.55:0/3165207185 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632400fde0 con 0x7f63300ccd40 2024-04-25T08:53:51.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.120+0000 7f63366e1640 1 -- 172.21.15.55:0/3165207185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6330153b70 con 0x7f63300ccd40 2024-04-25T08:53:51.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.121+0000 7f63366e1640 1 -- 172.21.15.55:0/3165207185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63300749b0 con 0x7f63300ccd40 2024-04-25T08:53:51.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.122+0000 7f632cff9640 1 -- 172.21.15.55:0/3165207185 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f632401d460 con 0x7f63300ccd40 2024-04-25T08:53:51.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.122+0000 7f632cff9640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f631c06b4d0 0x7f631c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.122+0000 7f632cff9640 1 -- 172.21.15.55:0/3165207185 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f632408a130 con 0x7f63300ccd40 2024-04-25T08:53:51.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.122+0000 7f632ffff640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f631c06b4d0 0x7f631c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.123+0000 7f632ffff640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f631c06b4d0 0x7f631c06d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6320033000 tx=0x7f6320008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:51.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.126+0000 7f632cff9640 1 -- 172.21.15.55:0/3165207185 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f63240589f0 con 0x7f63300ccd40 2024-04-25T08:53:51.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.358+0000 7f63366e1640 1 -- 172.21.15.55:0/3165207185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f63300b3920 con 0x7f63300ccd40 2024-04-25T08:53:51.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.361+0000 7f632cff9640 1 -- 172.21.15.55:0/3165207185 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171785 (secure 0 0 0) 0x7f632405ca90 con 0x7f63300ccd40 2024-04-25T08:53:51.353 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 -- 172.21.15.55:0/3165207185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f631c06b4d0 msgr2=0x7f631c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f631c06b4d0 0x7f631c06d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6320033000 tx=0x7f6320008030 comp rx=0 tx=0).stop 2024-04-25T08:53:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 -- 172.21.15.55:0/3165207185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63300ccd40 msgr2=0x7f63301f36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63300ccd40 0x7f63301f36b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6324007340 tx=0x7f6324007800 comp rx=0 tx=0).stop 2024-04-25T08:53:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 -- 172.21.15.55:0/3165207185 shutdown_connections 2024-04-25T08:53:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f631c06b4d0 0x7f631c06d990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63301f3bf0 0x7f6330154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63300ccd40 0x7f63301f36b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 --2- 172.21.15.55:0/3165207185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63180039b0 0x7f63300b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 -- 172.21.15.55:0/3165207185 >> 172.21.15.55:0/3165207185 conn(0x7f6330072900 msgr2=0x7f633015d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:51.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 -- 172.21.15.55:0/3165207185 shutdown_connections 2024-04-25T08:53:51.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.364+0000 7f63366e1640 1 -- 172.21.15.55:0/3165207185 wait complete. 2024-04-25T08:53:51.365 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3452216423},{"type":"v1","addr":"172.21.15.55:6833","nonce":3452216423}]},"active_addr":"172.21.15.55:6833/3452216423","active_change":"2024-04-25T08:53:22.538487+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2689968184}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2699122979}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":1874195410}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":3386379400}]}]} 2024-04-25T08:53:51.368 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T08:53:51.368 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T08:53:51.368 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.480+0000 7fa42635c640 1 Processor -- start 2024-04-25T08:53:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.480+0000 7fa42635c640 1 -- start start 2024-04-25T08:53:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa42635c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa42015dce0 0x7fa4200d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa42635c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42015e0c0 con 0x7fa4200b5b60 2024-04-25T08:53:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa42635c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4200d2510 con 0x7fa4200d35b0 2024-04-25T08:53:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa42635c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4200d27f0 con 0x7fa42015dce0 2024-04-25T08:53:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa41ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa42015dce0 0x7fa4200d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa41ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa42015dce0 0x7fa4200d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47844/0 (socket says 172.21.15.55:47844) 2024-04-25T08:53:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa41ffff640 1 -- 172.21.15.55:0/4258509979 learned_addr learned my addr 172.21.15.55:0/4258509979 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa4248f9640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa4200b5b60 0x7fa4200b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56858/0 (socket says 172.21.15.55:56858) 2024-04-25T08:53:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa41ffff640 1 -- 172.21.15.55:0/4258509979 >> v1:172.21.15.167:6789/0 conn(0x7fa4200d35b0 legacy=0x7fa4200b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa41ffff640 1 -- 172.21.15.55:0/4258509979 >> v1:172.21.15.55:6789/0 conn(0x7fa4200b5b60 legacy=0x7fa4200b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa41ffff640 1 -- 172.21.15.55:0/4258509979 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4200d2ad0 con 0x7fa42015dce0 2024-04-25T08:53:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.481+0000 7fa41effd640 1 -- 172.21.15.55:0/4258509979 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847725046 0 0) 0x7fa42015e0c0 con 0x7fa4200b5b60 2024-04-25T08:53:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.482+0000 7fa41ffff640 1 --2- 172.21.15.55:0/4258509979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42015dce0 0x7fa4200d1a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa410009870 tx=0x7fa41002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1b5f606bbb66af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.482+0000 7fa41effd640 1 -- 172.21.15.55:0/4258509979 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410037070 con 0x7fa42015dce0 2024-04-25T08:53:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.482+0000 7fa41effd640 1 -- 172.21.15.55:0/4258509979 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa410032440 con 0x7fa42015dce0 2024-04-25T08:53:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.482+0000 7fa41effd640 1 -- 172.21.15.55:0/4258509979 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410032810 con 0x7fa42015dce0 2024-04-25T08:53:51.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.483+0000 7fa42635c640 1 -- 172.21.15.55:0/4258509979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42015dce0 msgr2=0x7fa4200d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.483+0000 7fa42635c640 1 --2- 172.21.15.55:0/4258509979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42015dce0 0x7fa4200d1a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa410009870 tx=0x7fa41002a2a0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.483+0000 7fa42635c640 1 -- 172.21.15.55:0/4258509979 shutdown_connections 2024-04-25T08:53:51.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.483+0000 7fa42635c640 1 --2- 172.21.15.55:0/4258509979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42015dce0 0x7fa4200d1a50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.483+0000 7fa42635c640 1 -- 172.21.15.55:0/4258509979 >> 172.21.15.55:0/4258509979 conn(0x7fa420072900 msgr2=0x7fa4200d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:51.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.483+0000 7fa42635c640 1 -- 172.21.15.55:0/4258509979 shutdown_connections 2024-04-25T08:53:51.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.483+0000 7fa42635c640 1 -- 172.21.15.55:0/4258509979 wait complete. 2024-04-25T08:53:51.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.484+0000 7fa42635c640 1 Processor -- start 2024-04-25T08:53:51.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.484+0000 7fa42635c640 1 -- start start 2024-04-25T08:53:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa42635c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4200b5b60 0x7fa42014bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa42635c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4200d35b0 0x7fa420160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa42635c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42015dce0 0x7fa4200b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa42635c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200b9820 con 0x7fa4200d35b0 2024-04-25T08:53:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa42635c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200d3090 con 0x7fa42015dce0 2024-04-25T08:53:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa42635c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200b99a0 con 0x7fa4200b5b60 2024-04-25T08:53:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa41f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4200d35b0 0x7fa420160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa41f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4200d35b0 0x7fa420160890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47850/0 (socket says 172.21.15.55:47850) 2024-04-25T08:53:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa41f7fe640 1 -- 172.21.15.55:0/2656139140 learned_addr learned my addr 172.21.15.55:0/2656139140 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa4248f9640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42015dce0 0x7fa4200b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa41ffff640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4200b5b60 0x7fa42014bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa41f7fe640 1 -- 172.21.15.55:0/2656139140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4200b5b60 msgr2=0x7fa42014bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa41f7fe640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4200b5b60 0x7fa42014bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa41f7fe640 1 -- 172.21.15.55:0/2656139140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42015dce0 msgr2=0x7fa4200b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa41f7fe640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42015dce0 0x7fa4200b7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa41f7fe640 1 -- 172.21.15.55:0/2656139140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42014c330 con 0x7fa4200d35b0 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa4248f9640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42015dce0 0x7fa4200b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.485+0000 7fa41f7fe640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4200d35b0 0x7fa420160890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa40800c400 tx=0x7fa40800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.486+0000 7fa41cff9640 1 -- 172.21.15.55:0/2656139140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408011790 con 0x7fa4200d35b0 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.486+0000 7fa41cff9640 1 -- 172.21.15.55:0/2656139140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa408017070 con 0x7fa4200d35b0 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.486+0000 7fa42635c640 1 -- 172.21.15.55:0/2656139140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42014e960 con 0x7fa4200d35b0 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.486+0000 7fa41cff9640 1 -- 172.21.15.55:0/2656139140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408011bb0 con 0x7fa4200d35b0 2024-04-25T08:53:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.486+0000 7fa42635c640 1 -- 172.21.15.55:0/2656139140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42014ef20 con 0x7fa4200d35b0 2024-04-25T08:53:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.487+0000 7fa42635c640 1 -- 172.21.15.55:0/2656139140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4200749b0 con 0x7fa4200d35b0 2024-04-25T08:53:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.487+0000 7fa41cff9640 1 -- 172.21.15.55:0/2656139140 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa40801c460 con 0x7fa4200d35b0 2024-04-25T08:53:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.487+0000 7fa41cff9640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa40006b4d0 0x7fa40006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.488+0000 7fa41cff9640 1 -- 172.21.15.55:0/2656139140 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa40808a0c0 con 0x7fa4200d35b0 2024-04-25T08:53:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.488+0000 7fa41ffff640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa40006b4d0 0x7fa40006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.488+0000 7fa41ffff640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa40006b4d0 0x7fa40006d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa410034000 tx=0x7fa41002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:51.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.492+0000 7fa41cff9640 1 -- 172.21.15.55:0/2656139140 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa42014c330 con 0x7fa4200d35b0 2024-04-25T08:53:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.676+0000 7fa42635c640 1 -- 172.21.15.55:0/2656139140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa42015d320 con 0x7fa4200d35b0 2024-04-25T08:53:51.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.677+0000 7fa41cff9640 1 -- 172.21.15.55:0/2656139140 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fa408058f40 con 0x7fa4200d35b0 2024-04-25T08:53:51.668 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:51.668 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 -- 172.21.15.55:0/2656139140 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa40006b4d0 msgr2=0x7fa40006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa40006b4d0 0x7fa40006d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa410034000 tx=0x7fa41002e000 comp rx=0 tx=0).stop 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 -- 172.21.15.55:0/2656139140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4200d35b0 msgr2=0x7fa420160890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4200d35b0 0x7fa420160890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa40800c400 tx=0x7fa40800c8c0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 -- 172.21.15.55:0/2656139140 shutdown_connections 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa40006b4d0 0x7fa40006d990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42015dce0 0x7fa4200b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4200d35b0 0x7fa420160890 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 --2- 172.21.15.55:0/2656139140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4200b5b60 0x7fa42014bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 -- 172.21.15.55:0/2656139140 >> 172.21.15.55:0/2656139140 conn(0x7fa420072900 msgr2=0x7fa4200b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 -- 172.21.15.55:0/2656139140 shutdown_connections 2024-04-25T08:53:51.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.679+0000 7fa42635c640 1 -- 172.21.15.55:0/2656139140 wait complete. 2024-04-25T08:53:51.681 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T08:53:51.681 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:51.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.791+0000 7f141045d640 1 Processor -- start 2024-04-25T08:53:51.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.791+0000 7f141045d640 1 -- start start 2024-04-25T08:53:51.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f141045d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f140815a870 0x7f14080cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f141045d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f140806e2e0 0x7f140815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f141045d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14080cdb10 con 0x7f14080cd580 2024-04-25T08:53:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f141045d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14080ce720 con 0x7f140806e2e0 2024-04-25T08:53:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f141045d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14080cddf0 con 0x7f140815a870 2024-04-25T08:53:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f140d9f8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f140806e2e0 0x7f140815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f140d9f8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f140806e2e0 0x7f140815ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47866/0 (socket says 172.21.15.55:47866) 2024-04-25T08:53:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f140d9f8640 1 -- 172.21.15.55:0/2928146621 learned_addr learned my addr 172.21.15.55:0/2928146621 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f140e1f9640 1 --2- 172.21.15.55:0/2928146621 >> v2:172.21.15.167:3300/0 conn(0x7f140815a870 0x7f14080cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f140d9f8640 1 -- 172.21.15.55:0/2928146621 >> v2:172.21.15.167:3300/0 conn(0x7f140815a870 msgr2=0x7f14080cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f140d9f8640 1 --2- 172.21.15.55:0/2928146621 >> v2:172.21.15.167:3300/0 conn(0x7f140815a870 0x7f14080cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f140d9f8640 1 -- 172.21.15.55:0/2928146621 >> v1:172.21.15.167:6789/0 conn(0x7f14080cd580 legacy=0x7f14080cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.792+0000 7f140d9f8640 1 -- 172.21.15.55:0/2928146621 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080ce0d0 con 0x7f140806e2e0 2024-04-25T08:53:51.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.793+0000 7f140d9f8640 1 --2- 172.21.15.55:0/2928146621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140806e2e0 0x7f140815ac50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f140806ba10 tx=0x7f13f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d975d106260a7dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:51.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.793+0000 7f140d1f7640 1 -- 172.21.15.55:0/2928146621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8037070 con 0x7f140806e2e0 2024-04-25T08:53:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.793+0000 7f140d1f7640 1 -- 172.21.15.55:0/2928146621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f8032440 con 0x7f140806e2e0 2024-04-25T08:53:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.793+0000 7f140d1f7640 1 -- 172.21.15.55:0/2928146621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8032810 con 0x7f140806e2e0 2024-04-25T08:53:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.794+0000 7f141045d640 1 -- 172.21.15.55:0/2928146621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140806e2e0 msgr2=0x7f140815ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.794+0000 7f141045d640 1 --2- 172.21.15.55:0/2928146621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140806e2e0 0x7f140815ac50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f140806ba10 tx=0x7f13f802a270 comp rx=0 tx=0).stop 2024-04-25T08:53:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.794+0000 7f141045d640 1 -- 172.21.15.55:0/2928146621 shutdown_connections 2024-04-25T08:53:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.794+0000 7f141045d640 1 --2- 172.21.15.55:0/2928146621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140806e2e0 0x7f140815ac50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.794+0000 7f141045d640 1 --2- 172.21.15.55:0/2928146621 >> v2:172.21.15.167:3300/0 conn(0x7f140815a870 0x7f14080cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.794+0000 7f141045d640 1 -- 172.21.15.55:0/2928146621 >> 172.21.15.55:0/2928146621 conn(0x7f140806aba0 msgr2=0x7f140806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.794+0000 7f141045d640 1 -- 172.21.15.55:0/2928146621 shutdown_connections 2024-04-25T08:53:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.794+0000 7f141045d640 1 -- 172.21.15.55:0/2928146621 wait complete. 2024-04-25T08:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.795+0000 7f141045d640 1 Processor -- start 2024-04-25T08:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.795+0000 7f141045d640 1 -- start start 2024-04-25T08:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f141045d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140806e2e0 0x7f14081e6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f141045d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14080cd580 0x7f14081f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f141045d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f140815a870 0x7f14081f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f141045d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080cfdc0 con 0x7f140806e2e0 2024-04-25T08:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f141045d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080cfc40 con 0x7f14080cd580 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f141045d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140815bf10 con 0x7f140815a870 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f140e1f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140806e2e0 0x7f14081e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f140e1f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140806e2e0 0x7f14081e6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47868/0 (socket says 172.21.15.55:47868) 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f140e1f9640 1 -- 172.21.15.55:0/3614954371 learned_addr learned my addr 172.21.15.55:0/3614954371 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f140e1f9640 1 -- 172.21.15.55:0/3614954371 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f140815a870 msgr2=0x7f14081f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f140e1f9640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f140815a870 0x7f14081f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f140e1f9640 1 -- 172.21.15.55:0/3614954371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14080cd580 msgr2=0x7f14081f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f140e1f9640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14080cd580 0x7f14081f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f140e1f9640 1 -- 172.21.15.55:0/3614954371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408144e80 con 0x7f140806e2e0 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f140e1f9640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140806e2e0 0x7f14081e6380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f140400d5f0 tx=0x7f140400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f13feffd640 1 -- 172.21.15.55:0/3614954371 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040125f0 con 0x7f140806e2e0 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f13feffd640 1 -- 172.21.15.55:0/3614954371 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404019070 con 0x7f140806e2e0 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f141045d640 1 -- 172.21.15.55:0/3614954371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1408157270 con 0x7f140806e2e0 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.796+0000 7f13feffd640 1 -- 172.21.15.55:0/3614954371 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040129d0 con 0x7f140806e2e0 2024-04-25T08:53:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.797+0000 7f141045d640 1 -- 172.21.15.55:0/3614954371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14080a9690 con 0x7f140806e2e0 2024-04-25T08:53:51.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.798+0000 7f141045d640 1 -- 172.21.15.55:0/3614954371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14080749b0 con 0x7f140806e2e0 2024-04-25T08:53:51.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.798+0000 7f13feffd640 1 -- 172.21.15.55:0/3614954371 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1404012b70 con 0x7f140806e2e0 2024-04-25T08:53:51.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.798+0000 7f13feffd640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13ec06b500 0x7f13ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:51.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.798+0000 7f140d9f8640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13ec06b500 0x7f13ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:51.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.799+0000 7f13feffd640 1 -- 172.21.15.55:0/3614954371 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f140408a540 con 0x7f140806e2e0 2024-04-25T08:53:51.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.799+0000 7f140d9f8640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13ec06b500 0x7f13ec06d9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034000 tx=0x7f13f802c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:51.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.803+0000 7f13feffd640 1 -- 172.21.15.55:0/3614954371 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1408144e80 con 0x7f140806e2e0 2024-04-25T08:53:51.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.986+0000 7f141045d640 1 -- 172.21.15.55:0/3614954371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14080a98d0 con 0x7f140806e2e0 2024-04-25T08:53:51.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.987+0000 7f13feffd640 1 -- 172.21.15.55:0/3614954371 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f1404059450 con 0x7f140806e2e0 2024-04-25T08:53:51.977 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:51.977 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:51.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 -- 172.21.15.55:0/3614954371 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13ec06b500 msgr2=0x7f13ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13ec06b500 0x7f13ec06d9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034000 tx=0x7f13f802c000 comp rx=0 tx=0).stop 2024-04-25T08:53:51.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 -- 172.21.15.55:0/3614954371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140806e2e0 msgr2=0x7f14081e6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:51.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140806e2e0 0x7f14081e6380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f140400d5f0 tx=0x7f140400dab0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 -- 172.21.15.55:0/3614954371 shutdown_connections 2024-04-25T08:53:51.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13ec06b500 0x7f13ec06d9c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f140815a870 0x7f14081f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14080cd580 0x7f14081f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 --2- 172.21.15.55:0/3614954371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140806e2e0 0x7f14081e6380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:51.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 -- 172.21.15.55:0/3614954371 >> 172.21.15.55:0/3614954371 conn(0x7f140806aba0 msgr2=0x7f140815d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:51.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 -- 172.21.15.55:0/3614954371 shutdown_connections 2024-04-25T08:53:51.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:51.989+0000 7f141045d640 1 -- 172.21.15.55:0/3614954371 wait complete. 2024-04-25T08:53:51.990 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T08:53:51.990 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T08:53:51.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T08:53:51.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T08:53:51.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T08:53:51.992 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T08:53:51.992 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T08:53:51.992 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T08:53:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.176+0000 7f6e20e38640 1 Processor -- start 2024-04-25T08:53:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.176+0000 7f6e20e38640 1 -- start start 2024-04-25T08:53:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.177+0000 7f1c865f1640 1 Processor -- start 2024-04-25T08:53:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.177+0000 7f1c865f1640 1 -- start start 2024-04-25T08:53:52.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.178+0000 7fa0ff59e640 1 Processor -- start 2024-04-25T08:53:52.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.178+0000 7ff2e3a07640 1 Processor -- start 2024-04-25T08:53:52.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.178+0000 7f06528cb640 1 Processor -- start 2024-04-25T08:53:52.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.178+0000 7ff2e3a07640 1 -- start start 2024-04-25T08:53:52.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.178+0000 7f8621f22640 1 Processor -- start 2024-04-25T08:53:52.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.178+0000 7f06528cb640 1 -- start start 2024-04-25T08:53:52.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.178+0000 7f8621f22640 1 -- start start 2024-04-25T08:53:52.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.178+0000 7fa0ff59e640 1 -- start start 2024-04-25T08:53:52.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f1c865f1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c780069d0 0x7f1c78006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f1c855ef640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1c780eacf0 0x7f1c7804fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58528/0 (socket says 172.21.15.55:58528) 2024-04-25T08:53:52.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f1c855ef640 1 -- 172.21.15.55:0/944908228 learned_addr learned my addr 172.21.15.55:0/944908228 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:52.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f1c865f1640 1 -- 172.21.15.55:0/944908228 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c78053710 con 0x7f1c78005e80 2024-04-25T08:53:52.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f1c865f1640 1 -- 172.21.15.55:0/944908228 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c780539f0 con 0x7f1c780eacf0 2024-04-25T08:53:52.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f1c865f1640 1 -- 172.21.15.55:0/944908228 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78054320 con 0x7f1c780069d0 2024-04-25T08:53:52.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7ff2e3a07640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2dc15dbe0 0x7ff2dc0ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f6e20e38640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6e1c0b5aa0 0x7f6e1c1635e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f6e20e38640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e1c165f50 0x7f6e1c166400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f6e20e38640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c0b3170 con 0x7f6e1c14bfc0 2024-04-25T08:53:52.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f6e20e38640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1c163150 con 0x7f6e1c0b5aa0 2024-04-25T08:53:52.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f6e20e38640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c166e10 con 0x7f6e1c165f50 2024-04-25T08:53:52.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f6e19d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6e1c0b5aa0 0x7f6e1c1635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f6e19d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6e1c0b5aa0 0x7f6e1c1635e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:38230/0 (socket says 172.21.15.55:38230) 2024-04-25T08:53:52.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f6e19d9b640 1 -- 172.21.15.55:0/3472642207 learned_addr learned my addr 172.21.15.55:0/3472642207 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7f6e1ad9d640 1 --2- 172.21.15.55:0/3472642207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e1c165f50 0x7f6e1c166400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7fc71ea3f640 1 Processor -- start 2024-04-25T08:53:52.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7fc71ea3f640 1 -- start start 2024-04-25T08:53:52.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420445139 0 0) 0x7f1c780539f0 con 0x7f1c780eacf0 2024-04-25T08:53:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7ff2e17a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2dc15dbe0 0x7ff2dc0ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7ff2e17a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2dc15dbe0 0x7ff2dc0ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47884/0 (socket says 172.21.15.55:47884) 2024-04-25T08:53:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7ff2e17a3640 1 -- 172.21.15.55:0/4137933444 learned_addr learned my addr 172.21.15.55:0/4137933444 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7ff2e3a07640 1 --2- 172.21.15.55:0/4137933444 >> v2:172.21.15.167:3300/0 conn(0x7ff2dc0d08b0 0x7ff2dc0b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c6c003520 con 0x7f1c780eacf0 2024-04-25T08:53:52.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7fa0ff59e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa10015aa10 0x7fa10015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7fa0ff59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1000b3730 0x7fa1000b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7fa0ff59e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10015d060 con 0x7fa1000b44b0 2024-04-25T08:53:52.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7ff2e3a07640 1 -- 172.21.15.55:0/4137933444 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc15dfc0 con 0x7ff2dc0cf530 2024-04-25T08:53:52.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7ff2e3a07640 1 -- 172.21.15.55:0/4137933444 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc0d2420 con 0x7ff2dc15dbe0 2024-04-25T08:53:52.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7ff2e3a07640 1 -- 172.21.15.55:0/4137933444 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc0d1530 con 0x7ff2dc0d08b0 2024-04-25T08:53:52.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7fa0ff59e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10009b5a0 con 0x7fa10015aa10 2024-04-25T08:53:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.179+0000 7fa0ff59e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10015be00 con 0x7fa1000b3730 2024-04-25T08:53:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7fa0fe59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa10015aa10 0x7fa10015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7fa0fe59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa10015aa10 0x7fa10015c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:38240/0 (socket says 172.21.15.55:38240) 2024-04-25T08:53:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7fa0fe59c640 1 -- 172.21.15.55:0/2491133649 learned_addr learned my addr 172.21.15.55:0/2491133649 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7fa0fdd9b640 1 --2- 172.21.15.55:0/2491133649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1000b3730 0x7fa1000b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f8621f22640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8614050190 0x7f8614038070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f861b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f86140df210 0x7f861404fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56876/0 (socket says 172.21.15.55:56876) 2024-04-25T08:53:52.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f6e1ad9d640 1 -- 172.21.15.55:0/3472642207 >> v2:172.21.15.167:3300/0 conn(0x7f6e1c0b5aa0 msgr2=0x7f6e1c1635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f6e1ad9d640 1 --2- 172.21.15.55:0/3472642207 >> v2:172.21.15.167:3300/0 conn(0x7f6e1c0b5aa0 0x7f6e1c1635e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f6e1ad9d640 1 -- 172.21.15.55:0/3472642207 >> v1:172.21.15.55:6789/0 conn(0x7f6e1c14bfc0 legacy=0x7f6e1c0b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7fa0fe59c640 1 -- 172.21.15.55:0/2491133649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1000b3730 msgr2=0x7fa1000b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7fa0fe59c640 1 --2- 172.21.15.55:0/2491133649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1000b3730 0x7fa1000b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7fa0fe59c640 1 -- 172.21.15.55:0/2491133649 >> v1:172.21.15.167:6789/0 conn(0x7fa1000b44b0 legacy=0x7fa10006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7fa0fe59c640 1 -- 172.21.15.55:0/2491133649 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10015d340 con 0x7fa10015aa10 2024-04-25T08:53:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7fa0fdd9b640 1 --2- 172.21.15.55:0/2491133649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1000b3730 0x7fa1000b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651180484 0 0) 0x7f1c6c003520 con 0x7f1c780eacf0 2024-04-25T08:53:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f06528cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f064c0b3240 0x7f064c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f06528cb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f064c162e30 0x7f064c163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f6e1ad9d640 1 -- 172.21.15.55:0/3472642207 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c166b30 con 0x7f6e1c165f50 2024-04-25T08:53:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f06528cb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c06e3f0 con 0x7f064c071fc0 2024-04-25T08:53:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f06528cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c06e6d0 con 0x7f064c0b3240 2024-04-25T08:53:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f06528cb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c06e9b0 con 0x7f064c162e30 2024-04-25T08:53:52.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c780069d0 msgr2=0x7f1c78006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f1c85df0640 1 --2- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c780069d0 0x7f1c78006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f4945b27640 1 Processor -- start 2024-04-25T08:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f8621f22640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86140544b0 con 0x7f86140df210 2024-04-25T08:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f8621f22640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86140541d0 con 0x7f8614053c60 2024-04-25T08:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f8621f22640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8614005f20 con 0x7f8614050190 2024-04-25T08:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f861bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f8614053c60 0x7f8614006a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58542/0 (socket says 172.21.15.55:58542) 2024-04-25T08:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.180+0000 7f861bfff640 1 -- 172.21.15.55:0/3662178914 learned_addr learned my addr 172.21.15.55:0/3662178914 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f861affd640 1 --2- 172.21.15.55:0/3662178914 >> v2:172.21.15.167:3300/0 conn(0x7f8614050190 0x7f8614038070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f0650e68640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f064c162e30 0x7f064c163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f064b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f064c0b3240 0x7f064c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f0650e68640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f064c162e30 0x7f064c163280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:38280/0 (socket says 172.21.15.55:38280) 2024-04-25T08:53:52.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f0650e68640 1 -- 172.21.15.55:0/3225272526 learned_addr learned my addr 172.21.15.55:0/3225272526 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f064bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f064c071fc0 0x7f064c06d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58556/0 (socket says 172.21.15.55:58556) 2024-04-25T08:53:52.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7fc71ea3f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc7180b6020 0x7fc7180b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f4945b27640 1 -- start start 2024-04-25T08:53:52.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f1c77fff640 1 --2- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c780069d0 0x7f1c78006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7fc717fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc718161f70 0x7fc7180d32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58562/0 (socket says 172.21.15.55:58562) 2024-04-25T08:53:52.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f861affd640 1 -- 172.21.15.55:0/3662178914 >> v1:172.21.15.167:6789/0 conn(0x7f8614053c60 legacy=0x7f8614006a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f861affd640 1 -- 172.21.15.55:0/3662178914 >> v1:172.21.15.55:6789/0 conn(0x7f86140df210 legacy=0x7f861404fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f861affd640 1 -- 172.21.15.55:0/3662178914 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8614006200 con 0x7f8614050190 2024-04-25T08:53:52.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f6e1ad9d640 1 --2- 172.21.15.55:0/3472642207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e1c165f50 0x7f6e1c166400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009d90 tx=0x7f6e1402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfb01187c1e11f40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7fc7177fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc718162350 0x7fc7180b5910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56888/0 (socket says 172.21.15.55:56888) 2024-04-25T08:53:52.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7fc71ea3f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7180b7b60 con 0x7fc718162350 2024-04-25T08:53:52.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7fc71ea3f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7180b7e20 con 0x7fc718161f70 2024-04-25T08:53:52.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7fc71ea3f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7180b8100 con 0x7fc7180b6020 2024-04-25T08:53:52.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7fc717fff640 1 -- 172.21.15.55:0/2738741040 learned_addr learned my addr 172.21.15.55:0/2738741040 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 >> v1:172.21.15.55:6789/0 conn(0x7f1c78005e80 legacy=0x7f1c780062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c78053cd0 con 0x7f1c780eacf0 2024-04-25T08:53:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f1c800627f0 con 0x7f1c780eacf0 2024-04-25T08:53:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 >> v1:172.21.15.167:6789/0 conn(0x7f1c780eacf0 legacy=0x7f1c7804fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f1c77fff640 1 --2- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c0039b0 0x7f1c6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f1c77fff640 1 --2- 172.21.15.55:0/944908228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c004800 0x7f1c6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7fc71cfdc640 1 --2- 172.21.15.55:0/2738741040 >> v2:172.21.15.167:3300/0 conn(0x7fc7180b6020 0x7fc7180b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f1c77fff640 1 --2- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c6c0051c0 0x7f1c6c00b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78054320 con 0x7f1c6c004800 2024-04-25T08:53:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c00bf50 con 0x7f1c6c0051c0 2024-04-25T08:53:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c00c150 con 0x7f1c6c0039b0 2024-04-25T08:53:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7ff2e1fa4640 1 --2- 172.21.15.55:0/4137933444 >> v2:172.21.15.167:3300/0 conn(0x7ff2dc0d08b0 0x7ff2dc0b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7ff2e17a3640 1 -- 172.21.15.55:0/4137933444 >> v2:172.21.15.167:3300/0 conn(0x7ff2dc0d08b0 msgr2=0x7ff2dc0b8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7ff2e17a3640 1 --2- 172.21.15.55:0/4137933444 >> v2:172.21.15.167:3300/0 conn(0x7ff2dc0d08b0 0x7ff2dc0b8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7ff2d3fff640 1 -- 172.21.15.55:0/4137933444 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297281925 0 0) 0x7ff2dc15dfc0 con 0x7ff2dc0cf530 2024-04-25T08:53:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7ff2e17a3640 1 -- 172.21.15.55:0/4137933444 >> v1:172.21.15.167:6789/0 conn(0x7ff2dc0cf530 legacy=0x7ff2dc0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.181+0000 7ff2e17a3640 1 -- 172.21.15.55:0/4137933444 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc0d1810 con 0x7ff2dc15dbe0 2024-04-25T08:53:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f6e1959a640 1 -- 172.21.15.55:0/3472642207 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14007740 con 0x7f6e1c165f50 2024-04-25T08:53:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f6e1959a640 1 -- 172.21.15.55:0/3472642207 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e140078e0 con 0x7f6e1c165f50 2024-04-25T08:53:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f6e1959a640 1 -- 172.21.15.55:0/3472642207 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14007cb0 con 0x7f6e1c165f50 2024-04-25T08:53:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980153321 0 0) 0x7fc7180b7b60 con 0x7fc718162350 2024-04-25T08:53:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f1c855ef640 1 --2- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c0039b0 0x7f1c6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc704003520 con 0x7fc718162350 2024-04-25T08:53:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f0650e68640 1 -- 172.21.15.55:0/3225272526 >> v2:172.21.15.55:3300/0 conn(0x7f064c0b3240 msgr2=0x7f064c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f1c85df0640 1 --2- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c780069d0 0x7f1c78006e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227940502 0 0) 0x7fc7180b7e20 con 0x7fc718161f70 2024-04-25T08:53:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7ff2e17a3640 1 --2- 172.21.15.55:0/4137933444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc15dbe0 0x7ff2dc0ceff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0686d0 tx=0x7ff2d8032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b792471ceaaeaba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f0650e68640 1 --2- 172.21.15.55:0/3225272526 >> v2:172.21.15.55:3300/0 conn(0x7f064c0b3240 0x7f064c0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7180b7b60 con 0x7fc718161f70 2024-04-25T08:53:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f064affd640 1 -- 172.21.15.55:0/3225272526 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571406191 0 0) 0x7f064c06e3f0 con 0x7f064c071fc0 2024-04-25T08:53:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f0650e68640 1 -- 172.21.15.55:0/3225272526 >> v1:172.21.15.167:6789/0 conn(0x7f064c071fc0 legacy=0x7f064c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f4945b27640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400b3500 0x7f4940166380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f4945b27640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49400cea30 0x7f494006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f4945b27640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4940162140 con 0x7f4940161d60 2024-04-25T08:53:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f4945b27640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49400b2470 con 0x7f49400cea30 2024-04-25T08:53:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f4945b27640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4940165ef0 con 0x7f49400b3500 2024-04-25T08:53:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3442287645 0 0) 0x7fc704003520 con 0x7fc718162350 2024-04-25T08:53:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 >> v2:172.21.15.167:3300/0 conn(0x7fc7180b6020 msgr2=0x7fc7180b8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7fc716ffd640 1 --2- 172.21.15.55:0/2738741040 >> v2:172.21.15.167:3300/0 conn(0x7fc7180b6020 0x7fc7180b8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f1c855ef640 1 -- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c6c0051c0 msgr2=0x7f1c6c00b9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T08:53:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f1c855ef640 1 --2- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c6c0051c0 0x7f1c6c00b9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f1c855ef640 1 -- 172.21.15.55:0/944908228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c004800 msgr2=0x7f1c6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f1c855ef640 1 --2- 172.21.15.55:0/944908228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c004800 0x7f1c6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f1c855ef640 1 -- 172.21.15.55:0/944908228 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c78053cd0 con 0x7f1c6c0039b0 2024-04-25T08:53:52.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.182+0000 7f0650e68640 1 -- 172.21.15.55:0/3225272526 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c162910 con 0x7f064c162e30 2024-04-25T08:53:52.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 >> v1:172.21.15.167:6789/0 conn(0x7fc718161f70 legacy=0x7fc7180d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7180b83e0 con 0x7fc718162350 2024-04-25T08:53:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7ff2d3fff640 1 -- 172.21.15.55:0/4137933444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8040070 con 0x7ff2dc15dbe0 2024-04-25T08:53:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7ff2d3fff640 1 -- 172.21.15.55:0/4137933444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8033790 con 0x7ff2dc15dbe0 2024-04-25T08:53:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7ff2d3fff640 1 -- 172.21.15.55:0/4137933444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8033b60 con 0x7ff2dc15dbe0 2024-04-25T08:53:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f493ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400b3500 0x7f4940166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f493ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400b3500 0x7f4940166380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:51444/0 (socket says 172.21.15.55:51444) 2024-04-25T08:53:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f493ffff640 1 -- 172.21.15.55:0/2841390226 learned_addr learned my addr 172.21.15.55:0/2841390226 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc708001670 con 0x7fc718162350 2024-04-25T08:53:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f6e20e38640 1 -- 172.21.15.55:0/3472642207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e1c165f50 msgr2=0x7f6e1c166400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f6e20e38640 1 --2- 172.21.15.55:0/3472642207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e1c165f50 0x7f6e1c166400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009d90 tx=0x7f6e1402a660 comp rx=0 tx=0).stop 2024-04-25T08:53:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f0650e68640 1 --2- 172.21.15.55:0/3225272526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064c162e30 0x7f064c163280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f064c166c30 tx=0x7f064402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7e858006e3571a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7fa0fe59c640 1 --2- 172.21.15.55:0/2491133649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa10015aa10 0x7fa10015c9d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800ffd0 tx=0x7fa0f802a590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeda7da55977c97b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 >> v1:172.21.15.55:6789/0 conn(0x7fc718162350 legacy=0x7fc7180b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7fc716ffd640 1 --2- 172.21.15.55:0/2738741040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc704003b70 0x7fc704003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f4945326640 1 --2- 172.21.15.55:0/2841390226 >> v2:172.21.15.55:3300/0 conn(0x7f49400cea30 0x7f494006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f493ffff640 1 -- 172.21.15.55:0/2841390226 >> v2:172.21.15.55:3300/0 conn(0x7f49400cea30 msgr2=0x7f494006dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f493ffff640 1 --2- 172.21.15.55:0/2841390226 >> v2:172.21.15.55:3300/0 conn(0x7f49400cea30 0x7f494006dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f493ffff640 1 -- 172.21.15.55:0/2841390226 >> v1:172.21.15.55:6789/0 conn(0x7f4940161d60 legacy=0x7f49400b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7fc716ffd640 1 --2- 172.21.15.55:0/2738741040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc704004800 0x7fc704004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f064affd640 1 -- 172.21.15.55:0/3225272526 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644037070 con 0x7f064c162e30 2024-04-25T08:53:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f493ffff640 1 -- 172.21.15.55:0/2841390226 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49400cf210 con 0x7f49400b3500 2024-04-25T08:53:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f4945326640 1 --2- 172.21.15.55:0/2841390226 >> v2:172.21.15.55:3300/0 conn(0x7f49400cea30 0x7f494006dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7fc716ffd640 1 --2- 172.21.15.55:0/2738741040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 0x7fc70400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f064affd640 1 -- 172.21.15.55:0/3225272526 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0644032440 con 0x7f064c162e30 2024-04-25T08:53:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f064affd640 1 -- 172.21.15.55:0/3225272526 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644037070 con 0x7f064c162e30 2024-04-25T08:53:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7fa0fd59a640 1 -- 172.21.15.55:0/2491133649 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8036070 con 0x7fa10015aa10 2024-04-25T08:53:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7fa0fd59a640 1 -- 172.21.15.55:0/2491133649 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f8003b90 con 0x7fa10015aa10 2024-04-25T08:53:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180b8100 con 0x7fc7040051c0 2024-04-25T08:53:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70400c0f0 con 0x7fc704004800 2024-04-25T08:53:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7f1c855ef640 1 --2- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c0039b0 0x7f1c6c003d90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c80062780 tx=0x7f1c6c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17f300aec59819ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.183+0000 7f861affd640 1 --2- 172.21.15.55:0/3662178914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8614050190 0x7f8614038070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8608009720 tx=0x7f860802a030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe2ad353e288e921 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7fa0fd59a640 1 -- 172.21.15.55:0/2491133649 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8004030 con 0x7fa10015aa10 2024-04-25T08:53:52.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70400c2f0 con 0x7fc704003b70 2024-04-25T08:53:52.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7ff2e3a07640 1 -- 172.21.15.55:0/4137933444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc15dbe0 msgr2=0x7ff2dc0ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7ff2e3a07640 1 --2- 172.21.15.55:0/4137933444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc15dbe0 0x7ff2dc0ceff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0686d0 tx=0x7ff2d8032c50 comp rx=0 tx=0).stop 2024-04-25T08:53:52.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7f861a7fc640 1 -- 172.21.15.55:0/3662178914 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608037070 con 0x7f8614050190 2024-04-25T08:53:52.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7f861a7fc640 1 -- 172.21.15.55:0/3662178914 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860802ad40 con 0x7f8614050190 2024-04-25T08:53:52.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7f861a7fc640 1 -- 172.21.15.55:0/3662178914 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608037070 con 0x7f8614050190 2024-04-25T08:53:52.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7fc717fff640 1 --2- 172.21.15.55:0/2738741040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc704003b70 0x7fc704003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7fc7177fe640 1 --2- 172.21.15.55:0/2738741040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc704004800 0x7fc704004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7fc71cfdc640 1 --2- 172.21.15.55:0/2738741040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 0x7fc70400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7f493ffff640 1 --2- 172.21.15.55:0/2841390226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400b3500 0x7f4940166380 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4934009870 tx=0x7f493402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d02a4bbfd119ad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f06528cb640 1 -- 172.21.15.55:0/3225272526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064c162e30 msgr2=0x7f064c163280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f06528cb640 1 --2- 172.21.15.55:0/3225272526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064c162e30 0x7f064c163280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f064c166c30 tx=0x7f064402a270 comp rx=0 tx=0).stop 2024-04-25T08:53:52.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7f6e20e38640 1 -- 172.21.15.55:0/3472642207 shutdown_connections 2024-04-25T08:53:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7f6e20e38640 1 --2- 172.21.15.55:0/3472642207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e1c165f50 0x7f6e1c166400 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7f6e20e38640 1 --2- 172.21.15.55:0/3472642207 >> v2:172.21.15.167:3300/0 conn(0x7f6e1c0b5aa0 0x7f6e1c1635e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.184+0000 7f6e20e38640 1 -- 172.21.15.55:0/3472642207 >> 172.21.15.55:0/3472642207 conn(0x7f6e1c0d0390 msgr2=0x7f6e1c0d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7fa0ff59e640 1 -- 172.21.15.55:0/2491133649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa10015aa10 msgr2=0x7fa10015c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7fa0ff59e640 1 --2- 172.21.15.55:0/2491133649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa10015aa10 0x7fa10015c9d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800ffd0 tx=0x7fa0f802a590 comp rx=0 tx=0).stop 2024-04-25T08:53:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7ff2e3a07640 1 -- 172.21.15.55:0/4137933444 shutdown_connections 2024-04-25T08:53:52.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8006cbc0 con 0x7f1c6c0039b0 2024-04-25T08:53:52.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8006ac60 con 0x7f1c6c0039b0 2024-04-25T08:53:52.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f1c77fff640 1 -- 172.21.15.55:0/944908228 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8006c2d0 con 0x7f1c6c0039b0 2024-04-25T08:53:52.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7ff2e3a07640 1 --2- 172.21.15.55:0/4137933444 >> v2:172.21.15.167:3300/0 conn(0x7ff2dc0d08b0 0x7ff2dc0b8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f493f7fe640 1 -- 172.21.15.55:0/2841390226 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934037070 con 0x7f49400b3500 2024-04-25T08:53:52.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f6e20e38640 1 -- 172.21.15.55:0/3472642207 shutdown_connections 2024-04-25T08:53:52.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f493f7fe640 1 -- 172.21.15.55:0/2841390226 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4934032440 con 0x7f49400b3500 2024-04-25T08:53:52.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f6e20e38640 1 -- 172.21.15.55:0/3472642207 wait complete. 2024-04-25T08:53:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7ff2e3a07640 1 --2- 172.21.15.55:0/4137933444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc15dbe0 0x7ff2dc0ceff0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7ff2e3a07640 1 -- 172.21.15.55:0/4137933444 >> 172.21.15.55:0/4137933444 conn(0x7ff2dc08afd0 msgr2=0x7ff2dc0d3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7fc71cfdc640 1 -- 172.21.15.55:0/2738741040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc704003b70 msgr2=0x7fc704003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7fc71cfdc640 1 --2- 172.21.15.55:0/2738741040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc704003b70 0x7fc704003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f8621f22640 1 -- 172.21.15.55:0/3662178914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8614050190 msgr2=0x7f8614038070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f8621f22640 1 --2- 172.21.15.55:0/3662178914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8614050190 0x7f8614038070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8608009720 tx=0x7f860802a030 comp rx=0 tx=0).stop 2024-04-25T08:53:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7fc71cfdc640 1 -- 172.21.15.55:0/2738741040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc704004800 msgr2=0x7fc704004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7fc71cfdc640 1 --2- 172.21.15.55:0/2738741040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc704004800 0x7fc704004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7fc71cfdc640 1 -- 172.21.15.55:0/2738741040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc704003520 con 0x7fc7040051c0 2024-04-25T08:53:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7ff2e3a07640 1 -- 172.21.15.55:0/4137933444 shutdown_connections 2024-04-25T08:53:52.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f493f7fe640 1 -- 172.21.15.55:0/2841390226 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934032810 con 0x7f49400b3500 2024-04-25T08:53:52.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7ff2e3a07640 1 -- 172.21.15.55:0/4137933444 wait complete. 2024-04-25T08:53:52.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f8621f22640 1 -- 172.21.15.55:0/3662178914 shutdown_connections 2024-04-25T08:53:52.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f8621f22640 1 --2- 172.21.15.55:0/3662178914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8614050190 0x7f8614038070 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f8621f22640 1 -- 172.21.15.55:0/3662178914 >> 172.21.15.55:0/3662178914 conn(0x7f8614009fa0 msgr2=0x7f861400a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f06528cb640 1 -- 172.21.15.55:0/3225272526 shutdown_connections 2024-04-25T08:53:52.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f06528cb640 1 --2- 172.21.15.55:0/3225272526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064c162e30 0x7f064c163280 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f06528cb640 1 --2- 172.21.15.55:0/3225272526 >> v2:172.21.15.55:3300/0 conn(0x7f064c0b3240 0x7f064c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.185+0000 7f06528cb640 1 -- 172.21.15.55:0/3225272526 >> 172.21.15.55:0/3225272526 conn(0x7f064c06aba0 msgr2=0x7f064c06af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f8621f22640 1 -- 172.21.15.55:0/3662178914 shutdown_connections 2024-04-25T08:53:52.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f8621f22640 1 -- 172.21.15.55:0/3662178914 wait complete. 2024-04-25T08:53:52.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f1c865f1640 1 -- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c0039b0 msgr2=0x7f1c6c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f1c865f1640 1 --2- 172.21.15.55:0/944908228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c0039b0 0x7f1c6c003d90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c80062780 tx=0x7f1c6c005830 comp rx=0 tx=0).stop 2024-04-25T08:53:52.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f1c85df0640 1 -- 172.21.15.55:0/944908228 reap_dead start 2024-04-25T08:53:52.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f4945b27640 1 -- 172.21.15.55:0/2841390226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400b3500 msgr2=0x7f4940166380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f4945b27640 1 --2- 172.21.15.55:0/2841390226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400b3500 0x7f4940166380 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4934009870 tx=0x7f493402a1c0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f4945b27640 1 -- 172.21.15.55:0/2841390226 shutdown_connections 2024-04-25T08:53:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f4945b27640 1 --2- 172.21.15.55:0/2841390226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400b3500 0x7f4940166380 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4934009870 tx=0x7f493402a1c0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f4945b27640 1 --2- 172.21.15.55:0/2841390226 >> v2:172.21.15.55:3300/0 conn(0x7f49400cea30 0x7f494006dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f4945b27640 1 -- 172.21.15.55:0/2841390226 >> 172.21.15.55:0/2841390226 conn(0x7f4940066ff0 msgr2=0x7f49400b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7fa0ff59e640 1 -- 172.21.15.55:0/2491133649 shutdown_connections 2024-04-25T08:53:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7fa0ff59e640 1 --2- 172.21.15.55:0/2491133649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1000b3730 0x7fa1000b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7fa0ff59e640 1 --2- 172.21.15.55:0/2491133649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa10015aa10 0x7fa10015c9d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7fa0ff59e640 1 -- 172.21.15.55:0/2491133649 >> 172.21.15.55:0/2491133649 conn(0x7fa1000b59c0 msgr2=0x7fa1000b5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7fa0ff59e640 1 -- 172.21.15.55:0/2491133649 shutdown_connections 2024-04-25T08:53:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7fa0ff59e640 1 -- 172.21.15.55:0/2491133649 wait complete. 2024-04-25T08:53:52.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7fc71cfdc640 1 -- 172.21.15.55:0/2738741040 reap_dead start 2024-04-25T08:53:52.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f1c865f1640 1 -- 172.21.15.55:0/944908228 shutdown_connections 2024-04-25T08:53:52.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f1c865f1640 1 -- 172.21.15.55:0/944908228 >> 172.21.15.55:0/944908228 conn(0x7f1c78009fa0 msgr2=0x7f1c7800a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7fc71cfdc640 1 --2- 172.21.15.55:0/2738741040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 0x7fc70400b9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc70000ba30 tx=0x7fc704005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed91e9c656e4637 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f1c865f1640 1 -- 172.21.15.55:0/944908228 shutdown_connections 2024-04-25T08:53:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.187+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700030070 con 0x7fc7040051c0 2024-04-25T08:53:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.187+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70002ae50 con 0x7fc7040051c0 2024-04-25T08:53:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.187+0000 7fc716ffd640 1 -- 172.21.15.55:0/2738741040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70000b600 con 0x7fc7040051c0 2024-04-25T08:53:52.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.187+0000 7ff2e3a07640 1 Processor -- start 2024-04-25T08:53:52.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.187+0000 7ff2e3a07640 1 -- start start 2024-04-25T08:53:52.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.187+0000 7f6e20e38640 1 Processor -- start 2024-04-25T08:53:52.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.187+0000 7f6e20e38640 1 -- start start 2024-04-25T08:53:52.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.188+0000 7fa0ff59e640 1 Processor -- start 2024-04-25T08:53:52.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.188+0000 7fa0ff59e640 1 -- start start 2024-04-25T08:53:52.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.188+0000 7f8621f22640 1 Processor -- start 2024-04-25T08:53:52.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f06528cb640 1 -- 172.21.15.55:0/3225272526 shutdown_connections 2024-04-25T08:53:52.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.188+0000 7fc71ea3f640 1 -- 172.21.15.55:0/2738741040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 msgr2=0x7fc70400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.188+0000 7fc71ea3f640 1 --2- 172.21.15.55:0/2738741040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 0x7fc70400b9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc70000ba30 tx=0x7fc704005830 comp rx=0 tx=0).stop 2024-04-25T08:53:52.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f4945b27640 1 -- 172.21.15.55:0/2841390226 shutdown_connections 2024-04-25T08:53:52.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f4945b27640 1 -- 172.21.15.55:0/2841390226 wait complete. 2024-04-25T08:53:52.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.188+0000 7f8621f22640 1 -- start start 2024-04-25T08:53:52.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f06528cb640 1 -- 172.21.15.55:0/3225272526 wait complete. 2024-04-25T08:53:52.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.188+0000 7f06528cb640 1 Processor -- start 2024-04-25T08:53:52.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.186+0000 7f1c865f1640 1 -- 172.21.15.55:0/944908228 wait complete. 2024-04-25T08:53:52.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.188+0000 7f06528cb640 1 -- start start 2024-04-25T08:53:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.188+0000 7f1c865f1640 1 Processor -- start 2024-04-25T08:53:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.188+0000 7ff2e3a07640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc0cf530 0x7ff2dc159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7fc71ea3f640 1 -- 172.21.15.55:0/2738741040 shutdown_connections 2024-04-25T08:53:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7fc71ea3f640 1 --2- 172.21.15.55:0/2738741040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 0x7fc70400b9c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7fc71ea3f640 1 -- 172.21.15.55:0/2738741040 >> 172.21.15.55:0/2738741040 conn(0x7fc7180d0960 msgr2=0x7fc7180d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7f1c865f1640 1 -- start start 2024-04-25T08:53:52.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7ff2e17a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc0cf530 0x7ff2dc159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7ff2e17a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc0cf530 0x7ff2dc159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47934/0 (socket says 172.21.15.55:47934) 2024-04-25T08:53:52.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7ff2e17a3640 1 -- 172.21.15.55:0/231841509 learned_addr learned my addr 172.21.15.55:0/231841509 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7ff2e3a07640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2dc0d08b0 0x7ff2dc0caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7f6e20e38640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c0b5aa0 0x7f6e1c14ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7f4945b27640 1 Processor -- start 2024-04-25T08:53:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7ff2e3a07640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2dc15dbe0 0x7ff2dc15f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7f6e20e38640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e1c14bfc0 0x7f6e1c071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0d20b0 con 0x7ff2dc0cf530 2024-04-25T08:53:52.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7f6e1a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c0b5aa0 0x7f6e1c14ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7f6e1a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c0b5aa0 0x7f6e1c14ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47950/0 (socket says 172.21.15.55:47950) 2024-04-25T08:53:52.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7fa0ff59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1000b3730 0x7fa1001508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0d1dd0 con 0x7ff2dc15dbe0 2024-04-25T08:53:52.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7fa0ff59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1000b44b0 0x7fa1001529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0d28b0 con 0x7ff2dc0d08b0 2024-04-25T08:53:52.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7fa0ff59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa10015aa10 0x7fa10014ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7fa0ff59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10015dbe0 con 0x7fa1000b44b0 2024-04-25T08:53:52.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f8621f22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8614050190 0x7f86140ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7ff2e1fa4640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2dc15dbe0 0x7ff2dc15f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7ff2e0fa2640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2dc0d08b0 0x7ff2dc0caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.189+0000 7f6e1a59c640 1 -- 172.21.15.55:0/3052627186 learned_addr learned my addr 172.21.15.55:0/3052627186 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f6e20e38640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e1c165f50 0x7f6e1c0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f6e19d9b640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e1c14bfc0 0x7f6e1c071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f8621f22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8614053c60 0x7f86140485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f6e20e38640 1 -- 172.21.15.55:0/3052627186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0d14e0 con 0x7f6e1c0b5aa0 2024-04-25T08:53:52.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f6e20e38640 1 -- 172.21.15.55:0/3052627186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c162de0 con 0x7f6e1c165f50 2024-04-25T08:53:52.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f8621f22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86140df210 0x7f8614048b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f6e20e38640 1 -- 172.21.15.55:0/3052627186 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0d1660 con 0x7f6e1c14bfc0 2024-04-25T08:53:52.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f06528cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064c071fc0 0x7f064c152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f06528cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064c0b3240 0x7f064c0ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f6e1ad9d640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e1c165f50 0x7f6e1c0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f8621f22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8614037a80 con 0x7f86140df210 2024-04-25T08:53:52.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7fa0fe59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1000b3730 0x7fa1001508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f861bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86140df210 0x7f8614048b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f861b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8614050190 0x7f86140ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f861bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86140df210 0x7f8614048b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47958/0 (socket says 172.21.15.55:47958) 2024-04-25T08:53:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f861bfff640 1 -- 172.21.15.55:0/4111887975 learned_addr learned my addr 172.21.15.55:0/4111887975 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f06528cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f064c162e30 0x7f064c0b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f8621f22640 1 -- 172.21.15.55:0/4111887975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8614037900 con 0x7f8614050190 2024-04-25T08:53:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f06528cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c162590 con 0x7f064c162e30 2024-04-25T08:53:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f8621f22640 1 -- 172.21.15.55:0/4111887975 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86140df5f0 con 0x7f8614053c60 2024-04-25T08:53:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f06528cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c06e0b0 con 0x7f064c071fc0 2024-04-25T08:53:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f06528cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0713c0 con 0x7f064c0b3240 2024-04-25T08:53:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f4945b27640 1 -- start start 2024-04-25T08:53:52.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f861affd640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8614053c60 0x7f86140485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7fa0fe59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1000b3730 0x7fa1001508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:38320/0 (socket says 172.21.15.55:38320) 2024-04-25T08:53:52.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7fa0fe59c640 1 -- 172.21.15.55:0/465398037 learned_addr learned my addr 172.21.15.55:0/465398037 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7fa0fed9d640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa10015aa10 0x7fa10014ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f0650e68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f064c162e30 0x7f064c0b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f0650e68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f064c162e30 0x7f064c0b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47968/0 (socket says 172.21.15.55:47968) 2024-04-25T08:53:52.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f0650e68640 1 -- 172.21.15.55:0/1854051782 learned_addr learned my addr 172.21.15.55:0/1854051782 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7f064b7fe640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064c0b3240 0x7f064c0ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7fc71ea3f640 1 -- 172.21.15.55:0/2738741040 shutdown_connections 2024-04-25T08:53:52.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f064bfff640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064c071fc0 0x7f064c152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7fc71ea3f640 1 -- 172.21.15.55:0/2738741040 wait complete. 2024-04-25T08:53:52.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7ff2e17a3640 1 -- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2dc0d08b0 msgr2=0x7ff2dc0caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7ff2e17a3640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2dc0d08b0 0x7ff2dc0caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7ff2e17a3640 1 -- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2dc15dbe0 msgr2=0x7ff2dc15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7ff2e17a3640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2dc15dbe0 0x7ff2dc15f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7ff2e17a3640 1 -- 172.21.15.55:0/231841509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc0cb580 con 0x7ff2dc0cf530 2024-04-25T08:53:52.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c865f1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c0039b0 0x7f1c78186550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f0650e68640 1 -- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064c0b3240 msgr2=0x7f064c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f6e1ad9d640 1 -- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e1c14bfc0 msgr2=0x7f6e1c071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f6e1ad9d640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e1c14bfc0 0x7f6e1c071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f6e1ad9d640 1 -- 172.21.15.55:0/3052627186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c0b5aa0 msgr2=0x7f6e1c14ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f0650e68640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064c0b3240 0x7f064c0ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f0650e68640 1 -- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064c071fc0 msgr2=0x7f064c152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7fa0fdd9b640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1000b44b0 0x7fa1001529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f0650e68640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064c071fc0 0x7f064c152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c865f1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c7802dda0 0x7f1c780486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f861b7fe640 1 -- 172.21.15.55:0/4111887975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8614053c60 msgr2=0x7f86140485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f861b7fe640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8614053c60 0x7f86140485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f861b7fe640 1 -- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86140df210 msgr2=0x7f8614048b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f861b7fe640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86140df210 0x7f8614048b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f861b7fe640 1 -- 172.21.15.55:0/4111887975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86140491a0 con 0x7f8614050190 2024-04-25T08:53:52.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f6e1ad9d640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c0b5aa0 0x7f6e1c14ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f0650e68640 1 -- 172.21.15.55:0/1854051782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c1f7de0 con 0x7f064c162e30 2024-04-25T08:53:52.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f6e1ad9d640 1 -- 172.21.15.55:0/3052627186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c070670 con 0x7f6e1c165f50 2024-04-25T08:53:52.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f6e1a59c640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c0b5aa0 0x7f6e1c14ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10015d900 con 0x7fa1000b3730 2024-04-25T08:53:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.190+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1000b3bb0 con 0x7fa10015aa10 2024-04-25T08:53:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c865f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c7817bf30 0x7f1c7817c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c865f1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780547b0 con 0x7f1c7802dda0 2024-04-25T08:53:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f064bfff640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f064c071fc0 0x7f064c152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:52.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7ff2e17a3640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc0cf530 0x7ff2dc159db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8033170 tx=0x7ff2d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f6e1ad9d640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e1c165f50 0x7f6e1c0c9610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e14031000 tx=0x7f6e14004a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7fa0fed9d640 1 -- 172.21.15.55:0/465398037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1000b3730 msgr2=0x7fa1001508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7fa0fed9d640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1000b3730 0x7fa1001508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7fa0fed9d640 1 -- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1000b44b0 msgr2=0x7fa1001529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c865f1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78050190 con 0x7f1c7817bf30 2024-04-25T08:53:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c865f1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78054930 con 0x7f1c6c0039b0 2024-04-25T08:53:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c855ef640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c0039b0 0x7f1c78186550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c855ef640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c0039b0 0x7f1c78186550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:51500/0 (socket says 172.21.15.55:51500) 2024-04-25T08:53:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c84dee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c7802dda0 0x7f1c780486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c855ef640 1 -- 172.21.15.55:0/1958324171 learned_addr learned my addr 172.21.15.55:0/1958324171 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c85df0640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c7817bf30 0x7f1c7817c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f0650e68640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f064c162e30 0x7f064c0b13d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f064402a2b0 tx=0x7f06440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c855ef640 1 -- 172.21.15.55:0/1958324171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c7817bf30 msgr2=0x7f1c7817c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.191+0000 7f1c855ef640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c7817bf30 0x7f1c7817c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f6e0affd640 1 -- 172.21.15.55:0/3052627186 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1403f070 con 0x7f6e1c165f50 2024-04-25T08:53:52.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f6e0affd640 1 -- 172.21.15.55:0/3052627186 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e14031b40 con 0x7f6e1c165f50 2024-04-25T08:53:52.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f6e0affd640 1 -- 172.21.15.55:0/3052627186 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14044460 con 0x7f6e1c165f50 2024-04-25T08:53:52.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f1c855ef640 1 -- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c7802dda0 msgr2=0x7f1c780486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f1c855ef640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c7802dda0 0x7f1c780486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f1c855ef640 1 -- 172.21.15.55:0/1958324171 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7802f200 con 0x7f1c6c0039b0 2024-04-25T08:53:52.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f1c84dee640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c7802dda0 0x7f1c780486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:52.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f4945b27640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400cea30 0x7f49401fde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f4945b27640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4940161d60 0x7f4940201a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f4945b27640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4940203f90 0x7f4940204440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f4945b27640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49401658a0 con 0x7f4940203f90 2024-04-25T08:53:52.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f4945b27640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49400b29a0 con 0x7f4940161d60 2024-04-25T08:53:52.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f4945b27640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4940165b80 con 0x7f49400cea30 2024-04-25T08:53:52.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f0648ff9640 1 -- 172.21.15.55:0/1854051782 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644037070 con 0x7f064c162e30 2024-04-25T08:53:52.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f6e20e38640 1 -- 172.21.15.55:0/3052627186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c070950 con 0x7f6e1c165f50 2024-04-25T08:53:52.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f4944b25640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400cea30 0x7f49401fde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f4944b25640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400cea30 0x7f49401fde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:51508/0 (socket says 172.21.15.55:51508) 2024-04-25T08:53:52.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f4944b25640 1 -- 172.21.15.55:0/1952730553 learned_addr learned my addr 172.21.15.55:0/1952730553 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7fa0fed9d640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1000b44b0 0x7fa1001529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f06528cb640 1 -- 172.21.15.55:0/1854051782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c1f80c0 con 0x7f064c162e30 2024-04-25T08:53:52.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7fa0fed9d640 1 -- 172.21.15.55:0/465398037 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa100150ec0 con 0x7fa10015aa10 2024-04-25T08:53:52.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f493ffff640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4940161d60 0x7f4940201a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f06528cb640 1 -- 172.21.15.55:0/1854051782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c152e90 con 0x7f064c162e30 2024-04-25T08:53:52.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f6e20e38640 1 -- 172.21.15.55:0/3052627186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c070f10 con 0x7f6e1c165f50 2024-04-25T08:53:52.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f1c855ef640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c0039b0 0x7f1c78186550 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1c80064920 tx=0x7f1c80068980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7fa0fe59c640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1000b3730 0x7fa1001508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f0648ff9640 1 -- 172.21.15.55:0/1854051782 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0644032440 con 0x7f064c162e30 2024-04-25T08:53:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7fa0fed9d640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa10015aa10 0x7fa10014ff80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400c410 tx=0x7fa0f400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f4945326640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4940203f90 0x7f4940204440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7f861b7fe640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8614050190 0x7f86140ccda0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f861000c390 tx=0x7f861000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/231841509 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8040040 con 0x7ff2dc0cf530 2024-04-25T08:53:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.192+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/231841509 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d803ba90 con 0x7ff2dc0cf530 2024-04-25T08:53:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7fa0eeffd640 1 -- 172.21.15.55:0/465398037 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4017070 con 0x7fa10015aa10 2024-04-25T08:53:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1001511a0 con 0x7fa10015aa10 2024-04-25T08:53:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1001ef5f0 con 0x7fa10015aa10 2024-04-25T08:53:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7fc71ea3f640 1 Processor -- start 2024-04-25T08:53:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7fc71ea3f640 1 -- start start 2024-04-25T08:53:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f1c75ffb640 1 -- 172.21.15.55:0/1958324171 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c800b2040 con 0x7f1c6c0039b0 2024-04-25T08:53:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f1c75ffb640 1 -- 172.21.15.55:0/1958324171 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8004fe10 con 0x7f1c6c0039b0 2024-04-25T08:53:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f1c75ffb640 1 -- 172.21.15.55:0/1958324171 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c800ad7e0 con 0x7f1c6c0039b0 2024-04-25T08:53:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f8607fff640 1 -- 172.21.15.55:0/4111887975 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86100074e0 con 0x7f8614050190 2024-04-25T08:53:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f8607fff640 1 -- 172.21.15.55:0/4111887975 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8610007680 con 0x7f8614050190 2024-04-25T08:53:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f8607fff640 1 -- 172.21.15.55:0/4111887975 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86100049e0 con 0x7f8614050190 2024-04-25T08:53:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f0648ff9640 1 -- 172.21.15.55:0/1854051782 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644037070 con 0x7f064c162e30 2024-04-25T08:53:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.194+0000 7f06528cb640 1 -- 172.21.15.55:0/1854051782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0630001030 con 0x7f064c162e30 2024-04-25T08:53:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/231841509 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8044430 con 0x7ff2dc0cf530 2024-04-25T08:53:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f4945326640 1 -- 172.21.15.55:0/1952730553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400cea30 msgr2=0x7f49401fde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f4945326640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49400cea30 0x7f49401fde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f4945326640 1 -- 172.21.15.55:0/1952730553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4940161d60 msgr2=0x7f4940201a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f4945326640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4940161d60 0x7f4940201a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f4945326640 1 -- 172.21.15.55:0/1952730553 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4940204b00 con 0x7f4940203f90 2024-04-25T08:53:52.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7f4945326640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4940203f90 0x7f4940204440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f493000e7e0 tx=0x7f493000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.194+0000 7fa0eeffd640 1 -- 172.21.15.55:0/465398037 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f40035f0 con 0x7fa10015aa10 2024-04-25T08:53:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.194+0000 7fa0eeffd640 1 -- 172.21.15.55:0/465398037 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40039e0 con 0x7fa10015aa10 2024-04-25T08:53:52.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.194+0000 7f1c865f1640 1 -- 172.21.15.55:0/1958324171 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7802e580 con 0x7f1c6c0039b0 2024-04-25T08:53:52.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.194+0000 7f493d7fa640 1 -- 172.21.15.55:0/1952730553 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000f040 con 0x7f4940203f90 2024-04-25T08:53:52.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.194+0000 7f1c865f1640 1 -- 172.21.15.55:0/1958324171 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7802eb40 con 0x7f1c6c0039b0 2024-04-25T08:53:52.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.194+0000 7f4945b27640 1 -- 172.21.15.55:0/1952730553 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4940204de0 con 0x7f4940203f90 2024-04-25T08:53:52.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.194+0000 7f4945b27640 1 -- 172.21.15.55:0/1952730553 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4940158ad0 con 0x7f4940203f90 2024-04-25T08:53:52.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.195+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa1000749b0 con 0x7fa10015aa10 2024-04-25T08:53:52.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.194+0000 7f6e0affd640 1 -- 172.21.15.55:0/3052627186 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6e14044600 con 0x7f6e1c165f50 2024-04-25T08:53:52.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.193+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc0cb860 con 0x7ff2dc0cf530 2024-04-25T08:53:52.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.194+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc0cbe20 con 0x7ff2dc0cf530 2024-04-25T08:53:52.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.195+0000 7f6e0affd640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6dfc06b5a0 0x7f6dfc06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.195+0000 7f6e0affd640 1 -- 172.21.15.55:0/3052627186 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e140ab980 con 0x7f6e1c165f50 2024-04-25T08:53:52.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.195+0000 7fc71ea3f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 0x7fc718160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.195+0000 7f6e1a59c640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6dfc06b5a0 0x7f6dfc06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.195+0000 7f8621f22640 1 -- 172.21.15.55:0/4111887975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8614049480 con 0x7f8614050190 2024-04-25T08:53:52.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.195+0000 7f8621f22640 1 -- 172.21.15.55:0/4111887975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8614049a40 con 0x7f8614050190 2024-04-25T08:53:52.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.195+0000 7f6e20e38640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x7f6e1c071150 0x7f6e1c0d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.195+0000 7f6e20e38640 1 -- 172.21.15.55:0/3052627186 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e1c0cec50 con 0x7f6e1c071150 2024-04-25T08:53:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.196+0000 7f6e19d9b640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x7f6e1c071150 0x7f6e1c0d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.196+0000 7f6e1a59c640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6dfc06b5a0 0x7f6dfc06da60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c007fd0 tx=0x7f6e0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.194+0000 7f493d7fa640 1 -- 172.21.15.55:0/1952730553 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4930004030 con 0x7f4940203f90 2024-04-25T08:53:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.196+0000 7f493d7fa640 1 -- 172.21.15.55:0/1952730553 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930004400 con 0x7f4940203f90 2024-04-25T08:53:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.196+0000 7f4945b27640 1 -- 172.21.15.55:0/1952730553 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4920001030 con 0x7f4940203f90 2024-04-25T08:53:52.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.196+0000 7f1c637fe640 1 -- 172.21.15.55:0/1958324171 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c78186a90 con 0x7f1c6c0039b0 2024-04-25T08:53:52.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fc717fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 0x7fc718160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7f8605ffb640 1 -- 172.21.15.55:0/4111887975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85f4001030 con 0x7f8614050190 2024-04-25T08:53:52.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fc717fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 0x7fc718160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47986/0 (socket says 172.21.15.55:47986) 2024-04-25T08:53:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2dc0749b0 con 0x7ff2dc0cf530 2024-04-25T08:53:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fa0eeffd640 1 -- 172.21.15.55:0/465398037 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa0f401a070 con 0x7fa10015aa10 2024-04-25T08:53:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7f0648ff9640 1 -- 172.21.15.55:0/1854051782 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0644004030 con 0x7f064c162e30 2024-04-25T08:53:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7f6e19d9b640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x7f6e1c071150 0x7f6e1c0d2a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fa0eeffd640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0e006b5a0 0x7fa0e006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7f1c75ffb640 1 -- 172.21.15.55:0/1958324171 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c800be030 con 0x7f1c6c0039b0 2024-04-25T08:53:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fa0eeffd640 1 -- 172.21.15.55:0/465398037 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0f4089620 con 0x7fa10015aa10 2024-04-25T08:53:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f8607fff640 1 -- 172.21.15.55:0/4111887975 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f861001a020 con 0x7f8614050190 2024-04-25T08:53:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7f0648ff9640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f062c06b8d0 0x7f062c06dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7f0648ff9640 1 -- 172.21.15.55:0/1854051782 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f064402adc0 con 0x7f064c162e30 2024-04-25T08:53:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f064bfff640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f062c06b8d0 0x7f062c06dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f6e0affd640 1 -- 172.21.15.55:0/3052627186 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6e1c0cec50 con 0x7f6e1c071150 2024-04-25T08:53:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f8607fff640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f860006b5a0 0x7f860006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fa0fe59c640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0e006b5a0 0x7fa0e006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f8607fff640 1 -- 172.21.15.55:0/4111887975 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86100898b0 con 0x7f8614050190 2024-04-25T08:53:52.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fa0eeffd640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x7fa0e00737c0 0x7fa0e0075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fa0eeffd640 1 -- 172.21.15.55:0/465398037 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0f401fe50 con 0x7fa0e00737c0 2024-04-25T08:53:52.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fa0eeffd640 1 -- 172.21.15.55:0/465398037 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0f4089a10 con 0x7fa10015aa10 2024-04-25T08:53:52.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f1c75ffb640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1c6406b5d0 0x7f1c6406da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f861affd640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f860006b5a0 0x7f860006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f8607fff640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x7f86000737c0 0x7f8600075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f1c75ffb640 1 -- 172.21.15.55:0/1958324171 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c80124440 con 0x7f1c6c0039b0 2024-04-25T08:53:52.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fa0fdd9b640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x7fa0e00737c0 0x7fa0e0075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f1c75ffb640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x7f1c640737f0 0x7f1c64075c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f1c75ffb640 1 -- 172.21.15.55:0/1958324171 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c800677c0 con 0x7f1c640737f0 2024-04-25T08:53:52.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f1c75ffb640 1 -- 172.21.15.55:0/1958324171 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c8012b050 con 0x7f1c6c0039b0 2024-04-25T08:53:52.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7fa0fe59c640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0e006b5a0 0x7fa0e006da60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8011000 tx=0x7fa0f8011030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7f8607fff640 1 -- 172.21.15.55:0/4111887975 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8600076290 con 0x7f86000737c0 2024-04-25T08:53:52.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7f8607fff640 1 -- 172.21.15.55:0/4111887975 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f861008e2a0 con 0x7f8614050190 2024-04-25T08:53:52.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7f861bfff640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x7f86000737c0 0x7f8600075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f0648ff9640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x7f062c073a70 0x7f062c075e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f0648ff9640 1 -- 172.21.15.55:0/1854051782 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f064400af30 con 0x7f062c073a70 2024-04-25T08:53:52.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f0648ff9640 1 -- 172.21.15.55:0/1854051782 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06440aa7c0 con 0x7f064c162e30 2024-04-25T08:53:52.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7f064bfff640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f062c06b8d0 0x7f062c06dd90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f063c0012e0 tx=0x7f063c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7f064b7fe640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x7f062c073a70 0x7f062c075e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7f1c85df0640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x7f1c640737f0 0x7f1c64075c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7f493d7fa640 1 -- 172.21.15.55:0/1952730553 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f493000c6d0 con 0x7f4940203f90 2024-04-25T08:53:52.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7f1c85df0640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x7f1c640737f0 0x7f1c64075c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7f861bfff640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x7f86000737c0 0x7f8600075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7f861affd640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f860006b5a0 0x7f860006da60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8608034000 tx=0x7f860802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7fa0fdd9b640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x7fa0e00737c0 0x7fa0e0075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7f1c84dee640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1c6406b5d0 0x7f1c6406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.200+0000 7f1c84dee640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1c6406b5d0 0x7f1c6406da90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c78036cf0 tx=0x7f1c7c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.200+0000 7f8607fff640 1 -- 172.21.15.55:0/4111887975 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8600076290 con 0x7f86000737c0 2024-04-25T08:53:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.200+0000 7fa0eeffd640 1 -- 172.21.15.55:0/465398037 <== osd.0 v2:172.21.15.55:6808/382211730 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa0f401fe50 con 0x7fa0e00737c0 2024-04-25T08:53:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fc71ea3f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71815c380 0x7fc71815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fc71ea3f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7180d3610 0x7fc7180d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fc71ea3f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180b8be0 con 0x7fc7040051c0 2024-04-25T08:53:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fc71ea3f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180d2f80 con 0x7fc71815c380 2024-04-25T08:53:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fc71ea3f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180b8d60 con 0x7fc7180d3610 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fc7177fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71815c380 0x7fc71815c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fc7177fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71815c380 0x7fc71815c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:38362/0 (socket says 172.21.15.55:38362) 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fc7177fe640 1 -- 172.21.15.55:0/1441271667 learned_addr learned my addr 172.21.15.55:0/1441271667 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.197+0000 7fc71cfdc640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7180d3610 0x7fc7180d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fc7177fe640 1 -- 172.21.15.55:0/1441271667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7180d3610 msgr2=0x7fc7180d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fc7177fe640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7180d3610 0x7fc7180d3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fc7177fe640 1 -- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 msgr2=0x7fc718160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fc7177fe640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 0x7fc718160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fc7177fe640 1 -- 172.21.15.55:0/1441271667 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71815cd20 con 0x7fc71815c380 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fc71cfdc640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7180d3610 0x7fc7180d3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.198+0000 7fc7177fe640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71815c380 0x7fc71815c7e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc708001c30 tx=0x7fc708004c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7fc714ff9640 1 -- 172.21.15.55:0/1441271667 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70800f990 con 0x7fc71815c380 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.199+0000 7fc714ff9640 1 -- 172.21.15.55:0/1441271667 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc708018070 con 0x7fc71815c380 2024-04-25T08:53:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.200+0000 7fc714ff9640 1 -- 172.21.15.55:0/1441271667 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70800fd90 con 0x7fc71815c380 2024-04-25T08:53:52.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.200+0000 7fc71ea3f640 1 -- 172.21.15.55:0/1441271667 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7181f7a70 con 0x7fc71815c380 2024-04-25T08:53:52.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.200+0000 7fc71ea3f640 1 -- 172.21.15.55:0/1441271667 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7181f8030 con 0x7fc71815c380 2024-04-25T08:53:52.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.200+0000 7fc717fff640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7040051c0 0x7fc718160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-25T08:53:52.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7f064b7fe640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x7f062c073a70 0x7f062c075e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7f1c75ffb640 1 -- 172.21.15.55:0/1958324171 <== osd.2 v2:172.21.15.55:6824/2942240833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1c800677c0 con 0x7f1c640737f0 2024-04-25T08:53:52.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7f493d7fa640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f492c06b5a0 0x7f492c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7f493d7fa640 1 -- 172.21.15.55:0/1952730553 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4930089dc0 con 0x7f4940203f90 2024-04-25T08:53:52.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7f493d7fa640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x7f492c0737c0 0x7f492c075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7f493d7fa640 1 -- 172.21.15.55:0/1952730553 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4930004030 con 0x7f492c0737c0 2024-04-25T08:53:52.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7f493d7fa640 1 -- 172.21.15.55:0/1952730553 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f493008c420 con 0x7f4940203f90 2024-04-25T08:53:52.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7f4944b25640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f492c06b5a0 0x7f492c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7fc71ea3f640 1 -- 172.21.15.55:0/1441271667 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7180750b0 con 0x7fc71815c380 2024-04-25T08:53:52.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7f0648ff9640 1 -- 172.21.15.55:0/1854051782 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f064400af30 con 0x7f062c073a70 2024-04-25T08:53:52.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/231841509 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff2d80445d0 con 0x7ff2dc0cf530 2024-04-25T08:53:52.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.202+0000 7ff2d1ffb640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2c006b5a0 0x7ff2c006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.201+0000 7f493ffff640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x7f492c0737c0 0x7f492c075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.202+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/231841509 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2d80b3ad0 con 0x7ff2dc0cf530 2024-04-25T08:53:52.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.202+0000 7f4944b25640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f492c06b5a0 0x7f492c06da60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4938007fd0 tx=0x7f4938009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.202+0000 7ff2e0fa2640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2c006b5a0 0x7ff2c006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.202+0000 7fc714ff9640 1 -- 172.21.15.55:0/1441271667 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc70801d460 con 0x7fc71815c380 2024-04-25T08:53:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.203+0000 7ff2e0fa2640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2c006b5a0 0x7ff2c006da60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc1603e0 tx=0x7ff2cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.203+0000 7ff2d1ffb640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x7ff2c00737c0 0x7ff2c0075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.203+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/231841509 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2d8001d30 con 0x7ff2c00737c0 2024-04-25T08:53:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.203+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/231841509 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2d80b3ec0 con 0x7ff2dc0cf530 2024-04-25T08:53:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.202+0000 7f493ffff640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x7f492c0737c0 0x7f492c075be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.203+0000 7ff2e1fa4640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x7ff2c00737c0 0x7ff2c0075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.203+0000 7fc714ff9640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6f806b5a0 0x7fc6f806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.203+0000 7f493d7fa640 1 -- 172.21.15.55:0/1952730553 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4930004030 con 0x7f492c0737c0 2024-04-25T08:53:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.203+0000 7fc717fff640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6f806b5a0 0x7fc6f806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.204+0000 7fc714ff9640 1 -- 172.21.15.55:0/1441271667 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc70808a2a0 con 0x7fc71815c380 2024-04-25T08:53:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.204+0000 7fc717fff640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6f806b5a0 0x7fc6f806da60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc710001ad0 tx=0x7fc710006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.204+0000 7fc714ff9640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x7fc6f80737c0 0x7fc6f8075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.204+0000 7fc714ff9640 1 -- 172.21.15.55:0/1441271667 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc708015e70 con 0x7fc6f80737c0 2024-04-25T08:53:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.204+0000 7fc714ff9640 1 -- 172.21.15.55:0/1441271667 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc708091050 con 0x7fc71815c380 2024-04-25T08:53:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.205+0000 7ff2e1fa4640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x7ff2c00737c0 0x7ff2c0075be0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.205+0000 7fc71cfdc640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x7fc6f80737c0 0x7fc6f8075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.205+0000 7fc71cfdc640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x7fc6f80737c0 0x7fc6f8075be0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.205+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/231841509 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff2d8001d30 con 0x7ff2c00737c0 2024-04-25T08:53:52.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.206+0000 7fc714ff9640 1 -- 172.21.15.55:0/1441271667 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc708015e70 con 0x7fc6f80737c0 2024-04-25T08:53:52.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.232+0000 7f6e20e38640 1 -- 172.21.15.55:0/3052627186 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e1c06d660 con 0x7f6e1c071150 2024-04-25T08:53:52.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.233+0000 7f6e0affd640 1 -- 172.21.15.55:0/3052627186 <== osd.6 v2:172.21.15.167:6820/1814554564 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e1c06d660 con 0x7f6e1c071150 2024-04-25T08:53:52.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.233+0000 7f8605ffb640 1 -- 172.21.15.55:0/4111887975 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85f4002dd0 con 0x7f86000737c0 2024-04-25T08:53:52.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.233+0000 7f6e08ff9640 1 -- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x7f6e1c071150 msgr2=0x7f6e1c0d2a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.233+0000 7f6e08ff9640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x7f6e1c071150 0x7f6e1c0d2a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f8607fff640 1 -- 172.21.15.55:0/4111887975 <== osd.3 v2:172.21.15.55:6816/2016500802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f85f4002dd0 con 0x7f86000737c0 2024-04-25T08:53:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.233+0000 7f6e08ff9640 1 -- 172.21.15.55:0/3052627186 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6dfc06b5a0 msgr2=0x7f6dfc06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.233+0000 7f6e08ff9640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6dfc06b5a0 0x7f6dfc06da60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c007fd0 tx=0x7f6e0c009040 comp rx=0 tx=0).stop 2024-04-25T08:53:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f6e08ff9640 1 -- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e1c165f50 msgr2=0x7f6e1c0c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f6e08ff9640 1 --2- 172.21.15.55:0/3052627186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e1c165f50 0x7f6e1c0c9610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e14031000 tx=0x7f6e14004a70 comp rx=0 tx=0).stop 2024-04-25T08:53:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f6e1ad9d640 1 -- 172.21.15.55:0/3052627186 reap_dead start 2024-04-25T08:53:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f6e08ff9640 1 -- 172.21.15.55:0/3052627186 shutdown_connections 2024-04-25T08:53:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f6e08ff9640 1 -- 172.21.15.55:0/3052627186 >> 172.21.15.55:0/3052627186 conn(0x7f6e1c0d0390 msgr2=0x7f6e1c0b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f6e08ff9640 1 -- 172.21.15.55:0/3052627186 shutdown_connections 2024-04-25T08:53:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f6e08ff9640 1 -- 172.21.15.55:0/3052627186 wait complete. 2024-04-25T08:53:52.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f06528cb640 1 -- 172.21.15.55:0/1854051782 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0630002d50 con 0x7f062c073a70 2024-04-25T08:53:52.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f8621f22640 1 -- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x7f86000737c0 msgr2=0x7f8600075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f8621f22640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x7f86000737c0 0x7f8600075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.235+0000 7f1c637fe640 1 -- 172.21.15.55:0/1958324171 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c78005380 con 0x7f1c640737f0 2024-04-25T08:53:52.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f8621f22640 1 -- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f860006b5a0 msgr2=0x7f860006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f8621f22640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f860006b5a0 0x7f860006da60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8608034000 tx=0x7f860802e000 comp rx=0 tx=0).stop 2024-04-25T08:53:52.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.235+0000 7f0648ff9640 1 -- 172.21.15.55:0/1854051782 <== osd.4 v2:172.21.15.167:6808/1392386852 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0630002d50 con 0x7f062c073a70 2024-04-25T08:53:52.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f8621f22640 1 -- 172.21.15.55:0/4111887975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8614050190 msgr2=0x7f86140ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.234+0000 7f8621f22640 1 --2- 172.21.15.55:0/4111887975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8614050190 0x7f86140ccda0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f861000c390 tx=0x7f861000c790 comp rx=0 tx=0).stop 2024-04-25T08:53:52.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.235+0000 7f861bfff640 1 -- 172.21.15.55:0/4111887975 reap_dead start 2024-04-25T08:53:52.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.235+0000 7f1c75ffb640 1 -- 172.21.15.55:0/1958324171 <== osd.2 v2:172.21.15.55:6824/2942240833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c78005380 con 0x7f1c640737f0 2024-04-25T08:53:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.235+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa1001ef7c0 con 0x7fa0e00737c0 2024-04-25T08:53:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.235+0000 7f1c637fe640 1 -- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x7f1c640737f0 msgr2=0x7f1c64075c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.235+0000 7f1c637fe640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x7f1c640737f0 0x7f1c64075c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.235+0000 7f06528cb640 1 -- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x7f062c073a70 msgr2=0x7f062c075e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.235+0000 7f06528cb640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x7f062c073a70 0x7f062c075e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.235+0000 7fa0eeffd640 1 -- 172.21.15.55:0/465398037 <== osd.0 v2:172.21.15.55:6808/382211730 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa1001ef7c0 con 0x7fa0e00737c0 2024-04-25T08:53:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x7fa0e00737c0 msgr2=0x7fa0e0075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f1c637fe640 1 -- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1c6406b5d0 msgr2=0x7f1c6406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f1c637fe640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1c6406b5d0 0x7f1c6406da90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c78036cf0 tx=0x7f1c7c009040 comp rx=0 tx=0).stop 2024-04-25T08:53:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f1c637fe640 1 -- 172.21.15.55:0/1958324171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c0039b0 msgr2=0x7f1c78186550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f1c637fe640 1 --2- 172.21.15.55:0/1958324171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c0039b0 0x7f1c78186550 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1c80064920 tx=0x7f1c80068980 comp rx=0 tx=0).stop 2024-04-25T08:53:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f1c85df0640 1 -- 172.21.15.55:0/1958324171 reap_dead start 2024-04-25T08:53:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f1c637fe640 1 -- 172.21.15.55:0/1958324171 shutdown_connections 2024-04-25T08:53:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f1c637fe640 1 -- 172.21.15.55:0/1958324171 >> 172.21.15.55:0/1958324171 conn(0x7f1c78009fa0 msgr2=0x7f1c7804e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f06528cb640 1 -- 172.21.15.55:0/1854051782 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f062c06b8d0 msgr2=0x7f062c06dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f06528cb640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f062c06b8d0 0x7f062c06dd90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f063c0012e0 tx=0x7f063c009040 comp rx=0 tx=0).stop 2024-04-25T08:53:52.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f06528cb640 1 -- 172.21.15.55:0/1854051782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f064c162e30 msgr2=0x7f064c0b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f06528cb640 1 --2- 172.21.15.55:0/1854051782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f064c162e30 0x7f064c0b13d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f064402a2b0 tx=0x7f06440046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f0650e68640 1 -- 172.21.15.55:0/1854051782 reap_dead start 2024-04-25T08:53:52.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7fa0ff59e640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x7fa0e00737c0 0x7fa0e0075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f8621f22640 1 -- 172.21.15.55:0/4111887975 shutdown_connections 2024-04-25T08:53:52.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f8621f22640 1 -- 172.21.15.55:0/4111887975 >> 172.21.15.55:0/4111887975 conn(0x7f8614009fa0 msgr2=0x7f86140de220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f06528cb640 1 -- 172.21.15.55:0/1854051782 shutdown_connections 2024-04-25T08:53:52.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f06528cb640 1 -- 172.21.15.55:0/1854051782 >> 172.21.15.55:0/1854051782 conn(0x7f064c06aba0 msgr2=0x7f064c161af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0e006b5a0 msgr2=0x7fa0e006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7fa0ff59e640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0e006b5a0 0x7fa0e006da60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8011000 tx=0x7fa0f8011030 comp rx=0 tx=0).stop 2024-04-25T08:53:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f8621f22640 1 -- 172.21.15.55:0/4111887975 shutdown_connections 2024-04-25T08:53:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f06528cb640 1 -- 172.21.15.55:0/1854051782 shutdown_connections 2024-04-25T08:53:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f8621f22640 1 -- 172.21.15.55:0/4111887975 wait complete. 2024-04-25T08:53:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7f06528cb640 1 -- 172.21.15.55:0/1854051782 wait complete. 2024-04-25T08:53:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa10015aa10 msgr2=0x7fa10014ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7fa0ff59e640 1 --2- 172.21.15.55:0/465398037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa10015aa10 0x7fa10014ff80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400c410 tx=0x7fa0f400c8d0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.236+0000 7fa0fed9d640 1 -- 172.21.15.55:0/465398037 reap_dead start 2024-04-25T08:53:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.237+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 shutdown_connections 2024-04-25T08:53:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.237+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 >> 172.21.15.55:0/465398037 conn(0x7fa1000b59c0 msgr2=0x7fa10009a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.237+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 shutdown_connections 2024-04-25T08:53:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.237+0000 7fa0ff59e640 1 -- 172.21.15.55:0/465398037 wait complete. 2024-04-25T08:53:52.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.237+0000 7f1c637fe640 1 -- 172.21.15.55:0/1958324171 shutdown_connections 2024-04-25T08:53:52.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.238+0000 7f1c637fe640 1 -- 172.21.15.55:0/1958324171 wait complete. 2024-04-25T08:53:52.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.238+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2dc0749b0 con 0x7ff2c00737c0 2024-04-25T08:53:52.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.238+0000 7fc71ea3f640 1 -- 172.21.15.55:0/1441271667 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc7180d24f0 con 0x7fc6f80737c0 2024-04-25T08:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.238+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/231841509 <== osd.5 v2:172.21.15.167:6800/1337224202 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff2dc0749b0 con 0x7ff2c00737c0 2024-04-25T08:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.238+0000 7fc714ff9640 1 -- 172.21.15.55:0/1441271667 <== osd.1 v2:172.21.15.55:6800/2726345870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc7180d24f0 con 0x7fc6f80737c0 2024-04-25T08:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.239+0000 7f4945b27640 1 -- 172.21.15.55:0/1952730553 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4920002dd0 con 0x7f492c0737c0 2024-04-25T08:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.239+0000 7fc71ea3f640 1 -- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x7fc6f80737c0 msgr2=0x7fc6f8075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.239+0000 7fc71ea3f640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x7fc6f80737c0 0x7fc6f8075be0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.239+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x7ff2c00737c0 msgr2=0x7ff2c0075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.239+0000 7ff2e3a07640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x7ff2c00737c0 0x7ff2c0075be0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.239+0000 7f493d7fa640 1 -- 172.21.15.55:0/1952730553 <== osd.7 v2:172.21.15.167:6816/2254116283 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4920002dd0 con 0x7f492c0737c0 2024-04-25T08:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.239+0000 7fc71ea3f640 1 -- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6f806b5a0 msgr2=0x7fc6f806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.239+0000 7fc71ea3f640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6f806b5a0 0x7fc6f806da60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc710001ad0 tx=0x7fc710006040 comp rx=0 tx=0).stop 2024-04-25T08:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.239+0000 7fc71ea3f640 1 -- 172.21.15.55:0/1441271667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71815c380 msgr2=0x7fc71815c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.239+0000 7fc71ea3f640 1 --2- 172.21.15.55:0/1441271667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71815c380 0x7fc71815c7e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc708001c30 tx=0x7fc708004c70 comp rx=0 tx=0).stop 2024-04-25T08:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.239+0000 7fc71cfdc640 1 -- 172.21.15.55:0/1441271667 reap_dead start 2024-04-25T08:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7fc71ea3f640 1 -- 172.21.15.55:0/1441271667 shutdown_connections 2024-04-25T08:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7fc71ea3f640 1 -- 172.21.15.55:0/1441271667 >> 172.21.15.55:0/1441271667 conn(0x7fc7180d0960 msgr2=0x7fc718164f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7fc71ea3f640 1 -- 172.21.15.55:0/1441271667 shutdown_connections 2024-04-25T08:53:52.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7fc71ea3f640 1 -- 172.21.15.55:0/1441271667 wait complete. 2024-04-25T08:53:52.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2c006b5a0 msgr2=0x7ff2c006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7ff2e3a07640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2c006b5a0 0x7ff2c006da60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc1603e0 tx=0x7ff2cc009040 comp rx=0 tx=0).stop 2024-04-25T08:53:52.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc0cf530 msgr2=0x7ff2dc159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7ff2e3a07640 1 --2- 172.21.15.55:0/231841509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc0cf530 0x7ff2dc159db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8033170 tx=0x7ff2d80046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7ff2e1fa4640 1 -- 172.21.15.55:0/231841509 reap_dead start 2024-04-25T08:53:52.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 shutdown_connections 2024-04-25T08:53:52.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 >> 172.21.15.55:0/231841509 conn(0x7ff2dc08afd0 msgr2=0x7ff2dc0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 shutdown_connections 2024-04-25T08:53:52.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7ff2e3a07640 1 -- 172.21.15.55:0/231841509 wait complete. 2024-04-25T08:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.240+0000 7f4945b27640 1 -- 172.21.15.55:0/1952730553 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x7f492c0737c0 msgr2=0x7f492c075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.241+0000 7f4945b27640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x7f492c0737c0 0x7f492c075be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.241+0000 7f4945b27640 1 -- 172.21.15.55:0/1952730553 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f492c06b5a0 msgr2=0x7f492c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.241+0000 7f4945b27640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f492c06b5a0 0x7f492c06da60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4938007fd0 tx=0x7f4938009040 comp rx=0 tx=0).stop 2024-04-25T08:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.241+0000 7f4945b27640 1 -- 172.21.15.55:0/1952730553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4940203f90 msgr2=0x7f4940204440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.241+0000 7f4945b27640 1 --2- 172.21.15.55:0/1952730553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4940203f90 0x7f4940204440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f493000e7e0 tx=0x7f493000eca0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.241+0000 7f4945326640 1 -- 172.21.15.55:0/1952730553 reap_dead start 2024-04-25T08:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.241+0000 7f4945b27640 1 -- 172.21.15.55:0/1952730553 shutdown_connections 2024-04-25T08:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.241+0000 7f4945b27640 1 -- 172.21.15.55:0/1952730553 >> 172.21.15.55:0/1952730553 conn(0x7f4940066ff0 msgr2=0x7f49400af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.241+0000 7f4945b27640 1 -- 172.21.15.55:0/1952730553 shutdown_connections 2024-04-25T08:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.242+0000 7f4945b27640 1 -- 172.21.15.55:0/1952730553 wait complete. 2024-04-25T08:53:52.306 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-04-25T08:53:52.306 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T08:53:52.307 INFO:teuthology.orchestra.run.smithi055.stdout:64424509449 2024-04-25T08:53:52.307 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-04-25T08:53:52.308 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T08:53:52.308 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T08:53:52.309 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-04-25T08:53:52.310 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T08:53:52.310 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-04-25T08:53:52.310 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T08:53:52.311 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2024-04-25T08:53:52.311 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T08:53:52.312 INFO:teuthology.orchestra.run.smithi055.stdout:64424509448 2024-04-25T08:53:52.313 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T08:53:52.314 INFO:teuthology.orchestra.run.smithi055.stdout:64424509448 2024-04-25T08:53:52.314 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T08:53:52.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.530+0000 7f4462c0d640 1 Processor -- start 2024-04-25T08:53:52.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.531+0000 7f4462c0d640 1 -- start start 2024-04-25T08:53:52.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.532+0000 7f4462c0d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f445c147f70 0x7f445c071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.532+0000 7f4462c0d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f445c162ff0 0x7f445c071660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.532+0000 7f4462c0d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c166640 con 0x7f445c165910 2024-04-25T08:53:52.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.532+0000 7f4462c0d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c162510 con 0x7f445c162ff0 2024-04-25T08:53:52.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.532+0000 7f4462c0d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c1627f0 con 0x7f445c147f70 2024-04-25T08:53:52.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.532+0000 7f446240c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f445c165910 0x7f445c165d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56904/0 (socket says 172.21.15.55:56904) 2024-04-25T08:53:52.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.532+0000 7f446240c640 1 -- 172.21.15.55:0/1089627644 learned_addr learned my addr 172.21.15.55:0/1089627644 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:52.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.533+0000 7f4461c0b640 1 --2- 172.21.15.55:0/1089627644 >> v2:172.21.15.167:3300/0 conn(0x7f445c147f70 0x7f445c071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.533+0000 7f446140a640 1 --2- 172.21.15.55:0/1089627644 >> v2:172.21.15.55:3300/0 conn(0x7f445c162ff0 0x7f445c071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.533+0000 7fdf3359e640 1 Processor -- start 2024-04-25T08:53:52.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.533+0000 7f4460c09640 1 -- 172.21.15.55:0/1089627644 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116998773 0 0) 0x7f445c166640 con 0x7f445c165910 2024-04-25T08:53:52.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.533+0000 7f4460c09640 1 -- 172.21.15.55:0/1089627644 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4448003520 con 0x7f445c165910 2024-04-25T08:53:52.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.533+0000 7f4461c0b640 1 -- 172.21.15.55:0/1089627644 >> v2:172.21.15.55:3300/0 conn(0x7f445c162ff0 msgr2=0x7f445c071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.534+0000 7f4460c09640 1 -- 172.21.15.55:0/1089627644 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1238074822 0 0) 0x7f4448003520 con 0x7f445c165910 2024-04-25T08:53:52.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.533+0000 7fdf3359e640 1 -- start start 2024-04-25T08:53:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.534+0000 7f4461c0b640 1 --2- 172.21.15.55:0/1089627644 >> v2:172.21.15.55:3300/0 conn(0x7f445c162ff0 0x7f445c071660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.534+0000 7f4461c0b640 1 -- 172.21.15.55:0/1089627644 >> v1:172.21.15.55:6789/0 conn(0x7f445c165910 legacy=0x7f445c165d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.534+0000 7f4461c0b640 1 -- 172.21.15.55:0/1089627644 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c162ad0 con 0x7f445c147f70 2024-04-25T08:53:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.534+0000 7f22e0b70640 1 Processor -- start 2024-04-25T08:53:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.534+0000 7f20fb722640 1 Processor -- start 2024-04-25T08:53:52.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7fdf3359e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf2c0eacf0 0x7fdf2c04fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7fdf3359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf2c04ffc0 0x7fdf2c037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7fdf3359e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdf2c038100 0x7fdf2c038590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7fdf3359e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c054320 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7fdf3359e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c053710 con 0x7fdf2c038100 2024-04-25T08:53:52.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7fdf3359e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0539f0 con 0x7fdf2c0eacf0 2024-04-25T08:53:52.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.534+0000 7f446140a640 1 --2- 172.21.15.55:0/1089627644 >> v2:172.21.15.55:3300/0 conn(0x7f445c162ff0 0x7f445c071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:52.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7f3a1cb4e640 1 Processor -- start 2024-04-25T08:53:52.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7fdf31d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf2c04ffc0 0x7fdf2c037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7fdf31d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf2c04ffc0 0x7fdf2c037bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47998/0 (socket says 172.21.15.55:47998) 2024-04-25T08:53:52.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7fdf31d9b640 1 -- 172.21.15.55:0/1121366646 learned_addr learned my addr 172.21.15.55:0/1121366646 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7fdf32d9d640 1 --2- 172.21.15.55:0/1121366646 >> v2:172.21.15.167:3300/0 conn(0x7fdf2c038100 0x7fdf2c038590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7fdf31d9b640 1 -- 172.21.15.55:0/1121366646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf2c0eacf0 msgr2=0x7fdf2c04fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7fdf31d9b640 1 --2- 172.21.15.55:0/1121366646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf2c0eacf0 0x7fdf2c04fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7fdf31d9b640 1 -- 172.21.15.55:0/1121366646 >> v2:172.21.15.167:3300/0 conn(0x7fdf2c038100 msgr2=0x7fdf2c038590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7fdf31d9b640 1 --2- 172.21.15.55:0/1121366646 >> v2:172.21.15.167:3300/0 conn(0x7fdf2c038100 0x7fdf2c038590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7fdf31d9b640 1 -- 172.21.15.55:0/1121366646 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c053cd0 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7f3a1cb4e640 1 -- start start 2024-04-25T08:53:52.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7f20fb722640 1 -- start start 2024-04-25T08:53:52.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7f51272e1640 1 Processor -- start 2024-04-25T08:53:52.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7f3a1cb4e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3a100ead00 0x7f3a1004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7f3a1cb4e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a10053720 con 0x7f3a10006ea0 2024-04-25T08:53:52.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7f3a1cb4e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a10053a00 con 0x7f3a1004ffd0 2024-04-25T08:53:52.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7f3a1cb4e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a10054330 con 0x7f3a100ead00 2024-04-25T08:53:52.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7f51272e1640 1 -- start start 2024-04-25T08:53:52.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.536+0000 7f20fb722640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f20ec005e80 0x7f20ec0062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f20fb722640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec053710 con 0x7f20ec0eacf0 2024-04-25T08:53:52.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f3a16ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3a1004ffd0 0x7f3a10037bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58570/0 (socket says 172.21.15.55:58570) 2024-04-25T08:53:52.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f3a16ffd640 1 -- 172.21.15.55:0/891308442 learned_addr learned my addr 172.21.15.55:0/891308442 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:52.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f4461c0b640 1 --2- 172.21.15.55:0/1089627644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445c147f70 0x7f445c071120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f445c06b8e0 tx=0x7f444c02a0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98af9c177fa58d74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f20f9cbf640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f20ec006800 0x7f20ec006c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58580/0 (socket says 172.21.15.55:58580) 2024-04-25T08:53:52.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f20f9cbf640 1 -- 172.21.15.55:0/2667888629 learned_addr learned my addr 172.21.15.55:0/2667888629 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:52.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f20f8cbd640 1 --2- 172.21.15.55:0/2667888629 >> v2:172.21.15.167:3300/0 conn(0x7f20ec005e80 0x7f20ec0062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.535+0000 7f22e0b70640 1 -- start start 2024-04-25T08:53:52.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f22e0b70640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22dc071fc0 0x7f22dc06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f20fb722640 1 -- 172.21.15.55:0/2667888629 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0539f0 con 0x7f20ec006800 2024-04-25T08:53:52.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f20fb722640 1 -- 172.21.15.55:0/2667888629 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec054320 con 0x7f20ec005e80 2024-04-25T08:53:52.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f4460c09640 1 -- 172.21.15.55:0/1089627644 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c037070 con 0x7f445c147f70 2024-04-25T08:53:52.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f4460c09640 1 -- 172.21.15.55:0/1089627644 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c02ab40 con 0x7f445c147f70 2024-04-25T08:53:52.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f4460c09640 1 -- 172.21.15.55:0/1089627644 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44540019f0 con 0x7f445c147f70 2024-04-25T08:53:52.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f22e0b70640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 0x7f22dc0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f22e0b70640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22dc06e3f0 con 0x7f22dc0b3780 2024-04-25T08:53:52.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f22e0b70640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc06e6d0 con 0x7f22dc071fc0 2024-04-25T08:53:52.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f22e0b70640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc06e9b0 con 0x7f22dc06dee0 2024-04-25T08:53:52.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f3a177fe640 1 --2- 172.21.15.55:0/891308442 >> v2:172.21.15.55:3300/0 conn(0x7f3a100ead00 0x7f3a1004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.537+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 0x7f22dc0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 0x7f22dc0b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:51528/0 (socket says 172.21.15.55:51528) 2024-04-25T08:53:52.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f22d9d9b640 1 -- 172.21.15.55:0/1751910525 learned_addr learned my addr 172.21.15.55:0/1751910525 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f20ebfff640 1 -- 172.21.15.55:0/2667888629 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658513913 0 0) 0x7f20ec0539f0 con 0x7f20ec006800 2024-04-25T08:53:52.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f20ebfff640 1 -- 172.21.15.55:0/2667888629 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e0003520 con 0x7f20ec006800 2024-04-25T08:53:52.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f20f8cbd640 1 -- 172.21.15.55:0/2667888629 >> v1:172.21.15.167:6789/0 conn(0x7f20ec006800 legacy=0x7f20ec006c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f20f8cbd640 1 -- 172.21.15.55:0/2667888629 >> v1:172.21.15.55:6789/0 conn(0x7f20ec0eacf0 legacy=0x7f20ec04fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f20f8cbd640 1 -- 172.21.15.55:0/2667888629 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec053cd0 con 0x7f20ec005e80 2024-04-25T08:53:52.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f51272e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51200cf940 0x7f512015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f3a167fc640 1 -- 172.21.15.55:0/891308442 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087687594 0 0) 0x7f3a10053a00 con 0x7f3a1004ffd0 2024-04-25T08:53:52.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f3a167fc640 1 -- 172.21.15.55:0/891308442 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a08003520 con 0x7f3a1004ffd0 2024-04-25T08:53:52.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f51272e1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51200cc2f0 0x7f512015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f3a177fe640 1 -- 172.21.15.55:0/891308442 >> v1:172.21.15.167:6789/0 conn(0x7f3a1004ffd0 legacy=0x7f3a10037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f51272e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512015c450 con 0x7f51200b2c80 2024-04-25T08:53:52.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f51272e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512015c220 con 0x7f51200cf940 2024-04-25T08:53:52.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f51272e1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512015c730 con 0x7f51200cc2f0 2024-04-25T08:53:52.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f4462c0d640 1 -- 172.21.15.55:0/1089627644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445c147f70 msgr2=0x7f445c071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f4462c0d640 1 --2- 172.21.15.55:0/1089627644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445c147f70 0x7f445c071120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f445c06b8e0 tx=0x7f444c02a0b0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f4462c0d640 1 -- 172.21.15.55:0/1089627644 shutdown_connections 2024-04-25T08:53:52.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f4462c0d640 1 --2- 172.21.15.55:0/1089627644 >> v2:172.21.15.55:3300/0 conn(0x7f445c162ff0 0x7f445c071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f4462c0d640 1 --2- 172.21.15.55:0/1089627644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445c147f70 0x7f445c071120 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f4462c0d640 1 -- 172.21.15.55:0/1089627644 >> 172.21.15.55:0/1089627644 conn(0x7f445c06aba0 msgr2=0x7f445c06af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f512587e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51200cc2f0 0x7f512015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f512587e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51200cc2f0 0x7f512015f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:38410/0 (socket says 172.21.15.55:38410) 2024-04-25T08:53:52.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f512587e640 1 -- 172.21.15.55:0/2145388967 learned_addr learned my addr 172.21.15.55:0/2145388967 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f512507d640 1 --2- 172.21.15.55:0/2145388967 >> v2:172.21.15.55:3300/0 conn(0x7f51200cf940 0x7f512015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f512587e640 1 -- 172.21.15.55:0/2145388967 >> v2:172.21.15.55:3300/0 conn(0x7f51200cf940 msgr2=0x7f512015bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f512587e640 1 --2- 172.21.15.55:0/2145388967 >> v2:172.21.15.55:3300/0 conn(0x7f51200cf940 0x7f512015bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f512587e640 1 -- 172.21.15.55:0/2145388967 >> v1:172.21.15.55:6789/0 conn(0x7f51200b2c80 legacy=0x7f51200cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f512587e640 1 -- 172.21.15.55:0/2145388967 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512015ca10 con 0x7f51200cc2f0 2024-04-25T08:53:52.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f7d25f5c640 1 Processor -- start 2024-04-25T08:53:52.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f22da59c640 1 --2- 172.21.15.55:0/1751910525 >> v2:172.21.15.167:3300/0 conn(0x7f22dc071fc0 0x7f22dc06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f22d9d9b640 1 -- 172.21.15.55:0/1751910525 >> v2:172.21.15.167:3300/0 conn(0x7f22dc071fc0 msgr2=0x7f22dc06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f22d9d9b640 1 --2- 172.21.15.55:0/1751910525 >> v2:172.21.15.167:3300/0 conn(0x7f22dc071fc0 0x7f22dc06d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f22d9d9b640 1 -- 172.21.15.55:0/1751910525 >> v1:172.21.15.55:6789/0 conn(0x7f22dc0b3780 legacy=0x7f22dc165b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f22d9d9b640 1 -- 172.21.15.55:0/1751910525 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc162910 con 0x7f22dc06dee0 2024-04-25T08:53:52.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f20f8cbd640 1 --2- 172.21.15.55:0/2667888629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20ec005e80 0x7f20ec0062c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20e40097a0 tx=0x7f20e402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8efa46e7e6a39544 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f20ebfff640 1 -- 172.21.15.55:0/2667888629 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4037070 con 0x7f20ec005e80 2024-04-25T08:53:52.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f20ebfff640 1 -- 172.21.15.55:0/2667888629 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e4032440 con 0x7f20ec005e80 2024-04-25T08:53:52.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f20ebfff640 1 -- 172.21.15.55:0/2667888629 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4032810 con 0x7f20ec005e80 2024-04-25T08:53:52.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7fdf31d9b640 1 --2- 172.21.15.55:0/1121366646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c04ffc0 0x7fdf2c037bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf3404f440 tx=0x7fdf340a5220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8907d8cea038af4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f4462c0d640 1 -- 172.21.15.55:0/1089627644 shutdown_connections 2024-04-25T08:53:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f3a167fc640 1 -- 172.21.15.55:0/891308442 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 636453864 0 0) 0x7f3a08003520 con 0x7f3a1004ffd0 2024-04-25T08:53:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f3a177fe640 1 -- 172.21.15.55:0/891308442 >> v1:172.21.15.55:6789/0 conn(0x7f3a10006ea0 legacy=0x7f3a100382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f3a177fe640 1 -- 172.21.15.55:0/891308442 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10053ce0 con 0x7f3a100ead00 2024-04-25T08:53:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.538+0000 7f7d25f5c640 1 -- start start 2024-04-25T08:53:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7fdf3159a640 1 -- 172.21.15.55:0/1121366646 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340b2070 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7fdf3159a640 1 -- 172.21.15.55:0/1121366646 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf340ad640 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f3a177fe640 1 --2- 172.21.15.55:0/891308442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a100ead00 0x7f3a1004fa90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009720 tx=0x7f3a0c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef243f0aaccba88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f7d25f5c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1804b3b0 0x7f7d18034010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f7d25f5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d18006a40 0x7f7d18006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f7d25f5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d18054c00 con 0x7f7d1804f4c0 2024-04-25T08:53:52.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f7d25f5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d180062d0 con 0x7f7d18006a40 2024-04-25T08:53:52.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f7d25f5c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18053a40 con 0x7f7d1804b3b0 2024-04-25T08:53:52.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f22d9d9b640 1 --2- 172.21.15.55:0/1751910525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 0x7f22dc0b3240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009e50 tx=0x7f22d402a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d448cd1aa0481a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f3589307640 1 Processor -- start 2024-04-25T08:53:52.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.539+0000 7f3589307640 1 -- start start 2024-04-25T08:53:52.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f20fb722640 1 -- 172.21.15.55:0/2667888629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20ec005e80 msgr2=0x7f20ec0062c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f20fb722640 1 --2- 172.21.15.55:0/2667888629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20ec005e80 0x7f20ec0062c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20e40097a0 tx=0x7f20e402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f3a167fc640 1 -- 172.21.15.55:0/891308442 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c037070 con 0x7f3a100ead00 2024-04-25T08:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f3a167fc640 1 -- 172.21.15.55:0/891308442 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c02ac60 con 0x7f3a100ead00 2024-04-25T08:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f3a167fc640 1 -- 172.21.15.55:0/891308442 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c037070 con 0x7f3a100ead00 2024-04-25T08:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f7d1ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d18006a40 0x7f7d18006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f7d1ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d18006a40 0x7f7d18006ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48030/0 (socket says 172.21.15.55:48030) 2024-04-25T08:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f7d1ffff640 1 -- 172.21.15.55:0/136973007 learned_addr learned my addr 172.21.15.55:0/136973007 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f22d959a640 1 -- 172.21.15.55:0/1751910525 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4036070 con 0x7f22dc06dee0 2024-04-25T08:53:52.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7fdf3159a640 1 -- 172.21.15.55:0/1121366646 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340ada70 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7fdf3359e640 1 -- 172.21.15.55:0/1121366646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c04ffc0 msgr2=0x7fdf2c037bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7fdf3359e640 1 --2- 172.21.15.55:0/1121366646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c04ffc0 0x7fdf2c037bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf3404f440 tx=0x7fdf340a5220 comp rx=0 tx=0).stop 2024-04-25T08:53:52.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f7d1ffff640 1 -- 172.21.15.55:0/136973007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1804b3b0 msgr2=0x7f7d18034010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T08:53:52.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f7d1ffff640 1 --2- 172.21.15.55:0/136973007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1804b3b0 0x7f7d18034010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f7d1ffff640 1 -- 172.21.15.55:0/136973007 >> v1:172.21.15.55:6789/0 conn(0x7f7d1804f4c0 legacy=0x7f7d1804f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f7d1ffff640 1 -- 172.21.15.55:0/136973007 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d18053d20 con 0x7f7d18006a40 2024-04-25T08:53:52.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f22d959a640 1 -- 172.21.15.55:0/1751910525 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d4031600 con 0x7f22dc06dee0 2024-04-25T08:53:52.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f22d959a640 1 -- 172.21.15.55:0/1751910525 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40319d0 con 0x7f22dc06dee0 2024-04-25T08:53:52.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f20fb722640 1 -- 172.21.15.55:0/2667888629 shutdown_connections 2024-04-25T08:53:52.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f20fb722640 1 --2- 172.21.15.55:0/2667888629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20ec005e80 0x7f20ec0062c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f20fb722640 1 -- 172.21.15.55:0/2667888629 >> 172.21.15.55:0/2667888629 conn(0x7f20ec009fa0 msgr2=0x7f20ec00a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7fdf3359e640 1 -- 172.21.15.55:0/1121366646 shutdown_connections 2024-04-25T08:53:52.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7fdf3359e640 1 --2- 172.21.15.55:0/1121366646 >> v2:172.21.15.167:3300/0 conn(0x7fdf2c038100 0x7fdf2c038590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7fdf3359e640 1 --2- 172.21.15.55:0/1121366646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c04ffc0 0x7fdf2c037bc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7fdf3359e640 1 --2- 172.21.15.55:0/1121366646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf2c0eacf0 0x7fdf2c04fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7fdf3359e640 1 -- 172.21.15.55:0/1121366646 >> 172.21.15.55:0/1121366646 conn(0x7fdf2c009fa0 msgr2=0x7fdf2c00a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f3a1cb4e640 1 -- 172.21.15.55:0/891308442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a100ead00 msgr2=0x7f3a1004fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f3a1cb4e640 1 --2- 172.21.15.55:0/891308442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a100ead00 0x7f3a1004fa90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009720 tx=0x7f3a0c02a150 comp rx=0 tx=0).stop 2024-04-25T08:53:52.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f3a1cb4e640 1 -- 172.21.15.55:0/891308442 shutdown_connections 2024-04-25T08:53:52.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f3a1cb4e640 1 --2- 172.21.15.55:0/891308442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a100ead00 0x7f3a1004fa90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f3a1cb4e640 1 -- 172.21.15.55:0/891308442 >> 172.21.15.55:0/891308442 conn(0x7f3a10009fb0 msgr2=0x7f3a1000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f3a1cb4e640 1 -- 172.21.15.55:0/891308442 shutdown_connections 2024-04-25T08:53:52.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7fdf3359e640 1 -- 172.21.15.55:0/1121366646 shutdown_connections 2024-04-25T08:53:52.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7fdf3359e640 1 -- 172.21.15.55:0/1121366646 wait complete. 2024-04-25T08:53:52.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f3a1cb4e640 1 -- 172.21.15.55:0/891308442 wait complete. 2024-04-25T08:53:52.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f22e0b70640 1 -- 172.21.15.55:0/1751910525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 msgr2=0x7f22dc0b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f22e0b70640 1 --2- 172.21.15.55:0/1751910525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 0x7f22dc0b3240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009e50 tx=0x7f22d402a6c0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f20fb722640 1 -- 172.21.15.55:0/2667888629 shutdown_connections 2024-04-25T08:53:52.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f7d1ffff640 1 --2- 172.21.15.55:0/136973007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d18006a40 0x7f7d18006ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7d2002d370 tx=0x7f7d200a5260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b978445c2a96d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f22e0b70640 1 -- 172.21.15.55:0/1751910525 shutdown_connections 2024-04-25T08:53:52.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f22e0b70640 1 --2- 172.21.15.55:0/1751910525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 0x7f22dc0b3240 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f22e0b70640 1 --2- 172.21.15.55:0/1751910525 >> v2:172.21.15.167:3300/0 conn(0x7f22dc071fc0 0x7f22dc06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f512587e640 1 --2- 172.21.15.55:0/2145388967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51200cc2f0 0x7f512015f920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f512006d9e0 tx=0x7f511002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=814b2aa1d68d4759 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f3589307640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f358406b2b0 0x7f358415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f3589307640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358406dd10 con 0x7f358406e7f0 2024-04-25T08:53:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f3589307640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358406dff0 con 0x7f358406f140 2024-04-25T08:53:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f3589307640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358406e360 con 0x7f358406b2b0 2024-04-25T08:53:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f3583fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f358406f140 0x7f35841508c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58586/0 (socket says 172.21.15.55:58586) 2024-04-25T08:53:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f3583fff640 1 -- 172.21.15.55:0/1243532764 learned_addr learned my addr 172.21.15.55:0/1243532764 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f22e0b70640 1 -- 172.21.15.55:0/1751910525 >> 172.21.15.55:0/1751910525 conn(0x7f22dc06aba0 msgr2=0x7f22dc06af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f5117fff640 1 -- 172.21.15.55:0/2145388967 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110037070 con 0x7f51200cc2f0 2024-04-25T08:53:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f22e0b70640 1 -- 172.21.15.55:0/1751910525 shutdown_connections 2024-04-25T08:53:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f5117fff640 1 -- 172.21.15.55:0/2145388967 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511002ae50 con 0x7f51200cc2f0 2024-04-25T08:53:52.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f22e0b70640 1 -- 172.21.15.55:0/1751910525 wait complete. 2024-04-25T08:53:52.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.540+0000 7f4462c0d640 1 -- 172.21.15.55:0/1089627644 wait complete. 2024-04-25T08:53:52.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f4462c0d640 1 Processor -- start 2024-04-25T08:53:52.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.541+0000 7f4462c0d640 1 -- start start 2024-04-25T08:53:52.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f4462c0d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c147f70 0x7f445c15f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f4462c0d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445c162ff0 0x7f445c14aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f4462c0d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f445c165910 0x7f445c13de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f446140a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445c162ff0 0x7f445c14aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f446140a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445c162ff0 0x7f445c14aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:38424/0 (socket says 172.21.15.55:38424) 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f446140a640 1 -- 172.21.15.55:0/521987308 learned_addr learned my addr 172.21.15.55:0/521987308 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f4462c0d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0b11f0 con 0x7f445c147f70 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f4462c0d640 1 -- 172.21.15.55:0/521987308 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0b1070 con 0x7f445c162ff0 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f4462c0d640 1 -- 172.21.15.55:0/521987308 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0b1370 con 0x7f445c165910 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f446240c640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f445c165910 0x7f445c13de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f4461c0b640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c147f70 0x7f445c15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f446140a640 1 -- 172.21.15.55:0/521987308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f445c165910 msgr2=0x7f445c13de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f446140a640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f445c165910 0x7f445c13de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f446140a640 1 -- 172.21.15.55:0/521987308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c147f70 msgr2=0x7f445c15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f446140a640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c147f70 0x7f445c15f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f446140a640 1 -- 172.21.15.55:0/521987308 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c15fe80 con 0x7f445c162ff0 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f446240c640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f445c165910 0x7f445c13de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f4461c0b640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c147f70 0x7f445c15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:52.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3a1cb4e640 1 Processor -- start 2024-04-25T08:53:52.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3a1cb4e640 1 -- start start 2024-04-25T08:53:52.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f5117fff640 1 -- 172.21.15.55:0/2145388967 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110037070 con 0x7f51200cc2f0 2024-04-25T08:53:52.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f51272e1640 1 -- 172.21.15.55:0/2145388967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51200cc2f0 msgr2=0x7f512015f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f51272e1640 1 --2- 172.21.15.55:0/2145388967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51200cc2f0 0x7f512015f920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f512006d9e0 tx=0x7f511002a300 comp rx=0 tx=0).stop 2024-04-25T08:53:52.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f51272e1640 1 -- 172.21.15.55:0/2145388967 shutdown_connections 2024-04-25T08:53:52.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f51272e1640 1 --2- 172.21.15.55:0/2145388967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51200cc2f0 0x7f512015f920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f51272e1640 1 --2- 172.21.15.55:0/2145388967 >> v2:172.21.15.55:3300/0 conn(0x7f51200cf940 0x7f512015bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f51272e1640 1 -- 172.21.15.55:0/2145388967 >> 172.21.15.55:0/2145388967 conn(0x7f5120099a40 msgr2=0x7f51200b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058121047 0 0) 0x7f358406dff0 con 0x7f358406f140 2024-04-25T08:53:52.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3570003520 con 0x7f358406f140 2024-04-25T08:53:52.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914462451 0 0) 0x7f358406dd10 con 0x7f358406e7f0 2024-04-25T08:53:52.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f358406dff0 con 0x7f358406e7f0 2024-04-25T08:53:52.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 41491692 0 0) 0x7f3570003520 con 0x7f358406f140 2024-04-25T08:53:52.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 >> v2:172.21.15.167:3300/0 conn(0x7f358406b2b0 msgr2=0x7f358415d6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T08:53:52.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 --2- 172.21.15.55:0/1243532764 >> v2:172.21.15.167:3300/0 conn(0x7f358406b2b0 0x7f358415d6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 >> v1:172.21.15.55:6789/0 conn(0x7f358406e7f0 legacy=0x7f358406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358415e440 con 0x7f358406f140 2024-04-25T08:53:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f357c001670 con 0x7f358406f140 2024-04-25T08:53:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 >> v1:172.21.15.167:6789/0 conn(0x7f358406f140 legacy=0x7f35841508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3570004ba0 0x7f3570004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35700037a0 0x7f3570003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004280 0x7f357000fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358406e360 con 0x7f3570004280 2024-04-25T08:53:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700105f0 con 0x7f3570004ba0 2024-04-25T08:53:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35700107f0 con 0x7f35700037a0 2024-04-25T08:53:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3583fff640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3570004ba0 0x7f3570004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3588b06640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004280 0x7f357000fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7fdf3359e640 1 Processor -- start 2024-04-25T08:53:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f7d1e7fc640 1 -- 172.21.15.55:0/136973007 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200b2070 con 0x7f7d18006a40 2024-04-25T08:53:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f7d1e7fc640 1 -- 172.21.15.55:0/136973007 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d200ad640 con 0x7f7d18006a40 2024-04-25T08:53:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f7d1e7fc640 1 -- 172.21.15.55:0/136973007 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200adab0 con 0x7f7d18006a40 2024-04-25T08:53:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f7d25f5c640 1 -- 172.21.15.55:0/136973007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d18006a40 msgr2=0x7f7d18006ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.543+0000 7f7d25f5c640 1 --2- 172.21.15.55:0/136973007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d18006a40 0x7f7d18006ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7d2002d370 tx=0x7f7d200a5260 comp rx=0 tx=0).stop 2024-04-25T08:53:52.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f446140a640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445c162ff0 0x7f445c14aa10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f445800c820 tx=0x7f445800cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.542+0000 7f20fb722640 1 -- 172.21.15.55:0/2667888629 wait complete. 2024-04-25T08:53:52.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f35837fe640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35700037a0 0x7f3570003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f51272e1640 1 -- 172.21.15.55:0/2145388967 shutdown_connections 2024-04-25T08:53:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f7d25f5c640 1 -- 172.21.15.55:0/136973007 shutdown_connections 2024-04-25T08:53:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f7d25f5c640 1 --2- 172.21.15.55:0/136973007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d18006a40 0x7f7d18006ed0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f7d25f5c640 1 --2- 172.21.15.55:0/136973007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1804b3b0 0x7f7d18034010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f7d25f5c640 1 -- 172.21.15.55:0/136973007 >> 172.21.15.55:0/136973007 conn(0x7f7d1800a3f0 msgr2=0x7f7d1800a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3583fff640 1 -- 172.21.15.55:0/1243532764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35700037a0 msgr2=0x7f3570003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3583fff640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35700037a0 0x7f3570003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3583fff640 1 -- 172.21.15.55:0/1243532764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004280 msgr2=0x7f357000fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3583fff640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004280 0x7f357000fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3583fff640 1 -- 172.21.15.55:0/1243532764 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358415e440 con 0x7f3570004ba0 2024-04-25T08:53:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3a1cb4e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a10006ea0 0x7f3a100444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3a1cb4e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a1004ffd0 0x7f3a100dbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3a1cb4e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a100ead00 0x7f3a1004dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3a1cb4e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a10054940 con 0x7f3a100ead00 2024-04-25T08:53:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3a1cb4e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a100547c0 con 0x7f3a1004ffd0 2024-04-25T08:53:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3a1cb4e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1004f550 con 0x7f3a10006ea0 2024-04-25T08:53:52.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f7d25f5c640 1 -- 172.21.15.55:0/136973007 shutdown_connections 2024-04-25T08:53:52.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f22e0b70640 1 Processor -- start 2024-04-25T08:53:52.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f20fb722640 1 Processor -- start 2024-04-25T08:53:52.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f22e0b70640 1 -- start start 2024-04-25T08:53:52.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f3a177fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a10006ea0 0x7f3a100444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f7d25f5c640 1 -- 172.21.15.55:0/136973007 wait complete. 2024-04-25T08:53:52.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3588b06640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004280 0x7f357000fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:52.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f3588b06640 1 -- 172.21.15.55:0/1243532764 reap_dead start 2024-04-25T08:53:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7fdf3359e640 1 -- start start 2024-04-25T08:53:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7fdf3359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf2c038100 0x7fdf2c0dc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f44527fc640 1 -- 172.21.15.55:0/521987308 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458015070 con 0x7f445c162ff0 2024-04-25T08:53:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.544+0000 7f44527fc640 1 -- 172.21.15.55:0/521987308 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458007a30 con 0x7f445c162ff0 2024-04-25T08:53:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f44527fc640 1 -- 172.21.15.55:0/521987308 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458007e00 con 0x7f445c162ff0 2024-04-25T08:53:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f3a177fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a10006ea0 0x7f3a100444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:51562/0 (socket says 172.21.15.55:51562) 2024-04-25T08:53:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f3a177fe640 1 -- 172.21.15.55:0/4206772624 learned_addr learned my addr 172.21.15.55:0/4206772624 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f3a177fe640 1 -- 172.21.15.55:0/4206772624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a1004ffd0 msgr2=0x7f3a100dbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f3a177fe640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a1004ffd0 0x7f3a100dbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f3a177fe640 1 -- 172.21.15.55:0/4206772624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a100ead00 msgr2=0x7f3a1004dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f3a177fe640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a100ead00 0x7f3a1004dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f3a177fe640 1 -- 172.21.15.55:0/4206772624 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10044a20 con 0x7f3a10006ea0 2024-04-25T08:53:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f20fb722640 1 -- start start 2024-04-25T08:53:52.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f3583fff640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3570004ba0 0x7f3570004fa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f357c00c210 tx=0x7f3570005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f28ab62717526732 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.545+0000 7f51272e1640 1 -- 172.21.15.55:0/2145388967 wait complete. 2024-04-25T08:53:52.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c007d30 con 0x7f3570004ba0 2024-04-25T08:53:52.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c0058d0 con 0x7f3570004ba0 2024-04-25T08:53:52.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f3582ffd640 1 -- 172.21.15.55:0/1243532764 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c005cc0 con 0x7f3570004ba0 2024-04-25T08:53:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f7d25f5c640 1 Processor -- start 2024-04-25T08:53:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7fdf3359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c04ffc0 0x7fdf2c045120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7fdf3359e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf2c0eacf0 0x7fdf2c0dc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7fdf3359e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c054930 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7fdf3359e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0547b0 con 0x7fdf2c038100 2024-04-25T08:53:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7fdf3359e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c04f540 con 0x7fdf2c0eacf0 2024-04-25T08:53:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f20fb722640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20ec005e80 0x7f20ec045580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f4462c0d640 1 -- 172.21.15.55:0/521987308 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c160160 con 0x7f445c162ff0 2024-04-25T08:53:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f4462c0d640 1 -- 172.21.15.55:0/521987308 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c13d9a0 con 0x7f445c162ff0 2024-04-25T08:53:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f7d25f5c640 1 -- start start 2024-04-25T08:53:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f20fb722640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20ec006800 0x7f20ec0d7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f22e0b70640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 0x7f22dc1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f3a177fe640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a10006ea0 0x7f3a100444e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c035040 tx=0x7f3a0c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f20f94be640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20ec005e80 0x7f20ec045580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f20f94be640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20ec005e80 0x7f20ec045580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:51572/0 (socket says 172.21.15.55:51572) 2024-04-25T08:53:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f20f94be640 1 -- 172.21.15.55:0/3880015937 learned_addr learned my addr 172.21.15.55:0/3880015937 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f22e0b70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22dc071fc0 0x7f22dc15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f3a03fff640 1 -- 172.21.15.55:0/4206772624 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c042070 con 0x7f3a10006ea0 2024-04-25T08:53:52.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.546+0000 7f20f8cbd640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20ec006800 0x7f20ec0d7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7fdf31d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c04ffc0 0x7fdf2c045120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7fdf31d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c04ffc0 0x7fdf2c045120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48080/0 (socket says 172.21.15.55:48080) 2024-04-25T08:53:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7fdf3259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf2c038100 0x7fdf2c0dc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7fdf31d9b640 1 -- 172.21.15.55:0/2777857176 learned_addr learned my addr 172.21.15.55:0/2777857176 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f3a03fff640 1 -- 172.21.15.55:0/4206772624 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c03c620 con 0x7f3a10006ea0 2024-04-25T08:53:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f3a03fff640 1 -- 172.21.15.55:0/4206772624 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c037070 con 0x7f3a10006ea0 2024-04-25T08:53:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f20fb722640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20ec0eacf0 0x7f20ec04d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7fdf32d9d640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf2c0eacf0 0x7fdf2c0dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f20fb722640 1 -- 172.21.15.55:0/3880015937 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0547b0 con 0x7f20ec0eacf0 2024-04-25T08:53:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f20fb722640 1 -- 172.21.15.55:0/3880015937 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec050190 con 0x7f20ec006800 2024-04-25T08:53:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f20fb722640 1 -- 172.21.15.55:0/3880015937 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec054930 con 0x7f20ec005e80 2024-04-25T08:53:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f20f9cbf640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20ec0eacf0 0x7f20ec04d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f3589307640 1 -- 172.21.15.55:0/1243532764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3570004ba0 msgr2=0x7f3570004fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f51272e1640 1 Processor -- start 2024-04-25T08:53:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f20f8cbd640 1 -- 172.21.15.55:0/3880015937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20ec005e80 msgr2=0x7f20ec045580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f20f8cbd640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20ec005e80 0x7f20ec045580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f20f8cbd640 1 -- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20ec0eacf0 msgr2=0x7f20ec04d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f51272e1640 1 -- start start 2024-04-25T08:53:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7fdf31d9b640 1 -- 172.21.15.55:0/2777857176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf2c0eacf0 msgr2=0x7fdf2c0dc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7fdf31d9b640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf2c0eacf0 0x7fdf2c0dc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7fdf31d9b640 1 -- 172.21.15.55:0/2777857176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf2c038100 msgr2=0x7fdf2c0dc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7fdf31d9b640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf2c038100 0x7fdf2c0dc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7fdf31d9b640 1 -- 172.21.15.55:0/2777857176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c043810 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f7d25f5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d18006a40 0x7f7d180e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f22e0b70640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22dc0b3780 0x7f22dc15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f22e0b70640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0713c0 con 0x7f22dc071fc0 2024-04-25T08:53:52.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f22e0b70640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc162590 con 0x7f22dc0b3780 2024-04-25T08:53:52.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f22e0b70640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc071540 con 0x7f22dc06dee0 2024-04-25T08:53:52.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f20f8cbd640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20ec0eacf0 0x7f20ec04d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f20f8cbd640 1 -- 172.21.15.55:0/3880015937 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0d7a50 con 0x7f20ec006800 2024-04-25T08:53:52.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f3589307640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3570004ba0 0x7f3570004fa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f357c00c210 tx=0x7f3570005830 comp rx=0 tx=0).stop 2024-04-25T08:53:52.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22dc071fc0 0x7f22dc15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f22d9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22dc071fc0 0x7f22dc15a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48066/0 (socket says 172.21.15.55:48066) 2024-04-25T08:53:52.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f22d9d9b640 1 -- 172.21.15.55:0/929170762 learned_addr learned my addr 172.21.15.55:0/929170762 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f22da59c640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 0x7f22dc1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f20f9cbf640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20ec0eacf0 0x7f20ec04d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:52.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7fdf31d9b640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c04ffc0 0x7fdf2c045120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdf3404f440 tx=0x7fdf34068980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f3589307640 1 -- 172.21.15.55:0/1243532764 shutdown_connections 2024-04-25T08:53:52.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f3589307640 1 --2- 172.21.15.55:0/1243532764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3570004ba0 0x7f3570004fa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f3589307640 1 -- 172.21.15.55:0/1243532764 >> 172.21.15.55:0/1243532764 conn(0x7f3584066ff0 msgr2=0x7f35840b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f3a1cb4e640 1 -- 172.21.15.55:0/4206772624 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a10043720 con 0x7f3a10006ea0 2024-04-25T08:53:52.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.547+0000 7f3a1cb4e640 1 -- 172.21.15.55:0/4206772624 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a10043ce0 con 0x7f3a10006ea0 2024-04-25T08:53:52.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f7d1f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d18006a40 0x7f7d180e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f7d1f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d18006a40 0x7f7d180e4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48096/0 (socket says 172.21.15.55:48096) 2024-04-25T08:53:52.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f7d1f7fe640 1 -- 172.21.15.55:0/1234903818 learned_addr learned my addr 172.21.15.55:0/1234903818 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f22da59c640 1 -- 172.21.15.55:0/929170762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22dc0b3780 msgr2=0x7f22dc15cfa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T08:53:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f7d25f5c640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1804b3b0 0x7f7d1804de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f22da59c640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22dc0b3780 0x7f22dc15cfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f22da59c640 1 -- 172.21.15.55:0/929170762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22dc071fc0 msgr2=0x7f22dc15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f22da59c640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22dc071fc0 0x7f22dc15a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f7d25f5c640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d1804f4c0 0x7f7d1804e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f22da59c640 1 -- 172.21.15.55:0/929170762 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc15ac70 con 0x7f22dc06dee0 2024-04-25T08:53:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f7d1effd640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1804b3b0 0x7f7d1804de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7fdf22ffd640 1 -- 172.21.15.55:0/2777857176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340bc070 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f7d1ffff640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d1804f4c0 0x7f7d1804e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18050050 con 0x7f7d18006a40 2024-04-25T08:53:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1804b790 con 0x7f7d1804f4c0 2024-04-25T08:53:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18054820 con 0x7f7d1804b3b0 2024-04-25T08:53:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7fdf3359e640 1 -- 172.21.15.55:0/2777857176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c045d70 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7fdf22ffd640 1 -- 172.21.15.55:0/2777857176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf340ac8e0 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f22da59c640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 0x7f22dc1565b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f22d000d5f0 tx=0x7f22d000dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7fdf3359e640 1 -- 172.21.15.55:0/2777857176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c043ab0 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7fdf22ffd640 1 -- 172.21.15.55:0/2777857176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340b2040 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f22caffd640 1 -- 172.21.15.55:0/929170762 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d00125f0 con 0x7f22dc06dee0 2024-04-25T08:53:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f22caffd640 1 -- 172.21.15.55:0/929170762 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d0019070 con 0x7f22dc06dee0 2024-04-25T08:53:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f22caffd640 1 -- 172.21.15.55:0/929170762 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d00125f0 con 0x7f22dc06dee0 2024-04-25T08:53:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.548+0000 7f44527fc640 1 -- 172.21.15.55:0/521987308 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4458018070 con 0x7f445c162ff0 2024-04-25T08:53:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f4462c0d640 1 -- 172.21.15.55:0/521987308 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c0749b0 con 0x7f445c162ff0 2024-04-25T08:53:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f44527fc640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f444006b5a0 0x7f444006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f3a1cb4e640 1 -- 172.21.15.55:0/4206772624 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f8005290 con 0x7f3a10006ea0 2024-04-25T08:53:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f51272e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51200b2c80 0x7f5120155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f51272e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51200cc2f0 0x7f51200b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f22e0b70640 1 -- 172.21.15.55:0/929170762 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc15d980 con 0x7f22dc06dee0 2024-04-25T08:53:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f22e0b70640 1 -- 172.21.15.55:0/929170762 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc15df90 con 0x7f22dc06dee0 2024-04-25T08:53:52.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f51272e1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51200cf940 0x7f512006f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f44527fc640 1 -- 172.21.15.55:0/521987308 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f445808a020 con 0x7f445c162ff0 2024-04-25T08:53:52.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f4461c0b640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f444006b5a0 0x7f444006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f51272e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51200cc900 con 0x7f51200cc2f0 2024-04-25T08:53:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f51272e1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51200cc780 con 0x7f51200b2c80 2024-04-25T08:53:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f512507d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51200b2c80 0x7f5120155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f20f8cbd640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20ec006800 0x7f20ec0d7100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00b090 tx=0x7f20e40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.549+0000 7f512487c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51200cc2f0 0x7f51200b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f512507d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51200b2c80 0x7f5120155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:38478/0 (socket says 172.21.15.55:38478) 2024-04-25T08:53:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f512507d640 1 -- 172.21.15.55:0/664913940 learned_addr learned my addr 172.21.15.55:0/664913940 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f3589307640 1 -- 172.21.15.55:0/1243532764 shutdown_connections 2024-04-25T08:53:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f51272e1640 1 -- 172.21.15.55:0/664913940 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51200cf530 con 0x7f51200cf940 2024-04-25T08:53:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f3a03fff640 1 -- 172.21.15.55:0/4206772624 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3a0c045070 con 0x7f3a10006ea0 2024-04-25T08:53:52.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f4461c0b640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f444006b5a0 0x7f444006da60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f444c034000 tx=0x7f444c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f7d1effd640 1 -- 172.21.15.55:0/1234903818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d1804f4c0 msgr2=0x7f7d1804e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f7d1effd640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d1804f4c0 0x7f7d1804e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f7d1effd640 1 -- 172.21.15.55:0/1234903818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d18006a40 msgr2=0x7f7d180e4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f7d1effd640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d18006a40 0x7f7d180e4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f7d1effd640 1 -- 172.21.15.55:0/1234903818 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180e76a0 con 0x7f7d1804b3b0 2024-04-25T08:53:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f512587e640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51200cf940 0x7f512006f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f512487c640 1 -- 172.21.15.55:0/664913940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51200cf940 msgr2=0x7f512006f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f512487c640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51200cf940 0x7f512006f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f512487c640 1 -- 172.21.15.55:0/664913940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51200b2c80 msgr2=0x7f5120155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f512487c640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51200b2c80 0x7f5120155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f512487c640 1 -- 172.21.15.55:0/664913940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51200b4530 con 0x7f51200cc2f0 2024-04-25T08:53:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f7d1f7fe640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d18006a40 0x7f7d180e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:52.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7fdf3359e640 1 -- 172.21.15.55:0/2777857176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2c005380 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.551+0000 7f512507d640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51200b2c80 0x7f5120155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:52.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.551+0000 7f3a03fff640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39fc06b5a0 0x7f39fc06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.551+0000 7f3a03fff640 1 -- 172.21.15.55:0/4206772624 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a0c0aa750 con 0x7f3a10006ea0 2024-04-25T08:53:52.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.551+0000 7f512487c640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51200cc2f0 0x7f51200b3a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f511c00c390 tx=0x7f511c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.551+0000 7f7d1effd640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1804b3b0 0x7f7d1804de70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c3c0 tx=0x7f7d1400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.550+0000 7f3589307640 1 -- 172.21.15.55:0/1243532764 wait complete. 2024-04-25T08:53:52.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.551+0000 7f3a16ffd640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39fc06b5a0 0x7f39fc06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.551+0000 7f22e0b70640 1 -- 172.21.15.55:0/929170762 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc0750b0 con 0x7f22dc06dee0 2024-04-25T08:53:52.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.551+0000 7f5115ffb640 1 -- 172.21.15.55:0/664913940 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c017070 con 0x7f51200cc2f0 2024-04-25T08:53:52.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.551+0000 7f5115ffb640 1 -- 172.21.15.55:0/664913940 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c0052d0 con 0x7f51200cc2f0 2024-04-25T08:53:52.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.551+0000 7f5115ffb640 1 -- 172.21.15.55:0/664913940 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c003810 con 0x7f51200cc2f0 2024-04-25T08:53:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.551+0000 7f51272e1640 1 -- 172.21.15.55:0/664913940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51200b4810 con 0x7f51200cc2f0 2024-04-25T08:53:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.552+0000 7f51272e1640 1 -- 172.21.15.55:0/664913940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51201f0be0 con 0x7f51200cc2f0 2024-04-25T08:53:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.552+0000 7f22caffd640 1 -- 172.21.15.55:0/929170762 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f22d0012790 con 0x7f22dc06dee0 2024-04-25T08:53:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.552+0000 7f3589307640 1 Processor -- start 2024-04-25T08:53:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.552+0000 7f3a16ffd640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39fc06b5a0 0x7f39fc06da60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3a04000f60 tx=0x7f3a040017a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.552+0000 7fdf22ffd640 1 -- 172.21.15.55:0/2777857176 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf340bf070 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.552+0000 7f22caffd640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f22bc06b6d0 0x7f22bc06db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.553+0000 7f3589307640 1 -- start start 2024-04-25T08:53:52.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.552+0000 7f22caffd640 1 -- 172.21.15.55:0/929170762 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22d008a290 con 0x7f22dc06dee0 2024-04-25T08:53:52.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.553+0000 7fdf22ffd640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf1406b500 0x7fdf1406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.553+0000 7fdf22ffd640 1 -- 172.21.15.55:0/2777857176 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf34125950 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.553+0000 7fdf3259c640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf1406b500 0x7fdf1406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7fdf3259c640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf1406b500 0x7fdf1406d9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009890 tx=0x7fdf28008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f22d9d9b640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f22bc06b6d0 0x7f22bc06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f3589307640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004ba0 0x7f358414a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f3589307640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35840a84a0 0x7f35840a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f3583fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004ba0 0x7f358414a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f3583fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004ba0 0x7f358414a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48114/0 (socket says 172.21.15.55:48114) 2024-04-25T08:53:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f3589307640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3584154650 0x7f3584154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f3583fff640 1 -- 172.21.15.55:0/2199610820 learned_addr learned my addr 172.21.15.55:0/2199610820 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f22d9d9b640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f22bc06b6d0 0x7f22bc06db90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000f80 tx=0x7f22d4009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f3589307640 1 -- 172.21.15.55:0/2199610820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358406af30 con 0x7f3570004ba0 2024-04-25T08:53:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f35837fe640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35840a84a0 0x7f35840a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f5115ffb640 1 -- 172.21.15.55:0/664913940 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f511c01a070 con 0x7f51200cc2f0 2024-04-25T08:53:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f3589307640 1 -- 172.21.15.55:0/2199610820 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358406adb0 con 0x7f3584154650 2024-04-25T08:53:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f20e9ffb640 1 -- 172.21.15.55:0/3880015937 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4041070 con 0x7f20ec006800 2024-04-25T08:53:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f20e9ffb640 1 -- 172.21.15.55:0/3880015937 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e403c890 con 0x7f20ec006800 2024-04-25T08:53:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f20fb722640 1 -- 172.21.15.55:0/3880015937 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec0d7d30 con 0x7f20ec006800 2024-04-25T08:53:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f20e9ffb640 1 -- 172.21.15.55:0/3880015937 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4037040 con 0x7f20ec006800 2024-04-25T08:53:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f51272e1640 1 -- 172.21.15.55:0/664913940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51200749b0 con 0x7f51200cc2f0 2024-04-25T08:53:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f44527fc640 1 -- 172.21.15.55:0/521987308 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f44580588c0 con 0x7f445c162ff0 2024-04-25T08:53:52.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f3588b06640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3584154650 0x7f3584154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.554+0000 7f3589307640 1 -- 172.21.15.55:0/2199610820 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358406b0b0 con 0x7f35840a84a0 2024-04-25T08:53:52.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f20fb722640 1 -- 172.21.15.55:0/3880015937 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec0d82f0 con 0x7f20ec006800 2024-04-25T08:53:52.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f5115ffb640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f510406b500 0x7f510406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f7d0bfff640 1 -- 172.21.15.55:0/1234903818 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d140052d0 con 0x7f7d1804b3b0 2024-04-25T08:53:52.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d180e7980 con 0x7f7d1804b3b0 2024-04-25T08:53:52.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f3a03fff640 1 -- 172.21.15.55:0/4206772624 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3a0c0796d0 con 0x7f3a10006ea0 2024-04-25T08:53:52.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d180e7f40 con 0x7f7d1804b3b0 2024-04-25T08:53:52.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f512507d640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f510406b500 0x7f510406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f3583fff640 1 -- 172.21.15.55:0/2199610820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35840a84a0 msgr2=0x7f35840a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f3583fff640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35840a84a0 0x7f35840a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f3583fff640 1 -- 172.21.15.55:0/2199610820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3584154650 msgr2=0x7f3584154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f3583fff640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3584154650 0x7f3584154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.555+0000 7f3583fff640 1 -- 172.21.15.55:0/2199610820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3584155010 con 0x7f3570004ba0 2024-04-25T08:53:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.556+0000 7f3583fff640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004ba0 0x7f358414a6f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f357c00c300 tx=0x7f357c001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.556+0000 7f512507d640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f510406b500 0x7f510406d9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5118000ba0 tx=0x7f51180098d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.556+0000 7f35837fe640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35840a84a0 0x7f35840a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.556+0000 7f3588b06640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3584154650 0x7f3584154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.557+0000 7f20df7fe640 1 -- 172.21.15.55:0/3880015937 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec03a840 con 0x7f20ec006800 2024-04-25T08:53:52.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.557+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d18008e10 con 0x7f7d1804b3b0 2024-04-25T08:53:52.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.558+0000 7f20e9ffb640 1 -- 172.21.15.55:0/3880015937 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f20e4044070 con 0x7f20ec006800 2024-04-25T08:53:52.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.558+0000 7f20e9ffb640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d806b5a0 0x7f20d806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.558+0000 7f20e9ffb640 1 -- 172.21.15.55:0/3880015937 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20e40ab160 con 0x7f20ec006800 2024-04-25T08:53:52.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.558+0000 7f20f94be640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d806b5a0 0x7f20d806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.559+0000 7f20f94be640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d806b5a0 0x7f20d806da60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20f00099a0 tx=0x7f20f00090e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.560+0000 7f5115ffb640 1 -- 172.21.15.55:0/664913940 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f511c0879f0 con 0x7f51200cc2f0 2024-04-25T08:53:52.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.560+0000 7f7d0bfff640 1 -- 172.21.15.55:0/1234903818 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d14005470 con 0x7f7d1804b3b0 2024-04-25T08:53:52.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.560+0000 7f7d0bfff640 1 -- 172.21.15.55:0/1234903818 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14020060 con 0x7f7d1804b3b0 2024-04-25T08:53:52.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.560+0000 7f22caffd640 1 -- 172.21.15.55:0/929170762 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f22d0058ff0 con 0x7f22dc06dee0 2024-04-25T08:53:52.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.560+0000 7fdf22ffd640 1 -- 172.21.15.55:0/2777857176 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf340c6030 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.560+0000 7f3580ff9640 1 -- 172.21.15.55:0/2199610820 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c007d30 con 0x7f3570004ba0 2024-04-25T08:53:52.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.560+0000 7f3589307640 1 -- 172.21.15.55:0/2199610820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35841552a0 con 0x7f3570004ba0 2024-04-25T08:53:52.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.560+0000 7f3589307640 1 -- 172.21.15.55:0/2199610820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3584155860 con 0x7f3570004ba0 2024-04-25T08:53:52.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.562+0000 7f357a7fc640 1 -- 172.21.15.55:0/2199610820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3568005290 con 0x7f3570004ba0 2024-04-25T08:53:52.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.562+0000 7f20e9ffb640 1 -- 172.21.15.55:0/3880015937 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20e4079a90 con 0x7f20ec006800 2024-04-25T08:53:52.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.563+0000 7f7d0bfff640 1 -- 172.21.15.55:0/1234903818 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d14007220 con 0x7f7d1804b3b0 2024-04-25T08:53:52.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.564+0000 7f7d0bfff640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d0406b4d0 0x7f7d0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.564+0000 7f7d0bfff640 1 -- 172.21.15.55:0/1234903818 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d140899f0 con 0x7f7d1804b3b0 2024-04-25T08:53:52.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.564+0000 7f7d1f7fe640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d0406b4d0 0x7f7d0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.565+0000 7f7d1f7fe640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d0406b4d0 0x7f7d0406d990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0099f0 tx=0x7f7d0c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.566+0000 7f7d0bfff640 1 -- 172.21.15.55:0/1234903818 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7d14058200 con 0x7f7d1804b3b0 2024-04-25T08:53:52.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.570+0000 7f5115ffb640 1 -- 172.21.15.55:0/664913940 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f511c057c70 con 0x7f51200cc2f0 2024-04-25T08:53:52.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.570+0000 7f3580ff9640 1 -- 172.21.15.55:0/2199610820 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c041070 con 0x7f3570004ba0 2024-04-25T08:53:52.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.570+0000 7f3580ff9640 1 -- 172.21.15.55:0/2199610820 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c0047e0 con 0x7f3570004ba0 2024-04-25T08:53:52.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.581+0000 7f3580ff9640 1 -- 172.21.15.55:0/2199610820 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f357c03b070 con 0x7f3570004ba0 2024-04-25T08:53:52.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.581+0000 7f3580ff9640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f356406b500 0x7f356406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:52.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.582+0000 7f35837fe640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f356406b500 0x7f356406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:52.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.582+0000 7f35837fe640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f356406b500 0x7f356406d9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f35841fad70 tx=0x7f356c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:52.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.582+0000 7f3580ff9640 1 -- 172.21.15.55:0/2199610820 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f357c0aab40 con 0x7f3570004ba0 2024-04-25T08:53:52.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.584+0000 7f3580ff9640 1 -- 172.21.15.55:0/2199610820 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f357c0323c0 con 0x7f3570004ba0 2024-04-25T08:53:52.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.977+0000 7f4462c0d640 1 -- 172.21.15.55:0/521987308 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f445c1473f0 con 0x7f445c162ff0 2024-04-25T08:53:52.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.977+0000 7f44527fc640 1 -- 172.21.15.55:0/521987308 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f445805c960 con 0x7f445c162ff0 2024-04-25T08:53:52.968 INFO:teuthology.orchestra.run.smithi055.stdout:64424509445 2024-04-25T08:53:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.981+0000 7f443ffff640 1 -- 172.21.15.55:0/521987308 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f444006b5a0 msgr2=0x7f444006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.981+0000 7f443ffff640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f444006b5a0 0x7f444006da60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f444c034000 tx=0x7f444c02e000 comp rx=0 tx=0).stop 2024-04-25T08:53:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.981+0000 7f443ffff640 1 -- 172.21.15.55:0/521987308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445c162ff0 msgr2=0x7f445c14aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.981+0000 7f443ffff640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445c162ff0 0x7f445c14aa10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f445800c820 tx=0x7f445800cc20 comp rx=0 tx=0).stop 2024-04-25T08:53:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.982+0000 7f443ffff640 1 -- 172.21.15.55:0/521987308 shutdown_connections 2024-04-25T08:53:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.982+0000 7f443ffff640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f444006b5a0 0x7f444006da60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.982+0000 7f443ffff640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f445c165910 0x7f445c13de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.982+0000 7f443ffff640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f445c162ff0 0x7f445c14aa10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.982+0000 7f443ffff640 1 --2- 172.21.15.55:0/521987308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c147f70 0x7f445c15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.982+0000 7f443ffff640 1 -- 172.21.15.55:0/521987308 >> 172.21.15.55:0/521987308 conn(0x7f445c06aba0 msgr2=0x7f445c163af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.982+0000 7f443ffff640 1 -- 172.21.15.55:0/521987308 shutdown_connections 2024-04-25T08:53:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.982+0000 7f443ffff640 1 -- 172.21.15.55:0/521987308 wait complete. 2024-04-25T08:53:52.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.983+0000 7f3a1cb4e640 1 -- 172.21.15.55:0/4206772624 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f39f8005580 con 0x7f3a10006ea0 2024-04-25T08:53:52.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.983+0000 7f3a03fff640 1 -- 172.21.15.55:0/4206772624 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a0c078fd0 con 0x7f3a10006ea0 2024-04-25T08:53:52.974 INFO:teuthology.orchestra.run.smithi055.stdout:64424509448 2024-04-25T08:53:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.987+0000 7f3a01ffb640 1 -- 172.21.15.55:0/4206772624 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39fc06b5a0 msgr2=0x7f39fc06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.987+0000 7f3a01ffb640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39fc06b5a0 0x7f39fc06da60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3a04000f60 tx=0x7f3a040017a0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.987+0000 7f3a01ffb640 1 -- 172.21.15.55:0/4206772624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a10006ea0 msgr2=0x7f3a100444e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.987+0000 7f3a01ffb640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a10006ea0 0x7f3a100444e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c035040 tx=0x7f3a0c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.988+0000 7f3a01ffb640 1 -- 172.21.15.55:0/4206772624 shutdown_connections 2024-04-25T08:53:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.988+0000 7f3a01ffb640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39fc06b5a0 0x7f39fc06da60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.988+0000 7f3a01ffb640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a100ead00 0x7f3a1004dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.988+0000 7f3a01ffb640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a1004ffd0 0x7f3a100dbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.988+0000 7f3a01ffb640 1 --2- 172.21.15.55:0/4206772624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a10006ea0 0x7f3a100444e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.988+0000 7f3a01ffb640 1 -- 172.21.15.55:0/4206772624 >> 172.21.15.55:0/4206772624 conn(0x7f3a10009fb0 msgr2=0x7f3a10036430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.988+0000 7f3a01ffb640 1 -- 172.21.15.55:0/4206772624 shutdown_connections 2024-04-25T08:53:52.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.988+0000 7f3a01ffb640 1 -- 172.21.15.55:0/4206772624 wait complete. 2024-04-25T08:53:52.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.988+0000 7fdf3359e640 1 -- 172.21.15.55:0/2777857176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdf2c006a20 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.989+0000 7fdf22ffd640 1 -- 172.21.15.55:0/2777857176 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf340f47c0 con 0x7fdf2c04ffc0 2024-04-25T08:53:52.980 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-04-25T08:53:52.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.991+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7d180057d0 con 0x7f7d1804b3b0 2024-04-25T08:53:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.992+0000 7f7d0bfff640 1 -- 172.21.15.55:0/1234903818 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d1405c2a0 con 0x7f7d1804b3b0 2024-04-25T08:53:52.982 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-04-25T08:53:52.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.993+0000 7fdf3359e640 1 -- 172.21.15.55:0/2777857176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf1406b500 msgr2=0x7fdf1406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.993+0000 7fdf3359e640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf1406b500 0x7fdf1406d9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009890 tx=0x7fdf28008040 comp rx=0 tx=0).stop 2024-04-25T08:53:52.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.994+0000 7fdf3359e640 1 -- 172.21.15.55:0/2777857176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c04ffc0 msgr2=0x7fdf2c045120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.994+0000 7fdf3359e640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c04ffc0 0x7fdf2c045120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdf3404f440 tx=0x7fdf34068980 comp rx=0 tx=0).stop 2024-04-25T08:53:52.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.994+0000 7fdf3359e640 1 -- 172.21.15.55:0/2777857176 shutdown_connections 2024-04-25T08:53:52.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.994+0000 7fdf3359e640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf1406b500 0x7fdf1406d9c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.994+0000 7fdf3359e640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf2c0eacf0 0x7fdf2c0dc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.994+0000 7fdf3359e640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c04ffc0 0x7fdf2c045120 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.994+0000 7fdf3359e640 1 --2- 172.21.15.55:0/2777857176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf2c038100 0x7fdf2c0dc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.994+0000 7fdf3359e640 1 -- 172.21.15.55:0/2777857176 >> 172.21.15.55:0/2777857176 conn(0x7fdf2c009fa0 msgr2=0x7fdf2c006f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.995+0000 7f22e0b70640 1 -- 172.21.15.55:0/929170762 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f22dc165900 con 0x7f22dc06dee0 2024-04-25T08:53:52.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.995+0000 7fdf3359e640 1 -- 172.21.15.55:0/2777857176 shutdown_connections 2024-04-25T08:53:52.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.995+0000 7fdf3359e640 1 -- 172.21.15.55:0/2777857176 wait complete. 2024-04-25T08:53:52.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.995+0000 7f20df7fe640 1 -- 172.21.15.55:0/3880015937 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f20ec03a560 con 0x7f20ec006800 2024-04-25T08:53:52.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d0406b4d0 msgr2=0x7f7d0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d0406b4d0 0x7f7d0406d990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0099f0 tx=0x7f7d0c008040 comp rx=0 tx=0).stop 2024-04-25T08:53:52.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1804b3b0 msgr2=0x7f7d1804de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1804b3b0 0x7f7d1804de70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c3c0 tx=0x7f7d1400c880 comp rx=0 tx=0).stop 2024-04-25T08:53:52.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 shutdown_connections 2024-04-25T08:53:52.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d0406b4d0 0x7f7d0406d990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d1804f4c0 0x7f7d1804e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1804b3b0 0x7f7d1804de70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 --2- 172.21.15.55:0/1234903818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d18006a40 0x7f7d180e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.990 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-04-25T08:53:52.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 >> 172.21.15.55:0/1234903818 conn(0x7f7d1800a3f0 msgr2=0x7f7d1800a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f20e9ffb640 1 -- 172.21.15.55:0/3880015937 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20e407db30 con 0x7f20ec006800 2024-04-25T08:53:52.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f22caffd640 1 -- 172.21.15.55:0/929170762 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22d00588f0 con 0x7f22dc06dee0 2024-04-25T08:53:52.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 shutdown_connections 2024-04-25T08:53:52.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.996+0000 7f7d25f5c640 1 -- 172.21.15.55:0/1234903818 wait complete. 2024-04-25T08:53:52.991 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-04-25T08:53:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.998+0000 7f51272e1640 1 -- 172.21.15.55:0/664913940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f51201f0db0 con 0x7f51200cc2f0 2024-04-25T08:53:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.999+0000 7f5115ffb640 1 -- 172.21.15.55:0/664913940 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f511c05bd10 con 0x7f51200cc2f0 2024-04-25T08:53:52.992 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:52.999+0000 7f20df7fe640 1 -- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d806b5a0 msgr2=0x7f20d806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.000+0000 7f20df7fe640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d806b5a0 0x7f20d806da60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20f00099a0 tx=0x7f20f00090e0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.000+0000 7f20df7fe640 1 -- 172.21.15.55:0/3880015937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20ec006800 msgr2=0x7f20ec0d7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.000+0000 7f20df7fe640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20ec006800 0x7f20ec0d7100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00b090 tx=0x7f20e40046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.000+0000 7f20df7fe640 1 -- 172.21.15.55:0/3880015937 shutdown_connections 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.000+0000 7f20df7fe640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d806b5a0 0x7f20d806da60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.000+0000 7f20df7fe640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20ec0eacf0 0x7f20ec04d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.000+0000 7f20df7fe640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20ec006800 0x7f20ec0d7100 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.000+0000 7f20df7fe640 1 --2- 172.21.15.55:0/3880015937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20ec005e80 0x7f20ec045580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.000+0000 7f20df7fe640 1 -- 172.21.15.55:0/3880015937 >> 172.21.15.55:0/3880015937 conn(0x7f20ec009fa0 msgr2=0x7f20ec171ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.000+0000 7f20df7fe640 1 -- 172.21.15.55:0/3880015937 shutdown_connections 2024-04-25T08:53:52.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.000+0000 7f20df7fe640 1 -- 172.21.15.55:0/3880015937 wait complete. 2024-04-25T08:53:52.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.001+0000 7f22e0b70640 1 -- 172.21.15.55:0/929170762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f22bc06b6d0 msgr2=0x7f22bc06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.001+0000 7f22e0b70640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f22bc06b6d0 0x7f22bc06db90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000f80 tx=0x7f22d4009000 comp rx=0 tx=0).stop 2024-04-25T08:53:52.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.001+0000 7f22e0b70640 1 -- 172.21.15.55:0/929170762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 msgr2=0x7f22dc1565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.001+0000 7f22e0b70640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 0x7f22dc1565b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f22d000d5f0 tx=0x7f22d000dab0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.002+0000 7f22e0b70640 1 -- 172.21.15.55:0/929170762 shutdown_connections 2024-04-25T08:53:52.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.002+0000 7f22e0b70640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f22bc06b6d0 0x7f22bc06db90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.002+0000 7f22e0b70640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22dc0b3780 0x7f22dc15cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.002+0000 7f22e0b70640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22dc071fc0 0x7f22dc15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.002+0000 7f22e0b70640 1 --2- 172.21.15.55:0/929170762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22dc06dee0 0x7f22dc1565b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.002+0000 7f22e0b70640 1 -- 172.21.15.55:0/929170762 >> 172.21.15.55:0/929170762 conn(0x7f22dc06aba0 msgr2=0x7f22dc162f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-04-25T08:53:52.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.002+0000 7f22e0b70640 1 -- 172.21.15.55:0/929170762 shutdown_connections 2024-04-25T08:53:52.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.002+0000 7f22e0b70640 1 -- 172.21.15.55:0/929170762 wait complete. 2024-04-25T08:53:52.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.002+0000 7f51272e1640 1 -- 172.21.15.55:0/664913940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f510406b500 msgr2=0x7f510406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.002+0000 7f51272e1640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f510406b500 0x7f510406d9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5118000ba0 tx=0x7f51180098d0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.002+0000 7f51272e1640 1 -- 172.21.15.55:0/664913940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51200cc2f0 msgr2=0x7f51200b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:52.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.003+0000 7f51272e1640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51200cc2f0 0x7f51200b3a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f511c00c390 tx=0x7f511c00c850 comp rx=0 tx=0).stop 2024-04-25T08:53:52.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.003+0000 7f51272e1640 1 -- 172.21.15.55:0/664913940 shutdown_connections 2024-04-25T08:53:52.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.003+0000 7f51272e1640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f510406b500 0x7f510406d9c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.003+0000 7f51272e1640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51200cf940 0x7f512006f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.003+0000 7f51272e1640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51200cc2f0 0x7f51200b3a70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.003+0000 7f51272e1640 1 --2- 172.21.15.55:0/664913940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51200b2c80 0x7f5120155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:52.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.003+0000 7f51272e1640 1 -- 172.21.15.55:0/664913940 >> 172.21.15.55:0/664913940 conn(0x7f5120099a40 msgr2=0x7f512006aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:52.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.003+0000 7f51272e1640 1 -- 172.21.15.55:0/664913940 shutdown_connections 2024-04-25T08:53:52.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.003+0000 7f51272e1640 1 -- 172.21.15.55:0/664913940 wait complete. 2024-04-25T08:53:52.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.004+0000 7f357a7fc640 1 -- 172.21.15.55:0/2199610820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3568005850 con 0x7f3570004ba0 2024-04-25T08:53:52.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.005+0000 7f3580ff9640 1 -- 172.21.15.55:0/2199610820 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f357c079a40 con 0x7f3570004ba0 2024-04-25T08:53:52.999 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-04-25T08:53:52.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2024-04-25T08:53:53.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.009+0000 7f357a7fc640 1 -- 172.21.15.55:0/2199610820 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f356406b500 msgr2=0x7f356406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:53.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.009+0000 7f357a7fc640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f356406b500 0x7f356406d9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f35841fad70 tx=0x7f356c009040 comp rx=0 tx=0).stop 2024-04-25T08:53:53.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.009+0000 7f357a7fc640 1 -- 172.21.15.55:0/2199610820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004ba0 msgr2=0x7f358414a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:53.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.009+0000 7f357a7fc640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004ba0 0x7f358414a6f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f357c00c300 tx=0x7f357c001970 comp rx=0 tx=0).stop 2024-04-25T08:53:53.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.009+0000 7f357a7fc640 1 -- 172.21.15.55:0/2199610820 shutdown_connections 2024-04-25T08:53:53.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.009+0000 7f357a7fc640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f356406b500 0x7f356406d9c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:53.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.009+0000 7f357a7fc640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3584154650 0x7f3584154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:53.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.009+0000 7f357a7fc640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35840a84a0 0x7f35840a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:53.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.009+0000 7f357a7fc640 1 --2- 172.21.15.55:0/2199610820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3570004ba0 0x7f358414a6f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:53.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.009+0000 7f357a7fc640 1 -- 172.21.15.55:0/2199610820 >> 172.21.15.55:0/2199610820 conn(0x7f3584066ff0 msgr2=0x7f35840cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:53.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.011+0000 7f357a7fc640 1 -- 172.21.15.55:0/2199610820 shutdown_connections 2024-04-25T08:53:53.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:53.011+0000 7f357a7fc640 1 -- 172.21.15.55:0/2199610820 wait complete. 2024-04-25T08:53:53.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.4 2024-04-25T08:53:53.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-04-25T08:53:53.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.5 2024-04-25T08:53:53.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.1 2024-04-25T08:53:53.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-04-25T08:53:53.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.7 2024-04-25T08:53:53.996 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T08:53:54.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T08:53:54.005 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T08:53:54.008 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T08:53:54.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T08:53:54.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T08:53:54.016 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T08:53:54.018 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T08:53:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.173+0000 7f7feb4f5640 1 Processor -- start 2024-04-25T08:53:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.174+0000 7f7feb4f5640 1 -- start start 2024-04-25T08:53:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.175+0000 7f7feb4f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fe406c3c0 0x7f7fe40c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.175+0000 7f7feb4f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7fe40c4e50 0x7f7fe40cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.175+0000 7f7feb4f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe409a530 con 0x7f7fe4162100 2024-04-25T08:53:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.175+0000 7f7feb4f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe40cc3a0 con 0x7f7fe40c4e50 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.175+0000 7f7feb4f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40c5280 con 0x7f7fe406c3c0 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.176+0000 7f7fe9a92640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7fe40c4e50 0x7f7fe40cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.176+0000 7f7fe9a92640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7fe40c4e50 0x7f7fe40cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48126/0 (socket says 172.21.15.55:48126) 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.176+0000 7f7fe9a92640 1 -- 172.21.15.55:0/708866867 learned_addr learned my addr 172.21.15.55:0/708866867 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.176+0000 7f7fe9a92640 1 -- 172.21.15.55:0/708866867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fe406c3c0 msgr2=0x7f7fe40c4910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.176+0000 7f7fe9a92640 1 --2- 172.21.15.55:0/708866867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fe406c3c0 0x7f7fe40c4910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.176+0000 7f7fe9a92640 1 -- 172.21.15.55:0/708866867 >> v1:172.21.15.167:6789/0 conn(0x7f7fe4162100 legacy=0x7f7fe406bcb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.176+0000 7f7fe9a92640 1 -- 172.21.15.55:0/708866867 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe409a810 con 0x7f7fe40c4e50 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.178+0000 7f7fe9a92640 1 --2- 172.21.15.55:0/708866867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fe40c4e50 0x7f7fe40cc830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00b1a0 tx=0x7f7fdc02a830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33636527377f2bee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.178+0000 7f7fdbfff640 1 -- 172.21.15.55:0/708866867 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc033430 con 0x7f7fe40c4e50 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.179+0000 7f7fdbfff640 1 -- 172.21.15.55:0/708866867 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc0335d0 con 0x7f7fe40c4e50 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.180+0000 7f7feb4f5640 1 -- 172.21.15.55:0/708866867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fe40c4e50 msgr2=0x7f7fe40cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.180+0000 7f7feb4f5640 1 --2- 172.21.15.55:0/708866867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fe40c4e50 0x7f7fe40cc830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00b1a0 tx=0x7f7fdc02a830 comp rx=0 tx=0).stop 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.180+0000 7f7feb4f5640 1 -- 172.21.15.55:0/708866867 shutdown_connections 2024-04-25T08:53:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.180+0000 7f7feb4f5640 1 --2- 172.21.15.55:0/708866867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fe40c4e50 0x7f7fe40cc830 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.180+0000 7f7feb4f5640 1 --2- 172.21.15.55:0/708866867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fe406c3c0 0x7f7fe40c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.180+0000 7f7feb4f5640 1 -- 172.21.15.55:0/708866867 >> 172.21.15.55:0/708866867 conn(0x7f7fe40b3430 msgr2=0x7f7fe40b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.180+0000 7f7feb4f5640 1 -- 172.21.15.55:0/708866867 shutdown_connections 2024-04-25T08:53:54.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.180+0000 7f7feb4f5640 1 -- 172.21.15.55:0/708866867 wait complete. 2024-04-25T08:53:54.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.182+0000 7f7feb4f5640 1 Processor -- start 2024-04-25T08:53:54.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.182+0000 7f7feb4f5640 1 -- start start 2024-04-25T08:53:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.183+0000 7f7feb4f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe406c3c0 0x7f7fe4150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.183+0000 7f7feb4f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fe40c4e50 0x7f7fe40c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.183+0000 7f7feb4f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fe4162100 0x7f7fe40ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.183+0000 7f7feb4f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40cc030 con 0x7f7fe40c4e50 2024-04-25T08:53:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.183+0000 7f7feb4f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe409add0 con 0x7f7fe406c3c0 2024-04-25T08:53:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.183+0000 7f7feb4f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe41624e0 con 0x7f7fe4162100 2024-04-25T08:53:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.184+0000 7f7fe8a90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fe40c4e50 0x7f7fe40c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.184+0000 7f7fe8a90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fe40c4e50 0x7f7fe40c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48128/0 (socket says 172.21.15.55:48128) 2024-04-25T08:53:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.184+0000 7f7fe8a90640 1 -- 172.21.15.55:0/1883054428 learned_addr learned my addr 172.21.15.55:0/1883054428 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.184+0000 7f7fe9a92640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fe4162100 0x7f7fe40ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.184+0000 7f7fe9291640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe406c3c0 0x7f7fe4150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.185+0000 7f7fe8a90640 1 -- 172.21.15.55:0/1883054428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fe4162100 msgr2=0x7f7fe40ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.185+0000 7f7fe8a90640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fe4162100 0x7f7fe40ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.185+0000 7f7fe8a90640 1 -- 172.21.15.55:0/1883054428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe406c3c0 msgr2=0x7f7fe4150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.185+0000 7f7fe8a90640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe406c3c0 0x7f7fe4150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.185+0000 7f7fe8a90640 1 -- 172.21.15.55:0/1883054428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe41514c0 con 0x7f7fe40c4e50 2024-04-25T08:53:54.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.185+0000 7f7fe8a90640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fe40c4e50 0x7f7fe40c46e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000b780 tx=0x7f7fe000bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.187+0000 7f7fd9ffb640 1 -- 172.21.15.55:0/1883054428 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0019070 con 0x7f7fe40c4e50 2024-04-25T08:53:54.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.187+0000 7f7feb4f5640 1 -- 172.21.15.55:0/1883054428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe41517a0 con 0x7f7fe40c4e50 2024-04-25T08:53:54.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.187+0000 7f7feb4f5640 1 -- 172.21.15.55:0/1883054428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe40cabf0 con 0x7f7fe40c4e50 2024-04-25T08:53:54.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.190+0000 7f7fd9ffb640 1 -- 172.21.15.55:0/1883054428 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe000c740 con 0x7f7fe40c4e50 2024-04-25T08:53:54.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.191+0000 7f7fd9ffb640 1 -- 172.21.15.55:0/1883054428 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000cb30 con 0x7f7fe40c4e50 2024-04-25T08:53:54.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.192+0000 7f7fd9ffb640 1 -- 172.21.15.55:0/1883054428 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7fe001c070 con 0x7f7fe40c4e50 2024-04-25T08:53:54.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.192+0000 7f7fd9ffb640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7fc806b600 0x7f7fc806dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.193+0000 7f7fe9291640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7fc806b600 0x7f7fc806dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.194+0000 7f7fe9291640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7fc806b600 0x7f7fc806dac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4006fd0 tx=0x7f7fd40090e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.194+0000 7f7fd9ffb640 1 -- 172.21.15.55:0/1883054428 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fe0089700 con 0x7f7fe40c4e50 2024-04-25T08:53:54.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.194+0000 7f7feb4f5640 1 -- 172.21.15.55:0/1883054428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc4005290 con 0x7f7fe40c4e50 2024-04-25T08:53:54.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.204+0000 7f7fd9ffb640 1 -- 172.21.15.55:0/1883054428 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7fe0057fa0 con 0x7f7fe40c4e50 2024-04-25T08:53:54.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.230+0000 7f7f1b59e640 1 Processor -- start 2024-04-25T08:53:54.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.231+0000 7f7f1b59e640 1 -- start start 2024-04-25T08:53:54.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.231+0000 7f34f006f640 1 Processor -- start 2024-04-25T08:53:54.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.231+0000 7f30a97e0640 1 Processor -- start 2024-04-25T08:53:54.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.232+0000 7f7f1b59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f14050500 0x7f7f14008ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.232+0000 7f7f1b59e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f140512f0 con 0x7f7f140dfd40 2024-04-25T08:53:54.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.232+0000 7f7f1b59e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f140549d0 con 0x7f7f140e0120 2024-04-25T08:53:54.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.232+0000 7f7f1b59e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f14054cb0 con 0x7f7f14050500 2024-04-25T08:53:54.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.232+0000 7fd409a76640 1 Processor -- start 2024-04-25T08:53:54.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.232+0000 7fd409a76640 1 -- start start 2024-04-25T08:53:54.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f7f1a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7f140dfd40 0x7f7f14050be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56956/0 (socket says 172.21.15.55:56956) 2024-04-25T08:53:54.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f7f1a59c640 1 -- 172.21.15.55:0/351092125 learned_addr learned my addr 172.21.15.55:0/351092125 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:54.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.232+0000 7f30a97e0640 1 -- start start 2024-04-25T08:53:54.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f30a97e0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a4157a00 0x7f30a40b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f30a97e0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f30a415a4c0 0x7f30a415a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f30a97e0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a415af80 con 0x7f30a406bbb0 2024-04-25T08:53:54.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f30a97e0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40b2e10 con 0x7f30a415a4c0 2024-04-25T08:53:54.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f30a97e0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40b33d0 con 0x7f30a4157a00 2024-04-25T08:53:54.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.232+0000 7fb0f81f5640 1 Processor -- start 2024-04-25T08:53:54.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f463a2e2640 1 Processor -- start 2024-04-25T08:53:54.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f463a2e2640 1 -- start start 2024-04-25T08:53:54.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f7f19d9b640 1 --2- 172.21.15.55:0/351092125 >> v2:172.21.15.55:3300/0 conn(0x7f7f14050500 0x7f7f14008ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289089498 0 0) 0x7f7f0c001110 con 0x7f7f140dfd40 2024-04-25T08:53:54.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.232+0000 7f34f006f640 1 -- start start 2024-04-25T08:53:54.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f34f006f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34e81655e0 0x7f34e80cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f34f006f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f34e81665b0 0x7f34e80cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f34f006f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e80ce820 con 0x7f34e81659c0 2024-04-25T08:53:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f34f006f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e80d0340 con 0x7f34e81665b0 2024-04-25T08:53:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f34f006f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80ceb00 con 0x7f34e81655e0 2024-04-25T08:53:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f04003520 con 0x7f7f140dfd40 2024-04-25T08:53:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f34ee60c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f34e81665b0 0x7f34e80cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f34ed60a640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f34e81659c0 0x7f34e8165ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58600/0 (socket says 172.21.15.55:58600) 2024-04-25T08:53:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f34ed60a640 1 -- 172.21.15.55:0/4159322916 learned_addr learned my addr 172.21.15.55:0/4159322916 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:54.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7fd409a76640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd40406f140 0x7fd40413fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7fd409a76640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4040b17d0 0x7fd4040b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7fd409a76640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40415dd20 con 0x7fd40415aa30 2024-04-25T08:53:54.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7fd409a76640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd404140300 con 0x7fd40406f140 2024-04-25T08:53:54.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7fd409a76640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040b2140 con 0x7fd4040b17d0 2024-04-25T08:53:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fd402ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd40415aa30 0x7fd40415d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58602/0 (socket says 172.21.15.55:58602) 2024-04-25T08:53:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fd402ffd640 1 -- 172.21.15.55:0/4214153821 learned_addr learned my addr 172.21.15.55:0/4214153821 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fd403fff640 1 --2- 172.21.15.55:0/4214153821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4040b17d0 0x7fd4040b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fd4037fe640 1 --2- 172.21.15.55:0/4214153821 >> v2:172.21.15.55:3300/0 conn(0x7fd40406f140 0x7fd40413fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f34ede0b640 1 --2- 172.21.15.55:0/4159322916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34e81655e0 0x7f34e80cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2979833556 0 0) 0x7f7f04003520 con 0x7f7f140dfd40 2024-04-25T08:53:54.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 >> v2:172.21.15.55:3300/0 conn(0x7f7f14050500 msgr2=0x7f7f14008ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:54.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f7f1959a640 1 --2- 172.21.15.55:0/351092125 >> v2:172.21.15.55:3300/0 conn(0x7f7f14050500 0x7f7f14008ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 >> v1:172.21.15.167:6789/0 conn(0x7f7f140e0120 legacy=0x7f7f140eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fd4027fc640 1 -- 172.21.15.55:0/4214153821 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621071816 0 0) 0x7fd40415dd20 con 0x7fd40415aa30 2024-04-25T08:53:54.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fd4027fc640 1 -- 172.21.15.55:0/4214153821 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ec003520 con 0x7fd40415aa30 2024-04-25T08:53:54.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fd4037fe640 1 -- 172.21.15.55:0/4214153821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4040b17d0 msgr2=0x7fd4040b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:54.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fd4037fe640 1 --2- 172.21.15.55:0/4214153821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4040b17d0 0x7fd4040b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fd4037fe640 1 -- 172.21.15.55:0/4214153821 >> v1:172.21.15.167:6789/0 conn(0x7fd40415aa30 legacy=0x7fd40415d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fd4037fe640 1 -- 172.21.15.55:0/4214153821 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40415dff0 con 0x7fd40406f140 2024-04-25T08:53:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f463a2e2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f462c0e0ff0 0x7f462c033e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f463a2e2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f462c0343a0 0x7f462c037d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f14054f90 con 0x7f7f140dfd40 2024-04-25T08:53:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f7f0c001840 con 0x7f7f140dfd40 2024-04-25T08:53:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 >> v1:172.21.15.55:6789/0 conn(0x7f7f140dfd40 legacy=0x7f7f14050be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1959a640 1 --2- 172.21.15.55:0/351092125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f04003a00 0x7f7f04003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1959a640 1 --2- 172.21.15.55:0/351092125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f04004800 0x7f7f04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1959a640 1 --2- 172.21.15.55:0/351092125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f040052e0 0x7f7f0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14054cb0 con 0x7f7f04004800 2024-04-25T08:53:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0400c200 con 0x7f7f04003a00 2024-04-25T08:53:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0400c400 con 0x7f7f040052e0 2024-04-25T08:53:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1a59c640 1 --2- 172.21.15.55:0/351092125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f04003a00 0x7f7f04003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f30a37fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f30a406bbb0 0x7f30a40acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58598/0 (socket says 172.21.15.55:58598) 2024-04-25T08:53:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f30a37fe640 1 -- 172.21.15.55:0/1833647215 learned_addr learned my addr 172.21.15.55:0/1833647215 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f30a27fc640 1 --2- 172.21.15.55:0/1833647215 >> v2:172.21.15.167:3300/0 conn(0x7f30a415a4c0 0x7f30a415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f30a2ffd640 1 --2- 172.21.15.55:0/1833647215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a4157a00 0x7f30a40b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f30a2ffd640 1 -- 172.21.15.55:0/1833647215 >> v2:172.21.15.167:3300/0 conn(0x7f30a415a4c0 msgr2=0x7f30a415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f30a2ffd640 1 --2- 172.21.15.55:0/1833647215 >> v2:172.21.15.167:3300/0 conn(0x7f30a415a4c0 0x7f30a415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f30a2ffd640 1 -- 172.21.15.55:0/1833647215 >> v1:172.21.15.167:6789/0 conn(0x7f30a406bbb0 legacy=0x7f30a40acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f30a2ffd640 1 -- 172.21.15.55:0/1833647215 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a415b260 con 0x7f30a4157a00 2024-04-25T08:53:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f34ee60c640 1 -- 172.21.15.55:0/4159322916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34e81655e0 msgr2=0x7f34e80cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f34ee60c640 1 --2- 172.21.15.55:0/4159322916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34e81655e0 0x7f34e80cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f34ee60c640 1 -- 172.21.15.55:0/4159322916 >> v1:172.21.15.167:6789/0 conn(0x7f34e81659c0 legacy=0x7f34e8165ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f34ee60c640 1 -- 172.21.15.55:0/4159322916 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e80cffd0 con 0x7f34e81665b0 2024-04-25T08:53:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7f34ede0b640 1 --2- 172.21.15.55:0/4159322916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34e81655e0 0x7f34e80cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7fcda6f6c640 1 Processor -- start 2024-04-25T08:53:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7fcda6f6c640 1 -- start start 2024-04-25T08:53:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.233+0000 7fb0f81f5640 1 -- start start 2024-04-25T08:53:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fb0f81f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0e80e7700 0x7fb0e804ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fb0f81f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0e80589b0 0x7fb0e8053520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fb0f81f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e8056aa0 0x7fb0e8053a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fb0f81f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e8057d80 con 0x7fb0e80589b0 2024-04-25T08:53:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fb0f81f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e8006250 con 0x7fb0e80e7700 2024-04-25T08:53:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fb0f81f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8006530 con 0x7fb0e8056aa0 2024-04-25T08:53:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fb0f5790640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0e80589b0 0x7fb0e8053520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fb0f5790640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0e80589b0 0x7fb0e8053520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48156/0 (socket says 172.21.15.55:48156) 2024-04-25T08:53:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.234+0000 7fb0f5790640 1 -- 172.21.15.55:0/1969097850 learned_addr learned my addr 172.21.15.55:0/1969097850 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7fb0f5790640 1 -- 172.21.15.55:0/1969097850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e8056aa0 msgr2=0x7fb0e8053a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7fb0f5790640 1 --2- 172.21.15.55:0/1969097850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e8056aa0 0x7fb0e8053a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7fb0f5790640 1 -- 172.21.15.55:0/1969097850 >> v2:172.21.15.167:3300/0 conn(0x7fb0e80e7700 msgr2=0x7fb0e804ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7fb0f5790640 1 --2- 172.21.15.55:0/1969097850 >> v2:172.21.15.167:3300/0 conn(0x7fb0e80e7700 0x7fb0e804ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7fb0f5790640 1 -- 172.21.15.55:0/1969097850 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8006810 con 0x7fb0e80589b0 2024-04-25T08:53:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f4633fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f462c0e0ff0 0x7f462c033e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f463a2e2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f462c038290 0x7f462c0e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f463a2e2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462c038700 con 0x7f462c0343a0 2024-04-25T08:53:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f463a2e2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462c039f50 con 0x7f462c0e0ff0 2024-04-25T08:53:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f463a2e2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c03a230 con 0x7f462c038290 2024-04-25T08:53:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1a59c640 1 -- 172.21.15.55:0/351092125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f040052e0 msgr2=0x7f7f0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1a59c640 1 --2- 172.21.15.55:0/351092125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f040052e0 0x7f7f0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1a59c640 1 -- 172.21.15.55:0/351092125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f04004800 msgr2=0x7f7f04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1a59c640 1 --2- 172.21.15.55:0/351092125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f04004800 0x7f7f04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.235+0000 7f7f1a59c640 1 -- 172.21.15.55:0/351092125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f04003520 con 0x7f7f04003a00 2024-04-25T08:53:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f4633fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f462c0e0ff0 0x7f462c033e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:38532/0 (socket says 172.21.15.55:38532) 2024-04-25T08:53:54.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f4633fff640 1 -- 172.21.15.55:0/1094699412 learned_addr learned my addr 172.21.15.55:0/1094699412 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f34ee60c640 1 --2- 172.21.15.55:0/4159322916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e81665b0 0x7f34e80cc320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34e80d04c0 tx=0x7f34d802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce4444000e8b0c11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7fd4037fe640 1 --2- 172.21.15.55:0/4214153821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd40406f140 0x7fd40413fdc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80097d0 tx=0x7fd3f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f10a83660e6e18c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f34ece09640 1 -- 172.21.15.55:0/4159322916 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8037070 con 0x7f34e81665b0 2024-04-25T08:53:54.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f34ece09640 1 -- 172.21.15.55:0/4159322916 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d802adb0 con 0x7f34e81665b0 2024-04-25T08:53:54.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f34ece09640 1 -- 172.21.15.55:0/4159322916 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8032660 con 0x7f34e81665b0 2024-04-25T08:53:54.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f7f1ad9d640 1 -- 172.21.15.55:0/351092125 reap_dead start 2024-04-25T08:53:54.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7fb0f5790640 1 --2- 172.21.15.55:0/1969097850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0e80589b0 0x7fb0e8053520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb0f002d370 tx=0x7fb0f00a5240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc8a35c079915dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f4633fff640 1 -- 172.21.15.55:0/1094699412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f462c038290 msgr2=0x7f462c0e4a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T08:53:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f4633fff640 1 --2- 172.21.15.55:0/1094699412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f462c038290 0x7f462c0e4a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f4633fff640 1 -- 172.21.15.55:0/1094699412 >> v2:172.21.15.55:3300/0 conn(0x7f462c0343a0 msgr2=0x7f462c037d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f4633fff640 1 --2- 172.21.15.55:0/1094699412 >> v2:172.21.15.55:3300/0 conn(0x7f462c0343a0 0x7f462c037d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.236+0000 7f4633fff640 1 -- 172.21.15.55:0/1094699412 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c03a510 con 0x7f462c0e0ff0 2024-04-25T08:53:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fb0f4f8f640 1 -- 172.21.15.55:0/1969097850 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00b2070 con 0x7fb0e80589b0 2024-04-25T08:53:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fb0f4f8f640 1 -- 172.21.15.55:0/1969097850 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f00a5e50 con 0x7fb0e80589b0 2024-04-25T08:53:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fb0f4f8f640 1 -- 172.21.15.55:0/1969097850 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00ad900 con 0x7fb0e80589b0 2024-04-25T08:53:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fd4027fc640 1 -- 172.21.15.55:0/4214153821 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8037070 con 0x7fd40406f140 2024-04-25T08:53:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fd4027fc640 1 -- 172.21.15.55:0/4214153821 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f8032440 con 0x7fd40406f140 2024-04-25T08:53:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fd4027fc640 1 -- 172.21.15.55:0/4214153821 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8032850 con 0x7fd40406f140 2024-04-25T08:53:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fcda6f6c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d01d0 0x7fcda00cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fcda6f6c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcda00d1b90 0x7fcda00d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7f30a2ffd640 1 --2- 172.21.15.55:0/1833647215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a4157a00 0x7f30a40b3860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f309c00de80 tx=0x7f309c032d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b547ba469b10b304 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fcda6f6c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda01625f0 con 0x7fcda00d05b0 2024-04-25T08:53:54.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fcda6f6c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda0162160 con 0x7fcda00d1b90 2024-04-25T08:53:54.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fcda6f6c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00cef60 con 0x7fcda00d01d0 2024-04-25T08:53:54.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fcda5f6a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d01d0 0x7fcda00cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7f30a1ffb640 1 -- 172.21.15.55:0/1833647215 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c00d4e0 con 0x7f30a4157a00 2024-04-25T08:53:54.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7f30a1ffb640 1 -- 172.21.15.55:0/1833647215 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c00b740 con 0x7f30a4157a00 2024-04-25T08:53:54.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7f34f006f640 1 -- 172.21.15.55:0/4159322916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e81665b0 msgr2=0x7f34e80cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7f30a1ffb640 1 -- 172.21.15.55:0/1833647215 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c00bb10 con 0x7f30a4157a00 2024-04-25T08:53:54.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7f7f1a59c640 1 --2- 172.21.15.55:0/351092125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f04003a00 0x7f7f04003de0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0050e0 tx=0x7f7f04005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11410a8b4532c22d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c004d00 con 0x7f7f04003a00 2024-04-25T08:53:54.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7f7f1959a640 1 -- 172.21.15.55:0/351092125 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c02f030 con 0x7f7f04003a00 2024-04-25T08:53:54.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7f34f006f640 1 --2- 172.21.15.55:0/4159322916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e81665b0 0x7f34e80cc320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34e80d04c0 tx=0x7f34d802a060 comp rx=0 tx=0).stop 2024-04-25T08:53:54.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f34f006f640 1 -- 172.21.15.55:0/4159322916 shutdown_connections 2024-04-25T08:53:54.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f34f006f640 1 --2- 172.21.15.55:0/4159322916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e81665b0 0x7f34e80cc320 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fd409a76640 1 -- 172.21.15.55:0/4214153821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd40406f140 msgr2=0x7fd40413fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fd409a76640 1 --2- 172.21.15.55:0/4214153821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd40406f140 0x7fd40413fdc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80097d0 tx=0x7fd3f802a270 comp rx=0 tx=0).stop 2024-04-25T08:53:54.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f4633fff640 1 --2- 172.21.15.55:0/1094699412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f462c0e0ff0 0x7f462c033e60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f463402d370 tx=0x7f46340a9670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=629427064eccc58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fd409a76640 1 -- 172.21.15.55:0/4214153821 shutdown_connections 2024-04-25T08:53:54.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f4632ffd640 1 -- 172.21.15.55:0/1094699412 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340b5070 con 0x7f462c0e0ff0 2024-04-25T08:53:54.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f7f1b59e640 1 -- 172.21.15.55:0/351092125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f04003a00 msgr2=0x7f7f04003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f7f1b59e640 1 --2- 172.21.15.55:0/351092125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f04003a00 0x7f7f04003de0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0050e0 tx=0x7f7f04005830 comp rx=0 tx=0).stop 2024-04-25T08:53:54.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fd409a76640 1 --2- 172.21.15.55:0/4214153821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4040b17d0 0x7fd4040b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f7f1b59e640 1 -- 172.21.15.55:0/351092125 shutdown_connections 2024-04-25T08:53:54.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f7f1b59e640 1 --2- 172.21.15.55:0/351092125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f04003a00 0x7f7f04003de0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f7f1b59e640 1 -- 172.21.15.55:0/351092125 >> 172.21.15.55:0/351092125 conn(0x7f7f14055bc0 msgr2=0x7f7f14055fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f4632ffd640 1 -- 172.21.15.55:0/1094699412 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46340ae7d0 con 0x7f462c0e0ff0 2024-04-25T08:53:54.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f7f1b59e640 1 -- 172.21.15.55:0/351092125 shutdown_connections 2024-04-25T08:53:54.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f7f1b59e640 1 -- 172.21.15.55:0/351092125 wait complete. 2024-04-25T08:53:54.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fd409a76640 1 --2- 172.21.15.55:0/4214153821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd40406f140 0x7fd40413fdc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fd409a76640 1 -- 172.21.15.55:0/4214153821 >> 172.21.15.55:0/4214153821 conn(0x7fd40406aba0 msgr2=0x7fd40406af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f30a97e0640 1 -- 172.21.15.55:0/1833647215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a4157a00 msgr2=0x7f30a40b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f30a97e0640 1 --2- 172.21.15.55:0/1833647215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a4157a00 0x7f30a40b3860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f309c00de80 tx=0x7f309c032d60 comp rx=0 tx=0).stop 2024-04-25T08:53:54.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fd409a76640 1 -- 172.21.15.55:0/4214153821 shutdown_connections 2024-04-25T08:53:54.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fd409a76640 1 -- 172.21.15.55:0/4214153821 wait complete. 2024-04-25T08:53:54.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fcda5769640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcda00d05b0 0x7fcda015ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58608/0 (socket says 172.21.15.55:58608) 2024-04-25T08:53:54.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fcda5769640 1 -- 172.21.15.55:0/2537874446 learned_addr learned my addr 172.21.15.55:0/2537874446 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:54.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.237+0000 7fcda676b640 1 --2- 172.21.15.55:0/2537874446 >> v2:172.21.15.167:3300/0 conn(0x7fcda00d1b90 0x7fcda00d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f34f006f640 1 --2- 172.21.15.55:0/4159322916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34e81655e0 0x7f34e80cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f34f006f640 1 -- 172.21.15.55:0/4159322916 >> 172.21.15.55:0/4159322916 conn(0x7f34e806f4c0 msgr2=0x7f34e806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fb0f81f5640 1 -- 172.21.15.55:0/1969097850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0e80589b0 msgr2=0x7fb0e8053520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fb0f81f5640 1 --2- 172.21.15.55:0/1969097850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0e80589b0 0x7fb0e8053520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb0f002d370 tx=0x7fb0f00a5240 comp rx=0 tx=0).stop 2024-04-25T08:53:54.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fcda5f6a640 1 -- 172.21.15.55:0/2537874446 >> v2:172.21.15.167:3300/0 conn(0x7fcda00d1b90 msgr2=0x7fcda00d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:54.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fcda5f6a640 1 --2- 172.21.15.55:0/2537874446 >> v2:172.21.15.167:3300/0 conn(0x7fcda00d1b90 0x7fcda00d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fcda5f6a640 1 -- 172.21.15.55:0/2537874446 >> v1:172.21.15.167:6789/0 conn(0x7fcda00d05b0 legacy=0x7fcda015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7fcda5f6a640 1 -- 172.21.15.55:0/2537874446 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00cf200 con 0x7fcda00d01d0 2024-04-25T08:53:54.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f30a97e0640 1 -- 172.21.15.55:0/1833647215 shutdown_connections 2024-04-25T08:53:54.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f30a97e0640 1 --2- 172.21.15.55:0/1833647215 >> v2:172.21.15.167:3300/0 conn(0x7f30a415a4c0 0x7f30a415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f30a97e0640 1 --2- 172.21.15.55:0/1833647215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a4157a00 0x7f30a40b3860 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f30a97e0640 1 -- 172.21.15.55:0/1833647215 >> 172.21.15.55:0/1833647215 conn(0x7f30a4071b10 msgr2=0x7f30a4071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f4632ffd640 1 -- 172.21.15.55:0/1094699412 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340aec40 con 0x7f462c0e0ff0 2024-04-25T08:53:54.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7fcda5f6a640 1 --2- 172.21.15.55:0/2537874446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d01d0 0x7fcda00cea20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0097a0 tx=0x7fcd9c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f84dec81a6b6ea1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f30a97e0640 1 -- 172.21.15.55:0/1833647215 shutdown_connections 2024-04-25T08:53:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f30a97e0640 1 -- 172.21.15.55:0/1833647215 wait complete. 2024-04-25T08:53:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f34f006f640 1 -- 172.21.15.55:0/4159322916 shutdown_connections 2024-04-25T08:53:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.238+0000 7f34f006f640 1 -- 172.21.15.55:0/4159322916 wait complete. 2024-04-25T08:53:54.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7fcda4f68640 1 -- 172.21.15.55:0/2537874446 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c037070 con 0x7fcda00d01d0 2024-04-25T08:53:54.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7fcda4f68640 1 -- 172.21.15.55:0/2537874446 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c02ae50 con 0x7fcda00d01d0 2024-04-25T08:53:54.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7fcda4f68640 1 -- 172.21.15.55:0/2537874446 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c032660 con 0x7fcda00d01d0 2024-04-25T08:53:54.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f463a2e2640 1 -- 172.21.15.55:0/1094699412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f462c0e0ff0 msgr2=0x7f462c033e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f463a2e2640 1 --2- 172.21.15.55:0/1094699412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f462c0e0ff0 0x7f462c033e60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f463402d370 tx=0x7f46340a9670 comp rx=0 tx=0).stop 2024-04-25T08:53:54.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f463a2e2640 1 -- 172.21.15.55:0/1094699412 shutdown_connections 2024-04-25T08:53:54.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f463a2e2640 1 --2- 172.21.15.55:0/1094699412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f462c038290 0x7f462c0e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f463a2e2640 1 --2- 172.21.15.55:0/1094699412 >> v2:172.21.15.55:3300/0 conn(0x7f462c0343a0 0x7f462c037d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f463a2e2640 1 --2- 172.21.15.55:0/1094699412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f462c0e0ff0 0x7f462c033e60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f463a2e2640 1 -- 172.21.15.55:0/1094699412 >> 172.21.15.55:0/1094699412 conn(0x7f462c00a3f0 msgr2=0x7f462c00a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.239+0000 7f463a2e2640 1 -- 172.21.15.55:0/1094699412 shutdown_connections 2024-04-25T08:53:54.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.240+0000 7f463a2e2640 1 -- 172.21.15.55:0/1094699412 wait complete. 2024-04-25T08:53:54.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.240+0000 7fb0f81f5640 1 -- 172.21.15.55:0/1969097850 shutdown_connections 2024-04-25T08:53:54.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.240+0000 7fb0f81f5640 1 --2- 172.21.15.55:0/1969097850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e8056aa0 0x7fb0e8053a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.240+0000 7fb0f81f5640 1 --2- 172.21.15.55:0/1969097850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0e80589b0 0x7fb0e8053520 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.240+0000 7fb0f81f5640 1 --2- 172.21.15.55:0/1969097850 >> v2:172.21.15.167:3300/0 conn(0x7fb0e80e7700 0x7fb0e804ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.240+0000 7fb0f81f5640 1 -- 172.21.15.55:0/1969097850 >> 172.21.15.55:0/1969097850 conn(0x7fb0e8058ed0 msgr2=0x7fb0e80592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.240+0000 7f34f006f640 1 Processor -- start 2024-04-25T08:53:54.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.240+0000 7fd409a76640 1 Processor -- start 2024-04-25T08:53:54.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.240+0000 7fd409a76640 1 -- start start 2024-04-25T08:53:54.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.240+0000 7fb0f81f5640 1 -- 172.21.15.55:0/1969097850 shutdown_connections 2024-04-25T08:53:54.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.240+0000 7fb0f81f5640 1 -- 172.21.15.55:0/1969097850 wait complete. 2024-04-25T08:53:54.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.241+0000 7f7f1b59e640 1 Processor -- start 2024-04-25T08:53:54.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.241+0000 7fcda6f6c640 1 -- 172.21.15.55:0/2537874446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d01d0 msgr2=0x7fcda00cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.241+0000 7fcda6f6c640 1 --2- 172.21.15.55:0/2537874446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d01d0 0x7fcda00cea20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0097a0 tx=0x7fcd9c02a100 comp rx=0 tx=0).stop 2024-04-25T08:53:54.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.241+0000 7fcda6f6c640 1 -- 172.21.15.55:0/2537874446 shutdown_connections 2024-04-25T08:53:54.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.241+0000 7fcda6f6c640 1 --2- 172.21.15.55:0/2537874446 >> v2:172.21.15.167:3300/0 conn(0x7fcda00d1b90 0x7fcda00d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.241+0000 7fcda6f6c640 1 --2- 172.21.15.55:0/2537874446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d01d0 0x7fcda00cea20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.241+0000 7fcda6f6c640 1 -- 172.21.15.55:0/2537874446 >> 172.21.15.55:0/2537874446 conn(0x7fcda006bed0 msgr2=0x7fcda006c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.241+0000 7f30a97e0640 1 Processor -- start 2024-04-25T08:53:54.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.241+0000 7f7f1b59e640 1 -- start start 2024-04-25T08:53:54.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.241+0000 7f30a97e0640 1 -- start start 2024-04-25T08:53:54.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fd409a76640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd40406f140 0x7fd40413ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fd409a76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4040b17d0 0x7fd4041eef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.241+0000 7f34f006f640 1 -- start start 2024-04-25T08:53:54.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f463a2e2640 1 Processor -- start 2024-04-25T08:53:54.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd40406f140 0x7fd40413ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fcda6f6c640 1 -- 172.21.15.55:0/2537874446 shutdown_connections 2024-04-25T08:53:54.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f463a2e2640 1 -- start start 2024-04-25T08:53:54.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fcda6f6c640 1 -- 172.21.15.55:0/2537874446 wait complete. 2024-04-25T08:53:54.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f30a97e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a406bbb0 0x7f30a41f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f34f006f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34e81655e0 0x7f34e80b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f34f006f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e81659c0 0x7f34e80caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f34f006f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34e81665b0 0x7f34e81fb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f34f006f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80cc860 con 0x7f34e81665b0 2024-04-25T08:53:54.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f34f006f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8166c10 con 0x7f34e81659c0 2024-04-25T08:53:54.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f34f006f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80cc9e0 con 0x7f34e81655e0 2024-04-25T08:53:54.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fb0f81f5640 1 Processor -- start 2024-04-25T08:53:54.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fb0f81f5640 1 -- start start 2024-04-25T08:53:54.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f34ee60c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34e81665b0 0x7f34e81fb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f34ee60c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34e81665b0 0x7f34e81fb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48208/0 (socket says 172.21.15.55:48208) 2024-04-25T08:53:54.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f34ee60c640 1 -- 172.21.15.55:0/1601392699 learned_addr learned my addr 172.21.15.55:0/1601392699 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7f7f1b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f04003a00 0x7f7f140d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fd402ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4040b17d0 0x7fd4041eef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fd409a76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd40415aa30 0x7fd4040b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fd409a76640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40415aee0 con 0x7fd4040b17d0 2024-04-25T08:53:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fd402ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4040b17d0 0x7fd4041eef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48192/0 (socket says 172.21.15.55:48192) 2024-04-25T08:53:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fd402ffd640 1 -- 172.21.15.55:0/3594273654 learned_addr learned my addr 172.21.15.55:0/3594273654 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40415a230 con 0x7fd40415aa30 2024-04-25T08:53:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.242+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040cea20 con 0x7fd40406f140 2024-04-25T08:53:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f7f1b59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f140cbf50 0x7f7f1404ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f7f1b59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f140cd640 0x7f7f140e2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f7f1a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f04003a00 0x7f7f140d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f7f1a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f04003a00 0x7f7f140d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48212/0 (socket says 172.21.15.55:48212) 2024-04-25T08:53:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f30a97e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30a4157a00 0x7f30a40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f30a97e0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a415a4c0 0x7f30a41ef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f30a97e0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40b4c90 con 0x7f30a4157a00 2024-04-25T08:53:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f7f1b59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14050be0 con 0x7f7f04003a00 2024-04-25T08:53:54.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f30a2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a406bbb0 0x7f30a41f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f7f1b59e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14055550 con 0x7f7f140cd640 2024-04-25T08:53:54.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f7f1b59e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14050d60 con 0x7f7f140cbf50 2024-04-25T08:53:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f30a2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a406bbb0 0x7f30a41f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:38548/0 (socket says 172.21.15.55:38548) 2024-04-25T08:53:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f30a2ffd640 1 -- 172.21.15.55:0/2418167838 learned_addr learned my addr 172.21.15.55:0/2418167838 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4157de0 con 0x7f30a406bbb0 2024-04-25T08:53:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fd403fff640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd40415aa30 0x7fd4040b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f7f1a59c640 1 -- 172.21.15.55:0/3023430839 learned_addr learned my addr 172.21.15.55:0/3023430839 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f7f19d9b640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f140cbf50 0x7f7f1404ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40b4e10 con 0x7f30a415a4c0 2024-04-25T08:53:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fb0f81f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e8056aa0 0x7fb0e80e3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fb0f81f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e80589b0 0x7fb0e803e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fb0f81f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0e80e7700 0x7fb0e803e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fb0f81f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8057990 con 0x7fb0e80e7700 2024-04-25T08:53:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fb0f81f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e804cf60 con 0x7fb0e80589b0 2024-04-25T08:53:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fb0f81f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8057b10 con 0x7fb0e8056aa0 2024-04-25T08:53:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fb0f5f91640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e8056aa0 0x7fb0e80e3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fd402ffd640 1 -- 172.21.15.55:0/3594273654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd40406f140 msgr2=0x7fd40413ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fd402ffd640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd40406f140 0x7fd40413ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fd402ffd640 1 -- 172.21.15.55:0/3594273654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd40415aa30 msgr2=0x7fd4040b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fd402ffd640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd40415aa30 0x7fd4040b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fd402ffd640 1 -- 172.21.15.55:0/3594273654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40413d410 con 0x7fd4040b17d0 2024-04-25T08:53:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f34ede0b640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34e81655e0 0x7f34e80b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f34ee60c640 1 -- 172.21.15.55:0/1601392699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34e81655e0 msgr2=0x7f34e80b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fb0f5f91640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e8056aa0 0x7fb0e80e3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:51726/0 (socket says 172.21.15.55:51726) 2024-04-25T08:53:54.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7fb0f5f91640 1 -- 172.21.15.55:0/4033623627 learned_addr learned my addr 172.21.15.55:0/4033623627 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7fb0f5790640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e80589b0 0x7fb0e803e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.243+0000 7f30a2ffd640 1 -- 172.21.15.55:0/2418167838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a415a4c0 msgr2=0x7f30a41ef5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f30a2ffd640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a415a4c0 0x7f30a41ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f30a2ffd640 1 -- 172.21.15.55:0/2418167838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30a4157a00 msgr2=0x7f30a40ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f30a2ffd640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30a4157a00 0x7f30a40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f34ee60c640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34e81655e0 0x7f34e80b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f30a2ffd640 1 -- 172.21.15.55:0/2418167838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a41f3310 con 0x7f30a406bbb0 2024-04-25T08:53:54.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f463a2e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c0343a0 0x7f462c036950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f34ee60c640 1 -- 172.21.15.55:0/1601392699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e81659c0 msgr2=0x7f34e80caf90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T08:53:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f34ee60c640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e81659c0 0x7f34e80caf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f463a2e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f462c038290 0x7f462c048c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7fb0f6792640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0e80e7700 0x7fb0e803e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7fb0f5f91640 1 -- 172.21.15.55:0/4033623627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e80589b0 msgr2=0x7fb0e803e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7fb0f5f91640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e80589b0 0x7fb0e803e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7fb0f5f91640 1 -- 172.21.15.55:0/4033623627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0e80e7700 msgr2=0x7fb0e803e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7fb0f5f91640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0e80e7700 0x7fb0e803e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7fb0f5f91640 1 -- 172.21.15.55:0/4033623627 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e817da00 con 0x7fb0e8056aa0 2024-04-25T08:53:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f34ee60c640 1 -- 172.21.15.55:0/1601392699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e80b4a50 con 0x7f34e81665b0 2024-04-25T08:53:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7fb0f6792640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0e80e7700 0x7fb0e803e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f463a2e2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f462c0e0ff0 0x7f462c04e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f30a2ffd640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a406bbb0 0x7f30a41f2ba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f309c000f80 tx=0x7f309c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f34ee60c640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34e81665b0 0x7f34e81fb290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009860 tx=0x7f34d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f4633fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c0343a0 0x7f462c036950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7fd402ffd640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4040b17d0 0x7fd4041eef20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc002110 tx=0x7fd3fc0154b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f46337fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f462c038290 0x7f462c048c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f308b7fe640 1 -- 172.21.15.55:0/2418167838 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c003990 con 0x7f30a406bbb0 2024-04-25T08:53:54.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f4633fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c0343a0 0x7f462c036950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48236/0 (socket says 172.21.15.55:48236) 2024-04-25T08:53:54.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f308b7fe640 1 -- 172.21.15.55:0/2418167838 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c003b30 con 0x7f30a406bbb0 2024-04-25T08:53:54.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7fb0f5f91640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e8056aa0 0x7fb0e80e3d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000b4a0 tx=0x7fb0e000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f7f1ad9d640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f140cd640 0x7f7f140e2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f7f1a59c640 1 -- 172.21.15.55:0/3023430839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f140cbf50 msgr2=0x7f7f1404ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f7f1a59c640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f140cbf50 0x7f7f1404ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f7f1a59c640 1 -- 172.21.15.55:0/3023430839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f140cd640 msgr2=0x7f7f140e2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f7f1a59c640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f140cd640 0x7f7f140e2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f7f1a59c640 1 -- 172.21.15.55:0/3023430839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f140cc430 con 0x7f7f04003a00 2024-04-25T08:53:54.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f7f19d9b640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f140cbf50 0x7f7f1404ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:54.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f7f1ad9d640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f140cd640 0x7f7f140e2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:54.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.244+0000 7f4633fff640 1 -- 172.21.15.55:0/858484044 learned_addr learned my addr 172.21.15.55:0/858484044 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7f34de7fc640 1 -- 172.21.15.55:0/1601392699 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8041020 con 0x7f34e81665b0 2024-04-25T08:53:54.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7fb0e67fc640 1 -- 172.21.15.55:0/4033623627 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0014070 con 0x7fb0e8056aa0 2024-04-25T08:53:54.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7fb0e67fc640 1 -- 172.21.15.55:0/4033623627 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e0010610 con 0x7fb0e8056aa0 2024-04-25T08:53:54.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7fcda6f6c640 1 Processor -- start 2024-04-25T08:53:54.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7fcda6f6c640 1 -- start start 2024-04-25T08:53:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7f463887f640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f462c0e0ff0 0x7f462c04e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0e2280 con 0x7f462c0343a0 2024-04-25T08:53:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c03aad0 con 0x7f462c038290 2024-04-25T08:53:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0e2400 con 0x7f462c0e0ff0 2024-04-25T08:53:54.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a41f35f0 con 0x7f30a406bbb0 2024-04-25T08:53:54.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a40cc400 con 0x7f30a406bbb0 2024-04-25T08:53:54.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7f308b7fe640 1 -- 172.21.15.55:0/2418167838 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c033870 con 0x7f30a406bbb0 2024-04-25T08:53:54.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7fb0f81f5640 1 -- 172.21.15.55:0/4033623627 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e817dce0 con 0x7fb0e8056aa0 2024-04-25T08:53:54.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7fb0f81f5640 1 -- 172.21.15.55:0/4033623627 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e8050d60 con 0x7fb0e8056aa0 2024-04-25T08:53:54.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7fb0e67fc640 1 -- 172.21.15.55:0/4033623627 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0010a00 con 0x7fb0e8056aa0 2024-04-25T08:53:54.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7fd3ebfff640 1 -- 172.21.15.55:0/3594273654 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc020070 con 0x7fd4040b17d0 2024-04-25T08:53:54.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7fd3ebfff640 1 -- 172.21.15.55:0/3594273654 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc0102d0 con 0x7fd4040b17d0 2024-04-25T08:53:54.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7fd3ebfff640 1 -- 172.21.15.55:0/3594273654 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00e640 con 0x7fd4040b17d0 2024-04-25T08:53:54.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7fcda6f6c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcda00d01d0 0x7fcda00c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7f34f006f640 1 -- 172.21.15.55:0/1601392699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e80b4d30 con 0x7f34e81665b0 2024-04-25T08:53:54.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.245+0000 7f34f006f640 1 -- 172.21.15.55:0/1601392699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e80b52f0 con 0x7f34e81665b0 2024-04-25T08:53:54.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7fcda6f6c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d05b0 0x7fcda0148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7fcda6f6c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda00d1b90 0x7fcda01f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7fb0f81f5640 1 -- 172.21.15.55:0/4033623627 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e817deb0 con 0x7fb0e8056aa0 2024-04-25T08:53:54.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7fcda6f6c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda0161df0 con 0x7fcda00d1b90 2024-04-25T08:53:54.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7fcda6f6c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda0161b10 con 0x7fcda00d01d0 2024-04-25T08:53:54.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7fcda6f6c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00d0a10 con 0x7fcda00d05b0 2024-04-25T08:53:54.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4040b39a0 con 0x7fd4040b17d0 2024-04-25T08:53:54.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4040b3f60 con 0x7fd4040b17d0 2024-04-25T08:53:54.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a40750b0 con 0x7f30a406bbb0 2024-04-25T08:53:54.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7fcda5f6a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcda00d01d0 0x7fcda00c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7fcda5f6a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcda00d01d0 0x7fcda00c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:38608/0 (socket says 172.21.15.55:38608) 2024-04-25T08:53:54.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7fcda5f6a640 1 -- 172.21.15.55:0/1361332455 learned_addr learned my addr 172.21.15.55:0/1361332455 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7fb0e67fc640 1 -- 172.21.15.55:0/4033623627 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb0e0017070 con 0x7fb0e8056aa0 2024-04-25T08:53:54.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7f34d3fff640 1 -- 172.21.15.55:0/1601392699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c8005290 con 0x7f34e81665b0 2024-04-25T08:53:54.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.246+0000 7f34de7fc640 1 -- 172.21.15.55:0/1601392699 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d803d670 con 0x7f34e81665b0 2024-04-25T08:53:54.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7f34de7fc640 1 -- 172.21.15.55:0/1601392699 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8037040 con 0x7f34e81665b0 2024-04-25T08:53:54.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7fcda5769640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d05b0 0x7fcda0148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7fcda676b640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda00d1b90 0x7fcda01f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7f7f1a59c640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f04003a00 0x7f7f140d07c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c02b550 tx=0x7f7f0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7f46337fe640 1 -- 172.21.15.55:0/858484044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f462c0e0ff0 msgr2=0x7f462c04e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7f46337fe640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f462c0e0ff0 0x7f462c04e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7f46337fe640 1 -- 172.21.15.55:0/858484044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c0343a0 msgr2=0x7f462c036950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7f46337fe640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c0343a0 0x7f462c036950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.247+0000 7f46337fe640 1 -- 172.21.15.55:0/858484044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c035b90 con 0x7f462c038290 2024-04-25T08:53:54.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7f46337fe640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f462c038290 0x7f462c048c10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f462000b410 tx=0x7f462000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7f4630ff9640 1 -- 172.21.15.55:0/858484044 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620015020 con 0x7f462c038290 2024-04-25T08:53:54.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7fb0e67fc640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb0d406b5a0 0x7fb0d406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7f4630ff9640 1 -- 172.21.15.55:0/858484044 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4620011830 con 0x7f462c038290 2024-04-25T08:53:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7f4630ff9640 1 -- 172.21.15.55:0/858484044 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620011c20 con 0x7f462c038290 2024-04-25T08:53:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7fcda5769640 1 -- 172.21.15.55:0/1361332455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcda00d01d0 msgr2=0x7fcda00c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7fcda5769640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcda00d01d0 0x7fcda00c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7fcda5769640 1 -- 172.21.15.55:0/1361332455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda00d1b90 msgr2=0x7fcda01f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7fcda5769640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda00d1b90 0x7fcda01f3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7fcda5769640 1 -- 172.21.15.55:0/1361332455 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00c8680 con 0x7fcda00d05b0 2024-04-25T08:53:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7fb0f5790640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb0d406b5a0 0x7fb0d406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7fb0e67fc640 1 -- 172.21.15.55:0/4033623627 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0e0089b20 con 0x7fb0e8056aa0 2024-04-25T08:53:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7f7f0affd640 1 -- 172.21.15.55:0/3023430839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c001110 con 0x7f7f04003a00 2024-04-25T08:53:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.248+0000 7f7f1b59e640 1 -- 172.21.15.55:0/3023430839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f140cc710 con 0x7f7f04003a00 2024-04-25T08:53:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.249+0000 7f7f1b59e640 1 -- 172.21.15.55:0/3023430839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f140ce140 con 0x7f7f04003a00 2024-04-25T08:53:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.249+0000 7fcda5769640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d05b0 0x7fcda0148c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd90000f60 tx=0x7fcd9000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.249+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c035e70 con 0x7f462c038290 2024-04-25T08:53:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.249+0000 7f34de7fc640 1 -- 172.21.15.55:0/1601392699 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f34d8044020 con 0x7f34e81665b0 2024-04-25T08:53:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.249+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c036430 con 0x7f462c038290 2024-04-25T08:53:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.249+0000 7f308b7fe640 1 -- 172.21.15.55:0/2418167838 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f309c033a10 con 0x7f30a406bbb0 2024-04-25T08:53:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.249+0000 7f34de7fc640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f34cc06b5d0 0x7f34cc06da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.249+0000 7f34de7fc640 1 -- 172.21.15.55:0/1601392699 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34d80aa8c0 con 0x7f34e81665b0 2024-04-25T08:53:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.250+0000 7fb0f5790640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb0d406b5a0 0x7fb0d406da60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800f930 tx=0x7fb0f00a9000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.250+0000 7f308b7fe640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f309006b4d0 0x7f309006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.250+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4040749b0 con 0x7fd4040b17d0 2024-04-25T08:53:54.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.250+0000 7f7f1b59e640 1 -- 172.21.15.55:0/3023430839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f14009ad0 con 0x7f7f04003a00 2024-04-25T08:53:54.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.250+0000 7f34ede0b640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f34cc06b5d0 0x7f34cc06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.250+0000 7f308b7fe640 1 -- 172.21.15.55:0/2418167838 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f309c0b3b20 con 0x7f30a406bbb0 2024-04-25T08:53:54.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.250+0000 7f30a27fc640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f309006b4d0 0x7f309006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.250+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462c008e10 con 0x7f462c038290 2024-04-25T08:53:54.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.250+0000 7f7f0affd640 1 -- 172.21.15.55:0/3023430839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c004dc0 con 0x7f7f04003a00 2024-04-25T08:53:54.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.250+0000 7f7f0affd640 1 -- 172.21.15.55:0/3023430839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c001a60 con 0x7f7f04003a00 2024-04-25T08:53:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.251+0000 7f34ede0b640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f34cc06b5d0 0x7f34cc06da90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34e80ce0d0 tx=0x7f34e000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.251+0000 7f30a27fc640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f309006b4d0 0x7f309006d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3094007fd0 tx=0x7f3094007f40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.251+0000 7fd3ebfff640 1 -- 172.21.15.55:0/3594273654 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd3fc023070 con 0x7fd4040b17d0 2024-04-25T08:53:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.251+0000 7f4630ff9640 1 -- 172.21.15.55:0/858484044 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4620018020 con 0x7f462c038290 2024-04-25T08:53:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.252+0000 7fd3ebfff640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd3f006b520 0x7fd3f006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.252+0000 7fd4037fe640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd3f006b520 0x7fd3f006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.252+0000 7f4630ff9640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f461806b4d0 0x7f461806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.252+0000 7fd3ebfff640 1 -- 172.21.15.55:0/3594273654 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3fc092100 con 0x7fd4040b17d0 2024-04-25T08:53:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.252+0000 7f4630ff9640 1 -- 172.21.15.55:0/858484044 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4620089f10 con 0x7f462c038290 2024-04-25T08:53:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.252+0000 7f4633fff640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f461806b4d0 0x7f461806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.252+0000 7fd4037fe640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd3f006b520 0x7fd3f006d9e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8034000 tx=0x7fd3f802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.252+0000 7fcd967fc640 1 -- 172.21.15.55:0/1361332455 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90017070 con 0x7fcda00d05b0 2024-04-25T08:53:54.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.252+0000 7fcd967fc640 1 -- 172.21.15.55:0/1361332455 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd90005ce0 con 0x7fcda00d05b0 2024-04-25T08:53:54.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.252+0000 7fcd967fc640 1 -- 172.21.15.55:0/1361332455 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd900072d0 con 0x7fcda00d05b0 2024-04-25T08:53:54.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.253+0000 7fcda6f6c640 1 -- 172.21.15.55:0/1361332455 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda00c8920 con 0x7fcda00d05b0 2024-04-25T08:53:54.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.252+0000 7fb0e67fc640 1 -- 172.21.15.55:0/4033623627 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb0e00583c0 con 0x7fb0e8056aa0 2024-04-25T08:53:54.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.253+0000 7fcda6f6c640 1 -- 172.21.15.55:0/1361332455 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda00c8ee0 con 0x7fcda00d05b0 2024-04-25T08:53:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.253+0000 7f4633fff640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f461806b4d0 0x7f461806d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4634000b60 tx=0x7f463406e030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.254+0000 7fcda6f6c640 1 -- 172.21.15.55:0/1361332455 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda00749b0 con 0x7fcda00d05b0 2024-04-25T08:53:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.254+0000 7f308b7fe640 1 -- 172.21.15.55:0/2418167838 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f309c033d00 con 0x7f30a406bbb0 2024-04-25T08:53:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.254+0000 7fcd967fc640 1 -- 172.21.15.55:0/1361332455 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd9001a070 con 0x7fcda00d05b0 2024-04-25T08:53:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.255+0000 7fcd967fc640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd8406b500 0x7fcd8406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.255+0000 7fcd967fc640 1 -- 172.21.15.55:0/1361332455 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd900893a0 con 0x7fcda00d05b0 2024-04-25T08:53:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.255+0000 7fcda5f6a640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd8406b500 0x7fcd8406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.256+0000 7fcda5f6a640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd8406b500 0x7fcd8406d9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0097a0 tx=0x7fcd9c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.256+0000 7f34de7fc640 1 -- 172.21.15.55:0/1601392699 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f34d804b020 con 0x7f34e81665b0 2024-04-25T08:53:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.258+0000 7f7f0affd640 1 -- 172.21.15.55:0/3023430839 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7f0c001640 con 0x7f7f04003a00 2024-04-25T08:53:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.258+0000 7f7f0affd640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7efc06b500 0x7f7efc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.259+0000 7f7f19d9b640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7efc06b500 0x7f7efc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.259+0000 7f4630ff9640 1 -- 172.21.15.55:0/858484044 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f462001f020 con 0x7f462c038290 2024-04-25T08:53:54.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.259+0000 7fcd967fc640 1 -- 172.21.15.55:0/1361332455 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd90057bc0 con 0x7fcda00d05b0 2024-04-25T08:53:54.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.259+0000 7f7f19d9b640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7efc06b500 0x7f7efc06d9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c050190 tx=0x7f7f1c06e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.267+0000 7f7f0affd640 1 -- 172.21.15.55:0/3023430839 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f0c076f20 con 0x7f7f04003a00 2024-04-25T08:53:54.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.268+0000 7fd3ebfff640 1 -- 172.21.15.55:0/3594273654 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd40413d410 con 0x7fd4040b17d0 2024-04-25T08:53:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.276+0000 7f7f0affd640 1 -- 172.21.15.55:0/3023430839 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7f0c04e020 con 0x7f7f04003a00 2024-04-25T08:53:54.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.607+0000 7f7feb4f5640 1 -- 172.21.15.55:0/1883054428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7fc4005580 con 0x7f7fe40c4e50 2024-04-25T08:53:54.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.608+0000 7f7fd9ffb640 1 -- 172.21.15.55:0/1883054428 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fe005c040 con 0x7f7fe40c4e50 2024-04-25T08:53:54.598 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-04-25T08:53:54.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.612+0000 7f7fcf7fe640 1 -- 172.21.15.55:0/1883054428 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7fc806b600 msgr2=0x7f7fc806dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.612+0000 7f7fcf7fe640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7fc806b600 0x7f7fc806dac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4006fd0 tx=0x7f7fd40090e0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.612+0000 7f7fcf7fe640 1 -- 172.21.15.55:0/1883054428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fe40c4e50 msgr2=0x7f7fe40c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.612+0000 7f7fcf7fe640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fe40c4e50 0x7f7fe40c46e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000b780 tx=0x7f7fe000bc40 comp rx=0 tx=0).stop 2024-04-25T08:53:54.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.612+0000 7f7fcf7fe640 1 -- 172.21.15.55:0/1883054428 shutdown_connections 2024-04-25T08:53:54.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.612+0000 7f7fcf7fe640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7fc806b600 0x7f7fc806dac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.612+0000 7f7fcf7fe640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fe4162100 0x7f7fe40ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.613+0000 7f7fcf7fe640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fe40c4e50 0x7f7fe40c46e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.613+0000 7f7fcf7fe640 1 --2- 172.21.15.55:0/1883054428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe406c3c0 0x7f7fe4150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.613+0000 7f7fcf7fe640 1 -- 172.21.15.55:0/1883054428 >> 172.21.15.55:0/1883054428 conn(0x7f7fe40b3430 msgr2=0x7f7fe40af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.613+0000 7f7fcf7fe640 1 -- 172.21.15.55:0/1883054428 shutdown_connections 2024-04-25T08:53:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.613+0000 7f7fcf7fe640 1 -- 172.21.15.55:0/1883054428 wait complete. 2024-04-25T08:53:54.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-04-25T08:53:54.620 DEBUG:teuthology.parallel:result is None 2024-04-25T08:53:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.649+0000 7f34d3fff640 1 -- 172.21.15.55:0/1601392699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f34c8005580 con 0x7f34e81665b0 2024-04-25T08:53:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.649+0000 7f34de7fc640 1 -- 172.21.15.55:0/1601392699 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34d80798d0 con 0x7f34e81665b0 2024-04-25T08:53:54.639 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.651+0000 7f34d3fff640 1 -- 172.21.15.55:0/1601392699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f34cc06b5d0 msgr2=0x7f34cc06da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.651+0000 7f34d3fff640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f34cc06b5d0 0x7f34cc06da90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34e80ce0d0 tx=0x7f34e000b040 comp rx=0 tx=0).stop 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.651+0000 7f34d3fff640 1 -- 172.21.15.55:0/1601392699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34e81665b0 msgr2=0x7f34e81fb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.651+0000 7f34d3fff640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34e81665b0 0x7f34e81fb290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009860 tx=0x7f34d80046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.652+0000 7f34d3fff640 1 -- 172.21.15.55:0/1601392699 shutdown_connections 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.652+0000 7f34d3fff640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f34cc06b5d0 0x7f34cc06da90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.652+0000 7f34d3fff640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34e81665b0 0x7f34e81fb290 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.652+0000 7f34d3fff640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e81659c0 0x7f34e80caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.652+0000 7f34d3fff640 1 --2- 172.21.15.55:0/1601392699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34e81655e0 0x7f34e80b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.652+0000 7f34d3fff640 1 -- 172.21.15.55:0/1601392699 >> 172.21.15.55:0/1601392699 conn(0x7f34e806f4c0 msgr2=0x7f34e806d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.652+0000 7f34d3fff640 1 -- 172.21.15.55:0/1601392699 shutdown_connections 2024-04-25T08:53:54.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.652+0000 7f34d3fff640 1 -- 172.21.15.55:0/1601392699 wait complete. 2024-04-25T08:53:54.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-04-25T08:53:54.653 DEBUG:teuthology.parallel:result is None 2024-04-25T08:53:54.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.672+0000 7fb0f81f5640 1 -- 172.21.15.55:0/4033623627 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb0e8005380 con 0x7fb0e8056aa0 2024-04-25T08:53:54.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.672+0000 7fb0e67fc640 1 -- 172.21.15.55:0/4033623627 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0e005c460 con 0x7fb0e8056aa0 2024-04-25T08:53:54.662 INFO:teuthology.orchestra.run.smithi055.stdout:64424509448 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.674+0000 7fb0f81f5640 1 -- 172.21.15.55:0/4033623627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb0d406b5a0 msgr2=0x7fb0d406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.674+0000 7fb0f81f5640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb0d406b5a0 0x7fb0d406da60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800f930 tx=0x7fb0f00a9000 comp rx=0 tx=0).stop 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.674+0000 7fb0f81f5640 1 -- 172.21.15.55:0/4033623627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e8056aa0 msgr2=0x7fb0e80e3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.674+0000 7fb0f81f5640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e8056aa0 0x7fb0e80e3d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000b4a0 tx=0x7fb0e000b960 comp rx=0 tx=0).stop 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.674+0000 7fb0f81f5640 1 -- 172.21.15.55:0/4033623627 shutdown_connections 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.674+0000 7fb0f81f5640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb0d406b5a0 0x7fb0d406da60 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800f930 tx=0x7fb0f00a9000 comp rx=0 tx=0).stop 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.674+0000 7fb0f81f5640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0e80e7700 0x7fb0e803e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.674+0000 7fb0f81f5640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e80589b0 0x7fb0e803e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.674+0000 7fb0f81f5640 1 --2- 172.21.15.55:0/4033623627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e8056aa0 0x7fb0e80e3d60 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000b4a0 tx=0x7fb0e000b960 comp rx=0 tx=0).stop 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.674+0000 7fb0f81f5640 1 -- 172.21.15.55:0/4033623627 >> 172.21.15.55:0/4033623627 conn(0x7fb0e8058ed0 msgr2=0x7fb0e80e5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.675+0000 7fb0f81f5640 1 -- 172.21.15.55:0/4033623627 shutdown_connections 2024-04-25T08:53:54.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.675+0000 7fb0f81f5640 1 -- 172.21.15.55:0/4033623627 wait complete. 2024-04-25T08:53:54.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.682+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f30a40b43c0 con 0x7f30a406bbb0 2024-04-25T08:53:54.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.683+0000 7f308b7fe640 1 -- 172.21.15.55:0/2418167838 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f309c082990 con 0x7f30a406bbb0 2024-04-25T08:53:54.673 INFO:teuthology.orchestra.run.smithi055.stdout:64424509448 2024-04-25T08:53:54.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.683+0000 7f7f1b59e640 1 -- 172.21.15.55:0/3023430839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f140057d0 con 0x7f7f04003a00 2024-04-25T08:53:54.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.684+0000 7f7f0affd640 1 -- 172.21.15.55:0/3023430839 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f0c04e020 con 0x7f7f04003a00 2024-04-25T08:53:54.674 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-04-25T08:53:54.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f309006b4d0 msgr2=0x7f309006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f309006b4d0 0x7f309006d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3094007fd0 tx=0x7f3094007f40 comp rx=0 tx=0).stop 2024-04-25T08:53:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a406bbb0 msgr2=0x7f30a41f2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a406bbb0 0x7f30a41f2ba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f309c000f80 tx=0x7f309c004a40 comp rx=0 tx=0).stop 2024-04-25T08:53:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 shutdown_connections 2024-04-25T08:53:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f309006b4d0 0x7f309006d990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a415a4c0 0x7f30a41ef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30a4157a00 0x7f30a40ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 --2- 172.21.15.55:0/2418167838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a406bbb0 0x7f30a41f2ba0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 >> 172.21.15.55:0/2418167838 conn(0x7f30a4071b10 msgr2=0x7f30a40b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-04-25T08:53:54.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 shutdown_connections 2024-04-25T08:53:54.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.686+0000 7f30a97e0640 1 -- 172.21.15.55:0/2418167838 wait complete. 2024-04-25T08:53:54.679 DEBUG:teuthology.parallel:result is None 2024-04-25T08:53:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 -- 172.21.15.55:0/3023430839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7efc06b500 msgr2=0x7f7efc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7efc06b500 0x7f7efc06d9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c050190 tx=0x7f7f1c06e040 comp rx=0 tx=0).stop 2024-04-25T08:53:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 -- 172.21.15.55:0/3023430839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f04003a00 msgr2=0x7f7f140d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f04003a00 0x7f7f140d07c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c02b550 tx=0x7f7f0c004a40 comp rx=0 tx=0).stop 2024-04-25T08:53:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 -- 172.21.15.55:0/3023430839 shutdown_connections 2024-04-25T08:53:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7efc06b500 0x7f7efc06d9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f140cd640 0x7f7f140e2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f140cbf50 0x7f7f1404ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 --2- 172.21.15.55:0/3023430839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f04003a00 0x7f7f140d07c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 -- 172.21.15.55:0/3023430839 >> 172.21.15.55:0/3023430839 conn(0x7f7f14055bc0 msgr2=0x7f7f140351f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 -- 172.21.15.55:0/3023430839 shutdown_connections 2024-04-25T08:53:54.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.687+0000 7f7f1b59e640 1 -- 172.21.15.55:0/3023430839 wait complete. 2024-04-25T08:53:54.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.691+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f462c00b0e0 con 0x7f462c038290 2024-04-25T08:53:54.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.691+0000 7f4630ff9640 1 -- 172.21.15.55:0/858484044 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4620058730 con 0x7f462c038290 2024-04-25T08:53:54.681 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.693+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f461806b4d0 msgr2=0x7f461806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.693+0000 7f463a2e2640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f461806b4d0 0x7f461806d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4634000b60 tx=0x7f463406e030 comp rx=0 tx=0).stop 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.694+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f462c038290 msgr2=0x7f462c048c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.694+0000 7f463a2e2640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f462c038290 0x7f462c048c10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f462000b410 tx=0x7f462000b8d0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.694+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 shutdown_connections 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.694+0000 7f463a2e2640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f461806b4d0 0x7f461806d990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.694+0000 7f463a2e2640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f462c0e0ff0 0x7f462c04e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.694+0000 7f463a2e2640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f462c038290 0x7f462c048c10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.694+0000 7f463a2e2640 1 --2- 172.21.15.55:0/858484044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c0343a0 0x7f462c036950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.694+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 >> 172.21.15.55:0/858484044 conn(0x7f462c00a3f0 msgr2=0x7f462c053310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.694+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 shutdown_connections 2024-04-25T08:53:54.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.694+0000 7f463a2e2640 1 -- 172.21.15.55:0/858484044 wait complete. 2024-04-25T08:53:54.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.696+0000 7fcda6f6c640 1 -- 172.21.15.55:0/1361332455 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcda00ce800 con 0x7fcda00d05b0 2024-04-25T08:53:54.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.697+0000 7fcd967fc640 1 -- 172.21.15.55:0/1361332455 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd9005bc60 con 0x7fcda00d05b0 2024-04-25T08:53:54.687 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-04-25T08:53:54.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.698+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd40413e940 con 0x7fd4040b17d0 2024-04-25T08:53:54.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.698+0000 7fd3ebfff640 1 -- 172.21.15.55:0/3594273654 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3fc060910 con 0x7fd4040b17d0 2024-04-25T08:53:54.688 INFO:teuthology.orchestra.run.smithi055.stdout:64424509449 2024-04-25T08:53:54.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.699+0000 7fcda6f6c640 1 -- 172.21.15.55:0/1361332455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd8406b500 msgr2=0x7fcd8406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.699+0000 7fcda6f6c640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd8406b500 0x7fcd8406d9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0097a0 tx=0x7fcd9c02e000 comp rx=0 tx=0).stop 2024-04-25T08:53:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.699+0000 7fcda6f6c640 1 -- 172.21.15.55:0/1361332455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d05b0 msgr2=0x7fcda0148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.699+0000 7fcda6f6c640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d05b0 0x7fcda0148c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd90000f60 tx=0x7fcd9000c800 comp rx=0 tx=0).stop 2024-04-25T08:53:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.699+0000 7fcda6f6c640 1 -- 172.21.15.55:0/1361332455 shutdown_connections 2024-04-25T08:53:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.699+0000 7fcda6f6c640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd8406b500 0x7fcd8406d9c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.699+0000 7fcda6f6c640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda00d1b90 0x7fcda01f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.699+0000 7fcda6f6c640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcda00d05b0 0x7fcda0148c80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.699+0000 7fcda6f6c640 1 --2- 172.21.15.55:0/1361332455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcda00d01d0 0x7fcda00c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.699+0000 7fcda6f6c640 1 -- 172.21.15.55:0/1361332455 >> 172.21.15.55:0/1361332455 conn(0x7fcda006bed0 msgr2=0x7fcda006c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.700+0000 7fcda6f6c640 1 -- 172.21.15.55:0/1361332455 shutdown_connections 2024-04-25T08:53:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.700+0000 7fcda6f6c640 1 -- 172.21.15.55:0/1361332455 wait complete. 2024-04-25T08:53:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.700+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd3f006b520 msgr2=0x7fd3f006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.700+0000 7fd409a76640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd3f006b520 0x7fd3f006d9e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8034000 tx=0x7fd3f802e000 comp rx=0 tx=0).stop 2024-04-25T08:53:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.700+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4040b17d0 msgr2=0x7fd4041eef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.700+0000 7fd409a76640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4040b17d0 0x7fd4041eef20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc002110 tx=0x7fd3fc0154b0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.701+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 shutdown_connections 2024-04-25T08:53:54.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.701+0000 7fd409a76640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd3f006b520 0x7fd3f006d9e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.701+0000 7fd409a76640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd40415aa30 0x7fd4040b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.701+0000 7fd409a76640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4040b17d0 0x7fd4041eef20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.701+0000 7fd409a76640 1 --2- 172.21.15.55:0/3594273654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd40406f140 0x7fd40413ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.701+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 >> 172.21.15.55:0/3594273654 conn(0x7fd40406aba0 msgr2=0x7fd40413ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.701+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 shutdown_connections 2024-04-25T08:53:54.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.701+0000 7fd409a76640 1 -- 172.21.15.55:0/3594273654 wait complete. 2024-04-25T08:53:54.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-04-25T08:53:54.696 DEBUG:teuthology.parallel:result is None 2024-04-25T08:53:54.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.5 2024-04-25T08:53:54.697 DEBUG:teuthology.parallel:result is None 2024-04-25T08:53:54.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-04-25T08:53:54.699 DEBUG:teuthology.parallel:result is None 2024-04-25T08:53:54.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-04-25T08:53:54.704 DEBUG:teuthology.parallel:result is None 2024-04-25T08:53:54.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-04-25T08:53:54.704 DEBUG:teuthology.parallel:result is None 2024-04-25T08:53:54.704 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T08:53:54.704 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:53:54.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.855+0000 7f9535309640 1 Processor -- start 2024-04-25T08:53:54.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.855+0000 7f9535309640 1 -- start start 2024-04-25T08:53:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f9535309640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f953015dce0 0x7f95300d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f9535309640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f95300d35b0 0x7f95300b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f9535309640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953015e0c0 con 0x7f95300d1f90 2024-04-25T08:53:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f9535309640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95300b7b10 con 0x7f953015dce0 2024-04-25T08:53:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f9535309640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95300d2510 con 0x7f95300d35b0 2024-04-25T08:53:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f952effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f953015dce0 0x7f95300d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f952effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f953015dce0 0x7f95300d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48258/0 (socket says 172.21.15.55:48258) 2024-04-25T08:53:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f952effd640 1 -- 172.21.15.55:0/4080453384 learned_addr learned my addr 172.21.15.55:0/4080453384 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f952e7fc640 1 --2- 172.21.15.55:0/4080453384 >> v2:172.21.15.167:3300/0 conn(0x7f95300d35b0 0x7f95300b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f952effd640 1 -- 172.21.15.55:0/4080453384 >> v2:172.21.15.167:3300/0 conn(0x7f95300d35b0 msgr2=0x7f95300b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f952effd640 1 --2- 172.21.15.55:0/4080453384 >> v2:172.21.15.167:3300/0 conn(0x7f95300d35b0 0x7f95300b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f952effd640 1 -- 172.21.15.55:0/4080453384 >> v1:172.21.15.167:6789/0 conn(0x7f95300d1f90 legacy=0x7f953006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.856+0000 7f952effd640 1 -- 172.21.15.55:0/4080453384 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95300d27f0 con 0x7f953015dce0 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.857+0000 7f952effd640 1 --2- 172.21.15.55:0/4080453384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f953015dce0 0x7f95300d1a50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f95300cdfa0 tx=0x7f952002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0d8711b408000d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.857+0000 7f952dffb640 1 -- 172.21.15.55:0/4080453384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520037070 con 0x7f953015dce0 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.857+0000 7f952dffb640 1 -- 172.21.15.55:0/4080453384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520032440 con 0x7f953015dce0 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.857+0000 7f952dffb640 1 -- 172.21.15.55:0/4080453384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520032810 con 0x7f953015dce0 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.858+0000 7f9535309640 1 -- 172.21.15.55:0/4080453384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f953015dce0 msgr2=0x7f95300d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.858+0000 7f9535309640 1 --2- 172.21.15.55:0/4080453384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f953015dce0 0x7f95300d1a50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f95300cdfa0 tx=0x7f952002a270 comp rx=0 tx=0).stop 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.858+0000 7f9535309640 1 -- 172.21.15.55:0/4080453384 shutdown_connections 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.858+0000 7f9535309640 1 --2- 172.21.15.55:0/4080453384 >> v2:172.21.15.167:3300/0 conn(0x7f95300d35b0 0x7f95300b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.858+0000 7f9535309640 1 --2- 172.21.15.55:0/4080453384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f953015dce0 0x7f95300d1a50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.858+0000 7f9535309640 1 -- 172.21.15.55:0/4080453384 >> 172.21.15.55:0/4080453384 conn(0x7f9530072900 msgr2=0x7f95300d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.858+0000 7f9535309640 1 -- 172.21.15.55:0/4080453384 shutdown_connections 2024-04-25T08:53:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.858+0000 7f9535309640 1 -- 172.21.15.55:0/4080453384 wait complete. 2024-04-25T08:53:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.859+0000 7f9535309640 1 Processor -- start 2024-04-25T08:53:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.859+0000 7f9535309640 1 -- start start 2024-04-25T08:53:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f9535309640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95300d1f90 0x7f95300c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f9535309640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95300d35b0 0x7f9530152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f9535309640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953015dce0 0x7f95300ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f9535309640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95300d3090 con 0x7f95300d35b0 2024-04-25T08:53:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f9535309640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95300d2db0 con 0x7f95300d1f90 2024-04-25T08:53:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f9535309640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95300b9820 con 0x7f953015dce0 2024-04-25T08:53:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95300d35b0 0x7f9530152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95300d35b0 0x7f9530152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48272/0 (socket says 172.21.15.55:48272) 2024-04-25T08:53:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952e7fc640 1 -- 172.21.15.55:0/3265634146 learned_addr learned my addr 172.21.15.55:0/3265634146 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952effd640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95300d1f90 0x7f95300c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952f7fe640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953015dce0 0x7f95300ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952e7fc640 1 -- 172.21.15.55:0/3265634146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953015dce0 msgr2=0x7f95300ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952e7fc640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953015dce0 0x7f95300ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952e7fc640 1 -- 172.21.15.55:0/3265634146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95300d1f90 msgr2=0x7f95300c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952e7fc640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95300d1f90 0x7f95300c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952e7fc640 1 -- 172.21.15.55:0/3265634146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95300c8c20 con 0x7f95300d35b0 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952f7fe640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953015dce0 0x7f95300ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.860+0000 7f952e7fc640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95300d35b0 0x7f9530152ed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f952400d7d0 tx=0x7f952400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.861+0000 7f95177fe640 1 -- 172.21.15.55:0/3265634146 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400b6c0 con 0x7f95300d35b0 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.861+0000 7f95177fe640 1 -- 172.21.15.55:0/3265634146 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9524019070 con 0x7f95300d35b0 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.861+0000 7f95177fe640 1 -- 172.21.15.55:0/3265634146 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400bac0 con 0x7f95300d35b0 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.861+0000 7f9535309640 1 -- 172.21.15.55:0/3265634146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95300c8f00 con 0x7f95300d35b0 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.861+0000 7f9535309640 1 -- 172.21.15.55:0/3265634146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95300c94c0 con 0x7f95300d35b0 2024-04-25T08:53:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.862+0000 7f9535309640 1 -- 172.21.15.55:0/3265634146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95300749b0 con 0x7f95300d35b0 2024-04-25T08:53:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.862+0000 7f95177fe640 1 -- 172.21.15.55:0/3265634146 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f952400bc60 con 0x7f95300d35b0 2024-04-25T08:53:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.862+0000 7f95177fe640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f951c06b4d0 0x7f951c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.863+0000 7f95177fe640 1 -- 172.21.15.55:0/3265634146 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f952408a650 con 0x7f95300d35b0 2024-04-25T08:53:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.863+0000 7f952effd640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f951c06b4d0 0x7f951c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.863+0000 7f952effd640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f951c06b4d0 0x7f951c06d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9520034000 tx=0x7f952002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:54.867+0000 7f95177fe640 1 -- 172.21.15.55:0/3265634146 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9524059560 con 0x7f95300d35b0 2024-04-25T08:53:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.043+0000 7f9535309640 1 -- 172.21.15.55:0/3265634146 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9530161370 con 0x7f951c06b4d0 2024-04-25T08:53:55.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.049+0000 7f95177fe640 1 -- 172.21.15.55:0/3265634146 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251837 (secure 0 0 0) 0x7f9530161370 con 0x7f951c06b4d0 2024-04-25T08:53:55.046 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:55.048 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:53:55.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 -- 172.21.15.55:0/3265634146 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f951c06b4d0 msgr2=0x7f951c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f951c06b4d0 0x7f951c06d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9520034000 tx=0x7f952002e000 comp rx=0 tx=0).stop 2024-04-25T08:53:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 -- 172.21.15.55:0/3265634146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95300d35b0 msgr2=0x7f9530152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95300d35b0 0x7f9530152ed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f952400d7d0 tx=0x7f952400dc90 comp rx=0 tx=0).stop 2024-04-25T08:53:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 -- 172.21.15.55:0/3265634146 shutdown_connections 2024-04-25T08:53:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f951c06b4d0 0x7f951c06d990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953015dce0 0x7f95300ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95300d35b0 0x7f9530152ed0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 --2- 172.21.15.55:0/3265634146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95300d1f90 0x7f95300c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 -- 172.21.15.55:0/3265634146 >> 172.21.15.55:0/3265634146 conn(0x7f9530072900 msgr2=0x7f95300d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 -- 172.21.15.55:0/3265634146 shutdown_connections 2024-04-25T08:53:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.052+0000 7f9535309640 1 -- 172.21.15.55:0/3265634146 wait complete. 2024-04-25T08:53:55.053 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-25T08:53:54.554431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235868,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738852,"statfs":{"total":773094113280,"available":772852584448,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.346683"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458904+0000","last_change":"2024-04-25T08:53:43.226040+0000","last_active":"2024-04-25T08:53:44.458904+0000","last_peered":"2024-04-25T08:53:44.458904+0000","last_clean":"2024-04-25T08:53:44.458904+0000","last_became_active":"2024-04-25T08:53:43.225773+0000","last_became_peered":"2024-04-25T08:53:43.225773+0000","last_unstale":"2024-04-25T08:53:44.458904+0000","last_undegraded":"2024-04-25T08:53:44.458904+0000","last_fullsized":"2024-04-25T08:53:44.458904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:25.482497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214380+0000","last_change":"2024-04-25T08:53:43.213215+0000","last_active":"2024-04-25T08:53:45.214380+0000","last_peered":"2024-04-25T08:53:45.214380+0000","last_clean":"2024-04-25T08:53:45.214380+0000","last_became_active":"2024-04-25T08:53:43.212906+0000","last_became_peered":"2024-04-25T08:53:43.212906+0000","last_unstale":"2024-04-25T08:53:45.214380+0000","last_undegraded":"2024-04-25T08:53:45.214380+0000","last_fullsized":"2024-04-25T08:53:45.214380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:49.492910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356331+0000","last_change":"2024-04-25T08:53:43.222988+0000","last_active":"2024-04-25T08:53:45.356331+0000","last_peered":"2024-04-25T08:53:45.356331+0000","last_clean":"2024-04-25T08:53:45.356331+0000","last_became_active":"2024-04-25T08:53:43.222683+0000","last_became_peered":"2024-04-25T08:53:43.222683+0000","last_unstale":"2024-04-25T08:53:45.356331+0000","last_undegraded":"2024-04-25T08:53:45.356331+0000","last_fullsized":"2024-04-25T08:53:45.356331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336369+0000","last_change":"2024-04-25T08:53:43.227764+0000","last_active":"2024-04-25T08:53:44.336369+0000","last_peered":"2024-04-25T08:53:44.336369+0000","last_clean":"2024-04-25T08:53:44.336369+0000","last_became_active":"2024-04-25T08:53:43.227462+0000","last_became_peered":"2024-04-25T08:53:43.227462+0000","last_unstale":"2024-04-25T08:53:44.336369+0000","last_undegraded":"2024-04-25T08:53:44.336369+0000","last_fullsized":"2024-04-25T08:53:44.336369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458562+0000","last_change":"2024-04-25T08:53:43.222336+0000","last_active":"2024-04-25T08:53:44.458562+0000","last_peered":"2024-04-25T08:53:44.458562+0000","last_clean":"2024-04-25T08:53:44.458562+0000","last_became_active":"2024-04-25T08:53:43.222046+0000","last_became_peered":"2024-04-25T08:53:43.222046+0000","last_unstale":"2024-04-25T08:53:44.458562+0000","last_undegraded":"2024-04-25T08:53:44.458562+0000","last_fullsized":"2024-04-25T08:53:44.458562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336385+0000","last_change":"2024-04-25T08:53:43.226820+0000","last_active":"2024-04-25T08:53:44.336385+0000","last_peered":"2024-04-25T08:53:44.336385+0000","last_clean":"2024-04-25T08:53:44.336385+0000","last_became_active":"2024-04-25T08:53:43.226533+0000","last_became_peered":"2024-04-25T08:53:43.226533+0000","last_unstale":"2024-04-25T08:53:44.336385+0000","last_undegraded":"2024-04-25T08:53:44.336385+0000","last_fullsized":"2024-04-25T08:53:44.336385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:59.064691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458308+0000","last_change":"2024-04-25T08:53:43.226661+0000","last_active":"2024-04-25T08:53:44.458308+0000","last_peered":"2024-04-25T08:53:44.458308+0000","last_clean":"2024-04-25T08:53:44.458308+0000","last_became_active":"2024-04-25T08:53:43.226353+0000","last_became_peered":"2024-04-25T08:53:43.226353+0000","last_unstale":"2024-04-25T08:53:44.458308+0000","last_undegraded":"2024-04-25T08:53:44.458308+0000","last_fullsized":"2024-04-25T08:53:44.458308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209304+0000","last_change":"2024-04-25T08:53:43.217719+0000","last_active":"2024-04-25T08:53:44.209304+0000","last_peered":"2024-04-25T08:53:44.209304+0000","last_clean":"2024-04-25T08:53:44.209304+0000","last_became_active":"2024-04-25T08:53:43.217440+0000","last_became_peered":"2024-04-25T08:53:43.217440+0000","last_unstale":"2024-04-25T08:53:44.209304+0000","last_undegraded":"2024-04-25T08:53:44.209304+0000","last_fullsized":"2024-04-25T08:53:44.209304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458926+0000","last_change":"2024-04-25T08:53:43.219775+0000","last_active":"2024-04-25T08:53:44.458926+0000","last_peered":"2024-04-25T08:53:44.458926+0000","last_clean":"2024-04-25T08:53:44.458926+0000","last_became_active":"2024-04-25T08:53:43.219463+0000","last_became_peered":"2024-04-25T08:53:43.219463+0000","last_unstale":"2024-04-25T08:53:44.458926+0000","last_undegraded":"2024-04-25T08:53:44.458926+0000","last_fullsized":"2024-04-25T08:53:44.458926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.064857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214552+0000","last_change":"2024-04-25T08:53:43.216899+0000","last_active":"2024-04-25T08:53:44.214552+0000","last_peered":"2024-04-25T08:53:44.214552+0000","last_clean":"2024-04-25T08:53:44.214552+0000","last_became_active":"2024-04-25T08:53:43.216571+0000","last_became_peered":"2024-04-25T08:53:43.216571+0000","last_unstale":"2024-04-25T08:53:44.214552+0000","last_undegraded":"2024-04-25T08:53:44.214552+0000","last_fullsized":"2024-04-25T08:53:44.214552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214373+0000","last_change":"2024-04-25T08:53:43.220978+0000","last_active":"2024-04-25T08:53:44.214373+0000","last_peered":"2024-04-25T08:53:44.214373+0000","last_clean":"2024-04-25T08:53:44.214373+0000","last_became_active":"2024-04-25T08:53:43.219635+0000","last_became_peered":"2024-04-25T08:53:43.219635+0000","last_unstale":"2024-04-25T08:53:44.214373+0000","last_undegraded":"2024-04-25T08:53:44.214373+0000","last_fullsized":"2024-04-25T08:53:44.214373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215612+0000","last_change":"2024-04-25T08:53:43.224429+0000","last_active":"2024-04-25T08:53:44.215612+0000","last_peered":"2024-04-25T08:53:44.215612+0000","last_clean":"2024-04-25T08:53:44.215612+0000","last_became_active":"2024-04-25T08:53:43.224174+0000","last_became_peered":"2024-04-25T08:53:43.224174+0000","last_unstale":"2024-04-25T08:53:44.215612+0000","last_undegraded":"2024-04-25T08:53:44.215612+0000","last_fullsized":"2024-04-25T08:53:44.215612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:46.648651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209560+0000","last_change":"2024-04-25T08:53:43.216375+0000","last_active":"2024-04-25T08:53:44.209560+0000","last_peered":"2024-04-25T08:53:44.209560+0000","last_clean":"2024-04-25T08:53:44.209560+0000","last_became_active":"2024-04-25T08:53:43.216099+0000","last_became_peered":"2024-04-25T08:53:43.216099+0000","last_unstale":"2024-04-25T08:53:44.209560+0000","last_undegraded":"2024-04-25T08:53:44.209560+0000","last_fullsized":"2024-04-25T08:53:44.209560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356516+0000","last_change":"2024-04-25T08:53:43.223032+0000","last_active":"2024-04-25T08:53:45.356516+0000","last_peered":"2024-04-25T08:53:45.356516+0000","last_clean":"2024-04-25T08:53:45.356516+0000","last_became_active":"2024-04-25T08:53:43.222624+0000","last_became_peered":"2024-04-25T08:53:43.222624+0000","last_unstale":"2024-04-25T08:53:45.356516+0000","last_undegraded":"2024-04-25T08:53:45.356516+0000","last_fullsized":"2024-04-25T08:53:45.356516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214028+0000","last_change":"2024-04-25T08:53:43.210727+0000","last_active":"2024-04-25T08:53:45.214028+0000","last_peered":"2024-04-25T08:53:45.214028+0000","last_clean":"2024-04-25T08:53:45.214028+0000","last_became_active":"2024-04-25T08:53:43.208919+0000","last_became_peered":"2024-04-25T08:53:43.208919+0000","last_unstale":"2024-04-25T08:53:45.214028+0000","last_undegraded":"2024-04-25T08:53:45.214028+0000","last_fullsized":"2024-04-25T08:53:45.214028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:34.911186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.335931+0000","last_change":"2024-04-25T08:53:43.228001+0000","last_active":"2024-04-25T08:53:44.335931+0000","last_peered":"2024-04-25T08:53:44.335931+0000","last_clean":"2024-04-25T08:53:44.335931+0000","last_became_active":"2024-04-25T08:53:43.227703+0000","last_became_peered":"2024-04-25T08:53:43.227703+0000","last_unstale":"2024-04-25T08:53:44.335931+0000","last_undegraded":"2024-04-25T08:53:44.335931+0000","last_fullsized":"2024-04-25T08:53:44.335931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336584+0000","last_change":"2024-04-25T08:53:43.226726+0000","last_active":"2024-04-25T08:53:44.336584+0000","last_peered":"2024-04-25T08:53:44.336584+0000","last_clean":"2024-04-25T08:53:44.336584+0000","last_became_active":"2024-04-25T08:53:43.226448+0000","last_became_peered":"2024-04-25T08:53:43.226448+0000","last_unstale":"2024-04-25T08:53:44.336584+0000","last_undegraded":"2024-04-25T08:53:44.336584+0000","last_fullsized":"2024-04-25T08:53:44.336584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.064857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356481+0000","last_change":"2024-04-25T08:53:43.216437+0000","last_active":"2024-04-25T08:53:45.356481+0000","last_peered":"2024-04-25T08:53:45.356481+0000","last_clean":"2024-04-25T08:53:45.356481+0000","last_became_active":"2024-04-25T08:53:43.216118+0000","last_became_peered":"2024-04-25T08:53:43.216118+0000","last_unstale":"2024-04-25T08:53:45.356481+0000","last_undegraded":"2024-04-25T08:53:45.356481+0000","last_fullsized":"2024-04-25T08:53:45.356481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:30.574790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458878+0000","last_change":"2024-04-25T08:53:43.222245+0000","last_active":"2024-04-25T08:53:44.458878+0000","last_peered":"2024-04-25T08:53:44.458878+0000","last_clean":"2024-04-25T08:53:44.458878+0000","last_became_active":"2024-04-25T08:53:43.221954+0000","last_became_peered":"2024-04-25T08:53:43.221954+0000","last_unstale":"2024-04-25T08:53:44.458878+0000","last_undegraded":"2024-04-25T08:53:44.458878+0000","last_fullsized":"2024-04-25T08:53:44.458878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:46.272432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214280+0000","last_change":"2024-04-25T08:53:43.208966+0000","last_active":"2024-04-25T08:53:44.214280+0000","last_peered":"2024-04-25T08:53:44.214280+0000","last_clean":"2024-04-25T08:53:44.214280+0000","last_became_active":"2024-04-25T08:53:43.208694+0000","last_became_peered":"2024-04-25T08:53:43.208694+0000","last_unstale":"2024-04-25T08:53:44.214280+0000","last_undegraded":"2024-04-25T08:53:44.214280+0000","last_fullsized":"2024-04-25T08:53:44.214280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356228+0000","last_change":"2024-04-25T08:53:43.227774+0000","last_active":"2024-04-25T08:53:45.356228+0000","last_peered":"2024-04-25T08:53:45.356228+0000","last_clean":"2024-04-25T08:53:45.356228+0000","last_became_active":"2024-04-25T08:53:43.227471+0000","last_became_peered":"2024-04-25T08:53:43.227471+0000","last_unstale":"2024-04-25T08:53:45.356228+0000","last_undegraded":"2024-04-25T08:53:45.356228+0000","last_fullsized":"2024-04-25T08:53:45.356228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:28.340979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336129+0000","last_change":"2024-04-25T08:53:43.225757+0000","last_active":"2024-04-25T08:53:44.336129+0000","last_peered":"2024-04-25T08:53:44.336129+0000","last_clean":"2024-04-25T08:53:44.336129+0000","last_became_active":"2024-04-25T08:53:43.225482+0000","last_became_peered":"2024-04-25T08:53:43.225482+0000","last_unstale":"2024-04-25T08:53:44.336129+0000","last_undegraded":"2024-04-25T08:53:44.336129+0000","last_fullsized":"2024-04-25T08:53:44.336129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209673+0000","last_change":"2024-04-25T08:53:43.213773+0000","last_active":"2024-04-25T08:53:44.209673+0000","last_peered":"2024-04-25T08:53:44.209673+0000","last_clean":"2024-04-25T08:53:44.209673+0000","last_became_active":"2024-04-25T08:53:43.211924+0000","last_became_peered":"2024-04-25T08:53:43.211924+0000","last_unstale":"2024-04-25T08:53:44.209673+0000","last_undegraded":"2024-04-25T08:53:44.209673+0000","last_fullsized":"2024-04-25T08:53:44.209673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336156+0000","last_change":"2024-04-25T08:53:43.221087+0000","last_active":"2024-04-25T08:53:44.336156+0000","last_peered":"2024-04-25T08:53:44.336156+0000","last_clean":"2024-04-25T08:53:44.336156+0000","last_became_active":"2024-04-25T08:53:43.219503+0000","last_became_peered":"2024-04-25T08:53:43.219503+0000","last_unstale":"2024-04-25T08:53:44.336156+0000","last_undegraded":"2024-04-25T08:53:44.336156+0000","last_fullsized":"2024-04-25T08:53:44.336156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209695+0000","last_change":"2024-04-25T08:53:43.215393+0000","last_active":"2024-04-25T08:53:44.209695+0000","last_peered":"2024-04-25T08:53:44.209695+0000","last_clean":"2024-04-25T08:53:44.209695+0000","last_became_active":"2024-04-25T08:53:43.214671+0000","last_became_peered":"2024-04-25T08:53:43.214671+0000","last_unstale":"2024-04-25T08:53:44.209695+0000","last_undegraded":"2024-04-25T08:53:44.209695+0000","last_fullsized":"2024-04-25T08:53:44.209695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214588+0000","last_change":"2024-04-25T08:53:43.218493+0000","last_active":"2024-04-25T08:53:44.214588+0000","last_peered":"2024-04-25T08:53:44.214588+0000","last_clean":"2024-04-25T08:53:44.214588+0000","last_became_active":"2024-04-25T08:53:43.218199+0000","last_became_peered":"2024-04-25T08:53:43.218199+0000","last_unstale":"2024-04-25T08:53:44.214588+0000","last_undegraded":"2024-04-25T08:53:44.214588+0000","last_fullsized":"2024-04-25T08:53:44.214588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214156+0000","last_change":"2024-04-25T08:53:43.218908+0000","last_active":"2024-04-25T08:53:45.214156+0000","last_peered":"2024-04-25T08:53:45.214156+0000","last_clean":"2024-04-25T08:53:45.214156+0000","last_became_active":"2024-04-25T08:53:43.218580+0000","last_became_peered":"2024-04-25T08:53:43.218580+0000","last_unstale":"2024-04-25T08:53:45.214156+0000","last_undegraded":"2024-04-25T08:53:45.214156+0000","last_fullsized":"2024-04-25T08:53:45.214156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:13.572873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209813+0000","last_change":"2024-04-25T08:53:43.214059+0000","last_active":"2024-04-25T08:53:44.209813+0000","last_peered":"2024-04-25T08:53:44.209813+0000","last_clean":"2024-04-25T08:53:44.209813+0000","last_became_active":"2024-04-25T08:53:43.211412+0000","last_became_peered":"2024-04-25T08:53:43.211412+0000","last_unstale":"2024-04-25T08:53:44.209813+0000","last_undegraded":"2024-04-25T08:53:44.209813+0000","last_fullsized":"2024-04-25T08:53:44.209813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356366+0000","last_change":"2024-04-25T08:53:43.224899+0000","last_active":"2024-04-25T08:53:45.356366+0000","last_peered":"2024-04-25T08:53:45.356366+0000","last_clean":"2024-04-25T08:53:45.356366+0000","last_became_active":"2024-04-25T08:53:43.224532+0000","last_became_peered":"2024-04-25T08:53:43.224532+0000","last_unstale":"2024-04-25T08:53:45.356366+0000","last_undegraded":"2024-04-25T08:53:45.356366+0000","last_fullsized":"2024-04-25T08:53:45.356366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336482+0000","last_change":"2024-04-25T08:53:43.225133+0000","last_active":"2024-04-25T08:53:44.336482+0000","last_peered":"2024-04-25T08:53:44.336482+0000","last_clean":"2024-04-25T08:53:44.336482+0000","last_became_active":"2024-04-25T08:53:43.224687+0000","last_became_peered":"2024-04-25T08:53:43.224687+0000","last_unstale":"2024-04-25T08:53:44.336482+0000","last_undegraded":"2024-04-25T08:53:44.336482+0000","last_fullsized":"2024-04-25T08:53:44.336482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:46.272432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356080+0000","last_change":"2024-04-25T08:53:43.215307+0000","last_active":"2024-04-25T08:53:45.356080+0000","last_peered":"2024-04-25T08:53:45.356080+0000","last_clean":"2024-04-25T08:53:45.356080+0000","last_became_active":"2024-04-25T08:53:43.215014+0000","last_became_peered":"2024-04-25T08:53:43.215014+0000","last_unstale":"2024-04-25T08:53:45.356080+0000","last_undegraded":"2024-04-25T08:53:45.356080+0000","last_fullsized":"2024-04-25T08:53:45.356080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:46.648651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214040+0000","last_change":"2024-04-25T08:53:43.226428+0000","last_active":"2024-04-25T08:53:44.214040+0000","last_peered":"2024-04-25T08:53:44.214040+0000","last_clean":"2024-04-25T08:53:44.214040+0000","last_became_active":"2024-04-25T08:53:43.225678+0000","last_became_peered":"2024-04-25T08:53:43.225678+0000","last_unstale":"2024-04-25T08:53:44.214040+0000","last_undegraded":"2024-04-25T08:53:44.214040+0000","last_fullsized":"2024-04-25T08:53:44.214040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215161+0000","last_change":"2024-04-25T08:53:43.210436+0000","last_active":"2024-04-25T08:53:44.215161+0000","last_peered":"2024-04-25T08:53:44.215161+0000","last_clean":"2024-04-25T08:53:44.215161+0000","last_became_active":"2024-04-25T08:53:43.210150+0000","last_became_peered":"2024-04-25T08:53:43.210150+0000","last_unstale":"2024-04-25T08:53:44.215161+0000","last_undegraded":"2024-04-25T08:53:44.215161+0000","last_fullsized":"2024-04-25T08:53:44.215161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:36.391147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209779+0000","last_change":"2024-04-25T08:53:42.207162+0000","last_active":"2024-04-25T08:53:44.209779+0000","last_peered":"2024-04-25T08:53:44.209779+0000","last_clean":"2024-04-25T08:53:44.209779+0000","last_became_active":"2024-04-25T08:53:42.206827+0000","last_became_peered":"2024-04-25T08:53:42.206827+0000","last_unstale":"2024-04-25T08:53:44.209779+0000","last_undegraded":"2024-04-25T08:53:44.209779+0000","last_fullsized":"2024-04-25T08:53:44.209779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356472+0000","last_change":"2024-04-25T08:53:43.219024+0000","last_active":"2024-04-25T08:53:45.356472+0000","last_peered":"2024-04-25T08:53:45.356472+0000","last_clean":"2024-04-25T08:53:45.356472+0000","last_became_active":"2024-04-25T08:53:43.218674+0000","last_became_peered":"2024-04-25T08:53:43.218674+0000","last_unstale":"2024-04-25T08:53:45.356472+0000","last_undegraded":"2024-04-25T08:53:45.356472+0000","last_fullsized":"2024-04-25T08:53:45.356472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214016+0000","last_change":"2024-04-25T08:53:42.202321+0000","last_active":"2024-04-25T08:53:44.214016+0000","last_peered":"2024-04-25T08:53:44.214016+0000","last_clean":"2024-04-25T08:53:44.214016+0000","last_became_active":"2024-04-25T08:53:42.202063+0000","last_became_peered":"2024-04-25T08:53:42.202063+0000","last_unstale":"2024-04-25T08:53:44.214016+0000","last_undegraded":"2024-04-25T08:53:44.214016+0000","last_fullsized":"2024-04-25T08:53:44.214016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209484+0000","last_change":"2024-04-25T08:53:42.210884+0000","last_active":"2024-04-25T08:53:44.209484+0000","last_peered":"2024-04-25T08:53:44.209484+0000","last_clean":"2024-04-25T08:53:44.209484+0000","last_became_active":"2024-04-25T08:53:42.210568+0000","last_became_peered":"2024-04-25T08:53:42.210568+0000","last_unstale":"2024-04-25T08:53:44.209484+0000","last_undegraded":"2024-04-25T08:53:44.209484+0000","last_fullsized":"2024-04-25T08:53:44.209484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:51.480879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209351+0000","last_change":"2024-04-25T08:53:43.225401+0000","last_active":"2024-04-25T08:53:44.209351+0000","last_peered":"2024-04-25T08:53:44.209351+0000","last_clean":"2024-04-25T08:53:44.209351+0000","last_became_active":"2024-04-25T08:53:43.224926+0000","last_became_peered":"2024-04-25T08:53:43.224926+0000","last_unstale":"2024-04-25T08:53:44.209351+0000","last_undegraded":"2024-04-25T08:53:44.209351+0000","last_fullsized":"2024-04-25T08:53:44.209351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336053+0000","last_change":"2024-04-25T08:53:42.201897+0000","last_active":"2024-04-25T08:53:44.336053+0000","last_peered":"2024-04-25T08:53:44.336053+0000","last_clean":"2024-04-25T08:53:44.336053+0000","last_became_active":"2024-04-25T08:53:42.201641+0000","last_became_peered":"2024-04-25T08:53:42.201641+0000","last_unstale":"2024-04-25T08:53:44.336053+0000","last_undegraded":"2024-04-25T08:53:44.336053+0000","last_fullsized":"2024-04-25T08:53:44.336053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.213983+0000","last_change":"2024-04-25T08:53:43.209001+0000","last_active":"2024-04-25T08:53:45.213983+0000","last_peered":"2024-04-25T08:53:45.213983+0000","last_clean":"2024-04-25T08:53:45.213983+0000","last_became_active":"2024-04-25T08:53:43.207746+0000","last_became_peered":"2024-04-25T08:53:43.207746+0000","last_unstale":"2024-04-25T08:53:45.213983+0000","last_undegraded":"2024-04-25T08:53:45.213983+0000","last_fullsized":"2024-04-25T08:53:45.213983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:16.959076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214230+0000","last_change":"2024-04-25T08:53:42.209416+0000","last_active":"2024-04-25T08:53:44.214230+0000","last_peered":"2024-04-25T08:53:44.214230+0000","last_clean":"2024-04-25T08:53:44.214230+0000","last_became_active":"2024-04-25T08:53:42.209094+0000","last_became_peered":"2024-04-25T08:53:42.209094+0000","last_unstale":"2024-04-25T08:53:44.214230+0000","last_undegraded":"2024-04-25T08:53:44.214230+0000","last_fullsized":"2024-04-25T08:53:44.214230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336418+0000","last_change":"2024-04-25T08:53:43.221170+0000","last_active":"2024-04-25T08:53:44.336418+0000","last_peered":"2024-04-25T08:53:44.336418+0000","last_clean":"2024-04-25T08:53:44.336418+0000","last_became_active":"2024-04-25T08:53:43.220913+0000","last_became_peered":"2024-04-25T08:53:43.220913+0000","last_unstale":"2024-04-25T08:53:44.336418+0000","last_undegraded":"2024-04-25T08:53:44.336418+0000","last_fullsized":"2024-04-25T08:53:44.336418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:22.702870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336314+0000","last_change":"2024-04-25T08:53:42.209519+0000","last_active":"2024-04-25T08:53:44.336314+0000","last_peered":"2024-04-25T08:53:44.336314+0000","last_clean":"2024-04-25T08:53:44.336314+0000","last_became_active":"2024-04-25T08:53:42.209218+0000","last_became_peered":"2024-04-25T08:53:42.209218+0000","last_unstale":"2024-04-25T08:53:44.336314+0000","last_undegraded":"2024-04-25T08:53:44.336314+0000","last_fullsized":"2024-04-25T08:53:44.336314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356635+0000","last_change":"2024-04-25T08:53:43.216391+0000","last_active":"2024-04-25T08:53:45.356635+0000","last_peered":"2024-04-25T08:53:45.356635+0000","last_clean":"2024-04-25T08:53:45.356635+0000","last_became_active":"2024-04-25T08:53:43.216117+0000","last_became_peered":"2024-04-25T08:53:43.216117+0000","last_unstale":"2024-04-25T08:53:45.356635+0000","last_undegraded":"2024-04-25T08:53:45.356635+0000","last_fullsized":"2024-04-25T08:53:45.356635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214200+0000","last_change":"2024-04-25T08:53:42.199430+0000","last_active":"2024-04-25T08:53:45.214200+0000","last_peered":"2024-04-25T08:53:45.214200+0000","last_clean":"2024-04-25T08:53:45.214200+0000","last_became_active":"2024-04-25T08:53:42.199063+0000","last_became_peered":"2024-04-25T08:53:42.199063+0000","last_unstale":"2024-04-25T08:53:45.214200+0000","last_undegraded":"2024-04-25T08:53:45.214200+0000","last_fullsized":"2024-04-25T08:53:45.214200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:02.408782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215673+0000","last_change":"2024-04-25T08:53:43.222934+0000","last_active":"2024-04-25T08:53:44.215673+0000","last_peered":"2024-04-25T08:53:44.215673+0000","last_clean":"2024-04-25T08:53:44.215673+0000","last_became_active":"2024-04-25T08:53:43.222610+0000","last_became_peered":"2024-04-25T08:53:43.222610+0000","last_unstale":"2024-04-25T08:53:44.215673+0000","last_undegraded":"2024-04-25T08:53:44.215673+0000","last_fullsized":"2024-04-25T08:53:44.215673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:30.574790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214410+0000","last_change":"2024-04-25T08:53:42.205189+0000","last_active":"2024-04-25T08:53:44.214410+0000","last_peered":"2024-04-25T08:53:44.214410+0000","last_clean":"2024-04-25T08:53:44.214410+0000","last_became_active":"2024-04-25T08:53:42.204876+0000","last_became_peered":"2024-04-25T08:53:42.204876+0000","last_unstale":"2024-04-25T08:53:44.214410+0000","last_undegraded":"2024-04-25T08:53:44.214410+0000","last_fullsized":"2024-04-25T08:53:44.214410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458651+0000","last_change":"2024-04-25T08:53:43.229049+0000","last_active":"2024-04-25T08:53:44.458651+0000","last_peered":"2024-04-25T08:53:44.458651+0000","last_clean":"2024-04-25T08:53:44.458651+0000","last_became_active":"2024-04-25T08:53:43.228659+0000","last_became_peered":"2024-04-25T08:53:43.228659+0000","last_unstale":"2024-04-25T08:53:44.458651+0000","last_undegraded":"2024-04-25T08:53:44.458651+0000","last_fullsized":"2024-04-25T08:53:44.458651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:59.064691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356524+0000","last_change":"2024-04-25T08:53:42.205092+0000","last_active":"2024-04-25T08:53:45.356524+0000","last_peered":"2024-04-25T08:53:45.356524+0000","last_clean":"2024-04-25T08:53:45.356524+0000","last_became_active":"2024-04-25T08:53:42.204784+0000","last_became_peered":"2024-04-25T08:53:42.204784+0000","last_unstale":"2024-04-25T08:53:45.356524+0000","last_undegraded":"2024-04-25T08:53:45.356524+0000","last_fullsized":"2024-04-25T08:53:45.356524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:17.160891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356056+0000","last_change":"2024-04-25T08:53:43.227057+0000","last_active":"2024-04-25T08:53:45.356056+0000","last_peered":"2024-04-25T08:53:45.356056+0000","last_clean":"2024-04-25T08:53:45.356056+0000","last_became_active":"2024-04-25T08:53:43.226484+0000","last_became_peered":"2024-04-25T08:53:43.226484+0000","last_unstale":"2024-04-25T08:53:45.356056+0000","last_undegraded":"2024-04-25T08:53:45.356056+0000","last_fullsized":"2024-04-25T08:53:45.356056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:35.064000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336568+0000","last_change":"2024-04-25T08:53:42.204014+0000","last_active":"2024-04-25T08:53:44.336568+0000","last_peered":"2024-04-25T08:53:44.336568+0000","last_clean":"2024-04-25T08:53:44.336568+0000","last_became_active":"2024-04-25T08:53:42.203751+0000","last_became_peered":"2024-04-25T08:53:42.203751+0000","last_unstale":"2024-04-25T08:53:44.336568+0000","last_undegraded":"2024-04-25T08:53:44.336568+0000","last_fullsized":"2024-04-25T08:53:44.336568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458574+0000","last_change":"2024-04-25T08:53:43.231009+0000","last_active":"2024-04-25T08:53:44.458574+0000","last_peered":"2024-04-25T08:53:44.458574+0000","last_clean":"2024-04-25T08:53:44.458574+0000","last_became_active":"2024-04-25T08:53:43.230705+0000","last_became_peered":"2024-04-25T08:53:43.230705+0000","last_unstale":"2024-04-25T08:53:44.458574+0000","last_undegraded":"2024-04-25T08:53:44.458574+0000","last_fullsized":"2024-04-25T08:53:44.458574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.213930+0000","last_change":"2024-04-25T08:53:42.205489+0000","last_active":"2024-04-25T08:53:44.213930+0000","last_peered":"2024-04-25T08:53:44.213930+0000","last_clean":"2024-04-25T08:53:44.213930+0000","last_became_active":"2024-04-25T08:53:42.204328+0000","last_became_peered":"2024-04-25T08:53:42.204328+0000","last_unstale":"2024-04-25T08:53:44.213930+0000","last_undegraded":"2024-04-25T08:53:44.213930+0000","last_fullsized":"2024-04-25T08:53:44.213930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214069+0000","last_change":"2024-04-25T08:53:43.225273+0000","last_active":"2024-04-25T08:53:44.214069+0000","last_peered":"2024-04-25T08:53:44.214069+0000","last_clean":"2024-04-25T08:53:44.214069+0000","last_became_active":"2024-04-25T08:53:43.225014+0000","last_became_peered":"2024-04-25T08:53:43.225014+0000","last_unstale":"2024-04-25T08:53:44.214069+0000","last_undegraded":"2024-04-25T08:53:44.214069+0000","last_fullsized":"2024-04-25T08:53:44.214069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.355754+0000","last_change":"2024-04-25T08:53:42.206147+0000","last_active":"2024-04-25T08:53:45.355754+0000","last_peered":"2024-04-25T08:53:45.355754+0000","last_clean":"2024-04-25T08:53:45.355754+0000","last_became_active":"2024-04-25T08:53:42.205676+0000","last_became_peered":"2024-04-25T08:53:42.205676+0000","last_unstale":"2024-04-25T08:53:45.355754+0000","last_undegraded":"2024-04-25T08:53:45.355754+0000","last_fullsized":"2024-04-25T08:53:45.355754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458337+0000","last_change":"2024-04-25T08:53:43.224941+0000","last_active":"2024-04-25T08:53:44.458337+0000","last_peered":"2024-04-25T08:53:44.458337+0000","last_clean":"2024-04-25T08:53:44.458337+0000","last_became_active":"2024-04-25T08:53:43.224690+0000","last_became_peered":"2024-04-25T08:53:43.224690+0000","last_unstale":"2024-04-25T08:53:44.458337+0000","last_undegraded":"2024-04-25T08:53:44.458337+0000","last_fullsized":"2024-04-25T08:53:44.458337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215685+0000","last_change":"2024-04-25T08:53:42.208945+0000","last_active":"2024-04-25T08:53:44.215685+0000","last_peered":"2024-04-25T08:53:44.215685+0000","last_clean":"2024-04-25T08:53:44.215685+0000","last_became_active":"2024-04-25T08:53:42.208669+0000","last_became_peered":"2024-04-25T08:53:42.208669+0000","last_unstale":"2024-04-25T08:53:44.215685+0000","last_undegraded":"2024-04-25T08:53:44.215685+0000","last_fullsized":"2024-04-25T08:53:44.215685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458850+0000","last_change":"2024-04-25T08:53:43.228967+0000","last_active":"2024-04-25T08:53:44.458850+0000","last_peered":"2024-04-25T08:53:44.458850+0000","last_clean":"2024-04-25T08:53:44.458850+0000","last_became_active":"2024-04-25T08:53:43.228689+0000","last_became_peered":"2024-04-25T08:53:43.228689+0000","last_unstale":"2024-04-25T08:53:44.458850+0000","last_undegraded":"2024-04-25T08:53:44.458850+0000","last_fullsized":"2024-04-25T08:53:44.458850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:15.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356577+0000","last_change":"2024-04-25T08:53:42.208039+0000","last_active":"2024-04-25T08:53:45.356577+0000","last_peered":"2024-04-25T08:53:45.356577+0000","last_clean":"2024-04-25T08:53:45.356577+0000","last_became_active":"2024-04-25T08:53:42.207680+0000","last_became_peered":"2024-04-25T08:53:42.207680+0000","last_unstale":"2024-04-25T08:53:45.356577+0000","last_undegraded":"2024-04-25T08:53:45.356577+0000","last_fullsized":"2024-04-25T08:53:45.356577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.459007+0000","last_change":"2024-04-25T08:53:43.230110+0000","last_active":"2024-04-25T08:53:44.459007+0000","last_peered":"2024-04-25T08:53:44.459007+0000","last_clean":"2024-04-25T08:53:44.459007+0000","last_became_active":"2024-04-25T08:53:43.229539+0000","last_became_peered":"2024-04-25T08:53:43.229539+0000","last_unstale":"2024-04-25T08:53:44.459007+0000","last_undegraded":"2024-04-25T08:53:44.459007+0000","last_fullsized":"2024-04-25T08:53:44.459007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214243+0000","last_change":"2024-04-25T08:53:42.202509+0000","last_active":"2024-04-25T08:53:45.214243+0000","last_peered":"2024-04-25T08:53:45.214243+0000","last_clean":"2024-04-25T08:53:45.214243+0000","last_became_active":"2024-04-25T08:53:42.202223+0000","last_became_peered":"2024-04-25T08:53:42.202223+0000","last_unstale":"2024-04-25T08:53:45.214243+0000","last_undegraded":"2024-04-25T08:53:45.214243+0000","last_fullsized":"2024-04-25T08:53:45.214243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:39.125739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336537+0000","last_change":"2024-04-25T08:53:43.227532+0000","last_active":"2024-04-25T08:53:44.336537+0000","last_peered":"2024-04-25T08:53:44.336537+0000","last_clean":"2024-04-25T08:53:44.336537+0000","last_became_active":"2024-04-25T08:53:43.227269+0000","last_became_peered":"2024-04-25T08:53:43.227269+0000","last_unstale":"2024-04-25T08:53:44.336537+0000","last_undegraded":"2024-04-25T08:53:44.336537+0000","last_fullsized":"2024-04-25T08:53:44.336537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:25.482497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356340+0000","last_change":"2024-04-25T08:53:42.210667+0000","last_active":"2024-04-25T08:53:45.356340+0000","last_peered":"2024-04-25T08:53:45.356340+0000","last_clean":"2024-04-25T08:53:45.356340+0000","last_became_active":"2024-04-25T08:53:42.210367+0000","last_became_peered":"2024-04-25T08:53:42.210367+0000","last_unstale":"2024-04-25T08:53:45.356340+0000","last_undegraded":"2024-04-25T08:53:45.356340+0000","last_fullsized":"2024-04-25T08:53:45.356340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:06.737038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458667+0000","last_change":"2024-04-25T08:53:43.223897+0000","last_active":"2024-04-25T08:53:44.458667+0000","last_peered":"2024-04-25T08:53:44.458667+0000","last_clean":"2024-04-25T08:53:44.458667+0000","last_became_active":"2024-04-25T08:53:43.223610+0000","last_became_peered":"2024-04-25T08:53:43.223610+0000","last_unstale":"2024-04-25T08:53:44.458667+0000","last_undegraded":"2024-04-25T08:53:44.458667+0000","last_fullsized":"2024-04-25T08:53:44.458667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:22.702870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458346+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:53:44.458346+0000","last_peered":"2024-04-25T08:53:44.458346+0000","last_clean":"2024-04-25T08:53:44.458346+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:53:44.458346+0000","last_undegraded":"2024-04-25T08:53:44.458346+0000","last_fullsized":"2024-04-25T08:53:44.458346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336073+0000","last_change":"2024-04-25T08:53:42.204756+0000","last_active":"2024-04-25T08:53:44.336073+0000","last_peered":"2024-04-25T08:53:44.336073+0000","last_clean":"2024-04-25T08:53:44.336073+0000","last_became_active":"2024-04-25T08:53:42.204433+0000","last_became_peered":"2024-04-25T08:53:42.204433+0000","last_unstale":"2024-04-25T08:53:44.336073+0000","last_undegraded":"2024-04-25T08:53:44.336073+0000","last_fullsized":"2024-04-25T08:53:44.336073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209533+0000","last_change":"2024-04-25T08:53:43.217690+0000","last_active":"2024-04-25T08:53:44.209533+0000","last_peered":"2024-04-25T08:53:44.209533+0000","last_clean":"2024-04-25T08:53:44.209533+0000","last_became_active":"2024-04-25T08:53:43.217338+0000","last_became_peered":"2024-04-25T08:53:43.217338+0000","last_unstale":"2024-04-25T08:53:44.209533+0000","last_undegraded":"2024-04-25T08:53:44.209533+0000","last_fullsized":"2024-04-25T08:53:44.209533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458262+0000","last_change":"2024-04-25T08:53:42.205644+0000","last_active":"2024-04-25T08:53:44.458262+0000","last_peered":"2024-04-25T08:53:44.458262+0000","last_clean":"2024-04-25T08:53:44.458262+0000","last_became_active":"2024-04-25T08:53:42.205370+0000","last_became_peered":"2024-04-25T08:53:42.205370+0000","last_unstale":"2024-04-25T08:53:44.458262+0000","last_undegraded":"2024-04-25T08:53:44.458262+0000","last_fullsized":"2024-04-25T08:53:44.458262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:29.564869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.355926+0000","last_change":"2024-04-25T08:53:43.223276+0000","last_active":"2024-04-25T08:53:45.355926+0000","last_peered":"2024-04-25T08:53:45.355926+0000","last_clean":"2024-04-25T08:53:45.355926+0000","last_became_active":"2024-04-25T08:53:43.222289+0000","last_became_peered":"2024-04-25T08:53:43.222289+0000","last_unstale":"2024-04-25T08:53:45.355926+0000","last_undegraded":"2024-04-25T08:53:45.355926+0000","last_fullsized":"2024-04-25T08:53:45.355926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:21.260139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356060+0000","last_change":"2024-04-25T08:53:42.208356+0000","last_active":"2024-04-25T08:53:45.356060+0000","last_peered":"2024-04-25T08:53:45.356060+0000","last_clean":"2024-04-25T08:53:45.356060+0000","last_became_active":"2024-04-25T08:53:42.207946+0000","last_became_peered":"2024-04-25T08:53:42.207946+0000","last_unstale":"2024-04-25T08:53:45.356060+0000","last_undegraded":"2024-04-25T08:53:45.356060+0000","last_fullsized":"2024-04-25T08:53:45.356060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214265+0000","last_change":"2024-04-25T08:53:43.212295+0000","last_active":"2024-04-25T08:53:45.214265+0000","last_peered":"2024-04-25T08:53:45.214265+0000","last_clean":"2024-04-25T08:53:45.214265+0000","last_became_active":"2024-04-25T08:53:43.211966+0000","last_became_peered":"2024-04-25T08:53:43.211966+0000","last_unstale":"2024-04-25T08:53:45.214265+0000","last_undegraded":"2024-04-25T08:53:45.214265+0000","last_fullsized":"2024-04-25T08:53:45.214265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:14.026600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336592+0000","last_change":"2024-04-25T08:53:42.200507+0000","last_active":"2024-04-25T08:53:44.336592+0000","last_peered":"2024-04-25T08:53:44.336592+0000","last_clean":"2024-04-25T08:53:44.336592+0000","last_became_active":"2024-04-25T08:53:42.200202+0000","last_became_peered":"2024-04-25T08:53:42.200202+0000","last_unstale":"2024-04-25T08:53:44.336592+0000","last_undegraded":"2024-04-25T08:53:44.336592+0000","last_fullsized":"2024-04-25T08:53:44.336592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215336+0000","last_change":"2024-04-25T08:53:43.223144+0000","last_active":"2024-04-25T08:53:44.215336+0000","last_peered":"2024-04-25T08:53:44.215336+0000","last_clean":"2024-04-25T08:53:44.215336+0000","last_became_active":"2024-04-25T08:53:43.222867+0000","last_became_peered":"2024-04-25T08:53:43.222867+0000","last_unstale":"2024-04-25T08:53:44.215336+0000","last_undegraded":"2024-04-25T08:53:44.215336+0000","last_fullsized":"2024-04-25T08:53:44.215336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:33.206100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214034+0000","last_change":"2024-04-25T08:53:42.209304+0000","last_active":"2024-04-25T08:53:45.214034+0000","last_peered":"2024-04-25T08:53:45.214034+0000","last_clean":"2024-04-25T08:53:45.214034+0000","last_became_active":"2024-04-25T08:53:42.209028+0000","last_became_peered":"2024-04-25T08:53:42.209028+0000","last_unstale":"2024-04-25T08:53:45.214034+0000","last_undegraded":"2024-04-25T08:53:45.214034+0000","last_fullsized":"2024-04-25T08:53:45.214034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:00.557461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336639+0000","last_change":"2024-04-25T08:53:43.224224+0000","last_active":"2024-04-25T08:53:44.336639+0000","last_peered":"2024-04-25T08:53:44.336639+0000","last_clean":"2024-04-25T08:53:44.336639+0000","last_became_active":"2024-04-25T08:53:43.223968+0000","last_became_peered":"2024-04-25T08:53:43.223968+0000","last_unstale":"2024-04-25T08:53:44.336639+0000","last_undegraded":"2024-04-25T08:53:44.336639+0000","last_fullsized":"2024-04-25T08:53:44.336639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458861+0000","last_change":"2024-04-25T08:53:42.212251+0000","last_active":"2024-04-25T08:53:44.458861+0000","last_peered":"2024-04-25T08:53:44.458861+0000","last_clean":"2024-04-25T08:53:44.458861+0000","last_became_active":"2024-04-25T08:53:42.212014+0000","last_became_peered":"2024-04-25T08:53:42.212014+0000","last_unstale":"2024-04-25T08:53:44.458861+0000","last_undegraded":"2024-04-25T08:53:44.458861+0000","last_fullsized":"2024-04-25T08:53:44.458861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214213+0000","last_change":"2024-04-25T08:53:43.211702+0000","last_active":"2024-04-25T08:53:45.214213+0000","last_peered":"2024-04-25T08:53:45.214213+0000","last_clean":"2024-04-25T08:53:45.214213+0000","last_became_active":"2024-04-25T08:53:43.211273+0000","last_became_peered":"2024-04-25T08:53:43.211273+0000","last_unstale":"2024-04-25T08:53:45.214213+0000","last_undegraded":"2024-04-25T08:53:45.214213+0000","last_fullsized":"2024-04-25T08:53:45.214213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:04.627746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214358+0000","last_change":"2024-04-25T08:53:42.205102+0000","last_active":"2024-04-25T08:53:45.214358+0000","last_peered":"2024-04-25T08:53:45.214358+0000","last_clean":"2024-04-25T08:53:45.214358+0000","last_became_active":"2024-04-25T08:53:42.204781+0000","last_became_peered":"2024-04-25T08:53:42.204781+0000","last_unstale":"2024-04-25T08:53:45.214358+0000","last_undegraded":"2024-04-25T08:53:45.214358+0000","last_fullsized":"2024-04-25T08:53:45.214358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:26.598180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209997+0000","last_change":"2024-04-25T08:53:43.222064+0000","last_active":"2024-04-25T08:53:44.209997+0000","last_peered":"2024-04-25T08:53:44.209997+0000","last_clean":"2024-04-25T08:53:44.209997+0000","last_became_active":"2024-04-25T08:53:43.220696+0000","last_became_peered":"2024-04-25T08:53:43.220696+0000","last_unstale":"2024-04-25T08:53:44.209997+0000","last_undegraded":"2024-04-25T08:53:44.209997+0000","last_fullsized":"2024-04-25T08:53:44.209997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214303+0000","last_change":"2024-04-25T08:53:42.203104+0000","last_active":"2024-04-25T08:53:44.214303+0000","last_peered":"2024-04-25T08:53:44.214303+0000","last_clean":"2024-04-25T08:53:44.214303+0000","last_became_active":"2024-04-25T08:53:42.202822+0000","last_became_peered":"2024-04-25T08:53:42.202822+0000","last_unstale":"2024-04-25T08:53:44.214303+0000","last_undegraded":"2024-04-25T08:53:44.214303+0000","last_fullsized":"2024-04-25T08:53:44.214303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356308+0000","last_change":"2024-04-25T08:53:43.214747+0000","last_active":"2024-04-25T08:53:45.356308+0000","last_peered":"2024-04-25T08:53:45.356308+0000","last_clean":"2024-04-25T08:53:45.356308+0000","last_became_active":"2024-04-25T08:53:43.214410+0000","last_became_peered":"2024-04-25T08:53:43.214410+0000","last_unstale":"2024-04-25T08:53:45.356308+0000","last_undegraded":"2024-04-25T08:53:45.356308+0000","last_fullsized":"2024-04-25T08:53:45.356308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458260+0000","last_change":"2024-04-25T08:53:42.212258+0000","last_active":"2024-04-25T08:53:44.458260+0000","last_peered":"2024-04-25T08:53:44.458260+0000","last_clean":"2024-04-25T08:53:44.458260+0000","last_became_active":"2024-04-25T08:53:42.212025+0000","last_became_peered":"2024-04-25T08:53:42.212025+0000","last_unstale":"2024-04-25T08:53:44.458260+0000","last_undegraded":"2024-04-25T08:53:44.458260+0000","last_fullsized":"2024-04-25T08:53:44.458260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:45.638730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215251+0000","last_change":"2024-04-25T08:53:43.216186+0000","last_active":"2024-04-25T08:53:44.215251+0000","last_peered":"2024-04-25T08:53:44.215251+0000","last_clean":"2024-04-25T08:53:44.215251+0000","last_became_active":"2024-04-25T08:53:43.215899+0000","last_became_peered":"2024-04-25T08:53:43.215899+0000","last_unstale":"2024-04-25T08:53:44.215251+0000","last_undegraded":"2024-04-25T08:53:44.215251+0000","last_fullsized":"2024-04-25T08:53:44.215251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:04.077055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214051+0000","last_change":"2024-04-25T08:53:42.201324+0000","last_active":"2024-04-25T08:53:45.214051+0000","last_peered":"2024-04-25T08:53:45.214051+0000","last_clean":"2024-04-25T08:53:45.214051+0000","last_became_active":"2024-04-25T08:53:42.201017+0000","last_became_peered":"2024-04-25T08:53:42.201017+0000","last_unstale":"2024-04-25T08:53:45.214051+0000","last_undegraded":"2024-04-25T08:53:45.214051+0000","last_fullsized":"2024-04-25T08:53:45.214051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:23.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209486+0000","last_change":"2024-04-25T08:53:43.217644+0000","last_active":"2024-04-25T08:53:44.209486+0000","last_peered":"2024-04-25T08:53:44.209486+0000","last_clean":"2024-04-25T08:53:44.209486+0000","last_became_active":"2024-04-25T08:53:43.217347+0000","last_became_peered":"2024-04-25T08:53:43.217347+0000","last_unstale":"2024-04-25T08:53:44.209486+0000","last_undegraded":"2024-04-25T08:53:44.209486+0000","last_fullsized":"2024-04-25T08:53:44.209486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214070+0000","last_change":"2024-04-25T08:53:42.207935+0000","last_active":"2024-04-25T08:53:45.214070+0000","last_peered":"2024-04-25T08:53:45.214070+0000","last_clean":"2024-04-25T08:53:45.214070+0000","last_became_active":"2024-04-25T08:53:42.207643+0000","last_became_peered":"2024-04-25T08:53:42.207643+0000","last_unstale":"2024-04-25T08:53:45.214070+0000","last_undegraded":"2024-04-25T08:53:45.214070+0000","last_fullsized":"2024-04-25T08:53:45.214070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:58.628169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209913+0000","last_change":"2024-04-25T08:53:43.215719+0000","last_active":"2024-04-25T08:53:44.209913+0000","last_peered":"2024-04-25T08:53:44.209913+0000","last_clean":"2024-04-25T08:53:44.209913+0000","last_became_active":"2024-04-25T08:53:43.215453+0000","last_became_peered":"2024-04-25T08:53:43.215453+0000","last_unstale":"2024-04-25T08:53:44.209913+0000","last_undegraded":"2024-04-25T08:53:44.209913+0000","last_fullsized":"2024-04-25T08:53:44.209913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458715+0000","last_change":"2024-04-25T08:53:42.207288+0000","last_active":"2024-04-25T08:53:44.458715+0000","last_peered":"2024-04-25T08:53:44.458715+0000","last_clean":"2024-04-25T08:53:44.458715+0000","last_became_active":"2024-04-25T08:53:42.207012+0000","last_became_peered":"2024-04-25T08:53:42.207012+0000","last_unstale":"2024-04-25T08:53:44.458715+0000","last_undegraded":"2024-04-25T08:53:44.458715+0000","last_fullsized":"2024-04-25T08:53:44.458715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214055+0000","last_change":"2024-04-25T08:53:43.209633+0000","last_active":"2024-04-25T08:53:44.214055+0000","last_peered":"2024-04-25T08:53:44.214055+0000","last_clean":"2024-04-25T08:53:44.214055+0000","last_became_active":"2024-04-25T08:53:43.209378+0000","last_became_peered":"2024-04-25T08:53:43.209378+0000","last_unstale":"2024-04-25T08:53:44.214055+0000","last_undegraded":"2024-04-25T08:53:44.214055+0000","last_fullsized":"2024-04-25T08:53:44.214055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336439+0000","last_change":"2024-04-25T08:53:43.220635+0000","last_active":"2024-04-25T08:53:44.336439+0000","last_peered":"2024-04-25T08:53:44.336439+0000","last_clean":"2024-04-25T08:53:44.336439+0000","last_became_active":"2024-04-25T08:53:43.220373+0000","last_became_peered":"2024-04-25T08:53:43.220373+0000","last_unstale":"2024-04-25T08:53:44.336439+0000","last_undegraded":"2024-04-25T08:53:44.336439+0000","last_fullsized":"2024-04-25T08:53:44.336439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458542+0000","last_change":"2024-04-25T08:53:42.207788+0000","last_active":"2024-04-25T08:53:44.458542+0000","last_peered":"2024-04-25T08:53:44.458542+0000","last_clean":"2024-04-25T08:53:44.458542+0000","last_became_active":"2024-04-25T08:53:42.207521+0000","last_became_peered":"2024-04-25T08:53:42.207521+0000","last_unstale":"2024-04-25T08:53:44.458542+0000","last_undegraded":"2024-04-25T08:53:44.458542+0000","last_fullsized":"2024-04-25T08:53:44.458542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336474+0000","last_change":"2024-04-25T08:53:43.219991+0000","last_active":"2024-04-25T08:53:44.336474+0000","last_peered":"2024-04-25T08:53:44.336474+0000","last_clean":"2024-04-25T08:53:44.336474+0000","last_became_active":"2024-04-25T08:53:43.219715+0000","last_became_peered":"2024-04-25T08:53:43.219715+0000","last_unstale":"2024-04-25T08:53:44.336474+0000","last_undegraded":"2024-04-25T08:53:44.336474+0000","last_fullsized":"2024-04-25T08:53:44.336474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:15.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458764+0000","last_change":"2024-04-25T08:53:42.206350+0000","last_active":"2024-04-25T08:53:44.458764+0000","last_peered":"2024-04-25T08:53:44.458764+0000","last_clean":"2024-04-25T08:53:44.458764+0000","last_became_active":"2024-04-25T08:53:42.206045+0000","last_became_peered":"2024-04-25T08:53:42.206045+0000","last_unstale":"2024-04-25T08:53:44.458764+0000","last_undegraded":"2024-04-25T08:53:44.458764+0000","last_fullsized":"2024-04-25T08:53:44.458764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356482+0000","last_change":"2024-04-25T08:53:43.225375+0000","last_active":"2024-04-25T08:53:45.356482+0000","last_peered":"2024-04-25T08:53:45.356482+0000","last_clean":"2024-04-25T08:53:45.356482+0000","last_became_active":"2024-04-25T08:53:43.225062+0000","last_became_peered":"2024-04-25T08:53:43.225062+0000","last_unstale":"2024-04-25T08:53:45.356482+0000","last_undegraded":"2024-04-25T08:53:45.356482+0000","last_fullsized":"2024-04-25T08:53:45.356482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209778+0000","last_change":"2024-04-25T08:53:42.209070+0000","last_active":"2024-04-25T08:53:44.209778+0000","last_peered":"2024-04-25T08:53:44.209778+0000","last_clean":"2024-04-25T08:53:44.209778+0000","last_became_active":"2024-04-25T08:53:42.208670+0000","last_became_peered":"2024-04-25T08:53:42.208670+0000","last_unstale":"2024-04-25T08:53:44.209778+0000","last_undegraded":"2024-04-25T08:53:44.209778+0000","last_fullsized":"2024-04-25T08:53:44.209778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:06.737038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.210018+0000","last_change":"2024-04-25T08:53:43.224397+0000","last_active":"2024-04-25T08:53:44.210018+0000","last_peered":"2024-04-25T08:53:44.210018+0000","last_clean":"2024-04-25T08:53:44.210018+0000","last_became_active":"2024-04-25T08:53:43.224037+0000","last_became_peered":"2024-04-25T08:53:43.224037+0000","last_unstale":"2024-04-25T08:53:44.210018+0000","last_undegraded":"2024-04-25T08:53:44.210018+0000","last_fullsized":"2024-04-25T08:53:44.210018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356649+0000","last_change":"2024-04-25T08:53:42.209220+0000","last_active":"2024-04-25T08:53:45.356649+0000","last_peered":"2024-04-25T08:53:45.356649+0000","last_clean":"2024-04-25T08:53:45.356649+0000","last_became_active":"2024-04-25T08:53:42.208936+0000","last_became_peered":"2024-04-25T08:53:42.208936+0000","last_unstale":"2024-04-25T08:53:45.356649+0000","last_undegraded":"2024-04-25T08:53:45.356649+0000","last_fullsized":"2024-04-25T08:53:45.356649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:51.480879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:53:55.057 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:53:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.206+0000 7f981aab3640 1 Processor -- start 2024-04-25T08:53:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.206+0000 7f981aab3640 1 -- start start 2024-04-25T08:53:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.207+0000 7f981aab3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f981415dce0 0x7f98140d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.207+0000 7f981aab3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f98140b5b60 0x7f98140b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.207+0000 7f981aab3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981415e0c0 con 0x7f98140d35b0 2024-04-25T08:53:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.207+0000 7f981aab3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140d2510 con 0x7f981415dce0 2024-04-25T08:53:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.207+0000 7f981aab3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140d27f0 con 0x7f98140b5b60 2024-04-25T08:53:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.207+0000 7f981884f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f981415dce0 0x7f98140d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.207+0000 7f9813fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f98140d35b0 0x7f98140b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56966/0 (socket says 172.21.15.55:56966) 2024-04-25T08:53:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.207+0000 7f981884f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f981415dce0 0x7f98140d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48282/0 (socket says 172.21.15.55:48282) 2024-04-25T08:53:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.207+0000 7f9813fff640 1 -- 172.21.15.55:0/882146902 learned_addr learned my addr 172.21.15.55:0/882146902 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.207+0000 7f9819050640 1 --2- 172.21.15.55:0/882146902 >> v2:172.21.15.167:3300/0 conn(0x7f98140b5b60 0x7f98140b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.208+0000 7f981884f640 1 -- 172.21.15.55:0/882146902 >> v2:172.21.15.167:3300/0 conn(0x7f98140b5b60 msgr2=0x7f98140b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.208+0000 7f981884f640 1 --2- 172.21.15.55:0/882146902 >> v2:172.21.15.167:3300/0 conn(0x7f98140b5b60 0x7f98140b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.208+0000 7f981884f640 1 -- 172.21.15.55:0/882146902 >> v1:172.21.15.55:6789/0 conn(0x7f98140d35b0 legacy=0x7f98140b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.208+0000 7f98137fe640 1 -- 172.21.15.55:0/882146902 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353295018 0 0) 0x7f981415e0c0 con 0x7f98140d35b0 2024-04-25T08:53:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.208+0000 7f981884f640 1 -- 172.21.15.55:0/882146902 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140d2ad0 con 0x7f981415dce0 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.208+0000 7f981884f640 1 --2- 172.21.15.55:0/882146902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415dce0 0x7f98140d1a50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f98140b3390 tx=0x7f980c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df132ca24b6583c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.208+0000 7f98137fe640 1 -- 172.21.15.55:0/882146902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c037070 con 0x7f981415dce0 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.209+0000 7f98137fe640 1 -- 172.21.15.55:0/882146902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c032440 con 0x7f981415dce0 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.209+0000 7f98137fe640 1 -- 172.21.15.55:0/882146902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c032810 con 0x7f981415dce0 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.209+0000 7f981aab3640 1 -- 172.21.15.55:0/882146902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415dce0 msgr2=0x7f98140d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.209+0000 7f981aab3640 1 --2- 172.21.15.55:0/882146902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415dce0 0x7f98140d1a50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f98140b3390 tx=0x7f980c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.209+0000 7f981aab3640 1 -- 172.21.15.55:0/882146902 shutdown_connections 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.209+0000 7f981aab3640 1 --2- 172.21.15.55:0/882146902 >> v2:172.21.15.167:3300/0 conn(0x7f98140b5b60 0x7f98140b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.209+0000 7f981aab3640 1 --2- 172.21.15.55:0/882146902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415dce0 0x7f98140d1a50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.209+0000 7f981aab3640 1 -- 172.21.15.55:0/882146902 >> 172.21.15.55:0/882146902 conn(0x7f9814072900 msgr2=0x7f98140d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.209+0000 7f981aab3640 1 -- 172.21.15.55:0/882146902 shutdown_connections 2024-04-25T08:53:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.209+0000 7f981aab3640 1 -- 172.21.15.55:0/882146902 wait complete. 2024-04-25T08:53:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.210+0000 7f981aab3640 1 Processor -- start 2024-04-25T08:53:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.210+0000 7f981aab3640 1 -- start start 2024-04-25T08:53:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.211+0000 7f981aab3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98140b5b60 0x7f9814151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.211+0000 7f981aab3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98140d35b0 0x7f98140b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.211+0000 7f981aab3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f981415dce0 0x7f98140b8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.211+0000 7f981aab3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98140b9820 con 0x7f98140b5b60 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.211+0000 7f981aab3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98140d3090 con 0x7f98140d35b0 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.211+0000 7f981aab3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98140b99a0 con 0x7f981415dce0 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.211+0000 7f981884f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98140b5b60 0x7f9814151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.211+0000 7f981884f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98140b5b60 0x7f9814151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48288/0 (socket says 172.21.15.55:48288) 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.211+0000 7f981884f640 1 -- 172.21.15.55:0/3431356225 learned_addr learned my addr 172.21.15.55:0/3431356225 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.211+0000 7f9813fff640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98140d35b0 0x7f98140b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.211+0000 7f9819050640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f981415dce0 0x7f98140b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.212+0000 7f981884f640 1 -- 172.21.15.55:0/3431356225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f981415dce0 msgr2=0x7f98140b8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.212+0000 7f981884f640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f981415dce0 0x7f98140b8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.212+0000 7f981884f640 1 -- 172.21.15.55:0/3431356225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98140d35b0 msgr2=0x7f98140b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.212+0000 7f981884f640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98140d35b0 0x7f98140b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.212+0000 7f981884f640 1 -- 172.21.15.55:0/3431356225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98141f4490 con 0x7f98140b5b60 2024-04-25T08:53:55.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.212+0000 7f981884f640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98140b5b60 0x7f9814151790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f980c000c00 tx=0x7f980c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:55.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.212+0000 7f98117fa640 1 -- 172.21.15.55:0/3431356225 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c037040 con 0x7f98140b5b60 2024-04-25T08:53:55.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.212+0000 7f98117fa640 1 -- 172.21.15.55:0/3431356225 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c042070 con 0x7f98140b5b60 2024-04-25T08:53:55.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.212+0000 7f981aab3640 1 -- 172.21.15.55:0/3431356225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98141f36d0 con 0x7f98140b5b60 2024-04-25T08:53:55.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.212+0000 7f98117fa640 1 -- 172.21.15.55:0/3431356225 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c030920 con 0x7f98140b5b60 2024-04-25T08:53:55.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.212+0000 7f981aab3640 1 -- 172.21.15.55:0/3431356225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98141f3c90 con 0x7f98140b5b60 2024-04-25T08:53:55.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.213+0000 7f981aab3640 1 -- 172.21.15.55:0/3431356225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98140749b0 con 0x7f98140b5b60 2024-04-25T08:53:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.213+0000 7f98117fa640 1 -- 172.21.15.55:0/3431356225 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f980c030ac0 con 0x7f98140b5b60 2024-04-25T08:53:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.214+0000 7f98117fa640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f97f406b4d0 0x7f97f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.214+0000 7f98117fa640 1 -- 172.21.15.55:0/3431356225 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f980c0aaa30 con 0x7f98140b5b60 2024-04-25T08:53:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.214+0000 7f9813fff640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f97f406b4d0 0x7f97f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.214+0000 7f9813fff640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f97f406b4d0 0x7f97f406d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98140cef90 tx=0x7f9804001700 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:55.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.218+0000 7f98117fa640 1 -- 172.21.15.55:0/3431356225 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f980c079940 con 0x7f98140b5b60 2024-04-25T08:53:55.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.397+0000 7f981aab3640 1 -- 172.21.15.55:0/3431356225 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98140cf000 con 0x7f97f406b4d0 2024-04-25T08:53:55.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.403+0000 7f98117fa640 1 -- 172.21.15.55:0/3431356225 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251837 (secure 0 0 0) 0x7f98140cf000 con 0x7f97f406b4d0 2024-04-25T08:53:55.396 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:55.397 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:53:55.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 -- 172.21.15.55:0/3431356225 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f97f406b4d0 msgr2=0x7f97f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f97f406b4d0 0x7f97f406d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98140cef90 tx=0x7f9804001700 comp rx=0 tx=0).stop 2024-04-25T08:53:55.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 -- 172.21.15.55:0/3431356225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98140b5b60 msgr2=0x7f9814151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98140b5b60 0x7f9814151790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f980c000c00 tx=0x7f980c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 -- 172.21.15.55:0/3431356225 shutdown_connections 2024-04-25T08:53:55.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f97f406b4d0 0x7f97f406d990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f981415dce0 0x7f98140b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98140d35b0 0x7f98140b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 --2- 172.21.15.55:0/3431356225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98140b5b60 0x7f9814151790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 -- 172.21.15.55:0/3431356225 >> 172.21.15.55:0/3431356225 conn(0x7f9814072900 msgr2=0x7f98140b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:55.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 -- 172.21.15.55:0/3431356225 shutdown_connections 2024-04-25T08:53:55.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.406+0000 7f981aab3640 1 -- 172.21.15.55:0/3431356225 wait complete. 2024-04-25T08:53:55.408 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-25T08:53:54.554431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235868,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738852,"statfs":{"total":773094113280,"available":772852584448,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.346683"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458904+0000","last_change":"2024-04-25T08:53:43.226040+0000","last_active":"2024-04-25T08:53:44.458904+0000","last_peered":"2024-04-25T08:53:44.458904+0000","last_clean":"2024-04-25T08:53:44.458904+0000","last_became_active":"2024-04-25T08:53:43.225773+0000","last_became_peered":"2024-04-25T08:53:43.225773+0000","last_unstale":"2024-04-25T08:53:44.458904+0000","last_undegraded":"2024-04-25T08:53:44.458904+0000","last_fullsized":"2024-04-25T08:53:44.458904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:25.482497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214380+0000","last_change":"2024-04-25T08:53:43.213215+0000","last_active":"2024-04-25T08:53:45.214380+0000","last_peered":"2024-04-25T08:53:45.214380+0000","last_clean":"2024-04-25T08:53:45.214380+0000","last_became_active":"2024-04-25T08:53:43.212906+0000","last_became_peered":"2024-04-25T08:53:43.212906+0000","last_unstale":"2024-04-25T08:53:45.214380+0000","last_undegraded":"2024-04-25T08:53:45.214380+0000","last_fullsized":"2024-04-25T08:53:45.214380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:49.492910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356331+0000","last_change":"2024-04-25T08:53:43.222988+0000","last_active":"2024-04-25T08:53:45.356331+0000","last_peered":"2024-04-25T08:53:45.356331+0000","last_clean":"2024-04-25T08:53:45.356331+0000","last_became_active":"2024-04-25T08:53:43.222683+0000","last_became_peered":"2024-04-25T08:53:43.222683+0000","last_unstale":"2024-04-25T08:53:45.356331+0000","last_undegraded":"2024-04-25T08:53:45.356331+0000","last_fullsized":"2024-04-25T08:53:45.356331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336369+0000","last_change":"2024-04-25T08:53:43.227764+0000","last_active":"2024-04-25T08:53:44.336369+0000","last_peered":"2024-04-25T08:53:44.336369+0000","last_clean":"2024-04-25T08:53:44.336369+0000","last_became_active":"2024-04-25T08:53:43.227462+0000","last_became_peered":"2024-04-25T08:53:43.227462+0000","last_unstale":"2024-04-25T08:53:44.336369+0000","last_undegraded":"2024-04-25T08:53:44.336369+0000","last_fullsized":"2024-04-25T08:53:44.336369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458562+0000","last_change":"2024-04-25T08:53:43.222336+0000","last_active":"2024-04-25T08:53:44.458562+0000","last_peered":"2024-04-25T08:53:44.458562+0000","last_clean":"2024-04-25T08:53:44.458562+0000","last_became_active":"2024-04-25T08:53:43.222046+0000","last_became_peered":"2024-04-25T08:53:43.222046+0000","last_unstale":"2024-04-25T08:53:44.458562+0000","last_undegraded":"2024-04-25T08:53:44.458562+0000","last_fullsized":"2024-04-25T08:53:44.458562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336385+0000","last_change":"2024-04-25T08:53:43.226820+0000","last_active":"2024-04-25T08:53:44.336385+0000","last_peered":"2024-04-25T08:53:44.336385+0000","last_clean":"2024-04-25T08:53:44.336385+0000","last_became_active":"2024-04-25T08:53:43.226533+0000","last_became_peered":"2024-04-25T08:53:43.226533+0000","last_unstale":"2024-04-25T08:53:44.336385+0000","last_undegraded":"2024-04-25T08:53:44.336385+0000","last_fullsized":"2024-04-25T08:53:44.336385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:59.064691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458308+0000","last_change":"2024-04-25T08:53:43.226661+0000","last_active":"2024-04-25T08:53:44.458308+0000","last_peered":"2024-04-25T08:53:44.458308+0000","last_clean":"2024-04-25T08:53:44.458308+0000","last_became_active":"2024-04-25T08:53:43.226353+0000","last_became_peered":"2024-04-25T08:53:43.226353+0000","last_unstale":"2024-04-25T08:53:44.458308+0000","last_undegraded":"2024-04-25T08:53:44.458308+0000","last_fullsized":"2024-04-25T08:53:44.458308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209304+0000","last_change":"2024-04-25T08:53:43.217719+0000","last_active":"2024-04-25T08:53:44.209304+0000","last_peered":"2024-04-25T08:53:44.209304+0000","last_clean":"2024-04-25T08:53:44.209304+0000","last_became_active":"2024-04-25T08:53:43.217440+0000","last_became_peered":"2024-04-25T08:53:43.217440+0000","last_unstale":"2024-04-25T08:53:44.209304+0000","last_undegraded":"2024-04-25T08:53:44.209304+0000","last_fullsized":"2024-04-25T08:53:44.209304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458926+0000","last_change":"2024-04-25T08:53:43.219775+0000","last_active":"2024-04-25T08:53:44.458926+0000","last_peered":"2024-04-25T08:53:44.458926+0000","last_clean":"2024-04-25T08:53:44.458926+0000","last_became_active":"2024-04-25T08:53:43.219463+0000","last_became_peered":"2024-04-25T08:53:43.219463+0000","last_unstale":"2024-04-25T08:53:44.458926+0000","last_undegraded":"2024-04-25T08:53:44.458926+0000","last_fullsized":"2024-04-25T08:53:44.458926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.064857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214552+0000","last_change":"2024-04-25T08:53:43.216899+0000","last_active":"2024-04-25T08:53:44.214552+0000","last_peered":"2024-04-25T08:53:44.214552+0000","last_clean":"2024-04-25T08:53:44.214552+0000","last_became_active":"2024-04-25T08:53:43.216571+0000","last_became_peered":"2024-04-25T08:53:43.216571+0000","last_unstale":"2024-04-25T08:53:44.214552+0000","last_undegraded":"2024-04-25T08:53:44.214552+0000","last_fullsized":"2024-04-25T08:53:44.214552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214373+0000","last_change":"2024-04-25T08:53:43.220978+0000","last_active":"2024-04-25T08:53:44.214373+0000","last_peered":"2024-04-25T08:53:44.214373+0000","last_clean":"2024-04-25T08:53:44.214373+0000","last_became_active":"2024-04-25T08:53:43.219635+0000","last_became_peered":"2024-04-25T08:53:43.219635+0000","last_unstale":"2024-04-25T08:53:44.214373+0000","last_undegraded":"2024-04-25T08:53:44.214373+0000","last_fullsized":"2024-04-25T08:53:44.214373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215612+0000","last_change":"2024-04-25T08:53:43.224429+0000","last_active":"2024-04-25T08:53:44.215612+0000","last_peered":"2024-04-25T08:53:44.215612+0000","last_clean":"2024-04-25T08:53:44.215612+0000","last_became_active":"2024-04-25T08:53:43.224174+0000","last_became_peered":"2024-04-25T08:53:43.224174+0000","last_unstale":"2024-04-25T08:53:44.215612+0000","last_undegraded":"2024-04-25T08:53:44.215612+0000","last_fullsized":"2024-04-25T08:53:44.215612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:46.648651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209560+0000","last_change":"2024-04-25T08:53:43.216375+0000","last_active":"2024-04-25T08:53:44.209560+0000","last_peered":"2024-04-25T08:53:44.209560+0000","last_clean":"2024-04-25T08:53:44.209560+0000","last_became_active":"2024-04-25T08:53:43.216099+0000","last_became_peered":"2024-04-25T08:53:43.216099+0000","last_unstale":"2024-04-25T08:53:44.209560+0000","last_undegraded":"2024-04-25T08:53:44.209560+0000","last_fullsized":"2024-04-25T08:53:44.209560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356516+0000","last_change":"2024-04-25T08:53:43.223032+0000","last_active":"2024-04-25T08:53:45.356516+0000","last_peered":"2024-04-25T08:53:45.356516+0000","last_clean":"2024-04-25T08:53:45.356516+0000","last_became_active":"2024-04-25T08:53:43.222624+0000","last_became_peered":"2024-04-25T08:53:43.222624+0000","last_unstale":"2024-04-25T08:53:45.356516+0000","last_undegraded":"2024-04-25T08:53:45.356516+0000","last_fullsized":"2024-04-25T08:53:45.356516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214028+0000","last_change":"2024-04-25T08:53:43.210727+0000","last_active":"2024-04-25T08:53:45.214028+0000","last_peered":"2024-04-25T08:53:45.214028+0000","last_clean":"2024-04-25T08:53:45.214028+0000","last_became_active":"2024-04-25T08:53:43.208919+0000","last_became_peered":"2024-04-25T08:53:43.208919+0000","last_unstale":"2024-04-25T08:53:45.214028+0000","last_undegraded":"2024-04-25T08:53:45.214028+0000","last_fullsized":"2024-04-25T08:53:45.214028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:34.911186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.335931+0000","last_change":"2024-04-25T08:53:43.228001+0000","last_active":"2024-04-25T08:53:44.335931+0000","last_peered":"2024-04-25T08:53:44.335931+0000","last_clean":"2024-04-25T08:53:44.335931+0000","last_became_active":"2024-04-25T08:53:43.227703+0000","last_became_peered":"2024-04-25T08:53:43.227703+0000","last_unstale":"2024-04-25T08:53:44.335931+0000","last_undegraded":"2024-04-25T08:53:44.335931+0000","last_fullsized":"2024-04-25T08:53:44.335931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336584+0000","last_change":"2024-04-25T08:53:43.226726+0000","last_active":"2024-04-25T08:53:44.336584+0000","last_peered":"2024-04-25T08:53:44.336584+0000","last_clean":"2024-04-25T08:53:44.336584+0000","last_became_active":"2024-04-25T08:53:43.226448+0000","last_became_peered":"2024-04-25T08:53:43.226448+0000","last_unstale":"2024-04-25T08:53:44.336584+0000","last_undegraded":"2024-04-25T08:53:44.336584+0000","last_fullsized":"2024-04-25T08:53:44.336584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:51.064857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356481+0000","last_change":"2024-04-25T08:53:43.216437+0000","last_active":"2024-04-25T08:53:45.356481+0000","last_peered":"2024-04-25T08:53:45.356481+0000","last_clean":"2024-04-25T08:53:45.356481+0000","last_became_active":"2024-04-25T08:53:43.216118+0000","last_became_peered":"2024-04-25T08:53:43.216118+0000","last_unstale":"2024-04-25T08:53:45.356481+0000","last_undegraded":"2024-04-25T08:53:45.356481+0000","last_fullsized":"2024-04-25T08:53:45.356481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:30.574790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458878+0000","last_change":"2024-04-25T08:53:43.222245+0000","last_active":"2024-04-25T08:53:44.458878+0000","last_peered":"2024-04-25T08:53:44.458878+0000","last_clean":"2024-04-25T08:53:44.458878+0000","last_became_active":"2024-04-25T08:53:43.221954+0000","last_became_peered":"2024-04-25T08:53:43.221954+0000","last_unstale":"2024-04-25T08:53:44.458878+0000","last_undegraded":"2024-04-25T08:53:44.458878+0000","last_fullsized":"2024-04-25T08:53:44.458878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:46.272432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214280+0000","last_change":"2024-04-25T08:53:43.208966+0000","last_active":"2024-04-25T08:53:44.214280+0000","last_peered":"2024-04-25T08:53:44.214280+0000","last_clean":"2024-04-25T08:53:44.214280+0000","last_became_active":"2024-04-25T08:53:43.208694+0000","last_became_peered":"2024-04-25T08:53:43.208694+0000","last_unstale":"2024-04-25T08:53:44.214280+0000","last_undegraded":"2024-04-25T08:53:44.214280+0000","last_fullsized":"2024-04-25T08:53:44.214280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356228+0000","last_change":"2024-04-25T08:53:43.227774+0000","last_active":"2024-04-25T08:53:45.356228+0000","last_peered":"2024-04-25T08:53:45.356228+0000","last_clean":"2024-04-25T08:53:45.356228+0000","last_became_active":"2024-04-25T08:53:43.227471+0000","last_became_peered":"2024-04-25T08:53:43.227471+0000","last_unstale":"2024-04-25T08:53:45.356228+0000","last_undegraded":"2024-04-25T08:53:45.356228+0000","last_fullsized":"2024-04-25T08:53:45.356228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:28.340979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336129+0000","last_change":"2024-04-25T08:53:43.225757+0000","last_active":"2024-04-25T08:53:44.336129+0000","last_peered":"2024-04-25T08:53:44.336129+0000","last_clean":"2024-04-25T08:53:44.336129+0000","last_became_active":"2024-04-25T08:53:43.225482+0000","last_became_peered":"2024-04-25T08:53:43.225482+0000","last_unstale":"2024-04-25T08:53:44.336129+0000","last_undegraded":"2024-04-25T08:53:44.336129+0000","last_fullsized":"2024-04-25T08:53:44.336129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209673+0000","last_change":"2024-04-25T08:53:43.213773+0000","last_active":"2024-04-25T08:53:44.209673+0000","last_peered":"2024-04-25T08:53:44.209673+0000","last_clean":"2024-04-25T08:53:44.209673+0000","last_became_active":"2024-04-25T08:53:43.211924+0000","last_became_peered":"2024-04-25T08:53:43.211924+0000","last_unstale":"2024-04-25T08:53:44.209673+0000","last_undegraded":"2024-04-25T08:53:44.209673+0000","last_fullsized":"2024-04-25T08:53:44.209673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:58.506177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336156+0000","last_change":"2024-04-25T08:53:43.221087+0000","last_active":"2024-04-25T08:53:44.336156+0000","last_peered":"2024-04-25T08:53:44.336156+0000","last_clean":"2024-04-25T08:53:44.336156+0000","last_became_active":"2024-04-25T08:53:43.219503+0000","last_became_peered":"2024-04-25T08:53:43.219503+0000","last_unstale":"2024-04-25T08:53:44.336156+0000","last_undegraded":"2024-04-25T08:53:44.336156+0000","last_fullsized":"2024-04-25T08:53:44.336156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209695+0000","last_change":"2024-04-25T08:53:43.215393+0000","last_active":"2024-04-25T08:53:44.209695+0000","last_peered":"2024-04-25T08:53:44.209695+0000","last_clean":"2024-04-25T08:53:44.209695+0000","last_became_active":"2024-04-25T08:53:43.214671+0000","last_became_peered":"2024-04-25T08:53:43.214671+0000","last_unstale":"2024-04-25T08:53:44.209695+0000","last_undegraded":"2024-04-25T08:53:44.209695+0000","last_fullsized":"2024-04-25T08:53:44.209695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214588+0000","last_change":"2024-04-25T08:53:43.218493+0000","last_active":"2024-04-25T08:53:44.214588+0000","last_peered":"2024-04-25T08:53:44.214588+0000","last_clean":"2024-04-25T08:53:44.214588+0000","last_became_active":"2024-04-25T08:53:43.218199+0000","last_became_peered":"2024-04-25T08:53:43.218199+0000","last_unstale":"2024-04-25T08:53:44.214588+0000","last_undegraded":"2024-04-25T08:53:44.214588+0000","last_fullsized":"2024-04-25T08:53:44.214588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214156+0000","last_change":"2024-04-25T08:53:43.218908+0000","last_active":"2024-04-25T08:53:45.214156+0000","last_peered":"2024-04-25T08:53:45.214156+0000","last_clean":"2024-04-25T08:53:45.214156+0000","last_became_active":"2024-04-25T08:53:43.218580+0000","last_became_peered":"2024-04-25T08:53:43.218580+0000","last_unstale":"2024-04-25T08:53:45.214156+0000","last_undegraded":"2024-04-25T08:53:45.214156+0000","last_fullsized":"2024-04-25T08:53:45.214156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:13.572873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209813+0000","last_change":"2024-04-25T08:53:43.214059+0000","last_active":"2024-04-25T08:53:44.209813+0000","last_peered":"2024-04-25T08:53:44.209813+0000","last_clean":"2024-04-25T08:53:44.209813+0000","last_became_active":"2024-04-25T08:53:43.211412+0000","last_became_peered":"2024-04-25T08:53:43.211412+0000","last_unstale":"2024-04-25T08:53:44.209813+0000","last_undegraded":"2024-04-25T08:53:44.209813+0000","last_fullsized":"2024-04-25T08:53:44.209813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:04.311915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356366+0000","last_change":"2024-04-25T08:53:43.224899+0000","last_active":"2024-04-25T08:53:45.356366+0000","last_peered":"2024-04-25T08:53:45.356366+0000","last_clean":"2024-04-25T08:53:45.356366+0000","last_became_active":"2024-04-25T08:53:43.224532+0000","last_became_peered":"2024-04-25T08:53:43.224532+0000","last_unstale":"2024-04-25T08:53:45.356366+0000","last_undegraded":"2024-04-25T08:53:45.356366+0000","last_fullsized":"2024-04-25T08:53:45.356366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336482+0000","last_change":"2024-04-25T08:53:43.225133+0000","last_active":"2024-04-25T08:53:44.336482+0000","last_peered":"2024-04-25T08:53:44.336482+0000","last_clean":"2024-04-25T08:53:44.336482+0000","last_became_active":"2024-04-25T08:53:43.224687+0000","last_became_peered":"2024-04-25T08:53:43.224687+0000","last_unstale":"2024-04-25T08:53:44.336482+0000","last_undegraded":"2024-04-25T08:53:44.336482+0000","last_fullsized":"2024-04-25T08:53:44.336482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:46.272432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356080+0000","last_change":"2024-04-25T08:53:43.215307+0000","last_active":"2024-04-25T08:53:45.356080+0000","last_peered":"2024-04-25T08:53:45.356080+0000","last_clean":"2024-04-25T08:53:45.356080+0000","last_became_active":"2024-04-25T08:53:43.215014+0000","last_became_peered":"2024-04-25T08:53:43.215014+0000","last_unstale":"2024-04-25T08:53:45.356080+0000","last_undegraded":"2024-04-25T08:53:45.356080+0000","last_fullsized":"2024-04-25T08:53:45.356080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:46.648651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214040+0000","last_change":"2024-04-25T08:53:43.226428+0000","last_active":"2024-04-25T08:53:44.214040+0000","last_peered":"2024-04-25T08:53:44.214040+0000","last_clean":"2024-04-25T08:53:44.214040+0000","last_became_active":"2024-04-25T08:53:43.225678+0000","last_became_peered":"2024-04-25T08:53:43.225678+0000","last_unstale":"2024-04-25T08:53:44.214040+0000","last_undegraded":"2024-04-25T08:53:44.214040+0000","last_fullsized":"2024-04-25T08:53:44.214040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215161+0000","last_change":"2024-04-25T08:53:43.210436+0000","last_active":"2024-04-25T08:53:44.215161+0000","last_peered":"2024-04-25T08:53:44.215161+0000","last_clean":"2024-04-25T08:53:44.215161+0000","last_became_active":"2024-04-25T08:53:43.210150+0000","last_became_peered":"2024-04-25T08:53:43.210150+0000","last_unstale":"2024-04-25T08:53:44.215161+0000","last_undegraded":"2024-04-25T08:53:44.215161+0000","last_fullsized":"2024-04-25T08:53:44.215161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:36.391147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209779+0000","last_change":"2024-04-25T08:53:42.207162+0000","last_active":"2024-04-25T08:53:44.209779+0000","last_peered":"2024-04-25T08:53:44.209779+0000","last_clean":"2024-04-25T08:53:44.209779+0000","last_became_active":"2024-04-25T08:53:42.206827+0000","last_became_peered":"2024-04-25T08:53:42.206827+0000","last_unstale":"2024-04-25T08:53:44.209779+0000","last_undegraded":"2024-04-25T08:53:44.209779+0000","last_fullsized":"2024-04-25T08:53:44.209779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356472+0000","last_change":"2024-04-25T08:53:43.219024+0000","last_active":"2024-04-25T08:53:45.356472+0000","last_peered":"2024-04-25T08:53:45.356472+0000","last_clean":"2024-04-25T08:53:45.356472+0000","last_became_active":"2024-04-25T08:53:43.218674+0000","last_became_peered":"2024-04-25T08:53:43.218674+0000","last_unstale":"2024-04-25T08:53:45.356472+0000","last_undegraded":"2024-04-25T08:53:45.356472+0000","last_fullsized":"2024-04-25T08:53:45.356472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.226747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214016+0000","last_change":"2024-04-25T08:53:42.202321+0000","last_active":"2024-04-25T08:53:44.214016+0000","last_peered":"2024-04-25T08:53:44.214016+0000","last_clean":"2024-04-25T08:53:44.214016+0000","last_became_active":"2024-04-25T08:53:42.202063+0000","last_became_peered":"2024-04-25T08:53:42.202063+0000","last_unstale":"2024-04-25T08:53:44.214016+0000","last_undegraded":"2024-04-25T08:53:44.214016+0000","last_fullsized":"2024-04-25T08:53:44.214016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209484+0000","last_change":"2024-04-25T08:53:42.210884+0000","last_active":"2024-04-25T08:53:44.209484+0000","last_peered":"2024-04-25T08:53:44.209484+0000","last_clean":"2024-04-25T08:53:44.209484+0000","last_became_active":"2024-04-25T08:53:42.210568+0000","last_became_peered":"2024-04-25T08:53:42.210568+0000","last_unstale":"2024-04-25T08:53:44.209484+0000","last_undegraded":"2024-04-25T08:53:44.209484+0000","last_fullsized":"2024-04-25T08:53:44.209484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:51.480879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209351+0000","last_change":"2024-04-25T08:53:43.225401+0000","last_active":"2024-04-25T08:53:44.209351+0000","last_peered":"2024-04-25T08:53:44.209351+0000","last_clean":"2024-04-25T08:53:44.209351+0000","last_became_active":"2024-04-25T08:53:43.224926+0000","last_became_peered":"2024-04-25T08:53:43.224926+0000","last_unstale":"2024-04-25T08:53:44.209351+0000","last_undegraded":"2024-04-25T08:53:44.209351+0000","last_fullsized":"2024-04-25T08:53:44.209351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.257247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336053+0000","last_change":"2024-04-25T08:53:42.201897+0000","last_active":"2024-04-25T08:53:44.336053+0000","last_peered":"2024-04-25T08:53:44.336053+0000","last_clean":"2024-04-25T08:53:44.336053+0000","last_became_active":"2024-04-25T08:53:42.201641+0000","last_became_peered":"2024-04-25T08:53:42.201641+0000","last_unstale":"2024-04-25T08:53:44.336053+0000","last_undegraded":"2024-04-25T08:53:44.336053+0000","last_fullsized":"2024-04-25T08:53:44.336053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.213983+0000","last_change":"2024-04-25T08:53:43.209001+0000","last_active":"2024-04-25T08:53:45.213983+0000","last_peered":"2024-04-25T08:53:45.213983+0000","last_clean":"2024-04-25T08:53:45.213983+0000","last_became_active":"2024-04-25T08:53:43.207746+0000","last_became_peered":"2024-04-25T08:53:43.207746+0000","last_unstale":"2024-04-25T08:53:45.213983+0000","last_undegraded":"2024-04-25T08:53:45.213983+0000","last_fullsized":"2024-04-25T08:53:45.213983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:16.959076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214230+0000","last_change":"2024-04-25T08:53:42.209416+0000","last_active":"2024-04-25T08:53:44.214230+0000","last_peered":"2024-04-25T08:53:44.214230+0000","last_clean":"2024-04-25T08:53:44.214230+0000","last_became_active":"2024-04-25T08:53:42.209094+0000","last_became_peered":"2024-04-25T08:53:42.209094+0000","last_unstale":"2024-04-25T08:53:44.214230+0000","last_undegraded":"2024-04-25T08:53:44.214230+0000","last_fullsized":"2024-04-25T08:53:44.214230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336418+0000","last_change":"2024-04-25T08:53:43.221170+0000","last_active":"2024-04-25T08:53:44.336418+0000","last_peered":"2024-04-25T08:53:44.336418+0000","last_clean":"2024-04-25T08:53:44.336418+0000","last_became_active":"2024-04-25T08:53:43.220913+0000","last_became_peered":"2024-04-25T08:53:43.220913+0000","last_unstale":"2024-04-25T08:53:44.336418+0000","last_undegraded":"2024-04-25T08:53:44.336418+0000","last_fullsized":"2024-04-25T08:53:44.336418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:22.702870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336314+0000","last_change":"2024-04-25T08:53:42.209519+0000","last_active":"2024-04-25T08:53:44.336314+0000","last_peered":"2024-04-25T08:53:44.336314+0000","last_clean":"2024-04-25T08:53:44.336314+0000","last_became_active":"2024-04-25T08:53:42.209218+0000","last_became_peered":"2024-04-25T08:53:42.209218+0000","last_unstale":"2024-04-25T08:53:44.336314+0000","last_undegraded":"2024-04-25T08:53:44.336314+0000","last_fullsized":"2024-04-25T08:53:44.336314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356635+0000","last_change":"2024-04-25T08:53:43.216391+0000","last_active":"2024-04-25T08:53:45.356635+0000","last_peered":"2024-04-25T08:53:45.356635+0000","last_clean":"2024-04-25T08:53:45.356635+0000","last_became_active":"2024-04-25T08:53:43.216117+0000","last_became_peered":"2024-04-25T08:53:43.216117+0000","last_unstale":"2024-04-25T08:53:45.356635+0000","last_undegraded":"2024-04-25T08:53:45.356635+0000","last_fullsized":"2024-04-25T08:53:45.356635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.412026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214200+0000","last_change":"2024-04-25T08:53:42.199430+0000","last_active":"2024-04-25T08:53:45.214200+0000","last_peered":"2024-04-25T08:53:45.214200+0000","last_clean":"2024-04-25T08:53:45.214200+0000","last_became_active":"2024-04-25T08:53:42.199063+0000","last_became_peered":"2024-04-25T08:53:42.199063+0000","last_unstale":"2024-04-25T08:53:45.214200+0000","last_undegraded":"2024-04-25T08:53:45.214200+0000","last_fullsized":"2024-04-25T08:53:45.214200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:02.408782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215673+0000","last_change":"2024-04-25T08:53:43.222934+0000","last_active":"2024-04-25T08:53:44.215673+0000","last_peered":"2024-04-25T08:53:44.215673+0000","last_clean":"2024-04-25T08:53:44.215673+0000","last_became_active":"2024-04-25T08:53:43.222610+0000","last_became_peered":"2024-04-25T08:53:43.222610+0000","last_unstale":"2024-04-25T08:53:44.215673+0000","last_undegraded":"2024-04-25T08:53:44.215673+0000","last_fullsized":"2024-04-25T08:53:44.215673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:30.574790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214410+0000","last_change":"2024-04-25T08:53:42.205189+0000","last_active":"2024-04-25T08:53:44.214410+0000","last_peered":"2024-04-25T08:53:44.214410+0000","last_clean":"2024-04-25T08:53:44.214410+0000","last_became_active":"2024-04-25T08:53:42.204876+0000","last_became_peered":"2024-04-25T08:53:42.204876+0000","last_unstale":"2024-04-25T08:53:44.214410+0000","last_undegraded":"2024-04-25T08:53:44.214410+0000","last_fullsized":"2024-04-25T08:53:44.214410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458651+0000","last_change":"2024-04-25T08:53:43.229049+0000","last_active":"2024-04-25T08:53:44.458651+0000","last_peered":"2024-04-25T08:53:44.458651+0000","last_clean":"2024-04-25T08:53:44.458651+0000","last_became_active":"2024-04-25T08:53:43.228659+0000","last_became_peered":"2024-04-25T08:53:43.228659+0000","last_unstale":"2024-04-25T08:53:44.458651+0000","last_undegraded":"2024-04-25T08:53:44.458651+0000","last_fullsized":"2024-04-25T08:53:44.458651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:59.064691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356524+0000","last_change":"2024-04-25T08:53:42.205092+0000","last_active":"2024-04-25T08:53:45.356524+0000","last_peered":"2024-04-25T08:53:45.356524+0000","last_clean":"2024-04-25T08:53:45.356524+0000","last_became_active":"2024-04-25T08:53:42.204784+0000","last_became_peered":"2024-04-25T08:53:42.204784+0000","last_unstale":"2024-04-25T08:53:45.356524+0000","last_undegraded":"2024-04-25T08:53:45.356524+0000","last_fullsized":"2024-04-25T08:53:45.356524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:17.160891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356056+0000","last_change":"2024-04-25T08:53:43.227057+0000","last_active":"2024-04-25T08:53:45.356056+0000","last_peered":"2024-04-25T08:53:45.356056+0000","last_clean":"2024-04-25T08:53:45.356056+0000","last_became_active":"2024-04-25T08:53:43.226484+0000","last_became_peered":"2024-04-25T08:53:43.226484+0000","last_unstale":"2024-04-25T08:53:45.356056+0000","last_undegraded":"2024-04-25T08:53:45.356056+0000","last_fullsized":"2024-04-25T08:53:45.356056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:35.064000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336568+0000","last_change":"2024-04-25T08:53:42.204014+0000","last_active":"2024-04-25T08:53:44.336568+0000","last_peered":"2024-04-25T08:53:44.336568+0000","last_clean":"2024-04-25T08:53:44.336568+0000","last_became_active":"2024-04-25T08:53:42.203751+0000","last_became_peered":"2024-04-25T08:53:42.203751+0000","last_unstale":"2024-04-25T08:53:44.336568+0000","last_undegraded":"2024-04-25T08:53:44.336568+0000","last_fullsized":"2024-04-25T08:53:44.336568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458574+0000","last_change":"2024-04-25T08:53:43.231009+0000","last_active":"2024-04-25T08:53:44.458574+0000","last_peered":"2024-04-25T08:53:44.458574+0000","last_clean":"2024-04-25T08:53:44.458574+0000","last_became_active":"2024-04-25T08:53:43.230705+0000","last_became_peered":"2024-04-25T08:53:43.230705+0000","last_unstale":"2024-04-25T08:53:44.458574+0000","last_undegraded":"2024-04-25T08:53:44.458574+0000","last_fullsized":"2024-04-25T08:53:44.458574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.213930+0000","last_change":"2024-04-25T08:53:42.205489+0000","last_active":"2024-04-25T08:53:44.213930+0000","last_peered":"2024-04-25T08:53:44.213930+0000","last_clean":"2024-04-25T08:53:44.213930+0000","last_became_active":"2024-04-25T08:53:42.204328+0000","last_became_peered":"2024-04-25T08:53:42.204328+0000","last_unstale":"2024-04-25T08:53:44.213930+0000","last_undegraded":"2024-04-25T08:53:44.213930+0000","last_fullsized":"2024-04-25T08:53:44.213930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214069+0000","last_change":"2024-04-25T08:53:43.225273+0000","last_active":"2024-04-25T08:53:44.214069+0000","last_peered":"2024-04-25T08:53:44.214069+0000","last_clean":"2024-04-25T08:53:44.214069+0000","last_became_active":"2024-04-25T08:53:43.225014+0000","last_became_peered":"2024-04-25T08:53:43.225014+0000","last_unstale":"2024-04-25T08:53:44.214069+0000","last_undegraded":"2024-04-25T08:53:44.214069+0000","last_fullsized":"2024-04-25T08:53:44.214069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.355754+0000","last_change":"2024-04-25T08:53:42.206147+0000","last_active":"2024-04-25T08:53:45.355754+0000","last_peered":"2024-04-25T08:53:45.355754+0000","last_clean":"2024-04-25T08:53:45.355754+0000","last_became_active":"2024-04-25T08:53:42.205676+0000","last_became_peered":"2024-04-25T08:53:42.205676+0000","last_unstale":"2024-04-25T08:53:45.355754+0000","last_undegraded":"2024-04-25T08:53:45.355754+0000","last_fullsized":"2024-04-25T08:53:45.355754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458337+0000","last_change":"2024-04-25T08:53:43.224941+0000","last_active":"2024-04-25T08:53:44.458337+0000","last_peered":"2024-04-25T08:53:44.458337+0000","last_clean":"2024-04-25T08:53:44.458337+0000","last_became_active":"2024-04-25T08:53:43.224690+0000","last_became_peered":"2024-04-25T08:53:43.224690+0000","last_unstale":"2024-04-25T08:53:44.458337+0000","last_undegraded":"2024-04-25T08:53:44.458337+0000","last_fullsized":"2024-04-25T08:53:44.458337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215685+0000","last_change":"2024-04-25T08:53:42.208945+0000","last_active":"2024-04-25T08:53:44.215685+0000","last_peered":"2024-04-25T08:53:44.215685+0000","last_clean":"2024-04-25T08:53:44.215685+0000","last_became_active":"2024-04-25T08:53:42.208669+0000","last_became_peered":"2024-04-25T08:53:42.208669+0000","last_unstale":"2024-04-25T08:53:44.215685+0000","last_undegraded":"2024-04-25T08:53:44.215685+0000","last_fullsized":"2024-04-25T08:53:44.215685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:43.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458850+0000","last_change":"2024-04-25T08:53:43.228967+0000","last_active":"2024-04-25T08:53:44.458850+0000","last_peered":"2024-04-25T08:53:44.458850+0000","last_clean":"2024-04-25T08:53:44.458850+0000","last_became_active":"2024-04-25T08:53:43.228689+0000","last_became_peered":"2024-04-25T08:53:43.228689+0000","last_unstale":"2024-04-25T08:53:44.458850+0000","last_undegraded":"2024-04-25T08:53:44.458850+0000","last_fullsized":"2024-04-25T08:53:44.458850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:15.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356577+0000","last_change":"2024-04-25T08:53:42.208039+0000","last_active":"2024-04-25T08:53:45.356577+0000","last_peered":"2024-04-25T08:53:45.356577+0000","last_clean":"2024-04-25T08:53:45.356577+0000","last_became_active":"2024-04-25T08:53:42.207680+0000","last_became_peered":"2024-04-25T08:53:42.207680+0000","last_unstale":"2024-04-25T08:53:45.356577+0000","last_undegraded":"2024-04-25T08:53:45.356577+0000","last_fullsized":"2024-04-25T08:53:45.356577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.459007+0000","last_change":"2024-04-25T08:53:43.230110+0000","last_active":"2024-04-25T08:53:44.459007+0000","last_peered":"2024-04-25T08:53:44.459007+0000","last_clean":"2024-04-25T08:53:44.459007+0000","last_became_active":"2024-04-25T08:53:43.229539+0000","last_became_peered":"2024-04-25T08:53:43.229539+0000","last_unstale":"2024-04-25T08:53:44.459007+0000","last_undegraded":"2024-04-25T08:53:44.459007+0000","last_fullsized":"2024-04-25T08:53:44.459007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214243+0000","last_change":"2024-04-25T08:53:42.202509+0000","last_active":"2024-04-25T08:53:45.214243+0000","last_peered":"2024-04-25T08:53:45.214243+0000","last_clean":"2024-04-25T08:53:45.214243+0000","last_became_active":"2024-04-25T08:53:42.202223+0000","last_became_peered":"2024-04-25T08:53:42.202223+0000","last_unstale":"2024-04-25T08:53:45.214243+0000","last_undegraded":"2024-04-25T08:53:45.214243+0000","last_fullsized":"2024-04-25T08:53:45.214243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:39.125739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336537+0000","last_change":"2024-04-25T08:53:43.227532+0000","last_active":"2024-04-25T08:53:44.336537+0000","last_peered":"2024-04-25T08:53:44.336537+0000","last_clean":"2024-04-25T08:53:44.336537+0000","last_became_active":"2024-04-25T08:53:43.227269+0000","last_became_peered":"2024-04-25T08:53:43.227269+0000","last_unstale":"2024-04-25T08:53:44.336537+0000","last_undegraded":"2024-04-25T08:53:44.336537+0000","last_fullsized":"2024-04-25T08:53:44.336537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:25.482497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356340+0000","last_change":"2024-04-25T08:53:42.210667+0000","last_active":"2024-04-25T08:53:45.356340+0000","last_peered":"2024-04-25T08:53:45.356340+0000","last_clean":"2024-04-25T08:53:45.356340+0000","last_became_active":"2024-04-25T08:53:42.210367+0000","last_became_peered":"2024-04-25T08:53:42.210367+0000","last_unstale":"2024-04-25T08:53:45.356340+0000","last_undegraded":"2024-04-25T08:53:45.356340+0000","last_fullsized":"2024-04-25T08:53:45.356340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:06.737038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458667+0000","last_change":"2024-04-25T08:53:43.223897+0000","last_active":"2024-04-25T08:53:44.458667+0000","last_peered":"2024-04-25T08:53:44.458667+0000","last_clean":"2024-04-25T08:53:44.458667+0000","last_became_active":"2024-04-25T08:53:43.223610+0000","last_became_peered":"2024-04-25T08:53:43.223610+0000","last_unstale":"2024-04-25T08:53:44.458667+0000","last_undegraded":"2024-04-25T08:53:44.458667+0000","last_fullsized":"2024-04-25T08:53:44.458667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:22.702870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458346+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:53:44.458346+0000","last_peered":"2024-04-25T08:53:44.458346+0000","last_clean":"2024-04-25T08:53:44.458346+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:53:44.458346+0000","last_undegraded":"2024-04-25T08:53:44.458346+0000","last_fullsized":"2024-04-25T08:53:44.458346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336073+0000","last_change":"2024-04-25T08:53:42.204756+0000","last_active":"2024-04-25T08:53:44.336073+0000","last_peered":"2024-04-25T08:53:44.336073+0000","last_clean":"2024-04-25T08:53:44.336073+0000","last_became_active":"2024-04-25T08:53:42.204433+0000","last_became_peered":"2024-04-25T08:53:42.204433+0000","last_unstale":"2024-04-25T08:53:44.336073+0000","last_undegraded":"2024-04-25T08:53:44.336073+0000","last_fullsized":"2024-04-25T08:53:44.336073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:01.594562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209533+0000","last_change":"2024-04-25T08:53:43.217690+0000","last_active":"2024-04-25T08:53:44.209533+0000","last_peered":"2024-04-25T08:53:44.209533+0000","last_clean":"2024-04-25T08:53:44.209533+0000","last_became_active":"2024-04-25T08:53:43.217338+0000","last_became_peered":"2024-04-25T08:53:43.217338+0000","last_unstale":"2024-04-25T08:53:44.209533+0000","last_undegraded":"2024-04-25T08:53:44.209533+0000","last_fullsized":"2024-04-25T08:53:44.209533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458262+0000","last_change":"2024-04-25T08:53:42.205644+0000","last_active":"2024-04-25T08:53:44.458262+0000","last_peered":"2024-04-25T08:53:44.458262+0000","last_clean":"2024-04-25T08:53:44.458262+0000","last_became_active":"2024-04-25T08:53:42.205370+0000","last_became_peered":"2024-04-25T08:53:42.205370+0000","last_unstale":"2024-04-25T08:53:44.458262+0000","last_undegraded":"2024-04-25T08:53:44.458262+0000","last_fullsized":"2024-04-25T08:53:44.458262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:29.564869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.355926+0000","last_change":"2024-04-25T08:53:43.223276+0000","last_active":"2024-04-25T08:53:45.355926+0000","last_peered":"2024-04-25T08:53:45.355926+0000","last_clean":"2024-04-25T08:53:45.355926+0000","last_became_active":"2024-04-25T08:53:43.222289+0000","last_became_peered":"2024-04-25T08:53:43.222289+0000","last_unstale":"2024-04-25T08:53:45.355926+0000","last_undegraded":"2024-04-25T08:53:45.355926+0000","last_fullsized":"2024-04-25T08:53:45.355926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:21.260139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356060+0000","last_change":"2024-04-25T08:53:42.208356+0000","last_active":"2024-04-25T08:53:45.356060+0000","last_peered":"2024-04-25T08:53:45.356060+0000","last_clean":"2024-04-25T08:53:45.356060+0000","last_became_active":"2024-04-25T08:53:42.207946+0000","last_became_peered":"2024-04-25T08:53:42.207946+0000","last_unstale":"2024-04-25T08:53:45.356060+0000","last_undegraded":"2024-04-25T08:53:45.356060+0000","last_fullsized":"2024-04-25T08:53:45.356060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214265+0000","last_change":"2024-04-25T08:53:43.212295+0000","last_active":"2024-04-25T08:53:45.214265+0000","last_peered":"2024-04-25T08:53:45.214265+0000","last_clean":"2024-04-25T08:53:45.214265+0000","last_became_active":"2024-04-25T08:53:43.211966+0000","last_became_peered":"2024-04-25T08:53:43.211966+0000","last_unstale":"2024-04-25T08:53:45.214265+0000","last_undegraded":"2024-04-25T08:53:45.214265+0000","last_fullsized":"2024-04-25T08:53:45.214265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:14.026600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336592+0000","last_change":"2024-04-25T08:53:42.200507+0000","last_active":"2024-04-25T08:53:44.336592+0000","last_peered":"2024-04-25T08:53:44.336592+0000","last_clean":"2024-04-25T08:53:44.336592+0000","last_became_active":"2024-04-25T08:53:42.200202+0000","last_became_peered":"2024-04-25T08:53:42.200202+0000","last_unstale":"2024-04-25T08:53:44.336592+0000","last_undegraded":"2024-04-25T08:53:44.336592+0000","last_fullsized":"2024-04-25T08:53:44.336592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215336+0000","last_change":"2024-04-25T08:53:43.223144+0000","last_active":"2024-04-25T08:53:44.215336+0000","last_peered":"2024-04-25T08:53:44.215336+0000","last_clean":"2024-04-25T08:53:44.215336+0000","last_became_active":"2024-04-25T08:53:43.222867+0000","last_became_peered":"2024-04-25T08:53:43.222867+0000","last_unstale":"2024-04-25T08:53:44.215336+0000","last_undegraded":"2024-04-25T08:53:44.215336+0000","last_fullsized":"2024-04-25T08:53:44.215336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:33.206100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214034+0000","last_change":"2024-04-25T08:53:42.209304+0000","last_active":"2024-04-25T08:53:45.214034+0000","last_peered":"2024-04-25T08:53:45.214034+0000","last_clean":"2024-04-25T08:53:45.214034+0000","last_became_active":"2024-04-25T08:53:42.209028+0000","last_became_peered":"2024-04-25T08:53:42.209028+0000","last_unstale":"2024-04-25T08:53:45.214034+0000","last_undegraded":"2024-04-25T08:53:45.214034+0000","last_fullsized":"2024-04-25T08:53:45.214034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:00.557461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336639+0000","last_change":"2024-04-25T08:53:43.224224+0000","last_active":"2024-04-25T08:53:44.336639+0000","last_peered":"2024-04-25T08:53:44.336639+0000","last_clean":"2024-04-25T08:53:44.336639+0000","last_became_active":"2024-04-25T08:53:43.223968+0000","last_became_peered":"2024-04-25T08:53:43.223968+0000","last_unstale":"2024-04-25T08:53:44.336639+0000","last_undegraded":"2024-04-25T08:53:44.336639+0000","last_fullsized":"2024-04-25T08:53:44.336639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458861+0000","last_change":"2024-04-25T08:53:42.212251+0000","last_active":"2024-04-25T08:53:44.458861+0000","last_peered":"2024-04-25T08:53:44.458861+0000","last_clean":"2024-04-25T08:53:44.458861+0000","last_became_active":"2024-04-25T08:53:42.212014+0000","last_became_peered":"2024-04-25T08:53:42.212014+0000","last_unstale":"2024-04-25T08:53:44.458861+0000","last_undegraded":"2024-04-25T08:53:44.458861+0000","last_fullsized":"2024-04-25T08:53:44.458861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:32.196179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214213+0000","last_change":"2024-04-25T08:53:43.211702+0000","last_active":"2024-04-25T08:53:45.214213+0000","last_peered":"2024-04-25T08:53:45.214213+0000","last_clean":"2024-04-25T08:53:45.214213+0000","last_became_active":"2024-04-25T08:53:43.211273+0000","last_became_peered":"2024-04-25T08:53:43.211273+0000","last_unstale":"2024-04-25T08:53:45.214213+0000","last_undegraded":"2024-04-25T08:53:45.214213+0000","last_fullsized":"2024-04-25T08:53:45.214213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:04.627746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214358+0000","last_change":"2024-04-25T08:53:42.205102+0000","last_active":"2024-04-25T08:53:45.214358+0000","last_peered":"2024-04-25T08:53:45.214358+0000","last_clean":"2024-04-25T08:53:45.214358+0000","last_became_active":"2024-04-25T08:53:42.204781+0000","last_became_peered":"2024-04-25T08:53:42.204781+0000","last_unstale":"2024-04-25T08:53:45.214358+0000","last_undegraded":"2024-04-25T08:53:45.214358+0000","last_fullsized":"2024-04-25T08:53:45.214358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:26.598180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209997+0000","last_change":"2024-04-25T08:53:43.222064+0000","last_active":"2024-04-25T08:53:44.209997+0000","last_peered":"2024-04-25T08:53:44.209997+0000","last_clean":"2024-04-25T08:53:44.209997+0000","last_became_active":"2024-04-25T08:53:43.220696+0000","last_became_peered":"2024-04-25T08:53:43.220696+0000","last_unstale":"2024-04-25T08:53:44.209997+0000","last_undegraded":"2024-04-25T08:53:44.209997+0000","last_fullsized":"2024-04-25T08:53:44.209997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214303+0000","last_change":"2024-04-25T08:53:42.203104+0000","last_active":"2024-04-25T08:53:44.214303+0000","last_peered":"2024-04-25T08:53:44.214303+0000","last_clean":"2024-04-25T08:53:44.214303+0000","last_became_active":"2024-04-25T08:53:42.202822+0000","last_became_peered":"2024-04-25T08:53:42.202822+0000","last_unstale":"2024-04-25T08:53:44.214303+0000","last_undegraded":"2024-04-25T08:53:44.214303+0000","last_fullsized":"2024-04-25T08:53:44.214303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356308+0000","last_change":"2024-04-25T08:53:43.214747+0000","last_active":"2024-04-25T08:53:45.356308+0000","last_peered":"2024-04-25T08:53:45.356308+0000","last_clean":"2024-04-25T08:53:45.356308+0000","last_became_active":"2024-04-25T08:53:43.214410+0000","last_became_peered":"2024-04-25T08:53:43.214410+0000","last_unstale":"2024-04-25T08:53:45.356308+0000","last_undegraded":"2024-04-25T08:53:45.356308+0000","last_fullsized":"2024-04-25T08:53:45.356308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:24.690565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458260+0000","last_change":"2024-04-25T08:53:42.212258+0000","last_active":"2024-04-25T08:53:44.458260+0000","last_peered":"2024-04-25T08:53:44.458260+0000","last_clean":"2024-04-25T08:53:44.458260+0000","last_became_active":"2024-04-25T08:53:42.212025+0000","last_became_peered":"2024-04-25T08:53:42.212025+0000","last_unstale":"2024-04-25T08:53:44.458260+0000","last_undegraded":"2024-04-25T08:53:44.458260+0000","last_fullsized":"2024-04-25T08:53:44.458260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:45.638730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.215251+0000","last_change":"2024-04-25T08:53:43.216186+0000","last_active":"2024-04-25T08:53:44.215251+0000","last_peered":"2024-04-25T08:53:44.215251+0000","last_clean":"2024-04-25T08:53:44.215251+0000","last_became_active":"2024-04-25T08:53:43.215899+0000","last_became_peered":"2024-04-25T08:53:43.215899+0000","last_unstale":"2024-04-25T08:53:44.215251+0000","last_undegraded":"2024-04-25T08:53:44.215251+0000","last_fullsized":"2024-04-25T08:53:44.215251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:04.077055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214051+0000","last_change":"2024-04-25T08:53:42.201324+0000","last_active":"2024-04-25T08:53:45.214051+0000","last_peered":"2024-04-25T08:53:45.214051+0000","last_clean":"2024-04-25T08:53:45.214051+0000","last_became_active":"2024-04-25T08:53:42.201017+0000","last_became_peered":"2024-04-25T08:53:42.201017+0000","last_unstale":"2024-04-25T08:53:45.214051+0000","last_undegraded":"2024-04-25T08:53:45.214051+0000","last_fullsized":"2024-04-25T08:53:45.214051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:23.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209486+0000","last_change":"2024-04-25T08:53:43.217644+0000","last_active":"2024-04-25T08:53:44.209486+0000","last_peered":"2024-04-25T08:53:44.209486+0000","last_clean":"2024-04-25T08:53:44.209486+0000","last_became_active":"2024-04-25T08:53:43.217347+0000","last_became_peered":"2024-04-25T08:53:43.217347+0000","last_unstale":"2024-04-25T08:53:44.209486+0000","last_undegraded":"2024-04-25T08:53:44.209486+0000","last_fullsized":"2024-04-25T08:53:44.209486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.214070+0000","last_change":"2024-04-25T08:53:42.207935+0000","last_active":"2024-04-25T08:53:45.214070+0000","last_peered":"2024-04-25T08:53:45.214070+0000","last_clean":"2024-04-25T08:53:45.214070+0000","last_became_active":"2024-04-25T08:53:42.207643+0000","last_became_peered":"2024-04-25T08:53:42.207643+0000","last_unstale":"2024-04-25T08:53:45.214070+0000","last_undegraded":"2024-04-25T08:53:45.214070+0000","last_fullsized":"2024-04-25T08:53:45.214070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:58.628169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209913+0000","last_change":"2024-04-25T08:53:43.215719+0000","last_active":"2024-04-25T08:53:44.209913+0000","last_peered":"2024-04-25T08:53:44.209913+0000","last_clean":"2024-04-25T08:53:44.209913+0000","last_became_active":"2024-04-25T08:53:43.215453+0000","last_became_peered":"2024-04-25T08:53:43.215453+0000","last_unstale":"2024-04-25T08:53:44.209913+0000","last_undegraded":"2024-04-25T08:53:44.209913+0000","last_fullsized":"2024-04-25T08:53:44.209913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:25.927247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458715+0000","last_change":"2024-04-25T08:53:42.207288+0000","last_active":"2024-04-25T08:53:44.458715+0000","last_peered":"2024-04-25T08:53:44.458715+0000","last_clean":"2024-04-25T08:53:44.458715+0000","last_became_active":"2024-04-25T08:53:42.207012+0000","last_became_peered":"2024-04-25T08:53:42.207012+0000","last_unstale":"2024-04-25T08:53:44.458715+0000","last_undegraded":"2024-04-25T08:53:44.458715+0000","last_fullsized":"2024-04-25T08:53:44.458715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:35.381225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.214055+0000","last_change":"2024-04-25T08:53:43.209633+0000","last_active":"2024-04-25T08:53:44.214055+0000","last_peered":"2024-04-25T08:53:44.214055+0000","last_clean":"2024-04-25T08:53:44.214055+0000","last_became_active":"2024-04-25T08:53:43.209378+0000","last_became_peered":"2024-04-25T08:53:43.209378+0000","last_unstale":"2024-04-25T08:53:44.214055+0000","last_undegraded":"2024-04-25T08:53:44.214055+0000","last_fullsized":"2024-04-25T08:53:44.214055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.485521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336439+0000","last_change":"2024-04-25T08:53:43.220635+0000","last_active":"2024-04-25T08:53:44.336439+0000","last_peered":"2024-04-25T08:53:44.336439+0000","last_clean":"2024-04-25T08:53:44.336439+0000","last_became_active":"2024-04-25T08:53:43.220373+0000","last_became_peered":"2024-04-25T08:53:43.220373+0000","last_unstale":"2024-04-25T08:53:44.336439+0000","last_undegraded":"2024-04-25T08:53:44.336439+0000","last_fullsized":"2024-04-25T08:53:44.336439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:02.082871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458542+0000","last_change":"2024-04-25T08:53:42.207788+0000","last_active":"2024-04-25T08:53:44.458542+0000","last_peered":"2024-04-25T08:53:44.458542+0000","last_clean":"2024-04-25T08:53:44.458542+0000","last_became_active":"2024-04-25T08:53:42.207521+0000","last_became_peered":"2024-04-25T08:53:42.207521+0000","last_unstale":"2024-04-25T08:53:44.458542+0000","last_undegraded":"2024-04-25T08:53:44.458542+0000","last_fullsized":"2024-04-25T08:53:44.458542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:38.463215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.336474+0000","last_change":"2024-04-25T08:53:43.219991+0000","last_active":"2024-04-25T08:53:44.336474+0000","last_peered":"2024-04-25T08:53:44.336474+0000","last_clean":"2024-04-25T08:53:44.336474+0000","last_became_active":"2024-04-25T08:53:43.219715+0000","last_became_peered":"2024-04-25T08:53:43.219715+0000","last_unstale":"2024-04-25T08:53:44.336474+0000","last_undegraded":"2024-04-25T08:53:44.336474+0000","last_fullsized":"2024-04-25T08:53:44.336474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:15.077977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.458764+0000","last_change":"2024-04-25T08:53:42.206350+0000","last_active":"2024-04-25T08:53:44.458764+0000","last_peered":"2024-04-25T08:53:44.458764+0000","last_clean":"2024-04-25T08:53:44.458764+0000","last_became_active":"2024-04-25T08:53:42.206045+0000","last_became_peered":"2024-04-25T08:53:42.206045+0000","last_unstale":"2024-04-25T08:53:44.458764+0000","last_undegraded":"2024-04-25T08:53:44.458764+0000","last_fullsized":"2024-04-25T08:53:44.458764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.067134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356482+0000","last_change":"2024-04-25T08:53:43.225375+0000","last_active":"2024-04-25T08:53:45.356482+0000","last_peered":"2024-04-25T08:53:45.356482+0000","last_clean":"2024-04-25T08:53:45.356482+0000","last_became_active":"2024-04-25T08:53:43.225062+0000","last_became_peered":"2024-04-25T08:53:43.225062+0000","last_unstale":"2024-04-25T08:53:45.356482+0000","last_undegraded":"2024-04-25T08:53:45.356482+0000","last_fullsized":"2024-04-25T08:53:45.356482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.333715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.209778+0000","last_change":"2024-04-25T08:53:42.209070+0000","last_active":"2024-04-25T08:53:44.209778+0000","last_peered":"2024-04-25T08:53:44.209778+0000","last_clean":"2024-04-25T08:53:44.209778+0000","last_became_active":"2024-04-25T08:53:42.208670+0000","last_became_peered":"2024-04-25T08:53:42.208670+0000","last_unstale":"2024-04-25T08:53:44.209778+0000","last_undegraded":"2024-04-25T08:53:44.209778+0000","last_fullsized":"2024-04-25T08:53:44.209778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:06.737038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:44.210018+0000","last_change":"2024-04-25T08:53:43.224397+0000","last_active":"2024-04-25T08:53:44.210018+0000","last_peered":"2024-04-25T08:53:44.210018+0000","last_clean":"2024-04-25T08:53:44.210018+0000","last_became_active":"2024-04-25T08:53:43.224037+0000","last_became_peered":"2024-04-25T08:53:43.224037+0000","last_unstale":"2024-04-25T08:53:44.210018+0000","last_undegraded":"2024-04-25T08:53:44.210018+0000","last_fullsized":"2024-04-25T08:53:44.210018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:42.183932+0000","last_clean_scrub_stamp":"2024-04-25T08:53:42.183932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:47.348748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T08:53:45.356649+0000","last_change":"2024-04-25T08:53:42.209220+0000","last_active":"2024-04-25T08:53:45.356649+0000","last_peered":"2024-04-25T08:53:45.356649+0000","last_clean":"2024-04-25T08:53:45.356649+0000","last_became_active":"2024-04-25T08:53:42.208936+0000","last_became_peered":"2024-04-25T08:53:42.208936+0000","last_unstale":"2024-04-25T08:53:45.356649+0000","last_undegraded":"2024-04-25T08:53:45.356649+0000","last_fullsized":"2024-04-25T08:53:45.356649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:41.174011+0000","last_clean_scrub_stamp":"2024-04-25T08:53:41.174011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:51.480879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:53:55.412 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T08:53:55.412 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T08:53:55.412 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T08:53:55.412 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T08:53:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.557+0000 7f4fc2b0a640 1 Processor -- start 2024-04-25T08:53:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.558+0000 7f4fc2b0a640 1 -- start start 2024-04-25T08:53:55.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.558+0000 7f4fc2b0a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4fbc06b2b0 0x7f4fbc072710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.558+0000 7f4fc2b0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4fbc072c50 0x7f4fbc0ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.558+0000 7f4fc2b0a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fbc15f510 con 0x7f4fbc156120 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.558+0000 7f4fc2b0a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc160120 con 0x7f4fbc072c50 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.558+0000 7f4fc2b0a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc15f7f0 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.558+0000 7f4fc08a6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4fbc156120 0x7f4fbc06aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56982/0 (socket says 172.21.15.55:56982) 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.558+0000 7f4fc08a6640 1 -- 172.21.15.55:0/2298398628 learned_addr learned my addr 172.21.15.55:0/2298398628 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.558+0000 7f4fc10a7640 1 --2- 172.21.15.55:0/2298398628 >> v2:172.21.15.55:3300/0 conn(0x7f4fbc072c50 0x7f4fbc0ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.559+0000 7f4fbb7fe640 1 -- 172.21.15.55:0/2298398628 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820283462 0 0) 0x7f4fbc15f510 con 0x7f4fbc156120 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.559+0000 7f4fbb7fe640 1 -- 172.21.15.55:0/2298398628 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa8003520 con 0x7f4fbc156120 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.559+0000 7f4fbbfff640 1 --2- 172.21.15.55:0/2298398628 >> v2:172.21.15.167:3300/0 conn(0x7f4fbc06b2b0 0x7f4fbc072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.559+0000 7f4fc10a7640 1 -- 172.21.15.55:0/2298398628 >> v2:172.21.15.167:3300/0 conn(0x7f4fbc06b2b0 msgr2=0x7f4fbc072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.559+0000 7f4fc10a7640 1 --2- 172.21.15.55:0/2298398628 >> v2:172.21.15.167:3300/0 conn(0x7f4fbc06b2b0 0x7f4fbc072710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.559+0000 7f4fc10a7640 1 -- 172.21.15.55:0/2298398628 >> v1:172.21.15.55:6789/0 conn(0x7f4fbc156120 legacy=0x7f4fbc06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.559+0000 7f4fc10a7640 1 -- 172.21.15.55:0/2298398628 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc15fad0 con 0x7f4fbc072c50 2024-04-25T08:53:55.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.559+0000 7f4fc10a7640 1 --2- 172.21.15.55:0/2298398628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fbc072c50 0x7f4fbc0ce310 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc06d010 tx=0x7f4fa402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db03b8c036ba3a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:55.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.560+0000 7f4fbb7fe640 1 -- 172.21.15.55:0/2298398628 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4037070 con 0x7f4fbc072c50 2024-04-25T08:53:55.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.560+0000 7f4fbb7fe640 1 -- 172.21.15.55:0/2298398628 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa4032440 con 0x7f4fbc072c50 2024-04-25T08:53:55.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.560+0000 7f4fbb7fe640 1 -- 172.21.15.55:0/2298398628 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4032810 con 0x7f4fbc072c50 2024-04-25T08:53:55.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.560+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/2298398628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fbc072c50 msgr2=0x7f4fbc0ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.560+0000 7f4fc2b0a640 1 --2- 172.21.15.55:0/2298398628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fbc072c50 0x7f4fbc0ce310 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc06d010 tx=0x7f4fa402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.560+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/2298398628 shutdown_connections 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.560+0000 7f4fc2b0a640 1 --2- 172.21.15.55:0/2298398628 >> v2:172.21.15.167:3300/0 conn(0x7f4fbc06b2b0 0x7f4fbc072710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.560+0000 7f4fc2b0a640 1 --2- 172.21.15.55:0/2298398628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fbc072c50 0x7f4fbc0ce310 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.560+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/2298398628 >> 172.21.15.55:0/2298398628 conn(0x7f4fbc0b2370 msgr2=0x7f4fbc0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.560+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/2298398628 shutdown_connections 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.560+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/2298398628 wait complete. 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.561+0000 7f4fc2b0a640 1 Processor -- start 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.561+0000 7f4fc2b0a640 1 -- start start 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.562+0000 7f4fc2b0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fbc06b2b0 0x7f4fbc14b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.562+0000 7f4fc2b0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fbc072c50 0x7f4fbc0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.562+0000 7f4fc2b0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fbc156120 0x7f4fbc0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.562+0000 7f4fc2b0a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc073240 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.562+0000 7f4fc2b0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc0730c0 con 0x7f4fbc156120 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.562+0000 7f4fc2b0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc0ccf30 con 0x7f4fbc072c50 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.562+0000 7f4fc08a6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fbc06b2b0 0x7f4fbc14b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.562+0000 7f4fc08a6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fbc06b2b0 0x7f4fbc14b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48312/0 (socket says 172.21.15.55:48312) 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.562+0000 7f4fc08a6640 1 -- 172.21.15.55:0/1761239451 learned_addr learned my addr 172.21.15.55:0/1761239451 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fc08a6640 1 -- 172.21.15.55:0/1761239451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fbc072c50 msgr2=0x7f4fbc0b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fc08a6640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fbc072c50 0x7f4fbc0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fc08a6640 1 -- 172.21.15.55:0/1761239451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fbc156120 msgr2=0x7f4fbc0cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fc10a7640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fbc156120 0x7f4fbc0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fc08a6640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fbc156120 0x7f4fbc0cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fc08a6640 1 -- 172.21.15.55:0/1761239451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0b0a30 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fc10a7640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fbc156120 0x7f4fbc0cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fc08a6640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fbc06b2b0 0x7f4fbc14b7f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400c430 tx=0x7f4fb400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:55.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fb97fa640 1 -- 172.21.15.55:0/1761239451 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4017070 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fb97fa640 1 -- 172.21.15.55:0/1761239451 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb4005ce0 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/1761239451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc0b0d10 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fb97fa640 1 -- 172.21.15.55:0/1761239451 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40072f0 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.563+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/1761239451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc0b12d0 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.564+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/1761239451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fbc0c7a20 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.565+0000 7f4fb97fa640 1 -- 172.21.15.55:0/1761239451 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4fb401a070 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.565+0000 7f4fb97fa640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.565+0000 7f4fbbfff640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.565+0000 7f4fb97fa640 1 -- 172.21.15.55:0/1761239451 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fb4089680 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.566+0000 7f4fbbfff640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0b6b40 tx=0x7f4fac0072f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:55.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.570+0000 7f4fb97fa640 1 -- 172.21.15.55:0/1761239451 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4fb4058650 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.788+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/1761239451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4fbc072410 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.788+0000 7f4fb97fa640 1 -- 172.21.15.55:0/1761239451 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4fb4057f50 con 0x7f4fbc06b2b0 2024-04-25T08:53:55.778 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:55.778 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T08:53:55.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/1761239451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 msgr2=0x7f4f9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0b6b40 tx=0x7f4fac0072f0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/1761239451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fbc06b2b0 msgr2=0x7f4fbc14b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fbc06b2b0 0x7f4fbc14b7f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400c430 tx=0x7f4fb400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/1761239451 shutdown_connections 2024-04-25T08:53:55.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fbc156120 0x7f4fbc0cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fbc072c50 0x7f4fbc0b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 --2- 172.21.15.55:0/1761239451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fbc06b2b0 0x7f4fbc14b7f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/1761239451 >> 172.21.15.55:0/1761239451 conn(0x7f4fbc0b2370 msgr2=0x7f4fbc06aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:55.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/1761239451 shutdown_connections 2024-04-25T08:53:55.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.790+0000 7f4fc2b0a640 1 -- 172.21.15.55:0/1761239451 wait complete. 2024-04-25T08:53:55.791 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T08:53:55.791 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:55.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.902+0000 7fb2beb70640 1 Processor -- start 2024-04-25T08:53:55.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.902+0000 7fb2beb70640 1 -- start start 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2beb70640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2b815dce0 0x7fb2b80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2beb70640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b815e0c0 con 0x7fb2b80b5b60 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2beb70640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b80d2510 con 0x7fb2b80d35b0 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2beb70640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80d27f0 con 0x7fb2b815dce0 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2bd10d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb2b80b5b60 0x7fb2b80b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56990/0 (socket says 172.21.15.55:56990) 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2bd10d640 1 -- 172.21.15.55:0/4228455463 learned_addr learned my addr 172.21.15.55:0/4228455463 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2bc90c640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2b815dce0 0x7fb2b80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414761501 0 0) 0x7fb2b815e0c0 con 0x7fb2b80b5b60 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2a8003520 con 0x7fb2b80b5b60 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742058482 0 0) 0x7fb2b80d2510 con 0x7fb2b80d35b0 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2b815e0c0 con 0x7fb2b80d35b0 2024-04-25T08:53:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2051091832 0 0) 0x7fb2a8003520 con 0x7fb2b80b5b60 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2b815dce0 msgr2=0x7fb2b80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2b815dce0 0x7fb2b80d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 >> v1:172.21.15.167:6789/0 conn(0x7fb2b80d35b0 legacy=0x7fb2b80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b80d2ad0 con 0x7fb2b80b5b60 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fb2b00019f0 con 0x7fb2b80b5b60 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 >> v1:172.21.15.55:6789/0 conn(0x7fb2b80b5b60 legacy=0x7fb2b80b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a8003b70 0x7fb2a8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 0x7fb2a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a80051c0 0x7fb2a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80d27f0 con 0x7fb2a8004800 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a800bfb0 con 0x7fb2a8003b70 2024-04-25T08:53:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a800c1b0 con 0x7fb2a80051c0 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.903+0000 7fb2bc90c640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2b815dce0 0x7fb2b80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.904+0000 7fb2b7fff640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 0x7fb2a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.904+0000 7fb2bd10d640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a80051c0 0x7fb2a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.904+0000 7fb2bc90c640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a8003b70 0x7fb2a8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.904+0000 7fb2b7fff640 1 -- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a80051c0 msgr2=0x7fb2a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.904+0000 7fb2b7fff640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a80051c0 0x7fb2a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.904+0000 7fb2b7fff640 1 -- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a8003b70 msgr2=0x7fb2a8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.904+0000 7fb2b7fff640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a8003b70 0x7fb2a8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.904+0000 7fb2b7fff640 1 -- 172.21.15.55:0/4228455463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8003520 con 0x7fb2a8004800 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.905+0000 7fb2b7fff640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 0x7fb2a8004c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40018c0 tx=0x7fb2a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578771c51c601253 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.905+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40014e0 con 0x7fb2a8004800 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.905+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a40052f0 con 0x7fb2a8004800 2024-04-25T08:53:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.905+0000 7fb2b77fe640 1 -- 172.21.15.55:0/4228455463 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a402ac90 con 0x7fb2a8004800 2024-04-25T08:53:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.905+0000 7fb2beb70640 1 -- 172.21.15.55:0/4228455463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 msgr2=0x7fb2a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.905+0000 7fb2beb70640 1 --2- 172.21.15.55:0/4228455463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 0x7fb2a8004c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40018c0 tx=0x7fb2a8005830 comp rx=0 tx=0).stop 2024-04-25T08:53:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.905+0000 7fb2bd10d640 1 -- 172.21.15.55:0/4228455463 reap_dead start 2024-04-25T08:53:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.905+0000 7fb2beb70640 1 -- 172.21.15.55:0/4228455463 shutdown_connections 2024-04-25T08:53:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.905+0000 7fb2beb70640 1 -- 172.21.15.55:0/4228455463 >> 172.21.15.55:0/4228455463 conn(0x7fb2b8072900 msgr2=0x7fb2b80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.905+0000 7fb2beb70640 1 -- 172.21.15.55:0/4228455463 shutdown_connections 2024-04-25T08:53:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.905+0000 7fb2beb70640 1 -- 172.21.15.55:0/4228455463 wait complete. 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.906+0000 7fb2beb70640 1 Processor -- start 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.906+0000 7fb2beb70640 1 -- start start 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.907+0000 7fb2beb70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 0x7fb2b8153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.907+0000 7fb2beb70640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b80b47c0 0x7fb2b80b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.907+0000 7fb2beb70640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2b8159fb0 0x7fb2b815a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.907+0000 7fb2beb70640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80b9820 con 0x7fb2a8004800 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.907+0000 7fb2beb70640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80d3090 con 0x7fb2b80b47c0 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.907+0000 7fb2beb70640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80b99a0 con 0x7fb2b8159fb0 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.907+0000 7fb2bc90c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 0x7fb2b8153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2bc90c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 0x7fb2b8153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48322/0 (socket says 172.21.15.55:48322) 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2bc90c640 1 -- 172.21.15.55:0/3092804964 learned_addr learned my addr 172.21.15.55:0/3092804964 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2bd10d640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2b8159fb0 0x7fb2b815a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2b7fff640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b80b47c0 0x7fb2b80b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2bc90c640 1 -- 172.21.15.55:0/3092804964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2b8159fb0 msgr2=0x7fb2b815a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2bc90c640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2b8159fb0 0x7fb2b815a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2bc90c640 1 -- 172.21.15.55:0/3092804964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b80b47c0 msgr2=0x7fb2b80b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2bc90c640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b80b47c0 0x7fb2b80b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2bc90c640 1 -- 172.21.15.55:0/3092804964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b815a970 con 0x7fb2a8004800 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2b7fff640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b80b47c0 0x7fb2b80b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2bc90c640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 0x7fb2b8153a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac011c30 tx=0x7fb2ac00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2b57fa640 1 -- 172.21.15.55:0/3092804964 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac00fd20 con 0x7fb2a8004800 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2b57fa640 1 -- 172.21.15.55:0/3092804964 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac014440 con 0x7fb2a8004800 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2b57fa640 1 -- 172.21.15.55:0/3092804964 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0147f0 con 0x7fb2a8004800 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2beb70640 1 -- 172.21.15.55:0/3092804964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b81f6f00 con 0x7fb2a8004800 2024-04-25T08:53:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.908+0000 7fb2beb70640 1 -- 172.21.15.55:0/3092804964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b81f74c0 con 0x7fb2a8004800 2024-04-25T08:53:55.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.909+0000 7fb2beb70640 1 -- 172.21.15.55:0/3092804964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b80b5180 con 0x7fb2a8004800 2024-04-25T08:53:55.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.910+0000 7fb2b57fa640 1 -- 172.21.15.55:0/3092804964 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb2ac012040 con 0x7fb2a8004800 2024-04-25T08:53:55.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.910+0000 7fb2b57fa640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb29c06b500 0x7fb29c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:55.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.910+0000 7fb2b57fa640 1 -- 172.21.15.55:0/3092804964 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2ac08a840 con 0x7fb2a8004800 2024-04-25T08:53:55.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.910+0000 7fb2b7fff640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb29c06b500 0x7fb29c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:55.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.910+0000 7fb2b7fff640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb29c06b500 0x7fb29c06d9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4032000 tx=0x7fb2a402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:55.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:55.914+0000 7fb2b57fa640 1 -- 172.21.15.55:0/3092804964 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb2ac019030 con 0x7fb2a8004800 2024-04-25T08:53:56.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.100+0000 7fb2beb70640 1 -- 172.21.15.55:0/3092804964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2b80749b0 con 0x7fb2a8004800 2024-04-25T08:53:56.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.101+0000 7fb2b57fa640 1 -- 172.21.15.55:0/3092804964 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fb2ac059750 con 0x7fb2a8004800 2024-04-25T08:53:56.091 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:56.091 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 -- 172.21.15.55:0/3092804964 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb29c06b500 msgr2=0x7fb29c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb29c06b500 0x7fb29c06d9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4032000 tx=0x7fb2a402e000 comp rx=0 tx=0).stop 2024-04-25T08:53:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 -- 172.21.15.55:0/3092804964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 msgr2=0x7fb2b8153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 0x7fb2b8153a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac011c30 tx=0x7fb2ac00f610 comp rx=0 tx=0).stop 2024-04-25T08:53:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 -- 172.21.15.55:0/3092804964 shutdown_connections 2024-04-25T08:53:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb29c06b500 0x7fb29c06d9c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2b8159fb0 0x7fb2b815a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b80b47c0 0x7fb2b80b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 --2- 172.21.15.55:0/3092804964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2a8004800 0x7fb2b8153a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 -- 172.21.15.55:0/3092804964 >> 172.21.15.55:0/3092804964 conn(0x7fb2b8072900 msgr2=0x7fb2b80d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:56.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 -- 172.21.15.55:0/3092804964 shutdown_connections 2024-04-25T08:53:56.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.103+0000 7fb2beb70640 1 -- 172.21.15.55:0/3092804964 wait complete. 2024-04-25T08:53:56.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:53:56.105 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:53:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.218+0000 7f0136a5d640 1 Processor -- start 2024-04-25T08:53:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.218+0000 7f0136a5d640 1 -- start start 2024-04-25T08:53:56.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f0136a5d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f013015dca0 0x7f01300ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f0136a5d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01300d4090 con 0x7f01300d3b90 2024-04-25T08:53:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f0136a5d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01300d4370 con 0x7f01300d1130 2024-04-25T08:53:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f0136a5d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01300b6b20 con 0x7f013015dca0 2024-04-25T08:53:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f012ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f013015dca0 0x7f01300ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f012f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f01300d3b90 0x7f01300d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57002/0 (socket says 172.21.15.55:57002) 2024-04-25T08:53:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f012ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f013015dca0 0x7f01300ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48330/0 (socket says 172.21.15.55:48330) 2024-04-25T08:53:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f012f7fe640 1 -- 172.21.15.55:0/3662319624 learned_addr learned my addr 172.21.15.55:0/3662319624 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f012ffff640 1 -- 172.21.15.55:0/3662319624 >> v1:172.21.15.167:6789/0 conn(0x7f01300d1130 legacy=0x7f01300b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f012ffff640 1 -- 172.21.15.55:0/3662319624 >> v1:172.21.15.55:6789/0 conn(0x7f01300d3b90 legacy=0x7f01300d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f012effd640 1 -- 172.21.15.55:0/3662319624 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034702497 0 0) 0x7f01300d4090 con 0x7f01300d3b90 2024-04-25T08:53:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.219+0000 7f012ffff640 1 -- 172.21.15.55:0/3662319624 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300d4650 con 0x7f013015dca0 2024-04-25T08:53:56.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.220+0000 7f012ffff640 1 --2- 172.21.15.55:0/3662319624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f013015dca0 0x7f01300ce940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f01240097a0 tx=0x7f012402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b96376237fe2f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.220+0000 7f012effd640 1 -- 172.21.15.55:0/3662319624 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124037070 con 0x7f013015dca0 2024-04-25T08:53:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.220+0000 7f012effd640 1 -- 172.21.15.55:0/3662319624 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0124032440 con 0x7f013015dca0 2024-04-25T08:53:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.220+0000 7f012effd640 1 -- 172.21.15.55:0/3662319624 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124032810 con 0x7f013015dca0 2024-04-25T08:53:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.221+0000 7f0136a5d640 1 -- 172.21.15.55:0/3662319624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f013015dca0 msgr2=0x7f01300ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.221+0000 7f0136a5d640 1 --2- 172.21.15.55:0/3662319624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f013015dca0 0x7f01300ce940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f01240097a0 tx=0x7f012402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.221+0000 7f0136a5d640 1 -- 172.21.15.55:0/3662319624 shutdown_connections 2024-04-25T08:53:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.221+0000 7f0136a5d640 1 --2- 172.21.15.55:0/3662319624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f013015dca0 0x7f01300ce940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.221+0000 7f0136a5d640 1 -- 172.21.15.55:0/3662319624 >> 172.21.15.55:0/3662319624 conn(0x7f01300726c0 msgr2=0x7f0130072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.221+0000 7f0136a5d640 1 -- 172.21.15.55:0/3662319624 shutdown_connections 2024-04-25T08:53:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.221+0000 7f0136a5d640 1 -- 172.21.15.55:0/3662319624 wait complete. 2024-04-25T08:53:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.222+0000 7f0136a5d640 1 Processor -- start 2024-04-25T08:53:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.222+0000 7f0136a5d640 1 -- start start 2024-04-25T08:53:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f0136a5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01300d1130 0x7f0130156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f0136a5d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01300d3b90 0x7f0130152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f0136a5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f013015dca0 0x7f013015b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f0136a5d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013015e200 con 0x7f01300d1130 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f0136a5d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013015e080 con 0x7f01300d3b90 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f0136a5d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01300cee80 con 0x7f013015dca0 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01300d1130 0x7f0130156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01300d1130 0x7f0130156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48340/0 (socket says 172.21.15.55:48340) 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012ffff640 1 -- 172.21.15.55:0/396158524 learned_addr learned my addr 172.21.15.55:0/396158524 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012f7fe640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01300d3b90 0x7f0130152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f0134ffa640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f013015dca0 0x7f013015b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012ffff640 1 -- 172.21.15.55:0/396158524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f013015dca0 msgr2=0x7f013015b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012ffff640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f013015dca0 0x7f013015b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012ffff640 1 -- 172.21.15.55:0/396158524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01300d3b90 msgr2=0x7f0130152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012ffff640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01300d3b90 0x7f0130152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012ffff640 1 -- 172.21.15.55:0/396158524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300cc7d0 con 0x7f01300d1130 2024-04-25T08:53:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012ffff640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01300d1130 0x7f0130156910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f01240097a0 tx=0x7f01240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012cff9640 1 -- 172.21.15.55:0/396158524 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124037040 con 0x7f01300d1130 2024-04-25T08:53:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f012cff9640 1 -- 172.21.15.55:0/396158524 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0124004250 con 0x7f01300d1130 2024-04-25T08:53:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.223+0000 7f0136a5d640 1 -- 172.21.15.55:0/396158524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01300cceb0 con 0x7f01300d1130 2024-04-25T08:53:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.224+0000 7f012cff9640 1 -- 172.21.15.55:0/396158524 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124032e20 con 0x7f01300d1130 2024-04-25T08:53:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.224+0000 7f0136a5d640 1 -- 172.21.15.55:0/396158524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01300cd470 con 0x7f01300d1130 2024-04-25T08:53:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.225+0000 7f0136a5d640 1 -- 172.21.15.55:0/396158524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0130074120 con 0x7f01300d1130 2024-04-25T08:53:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.225+0000 7f012cff9640 1 -- 172.21.15.55:0/396158524 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0124030770 con 0x7f01300d1130 2024-04-25T08:53:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.225+0000 7f012cff9640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f011c06b4d0 0x7f011c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.226+0000 7f012f7fe640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f011c06b4d0 0x7f011c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.226+0000 7f012cff9640 1 -- 172.21.15.55:0/396158524 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01240ab520 con 0x7f01300d1130 2024-04-25T08:53:56.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.226+0000 7f012f7fe640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f011c06b4d0 0x7f011c06d990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f013015bea0 tx=0x7f0120007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:56.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.230+0000 7f012cff9640 1 -- 172.21.15.55:0/396158524 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0130074120 con 0x7f01300d1130 2024-04-25T08:53:56.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.411+0000 7f0136a5d640 1 -- 172.21.15.55:0/396158524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01300750b0 con 0x7f01300d1130 2024-04-25T08:53:56.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.412+0000 7f012cff9640 1 -- 172.21.15.55:0/396158524 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f012407a420 con 0x7f01300d1130 2024-04-25T08:53:56.402 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:53:56.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.413+0000 7f0136a5d640 1 -- 172.21.15.55:0/396158524 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f011c06b4d0 msgr2=0x7f011c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.413+0000 7f0136a5d640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f011c06b4d0 0x7f011c06d990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f013015bea0 tx=0x7f0120007b50 comp rx=0 tx=0).stop 2024-04-25T08:53:56.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.413+0000 7f0136a5d640 1 -- 172.21.15.55:0/396158524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01300d1130 msgr2=0x7f0130156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.413+0000 7f0136a5d640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01300d1130 0x7f0130156910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f01240097a0 tx=0x7f01240046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.414+0000 7f0136a5d640 1 -- 172.21.15.55:0/396158524 shutdown_connections 2024-04-25T08:53:56.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.414+0000 7f0136a5d640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f011c06b4d0 0x7f011c06d990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.414+0000 7f0136a5d640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f013015dca0 0x7f013015b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.414+0000 7f0136a5d640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01300d3b90 0x7f0130152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.414+0000 7f0136a5d640 1 --2- 172.21.15.55:0/396158524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01300d1130 0x7f0130156910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.414+0000 7f0136a5d640 1 -- 172.21.15.55:0/396158524 >> 172.21.15.55:0/396158524 conn(0x7f01300726c0 msgr2=0x7f013015a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:56.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.414+0000 7f0136a5d640 1 -- 172.21.15.55:0/396158524 shutdown_connections 2024-04-25T08:53:56.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.414+0000 7f0136a5d640 1 -- 172.21.15.55:0/396158524 wait complete. 2024-04-25T08:53:56.415 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:53:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.528+0000 7f8edef6a640 1 Processor -- start 2024-04-25T08:53:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.528+0000 7f8edef6a640 1 -- start start 2024-04-25T08:53:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8edef6a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ed80b2740 0x7f8ed815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8edef6a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ed80ce1a0 0x7f8ed80ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8edef6a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed806c150 con 0x7f8ed80d0490 2024-04-25T08:53:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8edef6a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed80d2000 con 0x7f8ed80b2740 2024-04-25T08:53:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8edef6a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed806cd60 con 0x7f8ed80ce1a0 2024-04-25T08:53:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8ed7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ed80b2740 0x7f8ed815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8ed7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ed80b2740 0x7f8ed815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48346/0 (socket says 172.21.15.55:48346) 2024-04-25T08:53:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8ed7fff640 1 -- 172.21.15.55:0/2105431803 learned_addr learned my addr 172.21.15.55:0/2105431803 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8edd507640 1 --2- 172.21.15.55:0/2105431803 >> v2:172.21.15.167:3300/0 conn(0x7f8ed80ce1a0 0x7f8ed80ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8ed7fff640 1 -- 172.21.15.55:0/2105431803 >> v2:172.21.15.167:3300/0 conn(0x7f8ed80ce1a0 msgr2=0x7f8ed80ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8ed7fff640 1 --2- 172.21.15.55:0/2105431803 >> v2:172.21.15.167:3300/0 conn(0x7f8ed80ce1a0 0x7f8ed80ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8ed7fff640 1 -- 172.21.15.55:0/2105431803 >> v1:172.21.15.167:6789/0 conn(0x7f8ed80d0490 legacy=0x7f8ed80d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.529+0000 7f8ed7fff640 1 -- 172.21.15.55:0/2105431803 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed806c430 con 0x7f8ed80b2740 2024-04-25T08:53:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8ed7fff640 1 --2- 172.21.15.55:0/2105431803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed80b2740 0x7f8ed815ec90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80b55f0 tx=0x7f8ec402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7403bdca73353b48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:56.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8ed77fe640 1 -- 172.21.15.55:0/2105431803 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4037070 con 0x7f8ed80b2740 2024-04-25T08:53:56.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8ed77fe640 1 -- 172.21.15.55:0/2105431803 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec4032440 con 0x7f8ed80b2740 2024-04-25T08:53:56.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8ed77fe640 1 -- 172.21.15.55:0/2105431803 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4032810 con 0x7f8ed80b2740 2024-04-25T08:53:56.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8edef6a640 1 -- 172.21.15.55:0/2105431803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed80b2740 msgr2=0x7f8ed815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8edef6a640 1 --2- 172.21.15.55:0/2105431803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed80b2740 0x7f8ed815ec90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80b55f0 tx=0x7f8ec402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8edef6a640 1 -- 172.21.15.55:0/2105431803 shutdown_connections 2024-04-25T08:53:56.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8edef6a640 1 --2- 172.21.15.55:0/2105431803 >> v2:172.21.15.167:3300/0 conn(0x7f8ed80ce1a0 0x7f8ed80ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8edef6a640 1 --2- 172.21.15.55:0/2105431803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed80b2740 0x7f8ed815ec90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8edef6a640 1 -- 172.21.15.55:0/2105431803 >> 172.21.15.55:0/2105431803 conn(0x7f8ed80b5660 msgr2=0x7f8ed80b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:56.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8edef6a640 1 -- 172.21.15.55:0/2105431803 shutdown_connections 2024-04-25T08:53:56.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.530+0000 7f8edef6a640 1 -- 172.21.15.55:0/2105431803 wait complete. 2024-04-25T08:53:56.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.532+0000 7f8edef6a640 1 Processor -- start 2024-04-25T08:53:56.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.532+0000 7f8edef6a640 1 -- start start 2024-04-25T08:53:56.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.532+0000 7f8edef6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed80b2740 0x7f8ed80c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.532+0000 7f8edef6a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed80ce1a0 0x7f8ed80cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.532+0000 7f8edef6a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ed80d0490 0x7f8ed81619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.532+0000 7f8edef6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed806c9f0 con 0x7f8ed80b2740 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.532+0000 7f8edef6a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed815f1d0 con 0x7f8ed80ce1a0 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.532+0000 7f8edef6a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed815e020 con 0x7f8ed80d0490 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edcd06640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed80b2740 0x7f8ed80c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edcd06640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed80b2740 0x7f8ed80c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48358/0 (socket says 172.21.15.55:48358) 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edcd06640 1 -- 172.21.15.55:0/1386696300 learned_addr learned my addr 172.21.15.55:0/1386696300 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8ed7fff640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed80ce1a0 0x7f8ed80cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edd507640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ed80d0490 0x7f8ed81619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edcd06640 1 -- 172.21.15.55:0/1386696300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ed80d0490 msgr2=0x7f8ed81619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edcd06640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ed80d0490 0x7f8ed81619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edcd06640 1 -- 172.21.15.55:0/1386696300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed80ce1a0 msgr2=0x7f8ed80cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edcd06640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed80ce1a0 0x7f8ed80cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edcd06640 1 -- 172.21.15.55:0/1386696300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8158860 con 0x7f8ed80b2740 2024-04-25T08:53:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edd507640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ed80d0490 0x7f8ed81619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edcd06640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed80b2740 0x7f8ed80c9e20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00c3c0 tx=0x7f8ecc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8ed57fa640 1 -- 172.21.15.55:0/1386696300 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc0052d0 con 0x7f8ed80b2740 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8ed57fa640 1 -- 172.21.15.55:0/1386696300 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc005490 con 0x7f8ed80b2740 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edef6a640 1 -- 172.21.15.55:0/1386696300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed8158b40 con 0x7f8ed80b2740 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8ed57fa640 1 -- 172.21.15.55:0/1386696300 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc007260 con 0x7f8ed80b2740 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.533+0000 7f8edef6a640 1 -- 172.21.15.55:0/1386696300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed8159100 con 0x7f8ed80b2740 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.534+0000 7f8edef6a640 1 -- 172.21.15.55:0/1386696300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed8159430 con 0x7f8ed80b2740 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.535+0000 7f8ed57fa640 1 -- 172.21.15.55:0/1386696300 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ecc007400 con 0x7f8ed80b2740 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.535+0000 7f8ed57fa640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ebc06b4d0 0x7f8ebc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.535+0000 7f8ed57fa640 1 -- 172.21.15.55:0/1386696300 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ecc089680 con 0x7f8ed80b2740 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.535+0000 7f8ed7fff640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ebc06b4d0 0x7f8ebc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.536+0000 7f8ed7fff640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ebc06b4d0 0x7f8ebc06d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4034000 tx=0x7f8ec402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:56.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.539+0000 7f8ed57fa640 1 -- 172.21.15.55:0/1386696300 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ecc057e20 con 0x7f8ed80b2740 2024-04-25T08:53:56.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.719+0000 7f8edef6a640 1 -- 172.21.15.55:0/1386696300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ed80d31a0 con 0x7f8ed80b2740 2024-04-25T08:53:56.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.719+0000 7f8ed57fa640 1 -- 172.21.15.55:0/1386696300 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ecc05bec0 con 0x7f8ed80b2740 2024-04-25T08:53:56.709 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:53:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 -- 172.21.15.55:0/1386696300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ebc06b4d0 msgr2=0x7f8ebc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ebc06b4d0 0x7f8ebc06d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4034000 tx=0x7f8ec402e000 comp rx=0 tx=0).stop 2024-04-25T08:53:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 -- 172.21.15.55:0/1386696300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed80b2740 msgr2=0x7f8ed80c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed80b2740 0x7f8ed80c9e20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00c3c0 tx=0x7f8ecc00c880 comp rx=0 tx=0).stop 2024-04-25T08:53:56.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 -- 172.21.15.55:0/1386696300 shutdown_connections 2024-04-25T08:53:56.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ebc06b4d0 0x7f8ebc06d990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ed80d0490 0x7f8ed81619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed80ce1a0 0x7f8ed80cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 --2- 172.21.15.55:0/1386696300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed80b2740 0x7f8ed80c9e20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 -- 172.21.15.55:0/1386696300 >> 172.21.15.55:0/1386696300 conn(0x7f8ed80b5660 msgr2=0x7f8ed80b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:56.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 -- 172.21.15.55:0/1386696300 shutdown_connections 2024-04-25T08:53:56.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.721+0000 7f8edef6a640 1 -- 172.21.15.55:0/1386696300 wait complete. 2024-04-25T08:53:56.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:53:56.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.836+0000 7f58095c1640 1 Processor -- start 2024-04-25T08:53:56.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.836+0000 7f58095c1640 1 -- start start 2024-04-25T08:53:56.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.837+0000 7f58095c1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f580415bbe0 0x7f58040cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.837+0000 7f58095c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58040cf510 0x7f58040cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.837+0000 7f58095c1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58040cc830 con 0x7f58040cff00 2024-04-25T08:53:56.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.837+0000 7f58095c1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58040ccb10 con 0x7f580415bbe0 2024-04-25T08:53:56.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.837+0000 7f58095c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58040ccdf0 con 0x7f58040cf510 2024-04-25T08:53:56.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.837+0000 7f5802ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f580415bbe0 0x7f58040cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.837+0000 7f58037fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f58040cff00 0x7f58040c5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57014/0 (socket says 172.21.15.55:57014) 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.837+0000 7f58037fe640 1 -- 172.21.15.55:0/3638480750 learned_addr learned my addr 172.21.15.55:0/3638480750 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.838+0000 7f58027fc640 1 --2- 172.21.15.55:0/3638480750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58040cf510 0x7f58040cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.838+0000 7f5802ffd640 1 -- 172.21.15.55:0/3638480750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58040cf510 msgr2=0x7f58040cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.838+0000 7f5802ffd640 1 --2- 172.21.15.55:0/3638480750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58040cf510 0x7f58040cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.838+0000 7f5802ffd640 1 -- 172.21.15.55:0/3638480750 >> v1:172.21.15.55:6789/0 conn(0x7f58040cff00 legacy=0x7f58040c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.838+0000 7f5802ffd640 1 -- 172.21.15.55:0/3638480750 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58040cd0d0 con 0x7f580415bbe0 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.838+0000 7f5801ffb640 1 -- 172.21.15.55:0/3638480750 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104465369 0 0) 0x7f58040cc830 con 0x7f58040cff00 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.838+0000 7f5802ffd640 1 --2- 172.21.15.55:0/3638480750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f580415bbe0 0x7f58040cd8d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0097a0 tx=0x7f57fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30cc6c8536a022cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.838+0000 7f5801ffb640 1 -- 172.21.15.55:0/3638480750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc037070 con 0x7f580415bbe0 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.839+0000 7f5801ffb640 1 -- 172.21.15.55:0/3638480750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc032440 con 0x7f580415bbe0 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.839+0000 7f5801ffb640 1 -- 172.21.15.55:0/3638480750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc032810 con 0x7f580415bbe0 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.839+0000 7f58095c1640 1 -- 172.21.15.55:0/3638480750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f580415bbe0 msgr2=0x7f58040cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.839+0000 7f58095c1640 1 --2- 172.21.15.55:0/3638480750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f580415bbe0 0x7f58040cd8d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0097a0 tx=0x7f57fc02a180 comp rx=0 tx=0).stop 2024-04-25T08:53:56.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.839+0000 7f58095c1640 1 -- 172.21.15.55:0/3638480750 shutdown_connections 2024-04-25T08:53:56.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.839+0000 7f58095c1640 1 --2- 172.21.15.55:0/3638480750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58040cf510 0x7f58040cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.839+0000 7f58095c1640 1 --2- 172.21.15.55:0/3638480750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f580415bbe0 0x7f58040cd8d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.839+0000 7f58095c1640 1 -- 172.21.15.55:0/3638480750 >> 172.21.15.55:0/3638480750 conn(0x7f58040b3430 msgr2=0x7f58040b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:56.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.839+0000 7f58095c1640 1 -- 172.21.15.55:0/3638480750 shutdown_connections 2024-04-25T08:53:56.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.839+0000 7f58095c1640 1 -- 172.21.15.55:0/3638480750 wait complete. 2024-04-25T08:53:56.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.840+0000 7f58095c1640 1 Processor -- start 2024-04-25T08:53:56.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.841+0000 7f58095c1640 1 -- start start 2024-04-25T08:53:56.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.841+0000 7f58095c1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58040cf510 0x7f5804157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.841+0000 7f58095c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58040cff00 0x7f58040b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.841+0000 7f58095c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f580415bbe0 0x7f580415e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.841+0000 7f58095c1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58040cde10 con 0x7f58040cff00 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.841+0000 7f58095c1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580415bfc0 con 0x7f58040cf510 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.841+0000 7f58095c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58040cc450 con 0x7f580415bbe0 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.841+0000 7f58027fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58040cff00 0x7f58040b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.841+0000 7f58027fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58040cff00 0x7f58040b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48380/0 (socket says 172.21.15.55:48380) 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.841+0000 7f58027fc640 1 -- 172.21.15.55:0/246829387 learned_addr learned my addr 172.21.15.55:0/246829387 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f58037fe640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f580415bbe0 0x7f580415e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f5802ffd640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58040cf510 0x7f5804157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f58027fc640 1 -- 172.21.15.55:0/246829387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f580415bbe0 msgr2=0x7f580415e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f58027fc640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f580415bbe0 0x7f580415e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f58027fc640 1 -- 172.21.15.55:0/246829387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58040cf510 msgr2=0x7f5804157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f58027fc640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58040cf510 0x7f5804157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f58027fc640 1 -- 172.21.15.55:0/246829387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58041583f0 con 0x7f58040cff00 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f58027fc640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58040cff00 0x7f58040b1ba0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f57f800c7f0 tx=0x7f57f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f57eb7fe640 1 -- 172.21.15.55:0/246829387 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8004230 con 0x7f58040cff00 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f57eb7fe640 1 -- 172.21.15.55:0/246829387 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f80043d0 con 0x7f58040cff00 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f58095c1640 1 -- 172.21.15.55:0/246829387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58041f29f0 con 0x7f58040cff00 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f57eb7fe640 1 -- 172.21.15.55:0/246829387 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8007860 con 0x7f58040cff00 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.842+0000 7f58095c1640 1 -- 172.21.15.55:0/246829387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58040ca1b0 con 0x7f58040cff00 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.843+0000 7f58095c1640 1 -- 172.21.15.55:0/246829387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58040750b0 con 0x7f58040cff00 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.844+0000 7f57eb7fe640 1 -- 172.21.15.55:0/246829387 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f57f8007c10 con 0x7f58040cff00 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.844+0000 7f57eb7fe640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57f006b4d0 0x7f57f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.844+0000 7f57eb7fe640 1 -- 172.21.15.55:0/246829387 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57f808a300 con 0x7f58040cff00 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.844+0000 7f5802ffd640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57f006b4d0 0x7f57f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.844+0000 7f5802ffd640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57f006b4d0 0x7f57f006d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f57fc034000 tx=0x7f57fc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:56.848+0000 7f57eb7fe640 1 -- 172.21.15.55:0/246829387 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f58041583f0 con 0x7f58040cff00 2024-04-25T08:53:57.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.028+0000 7f58095c1640 1 -- 172.21.15.55:0/246829387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58040b42d0 con 0x7f58040cff00 2024-04-25T08:53:57.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.028+0000 7f57eb7fe640 1 -- 172.21.15.55:0/246829387 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f57f8015020 con 0x7f58040cff00 2024-04-25T08:53:57.019 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 -- 172.21.15.55:0/246829387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57f006b4d0 msgr2=0x7f57f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57f006b4d0 0x7f57f006d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f57fc034000 tx=0x7f57fc02e000 comp rx=0 tx=0).stop 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 -- 172.21.15.55:0/246829387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58040cff00 msgr2=0x7f58040b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58040cff00 0x7f58040b1ba0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f57f800c7f0 tx=0x7f57f800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 -- 172.21.15.55:0/246829387 shutdown_connections 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57f006b4d0 0x7f57f006d990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f580415bbe0 0x7f580415e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58040cff00 0x7f58040b1ba0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 --2- 172.21.15.55:0/246829387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58040cf510 0x7f5804157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 -- 172.21.15.55:0/246829387 >> 172.21.15.55:0/246829387 conn(0x7f58040b3430 msgr2=0x7f58040b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 -- 172.21.15.55:0/246829387 shutdown_connections 2024-04-25T08:53:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.030+0000 7f58095c1640 1 -- 172.21.15.55:0/246829387 wait complete. 2024-04-25T08:53:57.032 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:53:57.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.142+0000 7f085ff89640 1 Processor -- start 2024-04-25T08:53:57.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.142+0000 7f085ff89640 1 -- start start 2024-04-25T08:53:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.143+0000 7f085ff89640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f085815dce0 0x7f08580d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.143+0000 7f085ff89640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 0x7f08580b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.143+0000 7f085ff89640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085815e0c0 con 0x7f08580d1f90 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.143+0000 7f085ff89640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08580b7b10 con 0x7f085815dce0 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.143+0000 7f085ff89640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580d2510 con 0x7f08580d35b0 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.143+0000 7f085d524640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 0x7f08580b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.143+0000 7f085dd25640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f085815dce0 0x7f08580d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.143+0000 7f085d524640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 0x7f08580b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:51860/0 (socket says 172.21.15.55:51860) 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.143+0000 7f085d524640 1 -- 172.21.15.55:0/2009759396 learned_addr learned my addr 172.21.15.55:0/2009759396 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.143+0000 7f085e526640 1 --1- 172.21.15.55:0/2009759396 >> v1:172.21.15.167:6789/0 conn(0x7f08580d1f90 0x7f085806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58656/0 (socket says 172.21.15.55:58656) 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.144+0000 7f085d524640 1 -- 172.21.15.55:0/2009759396 >> v2:172.21.15.167:3300/0 conn(0x7f085815dce0 msgr2=0x7f08580d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.144+0000 7f085d524640 1 --2- 172.21.15.55:0/2009759396 >> v2:172.21.15.167:3300/0 conn(0x7f085815dce0 0x7f08580d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.144+0000 7f085d524640 1 -- 172.21.15.55:0/2009759396 >> v1:172.21.15.167:6789/0 conn(0x7f08580d1f90 legacy=0x7f085806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.144+0000 7f085d524640 1 -- 172.21.15.55:0/2009759396 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580d27f0 con 0x7f08580d35b0 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.144+0000 7f085d524640 1 --2- 172.21.15.55:0/2009759396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 0x7f08580b5450 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0848009870 tx=0x7f084802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83bc732c036b2164 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.145+0000 7f085cd23640 1 -- 172.21.15.55:0/2009759396 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848037070 con 0x7f08580d35b0 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.145+0000 7f085cd23640 1 -- 172.21.15.55:0/2009759396 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0848032440 con 0x7f08580d35b0 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.145+0000 7f085cd23640 1 -- 172.21.15.55:0/2009759396 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848032810 con 0x7f08580d35b0 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.145+0000 7f085ff89640 1 -- 172.21.15.55:0/2009759396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 msgr2=0x7f08580b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.145+0000 7f085ff89640 1 --2- 172.21.15.55:0/2009759396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 0x7f08580b5450 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0848009870 tx=0x7f084802a1c0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.145+0000 7f085ff89640 1 -- 172.21.15.55:0/2009759396 shutdown_connections 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.145+0000 7f085ff89640 1 --2- 172.21.15.55:0/2009759396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 0x7f08580b5450 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.145+0000 7f085ff89640 1 --2- 172.21.15.55:0/2009759396 >> v2:172.21.15.167:3300/0 conn(0x7f085815dce0 0x7f08580d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.145+0000 7f085ff89640 1 -- 172.21.15.55:0/2009759396 >> 172.21.15.55:0/2009759396 conn(0x7f0858072900 msgr2=0x7f08580d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.145+0000 7f085ff89640 1 -- 172.21.15.55:0/2009759396 shutdown_connections 2024-04-25T08:53:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.145+0000 7f085ff89640 1 -- 172.21.15.55:0/2009759396 wait complete. 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.146+0000 7f085ff89640 1 Processor -- start 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.146+0000 7f085ff89640 1 -- start start 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.147+0000 7f085ff89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d1f90 0x7f08580c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.147+0000 7f085ff89640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 0x7f085814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.147+0000 7f085ff89640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f085815dce0 0x7f0858160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.147+0000 7f085ff89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08580d3090 con 0x7f08580d1f90 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.147+0000 7f085ff89640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08580d2db0 con 0x7f085815dce0 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.147+0000 7f085ff89640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580b9820 con 0x7f08580d35b0 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.147+0000 7f085dd25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d1f90 0x7f08580c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.147+0000 7f085dd25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d1f90 0x7f08580c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48390/0 (socket says 172.21.15.55:48390) 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.147+0000 7f085dd25640 1 -- 172.21.15.55:0/3039641647 learned_addr learned my addr 172.21.15.55:0/3039641647 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.147+0000 7f085d524640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 0x7f085814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.147+0000 7f085e526640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f085815dce0 0x7f0858160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f085dd25640 1 -- 172.21.15.55:0/3039641647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 msgr2=0x7f085814ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f085dd25640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 0x7f085814ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f085dd25640 1 -- 172.21.15.55:0/3039641647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f085815dce0 msgr2=0x7f0858160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f085dd25640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f085815dce0 0x7f0858160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f085dd25640 1 -- 172.21.15.55:0/3039641647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08581574a0 con 0x7f08580d1f90 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f085d524640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 0x7f085814ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f085dd25640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d1f90 0x7f08580c7500 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f085400e9e0 tx=0x7f085400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f084e7fc640 1 -- 172.21.15.55:0/3039641647 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0854017070 con 0x7f08580d1f90 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f084e7fc640 1 -- 172.21.15.55:0/3039641647 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085400c9d0 con 0x7f08580d1f90 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f085ff89640 1 -- 172.21.15.55:0/3039641647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085814b320 con 0x7f08580d1f90 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f084e7fc640 1 -- 172.21.15.55:0/3039641647 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085400cdc0 con 0x7f08580d1f90 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.148+0000 7f085ff89640 1 -- 172.21.15.55:0/3039641647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085815ffe0 con 0x7f08580d1f90 2024-04-25T08:53:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.149+0000 7f085ff89640 1 -- 172.21.15.55:0/3039641647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08580749b0 con 0x7f08580d1f90 2024-04-25T08:53:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.150+0000 7f084e7fc640 1 -- 172.21.15.55:0/3039641647 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f085401a070 con 0x7f08580d1f90 2024-04-25T08:53:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.150+0000 7f084e7fc640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f083c06b500 0x7f083c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.150+0000 7f084e7fc640 1 -- 172.21.15.55:0/3039641647 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f085408a1f0 con 0x7f08580d1f90 2024-04-25T08:53:57.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.150+0000 7f085d524640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f083c06b500 0x7f083c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.150+0000 7f085d524640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f083c06b500 0x7f083c06d9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0848034000 tx=0x7f084802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:57.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.154+0000 7f084e7fc640 1 -- 172.21.15.55:0/3039641647 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f085814b320 con 0x7f08580d1f90 2024-04-25T08:53:57.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.374+0000 7f085ff89640 1 -- 172.21.15.55:0/3039641647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08580c7260 con 0x7f08580d1f90 2024-04-25T08:53:57.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.374+0000 7f084e7fc640 1 -- 172.21.15.55:0/3039641647 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4938 (secure 0 0 0) 0x7f0854059070 con 0x7f08580d1f90 2024-04-25T08:53:57.364 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:57.365 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1710920573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1710920573},{"type":"v1","addr":"172.21.15.167:6834","nonce":1710920573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3883943704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3883943704},{"type":"v1","addr":"172.21.15.55:6836","nonce":3883943704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1410084850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1410084850},{"type":"v1","addr":"172.21.15.55:6837","nonce":1410084850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:53:42.558115+0000","modified":"2024-04-25T08:53:44.566698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/3753268738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3753268738},{"type":"v1","addr":"172.21.15.167:6835","nonce":3753268738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:53:57.365 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-04-25T08:53:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 -- 172.21.15.55:0/3039641647 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f083c06b500 msgr2=0x7f083c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f083c06b500 0x7f083c06d9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0848034000 tx=0x7f084802e000 comp rx=0 tx=0).stop 2024-04-25T08:53:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 -- 172.21.15.55:0/3039641647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d1f90 msgr2=0x7f08580c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d1f90 0x7f08580c7500 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f085400e9e0 tx=0x7f085400eea0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 -- 172.21.15.55:0/3039641647 shutdown_connections 2024-04-25T08:53:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f083c06b500 0x7f083c06d9c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f085815dce0 0x7f0858160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08580d35b0 0x7f085814ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 --2- 172.21.15.55:0/3039641647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d1f90 0x7f08580c7500 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 -- 172.21.15.55:0/3039641647 >> 172.21.15.55:0/3039641647 conn(0x7f0858072900 msgr2=0x7f08580b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 -- 172.21.15.55:0/3039641647 shutdown_connections 2024-04-25T08:53:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.376+0000 7f085ff89640 1 -- 172.21.15.55:0/3039641647 wait complete. 2024-04-25T08:53:57.377 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.491+0000 7f4e95717640 1 Processor -- start 2024-04-25T08:53:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.491+0000 7f4e95717640 1 -- start start 2024-04-25T08:53:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e95717640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4e9015dce0 0x7f4e900d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e95717640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e900d35b0 0x7f4e900b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e95717640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9015e0c0 con 0x7f4e900d1f90 2024-04-25T08:53:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e95717640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e900b7b10 con 0x7f4e900d35b0 2024-04-25T08:53:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e95717640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e900d2510 con 0x7f4e9015dce0 2024-04-25T08:53:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e8e7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e900d35b0 0x7f4e900b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e8e7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e900d35b0 0x7f4e900b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48398/0 (socket says 172.21.15.55:48398) 2024-04-25T08:53:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e8e7fc640 1 -- 172.21.15.55:0/1805442249 learned_addr learned my addr 172.21.15.55:0/1805442249 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e8effd640 1 --2- 172.21.15.55:0/1805442249 >> v2:172.21.15.167:3300/0 conn(0x7f4e9015dce0 0x7f4e900d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e8e7fc640 1 -- 172.21.15.55:0/1805442249 >> v2:172.21.15.167:3300/0 conn(0x7f4e9015dce0 msgr2=0x7f4e900d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e8e7fc640 1 --2- 172.21.15.55:0/1805442249 >> v2:172.21.15.167:3300/0 conn(0x7f4e9015dce0 0x7f4e900d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e8e7fc640 1 -- 172.21.15.55:0/1805442249 >> v1:172.21.15.167:6789/0 conn(0x7f4e900d1f90 legacy=0x7f4e9006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.492+0000 7f4e8e7fc640 1 -- 172.21.15.55:0/1805442249 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e900d27f0 con 0x7f4e900d35b0 2024-04-25T08:53:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.493+0000 7f4e8e7fc640 1 --2- 172.21.15.55:0/1805442249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e900d35b0 0x7f4e900b5450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e900ce220 tx=0x7f4e7802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343df90f505da5de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.493+0000 7f4e8dffb640 1 -- 172.21.15.55:0/1805442249 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78037070 con 0x7f4e900d35b0 2024-04-25T08:53:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.493+0000 7f4e8dffb640 1 -- 172.21.15.55:0/1805442249 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e78032440 con 0x7f4e900d35b0 2024-04-25T08:53:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.493+0000 7f4e8dffb640 1 -- 172.21.15.55:0/1805442249 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78032810 con 0x7f4e900d35b0 2024-04-25T08:53:57.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.494+0000 7f4e95717640 1 -- 172.21.15.55:0/1805442249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e900d35b0 msgr2=0x7f4e900b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.494+0000 7f4e95717640 1 --2- 172.21.15.55:0/1805442249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e900d35b0 0x7f4e900b5450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e900ce220 tx=0x7f4e7802a230 comp rx=0 tx=0).stop 2024-04-25T08:53:57.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.494+0000 7f4e95717640 1 -- 172.21.15.55:0/1805442249 shutdown_connections 2024-04-25T08:53:57.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.494+0000 7f4e95717640 1 --2- 172.21.15.55:0/1805442249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e900d35b0 0x7f4e900b5450 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.494+0000 7f4e95717640 1 --2- 172.21.15.55:0/1805442249 >> v2:172.21.15.167:3300/0 conn(0x7f4e9015dce0 0x7f4e900d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.494+0000 7f4e95717640 1 -- 172.21.15.55:0/1805442249 >> 172.21.15.55:0/1805442249 conn(0x7f4e90072900 msgr2=0x7f4e900d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:57.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.494+0000 7f4e95717640 1 -- 172.21.15.55:0/1805442249 shutdown_connections 2024-04-25T08:53:57.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.494+0000 7f4e95717640 1 -- 172.21.15.55:0/1805442249 wait complete. 2024-04-25T08:53:57.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.495+0000 7f4e95717640 1 Processor -- start 2024-04-25T08:53:57.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.495+0000 7f4e95717640 1 -- start start 2024-04-25T08:53:57.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e95717640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e900d1f90 0x7f4e900c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e95717640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e900d35b0 0x7f4e90152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e95717640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e9015dce0 0x7f4e900cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e95717640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900d3090 con 0x7f4e9015dce0 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e95717640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900d2db0 con 0x7f4e900d1f90 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e95717640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900b9820 con 0x7f4e900d35b0 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e9015dce0 0x7f4e900cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e9015dce0 0x7f4e900cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48400/0 (socket says 172.21.15.55:48400) 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e8f7fe640 1 -- 172.21.15.55:0/1662531381 learned_addr learned my addr 172.21.15.55:0/1662531381 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e8effd640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e900d1f90 0x7f4e900c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e8e7fc640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e900d35b0 0x7f4e90152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e8f7fe640 1 -- 172.21.15.55:0/1662531381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e900d35b0 msgr2=0x7f4e90152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e8f7fe640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e900d35b0 0x7f4e90152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e8f7fe640 1 -- 172.21.15.55:0/1662531381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e900d1f90 msgr2=0x7f4e900c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e8f7fe640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e900d1f90 0x7f4e900c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e8f7fe640 1 -- 172.21.15.55:0/1662531381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e900ca320 con 0x7f4e9015dce0 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.496+0000 7f4e8effd640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e900d1f90 0x7f4e900c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.497+0000 7f4e8f7fe640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e9015dce0 0x7f4e900cc090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000c780 tx=0x7f4e8000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.497+0000 7f4e877fe640 1 -- 172.21.15.55:0/1662531381 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80004b60 con 0x7f4e9015dce0 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.497+0000 7f4e877fe640 1 -- 172.21.15.55:0/1662531381 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e80004d00 con 0x7f4e9015dce0 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.497+0000 7f4e95717640 1 -- 172.21.15.55:0/1662531381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e900c7a30 con 0x7f4e9015dce0 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.497+0000 7f4e877fe640 1 -- 172.21.15.55:0/1662531381 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000aa90 con 0x7f4e9015dce0 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.497+0000 7f4e95717640 1 -- 172.21.15.55:0/1662531381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9015f6d0 con 0x7f4e9015dce0 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.498+0000 7f4e95717640 1 -- 172.21.15.55:0/1662531381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e900749b0 con 0x7f4e9015dce0 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.498+0000 7f4e877fe640 1 -- 172.21.15.55:0/1662531381 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4e8000ac30 con 0x7f4e9015dce0 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.499+0000 7f4e877fe640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e7006b4d0 0x7f4e7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.499+0000 7f4e877fe640 1 -- 172.21.15.55:0/1662531381 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e8008a6e0 con 0x7f4e9015dce0 2024-04-25T08:53:57.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.499+0000 7f4e8effd640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e7006b4d0 0x7f4e7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.499+0000 7f4e8effd640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e7006b4d0 0x7f4e7006d990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4e88006fd0 tx=0x7f4e88008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:57.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.503+0000 7f4e877fe640 1 -- 172.21.15.55:0/1662531381 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e800595f0 con 0x7f4e9015dce0 2024-04-25T08:53:57.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.686+0000 7f4e95717640 1 -- 172.21.15.55:0/1662531381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e900b8740 con 0x7f4e9015dce0 2024-04-25T08:53:57.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.687+0000 7f4e877fe640 1 -- 172.21.15.55:0/1662531381 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f4e80058ef0 con 0x7f4e9015dce0 2024-04-25T08:53:57.677 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:57.677 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 -- 172.21.15.55:0/1662531381 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e7006b4d0 msgr2=0x7f4e7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e7006b4d0 0x7f4e7006d990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4e88006fd0 tx=0x7f4e88008040 comp rx=0 tx=0).stop 2024-04-25T08:53:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 -- 172.21.15.55:0/1662531381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e9015dce0 msgr2=0x7f4e900cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e9015dce0 0x7f4e900cc090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000c780 tx=0x7f4e8000cc40 comp rx=0 tx=0).stop 2024-04-25T08:53:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 -- 172.21.15.55:0/1662531381 shutdown_connections 2024-04-25T08:53:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e7006b4d0 0x7f4e7006d990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e9015dce0 0x7f4e900cc090 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e900d35b0 0x7f4e90152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 --2- 172.21.15.55:0/1662531381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e900d1f90 0x7f4e900c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 -- 172.21.15.55:0/1662531381 >> 172.21.15.55:0/1662531381 conn(0x7f4e90072900 msgr2=0x7f4e900b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 -- 172.21.15.55:0/1662531381 shutdown_connections 2024-04-25T08:53:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.689+0000 7f4e95717640 1 -- 172.21.15.55:0/1662531381 wait complete. 2024-04-25T08:53:57.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:53:57.691 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:53:57.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.804+0000 7f13f65b7640 1 Processor -- start 2024-04-25T08:53:57.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.804+0000 7f13f65b7640 1 -- start start 2024-04-25T08:53:57.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.804+0000 7f13f65b7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13f00b98b0 0x7f13f015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.804+0000 7f13f65b7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f015f080 con 0x7f13f00b5a30 2024-04-25T08:53:57.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.804+0000 7f13f65b7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f006c4b0 con 0x7f13f00b5580 2024-04-25T08:53:57.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.804+0000 7f13f65b7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f015bb80 con 0x7f13f00b98b0 2024-04-25T08:53:57.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.804+0000 7f13effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13f00b98b0 0x7f13f015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.805+0000 7f13effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13f00b98b0 0x7f13f015eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48408/0 (socket says 172.21.15.55:48408) 2024-04-25T08:53:57.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.805+0000 7f13f4b54640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f13f00b5a30 0x7f13f00b2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57030/0 (socket says 172.21.15.55:57030) 2024-04-25T08:53:57.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.805+0000 7f13effff640 1 -- 172.21.15.55:0/2492359308 learned_addr learned my addr 172.21.15.55:0/2492359308 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:57.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.805+0000 7f13eeffd640 1 -- 172.21.15.55:0/2492359308 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783940919 0 0) 0x7f13f015f080 con 0x7f13f00b5a30 2024-04-25T08:53:57.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.805+0000 7f13eeffd640 1 -- 172.21.15.55:0/2492359308 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13d8003520 con 0x7f13f00b5a30 2024-04-25T08:53:57.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.805+0000 7f13effff640 1 -- 172.21.15.55:0/2492359308 >> v1:172.21.15.167:6789/0 conn(0x7f13f00b5580 legacy=0x7f13f00b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.805+0000 7f13effff640 1 -- 172.21.15.55:0/2492359308 >> v1:172.21.15.55:6789/0 conn(0x7f13f00b5a30 legacy=0x7f13f00b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.805+0000 7f13effff640 1 -- 172.21.15.55:0/2492359308 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f006c790 con 0x7f13f00b98b0 2024-04-25T08:53:57.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.806+0000 7f13effff640 1 --2- 172.21.15.55:0/2492359308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13f00b98b0 0x7f13f015eb40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009870 tx=0x7f13e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529ab22789e3113f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:57.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.806+0000 7f13eeffd640 1 -- 172.21.15.55:0/2492359308 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0037070 con 0x7f13f00b98b0 2024-04-25T08:53:57.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.806+0000 7f13eeffd640 1 -- 172.21.15.55:0/2492359308 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e0032440 con 0x7f13f00b98b0 2024-04-25T08:53:57.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.806+0000 7f13eeffd640 1 -- 172.21.15.55:0/2492359308 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0032810 con 0x7f13f00b98b0 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.806+0000 7f13f65b7640 1 -- 172.21.15.55:0/2492359308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13f00b98b0 msgr2=0x7f13f015eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.806+0000 7f13f65b7640 1 --2- 172.21.15.55:0/2492359308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13f00b98b0 0x7f13f015eb40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009870 tx=0x7f13e002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.806+0000 7f13f65b7640 1 -- 172.21.15.55:0/2492359308 shutdown_connections 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.806+0000 7f13f65b7640 1 --2- 172.21.15.55:0/2492359308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13f00b98b0 0x7f13f015eb40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.806+0000 7f13f65b7640 1 -- 172.21.15.55:0/2492359308 >> 172.21.15.55:0/2492359308 conn(0x7f13f00d0580 msgr2=0x7f13f00d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.806+0000 7f13f65b7640 1 -- 172.21.15.55:0/2492359308 shutdown_connections 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.806+0000 7f13f65b7640 1 -- 172.21.15.55:0/2492359308 wait complete. 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.807+0000 7f13f65b7640 1 Processor -- start 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.808+0000 7f13f65b7640 1 -- start start 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.808+0000 7f13f65b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13f00b5580 0x7f13f01599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.808+0000 7f13f65b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13f00b5a30 0x7f13f0159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.808+0000 7f13f65b7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13f01e74d0 0x7f13f01e7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.808+0000 7f13f65b7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f00b5e60 con 0x7f13f01e74d0 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.808+0000 7f13f65b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f006cd50 con 0x7f13f00b5a30 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.808+0000 7f13f65b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f006c140 con 0x7f13f00b5580 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.808+0000 7f13f4b54640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13f01e74d0 0x7f13f01e7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.808+0000 7f13f4b54640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13f01e74d0 0x7f13f01e7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48412/0 (socket says 172.21.15.55:48412) 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.808+0000 7f13f4b54640 1 -- 172.21.15.55:0/1316515333 learned_addr learned my addr 172.21.15.55:0/1316515333 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13effff640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13f00b5580 0x7f13f01599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13ef7fe640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13f00b5a30 0x7f13f0159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13f4b54640 1 -- 172.21.15.55:0/1316515333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13f00b5580 msgr2=0x7f13f01599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13f4b54640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13f00b5580 0x7f13f01599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13f4b54640 1 -- 172.21.15.55:0/1316515333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13f00b5a30 msgr2=0x7f13f0159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13f4b54640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13f00b5a30 0x7f13f0159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13f4b54640 1 -- 172.21.15.55:0/1316515333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f00cc620 con 0x7f13f01e74d0 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13f4b54640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13f01e74d0 0x7f13f01e7950 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f13e800c7c0 tx=0x7f13e800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13ecff9640 1 -- 172.21.15.55:0/1316515333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8017070 con 0x7f13f01e74d0 2024-04-25T08:53:57.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13ecff9640 1 -- 172.21.15.55:0/1316515333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e800a640 con 0x7f13f01e74d0 2024-04-25T08:53:57.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13f65b7640 1 -- 172.21.15.55:0/1316515333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f00cc900 con 0x7f13f01e74d0 2024-04-25T08:53:57.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13ecff9640 1 -- 172.21.15.55:0/1316515333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e800aa10 con 0x7f13f01e74d0 2024-04-25T08:53:57.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.809+0000 7f13f65b7640 1 -- 172.21.15.55:0/1316515333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f00c7d90 con 0x7f13f01e74d0 2024-04-25T08:53:57.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.810+0000 7f13f65b7640 1 -- 172.21.15.55:0/1316515333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f00750b0 con 0x7f13f01e74d0 2024-04-25T08:53:57.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.811+0000 7f13ecff9640 1 -- 172.21.15.55:0/1316515333 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f13e801a070 con 0x7f13f01e74d0 2024-04-25T08:53:57.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.811+0000 7f13ecff9640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13dc06b500 0x7f13dc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:57.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.811+0000 7f13effff640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13dc06b500 0x7f13dc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:57.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.811+0000 7f13ecff9640 1 -- 172.21.15.55:0/1316515333 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13e8089840 con 0x7f13f01e74d0 2024-04-25T08:53:57.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.812+0000 7f13effff640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13dc06b500 0x7f13dc06d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f13e0034000 tx=0x7f13e002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:57.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.816+0000 7f13ecff9640 1 -- 172.21.15.55:0/1316515333 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f13e8058070 con 0x7f13f01e74d0 2024-04-25T08:53:57.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.995+0000 7f13f65b7640 1 -- 172.21.15.55:0/1316515333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13f0162460 con 0x7f13f01e74d0 2024-04-25T08:53:57.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.996+0000 7f13ecff9640 1 -- 172.21.15.55:0/1316515333 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13e805c110 con 0x7f13f01e74d0 2024-04-25T08:53:57.986 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:53:57.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 -- 172.21.15.55:0/1316515333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13dc06b500 msgr2=0x7f13dc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13dc06b500 0x7f13dc06d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f13e0034000 tx=0x7f13e002e000 comp rx=0 tx=0).stop 2024-04-25T08:53:57.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 -- 172.21.15.55:0/1316515333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13f01e74d0 msgr2=0x7f13f01e7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:57.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13f01e74d0 0x7f13f01e7950 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f13e800c7c0 tx=0x7f13e800cc80 comp rx=0 tx=0).stop 2024-04-25T08:53:57.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 -- 172.21.15.55:0/1316515333 shutdown_connections 2024-04-25T08:53:57.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f13dc06b500 0x7f13dc06d9c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13f01e74d0 0x7f13f01e7950 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13f00b5a30 0x7f13f0159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 --2- 172.21.15.55:0/1316515333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13f00b5580 0x7f13f01599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:57.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 -- 172.21.15.55:0/1316515333 >> 172.21.15.55:0/1316515333 conn(0x7f13f00d0580 msgr2=0x7f13f00d32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:57.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 -- 172.21.15.55:0/1316515333 shutdown_connections 2024-04-25T08:53:57.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:57.998+0000 7f13f65b7640 1 -- 172.21.15.55:0/1316515333 wait complete. 2024-04-25T08:53:57.999 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:53:58.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.112+0000 7f1048cdd640 1 Processor -- start 2024-04-25T08:53:58.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.112+0000 7f1048cdd640 1 -- start start 2024-04-25T08:53:58.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.113+0000 7f1048cdd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f104415dc80 0x7f1044161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.113+0000 7f1048cdd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f10440b97c0 0x7f10440b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.113+0000 7f1048cdd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10440b5a30 0x7f104406bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.113+0000 7f1048cdd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10440b5e60 con 0x7f10440b97c0 2024-04-25T08:53:58.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.113+0000 7f1048cdd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10441627a0 con 0x7f104415dc80 2024-04-25T08:53:58.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.113+0000 7f1048cdd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10441621e0 con 0x7f10440b5a30 2024-04-25T08:53:58.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.113+0000 7f1041d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f10440b97c0 0x7f10440b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.113+0000 7f1041d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f10440b97c0 0x7f10440b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48418/0 (socket says 172.21.15.55:48418) 2024-04-25T08:53:58.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.113+0000 7f1041d9b640 1 -- 172.21.15.55:0/4038032074 learned_addr learned my addr 172.21.15.55:0/4038032074 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:58.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.114+0000 7f104259c640 1 --2- 172.21.15.55:0/4038032074 >> v2:172.21.15.167:3300/0 conn(0x7f104415dc80 0x7f1044161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.114+0000 7f1042d9d640 1 --2- 172.21.15.55:0/4038032074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10440b5a30 0x7f104406bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.114+0000 7f1041d9b640 1 -- 172.21.15.55:0/4038032074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10440b5a30 msgr2=0x7f104406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:58.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.114+0000 7f1041d9b640 1 --2- 172.21.15.55:0/4038032074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10440b5a30 0x7f104406bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.114+0000 7f1041d9b640 1 -- 172.21.15.55:0/4038032074 >> v2:172.21.15.167:3300/0 conn(0x7f104415dc80 msgr2=0x7f1044161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:58.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.114+0000 7f1041d9b640 1 --2- 172.21.15.55:0/4038032074 >> v2:172.21.15.167:3300/0 conn(0x7f104415dc80 0x7f1044161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.114+0000 7f1041d9b640 1 -- 172.21.15.55:0/4038032074 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10441624c0 con 0x7f10440b97c0 2024-04-25T08:53:58.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.114+0000 7f1041d9b640 1 --2- 172.21.15.55:0/4038032074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10440b97c0 0x7f10440b54f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f104406dab0 tx=0x7f103802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f619e69c66336c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:58.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.114+0000 7f104159a640 1 -- 172.21.15.55:0/4038032074 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038037070 con 0x7f10440b97c0 2024-04-25T08:53:58.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.115+0000 7f104159a640 1 -- 172.21.15.55:0/4038032074 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1038032440 con 0x7f10440b97c0 2024-04-25T08:53:58.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.115+0000 7f104159a640 1 -- 172.21.15.55:0/4038032074 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038032810 con 0x7f10440b97c0 2024-04-25T08:53:58.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.115+0000 7f1048cdd640 1 -- 172.21.15.55:0/4038032074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10440b97c0 msgr2=0x7f10440b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.115+0000 7f1048cdd640 1 --2- 172.21.15.55:0/4038032074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10440b97c0 0x7f10440b54f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f104406dab0 tx=0x7f103802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.115+0000 7f1048cdd640 1 -- 172.21.15.55:0/4038032074 shutdown_connections 2024-04-25T08:53:58.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.115+0000 7f1048cdd640 1 --2- 172.21.15.55:0/4038032074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10440b5a30 0x7f104406bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.115+0000 7f1048cdd640 1 --2- 172.21.15.55:0/4038032074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10440b97c0 0x7f10440b54f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.115+0000 7f1048cdd640 1 --2- 172.21.15.55:0/4038032074 >> v2:172.21.15.167:3300/0 conn(0x7f104415dc80 0x7f1044161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.115+0000 7f1048cdd640 1 -- 172.21.15.55:0/4038032074 >> 172.21.15.55:0/4038032074 conn(0x7f10440d04f0 msgr2=0x7f10440d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.115+0000 7f1048cdd640 1 -- 172.21.15.55:0/4038032074 shutdown_connections 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.115+0000 7f1048cdd640 1 -- 172.21.15.55:0/4038032074 wait complete. 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.117+0000 7f1048cdd640 1 Processor -- start 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.117+0000 7f1048cdd640 1 -- start start 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.117+0000 7f1048cdd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10440b5a30 0x7f104415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.117+0000 7f1048cdd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10440b97c0 0x7f1044149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.117+0000 7f1048cdd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f104415dc80 0x7f1044149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.117+0000 7f1048cdd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1044161db0 con 0x7f10440b5a30 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.117+0000 7f1048cdd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104415e060 con 0x7f104415dc80 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.117+0000 7f1048cdd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1044161f30 con 0x7f10440b97c0 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.117+0000 7f104259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10440b5a30 0x7f104415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.117+0000 7f104259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10440b5a30 0x7f104415fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48428/0 (socket says 172.21.15.55:48428) 2024-04-25T08:53:58.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.117+0000 7f104259c640 1 -- 172.21.15.55:0/2141019111 learned_addr learned my addr 172.21.15.55:0/2141019111 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f1042d9d640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f104415dc80 0x7f1044149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f1041d9b640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10440b97c0 0x7f1044149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f104259c640 1 -- 172.21.15.55:0/2141019111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10440b97c0 msgr2=0x7f1044149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f104259c640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10440b97c0 0x7f1044149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f104259c640 1 -- 172.21.15.55:0/2141019111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f104415dc80 msgr2=0x7f1044149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f104259c640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f104415dc80 0x7f1044149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f104259c640 1 -- 172.21.15.55:0/2141019111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10440cd990 con 0x7f10440b5a30 2024-04-25T08:53:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f1041d9b640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10440b97c0 0x7f1044149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f1042d9d640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f104415dc80 0x7f1044149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f104259c640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10440b5a30 0x7f104415fcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f103c00d5f0 tx=0x7f103c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f1032ffd640 1 -- 172.21.15.55:0/2141019111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c0125f0 con 0x7f10440b5a30 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f1032ffd640 1 -- 172.21.15.55:0/2141019111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103c019070 con 0x7f10440b5a30 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f1032ffd640 1 -- 172.21.15.55:0/2141019111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c0129d0 con 0x7f10440b5a30 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f1048cdd640 1 -- 172.21.15.55:0/2141019111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104415f1f0 con 0x7f10440b5a30 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.118+0000 7f1048cdd640 1 -- 172.21.15.55:0/2141019111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10441495c0 con 0x7f10440b5a30 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.119+0000 7f1048cdd640 1 -- 172.21.15.55:0/2141019111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10440d0e00 con 0x7f10440b5a30 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.119+0000 7f1032ffd640 1 -- 172.21.15.55:0/2141019111 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f103c012b70 con 0x7f10440b5a30 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.120+0000 7f1032ffd640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102406b4d0 0x7f102406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.120+0000 7f1032ffd640 1 -- 172.21.15.55:0/2141019111 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f103c08a530 con 0x7f10440b5a30 2024-04-25T08:53:58.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.120+0000 7f1041d9b640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102406b4d0 0x7f102406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.120+0000 7f1041d9b640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102406b4d0 0x7f102406d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1038034000 tx=0x7f103802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:58.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.124+0000 7f1032ffd640 1 -- 172.21.15.55:0/2141019111 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10440d0e00 con 0x7f10440b5a30 2024-04-25T08:53:58.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.306+0000 7f1048cdd640 1 -- 172.21.15.55:0/2141019111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10440750b0 con 0x7f10440b5a30 2024-04-25T08:53:58.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.307+0000 7f1032ffd640 1 -- 172.21.15.55:0/2141019111 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f103c059440 con 0x7f10440b5a30 2024-04-25T08:53:58.297 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:53:58.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 -- 172.21.15.55:0/2141019111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102406b4d0 msgr2=0x7f102406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102406b4d0 0x7f102406d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1038034000 tx=0x7f103802e000 comp rx=0 tx=0).stop 2024-04-25T08:53:58.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 -- 172.21.15.55:0/2141019111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10440b5a30 msgr2=0x7f104415fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10440b5a30 0x7f104415fcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f103c00d5f0 tx=0x7f103c00dab0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 -- 172.21.15.55:0/2141019111 shutdown_connections 2024-04-25T08:53:58.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102406b4d0 0x7f102406d990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f104415dc80 0x7f1044149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10440b97c0 0x7f1044149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 --2- 172.21.15.55:0/2141019111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10440b5a30 0x7f104415fcd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 -- 172.21.15.55:0/2141019111 >> 172.21.15.55:0/2141019111 conn(0x7f10440d04f0 msgr2=0x7f10440b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:58.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 -- 172.21.15.55:0/2141019111 shutdown_connections 2024-04-25T08:53:58.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.309+0000 7f1048cdd640 1 -- 172.21.15.55:0/2141019111 wait complete. 2024-04-25T08:53:58.310 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:53:58.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.424+0000 7f625ae5d640 1 Processor -- start 2024-04-25T08:53:58.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.424+0000 7f625ae5d640 1 -- start start 2024-04-25T08:53:58.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.425+0000 7f625ae5d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62540b5c70 0x7f6254168830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.425+0000 7f625ae5d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62540b7b80 con 0x7f625415dbb0 2024-04-25T08:53:58.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.425+0000 7f625ae5d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62540d2670 con 0x7f62540b9720 2024-04-25T08:53:58.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.425+0000 7f625ae5d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62540d2950 con 0x7f62540b5c70 2024-04-25T08:53:58.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.425+0000 7f6258bf9640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f625415dbb0 0x7f62540d1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57038/0 (socket says 172.21.15.55:57038) 2024-04-25T08:53:58.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.425+0000 7f6258bf9640 1 -- 172.21.15.55:0/1033261424 learned_addr learned my addr 172.21.15.55:0/1033261424 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:58.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.425+0000 7f62593fa640 1 --2- 172.21.15.55:0/1033261424 >> v2:172.21.15.55:3300/0 conn(0x7f62540b5c70 0x7f6254168830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.426+0000 7f62593fa640 1 -- 172.21.15.55:0/1033261424 >> v1:172.21.15.167:6789/0 conn(0x7f62540b9720 legacy=0x7f62540b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.426+0000 7f62593fa640 1 -- 172.21.15.55:0/1033261424 >> v1:172.21.15.55:6789/0 conn(0x7f625415dbb0 legacy=0x7f62540d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.426+0000 7f62593fa640 1 -- 172.21.15.55:0/1033261424 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540d2c30 con 0x7f62540b5c70 2024-04-25T08:53:58.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.426+0000 7f62593fa640 1 --2- 172.21.15.55:0/1033261424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62540b5c70 0x7f6254168830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f624c009d90 tx=0x7f624c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c457963793332c6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:58.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.426+0000 7f62537fe640 1 -- 172.21.15.55:0/1033261424 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c007740 con 0x7f62540b5c70 2024-04-25T08:53:58.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.426+0000 7f62537fe640 1 -- 172.21.15.55:0/1033261424 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c0078e0 con 0x7f62540b5c70 2024-04-25T08:53:58.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.426+0000 7f62537fe640 1 -- 172.21.15.55:0/1033261424 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c007cb0 con 0x7f62540b5c70 2024-04-25T08:53:58.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.427+0000 7f625ae5d640 1 -- 172.21.15.55:0/1033261424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62540b5c70 msgr2=0x7f6254168830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.427+0000 7f625ae5d640 1 --2- 172.21.15.55:0/1033261424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62540b5c70 0x7f6254168830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f624c009d90 tx=0x7f624c02a660 comp rx=0 tx=0).stop 2024-04-25T08:53:58.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.427+0000 7f625ae5d640 1 -- 172.21.15.55:0/1033261424 shutdown_connections 2024-04-25T08:53:58.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.427+0000 7f625ae5d640 1 --2- 172.21.15.55:0/1033261424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62540b5c70 0x7f6254168830 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.427+0000 7f625ae5d640 1 -- 172.21.15.55:0/1033261424 >> 172.21.15.55:0/1033261424 conn(0x7f62540d0560 msgr2=0x7f62540d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:58.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.427+0000 7f625ae5d640 1 -- 172.21.15.55:0/1033261424 shutdown_connections 2024-04-25T08:53:58.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.427+0000 7f625ae5d640 1 -- 172.21.15.55:0/1033261424 wait complete. 2024-04-25T08:53:58.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.428+0000 7f625ae5d640 1 Processor -- start 2024-04-25T08:53:58.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.428+0000 7f625ae5d640 1 -- start start 2024-04-25T08:53:58.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.429+0000 7f625ae5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62540b5c70 0x7f62541e3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.429+0000 7f625ae5d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62540b9720 0x7f6254154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.429+0000 7f625ae5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f625415dbb0 0x7f62540ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.429+0000 7f625ae5d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625415df90 con 0x7f62540b5c70 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.429+0000 7f625ae5d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62540d31f0 con 0x7f62540b9720 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.429+0000 7f625ae5d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625415e110 con 0x7f625415dbb0 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.429+0000 7f6258bf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62540b5c70 0x7f62541e3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.429+0000 7f6258bf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62540b5c70 0x7f62541e3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48456/0 (socket says 172.21.15.55:48456) 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.429+0000 7f6258bf9640 1 -- 172.21.15.55:0/3001184598 learned_addr learned my addr 172.21.15.55:0/3001184598 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f6258bf9640 1 -- 172.21.15.55:0/3001184598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f625415dbb0 msgr2=0x7f62540ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f6258bf9640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f625415dbb0 0x7f62540ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f6253fff640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62540b9720 0x7f6254154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f6258bf9640 1 -- 172.21.15.55:0/3001184598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62540b9720 msgr2=0x7f6254154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f6258bf9640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62540b9720 0x7f6254154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f6258bf9640 1 -- 172.21.15.55:0/3001184598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62541e3140 con 0x7f62540b5c70 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f6258bf9640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62540b5c70 0x7f62541e3ec0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f624400c480 tx=0x7f624400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:58.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f62517fa640 1 -- 172.21.15.55:0/3001184598 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6244017070 con 0x7f62540b5c70 2024-04-25T08:53:58.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f62517fa640 1 -- 172.21.15.55:0/3001184598 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6244005ce0 con 0x7f62540b5c70 2024-04-25T08:53:58.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f625ae5d640 1 -- 172.21.15.55:0/3001184598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62541e33e0 con 0x7f62540b5c70 2024-04-25T08:53:58.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f62517fa640 1 -- 172.21.15.55:0/3001184598 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440072f0 con 0x7f62540b5c70 2024-04-25T08:53:58.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.430+0000 7f625ae5d640 1 -- 172.21.15.55:0/3001184598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62541e39a0 con 0x7f62540b5c70 2024-04-25T08:53:58.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.431+0000 7f625ae5d640 1 -- 172.21.15.55:0/3001184598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62540750b0 con 0x7f62540b5c70 2024-04-25T08:53:58.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.431+0000 7f62517fa640 1 -- 172.21.15.55:0/3001184598 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f624401a070 con 0x7f62540b5c70 2024-04-25T08:53:58.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.432+0000 7f62517fa640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f624006b4d0 0x7f624006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.432+0000 7f62517fa640 1 -- 172.21.15.55:0/3001184598 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62440893f0 con 0x7f62540b5c70 2024-04-25T08:53:58.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.432+0000 7f6253fff640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f624006b4d0 0x7f624006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.432+0000 7f6253fff640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f624006b4d0 0x7f624006d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f62540b5910 tx=0x7f6248009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:58.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.436+0000 7f62517fa640 1 -- 172.21.15.55:0/3001184598 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6244057cb0 con 0x7f62540b5c70 2024-04-25T08:53:58.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.617+0000 7f625ae5d640 1 -- 172.21.15.55:0/3001184598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f625415c350 con 0x7f62540b5c70 2024-04-25T08:53:58.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.618+0000 7f62517fa640 1 -- 172.21.15.55:0/3001184598 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f624405bd50 con 0x7f62540b5c70 2024-04-25T08:53:58.608 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:53:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 -- 172.21.15.55:0/3001184598 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f624006b4d0 msgr2=0x7f624006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f624006b4d0 0x7f624006d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f62540b5910 tx=0x7f6248009040 comp rx=0 tx=0).stop 2024-04-25T08:53:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 -- 172.21.15.55:0/3001184598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62540b5c70 msgr2=0x7f62541e3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62540b5c70 0x7f62541e3ec0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f624400c480 tx=0x7f624400c940 comp rx=0 tx=0).stop 2024-04-25T08:53:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 -- 172.21.15.55:0/3001184598 shutdown_connections 2024-04-25T08:53:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f624006b4d0 0x7f624006d990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f625415dbb0 0x7f62540ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62540b9720 0x7f6254154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 --2- 172.21.15.55:0/3001184598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62540b5c70 0x7f62541e3ec0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 -- 172.21.15.55:0/3001184598 >> 172.21.15.55:0/3001184598 conn(0x7f62540d0560 msgr2=0x7f625415caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:58.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 -- 172.21.15.55:0/3001184598 shutdown_connections 2024-04-25T08:53:58.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.620+0000 7f625ae5d640 1 -- 172.21.15.55:0/3001184598 wait complete. 2024-04-25T08:53:58.620 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:53:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.731+0000 7f5741db0640 1 Processor -- start 2024-04-25T08:53:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.731+0000 7f5741db0640 1 -- start start 2024-04-25T08:53:58.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f5741db0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f573c15dce0 0x7f573c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f5741db0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c15e0c0 con 0x7f573c0d35b0 2024-04-25T08:53:58.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f5741db0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c0d2510 con 0x7f573c0b5b60 2024-04-25T08:53:58.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f5741db0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c0d27f0 con 0x7f573c15dce0 2024-04-25T08:53:58.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f573b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f573c15dce0 0x7f573c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f573affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f573c0d35b0 0x7f573c0b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55818/0 (socket says 172.21.15.55:55818) 2024-04-25T08:53:58.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f573affd640 1 -- 172.21.15.55:0/4182851242 learned_addr learned my addr 172.21.15.55:0/4182851242 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:53:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f573b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f573c15dce0 0x7f573c0d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49556/0 (socket says 172.21.15.55:49556) 2024-04-25T08:53:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f573b7fe640 1 -- 172.21.15.55:0/4182851242 >> v1:172.21.15.167:6789/0 conn(0x7f573c0b5b60 legacy=0x7f573c0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f573b7fe640 1 -- 172.21.15.55:0/4182851242 >> v1:172.21.15.55:6789/0 conn(0x7f573c0d35b0 legacy=0x7f573c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f573a7fc640 1 -- 172.21.15.55:0/4182851242 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787863375 0 0) 0x7f573c15e0c0 con 0x7f573c0d35b0 2024-04-25T08:53:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.732+0000 7f573b7fe640 1 -- 172.21.15.55:0/4182851242 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c0d2ad0 con 0x7f573c15dce0 2024-04-25T08:53:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.733+0000 7f573b7fe640 1 --2- 172.21.15.55:0/4182851242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c15dce0 0x7f573c0d1a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f572c0097a0 tx=0x7f572c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15288eb2debf3019 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.733+0000 7f573a7fc640 1 -- 172.21.15.55:0/4182851242 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c037070 con 0x7f573c15dce0 2024-04-25T08:53:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.733+0000 7f573a7fc640 1 -- 172.21.15.55:0/4182851242 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c032440 con 0x7f573c15dce0 2024-04-25T08:53:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.733+0000 7f573a7fc640 1 -- 172.21.15.55:0/4182851242 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c032810 con 0x7f573c15dce0 2024-04-25T08:53:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.734+0000 7f5741db0640 1 -- 172.21.15.55:0/4182851242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c15dce0 msgr2=0x7f573c0d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.734+0000 7f5741db0640 1 --2- 172.21.15.55:0/4182851242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c15dce0 0x7f573c0d1a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f572c0097a0 tx=0x7f572c02a230 comp rx=0 tx=0).stop 2024-04-25T08:53:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.734+0000 7f5741db0640 1 -- 172.21.15.55:0/4182851242 shutdown_connections 2024-04-25T08:53:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.734+0000 7f5741db0640 1 --2- 172.21.15.55:0/4182851242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c15dce0 0x7f573c0d1a50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.734+0000 7f5741db0640 1 -- 172.21.15.55:0/4182851242 >> 172.21.15.55:0/4182851242 conn(0x7f573c072900 msgr2=0x7f573c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.734+0000 7f5741db0640 1 -- 172.21.15.55:0/4182851242 shutdown_connections 2024-04-25T08:53:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.734+0000 7f5741db0640 1 -- 172.21.15.55:0/4182851242 wait complete. 2024-04-25T08:53:58.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.735+0000 7f5741db0640 1 Processor -- start 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.735+0000 7f5741db0640 1 -- start start 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f5741db0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c0b5b60 0x7f573c160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f5741db0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c0d35b0 0x7f573c1e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f5741db0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f573c15dce0 0x7f573c14cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f5741db0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0b9820 con 0x7f573c0b5b60 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f5741db0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0d3090 con 0x7f573c15dce0 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f5741db0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0b99a0 con 0x7f573c0d35b0 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c0b5b60 0x7f573c160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c0b5b60 0x7f573c160810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49566/0 (socket says 172.21.15.55:49566) 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573b7fe640 1 -- 172.21.15.55:0/2921570594 learned_addr learned my addr 172.21.15.55:0/2921570594 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573affd640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c0d35b0 0x7f573c1e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573bfff640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f573c15dce0 0x7f573c14cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573b7fe640 1 -- 172.21.15.55:0/2921570594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c0d35b0 msgr2=0x7f573c1e98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573b7fe640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c0d35b0 0x7f573c1e98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573b7fe640 1 -- 172.21.15.55:0/2921570594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f573c15dce0 msgr2=0x7f573c14cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573b7fe640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f573c15dce0 0x7f573c14cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573b7fe640 1 -- 172.21.15.55:0/2921570594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c1e9f20 con 0x7f573c0b5b60 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573bfff640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f573c15dce0 0x7f573c14cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f573b7fe640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c0b5b60 0x7f573c160810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f572c000c00 tx=0x7f572c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f5723fff640 1 -- 172.21.15.55:0/2921570594 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c037040 con 0x7f573c0b5b60 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f5723fff640 1 -- 172.21.15.55:0/2921570594 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c042070 con 0x7f573c0b5b60 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f5741db0640 1 -- 172.21.15.55:0/2921570594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c1ea200 con 0x7f573c0b5b60 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.736+0000 7f5723fff640 1 -- 172.21.15.55:0/2921570594 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c030a70 con 0x7f573c0b5b60 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.737+0000 7f5741db0640 1 -- 172.21.15.55:0/2921570594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c1ea7c0 con 0x7f573c0b5b60 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.737+0000 7f5741db0640 1 -- 172.21.15.55:0/2921570594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c0749b0 con 0x7f573c0b5b60 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.738+0000 7f5723fff640 1 -- 172.21.15.55:0/2921570594 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f572c030c10 con 0x7f573c0b5b60 2024-04-25T08:53:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.738+0000 7f5723fff640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 0x7f572806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:58.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.738+0000 7f5723fff640 1 -- 172.21.15.55:0/2921570594 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f572c0aac30 con 0x7f573c0b5b60 2024-04-25T08:53:58.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.738+0000 7f573affd640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 0x7f572806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:58.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.739+0000 7f573affd640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 0x7f572806d9c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f573c15bf30 tx=0x7f5730009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:58.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.742+0000 7f5723fff640 1 -- 172.21.15.55:0/2921570594 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f572c079b40 con 0x7f573c0b5b60 2024-04-25T08:53:58.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.962+0000 7f5741db0640 1 -- 172.21.15.55:0/2921570594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f573c0d1280 con 0x7f573c0b5b60 2024-04-25T08:53:58.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.962+0000 7f5723fff640 1 -- 172.21.15.55:0/2921570594 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4938 (secure 0 0 0) 0x7f572c079440 con 0x7f573c0b5b60 2024-04-25T08:53:58.953 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:58.953 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1710920573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1710920573},{"type":"v1","addr":"172.21.15.167:6834","nonce":1710920573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3883943704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3883943704},{"type":"v1","addr":"172.21.15.55:6836","nonce":3883943704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1410084850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1410084850},{"type":"v1","addr":"172.21.15.55:6837","nonce":1410084850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:53:42.558115+0000","modified":"2024-04-25T08:53:44.566698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/3753268738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3753268738},{"type":"v1","addr":"172.21.15.167:6835","nonce":3753268738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:53:58.955 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-04-25T08:53:58.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 -- 172.21.15.55:0/2921570594 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 msgr2=0x7f572806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 0x7f572806d9c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f573c15bf30 tx=0x7f5730009040 comp rx=0 tx=0).stop 2024-04-25T08:53:58.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 -- 172.21.15.55:0/2921570594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c0b5b60 msgr2=0x7f573c160810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:58.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c0b5b60 0x7f573c160810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f572c000c00 tx=0x7f572c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 -- 172.21.15.55:0/2921570594 shutdown_connections 2024-04-25T08:53:58.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 0x7f572806d9c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f573c15dce0 0x7f573c14cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c0d35b0 0x7f573c1e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 --2- 172.21.15.55:0/2921570594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c0b5b60 0x7f573c160810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:58.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 -- 172.21.15.55:0/2921570594 >> 172.21.15.55:0/2921570594 conn(0x7f573c072900 msgr2=0x7f573c0d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:58.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 -- 172.21.15.55:0/2921570594 shutdown_connections 2024-04-25T08:53:58.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:58.964+0000 7f5741db0640 1 -- 172.21.15.55:0/2921570594 wait complete. 2024-04-25T08:53:58.966 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:53:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.077+0000 7fc953df9640 1 Processor -- start 2024-04-25T08:53:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.077+0000 7fc953df9640 1 -- start start 2024-04-25T08:53:59.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc953df9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc94c15ba10 0x7fc94c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc953df9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc94c06c3c0 0x7fc94c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc953df9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c06c900 con 0x7fc94c099f80 2024-04-25T08:53:59.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc953df9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c0cbe50 con 0x7fc94c06c3c0 2024-04-25T08:53:59.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc953df9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c09a3d0 con 0x7fc94c15ba10 2024-04-25T08:53:59.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc952396640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc94c06c3c0 0x7fc94c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc952396640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc94c06c3c0 0x7fc94c0cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49580/0 (socket says 172.21.15.55:49580) 2024-04-25T08:53:59.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc952396640 1 -- 172.21.15.55:0/246230041 learned_addr learned my addr 172.21.15.55:0/246230041 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:59.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc951b95640 1 --2- 172.21.15.55:0/246230041 >> v2:172.21.15.167:3300/0 conn(0x7fc94c15ba10 0x7fc94c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc952396640 1 -- 172.21.15.55:0/246230041 >> v2:172.21.15.167:3300/0 conn(0x7fc94c15ba10 msgr2=0x7fc94c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:59.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc952396640 1 --2- 172.21.15.55:0/246230041 >> v2:172.21.15.167:3300/0 conn(0x7fc94c15ba10 0x7fc94c099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc952396640 1 -- 172.21.15.55:0/246230041 >> v1:172.21.15.167:6789/0 conn(0x7fc94c099f80 legacy=0x7fc94c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.078+0000 7fc952396640 1 -- 172.21.15.55:0/246230041 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c06cbe0 con 0x7fc94c06c3c0 2024-04-25T08:53:59.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.079+0000 7fc952396640 1 --2- 172.21.15.55:0/246230041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c06c3c0 0x7fc94c0cd220 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc94c09b2f0 tx=0x7fc94402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a1638c549b2b39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.079+0000 7fc950b93640 1 -- 172.21.15.55:0/246230041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944036070 con 0x7fc94c06c3c0 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.079+0000 7fc950b93640 1 -- 172.21.15.55:0/246230041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc944031600 con 0x7fc94c06c3c0 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.079+0000 7fc950b93640 1 -- 172.21.15.55:0/246230041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440319d0 con 0x7fc94c06c3c0 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.080+0000 7fc953df9640 1 -- 172.21.15.55:0/246230041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c06c3c0 msgr2=0x7fc94c0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.080+0000 7fc953df9640 1 --2- 172.21.15.55:0/246230041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c06c3c0 0x7fc94c0cd220 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc94c09b2f0 tx=0x7fc94402a730 comp rx=0 tx=0).stop 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.080+0000 7fc953df9640 1 -- 172.21.15.55:0/246230041 shutdown_connections 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.080+0000 7fc953df9640 1 --2- 172.21.15.55:0/246230041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c06c3c0 0x7fc94c0cd220 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.080+0000 7fc953df9640 1 --2- 172.21.15.55:0/246230041 >> v2:172.21.15.167:3300/0 conn(0x7fc94c15ba10 0x7fc94c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.080+0000 7fc953df9640 1 -- 172.21.15.55:0/246230041 >> 172.21.15.55:0/246230041 conn(0x7fc94c0b32f0 msgr2=0x7fc94c0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.080+0000 7fc953df9640 1 -- 172.21.15.55:0/246230041 shutdown_connections 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.080+0000 7fc953df9640 1 -- 172.21.15.55:0/246230041 wait complete. 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.081+0000 7fc953df9640 1 Processor -- start 2024-04-25T08:53:59.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.081+0000 7fc953df9640 1 -- start start 2024-04-25T08:53:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc953df9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c06c3c0 0x7fc94c14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc953df9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc94c099f80 0x7fc94c149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc953df9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc94c15ba10 0x7fc94c1f8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc953df9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0cd760 con 0x7fc94c06c3c0 2024-04-25T08:53:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc953df9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0cfe80 con 0x7fc94c15ba10 2024-04-25T08:53:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc953df9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0cd8e0 con 0x7fc94c099f80 2024-04-25T08:53:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc951b95640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c06c3c0 0x7fc94c14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc951b95640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c06c3c0 0x7fc94c14fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49584/0 (socket says 172.21.15.55:49584) 2024-04-25T08:53:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc951b95640 1 -- 172.21.15.55:0/1686807774 learned_addr learned my addr 172.21.15.55:0/1686807774 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc952396640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc94c15ba10 0x7fc94c1f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc951394640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc94c099f80 0x7fc94c149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc951b95640 1 -- 172.21.15.55:0/1686807774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc94c099f80 msgr2=0x7fc94c149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc951b95640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc94c099f80 0x7fc94c149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc951b95640 1 -- 172.21.15.55:0/1686807774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc94c15ba10 msgr2=0x7fc94c1f8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc951b95640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc94c15ba10 0x7fc94c1f8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc951b95640 1 -- 172.21.15.55:0/1686807774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c0c7cb0 con 0x7fc94c06c3c0 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc951b95640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c06c3c0 0x7fc94c14fe10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc94800e870 tx=0x7fc94800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc9427fc640 1 -- 172.21.15.55:0/1686807774 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948017070 con 0x7fc94c06c3c0 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc9427fc640 1 -- 172.21.15.55:0/1686807774 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94800c940 con 0x7fc94c06c3c0 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc953df9640 1 -- 172.21.15.55:0/1686807774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c0c7f90 con 0x7fc94c06c3c0 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc9427fc640 1 -- 172.21.15.55:0/1686807774 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94800cd30 con 0x7fc94c06c3c0 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.082+0000 7fc953df9640 1 -- 172.21.15.55:0/1686807774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c1f7d70 con 0x7fc94c06c3c0 2024-04-25T08:53:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.083+0000 7fc953df9640 1 -- 172.21.15.55:0/1686807774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c0749b0 con 0x7fc94c06c3c0 2024-04-25T08:53:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.084+0000 7fc9427fc640 1 -- 172.21.15.55:0/1686807774 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc94801a070 con 0x7fc94c06c3c0 2024-04-25T08:53:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.084+0000 7fc9427fc640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93006b4d0 0x7fc93006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.084+0000 7fc9427fc640 1 -- 172.21.15.55:0/1686807774 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc94808a3f0 con 0x7fc94c06c3c0 2024-04-25T08:53:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.084+0000 7fc951394640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93006b4d0 0x7fc93006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.085+0000 7fc951394640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93006b4d0 0x7fc93006d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc94c1f77a0 tx=0x7fc93c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:59.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.089+0000 7fc9427fc640 1 -- 172.21.15.55:0/1686807774 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc948059300 con 0x7fc94c06c3c0 2024-04-25T08:53:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.272+0000 7fc953df9640 1 -- 172.21.15.55:0/1686807774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc94c09a570 con 0x7fc94c06c3c0 2024-04-25T08:53:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.273+0000 7fc9427fc640 1 -- 172.21.15.55:0/1686807774 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fc948058c00 con 0x7fc94c06c3c0 2024-04-25T08:53:59.263 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:59.264 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:53:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 -- 172.21.15.55:0/1686807774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93006b4d0 msgr2=0x7fc93006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93006b4d0 0x7fc93006d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc94c1f77a0 tx=0x7fc93c009040 comp rx=0 tx=0).stop 2024-04-25T08:53:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 -- 172.21.15.55:0/1686807774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c06c3c0 msgr2=0x7fc94c14fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c06c3c0 0x7fc94c14fe10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc94800e870 tx=0x7fc94800ed30 comp rx=0 tx=0).stop 2024-04-25T08:53:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 -- 172.21.15.55:0/1686807774 shutdown_connections 2024-04-25T08:53:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93006b4d0 0x7fc93006d990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc94c15ba10 0x7fc94c1f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc94c099f80 0x7fc94c149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 --2- 172.21.15.55:0/1686807774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c06c3c0 0x7fc94c14fe10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 -- 172.21.15.55:0/1686807774 >> 172.21.15.55:0/1686807774 conn(0x7fc94c0b32f0 msgr2=0x7fc94c15ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 -- 172.21.15.55:0/1686807774 shutdown_connections 2024-04-25T08:53:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.275+0000 7fc953df9640 1 -- 172.21.15.55:0/1686807774 wait complete. 2024-04-25T08:53:59.276 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:53:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.389+0000 7fa929f61640 1 Processor -- start 2024-04-25T08:53:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.389+0000 7fa929f61640 1 -- start start 2024-04-25T08:53:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.389+0000 7fa929f61640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa9240d35b0 0x7fa9240b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.389+0000 7fa929f61640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9240b5990 0x7fa9240b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.389+0000 7fa929f61640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92415e0c0 con 0x7fa92415dce0 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.389+0000 7fa929f61640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9240d2510 con 0x7fa9240d35b0 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.389+0000 7fa929f61640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240d27f0 con 0x7fa9240b5990 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.390+0000 7fa922ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa9240d35b0 0x7fa9240b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.390+0000 7fa923fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9240b5990 0x7fa9240b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.390+0000 7fa922ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa9240d35b0 0x7fa9240b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:56582/0 (socket says 172.21.15.55:56582) 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.390+0000 7fa922ffd640 1 -- 172.21.15.55:0/3522777963 learned_addr learned my addr 172.21.15.55:0/3522777963 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.390+0000 7fa923fff640 1 -- 172.21.15.55:0/3522777963 >> v2:172.21.15.167:3300/0 conn(0x7fa9240d35b0 msgr2=0x7fa9240b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.390+0000 7fa923fff640 1 --2- 172.21.15.55:0/3522777963 >> v2:172.21.15.167:3300/0 conn(0x7fa9240d35b0 0x7fa9240b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.390+0000 7fa923fff640 1 -- 172.21.15.55:0/3522777963 >> v1:172.21.15.167:6789/0 conn(0x7fa92415dce0 legacy=0x7fa9240d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.390+0000 7fa923fff640 1 -- 172.21.15.55:0/3522777963 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9240d2ad0 con 0x7fa9240b5990 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.390+0000 7fa922ffd640 1 --2- 172.21.15.55:0/3522777963 >> v2:172.21.15.167:3300/0 conn(0x7fa9240d35b0 0x7fa9240b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.391+0000 7fa923fff640 1 --2- 172.21.15.55:0/3522777963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9240b5990 0x7fa9240b6b00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009d90 tx=0x7fa91c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7938e8d2a9990a95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.391+0000 7fa9227fc640 1 -- 172.21.15.55:0/3522777963 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c007740 con 0x7fa9240b5990 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.391+0000 7fa9227fc640 1 -- 172.21.15.55:0/3522777963 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c0078e0 con 0x7fa9240b5990 2024-04-25T08:53:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.391+0000 7fa9227fc640 1 -- 172.21.15.55:0/3522777963 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c007cb0 con 0x7fa9240b5990 2024-04-25T08:53:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.392+0000 7fa929f61640 1 -- 172.21.15.55:0/3522777963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9240b5990 msgr2=0x7fa9240b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.392+0000 7fa929f61640 1 --2- 172.21.15.55:0/3522777963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9240b5990 0x7fa9240b6b00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009d90 tx=0x7fa91c02a660 comp rx=0 tx=0).stop 2024-04-25T08:53:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.392+0000 7fa929f61640 1 -- 172.21.15.55:0/3522777963 shutdown_connections 2024-04-25T08:53:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.392+0000 7fa929f61640 1 --2- 172.21.15.55:0/3522777963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9240b5990 0x7fa9240b6b00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.392+0000 7fa929f61640 1 --2- 172.21.15.55:0/3522777963 >> v2:172.21.15.167:3300/0 conn(0x7fa9240d35b0 0x7fa9240b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.392+0000 7fa929f61640 1 -- 172.21.15.55:0/3522777963 >> 172.21.15.55:0/3522777963 conn(0x7fa924072900 msgr2=0x7fa9240d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.392+0000 7fa929f61640 1 -- 172.21.15.55:0/3522777963 shutdown_connections 2024-04-25T08:53:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.392+0000 7fa929f61640 1 -- 172.21.15.55:0/3522777963 wait complete. 2024-04-25T08:53:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.393+0000 7fa929f61640 1 Processor -- start 2024-04-25T08:53:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.393+0000 7fa929f61640 1 -- start start 2024-04-25T08:53:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa929f61640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9240b5990 0x7fa9240cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa929f61640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9240d35b0 0x7fa924158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa929f61640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa92415dce0 0x7fa9240b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa929f61640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240d2160 con 0x7fa92415dce0 2024-04-25T08:53:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa929f61640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240d3090 con 0x7fa9240d35b0 2024-04-25T08:53:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa929f61640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240cd8a0 con 0x7fa9240b5990 2024-04-25T08:53:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa923fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa92415dce0 0x7fa9240b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa923fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa92415dce0 0x7fa9240b7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49598/0 (socket says 172.21.15.55:49598) 2024-04-25T08:53:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa923fff640 1 -- 172.21.15.55:0/3194085309 learned_addr learned my addr 172.21.15.55:0/3194085309 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:53:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa9237fe640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9240b5990 0x7fa9240cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa922ffd640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9240d35b0 0x7fa924158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa923fff640 1 -- 172.21.15.55:0/3194085309 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9240b5990 msgr2=0x7fa9240cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa923fff640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9240b5990 0x7fa9240cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa923fff640 1 -- 172.21.15.55:0/3194085309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9240d35b0 msgr2=0x7fa924158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa923fff640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9240d35b0 0x7fa924158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa923fff640 1 -- 172.21.15.55:0/3194085309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9240c8b60 con 0x7fa92415dce0 2024-04-25T08:53:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa922ffd640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9240d35b0 0x7fa924158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.394+0000 7fa923fff640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa92415dce0 0x7fa9240b7cb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa91c02ac50 tx=0x7fa91c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.395+0000 7fa90bfff640 1 -- 172.21.15.55:0/3194085309 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c040070 con 0x7fa92415dce0 2024-04-25T08:53:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.395+0000 7fa90bfff640 1 -- 172.21.15.55:0/3194085309 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c031c60 con 0x7fa92415dce0 2024-04-25T08:53:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.395+0000 7fa929f61640 1 -- 172.21.15.55:0/3194085309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9240c7ac0 con 0x7fa92415dce0 2024-04-25T08:53:59.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.395+0000 7fa90bfff640 1 -- 172.21.15.55:0/3194085309 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c009450 con 0x7fa92415dce0 2024-04-25T08:53:59.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.395+0000 7fa929f61640 1 -- 172.21.15.55:0/3194085309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9240c8080 con 0x7fa92415dce0 2024-04-25T08:53:59.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.396+0000 7fa929f61640 1 -- 172.21.15.55:0/3194085309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9240749b0 con 0x7fa92415dce0 2024-04-25T08:53:59.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.396+0000 7fa90bfff640 1 -- 172.21.15.55:0/3194085309 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa91c039040 con 0x7fa92415dce0 2024-04-25T08:53:59.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.397+0000 7fa90bfff640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa91006b4d0 0x7fa91006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:59.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.397+0000 7fa90bfff640 1 -- 172.21.15.55:0/3194085309 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa91c0ab650 con 0x7fa92415dce0 2024-04-25T08:53:59.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.397+0000 7fa9237fe640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa91006b4d0 0x7fa91006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:59.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.397+0000 7fa9237fe640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa91006b4d0 0x7fa91006d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa914007fd0 tx=0x7fa914009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:59.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.401+0000 7fa90bfff640 1 -- 172.21.15.55:0/3194085309 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa91c07a4c0 con 0x7fa92415dce0 2024-04-25T08:53:59.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.618+0000 7fa929f61640 1 -- 172.21.15.55:0/3194085309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa92415a440 con 0x7fa92415dce0 2024-04-25T08:53:59.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.619+0000 7fa90bfff640 1 -- 172.21.15.55:0/3194085309 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4938 (secure 0 0 0) 0x7fa91c079dc0 con 0x7fa92415dce0 2024-04-25T08:53:59.609 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:53:59.609 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1710920573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1710920573},{"type":"v1","addr":"172.21.15.167:6834","nonce":1710920573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3883943704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3883943704},{"type":"v1","addr":"172.21.15.55:6836","nonce":3883943704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1410084850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1410084850},{"type":"v1","addr":"172.21.15.55:6837","nonce":1410084850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:53:42.558115+0000","modified":"2024-04-25T08:53:44.566698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/3753268738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3753268738},{"type":"v1","addr":"172.21.15.167:6835","nonce":3753268738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:53:59.609 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-04-25T08:53:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.620+0000 7fa929f61640 1 -- 172.21.15.55:0/3194085309 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa91006b4d0 msgr2=0x7fa91006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.620+0000 7fa929f61640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa91006b4d0 0x7fa91006d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa914007fd0 tx=0x7fa914009040 comp rx=0 tx=0).stop 2024-04-25T08:53:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.620+0000 7fa929f61640 1 -- 172.21.15.55:0/3194085309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa92415dce0 msgr2=0x7fa9240b7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.620+0000 7fa929f61640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa92415dce0 0x7fa9240b7cb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa91c02ac50 tx=0x7fa91c004a40 comp rx=0 tx=0).stop 2024-04-25T08:53:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.621+0000 7fa929f61640 1 -- 172.21.15.55:0/3194085309 shutdown_connections 2024-04-25T08:53:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.621+0000 7fa929f61640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa91006b4d0 0x7fa91006d990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.621+0000 7fa929f61640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa92415dce0 0x7fa9240b7cb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.621+0000 7fa929f61640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9240d35b0 0x7fa924158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.621+0000 7fa929f61640 1 --2- 172.21.15.55:0/3194085309 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9240b5990 0x7fa9240cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.621+0000 7fa929f61640 1 -- 172.21.15.55:0/3194085309 >> 172.21.15.55:0/3194085309 conn(0x7fa924072900 msgr2=0x7fa9240b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.621+0000 7fa929f61640 1 -- 172.21.15.55:0/3194085309 shutdown_connections 2024-04-25T08:53:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:53:59.621+0000 7fa929f61640 1 -- 172.21.15.55:0/3194085309 wait complete. 2024-04-25T08:54:00.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:53:42.558115+0000', 'modified': '2024-04-25T08:53:44.566698+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6835/3753268738', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6833', 'nonce': 3753268738}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 3753268738}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:54:00.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:54:00.025 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T08:54:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.141+0000 7f5e77389640 1 Processor -- start 2024-04-25T08:54:00.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.142+0000 7f5e77389640 1 -- start start 2024-04-25T08:54:00.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.142+0000 7f5e77389640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e700d0b60 0x7f5e70168950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.142+0000 7f5e77389640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e700d2a20 con 0x7f5e700d24b0 2024-04-25T08:54:00.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.142+0000 7f5e77389640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e700d2d00 con 0x7f5e7015dec0 2024-04-25T08:54:00.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.142+0000 7f5e77389640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700d2fe0 con 0x7f5e700d0b60 2024-04-25T08:54:00.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e74924640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5e700d24b0 0x7f5e700d0450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55820/0 (socket says 172.21.15.55:55820) 2024-04-25T08:54:00.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e74924640 1 -- 172.21.15.55:0/1041275981 learned_addr learned my addr 172.21.15.55:0/1041275981 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:00.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e75926640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e700d0b60 0x7f5e70168950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181862769 0 0) 0x7f5e700d2a20 con 0x7f5e700d24b0 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e5c003520 con 0x7f5e700d24b0 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1112152399 0 0) 0x7f5e5c003520 con 0x7f5e700d24b0 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e700d0b60 msgr2=0x7f5e70168950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e700d0b60 0x7f5e70168950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 >> v1:172.21.15.167:6789/0 conn(0x7f5e7015dec0 legacy=0x7f5e700d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e700d32c0 con 0x7f5e700d24b0 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f5e60001670 con 0x7f5e700d24b0 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 >> v1:172.21.15.55:6789/0 conn(0x7f5e700d24b0 legacy=0x7f5e700d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e700d0b60 0x7f5e5c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e5c003f60 0x7f5e5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e5c004d40 0x7f5e5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700d2fe0 con 0x7f5e5c004d40 2024-04-25T08:54:00.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c00baa0 con 0x7f5e5c003f60 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c00bca0 con 0x7f5e700d0b60 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e75926640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e5c004d40 0x7f5e5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e75125640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e700d0b60 0x7f5e5c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.143+0000 7f5e74924640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e5c003f60 0x7f5e5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.144+0000 7f5e75926640 1 -- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e700d0b60 msgr2=0x7f5e5c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.144+0000 7f5e75926640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e700d0b60 0x7f5e5c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.144+0000 7f5e75926640 1 -- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e5c003f60 msgr2=0x7f5e5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.144+0000 7f5e75926640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e5c003f60 0x7f5e5c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.144+0000 7f5e75926640 1 -- 172.21.15.55:0/1041275981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c003520 con 0x7f5e5c004d40 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.144+0000 7f5e74924640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e5c003f60 0x7f5e5c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.144+0000 7f5e75926640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e5c004d40 0x7f5e5c0051c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009fc0 tx=0x7f5e5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddad96b5e87ab9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.144+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c009c10 con 0x7f5e5c004d40 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.144+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c036070 con 0x7f5e5c004d40 2024-04-25T08:54:00.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.144+0000 7f5e67fff640 1 -- 172.21.15.55:0/1041275981 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c031880 con 0x7f5e5c004d40 2024-04-25T08:54:00.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.145+0000 7f5e77389640 1 -- 172.21.15.55:0/1041275981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e5c004d40 msgr2=0x7f5e5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.145+0000 7f5e77389640 1 --2- 172.21.15.55:0/1041275981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e5c004d40 0x7f5e5c0051c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009fc0 tx=0x7f5e5c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:00.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.145+0000 7f5e75926640 1 -- 172.21.15.55:0/1041275981 reap_dead start 2024-04-25T08:54:00.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.145+0000 7f5e77389640 1 -- 172.21.15.55:0/1041275981 shutdown_connections 2024-04-25T08:54:00.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.145+0000 7f5e77389640 1 -- 172.21.15.55:0/1041275981 >> 172.21.15.55:0/1041275981 conn(0x7f5e70072900 msgr2=0x7f5e700b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:00.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.145+0000 7f5e77389640 1 -- 172.21.15.55:0/1041275981 shutdown_connections 2024-04-25T08:54:00.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.145+0000 7f5e77389640 1 -- 172.21.15.55:0/1041275981 wait complete. 2024-04-25T08:54:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.146+0000 7f5e77389640 1 Processor -- start 2024-04-25T08:54:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.146+0000 7f5e77389640 1 -- start start 2024-04-25T08:54:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.147+0000 7f5e77389640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e701f2d80 0x7f5e7015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.147+0000 7f5e77389640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e701f3160 0x7f5e701f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.147+0000 7f5e77389640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e7015fe90 0x7f5e70160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.147+0000 7f5e77389640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700b8020 con 0x7f5e701f3160 2024-04-25T08:54:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.147+0000 7f5e77389640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700b7ea0 con 0x7f5e701f2d80 2024-04-25T08:54:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.147+0000 7f5e77389640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700b81a0 con 0x7f5e7015fe90 2024-04-25T08:54:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.147+0000 7f5e74924640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e701f3160 0x7f5e701f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.147+0000 7f5e74924640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e701f3160 0x7f5e701f4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49610/0 (socket says 172.21.15.55:49610) 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.147+0000 7f5e74924640 1 -- 172.21.15.55:0/3877916857 learned_addr learned my addr 172.21.15.55:0/3877916857 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.147+0000 7f5e75125640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e701f2d80 0x7f5e7015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.147+0000 7f5e75926640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e7015fe90 0x7f5e70160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.148+0000 7f5e74924640 1 -- 172.21.15.55:0/3877916857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e7015fe90 msgr2=0x7f5e70160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.148+0000 7f5e74924640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e7015fe90 0x7f5e70160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.148+0000 7f5e74924640 1 -- 172.21.15.55:0/3877916857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e701f2d80 msgr2=0x7f5e7015e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.148+0000 7f5e74924640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e701f2d80 0x7f5e7015e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.148+0000 7f5e74924640 1 -- 172.21.15.55:0/3877916857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7015e9a0 con 0x7f5e701f3160 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.148+0000 7f5e74924640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e701f3160 0x7f5e701f4130 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000e870 tx=0x7f5e6000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.148+0000 7f5e65ffb640 1 -- 172.21.15.55:0/3877916857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000c8d0 con 0x7f5e701f3160 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.148+0000 7f5e65ffb640 1 -- 172.21.15.55:0/3877916857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e60018070 con 0x7f5e701f3160 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.148+0000 7f5e65ffb640 1 -- 172.21.15.55:0/3877916857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000ccb0 con 0x7f5e701f3160 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.148+0000 7f5e77389640 1 -- 172.21.15.55:0/3877916857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7015ec80 con 0x7f5e701f3160 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.148+0000 7f5e77389640 1 -- 172.21.15.55:0/3877916857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7015f240 con 0x7f5e701f3160 2024-04-25T08:54:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.149+0000 7f5e65ffb640 1 -- 172.21.15.55:0/3877916857 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e6001d460 con 0x7f5e701f3160 2024-04-25T08:54:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.150+0000 7f5e65ffb640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5e5406b4d0 0x7f5e5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.150+0000 7f5e65ffb640 1 -- 172.21.15.55:0/3877916857 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e6008a010 con 0x7f5e701f3160 2024-04-25T08:54:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.150+0000 7f5e75125640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5e5406b4d0 0x7f5e5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.150+0000 7f5e75125640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5e5406b4d0 0x7f5e5406d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5e680017e0 tx=0x7f5e68009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.151+0000 7f5e7a16a740 1 Processor -- start 2024-04-25T08:54:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.151+0000 7f5e7a16a740 1 -- start start 2024-04-25T08:54:00.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x55792229b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5579222b8ad0 0x5579222b9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557922270f10 0x5579222b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579221d3a10 con 0x55792229b230 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55792217cb30 con 0x557922270f10 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579221cfc50 con 0x5579222b8ad0 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e75125640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x55792229b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e75125640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x55792229b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49612/0 (socket says 172.21.15.55:49612) 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e75125640 1 -- 172.21.15.55:0/3272803237 learned_addr learned my addr 172.21.15.55:0/3272803237 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e75125640 1 -- 172.21.15.55:0/3272803237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5579222b8ad0 msgr2=0x5579222b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e75125640 1 --2- 172.21.15.55:0/3272803237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5579222b8ad0 0x5579222b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e75125640 1 -- 172.21.15.55:0/3272803237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557922270f10 msgr2=0x5579222b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e75125640 1 --2- 172.21.15.55:0/3272803237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557922270f10 0x5579222b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e75125640 1 -- 172.21.15.55:0/3272803237 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557922191e10 con 0x55792229b230 2024-04-25T08:54:00.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e75125640 1 --2- 172.21.15.55:0/3272803237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x55792229b610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e68012c10 tx=0x7f5e68015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8faff77d1484e010 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e52ffd640 1 -- 172.21.15.55:0/3272803237 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68019070 con 0x55792229b230 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e52ffd640 1 -- 172.21.15.55:0/3272803237 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e68026070 con 0x55792229b230 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.152+0000 7f5e52ffd640 1 -- 172.21.15.55:0/3272803237 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68015b40 con 0x55792229b230 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.153+0000 7f5e7a16a740 1 -- 172.21.15.55:0/3272803237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 msgr2=0x55792229b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.153+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/3272803237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x55792229b610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e68012c10 tx=0x7f5e68015000 comp rx=0 tx=0).stop 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.153+0000 7f5e7a16a740 1 -- 172.21.15.55:0/3272803237 shutdown_connections 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.153+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/3272803237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557922270f10 0x5579222b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.153+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/3272803237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5579222b8ad0 0x5579222b9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.153+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/3272803237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x55792229b610 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.153+0000 7f5e7a16a740 1 -- 172.21.15.55:0/3272803237 >> 172.21.15.55:0/3272803237 conn(0x55792226d840 msgr2=0x5579222b6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.153+0000 7f5e7a16a740 1 -- 172.21.15.55:0/3272803237 shutdown_connections 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.153+0000 7f5e7a16a740 1 -- 172.21.15.55:0/3272803237 wait complete. 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.153+0000 7f5e7a16a740 1 -- start start 2024-04-25T08:54:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.154+0000 7f5e7a16a740 1 Processor -- start 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.154+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x557922298f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.154+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5579222b8ad0 0x5579222b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.154+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x55792229df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.154+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557922271cb0 con 0x55792229b230 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.154+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579221900c0 con 0x5579222b13d0 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.154+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55792226b770 con 0x5579222b8ad0 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.154+0000 7f5e7a16a740 10 client.0 _ll_register_callbacks cb 0x557922183ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e75125640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x557922298f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e75125640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x557922298f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49624/0 (socket says 172.21.15.55:49624) 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e75125640 1 -- 172.21.15.55:0/230890410 learned_addr learned my addr 172.21.15.55:0/230890410 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e75926640 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x55792229df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e75125640 1 -- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5579222b8ad0 msgr2=0x5579222b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e74924640 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5579222b8ad0 0x5579222b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e75125640 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5579222b8ad0 0x5579222b0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e75125640 1 -- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 msgr2=0x55792229df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e75125640 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x55792229df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e75125640 1 -- 172.21.15.55:0/230890410 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557921ee82d0 con 0x55792229b230 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e75926640 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x55792229df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e75125640 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x557922298f50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5e68015810 tx=0x7f5e68001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b5f95d9b364b04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e4bfff640 1 -- 172.21.15.55:0/230890410 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68019030 con 0x55792229b230 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e4bfff640 1 -- 172.21.15.55:0/230890410 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e680218a0 con 0x55792229b230 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e7a16a740 1 -- 172.21.15.55:0/230890410 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e68026070 con 0x55792229b230 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e4bfff640 1 -- 172.21.15.55:0/230890410 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e6803c050 con 0x55792229b230 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e7a16a740 10 client.4695 fetch_fsmap learned FSMap version 6 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.155+0000 7f5e7a16a740 1 -- 172.21.15.55:0/230890410 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x557921fb26b0 con 0x55792229b230 2024-04-25T08:54:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.156+0000 7f5e4bfff640 1 -- 172.21.15.55:0/230890410 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e68026070 con 0x55792229b230 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.156+0000 7f5e4bfff640 1 -- 172.21.15.55:0/230890410 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5e6803f020 con 0x55792229b230 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.156+0000 7f5e7a16a740 10 client.4695 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.156+0000 7f5e7a16a740 10 client.4695 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.156+0000 7f5e7a16a740 20 client.4695 populate_metadata read hostname 'smithi055' 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.156+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:6833/3753268738,v1:172.21.15.167:6835/3753268738] conn(0x5579222b3550 0x5579222b3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.156+0000 7f5e7a16a740 4 client.4695 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.156+0000 7f5e7a16a740 1 -- 172.21.15.55:0/230890410 --> [v2:172.21.15.167:6833/3753268738,v1:172.21.15.167:6835/3753268738] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557922232920 con 0x5579222b3550 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.156+0000 7f5e74924640 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:6833/3753268738,v1:172.21.15.167:6835/3753268738] conn(0x5579222b3550 0x5579222b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.156+0000 7f5e74924640 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:6833/3753268738,v1:172.21.15.167:6835/3753268738] conn(0x5579222b3550 0x5579222b3950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9db8868904316bed server_cookie=39429bf1230e6658 in_seq=0 out_seq=0 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.156+0000 7f5e4bfff640 10 client.4695 ms_handle_connect on v2:172.21.15.167:6833/3753268738 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e4bfff640 1 -- 172.21.15.55:0/230890410 <== mds.0 v2:172.21.15.167:6833/3753268738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557922232920 con 0x5579222b3550 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e4bfff640 10 client.4695 handle_command_reply: tid=0 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 1 client.4695 shutdown 2024-04-25T08:54:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 1 -- 172.21.15.55:0/230890410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 msgr2=0x557922298f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x557922298f50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5e68015810 tx=0x7f5e68001120 comp rx=0 tx=0).stop 2024-04-25T08:54:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 1 -- 172.21.15.55:0/230890410 shutdown_connections 2024-04-25T08:54:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:6833/3753268738,v1:172.21.15.167:6835/3753268738] conn(0x5579222b3550 0x5579222b3950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x55792229df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5579222b8ad0 0x5579222b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e4bfff640 0 client.4695 ms_handle_reset on v2:172.21.15.167:6833/3753268738 2024-04-25T08:54:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/230890410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55792229b230 0x557922298f50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 1 -- 172.21.15.55:0/230890410 >> 172.21.15.55:0/230890410 conn(0x557922270f10 msgr2=0x5579222b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 1 -- 172.21.15.55:0/230890410 shutdown_connections 2024-04-25T08:54:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 1 -- 172.21.15.55:0/230890410 wait complete. 2024-04-25T08:54:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.157+0000 7f5e7a16a740 20 client.4695 trim_cache size 0 max 16384 2024-04-25T08:54:00.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.173+0000 7f5e7a16a740 1 Processor -- start 2024-04-25T08:54:00.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.173+0000 7f5e7a16a740 1 -- start start 2024-04-25T08:54:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55792229b230 0x5579222b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x557922271500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e701ffb00 con 0x5579222b8ad0 2024-04-25T08:54:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e701fefa0 con 0x5579222b13d0 2024-04-25T08:54:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e701ff500 con 0x55792229b230 2024-04-25T08:54:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e75926640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e75926640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222ab9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49634/0 (socket says 172.21.15.55:49634) 2024-04-25T08:54:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e75926640 1 -- 172.21.15.55:0/276129207 learned_addr learned my addr 172.21.15.55:0/276129207 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e74924640 1 --2- 172.21.15.55:0/276129207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x557922271500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e75125640 1 --2- 172.21.15.55:0/276129207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55792229b230 0x5579222b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e75926640 1 -- 172.21.15.55:0/276129207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55792229b230 msgr2=0x5579222b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e75926640 1 --2- 172.21.15.55:0/276129207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55792229b230 0x5579222b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e75926640 1 -- 172.21.15.55:0/276129207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 msgr2=0x557922271500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e75926640 1 --2- 172.21.15.55:0/276129207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x557922271500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e75926640 1 -- 172.21.15.55:0/276129207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579222acf20 con 0x5579222b8ad0 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.174+0000 7f5e75926640 1 --2- 172.21.15.55:0/276129207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222ab9d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00e230 tx=0x7f5e6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879009e0e4b354a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e527fc640 1 -- 172.21.15.55:0/276129207 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c031440 con 0x5579222b8ad0 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e527fc640 1 -- 172.21.15.55:0/276129207 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c036070 con 0x5579222b8ad0 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e527fc640 1 -- 172.21.15.55:0/276129207 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c031800 con 0x5579222b8ad0 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e7a16a740 1 -- 172.21.15.55:0/276129207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 msgr2=0x5579222ab9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/276129207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222ab9d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00e230 tx=0x7f5e6c004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:00.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e7a16a740 1 -- 172.21.15.55:0/276129207 shutdown_connections 2024-04-25T08:54:00.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/276129207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222ab9d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/276129207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x557922271500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/276129207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55792229b230 0x5579222b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e7a16a740 1 -- 172.21.15.55:0/276129207 >> 172.21.15.55:0/276129207 conn(0x557922270f10 msgr2=0x557922298d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:00.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e7a16a740 1 -- 172.21.15.55:0/276129207 shutdown_connections 2024-04-25T08:54:00.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.175+0000 7f5e7a16a740 1 -- 172.21.15.55:0/276129207 wait complete. 2024-04-25T08:54:00.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.176+0000 7f5e7a16a740 1 -- start start 2024-04-25T08:54:00.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.176+0000 7f5e7a16a740 1 Processor -- start 2024-04-25T08:54:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55792229b230 0x557922306cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x557922324dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e7a16a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579222b41f0 con 0x5579222b8ad0 2024-04-25T08:54:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579222afb90 con 0x5579222b13d0 2024-04-25T08:54:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e7a16a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579222ad940 con 0x55792229b230 2024-04-25T08:54:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e7a16a740 10 client.0 _ll_register_callbacks cb 0x55792226bc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:54:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e75926640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e75926640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49648/0 (socket says 172.21.15.55:49648) 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e75926640 1 -- 172.21.15.55:0/1861096962 learned_addr learned my addr 172.21.15.55:0/1861096962 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e74924640 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x557922324dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e75125640 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55792229b230 0x557922306cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e75926640 1 -- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55792229b230 msgr2=0x557922306cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e75926640 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55792229b230 0x557922306cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e75926640 1 -- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 msgr2=0x557922324dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e75926640 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x557922324dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e75926640 1 -- 172.21.15.55:0/1861096962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55792229e270 con 0x5579222b8ad0 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e75926640 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222b6fc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c046770 tx=0x7f5e6c02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fe141c93c025d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e4bfff640 1 -- 172.21.15.55:0/1861096962 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c003c20 con 0x5579222b8ad0 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e4bfff640 1 -- 172.21.15.55:0/1861096962 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e6c003dc0 con 0x5579222b8ad0 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e7a16a740 1 -- 172.21.15.55:0/1861096962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e6c036070 con 0x5579222b8ad0 2024-04-25T08:54:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e4bfff640 1 -- 172.21.15.55:0/1861096962 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e6c0468d0 con 0x5579222b8ad0 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.177+0000 7f5e7a16a740 10 client.4701 fetch_fsmap learned FSMap version 6 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e7a16a740 1 -- 172.21.15.55:0/1861096962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5579223248a0 con 0x5579222b8ad0 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e4bfff640 1 -- 172.21.15.55:0/1861096962 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c036070 con 0x5579222b8ad0 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e4bfff640 1 -- 172.21.15.55:0/1861096962 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5e6c046a70 con 0x5579222b8ad0 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e7a16a740 10 client.4701 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e7a16a740 10 client.4701 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e7a16a740 20 client.4701 populate_metadata read hostname 'smithi055' 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:6833/3753268738,v1:172.21.15.167:6835/3753268738] conn(0x55792226ef20 0x55792226f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e7a16a740 4 client.4701 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e7a16a740 1 -- 172.21.15.55:0/1861096962 --> [v2:172.21.15.167:6833/3753268738,v1:172.21.15.167:6835/3753268738] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5579221e0f50 con 0x55792226ef20 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e75125640 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:6833/3753268738,v1:172.21.15.167:6835/3753268738] conn(0x55792226ef20 0x55792226f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e4bfff640 10 client.4701 ms_handle_connect on v2:172.21.15.167:6833/3753268738 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e75125640 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:6833/3753268738,v1:172.21.15.167:6835/3753268738] conn(0x55792226ef20 0x55792226f300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814f7d768e3037f0 server_cookie=1fdabe11247e47e3 in_seq=0 out_seq=0 2024-04-25T08:54:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e4bfff640 1 -- 172.21.15.55:0/1861096962 <== mds.0 v2:172.21.15.167:6833/3753268738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5579221e0f50 con 0x55792226ef20 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.178+0000 7f5e4bfff640 10 client.4701 handle_command_reply: tid=0 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 1 client.4701 shutdown 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 1 -- 172.21.15.55:0/1861096962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 msgr2=0x5579222b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222b6fc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c046770 tx=0x7f5e6c02f000 comp rx=0 tx=0).stop 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 1 -- 172.21.15.55:0/1861096962 shutdown_connections 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:6833/3753268738,v1:172.21.15.167:6835/3753268738] conn(0x55792226ef20 0x55792226f300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579222b8ad0 0x5579222b6fc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579222b13d0 0x557922324dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 1 --2- 172.21.15.55:0/1861096962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55792229b230 0x557922306cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e4bfff640 0 client.4701 ms_handle_reset on v2:172.21.15.167:6833/3753268738 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 1 -- 172.21.15.55:0/1861096962 >> 172.21.15.55:0/1861096962 conn(0x557922270f10 msgr2=0x557922271500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 1 -- 172.21.15.55:0/1861096962 shutdown_connections 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 1 -- 172.21.15.55:0/1861096962 wait complete. 2024-04-25T08:54:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e7a16a740 20 client.4701 trim_cache size 0 max 16384 2024-04-25T08:54:00.176 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:54:00.176 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T08:54:00.176 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T08:54:00.176 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4284, 2024-04-25T08:54:00.176 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T08:54:00.176 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T08:54:00.176 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T08:54:00.176 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 16.973624620999999, 2024-04-25T08:54:00.176 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 6, 2024-04-25T08:54:00.176 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 23, 2024-04-25T08:54:00.177 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 23, 2024-04-25T08:54:00.177 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 24.179047393000001 2024-04-25T08:54:00.177 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:54:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e77389640 1 -- 172.21.15.55:0/3877916857 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5e5406b4d0 msgr2=0x7f5e5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e77389640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5e5406b4d0 0x7f5e5406d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5e680017e0 tx=0x7f5e68009040 comp rx=0 tx=0).stop 2024-04-25T08:54:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e77389640 1 -- 172.21.15.55:0/3877916857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e701f3160 msgr2=0x7f5e701f4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e77389640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e701f3160 0x7f5e701f4130 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000e870 tx=0x7f5e6000ed30 comp rx=0 tx=0).stop 2024-04-25T08:54:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e77389640 1 -- 172.21.15.55:0/3877916857 shutdown_connections 2024-04-25T08:54:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e77389640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5e5406b4d0 0x7f5e5406d990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e77389640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e7015fe90 0x7f5e70160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e77389640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e701f3160 0x7f5e701f4130 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e77389640 1 --2- 172.21.15.55:0/3877916857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e701f2d80 0x7f5e7015e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.179+0000 7f5e77389640 1 -- 172.21.15.55:0/3877916857 >> 172.21.15.55:0/3877916857 conn(0x7f5e70072900 msgr2=0x7f5e700d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.180+0000 7f5e77389640 1 -- 172.21.15.55:0/3877916857 shutdown_connections 2024-04-25T08:54:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.180+0000 7f5e77389640 1 -- 172.21.15.55:0/3877916857 wait complete. 2024-04-25T08:54:00.180 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T08:54:00.202 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T08:54:00.202 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T08:54:00.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:00.203 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:54:00.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:00.218 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-25T08:54:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-04-25T08:54:00.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:54:00.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:00.285 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:54:00.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:00.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-25T08:54:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-04-25T08:54:00.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:54:00.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:00.408 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T08:54:00.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:00.427 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-04-25T08:54:00.497 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2024-04-25T08:54:00.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:54:00.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:00.499 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T08:54:00.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:00.556 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-04-25T08:54:00.624 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2024-04-25T08:54:00.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:54:00.625 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T08:54:00.625 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:54:00.625 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:54:00.626 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:54:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.736+0000 7fa97ba38640 1 Processor -- start 2024-04-25T08:54:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.736+0000 7fa97ba38640 1 -- start start 2024-04-25T08:54:00.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.737+0000 7fa97ba38640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa974162360 0x7fa9740cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.737+0000 7fa97ba38640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa9740cdf60 0x7fa97406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.737+0000 7fa97ba38640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa974161970 con 0x7fa97406b0e0 2024-04-25T08:54:00.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.737+0000 7fa97ba38640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9740ce3c0 con 0x7fa9740cdf60 2024-04-25T08:54:00.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.737+0000 7fa97ba38640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97406b550 con 0x7fa974162360 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.737+0000 7fa979fd5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa97406b0e0 0x7fa97415e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55836/0 (socket says 172.21.15.55:55836) 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.737+0000 7fa979fd5640 1 -- 172.21.15.55:0/2554368951 learned_addr learned my addr 172.21.15.55:0/2554368951 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa978fd3640 1 --2- 172.21.15.55:0/2554368951 >> v2:172.21.15.167:3300/0 conn(0x7fa9740cdf60 0x7fa97406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa9797d4640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa974162360 0x7fa9740cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739068337 0 0) 0x7fa96c001110 con 0x7fa97406b0e0 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa95c003520 con 0x7fa97406b0e0 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3299743662 0 0) 0x7fa95c003520 con 0x7fa97406b0e0 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa974162360 msgr2=0x7fa9740cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa974162360 0x7fa9740cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 >> v2:172.21.15.167:3300/0 conn(0x7fa9740cdf60 msgr2=0x7fa97406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 --2- 172.21.15.55:0/2554368951 >> v2:172.21.15.167:3300/0 conn(0x7fa9740cdf60 0x7fa97406aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97406b780 con 0x7fa97406b0e0 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fa96c001840 con 0x7fa97406b0e0 2024-04-25T08:54:00.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 >> v1:172.21.15.55:6789/0 conn(0x7fa97406b0e0 legacy=0x7fa97415e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95c0039b0 0x7fa95c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 0x7fa95c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa95c004e50 0x7fa95c0052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c00bc90 con 0x7fa95c004310 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c00be40 con 0x7fa95c004e50 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c00c040 con 0x7fa95c0039b0 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa978fd3640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 0x7fa95c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa9797d4640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95c0039b0 0x7fa95c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa979fd5640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa95c004e50 0x7fa95c0052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa978fd3640 1 -- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95c0039b0 msgr2=0x7fa95c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa978fd3640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa95c0039b0 0x7fa95c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa978fd3640 1 -- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa95c004e50 msgr2=0x7fa95c0052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa978fd3640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa95c004e50 0x7fa95c0052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa978fd3640 1 -- 172.21.15.55:0/2554368951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c003520 con 0x7fa95c004310 2024-04-25T08:54:00.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.738+0000 7fa979fd5640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa95c004e50 0x7fa95c0052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:00.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.739+0000 7fa978fd3640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 0x7fa95c004800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa968009ac0 tx=0x7fa95c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625fc746f2aa5b07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:00.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.739+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968036070 con 0x7fa95c004310 2024-04-25T08:54:00.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.739+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968031400 con 0x7fa95c004310 2024-04-25T08:54:00.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.739+0000 7fa973fff640 1 -- 172.21.15.55:0/2554368951 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968009690 con 0x7fa95c004310 2024-04-25T08:54:00.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.740+0000 7fa97ba38640 1 -- 172.21.15.55:0/2554368951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 msgr2=0x7fa95c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.740+0000 7fa97ba38640 1 --2- 172.21.15.55:0/2554368951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 0x7fa95c004800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa968009ac0 tx=0x7fa95c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.740+0000 7fa979fd5640 1 -- 172.21.15.55:0/2554368951 reap_dead start 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.740+0000 7fa97ba38640 1 -- 172.21.15.55:0/2554368951 shutdown_connections 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.740+0000 7fa97ba38640 1 -- 172.21.15.55:0/2554368951 >> 172.21.15.55:0/2554368951 conn(0x7fa9740cc8d0 msgr2=0x7fa9740ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.740+0000 7fa97ba38640 1 -- 172.21.15.55:0/2554368951 shutdown_connections 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.740+0000 7fa97ba38640 1 -- 172.21.15.55:0/2554368951 wait complete. 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.741+0000 7fa97ba38640 1 Processor -- start 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.741+0000 7fa97ba38640 1 -- start start 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa97ba38640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 0x7fa974152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa97ba38640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa974156b10 0x7fa9740b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa97ba38640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa974156f70 0x7fa9740b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa97ba38640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97406c020 con 0x7fa95c004310 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa97ba38640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97406bd40 con 0x7fa974156f70 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa97ba38640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97406c300 con 0x7fa974156b10 2024-04-25T08:54:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa9797d4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 0x7fa974152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa9797d4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 0x7fa974152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49664/0 (socket says 172.21.15.55:49664) 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa9797d4640 1 -- 172.21.15.55:0/2583256952 learned_addr learned my addr 172.21.15.55:0/2583256952 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa978fd3640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa974156b10 0x7fa9740b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa979fd5640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa974156f70 0x7fa9740b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa9797d4640 1 -- 172.21.15.55:0/2583256952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa974156b10 msgr2=0x7fa9740b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa9797d4640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa974156b10 0x7fa9740b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa9797d4640 1 -- 172.21.15.55:0/2583256952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa974156f70 msgr2=0x7fa9740b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa9797d4640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa974156f70 0x7fa9740b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa9797d4640 1 -- 172.21.15.55:0/2583256952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9741f35d0 con 0x7fa95c004310 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa978fd3640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa974156b10 0x7fa9740b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa979fd5640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa974156f70 0x7fa9740b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.742+0000 7fa9797d4640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 0x7fa974152ed0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa964011e30 tx=0x7fa96400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.743+0000 7fa971ffb640 1 -- 172.21.15.55:0/2583256952 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964015630 con 0x7fa95c004310 2024-04-25T08:54:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.743+0000 7fa971ffb640 1 -- 172.21.15.55:0/2583256952 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9640157d0 con 0x7fa95c004310 2024-04-25T08:54:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.743+0000 7fa97ba38640 1 -- 172.21.15.55:0/2583256952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9741f29c0 con 0x7fa95c004310 2024-04-25T08:54:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.743+0000 7fa971ffb640 1 -- 172.21.15.55:0/2583256952 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964015ba0 con 0x7fa95c004310 2024-04-25T08:54:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.743+0000 7fa97ba38640 1 -- 172.21.15.55:0/2583256952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9741f2f80 con 0x7fa95c004310 2024-04-25T08:54:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.744+0000 7fa97ba38640 1 -- 172.21.15.55:0/2583256952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9740749b0 con 0x7fa95c004310 2024-04-25T08:54:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.744+0000 7fa971ffb640 1 -- 172.21.15.55:0/2583256952 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa96401d400 con 0x7fa95c004310 2024-04-25T08:54:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.744+0000 7fa971ffb640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa96006b4d0 0x7fa96006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.745+0000 7fa971ffb640 1 -- 172.21.15.55:0/2583256952 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa96408b360 con 0x7fa95c004310 2024-04-25T08:54:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.745+0000 7fa978fd3640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa96006b4d0 0x7fa96006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.745+0000 7fa978fd3640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa96006b4d0 0x7fa96006d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa968033000 tx=0x7fa968008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:00.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.749+0000 7fa971ffb640 1 -- 172.21.15.55:0/2583256952 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa964019030 con 0x7fa95c004310 2024-04-25T08:54:00.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.965+0000 7fa97ba38640 1 -- 172.21.15.55:0/2583256952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa974066a30 con 0x7fa95c004310 2024-04-25T08:54:00.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.966+0000 7fa971ffb640 1 -- 172.21.15.55:0/2583256952 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa964010040 con 0x7fa95c004310 2024-04-25T08:54:00.956 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:54:00.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 -- 172.21.15.55:0/2583256952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa96006b4d0 msgr2=0x7fa96006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa96006b4d0 0x7fa96006d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa968033000 tx=0x7fa968008030 comp rx=0 tx=0).stop 2024-04-25T08:54:00.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 -- 172.21.15.55:0/2583256952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 msgr2=0x7fa974152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:00.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 0x7fa974152ed0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa964011e30 tx=0x7fa96400f580 comp rx=0 tx=0).stop 2024-04-25T08:54:00.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 -- 172.21.15.55:0/2583256952 shutdown_connections 2024-04-25T08:54:00.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa96006b4d0 0x7fa96006d990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa974156f70 0x7fa9740b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa974156b10 0x7fa9740b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 --2- 172.21.15.55:0/2583256952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c004310 0x7fa974152ed0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:00.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 -- 172.21.15.55:0/2583256952 >> 172.21.15.55:0/2583256952 conn(0x7fa9740cc8d0 msgr2=0x7fa9740b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:00.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 -- 172.21.15.55:0/2583256952 shutdown_connections 2024-04-25T08:54:00.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:00.968+0000 7fa97ba38640 1 -- 172.21.15.55:0/2583256952 wait complete. 2024-04-25T08:54:00.968 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:54:00.968 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:54:00.968 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T08:54:00.968 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:54:00.969 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:54:00.969 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:54:00.969 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:54:00.969 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:54:00.969 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:54:00.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:00.969 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T08:54:00.984 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:54:00.984 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:54:00.985 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:54:00.985 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:00.985 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:54:00.985 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:00.985 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:00.985 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:00.985 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T08:54:00.985 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:00.985 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:00.985 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T08:54:00.985 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:54:00.986 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:00.986 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T08:54:00.986 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:54:00.986 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42716sec preferred_lft 42716sec 2024-04-25T08:54:00.986 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T08:54:00.986 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:00.986 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:00.986 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:00.986 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T08:54:00.986 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T08:54:00.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:00.987 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:54:00.987 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:54:00.987 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2024-04-25T08:54:00.987 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2024-04-25T08:54:00.987 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2024-04-25T08:54:00.987 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T08:54:00.987 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:54:01.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:01.122 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:54:01.155 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:54:01.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:01.157 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T08:54:01.225 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T08:54:01.225 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:54:01.225 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:54:01.225 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:54:01.225 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:54:01.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:01.226 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:54:01.226 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:54:01.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:54:01.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:54:01.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:54:01.226 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:54:01.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:01.445 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:54:01.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:01.460 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-04-25T08:54:01.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:01.516 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:54:01.516 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:54:01.517 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:54:01.517 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T08:54:01.517 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:54:01.597 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T08:54:01.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:01.598 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:54:01.598 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:54:01.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T08:54:01.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T08:54:01.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T08:54:01.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T08:54:01.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T08:54:01.598 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:54:01.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:01.723 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:54:01.723 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:54:01.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T08:54:01.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T08:54:01.723 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:54:01.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:54:01.776 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:54:01.792 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:54:01.793 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:54:01.793 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:54:01.848 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:54:01.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:01.848 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:54:01.974 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:54:01.974 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:54:01.974 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:54:02.106 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:54:02.107 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:54:02.107 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:54:02.107 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:54:02.107 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:54:02.112 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:54:02.112 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:54:02.112 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:54:02.113 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:54:02.113 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:54:02.113 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:54:02.113 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:54:02.113 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:54:02.114 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:54:02.114 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:54:02.114 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:54:02.114 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:54:02.114 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:54:02.116 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:54:02.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:02.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:54:02.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:02.146 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:02.209 INFO:teuthology.orchestra.run.smithi055.stdout:client4454 2024-04-25T08:54:02.209 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:54:02.209 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:02.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:02.266 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:02.329 INFO:teuthology.orchestra.run.smithi055.stdout:client4454 2024-04-25T08:54:02.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:02.329 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:02.390 INFO:teuthology.orchestra.run.smithi055.stdout:client4454 2024-04-25T08:54:02.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:02.391 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c39ac909-02b8-4b68-9f8d-b272de9b1a7b.client4454/status') 2024-04-25T08:54:02.458 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4454 (3)172.21.15.55:0/631719177 2024-04-25T08:54:02.459 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2024-04-25T08:54:02.459 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2024-04-25T08:54:02.459 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2024-04-25T08:54:02.459 INFO:teuthology.orchestra.run.smithi055.stderr:69 bytes copied, 2.3028e-05 s, 3.0 MB/s 2024-04-25T08:54:02.460 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-25T08:54:02.460 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:54:02.460 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T08:54:02.460 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:54:02.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.614+0000 7f3b1a5db640 1 Processor -- start 2024-04-25T08:54:02.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.614+0000 7f3b1a5db640 1 -- start start 2024-04-25T08:54:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.614+0000 7f3b1a5db640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b140d35b0 0x7f3b140b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.614+0000 7f3b1a5db640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b140b5990 0x7f3b140b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b1a5db640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1415e0c0 con 0x7f3b1415dce0 2024-04-25T08:54:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b1a5db640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b140d2510 con 0x7f3b140d35b0 2024-04-25T08:54:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b1a5db640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140d27f0 con 0x7f3b140b5990 2024-04-25T08:54:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b18b78640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b140b5990 0x7f3b140b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b137fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b140d35b0 0x7f3b140b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b13fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3b1415dce0 0x7f3b140d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:33814/0 (socket says 172.21.15.55:33814) 2024-04-25T08:54:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b13fff640 1 -- 172.21.15.55:0/4175115284 learned_addr learned my addr 172.21.15.55:0/4175115284 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b12ffd640 1 -- 172.21.15.55:0/4175115284 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494214450 0 0) 0x7f3b1415e0c0 con 0x7f3b1415dce0 2024-04-25T08:54:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b12ffd640 1 -- 172.21.15.55:0/4175115284 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3afc003520 con 0x7f3b1415dce0 2024-04-25T08:54:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b18b78640 1 -- 172.21.15.55:0/4175115284 >> v2:172.21.15.167:3300/0 conn(0x7f3b140d35b0 msgr2=0x7f3b140b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b18b78640 1 --2- 172.21.15.55:0/4175115284 >> v2:172.21.15.167:3300/0 conn(0x7f3b140d35b0 0x7f3b140b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b18b78640 1 -- 172.21.15.55:0/4175115284 >> v1:172.21.15.167:6789/0 conn(0x7f3b1415dce0 legacy=0x7f3b140d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b18b78640 1 -- 172.21.15.55:0/4175115284 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140d2ad0 con 0x7f3b140b5990 2024-04-25T08:54:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.615+0000 7f3b137fe640 1 --2- 172.21.15.55:0/4175115284 >> v2:172.21.15.167:3300/0 conn(0x7f3b140d35b0 0x7f3b140b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.616+0000 7f3b18b78640 1 --2- 172.21.15.55:0/4175115284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b140b5990 0x7f3b140b6b00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009d90 tx=0x7f3b0c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d25b3a407d314068 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.616+0000 7f3b12ffd640 1 -- 172.21.15.55:0/4175115284 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c007740 con 0x7f3b140b5990 2024-04-25T08:54:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.616+0000 7f3b12ffd640 1 -- 172.21.15.55:0/4175115284 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c0078e0 con 0x7f3b140b5990 2024-04-25T08:54:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.616+0000 7f3b12ffd640 1 -- 172.21.15.55:0/4175115284 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c007c90 con 0x7f3b140b5990 2024-04-25T08:54:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.617+0000 7f3b1a5db640 1 -- 172.21.15.55:0/4175115284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b140b5990 msgr2=0x7f3b140b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.617+0000 7f3b1a5db640 1 --2- 172.21.15.55:0/4175115284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b140b5990 0x7f3b140b6b00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009d90 tx=0x7f3b0c02a660 comp rx=0 tx=0).stop 2024-04-25T08:54:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.617+0000 7f3b1a5db640 1 -- 172.21.15.55:0/4175115284 shutdown_connections 2024-04-25T08:54:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.617+0000 7f3b1a5db640 1 --2- 172.21.15.55:0/4175115284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b140b5990 0x7f3b140b6b00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.617+0000 7f3b1a5db640 1 --2- 172.21.15.55:0/4175115284 >> v2:172.21.15.167:3300/0 conn(0x7f3b140d35b0 0x7f3b140b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.617+0000 7f3b1a5db640 1 -- 172.21.15.55:0/4175115284 >> 172.21.15.55:0/4175115284 conn(0x7f3b14072900 msgr2=0x7f3b140d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.617+0000 7f3b1a5db640 1 -- 172.21.15.55:0/4175115284 shutdown_connections 2024-04-25T08:54:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.617+0000 7f3b1a5db640 1 -- 172.21.15.55:0/4175115284 wait complete. 2024-04-25T08:54:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.618+0000 7f3b1a5db640 1 Processor -- start 2024-04-25T08:54:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.619+0000 7f3b1a5db640 1 -- start start 2024-04-25T08:54:02.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.619+0000 7f3b1a5db640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b140b5990 0x7f3b140b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:02.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.619+0000 7f3b1a5db640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b140d35b0 0x7f3b140ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:02.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.619+0000 7f3b1a5db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1415dce0 0x7f3b1415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:02.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.619+0000 7f3b1a5db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140d2160 con 0x7f3b1415dce0 2024-04-25T08:54:02.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.619+0000 7f3b1a5db640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140d3090 con 0x7f3b140d35b0 2024-04-25T08:54:02.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.619+0000 7f3b1a5db640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140abf50 con 0x7f3b140b5990 2024-04-25T08:54:02.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b18b78640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1415dce0 0x7f3b1415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b18b78640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1415dce0 0x7f3b1415fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49680/0 (socket says 172.21.15.55:49680) 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b18b78640 1 -- 172.21.15.55:0/2157434368 learned_addr learned my addr 172.21.15.55:0/2157434368 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b13fff640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b140b5990 0x7f3b140b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b137fe640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b140d35b0 0x7f3b140ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b18b78640 1 -- 172.21.15.55:0/2157434368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b140b5990 msgr2=0x7f3b140b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b18b78640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b140b5990 0x7f3b140b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b18b78640 1 -- 172.21.15.55:0/2157434368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b140d35b0 msgr2=0x7f3b140ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b18b78640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b140d35b0 0x7f3b140ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b18b78640 1 -- 172.21.15.55:0/2157434368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1415f4d0 con 0x7f3b1415dce0 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b18b78640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1415dce0 0x7f3b1415fc60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009eb0 tx=0x7f3b0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b10ff9640 1 -- 172.21.15.55:0/2157434368 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c040070 con 0x7f3b1415dce0 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b10ff9640 1 -- 172.21.15.55:0/2157434368 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c031c60 con 0x7f3b1415dce0 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b1a5db640 1 -- 172.21.15.55:0/2157434368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b14160d20 con 0x7f3b1415dce0 2024-04-25T08:54:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b10ff9640 1 -- 172.21.15.55:0/2157434368 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c009450 con 0x7f3b1415dce0 2024-04-25T08:54:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.620+0000 7f3b1a5db640 1 -- 172.21.15.55:0/2157434368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b141612e0 con 0x7f3b1415dce0 2024-04-25T08:54:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.621+0000 7f3b1a5db640 1 -- 172.21.15.55:0/2157434368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b140b23d0 con 0x7f3b1415dce0 2024-04-25T08:54:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.622+0000 7f3b10ff9640 1 -- 172.21.15.55:0/2157434368 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b0c039040 con 0x7f3b1415dce0 2024-04-25T08:54:02.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.622+0000 7f3b10ff9640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b0006b500 0x7f3b0006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:02.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.622+0000 7f3b10ff9640 1 -- 172.21.15.55:0/2157434368 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b0c0ab400 con 0x7f3b1415dce0 2024-04-25T08:54:02.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.622+0000 7f3b13fff640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b0006b500 0x7f3b0006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:02.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.623+0000 7f3b13fff640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b0006b500 0x7f3b0006d9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3b04005880 tx=0x7f3b04009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:02.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.631+0000 7f3b10ff9640 1 -- 172.21.15.55:0/2157434368 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b0c079cc0 con 0x7f3b1415dce0 2024-04-25T08:54:02.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.851+0000 7f3b1a5db640 1 -- 172.21.15.55:0/2157434368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3b140749b0 con 0x7f3b1415dce0 2024-04-25T08:54:02.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.851+0000 7f3b10ff9640 1 -- 172.21.15.55:0/2157434368 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3b0c07dd60 con 0x7f3b1415dce0 2024-04-25T08:54:02.841 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:54:02.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 -- 172.21.15.55:0/2157434368 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b0006b500 msgr2=0x7f3b0006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:02.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b0006b500 0x7f3b0006d9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3b04005880 tx=0x7f3b04009040 comp rx=0 tx=0).stop 2024-04-25T08:54:02.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 -- 172.21.15.55:0/2157434368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1415dce0 msgr2=0x7f3b1415fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:02.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1415dce0 0x7f3b1415fc60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009eb0 tx=0x7f3b0c004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:02.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 -- 172.21.15.55:0/2157434368 shutdown_connections 2024-04-25T08:54:02.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b0006b500 0x7f3b0006d9c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:02.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1415dce0 0x7f3b1415fc60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:02.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b140d35b0 0x7f3b140ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:02.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 --2- 172.21.15.55:0/2157434368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b140b5990 0x7f3b140b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:02.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 -- 172.21.15.55:0/2157434368 >> 172.21.15.55:0/2157434368 conn(0x7f3b14072900 msgr2=0x7f3b140b82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:02.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 -- 172.21.15.55:0/2157434368 shutdown_connections 2024-04-25T08:54:02.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:02.853+0000 7f3b1a5db640 1 -- 172.21.15.55:0/2157434368 wait complete. 2024-04-25T08:54:02.854 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:54:02.854 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:54:02.854 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T08:54:02.854 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T08:54:02.854 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T08:54:02.854 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:54:02.854 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:54:02.854 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:54:02.854 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T08:54:02.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:02.855 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T08:54:02.870 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:54:02.870 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:54:02.870 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42714sec preferred_lft 42714sec 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T08:54:02.871 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link tentative 2024-04-25T08:54:02.872 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:02.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:02.873 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:54:02.934 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:54:02.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:02.936 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T08:54:02.992 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T08:54:02.992 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:54:02.992 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:54:02.992 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:54:02.992 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:54:02.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:02.992 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:54:02.993 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:54:02.993 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:54:02.993 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:54:02.993 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:54:02.993 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:54:03.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.078 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:54:03.093 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:54:03.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.094 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-04-25T08:54:03.149 INFO:teuthology.orchestra.run.smithi055.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T08:54:03.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.150 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:54:03.150 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:54:03.150 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:54:03.150 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T08:54:03.150 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:54:03.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T08:54:03.291 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:54:03.292 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:54:03.292 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:54:03.292 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:03.292 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:54:03.292 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:03.292 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:54:03.292 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 76:e4:1d:fc:25:0b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:54:03.292 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:54:03.292 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:03.293 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::74e4:1dff:fefc:250b/64 scope link 2024-04-25T08:54:03.293 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:03.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.295 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T08:54:03.358 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:54:03.359 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:54:03.359 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:54:03.359 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:03.359 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:54:03.359 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:03.359 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:54:03.359 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 76:e4:1d:fc:25:0b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:54:03.359 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:54:03.359 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:03.359 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::74e4:1dff:fefc:250b/64 scope link 2024-04-25T08:54:03.359 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:03.360 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T08:54:03.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.361 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:54:03.361 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:54:03.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T08:54:03.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T08:54:03.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T08:54:03.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T08:54:03.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T08:54:03.361 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:54:03.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.472 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:54:03.472 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:54:03.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.1 up 2024-04-25T08:54:03.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T08:54:03.473 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:54:03.509 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:54:03.509 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T08:54:03.566 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T08:54:03.566 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:54:03.566 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T08:54:03.621 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:54:03.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.621 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T08:54:03.703 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T08:54:03.703 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T08:54:03.703 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:54:03.711 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T08:54:03.712 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T08:54:03.712 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:54:03.712 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:54:03.712 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:54:03.730 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T08:54:03.730 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T08:54:03.731 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:54:03.731 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:54:03.731 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:54:03.731 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:54:03.731 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:54:03.731 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:54:03.731 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-25T08:54:03.732 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:54:03.732 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:54:03.732 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:54:03.732 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:54:03.733 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:54:03.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.733 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T08:54:03.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.798 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:03.855 INFO:teuthology.orchestra.run.smithi055.stdout:client4684 2024-04-25T08:54:03.856 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:54:03.856 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:03.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.911 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:03.968 INFO:teuthology.orchestra.run.smithi055.stdout:client4684 2024-04-25T08:54:03.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:03.969 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:04.025 INFO:teuthology.orchestra.run.smithi055.stdout:client4684 2024-04-25T08:54:04.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:04.026 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c39ac909-02b8-4b68-9f8d-b272de9b1a7b.client4684/status') 2024-04-25T08:54:04.089 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4684 (3)172.21.15.55:0/1373313707 2024-04-25T08:54:04.089 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2024-04-25T08:54:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2024-04-25T08:54:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2024-04-25T08:54:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:70 bytes copied, 2.4229e-05 s, 2.9 MB/s 2024-04-25T08:54:04.091 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-25T08:54:04.091 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:54:04.091 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T08:54:04.091 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:54:04.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.241+0000 7ff381c38640 1 Processor -- start 2024-04-25T08:54:04.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.241+0000 7ff381c38640 1 -- start start 2024-04-25T08:54:04.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.242+0000 7ff381c38640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c15ded0 0x7ff37c0cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:04.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.242+0000 7ff381c38640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c0c6540 con 0x7ff37c06fab0 2024-04-25T08:54:04.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.242+0000 7ff381c38640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c072e10 con 0x7ff37c06ff10 2024-04-25T08:54:04.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.242+0000 7ff381c38640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c072bc0 con 0x7ff37c15ded0 2024-04-25T08:54:04.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.242+0000 7ff37affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff37c06fab0 0x7ff37c070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55840/0 (socket says 172.21.15.55:55840) 2024-04-25T08:54:04.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.242+0000 7ff37affd640 1 -- 172.21.15.55:0/2784913398 learned_addr learned my addr 172.21.15.55:0/2784913398 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:04.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c15ded0 0x7ff37c0cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:04.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702320753 0 0) 0x7ff37c0c6540 con 0x7ff37c06fab0 2024-04-25T08:54:04.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff364003520 con 0x7ff37c06fab0 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099882628 0 0) 0x7ff37c072e10 con 0x7ff37c06ff10 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff37c0c6540 con 0x7ff37c06ff10 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 38963285 0 0) 0x7ff364003520 con 0x7ff37c06fab0 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c15ded0 msgr2=0x7ff37c0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c15ded0 0x7ff37c0cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 >> v1:172.21.15.167:6789/0 conn(0x7ff37c06ff10 legacy=0x7ff37c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c0730f0 con 0x7ff37c06fab0 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7ff370001670 con 0x7ff37c06fab0 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 >> v1:172.21.15.55:6789/0 conn(0x7ff37c06fab0 legacy=0x7ff37c070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 0x7ff364003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c15ded0 0x7ff364004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff364004d40 0x7ff3640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c072bc0 con 0x7ff364003b70 2024-04-25T08:54:04.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36400ba70 con 0x7ff364004d40 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36400bc20 con 0x7ff37c15ded0 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 0x7ff364003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37bfff640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff364004d40 0x7ff3640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37affd640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c15ded0 0x7ff364004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2784913398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c15ded0 msgr2=0x7ff364004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.243+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c15ded0 0x7ff364004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.244+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2784913398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff364004d40 msgr2=0x7ff3640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.244+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff364004d40 0x7ff3640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.244+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2784913398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c0730f0 con 0x7ff364003b70 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.244+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 0x7ff364003f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009ac0 tx=0x7ff364005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b2925608820cc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.244+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c036070 con 0x7ff364003b70 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.244+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c031400 con 0x7ff364003b70 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.244+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2784913398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c009690 con 0x7ff364003b70 2024-04-25T08:54:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.245+0000 7ff381c38640 1 -- 172.21.15.55:0/2784913398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 msgr2=0x7ff364003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:04.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.245+0000 7ff381c38640 1 --2- 172.21.15.55:0/2784913398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 0x7ff364003f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009ac0 tx=0x7ff364005830 comp rx=0 tx=0).stop 2024-04-25T08:54:04.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.245+0000 7ff37bfff640 1 -- 172.21.15.55:0/2784913398 reap_dead start 2024-04-25T08:54:04.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.245+0000 7ff381c38640 1 -- 172.21.15.55:0/2784913398 shutdown_connections 2024-04-25T08:54:04.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.245+0000 7ff381c38640 1 -- 172.21.15.55:0/2784913398 >> 172.21.15.55:0/2784913398 conn(0x7ff37c0b2370 msgr2=0x7ff37c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:04.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.245+0000 7ff381c38640 1 -- 172.21.15.55:0/2784913398 shutdown_connections 2024-04-25T08:54:04.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.245+0000 7ff381c38640 1 -- 172.21.15.55:0/2784913398 wait complete. 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.246+0000 7ff381c38640 1 Processor -- start 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.246+0000 7ff381c38640 1 -- start start 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.247+0000 7ff381c38640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 0x7ff37c15e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.247+0000 7ff381c38640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff37c14fbe0 0x7ff37c0c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.247+0000 7ff381c38640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c0c8960 0x7ff37c0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.247+0000 7ff381c38640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0cd4f0 con 0x7ff364003b70 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.247+0000 7ff381c38640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0ccfc0 con 0x7ff37c14fbe0 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.247+0000 7ff381c38640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c070a30 con 0x7ff37c0c8960 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.247+0000 7ff37b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 0x7ff37c15e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.247+0000 7ff37b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 0x7ff37c15e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49700/0 (socket says 172.21.15.55:49700) 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.247+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2248361631 learned_addr learned my addr 172.21.15.55:0/2248361631 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.247+0000 7ff37affd640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff37c14fbe0 0x7ff37c0c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.247+0000 7ff37bfff640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c0c8960 0x7ff37c0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2248361631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c0c8960 msgr2=0x7ff37c0c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c0c8960 0x7ff37c0c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2248361631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff37c14fbe0 msgr2=0x7ff37c0c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff37c14fbe0 0x7ff37c0c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2248361631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c1505b0 con 0x7ff364003b70 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff37bfff640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c0c8960 0x7ff37c0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 0x7ff37c15e2b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff36c02abb0 tx=0x7ff36c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff363fff640 1 -- 172.21.15.55:0/2248361631 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c040020 con 0x7ff364003b70 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff363fff640 1 -- 172.21.15.55:0/2248361631 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c003940 con 0x7ff364003b70 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff381c38640 1 -- 172.21.15.55:0/2248361631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c155f70 con 0x7ff364003b70 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff363fff640 1 -- 172.21.15.55:0/2248361631 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c036040 con 0x7ff364003b70 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.248+0000 7ff381c38640 1 -- 172.21.15.55:0/2248361631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37c0c7c20 con 0x7ff364003b70 2024-04-25T08:54:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.249+0000 7ff381c38640 1 -- 172.21.15.55:0/2248361631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37c0caa50 con 0x7ff364003b70 2024-04-25T08:54:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.249+0000 7ff363fff640 1 -- 172.21.15.55:0/2248361631 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff36c043020 con 0x7ff364003b70 2024-04-25T08:54:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.250+0000 7ff363fff640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff36806b4d0 0x7ff36806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.250+0000 7ff363fff640 1 -- 172.21.15.55:0/2248361631 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff36c0aa620 con 0x7ff364003b70 2024-04-25T08:54:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.250+0000 7ff37affd640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff36806b4d0 0x7ff36806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.250+0000 7ff37affd640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff36806b4d0 0x7ff36806d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff37c1613f0 tx=0x7ff370006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.254+0000 7ff363fff640 1 -- 172.21.15.55:0/2248361631 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff37c0caa50 con 0x7ff364003b70 2024-04-25T08:54:04.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.475+0000 7ff381c38640 1 -- 172.21.15.55:0/2248361631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff37c0749b0 con 0x7ff364003b70 2024-04-25T08:54:04.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.475+0000 7ff363fff640 1 -- 172.21.15.55:0/2248361631 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff36c04a030 con 0x7ff364003b70 2024-04-25T08:54:04.465 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:54:04.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 -- 172.21.15.55:0/2248361631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff36806b4d0 msgr2=0x7ff36806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:04.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff36806b4d0 0x7ff36806d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff37c1613f0 tx=0x7ff370006040 comp rx=0 tx=0).stop 2024-04-25T08:54:04.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 -- 172.21.15.55:0/2248361631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 msgr2=0x7ff37c15e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:04.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 0x7ff37c15e2b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff36c02abb0 tx=0x7ff36c004730 comp rx=0 tx=0).stop 2024-04-25T08:54:04.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 -- 172.21.15.55:0/2248361631 shutdown_connections 2024-04-25T08:54:04.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff36806b4d0 0x7ff36806d990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:04.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff37c0c8960 0x7ff37c0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:04.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff37c14fbe0 0x7ff37c0c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:04.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 --2- 172.21.15.55:0/2248361631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff364003b70 0x7ff37c15e2b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:04.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 -- 172.21.15.55:0/2248361631 >> 172.21.15.55:0/2248361631 conn(0x7ff37c0b2370 msgr2=0x7ff37c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:04.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 -- 172.21.15.55:0/2248361631 shutdown_connections 2024-04-25T08:54:04.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:04.477+0000 7ff381c38640 1 -- 172.21.15.55:0/2248361631 wait complete. 2024-04-25T08:54:04.477 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:54:04.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:54:04.478 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2024-04-25T08:54:04.478 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T08:54:04.478 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T08:54:04.478 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:54:04.478 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:54:04.478 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:54:04.478 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T08:54:04.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:04.479 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2024-04-25T08:54:04.497 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:54:04.497 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:04.498 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:04.499 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:54:04.499 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:04.499 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:54:04.499 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42746sec preferred_lft 42746sec 2024-04-25T08:54:04.499 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::4848:8fe3:fbeb:dc0b/64 scope link noprefixroute 2024-04-25T08:54:04.499 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:04.499 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T08:54:04.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:04.499 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T08:54:04.499 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T08:54:04.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add name ceph-brx type bridge 2024-04-25T08:54:04.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr flush dev ceph-brx 2024-04-25T08:54:04.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set ceph-brx up 2024-04-25T08:54:04.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T08:54:04.500 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T08:54:04.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:04.642 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:54:04.666 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-04-25T08:54:04.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:04.668 DEBUG:teuthology.orchestra.run.smithi167:> route 2024-04-25T08:54:04.728 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2024-04-25T08:54:04.728 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:54:04.728 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:54:04.728 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:54:04.728 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:54:04.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:04.729 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T08:54:04.729 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T08:54:04.729 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:54:04.729 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:54:04.729 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:54:04.729 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T08:54:04.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:04.955 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T08:54:04.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:04.969 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2024-04-25T08:54:05.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:05.025 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T08:54:05.025 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T08:54:05.025 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T08:54:05.025 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T08:54:05.025 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T08:54:05.101 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T08:54:05.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:05.101 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T08:54:05.101 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T08:54:05.101 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T08:54:05.101 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T08:54:05.101 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T08:54:05.101 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T08:54:05.101 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T08:54:05.102 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T08:54:05.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:05.220 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T08:54:05.220 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T08:54:05.220 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2024-04-25T08:54:05.220 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T08:54:05.220 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T08:54:05.256 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:54:05.256 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T08:54:05.311 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T08:54:05.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:54:05.311 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T08:54:05.365 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:54:05.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:05.366 DEBUG:teuthology.orchestra.run.smithi167:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T08:54:05.452 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T08:54:05.452 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T08:54:05.452 INFO:teuthology.orchestra.run.smithi167.stdout:invalid new device string format 2024-04-25T08:54:05.559 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T08:54:05.559 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T08:54:05.560 INFO:teuthology.orchestra.run.smithi167.stdout:invalid new device string format 2024-04-25T08:54:05.560 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:54:05.560 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:54:05.569 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T08:54:05.569 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T08:54:05.570 INFO:teuthology.orchestra.run.smithi167.stdout:invalid new device string format 2024-04-25T08:54:05.570 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:54:05.570 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:54:05.570 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:54:05.570 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:54:05.570 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:54:05.570 INFO:teuthology.orchestra.run.smithi167.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T08:54:05.571 INFO:teuthology.orchestra.run.smithi167.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:54:05.571 INFO:teuthology.orchestra.run.smithi167.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:54:05.571 INFO:teuthology.orchestra.run.smithi167.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:54:05.571 INFO:teuthology.orchestra.run.smithi167.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:54:05.572 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:54:05.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:05.572 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T08:54:05.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:05.598 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:05.654 INFO:teuthology.orchestra.run.smithi167.stdout:client4719 2024-04-25T08:54:05.654 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:54:05.654 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:05.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:05.710 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:05.766 INFO:teuthology.orchestra.run.smithi167.stdout:client4719 2024-04-25T08:54:05.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:05.767 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:05.822 INFO:teuthology.orchestra.run.smithi167.stdout:client4719 2024-04-25T08:54:05.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:05.822 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c39ac909-02b8-4b68-9f8d-b272de9b1a7b.client4719/status') 2024-04-25T08:54:05.886 INFO:teuthology.orchestra.run.smithi167.stdout:instance: client.4719 (3)172.21.15.167:0/156630105 2024-04-25T08:54:05.886 INFO:teuthology.orchestra.run.smithi167.stdout:blocklisted: false 2024-04-25T08:54:05.887 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records in 2024-04-25T08:54:05.887 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records out 2024-04-25T08:54:05.887 INFO:teuthology.orchestra.run.smithi167.stderr:70 bytes copied, 2.2386e-05 s, 3.1 MB/s 2024-04-25T08:54:05.887 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-25T08:54:05.887 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:54:05.888 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T08:54:05.888 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:54:06.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.011+0000 7fbe9918b640 1 Processor -- start 2024-04-25T08:54:06.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.011+0000 7fbe9918b640 1 -- start start 2024-04-25T08:54:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.012+0000 7fbe9918b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe940cea00 0x7fbe940cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.012+0000 7fbe9918b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbe940cfbe0 0x7fbe940ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.012+0000 7fbe9918b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe940d0430 con 0x7fbe9415f120 2024-04-25T08:54:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.012+0000 7fbe9918b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe940d09f0 con 0x7fbe940cfbe0 2024-04-25T08:54:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.012+0000 7fbe9918b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe940d0710 con 0x7fbe940cea00 2024-04-25T08:54:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.012+0000 7fbe92d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbe9415f120 0x7fbe940ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55850/0 (socket says 172.21.15.55:55850) 2024-04-25T08:54:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.012+0000 7fbe92d9d640 1 -- 172.21.15.55:0/3893833113 learned_addr learned my addr 172.21.15.55:0/3893833113 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.012+0000 7fbe9259c640 1 --2- 172.21.15.55:0/3893833113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe940cea00 0x7fbe940cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.012+0000 7fbe9359e640 1 --2- 172.21.15.55:0/3893833113 >> v2:172.21.15.167:3300/0 conn(0x7fbe940cfbe0 0x7fbe940ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.013+0000 7fbe91d9b640 1 -- 172.21.15.55:0/3893833113 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786408921 0 0) 0x7fbe940d0430 con 0x7fbe9415f120 2024-04-25T08:54:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.013+0000 7fbe91d9b640 1 -- 172.21.15.55:0/3893833113 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe7c003520 con 0x7fbe9415f120 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.013+0000 7fbe9359e640 1 -- 172.21.15.55:0/3893833113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe940cea00 msgr2=0x7fbe940cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.013+0000 7fbe9359e640 1 --2- 172.21.15.55:0/3893833113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe940cea00 0x7fbe940cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.013+0000 7fbe9359e640 1 -- 172.21.15.55:0/3893833113 >> v1:172.21.15.55:6789/0 conn(0x7fbe9415f120 legacy=0x7fbe940ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.013+0000 7fbe9359e640 1 -- 172.21.15.55:0/3893833113 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe940cc7d0 con 0x7fbe940cfbe0 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe9359e640 1 --2- 172.21.15.55:0/3893833113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe940cfbe0 0x7fbe940ccfd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009d90 tx=0x7fbe8402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec8db0026209ed01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe91d9b640 1 -- 172.21.15.55:0/3893833113 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84007740 con 0x7fbe940cfbe0 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe91d9b640 1 -- 172.21.15.55:0/3893833113 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe840078e0 con 0x7fbe940cfbe0 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe91d9b640 1 -- 172.21.15.55:0/3893833113 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84007cb0 con 0x7fbe940cfbe0 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe9918b640 1 -- 172.21.15.55:0/3893833113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe940cfbe0 msgr2=0x7fbe940ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe9918b640 1 --2- 172.21.15.55:0/3893833113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe940cfbe0 0x7fbe940ccfd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009d90 tx=0x7fbe8402a6f0 comp rx=0 tx=0).stop 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe9918b640 1 -- 172.21.15.55:0/3893833113 shutdown_connections 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe9918b640 1 --2- 172.21.15.55:0/3893833113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe940cfbe0 0x7fbe940ccfd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe9918b640 1 --2- 172.21.15.55:0/3893833113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe940cea00 0x7fbe940cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:06.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe9918b640 1 -- 172.21.15.55:0/3893833113 >> 172.21.15.55:0/3893833113 conn(0x7fbe940d1900 msgr2=0x7fbe940d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:06.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe9918b640 1 -- 172.21.15.55:0/3893833113 shutdown_connections 2024-04-25T08:54:06.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.014+0000 7fbe9918b640 1 -- 172.21.15.55:0/3893833113 wait complete. 2024-04-25T08:54:06.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.016+0000 7fbe9918b640 1 Processor -- start 2024-04-25T08:54:06.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.016+0000 7fbe9918b640 1 -- start start 2024-04-25T08:54:06.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9918b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe940cea00 0x7fbe940caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:06.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9918b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe940cfbe0 0x7fbe9414bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:06.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9918b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9415f120 0x7fbe9414c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:06.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9918b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe940c5450 con 0x7fbe940cfbe0 2024-04-25T08:54:06.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9918b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe940cc480 con 0x7fbe9415f120 2024-04-25T08:54:06.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9918b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe940d0090 con 0x7fbe940cea00 2024-04-25T08:54:06.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe940cfbe0 0x7fbe9414bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:06.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe940cfbe0 0x7fbe9414bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49716/0 (socket says 172.21.15.55:49716) 2024-04-25T08:54:06.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9259c640 1 -- 172.21.15.55:0/3934982619 learned_addr learned my addr 172.21.15.55:0/3934982619 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9359e640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9415f120 0x7fbe9414c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe92d9d640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe940cea00 0x7fbe940caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9259c640 1 -- 172.21.15.55:0/3934982619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe940cea00 msgr2=0x7fbe940caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9259c640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe940cea00 0x7fbe940caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9259c640 1 -- 172.21.15.55:0/3934982619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9415f120 msgr2=0x7fbe9414c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9259c640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9415f120 0x7fbe9414c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9259c640 1 -- 172.21.15.55:0/3934982619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe940c9ee0 con 0x7fbe940cfbe0 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9359e640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9415f120 0x7fbe9414c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.017+0000 7fbe9259c640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe940cfbe0 0x7fbe9414bcd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e9e0 tx=0x7fbe8800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.018+0000 7fbe7b7fe640 1 -- 172.21.15.55:0/3934982619 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88017070 con 0x7fbe940cfbe0 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.018+0000 7fbe7b7fe640 1 -- 172.21.15.55:0/3934982619 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800c9d0 con 0x7fbe940cfbe0 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.018+0000 7fbe9918b640 1 -- 172.21.15.55:0/3934982619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe940ca1c0 con 0x7fbe940cfbe0 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.018+0000 7fbe7b7fe640 1 -- 172.21.15.55:0/3934982619 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800cdc0 con 0x7fbe940cfbe0 2024-04-25T08:54:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.018+0000 7fbe9918b640 1 -- 172.21.15.55:0/3934982619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe940ca780 con 0x7fbe940cfbe0 2024-04-25T08:54:06.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.019+0000 7fbe9918b640 1 -- 172.21.15.55:0/3934982619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe94067850 con 0x7fbe940cfbe0 2024-04-25T08:54:06.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.019+0000 7fbe7b7fe640 1 -- 172.21.15.55:0/3934982619 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbe8801a070 con 0x7fbe940cfbe0 2024-04-25T08:54:06.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.020+0000 7fbe7b7fe640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe8006b4d0 0x7fbe8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:06.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.020+0000 7fbe7b7fe640 1 -- 172.21.15.55:0/3934982619 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe8808a5b0 con 0x7fbe940cfbe0 2024-04-25T08:54:06.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.020+0000 7fbe92d9d640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe8006b4d0 0x7fbe8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:06.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.020+0000 7fbe92d9d640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe8006b4d0 0x7fbe8006d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005880 tx=0x7fbe8c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:06.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.024+0000 7fbe7b7fe640 1 -- 172.21.15.55:0/3934982619 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe88058d50 con 0x7fbe940cfbe0 2024-04-25T08:54:06.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.247+0000 7fbe9918b640 1 -- 172.21.15.55:0/3934982619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbe940c80a0 con 0x7fbe940cfbe0 2024-04-25T08:54:06.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.247+0000 7fbe7b7fe640 1 -- 172.21.15.55:0/3934982619 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbe8805cdf0 con 0x7fbe940cfbe0 2024-04-25T08:54:06.237 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:54:06.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 -- 172.21.15.55:0/3934982619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe8006b4d0 msgr2=0x7fbe8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:06.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe8006b4d0 0x7fbe8006d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005880 tx=0x7fbe8c009040 comp rx=0 tx=0).stop 2024-04-25T08:54:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 -- 172.21.15.55:0/3934982619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe940cfbe0 msgr2=0x7fbe9414bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe940cfbe0 0x7fbe9414bcd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e9e0 tx=0x7fbe8800eea0 comp rx=0 tx=0).stop 2024-04-25T08:54:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 -- 172.21.15.55:0/3934982619 shutdown_connections 2024-04-25T08:54:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe8006b4d0 0x7fbe8006d990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe9415f120 0x7fbe9414c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe940cfbe0 0x7fbe9414bcd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 --2- 172.21.15.55:0/3934982619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe940cea00 0x7fbe940caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 -- 172.21.15.55:0/3934982619 >> 172.21.15.55:0/3934982619 conn(0x7fbe940d1900 msgr2=0x7fbe940cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 -- 172.21.15.55:0/3934982619 shutdown_connections 2024-04-25T08:54:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:06.249+0000 7fbe9918b640 1 -- 172.21.15.55:0/3934982619 wait complete. 2024-04-25T08:54:06.250 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:54:06.250 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:54:06.250 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2024-04-25T08:54:06.250 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T08:54:06.250 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T08:54:06.250 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:54:06.250 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:54:06.250 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:54:06.250 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T08:54:06.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:06.251 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2024-04-25T08:54:06.266 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:06.267 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42744sec preferred_lft 42744sec 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::4848:8fe3:fbeb:dc0b/64 scope link noprefixroute 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether ea:6d:61:31:16:a1 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::1c1a:45ff:fee1:895d/64 scope link 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether ea:6d:61:31:16:a1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T08:54:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::e86d:61ff:fe31:16a1/64 scope link tentative 2024-04-25T08:54:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:06.269 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:54:06.330 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-04-25T08:54:06.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:06.331 DEBUG:teuthology.orchestra.run.smithi167:> route 2024-04-25T08:54:06.387 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2024-04-25T08:54:06.388 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:54:06.388 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:54:06.388 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:54:06.388 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:54:06.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:06.388 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T08:54:06.388 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T08:54:06.388 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:54:06.388 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:54:06.388 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:54:06.389 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T08:54:06.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:06.473 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T08:54:06.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T08:54:06.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:06.529 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2024-04-25T08:54:06.582 INFO:teuthology.orchestra.run.smithi167.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T08:54:06.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:06.583 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T08:54:06.583 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T08:54:06.583 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T08:54:06.583 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T08:54:06.583 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T08:54:06.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:06.660 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T08:54:06.723 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:54:06.723 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:54:06.724 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:54:06.724 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.724 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-04-25T08:54:06.724 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.724 INFO:teuthology.orchestra.run.smithi167.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:54:06.724 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 12:0d:de:2d:a1:44 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:54:06.724 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:54:06.724 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.724 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::100d:deff:fe2d:a144/64 scope link 2024-04-25T08:54:06.724 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:06.725 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T08:54:06.788 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:54:06.788 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:54:06.788 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:54:06.788 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.788 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-04-25T08:54:06.788 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.788 INFO:teuthology.orchestra.run.smithi167.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:54:06.788 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 12:0d:de:2d:a1:44 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:54:06.788 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:54:06.788 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.789 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::100d:deff:fe2d:a144/64 scope link 2024-04-25T08:54:06.789 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:06.790 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T08:54:06.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:06.790 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T08:54:06.790 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T08:54:06.790 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T08:54:06.790 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T08:54:06.790 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T08:54:06.790 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T08:54:06.791 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T08:54:06.791 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T08:54:06.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:06.898 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T08:54:06.898 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T08:54:06.898 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.1 up 2024-04-25T08:54:06.898 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T08:54:06.898 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T08:54:06.938 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:54:06.938 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T08:54:06.997 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T08:54:06.997 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:54:06.997 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T08:54:07.052 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:54:07.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:07.052 DEBUG:teuthology.orchestra.run.smithi167:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T08:54:07.133 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T08:54:07.133 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T08:54:07.133 INFO:teuthology.orchestra.run.smithi167.stdout:invalid new device string format 2024-04-25T08:54:07.141 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T08:54:07.142 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T08:54:07.142 INFO:teuthology.orchestra.run.smithi167.stdout:invalid new device string format 2024-04-25T08:54:07.142 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:54:07.142 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:54:07.147 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T08:54:07.147 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T08:54:07.147 INFO:teuthology.orchestra.run.smithi167.stdout:invalid new device string format 2024-04-25T08:54:07.147 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:54:07.147 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:54:07.147 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:54:07.147 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:54:07.147 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:54:07.150 INFO:teuthology.orchestra.run.smithi167.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-25T08:54:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:54:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:54:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:54:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:54:07.151 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:54:07.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:07.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T08:54:07.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:07.216 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:07.273 INFO:teuthology.orchestra.run.smithi167.stdout:client4728 2024-04-25T08:54:07.273 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:54:07.273 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:07.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:07.328 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:07.384 INFO:teuthology.orchestra.run.smithi167.stdout:client4728 2024-04-25T08:54:07.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:07.384 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:07.440 INFO:teuthology.orchestra.run.smithi167.stdout:client4728 2024-04-25T08:54:07.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:07.440 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c39ac909-02b8-4b68-9f8d-b272de9b1a7b.client4728/status') 2024-04-25T08:54:07.503 INFO:teuthology.orchestra.run.smithi167.stdout:instance: client.4728 (3)172.21.15.167:0/3937059764 2024-04-25T08:54:07.503 INFO:teuthology.orchestra.run.smithi167.stdout:blocklisted: false 2024-04-25T08:54:07.503 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records in 2024-04-25T08:54:07.504 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records out 2024-04-25T08:54:07.504 INFO:teuthology.orchestra.run.smithi167.stderr:71 bytes copied, 2.1613e-05 s, 3.3 MB/s 2024-04-25T08:54:07.505 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T08:54:07.521 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.648+0000 7fe12b29a640 1 Processor -- start 2024-04-25T08:54:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.648+0000 7fe12b29a640 1 -- start start 2024-04-25T08:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.648+0000 7fe12b29a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1240d35b0 0x7fe1240b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe12b29a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12415e0c0 con 0x7fe12415dce0 2024-04-25T08:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe12b29a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1240d2510 con 0x7fe1240b5990 2024-04-25T08:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe12b29a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1240d27f0 con 0x7fe1240d35b0 2024-04-25T08:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe129036640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe12415dce0 0x7fe1240d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55864/0 (socket says 172.21.15.55:55864) 2024-04-25T08:54:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe129036640 1 -- 172.21.15.55:0/2838309434 learned_addr learned my addr 172.21.15.55:0/2838309434 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe128835640 1 --2- 172.21.15.55:0/2838309434 >> v2:172.21.15.167:3300/0 conn(0x7fe1240d35b0 0x7fe1240b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe11bfff640 1 -- 172.21.15.55:0/2838309434 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632207671 0 0) 0x7fe12415e0c0 con 0x7fe12415dce0 2024-04-25T08:54:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe11bfff640 1 -- 172.21.15.55:0/2838309434 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe110003520 con 0x7fe12415dce0 2024-04-25T08:54:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe128835640 1 -- 172.21.15.55:0/2838309434 >> v1:172.21.15.167:6789/0 conn(0x7fe1240b5990 legacy=0x7fe1240b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe11bfff640 1 -- 172.21.15.55:0/2838309434 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601407788 0 0) 0x7fe1240d2510 con 0x7fe1240b5990 2024-04-25T08:54:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe128835640 1 -- 172.21.15.55:0/2838309434 >> v1:172.21.15.55:6789/0 conn(0x7fe12415dce0 legacy=0x7fe1240d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.649+0000 7fe128835640 1 -- 172.21.15.55:0/2838309434 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1240d2ad0 con 0x7fe1240d35b0 2024-04-25T08:54:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.650+0000 7fe128835640 1 --2- 172.21.15.55:0/2838309434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1240d35b0 0x7fe1240b5450 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe1140097a0 tx=0x7fe11402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36bbe77f79c7e4cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.650+0000 7fe11bfff640 1 -- 172.21.15.55:0/2838309434 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114037070 con 0x7fe1240d35b0 2024-04-25T08:54:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.650+0000 7fe11bfff640 1 -- 172.21.15.55:0/2838309434 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe114032440 con 0x7fe1240d35b0 2024-04-25T08:54:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.650+0000 7fe11bfff640 1 -- 172.21.15.55:0/2838309434 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114032810 con 0x7fe1240d35b0 2024-04-25T08:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.651+0000 7fe12b29a640 1 -- 172.21.15.55:0/2838309434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1240d35b0 msgr2=0x7fe1240b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.651+0000 7fe12b29a640 1 --2- 172.21.15.55:0/2838309434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1240d35b0 0x7fe1240b5450 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe1140097a0 tx=0x7fe11402a230 comp rx=0 tx=0).stop 2024-04-25T08:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.651+0000 7fe12b29a640 1 -- 172.21.15.55:0/2838309434 shutdown_connections 2024-04-25T08:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.651+0000 7fe12b29a640 1 --2- 172.21.15.55:0/2838309434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1240d35b0 0x7fe1240b5450 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.651+0000 7fe12b29a640 1 -- 172.21.15.55:0/2838309434 >> 172.21.15.55:0/2838309434 conn(0x7fe124072900 msgr2=0x7fe1240d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.651+0000 7fe12b29a640 1 -- 172.21.15.55:0/2838309434 shutdown_connections 2024-04-25T08:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.651+0000 7fe12b29a640 1 -- 172.21.15.55:0/2838309434 wait complete. 2024-04-25T08:54:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.652+0000 7fe12b29a640 1 Processor -- start 2024-04-25T08:54:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.652+0000 7fe12b29a640 1 -- start start 2024-04-25T08:54:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe12b29a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1240b5990 0x7fe124156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe12b29a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1240d35b0 0x7fe12415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe12b29a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe12415dce0 0x7fe1241f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe12b29a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240d2160 con 0x7fe1240b5990 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe12b29a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240d3090 con 0x7fe12415dce0 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe12b29a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe124157470 con 0x7fe1240d35b0 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe129036640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1240b5990 0x7fe124156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe129036640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1240b5990 0x7fe124156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49724/0 (socket says 172.21.15.55:49724) 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe129036640 1 -- 172.21.15.55:0/595040325 learned_addr learned my addr 172.21.15.55:0/595040325 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe129837640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe12415dce0 0x7fe1241f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe128835640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1240d35b0 0x7fe12415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe129036640 1 -- 172.21.15.55:0/595040325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1240d35b0 msgr2=0x7fe12415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe129036640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1240d35b0 0x7fe12415ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe129036640 1 -- 172.21.15.55:0/595040325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe12415dce0 msgr2=0x7fe1241f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe129036640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe12415dce0 0x7fe1241f35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.653+0000 7fe129036640 1 -- 172.21.15.55:0/595040325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1241f40e0 con 0x7fe1240b5990 2024-04-25T08:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.654+0000 7fe129036640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1240b5990 0x7fe124156f30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00c3c0 tx=0x7fe11c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.654+0000 7fe119ffb640 1 -- 172.21.15.55:0/595040325 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c017070 con 0x7fe1240b5990 2024-04-25T08:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.654+0000 7fe119ffb640 1 -- 172.21.15.55:0/595040325 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c005ce0 con 0x7fe1240b5990 2024-04-25T08:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.654+0000 7fe12b29a640 1 -- 172.21.15.55:0/595040325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1241f43c0 con 0x7fe1240b5990 2024-04-25T08:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.654+0000 7fe119ffb640 1 -- 172.21.15.55:0/595040325 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c0072f0 con 0x7fe1240b5990 2024-04-25T08:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.654+0000 7fe12b29a640 1 -- 172.21.15.55:0/595040325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12415e7a0 con 0x7fe1240b5990 2024-04-25T08:54:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.655+0000 7fe12b29a640 1 -- 172.21.15.55:0/595040325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1240d2510 con 0x7fe1240b5990 2024-04-25T08:54:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.656+0000 7fe119ffb640 1 -- 172.21.15.55:0/595040325 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe11c01a070 con 0x7fe1240b5990 2024-04-25T08:54:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.656+0000 7fe119ffb640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe10806b4d0 0x7fe10806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.656+0000 7fe119ffb640 1 -- 172.21.15.55:0/595040325 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe11c089490 con 0x7fe1240b5990 2024-04-25T08:54:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.656+0000 7fe128835640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe10806b4d0 0x7fe10806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.657+0000 7fe128835640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe10806b4d0 0x7fe10806d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe114034000 tx=0x7fe11402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.660+0000 7fe119ffb640 1 -- 172.21.15.55:0/595040325 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1240d2510 con 0x7fe1240b5990 2024-04-25T08:54:07.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.844+0000 7fe12b29a640 1 -- 172.21.15.55:0/595040325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1240749b0 con 0x7fe1240b5990 2024-04-25T08:54:07.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.845+0000 7fe119ffb640 1 -- 172.21.15.55:0/595040325 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fe11c057d50 con 0x7fe1240b5990 2024-04-25T08:54:07.835 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:07.835 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.847+0000 7fe12b29a640 1 -- 172.21.15.55:0/595040325 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe10806b4d0 msgr2=0x7fe10806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.847+0000 7fe12b29a640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe10806b4d0 0x7fe10806d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe114034000 tx=0x7fe11402e000 comp rx=0 tx=0).stop 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.847+0000 7fe12b29a640 1 -- 172.21.15.55:0/595040325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1240b5990 msgr2=0x7fe124156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.847+0000 7fe12b29a640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1240b5990 0x7fe124156f30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00c3c0 tx=0x7fe11c00c880 comp rx=0 tx=0).stop 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.847+0000 7fe12b29a640 1 -- 172.21.15.55:0/595040325 shutdown_connections 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.847+0000 7fe12b29a640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe10806b4d0 0x7fe10806d990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.847+0000 7fe12b29a640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe12415dce0 0x7fe1241f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.847+0000 7fe12b29a640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1240d35b0 0x7fe12415ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.847+0000 7fe12b29a640 1 --2- 172.21.15.55:0/595040325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1240b5990 0x7fe124156f30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.847+0000 7fe12b29a640 1 -- 172.21.15.55:0/595040325 >> 172.21.15.55:0/595040325 conn(0x7fe124072900 msgr2=0x7fe1240b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.848+0000 7fe12b29a640 1 -- 172.21.15.55:0/595040325 shutdown_connections 2024-04-25T08:54:07.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.848+0000 7fe12b29a640 1 -- 172.21.15.55:0/595040325 wait complete. 2024-04-25T08:54:07.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:07.849 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:07.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.962+0000 7fdc131a5640 1 Processor -- start 2024-04-25T08:54:07.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.963+0000 7fdc131a5640 1 -- start start 2024-04-25T08:54:07.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.963+0000 7fdc131a5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc0c0afa30 0x7fdc0c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:07.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.963+0000 7fdc131a5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0afe10 0x7fdc0c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:07.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.963+0000 7fdc131a5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c06b4b0 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.963+0000 7fdc131a5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c162120 con 0x7fdc0c0afa30 2024-04-25T08:54:07.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.963+0000 7fdc131a5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c161ad0 con 0x7fdc0c0afe10 2024-04-25T08:54:07.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.963+0000 7fdc10f41640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc0c0afa30 0x7fdc0c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:07.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.964+0000 7fdc10f41640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc0c0afa30 0x7fdc0c06aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49734/0 (socket says 172.21.15.55:49734) 2024-04-25T08:54:07.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.964+0000 7fdc10f41640 1 -- 172.21.15.55:0/871648857 learned_addr learned my addr 172.21.15.55:0/871648857 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.964+0000 7fdc0bfff640 1 --2- 172.21.15.55:0/871648857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0afe10 0x7fdc0c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.964+0000 7fdc10f41640 1 -- 172.21.15.55:0/871648857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0afe10 msgr2=0x7fdc0c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.964+0000 7fdc10f41640 1 --2- 172.21.15.55:0/871648857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0afe10 0x7fdc0c0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.964+0000 7fdc10f41640 1 -- 172.21.15.55:0/871648857 >> v1:172.21.15.167:6789/0 conn(0x7fdc0c0b2f60 legacy=0x7fdc0c06e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.964+0000 7fdc10f41640 1 -- 172.21.15.55:0/871648857 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c161db0 con 0x7fdc0c0afa30 2024-04-25T08:54:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.964+0000 7fdc0b7fe640 1 -- 172.21.15.55:0/871648857 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668673524 0 0) 0x7fdc0c06b4b0 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc10f41640 1 --2- 172.21.15.55:0/871648857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc0c0afa30 0x7fdc0c06aba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009e50 tx=0x7fdc0402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5f898cc301a8ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc0b7fe640 1 -- 172.21.15.55:0/871648857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04036070 con 0x7fdc0c0afa30 2024-04-25T08:54:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc0b7fe640 1 -- 172.21.15.55:0/871648857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc04031600 con 0x7fdc0c0afa30 2024-04-25T08:54:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc0b7fe640 1 -- 172.21.15.55:0/871648857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040319d0 con 0x7fdc0c0afa30 2024-04-25T08:54:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc131a5640 1 -- 172.21.15.55:0/871648857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc0c0afa30 msgr2=0x7fdc0c06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:07.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc131a5640 1 --2- 172.21.15.55:0/871648857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc0c0afa30 0x7fdc0c06aba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009e50 tx=0x7fdc0402a730 comp rx=0 tx=0).stop 2024-04-25T08:54:07.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc131a5640 1 -- 172.21.15.55:0/871648857 shutdown_connections 2024-04-25T08:54:07.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc131a5640 1 --2- 172.21.15.55:0/871648857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0afe10 0x7fdc0c0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc131a5640 1 --2- 172.21.15.55:0/871648857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc0c0afa30 0x7fdc0c06aba0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc131a5640 1 -- 172.21.15.55:0/871648857 >> 172.21.15.55:0/871648857 conn(0x7fdc0c099a40 msgr2=0x7fdc0c0b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:07.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc131a5640 1 -- 172.21.15.55:0/871648857 shutdown_connections 2024-04-25T08:54:07.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.965+0000 7fdc131a5640 1 -- 172.21.15.55:0/871648857 wait complete. 2024-04-25T08:54:07.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.966+0000 7fdc131a5640 1 Processor -- start 2024-04-25T08:54:07.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.967+0000 7fdc131a5640 1 -- start start 2024-04-25T08:54:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.967+0000 7fdc131a5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0afa30 0x7fdc0c14b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.967+0000 7fdc131a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc0c0b2f60 0x7fdc0c0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.967+0000 7fdc131a5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c0c9880 0x7fdc0c0aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.967+0000 7fdc131a5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c162730 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.967+0000 7fdc131a5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c1625b0 con 0x7fdc0c0c9880 2024-04-25T08:54:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.967+0000 7fdc131a5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0c9e90 con 0x7fdc0c0afa30 2024-04-25T08:54:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.967+0000 7fdc0bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc0c0b2f60 0x7fdc0c0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc0bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc0c0b2f60 0x7fdc0c0c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49744/0 (socket says 172.21.15.55:49744) 2024-04-25T08:54:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc0bfff640 1 -- 172.21.15.55:0/1886272817 learned_addr learned my addr 172.21.15.55:0/1886272817 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc10f41640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0afa30 0x7fdc0c14b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc11742640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c0c9880 0x7fdc0c0aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc0bfff640 1 -- 172.21.15.55:0/1886272817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0afa30 msgr2=0x7fdc0c14b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc0bfff640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0afa30 0x7fdc0c14b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc0bfff640 1 -- 172.21.15.55:0/1886272817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c0c9880 msgr2=0x7fdc0c0aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc0bfff640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c0c9880 0x7fdc0c0aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc0bfff640 1 -- 172.21.15.55:0/1886272817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c0ca170 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc11742640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c0c9880 0x7fdc0c0aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc0bfff640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc0c0b2f60 0x7fdc0c0c9340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00e9b0 tx=0x7fdbfc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc097fa640 1 -- 172.21.15.55:0/1886272817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc017070 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc097fa640 1 -- 172.21.15.55:0/1886272817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc00c9a0 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc131a5640 1 -- 172.21.15.55:0/1886272817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c0ca450 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc097fa640 1 -- 172.21.15.55:0/1886272817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc00cd90 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.968+0000 7fdc131a5640 1 -- 172.21.15.55:0/1886272817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c14bf60 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.969+0000 7fdc131a5640 1 -- 172.21.15.55:0/1886272817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0c0750b0 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.970+0000 7fdc097fa640 1 -- 172.21.15.55:0/1886272817 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdbfc01a070 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.970+0000 7fdc097fa640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbec06b4d0 0x7fdbec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.970+0000 7fdc097fa640 1 -- 172.21.15.55:0/1886272817 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbfc08a530 con 0x7fdc0c0b2f60 2024-04-25T08:54:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.970+0000 7fdc10f41640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbec06b4d0 0x7fdbec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.971+0000 7fdc10f41640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbec06b4d0 0x7fdbec06d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdc04033000 tx=0x7fdc04009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:07.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:07.974+0000 7fdc097fa640 1 -- 172.21.15.55:0/1886272817 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdbfc058d60 con 0x7fdc0c0b2f60 2024-04-25T08:54:08.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.154+0000 7fdc131a5640 1 -- 172.21.15.55:0/1886272817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc0c099e50 con 0x7fdc0c0b2f60 2024-04-25T08:54:08.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.154+0000 7fdc097fa640 1 -- 172.21.15.55:0/1886272817 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdbfc05ce00 con 0x7fdc0c0b2f60 2024-04-25T08:54:08.144 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.156+0000 7fdc131a5640 1 -- 172.21.15.55:0/1886272817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbec06b4d0 msgr2=0x7fdbec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.156+0000 7fdc131a5640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbec06b4d0 0x7fdbec06d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdc04033000 tx=0x7fdc04009000 comp rx=0 tx=0).stop 2024-04-25T08:54:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.156+0000 7fdc131a5640 1 -- 172.21.15.55:0/1886272817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc0c0b2f60 msgr2=0x7fdc0c0c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.156+0000 7fdc131a5640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc0c0b2f60 0x7fdc0c0c9340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00e9b0 tx=0x7fdbfc00ee70 comp rx=0 tx=0).stop 2024-04-25T08:54:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.156+0000 7fdc131a5640 1 -- 172.21.15.55:0/1886272817 shutdown_connections 2024-04-25T08:54:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.156+0000 7fdc131a5640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbec06b4d0 0x7fdbec06d990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.156+0000 7fdc131a5640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c0c9880 0x7fdc0c0aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.157+0000 7fdc131a5640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc0c0b2f60 0x7fdc0c0c9340 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.157+0000 7fdc131a5640 1 --2- 172.21.15.55:0/1886272817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0afa30 0x7fdc0c14b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.157+0000 7fdc131a5640 1 -- 172.21.15.55:0/1886272817 >> 172.21.15.55:0/1886272817 conn(0x7fdc0c099a40 msgr2=0x7fdc0c0cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:08.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.157+0000 7fdc131a5640 1 -- 172.21.15.55:0/1886272817 shutdown_connections 2024-04-25T08:54:08.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.157+0000 7fdc131a5640 1 -- 172.21.15.55:0/1886272817 wait complete. 2024-04-25T08:54:08.157 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:54:08.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.271+0000 7faa0afdb640 1 Processor -- start 2024-04-25T08:54:08.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.271+0000 7faa0afdb640 1 -- start start 2024-04-25T08:54:08.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.272+0000 7faa0afdb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faa0415e040 0x7faa040cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.272+0000 7faa0afdb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa040ce410 0x7faa040cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.272+0000 7faa0afdb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa040cee20 0x7faa040cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.272+0000 7faa0afdb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa040cb350 con 0x7faa040ce410 2024-04-25T08:54:08.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.272+0000 7faa0afdb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa040ce9d0 con 0x7faa0415e040 2024-04-25T08:54:08.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.272+0000 7faa0afdb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa040cb5f0 con 0x7faa040cee20 2024-04-25T08:54:08.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.272+0000 7fa9fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa040ce410 0x7faa040cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.272+0000 7fa9fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa040ce410 0x7faa040cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49754/0 (socket says 172.21.15.55:49754) 2024-04-25T08:54:08.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.272+0000 7fa9fbfff640 1 -- 172.21.15.55:0/4092225470 learned_addr learned my addr 172.21.15.55:0/4092225470 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:08.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.273+0000 7faa08d77640 1 --2- 172.21.15.55:0/4092225470 >> v2:172.21.15.167:3300/0 conn(0x7faa0415e040 0x7faa040cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.273+0000 7faa09578640 1 --2- 172.21.15.55:0/4092225470 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa040cee20 0x7faa040cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.273+0000 7fa9fbfff640 1 -- 172.21.15.55:0/4092225470 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa040cee20 msgr2=0x7faa040cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:08.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.273+0000 7fa9fbfff640 1 --2- 172.21.15.55:0/4092225470 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa040cee20 0x7faa040cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.273+0000 7fa9fbfff640 1 -- 172.21.15.55:0/4092225470 >> v2:172.21.15.167:3300/0 conn(0x7faa0415e040 msgr2=0x7faa040cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:08.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.273+0000 7fa9fbfff640 1 --2- 172.21.15.55:0/4092225470 >> v2:172.21.15.167:3300/0 conn(0x7faa0415e040 0x7faa040cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.273+0000 7fa9fbfff640 1 -- 172.21.15.55:0/4092225470 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa040cb8d0 con 0x7faa040ce410 2024-04-25T08:54:08.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7fa9fbfff640 1 --2- 172.21.15.55:0/4092225470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa040ce410 0x7faa040cc0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009870 tx=0x7fa9f402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b634da1c36e669d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:08.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7fa9fb7fe640 1 -- 172.21.15.55:0/4092225470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4037070 con 0x7faa040ce410 2024-04-25T08:54:08.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7fa9fb7fe640 1 -- 172.21.15.55:0/4092225470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f4032440 con 0x7faa040ce410 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7fa9fb7fe640 1 -- 172.21.15.55:0/4092225470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4032810 con 0x7faa040ce410 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7faa0afdb640 1 -- 172.21.15.55:0/4092225470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa040ce410 msgr2=0x7faa040cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7faa0afdb640 1 --2- 172.21.15.55:0/4092225470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa040ce410 0x7faa040cc0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009870 tx=0x7fa9f402a210 comp rx=0 tx=0).stop 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7faa0afdb640 1 -- 172.21.15.55:0/4092225470 shutdown_connections 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7faa0afdb640 1 --2- 172.21.15.55:0/4092225470 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa040cee20 0x7faa040cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7faa0afdb640 1 --2- 172.21.15.55:0/4092225470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa040ce410 0x7faa040cc0d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7faa0afdb640 1 --2- 172.21.15.55:0/4092225470 >> v2:172.21.15.167:3300/0 conn(0x7faa0415e040 0x7faa040cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7faa0afdb640 1 -- 172.21.15.55:0/4092225470 >> 172.21.15.55:0/4092225470 conn(0x7faa040b2390 msgr2=0x7faa040b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7faa0afdb640 1 -- 172.21.15.55:0/4092225470 shutdown_connections 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.274+0000 7faa0afdb640 1 -- 172.21.15.55:0/4092225470 wait complete. 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.275+0000 7faa0afdb640 1 Processor -- start 2024-04-25T08:54:08.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.275+0000 7faa0afdb640 1 -- start start 2024-04-25T08:54:08.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.276+0000 7faa0afdb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa040ce410 0x7faa040c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.276+0000 7faa0afdb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa040cee20 0x7faa04157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.276+0000 7faa0afdb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0415e040 0x7faa0415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.276+0000 7faa0afdb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa040ce0f0 con 0x7faa0415e040 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.276+0000 7faa0afdb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0415e420 con 0x7faa040cee20 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.276+0000 7faa0afdb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa040ce270 con 0x7faa040ce410 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.276+0000 7faa09578640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0415e040 0x7faa0415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.276+0000 7faa09578640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0415e040 0x7faa0415b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49764/0 (socket says 172.21.15.55:49764) 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.276+0000 7faa09578640 1 -- 172.21.15.55:0/950074117 learned_addr learned my addr 172.21.15.55:0/950074117 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7faa08d77640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa040ce410 0x7faa040c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7fa9fbfff640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa040cee20 0x7faa04157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7faa09578640 1 -- 172.21.15.55:0/950074117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa040ce410 msgr2=0x7faa040c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7faa09578640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa040ce410 0x7faa040c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7faa09578640 1 -- 172.21.15.55:0/950074117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa040cee20 msgr2=0x7faa04157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7faa09578640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa040cee20 0x7faa04157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7faa09578640 1 -- 172.21.15.55:0/950074117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0415be80 con 0x7faa0415e040 2024-04-25T08:54:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7faa08d77640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa040ce410 0x7faa040c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7fa9fbfff640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa040cee20 0x7faa04157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7faa09578640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0415e040 0x7faa0415b630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00ef00 tx=0x7fa9fc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7fa9f97fa640 1 -- 172.21.15.55:0/950074117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc018020 con 0x7faa0415e040 2024-04-25T08:54:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7fa9f97fa640 1 -- 172.21.15.55:0/950074117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc00bd20 con 0x7faa0415e040 2024-04-25T08:54:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7faa0afdb640 1 -- 172.21.15.55:0/950074117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0415c160 con 0x7faa0415e040 2024-04-25T08:54:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7fa9f97fa640 1 -- 172.21.15.55:0/950074117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc014640 con 0x7faa0415e040 2024-04-25T08:54:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.277+0000 7faa0afdb640 1 -- 172.21.15.55:0/950074117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa040c7b60 con 0x7faa0415e040 2024-04-25T08:54:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.278+0000 7faa0afdb640 1 -- 172.21.15.55:0/950074117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0406f590 con 0x7faa0415e040 2024-04-25T08:54:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.279+0000 7fa9f97fa640 1 -- 172.21.15.55:0/950074117 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa9fc01b020 con 0x7faa0415e040 2024-04-25T08:54:08.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.279+0000 7fa9f97fa640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa9f006b4d0 0x7fa9f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.279+0000 7fa9f97fa640 1 -- 172.21.15.55:0/950074117 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9fc08a810 con 0x7faa0415e040 2024-04-25T08:54:08.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.279+0000 7faa08d77640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa9f006b4d0 0x7fa9f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.280+0000 7faa08d77640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa9f006b4d0 0x7fa9f006d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa00009b90 tx=0x7faa00008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:08.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.283+0000 7fa9f97fa640 1 -- 172.21.15.55:0/950074117 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faa0406f590 con 0x7faa0415e040 2024-04-25T08:54:08.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.462+0000 7faa0afdb640 1 -- 172.21.15.55:0/950074117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa040c7970 con 0x7faa0415e040 2024-04-25T08:54:08.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.463+0000 7fa9f97fa640 1 -- 172.21.15.55:0/950074117 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa9fc022030 con 0x7faa0415e040 2024-04-25T08:54:08.453 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:54:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 -- 172.21.15.55:0/950074117 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa9f006b4d0 msgr2=0x7fa9f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa9f006b4d0 0x7fa9f006d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa00009b90 tx=0x7faa00008040 comp rx=0 tx=0).stop 2024-04-25T08:54:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 -- 172.21.15.55:0/950074117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0415e040 msgr2=0x7faa0415b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0415e040 0x7faa0415b630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00ef00 tx=0x7fa9fc00b480 comp rx=0 tx=0).stop 2024-04-25T08:54:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 -- 172.21.15.55:0/950074117 shutdown_connections 2024-04-25T08:54:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa9f006b4d0 0x7fa9f006d990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0415e040 0x7faa0415b630 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa040cee20 0x7faa04157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 --2- 172.21.15.55:0/950074117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa040ce410 0x7faa040c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 -- 172.21.15.55:0/950074117 >> 172.21.15.55:0/950074117 conn(0x7faa040b2390 msgr2=0x7faa040b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 -- 172.21.15.55:0/950074117 shutdown_connections 2024-04-25T08:54:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.465+0000 7faa0afdb640 1 -- 172.21.15.55:0/950074117 wait complete. 2024-04-25T08:54:08.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:54:08.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.580+0000 7f922361f640 1 Processor -- start 2024-04-25T08:54:08.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.580+0000 7f922361f640 1 -- start start 2024-04-25T08:54:08.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f922361f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f921c15dc80 0x7f921c161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f922361f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c1627a0 con 0x7f921c0b5c00 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f922361f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c1621e0 con 0x7f921c0b97c0 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f922361f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c1624c0 con 0x7f921c15dc80 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9221bbc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f921c0b5c00 0x7f921c0d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55868/0 (socket says 172.21.15.55:55868) 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9221bbc640 1 -- 172.21.15.55:0/1064226627 learned_addr learned my addr 172.21.15.55:0/1064226627 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921014635 0 0) 0x7f921c1627a0 con 0x7f921c0b5c00 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f92213bb640 1 --2- 172.21.15.55:0/1064226627 >> v2:172.21.15.167:3300/0 conn(0x7f921c15dc80 0x7f921c161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9208003520 con 0x7f921c0b5c00 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 30968 0 0) 0x7f9208003520 con 0x7f921c0b5c00 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 >> v2:172.21.15.167:3300/0 conn(0x7f921c15dc80 msgr2=0x7f921c161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9213fff640 1 --2- 172.21.15.55:0/1064226627 >> v2:172.21.15.167:3300/0 conn(0x7f921c15dc80 0x7f921c161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 >> v1:172.21.15.167:6789/0 conn(0x7f921c0b97c0 legacy=0x7f921c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0d1c70 con 0x7f921c0b5c00 2024-04-25T08:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f92140019f0 con 0x7f921c0b5c00 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 >> v1:172.21.15.55:6789/0 conn(0x7f921c0b5c00 legacy=0x7f921c0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.581+0000 7f9213fff640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92080039b0 0x7f9208003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f9213fff640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9208004800 0x7f9208004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f9213fff640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92080051c0 0x7f920800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c1624c0 con 0x7f92080039b0 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920800c060 con 0x7f92080051c0 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920800c260 con 0x7f9208004800 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f92213bb640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92080039b0 0x7f9208003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f9220bba640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9208004800 0x7f9208004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f9221bbc640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92080051c0 0x7f920800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f92213bb640 1 -- 172.21.15.55:0/1064226627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9208004800 msgr2=0x7f9208004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f92213bb640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9208004800 0x7f9208004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f92213bb640 1 -- 172.21.15.55:0/1064226627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92080051c0 msgr2=0x7f920800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:08.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f92213bb640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92080051c0 0x7f920800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f92213bb640 1 -- 172.21.15.55:0/1064226627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208003520 con 0x7f92080039b0 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f9221bbc640 1 -- 172.21.15.55:0/1064226627 reap_dead start 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.582+0000 7f9220bba640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9208004800 0x7f9208004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.583+0000 7f92213bb640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92080039b0 0x7f9208003dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9218009ac0 tx=0x7f9208005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea6ff4db0edd95d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.583+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218036070 con 0x7f92080039b0 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.583+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9218031400 con 0x7f92080039b0 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.583+0000 7f9213fff640 1 -- 172.21.15.55:0/1064226627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218009690 con 0x7f92080039b0 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.583+0000 7f922361f640 1 -- 172.21.15.55:0/1064226627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92080039b0 msgr2=0x7f9208003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.583+0000 7f922361f640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92080039b0 0x7f9208003dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9218009ac0 tx=0x7f9208005830 comp rx=0 tx=0).stop 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.583+0000 7f922361f640 1 -- 172.21.15.55:0/1064226627 shutdown_connections 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.583+0000 7f922361f640 1 --2- 172.21.15.55:0/1064226627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92080039b0 0x7f9208003dd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.583+0000 7f922361f640 1 -- 172.21.15.55:0/1064226627 >> 172.21.15.55:0/1064226627 conn(0x7f921c0d04f0 msgr2=0x7f921c0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.583+0000 7f922361f640 1 -- 172.21.15.55:0/1064226627 shutdown_connections 2024-04-25T08:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.583+0000 7f922361f640 1 -- 172.21.15.55:0/1064226627 wait complete. 2024-04-25T08:54:08.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.585+0000 7f922361f640 1 Processor -- start 2024-04-25T08:54:08.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.585+0000 7f922361f640 1 -- start start 2024-04-25T08:54:08.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.585+0000 7f922361f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92080039b0 0x7f921c1e8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.585+0000 7f922361f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f921c1e8f10 0x7f921c143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.585+0000 7f922361f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f921c1e9370 0x7f921c144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.585+0000 7f922361f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0b5670 con 0x7f921c1e8f10 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.585+0000 7f922361f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0b54f0 con 0x7f921c1e9370 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.585+0000 7f922361f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0b57f0 con 0x7f92080039b0 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.585+0000 7f9220bba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f921c1e8f10 0x7f921c143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9220bba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f921c1e8f10 0x7f921c143cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49770/0 (socket says 172.21.15.55:49770) 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9220bba640 1 -- 172.21.15.55:0/1636395259 learned_addr learned my addr 172.21.15.55:0/1636395259 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9221bbc640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f921c1e9370 0x7f921c144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f92213bb640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92080039b0 0x7f921c1e8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9220bba640 1 -- 172.21.15.55:0/1636395259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92080039b0 msgr2=0x7f921c1e8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9220bba640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92080039b0 0x7f921c1e8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9220bba640 1 -- 172.21.15.55:0/1636395259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f921c1e9370 msgr2=0x7f921c144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9220bba640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f921c1e9370 0x7f921c144200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9220bba640 1 -- 172.21.15.55:0/1636395259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c144740 con 0x7f921c1e8f10 2024-04-25T08:54:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9220bba640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f921c1e8f10 0x7f921c143cc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f920c00e480 tx=0x7f920c00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9211ffb640 1 -- 172.21.15.55:0/1636395259 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c0052e0 con 0x7f921c1e8f10 2024-04-25T08:54:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9211ffb640 1 -- 172.21.15.55:0/1636395259 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c007020 con 0x7f921c1e8f10 2024-04-25T08:54:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f922361f640 1 -- 172.21.15.55:0/1636395259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c15e310 con 0x7f921c1e8f10 2024-04-25T08:54:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f9211ffb640 1 -- 172.21.15.55:0/1636395259 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c007210 con 0x7f921c1e8f10 2024-04-25T08:54:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.586+0000 7f922361f640 1 -- 172.21.15.55:0/1636395259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c1e8710 con 0x7f921c1e8f10 2024-04-25T08:54:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.587+0000 7f922361f640 1 -- 172.21.15.55:0/1636395259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c1e8540 con 0x7f921c1e8f10 2024-04-25T08:54:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.588+0000 7f9211ffb640 1 -- 172.21.15.55:0/1636395259 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f920c01a020 con 0x7f921c1e8f10 2024-04-25T08:54:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.588+0000 7f9211ffb640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f920006b4d0 0x7f920006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.588+0000 7f9211ffb640 1 -- 172.21.15.55:0/1636395259 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f920c0897c0 con 0x7f921c1e8f10 2024-04-25T08:54:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.588+0000 7f92213bb640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f920006b4d0 0x7f920006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.588+0000 7f92213bb640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f920006b4d0 0x7f920006d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9218033000 tx=0x7f9218008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:08.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.592+0000 7f9211ffb640 1 -- 172.21.15.55:0/1636395259 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f920c058640 con 0x7f921c1e8f10 2024-04-25T08:54:08.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.774+0000 7f922361f640 1 -- 172.21.15.55:0/1636395259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f921c15e830 con 0x7f921c1e8f10 2024-04-25T08:54:08.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.774+0000 7f9211ffb640 1 -- 172.21.15.55:0/1636395259 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f921c15e830 con 0x7f921c1e8f10 2024-04-25T08:54:08.764 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:54:08.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 -- 172.21.15.55:0/1636395259 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f920006b4d0 msgr2=0x7f920006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f920006b4d0 0x7f920006d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9218033000 tx=0x7f9218008030 comp rx=0 tx=0).stop 2024-04-25T08:54:08.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 -- 172.21.15.55:0/1636395259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f921c1e8f10 msgr2=0x7f921c143cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f921c1e8f10 0x7f921c143cc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f920c00e480 tx=0x7f920c00e940 comp rx=0 tx=0).stop 2024-04-25T08:54:08.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 -- 172.21.15.55:0/1636395259 shutdown_connections 2024-04-25T08:54:08.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f920006b4d0 0x7f920006d990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f921c1e9370 0x7f921c144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f921c1e8f10 0x7f921c143cc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 --2- 172.21.15.55:0/1636395259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92080039b0 0x7f921c1e8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 -- 172.21.15.55:0/1636395259 >> 172.21.15.55:0/1636395259 conn(0x7f921c0d04f0 msgr2=0x7f921c0b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:08.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 -- 172.21.15.55:0/1636395259 shutdown_connections 2024-04-25T08:54:08.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.776+0000 7f922361f640 1 -- 172.21.15.55:0/1636395259 wait complete. 2024-04-25T08:54:08.777 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.888+0000 7f8457fb0640 1 Processor -- start 2024-04-25T08:54:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.888+0000 7f8457fb0640 1 -- start start 2024-04-25T08:54:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.889+0000 7f8457fb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84500d35b0 0x7f84500b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.889+0000 7f8457fb0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845015e0c0 con 0x7f84500b5990 2024-04-25T08:54:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.889+0000 7f8457fb0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84500d2510 con 0x7f845015dce0 2024-04-25T08:54:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.889+0000 7f8457fb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84500b5de0 con 0x7f84500d35b0 2024-04-25T08:54:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.889+0000 7f845654d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f84500b5990 0x7f84500b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38438/0 (socket says 172.21.15.55:38438) 2024-04-25T08:54:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.889+0000 7f845654d640 1 -- 172.21.15.55:0/1465413741 learned_addr learned my addr 172.21.15.55:0/1465413741 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.889+0000 7f845554b640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84500d35b0 0x7f84500b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.889+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144933899 0 0) 0x7f845015e0c0 con 0x7f84500b5990 2024-04-25T08:54:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.889+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f843c003520 con 0x7f84500b5990 2024-04-25T08:54:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.889+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260752833 0 0) 0x7f84500d2510 con 0x7f845015dce0 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.889+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f845015e0c0 con 0x7f845015dce0 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2297382670 0 0) 0x7f843c003520 con 0x7f84500b5990 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84500d35b0 msgr2=0x7f84500b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84500d35b0 0x7f84500b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 >> v1:172.21.15.167:6789/0 conn(0x7f845015dce0 legacy=0x7f84500d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500d27f0 con 0x7f84500b5990 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f84480019f0 con 0x7f84500b5990 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f845554b640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84500d35b0 0x7f84500b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 >> v1:172.21.15.55:6789/0 conn(0x7f84500b5990 legacy=0x7f84500b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84500d35b0 0x7f843c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f843c0040b0 0x7f843c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c004d40 0x7f843c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500b5de0 con 0x7f843c004d40 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c00ba70 con 0x7f843c0040b0 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c00bc70 con 0x7f84500d35b0 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f845654d640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c004d40 0x7f843c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f8455d4c640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84500d35b0 0x7f843c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f845554b640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f843c0040b0 0x7f843c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f845654d640 1 -- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84500d35b0 msgr2=0x7f843c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f845654d640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84500d35b0 0x7f843c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f845654d640 1 -- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f843c0040b0 msgr2=0x7f843c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f845654d640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f843c0040b0 0x7f843c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.890+0000 7f845654d640 1 -- 172.21.15.55:0/1465413741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c003520 con 0x7f843c004d40 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.891+0000 7f845654d640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c004d40 0x7f843c0051c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f844800a810 tx=0x7f843c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7510f8ce863b5784 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.891+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844800a430 con 0x7f843c004d40 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.891+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844802f070 con 0x7f843c004d40 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.891+0000 7f8454d4a640 1 -- 172.21.15.55:0/1465413741 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844802bc50 con 0x7f843c004d40 2024-04-25T08:54:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.891+0000 7f8457fb0640 1 -- 172.21.15.55:0/1465413741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c004d40 msgr2=0x7f843c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.891+0000 7f8457fb0640 1 --2- 172.21.15.55:0/1465413741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c004d40 0x7f843c0051c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f844800a810 tx=0x7f843c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:08.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.891+0000 7f845654d640 1 -- 172.21.15.55:0/1465413741 reap_dead start 2024-04-25T08:54:08.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.891+0000 7f8457fb0640 1 -- 172.21.15.55:0/1465413741 shutdown_connections 2024-04-25T08:54:08.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.891+0000 7f8457fb0640 1 -- 172.21.15.55:0/1465413741 >> 172.21.15.55:0/1465413741 conn(0x7f8450072900 msgr2=0x7f84500d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:08.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.892+0000 7f8457fb0640 1 -- 172.21.15.55:0/1465413741 shutdown_connections 2024-04-25T08:54:08.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.892+0000 7f8457fb0640 1 -- 172.21.15.55:0/1465413741 wait complete. 2024-04-25T08:54:08.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.893+0000 7f8457fb0640 1 Processor -- start 2024-04-25T08:54:08.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.893+0000 7f8457fb0640 1 -- start start 2024-04-25T08:54:08.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.893+0000 7f8457fb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f843c004d40 0x7f84500c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.893+0000 7f8457fb0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84501f3ea0 0x7f84500b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.893+0000 7f8457fb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500b1d30 0x7f84501f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.893+0000 7f8457fb0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500d3090 con 0x7f84501f3ea0 2024-04-25T08:54:08.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.893+0000 7f8457fb0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500d2db0 con 0x7f84500b1d30 2024-04-25T08:54:08.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.893+0000 7f8457fb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84500d2160 con 0x7f843c004d40 2024-04-25T08:54:08.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f845554b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84501f3ea0 0x7f84500b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f845554b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84501f3ea0 0x7f84500b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37876/0 (socket says 172.21.15.55:37876) 2024-04-25T08:54:08.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f845554b640 1 -- 172.21.15.55:0/3431598226 learned_addr learned my addr 172.21.15.55:0/3431598226 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f8455d4c640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f843c004d40 0x7f84500c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f845654d640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500b1d30 0x7f84501f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f845554b640 1 -- 172.21.15.55:0/3431598226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f843c004d40 msgr2=0x7f84500c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f845554b640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f843c004d40 0x7f84500c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f845554b640 1 -- 172.21.15.55:0/3431598226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500b1d30 msgr2=0x7f84501f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f845554b640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500b1d30 0x7f84501f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f845554b640 1 -- 172.21.15.55:0/3431598226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500c8810 con 0x7f84501f3ea0 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f845654d640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500b1d30 0x7f84501f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f8455d4c640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f843c004d40 0x7f84500c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f845554b640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84501f3ea0 0x7f84500b17f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84400119d0 tx=0x7f8440011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f84467fc640 1 -- 172.21.15.55:0/3431598226 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844000fa90 con 0x7f84501f3ea0 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f84467fc640 1 -- 172.21.15.55:0/3431598226 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844000fc30 con 0x7f84501f3ea0 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f8457fb0640 1 -- 172.21.15.55:0/3431598226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84500c8af0 con 0x7f84501f3ea0 2024-04-25T08:54:08.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f84467fc640 1 -- 172.21.15.55:0/3431598226 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8440014440 con 0x7f84501f3ea0 2024-04-25T08:54:08.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.894+0000 7f8457fb0640 1 -- 172.21.15.55:0/3431598226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84501f4440 con 0x7f84501f3ea0 2024-04-25T08:54:08.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.895+0000 7f8457fb0640 1 -- 172.21.15.55:0/3431598226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84500749b0 con 0x7f84501f3ea0 2024-04-25T08:54:08.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.896+0000 7f84467fc640 1 -- 172.21.15.55:0/3431598226 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8440012040 con 0x7f84501f3ea0 2024-04-25T08:54:08.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.896+0000 7f84467fc640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f843406b500 0x7f843406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:08.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.896+0000 7f84467fc640 1 -- 172.21.15.55:0/3431598226 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f844008a7a0 con 0x7f84501f3ea0 2024-04-25T08:54:08.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.896+0000 7f8455d4c640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f843406b500 0x7f843406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:08.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.897+0000 7f8455d4c640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f843406b500 0x7f843406d9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f844c005620 tx=0x7f844c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:08.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:08.900+0000 7f84467fc640 1 -- 172.21.15.55:0/3431598226 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8440019030 con 0x7f84501f3ea0 2024-04-25T08:54:09.052 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:54:09.054 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:54:09.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.081+0000 7f8457fb0640 1 -- 172.21.15.55:0/3431598226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f845006b080 con 0x7f84501f3ea0 2024-04-25T08:54:09.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.083+0000 7f84467fc640 1 -- 172.21.15.55:0/3431598226 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f8440059620 con 0x7f84501f3ea0 2024-04-25T08:54:09.073 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:09.073 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:09.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 -- 172.21.15.55:0/3431598226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f843406b500 msgr2=0x7f843406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f843406b500 0x7f843406d9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f844c005620 tx=0x7f844c009040 comp rx=0 tx=0).stop 2024-04-25T08:54:09.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 -- 172.21.15.55:0/3431598226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84501f3ea0 msgr2=0x7f84500b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84501f3ea0 0x7f84500b17f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84400119d0 tx=0x7f8440011e90 comp rx=0 tx=0).stop 2024-04-25T08:54:09.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 -- 172.21.15.55:0/3431598226 shutdown_connections 2024-04-25T08:54:09.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f843406b500 0x7f843406d9c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500b1d30 0x7f84501f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84501f3ea0 0x7f84500b17f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 --2- 172.21.15.55:0/3431598226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f843c004d40 0x7f84500c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 -- 172.21.15.55:0/3431598226 >> 172.21.15.55:0/3431598226 conn(0x7f8450072900 msgr2=0x7f845006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:09.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 -- 172.21.15.55:0/3431598226 shutdown_connections 2024-04-25T08:54:09.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.085+0000 7f8457fb0640 1 -- 172.21.15.55:0/3431598226 wait complete. 2024-04-25T08:54:09.086 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:09.086 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.272+0000 7fe9cffa5640 1 Processor -- start 2024-04-25T08:54:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.272+0000 7fe9cffa5640 1 -- start start 2024-04-25T08:54:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.273+0000 7fe9cffa5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe9c80b42c0 0x7fe9c815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.273+0000 7fe9cffa5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9c815aef0 0x7fe9c80cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.273+0000 7fe9cffa5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9c80b46a0 0x7fe9c81549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.273+0000 7fe9cffa5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c80d05d0 con 0x7fe9c80b46a0 2024-04-25T08:54:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.273+0000 7fe9cffa5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c815b370 con 0x7fe9c80b42c0 2024-04-25T08:54:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.273+0000 7fe9cffa5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c815b650 con 0x7fe9c815aef0 2024-04-25T08:54:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.273+0000 7fe9ce542640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9c80b46a0 0x7fe9c81549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.273+0000 7fe9ce542640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9c80b46a0 0x7fe9c81549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37878/0 (socket says 172.21.15.55:37878) 2024-04-25T08:54:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.273+0000 7fe9ce542640 1 -- 172.21.15.55:0/2524116715 learned_addr learned my addr 172.21.15.55:0/2524116715 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.273+0000 7fe9cd540640 1 --2- 172.21.15.55:0/2524116715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9c815aef0 0x7fe9c80cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.273+0000 7fe9cdd41640 1 --2- 172.21.15.55:0/2524116715 >> v2:172.21.15.167:3300/0 conn(0x7fe9c80b42c0 0x7fe9c815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.274+0000 7fe9ce542640 1 -- 172.21.15.55:0/2524116715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9c815aef0 msgr2=0x7fe9c80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:09.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.274+0000 7fe9ce542640 1 --2- 172.21.15.55:0/2524116715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9c815aef0 0x7fe9c80cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.274+0000 7fe9ce542640 1 -- 172.21.15.55:0/2524116715 >> v2:172.21.15.167:3300/0 conn(0x7fe9c80b42c0 msgr2=0x7fe9c815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:09.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.274+0000 7fe9ce542640 1 --2- 172.21.15.55:0/2524116715 >> v2:172.21.15.167:3300/0 conn(0x7fe9c80b42c0 0x7fe9c815ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.274+0000 7fe9ce542640 1 -- 172.21.15.55:0/2524116715 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c815b930 con 0x7fe9c80b46a0 2024-04-25T08:54:09.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.274+0000 7fe9cdd41640 1 --2- 172.21.15.55:0/2524116715 >> v2:172.21.15.167:3300/0 conn(0x7fe9c80b42c0 0x7fe9c815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.274+0000 7fe9ce542640 1 --2- 172.21.15.55:0/2524116715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c80b46a0 0x7fe9c81549d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80d07c0 tx=0x7fe9c002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4830f280ea3f6cf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9ccd3f640 1 -- 172.21.15.55:0/2524116715 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0037070 con 0x7fe9c80b46a0 2024-04-25T08:54:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9ccd3f640 1 -- 172.21.15.55:0/2524116715 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c002ae00 con 0x7fe9c80b46a0 2024-04-25T08:54:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9ccd3f640 1 -- 172.21.15.55:0/2524116715 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0032660 con 0x7fe9c80b46a0 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9cffa5640 1 -- 172.21.15.55:0/2524116715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c80b46a0 msgr2=0x7fe9c81549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9cffa5640 1 --2- 172.21.15.55:0/2524116715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c80b46a0 0x7fe9c81549d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80d07c0 tx=0x7fe9c002a0b0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9cffa5640 1 -- 172.21.15.55:0/2524116715 shutdown_connections 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9cffa5640 1 --2- 172.21.15.55:0/2524116715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c80b46a0 0x7fe9c81549d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9cffa5640 1 --2- 172.21.15.55:0/2524116715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9c815aef0 0x7fe9c80cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9cffa5640 1 --2- 172.21.15.55:0/2524116715 >> v2:172.21.15.167:3300/0 conn(0x7fe9c80b42c0 0x7fe9c815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9cffa5640 1 -- 172.21.15.55:0/2524116715 >> 172.21.15.55:0/2524116715 conn(0x7fe9c806aba0 msgr2=0x7fe9c806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9cffa5640 1 -- 172.21.15.55:0/2524116715 shutdown_connections 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.275+0000 7fe9cffa5640 1 -- 172.21.15.55:0/2524116715 wait complete. 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.276+0000 7fe9cffa5640 1 Processor -- start 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.276+0000 7fe9cffa5640 1 -- start start 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.277+0000 7fe9cffa5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9c80b42c0 0x7fe9c814a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.277+0000 7fe9cffa5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c80b46a0 0x7fe9c8150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.277+0000 7fe9cffa5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c815aef0 0x7fe9c8167990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.277+0000 7fe9cffa5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c806eae0 con 0x7fe9c80b46a0 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.277+0000 7fe9cffa5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80cf980 con 0x7fe9c815aef0 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.277+0000 7fe9cffa5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c806ec60 con 0x7fe9c80b42c0 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.277+0000 7fe9cd540640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c80b46a0 0x7fe9c8150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.277+0000 7fe9cd540640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c80b46a0 0x7fe9c8150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37882/0 (socket says 172.21.15.55:37882) 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.277+0000 7fe9cd540640 1 -- 172.21.15.55:0/251189767 learned_addr learned my addr 172.21.15.55:0/251189767 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.277+0000 7fe9cdd41640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9c80b42c0 0x7fe9c814a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.277+0000 7fe9ce542640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c815aef0 0x7fe9c8167990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9cd540640 1 -- 172.21.15.55:0/251189767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9c80b42c0 msgr2=0x7fe9c814a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9cd540640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9c80b42c0 0x7fe9c814a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9cd540640 1 -- 172.21.15.55:0/251189767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c815aef0 msgr2=0x7fe9c8167990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9cd540640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c815aef0 0x7fe9c8167990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9cd540640 1 -- 172.21.15.55:0/251189767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8168450 con 0x7fe9c80b46a0 2024-04-25T08:54:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9ce542640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c815aef0 0x7fe9c8167990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9cd540640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c80b46a0 0x7fe9c8150410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00e870 tx=0x7fe9bc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9c67fc640 1 -- 172.21.15.55:0/251189767 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc017070 con 0x7fe9c80b46a0 2024-04-25T08:54:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9c67fc640 1 -- 172.21.15.55:0/251189767 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc00c940 con 0x7fe9c80b46a0 2024-04-25T08:54:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9c67fc640 1 -- 172.21.15.55:0/251189767 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc00cd30 con 0x7fe9c80b46a0 2024-04-25T08:54:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9cffa5640 1 -- 172.21.15.55:0/251189767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c8168730 con 0x7fe9c80b46a0 2024-04-25T08:54:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.278+0000 7fe9cffa5640 1 -- 172.21.15.55:0/251189767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c814d3d0 con 0x7fe9c80b46a0 2024-04-25T08:54:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.279+0000 7fe9cffa5640 1 -- 172.21.15.55:0/251189767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c8067640 con 0x7fe9c80b46a0 2024-04-25T08:54:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.279+0000 7fe9c67fc640 1 -- 172.21.15.55:0/251189767 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe9bc01a070 con 0x7fe9c80b46a0 2024-04-25T08:54:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.280+0000 7fe9c67fc640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9b406b4d0 0x7fe9b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.280+0000 7fe9c67fc640 1 -- 172.21.15.55:0/251189767 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9bc08a2c0 con 0x7fe9c80b46a0 2024-04-25T08:54:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.280+0000 7fe9cdd41640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9b406b4d0 0x7fe9b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.280+0000 7fe9cdd41640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9b406b4d0 0x7fe9b406d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80cbf80 tx=0x7fe9b8009890 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.284+0000 7fe9c67fc640 1 -- 172.21.15.55:0/251189767 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe9c8067640 con 0x7fe9c80b46a0 2024-04-25T08:54:09.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.466+0000 7fe9cffa5640 1 -- 172.21.15.55:0/251189767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9c814fa00 con 0x7fe9c80b46a0 2024-04-25T08:54:09.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.466+0000 7fe9c67fc640 1 -- 172.21.15.55:0/251189767 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9bc058b80 con 0x7fe9c80b46a0 2024-04-25T08:54:09.456 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:09.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 -- 172.21.15.55:0/251189767 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9b406b4d0 msgr2=0x7fe9b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9b406b4d0 0x7fe9b406d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80cbf80 tx=0x7fe9b8009890 comp rx=0 tx=0).stop 2024-04-25T08:54:09.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 -- 172.21.15.55:0/251189767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c80b46a0 msgr2=0x7fe9c8150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c80b46a0 0x7fe9c8150410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00e870 tx=0x7fe9bc00ed30 comp rx=0 tx=0).stop 2024-04-25T08:54:09.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 -- 172.21.15.55:0/251189767 shutdown_connections 2024-04-25T08:54:09.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9b406b4d0 0x7fe9b406d990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c815aef0 0x7fe9c8167990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c80b46a0 0x7fe9c8150410 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 --2- 172.21.15.55:0/251189767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9c80b42c0 0x7fe9c814a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 -- 172.21.15.55:0/251189767 >> 172.21.15.55:0/251189767 conn(0x7fe9c806aba0 msgr2=0x7fe9c815c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:09.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 -- 172.21.15.55:0/251189767 shutdown_connections 2024-04-25T08:54:09.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.468+0000 7fe9cffa5640 1 -- 172.21.15.55:0/251189767 wait complete. 2024-04-25T08:54:09.469 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:54:09.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.583+0000 7fae66a07640 1 Processor -- start 2024-04-25T08:54:09.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.583+0000 7fae66a07640 1 -- start start 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae66a07640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae600b5c00 0x7fae60168c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae66a07640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae601627a0 con 0x7fae600b97c0 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae66a07640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae601621e0 con 0x7fae6015dc80 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae66a07640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae60161f80 con 0x7fae600b5c00 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae5f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fae600b97c0 0x7fae600b54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38442/0 (socket says 172.21.15.55:38442) 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae5f7fe640 1 -- 172.21.15.55:0/477837570 learned_addr learned my addr 172.21.15.55:0/477837570 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae64fa4640 1 --2- 172.21.15.55:0/477837570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae600b5c00 0x7fae60168c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae5effd640 1 -- 172.21.15.55:0/477837570 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098826382 0 0) 0x7fae601627a0 con 0x7fae600b97c0 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae5effd640 1 -- 172.21.15.55:0/477837570 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae48003520 con 0x7fae600b97c0 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae5effd640 1 -- 172.21.15.55:0/477837570 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504164425 0 0) 0x7fae601621e0 con 0x7fae6015dc80 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae64fa4640 1 -- 172.21.15.55:0/477837570 >> v1:172.21.15.167:6789/0 conn(0x7fae6015dc80 legacy=0x7fae60161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae64fa4640 1 -- 172.21.15.55:0/477837570 >> v1:172.21.15.55:6789/0 conn(0x7fae600b97c0 legacy=0x7fae600b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.584+0000 7fae64fa4640 1 -- 172.21.15.55:0/477837570 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae601624c0 con 0x7fae600b5c00 2024-04-25T08:54:09.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.585+0000 7fae64fa4640 1 --2- 172.21.15.55:0/477837570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae600b5c00 0x7fae60168c00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae58009dc0 tx=0x7fae5802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59bad9f58d8d041a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.585+0000 7fae5effd640 1 -- 172.21.15.55:0/477837570 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58035020 con 0x7fae600b5c00 2024-04-25T08:54:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.586+0000 7fae5effd640 1 -- 172.21.15.55:0/477837570 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae58007540 con 0x7fae600b5c00 2024-04-25T08:54:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.586+0000 7fae5effd640 1 -- 172.21.15.55:0/477837570 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50001670 con 0x7fae600b5c00 2024-04-25T08:54:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.586+0000 7fae66a07640 1 -- 172.21.15.55:0/477837570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae600b5c00 msgr2=0x7fae60168c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.586+0000 7fae66a07640 1 --2- 172.21.15.55:0/477837570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae600b5c00 0x7fae60168c00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae58009dc0 tx=0x7fae5802a640 comp rx=0 tx=0).stop 2024-04-25T08:54:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.586+0000 7fae66a07640 1 -- 172.21.15.55:0/477837570 shutdown_connections 2024-04-25T08:54:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.586+0000 7fae66a07640 1 --2- 172.21.15.55:0/477837570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae600b5c00 0x7fae60168c00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.586+0000 7fae66a07640 1 -- 172.21.15.55:0/477837570 >> 172.21.15.55:0/477837570 conn(0x7fae600d04f0 msgr2=0x7fae600d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.586+0000 7fae66a07640 1 -- 172.21.15.55:0/477837570 shutdown_connections 2024-04-25T08:54:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.586+0000 7fae66a07640 1 -- 172.21.15.55:0/477837570 wait complete. 2024-04-25T08:54:09.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.587+0000 7fae66a07640 1 Processor -- start 2024-04-25T08:54:09.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.587+0000 7fae66a07640 1 -- start start 2024-04-25T08:54:09.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.588+0000 7fae66a07640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae600b5c00 0x7fae601f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.588+0000 7fae66a07640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae600b97c0 0x7fae600c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.588+0000 7fae66a07640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6015dc80 0x7fae600d3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.588+0000 7fae66a07640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae600d3480 con 0x7fae6015dc80 2024-04-25T08:54:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.588+0000 7fae66a07640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6015e060 con 0x7fae600b5c00 2024-04-25T08:54:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.588+0000 7fae66a07640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae600d3600 con 0x7fae600b97c0 2024-04-25T08:54:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.588+0000 7fae64fa4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6015dc80 0x7fae600d3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.588+0000 7fae64fa4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6015dc80 0x7fae600d3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37898/0 (socket says 172.21.15.55:37898) 2024-04-25T08:54:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.588+0000 7fae64fa4640 1 -- 172.21.15.55:0/2703070166 learned_addr learned my addr 172.21.15.55:0/2703070166 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.588+0000 7fae5ffff640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae600b5c00 0x7fae601f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.588+0000 7fae5f7fe640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae600b97c0 0x7fae600c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.589+0000 7fae64fa4640 1 -- 172.21.15.55:0/2703070166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae600b97c0 msgr2=0x7fae600c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.589+0000 7fae64fa4640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae600b97c0 0x7fae600c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.589+0000 7fae64fa4640 1 -- 172.21.15.55:0/2703070166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae600b5c00 msgr2=0x7fae601f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.589+0000 7fae64fa4640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae600b5c00 0x7fae601f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.589+0000 7fae64fa4640 1 -- 172.21.15.55:0/2703070166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae600cbc30 con 0x7fae6015dc80 2024-04-25T08:54:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.589+0000 7fae64fa4640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6015dc80 0x7fae600d3cc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae58009ee0 tx=0x7fae58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.589+0000 7fae5cff9640 1 -- 172.21.15.55:0/2703070166 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58035040 con 0x7fae6015dc80 2024-04-25T08:54:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.589+0000 7fae5cff9640 1 -- 172.21.15.55:0/2703070166 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae58031be0 con 0x7fae6015dc80 2024-04-25T08:54:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.589+0000 7fae66a07640 1 -- 172.21.15.55:0/2703070166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae600cbf10 con 0x7fae6015dc80 2024-04-25T08:54:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.589+0000 7fae5cff9640 1 -- 172.21.15.55:0/2703070166 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58009450 con 0x7fae6015dc80 2024-04-25T08:54:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.589+0000 7fae66a07640 1 -- 172.21.15.55:0/2703070166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae600cc4d0 con 0x7fae6015dc80 2024-04-25T08:54:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.590+0000 7fae66a07640 1 -- 172.21.15.55:0/2703070166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae600cc6d0 con 0x7fae6015dc80 2024-04-25T08:54:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.590+0000 7fae5cff9640 1 -- 172.21.15.55:0/2703070166 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae58003990 con 0x7fae6015dc80 2024-04-25T08:54:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.591+0000 7fae5cff9640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4c06b4d0 0x7fae4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.591+0000 7fae5ffff640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4c06b4d0 0x7fae4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.591+0000 7fae5cff9640 1 -- 172.21.15.55:0/2703070166 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae580ab2e0 con 0x7fae6015dc80 2024-04-25T08:54:09.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.591+0000 7fae5ffff640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4c06b4d0 0x7fae4c06d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae54000f60 tx=0x7fae54009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.595+0000 7fae5cff9640 1 -- 172.21.15.55:0/2703070166 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae600cc6d0 con 0x7fae6015dc80 2024-04-25T08:54:09.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.777+0000 7fae66a07640 1 -- 172.21.15.55:0/2703070166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae600750b0 con 0x7fae6015dc80 2024-04-25T08:54:09.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.778+0000 7fae5cff9640 1 -- 172.21.15.55:0/2703070166 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae58040020 con 0x7fae6015dc80 2024-04-25T08:54:09.768 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:54:09.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 -- 172.21.15.55:0/2703070166 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4c06b4d0 msgr2=0x7fae4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4c06b4d0 0x7fae4c06d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae54000f60 tx=0x7fae54009040 comp rx=0 tx=0).stop 2024-04-25T08:54:09.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 -- 172.21.15.55:0/2703070166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6015dc80 msgr2=0x7fae600d3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6015dc80 0x7fae600d3cc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae58009ee0 tx=0x7fae58004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:09.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 -- 172.21.15.55:0/2703070166 shutdown_connections 2024-04-25T08:54:09.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4c06b4d0 0x7fae4c06d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6015dc80 0x7fae600d3cc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae600b97c0 0x7fae600c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 --2- 172.21.15.55:0/2703070166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae600b5c00 0x7fae601f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 -- 172.21.15.55:0/2703070166 >> 172.21.15.55:0/2703070166 conn(0x7fae600d04f0 msgr2=0x7fae600b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 -- 172.21.15.55:0/2703070166 shutdown_connections 2024-04-25T08:54:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.780+0000 7fae66a07640 1 -- 172.21.15.55:0/2703070166 wait complete. 2024-04-25T08:54:09.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:54:09.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.894+0000 7f9b6375c640 1 Processor -- start 2024-04-25T08:54:09.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.894+0000 7f9b6375c640 1 -- start start 2024-04-25T08:54:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.895+0000 7f9b6375c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b5c15dc80 0x7f9b5c161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.895+0000 7f9b6375c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b5c0b5c00 0x7f9b5c0d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.895+0000 7f9b6375c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c1627a0 con 0x7f9b5c0b97c0 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.895+0000 7f9b6375c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c1621e0 con 0x7f9b5c15dc80 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.895+0000 7f9b6375c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c1624c0 con 0x7f9b5c0b5c00 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.895+0000 7f9b614f8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b5c15dc80 0x7f9b5c161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.895+0000 7f9b614f8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b5c15dc80 0x7f9b5c161870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37900/0 (socket says 172.21.15.55:37900) 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.895+0000 7f9b614f8640 1 -- 172.21.15.55:0/100236707 learned_addr learned my addr 172.21.15.55:0/100236707 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.896+0000 7f9b61cf9640 1 --2- 172.21.15.55:0/100236707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b5c0b5c00 0x7f9b5c0d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.896+0000 7f9b614f8640 1 -- 172.21.15.55:0/100236707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b5c0b5c00 msgr2=0x7f9b5c0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.896+0000 7f9b614f8640 1 --2- 172.21.15.55:0/100236707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b5c0b5c00 0x7f9b5c0d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.896+0000 7f9b614f8640 1 -- 172.21.15.55:0/100236707 >> v1:172.21.15.167:6789/0 conn(0x7f9b5c0b97c0 legacy=0x7f9b5c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.896+0000 7f9b614f8640 1 -- 172.21.15.55:0/100236707 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0d1c70 con 0x7f9b5c15dc80 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.896+0000 7f9b614f8640 1 --2- 172.21.15.55:0/100236707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5c15dc80 0x7f9b5c161870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009870 tx=0x7f9b5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888604de8b3d9b66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.897+0000 7f9b5bfff640 1 -- 172.21.15.55:0/100236707 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54037070 con 0x7f9b5c15dc80 2024-04-25T08:54:09.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.897+0000 7f9b5bfff640 1 -- 172.21.15.55:0/100236707 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b54032440 con 0x7f9b5c15dc80 2024-04-25T08:54:09.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.897+0000 7f9b5bfff640 1 -- 172.21.15.55:0/100236707 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54032810 con 0x7f9b5c15dc80 2024-04-25T08:54:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.897+0000 7f9b6375c640 1 -- 172.21.15.55:0/100236707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5c15dc80 msgr2=0x7f9b5c161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.897+0000 7f9b6375c640 1 --2- 172.21.15.55:0/100236707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5c15dc80 0x7f9b5c161870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009870 tx=0x7f9b5402a270 comp rx=0 tx=0).stop 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.897+0000 7f9b6375c640 1 -- 172.21.15.55:0/100236707 shutdown_connections 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.897+0000 7f9b6375c640 1 --2- 172.21.15.55:0/100236707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b5c0b5c00 0x7f9b5c0d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.897+0000 7f9b6375c640 1 --2- 172.21.15.55:0/100236707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5c15dc80 0x7f9b5c161870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.897+0000 7f9b6375c640 1 -- 172.21.15.55:0/100236707 >> 172.21.15.55:0/100236707 conn(0x7f9b5c0d04f0 msgr2=0x7f9b5c0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.897+0000 7f9b6375c640 1 -- 172.21.15.55:0/100236707 shutdown_connections 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.897+0000 7f9b6375c640 1 -- 172.21.15.55:0/100236707 wait complete. 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.898+0000 7f9b6375c640 1 Processor -- start 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.898+0000 7f9b6375c640 1 -- start start 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.899+0000 7f9b6375c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b5c0b5c00 0x7f9b5c15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.899+0000 7f9b6375c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5c0b97c0 0x7f9b5c0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.899+0000 7f9b6375c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b5c15dc80 0x7f9b5c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.899+0000 7f9b6375c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c161f30 con 0x7f9b5c0b97c0 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.899+0000 7f9b6375c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c161db0 con 0x7f9b5c0b5c00 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.899+0000 7f9b6375c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0d29b0 con 0x7f9b5c15dc80 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.899+0000 7f9b60cf7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5c0b97c0 0x7f9b5c0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.899+0000 7f9b60cf7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5c0b97c0 0x7f9b5c0b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37902/0 (socket says 172.21.15.55:37902) 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.899+0000 7f9b60cf7640 1 -- 172.21.15.55:0/1144391507 learned_addr learned my addr 172.21.15.55:0/1144391507 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.899+0000 7f9b614f8640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b5c0b5c00 0x7f9b5c15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.899+0000 7f9b61cf9640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b5c15dc80 0x7f9b5c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.900+0000 7f9b60cf7640 1 -- 172.21.15.55:0/1144391507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b5c15dc80 msgr2=0x7f9b5c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.900+0000 7f9b60cf7640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b5c15dc80 0x7f9b5c15caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.900+0000 7f9b60cf7640 1 -- 172.21.15.55:0/1144391507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b5c0b5c00 msgr2=0x7f9b5c15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.900+0000 7f9b60cf7640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b5c0b5c00 0x7f9b5c15ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.900+0000 7f9b60cf7640 1 -- 172.21.15.55:0/1144391507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0aba40 con 0x7f9b5c0b97c0 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.900+0000 7f9b60cf7640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5c0b97c0 0x7f9b5c0b44b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000c430 tx=0x7f9b5000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.900+0000 7f9b59ffb640 1 -- 172.21.15.55:0/1144391507 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b500052d0 con 0x7f9b5c0b97c0 2024-04-25T08:54:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.900+0000 7f9b59ffb640 1 -- 172.21.15.55:0/1144391507 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b50005490 con 0x7f9b5c0b97c0 2024-04-25T08:54:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.900+0000 7f9b6375c640 1 -- 172.21.15.55:0/1144391507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c0abd20 con 0x7f9b5c0b97c0 2024-04-25T08:54:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.900+0000 7f9b59ffb640 1 -- 172.21.15.55:0/1144391507 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b50007260 con 0x7f9b5c0b97c0 2024-04-25T08:54:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.900+0000 7f9b6375c640 1 -- 172.21.15.55:0/1144391507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c0ac2e0 con 0x7f9b5c0b97c0 2024-04-25T08:54:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.901+0000 7f9b6375c640 1 -- 172.21.15.55:0/1144391507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c0750b0 con 0x7f9b5c0b97c0 2024-04-25T08:54:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.901+0000 7f9b59ffb640 1 -- 172.21.15.55:0/1144391507 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b50007400 con 0x7f9b5c0b97c0 2024-04-25T08:54:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.902+0000 7f9b59ffb640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b4806b500 0x7f9b4806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.902+0000 7f9b59ffb640 1 -- 172.21.15.55:0/1144391507 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b50089640 con 0x7f9b5c0b97c0 2024-04-25T08:54:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.902+0000 7f9b614f8640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b4806b500 0x7f9b4806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.902+0000 7f9b614f8640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b4806b500 0x7f9b4806d9c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9b54034000 tx=0x7f9b5402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:09.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:09.906+0000 7f9b59ffb640 1 -- 172.21.15.55:0/1144391507 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b50057e70 con 0x7f9b5c0b97c0 2024-04-25T08:54:10.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.085+0000 7f9b6375c640 1 -- 172.21.15.55:0/1144391507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b5c0cde30 con 0x7f9b5c0b97c0 2024-04-25T08:54:10.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.086+0000 7f9b59ffb640 1 -- 172.21.15.55:0/1144391507 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b5005bf10 con 0x7f9b5c0b97c0 2024-04-25T08:54:10.076 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:54:10.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.087+0000 7f9b6375c640 1 -- 172.21.15.55:0/1144391507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b4806b500 msgr2=0x7f9b4806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.087+0000 7f9b6375c640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b4806b500 0x7f9b4806d9c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9b54034000 tx=0x7f9b5402e000 comp rx=0 tx=0).stop 2024-04-25T08:54:10.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.087+0000 7f9b6375c640 1 -- 172.21.15.55:0/1144391507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5c0b97c0 msgr2=0x7f9b5c0b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.087+0000 7f9b6375c640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5c0b97c0 0x7f9b5c0b44b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000c430 tx=0x7f9b5000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.087+0000 7f9b6375c640 1 -- 172.21.15.55:0/1144391507 shutdown_connections 2024-04-25T08:54:10.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.087+0000 7f9b6375c640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b4806b500 0x7f9b4806d9c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.088+0000 7f9b6375c640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b5c15dc80 0x7f9b5c15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.088+0000 7f9b6375c640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5c0b97c0 0x7f9b5c0b44b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.088+0000 7f9b6375c640 1 --2- 172.21.15.55:0/1144391507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b5c0b5c00 0x7f9b5c15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.088+0000 7f9b6375c640 1 -- 172.21.15.55:0/1144391507 >> 172.21.15.55:0/1144391507 conn(0x7f9b5c0d04f0 msgr2=0x7f9b5c0c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:10.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.088+0000 7f9b6375c640 1 -- 172.21.15.55:0/1144391507 shutdown_connections 2024-04-25T08:54:10.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.088+0000 7f9b6375c640 1 -- 172.21.15.55:0/1144391507 wait complete. 2024-04-25T08:54:10.088 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:10.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.199+0000 7fe53177e640 1 Processor -- start 2024-04-25T08:54:10.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.199+0000 7fe53177e640 1 -- start start 2024-04-25T08:54:10.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe53177e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe52c15dce0 0x7fe52c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe53177e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52c0d35b0 0x7fe52c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe53177e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe52c0d1f90 0x7fe52c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe53177e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c15e0c0 con 0x7fe52c15dce0 2024-04-25T08:54:10.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe53177e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c0d2510 con 0x7fe52c0d1f90 2024-04-25T08:54:10.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe53177e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0d27f0 con 0x7fe52c0d35b0 2024-04-25T08:54:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe52affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe52c15dce0 0x7fe52c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe52affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe52c15dce0 0x7fe52c0d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37906/0 (socket says 172.21.15.55:37906) 2024-04-25T08:54:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe52affd640 1 -- 172.21.15.55:0/657469993 learned_addr learned my addr 172.21.15.55:0/657469993 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe52b7fe640 1 --2- 172.21.15.55:0/657469993 >> v2:172.21.15.167:3300/0 conn(0x7fe52c0d1f90 0x7fe52c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe52a7fc640 1 --2- 172.21.15.55:0/657469993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52c0d35b0 0x7fe52c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe52affd640 1 -- 172.21.15.55:0/657469993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52c0d35b0 msgr2=0x7fe52c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe52affd640 1 --2- 172.21.15.55:0/657469993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52c0d35b0 0x7fe52c0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe52affd640 1 -- 172.21.15.55:0/657469993 >> v2:172.21.15.167:3300/0 conn(0x7fe52c0d1f90 msgr2=0x7fe52c0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe52affd640 1 --2- 172.21.15.55:0/657469993 >> v2:172.21.15.167:3300/0 conn(0x7fe52c0d1f90 0x7fe52c0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.200+0000 7fe52affd640 1 -- 172.21.15.55:0/657469993 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c0d2ad0 con 0x7fe52c15dce0 2024-04-25T08:54:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.201+0000 7fe52affd640 1 --2- 172.21.15.55:0/657469993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe52c15dce0 0x7fe52c0d1a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe52c161710 tx=0x7fe51c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5bd09a784ccfb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.201+0000 7fe529ffb640 1 -- 172.21.15.55:0/657469993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c036070 con 0x7fe52c15dce0 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.201+0000 7fe529ffb640 1 -- 172.21.15.55:0/657469993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c031600 con 0x7fe52c15dce0 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.201+0000 7fe529ffb640 1 -- 172.21.15.55:0/657469993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0319d0 con 0x7fe52c15dce0 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.202+0000 7fe53177e640 1 -- 172.21.15.55:0/657469993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe52c15dce0 msgr2=0x7fe52c0d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.202+0000 7fe53177e640 1 --2- 172.21.15.55:0/657469993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe52c15dce0 0x7fe52c0d1a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe52c161710 tx=0x7fe51c02a610 comp rx=0 tx=0).stop 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.202+0000 7fe53177e640 1 -- 172.21.15.55:0/657469993 shutdown_connections 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.202+0000 7fe53177e640 1 --2- 172.21.15.55:0/657469993 >> v2:172.21.15.167:3300/0 conn(0x7fe52c0d1f90 0x7fe52c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.202+0000 7fe53177e640 1 --2- 172.21.15.55:0/657469993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52c0d35b0 0x7fe52c0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.202+0000 7fe53177e640 1 --2- 172.21.15.55:0/657469993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe52c15dce0 0x7fe52c0d1a50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.202+0000 7fe53177e640 1 -- 172.21.15.55:0/657469993 >> 172.21.15.55:0/657469993 conn(0x7fe52c072900 msgr2=0x7fe52c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.202+0000 7fe53177e640 1 -- 172.21.15.55:0/657469993 shutdown_connections 2024-04-25T08:54:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.202+0000 7fe53177e640 1 -- 172.21.15.55:0/657469993 wait complete. 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.203+0000 7fe53177e640 1 Processor -- start 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.203+0000 7fe53177e640 1 -- start start 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe53177e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe52c0d1f90 0x7fe52c14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe53177e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe52c0d35b0 0x7fe52c15e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe53177e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52c15dce0 0x7fe52c0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe53177e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0b9820 con 0x7fe52c0d1f90 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe53177e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0d3090 con 0x7fe52c0d35b0 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe53177e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0b99a0 con 0x7fe52c15dce0 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe52affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe52c0d1f90 0x7fe52c14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe52affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe52c0d1f90 0x7fe52c14d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37918/0 (socket says 172.21.15.55:37918) 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe52affd640 1 -- 172.21.15.55:0/201612949 learned_addr learned my addr 172.21.15.55:0/201612949 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe52b7fe640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52c15dce0 0x7fe52c0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe52a7fc640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe52c0d35b0 0x7fe52c15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe52affd640 1 -- 172.21.15.55:0/201612949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52c15dce0 msgr2=0x7fe52c0cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe52affd640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52c15dce0 0x7fe52c0cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe52affd640 1 -- 172.21.15.55:0/201612949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe52c0d35b0 msgr2=0x7fe52c15e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe52affd640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe52c0d35b0 0x7fe52c15e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.204+0000 7fe52affd640 1 -- 172.21.15.55:0/201612949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c0cbc20 con 0x7fe52c0d1f90 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.205+0000 7fe52affd640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe52c0d1f90 0x7fe52c14d0b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe51c034040 tx=0x7fe51c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.205+0000 7fe5237fe640 1 -- 172.21.15.55:0/201612949 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c036050 con 0x7fe52c0d1f90 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.205+0000 7fe5237fe640 1 -- 172.21.15.55:0/201612949 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c042070 con 0x7fe52c0d1f90 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.205+0000 7fe53177e640 1 -- 172.21.15.55:0/201612949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c0cbf00 con 0x7fe52c0d1f90 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.205+0000 7fe5237fe640 1 -- 172.21.15.55:0/201612949 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c009510 con 0x7fe52c0d1f90 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.205+0000 7fe53177e640 1 -- 172.21.15.55:0/201612949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c0cc4c0 con 0x7fe52c0d1f90 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.206+0000 7fe53177e640 1 -- 172.21.15.55:0/201612949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c0749b0 con 0x7fe52c0d1f90 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.206+0000 7fe5237fe640 1 -- 172.21.15.55:0/201612949 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe51c007c50 con 0x7fe52c0d1f90 2024-04-25T08:54:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.207+0000 7fe5237fe640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 0x7fe50c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.207+0000 7fe5237fe640 1 -- 172.21.15.55:0/201612949 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe51c0ab160 con 0x7fe52c0d1f90 2024-04-25T08:54:10.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.207+0000 7fe52a7fc640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 0x7fe50c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.207+0000 7fe52a7fc640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 0x7fe50c06d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe514006fd0 tx=0x7fe514008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:10.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.211+0000 7fe5237fe640 1 -- 172.21.15.55:0/201612949 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe51c079fd0 con 0x7fe52c0d1f90 2024-04-25T08:54:10.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.395+0000 7fe53177e640 1 -- 172.21.15.55:0/201612949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe52c0ce000 con 0x7fe52c0d1f90 2024-04-25T08:54:10.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.396+0000 7fe5237fe640 1 -- 172.21.15.55:0/201612949 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fe51c0798d0 con 0x7fe52c0d1f90 2024-04-25T08:54:10.387 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:10.387 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 -- 172.21.15.55:0/201612949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 msgr2=0x7fe50c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 0x7fe50c06d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe514006fd0 tx=0x7fe514008040 comp rx=0 tx=0).stop 2024-04-25T08:54:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 -- 172.21.15.55:0/201612949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe52c0d1f90 msgr2=0x7fe52c14d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe52c0d1f90 0x7fe52c14d0b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe51c034040 tx=0x7fe51c004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 -- 172.21.15.55:0/201612949 shutdown_connections 2024-04-25T08:54:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 0x7fe50c06d990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52c15dce0 0x7fe52c0cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe52c0d35b0 0x7fe52c15e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 --2- 172.21.15.55:0/201612949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe52c0d1f90 0x7fe52c14d0b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 -- 172.21.15.55:0/201612949 >> 172.21.15.55:0/201612949 conn(0x7fe52c072900 msgr2=0x7fe52c0b84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 -- 172.21.15.55:0/201612949 shutdown_connections 2024-04-25T08:54:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.398+0000 7fe53177e640 1 -- 172.21.15.55:0/201612949 wait complete. 2024-04-25T08:54:10.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:10.400 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:10.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.514+0000 7fb094f7e640 1 Processor -- start 2024-04-25T08:54:10.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.514+0000 7fb094f7e640 1 -- start start 2024-04-25T08:54:10.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb094f7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb09015dca0 0x7fb0900ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb094f7e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0900d3b90 0x7fb0900d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb094f7e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0900cee80 0x7fb0900d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb094f7e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0900b6b20 con 0x7fb09015dca0 2024-04-25T08:54:10.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb094f7e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0900d4090 con 0x7fb0900d3b90 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb094f7e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0900d4370 con 0x7fb0900cee80 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb09015dca0 0x7fb0900ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb09015dca0 0x7fb0900ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37930/0 (socket says 172.21.15.55:37930) 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08e59c640 1 -- 172.21.15.55:0/2175385851 learned_addr learned my addr 172.21.15.55:0/2175385851 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08ed9d640 1 --2- 172.21.15.55:0/2175385851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0900cee80 0x7fb0900d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08dd9b640 1 --2- 172.21.15.55:0/2175385851 >> v2:172.21.15.167:3300/0 conn(0x7fb0900d3b90 0x7fb0900d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08e59c640 1 -- 172.21.15.55:0/2175385851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0900cee80 msgr2=0x7fb0900d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08e59c640 1 --2- 172.21.15.55:0/2175385851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0900cee80 0x7fb0900d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08e59c640 1 -- 172.21.15.55:0/2175385851 >> v2:172.21.15.167:3300/0 conn(0x7fb0900d3b90 msgr2=0x7fb0900d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08e59c640 1 --2- 172.21.15.55:0/2175385851 >> v2:172.21.15.167:3300/0 conn(0x7fb0900d3b90 0x7fb0900d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08e59c640 1 -- 172.21.15.55:0/2175385851 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0900d4650 con 0x7fb09015dca0 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08dd9b640 1 --2- 172.21.15.55:0/2175385851 >> v2:172.21.15.167:3300/0 conn(0x7fb0900d3b90 0x7fb0900d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.515+0000 7fb08ed9d640 1 --2- 172.21.15.55:0/2175385851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0900cee80 0x7fb0900d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.516+0000 7fb08e59c640 1 --2- 172.21.15.55:0/2175385851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09015dca0 0x7fb0900ce940 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb0900b6560 tx=0x7fb08002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0386e1530bc49d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.516+0000 7fb08d59a640 1 -- 172.21.15.55:0/2175385851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080037070 con 0x7fb09015dca0 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.516+0000 7fb08d59a640 1 -- 172.21.15.55:0/2175385851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb080032440 con 0x7fb09015dca0 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.516+0000 7fb08d59a640 1 -- 172.21.15.55:0/2175385851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080032810 con 0x7fb09015dca0 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.517+0000 7fb094f7e640 1 -- 172.21.15.55:0/2175385851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09015dca0 msgr2=0x7fb0900ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.517+0000 7fb094f7e640 1 --2- 172.21.15.55:0/2175385851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09015dca0 0x7fb0900ce940 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb0900b6560 tx=0x7fb08002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.517+0000 7fb094f7e640 1 -- 172.21.15.55:0/2175385851 shutdown_connections 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.517+0000 7fb094f7e640 1 --2- 172.21.15.55:0/2175385851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0900cee80 0x7fb0900d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.517+0000 7fb094f7e640 1 --2- 172.21.15.55:0/2175385851 >> v2:172.21.15.167:3300/0 conn(0x7fb0900d3b90 0x7fb0900d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.517+0000 7fb094f7e640 1 --2- 172.21.15.55:0/2175385851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09015dca0 0x7fb0900ce940 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.517+0000 7fb094f7e640 1 -- 172.21.15.55:0/2175385851 >> 172.21.15.55:0/2175385851 conn(0x7fb0900726c0 msgr2=0x7fb090072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.517+0000 7fb094f7e640 1 -- 172.21.15.55:0/2175385851 shutdown_connections 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.517+0000 7fb094f7e640 1 -- 172.21.15.55:0/2175385851 wait complete. 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.518+0000 7fb094f7e640 1 Processor -- start 2024-04-25T08:54:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.518+0000 7fb094f7e640 1 -- start start 2024-04-25T08:54:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb094f7e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0900cee80 0x7fb0900cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb094f7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0900d3b90 0x7fb0900ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb094f7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09015dca0 0x7fb0900cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb094f7e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09015e200 con 0x7fb09015dca0 2024-04-25T08:54:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb094f7e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09015e080 con 0x7fb0900d3b90 2024-04-25T08:54:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb094f7e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0900b2500 con 0x7fb0900cee80 2024-04-25T08:54:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb08ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09015dca0 0x7fb0900cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb08ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09015dca0 0x7fb0900cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37932/0 (socket says 172.21.15.55:37932) 2024-04-25T08:54:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb08ed9d640 1 -- 172.21.15.55:0/2764495061 learned_addr learned my addr 172.21.15.55:0/2764495061 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb08e59c640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0900cee80 0x7fb0900cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb08dd9b640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0900d3b90 0x7fb0900ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb08ed9d640 1 -- 172.21.15.55:0/2764495061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0900cee80 msgr2=0x7fb0900cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb08ed9d640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0900cee80 0x7fb0900cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb08ed9d640 1 -- 172.21.15.55:0/2764495061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0900d3b90 msgr2=0x7fb0900ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb08ed9d640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0900d3b90 0x7fb0900ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb08ed9d640 1 -- 172.21.15.55:0/2764495061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0900cc1e0 con 0x7fb09015dca0 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.519+0000 7fb08dd9b640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0900d3b90 0x7fb0900ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.520+0000 7fb08ed9d640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09015dca0 0x7fb0900cd320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb088007e10 tx=0x7fb08800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.520+0000 7fb07effd640 1 -- 172.21.15.55:0/2764495061 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08801a070 con 0x7fb09015dca0 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.520+0000 7fb07effd640 1 -- 172.21.15.55:0/2764495061 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb088003b90 con 0x7fb09015dca0 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.520+0000 7fb07effd640 1 -- 172.21.15.55:0/2764495061 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088004030 con 0x7fb09015dca0 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.520+0000 7fb094f7e640 1 -- 172.21.15.55:0/2764495061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0900cb140 con 0x7fb09015dca0 2024-04-25T08:54:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.520+0000 7fb094f7e640 1 -- 172.21.15.55:0/2764495061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0900cb700 con 0x7fb09015dca0 2024-04-25T08:54:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.521+0000 7fb094f7e640 1 -- 172.21.15.55:0/2764495061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0900750b0 con 0x7fb09015dca0 2024-04-25T08:54:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.521+0000 7fb07effd640 1 -- 172.21.15.55:0/2764495061 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb08801d070 con 0x7fb09015dca0 2024-04-25T08:54:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.521+0000 7fb07effd640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb07006b4d0 0x7fb07006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.522+0000 7fb07effd640 1 -- 172.21.15.55:0/2764495061 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb08808a3c0 con 0x7fb09015dca0 2024-04-25T08:54:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.522+0000 7fb08e59c640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb07006b4d0 0x7fb07006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.522+0000 7fb08e59c640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb07006b4d0 0x7fb07006d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb080034000 tx=0x7fb08002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.526+0000 7fb07effd640 1 -- 172.21.15.55:0/2764495061 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb088010070 con 0x7fb09015dca0 2024-04-25T08:54:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.710+0000 7fb094f7e640 1 -- 172.21.15.55:0/2764495061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0900d2320 con 0x7fb09015dca0 2024-04-25T08:54:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.710+0000 7fb07effd640 1 -- 172.21.15.55:0/2764495061 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb088058c80 con 0x7fb09015dca0 2024-04-25T08:54:10.700 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:10.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 -- 172.21.15.55:0/2764495061 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb07006b4d0 msgr2=0x7fb07006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb07006b4d0 0x7fb07006d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb080034000 tx=0x7fb08002e000 comp rx=0 tx=0).stop 2024-04-25T08:54:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 -- 172.21.15.55:0/2764495061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09015dca0 msgr2=0x7fb0900cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09015dca0 0x7fb0900cd320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb088007e10 tx=0x7fb08800d4a0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 -- 172.21.15.55:0/2764495061 shutdown_connections 2024-04-25T08:54:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb07006b4d0 0x7fb07006d990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09015dca0 0x7fb0900cd320 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0900d3b90 0x7fb0900ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 --2- 172.21.15.55:0/2764495061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0900cee80 0x7fb0900cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 -- 172.21.15.55:0/2764495061 >> 172.21.15.55:0/2764495061 conn(0x7fb0900726c0 msgr2=0x7fb0900b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 -- 172.21.15.55:0/2764495061 shutdown_connections 2024-04-25T08:54:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.712+0000 7fb094f7e640 1 -- 172.21.15.55:0/2764495061 wait complete. 2024-04-25T08:54:10.713 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:54:10.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.826+0000 7f1475076640 1 Processor -- start 2024-04-25T08:54:10.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.826+0000 7f1475076640 1 -- start start 2024-04-25T08:54:10.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.827+0000 7f1475076640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f147015bbe0 0x7f14700cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.827+0000 7f1475076640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f14700cf510 0x7f14700cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.827+0000 7f1475076640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14700cff00 0x7f14700d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.827+0000 7f1475076640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14700cc830 con 0x7f14700cff00 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.827+0000 7f1475076640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14700ccb10 con 0x7f14700cf510 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.827+0000 7f1475076640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14700ccdf0 con 0x7f147015bbe0 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.827+0000 7f146f59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14700cff00 0x7f14700d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.827+0000 7f146f59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14700cff00 0x7f14700d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37946/0 (socket says 172.21.15.55:37946) 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.827+0000 7f146f59e640 1 -- 172.21.15.55:0/1856406928 learned_addr learned my addr 172.21.15.55:0/1856406928 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.828+0000 7f146e59c640 1 --2- 172.21.15.55:0/1856406928 >> v2:172.21.15.167:3300/0 conn(0x7f14700cf510 0x7f14700cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.828+0000 7f146ed9d640 1 --2- 172.21.15.55:0/1856406928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f147015bbe0 0x7f14700cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.828+0000 7f146f59e640 1 -- 172.21.15.55:0/1856406928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f147015bbe0 msgr2=0x7f14700cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.828+0000 7f146f59e640 1 --2- 172.21.15.55:0/1856406928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f147015bbe0 0x7f14700cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.828+0000 7f146f59e640 1 -- 172.21.15.55:0/1856406928 >> v2:172.21.15.167:3300/0 conn(0x7f14700cf510 msgr2=0x7f14700cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.828+0000 7f146f59e640 1 --2- 172.21.15.55:0/1856406928 >> v2:172.21.15.167:3300/0 conn(0x7f14700cf510 0x7f14700cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.828+0000 7f146f59e640 1 -- 172.21.15.55:0/1856406928 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14700cd0d0 con 0x7f14700cff00 2024-04-25T08:54:10.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.828+0000 7f146f59e640 1 --2- 172.21.15.55:0/1856406928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14700cff00 0x7f14700d03b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f14700727c0 tx=0x7f146002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cbfc62d71f0053 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:10.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f146dd9b640 1 -- 172.21.15.55:0/1856406928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460036070 con 0x7f14700cff00 2024-04-25T08:54:10.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f146dd9b640 1 -- 172.21.15.55:0/1856406928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460031600 con 0x7f14700cff00 2024-04-25T08:54:10.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f146dd9b640 1 -- 172.21.15.55:0/1856406928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14600319d0 con 0x7f14700cff00 2024-04-25T08:54:10.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f1475076640 1 -- 172.21.15.55:0/1856406928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14700cff00 msgr2=0x7f14700d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f1475076640 1 --2- 172.21.15.55:0/1856406928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14700cff00 0x7f14700d03b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f14700727c0 tx=0x7f146002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f1475076640 1 -- 172.21.15.55:0/1856406928 shutdown_connections 2024-04-25T08:54:10.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f1475076640 1 --2- 172.21.15.55:0/1856406928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14700cff00 0x7f14700d03b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f1475076640 1 --2- 172.21.15.55:0/1856406928 >> v2:172.21.15.167:3300/0 conn(0x7f14700cf510 0x7f14700cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f1475076640 1 --2- 172.21.15.55:0/1856406928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f147015bbe0 0x7f14700cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f1475076640 1 -- 172.21.15.55:0/1856406928 >> 172.21.15.55:0/1856406928 conn(0x7f14700b3430 msgr2=0x7f14700b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:10.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f1475076640 1 -- 172.21.15.55:0/1856406928 shutdown_connections 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.829+0000 7f1475076640 1 -- 172.21.15.55:0/1856406928 wait complete. 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.831+0000 7f1475076640 1 Processor -- start 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.831+0000 7f1475076640 1 -- start start 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.831+0000 7f1475076640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14700cf510 0x7f147015e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.831+0000 7f1475076640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14700cff00 0x7f14700ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.831+0000 7f1475076640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f147015bbe0 0x7f147015e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.831+0000 7f1475076640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700cde10 con 0x7f14700cf510 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.831+0000 7f1475076640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147015bfc0 con 0x7f147015bbe0 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.831+0000 7f1475076640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14700cc450 con 0x7f14700cff00 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f146ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14700cf510 0x7f147015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f146ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14700cf510 0x7f147015e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37956/0 (socket says 172.21.15.55:37956) 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f146ed9d640 1 -- 172.21.15.55:0/860021311 learned_addr learned my addr 172.21.15.55:0/860021311 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f146e59c640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14700cff00 0x7f14700ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f146f59e640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f147015bbe0 0x7f147015e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f146ed9d640 1 -- 172.21.15.55:0/860021311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14700cff00 msgr2=0x7f14700ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f146ed9d640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14700cff00 0x7f14700ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f146ed9d640 1 -- 172.21.15.55:0/860021311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f147015bbe0 msgr2=0x7f147015e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f146ed9d640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f147015bbe0 0x7f147015e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f146ed9d640 1 -- 172.21.15.55:0/860021311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14700cac10 con 0x7f14700cf510 2024-04-25T08:54:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f146ed9d640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14700cf510 0x7f147015e050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f146800d800 tx=0x7f146800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f14677fe640 1 -- 172.21.15.55:0/860021311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800b6c0 con 0x7f14700cf510 2024-04-25T08:54:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f14677fe640 1 -- 172.21.15.55:0/860021311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1468019070 con 0x7f14700cf510 2024-04-25T08:54:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f1475076640 1 -- 172.21.15.55:0/860021311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14700caef0 con 0x7f14700cf510 2024-04-25T08:54:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f14677fe640 1 -- 172.21.15.55:0/860021311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800ba80 con 0x7f14700cf510 2024-04-25T08:54:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.832+0000 7f1475076640 1 -- 172.21.15.55:0/860021311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14700cb4b0 con 0x7f14700cf510 2024-04-25T08:54:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.833+0000 7f1475076640 1 -- 172.21.15.55:0/860021311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14700750b0 con 0x7f14700cf510 2024-04-25T08:54:10.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.834+0000 7f14677fe640 1 -- 172.21.15.55:0/860021311 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f146800bc20 con 0x7f14700cf510 2024-04-25T08:54:10.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.834+0000 7f14677fe640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f145006b4d0 0x7f145006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:10.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.834+0000 7f14677fe640 1 -- 172.21.15.55:0/860021311 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f146808a6a0 con 0x7f14700cf510 2024-04-25T08:54:10.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.834+0000 7f146e59c640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f145006b4d0 0x7f145006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:10.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.835+0000 7f146e59c640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f145006b4d0 0x7f145006d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1458006fd0 tx=0x7f1458008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:10.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:10.838+0000 7f14677fe640 1 -- 172.21.15.55:0/860021311 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f14680594a0 con 0x7f14700cf510 2024-04-25T08:54:11.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.017+0000 7f1475076640 1 -- 172.21.15.55:0/860021311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f147015e5e0 con 0x7f14700cf510 2024-04-25T08:54:11.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.017+0000 7f14677fe640 1 -- 172.21.15.55:0/860021311 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1468058da0 con 0x7f14700cf510 2024-04-25T08:54:11.007 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:54:11.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 -- 172.21.15.55:0/860021311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f145006b4d0 msgr2=0x7f145006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f145006b4d0 0x7f145006d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1458006fd0 tx=0x7f1458008040 comp rx=0 tx=0).stop 2024-04-25T08:54:11.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 -- 172.21.15.55:0/860021311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14700cf510 msgr2=0x7f147015e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14700cf510 0x7f147015e050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f146800d800 tx=0x7f146800dcc0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 -- 172.21.15.55:0/860021311 shutdown_connections 2024-04-25T08:54:11.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f145006b4d0 0x7f145006d990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f147015bbe0 0x7f147015e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14700cff00 0x7f14700ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 --2- 172.21.15.55:0/860021311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14700cf510 0x7f147015e050 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 -- 172.21.15.55:0/860021311 >> 172.21.15.55:0/860021311 conn(0x7f14700b3430 msgr2=0x7f14700b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:11.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 -- 172.21.15.55:0/860021311 shutdown_connections 2024-04-25T08:54:11.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.019+0000 7f1475076640 1 -- 172.21.15.55:0/860021311 wait complete. 2024-04-25T08:54:11.021 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:54:11.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.135+0000 7f983bb22640 1 Processor -- start 2024-04-25T08:54:11.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.135+0000 7f983bb22640 1 -- start start 2024-04-25T08:54:11.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.136+0000 7f983bb22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f983415dca0 0x7f98340ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.136+0000 7f983bb22640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98340d4090 con 0x7f98340d3b90 2024-04-25T08:54:11.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.136+0000 7f983bb22640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98340d4370 con 0x7f98340d1130 2024-04-25T08:54:11.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.136+0000 7f983bb22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98340b6b20 con 0x7f983415dca0 2024-04-25T08:54:11.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.136+0000 7f98390bd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f98340d3b90 0x7f98340d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38444/0 (socket says 172.21.15.55:38444) 2024-04-25T08:54:11.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.136+0000 7f98390bd640 1 -- 172.21.15.55:0/1201613105 learned_addr learned my addr 172.21.15.55:0/1201613105 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:11.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.136+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919697427 0 0) 0x7f98340d4090 con 0x7f98340d3b90 2024-04-25T08:54:11.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.136+0000 7f98398be640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f983415dca0 0x7f98340ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.136+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9820003520 con 0x7f98340d3b90 2024-04-25T08:54:11.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3312618236 0 0) 0x7f9820003520 con 0x7f98340d3b90 2024-04-25T08:54:11.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f983415dca0 msgr2=0x7f98340ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:11.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f983415dca0 0x7f98340ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 >> v1:172.21.15.167:6789/0 conn(0x7f98340d1130 legacy=0x7f98340b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98340d4650 con 0x7f98340d3b90 2024-04-25T08:54:11.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f9824001670 con 0x7f98340d3b90 2024-04-25T08:54:11.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 >> v1:172.21.15.55:6789/0 conn(0x7f98340d3b90 legacy=0x7f98340d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98200039e0 0x7f9820003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 0x7f9820004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f983415dca0 0x7f98200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982000ba70 con 0x7f9820004800 2024-04-25T08:54:11.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982000bbf0 con 0x7f98200039e0 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982000bdf0 con 0x7f983415dca0 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98390bd640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 0x7f9820004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98398be640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98200039e0 0x7f9820003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f983a0bf640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f983415dca0 0x7f98200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98390bd640 1 -- 172.21.15.55:0/1201613105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f983415dca0 msgr2=0x7f98200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98390bd640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f983415dca0 0x7f98200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98390bd640 1 -- 172.21.15.55:0/1201613105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98200039e0 msgr2=0x7f9820003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98390bd640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98200039e0 0x7f9820003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.137+0000 7f98390bd640 1 -- 172.21.15.55:0/1201613105 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9820003520 con 0x7f9820004800 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.138+0000 7f98390bd640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 0x7f9820004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f982400c210 tx=0x7f9820005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a61919c0db954fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.138+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824007cf0 con 0x7f9820004800 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.138+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9824005ad0 con 0x7f9820004800 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.138+0000 7f98388bc640 1 -- 172.21.15.55:0/1201613105 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824007070 con 0x7f9820004800 2024-04-25T08:54:11.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.139+0000 7f983bb22640 1 -- 172.21.15.55:0/1201613105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 msgr2=0x7f9820004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.139+0000 7f983bb22640 1 --2- 172.21.15.55:0/1201613105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 0x7f9820004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f982400c210 tx=0x7f9820005830 comp rx=0 tx=0).stop 2024-04-25T08:54:11.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.139+0000 7f983a0bf640 1 -- 172.21.15.55:0/1201613105 reap_dead start 2024-04-25T08:54:11.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.139+0000 7f983bb22640 1 -- 172.21.15.55:0/1201613105 shutdown_connections 2024-04-25T08:54:11.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.139+0000 7f983bb22640 1 -- 172.21.15.55:0/1201613105 >> 172.21.15.55:0/1201613105 conn(0x7f98340726c0 msgr2=0x7f9834072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:11.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.139+0000 7f983bb22640 1 -- 172.21.15.55:0/1201613105 shutdown_connections 2024-04-25T08:54:11.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.139+0000 7f983bb22640 1 -- 172.21.15.55:0/1201613105 wait complete. 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.140+0000 7f983bb22640 1 Processor -- start 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.140+0000 7f983bb22640 1 -- start start 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f983bb22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 0x7f9834159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f983bb22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98340cba70 0x7f98341501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f983bb22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9834160a50 0x7f98340cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f983bb22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983415e200 con 0x7f9820004800 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f983bb22640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983415e080 con 0x7f98340cba70 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f983bb22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98340b8280 con 0x7f9834160a50 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f98398be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 0x7f9834159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f98398be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 0x7f9834159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37978/0 (socket says 172.21.15.55:37978) 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f98398be640 1 -- 172.21.15.55:0/49863414 learned_addr learned my addr 172.21.15.55:0/49863414 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f98390bd640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98340cba70 0x7f98341501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f983a0bf640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9834160a50 0x7f98340cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f98398be640 1 -- 172.21.15.55:0/49863414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9834160a50 msgr2=0x7f98340cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f98398be640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9834160a50 0x7f98340cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f98398be640 1 -- 172.21.15.55:0/49863414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98340cba70 msgr2=0x7f98341501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f98398be640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98340cba70 0x7f98341501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f98398be640 1 -- 172.21.15.55:0/49863414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9834150730 con 0x7f9820004800 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f98398be640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 0x7f9834159a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f982c011e30 tx=0x7f982c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f982a7fc640 1 -- 172.21.15.55:0/49863414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c015630 con 0x7f9820004800 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f982a7fc640 1 -- 172.21.15.55:0/49863414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c0157d0 con 0x7f9820004800 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f983bb22640 1 -- 172.21.15.55:0/49863414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983415f9b0 con 0x7f9820004800 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.141+0000 7f982a7fc640 1 -- 172.21.15.55:0/49863414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c015ba0 con 0x7f9820004800 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.142+0000 7f983bb22640 1 -- 172.21.15.55:0/49863414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983415ff70 con 0x7f9820004800 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.142+0000 7f983bb22640 1 -- 172.21.15.55:0/49863414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98340750b0 con 0x7f9820004800 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.143+0000 7f982a7fc640 1 -- 172.21.15.55:0/49863414 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f982c01d400 con 0x7f9820004800 2024-04-25T08:54:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.143+0000 7f982a7fc640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f981806b500 0x7f981806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.144+0000 7f98390bd640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f981806b500 0x7f981806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.144+0000 7f982a7fc640 1 -- 172.21.15.55:0/49863414 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f982c08b250 con 0x7f9820004800 2024-04-25T08:54:11.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.144+0000 7f98390bd640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f981806b500 0x7f981806d9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9824032000 tx=0x7f9824009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:11.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.148+0000 7f982a7fc640 1 -- 172.21.15.55:0/49863414 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9834150730 con 0x7f9820004800 2024-04-25T08:54:11.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.328+0000 7f983bb22640 1 -- 172.21.15.55:0/49863414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98340b50e0 con 0x7f9820004800 2024-04-25T08:54:11.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.328+0000 7f982a7fc640 1 -- 172.21.15.55:0/49863414 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f982c019030 con 0x7f9820004800 2024-04-25T08:54:11.318 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:54:11.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 -- 172.21.15.55:0/49863414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f981806b500 msgr2=0x7f981806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f981806b500 0x7f981806d9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9824032000 tx=0x7f9824009030 comp rx=0 tx=0).stop 2024-04-25T08:54:11.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 -- 172.21.15.55:0/49863414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 msgr2=0x7f9834159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 0x7f9834159a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f982c011e30 tx=0x7f982c00f580 comp rx=0 tx=0).stop 2024-04-25T08:54:11.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 -- 172.21.15.55:0/49863414 shutdown_connections 2024-04-25T08:54:11.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f981806b500 0x7f981806d9c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9834160a50 0x7f98340cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98340cba70 0x7f98341501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 --2- 172.21.15.55:0/49863414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9820004800 0x7f9834159a70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 -- 172.21.15.55:0/49863414 >> 172.21.15.55:0/49863414 conn(0x7f98340726c0 msgr2=0x7f98340d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:11.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 -- 172.21.15.55:0/49863414 shutdown_connections 2024-04-25T08:54:11.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.330+0000 7f983bb22640 1 -- 172.21.15.55:0/49863414 wait complete. 2024-04-25T08:54:11.331 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.442+0000 7febd7c83640 1 Processor -- start 2024-04-25T08:54:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.442+0000 7febd7c83640 1 -- start start 2024-04-25T08:54:11.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd7c83640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febd009a150 0x7febd006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd7c83640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7febd006c1f0 0x7febd00cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd7c83640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd006c680 con 0x7febd015ba10 2024-04-25T08:54:11.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd7c83640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd00cbe50 con 0x7febd006c1f0 2024-04-25T08:54:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd7c83640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd00cfe80 con 0x7febd009a150 2024-04-25T08:54:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd6220640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7febd006c1f0 0x7febd00cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd5a1f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7febd015ba10 0x7febd0099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38446/0 (socket says 172.21.15.55:38446) 2024-04-25T08:54:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd5a1f640 1 -- 172.21.15.55:0/2997201402 learned_addr learned my addr 172.21.15.55:0/2997201402 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd521e640 1 --2- 172.21.15.55:0/2997201402 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febd009a150 0x7febd006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd6220640 1 -- 172.21.15.55:0/2997201402 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febd009a150 msgr2=0x7febd006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd6220640 1 --2- 172.21.15.55:0/2997201402 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febd009a150 0x7febd006bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd6220640 1 -- 172.21.15.55:0/2997201402 >> v1:172.21.15.55:6789/0 conn(0x7febd015ba10 legacy=0x7febd0099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd6220640 1 -- 172.21.15.55:0/2997201402 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd006c900 con 0x7febd006c1f0 2024-04-25T08:54:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd4a1d640 1 -- 172.21.15.55:0/2997201402 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231609673 0 0) 0x7febcc001110 con 0x7febd015ba10 2024-04-25T08:54:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.443+0000 7febd521e640 1 --2- 172.21.15.55:0/2997201402 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febd009a150 0x7febd006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.444+0000 7febd6220640 1 --2- 172.21.15.55:0/2997201402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd006c1f0 0x7febd00cd220 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7febc8009d90 tx=0x7febc802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ffd2d0fad43a9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.444+0000 7febd4a1d640 1 -- 172.21.15.55:0/2997201402 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8007740 con 0x7febd006c1f0 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.444+0000 7febd4a1d640 1 -- 172.21.15.55:0/2997201402 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc80078e0 con 0x7febd006c1f0 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.444+0000 7febd4a1d640 1 -- 172.21.15.55:0/2997201402 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8007cb0 con 0x7febd006c1f0 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.445+0000 7febd7c83640 1 -- 172.21.15.55:0/2997201402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd006c1f0 msgr2=0x7febd00cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.445+0000 7febd7c83640 1 --2- 172.21.15.55:0/2997201402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd006c1f0 0x7febd00cd220 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7febc8009d90 tx=0x7febc802a660 comp rx=0 tx=0).stop 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.445+0000 7febd7c83640 1 -- 172.21.15.55:0/2997201402 shutdown_connections 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.445+0000 7febd7c83640 1 --2- 172.21.15.55:0/2997201402 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febd009a150 0x7febd006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.445+0000 7febd7c83640 1 --2- 172.21.15.55:0/2997201402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd006c1f0 0x7febd00cd220 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.445+0000 7febd7c83640 1 -- 172.21.15.55:0/2997201402 >> 172.21.15.55:0/2997201402 conn(0x7febd00b32f0 msgr2=0x7febd00b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.445+0000 7febd7c83640 1 -- 172.21.15.55:0/2997201402 shutdown_connections 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.445+0000 7febd7c83640 1 -- 172.21.15.55:0/2997201402 wait complete. 2024-04-25T08:54:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.446+0000 7febd7c83640 1 Processor -- start 2024-04-25T08:54:11.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.446+0000 7febd7c83640 1 -- start start 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd7c83640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febd006c1f0 0x7febd00af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd7c83640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febd009a150 0x7febd015ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd7c83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd015ba10 0x7febd00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd7c83640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd00cd760 con 0x7febd015ba10 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd7c83640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd006cec0 con 0x7febd006c1f0 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd7c83640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd00cd8e0 con 0x7febd009a150 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd6220640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd015ba10 0x7febd00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd6220640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd015ba10 0x7febd00b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37994/0 (socket says 172.21.15.55:37994) 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd6220640 1 -- 172.21.15.55:0/1112855223 learned_addr learned my addr 172.21.15.55:0/1112855223 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd5a1f640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febd006c1f0 0x7febd00af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd521e640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febd009a150 0x7febd015ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd6220640 1 -- 172.21.15.55:0/1112855223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febd009a150 msgr2=0x7febd015ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd6220640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febd009a150 0x7febd015ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd6220640 1 -- 172.21.15.55:0/1112855223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febd006c1f0 msgr2=0x7febd00af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd6220640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febd006c1f0 0x7febd00af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd6220640 1 -- 172.21.15.55:0/1112855223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd00b4a70 con 0x7febd015ba10 2024-04-25T08:54:11.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febd6220640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd015ba10 0x7febd00b4530 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7febc8009eb0 tx=0x7febc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:11.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febc67fc640 1 -- 172.21.15.55:0/1112855223 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8040070 con 0x7febd015ba10 2024-04-25T08:54:11.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.447+0000 7febc67fc640 1 -- 172.21.15.55:0/1112855223 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc8031c90 con 0x7febd015ba10 2024-04-25T08:54:11.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.448+0000 7febd7c83640 1 -- 172.21.15.55:0/1112855223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd00c8b20 con 0x7febd015ba10 2024-04-25T08:54:11.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.448+0000 7febc67fc640 1 -- 172.21.15.55:0/1112855223 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8045680 con 0x7febd015ba10 2024-04-25T08:54:11.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.448+0000 7febd7c83640 1 -- 172.21.15.55:0/1112855223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd00c90e0 con 0x7febd015ba10 2024-04-25T08:54:11.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.448+0000 7febd7c83640 1 -- 172.21.15.55:0/1112855223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd00749b0 con 0x7febd015ba10 2024-04-25T08:54:11.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.449+0000 7febc67fc640 1 -- 172.21.15.55:0/1112855223 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7febc8039040 con 0x7febd015ba10 2024-04-25T08:54:11.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.449+0000 7febc67fc640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7febb406b4d0 0x7febb406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.449+0000 7febc67fc640 1 -- 172.21.15.55:0/1112855223 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febc80abb20 con 0x7febd015ba10 2024-04-25T08:54:11.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.449+0000 7febd5a1f640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7febb406b4d0 0x7febb406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.450+0000 7febd5a1f640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7febb406b4d0 0x7febb406d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7febcc007fd0 tx=0x7febcc007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:11.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.454+0000 7febc67fc640 1 -- 172.21.15.55:0/1112855223 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7febc807a410 con 0x7febd015ba10 2024-04-25T08:54:11.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.636+0000 7febd7c83640 1 -- 172.21.15.55:0/1112855223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febd00cbc30 con 0x7febd015ba10 2024-04-25T08:54:11.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.637+0000 7febc67fc640 1 -- 172.21.15.55:0/1112855223 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7febc807e4b0 con 0x7febd015ba10 2024-04-25T08:54:11.628 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:11.628 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 -- 172.21.15.55:0/1112855223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7febb406b4d0 msgr2=0x7febb406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7febb406b4d0 0x7febb406d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7febcc007fd0 tx=0x7febcc007de0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 -- 172.21.15.55:0/1112855223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd015ba10 msgr2=0x7febd00b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd015ba10 0x7febd00b4530 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7febc8009eb0 tx=0x7febc8004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 -- 172.21.15.55:0/1112855223 shutdown_connections 2024-04-25T08:54:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7febb406b4d0 0x7febb406d990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd015ba10 0x7febd00b4530 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febd009a150 0x7febd015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 --2- 172.21.15.55:0/1112855223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febd006c1f0 0x7febd00af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 -- 172.21.15.55:0/1112855223 >> 172.21.15.55:0/1112855223 conn(0x7febd00b32f0 msgr2=0x7febd00b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 -- 172.21.15.55:0/1112855223 shutdown_connections 2024-04-25T08:54:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.639+0000 7febd7c83640 1 -- 172.21.15.55:0/1112855223 wait complete. 2024-04-25T08:54:11.640 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:11.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:11.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.755+0000 7f81ac6b3640 1 Processor -- start 2024-04-25T08:54:11.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.755+0000 7f81ac6b3640 1 -- start start 2024-04-25T08:54:11.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81ac6b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81a415dca0 0x7f81a40ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81ac6b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81a40d3b90 0x7f81a40d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81ac6b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a40d4090 con 0x7f81a40cee80 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81ac6b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40b6b20 con 0x7f81a40d3b90 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81ac6b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40d4370 con 0x7f81a415dca0 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81a9c4e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81a40d3b90 0x7f81a40d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81aac50640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f81a40cee80 0x7f81a40b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38462/0 (socket says 172.21.15.55:38462) 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81aac50640 1 -- 172.21.15.55:0/230852052 learned_addr learned my addr 172.21.15.55:0/230852052 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81aa44f640 1 --2- 172.21.15.55:0/230852052 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81a415dca0 0x7f81a40ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81a9c4e640 1 -- 172.21.15.55:0/230852052 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81a415dca0 msgr2=0x7f81a40ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81a9c4e640 1 --2- 172.21.15.55:0/230852052 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81a415dca0 0x7f81a40ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81a9c4e640 1 -- 172.21.15.55:0/230852052 >> v1:172.21.15.55:6789/0 conn(0x7f81a40cee80 legacy=0x7f81a40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81a944d640 1 -- 172.21.15.55:0/230852052 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034181425 0 0) 0x7f81a40d4090 con 0x7f81a40cee80 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81a9c4e640 1 -- 172.21.15.55:0/230852052 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a40d4650 con 0x7f81a40d3b90 2024-04-25T08:54:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.756+0000 7f81aa44f640 1 --2- 172.21.15.55:0/230852052 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81a415dca0 0x7f81a40ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:11.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.757+0000 7f81a9c4e640 1 --2- 172.21.15.55:0/230852052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a40d3b90 0x7f81a40d0a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f81940097a0 tx=0x7f819402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826a923d3ba5cdf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:11.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.757+0000 7f81a944d640 1 -- 172.21.15.55:0/230852052 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194037070 con 0x7f81a40d3b90 2024-04-25T08:54:11.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.757+0000 7f81a944d640 1 -- 172.21.15.55:0/230852052 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8194032440 con 0x7f81a40d3b90 2024-04-25T08:54:11.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.757+0000 7f81a944d640 1 -- 172.21.15.55:0/230852052 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194032810 con 0x7f81a40d3b90 2024-04-25T08:54:11.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.758+0000 7f81ac6b3640 1 -- 172.21.15.55:0/230852052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a40d3b90 msgr2=0x7f81a40d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.758+0000 7f81ac6b3640 1 --2- 172.21.15.55:0/230852052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a40d3b90 0x7f81a40d0a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f81940097a0 tx=0x7f819402a180 comp rx=0 tx=0).stop 2024-04-25T08:54:11.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.758+0000 7f81ac6b3640 1 -- 172.21.15.55:0/230852052 shutdown_connections 2024-04-25T08:54:11.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.758+0000 7f81ac6b3640 1 --2- 172.21.15.55:0/230852052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a40d3b90 0x7f81a40d0a20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.758+0000 7f81ac6b3640 1 --2- 172.21.15.55:0/230852052 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81a415dca0 0x7f81a40ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.758+0000 7f81ac6b3640 1 -- 172.21.15.55:0/230852052 >> 172.21.15.55:0/230852052 conn(0x7f81a40726c0 msgr2=0x7f81a4072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:11.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.758+0000 7f81ac6b3640 1 -- 172.21.15.55:0/230852052 shutdown_connections 2024-04-25T08:54:11.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.758+0000 7f81ac6b3640 1 -- 172.21.15.55:0/230852052 wait complete. 2024-04-25T08:54:11.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.759+0000 7f81ac6b3640 1 Processor -- start 2024-04-25T08:54:11.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.759+0000 7f81ac6b3640 1 -- start start 2024-04-25T08:54:11.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81ac6b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a40cee80 0x7f81a4152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81ac6b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81a40d3b90 0x7f81a415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81ac6b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81a415dca0 0x7f81a4160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81ac6b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a415e200 con 0x7f81a40cee80 2024-04-25T08:54:11.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81ac6b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a415e080 con 0x7f81a40d3b90 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81ac6b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40d0f60 con 0x7f81a415dca0 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81aa44f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a40cee80 0x7f81a4152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81aa44f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a40cee80 0x7f81a4152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38004/0 (socket says 172.21.15.55:38004) 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81aa44f640 1 -- 172.21.15.55:0/2857005097 learned_addr learned my addr 172.21.15.55:0/2857005097 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81aa44f640 1 -- 172.21.15.55:0/2857005097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81a415dca0 msgr2=0x7f81a4160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81aa44f640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81a415dca0 0x7f81a4160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81aa44f640 1 -- 172.21.15.55:0/2857005097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81a40d3b90 msgr2=0x7f81a415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81aa44f640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81a40d3b90 0x7f81a415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81aa44f640 1 -- 172.21.15.55:0/2857005097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a415fae0 con 0x7f81a40cee80 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81aa44f640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a40cee80 0x7f81a4152df0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c820 tx=0x7f81a000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f819affd640 1 -- 172.21.15.55:0/2857005097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0015070 con 0x7f81a40cee80 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f819affd640 1 -- 172.21.15.55:0/2857005097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a0007a30 con 0x7f81a40cee80 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81ac6b3640 1 -- 172.21.15.55:0/2857005097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a415fdc0 con 0x7f81a40cee80 2024-04-25T08:54:11.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f819affd640 1 -- 172.21.15.55:0/2857005097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0007e00 con 0x7f81a40cee80 2024-04-25T08:54:11.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.760+0000 7f81ac6b3640 1 -- 172.21.15.55:0/2857005097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a4160380 con 0x7f81a40cee80 2024-04-25T08:54:11.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.761+0000 7f81ac6b3640 1 -- 172.21.15.55:0/2857005097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a40750b0 con 0x7f81a40cee80 2024-04-25T08:54:11.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.762+0000 7f819affd640 1 -- 172.21.15.55:0/2857005097 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f81a0018070 con 0x7f81a40cee80 2024-04-25T08:54:11.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.762+0000 7f819affd640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f818806b4d0 0x7f818806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:11.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.762+0000 7f819affd640 1 -- 172.21.15.55:0/2857005097 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81a008a1a0 con 0x7f81a40cee80 2024-04-25T08:54:11.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.762+0000 7f81a9c4e640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f818806b4d0 0x7f818806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:11.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.763+0000 7f81a9c4e640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f818806b4d0 0x7f818806d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8194034000 tx=0x7f819402c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:11.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.766+0000 7f819affd640 1 -- 172.21.15.55:0/2857005097 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81a0058fa0 con 0x7f81a40cee80 2024-04-25T08:54:11.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.948+0000 7f81ac6b3640 1 -- 172.21.15.55:0/2857005097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81a415f280 con 0x7f81a40cee80 2024-04-25T08:54:11.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.948+0000 7f819affd640 1 -- 172.21.15.55:0/2857005097 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81a00588a0 con 0x7f81a40cee80 2024-04-25T08:54:11.939 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:11.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 -- 172.21.15.55:0/2857005097 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f818806b4d0 msgr2=0x7f818806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f818806b4d0 0x7f818806d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8194034000 tx=0x7f819402c000 comp rx=0 tx=0).stop 2024-04-25T08:54:11.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 -- 172.21.15.55:0/2857005097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a40cee80 msgr2=0x7f81a4152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:11.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a40cee80 0x7f81a4152df0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c820 tx=0x7f81a000cce0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 -- 172.21.15.55:0/2857005097 shutdown_connections 2024-04-25T08:54:11.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f818806b4d0 0x7f818806d990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81a415dca0 0x7f81a4160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81a40d3b90 0x7f81a415ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 --2- 172.21.15.55:0/2857005097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a40cee80 0x7f81a4152df0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:11.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 -- 172.21.15.55:0/2857005097 >> 172.21.15.55:0/2857005097 conn(0x7f81a40726c0 msgr2=0x7f81a415cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:11.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 -- 172.21.15.55:0/2857005097 shutdown_connections 2024-04-25T08:54:11.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:11.950+0000 7f81ac6b3640 1 -- 172.21.15.55:0/2857005097 wait complete. 2024-04-25T08:54:11.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:54:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.065+0000 7f2737d41640 1 Processor -- start 2024-04-25T08:54:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.065+0000 7f2737d41640 1 -- start start 2024-04-25T08:54:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.066+0000 7f2737d41640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f273006b2b0 0x7f27300b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.066+0000 7f2737d41640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 0x7f27300b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.066+0000 7f2737d41640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300cd450 con 0x7f273015baf0 2024-04-25T08:54:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.066+0000 7f2737d41640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27300ce060 con 0x7f273006b2b0 2024-04-25T08:54:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.066+0000 7f2737d41640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27300cd730 con 0x7f27300ccee0 2024-04-25T08:54:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.067+0000 7f27362de640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 0x7f27300b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.067+0000 7f27362de640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 0x7f27300b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:59780/0 (socket says 172.21.15.55:59780) 2024-04-25T08:54:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.067+0000 7f27352dc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f273006b2b0 0x7f27300b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.067+0000 7f27362de640 1 -- 172.21.15.55:0/4291925088 learned_addr learned my addr 172.21.15.55:0/4291925088 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:12.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.067+0000 7f27362de640 1 -- 172.21.15.55:0/4291925088 >> v2:172.21.15.167:3300/0 conn(0x7f273006b2b0 msgr2=0x7f27300b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:12.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.067+0000 7f27362de640 1 --2- 172.21.15.55:0/4291925088 >> v2:172.21.15.167:3300/0 conn(0x7f273006b2b0 0x7f27300b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.067+0000 7f27362de640 1 -- 172.21.15.55:0/4291925088 >> v1:172.21.15.167:6789/0 conn(0x7f273015baf0 legacy=0x7f273006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.067+0000 7f27362de640 1 -- 172.21.15.55:0/4291925088 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300cda10 con 0x7f27300ccee0 2024-04-25T08:54:12.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f27362de640 1 --2- 172.21.15.55:0/4291925088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 0x7f27300b08f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2720009e50 tx=0x7f272002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ebba6842875ba0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:12.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f2734adb640 1 -- 172.21.15.55:0/4291925088 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720036070 con 0x7f27300ccee0 2024-04-25T08:54:12.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f2734adb640 1 -- 172.21.15.55:0/4291925088 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720031600 con 0x7f27300ccee0 2024-04-25T08:54:12.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f2734adb640 1 -- 172.21.15.55:0/4291925088 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200319d0 con 0x7f27300ccee0 2024-04-25T08:54:12.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f2737d41640 1 -- 172.21.15.55:0/4291925088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 msgr2=0x7f27300b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f2737d41640 1 --2- 172.21.15.55:0/4291925088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 0x7f27300b08f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2720009e50 tx=0x7f272002a710 comp rx=0 tx=0).stop 2024-04-25T08:54:12.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f2737d41640 1 -- 172.21.15.55:0/4291925088 shutdown_connections 2024-04-25T08:54:12.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f2737d41640 1 --2- 172.21.15.55:0/4291925088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 0x7f27300b08f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f2737d41640 1 --2- 172.21.15.55:0/4291925088 >> v2:172.21.15.167:3300/0 conn(0x7f273006b2b0 0x7f27300b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f2737d41640 1 -- 172.21.15.55:0/4291925088 >> 172.21.15.55:0/4291925088 conn(0x7f27300b2390 msgr2=0x7f27300b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:12.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f2737d41640 1 -- 172.21.15.55:0/4291925088 shutdown_connections 2024-04-25T08:54:12.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.068+0000 7f2737d41640 1 -- 172.21.15.55:0/4291925088 wait complete. 2024-04-25T08:54:12.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.070+0000 7f2737d41640 1 Processor -- start 2024-04-25T08:54:12.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.070+0000 7f2737d41640 1 -- start start 2024-04-25T08:54:12.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.070+0000 7f2737d41640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f273006b2b0 0x7f27301f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.070+0000 7f2737d41640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 0x7f27301443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.070+0000 7f2737d41640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f273015baf0 0x7f27300ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.070+0000 7f2737d41640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300c41a0 con 0x7f273015baf0 2024-04-25T08:54:12.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.070+0000 7f2737d41640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300c4020 con 0x7f273006b2b0 2024-04-25T08:54:12.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.070+0000 7f2737d41640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273015bed0 con 0x7f27300ccee0 2024-04-25T08:54:12.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f27362de640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f273015baf0 0x7f27300ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f27362de640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f273015baf0 0x7f27300ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38010/0 (socket says 172.21.15.55:38010) 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f27362de640 1 -- 172.21.15.55:0/4006133284 learned_addr learned my addr 172.21.15.55:0/4006133284 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f2735add640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f273006b2b0 0x7f27301f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f27352dc640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 0x7f27301443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f27362de640 1 -- 172.21.15.55:0/4006133284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 msgr2=0x7f27301443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f27362de640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 0x7f27301443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f27362de640 1 -- 172.21.15.55:0/4006133284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f273006b2b0 msgr2=0x7f27301f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f27362de640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f273006b2b0 0x7f27301f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f27362de640 1 -- 172.21.15.55:0/4006133284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2730144cd0 con 0x7f273015baf0 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f2735add640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f273006b2b0 0x7f27301f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f27362de640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f273015baf0 0x7f27300ce410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2720009f70 tx=0x7f2720004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f272e7fc640 1 -- 172.21.15.55:0/4006133284 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720036050 con 0x7f273015baf0 2024-04-25T08:54:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f272e7fc640 1 -- 172.21.15.55:0/4006133284 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720042070 con 0x7f273015baf0 2024-04-25T08:54:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f2737d41640 1 -- 172.21.15.55:0/4006133284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2730144fb0 con 0x7f273015baf0 2024-04-25T08:54:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f272e7fc640 1 -- 172.21.15.55:0/4006133284 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720009510 con 0x7f273015baf0 2024-04-25T08:54:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.071+0000 7f2737d41640 1 -- 172.21.15.55:0/4006133284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27301f42b0 con 0x7f273015baf0 2024-04-25T08:54:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.072+0000 7f2737d41640 1 -- 172.21.15.55:0/4006133284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27300adca0 con 0x7f273015baf0 2024-04-25T08:54:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.073+0000 7f272e7fc640 1 -- 172.21.15.55:0/4006133284 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2720007bf0 con 0x7f273015baf0 2024-04-25T08:54:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.073+0000 7f272e7fc640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271c06b4d0 0x7f271c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.073+0000 7f272e7fc640 1 -- 172.21.15.55:0/4006133284 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27200aaf10 con 0x7f273015baf0 2024-04-25T08:54:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.073+0000 7f2735add640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271c06b4d0 0x7f271c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.074+0000 7f2735add640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271c06b4d0 0x7f271c06d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2728001ad0 tx=0x7f2728009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.077+0000 7f272e7fc640 1 -- 172.21.15.55:0/4006133284 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f27300adca0 con 0x7f273015baf0 2024-04-25T08:54:12.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.256+0000 7f2737d41640 1 -- 172.21.15.55:0/4006133284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27300750b0 con 0x7f273015baf0 2024-04-25T08:54:12.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.257+0000 7f272e7fc640 1 -- 172.21.15.55:0/4006133284 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27200798f0 con 0x7f273015baf0 2024-04-25T08:54:12.247 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:54:12.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 -- 172.21.15.55:0/4006133284 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271c06b4d0 msgr2=0x7f271c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271c06b4d0 0x7f271c06d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2728001ad0 tx=0x7f2728009040 comp rx=0 tx=0).stop 2024-04-25T08:54:12.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 -- 172.21.15.55:0/4006133284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f273015baf0 msgr2=0x7f27300ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f273015baf0 0x7f27300ce410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2720009f70 tx=0x7f2720004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:12.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 -- 172.21.15.55:0/4006133284 shutdown_connections 2024-04-25T08:54:12.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271c06b4d0 0x7f271c06d990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f273015baf0 0x7f27300ce410 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27300ccee0 0x7f27301443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 --2- 172.21.15.55:0/4006133284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f273006b2b0 0x7f27301f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 -- 172.21.15.55:0/4006133284 >> 172.21.15.55:0/4006133284 conn(0x7f27300b2390 msgr2=0x7f27300cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 -- 172.21.15.55:0/4006133284 shutdown_connections 2024-04-25T08:54:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.259+0000 7f2737d41640 1 -- 172.21.15.55:0/4006133284 wait complete. 2024-04-25T08:54:12.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:54:12.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.374+0000 7f97637a9640 1 Processor -- start 2024-04-25T08:54:12.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.374+0000 7f97637a9640 1 -- start start 2024-04-25T08:54:12.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f97637a9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975c15dca0 0x7f975c0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f97637a9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f975c0d3b90 0x7f975c0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f97637a9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f975c0cee80 0x7f975c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f97637a9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c0b6b20 con 0x7f975c0d3b90 2024-04-25T08:54:12.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f97637a9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c0d4090 con 0x7f975c0cee80 2024-04-25T08:54:12.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f97637a9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0d4370 con 0x7f975c15dca0 2024-04-25T08:54:12.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f9760d44640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f975c0d3b90 0x7f975c0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f9760d44640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f975c0d3b90 0x7f975c0d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38026/0 (socket says 172.21.15.55:38026) 2024-04-25T08:54:12.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f9760d44640 1 -- 172.21.15.55:0/1566468247 learned_addr learned my addr 172.21.15.55:0/1566468247 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f9761545640 1 --2- 172.21.15.55:0/1566468247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975c15dca0 0x7f975c0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f9761d46640 1 --2- 172.21.15.55:0/1566468247 >> v2:172.21.15.167:3300/0 conn(0x7f975c0cee80 0x7f975c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f9760d44640 1 -- 172.21.15.55:0/1566468247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975c15dca0 msgr2=0x7f975c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f9760d44640 1 --2- 172.21.15.55:0/1566468247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975c15dca0 0x7f975c0ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f9760d44640 1 -- 172.21.15.55:0/1566468247 >> v2:172.21.15.167:3300/0 conn(0x7f975c0cee80 msgr2=0x7f975c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f9760d44640 1 --2- 172.21.15.55:0/1566468247 >> v2:172.21.15.167:3300/0 conn(0x7f975c0cee80 0x7f975c0d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.375+0000 7f9760d44640 1 -- 172.21.15.55:0/1566468247 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c0d4650 con 0x7f975c0d3b90 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.376+0000 7f9760d44640 1 --2- 172.21.15.55:0/1566468247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f975c0d3b90 0x7f975c0d0a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f975c0d04c0 tx=0x7f974c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5346fdd16692388 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.376+0000 7f9753fff640 1 -- 172.21.15.55:0/1566468247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c037070 con 0x7f975c0d3b90 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.376+0000 7f9753fff640 1 -- 172.21.15.55:0/1566468247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c032440 con 0x7f975c0d3b90 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.376+0000 7f9753fff640 1 -- 172.21.15.55:0/1566468247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c032810 con 0x7f975c0d3b90 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.377+0000 7f97637a9640 1 -- 172.21.15.55:0/1566468247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f975c0d3b90 msgr2=0x7f975c0d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.377+0000 7f97637a9640 1 --2- 172.21.15.55:0/1566468247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f975c0d3b90 0x7f975c0d0a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f975c0d04c0 tx=0x7f974c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.377+0000 7f97637a9640 1 -- 172.21.15.55:0/1566468247 shutdown_connections 2024-04-25T08:54:12.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.377+0000 7f97637a9640 1 --2- 172.21.15.55:0/1566468247 >> v2:172.21.15.167:3300/0 conn(0x7f975c0cee80 0x7f975c0d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.377+0000 7f97637a9640 1 --2- 172.21.15.55:0/1566468247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f975c0d3b90 0x7f975c0d0a20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.377+0000 7f97637a9640 1 --2- 172.21.15.55:0/1566468247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975c15dca0 0x7f975c0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.377+0000 7f97637a9640 1 -- 172.21.15.55:0/1566468247 >> 172.21.15.55:0/1566468247 conn(0x7f975c0726c0 msgr2=0x7f975c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:12.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.377+0000 7f97637a9640 1 -- 172.21.15.55:0/1566468247 shutdown_connections 2024-04-25T08:54:12.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.377+0000 7f97637a9640 1 -- 172.21.15.55:0/1566468247 wait complete. 2024-04-25T08:54:12.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.378+0000 7f97637a9640 1 Processor -- start 2024-04-25T08:54:12.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.378+0000 7f97637a9640 1 -- start start 2024-04-25T08:54:12.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f97637a9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f975c0cee80 0x7f975c0ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f97637a9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975c0d3b90 0x7f975c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f97637a9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f975c15dca0 0x7f975c1f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f97637a9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c15e200 con 0x7f975c15dca0 2024-04-25T08:54:12.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f97637a9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c15e080 con 0x7f975c0cee80 2024-04-25T08:54:12.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f97637a9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0b2500 con 0x7f975c0d3b90 2024-04-25T08:54:12.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9761d46640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f975c15dca0 0x7f975c1f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9761d46640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f975c15dca0 0x7f975c1f46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38034/0 (socket says 172.21.15.55:38034) 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9761d46640 1 -- 172.21.15.55:0/1543402682 learned_addr learned my addr 172.21.15.55:0/1543402682 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9761545640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f975c0cee80 0x7f975c0ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9760d44640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975c0d3b90 0x7f975c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9761d46640 1 -- 172.21.15.55:0/1543402682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975c0d3b90 msgr2=0x7f975c150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9761d46640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975c0d3b90 0x7f975c150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9761d46640 1 -- 172.21.15.55:0/1543402682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f975c0cee80 msgr2=0x7f975c0ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9761d46640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f975c0cee80 0x7f975c0ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9761d46640 1 -- 172.21.15.55:0/1543402682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c14fcc0 con 0x7f975c15dca0 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9761545640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f975c0cee80 0x7f975c0ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9761d46640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f975c15dca0 0x7f975c1f46c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9754007e90 tx=0x7f975400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9751ffb640 1 -- 172.21.15.55:0/1543402682 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754014420 con 0x7f975c15dca0 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.379+0000 7f9751ffb640 1 -- 172.21.15.55:0/1543402682 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9754019070 con 0x7f975c15dca0 2024-04-25T08:54:12.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.380+0000 7f97637a9640 1 -- 172.21.15.55:0/1543402682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c14ff40 con 0x7f975c15dca0 2024-04-25T08:54:12.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.380+0000 7f9751ffb640 1 -- 172.21.15.55:0/1543402682 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754014820 con 0x7f975c15dca0 2024-04-25T08:54:12.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.380+0000 7f97637a9640 1 -- 172.21.15.55:0/1543402682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c150500 con 0x7f975c15dca0 2024-04-25T08:54:12.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.381+0000 7f97637a9640 1 -- 172.21.15.55:0/1543402682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c0750b0 con 0x7f975c15dca0 2024-04-25T08:54:12.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.381+0000 7f9751ffb640 1 -- 172.21.15.55:0/1543402682 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f97540149c0 con 0x7f975c15dca0 2024-04-25T08:54:12.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.382+0000 7f9751ffb640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974006b4d0 0x7f974006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.382+0000 7f9751ffb640 1 -- 172.21.15.55:0/1543402682 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f975408aac0 con 0x7f975c15dca0 2024-04-25T08:54:12.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.382+0000 7f9761545640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974006b4d0 0x7f974006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.382+0000 7f9761545640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974006b4d0 0x7f974006d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9758006fd0 tx=0x7f9758008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:12.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.386+0000 7f9751ffb640 1 -- 172.21.15.55:0/1543402682 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f975c14fcc0 con 0x7f975c15dca0 2024-04-25T08:54:12.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.564+0000 7f97637a9640 1 -- 172.21.15.55:0/1543402682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f975c0ce570 con 0x7f975c15dca0 2024-04-25T08:54:12.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.564+0000 7f9751ffb640 1 -- 172.21.15.55:0/1543402682 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9754059940 con 0x7f975c15dca0 2024-04-25T08:54:12.554 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 -- 172.21.15.55:0/1543402682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974006b4d0 msgr2=0x7f974006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974006b4d0 0x7f974006d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9758006fd0 tx=0x7f9758008040 comp rx=0 tx=0).stop 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 -- 172.21.15.55:0/1543402682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f975c15dca0 msgr2=0x7f975c1f46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f975c15dca0 0x7f975c1f46c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9754007e90 tx=0x7f975400e4b0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 -- 172.21.15.55:0/1543402682 shutdown_connections 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974006b4d0 0x7f974006d990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f975c15dca0 0x7f975c1f46c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f975c0d3b90 0x7f975c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 --2- 172.21.15.55:0/1543402682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f975c0cee80 0x7f975c0ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 -- 172.21.15.55:0/1543402682 >> 172.21.15.55:0/1543402682 conn(0x7f975c0726c0 msgr2=0x7f975c0b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 -- 172.21.15.55:0/1543402682 shutdown_connections 2024-04-25T08:54:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.566+0000 7f97637a9640 1 -- 172.21.15.55:0/1543402682 wait complete. 2024-04-25T08:54:12.574 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T08:54:12.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:12.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.686+0000 7f5a3fbce640 1 Processor -- start 2024-04-25T08:54:12.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.686+0000 7f5a3fbce640 1 -- start start 2024-04-25T08:54:12.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.687+0000 7f5a3fbce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a3815dce0 0x7f5a380d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.687+0000 7f5a3fbce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5a380d35b0 0x7f5a380b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.687+0000 7f5a3fbce640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3815e0c0 con 0x7f5a380d1f90 2024-04-25T08:54:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.687+0000 7f5a3fbce640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a380b7b10 con 0x7f5a3815dce0 2024-04-25T08:54:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.687+0000 7f5a3fbce640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a380d2510 con 0x7f5a380d35b0 2024-04-25T08:54:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.687+0000 7f5a3d96a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a3815dce0 0x7f5a380d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.687+0000 7f5a3e16b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5a380d1f90 0x7f5a3806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38464/0 (socket says 172.21.15.55:38464) 2024-04-25T08:54:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.687+0000 7f5a3e16b640 1 -- 172.21.15.55:0/1478468208 learned_addr learned my addr 172.21.15.55:0/1478468208 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.688+0000 7f5a3d169640 1 --2- 172.21.15.55:0/1478468208 >> v2:172.21.15.167:3300/0 conn(0x7f5a380d35b0 0x7f5a380b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.688+0000 7f5a3d96a640 1 -- 172.21.15.55:0/1478468208 >> v2:172.21.15.167:3300/0 conn(0x7f5a380d35b0 msgr2=0x7f5a380b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.688+0000 7f5a3d96a640 1 --2- 172.21.15.55:0/1478468208 >> v2:172.21.15.167:3300/0 conn(0x7f5a380d35b0 0x7f5a380b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.688+0000 7f5a3d96a640 1 -- 172.21.15.55:0/1478468208 >> v1:172.21.15.55:6789/0 conn(0x7f5a380d1f90 legacy=0x7f5a3806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.688+0000 7f5a3d96a640 1 -- 172.21.15.55:0/1478468208 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380d27f0 con 0x7f5a3815dce0 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.688+0000 7f5a3d96a640 1 --2- 172.21.15.55:0/1478468208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3815dce0 0x7f5a380d1a50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5a380cdfa0 tx=0x7f5a3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d19e45fe95aec51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.688+0000 7f5a3c968640 1 -- 172.21.15.55:0/1478468208 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34037070 con 0x7f5a3815dce0 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.689+0000 7f5a3c968640 1 -- 172.21.15.55:0/1478468208 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a34032440 con 0x7f5a3815dce0 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.689+0000 7f5a3c968640 1 -- 172.21.15.55:0/1478468208 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34032810 con 0x7f5a3815dce0 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.689+0000 7f5a3fbce640 1 -- 172.21.15.55:0/1478468208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3815dce0 msgr2=0x7f5a380d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.689+0000 7f5a3fbce640 1 --2- 172.21.15.55:0/1478468208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3815dce0 0x7f5a380d1a50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5a380cdfa0 tx=0x7f5a3402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.689+0000 7f5a3fbce640 1 -- 172.21.15.55:0/1478468208 shutdown_connections 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.689+0000 7f5a3fbce640 1 --2- 172.21.15.55:0/1478468208 >> v2:172.21.15.167:3300/0 conn(0x7f5a380d35b0 0x7f5a380b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.689+0000 7f5a3fbce640 1 --2- 172.21.15.55:0/1478468208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3815dce0 0x7f5a380d1a50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.689+0000 7f5a3fbce640 1 -- 172.21.15.55:0/1478468208 >> 172.21.15.55:0/1478468208 conn(0x7f5a38072900 msgr2=0x7f5a380d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.689+0000 7f5a3fbce640 1 -- 172.21.15.55:0/1478468208 shutdown_connections 2024-04-25T08:54:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.689+0000 7f5a3fbce640 1 -- 172.21.15.55:0/1478468208 wait complete. 2024-04-25T08:54:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.690+0000 7f5a3fbce640 1 Processor -- start 2024-04-25T08:54:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.690+0000 7f5a3fbce640 1 -- start start 2024-04-25T08:54:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3fbce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1f90 0x7f5a381528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3fbce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a380d35b0 0x7f5a380b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3fbce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a3815dce0 0x7f5a380b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3fbce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380d3090 con 0x7f5a380d1f90 2024-04-25T08:54:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3fbce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380d2db0 con 0x7f5a3815dce0 2024-04-25T08:54:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3fbce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380b9820 con 0x7f5a380d35b0 2024-04-25T08:54:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3d96a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1f90 0x7f5a381528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3d96a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1f90 0x7f5a381528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38046/0 (socket says 172.21.15.55:38046) 2024-04-25T08:54:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3d96a640 1 -- 172.21.15.55:0/701955645 learned_addr learned my addr 172.21.15.55:0/701955645 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3e16b640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a3815dce0 0x7f5a380b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3d169640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a380d35b0 0x7f5a380b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3d96a640 1 -- 172.21.15.55:0/701955645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a380d35b0 msgr2=0x7f5a380b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3d96a640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a380d35b0 0x7f5a380b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3d96a640 1 -- 172.21.15.55:0/701955645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a3815dce0 msgr2=0x7f5a380b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.691+0000 7f5a3d96a640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a3815dce0 0x7f5a380b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.692+0000 7f5a3d96a640 1 -- 172.21.15.55:0/701955645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3815c780 con 0x7f5a380d1f90 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.692+0000 7f5a3d96a640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1f90 0x7f5a381528f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5a34000c00 tx=0x7f5a340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.692+0000 7f5a2e7fc640 1 -- 172.21.15.55:0/701955645 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34037040 con 0x7f5a380d1f90 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.692+0000 7f5a2e7fc640 1 -- 172.21.15.55:0/701955645 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a34042070 con 0x7f5a380d1f90 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.692+0000 7f5a3fbce640 1 -- 172.21.15.55:0/701955645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3815be50 con 0x7f5a380d1f90 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.692+0000 7f5a2e7fc640 1 -- 172.21.15.55:0/701955645 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34030a50 con 0x7f5a380d1f90 2024-04-25T08:54:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.692+0000 7f5a3fbce640 1 -- 172.21.15.55:0/701955645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3815c410 con 0x7f5a380d1f90 2024-04-25T08:54:12.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.693+0000 7f5a3fbce640 1 -- 172.21.15.55:0/701955645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a380d1030 con 0x7f5a380d1f90 2024-04-25T08:54:12.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.693+0000 7f5a2e7fc640 1 -- 172.21.15.55:0/701955645 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5a34030bf0 con 0x7f5a380d1f90 2024-04-25T08:54:12.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.694+0000 7f5a2e7fc640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a1c06b4d0 0x7f5a1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.694+0000 7f5a2e7fc640 1 -- 172.21.15.55:0/701955645 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a340aadd0 con 0x7f5a380d1f90 2024-04-25T08:54:12.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.694+0000 7f5a3d169640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a1c06b4d0 0x7f5a1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.694+0000 7f5a3d169640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a1c06b4d0 0x7f5a1c06d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5a380b4c80 tx=0x7f5a28008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:12.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.698+0000 7f5a2e7fc640 1 -- 172.21.15.55:0/701955645 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a380d1030 con 0x7f5a380d1f90 2024-04-25T08:54:12.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.879+0000 7f5a3fbce640 1 -- 172.21.15.55:0/701955645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a380749b0 con 0x7f5a380d1f90 2024-04-25T08:54:12.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.880+0000 7f5a2e7fc640 1 -- 172.21.15.55:0/701955645 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f5a34045360 con 0x7f5a380d1f90 2024-04-25T08:54:12.871 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:12.871 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.882+0000 7f5a3fbce640 1 -- 172.21.15.55:0/701955645 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a1c06b4d0 msgr2=0x7f5a1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.882+0000 7f5a3fbce640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a1c06b4d0 0x7f5a1c06d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5a380b4c80 tx=0x7f5a28008040 comp rx=0 tx=0).stop 2024-04-25T08:54:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.882+0000 7f5a3fbce640 1 -- 172.21.15.55:0/701955645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1f90 msgr2=0x7f5a381528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.882+0000 7f5a3fbce640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1f90 0x7f5a381528f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5a34000c00 tx=0x7f5a340046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.882+0000 7f5a3fbce640 1 -- 172.21.15.55:0/701955645 shutdown_connections 2024-04-25T08:54:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.882+0000 7f5a3fbce640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a1c06b4d0 0x7f5a1c06d990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.882+0000 7f5a3fbce640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a3815dce0 0x7f5a380b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.882+0000 7f5a3fbce640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a380d35b0 0x7f5a380b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.882+0000 7f5a3fbce640 1 --2- 172.21.15.55:0/701955645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1f90 0x7f5a381528f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.882+0000 7f5a3fbce640 1 -- 172.21.15.55:0/701955645 >> 172.21.15.55:0/701955645 conn(0x7f5a38072900 msgr2=0x7f5a380d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.883+0000 7f5a3fbce640 1 -- 172.21.15.55:0/701955645 shutdown_connections 2024-04-25T08:54:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.883+0000 7f5a3fbce640 1 -- 172.21.15.55:0/701955645 wait complete. 2024-04-25T08:54:12.883 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:12.884 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:12.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.998+0000 7fdeb2e1b640 1 Processor -- start 2024-04-25T08:54:12.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.998+0000 7fdeb2e1b640 1 -- start start 2024-04-25T08:54:12.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeb2e1b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdeac15dca0 0x7fdeac0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeb2e1b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac0d4090 con 0x7fdeac0d1130 2024-04-25T08:54:12.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeb2e1b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac0d4370 con 0x7fdeac0d3b90 2024-04-25T08:54:12.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeb2e1b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac0b6b20 con 0x7fdeac15dca0 2024-04-25T08:54:12.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeb13b8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdeac0d1130 0x7fdeac0b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38474/0 (socket says 172.21.15.55:38474) 2024-04-25T08:54:12.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeb13b8640 1 -- 172.21.15.55:0/3115760539 learned_addr learned my addr 172.21.15.55:0/3115760539 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:12.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeb0bb7640 1 --2- 172.21.15.55:0/3115760539 >> v2:172.21.15.167:3300/0 conn(0x7fdeac15dca0 0x7fdeac0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeab7fe640 1 -- 172.21.15.55:0/3115760539 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59159073 0 0) 0x7fdeac0d4090 con 0x7fdeac0d1130 2024-04-25T08:54:12.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeab7fe640 1 -- 172.21.15.55:0/3115760539 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde9c003520 con 0x7fdeac0d1130 2024-04-25T08:54:12.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeb0bb7640 1 -- 172.21.15.55:0/3115760539 >> v1:172.21.15.167:6789/0 conn(0x7fdeac0d3b90 legacy=0x7fdeac0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeb0bb7640 1 -- 172.21.15.55:0/3115760539 >> v1:172.21.15.55:6789/0 conn(0x7fdeac0d1130 legacy=0x7fdeac0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:12.999+0000 7fdeb0bb7640 1 -- 172.21.15.55:0/3115760539 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0d4650 con 0x7fdeac15dca0 2024-04-25T08:54:12.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.000+0000 7fdeb0bb7640 1 --2- 172.21.15.55:0/3115760539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac15dca0 0x7fdeac0ce940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdea00097a0 tx=0x7fdea002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70d9f48a272509e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:12.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.000+0000 7fdeab7fe640 1 -- 172.21.15.55:0/3115760539 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0037070 con 0x7fdeac15dca0 2024-04-25T08:54:12.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.000+0000 7fdeab7fe640 1 -- 172.21.15.55:0/3115760539 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea0032440 con 0x7fdeac15dca0 2024-04-25T08:54:12.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.000+0000 7fdeab7fe640 1 -- 172.21.15.55:0/3115760539 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0032810 con 0x7fdeac15dca0 2024-04-25T08:54:12.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.001+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3115760539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac15dca0 msgr2=0x7fdeac0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.001+0000 7fdeb2e1b640 1 --2- 172.21.15.55:0/3115760539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac15dca0 0x7fdeac0ce940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdea00097a0 tx=0x7fdea002a230 comp rx=0 tx=0).stop 2024-04-25T08:54:12.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.001+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3115760539 shutdown_connections 2024-04-25T08:54:12.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.001+0000 7fdeb2e1b640 1 --2- 172.21.15.55:0/3115760539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac15dca0 0x7fdeac0ce940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.001+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3115760539 >> 172.21.15.55:0/3115760539 conn(0x7fdeac0726c0 msgr2=0x7fdeac072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:12.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.001+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3115760539 shutdown_connections 2024-04-25T08:54:12.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.001+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3115760539 wait complete. 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.002+0000 7fdeb2e1b640 1 Processor -- start 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.002+0000 7fdeb2e1b640 1 -- start start 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb2e1b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeac0d1130 0x7fdeac0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb2e1b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac0d3b90 0x7fdeac153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb2e1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeac15dca0 0x7fdeac0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb2e1b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac15e200 con 0x7fdeac15dca0 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb2e1b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac15e080 con 0x7fdeac0d3b90 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb2e1b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0cee80 con 0x7fdeac0d1130 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb13b8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeac15dca0 0x7fdeac0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb13b8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeac15dca0 0x7fdeac0c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38048/0 (socket says 172.21.15.55:38048) 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb13b8640 1 -- 172.21.15.55:0/3622481564 learned_addr learned my addr 172.21.15.55:0/3622481564 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb0bb7640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeac0d1130 0x7fdeac0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeabfff640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac0d3b90 0x7fdeac153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb13b8640 1 -- 172.21.15.55:0/3622481564 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeac0d1130 msgr2=0x7fdeac0cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb13b8640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeac0d1130 0x7fdeac0cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb13b8640 1 -- 172.21.15.55:0/3622481564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac0d3b90 msgr2=0x7fdeac153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb13b8640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac0d3b90 0x7fdeac153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.003+0000 7fdeb13b8640 1 -- 172.21.15.55:0/3622481564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0cc570 con 0x7fdeac15dca0 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.004+0000 7fdeb13b8640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeac15dca0 0x7fdeac0c9f30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdea400cb40 tx=0x7fdea400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.004+0000 7fdea97fa640 1 -- 172.21.15.55:0/3622481564 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea4017070 con 0x7fdeac15dca0 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.004+0000 7fdea97fa640 1 -- 172.21.15.55:0/3622481564 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea400aca0 con 0x7fdeac15dca0 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.004+0000 7fdea97fa640 1 -- 172.21.15.55:0/3622481564 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea4012620 con 0x7fdeac15dca0 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.004+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3622481564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac0cc850 con 0x7fdeac15dca0 2024-04-25T08:54:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.004+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3622481564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac0cce10 con 0x7fdeac15dca0 2024-04-25T08:54:12.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.005+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3622481564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac0750b0 con 0x7fdeac15dca0 2024-04-25T08:54:12.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.005+0000 7fdea97fa640 1 -- 172.21.15.55:0/3622481564 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdea401a070 con 0x7fdeac15dca0 2024-04-25T08:54:12.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.006+0000 7fdea97fa640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde9006b4d0 0x7fde9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.006+0000 7fdea97fa640 1 -- 172.21.15.55:0/3622481564 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdea408a000 con 0x7fdeac15dca0 2024-04-25T08:54:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.006+0000 7fdeb0bb7640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde9006b4d0 0x7fde9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.006+0000 7fdeb0bb7640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde9006b4d0 0x7fde9006d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdea0034000 tx=0x7fdea002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:13.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.010+0000 7fdea97fa640 1 -- 172.21.15.55:0/3622481564 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdea4058f10 con 0x7fdeac15dca0 2024-04-25T08:54:13.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.212+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3622481564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdeac0d1f50 con 0x7fdeac15dca0 2024-04-25T08:54:13.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.213+0000 7fdea97fa640 1 -- 172.21.15.55:0/3622481564 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdea4058810 con 0x7fdeac15dca0 2024-04-25T08:54:13.203 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:13.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3622481564 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde9006b4d0 msgr2=0x7fde9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde9006b4d0 0x7fde9006d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdea0034000 tx=0x7fdea002e000 comp rx=0 tx=0).stop 2024-04-25T08:54:13.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3622481564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeac15dca0 msgr2=0x7fdeac0c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeac15dca0 0x7fdeac0c9f30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdea400cb40 tx=0x7fdea400a060 comp rx=0 tx=0).stop 2024-04-25T08:54:13.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3622481564 shutdown_connections 2024-04-25T08:54:13.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde9006b4d0 0x7fde9006d990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeac15dca0 0x7fdeac0c9f30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac0d3b90 0x7fdeac153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 --2- 172.21.15.55:0/3622481564 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeac0d1130 0x7fdeac0cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3622481564 >> 172.21.15.55:0/3622481564 conn(0x7fdeac0726c0 msgr2=0x7fdeac0b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:13.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3622481564 shutdown_connections 2024-04-25T08:54:13.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.215+0000 7fdeb2e1b640 1 -- 172.21.15.55:0/3622481564 wait complete. 2024-04-25T08:54:13.216 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:54:13.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.330+0000 7f7d1186b640 1 Processor -- start 2024-04-25T08:54:13.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.330+0000 7f7d1186b640 1 -- start start 2024-04-25T08:54:13.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d1186b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7d0c06aba0 0x7f7d0c06b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d1186b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0b1f00 con 0x7f7d0c0cae90 2024-04-25T08:54:13.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d1186b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0cd150 con 0x7f7d0c15deb0 2024-04-25T08:54:13.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d1186b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c0b21d0 con 0x7f7d0c06aba0 2024-04-25T08:54:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d0b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7d0c0cae90 0x7f7d0c0cb2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38482/0 (socket says 172.21.15.55:38482) 2024-04-25T08:54:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d0b7fe640 1 -- 172.21.15.55:0/2461462290 learned_addr learned my addr 172.21.15.55:0/2461462290 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d0a7fc640 1 --2- 172.21.15.55:0/2461462290 >> v2:172.21.15.167:3300/0 conn(0x7f7d0c06aba0 0x7f7d0c06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d09ffb640 1 -- 172.21.15.55:0/2461462290 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713745990 0 0) 0x7f7d0c0b1f00 con 0x7f7d0c0cae90 2024-04-25T08:54:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d09ffb640 1 -- 172.21.15.55:0/2461462290 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cf4003520 con 0x7f7d0c0cae90 2024-04-25T08:54:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d0a7fc640 1 -- 172.21.15.55:0/2461462290 >> v1:172.21.15.167:6789/0 conn(0x7f7d0c15deb0 legacy=0x7f7d0c0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d0a7fc640 1 -- 172.21.15.55:0/2461462290 >> v1:172.21.15.55:6789/0 conn(0x7f7d0c0cae90 legacy=0x7f7d0c0cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.331+0000 7f7d0a7fc640 1 -- 172.21.15.55:0/2461462290 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0cd430 con 0x7f7d0c06aba0 2024-04-25T08:54:13.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.332+0000 7f7d0a7fc640 1 --2- 172.21.15.55:0/2461462290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c06aba0 0x7f7d0c06b030 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7d000097a0 tx=0x7f7d0002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e613866e7f732594 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:13.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.332+0000 7f7d09ffb640 1 -- 172.21.15.55:0/2461462290 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00037070 con 0x7f7d0c06aba0 2024-04-25T08:54:13.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.332+0000 7f7d09ffb640 1 -- 172.21.15.55:0/2461462290 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d00032440 con 0x7f7d0c06aba0 2024-04-25T08:54:13.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.332+0000 7f7d09ffb640 1 -- 172.21.15.55:0/2461462290 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00032810 con 0x7f7d0c06aba0 2024-04-25T08:54:13.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.333+0000 7f7d1186b640 1 -- 172.21.15.55:0/2461462290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c06aba0 msgr2=0x7f7d0c06b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.333+0000 7f7d1186b640 1 --2- 172.21.15.55:0/2461462290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c06aba0 0x7f7d0c06b030 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7d000097a0 tx=0x7f7d0002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.333+0000 7f7d1186b640 1 -- 172.21.15.55:0/2461462290 shutdown_connections 2024-04-25T08:54:13.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.333+0000 7f7d1186b640 1 --2- 172.21.15.55:0/2461462290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c06aba0 0x7f7d0c06b030 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.333+0000 7f7d1186b640 1 -- 172.21.15.55:0/2461462290 >> 172.21.15.55:0/2461462290 conn(0x7f7d0c0b2390 msgr2=0x7f7d0c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:13.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.333+0000 7f7d1186b640 1 -- 172.21.15.55:0/2461462290 shutdown_connections 2024-04-25T08:54:13.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.333+0000 7f7d1186b640 1 -- 172.21.15.55:0/2461462290 wait complete. 2024-04-25T08:54:13.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.334+0000 7f7d1186b640 1 Processor -- start 2024-04-25T08:54:13.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.334+0000 7f7d1186b640 1 -- start start 2024-04-25T08:54:13.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d1186b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d0c06aba0 0x7f7d0c15cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d1186b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d0c0cae90 0x7f7d0c0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d1186b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c15deb0 0x7f7d0c0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d1186b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c15e290 con 0x7f7d0c06aba0 2024-04-25T08:54:13.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d1186b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0cd9f0 con 0x7f7d0c15deb0 2024-04-25T08:54:13.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d1186b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c15e410 con 0x7f7d0c0cae90 2024-04-25T08:54:13.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d0affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d0c06aba0 0x7f7d0c15cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d0affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d0c06aba0 0x7f7d0c15cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38058/0 (socket says 172.21.15.55:38058) 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d0affd640 1 -- 172.21.15.55:0/943944369 learned_addr learned my addr 172.21.15.55:0/943944369 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d0b7fe640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c15deb0 0x7f7d0c0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d0a7fc640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d0c0cae90 0x7f7d0c0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d0affd640 1 -- 172.21.15.55:0/943944369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d0c0cae90 msgr2=0x7f7d0c0c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d0affd640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d0c0cae90 0x7f7d0c0c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d0affd640 1 -- 172.21.15.55:0/943944369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c15deb0 msgr2=0x7f7d0c0c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.335+0000 7f7d0affd640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c15deb0 0x7f7d0c0c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.336+0000 7f7d0affd640 1 -- 172.21.15.55:0/943944369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c15d190 con 0x7f7d0c06aba0 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.336+0000 7f7d0affd640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d0c06aba0 0x7f7d0c15cc50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00c400 tx=0x7f7cfc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.336+0000 7f7cf3fff640 1 -- 172.21.15.55:0/943944369 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc017070 con 0x7f7d0c06aba0 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.336+0000 7f7cf3fff640 1 -- 172.21.15.55:0/943944369 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc0052d0 con 0x7f7d0c06aba0 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.336+0000 7f7d1186b640 1 -- 172.21.15.55:0/943944369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c0c5d50 con 0x7f7d0c06aba0 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.336+0000 7f7cf3fff640 1 -- 172.21.15.55:0/943944369 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc003830 con 0x7f7d0c06aba0 2024-04-25T08:54:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.336+0000 7f7d1186b640 1 -- 172.21.15.55:0/943944369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c0c54b0 con 0x7f7d0c06aba0 2024-04-25T08:54:13.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.337+0000 7f7d1186b640 1 -- 172.21.15.55:0/943944369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c06cc40 con 0x7f7d0c06aba0 2024-04-25T08:54:13.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.337+0000 7f7cf3fff640 1 -- 172.21.15.55:0/943944369 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7cfc01a070 con 0x7f7d0c06aba0 2024-04-25T08:54:13.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.338+0000 7f7cf3fff640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7cf806b4d0 0x7f7cf806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.338+0000 7f7cf3fff640 1 -- 172.21.15.55:0/943944369 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cfc089530 con 0x7f7d0c06aba0 2024-04-25T08:54:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.338+0000 7f7d0a7fc640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7cf806b4d0 0x7f7cf806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.338+0000 7f7d0a7fc640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7cf806b4d0 0x7f7cf806d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7d00034000 tx=0x7f7d0002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:13.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.342+0000 7f7cf3fff640 1 -- 172.21.15.55:0/943944369 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7cfc057ce0 con 0x7f7d0c06aba0 2024-04-25T08:54:13.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.521+0000 7f7d1186b640 1 -- 172.21.15.55:0/943944369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d0c0ce150 con 0x7f7d0c06aba0 2024-04-25T08:54:13.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.522+0000 7f7cf3fff640 1 -- 172.21.15.55:0/943944369 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7cfc05bd80 con 0x7f7d0c06aba0 2024-04-25T08:54:13.512 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.523+0000 7f7d1186b640 1 -- 172.21.15.55:0/943944369 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7cf806b4d0 msgr2=0x7f7cf806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.523+0000 7f7d1186b640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7cf806b4d0 0x7f7cf806d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7d00034000 tx=0x7f7d0002e000 comp rx=0 tx=0).stop 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.523+0000 7f7d1186b640 1 -- 172.21.15.55:0/943944369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d0c06aba0 msgr2=0x7f7d0c15cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.523+0000 7f7d1186b640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d0c06aba0 0x7f7d0c15cc50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00c400 tx=0x7f7cfc00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.524+0000 7f7d1186b640 1 -- 172.21.15.55:0/943944369 shutdown_connections 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.524+0000 7f7d1186b640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7cf806b4d0 0x7f7cf806d990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.524+0000 7f7d1186b640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c15deb0 0x7f7d0c0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.524+0000 7f7d1186b640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d0c0cae90 0x7f7d0c0c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.524+0000 7f7d1186b640 1 --2- 172.21.15.55:0/943944369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d0c06aba0 0x7f7d0c15cc50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.524+0000 7f7d1186b640 1 -- 172.21.15.55:0/943944369 >> 172.21.15.55:0/943944369 conn(0x7f7d0c0b2390 msgr2=0x7f7d0c06afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.524+0000 7f7d1186b640 1 -- 172.21.15.55:0/943944369 shutdown_connections 2024-04-25T08:54:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.524+0000 7f7d1186b640 1 -- 172.21.15.55:0/943944369 wait complete. 2024-04-25T08:54:13.525 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:54:13.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.639+0000 7fcc9630a640 1 Processor -- start 2024-04-25T08:54:13.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.639+0000 7fcc9630a640 1 -- start start 2024-04-25T08:54:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.639+0000 7fcc9630a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc9015aef0 0x7fcc9015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.639+0000 7fcc9630a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc900b46a0 0x7fcc901549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc9630a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9015b370 con 0x7fcc900b42c0 2024-04-25T08:54:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc9630a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc900d05d0 con 0x7fcc9015aef0 2024-04-25T08:54:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc9630a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9015b650 con 0x7fcc900b46a0 2024-04-25T08:54:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc8f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc9015aef0 0x7fcc9015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc8ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcc900b42c0 0x7fcc900cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38494/0 (socket says 172.21.15.55:38494) 2024-04-25T08:54:13.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc8ffff640 1 -- 172.21.15.55:0/362091792 learned_addr learned my addr 172.21.15.55:0/362091792 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:13.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc948a7640 1 --2- 172.21.15.55:0/362091792 >> v2:172.21.15.167:3300/0 conn(0x7fcc900b46a0 0x7fcc901549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc8f7fe640 1 -- 172.21.15.55:0/362091792 >> v2:172.21.15.167:3300/0 conn(0x7fcc900b46a0 msgr2=0x7fcc901549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:13.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc8f7fe640 1 --2- 172.21.15.55:0/362091792 >> v2:172.21.15.167:3300/0 conn(0x7fcc900b46a0 0x7fcc901549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc8f7fe640 1 -- 172.21.15.55:0/362091792 >> v1:172.21.15.55:6789/0 conn(0x7fcc900b42c0 legacy=0x7fcc900cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc8effd640 1 -- 172.21.15.55:0/362091792 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347186298 0 0) 0x7fcc9015b370 con 0x7fcc900b42c0 2024-04-25T08:54:13.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.640+0000 7fcc8f7fe640 1 -- 172.21.15.55:0/362091792 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9015b930 con 0x7fcc9015aef0 2024-04-25T08:54:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc8f7fe640 1 --2- 172.21.15.55:0/362091792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc9015aef0 0x7fcc9015ef40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc900cd110 tx=0x7fcc8402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd19b943536c860 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc8effd640 1 -- 172.21.15.55:0/362091792 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84037070 con 0x7fcc9015aef0 2024-04-25T08:54:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc8effd640 1 -- 172.21.15.55:0/362091792 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8402add0 con 0x7fcc9015aef0 2024-04-25T08:54:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc8effd640 1 -- 172.21.15.55:0/362091792 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84032660 con 0x7fcc9015aef0 2024-04-25T08:54:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc9630a640 1 -- 172.21.15.55:0/362091792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc9015aef0 msgr2=0x7fcc9015ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc9630a640 1 --2- 172.21.15.55:0/362091792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc9015aef0 0x7fcc9015ef40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc900cd110 tx=0x7fcc8402a080 comp rx=0 tx=0).stop 2024-04-25T08:54:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc9630a640 1 -- 172.21.15.55:0/362091792 shutdown_connections 2024-04-25T08:54:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc9630a640 1 --2- 172.21.15.55:0/362091792 >> v2:172.21.15.167:3300/0 conn(0x7fcc900b46a0 0x7fcc901549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc9630a640 1 --2- 172.21.15.55:0/362091792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc9015aef0 0x7fcc9015ef40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc9630a640 1 -- 172.21.15.55:0/362091792 >> 172.21.15.55:0/362091792 conn(0x7fcc9006aba0 msgr2=0x7fcc9006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc9630a640 1 -- 172.21.15.55:0/362091792 shutdown_connections 2024-04-25T08:54:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.641+0000 7fcc9630a640 1 -- 172.21.15.55:0/362091792 wait complete. 2024-04-25T08:54:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.643+0000 7fcc9630a640 1 Processor -- start 2024-04-25T08:54:13.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.643+0000 7fcc9630a640 1 -- start start 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.643+0000 7fcc9630a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc900b42c0 0x7fcc90138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.643+0000 7fcc9630a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc900b46a0 0x7fcc90137e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.643+0000 7fcc9630a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc9015aef0 0x7fcc901f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc9630a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9006ec60 con 0x7fcc900b42c0 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc9630a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9006eae0 con 0x7fcc9015aef0 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc9630a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc90154f10 con 0x7fcc900b46a0 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc900b42c0 0x7fcc90138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc900b42c0 0x7fcc90138680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38080/0 (socket says 172.21.15.55:38080) 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8ffff640 1 -- 172.21.15.55:0/3537176819 learned_addr learned my addr 172.21.15.55:0/3537176819 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8f7fe640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc900b46a0 0x7fcc90137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc948a7640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc9015aef0 0x7fcc901f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8ffff640 1 -- 172.21.15.55:0/3537176819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc900b46a0 msgr2=0x7fcc90137e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8ffff640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc900b46a0 0x7fcc90137e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8ffff640 1 -- 172.21.15.55:0/3537176819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc9015aef0 msgr2=0x7fcc901f3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8ffff640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc9015aef0 0x7fcc901f3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8ffff640 1 -- 172.21.15.55:0/3537176819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9014e060 con 0x7fcc900b42c0 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8f7fe640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc900b46a0 0x7fcc90137e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc948a7640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc9015aef0 0x7fcc901f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8ffff640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc900b42c0 0x7fcc90138680 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcc8000c4d0 tx=0x7fcc8000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8cff9640 1 -- 172.21.15.55:0/3537176819 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80018070 con 0x7fcc900b42c0 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8cff9640 1 -- 172.21.15.55:0/3537176819 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc80007500 con 0x7fcc900b42c0 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc8cff9640 1 -- 172.21.15.55:0/3537176819 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80004a20 con 0x7fcc900b42c0 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc9630a640 1 -- 172.21.15.55:0/3537176819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc90138370 con 0x7fcc900b42c0 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.644+0000 7fcc9630a640 1 -- 172.21.15.55:0/3537176819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc901f4460 con 0x7fcc900b42c0 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.645+0000 7fcc9630a640 1 -- 172.21.15.55:0/3537176819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc900750b0 con 0x7fcc900b42c0 2024-04-25T08:54:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.646+0000 7fcc8cff9640 1 -- 172.21.15.55:0/3537176819 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc8001b070 con 0x7fcc900b42c0 2024-04-25T08:54:13.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.646+0000 7fcc8cff9640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc7c06b4d0 0x7fcc7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.646+0000 7fcc8cff9640 1 -- 172.21.15.55:0/3537176819 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc80089470 con 0x7fcc900b42c0 2024-04-25T08:54:13.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.646+0000 7fcc8f7fe640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc7c06b4d0 0x7fcc7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.647+0000 7fcc8f7fe640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc7c06b4d0 0x7fcc7c06d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcc84034000 tx=0x7fcc8402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:13.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.650+0000 7fcc8cff9640 1 -- 172.21.15.55:0/3537176819 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc80058380 con 0x7fcc900b42c0 2024-04-25T08:54:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.832+0000 7fcc9630a640 1 -- 172.21.15.55:0/3537176819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc9006e700 con 0x7fcc900b42c0 2024-04-25T08:54:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.832+0000 7fcc8cff9640 1 -- 172.21.15.55:0/3537176819 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc8005e080 con 0x7fcc900b42c0 2024-04-25T08:54:13.823 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 -- 172.21.15.55:0/3537176819 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc7c06b4d0 msgr2=0x7fcc7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc7c06b4d0 0x7fcc7c06d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcc84034000 tx=0x7fcc8402e000 comp rx=0 tx=0).stop 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 -- 172.21.15.55:0/3537176819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc900b42c0 msgr2=0x7fcc90138680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc900b42c0 0x7fcc90138680 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcc8000c4d0 tx=0x7fcc8000c990 comp rx=0 tx=0).stop 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 -- 172.21.15.55:0/3537176819 shutdown_connections 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc7c06b4d0 0x7fcc7c06d990 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc9015aef0 0x7fcc901f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc900b46a0 0x7fcc90137e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 --2- 172.21.15.55:0/3537176819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc900b42c0 0x7fcc90138680 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 -- 172.21.15.55:0/3537176819 >> 172.21.15.55:0/3537176819 conn(0x7fcc9006aba0 msgr2=0x7fcc9006af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 -- 172.21.15.55:0/3537176819 shutdown_connections 2024-04-25T08:54:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.834+0000 7fcc9630a640 1 -- 172.21.15.55:0/3537176819 wait complete. 2024-04-25T08:54:13.835 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T08:54:13.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.946+0000 7f1f8869e640 1 Processor -- start 2024-04-25T08:54:13.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.946+0000 7f1f8869e640 1 -- start start 2024-04-25T08:54:13.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.947+0000 7f1f8869e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f8015dce0 0x7f1f800d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.947+0000 7f1f8869e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800b5b60 0x7f1f800b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.947+0000 7f1f8869e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8015e0c0 con 0x7f1f800d35b0 2024-04-25T08:54:13.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.947+0000 7f1f8869e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f800d2510 con 0x7f1f8015dce0 2024-04-25T08:54:13.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.947+0000 7f1f8869e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800d27f0 con 0x7f1f800b5b60 2024-04-25T08:54:13.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.947+0000 7f1f86c3b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800b5b60 0x7f1f800b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.947+0000 7f1f8643a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f8015dce0 0x7f1f800d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.947+0000 7f1f85c39640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1f800d35b0 0x7f1f800b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:32784/0 (socket says 172.21.15.55:32784) 2024-04-25T08:54:13.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.947+0000 7f1f85c39640 1 -- 172.21.15.55:0/3040443745 learned_addr learned my addr 172.21.15.55:0/3040443745 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:13.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.947+0000 7f1f8643a640 1 -- 172.21.15.55:0/3040443745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800b5b60 msgr2=0x7f1f800b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:13.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.947+0000 7f1f8643a640 1 --2- 172.21.15.55:0/3040443745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800b5b60 0x7f1f800b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.948+0000 7f1f8643a640 1 -- 172.21.15.55:0/3040443745 >> v1:172.21.15.167:6789/0 conn(0x7f1f800d35b0 legacy=0x7f1f800b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.948+0000 7f1f8643a640 1 -- 172.21.15.55:0/3040443745 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800d2ad0 con 0x7f1f8015dce0 2024-04-25T08:54:13.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.948+0000 7f1f85438640 1 -- 172.21.15.55:0/3040443745 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775454100 0 0) 0x7f1f8015e0c0 con 0x7f1f800d35b0 2024-04-25T08:54:13.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.948+0000 7f1f8643a640 1 --2- 172.21.15.55:0/3040443745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8015dce0 0x7f1f800d1a50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0097a0 tx=0x7f1f7c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99cd1af36a16ce31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:13.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.949+0000 7f1f85438640 1 -- 172.21.15.55:0/3040443745 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c037070 con 0x7f1f8015dce0 2024-04-25T08:54:13.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.949+0000 7f1f85438640 1 -- 172.21.15.55:0/3040443745 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c032440 con 0x7f1f8015dce0 2024-04-25T08:54:13.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.949+0000 7f1f85438640 1 -- 172.21.15.55:0/3040443745 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c032810 con 0x7f1f8015dce0 2024-04-25T08:54:13.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.949+0000 7f1f8869e640 1 -- 172.21.15.55:0/3040443745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8015dce0 msgr2=0x7f1f800d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.949+0000 7f1f8869e640 1 --2- 172.21.15.55:0/3040443745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8015dce0 0x7f1f800d1a50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0097a0 tx=0x7f1f7c02a180 comp rx=0 tx=0).stop 2024-04-25T08:54:13.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.949+0000 7f1f8869e640 1 -- 172.21.15.55:0/3040443745 shutdown_connections 2024-04-25T08:54:13.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.949+0000 7f1f8869e640 1 --2- 172.21.15.55:0/3040443745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800b5b60 0x7f1f800b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.949+0000 7f1f8869e640 1 --2- 172.21.15.55:0/3040443745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8015dce0 0x7f1f800d1a50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.949+0000 7f1f8869e640 1 -- 172.21.15.55:0/3040443745 >> 172.21.15.55:0/3040443745 conn(0x7f1f80072900 msgr2=0x7f1f800d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:13.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.949+0000 7f1f8869e640 1 -- 172.21.15.55:0/3040443745 shutdown_connections 2024-04-25T08:54:13.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.949+0000 7f1f8869e640 1 -- 172.21.15.55:0/3040443745 wait complete. 2024-04-25T08:54:13.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.950+0000 7f1f8869e640 1 Processor -- start 2024-04-25T08:54:13.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.950+0000 7f1f8869e640 1 -- start start 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.951+0000 7f1f8869e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f800b5b60 0x7f1f8014f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.951+0000 7f1f8869e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f800d35b0 0x7f1f800abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.951+0000 7f1f8869e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f8015dce0 0x7f1f800aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.951+0000 7f1f8869e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800b9820 con 0x7f1f800d35b0 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.951+0000 7f1f8869e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800d3090 con 0x7f1f800b5b60 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.951+0000 7f1f8869e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800b99a0 con 0x7f1f8015dce0 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.951+0000 7f1f85c39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f800d35b0 0x7f1f800abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.951+0000 7f1f85c39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f800d35b0 0x7f1f800abd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38094/0 (socket says 172.21.15.55:38094) 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.951+0000 7f1f85c39640 1 -- 172.21.15.55:0/622303136 learned_addr learned my addr 172.21.15.55:0/622303136 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.951+0000 7f1f8643a640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f800b5b60 0x7f1f8014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.951+0000 7f1f86c3b640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f8015dce0 0x7f1f800aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.952+0000 7f1f85c39640 1 -- 172.21.15.55:0/622303136 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f8015dce0 msgr2=0x7f1f800aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.952+0000 7f1f85c39640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f8015dce0 0x7f1f800aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.952+0000 7f1f85c39640 1 -- 172.21.15.55:0/622303136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f800b5b60 msgr2=0x7f1f8014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.952+0000 7f1f85c39640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f800b5b60 0x7f1f8014f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.952+0000 7f1f85c39640 1 -- 172.21.15.55:0/622303136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8015e4e0 con 0x7f1f800d35b0 2024-04-25T08:54:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.952+0000 7f1f85c39640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f800d35b0 0x7f1f800abd10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c4b0 tx=0x7f1f7000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.952+0000 7f1f76ffd640 1 -- 172.21.15.55:0/622303136 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70018070 con 0x7f1f800d35b0 2024-04-25T08:54:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.952+0000 7f1f76ffd640 1 -- 172.21.15.55:0/622303136 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f70007500 con 0x7f1f800d35b0 2024-04-25T08:54:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.952+0000 7f1f76ffd640 1 -- 172.21.15.55:0/622303136 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70004a20 con 0x7f1f800d35b0 2024-04-25T08:54:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.952+0000 7f1f8869e640 1 -- 172.21.15.55:0/622303136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8015e7c0 con 0x7f1f800d35b0 2024-04-25T08:54:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.952+0000 7f1f8869e640 1 -- 172.21.15.55:0/622303136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8015ed80 con 0x7f1f800d35b0 2024-04-25T08:54:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.953+0000 7f1f8869e640 1 -- 172.21.15.55:0/622303136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f800749b0 con 0x7f1f800d35b0 2024-04-25T08:54:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.954+0000 7f1f76ffd640 1 -- 172.21.15.55:0/622303136 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1f7001b070 con 0x7f1f800d35b0 2024-04-25T08:54:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.954+0000 7f1f76ffd640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1f6406b4d0 0x7f1f6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.954+0000 7f1f76ffd640 1 -- 172.21.15.55:0/622303136 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f70089480 con 0x7f1f800d35b0 2024-04-25T08:54:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.954+0000 7f1f8643a640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1f6406b4d0 0x7f1f6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.954+0000 7f1f8643a640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1f6406b4d0 0x7f1f6406d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c034000 tx=0x7f1f7c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:13.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:13.958+0000 7f1f76ffd640 1 -- 172.21.15.55:0/622303136 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1f70057d70 con 0x7f1f800d35b0 2024-04-25T08:54:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.214+0000 7f1f8869e640 1 -- 172.21.15.55:0/622303136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f1f800b8210 con 0x7f1f800d35b0 2024-04-25T08:54:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.669+0000 7f1f76ffd640 1 -- 172.21.15.55:0/622303136 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v53) v1 ==== 145+0+0 (secure 0 0 0) 0x7f1f7005be10 con 0x7f1f800d35b0 2024-04-25T08:54:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 -- 172.21.15.55:0/622303136 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1f6406b4d0 msgr2=0x7f1f6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1f6406b4d0 0x7f1f6406d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c034000 tx=0x7f1f7c02e000 comp rx=0 tx=0).stop 2024-04-25T08:54:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 -- 172.21.15.55:0/622303136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f800d35b0 msgr2=0x7f1f800abd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f800d35b0 0x7f1f800abd10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c4b0 tx=0x7f1f7000c970 comp rx=0 tx=0).stop 2024-04-25T08:54:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 -- 172.21.15.55:0/622303136 shutdown_connections 2024-04-25T08:54:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1f6406b4d0 0x7f1f6406d990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f8015dce0 0x7f1f800aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f800d35b0 0x7f1f800abd10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 --2- 172.21.15.55:0/622303136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f800b5b60 0x7f1f8014f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 -- 172.21.15.55:0/622303136 >> 172.21.15.55:0/622303136 conn(0x7f1f80072900 msgr2=0x7f1f800ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 -- 172.21.15.55:0/622303136 shutdown_connections 2024-04-25T08:54:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.672+0000 7f1f8869e640 1 -- 172.21.15.55:0/622303136 wait complete. 2024-04-25T08:54:14.675 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:54:14.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.794+0000 7f4027b16640 1 Processor -- start 2024-04-25T08:54:14.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.794+0000 7f4027b16640 1 -- start start 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f4027b16640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f402015dc80 0x7f4020161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f4027b16640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f40200b5c00 0x7f40200d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f4027b16640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40201627a0 con 0x7f40200b97c0 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f4027b16640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40201621e0 con 0x7f402015dc80 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f4027b16640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40201624c0 con 0x7f40200b5c00 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f40258b2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f402015dc80 0x7f4020161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f40250b1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f40200b97c0 0x7f40200b54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38498/0 (socket says 172.21.15.55:38498) 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f40250b1640 1 -- 172.21.15.55:0/3525293555 learned_addr learned my addr 172.21.15.55:0/3525293555 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f40260b3640 1 --2- 172.21.15.55:0/3525293555 >> v2:172.21.15.167:3300/0 conn(0x7f40200b5c00 0x7f40200d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f40258b2640 1 -- 172.21.15.55:0/3525293555 >> v2:172.21.15.167:3300/0 conn(0x7f40200b5c00 msgr2=0x7f40200d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f40258b2640 1 --2- 172.21.15.55:0/3525293555 >> v2:172.21.15.167:3300/0 conn(0x7f40200b5c00 0x7f40200d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f40258b2640 1 -- 172.21.15.55:0/3525293555 >> v1:172.21.15.55:6789/0 conn(0x7f40200b97c0 legacy=0x7f40200b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f40258b2640 1 -- 172.21.15.55:0/3525293555 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40200d1c70 con 0x7f402015dc80 2024-04-25T08:54:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f40248b0640 1 -- 172.21.15.55:0/3525293555 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450194190 0 0) 0x7f40201627a0 con 0x7f40200b97c0 2024-04-25T08:54:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.795+0000 7f40260b3640 1 --2- 172.21.15.55:0/3525293555 >> v2:172.21.15.167:3300/0 conn(0x7f40200b5c00 0x7f40200d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.796+0000 7f40258b2640 1 --2- 172.21.15.55:0/3525293555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402015dc80 0x7f4020161870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f40200b6300 tx=0x7f401c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484ec2fb348c1e52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.796+0000 7f40248b0640 1 -- 172.21.15.55:0/3525293555 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c037070 con 0x7f402015dc80 2024-04-25T08:54:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.796+0000 7f40248b0640 1 -- 172.21.15.55:0/3525293555 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c032440 con 0x7f402015dc80 2024-04-25T08:54:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.796+0000 7f40248b0640 1 -- 172.21.15.55:0/3525293555 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c032810 con 0x7f402015dc80 2024-04-25T08:54:14.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.796+0000 7f4027b16640 1 -- 172.21.15.55:0/3525293555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402015dc80 msgr2=0x7f4020161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.796+0000 7f4027b16640 1 --2- 172.21.15.55:0/3525293555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402015dc80 0x7f4020161870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f40200b6300 tx=0x7f401c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.797+0000 7f4027b16640 1 -- 172.21.15.55:0/3525293555 shutdown_connections 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.797+0000 7f4027b16640 1 --2- 172.21.15.55:0/3525293555 >> v2:172.21.15.167:3300/0 conn(0x7f40200b5c00 0x7f40200d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.797+0000 7f4027b16640 1 --2- 172.21.15.55:0/3525293555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402015dc80 0x7f4020161870 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.797+0000 7f4027b16640 1 -- 172.21.15.55:0/3525293555 >> 172.21.15.55:0/3525293555 conn(0x7f40200d04f0 msgr2=0x7f40200d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.797+0000 7f4027b16640 1 -- 172.21.15.55:0/3525293555 shutdown_connections 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.797+0000 7f4027b16640 1 -- 172.21.15.55:0/3525293555 wait complete. 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.798+0000 7f4027b16640 1 Processor -- start 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.798+0000 7f4027b16640 1 -- start start 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.798+0000 7f4027b16640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40200b5c00 0x7f40201f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f4027b16640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40200b97c0 0x7f40200cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f4027b16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f402015dc80 0x7f402015ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f4027b16640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4020161f30 con 0x7f40200b5c00 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f4027b16640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4020161db0 con 0x7f402015dc80 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f4027b16640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40200d29b0 con 0x7f40200b97c0 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40258b2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40200b5c00 0x7f40201f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40258b2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40200b5c00 0x7f40201f34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38118/0 (socket says 172.21.15.55:38118) 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40258b2640 1 -- 172.21.15.55:0/2461425458 learned_addr learned my addr 172.21.15.55:0/2461425458 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40260b3640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f402015dc80 0x7f402015ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40250b1640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40200b97c0 0x7f40200cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40258b2640 1 -- 172.21.15.55:0/2461425458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40200b97c0 msgr2=0x7f40200cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40258b2640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40200b97c0 0x7f40200cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40258b2640 1 -- 172.21.15.55:0/2461425458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f402015dc80 msgr2=0x7f402015ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40258b2640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f402015dc80 0x7f402015ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40258b2640 1 -- 172.21.15.55:0/2461425458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40200ccab0 con 0x7f40200b5c00 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40260b3640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f402015dc80 0x7f402015ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40250b1640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40200b97c0 0x7f40200cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40258b2640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40200b5c00 0x7f40201f34a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f401c009890 tx=0x7f401c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40167fc640 1 -- 172.21.15.55:0/2461425458 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c037040 con 0x7f40200b5c00 2024-04-25T08:54:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40167fc640 1 -- 172.21.15.55:0/2461425458 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c042070 con 0x7f40200b5c00 2024-04-25T08:54:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f40167fc640 1 -- 172.21.15.55:0/2461425458 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c030a50 con 0x7f40200b5c00 2024-04-25T08:54:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f4027b16640 1 -- 172.21.15.55:0/2461425458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40200cbf30 con 0x7f40200b5c00 2024-04-25T08:54:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.799+0000 7f4027b16640 1 -- 172.21.15.55:0/2461425458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40200cc4f0 con 0x7f40200b5c00 2024-04-25T08:54:14.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.800+0000 7f4027b16640 1 -- 172.21.15.55:0/2461425458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40200750b0 con 0x7f40200b5c00 2024-04-25T08:54:14.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.801+0000 7f40167fc640 1 -- 172.21.15.55:0/2461425458 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f401c030bf0 con 0x7f40200b5c00 2024-04-25T08:54:14.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.801+0000 7f40167fc640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f400406b4d0 0x7f400406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:14.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.801+0000 7f40167fc640 1 -- 172.21.15.55:0/2461425458 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f401c0aace0 con 0x7f40200b5c00 2024-04-25T08:54:14.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.801+0000 7f40250b1640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f400406b4d0 0x7f400406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:14.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.802+0000 7f40250b1640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f400406b4d0 0x7f400406d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f40200b7fc0 tx=0x7f4010009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:14.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.806+0000 7f40167fc640 1 -- 172.21.15.55:0/2461425458 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f401c045360 con 0x7f40200b5c00 2024-04-25T08:54:14.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.984+0000 7f4027b16640 1 -- 172.21.15.55:0/2461425458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f40200d1780 con 0x7f40200b5c00 2024-04-25T08:54:14.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.988+0000 7f40167fc640 1 -- 172.21.15.55:0/2461425458 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f401c079b50 con 0x7f40200b5c00 2024-04-25T08:54:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 -- 172.21.15.55:0/2461425458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f400406b4d0 msgr2=0x7f400406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f400406b4d0 0x7f400406d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f40200b7fc0 tx=0x7f4010009040 comp rx=0 tx=0).stop 2024-04-25T08:54:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 -- 172.21.15.55:0/2461425458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40200b5c00 msgr2=0x7f40201f34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40200b5c00 0x7f40201f34a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f401c009890 tx=0x7f401c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 -- 172.21.15.55:0/2461425458 shutdown_connections 2024-04-25T08:54:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f400406b4d0 0x7f400406d990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f402015dc80 0x7f402015ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40200b97c0 0x7f40200cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 --2- 172.21.15.55:0/2461425458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40200b5c00 0x7f40201f34a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:14.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 -- 172.21.15.55:0/2461425458 >> 172.21.15.55:0/2461425458 conn(0x7f40200d04f0 msgr2=0x7f40200b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:14.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 -- 172.21.15.55:0/2461425458 shutdown_connections 2024-04-25T08:54:14.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:14.991+0000 7f4027b16640 1 -- 172.21.15.55:0/2461425458 wait complete. 2024-04-25T08:54:14.992 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:54:14.992 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:54:15.036 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:54:15.076 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:54:15.076 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:54:15.076 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:15.092 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:54:15.093 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:15.148 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:54:15.149 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:15.205 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.357+0000 7fd3519f4640 1 Processor -- start 2024-04-25T08:54:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.357+0000 7fd3519f4640 1 -- start start 2024-04-25T08:54:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.357+0000 7fd3519f4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd34c15dce0 0x7fd34c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.357+0000 7fd3519f4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd34c0b5b60 0x7fd34c0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.357+0000 7fd3519f4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34c15e0c0 con 0x7fd34c0d35b0 2024-04-25T08:54:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.357+0000 7fd3519f4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c0d2510 con 0x7fd34c15dce0 2024-04-25T08:54:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.357+0000 7fd3519f4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0d27f0 con 0x7fd34c0b5b60 2024-04-25T08:54:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.358+0000 7fd34affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd34c15dce0 0x7fd34c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.358+0000 7fd34a7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd34c0d35b0 0x7fd34c0b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38504/0 (socket says 172.21.15.55:38504) 2024-04-25T08:54:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.358+0000 7fd34a7fc640 1 -- 172.21.15.55:0/2762171606 learned_addr learned my addr 172.21.15.55:0/2762171606 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.358+0000 7fd34b7fe640 1 --2- 172.21.15.55:0/2762171606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd34c0b5b60 0x7fd34c0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.358+0000 7fd34affd640 1 -- 172.21.15.55:0/2762171606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd34c0b5b60 msgr2=0x7fd34c0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.358+0000 7fd34affd640 1 --2- 172.21.15.55:0/2762171606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd34c0b5b60 0x7fd34c0b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.358+0000 7fd34affd640 1 -- 172.21.15.55:0/2762171606 >> v1:172.21.15.55:6789/0 conn(0x7fd34c0d35b0 legacy=0x7fd34c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.358+0000 7fd34affd640 1 -- 172.21.15.55:0/2762171606 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c0d2ad0 con 0x7fd34c15dce0 2024-04-25T08:54:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.358+0000 7fd349ffb640 1 -- 172.21.15.55:0/2762171606 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882458178 0 0) 0x7fd34c15e0c0 con 0x7fd34c0d35b0 2024-04-25T08:54:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.359+0000 7fd34affd640 1 --2- 172.21.15.55:0/2762171606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd34c15dce0 0x7fd34c0d1a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0097a0 tx=0x7fd33c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f62f07873a8f73e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.359+0000 7fd349ffb640 1 -- 172.21.15.55:0/2762171606 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c037070 con 0x7fd34c15dce0 2024-04-25T08:54:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.359+0000 7fd349ffb640 1 -- 172.21.15.55:0/2762171606 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c032440 con 0x7fd34c15dce0 2024-04-25T08:54:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.359+0000 7fd349ffb640 1 -- 172.21.15.55:0/2762171606 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c032810 con 0x7fd34c15dce0 2024-04-25T08:54:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.359+0000 7fd3519f4640 1 -- 172.21.15.55:0/2762171606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd34c15dce0 msgr2=0x7fd34c0d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.359+0000 7fd3519f4640 1 --2- 172.21.15.55:0/2762171606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd34c15dce0 0x7fd34c0d1a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0097a0 tx=0x7fd33c02a180 comp rx=0 tx=0).stop 2024-04-25T08:54:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.359+0000 7fd3519f4640 1 -- 172.21.15.55:0/2762171606 shutdown_connections 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.359+0000 7fd3519f4640 1 --2- 172.21.15.55:0/2762171606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd34c0b5b60 0x7fd34c0b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.359+0000 7fd3519f4640 1 --2- 172.21.15.55:0/2762171606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd34c15dce0 0x7fd34c0d1a50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.359+0000 7fd3519f4640 1 -- 172.21.15.55:0/2762171606 >> 172.21.15.55:0/2762171606 conn(0x7fd34c072900 msgr2=0x7fd34c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.359+0000 7fd3519f4640 1 -- 172.21.15.55:0/2762171606 shutdown_connections 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.360+0000 7fd3519f4640 1 -- 172.21.15.55:0/2762171606 wait complete. 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.361+0000 7fd3519f4640 1 Processor -- start 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.361+0000 7fd3519f4640 1 -- start start 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.361+0000 7fd3519f4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd34c0b5b60 0x7fd34c0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.361+0000 7fd3519f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd34c0d35b0 0x7fd34c1f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.361+0000 7fd3519f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd34c15dce0 0x7fd34c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.361+0000 7fd3519f4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0b9820 con 0x7fd34c0d35b0 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd3519f4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0d3090 con 0x7fd34c15dce0 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd3519f4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0b99a0 con 0x7fd34c0b5b60 2024-04-25T08:54:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd34a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd34c0d35b0 0x7fd34c1f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd34a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd34c0d35b0 0x7fd34c1f74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38132/0 (socket says 172.21.15.55:38132) 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd34a7fc640 1 -- 172.21.15.55:0/91883124 learned_addr learned my addr 172.21.15.55:0/91883124 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd34a7fc640 1 -- 172.21.15.55:0/91883124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd34c0b5b60 msgr2=0x7fd34c0c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd34a7fc640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd34c0b5b60 0x7fd34c0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd34a7fc640 1 -- 172.21.15.55:0/91883124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd34c15dce0 msgr2=0x7fd34c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd34a7fc640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd34c15dce0 0x7fd34c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd34a7fc640 1 -- 172.21.15.55:0/91883124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c148ea0 con 0x7fd34c0d35b0 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd34a7fc640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd34c0d35b0 0x7fd34c1f74a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c490 tx=0x7fd34000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd333fff640 1 -- 172.21.15.55:0/91883124 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400074e0 con 0x7fd34c0d35b0 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd333fff640 1 -- 172.21.15.55:0/91883124 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3400047e0 con 0x7fd34c0d35b0 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd3519f4640 1 -- 172.21.15.55:0/91883124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c149140 con 0x7fd34c0d35b0 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd333fff640 1 -- 172.21.15.55:0/91883124 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340004bd0 con 0x7fd34c0d35b0 2024-04-25T08:54:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.362+0000 7fd3519f4640 1 -- 172.21.15.55:0/91883124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c1499e0 con 0x7fd34c0d35b0 2024-04-25T08:54:15.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.363+0000 7fd3519f4640 1 -- 172.21.15.55:0/91883124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c149530 con 0x7fd34c0d35b0 2024-04-25T08:54:15.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.364+0000 7fd333fff640 1 -- 172.21.15.55:0/91883124 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd340011070 con 0x7fd34c0d35b0 2024-04-25T08:54:15.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.364+0000 7fd333fff640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 0x7fd33806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.364+0000 7fd333fff640 1 -- 172.21.15.55:0/91883124 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd340089d50 con 0x7fd34c0d35b0 2024-04-25T08:54:15.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.364+0000 7fd34affd640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 0x7fd33806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.365+0000 7fd34affd640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 0x7fd33806d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd33c034000 tx=0x7fd33c02c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:15.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.369+0000 7fd333fff640 1 -- 172.21.15.55:0/91883124 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd34008d030 con 0x7fd34c0d35b0 2024-04-25T08:54:15.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.549+0000 7fd3519f4640 1 -- 172.21.15.55:0/91883124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd34c0749b0 con 0x7fd34c0d35b0 2024-04-25T08:54:15.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.550+0000 7fd333fff640 1 -- 172.21.15.55:0/91883124 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fd340058c60 con 0x7fd34c0d35b0 2024-04-25T08:54:15.541 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:15.541 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.552+0000 7fd3519f4640 1 -- 172.21.15.55:0/91883124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 msgr2=0x7fd33806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.552+0000 7fd3519f4640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 0x7fd33806d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd33c034000 tx=0x7fd33c02c000 comp rx=0 tx=0).stop 2024-04-25T08:54:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.552+0000 7fd3519f4640 1 -- 172.21.15.55:0/91883124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd34c0d35b0 msgr2=0x7fd34c1f74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.552+0000 7fd3519f4640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd34c0d35b0 0x7fd34c1f74a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c490 tx=0x7fd34000c950 comp rx=0 tx=0).stop 2024-04-25T08:54:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.552+0000 7fd3519f4640 1 -- 172.21.15.55:0/91883124 shutdown_connections 2024-04-25T08:54:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.552+0000 7fd3519f4640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 0x7fd33806d990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.552+0000 7fd3519f4640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd34c15dce0 0x7fd34c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.552+0000 7fd3519f4640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd34c0d35b0 0x7fd34c1f74a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.552+0000 7fd3519f4640 1 --2- 172.21.15.55:0/91883124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd34c0b5b60 0x7fd34c0c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.552+0000 7fd3519f4640 1 -- 172.21.15.55:0/91883124 >> 172.21.15.55:0/91883124 conn(0x7fd34c072900 msgr2=0x7fd34c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:15.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.553+0000 7fd3519f4640 1 -- 172.21.15.55:0/91883124 shutdown_connections 2024-04-25T08:54:15.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.553+0000 7fd3519f4640 1 -- 172.21.15.55:0/91883124 wait complete. 2024-04-25T08:54:15.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:15.554 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:15.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.669+0000 7feabcc1f640 1 Processor -- start 2024-04-25T08:54:15.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.669+0000 7feabcc1f640 1 -- start start 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.670+0000 7feabcc1f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feab80d1130 0x7feab80b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.670+0000 7feabcc1f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80d4090 con 0x7feab80d3b90 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.670+0000 7feabcc1f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80d4370 con 0x7feab815dca0 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.670+0000 7feabcc1f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab80b6b20 con 0x7feab80d1130 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.670+0000 7feab5d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feab80d3b90 0x7feab80d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38506/0 (socket says 172.21.15.55:38506) 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.670+0000 7feab5d9b640 1 -- 172.21.15.55:0/3958389195 learned_addr learned my addr 172.21.15.55:0/3958389195 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.670+0000 7feab6d9d640 1 --2- 172.21.15.55:0/3958389195 >> v2:172.21.15.167:3300/0 conn(0x7feab80d1130 0x7feab80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.671+0000 7feab559a640 1 -- 172.21.15.55:0/3958389195 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806795802 0 0) 0x7feab80d4090 con 0x7feab80d3b90 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.671+0000 7feab559a640 1 -- 172.21.15.55:0/3958389195 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa0003520 con 0x7feab80d3b90 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.671+0000 7feab6d9d640 1 -- 172.21.15.55:0/3958389195 >> v1:172.21.15.167:6789/0 conn(0x7feab815dca0 legacy=0x7feab80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.671+0000 7feab6d9d640 1 -- 172.21.15.55:0/3958389195 >> v1:172.21.15.55:6789/0 conn(0x7feab80d3b90 legacy=0x7feab80d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.671+0000 7feab6d9d640 1 -- 172.21.15.55:0/3958389195 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab80d4650 con 0x7feab80d1130 2024-04-25T08:54:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.672+0000 7feab6d9d640 1 --2- 172.21.15.55:0/3958389195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feab80d1130 0x7feab80b2500 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009d90 tx=0x7feaa802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edda0d60d5e44727 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.674+0000 7feab559a640 1 -- 172.21.15.55:0/3958389195 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8007740 con 0x7feab80d1130 2024-04-25T08:54:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.674+0000 7feab559a640 1 -- 172.21.15.55:0/3958389195 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa80078e0 con 0x7feab80d1130 2024-04-25T08:54:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.674+0000 7feab559a640 1 -- 172.21.15.55:0/3958389195 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8007cb0 con 0x7feab80d1130 2024-04-25T08:54:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.675+0000 7feabcc1f640 1 -- 172.21.15.55:0/3958389195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feab80d1130 msgr2=0x7feab80b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.675+0000 7feabcc1f640 1 --2- 172.21.15.55:0/3958389195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feab80d1130 0x7feab80b2500 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009d90 tx=0x7feaa802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.675+0000 7feabcc1f640 1 -- 172.21.15.55:0/3958389195 shutdown_connections 2024-04-25T08:54:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.675+0000 7feabcc1f640 1 --2- 172.21.15.55:0/3958389195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feab80d1130 0x7feab80b2500 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.675+0000 7feabcc1f640 1 -- 172.21.15.55:0/3958389195 >> 172.21.15.55:0/3958389195 conn(0x7feab80726c0 msgr2=0x7feab8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.675+0000 7feabcc1f640 1 -- 172.21.15.55:0/3958389195 shutdown_connections 2024-04-25T08:54:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.675+0000 7feabcc1f640 1 -- 172.21.15.55:0/3958389195 wait complete. 2024-04-25T08:54:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.676+0000 7feabcc1f640 1 Processor -- start 2024-04-25T08:54:15.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.677+0000 7feabcc1f640 1 -- start start 2024-04-25T08:54:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.677+0000 7feabcc1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feab80d1130 0x7feab8152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.677+0000 7feabcc1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feab80d3b90 0x7feab81605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.677+0000 7feabcc1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feab815dca0 0x7feab8160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.677+0000 7feabcc1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab815e080 con 0x7feab815dca0 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.677+0000 7feabcc1f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab80cf050 con 0x7feab80d3b90 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.677+0000 7feabcc1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab815e200 con 0x7feab80d1130 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.677+0000 7feab6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feab815dca0 0x7feab8160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.677+0000 7feab6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feab815dca0 0x7feab8160af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38136/0 (socket says 172.21.15.55:38136) 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.677+0000 7feab6d9d640 1 -- 172.21.15.55:0/4234039012 learned_addr learned my addr 172.21.15.55:0/4234039012 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feab5d9b640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feab80d3b90 0x7feab81605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feab659c640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feab80d1130 0x7feab8152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feab6d9d640 1 -- 172.21.15.55:0/4234039012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feab80d1130 msgr2=0x7feab8152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feab6d9d640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feab80d1130 0x7feab8152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feab6d9d640 1 -- 172.21.15.55:0/4234039012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feab80d3b90 msgr2=0x7feab81605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feab6d9d640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feab80d3b90 0x7feab81605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feab6d9d640 1 -- 172.21.15.55:0/4234039012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab81f36e0 con 0x7feab815dca0 2024-04-25T08:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feab6d9d640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feab815dca0 0x7feab8160af0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feaa802ace0 tx=0x7feaa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feaa6ffd640 1 -- 172.21.15.55:0/4234039012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8040070 con 0x7feab815dca0 2024-04-25T08:54:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feaa6ffd640 1 -- 172.21.15.55:0/4234039012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa8031bc0 con 0x7feab815dca0 2024-04-25T08:54:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feabcc1f640 1 -- 172.21.15.55:0/4234039012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab80cc2a0 con 0x7feab815dca0 2024-04-25T08:54:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feaa6ffd640 1 -- 172.21.15.55:0/4234039012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8009450 con 0x7feab815dca0 2024-04-25T08:54:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.678+0000 7feabcc1f640 1 -- 172.21.15.55:0/4234039012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab80cba50 con 0x7feab815dca0 2024-04-25T08:54:15.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.679+0000 7feabcc1f640 1 -- 172.21.15.55:0/4234039012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab80750b0 con 0x7feab815dca0 2024-04-25T08:54:15.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.680+0000 7feaa6ffd640 1 -- 172.21.15.55:0/4234039012 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feaa8039040 con 0x7feab815dca0 2024-04-25T08:54:15.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.680+0000 7feaa6ffd640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea9806b4d0 0x7fea9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.680+0000 7feaa6ffd640 1 -- 172.21.15.55:0/4234039012 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feaa80ab970 con 0x7feab815dca0 2024-04-25T08:54:15.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.680+0000 7feab659c640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea9806b4d0 0x7fea9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.681+0000 7feab659c640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea9806b4d0 0x7fea9806d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feab0007fd0 tx=0x7feab0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.684+0000 7feaa6ffd640 1 -- 172.21.15.55:0/4234039012 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feaa8043360 con 0x7feab815dca0 2024-04-25T08:54:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.868+0000 7feabcc1f640 1 -- 172.21.15.55:0/4234039012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feab80b4f50 con 0x7feab815dca0 2024-04-25T08:54:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.869+0000 7feaa6ffd640 1 -- 172.21.15.55:0/4234039012 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7feaa807a880 con 0x7feab815dca0 2024-04-25T08:54:15.859 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 -- 172.21.15.55:0/4234039012 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea9806b4d0 msgr2=0x7fea9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea9806b4d0 0x7fea9806d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feab0007fd0 tx=0x7feab0009040 comp rx=0 tx=0).stop 2024-04-25T08:54:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 -- 172.21.15.55:0/4234039012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feab815dca0 msgr2=0x7feab8160af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feab815dca0 0x7feab8160af0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feaa802ace0 tx=0x7feaa8004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 -- 172.21.15.55:0/4234039012 shutdown_connections 2024-04-25T08:54:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea9806b4d0 0x7fea9806d990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feab815dca0 0x7feab8160af0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feab80d3b90 0x7feab81605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 --2- 172.21.15.55:0/4234039012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feab80d1130 0x7feab8152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 -- 172.21.15.55:0/4234039012 >> 172.21.15.55:0/4234039012 conn(0x7feab80726c0 msgr2=0x7feab80b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 -- 172.21.15.55:0/4234039012 shutdown_connections 2024-04-25T08:54:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.871+0000 7feabcc1f640 1 -- 172.21.15.55:0/4234039012 wait complete. 2024-04-25T08:54:15.872 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:54:15.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.986+0000 7f9f2acb3640 1 Processor -- start 2024-04-25T08:54:15.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.987+0000 7f9f2acb3640 1 -- start start 2024-04-25T08:54:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.987+0000 7f9f2acb3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f2415b7b0 0x7f9f240ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.987+0000 7f9f2acb3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9f2415e820 0x7f9f240cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.987+0000 7f9f2acb3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2415f000 con 0x7f9f240cf760 2024-04-25T08:54:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.987+0000 7f9f2acb3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f240ced00 con 0x7f9f2415b7b0 2024-04-25T08:54:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.987+0000 7f9f2acb3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f240ce330 con 0x7f9f2415e820 2024-04-25T08:54:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.987+0000 7f9f28a4f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f2415b7b0 0x7f9f240ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.987+0000 7f9f23fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9f240cf760 0x7f9f2415e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38518/0 (socket says 172.21.15.55:38518) 2024-04-25T08:54:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.987+0000 7f9f28a4f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f2415b7b0 0x7f9f240ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38140/0 (socket says 172.21.15.55:38140) 2024-04-25T08:54:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.987+0000 7f9f23fff640 1 -- 172.21.15.55:0/3287799868 learned_addr learned my addr 172.21.15.55:0/3287799868 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:15.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.988+0000 7f9f29250640 1 --2- 172.21.15.55:0/3287799868 >> v2:172.21.15.167:3300/0 conn(0x7f9f2415e820 0x7f9f240cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.988+0000 7f9f28a4f640 1 -- 172.21.15.55:0/3287799868 >> v2:172.21.15.167:3300/0 conn(0x7f9f2415e820 msgr2=0x7f9f240cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:15.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.988+0000 7f9f28a4f640 1 --2- 172.21.15.55:0/3287799868 >> v2:172.21.15.167:3300/0 conn(0x7f9f2415e820 0x7f9f240cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.988+0000 7f9f28a4f640 1 -- 172.21.15.55:0/3287799868 >> v1:172.21.15.55:6789/0 conn(0x7f9f240cf760 legacy=0x7f9f2415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.988+0000 7f9f237fe640 1 -- 172.21.15.55:0/3287799868 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156856355 0 0) 0x7f9f2415f000 con 0x7f9f240cf760 2024-04-25T08:54:15.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.988+0000 7f9f28a4f640 1 -- 172.21.15.55:0/3287799868 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2415ed20 con 0x7f9f2415b7b0 2024-04-25T08:54:15.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.988+0000 7f9f28a4f640 1 --2- 172.21.15.55:0/3287799868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f2415b7b0 0x7f9f240ce7c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9f140097a0 tx=0x7f9f1402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac322e55744466a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:15.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.989+0000 7f9f237fe640 1 -- 172.21.15.55:0/3287799868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14037070 con 0x7f9f2415b7b0 2024-04-25T08:54:15.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.989+0000 7f9f237fe640 1 -- 172.21.15.55:0/3287799868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14032440 con 0x7f9f2415b7b0 2024-04-25T08:54:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.989+0000 7f9f237fe640 1 -- 172.21.15.55:0/3287799868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14032810 con 0x7f9f2415b7b0 2024-04-25T08:54:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.989+0000 7f9f2acb3640 1 -- 172.21.15.55:0/3287799868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f2415b7b0 msgr2=0x7f9f240ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.989+0000 7f9f2acb3640 1 --2- 172.21.15.55:0/3287799868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f2415b7b0 0x7f9f240ce7c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9f140097a0 tx=0x7f9f1402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.989+0000 7f9f2acb3640 1 -- 172.21.15.55:0/3287799868 shutdown_connections 2024-04-25T08:54:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.989+0000 7f9f2acb3640 1 --2- 172.21.15.55:0/3287799868 >> v2:172.21.15.167:3300/0 conn(0x7f9f2415e820 0x7f9f240cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.989+0000 7f9f2acb3640 1 --2- 172.21.15.55:0/3287799868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f2415b7b0 0x7f9f240ce7c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.989+0000 7f9f2acb3640 1 -- 172.21.15.55:0/3287799868 >> 172.21.15.55:0/3287799868 conn(0x7f9f2406f4a0 msgr2=0x7f9f2406f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.989+0000 7f9f2acb3640 1 -- 172.21.15.55:0/3287799868 shutdown_connections 2024-04-25T08:54:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.989+0000 7f9f2acb3640 1 -- 172.21.15.55:0/3287799868 wait complete. 2024-04-25T08:54:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.990+0000 7f9f2acb3640 1 Processor -- start 2024-04-25T08:54:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.990+0000 7f9f2acb3640 1 -- start start 2024-04-25T08:54:15.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.991+0000 7f9f2acb3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240cf760 0x7f9f240c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.991+0000 7f9f2acb3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f2415b7b0 0x7f9f2415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.991+0000 7f9f2acb3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f2415e820 0x7f9f2415df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.991+0000 7f9f2acb3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f241619f0 con 0x7f9f240cf760 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.991+0000 7f9f2acb3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240cdfc0 con 0x7f9f2415b7b0 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.991+0000 7f9f2acb3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240cc080 con 0x7f9f2415e820 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.991+0000 7f9f28a4f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240cf760 0x7f9f240c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.991+0000 7f9f28a4f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240cf760 0x7f9f240c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38142/0 (socket says 172.21.15.55:38142) 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.991+0000 7f9f28a4f640 1 -- 172.21.15.55:0/2280020048 learned_addr learned my addr 172.21.15.55:0/2280020048 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f23fff640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f2415b7b0 0x7f9f2415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f29250640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f2415e820 0x7f9f2415df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f28a4f640 1 -- 172.21.15.55:0/2280020048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f2415e820 msgr2=0x7f9f2415df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f28a4f640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f2415e820 0x7f9f2415df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f28a4f640 1 -- 172.21.15.55:0/2280020048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f2415b7b0 msgr2=0x7f9f2415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f28a4f640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f2415b7b0 0x7f9f2415d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f28a4f640 1 -- 172.21.15.55:0/2280020048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f240cae00 con 0x7f9f240cf760 2024-04-25T08:54:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f28a4f640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240cf760 0x7f9f240c7ac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9f140098c0 tx=0x7f9f140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f217fa640 1 -- 172.21.15.55:0/2280020048 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14037040 con 0x7f9f240cf760 2024-04-25T08:54:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f217fa640 1 -- 172.21.15.55:0/2280020048 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14042070 con 0x7f9f240cf760 2024-04-25T08:54:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f2acb3640 1 -- 172.21.15.55:0/2280020048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f240cb0e0 con 0x7f9f240cf760 2024-04-25T08:54:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f217fa640 1 -- 172.21.15.55:0/2280020048 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14030bb0 con 0x7f9f240cf760 2024-04-25T08:54:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.992+0000 7f9f2acb3640 1 -- 172.21.15.55:0/2280020048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f240cb6a0 con 0x7f9f240cf760 2024-04-25T08:54:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.993+0000 7f9f2acb3640 1 -- 172.21.15.55:0/2280020048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f240750b0 con 0x7f9f240cf760 2024-04-25T08:54:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.994+0000 7f9f217fa640 1 -- 172.21.15.55:0/2280020048 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9f14047460 con 0x7f9f240cf760 2024-04-25T08:54:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.994+0000 7f9f217fa640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f0406b4d0 0x7f9f0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.994+0000 7f9f217fa640 1 -- 172.21.15.55:0/2280020048 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f140aad60 con 0x7f9f240cf760 2024-04-25T08:54:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.994+0000 7f9f23fff640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f0406b4d0 0x7f9f0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.995+0000 7f9f23fff640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f0406b4d0 0x7f9f0406d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f240c8000 tx=0x7f9f0c007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:15.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:15.998+0000 7f9f217fa640 1 -- 172.21.15.55:0/2280020048 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f14032e20 con 0x7f9f240cf760 2024-04-25T08:54:16.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.180+0000 7f9f2acb3640 1 -- 172.21.15.55:0/2280020048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f240d0f20 con 0x7f9f240cf760 2024-04-25T08:54:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.181+0000 7f9f217fa640 1 -- 172.21.15.55:0/2280020048 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f14079be0 con 0x7f9f240cf760 2024-04-25T08:54:16.171 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:54:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 -- 172.21.15.55:0/2280020048 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f0406b4d0 msgr2=0x7f9f0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f0406b4d0 0x7f9f0406d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f240c8000 tx=0x7f9f0c007b50 comp rx=0 tx=0).stop 2024-04-25T08:54:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 -- 172.21.15.55:0/2280020048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240cf760 msgr2=0x7f9f240c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240cf760 0x7f9f240c7ac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9f140098c0 tx=0x7f9f140046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 -- 172.21.15.55:0/2280020048 shutdown_connections 2024-04-25T08:54:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f0406b4d0 0x7f9f0406d990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f2415e820 0x7f9f2415df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f2415b7b0 0x7f9f2415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 --2- 172.21.15.55:0/2280020048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240cf760 0x7f9f240c7ac0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 -- 172.21.15.55:0/2280020048 >> 172.21.15.55:0/2280020048 conn(0x7f9f2406f4a0 msgr2=0x7f9f2406d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 -- 172.21.15.55:0/2280020048 shutdown_connections 2024-04-25T08:54:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.183+0000 7f9f2acb3640 1 -- 172.21.15.55:0/2280020048 wait complete. 2024-04-25T08:54:16.184 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:54:16.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.299+0000 7f169d0ac640 1 Processor -- start 2024-04-25T08:54:16.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.299+0000 7f169d0ac640 1 -- start start 2024-04-25T08:54:16.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.300+0000 7f169d0ac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169815dca0 0x7f16980ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.300+0000 7f169d0ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16980d4090 con 0x7f16980d1130 2024-04-25T08:54:16.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.300+0000 7f169d0ac640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16980d4370 con 0x7f16980d3b90 2024-04-25T08:54:16.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.300+0000 7f169d0ac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16980b6b20 con 0x7f169815dca0 2024-04-25T08:54:16.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.300+0000 7f169759e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f16980d1130 0x7f16980b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38522/0 (socket says 172.21.15.55:38522) 2024-04-25T08:54:16.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.300+0000 7f169759e640 1 -- 172.21.15.55:0/2363907100 learned_addr learned my addr 172.21.15.55:0/2363907100 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:16.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.300+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025790473 0 0) 0x7f16980d4090 con 0x7f16980d1130 2024-04-25T08:54:16.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.300+0000 7f1696d9d640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169815dca0 0x7f16980ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.300+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1680003520 con 0x7f16980d1130 2024-04-25T08:54:16.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3811890626 0 0) 0x7f1680003520 con 0x7f16980d1130 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169815dca0 msgr2=0x7f16980ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169815dca0 0x7f16980ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 >> v1:172.21.15.167:6789/0 conn(0x7f16980d3b90 legacy=0x7f16980d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16980d4650 con 0x7f16980d1130 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f16880019f0 con 0x7f16980d1130 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 >> v1:172.21.15.55:6789/0 conn(0x7f16980d1130 legacy=0x7f16980b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169815dca0 0x7f16800039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1680003f60 0x7f1680004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1680004d40 0x7f16800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168000ba70 con 0x7f1680004d40 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168000bc20 con 0x7f1680003f60 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168000be20 con 0x7f169815dca0 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f169759e640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1680004d40 0x7f16800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f1696d9d640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169815dca0 0x7f16800039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f169659c640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1680003f60 0x7f1680004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f169759e640 1 -- 172.21.15.55:0/2363907100 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169815dca0 msgr2=0x7f16800039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f169759e640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169815dca0 0x7f16800039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f169759e640 1 -- 172.21.15.55:0/2363907100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1680003f60 msgr2=0x7f1680004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f169759e640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1680003f60 0x7f1680004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.301+0000 7f169759e640 1 -- 172.21.15.55:0/2363907100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1680003520 con 0x7f1680004d40 2024-04-25T08:54:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.302+0000 7f169759e640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1680004d40 0x7f16800051c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f16980d0320 tx=0x7f1680005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890d6ac57b8645b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.302+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168800a460 con 0x7f1680004d40 2024-04-25T08:54:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.302+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168802f070 con 0x7f1680004d40 2024-04-25T08:54:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.302+0000 7f1695d9b640 1 -- 172.21.15.55:0/2363907100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168802bc90 con 0x7f1680004d40 2024-04-25T08:54:16.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.303+0000 7f169d0ac640 1 -- 172.21.15.55:0/2363907100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1680004d40 msgr2=0x7f16800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.303+0000 7f169d0ac640 1 --2- 172.21.15.55:0/2363907100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1680004d40 0x7f16800051c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f16980d0320 tx=0x7f1680005830 comp rx=0 tx=0).stop 2024-04-25T08:54:16.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.303+0000 7f169759e640 1 -- 172.21.15.55:0/2363907100 reap_dead start 2024-04-25T08:54:16.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.303+0000 7f169d0ac640 1 -- 172.21.15.55:0/2363907100 shutdown_connections 2024-04-25T08:54:16.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.303+0000 7f169d0ac640 1 -- 172.21.15.55:0/2363907100 >> 172.21.15.55:0/2363907100 conn(0x7f16980726c0 msgr2=0x7f1698072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:16.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.303+0000 7f169d0ac640 1 -- 172.21.15.55:0/2363907100 shutdown_connections 2024-04-25T08:54:16.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.303+0000 7f169d0ac640 1 -- 172.21.15.55:0/2363907100 wait complete. 2024-04-25T08:54:16.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.304+0000 7f169d0ac640 1 Processor -- start 2024-04-25T08:54:16.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.304+0000 7f169d0ac640 1 -- start start 2024-04-25T08:54:16.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f169d0ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16981f2e50 0x7f16980adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f169d0ac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16981f3230 0x7f16980ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f169d0ac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16980ccb10 0x7f16980ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f169d0ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169815e200 con 0x7f16981f2e50 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f169d0ac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169815e080 con 0x7f16980ccb10 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f169d0ac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16980b8280 con 0x7f16981f3230 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f1696d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16981f2e50 0x7f16980adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f1696d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16981f2e50 0x7f16980adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38168/0 (socket says 172.21.15.55:38168) 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f1696d9d640 1 -- 172.21.15.55:0/2803696329 learned_addr learned my addr 172.21.15.55:0/2803696329 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f169659c640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16981f3230 0x7f16980ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f169759e640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16980ccb10 0x7f16980ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f1696d9d640 1 -- 172.21.15.55:0/2803696329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16981f3230 msgr2=0x7f16980ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f1696d9d640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16981f3230 0x7f16980ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f1696d9d640 1 -- 172.21.15.55:0/2803696329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16980ccb10 msgr2=0x7f16980ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f1696d9d640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16980ccb10 0x7f16980ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f1696d9d640 1 -- 172.21.15.55:0/2803696329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16980cdb50 con 0x7f16981f2e50 2024-04-25T08:54:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.305+0000 7f1696d9d640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16981f2e50 0x7f16980adef0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1690011a00 tx=0x7f1690011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.306+0000 7f167f7fe640 1 -- 172.21.15.55:0/2803696329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000fb50 con 0x7f16981f2e50 2024-04-25T08:54:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.306+0000 7f167f7fe640 1 -- 172.21.15.55:0/2803696329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169000fcf0 con 0x7f16981f2e50 2024-04-25T08:54:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.306+0000 7f167f7fe640 1 -- 172.21.15.55:0/2803696329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000fea0 con 0x7f16981f2e50 2024-04-25T08:54:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.306+0000 7f169d0ac640 1 -- 172.21.15.55:0/2803696329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16980cd870 con 0x7f16981f2e50 2024-04-25T08:54:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.306+0000 7f169d0ac640 1 -- 172.21.15.55:0/2803696329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169814fe90 con 0x7f16981f2e50 2024-04-25T08:54:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.307+0000 7f169d0ac640 1 -- 172.21.15.55:0/2803696329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16980750b0 con 0x7f16981f2e50 2024-04-25T08:54:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.307+0000 7f167f7fe640 1 -- 172.21.15.55:0/2803696329 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1690012040 con 0x7f16981f2e50 2024-04-25T08:54:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.308+0000 7f167f7fe640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f168406b500 0x7f168406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.308+0000 7f167f7fe640 1 -- 172.21.15.55:0/2803696329 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f169008a710 con 0x7f16981f2e50 2024-04-25T08:54:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.308+0000 7f169659c640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f168406b500 0x7f168406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.308+0000 7f169659c640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f168406b500 0x7f168406d9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f16981f3630 tx=0x7f168c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:16.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.312+0000 7f167f7fe640 1 -- 172.21.15.55:0/2803696329 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1690019030 con 0x7f16981f2e50 2024-04-25T08:54:16.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.492+0000 7f169d0ac640 1 -- 172.21.15.55:0/2803696329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f169806b1d0 con 0x7f16981f2e50 2024-04-25T08:54:16.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.492+0000 7f167f7fe640 1 -- 172.21.15.55:0/2803696329 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1690058f40 con 0x7f16981f2e50 2024-04-25T08:54:16.483 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:54:16.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 -- 172.21.15.55:0/2803696329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f168406b500 msgr2=0x7f168406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f168406b500 0x7f168406d9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f16981f3630 tx=0x7f168c009040 comp rx=0 tx=0).stop 2024-04-25T08:54:16.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 -- 172.21.15.55:0/2803696329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16981f2e50 msgr2=0x7f16980adef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16981f2e50 0x7f16980adef0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1690011a00 tx=0x7f1690011ec0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 -- 172.21.15.55:0/2803696329 shutdown_connections 2024-04-25T08:54:16.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f168406b500 0x7f168406d9c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16980ccb10 0x7f16980ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16981f3230 0x7f16980ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 --2- 172.21.15.55:0/2803696329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16981f2e50 0x7f16980adef0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 -- 172.21.15.55:0/2803696329 >> 172.21.15.55:0/2803696329 conn(0x7f16980726c0 msgr2=0x7f169815d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:16.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 -- 172.21.15.55:0/2803696329 shutdown_connections 2024-04-25T08:54:16.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.495+0000 7f169d0ac640 1 -- 172.21.15.55:0/2803696329 wait complete. 2024-04-25T08:54:16.496 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:54:16.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.608+0000 7f99e893b640 1 Processor -- start 2024-04-25T08:54:16.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.608+0000 7f99e893b640 1 -- start start 2024-04-25T08:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e893b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99e4159f60 0x7f99e40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e893b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e415b5d0 con 0x7f99e406d970 2024-04-25T08:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e893b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e40b3820 con 0x7f99e4071200 2024-04-25T08:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e893b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e415b2f0 con 0x7f99e4159f60 2024-04-25T08:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e2d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f99e406d970 0x7f99e415a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38534/0 (socket says 172.21.15.55:38534) 2024-04-25T08:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e2d9d640 1 -- 172.21.15.55:0/818830525 learned_addr learned my addr 172.21.15.55:0/818830525 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e259c640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99e4159f60 0x7f99e40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071353677 0 0) 0x7f99e415b5d0 con 0x7f99e406d970 2024-04-25T08:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d0003520 con 0x7f99e406d970 2024-04-25T08:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 553329519 0 0) 0x7f99d0003520 con 0x7f99e406d970 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99e4159f60 msgr2=0x7f99e40b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99e4159f60 0x7f99e40b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 >> v1:172.21.15.167:6789/0 conn(0x7f99e4071200 legacy=0x7f99e406d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e40b2800 con 0x7f99e406d970 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f99dc0019f0 con 0x7f99e406d970 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 >> v1:172.21.15.55:6789/0 conn(0x7f99e406d970 legacy=0x7f99e415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d00039e0 0x7f99d0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99d0004390 0x7f99d0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.609+0000 7f99e1d9b640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99e4159f60 0x7f99d00050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.610+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e415b2f0 con 0x7f99d00039e0 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.610+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d000b9c0 con 0x7f99d0004390 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.610+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d000bbc0 con 0x7f99e4159f60 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.610+0000 7f99e259c640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d00039e0 0x7f99d0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.610+0000 7f99d9d9b640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99d0004390 0x7f99d0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.610+0000 7f99e2d9d640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99e4159f60 0x7f99d00050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.610+0000 7f99e259c640 1 -- 172.21.15.55:0/818830525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99e4159f60 msgr2=0x7f99d00050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.610+0000 7f99e259c640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99e4159f60 0x7f99d00050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.610+0000 7f99e259c640 1 -- 172.21.15.55:0/818830525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99d0004390 msgr2=0x7f99d0004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.610+0000 7f99e259c640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99d0004390 0x7f99d0004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.610+0000 7f99e259c640 1 -- 172.21.15.55:0/818830525 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d0003520 con 0x7f99d00039e0 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.611+0000 7f99e259c640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d00039e0 0x7f99d0003dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009650 tx=0x7f99d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e51b64d9425c40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.611+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4038070 con 0x7f99d00039e0 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.611+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d4033400 con 0x7f99d00039e0 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.611+0000 7f99e1d9b640 1 -- 172.21.15.55:0/818830525 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4009690 con 0x7f99d00039e0 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.611+0000 7f99e893b640 1 -- 172.21.15.55:0/818830525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d00039e0 msgr2=0x7f99d0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.611+0000 7f99e893b640 1 --2- 172.21.15.55:0/818830525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d00039e0 0x7f99d0003dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009650 tx=0x7f99d0005830 comp rx=0 tx=0).stop 2024-04-25T08:54:16.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.611+0000 7f99e2d9d640 1 -- 172.21.15.55:0/818830525 reap_dead start 2024-04-25T08:54:16.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.611+0000 7f99e893b640 1 -- 172.21.15.55:0/818830525 shutdown_connections 2024-04-25T08:54:16.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.611+0000 7f99e893b640 1 -- 172.21.15.55:0/818830525 >> 172.21.15.55:0/818830525 conn(0x7f99e406aba0 msgr2=0x7f99e406af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:16.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.611+0000 7f99e893b640 1 -- 172.21.15.55:0/818830525 shutdown_connections 2024-04-25T08:54:16.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.611+0000 7f99e893b640 1 -- 172.21.15.55:0/818830525 wait complete. 2024-04-25T08:54:16.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.613+0000 7f99e893b640 1 Processor -- start 2024-04-25T08:54:16.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.613+0000 7f99e893b640 1 -- start start 2024-04-25T08:54:16.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.613+0000 7f99e893b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d00039e0 0x7f99e40ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.613+0000 7f99e893b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e41e3220 0x7f99e4147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.613+0000 7f99e893b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99e41e36a0 0x7f99e4148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.613+0000 7f99e893b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e406dda0 con 0x7f99e41e3220 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.613+0000 7f99e893b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40b2dc0 con 0x7f99e41e36a0 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.613+0000 7f99e893b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40b32e0 con 0x7f99d00039e0 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99d9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e41e3220 0x7f99e4147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99d9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e41e3220 0x7f99e4147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38176/0 (socket says 172.21.15.55:38176) 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99d9d9b640 1 -- 172.21.15.55:0/4102011363 learned_addr learned my addr 172.21.15.55:0/4102011363 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99e2d9d640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99e41e36a0 0x7f99e4148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99e259c640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d00039e0 0x7f99e40ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99d9d9b640 1 -- 172.21.15.55:0/4102011363 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d00039e0 msgr2=0x7f99e40ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99d9d9b640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d00039e0 0x7f99e40ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99d9d9b640 1 -- 172.21.15.55:0/4102011363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99e41e36a0 msgr2=0x7f99e4148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99d9d9b640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99e41e36a0 0x7f99e4148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99d9d9b640 1 -- 172.21.15.55:0/4102011363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e4156160 con 0x7f99e41e3220 2024-04-25T08:54:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99e259c640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d00039e0 0x7f99e40ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99d9d9b640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e41e3220 0x7f99e4147bf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00f750 tx=0x7f99cc00fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99db7fe640 1 -- 172.21.15.55:0/4102011363 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00fe60 con 0x7f99e41e3220 2024-04-25T08:54:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99db7fe640 1 -- 172.21.15.55:0/4102011363 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc018070 con 0x7f99e41e3220 2024-04-25T08:54:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99e893b640 1 -- 172.21.15.55:0/4102011363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e41e67f0 con 0x7f99e41e3220 2024-04-25T08:54:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99db7fe640 1 -- 172.21.15.55:0/4102011363 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00d730 con 0x7f99e41e3220 2024-04-25T08:54:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.614+0000 7f99e893b640 1 -- 172.21.15.55:0/4102011363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e41e6db0 con 0x7f99e41e3220 2024-04-25T08:54:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.615+0000 7f99e893b640 1 -- 172.21.15.55:0/4102011363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e41539f0 con 0x7f99e41e3220 2024-04-25T08:54:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.616+0000 7f99db7fe640 1 -- 172.21.15.55:0/4102011363 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f99cc00d8d0 con 0x7f99e41e3220 2024-04-25T08:54:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.616+0000 7f99db7fe640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99c406b4d0 0x7f99c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:16.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.616+0000 7f99db7fe640 1 -- 172.21.15.55:0/4102011363 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99cc08a0b0 con 0x7f99e41e3220 2024-04-25T08:54:16.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.616+0000 7f99e259c640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99c406b4d0 0x7f99c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:16.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.617+0000 7f99e259c640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99c406b4d0 0x7f99c406d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f99d4000c00 tx=0x7f99d4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:16.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.620+0000 7f99db7fe640 1 -- 172.21.15.55:0/4102011363 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f99e41539f0 con 0x7f99e41e3220 2024-04-25T08:54:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.815+0000 7f99e893b640 1 -- 172.21.15.55:0/4102011363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f99e4074790 con 0x7f99e41e3220 2024-04-25T08:54:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.815+0000 7f99db7fe640 1 -- 172.21.15.55:0/4102011363 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f99cc058fc0 con 0x7f99e41e3220 2024-04-25T08:54:16.806 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 -- 172.21.15.55:0/4102011363 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99c406b4d0 msgr2=0x7f99c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99c406b4d0 0x7f99c406d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f99d4000c00 tx=0x7f99d4008030 comp rx=0 tx=0).stop 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 -- 172.21.15.55:0/4102011363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e41e3220 msgr2=0x7f99e4147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e41e3220 0x7f99e4147bf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00f750 tx=0x7f99cc00fc10 comp rx=0 tx=0).stop 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 -- 172.21.15.55:0/4102011363 shutdown_connections 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99c406b4d0 0x7f99c406d990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99e41e36a0 0x7f99e4148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e41e3220 0x7f99e4147bf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 --2- 172.21.15.55:0/4102011363 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d00039e0 0x7f99e40ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 -- 172.21.15.55:0/4102011363 >> 172.21.15.55:0/4102011363 conn(0x7f99e406aba0 msgr2=0x7f99e40b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 -- 172.21.15.55:0/4102011363 shutdown_connections 2024-04-25T08:54:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:16.817+0000 7f99e893b640 1 -- 172.21.15.55:0/4102011363 wait complete. 2024-04-25T08:54:16.818 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:54:16.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:16.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T08:54:16.844 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:54:16.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:16.845 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:54:16.913 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:54:16.913 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:16.933 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:54:16.933 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:16.991 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:54:16.991 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:17.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:17.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.160+0000 7fbd66bc8640 1 Processor -- start 2024-04-25T08:54:17.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.160+0000 7fbd66bc8640 1 -- start start 2024-04-25T08:54:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.161+0000 7fbd66bc8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd6015dce0 0x7fbd600d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.161+0000 7fbd66bc8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d35b0 0x7fbd600b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.161+0000 7fbd66bc8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6015e0c0 con 0x7fbd600d1f90 2024-04-25T08:54:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.161+0000 7fbd66bc8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd600b7b10 con 0x7fbd6015dce0 2024-04-25T08:54:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.161+0000 7fbd66bc8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600d2510 con 0x7fbd600d35b0 2024-04-25T08:54:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.162+0000 7fbd5ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d35b0 0x7fbd600b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.162+0000 7fbd64964640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd6015dce0 0x7fbd600d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.162+0000 7fbd64964640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd6015dce0 0x7fbd600d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:48740/0 (socket says 172.21.15.55:48740) 2024-04-25T08:54:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.162+0000 7fbd65165640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbd600d1f90 0x7fbd6006bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:32804/0 (socket says 172.21.15.55:32804) 2024-04-25T08:54:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.162+0000 7fbd5ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d35b0 0x7fbd600b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:59956/0 (socket says 172.21.15.55:59956) 2024-04-25T08:54:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.162+0000 7fbd64964640 1 -- 172.21.15.55:0/847988033 learned_addr learned my addr 172.21.15.55:0/847988033 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.162+0000 7fbd64964640 1 -- 172.21.15.55:0/847988033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d35b0 msgr2=0x7fbd600b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.162+0000 7fbd64964640 1 --2- 172.21.15.55:0/847988033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d35b0 0x7fbd600b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.162+0000 7fbd64964640 1 -- 172.21.15.55:0/847988033 >> v1:172.21.15.167:6789/0 conn(0x7fbd600d1f90 legacy=0x7fbd6006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.162+0000 7fbd64964640 1 -- 172.21.15.55:0/847988033 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd600d27f0 con 0x7fbd6015dce0 2024-04-25T08:54:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.162+0000 7fbd5ffff640 1 --2- 172.21.15.55:0/847988033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d35b0 0x7fbd600b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.163+0000 7fbd64964640 1 --2- 172.21.15.55:0/847988033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6015dce0 0x7fbd600d1a50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009e50 tx=0x7fbd5802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a095ff9f2d2cf2df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.163+0000 7fbd5f7fe640 1 -- 172.21.15.55:0/847988033 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58036070 con 0x7fbd6015dce0 2024-04-25T08:54:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.163+0000 7fbd5f7fe640 1 -- 172.21.15.55:0/847988033 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd58031600 con 0x7fbd6015dce0 2024-04-25T08:54:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.163+0000 7fbd5f7fe640 1 -- 172.21.15.55:0/847988033 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580319d0 con 0x7fbd6015dce0 2024-04-25T08:54:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.164+0000 7fbd66bc8640 1 -- 172.21.15.55:0/847988033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6015dce0 msgr2=0x7fbd600d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.164+0000 7fbd66bc8640 1 --2- 172.21.15.55:0/847988033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6015dce0 0x7fbd600d1a50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009e50 tx=0x7fbd5802a680 comp rx=0 tx=0).stop 2024-04-25T08:54:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.164+0000 7fbd66bc8640 1 -- 172.21.15.55:0/847988033 shutdown_connections 2024-04-25T08:54:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.164+0000 7fbd66bc8640 1 --2- 172.21.15.55:0/847988033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d35b0 0x7fbd600b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.164+0000 7fbd66bc8640 1 --2- 172.21.15.55:0/847988033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6015dce0 0x7fbd600d1a50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.164+0000 7fbd66bc8640 1 -- 172.21.15.55:0/847988033 >> 172.21.15.55:0/847988033 conn(0x7fbd60072900 msgr2=0x7fbd600d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.164+0000 7fbd66bc8640 1 -- 172.21.15.55:0/847988033 shutdown_connections 2024-04-25T08:54:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.164+0000 7fbd66bc8640 1 -- 172.21.15.55:0/847988033 wait complete. 2024-04-25T08:54:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.165+0000 7fbd66bc8640 1 Processor -- start 2024-04-25T08:54:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.165+0000 7fbd66bc8640 1 -- start start 2024-04-25T08:54:17.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd66bc8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d1f90 0x7fbd6014de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd66bc8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd600d35b0 0x7fbd600c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd66bc8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6015dce0 0x7fbd600b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd66bc8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600d3090 con 0x7fbd600d35b0 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd66bc8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600d2db0 con 0x7fbd6015dce0 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd66bc8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b9820 con 0x7fbd600d1f90 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd600d35b0 0x7fbd600c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd600d35b0 0x7fbd600c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38190/0 (socket says 172.21.15.55:38190) 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd5ffff640 1 -- 172.21.15.55:0/2869992180 learned_addr learned my addr 172.21.15.55:0/2869992180 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd64964640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d1f90 0x7fbd6014de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd65165640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6015dce0 0x7fbd600b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd5ffff640 1 -- 172.21.15.55:0/2869992180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d1f90 msgr2=0x7fbd6014de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd5ffff640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d1f90 0x7fbd6014de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd5ffff640 1 -- 172.21.15.55:0/2869992180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6015dce0 msgr2=0x7fbd600b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd5ffff640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6015dce0 0x7fbd600b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.166+0000 7fbd5ffff640 1 -- 172.21.15.55:0/2869992180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd600c7ec0 con 0x7fbd600d35b0 2024-04-25T08:54:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.167+0000 7fbd5ffff640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd600d35b0 0x7fbd600c7500 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400ebe0 tx=0x7fbd5400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.167+0000 7fbd5d7fa640 1 -- 172.21.15.55:0/2869992180 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54017070 con 0x7fbd600d35b0 2024-04-25T08:54:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.167+0000 7fbd5d7fa640 1 -- 172.21.15.55:0/2869992180 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5400cc30 con 0x7fbd600d35b0 2024-04-25T08:54:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.167+0000 7fbd5d7fa640 1 -- 172.21.15.55:0/2869992180 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54013470 con 0x7fbd600d35b0 2024-04-25T08:54:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.167+0000 7fbd66bc8640 1 -- 172.21.15.55:0/2869992180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd600c81a0 con 0x7fbd600d35b0 2024-04-25T08:54:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.167+0000 7fbd66bc8640 1 -- 172.21.15.55:0/2869992180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd600c8ca0 con 0x7fbd600d35b0 2024-04-25T08:54:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.168+0000 7fbd66bc8640 1 -- 172.21.15.55:0/2869992180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd600749b0 con 0x7fbd600d35b0 2024-04-25T08:54:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.168+0000 7fbd5d7fa640 1 -- 172.21.15.55:0/2869992180 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd5401a070 con 0x7fbd600d35b0 2024-04-25T08:54:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.169+0000 7fbd5d7fa640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd4c06b4d0 0x7fbd4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.169+0000 7fbd5d7fa640 1 -- 172.21.15.55:0/2869992180 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd5408a3b0 con 0x7fbd600d35b0 2024-04-25T08:54:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.169+0000 7fbd64964640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd4c06b4d0 0x7fbd4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.169+0000 7fbd64964640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd4c06b4d0 0x7fbd4c06d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd58033000 tx=0x7fbd58009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:17.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.173+0000 7fbd5d7fa640 1 -- 172.21.15.55:0/2869992180 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbd54058c70 con 0x7fbd600d35b0 2024-04-25T08:54:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.353+0000 7fbd66bc8640 1 -- 172.21.15.55:0/2869992180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd600d0410 con 0x7fbd600d35b0 2024-04-25T08:54:17.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.354+0000 7fbd5d7fa640 1 -- 172.21.15.55:0/2869992180 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fbd5405cd10 con 0x7fbd600d35b0 2024-04-25T08:54:17.345 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:17.345 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 -- 172.21.15.55:0/2869992180 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd4c06b4d0 msgr2=0x7fbd4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd4c06b4d0 0x7fbd4c06d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd58033000 tx=0x7fbd58009000 comp rx=0 tx=0).stop 2024-04-25T08:54:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 -- 172.21.15.55:0/2869992180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd600d35b0 msgr2=0x7fbd600c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd600d35b0 0x7fbd600c7500 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400ebe0 tx=0x7fbd5400c520 comp rx=0 tx=0).stop 2024-04-25T08:54:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 -- 172.21.15.55:0/2869992180 shutdown_connections 2024-04-25T08:54:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd4c06b4d0 0x7fbd4c06d990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6015dce0 0x7fbd600b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd600d35b0 0x7fbd600c7500 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 --2- 172.21.15.55:0/2869992180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd600d1f90 0x7fbd6014de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 -- 172.21.15.55:0/2869992180 >> 172.21.15.55:0/2869992180 conn(0x7fbd60072900 msgr2=0x7fbd600ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 -- 172.21.15.55:0/2869992180 shutdown_connections 2024-04-25T08:54:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.356+0000 7fbd66bc8640 1 -- 172.21.15.55:0/2869992180 wait complete. 2024-04-25T08:54:17.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:17.358 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:17.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.472+0000 7f0b0e3ce640 1 Processor -- start 2024-04-25T08:54:17.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.472+0000 7f0b0e3ce640 1 -- start start 2024-04-25T08:54:17.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.472+0000 7f0b0e3ce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0b080d3b90 0x7f0b080d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b0e3ce640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b080d4090 con 0x7f0b0815dca0 2024-04-25T08:54:17.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b0e3ce640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b080d4370 con 0x7f0b080d0f60 2024-04-25T08:54:17.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b0e3ce640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b080b6b20 con 0x7f0b080d3b90 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b07fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0b0815dca0 0x7f0b080ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38546/0 (socket says 172.21.15.55:38546) 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b07fff640 1 -- 172.21.15.55:0/3858814940 learned_addr learned my addr 172.21.15.55:0/3858814940 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b077fe640 1 --2- 172.21.15.55:0/3858814940 >> v2:172.21.15.167:3300/0 conn(0x7f0b080d3b90 0x7f0b080d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402243441 0 0) 0x7f0b080d4090 con 0x7f0b0815dca0 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0af4003520 con 0x7f0b0815dca0 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 722245292 0 0) 0x7f0af4003520 con 0x7f0b0815dca0 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 >> v2:172.21.15.167:3300/0 conn(0x7f0b080d3b90 msgr2=0x7f0b080d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 --2- 172.21.15.55:0/3858814940 >> v2:172.21.15.167:3300/0 conn(0x7f0b080d3b90 0x7f0b080d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 >> v1:172.21.15.167:6789/0 conn(0x7f0b080d0f60 legacy=0x7f0b080b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b080d4650 con 0x7f0b0815dca0 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f0af0001670 con 0x7f0b0815dca0 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 >> v1:172.21.15.55:6789/0 conn(0x7f0b0815dca0 legacy=0x7f0b080ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 --2- 172.21.15.55:0/3858814940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af40039b0 0x7f0af4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 --2- 172.21.15.55:0/3858814940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af40043b0 0x7f0af4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 --2- 172.21.15.55:0/3858814940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af4005080 0x7f0af400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af400bfb0 con 0x7f0af4005080 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af400c160 con 0x7f0af40043b0 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.473+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af400c360 con 0x7f0af40039b0 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.474+0000 7f0b0c96b640 1 --2- 172.21.15.55:0/3858814940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af4005080 0x7f0af400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.474+0000 7f0b07fff640 1 --2- 172.21.15.55:0/3858814940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af40039b0 0x7f0af4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.474+0000 7f0b077fe640 1 --2- 172.21.15.55:0/3858814940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af40043b0 0x7f0af4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.474+0000 7f0b0c96b640 1 -- 172.21.15.55:0/3858814940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af40039b0 msgr2=0x7f0af4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.474+0000 7f0b0c96b640 1 --2- 172.21.15.55:0/3858814940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af40039b0 0x7f0af4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.474+0000 7f0b0c96b640 1 -- 172.21.15.55:0/3858814940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af40043b0 msgr2=0x7f0af4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.474+0000 7f0b0c96b640 1 --2- 172.21.15.55:0/3858814940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af40043b0 0x7f0af4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.474+0000 7f0b0c96b640 1 -- 172.21.15.55:0/3858814940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af4003520 con 0x7f0af4005080 2024-04-25T08:54:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.474+0000 7f0b0c96b640 1 -- 172.21.15.55:0/3858814940 reap_dead start 2024-04-25T08:54:17.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.474+0000 7f0b0c96b640 1 --2- 172.21.15.55:0/3858814940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af4005080 0x7f0af400b9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b00001f60 tx=0x7f0af4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b9eecaa4f2f6a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:17.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.475+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00001b30 con 0x7f0af4005080 2024-04-25T08:54:17.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.475+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b00003b90 con 0x7f0af4005080 2024-04-25T08:54:17.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.475+0000 7f0b06ffd640 1 -- 172.21.15.55:0/3858814940 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00005110 con 0x7f0af4005080 2024-04-25T08:54:17.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.475+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/3858814940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af4005080 msgr2=0x7f0af400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.475+0000 7f0b0e3ce640 1 --2- 172.21.15.55:0/3858814940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af4005080 0x7f0af400b9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b00001f60 tx=0x7f0af4005830 comp rx=0 tx=0).stop 2024-04-25T08:54:17.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.475+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/3858814940 shutdown_connections 2024-04-25T08:54:17.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.475+0000 7f0b0e3ce640 1 --2- 172.21.15.55:0/3858814940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af4005080 0x7f0af400b9c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.475+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/3858814940 >> 172.21.15.55:0/3858814940 conn(0x7f0b080726c0 msgr2=0x7f0b08072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:17.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.475+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/3858814940 shutdown_connections 2024-04-25T08:54:17.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.475+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/3858814940 wait complete. 2024-04-25T08:54:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.476+0000 7f0b0e3ce640 1 Processor -- start 2024-04-25T08:54:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.477+0000 7f0b0e3ce640 1 -- start start 2024-04-25T08:54:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.477+0000 7f0b0e3ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af4005080 0x7f0b0814ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.477+0000 7f0b0e3ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b080ad970 0x7f0b080addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.477+0000 7f0b0e3ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b080cc7f0 0x7f0b080ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.477+0000 7f0b0e3ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0815e080 con 0x7f0b080ad970 2024-04-25T08:54:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.477+0000 7f0b0e3ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b080d1390 con 0x7f0b080cc7f0 2024-04-25T08:54:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.477+0000 7f0b0e3ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0815e200 con 0x7f0af4005080 2024-04-25T08:54:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.477+0000 7f0b077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b080ad970 0x7f0b080addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.477+0000 7f0b077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b080ad970 0x7f0b080addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38202/0 (socket says 172.21.15.55:38202) 2024-04-25T08:54:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.477+0000 7f0b077fe640 1 -- 172.21.15.55:0/4262465646 learned_addr learned my addr 172.21.15.55:0/4262465646 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b0c96b640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b080cc7f0 0x7f0b080ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b07fff640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af4005080 0x7f0b0814ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b077fe640 1 -- 172.21.15.55:0/4262465646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af4005080 msgr2=0x7f0b0814ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b077fe640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af4005080 0x7f0b0814ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b077fe640 1 -- 172.21.15.55:0/4262465646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b080cc7f0 msgr2=0x7f0b080ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b077fe640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b080cc7f0 0x7f0b080ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b077fe640 1 -- 172.21.15.55:0/4262465646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0814e410 con 0x7f0b080ad970 2024-04-25T08:54:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b077fe640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b080ad970 0x7f0b080addf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0af8011990 tx=0x7f0af8011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b04ff9640 1 -- 172.21.15.55:0/4262465646 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8019070 con 0x7f0b080ad970 2024-04-25T08:54:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b04ff9640 1 -- 172.21.15.55:0/4262465646 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af8004240 con 0x7f0b080ad970 2024-04-25T08:54:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/4262465646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b080cd560 con 0x7f0b080ad970 2024-04-25T08:54:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b04ff9640 1 -- 172.21.15.55:0/4262465646 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af800f820 con 0x7f0b080ad970 2024-04-25T08:54:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.478+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/4262465646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b080ab3b0 con 0x7f0b080ad970 2024-04-25T08:54:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.479+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/4262465646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b080750b0 con 0x7f0b080ad970 2024-04-25T08:54:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.480+0000 7f0b04ff9640 1 -- 172.21.15.55:0/4262465646 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0af801c070 con 0x7f0b080ad970 2024-04-25T08:54:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.480+0000 7f0b04ff9640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ae806b500 0x7f0ae806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.480+0000 7f0b07fff640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ae806b500 0x7f0ae806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.480+0000 7f0b04ff9640 1 -- 172.21.15.55:0/4262465646 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0af808a440 con 0x7f0b080ad970 2024-04-25T08:54:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.481+0000 7f0b07fff640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ae806b500 0x7f0ae806d9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0af0007cb0 tx=0x7f0af00078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.485+0000 7f0b04ff9640 1 -- 172.21.15.55:0/4262465646 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b0814e410 con 0x7f0b080ad970 2024-04-25T08:54:17.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.663+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/4262465646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b080cdb90 con 0x7f0b080ad970 2024-04-25T08:54:17.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.663+0000 7f0b04ff9640 1 -- 172.21.15.55:0/4262465646 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0af8058d30 con 0x7f0b080ad970 2024-04-25T08:54:17.654 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/4262465646 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ae806b500 msgr2=0x7f0ae806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ae806b500 0x7f0ae806d9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0af0007cb0 tx=0x7f0af00078f0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/4262465646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b080ad970 msgr2=0x7f0b080addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b080ad970 0x7f0b080addf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0af8011990 tx=0x7f0af8011d90 comp rx=0 tx=0).stop 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/4262465646 shutdown_connections 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ae806b500 0x7f0ae806d9c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b080cc7f0 0x7f0b080ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b080ad970 0x7f0b080addf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 --2- 172.21.15.55:0/4262465646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af4005080 0x7f0b0814ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/4262465646 >> 172.21.15.55:0/4262465646 conn(0x7f0b080726c0 msgr2=0x7f0b080d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/4262465646 shutdown_connections 2024-04-25T08:54:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.665+0000 7f0b0e3ce640 1 -- 172.21.15.55:0/4262465646 wait complete. 2024-04-25T08:54:17.666 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:54:17.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.780+0000 7f02c8491640 1 Processor -- start 2024-04-25T08:54:17.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.780+0000 7f02c8491640 1 -- start start 2024-04-25T08:54:17.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.781+0000 7f02c8491640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c00ce9d0 0x7f02c00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.781+0000 7f02c8491640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02c00cc300 0x7f02c00cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.781+0000 7f02c8491640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c006dcb0 con 0x7f02c0144e70 2024-04-25T08:54:17.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.781+0000 7f02c8491640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c015bfe0 con 0x7f02c00cc300 2024-04-25T08:54:17.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.781+0000 7f02c8491640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c006df90 con 0x7f02c00ce9d0 2024-04-25T08:54:17.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.781+0000 7f02c6a2e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02c00cc300 0x7f02c00cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.781+0000 7f02c6a2e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02c00cc300 0x7f02c00cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38216/0 (socket says 172.21.15.55:38216) 2024-04-25T08:54:17.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.781+0000 7f02c6a2e640 1 -- 172.21.15.55:0/3253279554 learned_addr learned my addr 172.21.15.55:0/3253279554 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:17.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.781+0000 7f02c5a2c640 1 --2- 172.21.15.55:0/3253279554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c00ce9d0 0x7f02c00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.782+0000 7f02c6a2e640 1 -- 172.21.15.55:0/3253279554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c00ce9d0 msgr2=0x7f02c00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:17.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.782+0000 7f02c6a2e640 1 --2- 172.21.15.55:0/3253279554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c00ce9d0 0x7f02c00cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.782+0000 7f02c6a2e640 1 -- 172.21.15.55:0/3253279554 >> v1:172.21.15.167:6789/0 conn(0x7f02c0144e70 legacy=0x7f02c006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.782+0000 7f02c6a2e640 1 -- 172.21.15.55:0/3253279554 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c006e270 con 0x7f02c00cc300 2024-04-25T08:54:17.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.782+0000 7f02c6a2e640 1 --2- 172.21.15.55:0/3253279554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c00cc300 0x7f02c00cc770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009e50 tx=0x7f02b002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744eeee2031072e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:17.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.782+0000 7f02c522b640 1 -- 172.21.15.55:0/3253279554 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b0036070 con 0x7f02c00cc300 2024-04-25T08:54:17.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.782+0000 7f02c522b640 1 -- 172.21.15.55:0/3253279554 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b0031600 con 0x7f02c00cc300 2024-04-25T08:54:17.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.782+0000 7f02c522b640 1 -- 172.21.15.55:0/3253279554 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b00319d0 con 0x7f02c00cc300 2024-04-25T08:54:17.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.783+0000 7f02c8491640 1 -- 172.21.15.55:0/3253279554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c00cc300 msgr2=0x7f02c00cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.783+0000 7f02c8491640 1 --2- 172.21.15.55:0/3253279554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c00cc300 0x7f02c00cc770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009e50 tx=0x7f02b002a680 comp rx=0 tx=0).stop 2024-04-25T08:54:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.783+0000 7f02c8491640 1 -- 172.21.15.55:0/3253279554 shutdown_connections 2024-04-25T08:54:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.783+0000 7f02c8491640 1 --2- 172.21.15.55:0/3253279554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c00cc300 0x7f02c00cc770 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.783+0000 7f02c8491640 1 --2- 172.21.15.55:0/3253279554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c00ce9d0 0x7f02c00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.783+0000 7f02c8491640 1 -- 172.21.15.55:0/3253279554 >> 172.21.15.55:0/3253279554 conn(0x7f02c006aba0 msgr2=0x7f02c006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.783+0000 7f02c8491640 1 -- 172.21.15.55:0/3253279554 shutdown_connections 2024-04-25T08:54:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.783+0000 7f02c8491640 1 -- 172.21.15.55:0/3253279554 wait complete. 2024-04-25T08:54:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.784+0000 7f02c8491640 1 Processor -- start 2024-04-25T08:54:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.784+0000 7f02c8491640 1 -- start start 2024-04-25T08:54:17.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c8491640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c00cc300 0x7f02c00b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c8491640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c00ce9d0 0x7f02c013c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c8491640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c0144e70 0x7f02c01425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c8491640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c006d970 con 0x7f02c00ce9d0 2024-04-25T08:54:17.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c8491640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c00cf370 con 0x7f02c00cc300 2024-04-25T08:54:17.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c8491640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01454b0 con 0x7f02c0144e70 2024-04-25T08:54:17.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c5a2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c00ce9d0 0x7f02c013c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c5a2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c00ce9d0 0x7f02c013c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38226/0 (socket says 172.21.15.55:38226) 2024-04-25T08:54:17.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c5a2c640 1 -- 172.21.15.55:0/2173703333 learned_addr learned my addr 172.21.15.55:0/2173703333 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:17.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c6a2e640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c0144e70 0x7f02c01425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c622d640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c00cc300 0x7f02c00b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c5a2c640 1 -- 172.21.15.55:0/2173703333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c0144e70 msgr2=0x7f02c01425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c5a2c640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c0144e70 0x7f02c01425c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c5a2c640 1 -- 172.21.15.55:0/2173703333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c00cc300 msgr2=0x7f02c00b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c5a2c640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c00cc300 0x7f02c00b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.785+0000 7f02c5a2c640 1 -- 172.21.15.55:0/2173703333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c013fa50 con 0x7f02c00ce9d0 2024-04-25T08:54:17.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.786+0000 7f02c5a2c640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c00ce9d0 0x7f02c013c000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f02b400e9b0 tx=0x7f02b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:17.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.786+0000 7f02beffd640 1 -- 172.21.15.55:0/2173703333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4017070 con 0x7f02c00ce9d0 2024-04-25T08:54:17.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.786+0000 7f02beffd640 1 -- 172.21.15.55:0/2173703333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b400c9a0 con 0x7f02c00ce9d0 2024-04-25T08:54:17.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.786+0000 7f02beffd640 1 -- 172.21.15.55:0/2173703333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b400cd90 con 0x7f02c00ce9d0 2024-04-25T08:54:17.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.786+0000 7f02c8491640 1 -- 172.21.15.55:0/2173703333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c00b3330 con 0x7f02c00ce9d0 2024-04-25T08:54:17.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.786+0000 7f02c8491640 1 -- 172.21.15.55:0/2173703333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c00b3bd0 con 0x7f02c00ce9d0 2024-04-25T08:54:17.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.787+0000 7f02c8491640 1 -- 172.21.15.55:0/2173703333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c00cb960 con 0x7f02c00ce9d0 2024-04-25T08:54:17.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.787+0000 7f02beffd640 1 -- 172.21.15.55:0/2173703333 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f02b401a070 con 0x7f02c00ce9d0 2024-04-25T08:54:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.788+0000 7f02beffd640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f02ac06b4d0 0x7f02ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.788+0000 7f02beffd640 1 -- 172.21.15.55:0/2173703333 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02b408a530 con 0x7f02c00ce9d0 2024-04-25T08:54:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.788+0000 7f02c622d640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f02ac06b4d0 0x7f02ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.788+0000 7f02c622d640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f02ac06b4d0 0x7f02ac06d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f02c006b160 tx=0x7f02b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:17.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.792+0000 7f02beffd640 1 -- 172.21.15.55:0/2173703333 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f02c00cb960 con 0x7f02c00ce9d0 2024-04-25T08:54:17.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.970+0000 7f02c8491640 1 -- 172.21.15.55:0/2173703333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02c00750b0 con 0x7f02c00ce9d0 2024-04-25T08:54:17.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.971+0000 7f02beffd640 1 -- 172.21.15.55:0/2173703333 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02b4058d60 con 0x7f02c00ce9d0 2024-04-25T08:54:17.961 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.972+0000 7f02c8491640 1 -- 172.21.15.55:0/2173703333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f02ac06b4d0 msgr2=0x7f02ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.972+0000 7f02c8491640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f02ac06b4d0 0x7f02ac06d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f02c006b160 tx=0x7f02b8009040 comp rx=0 tx=0).stop 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.972+0000 7f02c8491640 1 -- 172.21.15.55:0/2173703333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c00ce9d0 msgr2=0x7f02c013c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.972+0000 7f02c8491640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c00ce9d0 0x7f02c013c000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f02b400e9b0 tx=0x7f02b400ee70 comp rx=0 tx=0).stop 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.973+0000 7f02c8491640 1 -- 172.21.15.55:0/2173703333 shutdown_connections 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.973+0000 7f02c8491640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f02ac06b4d0 0x7f02ac06d990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.973+0000 7f02c8491640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c0144e70 0x7f02c01425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.973+0000 7f02c8491640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c00ce9d0 0x7f02c013c000 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.973+0000 7f02c8491640 1 --2- 172.21.15.55:0/2173703333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c00cc300 0x7f02c00b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.973+0000 7f02c8491640 1 -- 172.21.15.55:0/2173703333 >> 172.21.15.55:0/2173703333 conn(0x7f02c006aba0 msgr2=0x7f02c00ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.973+0000 7f02c8491640 1 -- 172.21.15.55:0/2173703333 shutdown_connections 2024-04-25T08:54:17.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:17.973+0000 7f02c8491640 1 -- 172.21.15.55:0/2173703333 wait complete. 2024-04-25T08:54:17.974 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:54:18.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.089+0000 7fb884970640 1 Processor -- start 2024-04-25T08:54:18.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.089+0000 7fb884970640 1 -- start start 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.089+0000 7fb884970640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb88015dc80 0x7fb880161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.089+0000 7fb884970640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8800b97c0 0x7fb8800b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb884970640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8800b5e40 con 0x7fb8800b5a30 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb884970640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8801627a0 con 0x7fb8800b97c0 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb884970640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8801621e0 con 0x7fb88015dc80 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb877fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8800b97c0 0x7fb8800b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb877fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8800b97c0 0x7fb8800b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38232/0 (socket says 172.21.15.55:38232) 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb877fff640 1 -- 172.21.15.55:0/1344052009 learned_addr learned my addr 172.21.15.55:0/1344052009 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb87e59c640 1 --2- 172.21.15.55:0/1344052009 >> v2:172.21.15.167:3300/0 conn(0x7fb88015dc80 0x7fb880161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb877fff640 1 -- 172.21.15.55:0/1344052009 >> v2:172.21.15.167:3300/0 conn(0x7fb88015dc80 msgr2=0x7fb880161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb877fff640 1 --2- 172.21.15.55:0/1344052009 >> v2:172.21.15.167:3300/0 conn(0x7fb88015dc80 0x7fb880161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb877fff640 1 -- 172.21.15.55:0/1344052009 >> v1:172.21.15.167:6789/0 conn(0x7fb8800b5a30 legacy=0x7fb88006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb877fff640 1 -- 172.21.15.55:0/1344052009 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8801624c0 con 0x7fb8800b97c0 2024-04-25T08:54:18.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.090+0000 7fb87e59c640 1 --2- 172.21.15.55:0/1344052009 >> v2:172.21.15.167:3300/0 conn(0x7fb88015dc80 0x7fb880161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:18.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.091+0000 7fb877fff640 1 --2- 172.21.15.55:0/1344052009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8800b97c0 0x7fb8800b54f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb88006dab0 tx=0x7fb86802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29f602d304b986b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:18.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.091+0000 7fb87dd9b640 1 -- 172.21.15.55:0/1344052009 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868037070 con 0x7fb8800b97c0 2024-04-25T08:54:18.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.091+0000 7fb87dd9b640 1 -- 172.21.15.55:0/1344052009 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb868032440 con 0x7fb8800b97c0 2024-04-25T08:54:18.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.091+0000 7fb87dd9b640 1 -- 172.21.15.55:0/1344052009 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868032810 con 0x7fb8800b97c0 2024-04-25T08:54:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.091+0000 7fb884970640 1 -- 172.21.15.55:0/1344052009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8800b97c0 msgr2=0x7fb8800b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.091+0000 7fb884970640 1 --2- 172.21.15.55:0/1344052009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8800b97c0 0x7fb8800b54f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb88006dab0 tx=0x7fb86802a230 comp rx=0 tx=0).stop 2024-04-25T08:54:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.091+0000 7fb884970640 1 -- 172.21.15.55:0/1344052009 shutdown_connections 2024-04-25T08:54:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.091+0000 7fb884970640 1 --2- 172.21.15.55:0/1344052009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8800b97c0 0x7fb8800b54f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.091+0000 7fb884970640 1 --2- 172.21.15.55:0/1344052009 >> v2:172.21.15.167:3300/0 conn(0x7fb88015dc80 0x7fb880161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.091+0000 7fb884970640 1 -- 172.21.15.55:0/1344052009 >> 172.21.15.55:0/1344052009 conn(0x7fb8800d04f0 msgr2=0x7fb8800d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.091+0000 7fb884970640 1 -- 172.21.15.55:0/1344052009 shutdown_connections 2024-04-25T08:54:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.092+0000 7fb884970640 1 -- 172.21.15.55:0/1344052009 wait complete. 2024-04-25T08:54:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.093+0000 7fb884970640 1 Processor -- start 2024-04-25T08:54:18.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.093+0000 7fb884970640 1 -- start start 2024-04-25T08:54:18.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb884970640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8800b5a30 0x7fb8800b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:18.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb884970640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8800b97c0 0x7fb8800caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:18.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb884970640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb88015dc80 0x7fb8801603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:18.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb884970640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb880161db0 con 0x7fb8800b97c0 2024-04-25T08:54:18.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb884970640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88015e060 con 0x7fb8800b5a30 2024-04-25T08:54:18.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb884970640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb880161f30 con 0x7fb88015dc80 2024-04-25T08:54:18.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb877fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8800b97c0 0x7fb8800caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb877fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8800b97c0 0x7fb8800caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38240/0 (socket says 172.21.15.55:38240) 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb877fff640 1 -- 172.21.15.55:0/3808980508 learned_addr learned my addr 172.21.15.55:0/3808980508 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb87e59c640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8800b5a30 0x7fb8800b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb87ed9d640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb88015dc80 0x7fb8801603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb877fff640 1 -- 172.21.15.55:0/3808980508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb88015dc80 msgr2=0x7fb8801603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb877fff640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb88015dc80 0x7fb8801603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb877fff640 1 -- 172.21.15.55:0/3808980508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8800b5a30 msgr2=0x7fb8800b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb877fff640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8800b5a30 0x7fb8800b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb877fff640 1 -- 172.21.15.55:0/3808980508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8801491d0 con 0x7fb8800b97c0 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb877fff640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8800b97c0 0x7fb8800caf00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb868000c00 tx=0x7fb8680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb876ffd640 1 -- 172.21.15.55:0/3808980508 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868041020 con 0x7fb8800b97c0 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb876ffd640 1 -- 172.21.15.55:0/3808980508 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb868030970 con 0x7fb8800b97c0 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb884970640 1 -- 172.21.15.55:0/3808980508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8801494b0 con 0x7fb8800b97c0 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb876ffd640 1 -- 172.21.15.55:0/3808980508 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868037040 con 0x7fb8800b97c0 2024-04-25T08:54:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.094+0000 7fb884970640 1 -- 172.21.15.55:0/3808980508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb880149a70 con 0x7fb8800b97c0 2024-04-25T08:54:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.096+0000 7fb884970640 1 -- 172.21.15.55:0/3808980508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8800750b0 con 0x7fb8800b97c0 2024-04-25T08:54:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.096+0000 7fb876ffd640 1 -- 172.21.15.55:0/3808980508 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb868044020 con 0x7fb8800b97c0 2024-04-25T08:54:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.096+0000 7fb876ffd640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb86006b4d0 0x7fb86006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.096+0000 7fb876ffd640 1 -- 172.21.15.55:0/3808980508 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8680aab70 con 0x7fb8800b97c0 2024-04-25T08:54:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.096+0000 7fb87e59c640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb86006b4d0 0x7fb86006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.097+0000 7fb87e59c640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb86006b4d0 0x7fb86006d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb87000a950 tx=0x7fb870008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:18.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.101+0000 7fb876ffd640 1 -- 172.21.15.55:0/3808980508 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb86804b030 con 0x7fb8800b97c0 2024-04-25T08:54:18.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.279+0000 7fb884970640 1 -- 172.21.15.55:0/3808980508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb880146e10 con 0x7fb8800b97c0 2024-04-25T08:54:18.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.280+0000 7fb876ffd640 1 -- 172.21.15.55:0/3808980508 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8800b5e40 con 0x7fb8800b97c0 2024-04-25T08:54:18.270 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:54:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 -- 172.21.15.55:0/3808980508 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb86006b4d0 msgr2=0x7fb86006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb86006b4d0 0x7fb86006d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb87000a950 tx=0x7fb870008040 comp rx=0 tx=0).stop 2024-04-25T08:54:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 -- 172.21.15.55:0/3808980508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8800b97c0 msgr2=0x7fb8800caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8800b97c0 0x7fb8800caf00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb868000c00 tx=0x7fb8680046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 -- 172.21.15.55:0/3808980508 shutdown_connections 2024-04-25T08:54:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb86006b4d0 0x7fb86006d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb88015dc80 0x7fb8801603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8800b97c0 0x7fb8800caf00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 --2- 172.21.15.55:0/3808980508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8800b5a30 0x7fb8800b7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 -- 172.21.15.55:0/3808980508 >> 172.21.15.55:0/3808980508 conn(0x7fb8800d04f0 msgr2=0x7fb8800d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:18.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 -- 172.21.15.55:0/3808980508 shutdown_connections 2024-04-25T08:54:18.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.282+0000 7fb884970640 1 -- 172.21.15.55:0/3808980508 wait complete. 2024-04-25T08:54:18.283 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:54:18.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.394+0000 7fdc47b1b640 1 Processor -- start 2024-04-25T08:54:18.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.395+0000 7fdc47b1b640 1 -- start start 2024-04-25T08:54:18.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.395+0000 7fdc47b1b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc401610b0 0x7fdc400b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:18.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.395+0000 7fdc47b1b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc40162040 con 0x7fdc400cef40 2024-04-25T08:54:18.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.395+0000 7fdc47b1b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc40162320 con 0x7fdc401618d0 2024-04-25T08:54:18.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.395+0000 7fdc47b1b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400d1ea0 con 0x7fdc401610b0 2024-04-25T08:54:18.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.395+0000 7fdc460b8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc400cef40 0x7fdc400d2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38548/0 (socket says 172.21.15.55:38548) 2024-04-25T08:54:18.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.396+0000 7fdc460b8640 1 -- 172.21.15.55:0/2270567695 learned_addr learned my addr 172.21.15.55:0/2270567695 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:18.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.396+0000 7fdc458b7640 1 --2- 172.21.15.55:0/2270567695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc401610b0 0x7fdc400b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:18.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.396+0000 7fdc448b5640 1 -- 172.21.15.55:0/2270567695 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357640791 0 0) 0x7fdc40162040 con 0x7fdc400cef40 2024-04-25T08:54:18.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.396+0000 7fdc448b5640 1 -- 172.21.15.55:0/2270567695 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc28003520 con 0x7fdc400cef40 2024-04-25T08:54:18.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.396+0000 7fdc448b5640 1 -- 172.21.15.55:0/2270567695 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369419442 0 0) 0x7fdc40162320 con 0x7fdc401618d0 2024-04-25T08:54:18.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.396+0000 7fdc448b5640 1 -- 172.21.15.55:0/2270567695 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc40162040 con 0x7fdc401618d0 2024-04-25T08:54:18.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.396+0000 7fdc458b7640 1 -- 172.21.15.55:0/2270567695 >> v1:172.21.15.167:6789/0 conn(0x7fdc401618d0 legacy=0x7fdc400ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.396+0000 7fdc458b7640 1 -- 172.21.15.55:0/2270567695 >> v1:172.21.15.55:6789/0 conn(0x7fdc400cef40 legacy=0x7fdc400d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.396+0000 7fdc448b5640 1 -- 172.21.15.55:0/2270567695 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1532408981 0 0) 0x7fdc28003520 con 0x7fdc400cef40 2024-04-25T08:54:18.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.396+0000 7fdc458b7640 1 -- 172.21.15.55:0/2270567695 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc40162600 con 0x7fdc401610b0 2024-04-25T08:54:18.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.397+0000 7fdc458b7640 1 --2- 172.21.15.55:0/2270567695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc401610b0 0x7fdc400b9580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc380097d0 tx=0x7fdc3802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2e6589155eb7761 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.397+0000 7fdc448b5640 1 -- 172.21.15.55:0/2270567695 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38037070 con 0x7fdc401610b0 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.397+0000 7fdc448b5640 1 -- 172.21.15.55:0/2270567695 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3802ab90 con 0x7fdc401610b0 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.397+0000 7fdc448b5640 1 -- 172.21.15.55:0/2270567695 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30001a10 con 0x7fdc401610b0 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.398+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2270567695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc401610b0 msgr2=0x7fdc400b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.398+0000 7fdc47b1b640 1 --2- 172.21.15.55:0/2270567695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc401610b0 0x7fdc400b9580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc380097d0 tx=0x7fdc3802a100 comp rx=0 tx=0).stop 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.398+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2270567695 shutdown_connections 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.398+0000 7fdc47b1b640 1 --2- 172.21.15.55:0/2270567695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc401610b0 0x7fdc400b9580 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.398+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2270567695 >> 172.21.15.55:0/2270567695 conn(0x7fdc400b5570 msgr2=0x7fdc400b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.398+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2270567695 shutdown_connections 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.398+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2270567695 wait complete. 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.399+0000 7fdc47b1b640 1 Processor -- start 2024-04-25T08:54:18.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.399+0000 7fdc47b1b640 1 -- start start 2024-04-25T08:54:18.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc47b1b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400cef40 0x7fdc40152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:18.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc47b1b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc401610b0 0x7fdc401549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc47b1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc401618d0 0x7fdc40154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc47b1b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc40161d10 con 0x7fdc401618d0 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc47b1b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400b6c00 con 0x7fdc401610b0 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc47b1b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc40161490 con 0x7fdc400cef40 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc460b8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc401618d0 0x7fdc40154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc460b8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc401618d0 0x7fdc40154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38246/0 (socket says 172.21.15.55:38246) 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc460b8640 1 -- 172.21.15.55:0/2555625185 learned_addr learned my addr 172.21.15.55:0/2555625185 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc450b6640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc401610b0 0x7fdc401549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc458b7640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400cef40 0x7fdc40152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc460b8640 1 -- 172.21.15.55:0/2555625185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400cef40 msgr2=0x7fdc40152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc460b8640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400cef40 0x7fdc40152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc460b8640 1 -- 172.21.15.55:0/2555625185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc401610b0 msgr2=0x7fdc401549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc460b8640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc401610b0 0x7fdc401549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc460b8640 1 -- 172.21.15.55:0/2555625185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc401555b0 con 0x7fdc401618d0 2024-04-25T08:54:18.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc460b8640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc401618d0 0x7fdc40154ee0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000cac0 tx=0x7fdc3000cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:18.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc3e7fc640 1 -- 172.21.15.55:0/2555625185 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30018070 con 0x7fdc401618d0 2024-04-25T08:54:18.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc3e7fc640 1 -- 172.21.15.55:0/2555625185 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3000a640 con 0x7fdc401618d0 2024-04-25T08:54:18.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2555625185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc40152850 con 0x7fdc401618d0 2024-04-25T08:54:18.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.400+0000 7fdc3e7fc640 1 -- 172.21.15.55:0/2555625185 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3000aa30 con 0x7fdc401618d0 2024-04-25T08:54:18.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.401+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2555625185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc40152e10 con 0x7fdc401618d0 2024-04-25T08:54:18.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.402+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2555625185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc400750b0 con 0x7fdc401618d0 2024-04-25T08:54:18.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.402+0000 7fdc3e7fc640 1 -- 172.21.15.55:0/2555625185 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdc3001b070 con 0x7fdc401618d0 2024-04-25T08:54:18.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.403+0000 7fdc3e7fc640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b500 0x7fdc2c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:18.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.403+0000 7fdc3e7fc640 1 -- 172.21.15.55:0/2555625185 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc300898d0 con 0x7fdc401618d0 2024-04-25T08:54:18.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.403+0000 7fdc458b7640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b500 0x7fdc2c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:18.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.403+0000 7fdc458b7640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b500 0x7fdc2c06d9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdc38034000 tx=0x7fdc3802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:18.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.407+0000 7fdc3e7fc640 1 -- 172.21.15.55:0/2555625185 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdc30058750 con 0x7fdc401618d0 2024-04-25T08:54:18.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.604+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2555625185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdc400cf620 con 0x7fdc401618d0 2024-04-25T08:54:18.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.604+0000 7fdc3e7fc640 1 -- 172.21.15.55:0/2555625185 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdc30058050 con 0x7fdc401618d0 2024-04-25T08:54:18.594 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T08:54:18.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2555625185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b500 msgr2=0x7fdc2c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b500 0x7fdc2c06d9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdc38034000 tx=0x7fdc3802e000 comp rx=0 tx=0).stop 2024-04-25T08:54:18.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2555625185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc401618d0 msgr2=0x7fdc40154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:18.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc401618d0 0x7fdc40154ee0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000cac0 tx=0x7fdc3000cec0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2555625185 shutdown_connections 2024-04-25T08:54:18.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b500 0x7fdc2c06d9c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc401618d0 0x7fdc40154ee0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc401610b0 0x7fdc401549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 --2- 172.21.15.55:0/2555625185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400cef40 0x7fdc40152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:18.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2555625185 >> 172.21.15.55:0/2555625185 conn(0x7fdc400b5570 msgr2=0x7fdc400b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:18.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2555625185 shutdown_connections 2024-04-25T08:54:18.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:18.606+0000 7fdc47b1b640 1 -- 172.21.15.55:0/2555625185 wait complete. 2024-04-25T08:54:18.607 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T08:54:18.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:18.607 DEBUG:teuthology.orchestra.run.smithi167:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T08:54:18.638 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T08:54:18.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:18.639 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T08:54:18.779 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:54:18.779 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:18.795 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:54:18.795 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:18.852 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:54:18.852 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:18.908 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:19.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.061+0000 7f3d0eff4640 1 Processor -- start 2024-04-25T08:54:19.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.061+0000 7f3d0eff4640 1 -- start start 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.061+0000 7f3d0eff4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d081476d0 0x7f3d080ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.061+0000 7f3d0eff4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3d080cd060 0x7f3d0806e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.061+0000 7f3d0eff4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d0806d690 0x7f3d0806edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.061+0000 7f3d0eff4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d080719f0 con 0x7f3d0806d690 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.061+0000 7f3d0eff4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d08071cd0 con 0x7f3d080cd060 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.061+0000 7f3d0eff4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08071fb0 con 0x7f3d081476d0 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.062+0000 7f3d0d591640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d0806d690 0x7f3d0806edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.062+0000 7f3d0d591640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d0806d690 0x7f3d0806edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41746/0 (socket says 172.21.15.55:41746) 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.062+0000 7f3d0d591640 1 -- 172.21.15.55:0/2130765800 learned_addr learned my addr 172.21.15.55:0/2130765800 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.062+0000 7f3d07fff640 1 --2- 172.21.15.55:0/2130765800 >> v2:172.21.15.167:3300/0 conn(0x7f3d080cd060 0x7f3d0806e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.062+0000 7f3d0cd90640 1 --2- 172.21.15.55:0/2130765800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d081476d0 0x7f3d080ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.062+0000 7f3d0d591640 1 -- 172.21.15.55:0/2130765800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d081476d0 msgr2=0x7f3d080ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.062+0000 7f3d0d591640 1 --2- 172.21.15.55:0/2130765800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d081476d0 0x7f3d080ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.062+0000 7f3d0d591640 1 -- 172.21.15.55:0/2130765800 >> v2:172.21.15.167:3300/0 conn(0x7f3d080cd060 msgr2=0x7f3d0806e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.062+0000 7f3d0d591640 1 --2- 172.21.15.55:0/2130765800 >> v2:172.21.15.167:3300/0 conn(0x7f3d080cd060 0x7f3d0806e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.062+0000 7f3d0d591640 1 -- 172.21.15.55:0/2130765800 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08072290 con 0x7f3d0806d690 2024-04-25T08:54:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.062+0000 7f3d0cd90640 1 --2- 172.21.15.55:0/2130765800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d081476d0 0x7f3d080ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d0d591640 1 --2- 172.21.15.55:0/2130765800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d0806d690 0x7f3d0806edf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3d0806d050 tx=0x7f3d0002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41591ac87c77a116 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d077fe640 1 -- 172.21.15.55:0/2130765800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00036070 con 0x7f3d0806d690 2024-04-25T08:54:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d077fe640 1 -- 172.21.15.55:0/2130765800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d00031600 con 0x7f3d0806d690 2024-04-25T08:54:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d077fe640 1 -- 172.21.15.55:0/2130765800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d000319d0 con 0x7f3d0806d690 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d0eff4640 1 -- 172.21.15.55:0/2130765800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d0806d690 msgr2=0x7f3d0806edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d0eff4640 1 --2- 172.21.15.55:0/2130765800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d0806d690 0x7f3d0806edf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3d0806d050 tx=0x7f3d0002a730 comp rx=0 tx=0).stop 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d0eff4640 1 -- 172.21.15.55:0/2130765800 shutdown_connections 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d0eff4640 1 --2- 172.21.15.55:0/2130765800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d0806d690 0x7f3d0806edf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d0eff4640 1 --2- 172.21.15.55:0/2130765800 >> v2:172.21.15.167:3300/0 conn(0x7f3d080cd060 0x7f3d0806e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d0eff4640 1 --2- 172.21.15.55:0/2130765800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d081476d0 0x7f3d080ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d0eff4640 1 -- 172.21.15.55:0/2130765800 >> 172.21.15.55:0/2130765800 conn(0x7f3d080cc540 msgr2=0x7f3d080cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d0eff4640 1 -- 172.21.15.55:0/2130765800 shutdown_connections 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.063+0000 7f3d0eff4640 1 -- 172.21.15.55:0/2130765800 wait complete. 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.065+0000 7f3d0eff4640 1 Processor -- start 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.065+0000 7f3d0eff4640 1 -- start start 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.065+0000 7f3d0eff4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d0806d690 0x7f3d08145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.065+0000 7f3d0eff4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d080cd060 0x7f3d080abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.065+0000 7f3d0eff4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d081476d0 0x7f3d080ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.065+0000 7f3d0eff4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080717b0 con 0x7f3d080cd060 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d0eff4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08071630 con 0x7f3d0806d690 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d0eff4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080c9260 con 0x7f3d081476d0 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d080cd060 0x7f3d080abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d080cd060 0x7f3d080abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41750/0 (socket says 172.21.15.55:41750) 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d07fff640 1 -- 172.21.15.55:0/1115616013 learned_addr learned my addr 172.21.15.55:0/1115616013 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d0d591640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d081476d0 0x7f3d080ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d07fff640 1 -- 172.21.15.55:0/1115616013 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d081476d0 msgr2=0x7f3d080ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d07fff640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d081476d0 0x7f3d080ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d07fff640 1 -- 172.21.15.55:0/1115616013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d0806d690 msgr2=0x7f3d08145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d0cd90640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d0806d690 0x7f3d08145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d07fff640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d0806d690 0x7f3d08145060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d07fff640 1 -- 172.21.15.55:0/1115616013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d081438a0 con 0x7f3d080cd060 2024-04-25T08:54:19.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d07fff640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d080cd060 0x7f3d080abf30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400d7d0 tx=0x7f3cf400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d057fa640 1 -- 172.21.15.55:0/1115616013 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40096a0 con 0x7f3d080cd060 2024-04-25T08:54:19.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d057fa640 1 -- 172.21.15.55:0/1115616013 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf4019070 con 0x7f3d080cd060 2024-04-25T08:54:19.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d0eff4640 1 -- 172.21.15.55:0/1115616013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d080ae960 con 0x7f3d080cd060 2024-04-25T08:54:19.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d057fa640 1 -- 172.21.15.55:0/1115616013 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4009a60 con 0x7f3d080cd060 2024-04-25T08:54:19.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.066+0000 7f3d0eff4640 1 -- 172.21.15.55:0/1115616013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d080aef20 con 0x7f3d080cd060 2024-04-25T08:54:19.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.067+0000 7f3d0eff4640 1 -- 172.21.15.55:0/1115616013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d080c9d90 con 0x7f3d080cd060 2024-04-25T08:54:19.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.068+0000 7f3d057fa640 1 -- 172.21.15.55:0/1115616013 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3cf4009c00 con 0x7f3d080cd060 2024-04-25T08:54:19.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.068+0000 7f3d057fa640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cec06b4d0 0x7f3cec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.068+0000 7f3d057fa640 1 -- 172.21.15.55:0/1115616013 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cf408a590 con 0x7f3d080cd060 2024-04-25T08:54:19.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.068+0000 7f3d0cd90640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cec06b4d0 0x7f3cec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.069+0000 7f3d0cd90640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cec06b4d0 0x7f3cec06d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00b840 tx=0x7f3cfc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.072+0000 7f3d057fa640 1 -- 172.21.15.55:0/1115616013 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3d080c9d90 con 0x7f3d080cd060 2024-04-25T08:54:19.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.252+0000 7f3d0eff4640 1 -- 172.21.15.55:0/1115616013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d080749b0 con 0x7f3d080cd060 2024-04-25T08:54:19.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.253+0000 7f3d057fa640 1 -- 172.21.15.55:0/1115616013 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f3cf40594a0 con 0x7f3d080cd060 2024-04-25T08:54:19.244 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:19.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 -- 172.21.15.55:0/1115616013 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cec06b4d0 msgr2=0x7f3cec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cec06b4d0 0x7f3cec06d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00b840 tx=0x7f3cfc008040 comp rx=0 tx=0).stop 2024-04-25T08:54:19.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 -- 172.21.15.55:0/1115616013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d080cd060 msgr2=0x7f3d080abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d080cd060 0x7f3d080abf30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400d7d0 tx=0x7f3cf400dc90 comp rx=0 tx=0).stop 2024-04-25T08:54:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 -- 172.21.15.55:0/1115616013 shutdown_connections 2024-04-25T08:54:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cec06b4d0 0x7f3cec06d990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d081476d0 0x7f3d080ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d080cd060 0x7f3d080abf30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 --2- 172.21.15.55:0/1115616013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d0806d690 0x7f3d08145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 -- 172.21.15.55:0/1115616013 >> 172.21.15.55:0/1115616013 conn(0x7f3d080cc540 msgr2=0x7f3d080b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 -- 172.21.15.55:0/1115616013 shutdown_connections 2024-04-25T08:54:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.255+0000 7f3d0eff4640 1 -- 172.21.15.55:0/1115616013 wait complete. 2024-04-25T08:54:19.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:19.258 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:19.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.371+0000 7fb64a1d5640 1 Processor -- start 2024-04-25T08:54:19.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.371+0000 7fb64a1d5640 1 -- start start 2024-04-25T08:54:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.372+0000 7fb64a1d5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb64415df30 0x7fb6440cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.372+0000 7fb64a1d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6440d0200 con 0x7fb64415db50 2024-04-25T08:54:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.372+0000 7fb64a1d5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6440d04e0 con 0x7fb6440d12a0 2024-04-25T08:54:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.372+0000 7fb64a1d5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64406c020 con 0x7fb64415df30 2024-04-25T08:54:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.372+0000 7fb6437fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb64415db50 0x7fb64406cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35882/0 (socket says 172.21.15.55:35882) 2024-04-25T08:54:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.372+0000 7fb6437fe640 1 -- 172.21.15.55:0/881944249 learned_addr learned my addr 172.21.15.55:0/881944249 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458214383 0 0) 0x7fb6440d0200 con 0x7fb64415db50 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb62c003520 con 0x7fb64415db50 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb642ffd640 1 --2- 172.21.15.55:0/881944249 >> v2:172.21.15.167:3300/0 conn(0x7fb64415df30 0x7fb6440cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 236111539 0 0) 0x7fb62c003520 con 0x7fb64415db50 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 >> v2:172.21.15.167:3300/0 conn(0x7fb64415df30 msgr2=0x7fb6440cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 --2- 172.21.15.55:0/881944249 >> v2:172.21.15.167:3300/0 conn(0x7fb64415df30 0x7fb6440cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 >> v1:172.21.15.167:6789/0 conn(0x7fb6440d12a0 legacy=0x7fb644099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6440d07c0 con 0x7fb64415db50 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fb634001670 con 0x7fb64415db50 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 >> v1:172.21.15.55:6789/0 conn(0x7fb64415db50 legacy=0x7fb64406cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 0x7fb62c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb62c004800 0x7fb62c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb62c0051c0 0x7fb62c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64406c020 con 0x7fb62c0039b0 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c00c060 con 0x7fb62c0051c0 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c00c260 con 0x7fb62c004800 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6437fe640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 0x7fb62c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb642ffd640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb62c004800 0x7fb62c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb643fff640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb62c0051c0 0x7fb62c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6437fe640 1 -- 172.21.15.55:0/881944249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb62c004800 msgr2=0x7fb62c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6437fe640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb62c004800 0x7fb62c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6437fe640 1 -- 172.21.15.55:0/881944249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb62c0051c0 msgr2=0x7fb62c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6437fe640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb62c0051c0 0x7fb62c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb6437fe640 1 -- 172.21.15.55:0/881944249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c003520 con 0x7fb62c0039b0 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb642ffd640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb62c004800 0x7fb62c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb643fff640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb62c0051c0 0x7fb62c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.373+0000 7fb643fff640 1 -- 172.21.15.55:0/881944249 reap_dead start 2024-04-25T08:54:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.374+0000 7fb6437fe640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 0x7fb62c003dd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb63400c210 tx=0x7fb62c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a1d55a58f66e9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.374+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634007d30 con 0x7fb62c0039b0 2024-04-25T08:54:19.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.374+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634005af0 con 0x7fb62c0039b0 2024-04-25T08:54:19.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.374+0000 7fb6427fc640 1 -- 172.21.15.55:0/881944249 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634007070 con 0x7fb62c0039b0 2024-04-25T08:54:19.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.375+0000 7fb64a1d5640 1 -- 172.21.15.55:0/881944249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 msgr2=0x7fb62c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.375+0000 7fb64a1d5640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 0x7fb62c003dd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb63400c210 tx=0x7fb62c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:19.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.375+0000 7fb64a1d5640 1 -- 172.21.15.55:0/881944249 shutdown_connections 2024-04-25T08:54:19.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.375+0000 7fb64a1d5640 1 --2- 172.21.15.55:0/881944249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 0x7fb62c003dd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.375+0000 7fb64a1d5640 1 -- 172.21.15.55:0/881944249 >> 172.21.15.55:0/881944249 conn(0x7fb6440b3430 msgr2=0x7fb6440b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:19.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.375+0000 7fb64a1d5640 1 -- 172.21.15.55:0/881944249 shutdown_connections 2024-04-25T08:54:19.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.375+0000 7fb64a1d5640 1 -- 172.21.15.55:0/881944249 wait complete. 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.376+0000 7fb64a1d5640 1 Processor -- start 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.376+0000 7fb64a1d5640 1 -- start start 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb64a1d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 0x7fb644152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb64a1d5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6440c7ef0 0x7fb6441580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb64a1d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb644158630 0x7fb6440c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb64a1d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440cfb80 con 0x7fb62c0039b0 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb64a1d5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440d0d80 con 0x7fb6440c7ef0 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb64a1d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440cfd00 con 0x7fb644158630 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb6437fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 0x7fb644152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb6437fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 0x7fb644152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41756/0 (socket says 172.21.15.55:41756) 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb6437fe640 1 -- 172.21.15.55:0/1815111387 learned_addr learned my addr 172.21.15.55:0/1815111387 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb642ffd640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6440c7ef0 0x7fb6441580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb643fff640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb644158630 0x7fb6440c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb6437fe640 1 -- 172.21.15.55:0/1815111387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb644158630 msgr2=0x7fb6440c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb6437fe640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb644158630 0x7fb6440c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb6437fe640 1 -- 172.21.15.55:0/1815111387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6440c7ef0 msgr2=0x7fb6441580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb6437fe640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6440c7ef0 0x7fb6441580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb6437fe640 1 -- 172.21.15.55:0/1815111387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6440c6e50 con 0x7fb62c0039b0 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.377+0000 7fb642ffd640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6440c7ef0 0x7fb6441580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.378+0000 7fb6437fe640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 0x7fb644152d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb634034040 tx=0x7fb634001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.378+0000 7fb62bfff640 1 -- 172.21.15.55:0/1815111387 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634041070 con 0x7fb62c0039b0 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.378+0000 7fb62bfff640 1 -- 172.21.15.55:0/1815111387 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634000ed0 con 0x7fb62c0039b0 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.378+0000 7fb62bfff640 1 -- 172.21.15.55:0/1815111387 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634007290 con 0x7fb62c0039b0 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.378+0000 7fb64a1d5640 1 -- 172.21.15.55:0/1815111387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6440c7130 con 0x7fb62c0039b0 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.378+0000 7fb64a1d5640 1 -- 172.21.15.55:0/1815111387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6440c76f0 con 0x7fb62c0039b0 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.379+0000 7fb64a1d5640 1 -- 172.21.15.55:0/1815111387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6440c8810 con 0x7fb62c0039b0 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.379+0000 7fb62bfff640 1 -- 172.21.15.55:0/1815111387 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb634044070 con 0x7fb62c0039b0 2024-04-25T08:54:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.380+0000 7fb62bfff640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb63006b4d0 0x7fb63006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.380+0000 7fb62bfff640 1 -- 172.21.15.55:0/1815111387 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6340aa1d0 con 0x7fb62c0039b0 2024-04-25T08:54:19.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.380+0000 7fb642ffd640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb63006b4d0 0x7fb63006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.380+0000 7fb642ffd640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb63006b4d0 0x7fb63006d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb644071470 tx=0x7fb638008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.384+0000 7fb62bfff640 1 -- 172.21.15.55:0/1815111387 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb634079050 con 0x7fb62c0039b0 2024-04-25T08:54:19.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.563+0000 7fb64a1d5640 1 -- 172.21.15.55:0/1815111387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb644158a10 con 0x7fb62c0039b0 2024-04-25T08:54:19.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.564+0000 7fb62bfff640 1 -- 172.21.15.55:0/1815111387 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb634078950 con 0x7fb62c0039b0 2024-04-25T08:54:19.554 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:19.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.565+0000 7fb64a1d5640 1 -- 172.21.15.55:0/1815111387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb63006b4d0 msgr2=0x7fb63006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.565+0000 7fb64a1d5640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb63006b4d0 0x7fb63006d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb644071470 tx=0x7fb638008040 comp rx=0 tx=0).stop 2024-04-25T08:54:19.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.565+0000 7fb64a1d5640 1 -- 172.21.15.55:0/1815111387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 msgr2=0x7fb644152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.565+0000 7fb64a1d5640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 0x7fb644152d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb634034040 tx=0x7fb634001a40 comp rx=0 tx=0).stop 2024-04-25T08:54:19.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.566+0000 7fb64a1d5640 1 -- 172.21.15.55:0/1815111387 shutdown_connections 2024-04-25T08:54:19.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.566+0000 7fb64a1d5640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb63006b4d0 0x7fb63006d990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.566+0000 7fb64a1d5640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb644158630 0x7fb6440c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.566+0000 7fb64a1d5640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6440c7ef0 0x7fb6441580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.566+0000 7fb64a1d5640 1 --2- 172.21.15.55:0/1815111387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c0039b0 0x7fb644152d80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.566+0000 7fb64a1d5640 1 -- 172.21.15.55:0/1815111387 >> 172.21.15.55:0/1815111387 conn(0x7fb6440b3430 msgr2=0x7fb644157070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:19.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.566+0000 7fb64a1d5640 1 -- 172.21.15.55:0/1815111387 shutdown_connections 2024-04-25T08:54:19.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.566+0000 7fb64a1d5640 1 -- 172.21.15.55:0/1815111387 wait complete. 2024-04-25T08:54:19.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:54:19.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.682+0000 7f33cc9c1640 1 Processor -- start 2024-04-25T08:54:19.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.682+0000 7f33cc9c1640 1 -- start start 2024-04-25T08:54:19.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.683+0000 7f33cc9c1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33c80b5580 0x7f33c80b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.683+0000 7f33cc9c1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c806c4b0 con 0x7f33c80b98b0 2024-04-25T08:54:19.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.683+0000 7f33cc9c1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c806c790 con 0x7f33c80b24c0 2024-04-25T08:54:19.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.683+0000 7f33cc9c1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c815bb80 con 0x7f33c80b5580 2024-04-25T08:54:19.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.683+0000 7f33c5d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33c80b5580 0x7f33c80b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.683+0000 7f33c659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f33c80b98b0 0x7f33c815eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35890/0 (socket says 172.21.15.55:35890) 2024-04-25T08:54:19.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.683+0000 7f33c659c640 1 -- 172.21.15.55:0/163176123 learned_addr learned my addr 172.21.15.55:0/163176123 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:19.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.683+0000 7f33c5d9b640 1 --2- 172.21.15.55:0/163176123 >> v2:172.21.15.55:3300/0 conn(0x7f33c80b5580 0x7f33c80b5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41768/0 (socket says 172.21.15.55:41768) 2024-04-25T08:54:19.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.684+0000 7f33c5d9b640 1 -- 172.21.15.55:0/163176123 >> v1:172.21.15.167:6789/0 conn(0x7f33c80b24c0 legacy=0x7f33c80b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:19.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.684+0000 7f33c5d9b640 1 -- 172.21.15.55:0/163176123 >> v1:172.21.15.55:6789/0 conn(0x7f33c80b98b0 legacy=0x7f33c815eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.684+0000 7f33c5d9b640 1 -- 172.21.15.55:0/163176123 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c806ca70 con 0x7f33c80b5580 2024-04-25T08:54:19.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.684+0000 7f33c5d9b640 1 --2- 172.21.15.55:0/163176123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c80b5580 0x7f33c80b5a30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f33b00097a0 tx=0x7f33b002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ecefd31d38a503 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.684+0000 7f33c559a640 1 -- 172.21.15.55:0/163176123 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0037070 con 0x7f33c80b5580 2024-04-25T08:54:19.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.685+0000 7f33c559a640 1 -- 172.21.15.55:0/163176123 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b002adc0 con 0x7f33c80b5580 2024-04-25T08:54:19.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.685+0000 7f33c559a640 1 -- 172.21.15.55:0/163176123 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0032660 con 0x7f33c80b5580 2024-04-25T08:54:19.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.685+0000 7f33cc9c1640 1 -- 172.21.15.55:0/163176123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c80b5580 msgr2=0x7f33c80b5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.685+0000 7f33cc9c1640 1 --2- 172.21.15.55:0/163176123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c80b5580 0x7f33c80b5a30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f33b00097a0 tx=0x7f33b002a0b0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.685+0000 7f33cc9c1640 1 -- 172.21.15.55:0/163176123 shutdown_connections 2024-04-25T08:54:19.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.685+0000 7f33cc9c1640 1 --2- 172.21.15.55:0/163176123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c80b5580 0x7f33c80b5a30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.685+0000 7f33cc9c1640 1 -- 172.21.15.55:0/163176123 >> 172.21.15.55:0/163176123 conn(0x7f33c80d0580 msgr2=0x7f33c80d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:19.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.685+0000 7f33cc9c1640 1 -- 172.21.15.55:0/163176123 shutdown_connections 2024-04-25T08:54:19.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.685+0000 7f33cc9c1640 1 -- 172.21.15.55:0/163176123 wait complete. 2024-04-25T08:54:19.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.686+0000 7f33cc9c1640 1 Processor -- start 2024-04-25T08:54:19.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.686+0000 7f33cc9c1640 1 -- start start 2024-04-25T08:54:19.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.687+0000 7f33cc9c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c80b24c0 0x7f33c815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.687+0000 7f33cc9c1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c80b5580 0x7f33c80c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.687+0000 7f33cc9c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33c8151990 0x7f33c8151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.687+0000 7f33cc9c1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80cec40 con 0x7f33c80b24c0 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.687+0000 7f33cc9c1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c806c140 con 0x7f33c80b5580 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.687+0000 7f33cc9c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80b3000 con 0x7f33c8151990 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.687+0000 7f33c659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c80b24c0 0x7f33c815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.687+0000 7f33c659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c80b24c0 0x7f33c815aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41770/0 (socket says 172.21.15.55:41770) 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.687+0000 7f33c659c640 1 -- 172.21.15.55:0/722336707 learned_addr learned my addr 172.21.15.55:0/722336707 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.687+0000 7f33c5d9b640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c80b5580 0x7f33c80c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.687+0000 7f33c6d9d640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33c8151990 0x7f33c8151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.688+0000 7f33c659c640 1 -- 172.21.15.55:0/722336707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33c8151990 msgr2=0x7f33c8151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.688+0000 7f33c659c640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33c8151990 0x7f33c8151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.688+0000 7f33c659c640 1 -- 172.21.15.55:0/722336707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c80b5580 msgr2=0x7f33c80c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.688+0000 7f33c659c640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c80b5580 0x7f33c80c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.688+0000 7f33c659c640 1 -- 172.21.15.55:0/722336707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c80c90f0 con 0x7f33c80b24c0 2024-04-25T08:54:19.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.688+0000 7f33c659c640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c80b24c0 0x7f33c815aaf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f33b800caa0 tx=0x7f33b800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.688+0000 7f33beffd640 1 -- 172.21.15.55:0/722336707 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8017070 con 0x7f33c80b24c0 2024-04-25T08:54:19.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.688+0000 7f33beffd640 1 -- 172.21.15.55:0/722336707 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b800aba0 con 0x7f33c80b24c0 2024-04-25T08:54:19.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.688+0000 7f33beffd640 1 -- 172.21.15.55:0/722336707 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8012400 con 0x7f33c80b24c0 2024-04-25T08:54:19.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.688+0000 7f33cc9c1640 1 -- 172.21.15.55:0/722336707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c80c93d0 con 0x7f33c80b24c0 2024-04-25T08:54:19.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.688+0000 7f33cc9c1640 1 -- 172.21.15.55:0/722336707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c80c9990 con 0x7f33c80b24c0 2024-04-25T08:54:19.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.689+0000 7f33cc9c1640 1 -- 172.21.15.55:0/722336707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c80750b0 con 0x7f33c80b24c0 2024-04-25T08:54:19.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.689+0000 7f33beffd640 1 -- 172.21.15.55:0/722336707 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f33b801a070 con 0x7f33c80b24c0 2024-04-25T08:54:19.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.690+0000 7f33beffd640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f33a806b500 0x7f33a806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.690+0000 7f33beffd640 1 -- 172.21.15.55:0/722336707 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33b8089e00 con 0x7f33c80b24c0 2024-04-25T08:54:19.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.690+0000 7f33c5d9b640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f33a806b500 0x7f33a806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.690+0000 7f33c5d9b640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f33a806b500 0x7f33a806d9c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f33b0034000 tx=0x7f33b002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.694+0000 7f33beffd640 1 -- 172.21.15.55:0/722336707 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f33b8058630 con 0x7f33c80b24c0 2024-04-25T08:54:19.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.874+0000 7f33cc9c1640 1 -- 172.21.15.55:0/722336707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33c80c9bd0 con 0x7f33c80b24c0 2024-04-25T08:54:19.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.875+0000 7f33beffd640 1 -- 172.21.15.55:0/722336707 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33b805c6d0 con 0x7f33c80b24c0 2024-04-25T08:54:19.865 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.876+0000 7f33cc9c1640 1 -- 172.21.15.55:0/722336707 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f33a806b500 msgr2=0x7f33a806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.876+0000 7f33cc9c1640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f33a806b500 0x7f33a806d9c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f33b0034000 tx=0x7f33b002e000 comp rx=0 tx=0).stop 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.876+0000 7f33cc9c1640 1 -- 172.21.15.55:0/722336707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c80b24c0 msgr2=0x7f33c815aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.876+0000 7f33cc9c1640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c80b24c0 0x7f33c815aaf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f33b800caa0 tx=0x7f33b800cf60 comp rx=0 tx=0).stop 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.876+0000 7f33cc9c1640 1 -- 172.21.15.55:0/722336707 shutdown_connections 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.876+0000 7f33cc9c1640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f33a806b500 0x7f33a806d9c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.876+0000 7f33cc9c1640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33c8151990 0x7f33c8151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.876+0000 7f33cc9c1640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c80b5580 0x7f33c80c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.876+0000 7f33cc9c1640 1 --2- 172.21.15.55:0/722336707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c80b24c0 0x7f33c815aaf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.876+0000 7f33cc9c1640 1 -- 172.21.15.55:0/722336707 >> 172.21.15.55:0/722336707 conn(0x7f33c80d0580 msgr2=0x7f33c8160b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.876+0000 7f33cc9c1640 1 -- 172.21.15.55:0/722336707 shutdown_connections 2024-04-25T08:54:19.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.877+0000 7f33cc9c1640 1 -- 172.21.15.55:0/722336707 wait complete. 2024-04-25T08:54:19.877 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:54:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.991+0000 7fc2846cb640 1 Processor -- start 2024-04-25T08:54:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.991+0000 7fc2846cb640 1 -- start start 2024-04-25T08:54:19.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.992+0000 7fc2846cb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc27c0b2740 0x7fc27c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.992+0000 7fc2846cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c06c150 con 0x7fc27c0d0490 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.992+0000 7fc2846cb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c06c430 con 0x7fc27c0ce1a0 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.992+0000 7fc2846cb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c0d2000 con 0x7fc27c0b2740 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.992+0000 7fc282467640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc27c0d0490 0x7fc27c0d0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35902/0 (socket says 172.21.15.55:35902) 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.992+0000 7fc282467640 1 -- 172.21.15.55:0/1207360671 learned_addr learned my addr 172.21.15.55:0/1207360671 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.992+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094232952 0 0) 0x7fc27c06c150 con 0x7fc27c0d0490 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.992+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc268003520 con 0x7fc27c0d0490 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.992+0000 7fc281c66640 1 --2- 172.21.15.55:0/1207360671 >> v2:172.21.15.167:3300/0 conn(0x7fc27c0b2740 0x7fc27c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.992+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2832506842 0 0) 0x7fc268003520 con 0x7fc27c0d0490 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 >> v2:172.21.15.167:3300/0 conn(0x7fc27c0b2740 msgr2=0x7fc27c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 --2- 172.21.15.55:0/1207360671 >> v2:172.21.15.167:3300/0 conn(0x7fc27c0b2740 0x7fc27c15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 >> v1:172.21.15.167:6789/0 conn(0x7fc27c0ce1a0 legacy=0x7fc27c0ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c06c710 con 0x7fc27c0d0490 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc278001670 con 0x7fc27c0d0490 2024-04-25T08:54:19.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 >> v1:172.21.15.55:6789/0 conn(0x7fc27c0d0490 legacy=0x7fc27c0d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680039b0 0x7fc268003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc268004800 0x7fc268004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2680051c0 0x7fc26800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26800c130 con 0x7fc2680039b0 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26800c2e0 con 0x7fc2680051c0 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26800c4e0 con 0x7fc268004800 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc282467640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680039b0 0x7fc268003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281c66640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc268004800 0x7fc268004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc282c68640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2680051c0 0x7fc26800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc282467640 1 -- 172.21.15.55:0/1207360671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc268004800 msgr2=0x7fc268004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc282467640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc268004800 0x7fc268004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc282467640 1 -- 172.21.15.55:0/1207360671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2680051c0 msgr2=0x7fc26800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc282467640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2680051c0 0x7fc26800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc282c68640 1 -- 172.21.15.55:0/1207360671 reap_dead start 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc282467640 1 -- 172.21.15.55:0/1207360671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268003520 con 0x7fc2680039b0 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.993+0000 7fc281c66640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc268004800 0x7fc268004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.994+0000 7fc282467640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680039b0 0x7fc268003dd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc27800c210 tx=0x7fc268005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee639069dbe3418 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.994+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc278007d30 con 0x7fc2680039b0 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.994+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc278005ad0 con 0x7fc2680039b0 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.994+0000 7fc281465640 1 -- 172.21.15.55:0/1207360671 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc278007070 con 0x7fc2680039b0 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.994+0000 7fc2846cb640 1 -- 172.21.15.55:0/1207360671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680039b0 msgr2=0x7fc268003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.994+0000 7fc2846cb640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680039b0 0x7fc268003dd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc27800c210 tx=0x7fc268005830 comp rx=0 tx=0).stop 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.995+0000 7fc2846cb640 1 -- 172.21.15.55:0/1207360671 shutdown_connections 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.995+0000 7fc2846cb640 1 --2- 172.21.15.55:0/1207360671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680039b0 0x7fc268003dd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.995+0000 7fc2846cb640 1 -- 172.21.15.55:0/1207360671 >> 172.21.15.55:0/1207360671 conn(0x7fc27c0b5660 msgr2=0x7fc27c0b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.995+0000 7fc2846cb640 1 -- 172.21.15.55:0/1207360671 shutdown_connections 2024-04-25T08:54:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.995+0000 7fc2846cb640 1 -- 172.21.15.55:0/1207360671 wait complete. 2024-04-25T08:54:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.996+0000 7fc2846cb640 1 Processor -- start 2024-04-25T08:54:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.996+0000 7fc2846cb640 1 -- start start 2024-04-25T08:54:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.996+0000 7fc2846cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2680039b0 0x7fc27c15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.996+0000 7fc2846cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc27c1570c0 0x7fc27c14ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.996+0000 7fc2846cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c0cc6a0 0x7fc27c0ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.996+0000 7fc2846cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c15e020 con 0x7fc27c0cc6a0 2024-04-25T08:54:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.996+0000 7fc2846cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c15ec90 con 0x7fc2680039b0 2024-04-25T08:54:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.996+0000 7fc2846cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c15ee10 con 0x7fc27c1570c0 2024-04-25T08:54:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc282c68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c0cc6a0 0x7fc27c0ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc282c68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c0cc6a0 0x7fc27c0ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41798/0 (socket says 172.21.15.55:41798) 2024-04-25T08:54:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc282c68640 1 -- 172.21.15.55:0/3231765261 learned_addr learned my addr 172.21.15.55:0/3231765261 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc282467640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2680039b0 0x7fc27c15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc281c66640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc27c1570c0 0x7fc27c14ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc282c68640 1 -- 172.21.15.55:0/3231765261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc27c1570c0 msgr2=0x7fc27c14ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc282c68640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc27c1570c0 0x7fc27c14ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc282c68640 1 -- 172.21.15.55:0/3231765261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2680039b0 msgr2=0x7fc27c15a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc282c68640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2680039b0 0x7fc27c15a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc282c68640 1 -- 172.21.15.55:0/3231765261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c14d390 con 0x7fc27c0cc6a0 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc282c68640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c0cc6a0 0x7fc27c0ccb20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc274007fd0 tx=0x7fc27400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc272ffd640 1 -- 172.21.15.55:0/3231765261 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274019070 con 0x7fc27c0cc6a0 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc272ffd640 1 -- 172.21.15.55:0/3231765261 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc274006d60 con 0x7fc27c0cc6a0 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc2846cb640 1 -- 172.21.15.55:0/3231765261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c0cae70 con 0x7fc27c0cc6a0 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc272ffd640 1 -- 172.21.15.55:0/3231765261 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274003b90 con 0x7fc27c0cc6a0 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.997+0000 7fc2846cb640 1 -- 172.21.15.55:0/3231765261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c0cd650 con 0x7fc27c0cc6a0 2024-04-25T08:54:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.998+0000 7fc2846cb640 1 -- 172.21.15.55:0/3231765261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c0750b0 con 0x7fc27c0cc6a0 2024-04-25T08:54:19.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.999+0000 7fc272ffd640 1 -- 172.21.15.55:0/3231765261 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc27401c070 con 0x7fc27c0cc6a0 2024-04-25T08:54:19.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.999+0000 7fc272ffd640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26006b4d0 0x7fc26006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:19.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.999+0000 7fc272ffd640 1 -- 172.21.15.55:0/3231765261 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2740897e0 con 0x7fc27c0cc6a0 2024-04-25T08:54:19.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:19.999+0000 7fc282467640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26006b4d0 0x7fc26006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:19.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.000+0000 7fc282467640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26006b4d0 0x7fc26006d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc278033000 tx=0x7fc27802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:19.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.003+0000 7fc272ffd640 1 -- 172.21.15.55:0/3231765261 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2740586f0 con 0x7fc27c0cc6a0 2024-04-25T08:54:20.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.182+0000 7fc2846cb640 1 -- 172.21.15.55:0/3231765261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc27c0d18d0 con 0x7fc27c0cc6a0 2024-04-25T08:54:20.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.183+0000 7fc272ffd640 1 -- 172.21.15.55:0/3231765261 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc274057ff0 con 0x7fc27c0cc6a0 2024-04-25T08:54:20.173 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:54:20.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.184+0000 7fc2846cb640 1 -- 172.21.15.55:0/3231765261 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26006b4d0 msgr2=0x7fc26006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.184+0000 7fc2846cb640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26006b4d0 0x7fc26006d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc278033000 tx=0x7fc27802e000 comp rx=0 tx=0).stop 2024-04-25T08:54:20.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.184+0000 7fc2846cb640 1 -- 172.21.15.55:0/3231765261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c0cc6a0 msgr2=0x7fc27c0ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.184+0000 7fc2846cb640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c0cc6a0 0x7fc27c0ccb20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc274007fd0 tx=0x7fc27400ea00 comp rx=0 tx=0).stop 2024-04-25T08:54:20.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.184+0000 7fc2846cb640 1 -- 172.21.15.55:0/3231765261 shutdown_connections 2024-04-25T08:54:20.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.184+0000 7fc2846cb640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26006b4d0 0x7fc26006d990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.184+0000 7fc2846cb640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c0cc6a0 0x7fc27c0ccb20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.184+0000 7fc2846cb640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc27c1570c0 0x7fc27c14ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.184+0000 7fc2846cb640 1 --2- 172.21.15.55:0/3231765261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2680039b0 0x7fc27c15a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.184+0000 7fc2846cb640 1 -- 172.21.15.55:0/3231765261 >> 172.21.15.55:0/3231765261 conn(0x7fc27c0b5660 msgr2=0x7fc27c0b74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:20.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.185+0000 7fc2846cb640 1 -- 172.21.15.55:0/3231765261 shutdown_connections 2024-04-25T08:54:20.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.185+0000 7fc2846cb640 1 -- 172.21.15.55:0/3231765261 wait complete. 2024-04-25T08:54:20.186 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:54:20.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.298+0000 7fdf1a390640 1 Processor -- start 2024-04-25T08:54:20.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.298+0000 7fdf1a390640 1 -- start start 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf1a390640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf140cef40 0x7fdf140b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf1a390640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf14161d80 con 0x7fdf141610b0 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf1a390640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf14162040 con 0x7fdf141618d0 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf1a390640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140d1ea0 con 0x7fdf140cef40 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf13fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdf141610b0 0x7fdf140ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35910/0 (socket says 172.21.15.55:35910) 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf13fff640 1 -- 172.21.15.55:0/2021789648 learned_addr learned my addr 172.21.15.55:0/2021789648 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf137fe640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf140cef40 0x7fdf140b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434204130 0 0) 0x7fdf14161d80 con 0x7fdf141610b0 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdefc003520 con 0x7fdf141610b0 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122489264 0 0) 0x7fdf14162040 con 0x7fdf141618d0 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf14161d80 con 0x7fdf141618d0 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2897691606 0 0) 0x7fdefc003520 con 0x7fdf141610b0 2024-04-25T08:54:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf140cef40 msgr2=0x7fdf140b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf12ffd640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf140cef40 0x7fdf140b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 >> v1:172.21.15.167:6789/0 conn(0x7fdf141618d0 legacy=0x7fdf140d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf14162320 con 0x7fdf141610b0 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.299+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fdf080015f0 con 0x7fdf141610b0 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 >> v1:172.21.15.55:6789/0 conn(0x7fdf141610b0 legacy=0x7fdf140ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf12ffd640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf140cef40 0x7fdefc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf12ffd640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdefc004120 0x7fdefc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf12ffd640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdefc004d40 0x7fdefc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140d1ea0 con 0x7fdefc004d40 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc00bb80 con 0x7fdefc004120 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc00bd80 con 0x7fdf140cef40 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf1892d640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdefc004d40 0x7fdefc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf13fff640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf140cef40 0x7fdefc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf137fe640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdefc004120 0x7fdefc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf1892d640 1 -- 172.21.15.55:0/2021789648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf140cef40 msgr2=0x7fdefc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf1892d640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf140cef40 0x7fdefc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf1892d640 1 -- 172.21.15.55:0/2021789648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdefc004120 msgr2=0x7fdefc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf1892d640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdefc004120 0x7fdefc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.300+0000 7fdf1892d640 1 -- 172.21.15.55:0/2021789648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc003520 con 0x7fdefc004d40 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.301+0000 7fdf1892d640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdefc004d40 0x7fdefc0051c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c001fd0 tx=0x7fdefc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa6df01985be02a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.301+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c001bf0 con 0x7fdefc004d40 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.301+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c003b70 con 0x7fdefc004d40 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.301+0000 7fdf12ffd640 1 -- 172.21.15.55:0/2021789648 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0050d0 con 0x7fdefc004d40 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.301+0000 7fdf1a390640 1 -- 172.21.15.55:0/2021789648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdefc004d40 msgr2=0x7fdefc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.301+0000 7fdf1a390640 1 --2- 172.21.15.55:0/2021789648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdefc004d40 0x7fdefc0051c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c001fd0 tx=0x7fdefc005830 comp rx=0 tx=0).stop 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.301+0000 7fdf1892d640 1 -- 172.21.15.55:0/2021789648 reap_dead start 2024-04-25T08:54:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.301+0000 7fdf1a390640 1 -- 172.21.15.55:0/2021789648 shutdown_connections 2024-04-25T08:54:20.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.301+0000 7fdf1a390640 1 -- 172.21.15.55:0/2021789648 >> 172.21.15.55:0/2021789648 conn(0x7fdf140b5570 msgr2=0x7fdf140b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:20.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.301+0000 7fdf1a390640 1 -- 172.21.15.55:0/2021789648 shutdown_connections 2024-04-25T08:54:20.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.301+0000 7fdf1a390640 1 -- 172.21.15.55:0/2021789648 wait complete. 2024-04-25T08:54:20.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.303+0000 7fdf1a390640 1 Processor -- start 2024-04-25T08:54:20.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.303+0000 7fdf1a390640 1 -- start start 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.303+0000 7fdf1a390640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdefc004d40 0x7fdf140c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.303+0000 7fdf1a390640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf14157ba0 0x7fdf1415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.303+0000 7fdf1a390640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf14158020 0x7fdf1415e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.303+0000 7fdf1a390640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140b6c00 con 0x7fdf14157ba0 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.303+0000 7fdf1a390640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140d20f0 con 0x7fdefc004d40 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.303+0000 7fdf1a390640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf14161490 con 0x7fdf14158020 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf137fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf14157ba0 0x7fdf1415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf137fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf14157ba0 0x7fdf1415db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41816/0 (socket says 172.21.15.55:41816) 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf137fe640 1 -- 172.21.15.55:0/1833931465 learned_addr learned my addr 172.21.15.55:0/1833931465 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf1892d640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf14158020 0x7fdf1415e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf13fff640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdefc004d40 0x7fdf140c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf137fe640 1 -- 172.21.15.55:0/1833931465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf14158020 msgr2=0x7fdf1415e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf137fe640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf14158020 0x7fdf1415e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf137fe640 1 -- 172.21.15.55:0/1833931465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdefc004d40 msgr2=0x7fdf140c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf137fe640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdefc004d40 0x7fdf140c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf137fe640 1 -- 172.21.15.55:0/1833931465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140c9c10 con 0x7fdf14157ba0 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf137fe640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf14157ba0 0x7fdf1415db40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdf04011a00 tx=0x7fdf04011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf10ff9640 1 -- 172.21.15.55:0/1833931465 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400fb50 con 0x7fdf14157ba0 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf10ff9640 1 -- 172.21.15.55:0/1833931465 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0400fcf0 con 0x7fdf14157ba0 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf1a390640 1 -- 172.21.15.55:0/1833931465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf14158560 con 0x7fdf14157ba0 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf10ff9640 1 -- 172.21.15.55:0/1833931465 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400fea0 con 0x7fdf14157ba0 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.304+0000 7fdf1a390640 1 -- 172.21.15.55:0/1833931465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf14158b20 con 0x7fdf14157ba0 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.305+0000 7fdf1a390640 1 -- 172.21.15.55:0/1833931465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf140750b0 con 0x7fdf14157ba0 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.306+0000 7fdf10ff9640 1 -- 172.21.15.55:0/1833931465 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf04012040 con 0x7fdf14157ba0 2024-04-25T08:54:20.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.306+0000 7fdf10ff9640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf0006b4d0 0x7fdf0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.306+0000 7fdf10ff9640 1 -- 172.21.15.55:0/1833931465 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf0408a890 con 0x7fdf14157ba0 2024-04-25T08:54:20.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.306+0000 7fdf13fff640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf0006b4d0 0x7fdf0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.307+0000 7fdf13fff640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf0006b4d0 0x7fdf0006d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdf080016b0 tx=0x7fdf08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:20.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.310+0000 7fdf10ff9640 1 -- 172.21.15.55:0/1833931465 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf04019030 con 0x7fdf14157ba0 2024-04-25T08:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.502+0000 7fdf1a390640 1 -- 172.21.15.55:0/1833931465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdf140d1770 con 0x7fdf14157ba0 2024-04-25T08:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.502+0000 7fdf10ff9640 1 -- 172.21.15.55:0/1833931465 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdf04059720 con 0x7fdf14157ba0 2024-04-25T08:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T08:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 -- 172.21.15.55:0/1833931465 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf0006b4d0 msgr2=0x7fdf0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf0006b4d0 0x7fdf0006d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdf080016b0 tx=0x7fdf08009040 comp rx=0 tx=0).stop 2024-04-25T08:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 -- 172.21.15.55:0/1833931465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf14157ba0 msgr2=0x7fdf1415db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf14157ba0 0x7fdf1415db40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdf04011a00 tx=0x7fdf04011ec0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 -- 172.21.15.55:0/1833931465 shutdown_connections 2024-04-25T08:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf0006b4d0 0x7fdf0006d990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf14158020 0x7fdf1415e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf14157ba0 0x7fdf1415db40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 --2- 172.21.15.55:0/1833931465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdefc004d40 0x7fdf140c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 -- 172.21.15.55:0/1833931465 >> 172.21.15.55:0/1833931465 conn(0x7fdf140b5570 msgr2=0x7fdf140b7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 -- 172.21.15.55:0/1833931465 shutdown_connections 2024-04-25T08:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.504+0000 7fdf1a390640 1 -- 172.21.15.55:0/1833931465 wait complete. 2024-04-25T08:54:20.505 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T08:54:20.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:20.505 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T08:54:20.531 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:54:20.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:20.531 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T08:54:20.587 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:54:20.587 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:20.605 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:54:20.606 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:20.664 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:54:20.664 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:20.724 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:20.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.836+0000 7f2cd06bd640 1 Processor -- start 2024-04-25T08:54:20.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.836+0000 7f2cd06bd640 1 -- start start 2024-04-25T08:54:20.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2cd06bd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2cc80d35b0 0x7f2cc80b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2cd06bd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cc80b5990 0x7f2cc80b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2cd06bd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc815e0c0 con 0x7f2cc815dce0 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2cd06bd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc80d2510 con 0x7f2cc80b5990 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2cd06bd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc80d27f0 con 0x7f2cc80d35b0 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2ccec5a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cc80b5990 0x7f2cc80b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2ccec5a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cc80b5990 0x7f2cc80b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41818/0 (socket says 172.21.15.55:41818) 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2ccec5a640 1 -- 172.21.15.55:0/1039995357 learned_addr learned my addr 172.21.15.55:0/1039995357 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2cce459640 1 --1- 172.21.15.55:0/1039995357 >> v1:172.21.15.55:6789/0 conn(0x7f2cc815dce0 0x7f2cc80d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35912/0 (socket says 172.21.15.55:35912) 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2ccec5a640 1 -- 172.21.15.55:0/1039995357 >> v2:172.21.15.167:3300/0 conn(0x7f2cc80d35b0 msgr2=0x7f2cc80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2ccdc58640 1 --2- 172.21.15.55:0/1039995357 >> v2:172.21.15.167:3300/0 conn(0x7f2cc80d35b0 0x7f2cc80b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2ccec5a640 1 --2- 172.21.15.55:0/1039995357 >> v2:172.21.15.167:3300/0 conn(0x7f2cc80d35b0 0x7f2cc80b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2ccec5a640 1 -- 172.21.15.55:0/1039995357 >> v1:172.21.15.55:6789/0 conn(0x7f2cc815dce0 legacy=0x7f2cc80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.837+0000 7f2ccec5a640 1 -- 172.21.15.55:0/1039995357 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80d2ad0 con 0x7f2cc80b5990 2024-04-25T08:54:20.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.838+0000 7f2ccec5a640 1 --2- 172.21.15.55:0/1039995357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc80b5990 0x7f2cc80b6b00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80cdfa0 tx=0x7f2cc002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6884ab4199fdb8e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:20.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.838+0000 7f2ccd457640 1 -- 172.21.15.55:0/1039995357 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0036070 con 0x7f2cc80b5990 2024-04-25T08:54:20.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.838+0000 7f2ccd457640 1 -- 172.21.15.55:0/1039995357 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc0031600 con 0x7f2cc80b5990 2024-04-25T08:54:20.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.838+0000 7f2ccd457640 1 -- 172.21.15.55:0/1039995357 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00319d0 con 0x7f2cc80b5990 2024-04-25T08:54:20.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.839+0000 7f2cd06bd640 1 -- 172.21.15.55:0/1039995357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc80b5990 msgr2=0x7f2cc80b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.839+0000 7f2cd06bd640 1 --2- 172.21.15.55:0/1039995357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc80b5990 0x7f2cc80b6b00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80cdfa0 tx=0x7f2cc002a730 comp rx=0 tx=0).stop 2024-04-25T08:54:20.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.839+0000 7f2cd06bd640 1 -- 172.21.15.55:0/1039995357 shutdown_connections 2024-04-25T08:54:20.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.839+0000 7f2cd06bd640 1 --2- 172.21.15.55:0/1039995357 >> v2:172.21.15.167:3300/0 conn(0x7f2cc80d35b0 0x7f2cc80b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.839+0000 7f2cd06bd640 1 --2- 172.21.15.55:0/1039995357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc80b5990 0x7f2cc80b6b00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.839+0000 7f2cd06bd640 1 -- 172.21.15.55:0/1039995357 >> 172.21.15.55:0/1039995357 conn(0x7f2cc8072900 msgr2=0x7f2cc80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:20.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.839+0000 7f2cd06bd640 1 -- 172.21.15.55:0/1039995357 shutdown_connections 2024-04-25T08:54:20.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.839+0000 7f2cd06bd640 1 -- 172.21.15.55:0/1039995357 wait complete. 2024-04-25T08:54:20.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.840+0000 7f2cd06bd640 1 Processor -- start 2024-04-25T08:54:20.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.840+0000 7f2cd06bd640 1 -- start start 2024-04-25T08:54:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2cd06bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cc80b5990 0x7f2cc80c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2cd06bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cc80d35b0 0x7f2cc80b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2cd06bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc815dce0 0x7f2cc80b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2cd06bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc80d2160 con 0x7f2cc815dce0 2024-04-25T08:54:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2cd06bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc80d3090 con 0x7f2cc80d35b0 2024-04-25T08:54:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2cd06bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc80c8fc0 con 0x7f2cc80b5990 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2ccec5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc815dce0 0x7f2cc80b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2ccec5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc815dce0 0x7f2cc80b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41826/0 (socket says 172.21.15.55:41826) 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2ccec5a640 1 -- 172.21.15.55:0/2687082699 learned_addr learned my addr 172.21.15.55:0/2687082699 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2ccdc58640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cc80d35b0 0x7f2cc80b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2ccec5a640 1 -- 172.21.15.55:0/2687082699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cc80b5990 msgr2=0x7f2cc80c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2ccec5a640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cc80b5990 0x7f2cc80c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2ccec5a640 1 -- 172.21.15.55:0/2687082699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cc80d35b0 msgr2=0x7f2cc80b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2ccec5a640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cc80d35b0 0x7f2cc80b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2ccec5a640 1 -- 172.21.15.55:0/2687082699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80c92a0 con 0x7f2cc815dce0 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2ccec5a640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc815dce0 0x7f2cc80b7250 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2cc002ad20 tx=0x7f2cc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2cbeffd640 1 -- 172.21.15.55:0/2687082699 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc003f020 con 0x7f2cc815dce0 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2cbeffd640 1 -- 172.21.15.55:0/2687082699 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc0037040 con 0x7f2cc815dce0 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2cd06bd640 1 -- 172.21.15.55:0/2687082699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc80c9580 con 0x7f2cc815dce0 2024-04-25T08:54:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.841+0000 7f2cbeffd640 1 -- 172.21.15.55:0/2687082699 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0036070 con 0x7f2cc815dce0 2024-04-25T08:54:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.842+0000 7f2cd06bd640 1 -- 172.21.15.55:0/2687082699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc814b200 con 0x7f2cc815dce0 2024-04-25T08:54:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.842+0000 7f2cd06bd640 1 -- 172.21.15.55:0/2687082699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc80b4950 con 0x7f2cc815dce0 2024-04-25T08:54:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.843+0000 7f2cbeffd640 1 -- 172.21.15.55:0/2687082699 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2cc0042020 con 0x7f2cc815dce0 2024-04-25T08:54:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.843+0000 7f2cbeffd640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cac06b4d0 0x7f2cac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.843+0000 7f2cbeffd640 1 -- 172.21.15.55:0/2687082699 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cc00aa7c0 con 0x7f2cc815dce0 2024-04-25T08:54:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.843+0000 7f2cce459640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cac06b4d0 0x7f2cac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.844+0000 7f2cce459640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cac06b4d0 0x7f2cac06d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000f60 tx=0x7f2cc4007a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:20.847+0000 7f2cbeffd640 1 -- 172.21.15.55:0/2687082699 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2cc80b4950 con 0x7f2cc815dce0 2024-04-25T08:54:21.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.031+0000 7f2cd06bd640 1 -- 172.21.15.55:0/2687082699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cc80749b0 con 0x7f2cc815dce0 2024-04-25T08:54:21.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.032+0000 7f2cbeffd640 1 -- 172.21.15.55:0/2687082699 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f2cc0049030 con 0x7f2cc815dce0 2024-04-25T08:54:21.023 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:21.023 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:53:44.204734+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:21.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 -- 172.21.15.55:0/2687082699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cac06b4d0 msgr2=0x7f2cac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cac06b4d0 0x7f2cac06d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000f60 tx=0x7f2cc4007a00 comp rx=0 tx=0).stop 2024-04-25T08:54:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 -- 172.21.15.55:0/2687082699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc815dce0 msgr2=0x7f2cc80b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc815dce0 0x7f2cc80b7250 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2cc002ad20 tx=0x7f2cc0004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 -- 172.21.15.55:0/2687082699 shutdown_connections 2024-04-25T08:54:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cac06b4d0 0x7f2cac06d990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc815dce0 0x7f2cc80b7250 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cc80d35b0 0x7f2cc80b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 --2- 172.21.15.55:0/2687082699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cc80b5990 0x7f2cc80c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 -- 172.21.15.55:0/2687082699 >> 172.21.15.55:0/2687082699 conn(0x7f2cc8072900 msgr2=0x7f2cc80d3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 -- 172.21.15.55:0/2687082699 shutdown_connections 2024-04-25T08:54:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.034+0000 7f2cd06bd640 1 -- 172.21.15.55:0/2687082699 wait complete. 2024-04-25T08:54:21.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:21.036 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:21.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.150+0000 7fe25710a640 1 Processor -- start 2024-04-25T08:54:21.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.150+0000 7fe25710a640 1 -- start start 2024-04-25T08:54:21.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.150+0000 7fe25710a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe25015dc80 0x7fe250161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.150+0000 7fe25710a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2500b97c0 0x7fe2500b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.150+0000 7fe25710a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2500b5a30 0x7fe25006bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.150+0000 7fe25710a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2500b5e60 con 0x7fe2500b97c0 2024-04-25T08:54:21.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.150+0000 7fe25710a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2501627a0 con 0x7fe25015dc80 2024-04-25T08:54:21.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.150+0000 7fe25710a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2501621e0 con 0x7fe2500b5a30 2024-04-25T08:54:21.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.151+0000 7fe24ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2500b97c0 0x7fe2500b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.151+0000 7fe24ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2500b97c0 0x7fe2500b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41828/0 (socket says 172.21.15.55:41828) 2024-04-25T08:54:21.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.151+0000 7fe24ffff640 1 -- 172.21.15.55:0/1379548238 learned_addr learned my addr 172.21.15.55:0/1379548238 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.151+0000 7fe2556a7640 1 --2- 172.21.15.55:0/1379548238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2500b5a30 0x7fe25006bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.151+0000 7fe254ea6640 1 --2- 172.21.15.55:0/1379548238 >> v2:172.21.15.167:3300/0 conn(0x7fe25015dc80 0x7fe250161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.151+0000 7fe24ffff640 1 -- 172.21.15.55:0/1379548238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2500b5a30 msgr2=0x7fe25006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.151+0000 7fe24ffff640 1 --2- 172.21.15.55:0/1379548238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2500b5a30 0x7fe25006bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.151+0000 7fe24ffff640 1 -- 172.21.15.55:0/1379548238 >> v2:172.21.15.167:3300/0 conn(0x7fe25015dc80 msgr2=0x7fe250161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.151+0000 7fe24ffff640 1 --2- 172.21.15.55:0/1379548238 >> v2:172.21.15.167:3300/0 conn(0x7fe25015dc80 0x7fe250161870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.151+0000 7fe24ffff640 1 -- 172.21.15.55:0/1379548238 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2501624c0 con 0x7fe2500b97c0 2024-04-25T08:54:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.151+0000 7fe2556a7640 1 --2- 172.21.15.55:0/1379548238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2500b5a30 0x7fe25006bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe24ffff640 1 --2- 172.21.15.55:0/1379548238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2500b97c0 0x7fe2500b54f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe25006dab0 tx=0x7fe23c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4ea64fb9da217c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe24f7fe640 1 -- 172.21.15.55:0/1379548238 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c037070 con 0x7fe2500b97c0 2024-04-25T08:54:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe24f7fe640 1 -- 172.21.15.55:0/1379548238 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c032440 con 0x7fe2500b97c0 2024-04-25T08:54:21.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe24f7fe640 1 -- 172.21.15.55:0/1379548238 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c032810 con 0x7fe2500b97c0 2024-04-25T08:54:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe25710a640 1 -- 172.21.15.55:0/1379548238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2500b97c0 msgr2=0x7fe2500b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe25710a640 1 --2- 172.21.15.55:0/1379548238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2500b97c0 0x7fe2500b54f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe25006dab0 tx=0x7fe23c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe25710a640 1 -- 172.21.15.55:0/1379548238 shutdown_connections 2024-04-25T08:54:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe25710a640 1 --2- 172.21.15.55:0/1379548238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2500b5a30 0x7fe25006bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe25710a640 1 --2- 172.21.15.55:0/1379548238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2500b97c0 0x7fe2500b54f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe25710a640 1 --2- 172.21.15.55:0/1379548238 >> v2:172.21.15.167:3300/0 conn(0x7fe25015dc80 0x7fe250161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe25710a640 1 -- 172.21.15.55:0/1379548238 >> 172.21.15.55:0/1379548238 conn(0x7fe2500d04f0 msgr2=0x7fe2500d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe25710a640 1 -- 172.21.15.55:0/1379548238 shutdown_connections 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.152+0000 7fe25710a640 1 -- 172.21.15.55:0/1379548238 wait complete. 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.154+0000 7fe25710a640 1 Processor -- start 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.154+0000 7fe25710a640 1 -- start start 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.154+0000 7fe25710a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2500b5a30 0x7fe2500aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.154+0000 7fe25710a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2500b97c0 0x7fe25015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.154+0000 7fe25710a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe25015dc80 0x7fe2500cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.154+0000 7fe25710a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe250161db0 con 0x7fe25015dc80 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.154+0000 7fe25710a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25015e060 con 0x7fe2500b97c0 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.154+0000 7fe25710a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe250161f30 con 0x7fe2500b5a30 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe2556a7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe25015dc80 0x7fe2500cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe2556a7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe25015dc80 0x7fe2500cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41840/0 (socket says 172.21.15.55:41840) 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe2556a7640 1 -- 172.21.15.55:0/647524648 learned_addr learned my addr 172.21.15.55:0/647524648 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe2556a7640 1 -- 172.21.15.55:0/647524648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2500b5a30 msgr2=0x7fe2500aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe2556a7640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2500b5a30 0x7fe2500aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe24ffff640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2500b97c0 0x7fe25015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe2556a7640 1 -- 172.21.15.55:0/647524648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2500b97c0 msgr2=0x7fe25015cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe2556a7640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2500b97c0 0x7fe25015cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe2556a7640 1 -- 172.21.15.55:0/647524648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25015f230 con 0x7fe25015dc80 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe24ffff640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2500b97c0 0x7fe25015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe2556a7640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe25015dc80 0x7fe2500cba30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe24800cf20 tx=0x7fe24800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe24d7fa640 1 -- 172.21.15.55:0/647524648 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24801a070 con 0x7fe25015dc80 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe24d7fa640 1 -- 172.21.15.55:0/647524648 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24800d840 con 0x7fe25015dc80 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe24d7fa640 1 -- 172.21.15.55:0/647524648 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800dc30 con 0x7fe25015dc80 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe25710a640 1 -- 172.21.15.55:0/647524648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2500cc1d0 con 0x7fe25015dc80 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.155+0000 7fe25710a640 1 -- 172.21.15.55:0/647524648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25015f7d0 con 0x7fe25015dc80 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.156+0000 7fe25710a640 1 -- 172.21.15.55:0/647524648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2500750b0 con 0x7fe25015dc80 2024-04-25T08:54:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.157+0000 7fe24d7fa640 1 -- 172.21.15.55:0/647524648 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe24801d070 con 0x7fe25015dc80 2024-04-25T08:54:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.157+0000 7fe24d7fa640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe23406b4d0 0x7fe23406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.157+0000 7fe24d7fa640 1 -- 172.21.15.55:0/647524648 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe24808a960 con 0x7fe25015dc80 2024-04-25T08:54:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.157+0000 7fe254ea6640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe23406b4d0 0x7fe23406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.158+0000 7fe254ea6640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe23406b4d0 0x7fe23406d990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe24400a810 tx=0x7fe244008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.162+0000 7fe24d7fa640 1 -- 172.21.15.55:0/647524648 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe248059870 con 0x7fe25015dc80 2024-04-25T08:54:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.342+0000 7fe25710a640 1 -- 172.21.15.55:0/647524648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2500d1780 con 0x7fe25015dc80 2024-04-25T08:54:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.342+0000 7fe24d7fa640 1 -- 172.21.15.55:0/647524648 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe248059170 con 0x7fe25015dc80 2024-04-25T08:54:21.332 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:21.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 -- 172.21.15.55:0/647524648 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe23406b4d0 msgr2=0x7fe23406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe23406b4d0 0x7fe23406d990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe24400a810 tx=0x7fe244008040 comp rx=0 tx=0).stop 2024-04-25T08:54:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 -- 172.21.15.55:0/647524648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe25015dc80 msgr2=0x7fe2500cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe25015dc80 0x7fe2500cba30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe24800cf20 tx=0x7fe24800a710 comp rx=0 tx=0).stop 2024-04-25T08:54:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 -- 172.21.15.55:0/647524648 shutdown_connections 2024-04-25T08:54:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe23406b4d0 0x7fe23406d990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe25015dc80 0x7fe2500cba30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2500b97c0 0x7fe25015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 --2- 172.21.15.55:0/647524648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2500b5a30 0x7fe2500aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 -- 172.21.15.55:0/647524648 >> 172.21.15.55:0/647524648 conn(0x7fe2500d04f0 msgr2=0x7fe2500d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 -- 172.21.15.55:0/647524648 shutdown_connections 2024-04-25T08:54:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.344+0000 7fe25710a640 1 -- 172.21.15.55:0/647524648 wait complete. 2024-04-25T08:54:21.345 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:54:21.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.460+0000 7fae2866f640 1 Processor -- start 2024-04-25T08:54:21.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.460+0000 7fae2866f640 1 -- start start 2024-04-25T08:54:21.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae2866f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae200ce3a0 0x7fae200b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae2866f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae200b1f60 con 0x7fae2006aba0 2024-04-25T08:54:21.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae2866f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae200b0380 con 0x7fae2015d450 2024-04-25T08:54:21.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae2866f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae200b0130 con 0x7fae200ce3a0 2024-04-25T08:54:21.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae2640b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fae2006aba0 0x7fae2006af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35928/0 (socket says 172.21.15.55:35928) 2024-04-25T08:54:21.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae2640b640 1 -- 172.21.15.55:0/2029326086 learned_addr learned my addr 172.21.15.55:0/2029326086 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:21.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25c0a640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae200ce3a0 0x7fae200b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085645439 0 0) 0x7fae200b1f60 con 0x7fae2006aba0 2024-04-25T08:54:21.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae0c003520 con 0x7fae2006aba0 2024-04-25T08:54:21.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 110447861 0 0) 0x7fae0c003520 con 0x7fae2006aba0 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae200ce3a0 msgr2=0x7fae200b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae200ce3a0 0x7fae200b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 >> v1:172.21.15.167:6789/0 conn(0x7fae2015d450 legacy=0x7fae2015d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200b0660 con 0x7fae2006aba0 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fae1c001670 con 0x7fae2006aba0 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 >> v1:172.21.15.55:6789/0 conn(0x7fae2006aba0 legacy=0x7fae2006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae0c0039e0 0x7fae0c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae200ce3a0 0x7fae0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 0x7fae0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200b0130 con 0x7fae0c004d40 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c00ba70 con 0x7fae0c0039e0 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c00bc70 con 0x7fae200ce3a0 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.461+0000 7fae26c0c640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 0x7fae0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.462+0000 7fae2640b640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae0c0039e0 0x7fae0c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.462+0000 7fae25c0a640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae200ce3a0 0x7fae0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.462+0000 7fae26c0c640 1 -- 172.21.15.55:0/2029326086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae200ce3a0 msgr2=0x7fae0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.462+0000 7fae26c0c640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae200ce3a0 0x7fae0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.462+0000 7fae26c0c640 1 -- 172.21.15.55:0/2029326086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae0c0039e0 msgr2=0x7fae0c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.462+0000 7fae26c0c640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae0c0039e0 0x7fae0c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.462+0000 7fae26c0c640 1 -- 172.21.15.55:0/2029326086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c003520 con 0x7fae0c004d40 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.462+0000 7fae26c0c640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 0x7fae0c0051c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fae18001e20 tx=0x7fae0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7465470878a1a198 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.463+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18001a70 con 0x7fae0c004d40 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.463+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1802ae40 con 0x7fae0c004d40 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.463+0000 7fae25409640 1 -- 172.21.15.55:0/2029326086 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18003bb0 con 0x7fae0c004d40 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.463+0000 7fae2866f640 1 -- 172.21.15.55:0/2029326086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 msgr2=0x7fae0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.463+0000 7fae2866f640 1 --2- 172.21.15.55:0/2029326086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 0x7fae0c0051c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fae18001e20 tx=0x7fae0c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.463+0000 7fae26c0c640 1 -- 172.21.15.55:0/2029326086 reap_dead start 2024-04-25T08:54:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.463+0000 7fae2866f640 1 -- 172.21.15.55:0/2029326086 shutdown_connections 2024-04-25T08:54:21.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.463+0000 7fae2866f640 1 -- 172.21.15.55:0/2029326086 >> 172.21.15.55:0/2029326086 conn(0x7fae200d07d0 msgr2=0x7fae200d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:21.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.463+0000 7fae2866f640 1 -- 172.21.15.55:0/2029326086 shutdown_connections 2024-04-25T08:54:21.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.463+0000 7fae2866f640 1 -- 172.21.15.55:0/2029326086 wait complete. 2024-04-25T08:54:21.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.464+0000 7fae2866f640 1 Processor -- start 2024-04-25T08:54:21.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.464+0000 7fae2866f640 1 -- start start 2024-04-25T08:54:21.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.465+0000 7fae2866f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 0x7fae2014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.465+0000 7fae2866f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae200b5ca0 0x7fae2014a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.465+0000 7fae2866f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2014ce80 0x7fae2006e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.465+0000 7fae2866f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200b0e60 con 0x7fae0c004d40 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.465+0000 7fae2866f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200b09d0 con 0x7fae200b5ca0 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.465+0000 7fae2866f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae200b0fe0 con 0x7fae2014ce80 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.465+0000 7fae2640b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 0x7fae2014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.465+0000 7fae2640b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 0x7fae2014fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41860/0 (socket says 172.21.15.55:41860) 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.465+0000 7fae2640b640 1 -- 172.21.15.55:0/3209977997 learned_addr learned my addr 172.21.15.55:0/3209977997 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.465+0000 7fae25c0a640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae200b5ca0 0x7fae2014a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.465+0000 7fae26c0c640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2014ce80 0x7fae2006e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae2640b640 1 -- 172.21.15.55:0/3209977997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2014ce80 msgr2=0x7fae2006e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae2640b640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2014ce80 0x7fae2006e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae2640b640 1 -- 172.21.15.55:0/3209977997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae200b5ca0 msgr2=0x7fae2014a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae2640b640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae200b5ca0 0x7fae2014a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae2640b640 1 -- 172.21.15.55:0/3209977997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200b6160 con 0x7fae0c004d40 2024-04-25T08:54:21.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae25c0a640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae200b5ca0 0x7fae2014a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae26c0c640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2014ce80 0x7fae2006e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae2640b640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 0x7fae2014fe60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0072c0 tx=0x7fae1c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae16ffd640 1 -- 172.21.15.55:0/3209977997 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c00f960 con 0x7fae0c004d40 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae16ffd640 1 -- 172.21.15.55:0/3209977997 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c018070 con 0x7fae0c004d40 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae2866f640 1 -- 172.21.15.55:0/3209977997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae200c5ea0 con 0x7fae0c004d40 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae16ffd640 1 -- 172.21.15.55:0/3209977997 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c00fd60 con 0x7fae0c004d40 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.466+0000 7fae2866f640 1 -- 172.21.15.55:0/3209977997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae200c45c0 con 0x7fae0c004d40 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.467+0000 7fae2866f640 1 -- 172.21.15.55:0/3209977997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae200b1ab0 con 0x7fae0c004d40 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.467+0000 7fae16ffd640 1 -- 172.21.15.55:0/3209977997 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae1c01d460 con 0x7fae0c004d40 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.468+0000 7fae16ffd640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0406b500 0x7fae0406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.468+0000 7fae16ffd640 1 -- 172.21.15.55:0/3209977997 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae1c08a2d0 con 0x7fae0c004d40 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.468+0000 7fae25c0a640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0406b500 0x7fae0406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.468+0000 7fae25c0a640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0406b500 0x7fae0406d9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae201f7680 tx=0x7fae10008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:21.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.472+0000 7fae16ffd640 1 -- 172.21.15.55:0/3209977997 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae200b1ab0 con 0x7fae0c004d40 2024-04-25T08:54:21.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.654+0000 7fae2866f640 1 -- 172.21.15.55:0/3209977997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae200750b0 con 0x7fae0c004d40 2024-04-25T08:54:21.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.654+0000 7fae16ffd640 1 -- 172.21.15.55:0/3209977997 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae1c059150 con 0x7fae0c004d40 2024-04-25T08:54:21.645 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:54:21.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.656+0000 7fae2866f640 1 -- 172.21.15.55:0/3209977997 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0406b500 msgr2=0x7fae0406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.656+0000 7fae2866f640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0406b500 0x7fae0406d9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae201f7680 tx=0x7fae10008040 comp rx=0 tx=0).stop 2024-04-25T08:54:21.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.656+0000 7fae2866f640 1 -- 172.21.15.55:0/3209977997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 msgr2=0x7fae2014fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.656+0000 7fae2866f640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 0x7fae2014fe60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0072c0 tx=0x7fae1c007780 comp rx=0 tx=0).stop 2024-04-25T08:54:21.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.656+0000 7fae2866f640 1 -- 172.21.15.55:0/3209977997 shutdown_connections 2024-04-25T08:54:21.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.656+0000 7fae2866f640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0406b500 0x7fae0406d9c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.656+0000 7fae2866f640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2014ce80 0x7fae2006e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.656+0000 7fae2866f640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae200b5ca0 0x7fae2014a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.656+0000 7fae2866f640 1 --2- 172.21.15.55:0/3209977997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae0c004d40 0x7fae2014fe60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.657+0000 7fae2866f640 1 -- 172.21.15.55:0/3209977997 >> 172.21.15.55:0/3209977997 conn(0x7fae200d07d0 msgr2=0x7fae20159e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:21.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.657+0000 7fae2866f640 1 -- 172.21.15.55:0/3209977997 shutdown_connections 2024-04-25T08:54:21.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.657+0000 7fae2866f640 1 -- 172.21.15.55:0/3209977997 wait complete. 2024-04-25T08:54:21.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:54:21.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.773+0000 7f614cabd640 1 Processor -- start 2024-04-25T08:54:21.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.773+0000 7f614cabd640 1 -- start start 2024-04-25T08:54:21.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614cabd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f614815dca0 0x7f61480ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614cabd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61480d3b90 0x7f61480d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614cabd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61480d4090 con 0x7f61480cee80 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614cabd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61480b6b20 con 0x7f614815dca0 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614cabd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61480d4370 con 0x7f61480d3b90 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f614815dca0 0x7f61480ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f614815dca0 0x7f61480ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41872/0 (socket says 172.21.15.55:41872) 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614659c640 1 -- 172.21.15.55:0/4203605915 learned_addr learned my addr 172.21.15.55:0/4203605915 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f6146d9d640 1 --1- 172.21.15.55:0/4203605915 >> v1:172.21.15.55:6789/0 conn(0x7f61480cee80 0x7f61480b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35938/0 (socket says 172.21.15.55:35938) 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f6145d9b640 1 --2- 172.21.15.55:0/4203605915 >> v2:172.21.15.167:3300/0 conn(0x7f61480d3b90 0x7f61480d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614659c640 1 -- 172.21.15.55:0/4203605915 >> v2:172.21.15.167:3300/0 conn(0x7f61480d3b90 msgr2=0x7f61480d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614659c640 1 --2- 172.21.15.55:0/4203605915 >> v2:172.21.15.167:3300/0 conn(0x7f61480d3b90 0x7f61480d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614659c640 1 -- 172.21.15.55:0/4203605915 >> v1:172.21.15.55:6789/0 conn(0x7f61480cee80 legacy=0x7f61480b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f614659c640 1 -- 172.21.15.55:0/4203605915 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61480d4650 con 0x7f614815dca0 2024-04-25T08:54:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.774+0000 7f6145d9b640 1 --2- 172.21.15.55:0/4203605915 >> v2:172.21.15.167:3300/0 conn(0x7f61480d3b90 0x7f61480d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.775+0000 7f614659c640 1 --2- 172.21.15.55:0/4203605915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f614815dca0 0x7f61480ce940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f61480b6560 tx=0x7f614002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c0cac57d8062c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.775+0000 7f614559a640 1 -- 172.21.15.55:0/4203605915 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140037070 con 0x7f614815dca0 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.775+0000 7f614559a640 1 -- 172.21.15.55:0/4203605915 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6140032440 con 0x7f614815dca0 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.775+0000 7f614559a640 1 -- 172.21.15.55:0/4203605915 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140032810 con 0x7f614815dca0 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.776+0000 7f614cabd640 1 -- 172.21.15.55:0/4203605915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f614815dca0 msgr2=0x7f61480ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.776+0000 7f614cabd640 1 --2- 172.21.15.55:0/4203605915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f614815dca0 0x7f61480ce940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f61480b6560 tx=0x7f614002a270 comp rx=0 tx=0).stop 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.776+0000 7f614cabd640 1 -- 172.21.15.55:0/4203605915 shutdown_connections 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.776+0000 7f614cabd640 1 --2- 172.21.15.55:0/4203605915 >> v2:172.21.15.167:3300/0 conn(0x7f61480d3b90 0x7f61480d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.776+0000 7f614cabd640 1 --2- 172.21.15.55:0/4203605915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f614815dca0 0x7f61480ce940 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.776+0000 7f614cabd640 1 -- 172.21.15.55:0/4203605915 >> 172.21.15.55:0/4203605915 conn(0x7f61480726c0 msgr2=0x7f6148072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.776+0000 7f614cabd640 1 -- 172.21.15.55:0/4203605915 shutdown_connections 2024-04-25T08:54:21.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.776+0000 7f614cabd640 1 -- 172.21.15.55:0/4203605915 wait complete. 2024-04-25T08:54:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.777+0000 7f614cabd640 1 Processor -- start 2024-04-25T08:54:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.777+0000 7f614cabd640 1 -- start start 2024-04-25T08:54:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.778+0000 7f614cabd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61480cee80 0x7f614814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.778+0000 7f614cabd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61480d3b90 0x7f61480d2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.778+0000 7f614cabd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614815dca0 0x7f61480d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.778+0000 7f614cabd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614815e200 con 0x7f61480d3b90 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.778+0000 7f614cabd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614815e080 con 0x7f614815dca0 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.778+0000 7f614cabd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61480d0f60 con 0x7f61480cee80 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.778+0000 7f6145d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61480d3b90 0x7f61480d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.778+0000 7f6145d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61480d3b90 0x7f61480d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41886/0 (socket says 172.21.15.55:41886) 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.778+0000 7f6145d9b640 1 -- 172.21.15.55:0/1015467526 learned_addr learned my addr 172.21.15.55:0/1015467526 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.778+0000 7f614659c640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61480cee80 0x7f614814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.778+0000 7f6146d9d640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614815dca0 0x7f61480d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f6145d9b640 1 -- 172.21.15.55:0/1015467526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61480cee80 msgr2=0x7f614814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f6145d9b640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61480cee80 0x7f614814a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f6145d9b640 1 -- 172.21.15.55:0/1015467526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614815dca0 msgr2=0x7f61480d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f6145d9b640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614815dca0 0x7f61480d2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f6145d9b640 1 -- 172.21.15.55:0/1015467526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61481f4430 con 0x7f61480d3b90 2024-04-25T08:54:21.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f6146d9d640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614815dca0 0x7f61480d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:21.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f614659c640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61480cee80 0x7f614814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:21.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f6145d9b640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61480d3b90 0x7f61480d2780 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f613000e810 tx=0x7f613000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:21.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f613effd640 1 -- 172.21.15.55:0/1015467526 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613000f040 con 0x7f61480d3b90 2024-04-25T08:54:21.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f613effd640 1 -- 172.21.15.55:0/1015467526 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6130004030 con 0x7f61480d3b90 2024-04-25T08:54:21.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f613effd640 1 -- 172.21.15.55:0/1015467526 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130004400 con 0x7f61480d3b90 2024-04-25T08:54:21.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f614cabd640 1 -- 172.21.15.55:0/1015467526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61480c87f0 con 0x7f61480d3b90 2024-04-25T08:54:21.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.779+0000 7f614cabd640 1 -- 172.21.15.55:0/1015467526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61480c8db0 con 0x7f61480d3b90 2024-04-25T08:54:21.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.780+0000 7f614cabd640 1 -- 172.21.15.55:0/1015467526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61480c8610 con 0x7f61480d3b90 2024-04-25T08:54:21.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.780+0000 7f613effd640 1 -- 172.21.15.55:0/1015467526 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f613000c6d0 con 0x7f61480d3b90 2024-04-25T08:54:21.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.781+0000 7f613effd640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f612806b500 0x7f612806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:21.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.781+0000 7f613effd640 1 -- 172.21.15.55:0/1015467526 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6130089e80 con 0x7f61480d3b90 2024-04-25T08:54:21.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.781+0000 7f614659c640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f612806b500 0x7f612806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:21.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.781+0000 7f614659c640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f612806b500 0x7f612806d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6140034000 tx=0x7f614002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:21.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.785+0000 7f613effd640 1 -- 172.21.15.55:0/1015467526 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f61480c8610 con 0x7f61480d3b90 2024-04-25T08:54:21.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.967+0000 7f614cabd640 1 -- 172.21.15.55:0/1015467526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61480750b0 con 0x7f61480d3b90 2024-04-25T08:54:21.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.967+0000 7f613effd640 1 -- 172.21.15.55:0/1015467526 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6130017020 con 0x7f61480d3b90 2024-04-25T08:54:21.957 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:54:21.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 -- 172.21.15.55:0/1015467526 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f612806b500 msgr2=0x7f612806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f612806b500 0x7f612806d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6140034000 tx=0x7f614002e000 comp rx=0 tx=0).stop 2024-04-25T08:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 -- 172.21.15.55:0/1015467526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61480d3b90 msgr2=0x7f61480d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61480d3b90 0x7f61480d2780 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f613000e810 tx=0x7f613000ecd0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 -- 172.21.15.55:0/1015467526 shutdown_connections 2024-04-25T08:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f612806b500 0x7f612806d9c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614815dca0 0x7f61480d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61480d3b90 0x7f61480d2780 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 --2- 172.21.15.55:0/1015467526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61480cee80 0x7f614814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 -- 172.21.15.55:0/1015467526 >> 172.21.15.55:0/1015467526 conn(0x7f61480726c0 msgr2=0x7f61480d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 -- 172.21.15.55:0/1015467526 shutdown_connections 2024-04-25T08:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:21.969+0000 7f614cabd640 1 -- 172.21.15.55:0/1015467526 wait complete. 2024-04-25T08:54:21.970 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:54:22.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.082+0000 7ffb144ac640 1 Processor -- start 2024-04-25T08:54:22.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.082+0000 7ffb144ac640 1 -- start start 2024-04-25T08:54:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb144ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb0c0cef40 0x7ffb0c0b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb144ac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c1618d0 0x7ffb0c0d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb144ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c161d80 con 0x7ffb0c1610b0 2024-04-25T08:54:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb144ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c0d1ea0 con 0x7ffb0c0cef40 2024-04-25T08:54:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb144ac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c162040 con 0x7ffb0c1618d0 2024-04-25T08:54:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb11a47640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb0c0cef40 0x7ffb0c0b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb11a47640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb0c0cef40 0x7ffb0c0b9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41898/0 (socket says 172.21.15.55:41898) 2024-04-25T08:54:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb11a47640 1 -- 172.21.15.55:0/625679140 learned_addr learned my addr 172.21.15.55:0/625679140 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb12a49640 1 --2- 172.21.15.55:0/625679140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c1618d0 0x7ffb0c0d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb11a47640 1 -- 172.21.15.55:0/625679140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c1618d0 msgr2=0x7ffb0c0d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb11a47640 1 --2- 172.21.15.55:0/625679140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c1618d0 0x7ffb0c0d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb11a47640 1 -- 172.21.15.55:0/625679140 >> v1:172.21.15.55:6789/0 conn(0x7ffb0c1610b0 legacy=0x7ffb0c0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb11a47640 1 -- 172.21.15.55:0/625679140 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c162320 con 0x7ffb0c0cef40 2024-04-25T08:54:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.083+0000 7ffb12a49640 1 --2- 172.21.15.55:0/625679140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c1618d0 0x7ffb0c0d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.084+0000 7ffb11a47640 1 --2- 172.21.15.55:0/625679140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c0cef40 0x7ffb0c0b9580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009870 tx=0x7ffafc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a60300cd866f4a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.084+0000 7ffb11246640 1 -- 172.21.15.55:0/625679140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc037070 con 0x7ffb0c0cef40 2024-04-25T08:54:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.084+0000 7ffb11246640 1 -- 172.21.15.55:0/625679140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc032440 con 0x7ffb0c0cef40 2024-04-25T08:54:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.084+0000 7ffb11246640 1 -- 172.21.15.55:0/625679140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc032810 con 0x7ffb0c0cef40 2024-04-25T08:54:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.085+0000 7ffb144ac640 1 -- 172.21.15.55:0/625679140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c0cef40 msgr2=0x7ffb0c0b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.085+0000 7ffb144ac640 1 --2- 172.21.15.55:0/625679140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c0cef40 0x7ffb0c0b9580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009870 tx=0x7ffafc02a1c0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.085+0000 7ffb144ac640 1 -- 172.21.15.55:0/625679140 shutdown_connections 2024-04-25T08:54:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.085+0000 7ffb144ac640 1 --2- 172.21.15.55:0/625679140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c1618d0 0x7ffb0c0d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.085+0000 7ffb144ac640 1 --2- 172.21.15.55:0/625679140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c0cef40 0x7ffb0c0b9580 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.085+0000 7ffb144ac640 1 -- 172.21.15.55:0/625679140 >> 172.21.15.55:0/625679140 conn(0x7ffb0c0b5570 msgr2=0x7ffb0c0b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.085+0000 7ffb144ac640 1 -- 172.21.15.55:0/625679140 shutdown_connections 2024-04-25T08:54:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.085+0000 7ffb144ac640 1 -- 172.21.15.55:0/625679140 wait complete. 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.086+0000 7ffb144ac640 1 Processor -- start 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.086+0000 7ffb144ac640 1 -- start start 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb144ac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c0cef40 0x7ffb0c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb144ac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c1610b0 0x7ffb0c15a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb144ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c1618d0 0x7ffb0c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb144ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0b6c00 con 0x7ffb0c1618d0 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb144ac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0d20f0 con 0x7ffb0c1610b0 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb144ac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c161490 con 0x7ffb0c0cef40 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb12a49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c1618d0 0x7ffb0c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb12a49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c1618d0 0x7ffb0c0c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41906/0 (socket says 172.21.15.55:41906) 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb12a49640 1 -- 172.21.15.55:0/1271174584 learned_addr learned my addr 172.21.15.55:0/1271174584 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb12248640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c0cef40 0x7ffb0c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb11a47640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c1610b0 0x7ffb0c15a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb12a49640 1 -- 172.21.15.55:0/1271174584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c0cef40 msgr2=0x7ffb0c15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb12a49640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c0cef40 0x7ffb0c15b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb12a49640 1 -- 172.21.15.55:0/1271174584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c1610b0 msgr2=0x7ffb0c15a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb12a49640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c1610b0 0x7ffb0c15a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb12a49640 1 -- 172.21.15.55:0/1271174584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c15bde0 con 0x7ffb0c1618d0 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.087+0000 7ffb12a49640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c1618d0 0x7ffb0c0c8e00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400cf20 tx=0x7ffb0400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.088+0000 7ffb02ffd640 1 -- 172.21.15.55:0/1271174584 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0401a070 con 0x7ffb0c1618d0 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.088+0000 7ffb02ffd640 1 -- 172.21.15.55:0/1271174584 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0400d840 con 0x7ffb0c1618d0 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.088+0000 7ffb144ac640 1 -- 172.21.15.55:0/1271174584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c15c0c0 con 0x7ffb0c1618d0 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.088+0000 7ffb02ffd640 1 -- 172.21.15.55:0/1271174584 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400dc30 con 0x7ffb0c1618d0 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.088+0000 7ffb144ac640 1 -- 172.21.15.55:0/1271174584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c15c680 con 0x7ffb0c1618d0 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.089+0000 7ffb144ac640 1 -- 172.21.15.55:0/1271174584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c0750b0 con 0x7ffb0c1618d0 2024-04-25T08:54:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.089+0000 7ffb02ffd640 1 -- 172.21.15.55:0/1271174584 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb0401d070 con 0x7ffb0c1618d0 2024-04-25T08:54:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.090+0000 7ffb02ffd640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 0x7ffaf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.090+0000 7ffb12248640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 0x7ffaf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.090+0000 7ffb02ffd640 1 -- 172.21.15.55:0/1271174584 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb0408aad0 con 0x7ffb0c1618d0 2024-04-25T08:54:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.090+0000 7ffb12248640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 0x7ffaf006d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffb08001640 tx=0x7ffb08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.094+0000 7ffb02ffd640 1 -- 172.21.15.55:0/1271174584 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb04059940 con 0x7ffb0c1618d0 2024-04-25T08:54:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.294+0000 7ffb144ac640 1 -- 172.21.15.55:0/1271174584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffb0c0d1770 con 0x7ffb0c1618d0 2024-04-25T08:54:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.294+0000 7ffb02ffd640 1 -- 172.21.15.55:0/1271174584 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffb04059240 con 0x7ffb0c1618d0 2024-04-25T08:54:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T08:54:22.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 -- 172.21.15.55:0/1271174584 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 msgr2=0x7ffaf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 0x7ffaf006d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffb08001640 tx=0x7ffb08009040 comp rx=0 tx=0).stop 2024-04-25T08:54:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 -- 172.21.15.55:0/1271174584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c1618d0 msgr2=0x7ffb0c0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c1618d0 0x7ffb0c0c8e00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400cf20 tx=0x7ffb0400a7d0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 -- 172.21.15.55:0/1271174584 shutdown_connections 2024-04-25T08:54:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 0x7ffaf006d990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c1618d0 0x7ffb0c0c8e00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c1610b0 0x7ffb0c15a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 --2- 172.21.15.55:0/1271174584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c0cef40 0x7ffb0c15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 -- 172.21.15.55:0/1271174584 >> 172.21.15.55:0/1271174584 conn(0x7ffb0c0b5570 msgr2=0x7ffb0c0d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 -- 172.21.15.55:0/1271174584 shutdown_connections 2024-04-25T08:54:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.296+0000 7ffb144ac640 1 -- 172.21.15.55:0/1271174584 wait complete. 2024-04-25T08:54:22.297 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T08:54:22.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:22.297 DEBUG:teuthology.orchestra.run.smithi167:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T08:54:22.328 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T08:54:22.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:22.328 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T08:54:22.385 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:54:22.385 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:54:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.497+0000 7f1f10153640 1 Processor -- start 2024-04-25T08:54:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.497+0000 7f1f10153640 1 -- start start 2024-04-25T08:54:22.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.498+0000 7f1f10153640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f0815dce0 0x7f1f080d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.498+0000 7f1f10153640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0815e0c0 con 0x7f1f080d35b0 2024-04-25T08:54:22.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.498+0000 7f1f10153640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f080d2510 con 0x7f1f080b5b60 2024-04-25T08:54:22.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.498+0000 7f1f10153640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080d27f0 con 0x7f1f0815dce0 2024-04-25T08:54:22.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.498+0000 7f1f0deef640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f0815dce0 0x7f1f080d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.498+0000 7f1f0d6ee640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1f080d35b0 0x7f1f080b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35962/0 (socket says 172.21.15.55:35962) 2024-04-25T08:54:22.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.498+0000 7f1f0d6ee640 1 -- 172.21.15.55:0/838163065 learned_addr learned my addr 172.21.15.55:0/838163065 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.498+0000 7f1f0deef640 1 -- 172.21.15.55:0/838163065 >> v1:172.21.15.167:6789/0 conn(0x7f1f080b5b60 legacy=0x7f1f080b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.498+0000 7f1f0deef640 1 -- 172.21.15.55:0/838163065 >> v1:172.21.15.55:6789/0 conn(0x7f1f080d35b0 legacy=0x7f1f080b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.498+0000 7f1f0deef640 1 -- 172.21.15.55:0/838163065 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080d2ad0 con 0x7f1f0815dce0 2024-04-25T08:54:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.498+0000 7f1f0ceed640 1 -- 172.21.15.55:0/838163065 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621170906 0 0) 0x7f1f0815e0c0 con 0x7f1f080d35b0 2024-04-25T08:54:22.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.499+0000 7f1f0deef640 1 --2- 172.21.15.55:0/838163065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f0815dce0 0x7f1f080d1a50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1f040097a0 tx=0x7f1f0402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e060653c32917d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:22.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.499+0000 7f1f0ceed640 1 -- 172.21.15.55:0/838163065 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04037070 con 0x7f1f0815dce0 2024-04-25T08:54:22.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.499+0000 7f1f0ceed640 1 -- 172.21.15.55:0/838163065 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f04032440 con 0x7f1f0815dce0 2024-04-25T08:54:22.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.499+0000 7f1f0ceed640 1 -- 172.21.15.55:0/838163065 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04032810 con 0x7f1f0815dce0 2024-04-25T08:54:22.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.500+0000 7f1f10153640 1 -- 172.21.15.55:0/838163065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f0815dce0 msgr2=0x7f1f080d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.500+0000 7f1f10153640 1 --2- 172.21.15.55:0/838163065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f0815dce0 0x7f1f080d1a50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1f040097a0 tx=0x7f1f0402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.500+0000 7f1f10153640 1 -- 172.21.15.55:0/838163065 shutdown_connections 2024-04-25T08:54:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.500+0000 7f1f10153640 1 --2- 172.21.15.55:0/838163065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f0815dce0 0x7f1f080d1a50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.500+0000 7f1f10153640 1 -- 172.21.15.55:0/838163065 >> 172.21.15.55:0/838163065 conn(0x7f1f08072900 msgr2=0x7f1f080d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.500+0000 7f1f10153640 1 -- 172.21.15.55:0/838163065 shutdown_connections 2024-04-25T08:54:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.500+0000 7f1f10153640 1 -- 172.21.15.55:0/838163065 wait complete. 2024-04-25T08:54:22.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.501+0000 7f1f10153640 1 Processor -- start 2024-04-25T08:54:22.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.501+0000 7f1f10153640 1 -- start start 2024-04-25T08:54:22.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f10153640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f080b5b60 0x7f1f08157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f10153640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f080d35b0 0x7f1f080b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f10153640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f0815dce0 0x7f1f081f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f10153640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080b9820 con 0x7f1f080b5b60 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f10153640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080d3090 con 0x7f1f080d35b0 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f10153640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080b99a0 con 0x7f1f0815dce0 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f0deef640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f080b5b60 0x7f1f08157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f0deef640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f080b5b60 0x7f1f08157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41926/0 (socket says 172.21.15.55:41926) 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f0deef640 1 -- 172.21.15.55:0/2583051467 learned_addr learned my addr 172.21.15.55:0/2583051467 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f0deef640 1 -- 172.21.15.55:0/2583051467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f0815dce0 msgr2=0x7f1f081f39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f0deef640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f0815dce0 0x7f1f081f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f0deef640 1 -- 172.21.15.55:0/2583051467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f080d35b0 msgr2=0x7f1f080b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f0deef640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f080d35b0 0x7f1f080b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f0deef640 1 -- 172.21.15.55:0/2583051467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0815f980 con 0x7f1f080b5b60 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f0deef640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f080b5b60 0x7f1f08157850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1f040097a0 tx=0x7f1f040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1efe7fc640 1 -- 172.21.15.55:0/2583051467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04041070 con 0x7f1f080b5b60 2024-04-25T08:54:22.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1efe7fc640 1 -- 172.21.15.55:0/2583051467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0403c870 con 0x7f1f080b5b60 2024-04-25T08:54:22.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1efe7fc640 1 -- 172.21.15.55:0/2583051467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04037040 con 0x7f1f080b5b60 2024-04-25T08:54:22.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.502+0000 7f1f10153640 1 -- 172.21.15.55:0/2583051467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0815fc60 con 0x7f1f080b5b60 2024-04-25T08:54:22.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.503+0000 7f1f10153640 1 -- 172.21.15.55:0/2583051467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f08160220 con 0x7f1f080b5b60 2024-04-25T08:54:22.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.503+0000 7f1f10153640 1 -- 172.21.15.55:0/2583051467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f080749b0 con 0x7f1f080b5b60 2024-04-25T08:54:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.504+0000 7f1efe7fc640 1 -- 172.21.15.55:0/2583051467 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1f04044070 con 0x7f1f080b5b60 2024-04-25T08:54:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.504+0000 7f1efe7fc640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1eec06b4d0 0x7f1eec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.505+0000 7f1f0d6ee640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1eec06b4d0 0x7f1eec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.505+0000 7f1efe7fc640 1 -- 172.21.15.55:0/2583051467 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f040aada0 con 0x7f1f080b5b60 2024-04-25T08:54:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.505+0000 7f1f0d6ee640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1eec06b4d0 0x7f1eec06d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8007fd0 tx=0x7f1ef8007920 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:22.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.509+0000 7f1efe7fc640 1 -- 172.21.15.55:0/2583051467 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1f04079c00 con 0x7f1f080b5b60 2024-04-25T08:54:22.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.731+0000 7f1f10153640 1 -- 172.21.15.55:0/2583051467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f080b7ca0 con 0x7f1f080b5b60 2024-04-25T08:54:22.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.732+0000 7f1efe7fc640 1 -- 172.21.15.55:0/2583051467 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4938 (secure 0 0 0) 0x7f1f04079500 con 0x7f1f080b5b60 2024-04-25T08:54:22.722 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:22.722 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1710920573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1710920573},{"type":"v1","addr":"172.21.15.167:6834","nonce":1710920573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3883943704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3883943704},{"type":"v1","addr":"172.21.15.55:6836","nonce":3883943704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1410084850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1410084850},{"type":"v1","addr":"172.21.15.55:6837","nonce":1410084850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:53:42.558115+0000","modified":"2024-04-25T08:53:44.566698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/3753268738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3753268738},{"type":"v1","addr":"172.21.15.167:6835","nonce":3753268738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:54:22.722 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-04-25T08:54:22.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 -- 172.21.15.55:0/2583051467 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1eec06b4d0 msgr2=0x7f1eec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1eec06b4d0 0x7f1eec06d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8007fd0 tx=0x7f1ef8007920 comp rx=0 tx=0).stop 2024-04-25T08:54:22.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 -- 172.21.15.55:0/2583051467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f080b5b60 msgr2=0x7f1f08157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f080b5b60 0x7f1f08157850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1f040097a0 tx=0x7f1f040046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 -- 172.21.15.55:0/2583051467 shutdown_connections 2024-04-25T08:54:22.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1eec06b4d0 0x7f1eec06d990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f0815dce0 0x7f1f081f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f080d35b0 0x7f1f080b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 --2- 172.21.15.55:0/2583051467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f080b5b60 0x7f1f08157850 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 -- 172.21.15.55:0/2583051467 >> 172.21.15.55:0/2583051467 conn(0x7f1f08072900 msgr2=0x7f1f080b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:22.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 -- 172.21.15.55:0/2583051467 shutdown_connections 2024-04-25T08:54:22.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.734+0000 7f1f10153640 1 -- 172.21.15.55:0/2583051467 wait complete. 2024-04-25T08:54:22.736 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.847+0000 7efebe17e640 1 Processor -- start 2024-04-25T08:54:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.847+0000 7efebe17e640 1 -- start start 2024-04-25T08:54:22.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.848+0000 7efebe17e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efeb815dce0 0x7efeb80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.848+0000 7efebe17e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb815e0c0 con 0x7efeb80b5b60 2024-04-25T08:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.848+0000 7efebe17e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb80d2510 con 0x7efeb80d35b0 2024-04-25T08:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.848+0000 7efebe17e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80d27f0 con 0x7efeb815dce0 2024-04-25T08:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.848+0000 7efeb77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efeb815dce0 0x7efeb80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.848+0000 7efeb7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efeb80b5b60 0x7efeb80b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35976/0 (socket says 172.21.15.55:35976) 2024-04-25T08:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.848+0000 7efeb7fff640 1 -- 172.21.15.55:0/171512719 learned_addr learned my addr 172.21.15.55:0/171512719 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.848+0000 7efeb77fe640 1 -- 172.21.15.55:0/171512719 >> v1:172.21.15.167:6789/0 conn(0x7efeb80d35b0 legacy=0x7efeb80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.848+0000 7efeb77fe640 1 -- 172.21.15.55:0/171512719 >> v1:172.21.15.55:6789/0 conn(0x7efeb80b5b60 legacy=0x7efeb80b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.848+0000 7efeb77fe640 1 -- 172.21.15.55:0/171512719 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80d2ad0 con 0x7efeb815dce0 2024-04-25T08:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.849+0000 7efeb77fe640 1 --2- 172.21.15.55:0/171512719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb815dce0 0x7efeb80d1a50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efea80097a0 tx=0x7efea802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2472db0d4f840c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.849+0000 7efeb67fc640 1 -- 172.21.15.55:0/171512719 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8037070 con 0x7efeb815dce0 2024-04-25T08:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.849+0000 7efeb67fc640 1 -- 172.21.15.55:0/171512719 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea8032440 con 0x7efeb815dce0 2024-04-25T08:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.849+0000 7efeb67fc640 1 -- 172.21.15.55:0/171512719 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8032810 con 0x7efeb815dce0 2024-04-25T08:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.850+0000 7efebe17e640 1 -- 172.21.15.55:0/171512719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb815dce0 msgr2=0x7efeb80d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.850+0000 7efebe17e640 1 --2- 172.21.15.55:0/171512719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb815dce0 0x7efeb80d1a50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efea80097a0 tx=0x7efea802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.850+0000 7efebe17e640 1 -- 172.21.15.55:0/171512719 shutdown_connections 2024-04-25T08:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.850+0000 7efebe17e640 1 --2- 172.21.15.55:0/171512719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb815dce0 0x7efeb80d1a50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.850+0000 7efebe17e640 1 -- 172.21.15.55:0/171512719 >> 172.21.15.55:0/171512719 conn(0x7efeb8072900 msgr2=0x7efeb80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.850+0000 7efebe17e640 1 -- 172.21.15.55:0/171512719 shutdown_connections 2024-04-25T08:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.850+0000 7efebe17e640 1 -- 172.21.15.55:0/171512719 wait complete. 2024-04-25T08:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.851+0000 7efebe17e640 1 Processor -- start 2024-04-25T08:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.851+0000 7efebe17e640 1 -- start start 2024-04-25T08:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efebe17e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb80b5b60 0x7efeb81f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efebe17e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80d35b0 0x7efeb8154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efebe17e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efeb815dce0 0x7efeb815ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efebe17e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80b9820 con 0x7efeb80d35b0 2024-04-25T08:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efebe17e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80d3090 con 0x7efeb80b5b60 2024-04-25T08:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efebe17e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80b99a0 con 0x7efeb815dce0 2024-04-25T08:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efeb6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80d35b0 0x7efeb8154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efeb6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80d35b0 0x7efeb8154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41934/0 (socket says 172.21.15.55:41934) 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efeb6ffd640 1 -- 172.21.15.55:0/2733731764 learned_addr learned my addr 172.21.15.55:0/2733731764 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efeb77fe640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb80b5b60 0x7efeb81f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efeb7fff640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efeb815dce0 0x7efeb815ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efeb6ffd640 1 -- 172.21.15.55:0/2733731764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efeb815dce0 msgr2=0x7efeb815ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efeb6ffd640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efeb815dce0 0x7efeb815ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efeb6ffd640 1 -- 172.21.15.55:0/2733731764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb80b5b60 msgr2=0x7efeb81f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efeb6ffd640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb80b5b60 0x7efeb81f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.852+0000 7efeb6ffd640 1 -- 172.21.15.55:0/2733731764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb81f8010 con 0x7efeb80d35b0 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.853+0000 7efeb6ffd640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80d35b0 0x7efeb8154550 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efeac00c400 tx=0x7efeac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.853+0000 7efe9ffff640 1 -- 172.21.15.55:0/2733731764 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac011790 con 0x7efeb80d35b0 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.853+0000 7efe9ffff640 1 -- 172.21.15.55:0/2733731764 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac017070 con 0x7efeb80d35b0 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.853+0000 7efe9ffff640 1 -- 172.21.15.55:0/2733731764 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac011bb0 con 0x7efeb80d35b0 2024-04-25T08:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.853+0000 7efebe17e640 1 -- 172.21.15.55:0/2733731764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb80cd520 con 0x7efeb80d35b0 2024-04-25T08:54:22.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.853+0000 7efebe17e640 1 -- 172.21.15.55:0/2733731764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb815fa50 con 0x7efeb80d35b0 2024-04-25T08:54:22.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.854+0000 7efebe17e640 1 -- 172.21.15.55:0/2733731764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb80749b0 con 0x7efeb80d35b0 2024-04-25T08:54:22.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.854+0000 7efe9ffff640 1 -- 172.21.15.55:0/2733731764 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efeac01c460 con 0x7efeb80d35b0 2024-04-25T08:54:22.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.855+0000 7efe9ffff640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efea406b500 0x7efea406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:22.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.855+0000 7efe9ffff640 1 -- 172.21.15.55:0/2733731764 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7efeac08a170 con 0x7efeb80d35b0 2024-04-25T08:54:22.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.855+0000 7efeb77fe640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efea406b500 0x7efea406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:22.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.855+0000 7efeb77fe640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efea406b500 0x7efea406d9c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efea8034000 tx=0x7efea802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:22.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:22.859+0000 7efe9ffff640 1 -- 172.21.15.55:0/2733731764 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efeb81f8010 con 0x7efeb80d35b0 2024-04-25T08:54:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.040+0000 7efebe17e640 1 -- 172.21.15.55:0/2733731764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeb80d0580 con 0x7efeb80d35b0 2024-04-25T08:54:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.042+0000 7efe9ffff640 1 -- 172.21.15.55:0/2733731764 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16798 (secure 0 0 0) 0x7efeac058ed0 con 0x7efeb80d35b0 2024-04-25T08:54:23.032 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:23.032 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:54:22.706444+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 -- 172.21.15.55:0/2733731764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efea406b500 msgr2=0x7efea406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efea406b500 0x7efea406d9c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efea8034000 tx=0x7efea802e000 comp rx=0 tx=0).stop 2024-04-25T08:54:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 -- 172.21.15.55:0/2733731764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80d35b0 msgr2=0x7efeb8154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80d35b0 0x7efeb8154550 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efeac00c400 tx=0x7efeac00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 -- 172.21.15.55:0/2733731764 shutdown_connections 2024-04-25T08:54:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efea406b500 0x7efea406d9c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efeb815dce0 0x7efeb815ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80d35b0 0x7efeb8154550 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 --2- 172.21.15.55:0/2733731764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb80b5b60 0x7efeb81f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 -- 172.21.15.55:0/2733731764 >> 172.21.15.55:0/2733731764 conn(0x7efeb8072900 msgr2=0x7efeb80ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 -- 172.21.15.55:0/2733731764 shutdown_connections 2024-04-25T08:54:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.044+0000 7efebe17e640 1 -- 172.21.15.55:0/2733731764 wait complete. 2024-04-25T08:54:23.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:53:40.498103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:53:41.542396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:23.046 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.160+0000 7f2e1d15c640 1 Processor -- start 2024-04-25T08:54:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.160+0000 7f2e1d15c640 1 -- start start 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.161+0000 7f2e1d15c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e180d3b90 0x7f2e180d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.161+0000 7f2e1d15c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e180d4090 con 0x7f2e1815dca0 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.161+0000 7f2e1d15c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e180d4370 con 0x7f2e180d0f60 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.161+0000 7f2e1d15c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180b6b20 con 0x7f2e180d3b90 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.161+0000 7f2e16d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2e1815dca0 0x7f2e180ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35980/0 (socket says 172.21.15.55:35980) 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.161+0000 7f2e16d9d640 1 -- 172.21.15.55:0/1070752707 learned_addr learned my addr 172.21.15.55:0/1070752707 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.161+0000 7f2e1659c640 1 --2- 172.21.15.55:0/1070752707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e180d3b90 0x7f2e180d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.161+0000 7f2e15d9b640 1 -- 172.21.15.55:0/1070752707 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004949786 0 0) 0x7f2e180d4090 con 0x7f2e1815dca0 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.161+0000 7f2e15d9b640 1 -- 172.21.15.55:0/1070752707 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e00003520 con 0x7f2e1815dca0 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.161+0000 7f2e15d9b640 1 -- 172.21.15.55:0/1070752707 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011290363 0 0) 0x7f2e180d4370 con 0x7f2e180d0f60 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.161+0000 7f2e15d9b640 1 -- 172.21.15.55:0/1070752707 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e180d4090 con 0x7f2e180d0f60 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.162+0000 7f2e1659c640 1 -- 172.21.15.55:0/1070752707 >> v1:172.21.15.167:6789/0 conn(0x7f2e180d0f60 legacy=0x7f2e180b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.162+0000 7f2e15d9b640 1 -- 172.21.15.55:0/1070752707 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3349851791 0 0) 0x7f2e00003520 con 0x7f2e1815dca0 2024-04-25T08:54:23.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.162+0000 7f2e1659c640 1 -- 172.21.15.55:0/1070752707 >> v1:172.21.15.55:6789/0 conn(0x7f2e1815dca0 legacy=0x7f2e180ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.162+0000 7f2e1659c640 1 -- 172.21.15.55:0/1070752707 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180d4650 con 0x7f2e180d3b90 2024-04-25T08:54:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.162+0000 7f2e1659c640 1 --2- 172.21.15.55:0/1070752707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e180d3b90 0x7f2e180d0a20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0097d0 tx=0x7f2e0c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bc9c112061fcc6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.163+0000 7f2e15d9b640 1 -- 172.21.15.55:0/1070752707 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c037070 con 0x7f2e180d3b90 2024-04-25T08:54:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.163+0000 7f2e15d9b640 1 -- 172.21.15.55:0/1070752707 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c02ac30 con 0x7f2e180d3b90 2024-04-25T08:54:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.163+0000 7f2e15d9b640 1 -- 172.21.15.55:0/1070752707 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e080019f0 con 0x7f2e180d3b90 2024-04-25T08:54:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.163+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1070752707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e180d3b90 msgr2=0x7f2e180d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.163+0000 7f2e1d15c640 1 --2- 172.21.15.55:0/1070752707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e180d3b90 0x7f2e180d0a20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0097d0 tx=0x7f2e0c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.163+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1070752707 shutdown_connections 2024-04-25T08:54:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.163+0000 7f2e1d15c640 1 --2- 172.21.15.55:0/1070752707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e180d3b90 0x7f2e180d0a20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.163+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1070752707 >> 172.21.15.55:0/1070752707 conn(0x7f2e180726c0 msgr2=0x7f2e18072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.163+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1070752707 shutdown_connections 2024-04-25T08:54:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.163+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1070752707 wait complete. 2024-04-25T08:54:23.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.165+0000 7f2e1d15c640 1 Processor -- start 2024-04-25T08:54:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.165+0000 7f2e1d15c640 1 -- start start 2024-04-25T08:54:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.165+0000 7f2e1d15c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e180d0f60 0x7f2e180c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.165+0000 7f2e1d15c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e180d3b90 0x7f2e18159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.165+0000 7f2e1d15c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e1815dca0 0x7f2e1815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.165+0000 7f2e1d15c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1815e080 con 0x7f2e180d3b90 2024-04-25T08:54:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.165+0000 7f2e1d15c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180cf050 con 0x7f2e180d0f60 2024-04-25T08:54:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.165+0000 7f2e1d15c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1815e200 con 0x7f2e1815dca0 2024-04-25T08:54:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e180d3b90 0x7f2e18159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e180d3b90 0x7f2e18159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41940/0 (socket says 172.21.15.55:41940) 2024-04-25T08:54:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1659c640 1 -- 172.21.15.55:0/1305424804 learned_addr learned my addr 172.21.15.55:0/1305424804 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1759e640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e1815dca0 0x7f2e1815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e16d9d640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e180d0f60 0x7f2e180c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1659c640 1 -- 172.21.15.55:0/1305424804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e1815dca0 msgr2=0x7f2e1815ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1659c640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e1815dca0 0x7f2e1815ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1659c640 1 -- 172.21.15.55:0/1305424804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e180d0f60 msgr2=0x7f2e180c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1659c640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e180d0f60 0x7f2e180c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1659c640 1 -- 172.21.15.55:0/1305424804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1815a3d0 con 0x7f2e180d3b90 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1759e640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e1815dca0 0x7f2e1815ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e16d9d640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e180d0f60 0x7f2e180c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1659c640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e180d3b90 0x7f2e18159510 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0097d0 tx=0x7f2e0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2dff7fe640 1 -- 172.21.15.55:0/1305424804 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c037050 con 0x7f2e180d3b90 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2dff7fe640 1 -- 172.21.15.55:0/1305424804 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c043070 con 0x7f2e180d3b90 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1305424804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e18159e10 con 0x7f2e180d3b90 2024-04-25T08:54:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2dff7fe640 1 -- 172.21.15.55:0/1305424804 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c006e10 con 0x7f2e180d3b90 2024-04-25T08:54:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.166+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1305424804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e181540b0 con 0x7f2e180d3b90 2024-04-25T08:54:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.167+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1305424804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e180750b0 con 0x7f2e180d3b90 2024-04-25T08:54:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.168+0000 7f2dff7fe640 1 -- 172.21.15.55:0/1305424804 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e0c03ca50 con 0x7f2e180d3b90 2024-04-25T08:54:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.168+0000 7f2dff7fe640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0406b500 0x7f2e0406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.168+0000 7f2dff7fe640 1 -- 172.21.15.55:0/1305424804 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2e0c0ab0c0 con 0x7f2e180d3b90 2024-04-25T08:54:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.168+0000 7f2e16d9d640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0406b500 0x7f2e0406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.169+0000 7f2e16d9d640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0406b500 0x7f2e0406d9c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2e08001b60 tx=0x7f2e08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.173+0000 7f2dff7fe640 1 -- 172.21.15.55:0/1305424804 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e0c079f40 con 0x7f2e180d3b90 2024-04-25T08:54:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.358+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1305424804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e180b4d20 con 0x7f2e180d3b90 2024-04-25T08:54:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.358+0000 7f2dff7fe640 1 -- 172.21.15.55:0/1305424804 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e0c079840 con 0x7f2e180d3b90 2024-04-25T08:54:23.348 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:23.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1305424804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0406b500 msgr2=0x7f2e0406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0406b500 0x7f2e0406d9c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2e08001b60 tx=0x7f2e08009040 comp rx=0 tx=0).stop 2024-04-25T08:54:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1305424804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e180d3b90 msgr2=0x7f2e18159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e180d3b90 0x7f2e18159510 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0097d0 tx=0x7f2e0c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1305424804 shutdown_connections 2024-04-25T08:54:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0406b500 0x7f2e0406d9c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e1815dca0 0x7f2e1815ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e180d3b90 0x7f2e18159510 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 --2- 172.21.15.55:0/1305424804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e180d0f60 0x7f2e180c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1305424804 >> 172.21.15.55:0/1305424804 conn(0x7f2e180726c0 msgr2=0x7f2e1815a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1305424804 shutdown_connections 2024-04-25T08:54:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.360+0000 7f2e1d15c640 1 -- 172.21.15.55:0/1305424804 wait complete. 2024-04-25T08:54:23.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:54:23.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.475+0000 7fb4be730640 1 Processor -- start 2024-04-25T08:54:23.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.475+0000 7fb4be730640 1 -- start start 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.476+0000 7fb4be730640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb4b80d1130 0x7fb4b80b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.476+0000 7fb4be730640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b80d4090 con 0x7fb4b815dca0 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.476+0000 7fb4be730640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b80d4370 con 0x7fb4b80d3b90 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.476+0000 7fb4be730640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b80b6b20 con 0x7fb4b80d1130 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.476+0000 7fb4b7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb4b815dca0 0x7fb4b80ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35986/0 (socket says 172.21.15.55:35986) 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.476+0000 7fb4b7fff640 1 -- 172.21.15.55:0/3582231537 learned_addr learned my addr 172.21.15.55:0/3582231537 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.476+0000 7fb4bcccd640 1 --2- 172.21.15.55:0/3582231537 >> v2:172.21.15.167:3300/0 conn(0x7fb4b80d1130 0x7fb4b80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.476+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040839849 0 0) 0x7fb4b80d4090 con 0x7fb4b815dca0 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.476+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a0003520 con 0x7fb4b815dca0 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1583535044 0 0) 0x7fb4a0003520 con 0x7fb4b815dca0 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 >> v2:172.21.15.167:3300/0 conn(0x7fb4b80d1130 msgr2=0x7fb4b80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 --2- 172.21.15.55:0/3582231537 >> v2:172.21.15.167:3300/0 conn(0x7fb4b80d1130 0x7fb4b80b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 >> v1:172.21.15.167:6789/0 conn(0x7fb4b80d3b90 legacy=0x7fb4b80d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b80d4650 con 0x7fb4b815dca0 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fb4a8001670 con 0x7fb4b815dca0 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 >> v1:172.21.15.55:6789/0 conn(0x7fb4b815dca0 legacy=0x7fb4b80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 --2- 172.21.15.55:0/3582231537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4a00039b0 0x7fb4a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 --2- 172.21.15.55:0/3582231537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 0x7fb4a0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 --2- 172.21.15.55:0/3582231537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4a0005080 0x7fb4a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a000bfb0 con 0x7fb4a00043b0 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a000c160 con 0x7fb4a0005080 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a000c360 con 0x7fb4a00039b0 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b77fe640 1 --2- 172.21.15.55:0/3582231537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 0x7fb4a0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b7fff640 1 --2- 172.21.15.55:0/3582231537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4a00039b0 0x7fb4a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4bcccd640 1 --2- 172.21.15.55:0/3582231537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4a0005080 0x7fb4a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b77fe640 1 -- 172.21.15.55:0/3582231537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4a00039b0 msgr2=0x7fb4a0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b77fe640 1 --2- 172.21.15.55:0/3582231537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4a00039b0 0x7fb4a0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b77fe640 1 -- 172.21.15.55:0/3582231537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4a0005080 msgr2=0x7fb4a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b77fe640 1 --2- 172.21.15.55:0/3582231537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4a0005080 0x7fb4a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4b77fe640 1 -- 172.21.15.55:0/3582231537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a0003520 con 0x7fb4a00043b0 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.477+0000 7fb4bcccd640 1 -- 172.21.15.55:0/3582231537 reap_dead start 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.478+0000 7fb4b77fe640 1 --2- 172.21.15.55:0/3582231537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 0x7fb4a0004880 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0018e0 tx=0x7fb4a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea4d26cb3560f60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.478+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac037070 con 0x7fb4a00043b0 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.478+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac02ac00 con 0x7fb4a00043b0 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.478+0000 7fb4b6ffd640 1 -- 172.21.15.55:0/3582231537 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac0014e0 con 0x7fb4a00043b0 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.479+0000 7fb4be730640 1 -- 172.21.15.55:0/3582231537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 msgr2=0x7fb4a0004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.479+0000 7fb4be730640 1 --2- 172.21.15.55:0/3582231537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 0x7fb4a0004880 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0018e0 tx=0x7fb4a0005830 comp rx=0 tx=0).stop 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.479+0000 7fb4be730640 1 -- 172.21.15.55:0/3582231537 shutdown_connections 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.479+0000 7fb4be730640 1 --2- 172.21.15.55:0/3582231537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 0x7fb4a0004880 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.479+0000 7fb4be730640 1 -- 172.21.15.55:0/3582231537 >> 172.21.15.55:0/3582231537 conn(0x7fb4b80726c0 msgr2=0x7fb4b8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.479+0000 7fb4be730640 1 -- 172.21.15.55:0/3582231537 shutdown_connections 2024-04-25T08:54:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.479+0000 7fb4be730640 1 -- 172.21.15.55:0/3582231537 wait complete. 2024-04-25T08:54:23.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.480+0000 7fb4be730640 1 Processor -- start 2024-04-25T08:54:23.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.480+0000 7fb4be730640 1 -- start start 2024-04-25T08:54:23.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4be730640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 0x7fb4b8150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4be730640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4b8153f40 0x7fb4b81543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4be730640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4b80cbc00 0x7fb4b80cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4be730640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b815e200 con 0x7fb4a00043b0 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4be730640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b815e080 con 0x7fb4b8153f40 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4be730640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b80d0a20 con 0x7fb4b80cbc00 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 0x7fb4b8150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 0x7fb4b8150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41958/0 (socket says 172.21.15.55:41958) 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b7fff640 1 -- 172.21.15.55:0/2888434229 learned_addr learned my addr 172.21.15.55:0/2888434229 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b77fe640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4b8153f40 0x7fb4b81543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4bcccd640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4b80cbc00 0x7fb4b80cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b7fff640 1 -- 172.21.15.55:0/2888434229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4b80cbc00 msgr2=0x7fb4b80cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b7fff640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4b80cbc00 0x7fb4b80cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b7fff640 1 -- 172.21.15.55:0/2888434229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4b8153f40 msgr2=0x7fb4b81543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b7fff640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4b8153f40 0x7fb4b81543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b7fff640 1 -- 172.21.15.55:0/2888434229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b80cab60 con 0x7fb4a00043b0 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b77fe640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4b8153f40 0x7fb4b81543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b7fff640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 0x7fb4b8150440 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8004f70 tx=0x7fb4a80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b4ff9640 1 -- 172.21.15.55:0/2888434229 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800f750 con 0x7fb4a00043b0 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b4ff9640 1 -- 172.21.15.55:0/2888434229 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8018070 con 0x7fb4a00043b0 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.481+0000 7fb4b4ff9640 1 -- 172.21.15.55:0/2888434229 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800fb50 con 0x7fb4a00043b0 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.482+0000 7fb4be730640 1 -- 172.21.15.55:0/2888434229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b80cae40 con 0x7fb4a00043b0 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.482+0000 7fb4be730640 1 -- 172.21.15.55:0/2888434229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b80cb400 con 0x7fb4a00043b0 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.482+0000 7fb4be730640 1 -- 172.21.15.55:0/2888434229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b80750b0 con 0x7fb4a00043b0 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.483+0000 7fb4b4ff9640 1 -- 172.21.15.55:0/2888434229 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb4a800fcf0 con 0x7fb4a00043b0 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.483+0000 7fb4b4ff9640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb4a406b500 0x7fb4a406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.483+0000 7fb4b4ff9640 1 -- 172.21.15.55:0/2888434229 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb4a808a2a0 con 0x7fb4a00043b0 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.483+0000 7fb4b77fe640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb4a406b500 0x7fb4a406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.484+0000 7fb4b77fe640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb4a406b500 0x7fb4a406d9c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac034000 tx=0x7fb4ac02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:23.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.488+0000 7fb4b4ff9640 1 -- 172.21.15.55:0/2888434229 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb4a8059000 con 0x7fb4a00043b0 2024-04-25T08:54:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.666+0000 7fb4be730640 1 -- 172.21.15.55:0/2888434229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4b8160c60 con 0x7fb4a00043b0 2024-04-25T08:54:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.666+0000 7fb4b4ff9640 1 -- 172.21.15.55:0/2888434229 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4a8058900 con 0x7fb4a00043b0 2024-04-25T08:54:23.656 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:54:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 -- 172.21.15.55:0/2888434229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb4a406b500 msgr2=0x7fb4a406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb4a406b500 0x7fb4a406d9c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac034000 tx=0x7fb4ac02e000 comp rx=0 tx=0).stop 2024-04-25T08:54:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 -- 172.21.15.55:0/2888434229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 msgr2=0x7fb4b8150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 0x7fb4b8150440 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8004f70 tx=0x7fb4a80074f0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 -- 172.21.15.55:0/2888434229 shutdown_connections 2024-04-25T08:54:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb4a406b500 0x7fb4a406d9c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4b80cbc00 0x7fb4b80cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4b8153f40 0x7fb4b81543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 --2- 172.21.15.55:0/2888434229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4a00043b0 0x7fb4b8150440 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 -- 172.21.15.55:0/2888434229 >> 172.21.15.55:0/2888434229 conn(0x7fb4b80726c0 msgr2=0x7fb4b80b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 -- 172.21.15.55:0/2888434229 shutdown_connections 2024-04-25T08:54:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.668+0000 7fb4be730640 1 -- 172.21.15.55:0/2888434229 wait complete. 2024-04-25T08:54:23.669 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:54:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.786+0000 7f5a2bff5640 1 Processor -- start 2024-04-25T08:54:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.787+0000 7f5a2bff5640 1 -- start start 2024-04-25T08:54:23.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.787+0000 7f5a2bff5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a240b97c0 0x7f5a240b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.787+0000 7f5a2bff5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a240b5a30 0x7f5a240d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.788+0000 7f5a2bff5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a241627a0 con 0x7f5a2415dc80 2024-04-25T08:54:23.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.788+0000 7f5a2bff5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a24161f80 con 0x7f5a240b97c0 2024-04-25T08:54:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.788+0000 7f5a2bff5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240b5e60 con 0x7f5a240b5a30 2024-04-25T08:54:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.788+0000 7f5a29590640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a240b97c0 0x7f5a240b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.788+0000 7f5a29590640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a240b97c0 0x7f5a240b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41960/0 (socket says 172.21.15.55:41960) 2024-04-25T08:54:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.788+0000 7f5a29590640 1 -- 172.21.15.55:0/2321068005 learned_addr learned my addr 172.21.15.55:0/2321068005 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.788+0000 7f5a2a592640 1 --2- 172.21.15.55:0/2321068005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a240b5a30 0x7f5a240d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.788+0000 7f5a29590640 1 -- 172.21.15.55:0/2321068005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a240b5a30 msgr2=0x7f5a240d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.788+0000 7f5a29590640 1 --2- 172.21.15.55:0/2321068005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a240b5a30 0x7f5a240d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.788+0000 7f5a29590640 1 -- 172.21.15.55:0/2321068005 >> v1:172.21.15.167:6789/0 conn(0x7f5a2415dc80 legacy=0x7f5a24161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.788+0000 7f5a29590640 1 -- 172.21.15.55:0/2321068005 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a241621e0 con 0x7f5a240b97c0 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.789+0000 7f5a29590640 1 --2- 172.21.15.55:0/2321068005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a240b97c0 0x7f5a240b54f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5a140098a0 tx=0x7f5a1402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80866707ed94ee0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.789+0000 7f5a28d8f640 1 -- 172.21.15.55:0/2321068005 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14037070 con 0x7f5a240b97c0 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.789+0000 7f5a28d8f640 1 -- 172.21.15.55:0/2321068005 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a14032440 con 0x7f5a240b97c0 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.789+0000 7f5a28d8f640 1 -- 172.21.15.55:0/2321068005 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14032810 con 0x7f5a240b97c0 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.789+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2321068005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a240b97c0 msgr2=0x7f5a240b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.789+0000 7f5a2bff5640 1 --2- 172.21.15.55:0/2321068005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a240b97c0 0x7f5a240b54f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5a140098a0 tx=0x7f5a1402a290 comp rx=0 tx=0).stop 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.790+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2321068005 shutdown_connections 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.790+0000 7f5a2bff5640 1 --2- 172.21.15.55:0/2321068005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a240b5a30 0x7f5a240d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.790+0000 7f5a2bff5640 1 --2- 172.21.15.55:0/2321068005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a240b97c0 0x7f5a240b54f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.790+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2321068005 >> 172.21.15.55:0/2321068005 conn(0x7f5a240d04f0 msgr2=0x7f5a240d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.790+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2321068005 shutdown_connections 2024-04-25T08:54:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.790+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2321068005 wait complete. 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.791+0000 7f5a2bff5640 1 Processor -- start 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.791+0000 7f5a2bff5640 1 -- start start 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.791+0000 7f5a2bff5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a240b5a30 0x7f5a24151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.791+0000 7f5a2bff5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a240b97c0 0x7f5a240c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.791+0000 7f5a2bff5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a2415dc80 0x7f5a240cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a2bff5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2415e060 con 0x7f5a240b97c0 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a2bff5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240d1c70 con 0x7f5a2415dc80 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a2bff5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240d29b0 con 0x7f5a240b5a30 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a29590640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a240b97c0 0x7f5a240c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a29590640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a240b97c0 0x7f5a240c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41976/0 (socket says 172.21.15.55:41976) 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a29590640 1 -- 172.21.15.55:0/2622026139 learned_addr learned my addr 172.21.15.55:0/2622026139 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a29d91640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a240b5a30 0x7f5a24151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a2a592640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a2415dc80 0x7f5a240cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a29590640 1 -- 172.21.15.55:0/2622026139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a240b5a30 msgr2=0x7f5a24151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a29590640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a240b5a30 0x7f5a24151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a29590640 1 -- 172.21.15.55:0/2622026139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a2415dc80 msgr2=0x7f5a240cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a29590640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a2415dc80 0x7f5a240cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a29590640 1 -- 172.21.15.55:0/2622026139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a240c84f0 con 0x7f5a240b97c0 2024-04-25T08:54:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a29d91640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a240b5a30 0x7f5a24151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a2a592640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a2415dc80 0x7f5a240cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a29590640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a240b97c0 0x7f5a240c7fb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5a140098a0 tx=0x7f5a140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a1a7fc640 1 -- 172.21.15.55:0/2622026139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14037040 con 0x7f5a240b97c0 2024-04-25T08:54:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a1a7fc640 1 -- 172.21.15.55:0/2622026139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a14042070 con 0x7f5a240b97c0 2024-04-25T08:54:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2622026139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a241f3e70 con 0x7f5a240b97c0 2024-04-25T08:54:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a1a7fc640 1 -- 172.21.15.55:0/2622026139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14030880 con 0x7f5a240b97c0 2024-04-25T08:54:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.792+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2622026139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a241f4430 con 0x7f5a240b97c0 2024-04-25T08:54:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.793+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2622026139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a240750b0 con 0x7f5a240b97c0 2024-04-25T08:54:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.794+0000 7f5a1a7fc640 1 -- 172.21.15.55:0/2622026139 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5a14030a20 con 0x7f5a240b97c0 2024-04-25T08:54:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.795+0000 7f5a1a7fc640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a0806b4d0 0x7f5a0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.795+0000 7f5a1a7fc640 1 -- 172.21.15.55:0/2622026139 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5a140aaae0 con 0x7f5a240b97c0 2024-04-25T08:54:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.795+0000 7f5a29d91640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a0806b4d0 0x7f5a0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.795+0000 7f5a29d91640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a0806b4d0 0x7f5a0806d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a20001660 tx=0x7f5a20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:23.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.799+0000 7f5a1a7fc640 1 -- 172.21.15.55:0/2622026139 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a240c84f0 con 0x7f5a240b97c0 2024-04-25T08:54:23.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.980+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2622026139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a240d1780 con 0x7f5a240b97c0 2024-04-25T08:54:23.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.981+0000 7f5a1a7fc640 1 -- 172.21.15.55:0/2622026139 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a140798e0 con 0x7f5a240b97c0 2024-04-25T08:54:23.971 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:54:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2622026139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a0806b4d0 msgr2=0x7f5a0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a0806b4d0 0x7f5a0806d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a20001660 tx=0x7f5a20009040 comp rx=0 tx=0).stop 2024-04-25T08:54:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2622026139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a240b97c0 msgr2=0x7f5a240c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a240b97c0 0x7f5a240c7fb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5a140098a0 tx=0x7f5a140046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2622026139 shutdown_connections 2024-04-25T08:54:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a0806b4d0 0x7f5a0806d990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a2415dc80 0x7f5a240cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a240b97c0 0x7f5a240c7fb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 --2- 172.21.15.55:0/2622026139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a240b5a30 0x7f5a24151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2622026139 >> 172.21.15.55:0/2622026139 conn(0x7f5a240d04f0 msgr2=0x7f5a2415b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:23.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2622026139 shutdown_connections 2024-04-25T08:54:23.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:23.983+0000 7f5a2bff5640 1 -- 172.21.15.55:0/2622026139 wait complete. 2024-04-25T08:54:23.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:54:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.094+0000 7effb003f640 1 Processor -- start 2024-04-25T08:54:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.094+0000 7effb003f640 1 -- start start 2024-04-25T08:54:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.095+0000 7effb003f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effa815dce0 0x7effa80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.095+0000 7effb003f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7effa80b5b60 0x7effa80b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.095+0000 7effb003f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa815e0c0 con 0x7effa80d35b0 2024-04-25T08:54:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.095+0000 7effb003f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa80d2510 con 0x7effa80b5b60 2024-04-25T08:54:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.095+0000 7effb003f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa80d27f0 con 0x7effa815dce0 2024-04-25T08:54:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.095+0000 7effae5dc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7effa80b5b60 0x7effa80b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.095+0000 7effadddb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effa815dce0 0x7effa80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.095+0000 7effad5da640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7effa80d35b0 0x7effa80b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:45718/0 (socket says 172.21.15.55:45718) 2024-04-25T08:54:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.095+0000 7effad5da640 1 -- 172.21.15.55:0/1725528318 learned_addr learned my addr 172.21.15.55:0/1725528318 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.096+0000 7effacdd9640 1 -- 172.21.15.55:0/1725528318 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023929545 0 0) 0x7effa815e0c0 con 0x7effa80d35b0 2024-04-25T08:54:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.096+0000 7effacdd9640 1 -- 172.21.15.55:0/1725528318 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff90003520 con 0x7effa80d35b0 2024-04-25T08:54:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.096+0000 7effae5dc640 1 -- 172.21.15.55:0/1725528318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effa815dce0 msgr2=0x7effa80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.096+0000 7effae5dc640 1 --2- 172.21.15.55:0/1725528318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effa815dce0 0x7effa80d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.096+0000 7effae5dc640 1 -- 172.21.15.55:0/1725528318 >> v1:172.21.15.167:6789/0 conn(0x7effa80d35b0 legacy=0x7effa80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.096+0000 7effae5dc640 1 -- 172.21.15.55:0/1725528318 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80d2ad0 con 0x7effa80b5b60 2024-04-25T08:54:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.096+0000 7effadddb640 1 --2- 172.21.15.55:0/1725528318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effa815dce0 0x7effa80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.097+0000 7effae5dc640 1 --2- 172.21.15.55:0/1725528318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effa80b5b60 0x7effa80b6b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff980097a0 tx=0x7eff9802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ad7e6979d6a8841 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.097+0000 7effacdd9640 1 -- 172.21.15.55:0/1725528318 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98037070 con 0x7effa80b5b60 2024-04-25T08:54:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.097+0000 7effacdd9640 1 -- 172.21.15.55:0/1725528318 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff98032440 con 0x7effa80b5b60 2024-04-25T08:54:24.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.097+0000 7effacdd9640 1 -- 172.21.15.55:0/1725528318 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980327f0 con 0x7effa80b5b60 2024-04-25T08:54:24.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.097+0000 7effb003f640 1 -- 172.21.15.55:0/1725528318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effa80b5b60 msgr2=0x7effa80b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.097+0000 7effb003f640 1 --2- 172.21.15.55:0/1725528318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effa80b5b60 0x7effa80b6b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff980097a0 tx=0x7eff9802a180 comp rx=0 tx=0).stop 2024-04-25T08:54:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.097+0000 7effb003f640 1 -- 172.21.15.55:0/1725528318 shutdown_connections 2024-04-25T08:54:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.097+0000 7effb003f640 1 --2- 172.21.15.55:0/1725528318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effa80b5b60 0x7effa80b6b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.097+0000 7effb003f640 1 --2- 172.21.15.55:0/1725528318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effa815dce0 0x7effa80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.097+0000 7effb003f640 1 -- 172.21.15.55:0/1725528318 >> 172.21.15.55:0/1725528318 conn(0x7effa8072900 msgr2=0x7effa80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.098+0000 7effb003f640 1 -- 172.21.15.55:0/1725528318 shutdown_connections 2024-04-25T08:54:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.098+0000 7effb003f640 1 -- 172.21.15.55:0/1725528318 wait complete. 2024-04-25T08:54:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.099+0000 7effb003f640 1 Processor -- start 2024-04-25T08:54:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.099+0000 7effb003f640 1 -- start start 2024-04-25T08:54:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.099+0000 7effb003f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa80b5b60 0x7effa8153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.099+0000 7effb003f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effa80d35b0 0x7effa80c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.099+0000 7effb003f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effa815dce0 0x7effa81f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.099+0000 7effb003f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa80b9820 con 0x7effa80b5b60 2024-04-25T08:54:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.099+0000 7effb003f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa80d3090 con 0x7effa80d35b0 2024-04-25T08:54:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.099+0000 7effb003f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa80b99a0 con 0x7effa815dce0 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effadddb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa80b5b60 0x7effa8153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effadddb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa80b5b60 0x7effa8153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41988/0 (socket says 172.21.15.55:41988) 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effadddb640 1 -- 172.21.15.55:0/2507902504 learned_addr learned my addr 172.21.15.55:0/2507902504 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effae5dc640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effa815dce0 0x7effa81f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effad5da640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effa80d35b0 0x7effa80c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effadddb640 1 -- 172.21.15.55:0/2507902504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effa815dce0 msgr2=0x7effa81f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effadddb640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effa815dce0 0x7effa81f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effadddb640 1 -- 172.21.15.55:0/2507902504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effa80d35b0 msgr2=0x7effa80c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effadddb640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effa80d35b0 0x7effa80c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effadddb640 1 -- 172.21.15.55:0/2507902504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa81f3b60 con 0x7effa80b5b60 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effad5da640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effa80d35b0 0x7effa80c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effadddb640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa80b5b60 0x7effa8153e70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7effa000efc0 tx=0x7effa000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effa67fc640 1 -- 172.21.15.55:0/2507902504 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0018020 con 0x7effa80b5b60 2024-04-25T08:54:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effa67fc640 1 -- 172.21.15.55:0/2507902504 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa0014480 con 0x7effa80b5b60 2024-04-25T08:54:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effb003f640 1 -- 172.21.15.55:0/2507902504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa81f3e40 con 0x7effa80b5b60 2024-04-25T08:54:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effa67fc640 1 -- 172.21.15.55:0/2507902504 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0014850 con 0x7effa80b5b60 2024-04-25T08:54:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.100+0000 7effb003f640 1 -- 172.21.15.55:0/2507902504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa80c7980 con 0x7effa80b5b60 2024-04-25T08:54:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.101+0000 7effb003f640 1 -- 172.21.15.55:0/2507902504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa80d2020 con 0x7effa80b5b60 2024-04-25T08:54:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.102+0000 7effa67fc640 1 -- 172.21.15.55:0/2507902504 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effa0005d10 con 0x7effa80b5b60 2024-04-25T08:54:24.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.102+0000 7effa67fc640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff9406b4d0 0x7eff9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.102+0000 7effa67fc640 1 -- 172.21.15.55:0/2507902504 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7effa008aed0 con 0x7effa80b5b60 2024-04-25T08:54:24.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.102+0000 7effad5da640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff9406b4d0 0x7eff9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.103+0000 7effad5da640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff9406b4d0 0x7eff9406d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7eff9c007fd0 tx=0x7eff9c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:24.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.106+0000 7effa67fc640 1 -- 172.21.15.55:0/2507902504 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7effa80d2020 con 0x7effa80b5b60 2024-04-25T08:54:24.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.323+0000 7effb003f640 1 -- 172.21.15.55:0/2507902504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effa80749b0 con 0x7effa80b5b60 2024-04-25T08:54:24.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.324+0000 7effa67fc640 1 -- 172.21.15.55:0/2507902504 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4938 (secure 0 0 0) 0x7effa0022030 con 0x7effa80b5b60 2024-04-25T08:54:24.314 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:24.314 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1710920573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1710920573},{"type":"v1","addr":"172.21.15.167:6834","nonce":1710920573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3883943704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3883943704},{"type":"v1","addr":"172.21.15.55:6836","nonce":3883943704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1410084850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1410084850},{"type":"v1","addr":"172.21.15.55:6837","nonce":1410084850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:53:42.558115+0000","modified":"2024-04-25T08:53:44.566698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/3753268738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3753268738},{"type":"v1","addr":"172.21.15.167:6835","nonce":3753268738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:54:24.314 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-04-25T08:54:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 -- 172.21.15.55:0/2507902504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff9406b4d0 msgr2=0x7eff9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff9406b4d0 0x7eff9406d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7eff9c007fd0 tx=0x7eff9c009040 comp rx=0 tx=0).stop 2024-04-25T08:54:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 -- 172.21.15.55:0/2507902504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa80b5b60 msgr2=0x7effa8153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa80b5b60 0x7effa8153e70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7effa000efc0 tx=0x7effa000c490 comp rx=0 tx=0).stop 2024-04-25T08:54:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 -- 172.21.15.55:0/2507902504 shutdown_connections 2024-04-25T08:54:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff9406b4d0 0x7eff9406d990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effa815dce0 0x7effa81f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effa80d35b0 0x7effa80c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 --2- 172.21.15.55:0/2507902504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa80b5b60 0x7effa8153e70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 -- 172.21.15.55:0/2507902504 >> 172.21.15.55:0/2507902504 conn(0x7effa8072900 msgr2=0x7effa80b80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:24.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 -- 172.21.15.55:0/2507902504 shutdown_connections 2024-04-25T08:54:24.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.326+0000 7effb003f640 1 -- 172.21.15.55:0/2507902504 wait complete. 2024-04-25T08:54:24.327 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:24.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.437+0000 7fa5a80ee640 1 Processor -- start 2024-04-25T08:54:24.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.437+0000 7fa5a80ee640 1 -- start start 2024-04-25T08:54:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.438+0000 7fa5a80ee640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa5a00b5b60 0x7fa5a01687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.438+0000 7fa5a80ee640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a015e0c0 con 0x7fa5a015dce0 2024-04-25T08:54:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.438+0000 7fa5a80ee640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a00d2510 con 0x7fa5a00d35b0 2024-04-25T08:54:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.438+0000 7fa5a80ee640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a00b7b10 con 0x7fa5a00b5b60 2024-04-25T08:54:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.438+0000 7fa5a5e8a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa5a015dce0 0x7fa5a00d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35992/0 (socket says 172.21.15.55:35992) 2024-04-25T08:54:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.438+0000 7fa5a5e8a640 1 -- 172.21.15.55:0/1116108479 learned_addr learned my addr 172.21.15.55:0/1116108479 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.438+0000 7fa5a668b640 1 --2- 172.21.15.55:0/1116108479 >> v2:172.21.15.167:3300/0 conn(0x7fa5a00b5b60 0x7fa5a01687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.438+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031393412 0 0) 0x7fa5a015e0c0 con 0x7fa5a015dce0 2024-04-25T08:54:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.438+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa588003520 con 0x7fa5a015dce0 2024-04-25T08:54:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487589950 0 0) 0x7fa5a00d2510 con 0x7fa5a00d35b0 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a015e0c0 con 0x7fa5a00d35b0 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 695176225 0 0) 0x7fa588003520 con 0x7fa5a015dce0 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 >> v2:172.21.15.167:3300/0 conn(0x7fa5a00b5b60 msgr2=0x7fa5a01687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 --2- 172.21.15.55:0/1116108479 >> v2:172.21.15.167:3300/0 conn(0x7fa5a00b5b60 0x7fa5a01687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 >> v1:172.21.15.167:6789/0 conn(0x7fa5a00d35b0 legacy=0x7fa5a00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a00d27f0 con 0x7fa5a015dce0 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fa5900019f0 con 0x7fa5a015dce0 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 >> v1:172.21.15.55:6789/0 conn(0x7fa5a015dce0 legacy=0x7fa5a00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 0x7fa588003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa588004800 0x7fa588004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5880051c0 0x7fa58800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00b7b10 con 0x7fa588003b40 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58800c040 con 0x7fa5880051c0 2024-04-25T08:54:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58800c240 con 0x7fa588004800 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a5e8a640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 0x7fa588003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a5689640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa588004800 0x7fa588004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a668b640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5880051c0 0x7fa58800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a5e8a640 1 -- 172.21.15.55:0/1116108479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa588004800 msgr2=0x7fa588004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a5e8a640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa588004800 0x7fa588004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a5e8a640 1 -- 172.21.15.55:0/1116108479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5880051c0 msgr2=0x7fa58800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a5e8a640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5880051c0 0x7fa58800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a5e8a640 1 -- 172.21.15.55:0/1116108479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa588003520 con 0x7fa588003b40 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a668b640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5880051c0 0x7fa58800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.439+0000 7fa5a668b640 1 -- 172.21.15.55:0/1116108479 reap_dead start 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.440+0000 7fa5a5e8a640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 0x7fa588003f40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa59000a810 tx=0x7fa588005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e817a7c1353e92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.440+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59000a430 con 0x7fa588003b40 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.440+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59002f070 con 0x7fa588003b40 2024-04-25T08:54:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.440+0000 7fa5a4e88640 1 -- 172.21.15.55:0/1116108479 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59002bcb0 con 0x7fa588003b40 2024-04-25T08:54:24.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.441+0000 7fa5a80ee640 1 -- 172.21.15.55:0/1116108479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 msgr2=0x7fa588003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.441+0000 7fa5a80ee640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 0x7fa588003f40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa59000a810 tx=0x7fa588005830 comp rx=0 tx=0).stop 2024-04-25T08:54:24.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.441+0000 7fa5a80ee640 1 -- 172.21.15.55:0/1116108479 shutdown_connections 2024-04-25T08:54:24.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.441+0000 7fa5a80ee640 1 --2- 172.21.15.55:0/1116108479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 0x7fa588003f40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.441+0000 7fa5a80ee640 1 -- 172.21.15.55:0/1116108479 >> 172.21.15.55:0/1116108479 conn(0x7fa5a0072900 msgr2=0x7fa5a00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:24.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.441+0000 7fa5a80ee640 1 -- 172.21.15.55:0/1116108479 shutdown_connections 2024-04-25T08:54:24.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.441+0000 7fa5a80ee640 1 -- 172.21.15.55:0/1116108479 wait complete. 2024-04-25T08:54:24.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.442+0000 7fa5a80ee640 1 Processor -- start 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.442+0000 7fa5a80ee640 1 -- start start 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a80ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 0x7fa5a00cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a80ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5a00cd230 0x7fa5a0153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a80ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a00c9600 0x7fa5a0145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a80ee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00d3090 con 0x7fa588003b40 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a80ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00d2db0 con 0x7fa5a00c9600 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a80ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00b9820 con 0x7fa5a00cd230 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a5e8a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 0x7fa5a00cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a5e8a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 0x7fa5a00cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42006/0 (socket says 172.21.15.55:42006) 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a5e8a640 1 -- 172.21.15.55:0/790688096 learned_addr learned my addr 172.21.15.55:0/790688096 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a5689640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5a00cd230 0x7fa5a0153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a668b640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a00c9600 0x7fa5a0145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a5e8a640 1 -- 172.21.15.55:0/790688096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5a00cd230 msgr2=0x7fa5a0153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a5e8a640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5a00cd230 0x7fa5a0153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a5e8a640 1 -- 172.21.15.55:0/790688096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a00c9600 msgr2=0x7fa5a0145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a5e8a640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a00c9600 0x7fa5a0145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a5e8a640 1 -- 172.21.15.55:0/790688096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0153fa0 con 0x7fa588003b40 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a5689640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5a00cd230 0x7fa5a0153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a668b640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a00c9600 0x7fa5a0145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.443+0000 7fa5a5e8a640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 0x7fa5a00cbaf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa59000a810 tx=0x7fa590001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.444+0000 7fa59e7fc640 1 -- 172.21.15.55:0/790688096 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59000a430 con 0x7fa588003b40 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.444+0000 7fa59e7fc640 1 -- 172.21.15.55:0/790688096 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59002be50 con 0x7fa588003b40 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.444+0000 7fa5a80ee640 1 -- 172.21.15.55:0/790688096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a00cc190 con 0x7fa588003b40 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.444+0000 7fa59e7fc640 1 -- 172.21.15.55:0/790688096 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590001f80 con 0x7fa588003b40 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.444+0000 7fa5a80ee640 1 -- 172.21.15.55:0/790688096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a00cc750 con 0x7fa588003b40 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.445+0000 7fa5a80ee640 1 -- 172.21.15.55:0/790688096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a00749b0 con 0x7fa588003b40 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.445+0000 7fa59e7fc640 1 -- 172.21.15.55:0/790688096 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa590034470 con 0x7fa588003b40 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.445+0000 7fa59e7fc640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa58c06b500 0x7fa58c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.445+0000 7fa59e7fc640 1 -- 172.21.15.55:0/790688096 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa5900aaa60 con 0x7fa588003b40 2024-04-25T08:54:24.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.446+0000 7fa5a5689640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa58c06b500 0x7fa58c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.446+0000 7fa5a5689640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa58c06b500 0x7fa58c06d9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa594000c00 tx=0x7fa594009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:24.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.450+0000 7fa59e7fc640 1 -- 172.21.15.55:0/790688096 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5900797d0 con 0x7fa588003b40 2024-04-25T08:54:24.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.631+0000 7fa5a80ee640 1 -- 172.21.15.55:0/790688096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5a00749b0 con 0x7fa588003b40 2024-04-25T08:54:24.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.633+0000 7fa59e7fc640 1 -- 172.21.15.55:0/790688096 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16798 (secure 0 0 0) 0x7fa5900790d0 con 0x7fa588003b40 2024-04-25T08:54:24.623 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:24.623 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:54:23.713130+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.634+0000 7fa5a80ee640 1 -- 172.21.15.55:0/790688096 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa58c06b500 msgr2=0x7fa58c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.634+0000 7fa5a80ee640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa58c06b500 0x7fa58c06d9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa594000c00 tx=0x7fa594009040 comp rx=0 tx=0).stop 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.634+0000 7fa5a80ee640 1 -- 172.21.15.55:0/790688096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 msgr2=0x7fa5a00cbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.634+0000 7fa5a80ee640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 0x7fa5a00cbaf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa59000a810 tx=0x7fa590001d40 comp rx=0 tx=0).stop 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.634+0000 7fa5a80ee640 1 -- 172.21.15.55:0/790688096 shutdown_connections 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.634+0000 7fa5a80ee640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa58c06b500 0x7fa58c06d9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.634+0000 7fa5a80ee640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a00c9600 0x7fa5a0145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.634+0000 7fa5a80ee640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5a00cd230 0x7fa5a0153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.634+0000 7fa5a80ee640 1 --2- 172.21.15.55:0/790688096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa588003b40 0x7fa5a00cbaf0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.635+0000 7fa5a80ee640 1 -- 172.21.15.55:0/790688096 >> 172.21.15.55:0/790688096 conn(0x7fa5a0072900 msgr2=0x7fa5a00d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.635+0000 7fa5a80ee640 1 -- 172.21.15.55:0/790688096 shutdown_connections 2024-04-25T08:54:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.635+0000 7fa5a80ee640 1 -- 172.21.15.55:0/790688096 wait complete. 2024-04-25T08:54:24.636 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:54:24.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:54:24.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.748+0000 7fdcd070a640 1 Processor -- start 2024-04-25T08:54:24.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.748+0000 7fdcd070a640 1 -- start start 2024-04-25T08:54:24.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdcd070a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdcc80d35b0 0x7fdcc80b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdcd070a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc80b5990 0x7fdcc80b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdcd070a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc815e0c0 con 0x7fdcc815dce0 2024-04-25T08:54:24.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdcd070a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc80d2510 con 0x7fdcc80d35b0 2024-04-25T08:54:24.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdcd070a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80d27f0 con 0x7fdcc80b5990 2024-04-25T08:54:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdccdca5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdcc80d35b0 0x7fdcc80b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdcceca7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc80b5990 0x7fdcc80b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdccdca5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdcc80d35b0 0x7fdcc80b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:48640/0 (socket says 172.21.15.55:48640) 2024-04-25T08:54:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdccdca5640 1 -- 172.21.15.55:0/294037130 learned_addr learned my addr 172.21.15.55:0/294037130 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdccdca5640 1 -- 172.21.15.55:0/294037130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc80b5990 msgr2=0x7fdcc80b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdccdca5640 1 --2- 172.21.15.55:0/294037130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc80b5990 0x7fdcc80b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdccdca5640 1 -- 172.21.15.55:0/294037130 >> v1:172.21.15.167:6789/0 conn(0x7fdcc815dce0 legacy=0x7fdcc80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdccd4a4640 1 -- 172.21.15.55:0/294037130 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078533333 0 0) 0x7fdcc815e0c0 con 0x7fdcc815dce0 2024-04-25T08:54:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.749+0000 7fdccdca5640 1 -- 172.21.15.55:0/294037130 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc80d2ad0 con 0x7fdcc80d35b0 2024-04-25T08:54:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.750+0000 7fdccdca5640 1 --2- 172.21.15.55:0/294037130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcc80d35b0 0x7fdcc80b5450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009870 tx=0x7fdcb802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7504ce76c90c53ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.750+0000 7fdccd4a4640 1 -- 172.21.15.55:0/294037130 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8037070 con 0x7fdcc80d35b0 2024-04-25T08:54:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.750+0000 7fdccd4a4640 1 -- 172.21.15.55:0/294037130 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb8032440 con 0x7fdcc80d35b0 2024-04-25T08:54:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.750+0000 7fdccd4a4640 1 -- 172.21.15.55:0/294037130 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8032810 con 0x7fdcc80d35b0 2024-04-25T08:54:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.751+0000 7fdcd070a640 1 -- 172.21.15.55:0/294037130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcc80d35b0 msgr2=0x7fdcc80b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.751+0000 7fdcd070a640 1 --2- 172.21.15.55:0/294037130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcc80d35b0 0x7fdcc80b5450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009870 tx=0x7fdcb802a270 comp rx=0 tx=0).stop 2024-04-25T08:54:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.751+0000 7fdcd070a640 1 -- 172.21.15.55:0/294037130 shutdown_connections 2024-04-25T08:54:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.751+0000 7fdcd070a640 1 --2- 172.21.15.55:0/294037130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc80b5990 0x7fdcc80b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.751+0000 7fdcd070a640 1 --2- 172.21.15.55:0/294037130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcc80d35b0 0x7fdcc80b5450 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.751+0000 7fdcd070a640 1 -- 172.21.15.55:0/294037130 >> 172.21.15.55:0/294037130 conn(0x7fdcc8072900 msgr2=0x7fdcc80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.751+0000 7fdcd070a640 1 -- 172.21.15.55:0/294037130 shutdown_connections 2024-04-25T08:54:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.751+0000 7fdcd070a640 1 -- 172.21.15.55:0/294037130 wait complete. 2024-04-25T08:54:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.752+0000 7fdcd070a640 1 Processor -- start 2024-04-25T08:54:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.752+0000 7fdcd070a640 1 -- start start 2024-04-25T08:54:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcd070a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcc80b5990 0x7fdcc81f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcd070a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc80d35b0 0x7fdcc80ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcd070a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc815dce0 0x7fdcc815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcd070a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80d2160 con 0x7fdcc815dce0 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcd070a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80d3090 con 0x7fdcc80b5990 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcd070a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc81f6440 con 0x7fdcc80d35b0 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcceca7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc815dce0 0x7fdcc815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcceca7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc815dce0 0x7fdcc815e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42010/0 (socket says 172.21.15.55:42010) 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcceca7640 1 -- 172.21.15.55:0/3329684075 learned_addr learned my addr 172.21.15.55:0/3329684075 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdccdca5640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc80d35b0 0x7fdcc80ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcce4a6640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcc80b5990 0x7fdcc81f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcceca7640 1 -- 172.21.15.55:0/3329684075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc80d35b0 msgr2=0x7fdcc80ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcceca7640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc80d35b0 0x7fdcc80ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcceca7640 1 -- 172.21.15.55:0/3329684075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcc80b5990 msgr2=0x7fdcc81f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcceca7640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcc80b5990 0x7fdcc81f4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.753+0000 7fdcceca7640 1 -- 172.21.15.55:0/3329684075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc81f5830 con 0x7fdcc815dce0 2024-04-25T08:54:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.754+0000 7fdcceca7640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc815dce0 0x7fdcc815e2b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000efc0 tx=0x7fdcc000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.754+0000 7fdcbeffd640 1 -- 172.21.15.55:0/3329684075 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0018020 con 0x7fdcc815dce0 2024-04-25T08:54:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.754+0000 7fdcbeffd640 1 -- 172.21.15.55:0/3329684075 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc0014480 con 0x7fdcc815dce0 2024-04-25T08:54:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.754+0000 7fdcd070a640 1 -- 172.21.15.55:0/3329684075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc81f5b10 con 0x7fdcc815dce0 2024-04-25T08:54:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.754+0000 7fdcbeffd640 1 -- 172.21.15.55:0/3329684075 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0014870 con 0x7fdcc815dce0 2024-04-25T08:54:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.754+0000 7fdcd070a640 1 -- 172.21.15.55:0/3329684075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc81f60d0 con 0x7fdcc815dce0 2024-04-25T08:54:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.755+0000 7fdcd070a640 1 -- 172.21.15.55:0/3329684075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc80749b0 con 0x7fdcc815dce0 2024-04-25T08:54:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.755+0000 7fdcbeffd640 1 -- 172.21.15.55:0/3329684075 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdcc0005d10 con 0x7fdcc815dce0 2024-04-25T08:54:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.756+0000 7fdcbeffd640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdcac06b4d0 0x7fdcac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.756+0000 7fdcbeffd640 1 -- 172.21.15.55:0/3329684075 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdcc008ac50 con 0x7fdcc815dce0 2024-04-25T08:54:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.756+0000 7fdcce4a6640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdcac06b4d0 0x7fdcac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.756+0000 7fdcce4a6640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdcac06b4d0 0x7fdcac06d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4000f60 tx=0x7fdcc4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:24.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.760+0000 7fdcbeffd640 1 -- 172.21.15.55:0/3329684075 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdcc0090020 con 0x7fdcc815dce0 2024-04-25T08:54:24.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.980+0000 7fdcd070a640 1 -- 172.21.15.55:0/3329684075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcc80b7650 con 0x7fdcc815dce0 2024-04-25T08:54:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.980+0000 7fdcbeffd640 1 -- 172.21.15.55:0/3329684075 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4938 (secure 0 0 0) 0x7fdcc0022070 con 0x7fdcc815dce0 2024-04-25T08:54:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:24.970 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1710920573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1710920573},{"type":"v1","addr":"172.21.15.167:6834","nonce":1710920573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3883943704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3883943704},{"type":"v1","addr":"172.21.15.55:6836","nonce":3883943704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1410084850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1410084850},{"type":"v1","addr":"172.21.15.55:6837","nonce":1410084850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:53:42.558115+0000","modified":"2024-04-25T08:53:44.566698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/3753268738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3753268738},{"type":"v1","addr":"172.21.15.167:6835","nonce":3753268738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:54:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-04-25T08:54:24.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 -- 172.21.15.55:0/3329684075 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdcac06b4d0 msgr2=0x7fdcac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdcac06b4d0 0x7fdcac06d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4000f60 tx=0x7fdcc4009040 comp rx=0 tx=0).stop 2024-04-25T08:54:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 -- 172.21.15.55:0/3329684075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc815dce0 msgr2=0x7fdcc815e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc815dce0 0x7fdcc815e2b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000efc0 tx=0x7fdcc000c490 comp rx=0 tx=0).stop 2024-04-25T08:54:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 -- 172.21.15.55:0/3329684075 shutdown_connections 2024-04-25T08:54:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdcac06b4d0 0x7fdcac06d990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc815dce0 0x7fdcc815e2b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc80d35b0 0x7fdcc80ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 --2- 172.21.15.55:0/3329684075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcc80b5990 0x7fdcc81f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 -- 172.21.15.55:0/3329684075 >> 172.21.15.55:0/3329684075 conn(0x7fdcc8072900 msgr2=0x7fdcc80b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 -- 172.21.15.55:0/3329684075 shutdown_connections 2024-04-25T08:54:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:24.982+0000 7fdcd070a640 1 -- 172.21.15.55:0/3329684075 wait complete. 2024-04-25T08:54:24.983 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:54:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.095+0000 7f2006d63640 1 Processor -- start 2024-04-25T08:54:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.095+0000 7f2006d63640 1 -- start start 2024-04-25T08:54:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.095+0000 7f2006d63640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f20000b9460 0x7f20000ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.095+0000 7f2006d63640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20000d2440 con 0x7f20000d34e0 2024-04-25T08:54:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.095+0000 7f2006d63640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20000d2720 con 0x7f200015dd50 2024-04-25T08:54:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.095+0000 7f2006d63640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000d2a00 con 0x7f20000b9460 2024-04-25T08:54:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f2005300640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f20000d34e0 0x7f20000b6c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36002/0 (socket says 172.21.15.55:36002) 2024-04-25T08:54:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f2005300640 1 -- 172.21.15.55:0/4052633329 learned_addr learned my addr 172.21.15.55:0/4052633329 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1ffffff640 1 --2- 172.21.15.55:0/4052633329 >> v2:172.21.15.167:3300/0 conn(0x7f20000b9460 0x7f20000ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807276271 0 0) 0x7f20000d2440 con 0x7f20000d34e0 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ff0003520 con 0x7f20000d34e0 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234727603 0 0) 0x7f1ff0003520 con 0x7f20000d34e0 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 >> v2:172.21.15.167:3300/0 conn(0x7f20000b9460 msgr2=0x7f20000ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 --2- 172.21.15.55:0/4052633329 >> v2:172.21.15.167:3300/0 conn(0x7f20000b9460 0x7f20000ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 >> v1:172.21.15.167:6789/0 conn(0x7f200015dd50 legacy=0x7f20000d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000d2ce0 con 0x7f20000d34e0 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f1ff80019f0 con 0x7f20000d34e0 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 >> v1:172.21.15.55:6789/0 conn(0x7f20000d34e0 legacy=0x7f20000b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ff00039b0 0x7f1ff0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ff0004800 0x7f1ff0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 0x7f1ff000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000d2a00 con 0x7f1ff00051c0 2024-04-25T08:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff000c160 con 0x7f1ff0004800 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff000c360 con 0x7f1ff00039b0 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f2005300640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 0x7f1ff000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f1ffffff640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ff0004800 0x7f1ff0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.096+0000 7f2004aff640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ff00039b0 0x7f1ff0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.097+0000 7f2005300640 1 -- 172.21.15.55:0/4052633329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ff00039b0 msgr2=0x7f1ff0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.097+0000 7f2005300640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ff00039b0 0x7f1ff0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.097+0000 7f2005300640 1 -- 172.21.15.55:0/4052633329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ff0004800 msgr2=0x7f1ff0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.097+0000 7f2005300640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ff0004800 0x7f1ff0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.097+0000 7f2005300640 1 -- 172.21.15.55:0/4052633329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff0003520 con 0x7f1ff00051c0 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.097+0000 7f1ffffff640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ff0004800 0x7f1ff0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.097+0000 7f2005300640 1 -- 172.21.15.55:0/4052633329 reap_dead start 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.097+0000 7f2005300640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 0x7f1ff000b9c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800a860 tx=0x7f1ff0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5baf25cda0fabc31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.097+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec009690 con 0x7f1ff00051c0 2024-04-25T08:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.097+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff802f070 con 0x7f1ff00051c0 2024-04-25T08:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.097+0000 7f1fff7fe640 1 -- 172.21.15.55:0/4052633329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800a480 con 0x7f1ff00051c0 2024-04-25T08:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.098+0000 7f2006d63640 1 -- 172.21.15.55:0/4052633329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 msgr2=0x7f1ff000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.098+0000 7f2006d63640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 0x7f1ff000b9c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800a860 tx=0x7f1ff0005830 comp rx=0 tx=0).stop 2024-04-25T08:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.098+0000 7f2006d63640 1 -- 172.21.15.55:0/4052633329 shutdown_connections 2024-04-25T08:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.098+0000 7f2006d63640 1 --2- 172.21.15.55:0/4052633329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 0x7f1ff000b9c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.098+0000 7f2006d63640 1 -- 172.21.15.55:0/4052633329 >> 172.21.15.55:0/4052633329 conn(0x7f20000722d0 msgr2=0x7f20000726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.098+0000 7f2006d63640 1 -- 172.21.15.55:0/4052633329 shutdown_connections 2024-04-25T08:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.098+0000 7f2006d63640 1 -- 172.21.15.55:0/4052633329 wait complete. 2024-04-25T08:54:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.099+0000 7f2006d63640 1 Processor -- start 2024-04-25T08:54:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.099+0000 7f2006d63640 1 -- start start 2024-04-25T08:54:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.100+0000 7f2006d63640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 0x7f200015e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.100+0000 7f2006d63640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20000cd5c0 0x7f200014afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.100+0000 7f2006d63640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20000cc800 0x7f20000ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.100+0000 7f2006d63640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000d1d90 con 0x7f1ff00051c0 2024-04-25T08:54:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.100+0000 7f2006d63640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000d1c10 con 0x7f20000cc800 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.100+0000 7f2006d63640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20000d1f10 con 0x7f20000cd5c0 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.100+0000 7f2004aff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 0x7f200015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.100+0000 7f2004aff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 0x7f200015e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42024/0 (socket says 172.21.15.55:42024) 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.100+0000 7f2004aff640 1 -- 172.21.15.55:0/446010750 learned_addr learned my addr 172.21.15.55:0/446010750 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.100+0000 7f1ffffff640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20000cd5c0 0x7f200014afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.100+0000 7f2004aff640 1 -- 172.21.15.55:0/446010750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20000cd5c0 msgr2=0x7f200014afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.101+0000 7f2005300640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20000cc800 0x7f20000ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.101+0000 7f2004aff640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20000cd5c0 0x7f200014afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.101+0000 7f2004aff640 1 -- 172.21.15.55:0/446010750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20000cc800 msgr2=0x7f20000ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.101+0000 7f2004aff640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20000cc800 0x7f20000ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.101+0000 7f2004aff640 1 -- 172.21.15.55:0/446010750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000caee0 con 0x7f1ff00051c0 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.101+0000 7f2004aff640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 0x7f200015e130 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400f620 tx=0x7f1ff400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.101+0000 7f1ffd7fa640 1 -- 172.21.15.55:0/446010750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff40052e0 con 0x7f1ff00051c0 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.101+0000 7f1ffd7fa640 1 -- 172.21.15.55:0/446010750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff4018070 con 0x7f1ff00051c0 2024-04-25T08:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.101+0000 7f2006d63640 1 -- 172.21.15.55:0/446010750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20000cda00 con 0x7f1ff00051c0 2024-04-25T08:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.101+0000 7f1ffd7fa640 1 -- 172.21.15.55:0/446010750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4003810 con 0x7f1ff00051c0 2024-04-25T08:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.101+0000 7f2006d63640 1 -- 172.21.15.55:0/446010750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2000160b80 con 0x7f1ff00051c0 2024-04-25T08:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.102+0000 7f2006d63640 1 -- 172.21.15.55:0/446010750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2000067850 con 0x7f1ff00051c0 2024-04-25T08:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.102+0000 7f1ffd7fa640 1 -- 172.21.15.55:0/446010750 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ff40039b0 con 0x7f1ff00051c0 2024-04-25T08:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.103+0000 7f1ffd7fa640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1fe406b4d0 0x7f1fe406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.103+0000 7f1ffffff640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1fe406b4d0 0x7f1fe406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.103+0000 7f1ffd7fa640 1 -- 172.21.15.55:0/446010750 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1ff408a050 con 0x7f1ff00051c0 2024-04-25T08:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.104+0000 7f1ffffff640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1fe406b4d0 0x7f1fe406d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f200015c550 tx=0x7f1fec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:25.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.107+0000 7f1ffd7fa640 1 -- 172.21.15.55:0/446010750 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1ff4058e50 con 0x7f1ff00051c0 2024-04-25T08:54:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.325+0000 7f2006d63640 1 -- 172.21.15.55:0/446010750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20000749b0 con 0x7f1ff00051c0 2024-04-25T08:54:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.325+0000 7f1ffd7fa640 1 -- 172.21.15.55:0/446010750 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4938 (secure 0 0 0) 0x7f1ff4058750 con 0x7f1ff00051c0 2024-04-25T08:54:25.316 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:25.316 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1710920573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1710920573},{"type":"v1","addr":"172.21.15.167:6834","nonce":1710920573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3883943704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3883943704},{"type":"v1","addr":"172.21.15.55:6836","nonce":3883943704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1410084850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1410084850},{"type":"v1","addr":"172.21.15.55:6837","nonce":1410084850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:53:42.558115+0000","modified":"2024-04-25T08:53:44.566698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/3753268738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3753268738},{"type":"v1","addr":"172.21.15.167:6835","nonce":3753268738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:54:25.316 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.327+0000 7f2006d63640 1 -- 172.21.15.55:0/446010750 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1fe406b4d0 msgr2=0x7f1fe406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.327+0000 7f2006d63640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1fe406b4d0 0x7f1fe406d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f200015c550 tx=0x7f1fec008040 comp rx=0 tx=0).stop 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.327+0000 7f2006d63640 1 -- 172.21.15.55:0/446010750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 msgr2=0x7f200015e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.327+0000 7f2006d63640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 0x7f200015e130 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400f620 tx=0x7f1ff400fae0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.328+0000 7f2006d63640 1 -- 172.21.15.55:0/446010750 shutdown_connections 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.328+0000 7f2006d63640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1fe406b4d0 0x7f1fe406d990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.328+0000 7f2006d63640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20000cc800 0x7f20000ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.328+0000 7f2006d63640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20000cd5c0 0x7f200014afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.328+0000 7f2006d63640 1 --2- 172.21.15.55:0/446010750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff00051c0 0x7f200015e130 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.328+0000 7f2006d63640 1 -- 172.21.15.55:0/446010750 >> 172.21.15.55:0/446010750 conn(0x7f20000722d0 msgr2=0x7f200015c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.328+0000 7f2006d63640 1 -- 172.21.15.55:0/446010750 shutdown_connections 2024-04-25T08:54:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.328+0000 7f2006d63640 1 -- 172.21.15.55:0/446010750 wait complete. 2024-04-25T08:54:25.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.439+0000 7f91ec322640 1 Processor -- start 2024-04-25T08:54:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.439+0000 7f91ec322640 1 -- start start 2024-04-25T08:54:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.440+0000 7f91ec322640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91e415dc30 0x7f91e406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.440+0000 7f91ec322640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91e406cc00 0x7f91e40b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.440+0000 7f91ec322640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e406c1f0 con 0x7f91e40b1960 2024-04-25T08:54:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.440+0000 7f91ec322640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e40cfb40 con 0x7f91e406cc00 2024-04-25T08:54:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.440+0000 7f91ec322640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40b2060 con 0x7f91e415dc30 2024-04-25T08:54:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.441+0000 7f91e98bd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91e406cc00 0x7f91e40b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.441+0000 7f91ea8bf640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f91e40b1960 0x7f91e4099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:45760/0 (socket says 172.21.15.55:45760) 2024-04-25T08:54:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.441+0000 7f91ea0be640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91e415dc30 0x7f91e406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.441+0000 7f91ea8bf640 1 -- 172.21.15.55:0/1853738062 learned_addr learned my addr 172.21.15.55:0/1853738062 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.441+0000 7f91e98bd640 1 -- 172.21.15.55:0/1853738062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91e415dc30 msgr2=0x7f91e406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.441+0000 7f91e98bd640 1 --2- 172.21.15.55:0/1853738062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91e415dc30 0x7f91e406c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.441+0000 7f91e98bd640 1 -- 172.21.15.55:0/1853738062 >> v1:172.21.15.167:6789/0 conn(0x7f91e40b1960 legacy=0x7f91e4099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.441+0000 7f91e98bd640 1 -- 172.21.15.55:0/1853738062 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40b2340 con 0x7f91e406cc00 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.442+0000 7f91e98bd640 1 --2- 172.21.15.55:0/1853738062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91e406cc00 0x7f91e40b1420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91d80097a0 tx=0x7f91d802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ef73da478036077 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.442+0000 7f91e90bc640 1 -- 172.21.15.55:0/1853738062 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8037070 con 0x7f91e406cc00 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.442+0000 7f91e90bc640 1 -- 172.21.15.55:0/1853738062 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d8032440 con 0x7f91e406cc00 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.442+0000 7f91e90bc640 1 -- 172.21.15.55:0/1853738062 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8032810 con 0x7f91e406cc00 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.442+0000 7f91ec322640 1 -- 172.21.15.55:0/1853738062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91e406cc00 msgr2=0x7f91e40b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.442+0000 7f91ec322640 1 --2- 172.21.15.55:0/1853738062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91e406cc00 0x7f91e40b1420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91d80097a0 tx=0x7f91d802a180 comp rx=0 tx=0).stop 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.443+0000 7f91ec322640 1 -- 172.21.15.55:0/1853738062 shutdown_connections 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.443+0000 7f91ec322640 1 --2- 172.21.15.55:0/1853738062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91e406cc00 0x7f91e40b1420 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.443+0000 7f91ec322640 1 --2- 172.21.15.55:0/1853738062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91e415dc30 0x7f91e406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.443+0000 7f91ec322640 1 -- 172.21.15.55:0/1853738062 >> 172.21.15.55:0/1853738062 conn(0x7f91e40d1900 msgr2=0x7f91e40d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.443+0000 7f91ec322640 1 -- 172.21.15.55:0/1853738062 shutdown_connections 2024-04-25T08:54:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.443+0000 7f91ec322640 1 -- 172.21.15.55:0/1853738062 wait complete. 2024-04-25T08:54:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.444+0000 7f91ec322640 1 Processor -- start 2024-04-25T08:54:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.444+0000 7f91ec322640 1 -- start start 2024-04-25T08:54:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.444+0000 7f91ec322640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91e406cc00 0x7f91e415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91ec322640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e40b1960 0x7f91e40c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91ec322640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91e415dc30 0x7f91e40cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91ec322640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40b1d80 con 0x7f91e40b1960 2024-04-25T08:54:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91ec322640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40cfde0 con 0x7f91e415dc30 2024-04-25T08:54:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91ec322640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e415e010 con 0x7f91e406cc00 2024-04-25T08:54:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e98bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e40b1960 0x7f91e40c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e98bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e40b1960 0x7f91e40c5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42040/0 (socket says 172.21.15.55:42040) 2024-04-25T08:54:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e98bd640 1 -- 172.21.15.55:0/52037764 learned_addr learned my addr 172.21.15.55:0/52037764 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91ea0be640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91e406cc00 0x7f91e415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91ea8bf640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91e415dc30 0x7f91e40cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e98bd640 1 -- 172.21.15.55:0/52037764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91e406cc00 msgr2=0x7f91e415a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e98bd640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91e406cc00 0x7f91e415a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e98bd640 1 -- 172.21.15.55:0/52037764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91e415dc30 msgr2=0x7f91e40cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e98bd640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91e415dc30 0x7f91e40cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e98bd640 1 -- 172.21.15.55:0/52037764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40c6340 con 0x7f91e40b1960 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e98bd640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e40b1960 0x7f91e40c5e00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f91d802a1c0 tx=0x7f91d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e2ffd640 1 -- 172.21.15.55:0/52037764 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8041020 con 0x7f91e40b1960 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e2ffd640 1 -- 172.21.15.55:0/52037764 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d8030700 con 0x7f91e40b1960 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91e2ffd640 1 -- 172.21.15.55:0/52037764 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8037040 con 0x7f91e40b1960 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.445+0000 7f91ec322640 1 -- 172.21.15.55:0/52037764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e4160290 con 0x7f91e40b1960 2024-04-25T08:54:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.446+0000 7f91ec322640 1 -- 172.21.15.55:0/52037764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e4160850 con 0x7f91e40b1960 2024-04-25T08:54:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.446+0000 7f91ec322640 1 -- 172.21.15.55:0/52037764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e4067850 con 0x7f91e40b1960 2024-04-25T08:54:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.447+0000 7f91e2ffd640 1 -- 172.21.15.55:0/52037764 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f91d8044020 con 0x7f91e40b1960 2024-04-25T08:54:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.447+0000 7f91e2ffd640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d006b4d0 0x7f91d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.448+0000 7f91e2ffd640 1 -- 172.21.15.55:0/52037764 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f91d80aa8a0 con 0x7f91e40b1960 2024-04-25T08:54:25.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.448+0000 7f91ea0be640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d006b4d0 0x7f91d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.448+0000 7f91ea0be640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d006b4d0 0x7f91d006d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009b40 tx=0x7f91dc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:25.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.452+0000 7f91e2ffd640 1 -- 172.21.15.55:0/52037764 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f91d804b030 con 0x7f91e40b1960 2024-04-25T08:54:25.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.634+0000 7f91ec322640 1 -- 172.21.15.55:0/52037764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91e406e330 con 0x7f91e40b1960 2024-04-25T08:54:25.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.636+0000 7f91e2ffd640 1 -- 172.21.15.55:0/52037764 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16798 (secure 0 0 0) 0x7f91d80790e0 con 0x7f91e40b1960 2024-04-25T08:54:25.671 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:25.671 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:54:23.713130+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:53:40.498103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:53:41.542396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:25.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 -- 172.21.15.55:0/52037764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d006b4d0 msgr2=0x7f91d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d006b4d0 0x7f91d006d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009b40 tx=0x7f91dc009190 comp rx=0 tx=0).stop 2024-04-25T08:54:25.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 -- 172.21.15.55:0/52037764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e40b1960 msgr2=0x7f91e40c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e40b1960 0x7f91e40c5e00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f91d802a1c0 tx=0x7f91d80046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 -- 172.21.15.55:0/52037764 shutdown_connections 2024-04-25T08:54:25.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d006b4d0 0x7f91d006d990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91e415dc30 0x7f91e40cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e40b1960 0x7f91e40c5e00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 --2- 172.21.15.55:0/52037764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91e406cc00 0x7f91e415a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 -- 172.21.15.55:0/52037764 >> 172.21.15.55:0/52037764 conn(0x7f91e40d1900 msgr2=0x7f91e40d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 -- 172.21.15.55:0/52037764 shutdown_connections 2024-04-25T08:54:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.638+0000 7f91ec322640 1 -- 172.21.15.55:0/52037764 wait complete. 2024-04-25T08:54:25.675 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:54:25.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.787+0000 7f5a46509640 1 Processor -- start 2024-04-25T08:54:25.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.787+0000 7f5a46509640 1 -- start start 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.787+0000 7f5a46509640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a400ce1e0 0x7f5a400ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.787+0000 7f5a46509640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a400cc240 0x7f5a400cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.787+0000 7f5a46509640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a400ceb80 con 0x7f5a4015f0b0 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a46509640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4015f490 con 0x7f5a400cc240 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a46509640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400cf8f0 con 0x7f5a400ce1e0 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a44aa6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a400cc240 0x7f5a400cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a3ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5a4015f0b0 0x7f5a400d0990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36006/0 (socket says 172.21.15.55:36006) 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a3ffff640 1 -- 172.21.15.55:0/3713534769 learned_addr learned my addr 172.21.15.55:0/3713534769 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a44aa6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a400cc240 0x7f5a400cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42048/0 (socket says 172.21.15.55:42048) 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a3f7fe640 1 --2- 172.21.15.55:0/3713534769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a400ce1e0 0x7f5a400ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a44aa6640 1 -- 172.21.15.55:0/3713534769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a400ce1e0 msgr2=0x7f5a400ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a44aa6640 1 --2- 172.21.15.55:0/3713534769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a400ce1e0 0x7f5a400ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a44aa6640 1 -- 172.21.15.55:0/3713534769 >> v1:172.21.15.55:6789/0 conn(0x7f5a4015f0b0 legacy=0x7f5a400d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a44aa6640 1 -- 172.21.15.55:0/3713534769 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400cfbd0 con 0x7f5a400cc240 2024-04-25T08:54:25.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.788+0000 7f5a3effd640 1 -- 172.21.15.55:0/3713534769 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645984434 0 0) 0x7f5a30001110 con 0x7f5a4015f0b0 2024-04-25T08:54:25.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.789+0000 7f5a44aa6640 1 --2- 172.21.15.55:0/3713534769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a400cc240 0x7f5a400cc6d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009d90 tx=0x7f5a3802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce844cace57e1555 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:25.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.789+0000 7f5a3effd640 1 -- 172.21.15.55:0/3713534769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38007740 con 0x7f5a400cc240 2024-04-25T08:54:25.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.789+0000 7f5a3effd640 1 -- 172.21.15.55:0/3713534769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a380078e0 con 0x7f5a400cc240 2024-04-25T08:54:25.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.789+0000 7f5a3effd640 1 -- 172.21.15.55:0/3713534769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38007cb0 con 0x7f5a400cc240 2024-04-25T08:54:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.789+0000 7f5a46509640 1 -- 172.21.15.55:0/3713534769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a400cc240 msgr2=0x7f5a400cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.789+0000 7f5a46509640 1 --2- 172.21.15.55:0/3713534769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a400cc240 0x7f5a400cc6d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009d90 tx=0x7f5a3802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.789+0000 7f5a46509640 1 -- 172.21.15.55:0/3713534769 shutdown_connections 2024-04-25T08:54:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.789+0000 7f5a46509640 1 --2- 172.21.15.55:0/3713534769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a400ce1e0 0x7f5a400ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.789+0000 7f5a46509640 1 --2- 172.21.15.55:0/3713534769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a400cc240 0x7f5a400cc6d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.789+0000 7f5a46509640 1 -- 172.21.15.55:0/3713534769 >> 172.21.15.55:0/3713534769 conn(0x7f5a4006f430 msgr2=0x7f5a4006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.789+0000 7f5a46509640 1 -- 172.21.15.55:0/3713534769 shutdown_connections 2024-04-25T08:54:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.790+0000 7f5a46509640 1 -- 172.21.15.55:0/3713534769 wait complete. 2024-04-25T08:54:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.791+0000 7f5a46509640 1 Processor -- start 2024-04-25T08:54:25.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.791+0000 7f5a46509640 1 -- start start 2024-04-25T08:54:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a46509640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a400cc240 0x7f5a40150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a46509640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a400ce1e0 0x7f5a400c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a46509640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015f0b0 0x7f5a4015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a46509640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400d0470 con 0x7f5a4015f0b0 2024-04-25T08:54:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a46509640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400d0190 con 0x7f5a400cc240 2024-04-25T08:54:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a46509640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400ccc10 con 0x7f5a400ce1e0 2024-04-25T08:54:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a44aa6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015f0b0 0x7f5a4015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a44aa6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015f0b0 0x7f5a4015c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42060/0 (socket says 172.21.15.55:42060) 2024-04-25T08:54:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a44aa6640 1 -- 172.21.15.55:0/1123172890 learned_addr learned my addr 172.21.15.55:0/1123172890 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a3f7fe640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a400ce1e0 0x7f5a400c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a3ffff640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a400cc240 0x7f5a40150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a44aa6640 1 -- 172.21.15.55:0/1123172890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a400ce1e0 msgr2=0x7f5a400c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a44aa6640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a400ce1e0 0x7f5a400c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a44aa6640 1 -- 172.21.15.55:0/1123172890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a400cc240 msgr2=0x7f5a40150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a44aa6640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a400cc240 0x7f5a40150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a44aa6640 1 -- 172.21.15.55:0/1123172890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400c65b0 con 0x7f5a4015f0b0 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a44aa6640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015f0b0 0x7f5a4015c4f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5a3802ace0 tx=0x7f5a38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a3cff9640 1 -- 172.21.15.55:0/1123172890 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38040070 con 0x7f5a4015f0b0 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a3cff9640 1 -- 172.21.15.55:0/1123172890 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a38031bc0 con 0x7f5a4015f0b0 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a46509640 1 -- 172.21.15.55:0/1123172890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a400c6890 con 0x7f5a4015f0b0 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.792+0000 7f5a3cff9640 1 -- 172.21.15.55:0/1123172890 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38045460 con 0x7f5a4015f0b0 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.793+0000 7f5a46509640 1 -- 172.21.15.55:0/1123172890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a400c6e50 con 0x7f5a4015f0b0 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.793+0000 7f5a46509640 1 -- 172.21.15.55:0/1123172890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a400750b0 con 0x7f5a4015f0b0 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.794+0000 7f5a3cff9640 1 -- 172.21.15.55:0/1123172890 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5a38039040 con 0x7f5a4015f0b0 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.794+0000 7f5a3cff9640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a2c06b4d0 0x7f5a2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.794+0000 7f5a3cff9640 1 -- 172.21.15.55:0/1123172890 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5a380abbc0 con 0x7f5a4015f0b0 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.794+0000 7f5a3ffff640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a2c06b4d0 0x7f5a2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.795+0000 7f5a3ffff640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a2c06b4d0 0x7f5a2c06d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5a30000f60 tx=0x7f5a30009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:25.798+0000 7f5a3cff9640 1 -- 172.21.15.55:0/1123172890 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a3807a9b0 con 0x7f5a4015f0b0 2024-04-25T08:54:26.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.015+0000 7f5a46509640 1 -- 172.21.15.55:0/1123172890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5a400c7020 con 0x7f5a4015f0b0 2024-04-25T08:54:26.006 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T08:54:26.016+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:54:26.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.021+0000 7f5a3cff9640 1 -- 172.21.15.55:0/1123172890 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5a3807a2b0 con 0x7f5a4015f0b0 2024-04-25T08:54:26.011 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:54:26.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 -- 172.21.15.55:0/1123172890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a2c06b4d0 msgr2=0x7f5a2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:26.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a2c06b4d0 0x7f5a2c06d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5a30000f60 tx=0x7f5a30009040 comp rx=0 tx=0).stop 2024-04-25T08:54:26.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 -- 172.21.15.55:0/1123172890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015f0b0 msgr2=0x7f5a4015c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:26.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015f0b0 0x7f5a4015c4f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5a3802ace0 tx=0x7f5a38004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:26.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 -- 172.21.15.55:0/1123172890 shutdown_connections 2024-04-25T08:54:26.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5a2c06b4d0 0x7f5a2c06d990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:26.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015f0b0 0x7f5a4015c4f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:26.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a400ce1e0 0x7f5a400c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:26.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 --2- 172.21.15.55:0/1123172890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a400cc240 0x7f5a40150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:26.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 -- 172.21.15.55:0/1123172890 >> 172.21.15.55:0/1123172890 conn(0x7f5a4006f430 msgr2=0x7f5a400b4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:26.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 -- 172.21.15.55:0/1123172890 shutdown_connections 2024-04-25T08:54:26.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.024+0000 7f5a46509640 1 -- 172.21.15.55:0/1123172890 wait complete. 2024-04-25T08:54:26.018 INFO:tasks.ceph.mds.d.smithi167.stderr: -6911> 2024-04-25T08:53:47.003+0000 7f5e677b4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:54:26.026 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:54:26.052 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T08:54:26.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.139+0000 7f3a3641f640 1 Processor -- start 2024-04-25T08:54:26.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.139+0000 7f3a3641f640 1 -- start start 2024-04-25T08:54:26.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.139+0000 7f3a3641f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3015deb0 0x7f3a300b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:26.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.139+0000 7f3a3641f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3a3006b2b0 0x7f3a300cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:26.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.139+0000 7f3a3641f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a300cd150 con 0x7f3a300b1d30 2024-04-25T08:54:26.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.139+0000 7f3a3641f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300b21d0 con 0x7f3a3006b2b0 2024-04-25T08:54:26.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.139+0000 7f3a3641f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300cd430 con 0x7f3a3015deb0 2024-04-25T08:54:26.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.140+0000 7f3a349bc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3a3006b2b0 0x7f3a300cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:26.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.140+0000 7f3a2f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3a300b1d30 0x7f3a3006aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36014/0 (socket says 172.21.15.55:36014) 2024-04-25T08:54:26.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.140+0000 7f3a2f7fe640 1 -- 172.21.15.55:0/1792114746 learned_addr learned my addr 172.21.15.55:0/1792114746 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:26.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.140+0000 7f3a2ffff640 1 --2- 172.21.15.55:0/1792114746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3015deb0 0x7f3a300b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:26.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.140+0000 7f3a349bc640 1 -- 172.21.15.55:0/1792114746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3015deb0 msgr2=0x7f3a300b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:26.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.140+0000 7f3a349bc640 1 --2- 172.21.15.55:0/1792114746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3015deb0 0x7f3a300b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:26.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.140+0000 7f3a349bc640 1 -- 172.21.15.55:0/1792114746 >> v1:172.21.15.55:6789/0 conn(0x7f3a300b1d30 legacy=0x7f3a3006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:26.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.140+0000 7f3a349bc640 1 -- 172.21.15.55:0/1792114746 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a300cd710 con 0x7f3a3006b2b0 2024-04-25T08:54:26.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.140+0000 7f3a2effd640 1 -- 172.21.15.55:0/1792114746 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973519630 0 0) 0x7f3a300cd150 con 0x7f3a300b1d30 2024-04-25T08:54:26.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.140+0000 7f3a2ffff640 1 --2- 172.21.15.55:0/1792114746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3015deb0 0x7f3a300b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:26.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a349bc640 1 --2- 172.21.15.55:0/1792114746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3006b2b0 0x7f3a300cae90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009d90 tx=0x7f3a2802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c876353d6f6d3a64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:26.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a2effd640 1 -- 172.21.15.55:0/1792114746 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a28031600 con 0x7f3a3006b2b0 2024-04-25T08:54:26.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a2effd640 1 -- 172.21.15.55:0/1792114746 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a280317a0 con 0x7f3a3006b2b0 2024-04-25T08:54:26.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a2effd640 1 -- 172.21.15.55:0/1792114746 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a28031b70 con 0x7f3a3006b2b0 2024-04-25T08:54:26.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a3641f640 1 -- 172.21.15.55:0/1792114746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3006b2b0 msgr2=0x7f3a300cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:26.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a3641f640 1 --2- 172.21.15.55:0/1792114746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3006b2b0 0x7f3a300cae90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009d90 tx=0x7f3a2802a5d0 comp rx=0 tx=0).stop 2024-04-25T08:54:26.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a3641f640 1 -- 172.21.15.55:0/1792114746 shutdown_connections 2024-04-25T08:54:26.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a3641f640 1 --2- 172.21.15.55:0/1792114746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3006b2b0 0x7f3a300cae90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:26.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a3641f640 1 --2- 172.21.15.55:0/1792114746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3015deb0 0x7f3a300b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:26.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a3641f640 1 -- 172.21.15.55:0/1792114746 >> 172.21.15.55:0/1792114746 conn(0x7f3a300b2390 msgr2=0x7f3a300b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:26.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a3641f640 1 -- 172.21.15.55:0/1792114746 shutdown_connections 2024-04-25T08:54:26.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.141+0000 7f3a3641f640 1 -- 172.21.15.55:0/1792114746 wait complete. 2024-04-25T08:54:26.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.142+0000 7f3a3641f640 1 Processor -- start 2024-04-25T08:54:26.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.143+0000 7f3a3641f640 1 -- start start 2024-04-25T08:54:26.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.143+0000 7f3a3641f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3006b2b0 0x7f3a3014ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:26.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.143+0000 7f3a3641f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a300b1d30 0x7f3a3015b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:26.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.143+0000 7f3a3641f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3015deb0 0x7f3a3006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.143+0000 7f3a3641f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3015e410 con 0x7f3a300b1d30 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.143+0000 7f3a3641f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3015e290 con 0x7f3a3015deb0 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.143+0000 7f3a3641f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300ccc40 con 0x7f3a3006b2b0 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.143+0000 7f3a2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a300b1d30 0x7f3a3015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.143+0000 7f3a2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a300b1d30 0x7f3a3015b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42070/0 (socket says 172.21.15.55:42070) 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a2f7fe640 1 -- 172.21.15.55:0/1562767461 learned_addr learned my addr 172.21.15.55:0/1562767461 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a349bc640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3015deb0 0x7f3a3006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a2f7fe640 1 -- 172.21.15.55:0/1562767461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3006b2b0 msgr2=0x7f3a3014ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a2ffff640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3006b2b0 0x7f3a3014ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a2f7fe640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3006b2b0 0x7f3a3014ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a2f7fe640 1 -- 172.21.15.55:0/1562767461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3015deb0 msgr2=0x7f3a3006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:26.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a2f7fe640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3015deb0 0x7f3a3006f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a2f7fe640 1 -- 172.21.15.55:0/1562767461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a301f4180 con 0x7f3a300b1d30 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a349bc640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3015deb0 0x7f3a3006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a2f7fe640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a300b1d30 0x7f3a3015b390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800c500 tx=0x7f3a1800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a2cff9640 1 -- 172.21.15.55:0/1562767461 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18018070 con 0x7f3a300b1d30 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a2cff9640 1 -- 172.21.15.55:0/1562767461 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a18007580 con 0x7f3a300b1d30 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a2cff9640 1 -- 172.21.15.55:0/1562767461 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18004a20 con 0x7f3a300b1d30 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a3641f640 1 -- 172.21.15.55:0/1562767461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a301f4460 con 0x7f3a300b1d30 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.144+0000 7f3a3641f640 1 -- 172.21.15.55:0/1562767461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a301f4a20 con 0x7f3a300b1d30 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.145+0000 7f3a3641f640 1 -- 172.21.15.55:0/1562767461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a300750b0 con 0x7f3a300b1d30 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.146+0000 7f3a2cff9640 1 -- 172.21.15.55:0/1562767461 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3a18004bc0 con 0x7f3a300b1d30 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.146+0000 7f3a2cff9640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3a1006b500 0x7f3a1006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.146+0000 7f3a2cff9640 1 -- 172.21.15.55:0/1562767461 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f3a180894d0 con 0x7f3a300b1d30 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.146+0000 7f3a2ffff640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3a1006b500 0x7f3a1006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:26.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.147+0000 7f3a2ffff640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3a1006b500 0x7f3a1006d9c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3a301591e0 tx=0x7f3a20008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:26.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.150+0000 7f3a2cff9640 1 -- 172.21.15.55:0/1562767461 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3a18058310 con 0x7f3a300b1d30 2024-04-25T08:54:26.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:26.369+0000 7f3a3641f640 1 -- 172.21.15.55:0/1562767461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3a300c5810 con 0x7f3a300b1d30 2024-04-25T08:54:27.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.029+0000 7f3a2cff9640 1 -- 172.21.15.55:0/1562767461 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3a18057c10 con 0x7f3a300b1d30 2024-04-25T08:54:27.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 -- 172.21.15.55:0/1562767461 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3a1006b500 msgr2=0x7f3a1006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:27.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3a1006b500 0x7f3a1006d9c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3a301591e0 tx=0x7f3a20008040 comp rx=0 tx=0).stop 2024-04-25T08:54:27.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 -- 172.21.15.55:0/1562767461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a300b1d30 msgr2=0x7f3a3015b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:27.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a300b1d30 0x7f3a3015b390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800c500 tx=0x7f3a1800c9c0 comp rx=0 tx=0).stop 2024-04-25T08:54:27.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 -- 172.21.15.55:0/1562767461 shutdown_connections 2024-04-25T08:54:27.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3a1006b500 0x7f3a1006d9c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:27.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3015deb0 0x7f3a3006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:27.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a300b1d30 0x7f3a3015b390 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:27.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 --2- 172.21.15.55:0/1562767461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3006b2b0 0x7f3a3014ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:27.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 -- 172.21.15.55:0/1562767461 >> 172.21.15.55:0/1562767461 conn(0x7f3a300b2390 msgr2=0x7f3a300b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:27.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 -- 172.21.15.55:0/1562767461 shutdown_connections 2024-04-25T08:54:27.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.032+0000 7f3a3641f640 1 -- 172.21.15.55:0/1562767461 wait complete. 2024-04-25T08:54:27.036 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:54:27.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.158+0000 7f3d44970640 1 Processor -- start 2024-04-25T08:54:27.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.158+0000 7f3d44970640 1 -- start start 2024-04-25T08:54:27.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d44970640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4015f0b0 0x7f3d400d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d44970640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3d400cc240 0x7f3d400cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d44970640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4015f490 con 0x7f3d400ce1e0 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d44970640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d400cf8f0 con 0x7f3d400cc240 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d44970640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400cfbd0 con 0x7f3d4015f0b0 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d37fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3d400ce1e0 0x7f3d400ce640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36022/0 (socket says 172.21.15.55:36022) 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d37fff640 1 -- 172.21.15.55:0/193938806 learned_addr learned my addr 172.21.15.55:0/193938806 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766329145 0 0) 0x7f3d4015f490 con 0x7f3d400ce1e0 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d2c003520 con 0x7f3d400ce1e0 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d3ed9d640 1 --2- 172.21.15.55:0/193938806 >> v2:172.21.15.167:3300/0 conn(0x7f3d400cc240 0x7f3d400cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d3e59c640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4015f0b0 0x7f3d400d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.159+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2420294215 0 0) 0x7f3d2c003520 con 0x7f3d400ce1e0 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4015f0b0 msgr2=0x7f3d400d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4015f0b0 0x7f3d400d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 >> v2:172.21.15.167:3300/0 conn(0x7f3d400cc240 msgr2=0x7f3d400cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 --2- 172.21.15.55:0/193938806 >> v2:172.21.15.167:3300/0 conn(0x7f3d400cc240 0x7f3d400cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400cfeb0 con 0x7f3d400ce1e0 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f3d28001670 con 0x7f3d400ce1e0 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 >> v1:172.21.15.55:6789/0 conn(0x7f3d400ce1e0 legacy=0x7f3d400ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4015f0b0 0x7f3d2c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d2c003f30 0x7f3d2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d2c004d40 0x7f3d2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400cf8f0 con 0x7f3d2c003f30 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400cfbd0 con 0x7f3d2c004d40 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c00b9f0 con 0x7f3d4015f0b0 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d37fff640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d2c003f30 0x7f3d2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3e59c640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4015f0b0 0x7f3d2c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:27.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d3ed9d640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d2c004d40 0x7f3d2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d37fff640 1 -- 172.21.15.55:0/193938806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4015f0b0 msgr2=0x7f3d2c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d37fff640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4015f0b0 0x7f3d2c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d37fff640 1 -- 172.21.15.55:0/193938806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d2c004d40 msgr2=0x7f3d2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d37fff640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d2c004d40 0x7f3d2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.160+0000 7f3d37fff640 1 -- 172.21.15.55:0/193938806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c003520 con 0x7f3d2c003f30 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.161+0000 7f3d37fff640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d2c003f30 0x7f3d2c004800 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3d28007fd0 tx=0x7f3d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e94945c9edf3d60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.161+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28007d50 con 0x7f3d2c003f30 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.161+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d28005ad0 con 0x7f3d2c003f30 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.161+0000 7f3d3dd9b640 1 -- 172.21.15.55:0/193938806 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28007070 con 0x7f3d2c003f30 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.162+0000 7f3d44970640 1 -- 172.21.15.55:0/193938806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d2c003f30 msgr2=0x7f3d2c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.162+0000 7f3d44970640 1 --2- 172.21.15.55:0/193938806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d2c003f30 0x7f3d2c004800 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3d28007fd0 tx=0x7f3d2c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.162+0000 7f3d3ed9d640 1 -- 172.21.15.55:0/193938806 reap_dead start 2024-04-25T08:54:27.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.162+0000 7f3d44970640 1 -- 172.21.15.55:0/193938806 shutdown_connections 2024-04-25T08:54:27.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.162+0000 7f3d44970640 1 -- 172.21.15.55:0/193938806 >> 172.21.15.55:0/193938806 conn(0x7f3d4006f430 msgr2=0x7f3d4006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:27.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.162+0000 7f3d44970640 1 -- 172.21.15.55:0/193938806 shutdown_connections 2024-04-25T08:54:27.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.162+0000 7f3d44970640 1 -- 172.21.15.55:0/193938806 wait complete. 2024-04-25T08:54:27.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.163+0000 7f3d44970640 1 Processor -- start 2024-04-25T08:54:27.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.163+0000 7f3d44970640 1 -- start start 2024-04-25T08:54:27.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d44970640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d2c003f30 0x7f3d400ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:27.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d44970640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d400c95b0 0x7f3d4015d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d44970640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d401f3570 0x7f3d4015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d44970640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400ccc10 con 0x7f3d400c95b0 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d44970640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400d0470 con 0x7f3d401f3570 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d44970640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400d0990 con 0x7f3d2c003f30 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d400c95b0 0x7f3d4015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d400c95b0 0x7f3d4015d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42096/0 (socket says 172.21.15.55:42096) 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d37fff640 1 -- 172.21.15.55:0/988096118 learned_addr learned my addr 172.21.15.55:0/988096118 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d3ed9d640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d401f3570 0x7f3d4015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d3e59c640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d2c003f30 0x7f3d400ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d37fff640 1 -- 172.21.15.55:0/988096118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d2c003f30 msgr2=0x7f3d400ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d37fff640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d2c003f30 0x7f3d400ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d37fff640 1 -- 172.21.15.55:0/988096118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d401f3570 msgr2=0x7f3d4015aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d37fff640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d401f3570 0x7f3d4015aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:27.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d37fff640 1 -- 172.21.15.55:0/988096118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400cac60 con 0x7f3d400c95b0 2024-04-25T08:54:27.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.164+0000 7f3d37fff640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d400c95b0 0x7f3d4015d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800c300 tx=0x7f3d400b1270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:27.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.165+0000 7f3d36ffd640 1 -- 172.21.15.55:0/988096118 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28042020 con 0x7f3d400c95b0 2024-04-25T08:54:27.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.165+0000 7f3d36ffd640 1 -- 172.21.15.55:0/988096118 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d28004bf0 con 0x7f3d400c95b0 2024-04-25T08:54:27.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.165+0000 7f3d44970640 1 -- 172.21.15.55:0/988096118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d400c54d0 con 0x7f3d400c95b0 2024-04-25T08:54:27.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.165+0000 7f3d36ffd640 1 -- 172.21.15.55:0/988096118 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28001cb0 con 0x7f3d400c95b0 2024-04-25T08:54:27.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.165+0000 7f3d44970640 1 -- 172.21.15.55:0/988096118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d400c5a90 con 0x7f3d400c95b0 2024-04-25T08:54:27.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.166+0000 7f3d44970640 1 -- 172.21.15.55:0/988096118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d400750b0 con 0x7f3d400c95b0 2024-04-25T08:54:27.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.166+0000 7f3d36ffd640 1 -- 172.21.15.55:0/988096118 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3d28045020 con 0x7f3d400c95b0 2024-04-25T08:54:27.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.167+0000 7f3d36ffd640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3d2006b500 0x7f3d2006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:27.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.167+0000 7f3d36ffd640 1 -- 172.21.15.55:0/988096118 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f3d280aa9b0 con 0x7f3d400c95b0 2024-04-25T08:54:27.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.167+0000 7f3d3e59c640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3d2006b500 0x7f3d2006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:27.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.167+0000 7f3d3e59c640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3d2006b500 0x7f3d2006d9c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009ae0 tx=0x7f3d30009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:27.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.171+0000 7f3d36ffd640 1 -- 172.21.15.55:0/988096118 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3d28079760 con 0x7f3d400c95b0 2024-04-25T08:54:27.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:27.354+0000 7f3d44970640 1 -- 172.21.15.55:0/988096118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3d400c51e0 con 0x7f3d400c95b0 2024-04-25T08:54:28.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.031+0000 7f3d36ffd640 1 -- 172.21.15.55:0/988096118 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3d28079060 con 0x7f3d400c95b0 2024-04-25T08:54:28.021 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:54:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 -- 172.21.15.55:0/988096118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3d2006b500 msgr2=0x7f3d2006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3d2006b500 0x7f3d2006d9c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009ae0 tx=0x7f3d30009190 comp rx=0 tx=0).stop 2024-04-25T08:54:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 -- 172.21.15.55:0/988096118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d400c95b0 msgr2=0x7f3d4015d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d400c95b0 0x7f3d4015d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800c300 tx=0x7f3d400b1270 comp rx=0 tx=0).stop 2024-04-25T08:54:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 -- 172.21.15.55:0/988096118 shutdown_connections 2024-04-25T08:54:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3d2006b500 0x7f3d2006d9c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d401f3570 0x7f3d4015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d400c95b0 0x7f3d4015d330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:28.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 --2- 172.21.15.55:0/988096118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d2c003f30 0x7f3d400ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:28.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 -- 172.21.15.55:0/988096118 >> 172.21.15.55:0/988096118 conn(0x7f3d4006f430 msgr2=0x7f3d4006d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:28.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 -- 172.21.15.55:0/988096118 shutdown_connections 2024-04-25T08:54:28.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.034+0000 7f3d44970640 1 -- 172.21.15.55:0/988096118 wait complete. 2024-04-25T08:54:28.039 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:54:28.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.160+0000 7f0945389640 1 Processor -- start 2024-04-25T08:54:28.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.160+0000 7f0945389640 1 -- start start 2024-04-25T08:54:28.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.161+0000 7f0945389640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09400b9720 0x7f09400ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:28.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.161+0000 7f0945389640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09400cece0 0x7f09400d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:28.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.161+0000 7f0945389640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0940161f80 con 0x7f0940161090 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.161+0000 7f0945389640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09400cf130 con 0x7f09400b9720 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.161+0000 7f0945389640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09400d21a0 con 0x7f09400cece0 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.161+0000 7f093effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0940161090 0x7f0940161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36030/0 (socket says 172.21.15.55:36030) 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.161+0000 7f093effd640 1 -- 172.21.15.55:0/3042222758 learned_addr learned my addr 172.21.15.55:0/3042222758 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.161+0000 7f093e7fc640 1 --2- 172.21.15.55:0/3042222758 >> v2:172.21.15.55:3300/0 conn(0x7f09400b9720 0x7f09400ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.161+0000 7f093dffb640 1 -- 172.21.15.55:0/3042222758 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713665251 0 0) 0x7f0940161f80 con 0x7f0940161090 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.161+0000 7f093dffb640 1 -- 172.21.15.55:0/3042222758 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0928003520 con 0x7f0940161090 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.161+0000 7f093f7fe640 1 --2- 172.21.15.55:0/3042222758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09400cece0 0x7f09400d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.162+0000 7f093e7fc640 1 -- 172.21.15.55:0/3042222758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09400cece0 msgr2=0x7f09400d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.162+0000 7f093e7fc640 1 --2- 172.21.15.55:0/3042222758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09400cece0 0x7f09400d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.162+0000 7f093e7fc640 1 -- 172.21.15.55:0/3042222758 >> v1:172.21.15.55:6789/0 conn(0x7f0940161090 legacy=0x7f0940161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.162+0000 7f093e7fc640 1 -- 172.21.15.55:0/3042222758 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0940162260 con 0x7f09400b9720 2024-04-25T08:54:28.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.162+0000 7f093e7fc640 1 --2- 172.21.15.55:0/3042222758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09400b9720 0x7f09400ce7a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f09340097a0 tx=0x7f093402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453fc5d7a6adc46c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:28.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.163+0000 7f093dffb640 1 -- 172.21.15.55:0/3042222758 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934037070 con 0x7f09400b9720 2024-04-25T08:54:28.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.163+0000 7f093dffb640 1 -- 172.21.15.55:0/3042222758 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093402ae50 con 0x7f09400b9720 2024-04-25T08:54:28.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.163+0000 7f093dffb640 1 -- 172.21.15.55:0/3042222758 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934032660 con 0x7f09400b9720 2024-04-25T08:54:28.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.163+0000 7f0945389640 1 -- 172.21.15.55:0/3042222758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09400b9720 msgr2=0x7f09400ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:28.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.163+0000 7f0945389640 1 --2- 172.21.15.55:0/3042222758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09400b9720 0x7f09400ce7a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f09340097a0 tx=0x7f093402a100 comp rx=0 tx=0).stop 2024-04-25T08:54:28.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.163+0000 7f0945389640 1 -- 172.21.15.55:0/3042222758 shutdown_connections 2024-04-25T08:54:28.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.163+0000 7f0945389640 1 --2- 172.21.15.55:0/3042222758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09400cece0 0x7f09400d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:28.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.163+0000 7f0945389640 1 --2- 172.21.15.55:0/3042222758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09400b9720 0x7f09400ce7a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:28.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.163+0000 7f0945389640 1 -- 172.21.15.55:0/3042222758 >> 172.21.15.55:0/3042222758 conn(0x7f09400b55e0 msgr2=0x7f09400b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.163+0000 7f0945389640 1 -- 172.21.15.55:0/3042222758 shutdown_connections 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.163+0000 7f0945389640 1 -- 172.21.15.55:0/3042222758 wait complete. 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.164+0000 7f0945389640 1 Processor -- start 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.165+0000 7f0945389640 1 -- start start 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.165+0000 7f0945389640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09400b9720 0x7f0940157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.165+0000 7f0945389640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09400cece0 0x7f09401f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.165+0000 7f0945389640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940161090 0x7f094015d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.165+0000 7f0945389640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940161470 con 0x7f09400cece0 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.165+0000 7f0945389640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09400d1e30 con 0x7f0940161090 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.165+0000 7f0945389640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09400d2b70 con 0x7f09400b9720 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.165+0000 7f093e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09400cece0 0x7f09401f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.165+0000 7f093e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09400cece0 0x7f09401f37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42108/0 (socket says 172.21.15.55:42108) 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.165+0000 7f093e7fc640 1 -- 172.21.15.55:0/4205664927 learned_addr learned my addr 172.21.15.55:0/4205664927 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f093effd640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09400b9720 0x7f0940157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f093f7fe640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940161090 0x7f094015d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f093e7fc640 1 -- 172.21.15.55:0/4205664927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09400b9720 msgr2=0x7f0940157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f093e7fc640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09400b9720 0x7f0940157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f093e7fc640 1 -- 172.21.15.55:0/4205664927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940161090 msgr2=0x7f094015d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f093e7fc640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940161090 0x7f094015d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f093e7fc640 1 -- 172.21.15.55:0/4205664927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09400c9140 con 0x7f09400cece0 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f093e7fc640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09400cece0 0x7f09401f37a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0934035040 tx=0x7f09340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f09277fe640 1 -- 172.21.15.55:0/4205664927 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934041070 con 0x7f09400cece0 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f09277fe640 1 -- 172.21.15.55:0/4205664927 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093403c460 con 0x7f09400cece0 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f0945389640 1 -- 172.21.15.55:0/4205664927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094015db70 con 0x7f09400cece0 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f09277fe640 1 -- 172.21.15.55:0/4205664927 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934037040 con 0x7f09400cece0 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.166+0000 7f0945389640 1 -- 172.21.15.55:0/4205664927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094015e130 con 0x7f09400cece0 2024-04-25T08:54:28.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.167+0000 7f0945389640 1 -- 172.21.15.55:0/4205664927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09400750b0 con 0x7f09400cece0 2024-04-25T08:54:28.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.168+0000 7f09277fe640 1 -- 172.21.15.55:0/4205664927 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f093403a070 con 0x7f09400cece0 2024-04-25T08:54:28.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.168+0000 7f09277fe640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f092c06b4d0 0x7f092c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:28.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.168+0000 7f09277fe640 1 -- 172.21.15.55:0/4205664927 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f09340aa300 con 0x7f09400cece0 2024-04-25T08:54:28.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.168+0000 7f093effd640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f092c06b4d0 0x7f092c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:28.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.169+0000 7f093effd640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f092c06b4d0 0x7f092c06d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0930005880 tx=0x7f0930009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:28.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.172+0000 7f09277fe640 1 -- 172.21.15.55:0/4205664927 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0934078c20 con 0x7f09400cece0 2024-04-25T08:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:28.356+0000 7f0945389640 1 -- 172.21.15.55:0/4205664927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f09400c71d0 con 0x7f09400cece0 2024-04-25T08:54:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.038+0000 7f09277fe640 1 -- 172.21.15.55:0/4205664927 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f093407ccc0 con 0x7f09400cece0 2024-04-25T08:54:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-25T08:54:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.040+0000 7f0945389640 1 -- 172.21.15.55:0/4205664927 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f092c06b4d0 msgr2=0x7f092c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.040+0000 7f0945389640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f092c06b4d0 0x7f092c06d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0930005880 tx=0x7f0930009040 comp rx=0 tx=0).stop 2024-04-25T08:54:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.040+0000 7f0945389640 1 -- 172.21.15.55:0/4205664927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09400cece0 msgr2=0x7f09401f37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.040+0000 7f0945389640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09400cece0 0x7f09401f37a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0934035040 tx=0x7f09340046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.040+0000 7f0945389640 1 -- 172.21.15.55:0/4205664927 shutdown_connections 2024-04-25T08:54:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.040+0000 7f0945389640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f092c06b4d0 0x7f092c06d990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.040+0000 7f0945389640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0940161090 0x7f094015d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.040+0000 7f0945389640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09400cece0 0x7f09401f37a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.040+0000 7f0945389640 1 --2- 172.21.15.55:0/4205664927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09400b9720 0x7f0940157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.040+0000 7f0945389640 1 -- 172.21.15.55:0/4205664927 >> 172.21.15.55:0/4205664927 conn(0x7f09400b55e0 msgr2=0x7f09400b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.041+0000 7f0945389640 1 -- 172.21.15.55:0/4205664927 shutdown_connections 2024-04-25T08:54:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.041+0000 7f0945389640 1 -- 172.21.15.55:0/4205664927 wait complete. 2024-04-25T08:54:29.049 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:54:29.049 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:54:29.050 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:54:29.050 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:54:29.050 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:54:29.050 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:54:29.050 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:54:29.050 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:54:29.050 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:54:29.051 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:54:29.051 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:54:29.051 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:54:29.051 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:54:29.053 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:54:29.053 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:54:29.053 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:54:29.061 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:54:29.062 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:54:29.063 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:54:29.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:54:29.065 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:54:29.065 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:54:29.066 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:54:29.066 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:54:29.105 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:54:29.105 DEBUG:teuthology.parallel:result is None 2024-04-25T08:54:29.106 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:54:29.106 DEBUG:teuthology.parallel:result is None 2024-04-25T08:54:29.108 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:54:29.109 DEBUG:teuthology.parallel:result is None 2024-04-25T08:54:29.110 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:54:29.110 DEBUG:teuthology.parallel:result is None 2024-04-25T08:54:29.110 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:54:29.186 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T08:54:29.187 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T08:54:29.188 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-25T08:54:29.188 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T08:54:29.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.231+0000 7f6f6fe2a640 1 Processor -- start 2024-04-25T08:54:29.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.232+0000 7f6f6fe2a640 1 -- start start 2024-04-25T08:54:29.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.232+0000 7f6f6fe2a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f680b9720 0x7f6f680ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:29.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.232+0000 7f6f6fe2a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f68161f80 con 0x7f6f68161090 2024-04-25T08:54:29.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.232+0000 7f6f6fe2a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f68162260 con 0x7f6f680cece0 2024-04-25T08:54:29.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.233+0000 7f6f6fe2a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680cf130 con 0x7f6f680b9720 2024-04-25T08:54:29.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.233+0000 7f6f6dbc6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6f68161090 0x7f6f68161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57620/0 (socket says 172.21.15.55:57620) 2024-04-25T08:54:29.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.233+0000 7f6f6dbc6640 1 -- 172.21.15.55:0/2103279455 learned_addr learned my addr 172.21.15.55:0/2103279455 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:29.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.233+0000 7f6f6d3c5640 1 --2- 172.21.15.55:0/2103279455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f680b9720 0x7f6f680ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:29.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.233+0000 7f6f6cbc4640 1 -- 172.21.15.55:0/2103279455 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833748062 0 0) 0x7f6f68161f80 con 0x7f6f68161090 2024-04-25T08:54:29.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.233+0000 7f6f6cbc4640 1 -- 172.21.15.55:0/2103279455 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f54003520 con 0x7f6f68161090 2024-04-25T08:54:29.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.233+0000 7f6f6cbc4640 1 -- 172.21.15.55:0/2103279455 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26752985 0 0) 0x7f6f68162260 con 0x7f6f680cece0 2024-04-25T08:54:29.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.233+0000 7f6f6cbc4640 1 -- 172.21.15.55:0/2103279455 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f68161f80 con 0x7f6f680cece0 2024-04-25T08:54:29.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.233+0000 7f6f6d3c5640 1 -- 172.21.15.55:0/2103279455 >> v1:172.21.15.167:6789/0 conn(0x7f6f680cece0 legacy=0x7f6f680d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:29.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.233+0000 7f6f6d3c5640 1 -- 172.21.15.55:0/2103279455 >> v1:172.21.15.55:6789/0 conn(0x7f6f68161090 legacy=0x7f6f68161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:29.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.233+0000 7f6f6d3c5640 1 -- 172.21.15.55:0/2103279455 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f68162540 con 0x7f6f680b9720 2024-04-25T08:54:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.234+0000 7f6f6d3c5640 1 --2- 172.21.15.55:0/2103279455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f680b9720 0x7f6f680ce7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6f640097d0 tx=0x7f6f6402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88f77dac3cdbafc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.234+0000 7f6f6cbc4640 1 -- 172.21.15.55:0/2103279455 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64037070 con 0x7f6f680b9720 2024-04-25T08:54:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.234+0000 7f6f6cbc4640 1 -- 172.21.15.55:0/2103279455 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64032440 con 0x7f6f680b9720 2024-04-25T08:54:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.234+0000 7f6f6cbc4640 1 -- 172.21.15.55:0/2103279455 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64032810 con 0x7f6f680b9720 2024-04-25T08:54:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.235+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2103279455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f680b9720 msgr2=0x7f6f680ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.235+0000 7f6f6fe2a640 1 --2- 172.21.15.55:0/2103279455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f680b9720 0x7f6f680ce7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6f640097d0 tx=0x7f6f6402a210 comp rx=0 tx=0).stop 2024-04-25T08:54:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.235+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2103279455 shutdown_connections 2024-04-25T08:54:29.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.235+0000 7f6f6fe2a640 1 --2- 172.21.15.55:0/2103279455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f680b9720 0x7f6f680ce7a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:29.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.235+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2103279455 >> 172.21.15.55:0/2103279455 conn(0x7f6f680b55e0 msgr2=0x7f6f680b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:29.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.235+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2103279455 shutdown_connections 2024-04-25T08:54:29.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.235+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2103279455 wait complete. 2024-04-25T08:54:29.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.236+0000 7f6f6fe2a640 1 Processor -- start 2024-04-25T08:54:29.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.236+0000 7f6f6fe2a640 1 -- start start 2024-04-25T08:54:29.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6fe2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f680b9720 0x7f6f6815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:29.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6fe2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f680cece0 0x7f6f681e94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:29.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6fe2a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f68161090 0x7f6f680c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:29.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6fe2a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68161470 con 0x7f6f680cece0 2024-04-25T08:54:29.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6fe2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680d21a0 con 0x7f6f680b9720 2024-04-25T08:54:29.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6fe2a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680d2d40 con 0x7f6f68161090 2024-04-25T08:54:29.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6d3c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f680cece0 0x7f6f681e94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:29.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6d3c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f680cece0 0x7f6f681e94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53220/0 (socket says 172.21.15.55:53220) 2024-04-25T08:54:29.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6d3c5640 1 -- 172.21.15.55:0/2039702187 learned_addr learned my addr 172.21.15.55:0/2039702187 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:29.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6d3c5640 1 -- 172.21.15.55:0/2039702187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f68161090 msgr2=0x7f6f680c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:29.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6dbc6640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f680b9720 0x7f6f6815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:29.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6d3c5640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f68161090 0x7f6f680c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:29.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6d3c5640 1 -- 172.21.15.55:0/2039702187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f680b9720 msgr2=0x7f6f6815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:29.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6d3c5640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f680b9720 0x7f6f6815a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:29.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6d3c5640 1 -- 172.21.15.55:0/2039702187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6815df70 con 0x7f6f680cece0 2024-04-25T08:54:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6dbc6640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f680b9720 0x7f6f6815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6d3c5640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f680cece0 0x7f6f681e94a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6f640098f0 tx=0x7f6f640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f5e7fc640 1 -- 172.21.15.55:0/2039702187 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64041020 con 0x7f6f680cece0 2024-04-25T08:54:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f5e7fc640 1 -- 172.21.15.55:0/2039702187 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6403d6e0 con 0x7f6f680cece0 2024-04-25T08:54:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2039702187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6815e210 con 0x7f6f680cece0 2024-04-25T08:54:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.237+0000 7f6f5e7fc640 1 -- 172.21.15.55:0/2039702187 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64037040 con 0x7f6f680cece0 2024-04-25T08:54:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.238+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2039702187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6815e7d0 con 0x7f6f680cece0 2024-04-25T08:54:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.238+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2039702187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f680750b0 con 0x7f6f680cece0 2024-04-25T08:54:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.239+0000 7f6f5e7fc640 1 -- 172.21.15.55:0/2039702187 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6f64044020 con 0x7f6f680cece0 2024-04-25T08:54:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.239+0000 7f6f5e7fc640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f4c06b4d0 0x7f6f4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.239+0000 7f6f5e7fc640 1 -- 172.21.15.55:0/2039702187 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6f640aa660 con 0x7f6f680cece0 2024-04-25T08:54:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.239+0000 7f6f6dbc6640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f4c06b4d0 0x7f6f4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.240+0000 7f6f6dbc6640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f4c06b4d0 0x7f6f4c06d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007fd0 tx=0x7f6f58009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:29.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.244+0000 7f6f5e7fc640 1 -- 172.21.15.55:0/2039702187 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6f6404b030 con 0x7f6f680cece0 2024-04-25T08:54:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:29.436+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2039702187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6f680d1700 con 0x7f6f680cece0 2024-04-25T08:54:30.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.053+0000 7f6f5e7fc640 1 -- 172.21.15.55:0/2039702187 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6f64079750 con 0x7f6f680cece0 2024-04-25T08:54:30.043 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-25T08:54:30.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2039702187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f4c06b4d0 msgr2=0x7f6f4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f4c06b4d0 0x7f6f4c06d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007fd0 tx=0x7f6f58009040 comp rx=0 tx=0).stop 2024-04-25T08:54:30.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2039702187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f680cece0 msgr2=0x7f6f681e94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f680cece0 0x7f6f681e94a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6f640098f0 tx=0x7f6f640046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2039702187 shutdown_connections 2024-04-25T08:54:30.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f4c06b4d0 0x7f6f4c06d990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f68161090 0x7f6f680c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f680cece0 0x7f6f681e94a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 --2- 172.21.15.55:0/2039702187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f680b9720 0x7f6f6815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2039702187 >> 172.21.15.55:0/2039702187 conn(0x7f6f680b55e0 msgr2=0x7f6f680b8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2039702187 shutdown_connections 2024-04-25T08:54:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.056+0000 7f6f6fe2a640 1 -- 172.21.15.55:0/2039702187 wait complete. 2024-04-25T08:54:30.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:54:30.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.179+0000 7f07b49c1640 1 Processor -- start 2024-04-25T08:54:30.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.179+0000 7f07b49c1640 1 -- start start 2024-04-25T08:54:30.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07b49c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07b00d35b0 0x7f07b00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07b49c1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07b00b5990 0x7f07b00b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07b49c1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b015e0c0 con 0x7f07b015dce0 2024-04-25T08:54:30.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07b49c1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b00b5de0 con 0x7f07b00b5990 2024-04-25T08:54:30.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07b49c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00d2510 con 0x7f07b00d35b0 2024-04-25T08:54:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07aed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07b00b5990 0x7f07b00b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07aed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07b00b5990 0x7f07b00b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53222/0 (socket says 172.21.15.55:53222) 2024-04-25T08:54:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07aed9d640 1 -- 172.21.15.55:0/2605865639 learned_addr learned my addr 172.21.15.55:0/2605865639 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07a7fff640 1 --2- 172.21.15.55:0/2605865639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07b00d35b0 0x7f07b00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07aed9d640 1 -- 172.21.15.55:0/2605865639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07b00d35b0 msgr2=0x7f07b00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07aed9d640 1 --2- 172.21.15.55:0/2605865639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07b00d35b0 0x7f07b00b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07aed9d640 1 -- 172.21.15.55:0/2605865639 >> v1:172.21.15.167:6789/0 conn(0x7f07b015dce0 legacy=0x7f07b00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.180+0000 7f07aed9d640 1 -- 172.21.15.55:0/2605865639 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00d27f0 con 0x7f07b00b5990 2024-04-25T08:54:30.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.181+0000 7f07aed9d640 1 --2- 172.21.15.55:0/2605865639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07b00b5990 0x7f07b00b6b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009e50 tx=0x7f07a802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9d50294382306b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:30.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.181+0000 7f07add9b640 1 -- 172.21.15.55:0/2605865639 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8036070 con 0x7f07b00b5990 2024-04-25T08:54:30.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.181+0000 7f07add9b640 1 -- 172.21.15.55:0/2605865639 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a8031600 con 0x7f07b00b5990 2024-04-25T08:54:30.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.181+0000 7f07add9b640 1 -- 172.21.15.55:0/2605865639 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a80319d0 con 0x7f07b00b5990 2024-04-25T08:54:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.182+0000 7f07b49c1640 1 -- 172.21.15.55:0/2605865639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07b00b5990 msgr2=0x7f07b00b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.182+0000 7f07b49c1640 1 --2- 172.21.15.55:0/2605865639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07b00b5990 0x7f07b00b6b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009e50 tx=0x7f07a802a710 comp rx=0 tx=0).stop 2024-04-25T08:54:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.182+0000 7f07b49c1640 1 -- 172.21.15.55:0/2605865639 shutdown_connections 2024-04-25T08:54:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.182+0000 7f07b49c1640 1 --2- 172.21.15.55:0/2605865639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07b00b5990 0x7f07b00b6b00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.182+0000 7f07b49c1640 1 --2- 172.21.15.55:0/2605865639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07b00d35b0 0x7f07b00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.182+0000 7f07b49c1640 1 -- 172.21.15.55:0/2605865639 >> 172.21.15.55:0/2605865639 conn(0x7f07b0072900 msgr2=0x7f07b00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.182+0000 7f07b49c1640 1 -- 172.21.15.55:0/2605865639 shutdown_connections 2024-04-25T08:54:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.182+0000 7f07b49c1640 1 -- 172.21.15.55:0/2605865639 wait complete. 2024-04-25T08:54:30.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.183+0000 7f07b49c1640 1 Processor -- start 2024-04-25T08:54:30.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.183+0000 7f07b49c1640 1 -- start start 2024-04-25T08:54:30.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07b49c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07b00b5990 0x7f07b0152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07b49c1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07b00d35b0 0x7f07b0153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07b49c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07b015dce0 0x7f07b0153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07b49c1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00d3090 con 0x7f07b015dce0 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07b49c1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00d2db0 con 0x7f07b00d35b0 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07b49c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00d2160 con 0x7f07b00b5990 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07aed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07b015dce0 0x7f07b0153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07aed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07b015dce0 0x7f07b0153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53238/0 (socket says 172.21.15.55:53238) 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07aed9d640 1 -- 172.21.15.55:0/2667927387 learned_addr learned my addr 172.21.15.55:0/2667927387 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07a7fff640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07b00d35b0 0x7f07b0153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07ae59c640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07b00b5990 0x7f07b0152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07aed9d640 1 -- 172.21.15.55:0/2667927387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07b00b5990 msgr2=0x7f07b0152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07aed9d640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07b00b5990 0x7f07b0152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07aed9d640 1 -- 172.21.15.55:0/2667927387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07b00d35b0 msgr2=0x7f07b0153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07aed9d640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07b00d35b0 0x7f07b0153f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07aed9d640 1 -- 172.21.15.55:0/2667927387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00c8950 con 0x7f07b015dce0 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.184+0000 7f07aed9d640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07b015dce0 0x7f07b0153230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f07a8034040 tx=0x7f07a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.185+0000 7f07a6ffd640 1 -- 172.21.15.55:0/2667927387 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8036050 con 0x7f07b015dce0 2024-04-25T08:54:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.185+0000 7f07a6ffd640 1 -- 172.21.15.55:0/2667927387 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a8042070 con 0x7f07b015dce0 2024-04-25T08:54:30.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.185+0000 7f07b49c1640 1 -- 172.21.15.55:0/2667927387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b00c8bf0 con 0x7f07b015dce0 2024-04-25T08:54:30.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.185+0000 7f07a6ffd640 1 -- 172.21.15.55:0/2667927387 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8009510 con 0x7f07b015dce0 2024-04-25T08:54:30.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.185+0000 7f07b49c1640 1 -- 172.21.15.55:0/2667927387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b00c91b0 con 0x7f07b015dce0 2024-04-25T08:54:30.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.186+0000 7f07b49c1640 1 -- 172.21.15.55:0/2667927387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b00cf5f0 con 0x7f07b015dce0 2024-04-25T08:54:30.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.186+0000 7f07a6ffd640 1 -- 172.21.15.55:0/2667927387 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f07a8007bd0 con 0x7f07b015dce0 2024-04-25T08:54:30.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.187+0000 7f07a6ffd640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f079006b4d0 0x7f079006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.187+0000 7f07a6ffd640 1 -- 172.21.15.55:0/2667927387 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f07a80aacd0 con 0x7f07b015dce0 2024-04-25T08:54:30.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.187+0000 7f07ae59c640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f079006b4d0 0x7f079006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.187+0000 7f07ae59c640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f079006b4d0 0x7f079006d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f07a0001500 tx=0x7f07a0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:30.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.191+0000 7f07a6ffd640 1 -- 172.21.15.55:0/2667927387 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f07b00cf5f0 con 0x7f07b015dce0 2024-04-25T08:54:30.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.439+0000 7f07b49c1640 1 -- 172.21.15.55:0/2667927387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f07b00b9390 con 0x7f07b015dce0 2024-04-25T08:54:30.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.440+0000 7f07a6ffd640 1 -- 172.21.15.55:0/2667927387 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f07a8079f30 con 0x7f07b015dce0 2024-04-25T08:54:30.430 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:30.430 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:54:30.430 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-25T08:54:30.430 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.430 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm4IxeGBAAwuzfw8fkgBWLS/OHkVRPdA==", 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmz17MIxAAOjfHLP2pVtyOH1KkaFBdpw==", 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:54:30.431 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcJlOHxAAWRBqx21VaZdp7n+bG6QdjA==", 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.432 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmbKyTKhAARg7pgR8TeZKNHV38FuAv+g==", 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDgGSpmMDqwHRAAte7ZpF14thK4VEsC4getWg==", 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.433 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDjGSpm7bEhHRAALQKewGfpKljGFsW75+h/Dg==", 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDmGSpmjg2RHBAA+DxXqJHuPIGUsVvwUirEwg==", 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDpGSpmxft1HBAAsIYtKh97QF4WhdL9kI2QeA==", 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:54:30.435 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDvGSpm4QDFIRAAlMSvRI/gNR4p8BgQdRUcBA==", 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-25T08:54:30.436 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyGSpmARfiHxAABn3CWZTkyRxXpTUxKGi71A==", 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1GSpmLHBmHRAA4xXuyYK95pq8g+DAXREvKQ==", 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.437 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4GSpmMbpPGxAAP7YWBUzcafaowcZG1ZWhDA==", 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw==", 2024-04-25T08:54:30.438 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcP0TNxAA02w2xuYx7fMlMbZpgy53hQ==", 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:54:30.439 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:54:30.440 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:54:30.440 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.440 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.440 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.440 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-25T08:54:30.440 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmpD8INBAA29l06IV/RnM5qxOD6VL3MA==", 2024-04-25T08:54:30.440 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.440 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:54:30.440 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:54:30.440 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDaGSpm8xftABAADCQqbD2gknLM2w+MV/H29A==", 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.441 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-25T08:54:30.442 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDYGSpmHI4oORAAQoQL0ylKsbBRG+EldcMd4g==", 2024-04-25T08:54:30.442 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.442 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:54:30.442 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:54:30.442 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:54:30.442 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.442 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.442 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.442 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.442 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mds", 2024-04-25T08:54:30.443 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD+GSpmNlHaDxAANX5/jYlttaXuZGG2yX5zKg==", 2024-04-25T08:54:30.443 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.443 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T08:54:30.443 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.443 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.443 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.443 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T08:54:30.443 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD+GSpmUFnaDxAAnXkiQ9NxJAD0BKUJPsDcbw==", 2024-04-25T08:54:30.443 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.443 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T08:54:30.443 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.444 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.444 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.444 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-osd", 2024-04-25T08:54:30.444 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD+GSpmN2DaDxAAOpWxzLpZjCG60JDY3+xdsw==", 2024-04-25T08:54:30.444 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.444 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T08:54:30.444 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.444 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.444 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.444 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T08:54:30.444 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD+GSpmIGfaDxAA8plbaQ8gnYbhaL0ANHT27w==", 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD+GSpmgW7aDxAAJPCTNEkiJsZGQqYUeF7dDg==", 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.445 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD+GSpmy3XaDxAAkCSFKuo/MeYhiY61ZCdlqA==", 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmk2Q/FRAAwGHbq7UsFI+OdwcBOqLnlA==", 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.446 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm6NfaERAAtb5ZheEavSDdOCOxeM0a2Q==", 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-25T08:54:30.447 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:54:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 -- 172.21.15.55:0/2667927387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f079006b4d0 msgr2=0x7f079006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f079006b4d0 0x7f079006d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f07a0001500 tx=0x7f07a0009040 comp rx=0 tx=0).stop 2024-04-25T08:54:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 -- 172.21.15.55:0/2667927387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07b015dce0 msgr2=0x7f07b0153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07b015dce0 0x7f07b0153230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f07a8034040 tx=0x7f07a8004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 -- 172.21.15.55:0/2667927387 shutdown_connections 2024-04-25T08:54:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f079006b4d0 0x7f079006d990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07b015dce0 0x7f07b0153230 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07b00d35b0 0x7f07b0153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 --2- 172.21.15.55:0/2667927387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07b00b5990 0x7f07b0152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 -- 172.21.15.55:0/2667927387 >> 172.21.15.55:0/2667927387 conn(0x7f07b0072900 msgr2=0x7f07b00b6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 -- 172.21.15.55:0/2667927387 shutdown_connections 2024-04-25T08:54:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.442+0000 7f07b49c1640 1 -- 172.21.15.55:0/2667927387 wait complete. 2024-04-25T08:54:30.450 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T08:54:30.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.562+0000 7f5f2f530640 1 Processor -- start 2024-04-25T08:54:30.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.562+0000 7f5f2f530640 1 -- start start 2024-04-25T08:54:30.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.563+0000 7f5f2f530640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f281610b0 0x7f5f280b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.563+0000 7f5f2f530640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f28162040 con 0x7f5f280cef40 2024-04-25T08:54:30.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.563+0000 7f5f2f530640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f28162320 con 0x7f5f281618d0 2024-04-25T08:54:30.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.563+0000 7f5f2f530640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f280d1ea0 con 0x7f5f281610b0 2024-04-25T08:54:30.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.563+0000 7f5f2d2cc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f281610b0 0x7f5f280b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.563+0000 7f5f2dacd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5f280cef40 0x7f5f280d2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57630/0 (socket says 172.21.15.55:57630) 2024-04-25T08:54:30.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.563+0000 7f5f2dacd640 1 -- 172.21.15.55:0/3971202759 learned_addr learned my addr 172.21.15.55:0/3971202759 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:30.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.563+0000 7f5f2d2cc640 1 -- 172.21.15.55:0/3971202759 >> v1:172.21.15.167:6789/0 conn(0x7f5f281618d0 legacy=0x7f5f280ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.563+0000 7f5f2d2cc640 1 -- 172.21.15.55:0/3971202759 >> v1:172.21.15.55:6789/0 conn(0x7f5f280cef40 legacy=0x7f5f280d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.563+0000 7f5f2d2cc640 1 -- 172.21.15.55:0/3971202759 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28162600 con 0x7f5f281610b0 2024-04-25T08:54:30.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.563+0000 7f5f27fff640 1 -- 172.21.15.55:0/3971202759 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081449817 0 0) 0x7f5f28162040 con 0x7f5f280cef40 2024-04-25T08:54:30.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.564+0000 7f5f2d2cc640 1 --2- 172.21.15.55:0/3971202759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f281610b0 0x7f5f280b9580 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f200097a0 tx=0x7f5f2002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758225a990e66046 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:30.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.564+0000 7f5f27fff640 1 -- 172.21.15.55:0/3971202759 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20037070 con 0x7f5f281610b0 2024-04-25T08:54:30.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.564+0000 7f5f27fff640 1 -- 172.21.15.55:0/3971202759 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20032440 con 0x7f5f281610b0 2024-04-25T08:54:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.564+0000 7f5f27fff640 1 -- 172.21.15.55:0/3971202759 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20032810 con 0x7f5f281610b0 2024-04-25T08:54:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.565+0000 7f5f2f530640 1 -- 172.21.15.55:0/3971202759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f281610b0 msgr2=0x7f5f280b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.565+0000 7f5f2f530640 1 --2- 172.21.15.55:0/3971202759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f281610b0 0x7f5f280b9580 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f200097a0 tx=0x7f5f2002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.565+0000 7f5f2f530640 1 -- 172.21.15.55:0/3971202759 shutdown_connections 2024-04-25T08:54:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.565+0000 7f5f2f530640 1 --2- 172.21.15.55:0/3971202759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f281610b0 0x7f5f280b9580 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.565+0000 7f5f2f530640 1 -- 172.21.15.55:0/3971202759 >> 172.21.15.55:0/3971202759 conn(0x7f5f280b5570 msgr2=0x7f5f280b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.565+0000 7f5f2f530640 1 -- 172.21.15.55:0/3971202759 shutdown_connections 2024-04-25T08:54:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.565+0000 7f5f2f530640 1 -- 172.21.15.55:0/3971202759 wait complete. 2024-04-25T08:54:30.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.566+0000 7f5f2f530640 1 Processor -- start 2024-04-25T08:54:30.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.566+0000 7f5f2f530640 1 -- start start 2024-04-25T08:54:30.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2f530640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f280cef40 0x7f5f28140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2f530640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f281610b0 0x7f5f280c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2f530640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f281618d0 0x7f5f2815e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2f530640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28161d10 con 0x7f5f281610b0 2024-04-25T08:54:30.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2f530640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280b6c00 con 0x7f5f280cef40 2024-04-25T08:54:30.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2f530640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28161490 con 0x7f5f281618d0 2024-04-25T08:54:30.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2cacb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f281610b0 0x7f5f280c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2cacb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f281610b0 0x7f5f280c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53256/0 (socket says 172.21.15.55:53256) 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2cacb640 1 -- 172.21.15.55:0/1893908903 learned_addr learned my addr 172.21.15.55:0/1893908903 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2d2cc640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f280cef40 0x7f5f28140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2dacd640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f281618d0 0x7f5f2815e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2cacb640 1 -- 172.21.15.55:0/1893908903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f281618d0 msgr2=0x7f5f2815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2cacb640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f281618d0 0x7f5f2815e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2cacb640 1 -- 172.21.15.55:0/1893908903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f280cef40 msgr2=0x7f5f28140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2cacb640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f280cef40 0x7f5f28140810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.567+0000 7f5f2cacb640 1 -- 172.21.15.55:0/1893908903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f280cb7f0 con 0x7f5f281610b0 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.568+0000 7f5f2cacb640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f281610b0 0x7f5f280c9570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00c400 tx=0x7f5f1c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.568+0000 7f5f25ffb640 1 -- 172.21.15.55:0/1893908903 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c017070 con 0x7f5f281610b0 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.568+0000 7f5f25ffb640 1 -- 172.21.15.55:0/1893908903 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c0052d0 con 0x7f5f281610b0 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.568+0000 7f5f2f530640 1 -- 172.21.15.55:0/1893908903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2815ee60 con 0x7f5f281610b0 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.568+0000 7f5f25ffb640 1 -- 172.21.15.55:0/1893908903 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c003830 con 0x7f5f281610b0 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.568+0000 7f5f2f530640 1 -- 172.21.15.55:0/1893908903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f280cba90 con 0x7f5f281610b0 2024-04-25T08:54:30.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.569+0000 7f5f2f530640 1 -- 172.21.15.55:0/1893908903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f280750b0 con 0x7f5f281610b0 2024-04-25T08:54:30.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.569+0000 7f5f25ffb640 1 -- 172.21.15.55:0/1893908903 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5f1c01a070 con 0x7f5f281610b0 2024-04-25T08:54:30.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.570+0000 7f5f25ffb640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5f1406b500 0x7f5f1406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.570+0000 7f5f25ffb640 1 -- 172.21.15.55:0/1893908903 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f1c089150 con 0x7f5f281610b0 2024-04-25T08:54:30.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.570+0000 7f5f2d2cc640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5f1406b500 0x7f5f1406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.570+0000 7f5f2d2cc640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5f1406b500 0x7f5f1406d9c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f20034000 tx=0x7f5f2002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:30.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.574+0000 7f5f25ffb640 1 -- 172.21.15.55:0/1893908903 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5f1c057cd0 con 0x7f5f281610b0 2024-04-25T08:54:30.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.825+0000 7f5f2f530640 1 -- 172.21.15.55:0/1893908903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5f281607e0 con 0x7f5f281610b0 2024-04-25T08:54:30.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.827+0000 7f5f25ffb640 1 -- 172.21.15.55:0/1893908903 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5f1c05bd70 con 0x7f5f281610b0 2024-04-25T08:54:30.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 -- 172.21.15.55:0/1893908903 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5f1406b500 msgr2=0x7f5f1406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5f1406b500 0x7f5f1406d9c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f20034000 tx=0x7f5f2002e000 comp rx=0 tx=0).stop 2024-04-25T08:54:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 -- 172.21.15.55:0/1893908903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f281610b0 msgr2=0x7f5f280c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f281610b0 0x7f5f280c9570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00c400 tx=0x7f5f1c00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 -- 172.21.15.55:0/1893908903 shutdown_connections 2024-04-25T08:54:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5f1406b500 0x7f5f1406d9c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f281618d0 0x7f5f2815e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f281610b0 0x7f5f280c9570 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 --2- 172.21.15.55:0/1893908903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f280cef40 0x7f5f28140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 -- 172.21.15.55:0/1893908903 >> 172.21.15.55:0/1893908903 conn(0x7f5f280b5570 msgr2=0x7f5f280d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 -- 172.21.15.55:0/1893908903 shutdown_connections 2024-04-25T08:54:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.829+0000 7f5f2f530640 1 -- 172.21.15.55:0/1893908903 wait complete. 2024-04-25T08:54:30.830 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T08:54:30.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.942+0000 7fd84bcfc640 1 Processor -- start 2024-04-25T08:54:30.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.942+0000 7fd84bcfc640 1 -- start start 2024-04-25T08:54:30.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.943+0000 7fd84bcfc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd84415b910 0x7fd8440cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.943+0000 7fd84bcfc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd84415e0b0 0x7fd8440d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.943+0000 7fd84bcfc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd84415e510 0x7fd8440d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.943+0000 7fd84bcfc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84415f2d0 con 0x7fd84415e510 2024-04-25T08:54:30.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.943+0000 7fd84bcfc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84415e9d0 con 0x7fd84415b910 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.943+0000 7fd84bcfc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84415ecb0 con 0x7fd84415e0b0 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.943+0000 7fd84a299640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd84415e510 0x7fd8440d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.943+0000 7fd84a299640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd84415e510 0x7fd8440d0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53266/0 (socket says 172.21.15.55:53266) 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.943+0000 7fd84a299640 1 -- 172.21.15.55:0/4136985939 learned_addr learned my addr 172.21.15.55:0/4136985939 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd849297640 1 --2- 172.21.15.55:0/4136985939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd84415e0b0 0x7fd8440d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd849a98640 1 --2- 172.21.15.55:0/4136985939 >> v2:172.21.15.167:3300/0 conn(0x7fd84415b910 0x7fd8440cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd84a299640 1 -- 172.21.15.55:0/4136985939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd84415e0b0 msgr2=0x7fd8440d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd84a299640 1 --2- 172.21.15.55:0/4136985939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd84415e0b0 0x7fd8440d0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd84a299640 1 -- 172.21.15.55:0/4136985939 >> v2:172.21.15.167:3300/0 conn(0x7fd84415b910 msgr2=0x7fd8440cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd84a299640 1 --2- 172.21.15.55:0/4136985939 >> v2:172.21.15.167:3300/0 conn(0x7fd84415b910 0x7fd8440cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd84a299640 1 -- 172.21.15.55:0/4136985939 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84415ef90 con 0x7fd84415e510 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd849a98640 1 --2- 172.21.15.55:0/4136985939 >> v2:172.21.15.167:3300/0 conn(0x7fd84415b910 0x7fd8440cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:30.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd84a299640 1 --2- 172.21.15.55:0/4136985939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84415e510 0x7fd8440d0f40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd8440b5c70 tx=0x7fd83402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b45e0be64723b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:30.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd848a96640 1 -- 172.21.15.55:0/4136985939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834036070 con 0x7fd84415e510 2024-04-25T08:54:30.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd848a96640 1 -- 172.21.15.55:0/4136985939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834031600 con 0x7fd84415e510 2024-04-25T08:54:30.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.944+0000 7fd848a96640 1 -- 172.21.15.55:0/4136985939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8340319d0 con 0x7fd84415e510 2024-04-25T08:54:30.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.945+0000 7fd84bcfc640 1 -- 172.21.15.55:0/4136985939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84415e510 msgr2=0x7fd8440d0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.945+0000 7fd84bcfc640 1 --2- 172.21.15.55:0/4136985939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84415e510 0x7fd8440d0f40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd8440b5c70 tx=0x7fd83402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.945+0000 7fd84bcfc640 1 -- 172.21.15.55:0/4136985939 shutdown_connections 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.945+0000 7fd84bcfc640 1 --2- 172.21.15.55:0/4136985939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84415e510 0x7fd8440d0f40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.945+0000 7fd84bcfc640 1 --2- 172.21.15.55:0/4136985939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd84415e0b0 0x7fd8440d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.945+0000 7fd84bcfc640 1 --2- 172.21.15.55:0/4136985939 >> v2:172.21.15.167:3300/0 conn(0x7fd84415b910 0x7fd8440cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.945+0000 7fd84bcfc640 1 -- 172.21.15.55:0/4136985939 >> 172.21.15.55:0/4136985939 conn(0x7fd8440726c0 msgr2=0x7fd844072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.945+0000 7fd84bcfc640 1 -- 172.21.15.55:0/4136985939 shutdown_connections 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.945+0000 7fd84bcfc640 1 -- 172.21.15.55:0/4136985939 wait complete. 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.946+0000 7fd84bcfc640 1 Processor -- start 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.946+0000 7fd84bcfc640 1 -- start start 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd84bcfc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84415b910 0x7fd8440d2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd84bcfc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84415e0b0 0x7fd8440d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd84bcfc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd84415e510 0x7fd84414f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd84bcfc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844161880 con 0x7fd84415b910 2024-04-25T08:54:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd84bcfc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844161700 con 0x7fd84415e0b0 2024-04-25T08:54:30.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd84bcfc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd844161a00 con 0x7fd84415e510 2024-04-25T08:54:30.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd849a98640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84415b910 0x7fd8440d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd849a98640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84415b910 0x7fd8440d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53282/0 (socket says 172.21.15.55:53282) 2024-04-25T08:54:30.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd849a98640 1 -- 172.21.15.55:0/3024996112 learned_addr learned my addr 172.21.15.55:0/3024996112 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:30.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd84a299640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd84415e510 0x7fd84414f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd849297640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84415e0b0 0x7fd8440d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd849a98640 1 -- 172.21.15.55:0/3024996112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd84415e510 msgr2=0x7fd84414f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd849a98640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd84415e510 0x7fd84414f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd849a98640 1 -- 172.21.15.55:0/3024996112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84415e0b0 msgr2=0x7fd8440d3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:30.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd849a98640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84415e0b0 0x7fd8440d3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:30.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.947+0000 7fd849a98640 1 -- 172.21.15.55:0/3024996112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440d2640 con 0x7fd84415b910 2024-04-25T08:54:30.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.948+0000 7fd849a98640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84415b910 0x7fd8440d2100 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00c7f0 tx=0x7fd83c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:30.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.948+0000 7fd8427fc640 1 -- 172.21.15.55:0/3024996112 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c015070 con 0x7fd84415b910 2024-04-25T08:54:30.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.948+0000 7fd8427fc640 1 -- 172.21.15.55:0/3024996112 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c007a30 con 0x7fd84415b910 2024-04-25T08:54:30.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.948+0000 7fd84bcfc640 1 -- 172.21.15.55:0/3024996112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8440c9bf0 con 0x7fd84415b910 2024-04-25T08:54:30.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.948+0000 7fd8427fc640 1 -- 172.21.15.55:0/3024996112 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c007e00 con 0x7fd84415b910 2024-04-25T08:54:30.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.948+0000 7fd84bcfc640 1 -- 172.21.15.55:0/3024996112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8440d4600 con 0x7fd84415b910 2024-04-25T08:54:30.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.949+0000 7fd84bcfc640 1 -- 172.21.15.55:0/3024996112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8440750b0 con 0x7fd84415b910 2024-04-25T08:54:30.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.949+0000 7fd8427fc640 1 -- 172.21.15.55:0/3024996112 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd83c018070 con 0x7fd84415b910 2024-04-25T08:54:30.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.950+0000 7fd8427fc640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd83006b4d0 0x7fd83006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:30.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.950+0000 7fd8427fc640 1 -- 172.21.15.55:0/3024996112 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd83c089d70 con 0x7fd84415b910 2024-04-25T08:54:30.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.950+0000 7fd849297640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd83006b4d0 0x7fd83006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:30.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.950+0000 7fd849297640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd83006b4d0 0x7fd83006d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8440d1c40 tx=0x7fd838008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:30.954+0000 7fd8427fc640 1 -- 172.21.15.55:0/3024996112 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd83c0588f0 con 0x7fd84415b910 2024-04-25T08:54:31.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.214+0000 7fd84bcfc640 1 -- 172.21.15.55:0/3024996112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd844160b10 con 0x7fd84415b910 2024-04-25T08:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.217+0000 7fd8427fc640 1 -- 172.21.15.55:0/3024996112 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd83c05c990 con 0x7fd84415b910 2024-04-25T08:54:31.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 -- 172.21.15.55:0/3024996112 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd83006b4d0 msgr2=0x7fd83006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd83006b4d0 0x7fd83006d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8440d1c40 tx=0x7fd838008040 comp rx=0 tx=0).stop 2024-04-25T08:54:31.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 -- 172.21.15.55:0/3024996112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84415b910 msgr2=0x7fd8440d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84415b910 0x7fd8440d2100 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00c7f0 tx=0x7fd83c00cbf0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 -- 172.21.15.55:0/3024996112 shutdown_connections 2024-04-25T08:54:31.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd83006b4d0 0x7fd83006d990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd84415e510 0x7fd84414f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd84415e0b0 0x7fd8440d3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 --2- 172.21.15.55:0/3024996112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84415b910 0x7fd8440d2100 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 -- 172.21.15.55:0/3024996112 >> 172.21.15.55:0/3024996112 conn(0x7fd8440726c0 msgr2=0x7fd84415d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:31.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 -- 172.21.15.55:0/3024996112 shutdown_connections 2024-04-25T08:54:31.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.219+0000 7fd84bcfc640 1 -- 172.21.15.55:0/3024996112 wait complete. 2024-04-25T08:54:31.220 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T08:54:31.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.332+0000 7f3603fa5640 1 Processor -- start 2024-04-25T08:54:31.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.332+0000 7f3603fa5640 1 -- start start 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.333+0000 7f3603fa5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc0b9720 0x7f35fc0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.333+0000 7f3603fa5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35fc0cece0 0x7f35fc0d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.333+0000 7f3603fa5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc161f80 con 0x7f35fc161090 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.333+0000 7f3603fa5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc0cf130 con 0x7f35fc0cece0 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.333+0000 7f3603fa5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0d21a0 con 0x7f35fc0b9720 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.333+0000 7f3601540640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc0b9720 0x7f35fc0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.333+0000 7f3601540640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc0b9720 0x7f35fc0ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:54418/0 (socket says 172.21.15.55:54418) 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.333+0000 7f3602542640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35fc0cece0 0x7f35fc0d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.333+0000 7f3601540640 1 -- 172.21.15.55:0/287417650 learned_addr learned my addr 172.21.15.55:0/287417650 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.334+0000 7f3601540640 1 -- 172.21.15.55:0/287417650 >> v2:172.21.15.167:3300/0 conn(0x7f35fc0cece0 msgr2=0x7f35fc0d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.334+0000 7f3601540640 1 --2- 172.21.15.55:0/287417650 >> v2:172.21.15.167:3300/0 conn(0x7f35fc0cece0 0x7f35fc0d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.334+0000 7f3601540640 1 -- 172.21.15.55:0/287417650 >> v1:172.21.15.167:6789/0 conn(0x7f35fc161090 legacy=0x7f35fc161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.334+0000 7f3601540640 1 -- 172.21.15.55:0/287417650 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc162260 con 0x7f35fc0b9720 2024-04-25T08:54:31.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.334+0000 7f3602542640 1 --2- 172.21.15.55:0/287417650 >> v2:172.21.15.167:3300/0 conn(0x7f35fc0cece0 0x7f35fc0d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:31.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.335+0000 7f3601540640 1 --2- 172.21.15.55:0/287417650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc0b9720 0x7f35fc0ce7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009870 tx=0x7f35f002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b437a6969257f10d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:31.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.335+0000 7f3600d3f640 1 -- 172.21.15.55:0/287417650 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0037070 con 0x7f35fc0b9720 2024-04-25T08:54:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.335+0000 7f3600d3f640 1 -- 172.21.15.55:0/287417650 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f0032440 con 0x7f35fc0b9720 2024-04-25T08:54:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.335+0000 7f3600d3f640 1 -- 172.21.15.55:0/287417650 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0032810 con 0x7f35fc0b9720 2024-04-25T08:54:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.336+0000 7f3603fa5640 1 -- 172.21.15.55:0/287417650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc0b9720 msgr2=0x7f35fc0ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.336+0000 7f3603fa5640 1 --2- 172.21.15.55:0/287417650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc0b9720 0x7f35fc0ce7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009870 tx=0x7f35f002a270 comp rx=0 tx=0).stop 2024-04-25T08:54:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.336+0000 7f3603fa5640 1 -- 172.21.15.55:0/287417650 shutdown_connections 2024-04-25T08:54:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.336+0000 7f3603fa5640 1 --2- 172.21.15.55:0/287417650 >> v2:172.21.15.167:3300/0 conn(0x7f35fc0cece0 0x7f35fc0d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.336+0000 7f3603fa5640 1 --2- 172.21.15.55:0/287417650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc0b9720 0x7f35fc0ce7a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.336+0000 7f3603fa5640 1 -- 172.21.15.55:0/287417650 >> 172.21.15.55:0/287417650 conn(0x7f35fc0b55e0 msgr2=0x7f35fc0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:31.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.336+0000 7f3603fa5640 1 -- 172.21.15.55:0/287417650 shutdown_connections 2024-04-25T08:54:31.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.336+0000 7f3603fa5640 1 -- 172.21.15.55:0/287417650 wait complete. 2024-04-25T08:54:31.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.337+0000 7f3603fa5640 1 Processor -- start 2024-04-25T08:54:31.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.337+0000 7f3603fa5640 1 -- start start 2024-04-25T08:54:31.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3603fa5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35fc0b9720 0x7f35fc15d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3603fa5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0cece0 0x7f35fc15f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3603fa5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc161090 0x7f35fc151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3603fa5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc161470 con 0x7f35fc0cece0 2024-04-25T08:54:31.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3603fa5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0d1e30 con 0x7f35fc0b9720 2024-04-25T08:54:31.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3603fa5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0d2b70 con 0x7f35fc161090 2024-04-25T08:54:31.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3601540640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0cece0 0x7f35fc15f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3601540640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0cece0 0x7f35fc15f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53294/0 (socket says 172.21.15.55:53294) 2024-04-25T08:54:31.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3601540640 1 -- 172.21.15.55:0/3171266568 learned_addr learned my addr 172.21.15.55:0/3171266568 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:31.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3601d41640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35fc0b9720 0x7f35fc15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3602542640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc161090 0x7f35fc151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3601540640 1 -- 172.21.15.55:0/3171266568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc161090 msgr2=0x7f35fc151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3601540640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc161090 0x7f35fc151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3601540640 1 -- 172.21.15.55:0/3171266568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35fc0b9720 msgr2=0x7f35fc15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3601540640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35fc0b9720 0x7f35fc15d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.338+0000 7f3601540640 1 -- 172.21.15.55:0/3171266568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc1524e0 con 0x7f35fc0cece0 2024-04-25T08:54:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.339+0000 7f3601540640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0cece0 0x7f35fc15f9e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f35f0000c00 tx=0x7f35f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.339+0000 7f35fa7fc640 1 -- 172.21.15.55:0/3171266568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0037040 con 0x7f35fc0cece0 2024-04-25T08:54:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.339+0000 7f35fa7fc640 1 -- 172.21.15.55:0/3171266568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f0042070 con 0x7f35fc0cece0 2024-04-25T08:54:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.339+0000 7f35fa7fc640 1 -- 172.21.15.55:0/3171266568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f00308a0 con 0x7f35fc0cece0 2024-04-25T08:54:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.339+0000 7f3603fa5640 1 -- 172.21.15.55:0/3171266568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc15d6e0 con 0x7f35fc0cece0 2024-04-25T08:54:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.339+0000 7f3603fa5640 1 -- 172.21.15.55:0/3171266568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc15dca0 con 0x7f35fc0cece0 2024-04-25T08:54:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.340+0000 7f3603fa5640 1 -- 172.21.15.55:0/3171266568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc0750b0 con 0x7f35fc0cece0 2024-04-25T08:54:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.340+0000 7f35fa7fc640 1 -- 172.21.15.55:0/3171266568 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f35f0030a40 con 0x7f35fc0cece0 2024-04-25T08:54:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.341+0000 7f35fa7fc640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35e806b4d0 0x7f35e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.341+0000 7f35fa7fc640 1 -- 172.21.15.55:0/3171266568 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f35f00aa5a0 con 0x7f35fc0cece0 2024-04-25T08:54:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.341+0000 7f3601d41640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35e806b4d0 0x7f35e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.341+0000 7f3601d41640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35e806b4d0 0x7f35e806d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35f40016e0 tx=0x7f35f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:31.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.345+0000 7f35fa7fc640 1 -- 172.21.15.55:0/3171266568 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f35f0079800 con 0x7f35fc0cece0 2024-04-25T08:54:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.599+0000 7f3603fa5640 1 -- 172.21.15.55:0/3171266568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f35fc0cf710 con 0x7f35fc0cece0 2024-04-25T08:54:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.601+0000 7f35fa7fc640 1 -- 172.21.15.55:0/3171266568 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f35f0079100 con 0x7f35fc0cece0 2024-04-25T08:54:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 -- 172.21.15.55:0/3171266568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35e806b4d0 msgr2=0x7f35e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35e806b4d0 0x7f35e806d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35f40016e0 tx=0x7f35f4009040 comp rx=0 tx=0).stop 2024-04-25T08:54:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 -- 172.21.15.55:0/3171266568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0cece0 msgr2=0x7f35fc15f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0cece0 0x7f35fc15f9e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f35f0000c00 tx=0x7f35f00046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 -- 172.21.15.55:0/3171266568 shutdown_connections 2024-04-25T08:54:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35e806b4d0 0x7f35e806d990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35fc161090 0x7f35fc151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0cece0 0x7f35fc15f9e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 --2- 172.21.15.55:0/3171266568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35fc0b9720 0x7f35fc15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 -- 172.21.15.55:0/3171266568 >> 172.21.15.55:0/3171266568 conn(0x7f35fc0b55e0 msgr2=0x7f35fc0b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 -- 172.21.15.55:0/3171266568 shutdown_connections 2024-04-25T08:54:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.603+0000 7f3603fa5640 1 -- 172.21.15.55:0/3171266568 wait complete. 2024-04-25T08:54:31.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T08:54:31.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.716+0000 7f4c5fe5a640 1 Processor -- start 2024-04-25T08:54:31.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.716+0000 7f4c5fe5a640 1 -- start start 2024-04-25T08:54:31.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5fe5a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c5815dc50 0x7f4c58070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5fe5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c580cf600 0x7f4c580713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5fe5a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5806c220 con 0x7f4c580cd940 2024-04-25T08:54:31.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5fe5a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c580cfe00 con 0x7f4c5815dc50 2024-04-25T08:54:31.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5fe5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c580cec10 con 0x7f4c580cf600 2024-04-25T08:54:31.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5dbf6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c5815dc50 0x7f4c58070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5d3f5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4c580cd940 0x7f4c58161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57644/0 (socket says 172.21.15.55:57644) 2024-04-25T08:54:31.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5d3f5640 1 -- 172.21.15.55:0/3078181835 learned_addr learned my addr 172.21.15.55:0/3078181835 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:31.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5e3f7640 1 --2- 172.21.15.55:0/3078181835 >> v2:172.21.15.167:3300/0 conn(0x7f4c580cf600 0x7f4c580713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5dbf6640 1 -- 172.21.15.55:0/3078181835 >> v2:172.21.15.167:3300/0 conn(0x7f4c580cf600 msgr2=0x7f4c580713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:31.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5dbf6640 1 --2- 172.21.15.55:0/3078181835 >> v2:172.21.15.167:3300/0 conn(0x7f4c580cf600 0x7f4c580713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5dbf6640 1 -- 172.21.15.55:0/3078181835 >> v1:172.21.15.55:6789/0 conn(0x7f4c580cd940 legacy=0x7f4c58161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5dbf6640 1 -- 172.21.15.55:0/3078181835 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580d0050 con 0x7f4c5815dc50 2024-04-25T08:54:31.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5cbf4640 1 -- 172.21.15.55:0/3078181835 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848646385 0 0) 0x7f4c5806c220 con 0x7f4c580cd940 2024-04-25T08:54:31.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.717+0000 7f4c5e3f7640 1 --2- 172.21.15.55:0/3078181835 >> v2:172.21.15.167:3300/0 conn(0x7f4c580cf600 0x7f4c580713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:31.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.718+0000 7f4c5dbf6640 1 --2- 172.21.15.55:0/3078181835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5815dc50 0x7f4c58070e80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4c580b0a90 tx=0x7f4c5402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16b2a4f9fbac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:31.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.718+0000 7f4c5cbf4640 1 -- 172.21.15.55:0/3078181835 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54037070 con 0x7f4c5815dc50 2024-04-25T08:54:31.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.718+0000 7f4c5cbf4640 1 -- 172.21.15.55:0/3078181835 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c54032440 con 0x7f4c5815dc50 2024-04-25T08:54:31.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.718+0000 7f4c5cbf4640 1 -- 172.21.15.55:0/3078181835 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5402ae60 con 0x7f4c5815dc50 2024-04-25T08:54:31.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.719+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3078181835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5815dc50 msgr2=0x7f4c58070e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.719+0000 7f4c5fe5a640 1 --2- 172.21.15.55:0/3078181835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5815dc50 0x7f4c58070e80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4c580b0a90 tx=0x7f4c5402a110 comp rx=0 tx=0).stop 2024-04-25T08:54:31.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.719+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3078181835 shutdown_connections 2024-04-25T08:54:31.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.719+0000 7f4c5fe5a640 1 --2- 172.21.15.55:0/3078181835 >> v2:172.21.15.167:3300/0 conn(0x7f4c580cf600 0x7f4c580713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.719+0000 7f4c5fe5a640 1 --2- 172.21.15.55:0/3078181835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5815dc50 0x7f4c58070e80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.719+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3078181835 >> 172.21.15.55:0/3078181835 conn(0x7f4c5806f430 msgr2=0x7f4c5806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:31.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.719+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3078181835 shutdown_connections 2024-04-25T08:54:31.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.719+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3078181835 wait complete. 2024-04-25T08:54:31.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.720+0000 7f4c5fe5a640 1 Processor -- start 2024-04-25T08:54:31.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.720+0000 7f4c5fe5a640 1 -- start start 2024-04-25T08:54:31.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5fe5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c580cd940 0x7f4c5814f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5fe5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c580cf600 0x7f4c580c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5fe5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c5815dc50 0x7f4c580c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5fe5a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580ce8a0 con 0x7f4c580cd940 2024-04-25T08:54:31.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5fe5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580cc0c0 con 0x7f4c580cf600 2024-04-25T08:54:31.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5fe5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580cd620 con 0x7f4c5815dc50 2024-04-25T08:54:31.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5dbf6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c580cd940 0x7f4c5814f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5dbf6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c580cd940 0x7f4c5814f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53314/0 (socket says 172.21.15.55:53314) 2024-04-25T08:54:31.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5dbf6640 1 -- 172.21.15.55:0/3648280438 learned_addr learned my addr 172.21.15.55:0/3648280438 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:31.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5d3f5640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c580cf600 0x7f4c580c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5dbf6640 1 -- 172.21.15.55:0/3648280438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c5815dc50 msgr2=0x7f4c580c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5e3f7640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c5815dc50 0x7f4c580c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5dbf6640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c5815dc50 0x7f4c580c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5dbf6640 1 -- 172.21.15.55:0/3648280438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c580cf600 msgr2=0x7f4c580c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5dbf6640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c580cf600 0x7f4c580c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5dbf6640 1 -- 172.21.15.55:0/3648280438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580c6340 con 0x7f4c580cd940 2024-04-25T08:54:31.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5e3f7640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c5815dc50 0x7f4c580c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5d3f5640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c580cf600 0x7f4c580c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c5dbf6640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c580cd940 0x7f4c5814f000 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4c54035040 tx=0x7f4c540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.721+0000 7f4c4e7fc640 1 -- 172.21.15.55:0/3648280438 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54037040 con 0x7f4c580cd940 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.722+0000 7f4c4e7fc640 1 -- 172.21.15.55:0/3648280438 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c54042070 con 0x7f4c580cd940 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.722+0000 7f4c4e7fc640 1 -- 172.21.15.55:0/3648280438 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54030bd0 con 0x7f4c580cd940 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.722+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3648280438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c581f40b0 con 0x7f4c580cd940 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.722+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3648280438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c581f4670 con 0x7f4c580cd940 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.723+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3648280438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c581f4d30 con 0x7f4c580cd940 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.723+0000 7f4c4e7fc640 1 -- 172.21.15.55:0/3648280438 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4c54047460 con 0x7f4c580cd940 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.723+0000 7f4c4e7fc640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3c06b4d0 0x7f4c3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.724+0000 7f4c5d3f5640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3c06b4d0 0x7f4c3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.724+0000 7f4c4e7fc640 1 -- 172.21.15.55:0/3648280438 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4c540aaba0 con 0x7f4c580cd940 2024-04-25T08:54:31.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.724+0000 7f4c5d3f5640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3c06b4d0 0x7f4c3c06d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4c58071010 tx=0x7f4c48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:31.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.728+0000 7f4c4e7fc640 1 -- 172.21.15.55:0/3648280438 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c581f4d30 con 0x7f4c580cd940 2024-04-25T08:54:31.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.979+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3648280438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f4c580750b0 con 0x7f4c580cd940 2024-04-25T08:54:31.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.981+0000 7f4c4e7fc640 1 -- 172.21.15.55:0/3648280438 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4c54032e20 con 0x7f4c580cd940 2024-04-25T08:54:31.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.983+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3648280438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3c06b4d0 msgr2=0x7f4c3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.983+0000 7f4c5fe5a640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3c06b4d0 0x7f4c3c06d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4c58071010 tx=0x7f4c48009040 comp rx=0 tx=0).stop 2024-04-25T08:54:31.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.983+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3648280438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c580cd940 msgr2=0x7f4c5814f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:31.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.983+0000 7f4c5fe5a640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c580cd940 0x7f4c5814f000 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4c54035040 tx=0x7f4c540046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.983+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3648280438 shutdown_connections 2024-04-25T08:54:31.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.983+0000 7f4c5fe5a640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4c3c06b4d0 0x7f4c3c06d990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.983+0000 7f4c5fe5a640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c5815dc50 0x7f4c580c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.983+0000 7f4c5fe5a640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c580cf600 0x7f4c580c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.983+0000 7f4c5fe5a640 1 --2- 172.21.15.55:0/3648280438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c580cd940 0x7f4c5814f000 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:31.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.983+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3648280438 >> 172.21.15.55:0/3648280438 conn(0x7f4c5806f430 msgr2=0x7f4c5806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:31.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.984+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3648280438 shutdown_connections 2024-04-25T08:54:31.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:31.984+0000 7f4c5fe5a640 1 -- 172.21.15.55:0/3648280438 wait complete. 2024-04-25T08:54:31.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T08:54:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.097+0000 7f0b65488640 1 Processor -- start 2024-04-25T08:54:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.097+0000 7f0b65488640 1 -- start start 2024-04-25T08:54:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.098+0000 7f0b65488640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0b60161090 0x7f0b60161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.098+0000 7f0b65488640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b600b9720 0x7f0b600ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.098+0000 7f0b65488640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b60161f80 con 0x7f0b600cece0 2024-04-25T08:54:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.098+0000 7f0b65488640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b600cf130 con 0x7f0b60161090 2024-04-25T08:54:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.098+0000 7f0b65488640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600d21a0 con 0x7f0b600b9720 2024-04-25T08:54:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.098+0000 7f0b5effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0b60161090 0x7f0b60161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.098+0000 7f0b5e7fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b600b9720 0x7f0b600ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.098+0000 7f0b5f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0b600cece0 0x7f0b6006c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:53022/0 (socket says 172.21.15.55:53022) 2024-04-25T08:54:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.098+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/4154164032 learned_addr learned my addr 172.21.15.55:0/4154164032 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.099+0000 7f0b5e7fc640 1 -- 172.21.15.55:0/4154164032 >> v2:172.21.15.167:3300/0 conn(0x7f0b60161090 msgr2=0x7f0b60161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.099+0000 7f0b5e7fc640 1 --2- 172.21.15.55:0/4154164032 >> v2:172.21.15.167:3300/0 conn(0x7f0b60161090 0x7f0b60161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.099+0000 7f0b5e7fc640 1 -- 172.21.15.55:0/4154164032 >> v1:172.21.15.167:6789/0 conn(0x7f0b600cece0 legacy=0x7f0b6006c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.099+0000 7f0b5e7fc640 1 -- 172.21.15.55:0/4154164032 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60162260 con 0x7f0b600b9720 2024-04-25T08:54:32.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.099+0000 7f0b5effd640 1 --2- 172.21.15.55:0/4154164032 >> v2:172.21.15.167:3300/0 conn(0x7f0b60161090 0x7f0b60161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:32.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.099+0000 7f0b5e7fc640 1 --2- 172.21.15.55:0/4154164032 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b600b9720 0x7f0b600ce7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b480097a0 tx=0x7f0b4802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82ee3051bb95fde7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:32.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.100+0000 7f0b5dffb640 1 -- 172.21.15.55:0/4154164032 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48037070 con 0x7f0b600b9720 2024-04-25T08:54:32.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.100+0000 7f0b5dffb640 1 -- 172.21.15.55:0/4154164032 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48032440 con 0x7f0b600b9720 2024-04-25T08:54:32.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.100+0000 7f0b5dffb640 1 -- 172.21.15.55:0/4154164032 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48032810 con 0x7f0b600b9720 2024-04-25T08:54:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.100+0000 7f0b65488640 1 -- 172.21.15.55:0/4154164032 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b600b9720 msgr2=0x7f0b600ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.100+0000 7f0b65488640 1 --2- 172.21.15.55:0/4154164032 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b600b9720 0x7f0b600ce7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b480097a0 tx=0x7f0b4802a180 comp rx=0 tx=0).stop 2024-04-25T08:54:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.100+0000 7f0b65488640 1 -- 172.21.15.55:0/4154164032 shutdown_connections 2024-04-25T08:54:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.100+0000 7f0b65488640 1 --2- 172.21.15.55:0/4154164032 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b600b9720 0x7f0b600ce7a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.100+0000 7f0b65488640 1 --2- 172.21.15.55:0/4154164032 >> v2:172.21.15.167:3300/0 conn(0x7f0b60161090 0x7f0b60161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.100+0000 7f0b65488640 1 -- 172.21.15.55:0/4154164032 >> 172.21.15.55:0/4154164032 conn(0x7f0b600b55e0 msgr2=0x7f0b600b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.100+0000 7f0b65488640 1 -- 172.21.15.55:0/4154164032 shutdown_connections 2024-04-25T08:54:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.100+0000 7f0b65488640 1 -- 172.21.15.55:0/4154164032 wait complete. 2024-04-25T08:54:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.101+0000 7f0b65488640 1 Processor -- start 2024-04-25T08:54:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.102+0000 7f0b65488640 1 -- start start 2024-04-25T08:54:32.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.102+0000 7f0b65488640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b600b9720 0x7f0b6015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.102+0000 7f0b65488640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b600cece0 0x7f0b600b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.102+0000 7f0b65488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b60161090 0x7f0b600b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.102+0000 7f0b65488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60161470 con 0x7f0b60161090 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.102+0000 7f0b65488640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600d1e30 con 0x7f0b600b9720 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.102+0000 7f0b65488640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60161c70 con 0x7f0b600cece0 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.102+0000 7f0b5f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b60161090 0x7f0b600b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.102+0000 7f0b5f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b60161090 0x7f0b600b8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53326/0 (socket says 172.21.15.55:53326) 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/3877358490 learned_addr learned my addr 172.21.15.55:0/3877358490 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b5effd640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b600b9720 0x7f0b6015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b5e7fc640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b600cece0 0x7f0b600b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/3877358490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b600cece0 msgr2=0x7f0b600b7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b5f7fe640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b600cece0 0x7f0b600b7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/3877358490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b600b9720 msgr2=0x7f0b6015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b5f7fe640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b600b9720 0x7f0b6015aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/3877358490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6015db50 con 0x7f0b60161090 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b5f7fe640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b60161090 0x7f0b600b8150 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c420 tx=0x7f0b5800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b577fe640 1 -- 172.21.15.55:0/3877358490 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58017070 con 0x7f0b60161090 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b577fe640 1 -- 172.21.15.55:0/3877358490 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b58005ce0 con 0x7f0b60161090 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b577fe640 1 -- 172.21.15.55:0/3877358490 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580072d0 con 0x7f0b60161090 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b65488640 1 -- 172.21.15.55:0/3877358490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6015de30 con 0x7f0b60161090 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.103+0000 7f0b65488640 1 -- 172.21.15.55:0/3877358490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6015e3f0 con 0x7f0b60161090 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.104+0000 7f0b65488640 1 -- 172.21.15.55:0/3877358490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b600750b0 con 0x7f0b60161090 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.105+0000 7f0b577fe640 1 -- 172.21.15.55:0/3877358490 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b5801a070 con 0x7f0b60161090 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.105+0000 7f0b577fe640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b4006b4d0 0x7f0b4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.105+0000 7f0b577fe640 1 -- 172.21.15.55:0/3877358490 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0b580891d0 con 0x7f0b60161090 2024-04-25T08:54:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.105+0000 7f0b5effd640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b4006b4d0 0x7f0b4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.106+0000 7f0b5effd640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b4006b4d0 0x7f0b4006d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009bd0 tx=0x7f0b5000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:32.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.109+0000 7f0b577fe640 1 -- 172.21.15.55:0/3877358490 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b58057cc0 con 0x7f0b60161090 2024-04-25T08:54:32.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.364+0000 7f0b65488640 1 -- 172.21.15.55:0/3877358490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f0b601603c0 con 0x7f0b60161090 2024-04-25T08:54:32.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.366+0000 7f0b577fe640 1 -- 172.21.15.55:0/3877358490 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0b5805bd60 con 0x7f0b60161090 2024-04-25T08:54:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 -- 172.21.15.55:0/3877358490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b4006b4d0 msgr2=0x7f0b4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b4006b4d0 0x7f0b4006d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009bd0 tx=0x7f0b5000b040 comp rx=0 tx=0).stop 2024-04-25T08:54:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 -- 172.21.15.55:0/3877358490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b60161090 msgr2=0x7f0b600b8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b60161090 0x7f0b600b8150 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c420 tx=0x7f0b5800c8e0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 -- 172.21.15.55:0/3877358490 shutdown_connections 2024-04-25T08:54:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b4006b4d0 0x7f0b4006d990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b60161090 0x7f0b600b8150 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b600cece0 0x7f0b600b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 --2- 172.21.15.55:0/3877358490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b600b9720 0x7f0b6015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 -- 172.21.15.55:0/3877358490 >> 172.21.15.55:0/3877358490 conn(0x7f0b600b55e0 msgr2=0x7f0b600b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:32.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 -- 172.21.15.55:0/3877358490 shutdown_connections 2024-04-25T08:54:32.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.368+0000 7f0b65488640 1 -- 172.21.15.55:0/3877358490 wait complete. 2024-04-25T08:54:32.369 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T08:54:32.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.481+0000 7fbec2330640 1 Processor -- start 2024-04-25T08:54:32.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.481+0000 7fbec2330640 1 -- start start 2024-04-25T08:54:32.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbec2330640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbebc06aba0 0x7fbebc06af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbec2330640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbebc06f980 0x7fbebc06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbec2330640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc070440 con 0x7fbebc0cc8c0 2024-04-25T08:54:32.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbec2330640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbebc15e280 con 0x7fbebc06f980 2024-04-25T08:54:32.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbec2330640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0caed0 con 0x7fbebc06aba0 2024-04-25T08:54:32.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbebb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbebc06f980 0x7fbebc06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbebb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbebc06f980 0x7fbebc06e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53342/0 (socket says 172.21.15.55:53342) 2024-04-25T08:54:32.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbebb7fe640 1 -- 172.21.15.55:0/2155454543 learned_addr learned my addr 172.21.15.55:0/2155454543 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:32.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbebbfff640 1 --2- 172.21.15.55:0/2155454543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbebc06aba0 0x7fbebc06af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbebb7fe640 1 -- 172.21.15.55:0/2155454543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbebc06aba0 msgr2=0x7fbebc06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:32.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbebb7fe640 1 --2- 172.21.15.55:0/2155454543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbebc06aba0 0x7fbebc06af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbebb7fe640 1 -- 172.21.15.55:0/2155454543 >> v1:172.21.15.167:6789/0 conn(0x7fbebc0cc8c0 legacy=0x7fbebc06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.482+0000 7fbebb7fe640 1 -- 172.21.15.55:0/2155454543 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc06b4c0 con 0x7fbebc06f980 2024-04-25T08:54:32.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.483+0000 7fbebb7fe640 1 --2- 172.21.15.55:0/2155454543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbebc06f980 0x7fbebc06e3b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009870 tx=0x7fbeac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15df178f7b8b9611 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:32.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.483+0000 7fbebaffd640 1 -- 172.21.15.55:0/2155454543 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac037070 con 0x7fbebc06f980 2024-04-25T08:54:32.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.483+0000 7fbebaffd640 1 -- 172.21.15.55:0/2155454543 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac032440 con 0x7fbebc06f980 2024-04-25T08:54:32.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.483+0000 7fbebaffd640 1 -- 172.21.15.55:0/2155454543 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac032810 con 0x7fbebc06f980 2024-04-25T08:54:32.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.484+0000 7fbec2330640 1 -- 172.21.15.55:0/2155454543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbebc06f980 msgr2=0x7fbebc06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.484+0000 7fbec2330640 1 --2- 172.21.15.55:0/2155454543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbebc06f980 0x7fbebc06e3b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009870 tx=0x7fbeac02a270 comp rx=0 tx=0).stop 2024-04-25T08:54:32.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.484+0000 7fbec2330640 1 -- 172.21.15.55:0/2155454543 shutdown_connections 2024-04-25T08:54:32.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.484+0000 7fbec2330640 1 --2- 172.21.15.55:0/2155454543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbebc06f980 0x7fbebc06e3b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.484+0000 7fbec2330640 1 --2- 172.21.15.55:0/2155454543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbebc06aba0 0x7fbebc06af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.484+0000 7fbec2330640 1 -- 172.21.15.55:0/2155454543 >> 172.21.15.55:0/2155454543 conn(0x7fbebc0d0750 msgr2=0x7fbebc0d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:32.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.484+0000 7fbec2330640 1 -- 172.21.15.55:0/2155454543 shutdown_connections 2024-04-25T08:54:32.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.484+0000 7fbec2330640 1 -- 172.21.15.55:0/2155454543 wait complete. 2024-04-25T08:54:32.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.485+0000 7fbec2330640 1 Processor -- start 2024-04-25T08:54:32.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.485+0000 7fbec2330640 1 -- start start 2024-04-25T08:54:32.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbec2330640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbebc06aba0 0x7fbebc155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbec2330640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbebc06f980 0x7fbebc0b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbec2330640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbebc0cc8c0 0x7fbebc0b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbec2330640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0cb170 con 0x7fbebc06f980 2024-04-25T08:54:32.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbec2330640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc070160 con 0x7fbebc06aba0 2024-04-25T08:54:32.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbec2330640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc06b950 con 0x7fbebc0cc8c0 2024-04-25T08:54:32.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbebb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbebc06f980 0x7fbebc0b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbebb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbebc06f980 0x7fbebc0b2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53352/0 (socket says 172.21.15.55:53352) 2024-04-25T08:54:32.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbebb7fe640 1 -- 172.21.15.55:0/276176194 learned_addr learned my addr 172.21.15.55:0/276176194 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbebbfff640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbebc06aba0 0x7fbebc155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbec08cd640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbebc0cc8c0 0x7fbebc0b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbebb7fe640 1 -- 172.21.15.55:0/276176194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbebc0cc8c0 msgr2=0x7fbebc0b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbebb7fe640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbebc0cc8c0 0x7fbebc0b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbebb7fe640 1 -- 172.21.15.55:0/276176194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbebc06aba0 msgr2=0x7fbebc155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbebb7fe640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbebc06aba0 0x7fbebc155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbebb7fe640 1 -- 172.21.15.55:0/276176194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0b0640 con 0x7fbebc06f980 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.486+0000 7fbebbfff640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbebc06aba0 0x7fbebc155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.487+0000 7fbebb7fe640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbebc06f980 0x7fbebc0b2e40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbeac000c00 tx=0x7fbeac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.487+0000 7fbeb8ff9640 1 -- 172.21.15.55:0/276176194 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac037040 con 0x7fbebc06f980 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.487+0000 7fbeb8ff9640 1 -- 172.21.15.55:0/276176194 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac042070 con 0x7fbebc06f980 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.487+0000 7fbec2330640 1 -- 172.21.15.55:0/276176194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc0b0920 con 0x7fbebc06f980 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.487+0000 7fbeb8ff9640 1 -- 172.21.15.55:0/276176194 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac030880 con 0x7fbebc06f980 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.487+0000 7fbec2330640 1 -- 172.21.15.55:0/276176194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc0b0ee0 con 0x7fbebc06f980 2024-04-25T08:54:32.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.488+0000 7fbec2330640 1 -- 172.21.15.55:0/276176194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc0750b0 con 0x7fbebc06f980 2024-04-25T08:54:32.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.488+0000 7fbeb8ff9640 1 -- 172.21.15.55:0/276176194 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbeac030a20 con 0x7fbebc06f980 2024-04-25T08:54:32.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.489+0000 7fbeb8ff9640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbea806b4d0 0x7fbea806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.489+0000 7fbeb8ff9640 1 -- 172.21.15.55:0/276176194 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbeac0aa620 con 0x7fbebc06f980 2024-04-25T08:54:32.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.489+0000 7fbebbfff640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbea806b4d0 0x7fbea806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.489+0000 7fbebbfff640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbea806b4d0 0x7fbea806d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0009f30 tx=0x7fbeb0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:32.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.493+0000 7fbeb8ff9640 1 -- 172.21.15.55:0/276176194 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbeac0791a0 con 0x7fbebc06f980 2024-04-25T08:54:32.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.740+0000 7fbec2330640 1 -- 172.21.15.55:0/276176194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fbebc0cf1c0 con 0x7fbebc06f980 2024-04-25T08:54:32.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.747+0000 7fbeb8ff9640 1 -- 172.21.15.55:0/276176194 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbeac07d240 con 0x7fbebc06f980 2024-04-25T08:54:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 -- 172.21.15.55:0/276176194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbea806b4d0 msgr2=0x7fbea806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbea806b4d0 0x7fbea806d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0009f30 tx=0x7fbeb0009190 comp rx=0 tx=0).stop 2024-04-25T08:54:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 -- 172.21.15.55:0/276176194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbebc06f980 msgr2=0x7fbebc0b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbebc06f980 0x7fbebc0b2e40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbeac000c00 tx=0x7fbeac0046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 -- 172.21.15.55:0/276176194 shutdown_connections 2024-04-25T08:54:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbea806b4d0 0x7fbea806d990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbebc0cc8c0 0x7fbebc0b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbebc06f980 0x7fbebc0b2e40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 --2- 172.21.15.55:0/276176194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbebc06aba0 0x7fbebc155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 -- 172.21.15.55:0/276176194 >> 172.21.15.55:0/276176194 conn(0x7fbebc0d0750 msgr2=0x7fbebc0d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 -- 172.21.15.55:0/276176194 shutdown_connections 2024-04-25T08:54:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.749+0000 7fbec2330640 1 -- 172.21.15.55:0/276176194 wait complete. 2024-04-25T08:54:32.750 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:32.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.861+0000 7feb2a717640 1 Processor -- start 2024-04-25T08:54:32.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.861+0000 7feb2a717640 1 -- start start 2024-04-25T08:54:32.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.862+0000 7feb2a717640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb240b5b60 0x7feb241687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.862+0000 7feb2a717640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2415e0c0 con 0x7feb240d35b0 2024-04-25T08:54:32.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.862+0000 7feb2a717640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb240d2510 con 0x7feb2415dce0 2024-04-25T08:54:32.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.862+0000 7feb2a717640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb240b7b10 con 0x7feb240b5b60 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.862+0000 7feb237fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb240d35b0 0x7feb240b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57652/0 (socket says 172.21.15.55:57652) 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.862+0000 7feb237fe640 1 -- 172.21.15.55:0/4223580106 learned_addr learned my addr 172.21.15.55:0/4223580106 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.862+0000 7feb28cb4640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb240b5b60 0x7feb241687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.862+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362716259 0 0) 0x7feb2415e0c0 con 0x7feb240d35b0 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb10003520 con 0x7feb240d35b0 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375563631 0 0) 0x7feb240d2510 con 0x7feb2415dce0 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb2415e0c0 con 0x7feb2415dce0 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1565205483 0 0) 0x7feb10003520 con 0x7feb240d35b0 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb240b5b60 msgr2=0x7feb241687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb240b5b60 0x7feb241687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 >> v1:172.21.15.167:6789/0 conn(0x7feb2415dce0 legacy=0x7feb240d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240d27f0 con 0x7feb240d35b0 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb28cb4640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb240b5b60 0x7feb241687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:32.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7feb14001670 con 0x7feb240d35b0 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 >> v1:172.21.15.55:6789/0 conn(0x7feb240d35b0 legacy=0x7feb240b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb10003b70 0x7feb10003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb240b5b60 0x7feb10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb10004d40 0x7feb100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240b7b10 con 0x7feb10004d40 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1000ba70 con 0x7feb10003b70 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1000bbf0 con 0x7feb240b5b60 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb28cb4640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb10004d40 0x7feb100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb23fff640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb10003b70 0x7feb10003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb237fe640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb240b5b60 0x7feb10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb28cb4640 1 -- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb240b5b60 msgr2=0x7feb10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb28cb4640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb240b5b60 0x7feb10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb28cb4640 1 -- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb10003b70 msgr2=0x7feb10003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb28cb4640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb10003b70 0x7feb10003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.863+0000 7feb28cb4640 1 -- 172.21.15.55:0/4223580106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb10003520 con 0x7feb10004d40 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.864+0000 7feb28cb4640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb10004d40 0x7feb100051c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00e380 tx=0x7feb10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df86070832634e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.864+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c009de0 con 0x7feb10004d40 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.864+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c02e610 con 0x7feb10004d40 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.864+0000 7feb22ffd640 1 -- 172.21.15.55:0/4223580106 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c02e9c0 con 0x7feb10004d40 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.865+0000 7feb2a717640 1 -- 172.21.15.55:0/4223580106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb10004d40 msgr2=0x7feb100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.865+0000 7feb2a717640 1 --2- 172.21.15.55:0/4223580106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb10004d40 0x7feb100051c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00e380 tx=0x7feb10005830 comp rx=0 tx=0).stop 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.865+0000 7feb28cb4640 1 -- 172.21.15.55:0/4223580106 reap_dead start 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.865+0000 7feb2a717640 1 -- 172.21.15.55:0/4223580106 shutdown_connections 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.865+0000 7feb2a717640 1 -- 172.21.15.55:0/4223580106 >> 172.21.15.55:0/4223580106 conn(0x7feb24072900 msgr2=0x7feb240d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.865+0000 7feb2a717640 1 -- 172.21.15.55:0/4223580106 shutdown_connections 2024-04-25T08:54:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.865+0000 7feb2a717640 1 -- 172.21.15.55:0/4223580106 wait complete. 2024-04-25T08:54:32.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.866+0000 7feb2a717640 1 Processor -- start 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.866+0000 7feb2a717640 1 -- start start 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb2a717640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb10004d40 0x7feb241e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb2a717640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb241598e0 0x7feb241e7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb2a717640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb241e7e40 0x7feb240ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb2a717640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240d3090 con 0x7feb241598e0 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb2a717640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240d2db0 con 0x7feb241e7e40 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb2a717640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb240d2160 con 0x7feb10004d40 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb241598e0 0x7feb241e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb241598e0 0x7feb241e7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53364/0 (socket says 172.21.15.55:53364) 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb23fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb10004d40 0x7feb241e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb28cb4640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb241e7e40 0x7feb240ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb237fe640 1 -- 172.21.15.55:0/1023453693 learned_addr learned my addr 172.21.15.55:0/1023453693 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb237fe640 1 -- 172.21.15.55:0/1023453693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb10004d40 msgr2=0x7feb241e60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb237fe640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb10004d40 0x7feb241e60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb237fe640 1 -- 172.21.15.55:0/1023453693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb241e7e40 msgr2=0x7feb240ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb237fe640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb241e7e40 0x7feb240ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.867+0000 7feb237fe640 1 -- 172.21.15.55:0/1023453693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb241e6860 con 0x7feb241598e0 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.868+0000 7feb237fe640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb241598e0 0x7feb241e7900 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7feb14007340 tx=0x7feb14007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.868+0000 7feb20ff9640 1 -- 172.21.15.55:0/1023453693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1400f8e0 con 0x7feb241598e0 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.868+0000 7feb20ff9640 1 -- 172.21.15.55:0/1023453693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14018070 con 0x7feb241598e0 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.868+0000 7feb2a717640 1 -- 172.21.15.55:0/1023453693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb241e6b40 con 0x7feb241598e0 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.868+0000 7feb20ff9640 1 -- 172.21.15.55:0/1023453693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1400fd00 con 0x7feb241598e0 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.868+0000 7feb2a717640 1 -- 172.21.15.55:0/1023453693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb241e7100 con 0x7feb241598e0 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.869+0000 7feb2a717640 1 -- 172.21.15.55:0/1023453693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb240749b0 con 0x7feb241598e0 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.869+0000 7feb20ff9640 1 -- 172.21.15.55:0/1023453693 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feb1401d460 con 0x7feb241598e0 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.870+0000 7feb20ff9640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb0406b4d0 0x7feb0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.870+0000 7feb20ff9640 1 -- 172.21.15.55:0/1023453693 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb14089e50 con 0x7feb241598e0 2024-04-25T08:54:32.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.870+0000 7feb23fff640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb0406b4d0 0x7feb0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:32.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.870+0000 7feb23fff640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb0406b4d0 0x7feb0406d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0018d0 tx=0x7feb0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:32.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:32.874+0000 7feb20ff9640 1 -- 172.21.15.55:0/1023453693 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feb14059020 con 0x7feb241598e0 2024-04-25T08:54:33.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.058+0000 7feb2a717640 1 -- 172.21.15.55:0/1023453693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb240ca140 con 0x7feb241598e0 2024-04-25T08:54:33.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.060+0000 7feb20ff9640 1 -- 172.21.15.55:0/1023453693 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+12891 (secure 0 0 0) 0x7feb14058920 con 0x7feb241598e0 2024-04-25T08:54:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:33.050 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:54:30.061038+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:33.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 -- 172.21.15.55:0/1023453693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb0406b4d0 msgr2=0x7feb0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb0406b4d0 0x7feb0406d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0018d0 tx=0x7feb0c009040 comp rx=0 tx=0).stop 2024-04-25T08:54:33.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 -- 172.21.15.55:0/1023453693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb241598e0 msgr2=0x7feb241e7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb241598e0 0x7feb241e7900 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7feb14007340 tx=0x7feb14007740 comp rx=0 tx=0).stop 2024-04-25T08:54:33.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 -- 172.21.15.55:0/1023453693 shutdown_connections 2024-04-25T08:54:33.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb0406b4d0 0x7feb0406d990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb241e7e40 0x7feb240ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb241598e0 0x7feb241e7900 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 --2- 172.21.15.55:0/1023453693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb10004d40 0x7feb241e60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 -- 172.21.15.55:0/1023453693 >> 172.21.15.55:0/1023453693 conn(0x7feb24072900 msgr2=0x7feb240b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:33.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 -- 172.21.15.55:0/1023453693 shutdown_connections 2024-04-25T08:54:33.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.062+0000 7feb2a717640 1 -- 172.21.15.55:0/1023453693 wait complete. 2024-04-25T08:54:33.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:33.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:33.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.176+0000 7f735a8fc640 1 Processor -- start 2024-04-25T08:54:33.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.176+0000 7f735a8fc640 1 -- start start 2024-04-25T08:54:33.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.177+0000 7f735a8fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f73540d3b90 0x7f73540d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.177+0000 7f735a8fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73540d4090 con 0x7f73540d0f60 2024-04-25T08:54:33.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.177+0000 7f735a8fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73540d4370 con 0x7f735415dca0 2024-04-25T08:54:33.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.177+0000 7f735a8fc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540b6b20 con 0x7f73540d3b90 2024-04-25T08:54:33.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.177+0000 7f7358e99640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f73540d0f60 0x7f73540b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57664/0 (socket says 172.21.15.55:57664) 2024-04-25T08:54:33.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.177+0000 7f7358e99640 1 -- 172.21.15.55:0/1661668560 learned_addr learned my addr 172.21.15.55:0/1661668560 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:33.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862345489 0 0) 0x7f73540d4090 con 0x7f73540d0f60 2024-04-25T08:54:33.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f73537fe640 1 --2- 172.21.15.55:0/1661668560 >> v2:172.21.15.167:3300/0 conn(0x7f73540d3b90 0x7f73540d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f733c003520 con 0x7f73540d0f60 2024-04-25T08:54:33.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3438007740 0 0) 0x7f733c003520 con 0x7f73540d0f60 2024-04-25T08:54:33.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 >> v2:172.21.15.167:3300/0 conn(0x7f73540d3b90 msgr2=0x7f73540d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:33.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 --2- 172.21.15.55:0/1661668560 >> v2:172.21.15.167:3300/0 conn(0x7f73540d3b90 0x7f73540d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 >> v1:172.21.15.167:6789/0 conn(0x7f735415dca0 legacy=0x7f73540ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540d4650 con 0x7f73540d0f60 2024-04-25T08:54:33.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f734c0019f0 con 0x7f73540d0f60 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 >> v1:172.21.15.55:6789/0 conn(0x7f73540d0f60 legacy=0x7f73540b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f733c0039b0 0x7f733c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c004800 0x7f733c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f733c0051c0 0x7f733c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c00c030 con 0x7f733c0051c0 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c00c1e0 con 0x7f733c004800 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c00c3e0 con 0x7f733c0039b0 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7358e99640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f733c0051c0 0x7f733c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f73537fe640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c004800 0x7f733c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7353fff640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f733c0039b0 0x7f733c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7358e99640 1 -- 172.21.15.55:0/1661668560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f733c0039b0 msgr2=0x7f733c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:33.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7358e99640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f733c0039b0 0x7f733c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7358e99640 1 -- 172.21.15.55:0/1661668560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c004800 msgr2=0x7f733c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:33.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7358e99640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c004800 0x7f733c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f7358e99640 1 -- 172.21.15.55:0/1661668560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c003520 con 0x7f733c0051c0 2024-04-25T08:54:33.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.178+0000 7f73537fe640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c004800 0x7f733c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:33.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.179+0000 7f7353fff640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f733c0039b0 0x7f733c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:33.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.179+0000 7f7358e99640 1 -- 172.21.15.55:0/1661668560 reap_dead start 2024-04-25T08:54:33.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.179+0000 7f7358e99640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f733c0051c0 0x7f733c00b9c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f734c00a840 tx=0x7f733c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f171b3eefbbc48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:33.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.179+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c00a460 con 0x7f733c0051c0 2024-04-25T08:54:33.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.179+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c02f070 con 0x7f733c0051c0 2024-04-25T08:54:33.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.179+0000 7f7352ffd640 1 -- 172.21.15.55:0/1661668560 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c02bcb0 con 0x7f733c0051c0 2024-04-25T08:54:33.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.180+0000 7f735a8fc640 1 -- 172.21.15.55:0/1661668560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f733c0051c0 msgr2=0x7f733c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.180+0000 7f735a8fc640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f733c0051c0 0x7f733c00b9c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f734c00a840 tx=0x7f733c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:33.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.180+0000 7f735a8fc640 1 -- 172.21.15.55:0/1661668560 shutdown_connections 2024-04-25T08:54:33.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.180+0000 7f735a8fc640 1 --2- 172.21.15.55:0/1661668560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f733c0051c0 0x7f733c00b9c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.180+0000 7f735a8fc640 1 -- 172.21.15.55:0/1661668560 >> 172.21.15.55:0/1661668560 conn(0x7f73540726c0 msgr2=0x7f7354072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:33.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.180+0000 7f735a8fc640 1 -- 172.21.15.55:0/1661668560 shutdown_connections 2024-04-25T08:54:33.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.180+0000 7f735a8fc640 1 -- 172.21.15.55:0/1661668560 wait complete. 2024-04-25T08:54:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.181+0000 7f735a8fc640 1 Processor -- start 2024-04-25T08:54:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.181+0000 7f735a8fc640 1 -- start start 2024-04-25T08:54:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f735a8fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c0051c0 0x7f73540c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f735a8fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7354153840 0x7f7354153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f735a8fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f735415fed0 0x7f7354160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f735a8fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735415e080 con 0x7f735415fed0 2024-04-25T08:54:33.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f735a8fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73540d1390 con 0x7f733c0051c0 2024-04-25T08:54:33.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f735a8fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735415e200 con 0x7f7354153840 2024-04-25T08:54:33.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f7358e99640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f735415fed0 0x7f7354160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f7358e99640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f735415fed0 0x7f7354160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53384/0 (socket says 172.21.15.55:53384) 2024-04-25T08:54:33.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f7358e99640 1 -- 172.21.15.55:0/1846211037 learned_addr learned my addr 172.21.15.55:0/1846211037 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:33.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f7353fff640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c0051c0 0x7f73540c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f73537fe640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7354153840 0x7f7354153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f7358e99640 1 -- 172.21.15.55:0/1846211037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7354153840 msgr2=0x7f7354153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f7358e99640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7354153840 0x7f7354153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f7358e99640 1 -- 172.21.15.55:0/1846211037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c0051c0 msgr2=0x7f73540c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.182+0000 7f7358e99640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c0051c0 0x7f73540c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.183+0000 7f7358e99640 1 -- 172.21.15.55:0/1846211037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354160c90 con 0x7f735415fed0 2024-04-25T08:54:33.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.183+0000 7f7358e99640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f735415fed0 0x7f7354160350 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f734c00a960 tx=0x7f73540d4260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:33.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.183+0000 7f7350ff9640 1 -- 172.21.15.55:0/1846211037 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c00a460 con 0x7f735415fed0 2024-04-25T08:54:33.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.183+0000 7f7350ff9640 1 -- 172.21.15.55:0/1846211037 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c034670 con 0x7f735415fed0 2024-04-25T08:54:33.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.183+0000 7f735a8fc640 1 -- 172.21.15.55:0/1846211037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73540cb5a0 con 0x7f735415fed0 2024-04-25T08:54:33.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.183+0000 7f7350ff9640 1 -- 172.21.15.55:0/1846211037 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c001fb0 con 0x7f735415fed0 2024-04-25T08:54:33.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.183+0000 7f735a8fc640 1 -- 172.21.15.55:0/1846211037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73540cbb60 con 0x7f735415fed0 2024-04-25T08:54:33.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.184+0000 7f735a8fc640 1 -- 172.21.15.55:0/1846211037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73540750b0 con 0x7f735415fed0 2024-04-25T08:54:33.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.184+0000 7f7350ff9640 1 -- 172.21.15.55:0/1846211037 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f734c034a20 con 0x7f735415fed0 2024-04-25T08:54:33.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.185+0000 7f7350ff9640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f734006b4d0 0x7f734006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.185+0000 7f7350ff9640 1 -- 172.21.15.55:0/1846211037 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f734c0a9c00 con 0x7f735415fed0 2024-04-25T08:54:33.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.185+0000 7f7353fff640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f734006b4d0 0x7f734006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.185+0000 7f7353fff640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f734006b4d0 0x7f734006d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7348000c00 tx=0x7f7348009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:33.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.189+0000 7f7350ff9640 1 -- 172.21.15.55:0/1846211037 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f734c0b0080 con 0x7f735415fed0 2024-04-25T08:54:33.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.369+0000 7f735a8fc640 1 -- 172.21.15.55:0/1846211037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f735415c350 con 0x7f735415fed0 2024-04-25T08:54:33.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.369+0000 7f7350ff9640 1 -- 172.21.15.55:0/1846211037 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f734c046060 con 0x7f735415fed0 2024-04-25T08:54:33.359 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 -- 172.21.15.55:0/1846211037 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f734006b4d0 msgr2=0x7f734006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f734006b4d0 0x7f734006d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7348000c00 tx=0x7f7348009040 comp rx=0 tx=0).stop 2024-04-25T08:54:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 -- 172.21.15.55:0/1846211037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f735415fed0 msgr2=0x7f7354160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f735415fed0 0x7f7354160350 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f734c00a960 tx=0x7f73540d4260 comp rx=0 tx=0).stop 2024-04-25T08:54:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 -- 172.21.15.55:0/1846211037 shutdown_connections 2024-04-25T08:54:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f734006b4d0 0x7f734006d990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f735415fed0 0x7f7354160350 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7354153840 0x7f7354153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 --2- 172.21.15.55:0/1846211037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c0051c0 0x7f73540c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 -- 172.21.15.55:0/1846211037 >> 172.21.15.55:0/1846211037 conn(0x7f73540726c0 msgr2=0x7f73540d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 -- 172.21.15.55:0/1846211037 shutdown_connections 2024-04-25T08:54:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.371+0000 7f735a8fc640 1 -- 172.21.15.55:0/1846211037 wait complete. 2024-04-25T08:54:33.372 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:54:33.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.482+0000 7fc7440a3640 1 Processor -- start 2024-04-25T08:54:33.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.483+0000 7fc7440a3640 1 -- start start 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.483+0000 7fc7440a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc73c071190 0x7fc73c0ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.483+0000 7fc7440a3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc73c0b3730 0x7fc73c15e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.483+0000 7fc7440a3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73c06d550 con 0x7fc73c071570 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.484+0000 7fc7440a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73c0aeee0 con 0x7fc73c071190 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.484+0000 7fc7440a3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c06d830 con 0x7fc73c0b3730 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.484+0000 7fc741e3f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc73c071190 0x7fc73c0ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.484+0000 7fc741e3f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc73c071190 0x7fc73c0ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53388/0 (socket says 172.21.15.55:53388) 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.484+0000 7fc741e3f640 1 -- 172.21.15.55:0/1477971513 learned_addr learned my addr 172.21.15.55:0/1477971513 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.484+0000 7fc741e3f640 1 -- 172.21.15.55:0/1477971513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc73c0b3730 msgr2=0x7fc73c15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.484+0000 7fc741e3f640 1 --2- 172.21.15.55:0/1477971513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc73c0b3730 0x7fc73c15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.484+0000 7fc741e3f640 1 -- 172.21.15.55:0/1477971513 >> v1:172.21.15.167:6789/0 conn(0x7fc73c071570 legacy=0x7fc73c15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.484+0000 7fc741e3f640 1 -- 172.21.15.55:0/1477971513 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c06db10 con 0x7fc73c071190 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.485+0000 7fc741e3f640 1 --2- 172.21.15.55:0/1477971513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc73c071190 0x7fc73c0ae9a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc7380098a0 tx=0x7fc73802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19fcbe95d8d9a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.485+0000 7fc740e3d640 1 -- 172.21.15.55:0/1477971513 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738037070 con 0x7fc73c071190 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.485+0000 7fc740e3d640 1 -- 172.21.15.55:0/1477971513 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc738032440 con 0x7fc73c071190 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.485+0000 7fc740e3d640 1 -- 172.21.15.55:0/1477971513 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738032810 con 0x7fc73c071190 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.485+0000 7fc7440a3640 1 -- 172.21.15.55:0/1477971513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc73c071190 msgr2=0x7fc73c0ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.485+0000 7fc7440a3640 1 --2- 172.21.15.55:0/1477971513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc73c071190 0x7fc73c0ae9a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc7380098a0 tx=0x7fc73802a250 comp rx=0 tx=0).stop 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.485+0000 7fc7440a3640 1 -- 172.21.15.55:0/1477971513 shutdown_connections 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.485+0000 7fc7440a3640 1 --2- 172.21.15.55:0/1477971513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc73c0b3730 0x7fc73c15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.485+0000 7fc7440a3640 1 --2- 172.21.15.55:0/1477971513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc73c071190 0x7fc73c0ae9a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.485+0000 7fc7440a3640 1 -- 172.21.15.55:0/1477971513 >> 172.21.15.55:0/1477971513 conn(0x7fc73c06aba0 msgr2=0x7fc73c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.486+0000 7fc7440a3640 1 -- 172.21.15.55:0/1477971513 shutdown_connections 2024-04-25T08:54:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.486+0000 7fc7440a3640 1 -- 172.21.15.55:0/1477971513 wait complete. 2024-04-25T08:54:33.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.487+0000 7fc7440a3640 1 Processor -- start 2024-04-25T08:54:33.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.487+0000 7fc7440a3640 1 -- start start 2024-04-25T08:54:33.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.487+0000 7fc7440a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc73c071190 0x7fc73c1663e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.487+0000 7fc7440a3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc73c071570 0x7fc73c13eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.487+0000 7fc7440a3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc73c0b3730 0x7fc73c1f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.487+0000 7fc7440a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c071a00 con 0x7fc73c071190 2024-04-25T08:54:33.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.487+0000 7fc7440a3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c06e0d0 con 0x7fc73c0b3730 2024-04-25T08:54:33.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.487+0000 7fc7440a3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c06e8b0 con 0x7fc73c071570 2024-04-25T08:54:33.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.487+0000 7fc741e3f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc73c071190 0x7fc73c1663e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.487+0000 7fc741e3f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc73c071190 0x7fc73c1663e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53396/0 (socket says 172.21.15.55:53396) 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc741e3f640 1 -- 172.21.15.55:0/2069717244 learned_addr learned my addr 172.21.15.55:0/2069717244 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc74163e640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc73c071570 0x7fc73c13eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc742640640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc73c0b3730 0x7fc73c1f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc741e3f640 1 -- 172.21.15.55:0/2069717244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc73c071570 msgr2=0x7fc73c13eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc741e3f640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc73c071570 0x7fc73c13eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc741e3f640 1 -- 172.21.15.55:0/2069717244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc73c0b3730 msgr2=0x7fc73c1f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc741e3f640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc73c0b3730 0x7fc73c1f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc741e3f640 1 -- 172.21.15.55:0/2069717244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c166920 con 0x7fc73c071190 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc74163e640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc73c071570 0x7fc73c13eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc742640640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc73c0b3730 0x7fc73c1f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc741e3f640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc73c071190 0x7fc73c1663e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc7380098a0 tx=0x7fc7380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc7327fc640 1 -- 172.21.15.55:0/2069717244 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738037040 con 0x7fc73c071190 2024-04-25T08:54:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc7327fc640 1 -- 172.21.15.55:0/2069717244 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc738004230 con 0x7fc73c071190 2024-04-25T08:54:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc7440a3640 1 -- 172.21.15.55:0/2069717244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73c14f970 con 0x7fc73c071190 2024-04-25T08:54:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc7327fc640 1 -- 172.21.15.55:0/2069717244 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73803c670 con 0x7fc73c071190 2024-04-25T08:54:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.488+0000 7fc7440a3640 1 -- 172.21.15.55:0/2069717244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73c154f70 con 0x7fc73c071190 2024-04-25T08:54:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.489+0000 7fc7440a3640 1 -- 172.21.15.55:0/2069717244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73c071ee0 con 0x7fc73c071190 2024-04-25T08:54:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.490+0000 7fc7327fc640 1 -- 172.21.15.55:0/2069717244 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc73803a070 con 0x7fc73c071190 2024-04-25T08:54:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.490+0000 7fc7327fc640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc72006b4d0 0x7fc72006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.490+0000 7fc7327fc640 1 -- 172.21.15.55:0/2069717244 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc7380aa750 con 0x7fc73c071190 2024-04-25T08:54:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.490+0000 7fc74163e640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc72006b4d0 0x7fc72006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.491+0000 7fc74163e640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc72006b4d0 0x7fc72006d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc72c007fd0 tx=0x7fc72c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:33.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.494+0000 7fc7327fc640 1 -- 172.21.15.55:0/2069717244 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc73c071ee0 con 0x7fc73c071190 2024-04-25T08:54:33.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.682+0000 7fc7440a3640 1 -- 172.21.15.55:0/2069717244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc73c0749b0 con 0x7fc73c071190 2024-04-25T08:54:33.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.682+0000 7fc7327fc640 1 -- 172.21.15.55:0/2069717244 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc738041020 con 0x7fc73c071190 2024-04-25T08:54:33.672 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:33.672 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T08:54:33.672 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:54:33.672 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-25T08:54:33.672 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-25T08:54:33.673 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:54:33.673 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T08:54:33.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 -- 172.21.15.55:0/2069717244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc72006b4d0 msgr2=0x7fc72006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc72006b4d0 0x7fc72006d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc72c007fd0 tx=0x7fc72c009040 comp rx=0 tx=0).stop 2024-04-25T08:54:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 -- 172.21.15.55:0/2069717244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc73c071190 msgr2=0x7fc73c1663e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc73c071190 0x7fc73c1663e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc7380098a0 tx=0x7fc7380046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 -- 172.21.15.55:0/2069717244 shutdown_connections 2024-04-25T08:54:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc72006b4d0 0x7fc72006d990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc73c0b3730 0x7fc73c1f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc73c071570 0x7fc73c13eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 --2- 172.21.15.55:0/2069717244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc73c071190 0x7fc73c1663e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 -- 172.21.15.55:0/2069717244 >> 172.21.15.55:0/2069717244 conn(0x7fc73c06aba0 msgr2=0x7fc73c15cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 -- 172.21.15.55:0/2069717244 shutdown_connections 2024-04-25T08:54:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.684+0000 7fc7440a3640 1 -- 172.21.15.55:0/2069717244 wait complete. 2024-04-25T08:54:33.685 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:54:33.685 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:54:33.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.800+0000 7f894e57e640 1 Processor -- start 2024-04-25T08:54:33.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.800+0000 7f894e57e640 1 -- start start 2024-04-25T08:54:33.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.801+0000 7f894e57e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89481610b0 0x7f89480b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.801+0000 7f894e57e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f89481618d0 0x7f89480ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.801+0000 7f894e57e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8948162040 con 0x7f89480ced70 2024-04-25T08:54:33.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.801+0000 7f894e57e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480cf1c0 con 0x7f89481610b0 2024-04-25T08:54:33.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.801+0000 7f894e57e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480d1ea0 con 0x7f89481618d0 2024-04-25T08:54:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.801+0000 7f8947fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89481610b0 0x7f89480b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.801+0000 7f8947fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89481610b0 0x7f89480b9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53402/0 (socket says 172.21.15.55:53402) 2024-04-25T08:54:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.801+0000 7f8947fff640 1 -- 172.21.15.55:0/2904972653 learned_addr learned my addr 172.21.15.55:0/2904972653 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.801+0000 7f8947fff640 1 -- 172.21.15.55:0/2904972653 >> v2:172.21.15.167:3300/0 conn(0x7f89481618d0 msgr2=0x7f89480ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.801+0000 7f8947fff640 1 --2- 172.21.15.55:0/2904972653 >> v2:172.21.15.167:3300/0 conn(0x7f89481618d0 0x7f89480ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.801+0000 7f8947fff640 1 -- 172.21.15.55:0/2904972653 >> v1:172.21.15.167:6789/0 conn(0x7f89480ced70 legacy=0x7f894806c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.802+0000 7f8947fff640 1 -- 172.21.15.55:0/2904972653 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8948162320 con 0x7f89481610b0 2024-04-25T08:54:33.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.802+0000 7f8947fff640 1 --2- 172.21.15.55:0/2904972653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89481610b0 0x7f89480b9580 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f894806d320 tx=0x7f893c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72db425b6657bf02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:33.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.802+0000 7f8946ffd640 1 -- 172.21.15.55:0/2904972653 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c037070 con 0x7f89481610b0 2024-04-25T08:54:33.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.802+0000 7f8946ffd640 1 -- 172.21.15.55:0/2904972653 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c032440 con 0x7f89481610b0 2024-04-25T08:54:33.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.802+0000 7f8946ffd640 1 -- 172.21.15.55:0/2904972653 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c032810 con 0x7f89481610b0 2024-04-25T08:54:33.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.803+0000 7f894e57e640 1 -- 172.21.15.55:0/2904972653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89481610b0 msgr2=0x7f89480b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.803+0000 7f894e57e640 1 --2- 172.21.15.55:0/2904972653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89481610b0 0x7f89480b9580 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f894806d320 tx=0x7f893c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.803+0000 7f894e57e640 1 -- 172.21.15.55:0/2904972653 shutdown_connections 2024-04-25T08:54:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.803+0000 7f894e57e640 1 --2- 172.21.15.55:0/2904972653 >> v2:172.21.15.167:3300/0 conn(0x7f89481618d0 0x7f89480ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.803+0000 7f894e57e640 1 --2- 172.21.15.55:0/2904972653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89481610b0 0x7f89480b9580 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.803+0000 7f894e57e640 1 -- 172.21.15.55:0/2904972653 >> 172.21.15.55:0/2904972653 conn(0x7f89480b5570 msgr2=0x7f89480b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.803+0000 7f894e57e640 1 -- 172.21.15.55:0/2904972653 shutdown_connections 2024-04-25T08:54:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.803+0000 7f894e57e640 1 -- 172.21.15.55:0/2904972653 wait complete. 2024-04-25T08:54:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.804+0000 7f894e57e640 1 Processor -- start 2024-04-25T08:54:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.804+0000 7f894e57e640 1 -- start start 2024-04-25T08:54:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894e57e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89480ced70 0x7f8948144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894e57e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89481610b0 0x7f894815f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894e57e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89481618d0 0x7f8948142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894e57e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89480b6c00 con 0x7f89481618d0 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894e57e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89480d20f0 con 0x7f89481610b0 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894e57e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8948161d10 con 0x7f89480ced70 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894cb1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89481618d0 0x7f8948142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894cb1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89481618d0 0x7f8948142fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53418/0 (socket says 172.21.15.55:53418) 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894cb1b640 1 -- 172.21.15.55:0/2654870614 learned_addr learned my addr 172.21.15.55:0/2654870614 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f8947fff640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89480ced70 0x7f8948144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f89477fe640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89481610b0 0x7f894815f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894cb1b640 1 -- 172.21.15.55:0/2654870614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89480ced70 msgr2=0x7f8948144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894cb1b640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89480ced70 0x7f8948144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894cb1b640 1 -- 172.21.15.55:0/2654870614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89481610b0 msgr2=0x7f894815f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.805+0000 7f894cb1b640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89481610b0 0x7f894815f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.806+0000 7f894cb1b640 1 -- 172.21.15.55:0/2654870614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89481438f0 con 0x7f89481618d0 2024-04-25T08:54:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.806+0000 7f8947fff640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89480ced70 0x7f8948144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.806+0000 7f894cb1b640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89481618d0 0x7f8948142fa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f894000c7b0 tx=0x7f894000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.806+0000 7f8944ff9640 1 -- 172.21.15.55:0/2654870614 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8940017070 con 0x7f89481618d0 2024-04-25T08:54:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.806+0000 7f8944ff9640 1 -- 172.21.15.55:0/2654870614 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8940003da0 con 0x7f89481618d0 2024-04-25T08:54:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.806+0000 7f8944ff9640 1 -- 172.21.15.55:0/2654870614 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89400052b0 con 0x7f89481618d0 2024-04-25T08:54:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.806+0000 7f894e57e640 1 -- 172.21.15.55:0/2654870614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8948143bd0 con 0x7f89481618d0 2024-04-25T08:54:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.806+0000 7f894e57e640 1 -- 172.21.15.55:0/2654870614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8948144190 con 0x7f89481618d0 2024-04-25T08:54:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.807+0000 7f894e57e640 1 -- 172.21.15.55:0/2654870614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89480750b0 con 0x7f89481618d0 2024-04-25T08:54:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.807+0000 7f8944ff9640 1 -- 172.21.15.55:0/2654870614 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f894001a070 con 0x7f89481618d0 2024-04-25T08:54:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.808+0000 7f8944ff9640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f893406b4d0 0x7f893406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.808+0000 7f8944ff9640 1 -- 172.21.15.55:0/2654870614 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8940089580 con 0x7f89481618d0 2024-04-25T08:54:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.808+0000 7f8947fff640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f893406b4d0 0x7f893406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.808+0000 7f8947fff640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f893406b4d0 0x7f893406d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f893c034000 tx=0x7f893c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:33.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.812+0000 7f8944ff9640 1 -- 172.21.15.55:0/2654870614 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f89400586b0 con 0x7f89481618d0 2024-04-25T08:54:33.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:33.992+0000 7f894e57e640 1 -- 172.21.15.55:0/2654870614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f89480d1770 con 0x7f89481618d0 2024-04-25T08:54:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.373+0000 7f8944ff9640 1 -- 172.21.15.55:0/2654870614 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8940057fb0 con 0x7f89481618d0 2024-04-25T08:54:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-25T08:54:34.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.376+0000 7f894e57e640 1 -- 172.21.15.55:0/2654870614 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f893406b4d0 msgr2=0x7f893406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:34.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.376+0000 7f894e57e640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f893406b4d0 0x7f893406d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f893c034000 tx=0x7f893c02e000 comp rx=0 tx=0).stop 2024-04-25T08:54:34.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.376+0000 7f894e57e640 1 -- 172.21.15.55:0/2654870614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89481618d0 msgr2=0x7f8948142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:34.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.376+0000 7f894e57e640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89481618d0 0x7f8948142fa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f894000c7b0 tx=0x7f894000cc70 comp rx=0 tx=0).stop 2024-04-25T08:54:34.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.377+0000 7f894e57e640 1 -- 172.21.15.55:0/2654870614 shutdown_connections 2024-04-25T08:54:34.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.377+0000 7f894e57e640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f893406b4d0 0x7f893406d990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:34.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.377+0000 7f894e57e640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89481618d0 0x7f8948142fa0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:34.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.377+0000 7f894e57e640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89481610b0 0x7f894815f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:34.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.377+0000 7f894e57e640 1 --2- 172.21.15.55:0/2654870614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89480ced70 0x7f8948144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:34.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.377+0000 7f894e57e640 1 -- 172.21.15.55:0/2654870614 >> 172.21.15.55:0/2654870614 conn(0x7f89480b5570 msgr2=0x7f89480b9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:34.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.377+0000 7f894e57e640 1 -- 172.21.15.55:0/2654870614 shutdown_connections 2024-04-25T08:54:34.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.377+0000 7f894e57e640 1 -- 172.21.15.55:0/2654870614 wait complete. 2024-04-25T08:54:34.383 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:54:34.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.504+0000 7f2cf2238640 1 Processor -- start 2024-04-25T08:54:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.504+0000 7f2cf2238640 1 -- start start 2024-04-25T08:54:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.505+0000 7f2cf2238640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cec15de70 0x7f2cec0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.505+0000 7f2cf2238640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2cec0d1eb0 0x7f2cec0cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.505+0000 7f2cf2238640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec0cc860 con 0x7f2cec06d620 2024-04-25T08:54:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.505+0000 7f2cf2238640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec0ccb40 con 0x7f2cec15de70 2024-04-25T08:54:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.505+0000 7f2cf2238640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec0cce20 con 0x7f2cec0d1eb0 2024-04-25T08:54:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.505+0000 7f2ceb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cec15de70 0x7f2cec0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.505+0000 7f2ceb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cec15de70 0x7f2cec0cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53434/0 (socket says 172.21.15.55:53434) 2024-04-25T08:54:34.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.505+0000 7f2ceb7fe640 1 -- 172.21.15.55:0/3036003692 learned_addr learned my addr 172.21.15.55:0/3036003692 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:34.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.505+0000 7f2cebfff640 1 --2- 172.21.15.55:0/3036003692 >> v2:172.21.15.167:3300/0 conn(0x7f2cec0d1eb0 0x7f2cec0cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:34.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.505+0000 7f2ceb7fe640 1 -- 172.21.15.55:0/3036003692 >> v2:172.21.15.167:3300/0 conn(0x7f2cec0d1eb0 msgr2=0x7f2cec0cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:34.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.506+0000 7f2ceb7fe640 1 --2- 172.21.15.55:0/3036003692 >> v2:172.21.15.167:3300/0 conn(0x7f2cec0d1eb0 0x7f2cec0cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:34.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.506+0000 7f2ceb7fe640 1 -- 172.21.15.55:0/3036003692 >> v1:172.21.15.167:6789/0 conn(0x7f2cec06d620 legacy=0x7f2cec0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:34.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.506+0000 7f2ceb7fe640 1 -- 172.21.15.55:0/3036003692 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec0cd100 con 0x7f2cec15de70 2024-04-25T08:54:34.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.506+0000 7f2cebfff640 1 --2- 172.21.15.55:0/3036003692 >> v2:172.21.15.167:3300/0 conn(0x7f2cec0d1eb0 0x7f2cec0cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.506+0000 7f2ceb7fe640 1 --2- 172.21.15.55:0/3036003692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec15de70 0x7f2cec0cbf10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009870 tx=0x7f2cdc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6842eca86276e5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.506+0000 7f2cea7fc640 1 -- 172.21.15.55:0/3036003692 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc037070 con 0x7f2cec15de70 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.506+0000 7f2cea7fc640 1 -- 172.21.15.55:0/3036003692 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc032640 con 0x7f2cec15de70 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.507+0000 7f2cea7fc640 1 -- 172.21.15.55:0/3036003692 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc032a10 con 0x7f2cec15de70 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.507+0000 7f2cf2238640 1 -- 172.21.15.55:0/3036003692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec15de70 msgr2=0x7f2cec0cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.507+0000 7f2cf2238640 1 --2- 172.21.15.55:0/3036003692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec15de70 0x7f2cec0cbf10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009870 tx=0x7f2cdc02a300 comp rx=0 tx=0).stop 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.507+0000 7f2cf2238640 1 -- 172.21.15.55:0/3036003692 shutdown_connections 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.507+0000 7f2cf2238640 1 --2- 172.21.15.55:0/3036003692 >> v2:172.21.15.167:3300/0 conn(0x7f2cec0d1eb0 0x7f2cec0cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.507+0000 7f2cf2238640 1 --2- 172.21.15.55:0/3036003692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec15de70 0x7f2cec0cbf10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.507+0000 7f2cf2238640 1 -- 172.21.15.55:0/3036003692 >> 172.21.15.55:0/3036003692 conn(0x7f2cec0b33e0 msgr2=0x7f2cec0b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.507+0000 7f2cf2238640 1 -- 172.21.15.55:0/3036003692 shutdown_connections 2024-04-25T08:54:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.507+0000 7f2cf2238640 1 -- 172.21.15.55:0/3036003692 wait complete. 2024-04-25T08:54:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.508+0000 7f2cf2238640 1 Processor -- start 2024-04-25T08:54:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.508+0000 7f2cf2238640 1 -- start start 2024-04-25T08:54:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.509+0000 7f2cf2238640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06d620 0x7f2cec14cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.509+0000 7f2cf2238640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec0d1eb0 0x7f2cec158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.509+0000 7f2cf2238640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cec15de70 0x7f2cec15c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.509+0000 7f2cf2238640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0cc5d0 con 0x7f2cec06d620 2024-04-25T08:54:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.509+0000 7f2cf2238640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0cc450 con 0x7f2cec0d1eb0 2024-04-25T08:54:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.509+0000 7f2cf2238640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0cde40 con 0x7f2cec15de70 2024-04-25T08:54:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.509+0000 7f2ceb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06d620 0x7f2cec14cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.509+0000 7f2ceb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06d620 0x7f2cec14cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53444/0 (socket says 172.21.15.55:53444) 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.509+0000 7f2ceb7fe640 1 -- 172.21.15.55:0/741608760 learned_addr learned my addr 172.21.15.55:0/741608760 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.509+0000 7f2cebfff640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cec15de70 0x7f2cec15c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2ceaffd640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec0d1eb0 0x7f2cec158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2ceb7fe640 1 -- 172.21.15.55:0/741608760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cec15de70 msgr2=0x7f2cec15c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2ceb7fe640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cec15de70 0x7f2cec15c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2ceb7fe640 1 -- 172.21.15.55:0/741608760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec0d1eb0 msgr2=0x7f2cec158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2ceb7fe640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec0d1eb0 0x7f2cec158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2ceb7fe640 1 -- 172.21.15.55:0/741608760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec157ad0 con 0x7f2cec06d620 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2cebfff640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cec15de70 0x7f2cec15c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2ceaffd640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec0d1eb0 0x7f2cec158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2ceb7fe640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06d620 0x7f2cec14cfe0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009870 tx=0x7f2cdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2cd3fff640 1 -- 172.21.15.55:0/741608760 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc037040 con 0x7f2cec06d620 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2cd3fff640 1 -- 172.21.15.55:0/741608760 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc004230 con 0x7f2cec06d620 2024-04-25T08:54:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2cf2238640 1 -- 172.21.15.55:0/741608760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec157db0 con 0x7f2cec06d620 2024-04-25T08:54:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2cd3fff640 1 -- 172.21.15.55:0/741608760 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc030770 con 0x7f2cec06d620 2024-04-25T08:54:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.510+0000 7f2cf2238640 1 -- 172.21.15.55:0/741608760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec158370 con 0x7f2cec06d620 2024-04-25T08:54:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.511+0000 7f2cf2238640 1 -- 172.21.15.55:0/741608760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec06de40 con 0x7f2cec06d620 2024-04-25T08:54:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.512+0000 7f2cd3fff640 1 -- 172.21.15.55:0/741608760 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2cdc032500 con 0x7f2cec06d620 2024-04-25T08:54:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.512+0000 7f2cd3fff640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cd806b4d0 0x7f2cd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.512+0000 7f2cd3fff640 1 -- 172.21.15.55:0/741608760 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2cdc0aaeb0 con 0x7f2cec06d620 2024-04-25T08:54:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.512+0000 7f2ceaffd640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cd806b4d0 0x7f2cd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.513+0000 7f2ceaffd640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cd806b4d0 0x7f2cd806d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0cbe10 tx=0x7f2ce0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:34.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.517+0000 7f2cd3fff640 1 -- 172.21.15.55:0/741608760 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2cdc07a0c0 con 0x7f2cec06d620 2024-04-25T08:54:34.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:34.699+0000 7f2cf2238640 1 -- 172.21.15.55:0/741608760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2cec0749b0 con 0x7f2cec06d620 2024-04-25T08:54:35.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.379+0000 7f2cd3fff640 1 -- 172.21.15.55:0/741608760 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2cdc0799c0 con 0x7f2cec06d620 2024-04-25T08:54:35.369 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-25T08:54:35.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 -- 172.21.15.55:0/741608760 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cd806b4d0 msgr2=0x7f2cd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:35.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cd806b4d0 0x7f2cd806d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0cbe10 tx=0x7f2ce0009040 comp rx=0 tx=0).stop 2024-04-25T08:54:35.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 -- 172.21.15.55:0/741608760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06d620 msgr2=0x7f2cec14cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:35.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06d620 0x7f2cec14cfe0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009870 tx=0x7f2cdc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:35.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 -- 172.21.15.55:0/741608760 shutdown_connections 2024-04-25T08:54:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2cd806b4d0 0x7f2cd806d990 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cec15de70 0x7f2cec15c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec0d1eb0 0x7f2cec158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 --2- 172.21.15.55:0/741608760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06d620 0x7f2cec14cfe0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 -- 172.21.15.55:0/741608760 >> 172.21.15.55:0/741608760 conn(0x7f2cec0b33e0 msgr2=0x7f2cec06f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 -- 172.21.15.55:0/741608760 shutdown_connections 2024-04-25T08:54:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.382+0000 7f2cf2238640 1 -- 172.21.15.55:0/741608760 wait complete. 2024-04-25T08:54:35.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:54:35.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.515+0000 7f2ea2838640 1 Processor -- start 2024-04-25T08:54:35.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.515+0000 7f2ea2838640 1 -- start start 2024-04-25T08:54:35.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2ea2838640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2e9c0d3b90 0x7f2e9c0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:35.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2ea2838640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e9c0d0f60 0x7f2e9c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:35.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2ea2838640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c0d4090 con 0x7f2e9c15dca0 2024-04-25T08:54:35.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2ea2838640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0b6b20 con 0x7f2e9c0d0f60 2024-04-25T08:54:35.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2ea2838640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0d1390 con 0x7f2e9c0d3b90 2024-04-25T08:54:35.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2ea0dd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e9c0d0f60 0x7f2e9c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2e9bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2e9c15dca0 0x7f2e9c0ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57666/0 (socket says 172.21.15.55:57666) 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2e9bfff640 1 -- 172.21.15.55:0/3679672866 learned_addr learned my addr 172.21.15.55:0/3679672866 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2e9b7fe640 1 --2- 172.21.15.55:0/3679672866 >> v2:172.21.15.167:3300/0 conn(0x7f2e9c0d3b90 0x7f2e9c0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2ea0dd5640 1 -- 172.21.15.55:0/3679672866 >> v2:172.21.15.167:3300/0 conn(0x7f2e9c0d3b90 msgr2=0x7f2e9c0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2ea0dd5640 1 --2- 172.21.15.55:0/3679672866 >> v2:172.21.15.167:3300/0 conn(0x7f2e9c0d3b90 0x7f2e9c0d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2ea0dd5640 1 -- 172.21.15.55:0/3679672866 >> v1:172.21.15.55:6789/0 conn(0x7f2e9c15dca0 legacy=0x7f2e9c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2ea0dd5640 1 -- 172.21.15.55:0/3679672866 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0d4370 con 0x7f2e9c0d0f60 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.516+0000 7f2e9affd640 1 -- 172.21.15.55:0/3679672866 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114076202 0 0) 0x7f2e9c0d4090 con 0x7f2e9c15dca0 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.517+0000 7f2ea0dd5640 1 --2- 172.21.15.55:0/3679672866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e9c0d0f60 0x7f2e9c0b2500 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0b6560 tx=0x7f2e9402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bf12f031efb209 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.517+0000 7f2e9affd640 1 -- 172.21.15.55:0/3679672866 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94007740 con 0x7f2e9c0d0f60 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.517+0000 7f2e9affd640 1 -- 172.21.15.55:0/3679672866 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e940078e0 con 0x7f2e9c0d0f60 2024-04-25T08:54:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.517+0000 7f2e9affd640 1 -- 172.21.15.55:0/3679672866 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94007cb0 con 0x7f2e9c0d0f60 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.518+0000 7f2ea2838640 1 -- 172.21.15.55:0/3679672866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e9c0d0f60 msgr2=0x7f2e9c0b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.518+0000 7f2ea2838640 1 --2- 172.21.15.55:0/3679672866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e9c0d0f60 0x7f2e9c0b2500 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0b6560 tx=0x7f2e9402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.518+0000 7f2ea2838640 1 -- 172.21.15.55:0/3679672866 shutdown_connections 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.518+0000 7f2ea2838640 1 --2- 172.21.15.55:0/3679672866 >> v2:172.21.15.167:3300/0 conn(0x7f2e9c0d3b90 0x7f2e9c0d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.518+0000 7f2ea2838640 1 --2- 172.21.15.55:0/3679672866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e9c0d0f60 0x7f2e9c0b2500 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.518+0000 7f2ea2838640 1 -- 172.21.15.55:0/3679672866 >> 172.21.15.55:0/3679672866 conn(0x7f2e9c0726c0 msgr2=0x7f2e9c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.518+0000 7f2ea2838640 1 -- 172.21.15.55:0/3679672866 shutdown_connections 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.518+0000 7f2ea2838640 1 -- 172.21.15.55:0/3679672866 wait complete. 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.519+0000 7f2ea2838640 1 Processor -- start 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.519+0000 7f2ea2838640 1 -- start start 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea2838640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e9c0d0f60 0x7f2e9c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea2838640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e9c0d3b90 0x7f2e9c1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea2838640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e9c15dca0 0x7f2e9c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:35.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea2838640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0cf050 con 0x7f2e9c15dca0 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea2838640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0b6d50 con 0x7f2e9c0d3b90 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea2838640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c15e080 con 0x7f2e9c0d0f60 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea0dd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e9c15dca0 0x7f2e9c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea0dd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e9c15dca0 0x7f2e9c159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53464/0 (socket says 172.21.15.55:53464) 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea0dd5640 1 -- 172.21.15.55:0/471233848 learned_addr learned my addr 172.21.15.55:0/471233848 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2e9b7fe640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e9c0d3b90 0x7f2e9c1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2e9bfff640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e9c0d0f60 0x7f2e9c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea0dd5640 1 -- 172.21.15.55:0/471233848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e9c0d0f60 msgr2=0x7f2e9c157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea0dd5640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e9c0d0f60 0x7f2e9c157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea0dd5640 1 -- 172.21.15.55:0/471233848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e9c0d3b90 msgr2=0x7f2e9c1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea0dd5640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e9c0d3b90 0x7f2e9c1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.520+0000 7f2ea0dd5640 1 -- 172.21.15.55:0/471233848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c161220 con 0x7f2e9c15dca0 2024-04-25T08:54:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.521+0000 7f2ea0dd5640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e9c15dca0 0x7f2e9c159f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009d90 tx=0x7f2e94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.521+0000 7f2e98ff9640 1 -- 172.21.15.55:0/471233848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94040070 con 0x7f2e9c15dca0 2024-04-25T08:54:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.521+0000 7f2e98ff9640 1 -- 172.21.15.55:0/471233848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e94031bc0 con 0x7f2e9c15dca0 2024-04-25T08:54:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.521+0000 7f2ea2838640 1 -- 172.21.15.55:0/471233848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c15f070 con 0x7f2e9c15dca0 2024-04-25T08:54:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.521+0000 7f2e98ff9640 1 -- 172.21.15.55:0/471233848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9403c420 con 0x7f2e9c15dca0 2024-04-25T08:54:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.521+0000 7f2ea2838640 1 -- 172.21.15.55:0/471233848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c15f630 con 0x7f2e9c15dca0 2024-04-25T08:54:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.522+0000 7f2ea2838640 1 -- 172.21.15.55:0/471233848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c0750b0 con 0x7f2e9c15dca0 2024-04-25T08:54:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.523+0000 7f2e98ff9640 1 -- 172.21.15.55:0/471233848 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e94039040 con 0x7f2e9c15dca0 2024-04-25T08:54:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.523+0000 7f2e98ff9640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e8806b4d0 0x7f2e8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.523+0000 7f2e98ff9640 1 -- 172.21.15.55:0/471233848 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2e940ab4b0 con 0x7f2e9c15dca0 2024-04-25T08:54:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.523+0000 7f2e9bfff640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e8806b4d0 0x7f2e8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.523+0000 7f2e9bfff640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e8806b4d0 0x7f2e8806d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2e90007fd0 tx=0x7f2e90007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:35.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.528+0000 7f2e98ff9640 1 -- 172.21.15.55:0/471233848 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e94079dd0 con 0x7f2e9c15dca0 2024-04-25T08:54:35.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:35.750+0000 7f2ea2838640 1 -- 172.21.15.55:0/471233848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2e9c0b51e0 con 0x7f2e9c15dca0 2024-04-25T08:54:36.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.381+0000 7f2e98ff9640 1 -- 172.21.15.55:0/471233848 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2e9407de70 con 0x7f2e9c15dca0 2024-04-25T08:54:36.371 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 4 and data pool 5 2024-04-25T08:54:36.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.384+0000 7f2ea2838640 1 -- 172.21.15.55:0/471233848 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e8806b4d0 msgr2=0x7f2e8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.384+0000 7f2ea2838640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e8806b4d0 0x7f2e8806d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2e90007fd0 tx=0x7f2e90007de0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.384+0000 7f2ea2838640 1 -- 172.21.15.55:0/471233848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e9c15dca0 msgr2=0x7f2e9c159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.384+0000 7f2ea2838640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e9c15dca0 0x7f2e9c159f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009d90 tx=0x7f2e94004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.384+0000 7f2ea2838640 1 -- 172.21.15.55:0/471233848 shutdown_connections 2024-04-25T08:54:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.384+0000 7f2ea2838640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e8806b4d0 0x7f2e8806d990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.384+0000 7f2ea2838640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e9c15dca0 0x7f2e9c159f20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.384+0000 7f2ea2838640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e9c0d3b90 0x7f2e9c1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.384+0000 7f2ea2838640 1 --2- 172.21.15.55:0/471233848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e9c0d0f60 0x7f2e9c157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.384+0000 7f2ea2838640 1 -- 172.21.15.55:0/471233848 >> 172.21.15.55:0/471233848 conn(0x7f2e9c0726c0 msgr2=0x7f2e9c0ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.384+0000 7f2ea2838640 1 -- 172.21.15.55:0/471233848 shutdown_connections 2024-04-25T08:54:36.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.385+0000 7f2ea2838640 1 -- 172.21.15.55:0/471233848 wait complete. 2024-04-25T08:54:36.403 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:36.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.522+0000 7f41a0b7e640 1 Processor -- start 2024-04-25T08:54:36.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.522+0000 7f41a0b7e640 1 -- start start 2024-04-25T08:54:36.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f41a0b7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f419c0cd060 0x7f419c06e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f41a0b7e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f419c06d690 0x7f419c06edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f41a0b7e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419c0719f0 con 0x7f419c1476d0 2024-04-25T08:54:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f41a0b7e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c071cd0 con 0x7f419c0cd060 2024-04-25T08:54:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f41a0b7e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c071fb0 con 0x7f419c06d690 2024-04-25T08:54:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f4193fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f419c0cd060 0x7f419c06e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f4193fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f419c0cd060 0x7f419c06e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53468/0 (socket says 172.21.15.55:53468) 2024-04-25T08:54:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f4193fff640 1 -- 172.21.15.55:0/1477724542 learned_addr learned my addr 172.21.15.55:0/1477724542 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f419ad9d640 1 --2- 172.21.15.55:0/1477724542 >> v2:172.21.15.167:3300/0 conn(0x7f419c06d690 0x7f419c06edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f4193fff640 1 -- 172.21.15.55:0/1477724542 >> v2:172.21.15.167:3300/0 conn(0x7f419c06d690 msgr2=0x7f419c06edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f4193fff640 1 --2- 172.21.15.55:0/1477724542 >> v2:172.21.15.167:3300/0 conn(0x7f419c06d690 0x7f419c06edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f4193fff640 1 -- 172.21.15.55:0/1477724542 >> v1:172.21.15.167:6789/0 conn(0x7f419c1476d0 legacy=0x7f419c0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f4193fff640 1 -- 172.21.15.55:0/1477724542 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c072290 con 0x7f419c0cd060 2024-04-25T08:54:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.523+0000 7f419ad9d640 1 --2- 172.21.15.55:0/1477724542 >> v2:172.21.15.167:3300/0 conn(0x7f419c06d690 0x7f419c06edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.524+0000 7f4193fff640 1 --2- 172.21.15.55:0/1477724542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419c0cd060 0x7f419c06e8b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f419c0cbbc0 tx=0x7f418402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b19ffe8a37c28f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:36.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.524+0000 7f4199d9b640 1 -- 172.21.15.55:0/1477724542 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184037070 con 0x7f419c0cd060 2024-04-25T08:54:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.524+0000 7f4199d9b640 1 -- 172.21.15.55:0/1477724542 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418402ae50 con 0x7f419c0cd060 2024-04-25T08:54:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.524+0000 7f4199d9b640 1 -- 172.21.15.55:0/1477724542 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184032860 con 0x7f419c0cd060 2024-04-25T08:54:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.525+0000 7f41a0b7e640 1 -- 172.21.15.55:0/1477724542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419c0cd060 msgr2=0x7f419c06e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.525+0000 7f41a0b7e640 1 --2- 172.21.15.55:0/1477724542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419c0cd060 0x7f419c06e8b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f419c0cbbc0 tx=0x7f418402a300 comp rx=0 tx=0).stop 2024-04-25T08:54:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.525+0000 7f41a0b7e640 1 -- 172.21.15.55:0/1477724542 shutdown_connections 2024-04-25T08:54:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.525+0000 7f41a0b7e640 1 --2- 172.21.15.55:0/1477724542 >> v2:172.21.15.167:3300/0 conn(0x7f419c06d690 0x7f419c06edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.525+0000 7f41a0b7e640 1 --2- 172.21.15.55:0/1477724542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419c0cd060 0x7f419c06e8b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.525+0000 7f41a0b7e640 1 -- 172.21.15.55:0/1477724542 >> 172.21.15.55:0/1477724542 conn(0x7f419c0cc540 msgr2=0x7f419c0cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:36.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.525+0000 7f41a0b7e640 1 -- 172.21.15.55:0/1477724542 shutdown_connections 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.525+0000 7f41a0b7e640 1 -- 172.21.15.55:0/1477724542 wait complete. 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.526+0000 7f41a0b7e640 1 Processor -- start 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.526+0000 7f41a0b7e640 1 -- start start 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f41a0b7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f419c06d690 0x7f419c141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f41a0b7e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f419c0cd060 0x7f419c140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f41a0b7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419c1476d0 0x7f419c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f41a0b7e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0c93e0 con 0x7f419c1476d0 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f41a0b7e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0c9260 con 0x7f419c06d690 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f41a0b7e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0c9560 con 0x7f419c0cd060 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f419ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419c1476d0 0x7f419c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f419ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419c1476d0 0x7f419c15a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53476/0 (socket says 172.21.15.55:53476) 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f419ad9d640 1 -- 172.21.15.55:0/4093091949 learned_addr learned my addr 172.21.15.55:0/4093091949 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f419a59c640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f419c06d690 0x7f419c141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f4193fff640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f419c0cd060 0x7f419c140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f419ad9d640 1 -- 172.21.15.55:0/4093091949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f419c0cd060 msgr2=0x7f419c140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f419ad9d640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f419c0cd060 0x7f419c140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f419ad9d640 1 -- 172.21.15.55:0/4093091949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f419c06d690 msgr2=0x7f419c141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f419ad9d640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f419c06d690 0x7f419c141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.527+0000 7f419ad9d640 1 -- 172.21.15.55:0/4093091949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c1416f0 con 0x7f419c1476d0 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.528+0000 7f419ad9d640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419c1476d0 0x7f419c15a250 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4194007ef0 tx=0x7f419400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.528+0000 7f4192ffd640 1 -- 172.21.15.55:0/4093091949 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419401a070 con 0x7f419c1476d0 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.528+0000 7f4192ffd640 1 -- 172.21.15.55:0/4093091949 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4194003b90 con 0x7f419c1476d0 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.528+0000 7f41a0b7e640 1 -- 172.21.15.55:0/4093091949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419c140b70 con 0x7f419c1476d0 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.528+0000 7f4192ffd640 1 -- 172.21.15.55:0/4093091949 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4194004030 con 0x7f419c1476d0 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.528+0000 7f41a0b7e640 1 -- 172.21.15.55:0/4093091949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c141410 con 0x7f419c1476d0 2024-04-25T08:54:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.529+0000 7f41a0b7e640 1 -- 172.21.15.55:0/4093091949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c06ba30 con 0x7f419c1476d0 2024-04-25T08:54:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.529+0000 7f4192ffd640 1 -- 172.21.15.55:0/4093091949 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f419401d070 con 0x7f419c1476d0 2024-04-25T08:54:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.530+0000 7f4192ffd640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f417c06b4d0 0x7f417c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.530+0000 7f4192ffd640 1 -- 172.21.15.55:0/4093091949 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f419408a510 con 0x7f419c1476d0 2024-04-25T08:54:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.530+0000 7f419a59c640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f417c06b4d0 0x7f417c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.530+0000 7f419a59c640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f417c06b4d0 0x7f417c06d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f418c0016e0 tx=0x7f418c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:36.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.534+0000 7f4192ffd640 1 -- 172.21.15.55:0/4093091949 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f419c06ba30 con 0x7f419c1476d0 2024-04-25T08:54:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.715+0000 7f41a0b7e640 1 -- 172.21.15.55:0/4093091949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f419c0749b0 con 0x7f419c1476d0 2024-04-25T08:54:36.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.717+0000 7f4192ffd640 1 -- 172.21.15.55:0/4093091949 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16682 (secure 0 0 0) 0x7f4194010070 con 0x7f419c1476d0 2024-04-25T08:54:36.707 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:36.707 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:54:35.751834+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:54:34.023960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:54:34.730867+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:36.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 -- 172.21.15.55:0/4093091949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f417c06b4d0 msgr2=0x7f417c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:36.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f417c06b4d0 0x7f417c06d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f418c0016e0 tx=0x7f418c009040 comp rx=0 tx=0).stop 2024-04-25T08:54:36.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 -- 172.21.15.55:0/4093091949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419c1476d0 msgr2=0x7f419c15a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:36.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419c1476d0 0x7f419c15a250 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4194007ef0 tx=0x7f419400d4a0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 -- 172.21.15.55:0/4093091949 shutdown_connections 2024-04-25T08:54:36.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f417c06b4d0 0x7f417c06d990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419c1476d0 0x7f419c15a250 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f419c0cd060 0x7f419c140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 --2- 172.21.15.55:0/4093091949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f419c06d690 0x7f419c141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 -- 172.21.15.55:0/4093091949 >> 172.21.15.55:0/4093091949 conn(0x7f419c0cc540 msgr2=0x7f419c0ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:36.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 -- 172.21.15.55:0/4093091949 shutdown_connections 2024-04-25T08:54:36.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.719+0000 7f41a0b7e640 1 -- 172.21.15.55:0/4093091949 wait complete. 2024-04-25T08:54:36.720 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:36.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.831+0000 7f5d6bcc4640 1 Processor -- start 2024-04-25T08:54:36.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.832+0000 7f5d6bcc4640 1 -- start start 2024-04-25T08:54:36.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.832+0000 7f5d6bcc4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d6415dce0 0x7f5d640d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.832+0000 7f5d6bcc4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640d35b0 0x7f5d640b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.832+0000 7f5d6bcc4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d640d1f90 0x7f5d640b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.832+0000 7f5d6bcc4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6415e0c0 con 0x7f5d640d1f90 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.832+0000 7f5d6bcc4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d640d2510 con 0x7f5d6415dce0 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.832+0000 7f5d6bcc4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640d27f0 con 0x7f5d640d35b0 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.833+0000 7f5d6a261640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d640d1f90 0x7f5d640b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.833+0000 7f5d6a261640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d640d1f90 0x7f5d640b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53478/0 (socket says 172.21.15.55:53478) 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.833+0000 7f5d6a261640 1 -- 172.21.15.55:0/343761618 learned_addr learned my addr 172.21.15.55:0/343761618 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.833+0000 7f5d69a60640 1 --2- 172.21.15.55:0/343761618 >> v2:172.21.15.167:3300/0 conn(0x7f5d6415dce0 0x7f5d640d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.833+0000 7f5d6925f640 1 --2- 172.21.15.55:0/343761618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640d35b0 0x7f5d640b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.833+0000 7f5d6a261640 1 -- 172.21.15.55:0/343761618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640d35b0 msgr2=0x7f5d640b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:36.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.833+0000 7f5d6a261640 1 --2- 172.21.15.55:0/343761618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640d35b0 0x7f5d640b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.833+0000 7f5d6a261640 1 -- 172.21.15.55:0/343761618 >> v2:172.21.15.167:3300/0 conn(0x7f5d6415dce0 msgr2=0x7f5d640d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:36.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.833+0000 7f5d6a261640 1 --2- 172.21.15.55:0/343761618 >> v2:172.21.15.167:3300/0 conn(0x7f5d6415dce0 0x7f5d640d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.833+0000 7f5d6a261640 1 -- 172.21.15.55:0/343761618 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d640d2ad0 con 0x7f5d640d1f90 2024-04-25T08:54:36.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d6a261640 1 --2- 172.21.15.55:0/343761618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d640d1f90 0x7f5d640b5990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5d640ce220 tx=0x7f5d5402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6259b1abd3d9cb33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:36.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d68a5e640 1 -- 172.21.15.55:0/343761618 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d54036070 con 0x7f5d640d1f90 2024-04-25T08:54:36.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d68a5e640 1 -- 172.21.15.55:0/343761618 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d54031600 con 0x7f5d640d1f90 2024-04-25T08:54:36.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d68a5e640 1 -- 172.21.15.55:0/343761618 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d540319d0 con 0x7f5d640d1f90 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/343761618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d640d1f90 msgr2=0x7f5d640b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d6bcc4640 1 --2- 172.21.15.55:0/343761618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d640d1f90 0x7f5d640b5990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5d640ce220 tx=0x7f5d5402a610 comp rx=0 tx=0).stop 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/343761618 shutdown_connections 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d6bcc4640 1 --2- 172.21.15.55:0/343761618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d640d1f90 0x7f5d640b5990 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d6bcc4640 1 --2- 172.21.15.55:0/343761618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640d35b0 0x7f5d640b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d6bcc4640 1 --2- 172.21.15.55:0/343761618 >> v2:172.21.15.167:3300/0 conn(0x7f5d6415dce0 0x7f5d640d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/343761618 >> 172.21.15.55:0/343761618 conn(0x7f5d64072900 msgr2=0x7f5d640d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/343761618 shutdown_connections 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.834+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/343761618 wait complete. 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.836+0000 7f5d6bcc4640 1 Processor -- start 2024-04-25T08:54:36.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.836+0000 7f5d6bcc4640 1 -- start start 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.836+0000 7f5d6bcc4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640d1f90 0x7f5d64156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.836+0000 7f5d6bcc4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d640d35b0 0x7f5d640c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.836+0000 7f5d6bcc4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6415dce0 0x7f5d6415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.836+0000 7f5d6bcc4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640b9820 con 0x7f5d6415dce0 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.836+0000 7f5d6bcc4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640d3090 con 0x7f5d640d35b0 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.836+0000 7f5d6bcc4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640b99a0 con 0x7f5d640d1f90 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.836+0000 7f5d6a261640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6415dce0 0x7f5d6415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.836+0000 7f5d6a261640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6415dce0 0x7f5d6415fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53488/0 (socket says 172.21.15.55:53488) 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.836+0000 7f5d6a261640 1 -- 172.21.15.55:0/1799459620 learned_addr learned my addr 172.21.15.55:0/1799459620 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d6925f640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d640d35b0 0x7f5d640c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d69a60640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640d1f90 0x7f5d64156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d6a261640 1 -- 172.21.15.55:0/1799459620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640d1f90 msgr2=0x7f5d64156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d6a261640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640d1f90 0x7f5d64156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d6a261640 1 -- 172.21.15.55:0/1799459620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d640d35b0 msgr2=0x7f5d640c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:36.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d6a261640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d640d35b0 0x7f5d640c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:36.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d6a261640 1 -- 172.21.15.55:0/1799459620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6415ed80 con 0x7f5d6415dce0 2024-04-25T08:54:36.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d6a261640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6415dce0 0x7f5d6415fe20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009f40 tx=0x7f5d54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:36.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d627fc640 1 -- 172.21.15.55:0/1799459620 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d54036050 con 0x7f5d6415dce0 2024-04-25T08:54:36.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d627fc640 1 -- 172.21.15.55:0/1799459620 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d54042070 con 0x7f5d6415dce0 2024-04-25T08:54:36.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d627fc640 1 -- 172.21.15.55:0/1799459620 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d54009510 con 0x7f5d6415dce0 2024-04-25T08:54:36.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/1799459620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6415f060 con 0x7f5d6415dce0 2024-04-25T08:54:36.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.837+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/1799459620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6415f620 con 0x7f5d6415dce0 2024-04-25T08:54:36.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.838+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/1799459620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d640749b0 con 0x7f5d6415dce0 2024-04-25T08:54:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.838+0000 7f5d627fc640 1 -- 172.21.15.55:0/1799459620 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d54007bd0 con 0x7f5d6415dce0 2024-04-25T08:54:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.839+0000 7f5d627fc640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d5006b4d0 0x7f5d5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.839+0000 7f5d627fc640 1 -- 172.21.15.55:0/1799459620 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d540ab110 con 0x7f5d6415dce0 2024-04-25T08:54:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.839+0000 7f5d69a60640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d5006b4d0 0x7f5d5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.839+0000 7f5d69a60640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d5006b4d0 0x7f5d5006d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00a970 tx=0x7f5d5c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:36.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:36.843+0000 7f5d627fc640 1 -- 172.21.15.55:0/1799459620 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d5407a020 con 0x7f5d6415dce0 2024-04-25T08:54:37.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.031+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/1799459620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d6406cb90 con 0x7f5d6415dce0 2024-04-25T08:54:37.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.032+0000 7f5d627fc640 1 -- 172.21.15.55:0/1799459620 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16682 (secure 0 0 0) 0x7f5d54079920 con 0x7f5d6415dce0 2024-04-25T08:54:37.022 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:37.023 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:54:35.751834+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:54:34.023960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:54:34.730867+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:37.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/1799459620 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d5006b4d0 msgr2=0x7f5d5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d5006b4d0 0x7f5d5006d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00a970 tx=0x7f5d5c008040 comp rx=0 tx=0).stop 2024-04-25T08:54:37.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/1799459620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6415dce0 msgr2=0x7f5d6415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6415dce0 0x7f5d6415fe20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009f40 tx=0x7f5d54004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/1799459620 shutdown_connections 2024-04-25T08:54:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d5006b4d0 0x7f5d5006d990 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6415dce0 0x7f5d6415fe20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d640d35b0 0x7f5d640c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 --2- 172.21.15.55:0/1799459620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640d1f90 0x7f5d64156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/1799459620 >> 172.21.15.55:0/1799459620 conn(0x7f5d64072900 msgr2=0x7f5d640b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/1799459620 shutdown_connections 2024-04-25T08:54:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.034+0000 7f5d6bcc4640 1 -- 172.21.15.55:0/1799459620 wait complete. 2024-04-25T08:54:37.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:54:37.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.149+0000 7eff93322640 1 Processor -- start 2024-04-25T08:54:37.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.149+0000 7eff93322640 1 -- start start 2024-04-25T08:54:37.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.150+0000 7eff93322640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff8c0d3b90 0x7eff8c0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:37.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.150+0000 7eff93322640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff8c0d0f60 0x7eff8c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:37.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.150+0000 7eff93322640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c0d4090 con 0x7eff8c15dca0 2024-04-25T08:54:37.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.150+0000 7eff93322640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c0b6b20 con 0x7eff8c0d0f60 2024-04-25T08:54:37.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.150+0000 7eff93322640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c0d4370 con 0x7eff8c0d3b90 2024-04-25T08:54:37.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.150+0000 7eff908bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff8c0d3b90 0x7eff8c0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:37.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.150+0000 7eff918bf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff8c0d0f60 0x7eff8c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:37.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.150+0000 7eff910be640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7eff8c15dca0 0x7eff8c0ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:53096/0 (socket says 172.21.15.55:53096) 2024-04-25T08:54:37.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.150+0000 7eff910be640 1 -- 172.21.15.55:0/1742389943 learned_addr learned my addr 172.21.15.55:0/1742389943 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:37.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.151+0000 7eff918bf640 1 -- 172.21.15.55:0/1742389943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff8c0d3b90 msgr2=0x7eff8c0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:37.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.151+0000 7eff918bf640 1 --2- 172.21.15.55:0/1742389943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff8c0d3b90 0x7eff8c0d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.151+0000 7eff918bf640 1 -- 172.21.15.55:0/1742389943 >> v1:172.21.15.167:6789/0 conn(0x7eff8c15dca0 legacy=0x7eff8c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.151+0000 7eff918bf640 1 -- 172.21.15.55:0/1742389943 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0d4650 con 0x7eff8c0d0f60 2024-04-25T08:54:37.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.151+0000 7eff908bd640 1 --2- 172.21.15.55:0/1742389943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff8c0d3b90 0x7eff8c0d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:37.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.151+0000 7eff918bf640 1 --2- 172.21.15.55:0/1742389943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c0d0f60 0x7eff8c0b2500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009d90 tx=0x7eff7c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e60104250170b1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:37.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.152+0000 7eff8bfff640 1 -- 172.21.15.55:0/1742389943 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c007740 con 0x7eff8c0d0f60 2024-04-25T08:54:37.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.152+0000 7eff8bfff640 1 -- 172.21.15.55:0/1742389943 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c0078e0 con 0x7eff8c0d0f60 2024-04-25T08:54:37.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.152+0000 7eff8bfff640 1 -- 172.21.15.55:0/1742389943 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c007cb0 con 0x7eff8c0d0f60 2024-04-25T08:54:37.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.152+0000 7eff93322640 1 -- 172.21.15.55:0/1742389943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c0d0f60 msgr2=0x7eff8c0b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.152+0000 7eff93322640 1 --2- 172.21.15.55:0/1742389943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c0d0f60 0x7eff8c0b2500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009d90 tx=0x7eff7c02a660 comp rx=0 tx=0).stop 2024-04-25T08:54:37.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.152+0000 7eff93322640 1 -- 172.21.15.55:0/1742389943 shutdown_connections 2024-04-25T08:54:37.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.152+0000 7eff93322640 1 --2- 172.21.15.55:0/1742389943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c0d0f60 0x7eff8c0b2500 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.152+0000 7eff93322640 1 --2- 172.21.15.55:0/1742389943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff8c0d3b90 0x7eff8c0d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.152+0000 7eff93322640 1 -- 172.21.15.55:0/1742389943 >> 172.21.15.55:0/1742389943 conn(0x7eff8c0726c0 msgr2=0x7eff8c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:37.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.152+0000 7eff93322640 1 -- 172.21.15.55:0/1742389943 shutdown_connections 2024-04-25T08:54:37.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.152+0000 7eff93322640 1 -- 172.21.15.55:0/1742389943 wait complete. 2024-04-25T08:54:37.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.153+0000 7eff93322640 1 Processor -- start 2024-04-25T08:54:37.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.153+0000 7eff93322640 1 -- start start 2024-04-25T08:54:37.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.154+0000 7eff93322640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8c0d0f60 0x7eff8c0ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:37.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.154+0000 7eff93322640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c0d3b90 0x7eff8c160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:37.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.154+0000 7eff93322640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff8c15dca0 0x7eff8c159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.154+0000 7eff93322640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c15e080 con 0x7eff8c0d0f60 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.154+0000 7eff93322640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c0cf050 con 0x7eff8c0d3b90 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.154+0000 7eff93322640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c15e200 con 0x7eff8c15dca0 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.154+0000 7eff910be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8c0d0f60 0x7eff8c0ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.154+0000 7eff910be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8c0d0f60 0x7eff8c0ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53500/0 (socket says 172.21.15.55:53500) 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.154+0000 7eff910be640 1 -- 172.21.15.55:0/1581124884 learned_addr learned my addr 172.21.15.55:0/1581124884 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.154+0000 7eff908bd640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c0d3b90 0x7eff8c160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.154+0000 7eff918bf640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff8c15dca0 0x7eff8c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.155+0000 7eff910be640 1 -- 172.21.15.55:0/1581124884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff8c15dca0 msgr2=0x7eff8c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.155+0000 7eff910be640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff8c15dca0 0x7eff8c159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.155+0000 7eff910be640 1 -- 172.21.15.55:0/1581124884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c0d3b90 msgr2=0x7eff8c160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.155+0000 7eff910be640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c0d3b90 0x7eff8c160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.155+0000 7eff910be640 1 -- 172.21.15.55:0/1581124884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c15fd50 con 0x7eff8c0d0f60 2024-04-25T08:54:37.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.155+0000 7eff910be640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8c0d0f60 0x7eff8c0ca1c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7eff8400c3c0 tx=0x7eff8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:37.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.155+0000 7eff89ffb640 1 -- 172.21.15.55:0/1581124884 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84017070 con 0x7eff8c0d0f60 2024-04-25T08:54:37.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.155+0000 7eff89ffb640 1 -- 172.21.15.55:0/1581124884 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff84005ce0 con 0x7eff8c0d0f60 2024-04-25T08:54:37.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.155+0000 7eff93322640 1 -- 172.21.15.55:0/1581124884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c161110 con 0x7eff8c0d0f60 2024-04-25T08:54:37.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.155+0000 7eff89ffb640 1 -- 172.21.15.55:0/1581124884 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff840072f0 con 0x7eff8c0d0f60 2024-04-25T08:54:37.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.155+0000 7eff93322640 1 -- 172.21.15.55:0/1581124884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c15f270 con 0x7eff8c0d0f60 2024-04-25T08:54:37.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.156+0000 7eff93322640 1 -- 172.21.15.55:0/1581124884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8c0750b0 con 0x7eff8c0d0f60 2024-04-25T08:54:37.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.156+0000 7eff89ffb640 1 -- 172.21.15.55:0/1581124884 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff8401a070 con 0x7eff8c0d0f60 2024-04-25T08:54:37.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.157+0000 7eff89ffb640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff7806b4d0 0x7eff7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:37.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.157+0000 7eff89ffb640 1 -- 172.21.15.55:0/1581124884 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff84089510 con 0x7eff8c0d0f60 2024-04-25T08:54:37.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.157+0000 7eff908bd640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff7806b4d0 0x7eff7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:37.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.157+0000 7eff908bd640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff7806b4d0 0x7eff7806d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff80009560 tx=0x7eff80008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:37.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.161+0000 7eff89ffb640 1 -- 172.21.15.55:0/1581124884 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff84058420 con 0x7eff8c0d0f60 2024-04-25T08:54:37.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.383+0000 7eff93322640 1 -- 172.21.15.55:0/1581124884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7eff8c0cdb90 con 0x7eff8c0d0f60 2024-04-25T08:54:37.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.400+0000 7eff89ffb640 1 -- 172.21.15.55:0/1581124884 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7eff84057d20 con 0x7eff8c0d0f60 2024-04-25T08:54:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.402+0000 7eff93322640 1 -- 172.21.15.55:0/1581124884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff7806b4d0 msgr2=0x7eff7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.402+0000 7eff93322640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff7806b4d0 0x7eff7806d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff80009560 tx=0x7eff80008040 comp rx=0 tx=0).stop 2024-04-25T08:54:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.403+0000 7eff93322640 1 -- 172.21.15.55:0/1581124884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8c0d0f60 msgr2=0x7eff8c0ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.403+0000 7eff93322640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8c0d0f60 0x7eff8c0ca1c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7eff8400c3c0 tx=0x7eff8400c880 comp rx=0 tx=0).stop 2024-04-25T08:54:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.403+0000 7eff93322640 1 -- 172.21.15.55:0/1581124884 shutdown_connections 2024-04-25T08:54:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.403+0000 7eff93322640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7eff7806b4d0 0x7eff7806d990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.403+0000 7eff93322640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff8c15dca0 0x7eff8c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.403+0000 7eff93322640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c0d3b90 0x7eff8c160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.403+0000 7eff93322640 1 --2- 172.21.15.55:0/1581124884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8c0d0f60 0x7eff8c0ca1c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.403+0000 7eff93322640 1 -- 172.21.15.55:0/1581124884 >> 172.21.15.55:0/1581124884 conn(0x7eff8c0726c0 msgr2=0x7eff8c0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:37.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.403+0000 7eff93322640 1 -- 172.21.15.55:0/1581124884 shutdown_connections 2024-04-25T08:54:37.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.403+0000 7eff93322640 1 -- 172.21.15.55:0/1581124884 wait complete. 2024-04-25T08:54:37.403 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:54:37.403 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:54:37.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.517+0000 7fa4a5530640 1 Processor -- start 2024-04-25T08:54:37.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.518+0000 7fa4a5530640 1 -- start start 2024-04-25T08:54:37.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.518+0000 7fa4a5530640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4a015dca0 0x7fa4a00ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:37.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.518+0000 7fa4a5530640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a00d4090 con 0x7fa4a00d3b90 2024-04-25T08:54:37.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.518+0000 7fa4a5530640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a00d4370 con 0x7fa4a00d1130 2024-04-25T08:54:37.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.518+0000 7fa4a5530640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00b6b20 con 0x7fa4a015dca0 2024-04-25T08:54:37.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.519+0000 7fa49effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4a015dca0 0x7fa4a00ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:37.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.519+0000 7fa49e7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa4a00d3b90 0x7fa4a00d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57678/0 (socket says 172.21.15.55:57678) 2024-04-25T08:54:37.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.519+0000 7fa49e7fc640 1 -- 172.21.15.55:0/585480646 learned_addr learned my addr 172.21.15.55:0/585480646 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:37.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.519+0000 7fa49effd640 1 -- 172.21.15.55:0/585480646 >> v1:172.21.15.167:6789/0 conn(0x7fa4a00d1130 legacy=0x7fa4a00b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:37.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.519+0000 7fa49effd640 1 -- 172.21.15.55:0/585480646 >> v1:172.21.15.55:6789/0 conn(0x7fa4a00d3b90 legacy=0x7fa4a00d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.519+0000 7fa49effd640 1 -- 172.21.15.55:0/585480646 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a00d4650 con 0x7fa4a015dca0 2024-04-25T08:54:37.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.519+0000 7fa49effd640 1 --2- 172.21.15.55:0/585480646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4a015dca0 0x7fa4a00ce940 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa4980097a0 tx=0x7fa49802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b414032dcb6c3b34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:37.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.520+0000 7fa49dffb640 1 -- 172.21.15.55:0/585480646 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498037070 con 0x7fa4a015dca0 2024-04-25T08:54:37.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.520+0000 7fa49dffb640 1 -- 172.21.15.55:0/585480646 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa498032440 con 0x7fa4a015dca0 2024-04-25T08:54:37.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.520+0000 7fa49dffb640 1 -- 172.21.15.55:0/585480646 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498032810 con 0x7fa4a015dca0 2024-04-25T08:54:37.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.520+0000 7fa4a5530640 1 -- 172.21.15.55:0/585480646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4a015dca0 msgr2=0x7fa4a00ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.520+0000 7fa4a5530640 1 --2- 172.21.15.55:0/585480646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4a015dca0 0x7fa4a00ce940 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa4980097a0 tx=0x7fa49802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.520+0000 7fa4a5530640 1 -- 172.21.15.55:0/585480646 shutdown_connections 2024-04-25T08:54:37.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.520+0000 7fa4a5530640 1 --2- 172.21.15.55:0/585480646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4a015dca0 0x7fa4a00ce940 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.520+0000 7fa4a5530640 1 -- 172.21.15.55:0/585480646 >> 172.21.15.55:0/585480646 conn(0x7fa4a00726c0 msgr2=0x7fa4a0072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:37.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.520+0000 7fa4a5530640 1 -- 172.21.15.55:0/585480646 shutdown_connections 2024-04-25T08:54:37.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.520+0000 7fa4a5530640 1 -- 172.21.15.55:0/585480646 wait complete. 2024-04-25T08:54:37.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.522+0000 7fa4a5530640 1 Processor -- start 2024-04-25T08:54:37.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.522+0000 7fa4a5530640 1 -- start start 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.522+0000 7fa4a5530640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4a00d1130 0x7fa4a01578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.522+0000 7fa4a5530640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4a00d3b90 0x7fa4a00cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.522+0000 7fa4a5530640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4a015dca0 0x7fa4a00cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.522+0000 7fa4a5530640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a015e200 con 0x7fa4a00d1130 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.522+0000 7fa4a5530640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a015e080 con 0x7fa4a015dca0 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.522+0000 7fa4a5530640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00cee80 con 0x7fa4a00d3b90 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4a00d1130 0x7fa4a01578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4a00d1130 0x7fa4a01578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53516/0 (socket says 172.21.15.55:53516) 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49effd640 1 -- 172.21.15.55:0/2871007406 learned_addr learned my addr 172.21.15.55:0/2871007406 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49e7fc640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4a00d3b90 0x7fa4a00cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49f7fe640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4a015dca0 0x7fa4a00cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:37.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49effd640 1 -- 172.21.15.55:0/2871007406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4a00d3b90 msgr2=0x7fa4a00cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49effd640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4a00d3b90 0x7fa4a00cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49effd640 1 -- 172.21.15.55:0/2871007406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4a015dca0 msgr2=0x7fa4a00cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:37.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49effd640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4a015dca0 0x7fa4a00cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:37.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49effd640 1 -- 172.21.15.55:0/2871007406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a00cae90 con 0x7fa4a00d1130 2024-04-25T08:54:37.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49e7fc640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4a00d3b90 0x7fa4a00cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:37.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa49effd640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4a00d1130 0x7fa4a01578f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa498000c00 tx=0x7fa4980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:37.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa4877fe640 1 -- 172.21.15.55:0/2871007406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498041070 con 0x7fa4a00d1130 2024-04-25T08:54:37.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa4877fe640 1 -- 172.21.15.55:0/2871007406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49803c930 con 0x7fa4a00d1130 2024-04-25T08:54:37.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa4877fe640 1 -- 172.21.15.55:0/2871007406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498037040 con 0x7fa4a00d1130 2024-04-25T08:54:37.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa4a5530640 1 -- 172.21.15.55:0/2871007406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a00c8870 con 0x7fa4a00d1130 2024-04-25T08:54:37.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.523+0000 7fa4a5530640 1 -- 172.21.15.55:0/2871007406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a00c7ab0 con 0x7fa4a00d1130 2024-04-25T08:54:37.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.524+0000 7fa4a5530640 1 -- 172.21.15.55:0/2871007406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a00750b0 con 0x7fa4a00d1130 2024-04-25T08:54:37.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.525+0000 7fa4877fe640 1 -- 172.21.15.55:0/2871007406 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa498044070 con 0x7fa4a00d1130 2024-04-25T08:54:37.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.525+0000 7fa4877fe640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa48c06b4d0 0x7fa48c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:37.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.525+0000 7fa4877fe640 1 -- 172.21.15.55:0/2871007406 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4980ab000 con 0x7fa4a00d1130 2024-04-25T08:54:37.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.525+0000 7fa49e7fc640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa48c06b4d0 0x7fa48c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:37.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.526+0000 7fa49e7fc640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa48c06b4d0 0x7fa48c06d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00ca770 tx=0x7fa494009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:37.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.529+0000 7fa4877fe640 1 -- 172.21.15.55:0/2871007406 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa4a00cae90 con 0x7fa4a00d1130 2024-04-25T08:54:37.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:37.748+0000 7fa4a5530640 1 -- 172.21.15.55:0/2871007406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa4a00d29d0 con 0x7fa4a00d1130 2024-04-25T08:54:38.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.408+0000 7fa4877fe640 1 -- 172.21.15.55:0/2871007406 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa498079950 con 0x7fa4a00d1130 2024-04-25T08:54:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.410+0000 7fa4a5530640 1 -- 172.21.15.55:0/2871007406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa48c06b4d0 msgr2=0x7fa48c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.411+0000 7fa4a5530640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa48c06b4d0 0x7fa48c06d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00ca770 tx=0x7fa494009040 comp rx=0 tx=0).stop 2024-04-25T08:54:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.411+0000 7fa4a5530640 1 -- 172.21.15.55:0/2871007406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4a00d1130 msgr2=0x7fa4a01578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.411+0000 7fa4a5530640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4a00d1130 0x7fa4a01578f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa498000c00 tx=0x7fa4980046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.411+0000 7fa4a5530640 1 -- 172.21.15.55:0/2871007406 shutdown_connections 2024-04-25T08:54:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.411+0000 7fa4a5530640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa48c06b4d0 0x7fa48c06d990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.411+0000 7fa4a5530640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4a015dca0 0x7fa4a00cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.411+0000 7fa4a5530640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4a00d3b90 0x7fa4a00cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.411+0000 7fa4a5530640 1 --2- 172.21.15.55:0/2871007406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4a00d1130 0x7fa4a01578f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.411+0000 7fa4a5530640 1 -- 172.21.15.55:0/2871007406 >> 172.21.15.55:0/2871007406 conn(0x7fa4a00726c0 msgr2=0x7fa4a00ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.411+0000 7fa4a5530640 1 -- 172.21.15.55:0/2871007406 shutdown_connections 2024-04-25T08:54:38.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.411+0000 7fa4a5530640 1 -- 172.21.15.55:0/2871007406 wait complete. 2024-04-25T08:54:38.413 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:54:38.414 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:54:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.531+0000 7f98b23f4640 1 Processor -- start 2024-04-25T08:54:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.531+0000 7f98b23f4640 1 -- start start 2024-04-25T08:54:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.532+0000 7f98b23f4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f98ac15dd50 0x7f98ac0d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.532+0000 7f98b23f4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98ac0b9460 0x7f98ac0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.532+0000 7f98b23f4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac0d2440 con 0x7f98ac0d34e0 2024-04-25T08:54:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.532+0000 7f98b23f4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0d2720 con 0x7f98ac15dd50 2024-04-25T08:54:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.532+0000 7f98b23f4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0d2a00 con 0x7f98ac0b9460 2024-04-25T08:54:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.533+0000 7f98ab7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98ac0b9460 0x7f98ac0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.533+0000 7f98abfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f98ac15dd50 0x7f98ac0d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.533+0000 7f98b0991640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f98ac0d34e0 0x7f98ac0b5550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:53114/0 (socket says 172.21.15.55:53114) 2024-04-25T08:54:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.533+0000 7f98abfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f98ac15dd50 0x7f98ac0d1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:48776/0 (socket says 172.21.15.55:48776) 2024-04-25T08:54:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.533+0000 7f98abfff640 1 -- 172.21.15.55:0/2833280825 learned_addr learned my addr 172.21.15.55:0/2833280825 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:38.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.533+0000 7f98abfff640 1 -- 172.21.15.55:0/2833280825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98ac0b9460 msgr2=0x7f98ac0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:38.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.533+0000 7f98abfff640 1 --2- 172.21.15.55:0/2833280825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98ac0b9460 0x7f98ac0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.533+0000 7f98abfff640 1 -- 172.21.15.55:0/2833280825 >> v1:172.21.15.167:6789/0 conn(0x7f98ac0d34e0 legacy=0x7f98ac0b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.533+0000 7f98abfff640 1 -- 172.21.15.55:0/2833280825 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0d2ce0 con 0x7f98ac15dd50 2024-04-25T08:54:38.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.533+0000 7f98ab7fe640 1 --2- 172.21.15.55:0/2833280825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98ac0b9460 0x7f98ac0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:38.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.534+0000 7f98abfff640 1 --2- 172.21.15.55:0/2833280825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98ac15dd50 0x7f98ac0d1c10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f989c009870 tx=0x7f989c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11c90aa1048dc96f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:38.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.534+0000 7f98aaffd640 1 -- 172.21.15.55:0/2833280825 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c037070 con 0x7f98ac15dd50 2024-04-25T08:54:38.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.534+0000 7f98aaffd640 1 -- 172.21.15.55:0/2833280825 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c032440 con 0x7f98ac15dd50 2024-04-25T08:54:38.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.534+0000 7f98aaffd640 1 -- 172.21.15.55:0/2833280825 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c032810 con 0x7f98ac15dd50 2024-04-25T08:54:38.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.535+0000 7f98b23f4640 1 -- 172.21.15.55:0/2833280825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98ac15dd50 msgr2=0x7f98ac0d1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.535+0000 7f98b23f4640 1 --2- 172.21.15.55:0/2833280825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98ac15dd50 0x7f98ac0d1c10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f989c009870 tx=0x7f989c02a1c0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.535+0000 7f98b23f4640 1 -- 172.21.15.55:0/2833280825 shutdown_connections 2024-04-25T08:54:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.535+0000 7f98b23f4640 1 --2- 172.21.15.55:0/2833280825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98ac0b9460 0x7f98ac0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.535+0000 7f98b23f4640 1 --2- 172.21.15.55:0/2833280825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98ac15dd50 0x7f98ac0d1c10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.535+0000 7f98b23f4640 1 -- 172.21.15.55:0/2833280825 >> 172.21.15.55:0/2833280825 conn(0x7f98ac0722d0 msgr2=0x7f98ac0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.535+0000 7f98b23f4640 1 -- 172.21.15.55:0/2833280825 shutdown_connections 2024-04-25T08:54:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.535+0000 7f98b23f4640 1 -- 172.21.15.55:0/2833280825 wait complete. 2024-04-25T08:54:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.536+0000 7f98b23f4640 1 Processor -- start 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.536+0000 7f98b23f4640 1 -- start start 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98b23f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98ac0b9460 0x7f98ac0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98b23f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98ac0d34e0 0x7f98ac1f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98b23f4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98ac15dd50 0x7f98ac15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98b23f4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0cece0 con 0x7f98ac0b9460 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98b23f4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0d2150 con 0x7f98ac0d34e0 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98b23f4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0cee60 con 0x7f98ac15dd50 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98abfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98ac0b9460 0x7f98ac0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98abfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98ac0b9460 0x7f98ac0caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53526/0 (socket says 172.21.15.55:53526) 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98abfff640 1 -- 172.21.15.55:0/759988672 learned_addr learned my addr 172.21.15.55:0/759988672 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98b0991640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98ac15dd50 0x7f98ac15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98ab7fe640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98ac0d34e0 0x7f98ac1f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98abfff640 1 -- 172.21.15.55:0/759988672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98ac15dd50 msgr2=0x7f98ac15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98abfff640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98ac15dd50 0x7f98ac15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98abfff640 1 -- 172.21.15.55:0/759988672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98ac0d34e0 msgr2=0x7f98ac1f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98abfff640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98ac0d34e0 0x7f98ac1f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.537+0000 7f98abfff640 1 -- 172.21.15.55:0/759988672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac15fcd0 con 0x7f98ac0b9460 2024-04-25T08:54:38.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.538+0000 7f98abfff640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98ac0b9460 0x7f98ac0caba0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f989c000c00 tx=0x7f989c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:38.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.538+0000 7f98a8ff9640 1 -- 172.21.15.55:0/759988672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c037040 con 0x7f98ac0b9460 2024-04-25T08:54:38.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.538+0000 7f98a8ff9640 1 -- 172.21.15.55:0/759988672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c042070 con 0x7f98ac0b9460 2024-04-25T08:54:38.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.538+0000 7f98b23f4640 1 -- 172.21.15.55:0/759988672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac15ffb0 con 0x7f98ac0b9460 2024-04-25T08:54:38.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.538+0000 7f98a8ff9640 1 -- 172.21.15.55:0/759988672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c030880 con 0x7f98ac0b9460 2024-04-25T08:54:38.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.538+0000 7f98b23f4640 1 -- 172.21.15.55:0/759988672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac160570 con 0x7f98ac0b9460 2024-04-25T08:54:38.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.539+0000 7f98b23f4640 1 -- 172.21.15.55:0/759988672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac067850 con 0x7f98ac0b9460 2024-04-25T08:54:38.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.539+0000 7f98a8ff9640 1 -- 172.21.15.55:0/759988672 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f989c02ad10 con 0x7f98ac0b9460 2024-04-25T08:54:38.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.540+0000 7f98a8ff9640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989806b4d0 0x7f989806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.540+0000 7f98ab7fe640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989806b4d0 0x7f989806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.540+0000 7f98a8ff9640 1 -- 172.21.15.55:0/759988672 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f989c0aa640 con 0x7f98ac0b9460 2024-04-25T08:54:38.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.540+0000 7f98ab7fe640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989806b4d0 0x7f989806d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009560 tx=0x7f98a0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:38.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.544+0000 7f98a8ff9640 1 -- 172.21.15.55:0/759988672 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f989c078e70 con 0x7f98ac0b9460 2024-04-25T08:54:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.768+0000 7f98b23f4640 1 -- 172.21.15.55:0/759988672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98ac0b6e10 con 0x7f98ac0b9460 2024-04-25T08:54:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.769+0000 7f98a8ff9640 1 -- 172.21.15.55:0/759988672 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f989c07cf10 con 0x7f98ac0b9460 2024-04-25T08:54:38.759 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:38.759 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2362450653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2362450653},{"type":"v1","addr":"172.21.15.167:6835","nonce":2362450653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3897225045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3897225045},{"type":"v1","addr":"172.21.15.167:6834","nonce":3897225045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2007115110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2007115110},{"type":"v1","addr":"172.21.15.55:6836","nonce":2007115110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:54:35.752157+0000","modified":"2024-04-25T08:54:37.749451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1495159001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1495159001},{"type":"v1","addr":"172.21.15.55:6837","nonce":1495159001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:54:38.759 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-25T08:54:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 -- 172.21.15.55:0/759988672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989806b4d0 msgr2=0x7f989806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989806b4d0 0x7f989806d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009560 tx=0x7f98a0009190 comp rx=0 tx=0).stop 2024-04-25T08:54:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 -- 172.21.15.55:0/759988672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98ac0b9460 msgr2=0x7f98ac0caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98ac0b9460 0x7f98ac0caba0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f989c000c00 tx=0x7f989c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 -- 172.21.15.55:0/759988672 shutdown_connections 2024-04-25T08:54:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989806b4d0 0x7f989806d990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98ac15dd50 0x7f98ac15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98ac0d34e0 0x7f98ac1f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 --2- 172.21.15.55:0/759988672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98ac0b9460 0x7f98ac0caba0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 -- 172.21.15.55:0/759988672 >> 172.21.15.55:0/759988672 conn(0x7f98ac0722d0 msgr2=0x7f98ac0c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 -- 172.21.15.55:0/759988672 shutdown_connections 2024-04-25T08:54:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.771+0000 7f98b23f4640 1 -- 172.21.15.55:0/759988672 wait complete. 2024-04-25T08:54:38.771 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:38.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.882+0000 7f533ef89640 1 Processor -- start 2024-04-25T08:54:38.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.882+0000 7f533ef89640 1 -- start start 2024-04-25T08:54:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.883+0000 7f533ef89640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f533815bd40 0x7f533809a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.883+0000 7f533ef89640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5338099e20 0x7f53380cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.883+0000 7f533ef89640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53380cfb90 con 0x7f5338099a40 2024-04-25T08:54:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.883+0000 7f533ef89640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533815cfd0 con 0x7f5338099e20 2024-04-25T08:54:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.883+0000 7f533ef89640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533815c210 con 0x7f533815bd40 2024-04-25T08:54:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.883+0000 7f533cd25640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5338099a40 0x7f53380cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56260/0 (socket says 172.21.15.55:56260) 2024-04-25T08:54:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.883+0000 7f533cd25640 1 -- 172.21.15.55:0/1529444610 learned_addr learned my addr 172.21.15.55:0/1529444610 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430255338 0 0) 0x7f53380cfb90 con 0x7f5338099a40 2024-04-25T08:54:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f533d526640 1 --2- 172.21.15.55:0/1529444610 >> v2:172.21.15.167:3300/0 conn(0x7f5338099e20 0x7f53380cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5324003520 con 0x7f5338099a40 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f5337fff640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f533815bd40 0x7f533809a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1944151353 0 0) 0x7f5324003520 con 0x7f5338099a40 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f533815bd40 msgr2=0x7f533809a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f533815bd40 0x7f533809a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 >> v2:172.21.15.167:3300/0 conn(0x7f5338099e20 msgr2=0x7f53380cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 --2- 172.21.15.55:0/1529444610 >> v2:172.21.15.167:3300/0 conn(0x7f5338099e20 0x7f53380cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533815c4f0 con 0x7f5338099a40 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f5330001670 con 0x7f5338099a40 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 >> v1:172.21.15.55:6789/0 conn(0x7f5338099a40 legacy=0x7f53380cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 0x7f5324003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5324004800 0x7f5324004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f533815bd40 0x7f53240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533815cfd0 con 0x7f53240039b0 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533815c210 con 0x7f5324004800 2024-04-25T08:54:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532400b9f0 con 0x7f533815bd40 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f533cd25640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 0x7f5324003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f5337fff640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5324004800 0x7f5324004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f533d526640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f533815bd40 0x7f53240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f533cd25640 1 -- 172.21.15.55:0/1529444610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f533815bd40 msgr2=0x7f53240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f533cd25640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f533815bd40 0x7f53240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f533cd25640 1 -- 172.21.15.55:0/1529444610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5324004800 msgr2=0x7f5324004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.884+0000 7f533cd25640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5324004800 0x7f5324004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.885+0000 7f533cd25640 1 -- 172.21.15.55:0/1529444610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324003520 con 0x7f53240039b0 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.885+0000 7f533cd25640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 0x7f5324003dd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5330001050 tx=0x7f5324005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988ec27da6cd1a74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.885+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330007d70 con 0x7f53240039b0 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.885+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5330005af0 con 0x7f53240039b0 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.885+0000 7f53377fe640 1 -- 172.21.15.55:0/1529444610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330007070 con 0x7f53240039b0 2024-04-25T08:54:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.886+0000 7f533ef89640 1 -- 172.21.15.55:0/1529444610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 msgr2=0x7f5324003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.886+0000 7f533ef89640 1 --2- 172.21.15.55:0/1529444610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 0x7f5324003dd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5330001050 tx=0x7f5324005830 comp rx=0 tx=0).stop 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.886+0000 7f533d526640 1 -- 172.21.15.55:0/1529444610 reap_dead start 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.886+0000 7f533ef89640 1 -- 172.21.15.55:0/1529444610 shutdown_connections 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.886+0000 7f533ef89640 1 -- 172.21.15.55:0/1529444610 >> 172.21.15.55:0/1529444610 conn(0x7f53380b32f0 msgr2=0x7f53380b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.886+0000 7f533ef89640 1 -- 172.21.15.55:0/1529444610 shutdown_connections 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.886+0000 7f533ef89640 1 -- 172.21.15.55:0/1529444610 wait complete. 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.887+0000 7f533ef89640 1 Processor -- start 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.887+0000 7f533ef89640 1 -- start start 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f533ef89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 0x7f5338156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f533ef89640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53380c88d0 0x7f5338159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f533ef89640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53380c8d50 0x7f533815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f533ef89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533809a2b0 con 0x7f53240039b0 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f533ef89640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533815cab0 con 0x7f53380c88d0 2024-04-25T08:54:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f533ef89640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533809a9c0 con 0x7f53380c8d50 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f533cd25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 0x7f5338156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f533cd25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 0x7f5338156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56610/0 (socket says 172.21.15.55:56610) 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f533cd25640 1 -- 172.21.15.55:0/1064373977 learned_addr learned my addr 172.21.15.55:0/1064373977 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f533d526640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53380c8d50 0x7f533815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f5337fff640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53380c88d0 0x7f5338159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.888+0000 7f533cd25640 1 -- 172.21.15.55:0/1064373977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53380c8d50 msgr2=0x7f533815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.889+0000 7f533cd25640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53380c8d50 0x7f533815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.889+0000 7f533cd25640 1 -- 172.21.15.55:0/1064373977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53380c88d0 msgr2=0x7f5338159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.889+0000 7f533cd25640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53380c88d0 0x7f5338159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.889+0000 7f533cd25640 1 -- 172.21.15.55:0/1064373977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53380c55e0 con 0x7f53240039b0 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.889+0000 7f533cd25640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 0x7f5338156670 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f533000c300 tx=0x7f5330000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.889+0000 7f53357fa640 1 -- 172.21.15.55:0/1064373977 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330042070 con 0x7f53240039b0 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.889+0000 7f53357fa640 1 -- 172.21.15.55:0/1064373977 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5330007480 con 0x7f53240039b0 2024-04-25T08:54:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.889+0000 7f53357fa640 1 -- 172.21.15.55:0/1064373977 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330007d50 con 0x7f53240039b0 2024-04-25T08:54:38.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.889+0000 7f533ef89640 1 -- 172.21.15.55:0/1064373977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53380c58c0 con 0x7f53240039b0 2024-04-25T08:54:38.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.889+0000 7f533ef89640 1 -- 172.21.15.55:0/1064373977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533815f200 con 0x7f53240039b0 2024-04-25T08:54:38.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.890+0000 7f533ef89640 1 -- 172.21.15.55:0/1064373977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53380749b0 con 0x7f53240039b0 2024-04-25T08:54:38.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.890+0000 7f53357fa640 1 -- 172.21.15.55:0/1064373977 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f533003b050 con 0x7f53240039b0 2024-04-25T08:54:38.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.891+0000 7f53357fa640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f531806b4d0 0x7f531806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:38.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.891+0000 7f53357fa640 1 -- 172.21.15.55:0/1064373977 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53300aa960 con 0x7f53240039b0 2024-04-25T08:54:38.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.891+0000 7f5337fff640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f531806b4d0 0x7f531806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:38.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.891+0000 7f5337fff640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f531806b4d0 0x7f531806d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f533815b1e0 tx=0x7f532800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:38.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:38.895+0000 7f53357fa640 1 -- 172.21.15.55:0/1064373977 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5330005ac0 con 0x7f53240039b0 2024-04-25T08:54:39.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.077+0000 7f533ef89640 1 -- 172.21.15.55:0/1064373977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f533809a570 con 0x7f53240039b0 2024-04-25T08:54:39.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.078+0000 7f53357fa640 1 -- 172.21.15.55:0/1064373977 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f5330079990 con 0x7f53240039b0 2024-04-25T08:54:39.068 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:39.068 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":36,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:54:37.381878+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:54:34.023960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:54:34.730867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 -- 172.21.15.55:0/1064373977 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f531806b4d0 msgr2=0x7f531806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f531806b4d0 0x7f531806d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f533815b1e0 tx=0x7f532800b040 comp rx=0 tx=0).stop 2024-04-25T08:54:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 -- 172.21.15.55:0/1064373977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 msgr2=0x7f5338156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 0x7f5338156670 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f533000c300 tx=0x7f5330000fe0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 -- 172.21.15.55:0/1064373977 shutdown_connections 2024-04-25T08:54:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f531806b4d0 0x7f531806d990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53380c8d50 0x7f533815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53380c88d0 0x7f5338159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 --2- 172.21.15.55:0/1064373977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240039b0 0x7f5338156670 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 -- 172.21.15.55:0/1064373977 >> 172.21.15.55:0/1064373977 conn(0x7f53380b32f0 msgr2=0x7f5338070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:39.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 -- 172.21.15.55:0/1064373977 shutdown_connections 2024-04-25T08:54:39.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.080+0000 7f533ef89640 1 -- 172.21.15.55:0/1064373977 wait complete. 2024-04-25T08:54:39.081 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:54:39.081 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:54:39.179 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:54:39.181 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:54:39.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.192+0000 7f59e659e640 1 Processor -- start 2024-04-25T08:54:39.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.192+0000 7f59e659e640 1 -- start start 2024-04-25T08:54:39.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59e659e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f59e0160f00 0x7f59e00ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59e659e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59e01616f0 0x7f59e0072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59e659e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59e006aba0 0x7f59e006afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59e659e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e006fab0 con 0x7f59e01616f0 2024-04-25T08:54:39.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59e659e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e006b520 con 0x7f59e0160f00 2024-04-25T08:54:39.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59e659e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e0072f70 con 0x7f59e006aba0 2024-04-25T08:54:39.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59df7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59e01616f0 0x7f59e0072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59df7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59e01616f0 0x7f59e0072a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56616/0 (socket says 172.21.15.55:56616) 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59df7fe640 1 -- 172.21.15.55:0/720172701 learned_addr learned my addr 172.21.15.55:0/720172701 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59dffff640 1 --2- 172.21.15.55:0/720172701 >> v2:172.21.15.167:3300/0 conn(0x7f59e0160f00 0x7f59e00ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59e4b3b640 1 --2- 172.21.15.55:0/720172701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59e006aba0 0x7f59e006afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59df7fe640 1 -- 172.21.15.55:0/720172701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59e006aba0 msgr2=0x7f59e006afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59df7fe640 1 --2- 172.21.15.55:0/720172701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59e006aba0 0x7f59e006afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59df7fe640 1 -- 172.21.15.55:0/720172701 >> v2:172.21.15.167:3300/0 conn(0x7f59e0160f00 msgr2=0x7f59e00ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59df7fe640 1 --2- 172.21.15.55:0/720172701 >> v2:172.21.15.167:3300/0 conn(0x7f59e0160f00 0x7f59e00ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.193+0000 7f59df7fe640 1 -- 172.21.15.55:0/720172701 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0161bf0 con 0x7f59e01616f0 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.194+0000 7f59df7fe640 1 --2- 172.21.15.55:0/720172701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59e01616f0 0x7f59e0072a30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f59e006dc30 tx=0x7f59d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a764ca0d768a094c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.194+0000 7f59deffd640 1 -- 172.21.15.55:0/720172701 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0037070 con 0x7f59e01616f0 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.194+0000 7f59deffd640 1 -- 172.21.15.55:0/720172701 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d0032440 con 0x7f59e01616f0 2024-04-25T08:54:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.194+0000 7f59deffd640 1 -- 172.21.15.55:0/720172701 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0032810 con 0x7f59e01616f0 2024-04-25T08:54:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.195+0000 7f59e659e640 1 -- 172.21.15.55:0/720172701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59e01616f0 msgr2=0x7f59e0072a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.195+0000 7f59e659e640 1 --2- 172.21.15.55:0/720172701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59e01616f0 0x7f59e0072a30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f59e006dc30 tx=0x7f59d002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.195+0000 7f59e659e640 1 -- 172.21.15.55:0/720172701 shutdown_connections 2024-04-25T08:54:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.195+0000 7f59e659e640 1 --2- 172.21.15.55:0/720172701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59e006aba0 0x7f59e006afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.195+0000 7f59e659e640 1 --2- 172.21.15.55:0/720172701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59e01616f0 0x7f59e0072a30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.195+0000 7f59e659e640 1 --2- 172.21.15.55:0/720172701 >> v2:172.21.15.167:3300/0 conn(0x7f59e0160f00 0x7f59e00ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.195+0000 7f59e659e640 1 -- 172.21.15.55:0/720172701 >> 172.21.15.55:0/720172701 conn(0x7f59e00b2370 msgr2=0x7f59e00b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.195+0000 7f59e659e640 1 -- 172.21.15.55:0/720172701 shutdown_connections 2024-04-25T08:54:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.195+0000 7f59e659e640 1 -- 172.21.15.55:0/720172701 wait complete. 2024-04-25T08:54:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.196+0000 7f59e659e640 1 Processor -- start 2024-04-25T08:54:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.196+0000 7f59e659e640 1 -- start start 2024-04-25T08:54:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.197+0000 7f59e659e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59e006aba0 0x7f59e0155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.197+0000 7f59e659e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e0160f00 0x7f59e00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.197+0000 7f59e659e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59e01616f0 0x7f59e00cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.197+0000 7f59e659e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e0162490 con 0x7f59e006aba0 2024-04-25T08:54:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.197+0000 7f59e659e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e01621b0 con 0x7f59e0160f00 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.197+0000 7f59e659e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e01612e0 con 0x7f59e01616f0 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.197+0000 7f59dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59e006aba0 0x7f59e0155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.197+0000 7f59dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59e006aba0 0x7f59e0155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56620/0 (socket says 172.21.15.55:56620) 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.197+0000 7f59dffff640 1 -- 172.21.15.55:0/470554703 learned_addr learned my addr 172.21.15.55:0/470554703 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.197+0000 7f59df7fe640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e0160f00 0x7f59e00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.197+0000 7f59e4b3b640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59e01616f0 0x7f59e00cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59dffff640 1 -- 172.21.15.55:0/470554703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59e01616f0 msgr2=0x7f59e00cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59dffff640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59e01616f0 0x7f59e00cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59dffff640 1 -- 172.21.15.55:0/470554703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e0160f00 msgr2=0x7f59e00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59dffff640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e0160f00 0x7f59e00cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59dffff640 1 -- 172.21.15.55:0/470554703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e00b3ef0 con 0x7f59e006aba0 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59e4b3b640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59e01616f0 0x7f59e00cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59dffff640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59e006aba0 0x7f59e0155930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f59c800e9b0 tx=0x7f59c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59dcff9640 1 -- 172.21.15.55:0/470554703 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8017070 con 0x7f59e006aba0 2024-04-25T08:54:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59dcff9640 1 -- 172.21.15.55:0/470554703 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c800c9a0 con 0x7f59e006aba0 2024-04-25T08:54:39.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59e659e640 1 -- 172.21.15.55:0/470554703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e00b41d0 con 0x7f59e006aba0 2024-04-25T08:54:39.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59dcff9640 1 -- 172.21.15.55:0/470554703 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c800cd90 con 0x7f59e006aba0 2024-04-25T08:54:39.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.198+0000 7f59e659e640 1 -- 172.21.15.55:0/470554703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e00adb00 con 0x7f59e006aba0 2024-04-25T08:54:39.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.199+0000 7f59e659e640 1 -- 172.21.15.55:0/470554703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e00749b0 con 0x7f59e006aba0 2024-04-25T08:54:39.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.200+0000 7f59dcff9640 1 -- 172.21.15.55:0/470554703 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f59c801a070 con 0x7f59e006aba0 2024-04-25T08:54:39.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.200+0000 7f59dcff9640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f59c006b4d0 0x7f59c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.200+0000 7f59dcff9640 1 -- 172.21.15.55:0/470554703 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59c808a520 con 0x7f59e006aba0 2024-04-25T08:54:39.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.200+0000 7f59df7fe640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f59c006b4d0 0x7f59c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.201+0000 7f59df7fe640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f59c006b4d0 0x7f59c006d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f59d0034000 tx=0x7f59d002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:39.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.204+0000 7f59dcff9640 1 -- 172.21.15.55:0/470554703 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f59c8058d60 con 0x7f59e006aba0 2024-04-25T08:54:39.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.383+0000 7f59e659e640 1 -- 172.21.15.55:0/470554703 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59e015b060 con 0x7f59c006b4d0 2024-04-25T08:54:39.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.389+0000 7f59dcff9640 1 -- 172.21.15.55:0/470554703 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241422 (secure 0 0 0) 0x7f59e015b060 con 0x7f59c006b4d0 2024-04-25T08:54:39.381 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:39.382 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:54:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 -- 172.21.15.55:0/470554703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f59c006b4d0 msgr2=0x7f59c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f59c006b4d0 0x7f59c006d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f59d0034000 tx=0x7f59d002e000 comp rx=0 tx=0).stop 2024-04-25T08:54:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 -- 172.21.15.55:0/470554703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59e006aba0 msgr2=0x7f59e0155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59e006aba0 0x7f59e0155930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f59c800e9b0 tx=0x7f59c800ee70 comp rx=0 tx=0).stop 2024-04-25T08:54:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 -- 172.21.15.55:0/470554703 shutdown_connections 2024-04-25T08:54:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f59c006b4d0 0x7f59c006d990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59e01616f0 0x7f59e00cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e0160f00 0x7f59e00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 --2- 172.21.15.55:0/470554703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59e006aba0 0x7f59e0155930 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 -- 172.21.15.55:0/470554703 >> 172.21.15.55:0/470554703 conn(0x7f59e00b2370 msgr2=0x7f59e00cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 -- 172.21.15.55:0/470554703 shutdown_connections 2024-04-25T08:54:39.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.392+0000 7f59e659e640 1 -- 172.21.15.55:0/470554703 wait complete. 2024-04-25T08:54:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-04-25T08:54:38.562538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236796,"kb_used_data":3936,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737924,"statfs":{"total":773094113280,"available":772851634176,"internally_reserved":0,"allocated":4030464,"data_stored":2246820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.188074"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417844+0000","last_change":"2024-04-25T08:54:36.412325+0000","last_active":"2024-04-25T08:54:36.417844+0000","last_peered":"2024-04-25T08:54:36.417844+0000","last_clean":"2024-04-25T08:54:36.417844+0000","last_became_active":"2024-04-25T08:54:36.411987+0000","last_became_peered":"2024-04-25T08:54:36.411987+0000","last_unstale":"2024-04-25T08:54:36.417844+0000","last_undegraded":"2024-04-25T08:54:36.417844+0000","last_fullsized":"2024-04-25T08:54:36.417844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:35.550558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.421771+0000","last_change":"2024-04-25T08:54:36.418746+0000","last_active":"2024-04-25T08:54:36.421771+0000","last_peered":"2024-04-25T08:54:36.421771+0000","last_clean":"2024-04-25T08:54:36.421771+0000","last_became_active":"2024-04-25T08:54:36.418469+0000","last_became_peered":"2024-04-25T08:54:36.418469+0000","last_unstale":"2024-04-25T08:54:36.421771+0000","last_undegraded":"2024-04-25T08:54:36.421771+0000","last_fullsized":"2024-04-25T08:54:36.421771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:41.670068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415462+0000","last_change":"2024-04-25T08:54:36.409846+0000","last_active":"2024-04-25T08:54:36.415462+0000","last_peered":"2024-04-25T08:54:36.415462+0000","last_clean":"2024-04-25T08:54:36.415462+0000","last_became_active":"2024-04-25T08:54:36.409400+0000","last_became_peered":"2024-04-25T08:54:36.409400+0000","last_unstale":"2024-04-25T08:54:36.415462+0000","last_undegraded":"2024-04-25T08:54:36.415462+0000","last_fullsized":"2024-04-25T08:54:36.415462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:54.774408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417898+0000","last_change":"2024-04-25T08:54:36.413975+0000","last_active":"2024-04-25T08:54:36.417898+0000","last_peered":"2024-04-25T08:54:36.417898+0000","last_clean":"2024-04-25T08:54:36.417898+0000","last_became_active":"2024-04-25T08:54:36.413521+0000","last_became_peered":"2024-04-25T08:54:36.413521+0000","last_unstale":"2024-04-25T08:54:36.417898+0000","last_undegraded":"2024-04-25T08:54:36.417898+0000","last_fullsized":"2024-04-25T08:54:36.417898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:29.790880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377472+0000","last_change":"2024-04-25T08:54:34.377472+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377472+0000","last_undegraded":"2024-04-25T08:54:34.377472+0000","last_fullsized":"2024-04-25T08:54:34.377472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.378265+0000","last_change":"2024-04-25T08:54:34.378265+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.378265+0000","last_undegraded":"2024-04-25T08:54:34.378265+0000","last_fullsized":"2024-04-25T08:54:34.378265+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381583+0000","last_change":"2024-04-25T08:54:34.381583+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381583+0000","last_undegraded":"2024-04-25T08:54:34.381583+0000","last_fullsized":"2024-04-25T08:54:34.381583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417876+0000","last_change":"2024-04-25T08:54:36.412868+0000","last_active":"2024-04-25T08:54:36.417876+0000","last_peered":"2024-04-25T08:54:36.417876+0000","last_clean":"2024-04-25T08:54:36.417876+0000","last_became_active":"2024-04-25T08:54:36.411685+0000","last_became_peered":"2024-04-25T08:54:36.411685+0000","last_unstale":"2024-04-25T08:54:36.417876+0000","last_undegraded":"2024-04-25T08:54:36.417876+0000","last_fullsized":"2024-04-25T08:54:36.417876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:20.842028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381315+0000","last_change":"2024-04-25T08:54:34.381315+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381315+0000","last_undegraded":"2024-04-25T08:54:34.381315+0000","last_fullsized":"2024-04-25T08:54:34.381315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382709+0000","last_change":"2024-04-25T08:54:34.382709+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382709+0000","last_undegraded":"2024-04-25T08:54:34.382709+0000","last_fullsized":"2024-04-25T08:54:34.382709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.379977+0000","last_change":"2024-04-25T08:54:34.379977+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.379977+0000","last_undegraded":"2024-04-25T08:54:34.379977+0000","last_fullsized":"2024-04-25T08:54:34.379977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381225+0000","last_change":"2024-04-25T08:54:34.381225+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381225+0000","last_undegraded":"2024-04-25T08:54:34.381225+0000","last_fullsized":"2024-04-25T08:54:34.381225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.412739+0000","last_change":"2024-04-25T08:54:36.407767+0000","last_active":"2024-04-25T08:54:36.412739+0000","last_peered":"2024-04-25T08:54:36.412739+0000","last_clean":"2024-04-25T08:54:36.412739+0000","last_became_active":"2024-04-25T08:54:36.407386+0000","last_became_peered":"2024-04-25T08:54:36.407386+0000","last_unstale":"2024-04-25T08:54:36.412739+0000","last_undegraded":"2024-04-25T08:54:36.412739+0000","last_fullsized":"2024-04-25T08:54:36.412739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:19.703713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380014+0000","last_change":"2024-04-25T08:54:34.380014+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380014+0000","last_undegraded":"2024-04-25T08:54:34.380014+0000","last_fullsized":"2024-04-25T08:54:34.380014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381563+0000","last_change":"2024-04-25T08:54:34.381563+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381563+0000","last_undegraded":"2024-04-25T08:54:34.381563+0000","last_fullsized":"2024-04-25T08:54:34.381563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377683+0000","last_change":"2024-04-25T08:54:34.377683+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377683+0000","last_undegraded":"2024-04-25T08:54:34.377683+0000","last_fullsized":"2024-04-25T08:54:34.377683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.379882+0000","last_change":"2024-04-25T08:54:34.379882+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.379882+0000","last_undegraded":"2024-04-25T08:54:34.379882+0000","last_fullsized":"2024-04-25T08:54:34.379882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381941+0000","last_change":"2024-04-25T08:54:34.381941+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381941+0000","last_undegraded":"2024-04-25T08:54:34.381941+0000","last_fullsized":"2024-04-25T08:54:34.381941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415658+0000","last_change":"2024-04-25T08:54:36.410706+0000","last_active":"2024-04-25T08:54:36.415658+0000","last_peered":"2024-04-25T08:54:36.415658+0000","last_clean":"2024-04-25T08:54:36.415658+0000","last_became_active":"2024-04-25T08:54:36.410365+0000","last_became_peered":"2024-04-25T08:54:36.410365+0000","last_unstale":"2024-04-25T08:54:36.415658+0000","last_undegraded":"2024-04-25T08:54:36.415658+0000","last_fullsized":"2024-04-25T08:54:36.415658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:24.499466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380305+0000","last_change":"2024-04-25T08:54:34.380305+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380305+0000","last_undegraded":"2024-04-25T08:54:34.380305+0000","last_fullsized":"2024-04-25T08:54:34.380305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.390879+0000","last_change":"2024-04-25T08:54:35.406890+0000","last_active":"2024-04-25T08:54:36.390879+0000","last_peered":"2024-04-25T08:54:36.390879+0000","last_clean":"2024-04-25T08:54:36.390879+0000","last_became_active":"2024-04-25T08:54:35.406564+0000","last_became_peered":"2024-04-25T08:54:35.406564+0000","last_unstale":"2024-04-25T08:54:36.390879+0000","last_undegraded":"2024-04-25T08:54:36.390879+0000","last_fullsized":"2024-04-25T08:54:36.390879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:52.728522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382369+0000","last_change":"2024-04-25T08:54:34.382369+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382369+0000","last_undegraded":"2024-04-25T08:54:34.382369+0000","last_fullsized":"2024-04-25T08:54:34.382369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382202+0000","last_change":"2024-04-25T08:54:34.382202+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382202+0000","last_undegraded":"2024-04-25T08:54:34.382202+0000","last_fullsized":"2024-04-25T08:54:34.382202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.420752+0000","last_change":"2024-04-25T08:54:35.406766+0000","last_active":"2024-04-25T08:54:36.420752+0000","last_peered":"2024-04-25T08:54:36.420752+0000","last_clean":"2024-04-25T08:54:36.420752+0000","last_became_active":"2024-04-25T08:54:35.406301+0000","last_became_peered":"2024-04-25T08:54:35.406301+0000","last_unstale":"2024-04-25T08:54:36.420752+0000","last_undegraded":"2024-04-25T08:54:36.420752+0000","last_fullsized":"2024-04-25T08:54:36.420752+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:20.198029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381639+0000","last_change":"2024-04-25T08:54:34.381639+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381639+0000","last_undegraded":"2024-04-25T08:54:34.381639+0000","last_fullsized":"2024-04-25T08:54:34.381639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415498+0000","last_change":"2024-04-25T08:54:36.408929+0000","last_active":"2024-04-25T08:54:36.415498+0000","last_peered":"2024-04-25T08:54:36.415498+0000","last_clean":"2024-04-25T08:54:36.415498+0000","last_became_active":"2024-04-25T08:54:36.408650+0000","last_became_peered":"2024-04-25T08:54:36.408650+0000","last_unstale":"2024-04-25T08:54:36.415498+0000","last_undegraded":"2024-04-25T08:54:36.415498+0000","last_fullsized":"2024-04-25T08:54:36.415498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:05.278920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380083+0000","last_change":"2024-04-25T08:54:34.380083+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380083+0000","last_undegraded":"2024-04-25T08:54:34.380083+0000","last_fullsized":"2024-04-25T08:54:34.380083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382030+0000","last_change":"2024-04-25T08:54:34.382030+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382030+0000","last_undegraded":"2024-04-25T08:54:34.382030+0000","last_fullsized":"2024-04-25T08:54:34.382030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377793+0000","last_change":"2024-04-25T08:54:34.377793+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377793+0000","last_undegraded":"2024-04-25T08:54:34.377793+0000","last_fullsized":"2024-04-25T08:54:34.377793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377488+0000","last_change":"2024-04-25T08:54:34.377488+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377488+0000","last_undegraded":"2024-04-25T08:54:34.377488+0000","last_fullsized":"2024-04-25T08:54:34.377488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381181+0000","last_change":"2024-04-25T08:54:34.381181+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381181+0000","last_undegraded":"2024-04-25T08:54:34.381181+0000","last_fullsized":"2024-04-25T08:54:34.381181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.379921+0000","last_change":"2024-04-25T08:54:34.379921+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.379921+0000","last_undegraded":"2024-04-25T08:54:34.379921+0000","last_fullsized":"2024-04-25T08:54:34.379921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.412321+0000","last_change":"2024-04-25T08:54:35.406931+0000","last_active":"2024-04-25T08:54:36.412321+0000","last_peered":"2024-04-25T08:54:36.412321+0000","last_clean":"2024-04-25T08:54:36.412321+0000","last_became_active":"2024-04-25T08:54:35.406639+0000","last_became_peered":"2024-04-25T08:54:35.406639+0000","last_unstale":"2024-04-25T08:54:36.412321+0000","last_undegraded":"2024-04-25T08:54:36.412321+0000","last_fullsized":"2024-04-25T08:54:36.412321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:21.339601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377142+0000","last_change":"2024-04-25T08:54:34.377142+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377142+0000","last_undegraded":"2024-04-25T08:54:34.377142+0000","last_fullsized":"2024-04-25T08:54:34.377142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.390875+0000","last_change":"2024-04-25T08:54:35.408435+0000","last_active":"2024-04-25T08:54:36.390875+0000","last_peered":"2024-04-25T08:54:36.390875+0000","last_clean":"2024-04-25T08:54:36.390875+0000","last_became_active":"2024-04-25T08:54:35.407831+0000","last_became_peered":"2024-04-25T08:54:35.407831+0000","last_unstale":"2024-04-25T08:54:36.390875+0000","last_undegraded":"2024-04-25T08:54:36.390875+0000","last_fullsized":"2024-04-25T08:54:36.390875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:11.392588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377294+0000","last_change":"2024-04-25T08:54:34.377294+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377294+0000","last_undegraded":"2024-04-25T08:54:34.377294+0000","last_fullsized":"2024-04-25T08:54:34.377294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.391074+0000","last_change":"2024-04-25T08:54:35.406919+0000","last_active":"2024-04-25T08:54:36.391074+0000","last_peered":"2024-04-25T08:54:36.391074+0000","last_clean":"2024-04-25T08:54:36.391074+0000","last_became_active":"2024-04-25T08:54:35.406619+0000","last_became_peered":"2024-04-25T08:54:35.406619+0000","last_unstale":"2024-04-25T08:54:36.391074+0000","last_undegraded":"2024-04-25T08:54:36.391074+0000","last_fullsized":"2024-04-25T08:54:36.391074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:42.641822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380604+0000","last_change":"2024-04-25T08:54:34.380604+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380604+0000","last_undegraded":"2024-04-25T08:54:34.380604+0000","last_fullsized":"2024-04-25T08:54:34.380604+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382616+0000","last_change":"2024-04-25T08:54:34.382616+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382616+0000","last_undegraded":"2024-04-25T08:54:34.382616+0000","last_fullsized":"2024-04-25T08:54:34.382616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377487+0000","last_change":"2024-04-25T08:54:34.377487+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377487+0000","last_undegraded":"2024-04-25T08:54:34.377487+0000","last_fullsized":"2024-04-25T08:54:34.377487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T08:54:34.381621+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:54:34.381621+0000","last_peered":"2024-04-25T08:54:34.381621+0000","last_clean":"2024-04-25T08:54:34.381621+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:54:34.381621+0000","last_undegraded":"2024-04-25T08:54:34.381621+0000","last_fullsized":"2024-04-25T08:54:34.381621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":722118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":722118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":143834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:54:39.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:54:39.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.544+0000 7fc6511ed640 1 Processor -- start 2024-04-25T08:54:39.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.544+0000 7fc6511ed640 1 -- start start 2024-04-25T08:54:39.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc6511ed640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c15df40 0x7fc64c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc6511ed640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc64c0b19c0 0x7fc64c0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc6511ed640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c0cd930 con 0x7fc64c0cfe80 2024-04-25T08:54:39.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc6511ed640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c0cc5b0 con 0x7fc64c0b19c0 2024-04-25T08:54:39.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc6511ed640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0cdc10 con 0x7fc64c15df40 2024-04-25T08:54:39.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64b59e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc64c0cfe80 0x7fc64c06aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56270/0 (socket says 172.21.15.55:56270) 2024-04-25T08:54:39.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64b59e640 1 -- 172.21.15.55:0/2055988457 learned_addr learned my addr 172.21.15.55:0/2055988457 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:39.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64ad9d640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c15df40 0x7fc64c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc643fff640 1 --2- 172.21.15.55:0/2055988457 >> v2:172.21.15.167:3300/0 conn(0x7fc64c0b19c0 0x7fc64c0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135478001 0 0) 0x7fc64c0cd930 con 0x7fc64c0cfe80 2024-04-25T08:54:39.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc638003520 con 0x7fc64c0cfe80 2024-04-25T08:54:39.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835047663 0 0) 0x7fc638003520 con 0x7fc64c0cfe80 2024-04-25T08:54:39.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c15df40 msgr2=0x7fc64c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:39.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64a59c640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c15df40 0x7fc64c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 >> v2:172.21.15.167:3300/0 conn(0x7fc64c0b19c0 msgr2=0x7fc64c0cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:39.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64a59c640 1 --2- 172.21.15.55:0/2055988457 >> v2:172.21.15.167:3300/0 conn(0x7fc64c0b19c0 0x7fc64c0cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0cdef0 con 0x7fc64c0cfe80 2024-04-25T08:54:39.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc6440019f0 con 0x7fc64c0cfe80 2024-04-25T08:54:39.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.545+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 >> v1:172.21.15.55:6789/0 conn(0x7fc64c0cfe80 legacy=0x7fc64c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64a59c640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c15df40 0x7fc6380039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64a59c640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc638003f30 0x7fc638004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64a59c640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc638004d40 0x7fc6380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0cc5b0 con 0x7fc638004d40 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0cdc10 con 0x7fc638003f30 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63800ba10 con 0x7fc64c15df40 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64b59e640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc638004d40 0x7fc6380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64ad9d640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c15df40 0x7fc6380039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc643fff640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc638003f30 0x7fc638004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64b59e640 1 -- 172.21.15.55:0/2055988457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c15df40 msgr2=0x7fc6380039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64b59e640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c15df40 0x7fc6380039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64b59e640 1 -- 172.21.15.55:0/2055988457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc638003f30 msgr2=0x7fc638004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64b59e640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc638003f30 0x7fc638004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.546+0000 7fc64b59e640 1 -- 172.21.15.55:0/2055988457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc638003520 con 0x7fc638004d40 2024-04-25T08:54:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.547+0000 7fc64b59e640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc638004d40 0x7fc6380051c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc64400a890 tx=0x7fc638005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f128f8052cc609f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.547+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64400a4e0 con 0x7fc638004d40 2024-04-25T08:54:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.547+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64402f070 con 0x7fc638004d40 2024-04-25T08:54:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.547+0000 7fc64a59c640 1 -- 172.21.15.55:0/2055988457 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64402bcf0 con 0x7fc638004d40 2024-04-25T08:54:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.547+0000 7fc6511ed640 1 -- 172.21.15.55:0/2055988457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc638004d40 msgr2=0x7fc6380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.547+0000 7fc6511ed640 1 --2- 172.21.15.55:0/2055988457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc638004d40 0x7fc6380051c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc64400a890 tx=0x7fc638005830 comp rx=0 tx=0).stop 2024-04-25T08:54:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.547+0000 7fc64b59e640 1 -- 172.21.15.55:0/2055988457 reap_dead start 2024-04-25T08:54:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.547+0000 7fc6511ed640 1 -- 172.21.15.55:0/2055988457 shutdown_connections 2024-04-25T08:54:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.547+0000 7fc6511ed640 1 -- 172.21.15.55:0/2055988457 >> 172.21.15.55:0/2055988457 conn(0x7fc64c0d06b0 msgr2=0x7fc64c0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.547+0000 7fc6511ed640 1 -- 172.21.15.55:0/2055988457 shutdown_connections 2024-04-25T08:54:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.547+0000 7fc6511ed640 1 -- 172.21.15.55:0/2055988457 wait complete. 2024-04-25T08:54:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.549+0000 7fc6511ed640 1 Processor -- start 2024-04-25T08:54:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.549+0000 7fc6511ed640 1 -- start start 2024-04-25T08:54:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc6511ed640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc64c14ff80 0x7fc64c153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc6511ed640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c153940 0x7fc64c14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc6511ed640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc64c14d770 0x7fc64c150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc6511ed640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0d0310 con 0x7fc64c14ff80 2024-04-25T08:54:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc6511ed640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0cb080 con 0x7fc64c14d770 2024-04-25T08:54:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc6511ed640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0b1e20 con 0x7fc64c153940 2024-04-25T08:54:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc64ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc64c14ff80 0x7fc64c153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc64ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc64c14ff80 0x7fc64c153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56634/0 (socket says 172.21.15.55:56634) 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc64ad9d640 1 -- 172.21.15.55:0/314980852 learned_addr learned my addr 172.21.15.55:0/314980852 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc643fff640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c153940 0x7fc64c14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc64b59e640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc64c14d770 0x7fc64c150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc64ad9d640 1 -- 172.21.15.55:0/314980852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c153940 msgr2=0x7fc64c14d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc64ad9d640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c153940 0x7fc64c14d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc64ad9d640 1 -- 172.21.15.55:0/314980852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc64c14d770 msgr2=0x7fc64c150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc64ad9d640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc64c14d770 0x7fc64c150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc64ad9d640 1 -- 172.21.15.55:0/314980852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c14dbf0 con 0x7fc64c14ff80 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc643fff640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c153940 0x7fc64c14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc64ad9d640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc64c14ff80 0x7fc64c153400 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0119a0 tx=0x7fc63c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc6437fe640 1 -- 172.21.15.55:0/314980852 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00fa90 con 0x7fc64c14ff80 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc6437fe640 1 -- 172.21.15.55:0/314980852 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c00fc30 con 0x7fc64c14ff80 2024-04-25T08:54:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc6437fe640 1 -- 172.21.15.55:0/314980852 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c014440 con 0x7fc64c14ff80 2024-04-25T08:54:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc6511ed640 1 -- 172.21.15.55:0/314980852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c0c9320 con 0x7fc64c14ff80 2024-04-25T08:54:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.550+0000 7fc6511ed640 1 -- 172.21.15.55:0/314980852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c14e300 con 0x7fc64c14ff80 2024-04-25T08:54:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.551+0000 7fc6511ed640 1 -- 172.21.15.55:0/314980852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c0749b0 con 0x7fc64c14ff80 2024-04-25T08:54:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.552+0000 7fc6437fe640 1 -- 172.21.15.55:0/314980852 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc63c012040 con 0x7fc64c14ff80 2024-04-25T08:54:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.552+0000 7fc6437fe640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc62c06b500 0x7fc62c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.552+0000 7fc6437fe640 1 -- 172.21.15.55:0/314980852 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc63c08a720 con 0x7fc64c14ff80 2024-04-25T08:54:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.552+0000 7fc643fff640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc62c06b500 0x7fc62c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.553+0000 7fc643fff640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc62c06b500 0x7fc62c06d9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc64c15a4d0 tx=0x7fc634008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.556+0000 7fc6437fe640 1 -- 172.21.15.55:0/314980852 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc63c019030 con 0x7fc64c14ff80 2024-04-25T08:54:39.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.733+0000 7fc6511ed640 1 -- 172.21.15.55:0/314980852 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc64c15d670 con 0x7fc62c06b500 2024-04-25T08:54:39.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.738+0000 7fc6437fe640 1 -- 172.21.15.55:0/314980852 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241422 (secure 0 0 0) 0x7fc64c15d670 con 0x7fc62c06b500 2024-04-25T08:54:39.731 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:39.734 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:54:39.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.741+0000 7fc6511ed640 1 -- 172.21.15.55:0/314980852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc62c06b500 msgr2=0x7fc62c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.741+0000 7fc6511ed640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc62c06b500 0x7fc62c06d9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc64c15a4d0 tx=0x7fc634008040 comp rx=0 tx=0).stop 2024-04-25T08:54:39.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.741+0000 7fc6511ed640 1 -- 172.21.15.55:0/314980852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc64c14ff80 msgr2=0x7fc64c153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.741+0000 7fc6511ed640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc64c14ff80 0x7fc64c153400 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0119a0 tx=0x7fc63c011e60 comp rx=0 tx=0).stop 2024-04-25T08:54:39.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.741+0000 7fc6511ed640 1 -- 172.21.15.55:0/314980852 shutdown_connections 2024-04-25T08:54:39.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.741+0000 7fc6511ed640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc62c06b500 0x7fc62c06d9c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.741+0000 7fc6511ed640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc64c14d770 0x7fc64c150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.741+0000 7fc6511ed640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64c153940 0x7fc64c14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.741+0000 7fc6511ed640 1 --2- 172.21.15.55:0/314980852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc64c14ff80 0x7fc64c153400 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.741+0000 7fc6511ed640 1 -- 172.21.15.55:0/314980852 >> 172.21.15.55:0/314980852 conn(0x7fc64c0d06b0 msgr2=0x7fc64c0c61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:39.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.742+0000 7fc6511ed640 1 -- 172.21.15.55:0/314980852 shutdown_connections 2024-04-25T08:54:39.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.742+0000 7fc6511ed640 1 -- 172.21.15.55:0/314980852 wait complete. 2024-04-25T08:54:39.742 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-04-25T08:54:38.562538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236796,"kb_used_data":3936,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737924,"statfs":{"total":773094113280,"available":772851634176,"internally_reserved":0,"allocated":4030464,"data_stored":2246820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.188074"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417844+0000","last_change":"2024-04-25T08:54:36.412325+0000","last_active":"2024-04-25T08:54:36.417844+0000","last_peered":"2024-04-25T08:54:36.417844+0000","last_clean":"2024-04-25T08:54:36.417844+0000","last_became_active":"2024-04-25T08:54:36.411987+0000","last_became_peered":"2024-04-25T08:54:36.411987+0000","last_unstale":"2024-04-25T08:54:36.417844+0000","last_undegraded":"2024-04-25T08:54:36.417844+0000","last_fullsized":"2024-04-25T08:54:36.417844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:35.550558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.421771+0000","last_change":"2024-04-25T08:54:36.418746+0000","last_active":"2024-04-25T08:54:36.421771+0000","last_peered":"2024-04-25T08:54:36.421771+0000","last_clean":"2024-04-25T08:54:36.421771+0000","last_became_active":"2024-04-25T08:54:36.418469+0000","last_became_peered":"2024-04-25T08:54:36.418469+0000","last_unstale":"2024-04-25T08:54:36.421771+0000","last_undegraded":"2024-04-25T08:54:36.421771+0000","last_fullsized":"2024-04-25T08:54:36.421771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:41.670068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415462+0000","last_change":"2024-04-25T08:54:36.409846+0000","last_active":"2024-04-25T08:54:36.415462+0000","last_peered":"2024-04-25T08:54:36.415462+0000","last_clean":"2024-04-25T08:54:36.415462+0000","last_became_active":"2024-04-25T08:54:36.409400+0000","last_became_peered":"2024-04-25T08:54:36.409400+0000","last_unstale":"2024-04-25T08:54:36.415462+0000","last_undegraded":"2024-04-25T08:54:36.415462+0000","last_fullsized":"2024-04-25T08:54:36.415462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:54.774408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417898+0000","last_change":"2024-04-25T08:54:36.413975+0000","last_active":"2024-04-25T08:54:36.417898+0000","last_peered":"2024-04-25T08:54:36.417898+0000","last_clean":"2024-04-25T08:54:36.417898+0000","last_became_active":"2024-04-25T08:54:36.413521+0000","last_became_peered":"2024-04-25T08:54:36.413521+0000","last_unstale":"2024-04-25T08:54:36.417898+0000","last_undegraded":"2024-04-25T08:54:36.417898+0000","last_fullsized":"2024-04-25T08:54:36.417898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:29.790880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377472+0000","last_change":"2024-04-25T08:54:34.377472+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377472+0000","last_undegraded":"2024-04-25T08:54:34.377472+0000","last_fullsized":"2024-04-25T08:54:34.377472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.378265+0000","last_change":"2024-04-25T08:54:34.378265+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.378265+0000","last_undegraded":"2024-04-25T08:54:34.378265+0000","last_fullsized":"2024-04-25T08:54:34.378265+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381583+0000","last_change":"2024-04-25T08:54:34.381583+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381583+0000","last_undegraded":"2024-04-25T08:54:34.381583+0000","last_fullsized":"2024-04-25T08:54:34.381583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417876+0000","last_change":"2024-04-25T08:54:36.412868+0000","last_active":"2024-04-25T08:54:36.417876+0000","last_peered":"2024-04-25T08:54:36.417876+0000","last_clean":"2024-04-25T08:54:36.417876+0000","last_became_active":"2024-04-25T08:54:36.411685+0000","last_became_peered":"2024-04-25T08:54:36.411685+0000","last_unstale":"2024-04-25T08:54:36.417876+0000","last_undegraded":"2024-04-25T08:54:36.417876+0000","last_fullsized":"2024-04-25T08:54:36.417876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:20.842028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381315+0000","last_change":"2024-04-25T08:54:34.381315+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381315+0000","last_undegraded":"2024-04-25T08:54:34.381315+0000","last_fullsized":"2024-04-25T08:54:34.381315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382709+0000","last_change":"2024-04-25T08:54:34.382709+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382709+0000","last_undegraded":"2024-04-25T08:54:34.382709+0000","last_fullsized":"2024-04-25T08:54:34.382709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.379977+0000","last_change":"2024-04-25T08:54:34.379977+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.379977+0000","last_undegraded":"2024-04-25T08:54:34.379977+0000","last_fullsized":"2024-04-25T08:54:34.379977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381225+0000","last_change":"2024-04-25T08:54:34.381225+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381225+0000","last_undegraded":"2024-04-25T08:54:34.381225+0000","last_fullsized":"2024-04-25T08:54:34.381225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.412739+0000","last_change":"2024-04-25T08:54:36.407767+0000","last_active":"2024-04-25T08:54:36.412739+0000","last_peered":"2024-04-25T08:54:36.412739+0000","last_clean":"2024-04-25T08:54:36.412739+0000","last_became_active":"2024-04-25T08:54:36.407386+0000","last_became_peered":"2024-04-25T08:54:36.407386+0000","last_unstale":"2024-04-25T08:54:36.412739+0000","last_undegraded":"2024-04-25T08:54:36.412739+0000","last_fullsized":"2024-04-25T08:54:36.412739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:19.703713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380014+0000","last_change":"2024-04-25T08:54:34.380014+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380014+0000","last_undegraded":"2024-04-25T08:54:34.380014+0000","last_fullsized":"2024-04-25T08:54:34.380014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381563+0000","last_change":"2024-04-25T08:54:34.381563+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381563+0000","last_undegraded":"2024-04-25T08:54:34.381563+0000","last_fullsized":"2024-04-25T08:54:34.381563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377683+0000","last_change":"2024-04-25T08:54:34.377683+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377683+0000","last_undegraded":"2024-04-25T08:54:34.377683+0000","last_fullsized":"2024-04-25T08:54:34.377683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.379882+0000","last_change":"2024-04-25T08:54:34.379882+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.379882+0000","last_undegraded":"2024-04-25T08:54:34.379882+0000","last_fullsized":"2024-04-25T08:54:34.379882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381941+0000","last_change":"2024-04-25T08:54:34.381941+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381941+0000","last_undegraded":"2024-04-25T08:54:34.381941+0000","last_fullsized":"2024-04-25T08:54:34.381941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415658+0000","last_change":"2024-04-25T08:54:36.410706+0000","last_active":"2024-04-25T08:54:36.415658+0000","last_peered":"2024-04-25T08:54:36.415658+0000","last_clean":"2024-04-25T08:54:36.415658+0000","last_became_active":"2024-04-25T08:54:36.410365+0000","last_became_peered":"2024-04-25T08:54:36.410365+0000","last_unstale":"2024-04-25T08:54:36.415658+0000","last_undegraded":"2024-04-25T08:54:36.415658+0000","last_fullsized":"2024-04-25T08:54:36.415658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:24.499466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380305+0000","last_change":"2024-04-25T08:54:34.380305+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380305+0000","last_undegraded":"2024-04-25T08:54:34.380305+0000","last_fullsized":"2024-04-25T08:54:34.380305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.390879+0000","last_change":"2024-04-25T08:54:35.406890+0000","last_active":"2024-04-25T08:54:36.390879+0000","last_peered":"2024-04-25T08:54:36.390879+0000","last_clean":"2024-04-25T08:54:36.390879+0000","last_became_active":"2024-04-25T08:54:35.406564+0000","last_became_peered":"2024-04-25T08:54:35.406564+0000","last_unstale":"2024-04-25T08:54:36.390879+0000","last_undegraded":"2024-04-25T08:54:36.390879+0000","last_fullsized":"2024-04-25T08:54:36.390879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:52.728522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382369+0000","last_change":"2024-04-25T08:54:34.382369+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382369+0000","last_undegraded":"2024-04-25T08:54:34.382369+0000","last_fullsized":"2024-04-25T08:54:34.382369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382202+0000","last_change":"2024-04-25T08:54:34.382202+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382202+0000","last_undegraded":"2024-04-25T08:54:34.382202+0000","last_fullsized":"2024-04-25T08:54:34.382202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.420752+0000","last_change":"2024-04-25T08:54:35.406766+0000","last_active":"2024-04-25T08:54:36.420752+0000","last_peered":"2024-04-25T08:54:36.420752+0000","last_clean":"2024-04-25T08:54:36.420752+0000","last_became_active":"2024-04-25T08:54:35.406301+0000","last_became_peered":"2024-04-25T08:54:35.406301+0000","last_unstale":"2024-04-25T08:54:36.420752+0000","last_undegraded":"2024-04-25T08:54:36.420752+0000","last_fullsized":"2024-04-25T08:54:36.420752+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:20.198029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381639+0000","last_change":"2024-04-25T08:54:34.381639+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381639+0000","last_undegraded":"2024-04-25T08:54:34.381639+0000","last_fullsized":"2024-04-25T08:54:34.381639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415498+0000","last_change":"2024-04-25T08:54:36.408929+0000","last_active":"2024-04-25T08:54:36.415498+0000","last_peered":"2024-04-25T08:54:36.415498+0000","last_clean":"2024-04-25T08:54:36.415498+0000","last_became_active":"2024-04-25T08:54:36.408650+0000","last_became_peered":"2024-04-25T08:54:36.408650+0000","last_unstale":"2024-04-25T08:54:36.415498+0000","last_undegraded":"2024-04-25T08:54:36.415498+0000","last_fullsized":"2024-04-25T08:54:36.415498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:05.278920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380083+0000","last_change":"2024-04-25T08:54:34.380083+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380083+0000","last_undegraded":"2024-04-25T08:54:34.380083+0000","last_fullsized":"2024-04-25T08:54:34.380083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382030+0000","last_change":"2024-04-25T08:54:34.382030+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382030+0000","last_undegraded":"2024-04-25T08:54:34.382030+0000","last_fullsized":"2024-04-25T08:54:34.382030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377793+0000","last_change":"2024-04-25T08:54:34.377793+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377793+0000","last_undegraded":"2024-04-25T08:54:34.377793+0000","last_fullsized":"2024-04-25T08:54:34.377793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377488+0000","last_change":"2024-04-25T08:54:34.377488+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377488+0000","last_undegraded":"2024-04-25T08:54:34.377488+0000","last_fullsized":"2024-04-25T08:54:34.377488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381181+0000","last_change":"2024-04-25T08:54:34.381181+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381181+0000","last_undegraded":"2024-04-25T08:54:34.381181+0000","last_fullsized":"2024-04-25T08:54:34.381181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.379921+0000","last_change":"2024-04-25T08:54:34.379921+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.379921+0000","last_undegraded":"2024-04-25T08:54:34.379921+0000","last_fullsized":"2024-04-25T08:54:34.379921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.412321+0000","last_change":"2024-04-25T08:54:35.406931+0000","last_active":"2024-04-25T08:54:36.412321+0000","last_peered":"2024-04-25T08:54:36.412321+0000","last_clean":"2024-04-25T08:54:36.412321+0000","last_became_active":"2024-04-25T08:54:35.406639+0000","last_became_peered":"2024-04-25T08:54:35.406639+0000","last_unstale":"2024-04-25T08:54:36.412321+0000","last_undegraded":"2024-04-25T08:54:36.412321+0000","last_fullsized":"2024-04-25T08:54:36.412321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:21.339601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377142+0000","last_change":"2024-04-25T08:54:34.377142+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377142+0000","last_undegraded":"2024-04-25T08:54:34.377142+0000","last_fullsized":"2024-04-25T08:54:34.377142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.390875+0000","last_change":"2024-04-25T08:54:35.408435+0000","last_active":"2024-04-25T08:54:36.390875+0000","last_peered":"2024-04-25T08:54:36.390875+0000","last_clean":"2024-04-25T08:54:36.390875+0000","last_became_active":"2024-04-25T08:54:35.407831+0000","last_became_peered":"2024-04-25T08:54:35.407831+0000","last_unstale":"2024-04-25T08:54:36.390875+0000","last_undegraded":"2024-04-25T08:54:36.390875+0000","last_fullsized":"2024-04-25T08:54:36.390875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:11.392588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377294+0000","last_change":"2024-04-25T08:54:34.377294+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377294+0000","last_undegraded":"2024-04-25T08:54:34.377294+0000","last_fullsized":"2024-04-25T08:54:34.377294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.391074+0000","last_change":"2024-04-25T08:54:35.406919+0000","last_active":"2024-04-25T08:54:36.391074+0000","last_peered":"2024-04-25T08:54:36.391074+0000","last_clean":"2024-04-25T08:54:36.391074+0000","last_became_active":"2024-04-25T08:54:35.406619+0000","last_became_peered":"2024-04-25T08:54:35.406619+0000","last_unstale":"2024-04-25T08:54:36.391074+0000","last_undegraded":"2024-04-25T08:54:36.391074+0000","last_fullsized":"2024-04-25T08:54:36.391074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:42.641822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380604+0000","last_change":"2024-04-25T08:54:34.380604+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380604+0000","last_undegraded":"2024-04-25T08:54:34.380604+0000","last_fullsized":"2024-04-25T08:54:34.380604+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382616+0000","last_change":"2024-04-25T08:54:34.382616+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382616+0000","last_undegraded":"2024-04-25T08:54:34.382616+0000","last_fullsized":"2024-04-25T08:54:34.382616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377487+0000","last_change":"2024-04-25T08:54:34.377487+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377487+0000","last_undegraded":"2024-04-25T08:54:34.377487+0000","last_fullsized":"2024-04-25T08:54:34.377487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T08:54:34.381621+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:54:34.381621+0000","last_peered":"2024-04-25T08:54:34.381621+0000","last_clean":"2024-04-25T08:54:34.381621+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:54:34.381621+0000","last_undegraded":"2024-04-25T08:54:34.381621+0000","last_fullsized":"2024-04-25T08:54:34.381621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":722118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":722118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":143834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:54:39.746 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:54:39.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.894+0000 7f68a0ec4640 1 Processor -- start 2024-04-25T08:54:39.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.894+0000 7f68a0ec4640 1 -- start start 2024-04-25T08:54:39.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f68a0ec4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f689c15dce0 0x7f689c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f68a0ec4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f689c0d35b0 0x7f689c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f68a0ec4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689c0d1f90 0x7f689c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f68a0ec4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c15e0c0 con 0x7f689c15dce0 2024-04-25T08:54:39.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f68a0ec4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c0d2510 con 0x7f689c0d35b0 2024-04-25T08:54:39.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f68a0ec4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0d27f0 con 0x7f689c0d1f90 2024-04-25T08:54:39.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f689a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f689c15dce0 0x7f689c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f689a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f689c15dce0 0x7f689c0d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56650/0 (socket says 172.21.15.55:56650) 2024-04-25T08:54:39.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f689a59c640 1 -- 172.21.15.55:0/3839899531 learned_addr learned my addr 172.21.15.55:0/3839899531 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:39.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f6899d9b640 1 --2- 172.21.15.55:0/3839899531 >> v2:172.21.15.167:3300/0 conn(0x7f689c0d35b0 0x7f689c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f689ad9d640 1 --2- 172.21.15.55:0/3839899531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689c0d1f90 0x7f689c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f689a59c640 1 -- 172.21.15.55:0/3839899531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689c0d1f90 msgr2=0x7f689c0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:39.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f689a59c640 1 --2- 172.21.15.55:0/3839899531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689c0d1f90 0x7f689c0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f689a59c640 1 -- 172.21.15.55:0/3839899531 >> v2:172.21.15.167:3300/0 conn(0x7f689c0d35b0 msgr2=0x7f689c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:39.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f689a59c640 1 --2- 172.21.15.55:0/3839899531 >> v2:172.21.15.167:3300/0 conn(0x7f689c0d35b0 0x7f689c0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.895+0000 7f689a59c640 1 -- 172.21.15.55:0/3839899531 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c0d2ad0 con 0x7f689c15dce0 2024-04-25T08:54:39.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.896+0000 7f689a59c640 1 --2- 172.21.15.55:0/3839899531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f689c15dce0 0x7f689c0d1a50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f689c0cdfa0 tx=0x7f688c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f49606cd7c0ade server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:39.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.896+0000 7f689959a640 1 -- 172.21.15.55:0/3839899531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c037070 con 0x7f689c15dce0 2024-04-25T08:54:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.896+0000 7f689959a640 1 -- 172.21.15.55:0/3839899531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c032440 con 0x7f689c15dce0 2024-04-25T08:54:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.896+0000 7f689959a640 1 -- 172.21.15.55:0/3839899531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c032810 con 0x7f689c15dce0 2024-04-25T08:54:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.897+0000 7f68a0ec4640 1 -- 172.21.15.55:0/3839899531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f689c15dce0 msgr2=0x7f689c0d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.897+0000 7f68a0ec4640 1 --2- 172.21.15.55:0/3839899531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f689c15dce0 0x7f689c0d1a50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f689c0cdfa0 tx=0x7f688c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.897+0000 7f68a0ec4640 1 -- 172.21.15.55:0/3839899531 shutdown_connections 2024-04-25T08:54:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.897+0000 7f68a0ec4640 1 --2- 172.21.15.55:0/3839899531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689c0d1f90 0x7f689c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.897+0000 7f68a0ec4640 1 --2- 172.21.15.55:0/3839899531 >> v2:172.21.15.167:3300/0 conn(0x7f689c0d35b0 0x7f689c0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.897+0000 7f68a0ec4640 1 --2- 172.21.15.55:0/3839899531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f689c15dce0 0x7f689c0d1a50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.897+0000 7f68a0ec4640 1 -- 172.21.15.55:0/3839899531 >> 172.21.15.55:0/3839899531 conn(0x7f689c072900 msgr2=0x7f689c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.897+0000 7f68a0ec4640 1 -- 172.21.15.55:0/3839899531 shutdown_connections 2024-04-25T08:54:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.897+0000 7f68a0ec4640 1 -- 172.21.15.55:0/3839899531 wait complete. 2024-04-25T08:54:39.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.898+0000 7f68a0ec4640 1 Processor -- start 2024-04-25T08:54:39.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.898+0000 7f68a0ec4640 1 -- start start 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f68a0ec4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f689c0d1f90 0x7f689c15f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f68a0ec4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689c0d35b0 0x7f689c14dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f68a0ec4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f689c15dce0 0x7f689c15a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f68a0ec4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0b9820 con 0x7f689c15dce0 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f68a0ec4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0d3090 con 0x7f689c0d1f90 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f68a0ec4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0b99a0 con 0x7f689c0d35b0 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f689ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f689c15dce0 0x7f689c15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f689ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f689c15dce0 0x7f689c15a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56654/0 (socket says 172.21.15.55:56654) 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f689ad9d640 1 -- 172.21.15.55:0/1174412532 learned_addr learned my addr 172.21.15.55:0/1174412532 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f689a59c640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f689c0d1f90 0x7f689c15f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f6899d9b640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689c0d35b0 0x7f689c14dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f689ad9d640 1 -- 172.21.15.55:0/1174412532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689c0d35b0 msgr2=0x7f689c14dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f689ad9d640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689c0d35b0 0x7f689c14dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f689ad9d640 1 -- 172.21.15.55:0/1174412532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f689c0d1f90 msgr2=0x7f689c15f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:39.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.899+0000 7f689ad9d640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f689c0d1f90 0x7f689c15f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:39.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.900+0000 7f689ad9d640 1 -- 172.21.15.55:0/1174412532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c1f6d90 con 0x7f689c15dce0 2024-04-25T08:54:39.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.900+0000 7f689ad9d640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f689c15dce0 0x7f689c15a310 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f689400eed0 tx=0x7f689400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:39.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.900+0000 7f688affd640 1 -- 172.21.15.55:0/1174412532 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894018020 con 0x7f689c15dce0 2024-04-25T08:54:39.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.900+0000 7f688affd640 1 -- 172.21.15.55:0/1174412532 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689400bd20 con 0x7f689c15dce0 2024-04-25T08:54:39.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.900+0000 7f68a0ec4640 1 -- 172.21.15.55:0/1174412532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689c1f7070 con 0x7f689c15dce0 2024-04-25T08:54:39.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.900+0000 7f688affd640 1 -- 172.21.15.55:0/1174412532 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894014640 con 0x7f689c15dce0 2024-04-25T08:54:39.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.900+0000 7f68a0ec4640 1 -- 172.21.15.55:0/1174412532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c1f7630 con 0x7f689c15dce0 2024-04-25T08:54:39.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.901+0000 7f68a0ec4640 1 -- 172.21.15.55:0/1174412532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c0749b0 con 0x7f689c15dce0 2024-04-25T08:54:39.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.901+0000 7f688affd640 1 -- 172.21.15.55:0/1174412532 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6894005d10 con 0x7f689c15dce0 2024-04-25T08:54:39.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.902+0000 7f688affd640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f687c06b4d0 0x7f687c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:39.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.902+0000 7f688affd640 1 -- 172.21.15.55:0/1174412532 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f689408a700 con 0x7f689c15dce0 2024-04-25T08:54:39.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.902+0000 7f689a59c640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f687c06b4d0 0x7f687c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:39.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.902+0000 7f689a59c640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f687c06b4d0 0x7f687c06d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f688c034000 tx=0x7f688c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:39.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:39.906+0000 7f688affd640 1 -- 172.21.15.55:0/1174412532 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6894022070 con 0x7f689c15dce0 2024-04-25T08:54:40.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.085+0000 7f68a0ec4640 1 -- 172.21.15.55:0/1174412532 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f689c15d2c0 con 0x7f687c06b4d0 2024-04-25T08:54:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.090+0000 7f688affd640 1 -- 172.21.15.55:0/1174412532 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241422 (secure 0 0 0) 0x7f689c15d2c0 con 0x7f687c06b4d0 2024-04-25T08:54:40.083 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:40.084 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:54:40.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 -- 172.21.15.55:0/1174412532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f687c06b4d0 msgr2=0x7f687c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f687c06b4d0 0x7f687c06d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f688c034000 tx=0x7f688c02e000 comp rx=0 tx=0).stop 2024-04-25T08:54:40.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 -- 172.21.15.55:0/1174412532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f689c15dce0 msgr2=0x7f689c15a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f689c15dce0 0x7f689c15a310 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f689400eed0 tx=0x7f689400b480 comp rx=0 tx=0).stop 2024-04-25T08:54:40.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 -- 172.21.15.55:0/1174412532 shutdown_connections 2024-04-25T08:54:40.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f687c06b4d0 0x7f687c06d990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f689c15dce0 0x7f689c15a310 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f689c0d35b0 0x7f689c14dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 --2- 172.21.15.55:0/1174412532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f689c0d1f90 0x7f689c15f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 -- 172.21.15.55:0/1174412532 >> 172.21.15.55:0/1174412532 conn(0x7f689c072900 msgr2=0x7f689c0b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:40.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 -- 172.21.15.55:0/1174412532 shutdown_connections 2024-04-25T08:54:40.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.093+0000 7f68a0ec4640 1 -- 172.21.15.55:0/1174412532 wait complete. 2024-04-25T08:54:40.094 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-04-25T08:54:38.562538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236796,"kb_used_data":3936,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737924,"statfs":{"total":773094113280,"available":772851634176,"internally_reserved":0,"allocated":4030464,"data_stored":2246820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.188074"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417844+0000","last_change":"2024-04-25T08:54:36.412325+0000","last_active":"2024-04-25T08:54:36.417844+0000","last_peered":"2024-04-25T08:54:36.417844+0000","last_clean":"2024-04-25T08:54:36.417844+0000","last_became_active":"2024-04-25T08:54:36.411987+0000","last_became_peered":"2024-04-25T08:54:36.411987+0000","last_unstale":"2024-04-25T08:54:36.417844+0000","last_undegraded":"2024-04-25T08:54:36.417844+0000","last_fullsized":"2024-04-25T08:54:36.417844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:35.550558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.421771+0000","last_change":"2024-04-25T08:54:36.418746+0000","last_active":"2024-04-25T08:54:36.421771+0000","last_peered":"2024-04-25T08:54:36.421771+0000","last_clean":"2024-04-25T08:54:36.421771+0000","last_became_active":"2024-04-25T08:54:36.418469+0000","last_became_peered":"2024-04-25T08:54:36.418469+0000","last_unstale":"2024-04-25T08:54:36.421771+0000","last_undegraded":"2024-04-25T08:54:36.421771+0000","last_fullsized":"2024-04-25T08:54:36.421771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:41.670068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415462+0000","last_change":"2024-04-25T08:54:36.409846+0000","last_active":"2024-04-25T08:54:36.415462+0000","last_peered":"2024-04-25T08:54:36.415462+0000","last_clean":"2024-04-25T08:54:36.415462+0000","last_became_active":"2024-04-25T08:54:36.409400+0000","last_became_peered":"2024-04-25T08:54:36.409400+0000","last_unstale":"2024-04-25T08:54:36.415462+0000","last_undegraded":"2024-04-25T08:54:36.415462+0000","last_fullsized":"2024-04-25T08:54:36.415462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:54.774408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417898+0000","last_change":"2024-04-25T08:54:36.413975+0000","last_active":"2024-04-25T08:54:36.417898+0000","last_peered":"2024-04-25T08:54:36.417898+0000","last_clean":"2024-04-25T08:54:36.417898+0000","last_became_active":"2024-04-25T08:54:36.413521+0000","last_became_peered":"2024-04-25T08:54:36.413521+0000","last_unstale":"2024-04-25T08:54:36.417898+0000","last_undegraded":"2024-04-25T08:54:36.417898+0000","last_fullsized":"2024-04-25T08:54:36.417898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:29.790880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377472+0000","last_change":"2024-04-25T08:54:34.377472+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377472+0000","last_undegraded":"2024-04-25T08:54:34.377472+0000","last_fullsized":"2024-04-25T08:54:34.377472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.378265+0000","last_change":"2024-04-25T08:54:34.378265+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.378265+0000","last_undegraded":"2024-04-25T08:54:34.378265+0000","last_fullsized":"2024-04-25T08:54:34.378265+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381583+0000","last_change":"2024-04-25T08:54:34.381583+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381583+0000","last_undegraded":"2024-04-25T08:54:34.381583+0000","last_fullsized":"2024-04-25T08:54:34.381583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417876+0000","last_change":"2024-04-25T08:54:36.412868+0000","last_active":"2024-04-25T08:54:36.417876+0000","last_peered":"2024-04-25T08:54:36.417876+0000","last_clean":"2024-04-25T08:54:36.417876+0000","last_became_active":"2024-04-25T08:54:36.411685+0000","last_became_peered":"2024-04-25T08:54:36.411685+0000","last_unstale":"2024-04-25T08:54:36.417876+0000","last_undegraded":"2024-04-25T08:54:36.417876+0000","last_fullsized":"2024-04-25T08:54:36.417876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:20.842028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381315+0000","last_change":"2024-04-25T08:54:34.381315+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381315+0000","last_undegraded":"2024-04-25T08:54:34.381315+0000","last_fullsized":"2024-04-25T08:54:34.381315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382709+0000","last_change":"2024-04-25T08:54:34.382709+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382709+0000","last_undegraded":"2024-04-25T08:54:34.382709+0000","last_fullsized":"2024-04-25T08:54:34.382709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.379977+0000","last_change":"2024-04-25T08:54:34.379977+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.379977+0000","last_undegraded":"2024-04-25T08:54:34.379977+0000","last_fullsized":"2024-04-25T08:54:34.379977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381225+0000","last_change":"2024-04-25T08:54:34.381225+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381225+0000","last_undegraded":"2024-04-25T08:54:34.381225+0000","last_fullsized":"2024-04-25T08:54:34.381225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.412739+0000","last_change":"2024-04-25T08:54:36.407767+0000","last_active":"2024-04-25T08:54:36.412739+0000","last_peered":"2024-04-25T08:54:36.412739+0000","last_clean":"2024-04-25T08:54:36.412739+0000","last_became_active":"2024-04-25T08:54:36.407386+0000","last_became_peered":"2024-04-25T08:54:36.407386+0000","last_unstale":"2024-04-25T08:54:36.412739+0000","last_undegraded":"2024-04-25T08:54:36.412739+0000","last_fullsized":"2024-04-25T08:54:36.412739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:19.703713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380014+0000","last_change":"2024-04-25T08:54:34.380014+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380014+0000","last_undegraded":"2024-04-25T08:54:34.380014+0000","last_fullsized":"2024-04-25T08:54:34.380014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381563+0000","last_change":"2024-04-25T08:54:34.381563+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381563+0000","last_undegraded":"2024-04-25T08:54:34.381563+0000","last_fullsized":"2024-04-25T08:54:34.381563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377683+0000","last_change":"2024-04-25T08:54:34.377683+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377683+0000","last_undegraded":"2024-04-25T08:54:34.377683+0000","last_fullsized":"2024-04-25T08:54:34.377683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.379882+0000","last_change":"2024-04-25T08:54:34.379882+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.379882+0000","last_undegraded":"2024-04-25T08:54:34.379882+0000","last_fullsized":"2024-04-25T08:54:34.379882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381941+0000","last_change":"2024-04-25T08:54:34.381941+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381941+0000","last_undegraded":"2024-04-25T08:54:34.381941+0000","last_fullsized":"2024-04-25T08:54:34.381941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415658+0000","last_change":"2024-04-25T08:54:36.410706+0000","last_active":"2024-04-25T08:54:36.415658+0000","last_peered":"2024-04-25T08:54:36.415658+0000","last_clean":"2024-04-25T08:54:36.415658+0000","last_became_active":"2024-04-25T08:54:36.410365+0000","last_became_peered":"2024-04-25T08:54:36.410365+0000","last_unstale":"2024-04-25T08:54:36.415658+0000","last_undegraded":"2024-04-25T08:54:36.415658+0000","last_fullsized":"2024-04-25T08:54:36.415658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:24.499466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380305+0000","last_change":"2024-04-25T08:54:34.380305+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380305+0000","last_undegraded":"2024-04-25T08:54:34.380305+0000","last_fullsized":"2024-04-25T08:54:34.380305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.390879+0000","last_change":"2024-04-25T08:54:35.406890+0000","last_active":"2024-04-25T08:54:36.390879+0000","last_peered":"2024-04-25T08:54:36.390879+0000","last_clean":"2024-04-25T08:54:36.390879+0000","last_became_active":"2024-04-25T08:54:35.406564+0000","last_became_peered":"2024-04-25T08:54:35.406564+0000","last_unstale":"2024-04-25T08:54:36.390879+0000","last_undegraded":"2024-04-25T08:54:36.390879+0000","last_fullsized":"2024-04-25T08:54:36.390879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:52.728522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382369+0000","last_change":"2024-04-25T08:54:34.382369+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382369+0000","last_undegraded":"2024-04-25T08:54:34.382369+0000","last_fullsized":"2024-04-25T08:54:34.382369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382202+0000","last_change":"2024-04-25T08:54:34.382202+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382202+0000","last_undegraded":"2024-04-25T08:54:34.382202+0000","last_fullsized":"2024-04-25T08:54:34.382202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.420752+0000","last_change":"2024-04-25T08:54:35.406766+0000","last_active":"2024-04-25T08:54:36.420752+0000","last_peered":"2024-04-25T08:54:36.420752+0000","last_clean":"2024-04-25T08:54:36.420752+0000","last_became_active":"2024-04-25T08:54:35.406301+0000","last_became_peered":"2024-04-25T08:54:35.406301+0000","last_unstale":"2024-04-25T08:54:36.420752+0000","last_undegraded":"2024-04-25T08:54:36.420752+0000","last_fullsized":"2024-04-25T08:54:36.420752+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:20.198029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381639+0000","last_change":"2024-04-25T08:54:34.381639+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381639+0000","last_undegraded":"2024-04-25T08:54:34.381639+0000","last_fullsized":"2024-04-25T08:54:34.381639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415498+0000","last_change":"2024-04-25T08:54:36.408929+0000","last_active":"2024-04-25T08:54:36.415498+0000","last_peered":"2024-04-25T08:54:36.415498+0000","last_clean":"2024-04-25T08:54:36.415498+0000","last_became_active":"2024-04-25T08:54:36.408650+0000","last_became_peered":"2024-04-25T08:54:36.408650+0000","last_unstale":"2024-04-25T08:54:36.415498+0000","last_undegraded":"2024-04-25T08:54:36.415498+0000","last_fullsized":"2024-04-25T08:54:36.415498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:05.278920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380083+0000","last_change":"2024-04-25T08:54:34.380083+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380083+0000","last_undegraded":"2024-04-25T08:54:34.380083+0000","last_fullsized":"2024-04-25T08:54:34.380083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382030+0000","last_change":"2024-04-25T08:54:34.382030+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382030+0000","last_undegraded":"2024-04-25T08:54:34.382030+0000","last_fullsized":"2024-04-25T08:54:34.382030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377793+0000","last_change":"2024-04-25T08:54:34.377793+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377793+0000","last_undegraded":"2024-04-25T08:54:34.377793+0000","last_fullsized":"2024-04-25T08:54:34.377793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377488+0000","last_change":"2024-04-25T08:54:34.377488+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377488+0000","last_undegraded":"2024-04-25T08:54:34.377488+0000","last_fullsized":"2024-04-25T08:54:34.377488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.381181+0000","last_change":"2024-04-25T08:54:34.381181+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.381181+0000","last_undegraded":"2024-04-25T08:54:34.381181+0000","last_fullsized":"2024-04-25T08:54:34.381181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.379921+0000","last_change":"2024-04-25T08:54:34.379921+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.379921+0000","last_undegraded":"2024-04-25T08:54:34.379921+0000","last_fullsized":"2024-04-25T08:54:34.379921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.412321+0000","last_change":"2024-04-25T08:54:35.406931+0000","last_active":"2024-04-25T08:54:36.412321+0000","last_peered":"2024-04-25T08:54:36.412321+0000","last_clean":"2024-04-25T08:54:36.412321+0000","last_became_active":"2024-04-25T08:54:35.406639+0000","last_became_peered":"2024-04-25T08:54:35.406639+0000","last_unstale":"2024-04-25T08:54:36.412321+0000","last_undegraded":"2024-04-25T08:54:36.412321+0000","last_fullsized":"2024-04-25T08:54:36.412321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:21.339601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377142+0000","last_change":"2024-04-25T08:54:34.377142+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377142+0000","last_undegraded":"2024-04-25T08:54:34.377142+0000","last_fullsized":"2024-04-25T08:54:34.377142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.390875+0000","last_change":"2024-04-25T08:54:35.408435+0000","last_active":"2024-04-25T08:54:36.390875+0000","last_peered":"2024-04-25T08:54:36.390875+0000","last_clean":"2024-04-25T08:54:36.390875+0000","last_became_active":"2024-04-25T08:54:35.407831+0000","last_became_peered":"2024-04-25T08:54:35.407831+0000","last_unstale":"2024-04-25T08:54:36.390875+0000","last_undegraded":"2024-04-25T08:54:36.390875+0000","last_fullsized":"2024-04-25T08:54:36.390875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:11.392588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377294+0000","last_change":"2024-04-25T08:54:34.377294+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377294+0000","last_undegraded":"2024-04-25T08:54:34.377294+0000","last_fullsized":"2024-04-25T08:54:34.377294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.391074+0000","last_change":"2024-04-25T08:54:35.406919+0000","last_active":"2024-04-25T08:54:36.391074+0000","last_peered":"2024-04-25T08:54:36.391074+0000","last_clean":"2024-04-25T08:54:36.391074+0000","last_became_active":"2024-04-25T08:54:35.406619+0000","last_became_peered":"2024-04-25T08:54:35.406619+0000","last_unstale":"2024-04-25T08:54:36.391074+0000","last_undegraded":"2024-04-25T08:54:36.391074+0000","last_fullsized":"2024-04-25T08:54:36.391074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:42.641822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.380604+0000","last_change":"2024-04-25T08:54:34.380604+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.380604+0000","last_undegraded":"2024-04-25T08:54:34.380604+0000","last_fullsized":"2024-04-25T08:54:34.380604+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.382616+0000","last_change":"2024-04-25T08:54:34.382616+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.382616+0000","last_undegraded":"2024-04-25T08:54:34.382616+0000","last_fullsized":"2024-04-25T08:54:34.382616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:54:35.374522+0000","last_change":"2024-04-25T08:54:35.374522+0000","last_active":"2024-04-25T08:54:35.374522+0000","last_peered":"2024-04-25T08:54:35.374522+0000","last_clean":"2024-04-25T08:54:35.374522+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:35.374522+0000","last_undegraded":"2024-04-25T08:54:35.374522+0000","last_fullsized":"2024-04-25T08:54:35.374522+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-04-25T08:54:34.377487+0000","last_change":"2024-04-25T08:54:34.377487+0000","last_active":"2024-04-25T08:54:34.372375+0000","last_peered":"2024-04-25T08:54:34.372375+0000","last_clean":"2024-04-25T08:54:34.372375+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:54:34.377487+0000","last_undegraded":"2024-04-25T08:54:34.377487+0000","last_fullsized":"2024-04-25T08:54:34.377487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T08:54:34.381621+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:54:34.381621+0000","last_peered":"2024-04-25T08:54:34.381621+0000","last_clean":"2024-04-25T08:54:34.381621+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:54:34.381621+0000","last_undegraded":"2024-04-25T08:54:34.381621+0000","last_fullsized":"2024-04-25T08:54:34.381621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":722118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":352256,"data_stored":131750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":722118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":143834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:54:40.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-04-25T08:54:40.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-04-25T08:54:40.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-04-25T08:54:40.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-04-25T08:54:40.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-04-25T08:54:40.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-04-25T08:54:40.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-04-25T08:54:40.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-04-25T08:54:40.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-04-25T08:54:40.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-04-25T08:54:40.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-04-25T08:54:40.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-04-25T08:54:40.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-04-25T08:54:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-04-25T08:54:40.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-04-25T08:54:40.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-04-25T08:54:40.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-04-25T08:54:40.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-04-25T08:54:40.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-04-25T08:54:40.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-04-25T08:54:40.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-04-25T08:54:40.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-04-25T08:54:40.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-04-25T08:54:40.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-25T08:54:40.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.377472+0000', 'last_change': '2024-04-25T08:54:34.377472+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.377472+0000', 'last_undegraded': '2024-04-25T08:54:34.377472+0000', 'last_fullsized': '2024-04-25T08:54:34.377472+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.378265+0000', 'last_change': '2024-04-25T08:54:34.378265+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.378265+0000', 'last_undegraded': '2024-04-25T08:54:34.378265+0000', 'last_fullsized': '2024-04-25T08:54:34.378265+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.381583+0000', 'last_change': '2024-04-25T08:54:34.381583+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.381583+0000', 'last_undegraded': '2024-04-25T08:54:34.381583+0000', 'last_fullsized': '2024-04-25T08:54:34.381583+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-25T08:54:40.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.381315+0000', 'last_change': '2024-04-25T08:54:34.381315+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.381315+0000', 'last_undegraded': '2024-04-25T08:54:34.381315+0000', 'last_fullsized': '2024-04-25T08:54:34.381315+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:54:40.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-25T08:54:40.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-25T08:54:40.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.382709+0000', 'last_change': '2024-04-25T08:54:34.382709+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.382709+0000', 'last_undegraded': '2024-04-25T08:54:34.382709+0000', 'last_fullsized': '2024-04-25T08:54:34.382709+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:54:40.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-25T08:54:40.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-25T08:54:40.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.379977+0000', 'last_change': '2024-04-25T08:54:34.379977+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.379977+0000', 'last_undegraded': '2024-04-25T08:54:34.379977+0000', 'last_fullsized': '2024-04-25T08:54:34.379977+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:54:40.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-25T08:54:40.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.381225+0000', 'last_change': '2024-04-25T08:54:34.381225+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.381225+0000', 'last_undegraded': '2024-04-25T08:54:34.381225+0000', 'last_fullsized': '2024-04-25T08:54:34.381225+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.380014+0000', 'last_change': '2024-04-25T08:54:34.380014+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.380014+0000', 'last_undegraded': '2024-04-25T08:54:34.380014+0000', 'last_fullsized': '2024-04-25T08:54:34.380014+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.381563+0000', 'last_change': '2024-04-25T08:54:34.381563+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.381563+0000', 'last_undegraded': '2024-04-25T08:54:34.381563+0000', 'last_fullsized': '2024-04-25T08:54:34.381563+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.377683+0000', 'last_change': '2024-04-25T08:54:34.377683+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.377683+0000', 'last_undegraded': '2024-04-25T08:54:34.377683+0000', 'last_fullsized': '2024-04-25T08:54:34.377683+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-25T08:54:40.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-25T08:54:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.379882+0000', 'last_change': '2024-04-25T08:54:34.379882+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.379882+0000', 'last_undegraded': '2024-04-25T08:54:34.379882+0000', 'last_fullsized': '2024-04-25T08:54:34.379882+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:54:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-25T08:54:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-25T08:54:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.381941+0000', 'last_change': '2024-04-25T08:54:34.381941+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.381941+0000', 'last_undegraded': '2024-04-25T08:54:34.381941+0000', 'last_fullsized': '2024-04-25T08:54:34.381941+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:54:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-25T08:54:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.380305+0000', 'last_change': '2024-04-25T08:54:34.380305+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.380305+0000', 'last_undegraded': '2024-04-25T08:54:34.380305+0000', 'last_fullsized': '2024-04-25T08:54:34.380305+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:54:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-25T08:54:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.382369+0000', 'last_change': '2024-04-25T08:54:34.382369+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.382369+0000', 'last_undegraded': '2024-04-25T08:54:34.382369+0000', 'last_fullsized': '2024-04-25T08:54:34.382369+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.382202+0000', 'last_change': '2024-04-25T08:54:34.382202+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.382202+0000', 'last_undegraded': '2024-04-25T08:54:34.382202+0000', 'last_fullsized': '2024-04-25T08:54:34.382202+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-25T08:54:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-25T08:54:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.381639+0000', 'last_change': '2024-04-25T08:54:34.381639+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.381639+0000', 'last_undegraded': '2024-04-25T08:54:34.381639+0000', 'last_fullsized': '2024-04-25T08:54:34.381639+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:54:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-25T08:54:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.380083+0000', 'last_change': '2024-04-25T08:54:34.380083+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.380083+0000', 'last_undegraded': '2024-04-25T08:54:34.380083+0000', 'last_fullsized': '2024-04-25T08:54:34.380083+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:54:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-25T08:54:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-25T08:54:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.382030+0000', 'last_change': '2024-04-25T08:54:34.382030+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.382030+0000', 'last_undegraded': '2024-04-25T08:54:34.382030+0000', 'last_fullsized': '2024-04-25T08:54:34.382030+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:54:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-25T08:54:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-25T08:54:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.377793+0000', 'last_change': '2024-04-25T08:54:34.377793+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.377793+0000', 'last_undegraded': '2024-04-25T08:54:34.377793+0000', 'last_fullsized': '2024-04-25T08:54:34.377793+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:54:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-25T08:54:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-25T08:54:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.377488+0000', 'last_change': '2024-04-25T08:54:34.377488+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.377488+0000', 'last_undegraded': '2024-04-25T08:54:34.377488+0000', 'last_fullsized': '2024-04-25T08:54:34.377488+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:54:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-25T08:54:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-25T08:54:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.381181+0000', 'last_change': '2024-04-25T08:54:34.381181+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.381181+0000', 'last_undegraded': '2024-04-25T08:54:34.381181+0000', 'last_fullsized': '2024-04-25T08:54:34.381181+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:54:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-25T08:54:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-25T08:54:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.379921+0000', 'last_change': '2024-04-25T08:54:34.379921+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.379921+0000', 'last_undegraded': '2024-04-25T08:54:34.379921+0000', 'last_fullsized': '2024-04-25T08:54:34.379921+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:54:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-25T08:54:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-25T08:54:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-25T08:54:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.377142+0000', 'last_change': '2024-04-25T08:54:34.377142+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.377142+0000', 'last_undegraded': '2024-04-25T08:54:34.377142+0000', 'last_fullsized': '2024-04-25T08:54:34.377142+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:54:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-25T08:54:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.377294+0000', 'last_change': '2024-04-25T08:54:34.377294+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.377294+0000', 'last_undegraded': '2024-04-25T08:54:34.377294+0000', 'last_fullsized': '2024-04-25T08:54:34.377294+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.380604+0000', 'last_change': '2024-04-25T08:54:34.380604+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.380604+0000', 'last_undegraded': '2024-04-25T08:54:34.380604+0000', 'last_fullsized': '2024-04-25T08:54:34.380604+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-25T08:54:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.382616+0000', 'last_change': '2024-04-25T08:54:34.382616+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.382616+0000', 'last_undegraded': '2024-04-25T08:54:34.382616+0000', 'last_fullsized': '2024-04-25T08:54:34.382616+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:54:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-25T08:54:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:54:35.374522+0000', 'last_change': '2024-04-25T08:54:35.374522+0000', 'last_active': '2024-04-25T08:54:35.374522+0000', 'last_peered': '2024-04-25T08:54:35.374522+0000', 'last_clean': '2024-04-25T08:54:35.374522+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:35.374522+0000', 'last_undegraded': '2024-04-25T08:54:35.374522+0000', 'last_fullsized': '2024-04-25T08:54:35.374522+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:35.374522+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:54:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-25T08:54:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:54:34.377487+0000', 'last_change': '2024-04-25T08:54:34.377487+0000', 'last_active': '2024-04-25T08:54:34.372375+0000', 'last_peered': '2024-04-25T08:54:34.372375+0000', 'last_clean': '2024-04-25T08:54:34.372375+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:54:34.377487+0000', 'last_undegraded': '2024-04-25T08:54:34.377487+0000', 'last_fullsized': '2024-04-25T08:54:34.377487+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'last_clean_scrub_stamp': '2024-04-25T08:54:34.372375+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:54:40.112 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:54:40.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.243+0000 7f224bd90640 1 Processor -- start 2024-04-25T08:54:40.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.244+0000 7f224bd90640 1 -- start start 2024-04-25T08:54:40.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.244+0000 7f224bd90640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f224415dc30 0x7f224406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.244+0000 7f224bd90640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22440b1b30 0x7f22440d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.244+0000 7f224bd90640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224406c1f0 con 0x7f224406cc00 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.244+0000 7f224bd90640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22440cfb40 con 0x7f224415dc30 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.244+0000 7f224bd90640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22440b2060 con 0x7f22440b1b30 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.245+0000 7f2249b2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f224415dc30 0x7f224406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.245+0000 7f224932b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f224406cc00 0x7f22440b1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56272/0 (socket says 172.21.15.55:56272) 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.245+0000 7f224932b640 1 -- 172.21.15.55:0/488371045 learned_addr learned my addr 172.21.15.55:0/488371045 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.245+0000 7f224a32d640 1 --2- 172.21.15.55:0/488371045 >> v2:172.21.15.167:3300/0 conn(0x7f22440b1b30 0x7f22440d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.245+0000 7f2249b2c640 1 -- 172.21.15.55:0/488371045 >> v2:172.21.15.167:3300/0 conn(0x7f22440b1b30 msgr2=0x7f22440d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.245+0000 7f2249b2c640 1 --2- 172.21.15.55:0/488371045 >> v2:172.21.15.167:3300/0 conn(0x7f22440b1b30 0x7f22440d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.245+0000 7f2249b2c640 1 -- 172.21.15.55:0/488371045 >> v1:172.21.15.55:6789/0 conn(0x7f224406cc00 legacy=0x7f22440b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.245+0000 7f2249b2c640 1 -- 172.21.15.55:0/488371045 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440b2340 con 0x7f224415dc30 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.245+0000 7f2248b2a640 1 -- 172.21.15.55:0/488371045 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465950561 0 0) 0x7f2234001110 con 0x7f224406cc00 2024-04-25T08:54:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.246+0000 7f2249b2c640 1 --2- 172.21.15.55:0/488371045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224415dc30 0x7f224406c6c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f22440b7990 tx=0x7f224002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e779672a098449 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.246+0000 7f2248b2a640 1 -- 172.21.15.55:0/488371045 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240037070 con 0x7f224415dc30 2024-04-25T08:54:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.246+0000 7f2248b2a640 1 -- 172.21.15.55:0/488371045 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2240032440 con 0x7f224415dc30 2024-04-25T08:54:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.246+0000 7f2248b2a640 1 -- 172.21.15.55:0/488371045 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240032810 con 0x7f224415dc30 2024-04-25T08:54:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.246+0000 7f224bd90640 1 -- 172.21.15.55:0/488371045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224415dc30 msgr2=0x7f224406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.246+0000 7f224bd90640 1 --2- 172.21.15.55:0/488371045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224415dc30 0x7f224406c6c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f22440b7990 tx=0x7f224002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.246+0000 7f224bd90640 1 -- 172.21.15.55:0/488371045 shutdown_connections 2024-04-25T08:54:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.246+0000 7f224bd90640 1 --2- 172.21.15.55:0/488371045 >> v2:172.21.15.167:3300/0 conn(0x7f22440b1b30 0x7f22440d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.246+0000 7f224bd90640 1 --2- 172.21.15.55:0/488371045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224415dc30 0x7f224406c6c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.246+0000 7f224bd90640 1 -- 172.21.15.55:0/488371045 >> 172.21.15.55:0/488371045 conn(0x7f22440d1900 msgr2=0x7f22440d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.247+0000 7f224bd90640 1 -- 172.21.15.55:0/488371045 shutdown_connections 2024-04-25T08:54:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.247+0000 7f224bd90640 1 -- 172.21.15.55:0/488371045 wait complete. 2024-04-25T08:54:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.248+0000 7f224bd90640 1 Processor -- start 2024-04-25T08:54:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.248+0000 7f224bd90640 1 -- start start 2024-04-25T08:54:40.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.248+0000 7f224bd90640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224406cc00 0x7f22440b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.248+0000 7f224bd90640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22440b1b30 0x7f22440ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.248+0000 7f224bd90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224415dc30 0x7f22440caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.248+0000 7f224bd90640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224415e010 con 0x7f224415dc30 2024-04-25T08:54:40.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.248+0000 7f224bd90640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440cfde0 con 0x7f22440b1b30 2024-04-25T08:54:40.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.248+0000 7f224bd90640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22440d0840 con 0x7f224406cc00 2024-04-25T08:54:40.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224a32d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224415dc30 0x7f22440caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224a32d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224415dc30 0x7f22440caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56668/0 (socket says 172.21.15.55:56668) 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224a32d640 1 -- 172.21.15.55:0/2688428022 learned_addr learned my addr 172.21.15.55:0/2688428022 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f2249b2c640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224406cc00 0x7f22440b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224932b640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22440b1b30 0x7f22440ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224a32d640 1 -- 172.21.15.55:0/2688428022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224406cc00 msgr2=0x7f22440b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224a32d640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224406cc00 0x7f22440b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224a32d640 1 -- 172.21.15.55:0/2688428022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22440b1b30 msgr2=0x7f22440ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224a32d640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22440b1b30 0x7f22440ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224a32d640 1 -- 172.21.15.55:0/2688428022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2244158240 con 0x7f224415dc30 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224932b640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22440b1b30 0x7f22440ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224a32d640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224415dc30 0x7f22440caf30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f223c007e40 tx=0x7f223c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f223a7fc640 1 -- 172.21.15.55:0/2688428022 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c014620 con 0x7f224415dc30 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f223a7fc640 1 -- 172.21.15.55:0/2688428022 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c019070 con 0x7f224415dc30 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224bd90640 1 -- 172.21.15.55:0/2688428022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2244157570 con 0x7f224415dc30 2024-04-25T08:54:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f223a7fc640 1 -- 172.21.15.55:0/2688428022 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c014a20 con 0x7f224415dc30 2024-04-25T08:54:40.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.249+0000 7f224bd90640 1 -- 172.21.15.55:0/2688428022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2244157b30 con 0x7f224415dc30 2024-04-25T08:54:40.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.250+0000 7f224bd90640 1 -- 172.21.15.55:0/2688428022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2244067850 con 0x7f224415dc30 2024-04-25T08:54:40.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.251+0000 7f223a7fc640 1 -- 172.21.15.55:0/2688428022 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f223c014bc0 con 0x7f224415dc30 2024-04-25T08:54:40.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.251+0000 7f223a7fc640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222806b500 0x7f222806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.251+0000 7f223a7fc640 1 -- 172.21.15.55:0/2688428022 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f223c08aa90 con 0x7f224415dc30 2024-04-25T08:54:40.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.251+0000 7f2249b2c640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222806b500 0x7f222806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.251+0000 7f2249b2c640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222806b500 0x7f222806d9c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2240034000 tx=0x7f224002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:40.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.255+0000 7f223a7fc640 1 -- 172.21.15.55:0/2688428022 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f223c059910 con 0x7f224415dc30 2024-04-25T08:54:40.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.517+0000 7f224bd90640 1 -- 172.21.15.55:0/2688428022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f224415e400 con 0x7f224415dc30 2024-04-25T08:54:40.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.517+0000 7f223a7fc640 1 -- 172.21.15.55:0/2688428022 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1720 (secure 0 0 0) 0x7f223c059210 con 0x7f224415dc30 2024-04-25T08:54:40.507 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:40.507 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":82,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":36,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035209,"num_in_osds":8,"osd_in_since":1714035200,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":56},{"state_name":"creating+peering","count":27},{"state_name":"active+clean","count":14}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590390,"bytes_used":242479104,"bytes_avail":772851634176,"bytes_total":773094113280,"unknown_pgs_ratio":0.57731956243515015,"inactive_pgs_ratio":0.27835050225257874,"write_bytes_sec":244,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5127}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-25T08:54:30.561551+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:54:40.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 -- 172.21.15.55:0/2688428022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222806b500 msgr2=0x7f222806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222806b500 0x7f222806d9c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2240034000 tx=0x7f224002e000 comp rx=0 tx=0).stop 2024-04-25T08:54:40.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 -- 172.21.15.55:0/2688428022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224415dc30 msgr2=0x7f22440caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224415dc30 0x7f22440caf30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f223c007e40 tx=0x7f223c00e4b0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 -- 172.21.15.55:0/2688428022 shutdown_connections 2024-04-25T08:54:40.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222806b500 0x7f222806d9c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224415dc30 0x7f22440caf30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22440b1b30 0x7f22440ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 --2- 172.21.15.55:0/2688428022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224406cc00 0x7f22440b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 -- 172.21.15.55:0/2688428022 >> 172.21.15.55:0/2688428022 conn(0x7f22440d1900 msgr2=0x7f22440702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:40.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 -- 172.21.15.55:0/2688428022 shutdown_connections 2024-04-25T08:54:40.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.519+0000 7f224bd90640 1 -- 172.21.15.55:0/2688428022 wait complete. 2024-04-25T08:54:40.520 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:54:40.520 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:54:40.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.631+0000 7f472e693640 1 Processor -- start 2024-04-25T08:54:40.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.631+0000 7f472e693640 1 -- start start 2024-04-25T08:54:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f472e693640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47280ae9a0 0x7f47280b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f472e693640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47280b2c60 0x7f47280b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f472e693640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472806d550 con 0x7f4728071190 2024-04-25T08:54:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f472e693640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472806d830 con 0x7f47280ae9a0 2024-04-25T08:54:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f472e693640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472806db10 con 0x7f47280b2c60 2024-04-25T08:54:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f47277fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47280ae9a0 0x7f47280b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f47277fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47280ae9a0 0x7f47280b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56676/0 (socket says 172.21.15.55:56676) 2024-04-25T08:54:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f47277fe640 1 -- 172.21.15.55:0/1167719678 learned_addr learned my addr 172.21.15.55:0/1167719678 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f472cc30640 1 --2- 172.21.15.55:0/1167719678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47280b2c60 0x7f47280b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f47277fe640 1 -- 172.21.15.55:0/1167719678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47280b2c60 msgr2=0x7f47280b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f47277fe640 1 --2- 172.21.15.55:0/1167719678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47280b2c60 0x7f47280b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f47277fe640 1 -- 172.21.15.55:0/1167719678 >> v1:172.21.15.167:6789/0 conn(0x7f4728071190 legacy=0x7f4728071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.632+0000 7f47277fe640 1 -- 172.21.15.55:0/1167719678 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472806ddf0 con 0x7f47280ae9a0 2024-04-25T08:54:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.633+0000 7f47277fe640 1 --2- 172.21.15.55:0/1167719678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47280ae9a0 0x7f47280b2720 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f47180098a0 tx=0x7f471802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8104b7e0b95d68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.633+0000 7f4726ffd640 1 -- 172.21.15.55:0/1167719678 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718037070 con 0x7f47280ae9a0 2024-04-25T08:54:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.633+0000 7f4726ffd640 1 -- 172.21.15.55:0/1167719678 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4718032440 con 0x7f47280ae9a0 2024-04-25T08:54:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.633+0000 7f4726ffd640 1 -- 172.21.15.55:0/1167719678 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718032810 con 0x7f47280ae9a0 2024-04-25T08:54:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.634+0000 7f472e693640 1 -- 172.21.15.55:0/1167719678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47280ae9a0 msgr2=0x7f47280b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.634+0000 7f472e693640 1 --2- 172.21.15.55:0/1167719678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47280ae9a0 0x7f47280b2720 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f47180098a0 tx=0x7f471802a290 comp rx=0 tx=0).stop 2024-04-25T08:54:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.634+0000 7f472e693640 1 -- 172.21.15.55:0/1167719678 shutdown_connections 2024-04-25T08:54:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.634+0000 7f472e693640 1 --2- 172.21.15.55:0/1167719678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47280b2c60 0x7f47280b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.634+0000 7f472e693640 1 --2- 172.21.15.55:0/1167719678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47280ae9a0 0x7f47280b2720 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.634+0000 7f472e693640 1 -- 172.21.15.55:0/1167719678 >> 172.21.15.55:0/1167719678 conn(0x7f472806aba0 msgr2=0x7f472806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.634+0000 7f472e693640 1 -- 172.21.15.55:0/1167719678 shutdown_connections 2024-04-25T08:54:40.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.634+0000 7f472e693640 1 -- 172.21.15.55:0/1167719678 wait complete. 2024-04-25T08:54:40.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.635+0000 7f472e693640 1 Processor -- start 2024-04-25T08:54:40.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.635+0000 7f472e693640 1 -- start start 2024-04-25T08:54:40.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472e693640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4728071190 0x7f47280b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472e693640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47280ae9a0 0x7f472814b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472e693640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47280b2c60 0x7f4728149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472e693640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472806e8b0 con 0x7f47280b2c60 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472e693640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47280aee30 con 0x7f47280ae9a0 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472e693640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472806d1b0 con 0x7f4728071190 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472cc30640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47280b2c60 0x7f4728149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472cc30640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47280b2c60 0x7f4728149c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56678/0 (socket says 172.21.15.55:56678) 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472cc30640 1 -- 172.21.15.55:0/466029540 learned_addr learned my addr 172.21.15.55:0/466029540 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f4727fff640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4728071190 0x7f47280b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f47277fe640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47280ae9a0 0x7f472814b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472cc30640 1 -- 172.21.15.55:0/466029540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4728071190 msgr2=0x7f47280b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472cc30640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4728071190 0x7f47280b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472cc30640 1 -- 172.21.15.55:0/466029540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47280ae9a0 msgr2=0x7f472814b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472cc30640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47280ae9a0 0x7f472814b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.636+0000 7f472cc30640 1 -- 172.21.15.55:0/466029540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472814a500 con 0x7f47280b2c60 2024-04-25T08:54:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.637+0000 7f472cc30640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47280b2c60 0x7f4728149c40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f472000efc0 tx=0x7f472000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.637+0000 7f4724ff9640 1 -- 172.21.15.55:0/466029540 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720018020 con 0x7f47280b2c60 2024-04-25T08:54:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.637+0000 7f4724ff9640 1 -- 172.21.15.55:0/466029540 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4720014480 con 0x7f47280b2c60 2024-04-25T08:54:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.637+0000 7f472e693640 1 -- 172.21.15.55:0/466029540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472814a7e0 con 0x7f47280b2c60 2024-04-25T08:54:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.637+0000 7f4724ff9640 1 -- 172.21.15.55:0/466029540 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720014870 con 0x7f47280b2c60 2024-04-25T08:54:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.637+0000 7f472e693640 1 -- 172.21.15.55:0/466029540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472814ff40 con 0x7f47280b2c60 2024-04-25T08:54:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.638+0000 7f472e693640 1 -- 172.21.15.55:0/466029540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47280749b0 con 0x7f47280b2c60 2024-04-25T08:54:40.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.638+0000 7f4724ff9640 1 -- 172.21.15.55:0/466029540 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4720005d10 con 0x7f47280b2c60 2024-04-25T08:54:40.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.639+0000 7f4724ff9640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f471406b500 0x7f471406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.639+0000 7f4724ff9640 1 -- 172.21.15.55:0/466029540 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f472008ab00 con 0x7f47280b2c60 2024-04-25T08:54:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.639+0000 7f4727fff640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f471406b500 0x7f471406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.639+0000 7f4727fff640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f471406b500 0x7f471406d9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f471c001780 tx=0x7f471c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:40.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.643+0000 7f4724ff9640 1 -- 172.21.15.55:0/466029540 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4720022070 con 0x7f47280b2c60 2024-04-25T08:54:40.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.821+0000 7f472e693640 1 -- 172.21.15.55:0/466029540 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f472814a180 con 0x7f471406b500 2024-04-25T08:54:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.827+0000 7f4724ff9640 1 -- 172.21.15.55:0/466029540 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251943 (secure 0 0 0) 0x7f471c001420 con 0x7f471406b500 2024-04-25T08:54:40.819 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:40.821 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:54:40.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 -- 172.21.15.55:0/466029540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f471406b500 msgr2=0x7f471406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f471406b500 0x7f471406d9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f471c001780 tx=0x7f471c009040 comp rx=0 tx=0).stop 2024-04-25T08:54:40.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 -- 172.21.15.55:0/466029540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47280b2c60 msgr2=0x7f4728149c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:40.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47280b2c60 0x7f4728149c40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f472000efc0 tx=0x7f472000c490 comp rx=0 tx=0).stop 2024-04-25T08:54:40.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 -- 172.21.15.55:0/466029540 shutdown_connections 2024-04-25T08:54:40.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f471406b500 0x7f471406d9c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47280b2c60 0x7f4728149c40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47280ae9a0 0x7f472814b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 --2- 172.21.15.55:0/466029540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4728071190 0x7f47280b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:40.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 -- 172.21.15.55:0/466029540 >> 172.21.15.55:0/466029540 conn(0x7f472806aba0 msgr2=0x7f472814e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:40.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 -- 172.21.15.55:0/466029540 shutdown_connections 2024-04-25T08:54:40.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:40.830+0000 7f472e693640 1 -- 172.21.15.55:0/466029540 wait complete. 2024-04-25T08:54:40.831 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-04-25T08:54:40.562800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237132,"kb_used_data":4320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737588,"statfs":{"total":773094113280,"available":772851290112,"internally_reserved":0,"allocated":4423680,"data_stored":2426119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000783"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386790+0000","last_change":"2024-04-25T08:54:36.392752+0000","last_active":"2024-04-25T08:54:37.386790+0000","last_peered":"2024-04-25T08:54:37.386790+0000","last_clean":"2024-04-25T08:54:37.386790+0000","last_became_active":"2024-04-25T08:54:36.392423+0000","last_became_peered":"2024-04-25T08:54:36.392423+0000","last_unstale":"2024-04-25T08:54:37.386790+0000","last_undegraded":"2024-04-25T08:54:37.386790+0000","last_fullsized":"2024-04-25T08:54:37.386790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:23.813689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387417+0000","last_change":"2024-04-25T08:54:36.419350+0000","last_active":"2024-04-25T08:54:37.387417+0000","last_peered":"2024-04-25T08:54:37.387417+0000","last_clean":"2024-04-25T08:54:37.387417+0000","last_became_active":"2024-04-25T08:54:36.419045+0000","last_became_peered":"2024-04-25T08:54:36.419045+0000","last_unstale":"2024-04-25T08:54:37.387417+0000","last_undegraded":"2024-04-25T08:54:37.387417+0000","last_fullsized":"2024-04-25T08:54:37.387417+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:26.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933117+0000","last_change":"2024-04-25T08:54:36.410959+0000","last_active":"2024-04-25T08:54:37.933117+0000","last_peered":"2024-04-25T08:54:37.933117+0000","last_clean":"2024-04-25T08:54:37.933117+0000","last_became_active":"2024-04-25T08:54:36.410754+0000","last_became_peered":"2024-04-25T08:54:36.410754+0000","last_unstale":"2024-04-25T08:54:37.933117+0000","last_undegraded":"2024-04-25T08:54:37.933117+0000","last_fullsized":"2024-04-25T08:54:37.933117+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:19.460450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417844+0000","last_change":"2024-04-25T08:54:36.412325+0000","last_active":"2024-04-25T08:54:36.417844+0000","last_peered":"2024-04-25T08:54:36.417844+0000","last_clean":"2024-04-25T08:54:36.417844+0000","last_became_active":"2024-04-25T08:54:36.411987+0000","last_became_peered":"2024-04-25T08:54:36.411987+0000","last_unstale":"2024-04-25T08:54:36.417844+0000","last_undegraded":"2024-04-25T08:54:36.417844+0000","last_fullsized":"2024-04-25T08:54:36.417844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:35.550558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.737903+0000","last_change":"2024-04-25T08:54:36.418443+0000","last_active":"2024-04-25T08:54:37.737903+0000","last_peered":"2024-04-25T08:54:37.737903+0000","last_clean":"2024-04-25T08:54:37.737903+0000","last_became_active":"2024-04-25T08:54:36.418159+0000","last_became_peered":"2024-04-25T08:54:36.418159+0000","last_unstale":"2024-04-25T08:54:37.737903+0000","last_undegraded":"2024-04-25T08:54:37.737903+0000","last_fullsized":"2024-04-25T08:54:37.737903+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:57.373518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386861+0000","last_change":"2024-04-25T08:54:36.418404+0000","last_active":"2024-04-25T08:54:37.386861+0000","last_peered":"2024-04-25T08:54:37.386861+0000","last_clean":"2024-04-25T08:54:37.386861+0000","last_became_active":"2024-04-25T08:54:36.415172+0000","last_became_peered":"2024-04-25T08:54:36.415172+0000","last_unstale":"2024-04-25T08:54:37.386861+0000","last_undegraded":"2024-04-25T08:54:37.386861+0000","last_fullsized":"2024-04-25T08:54:37.386861+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:24.946875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386518+0000","last_change":"2024-04-25T08:54:36.406130+0000","last_active":"2024-04-25T08:54:37.386518+0000","last_peered":"2024-04-25T08:54:37.386518+0000","last_clean":"2024-04-25T08:54:37.386518+0000","last_became_active":"2024-04-25T08:54:36.405669+0000","last_became_peered":"2024-04-25T08:54:36.405669+0000","last_unstale":"2024-04-25T08:54:37.386518+0000","last_undegraded":"2024-04-25T08:54:37.386518+0000","last_fullsized":"2024-04-25T08:54:37.386518+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:16.391684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386603+0000","last_change":"2024-04-25T08:54:36.402940+0000","last_active":"2024-04-25T08:54:37.386603+0000","last_peered":"2024-04-25T08:54:37.386603+0000","last_clean":"2024-04-25T08:54:37.386603+0000","last_became_active":"2024-04-25T08:54:36.402622+0000","last_became_peered":"2024-04-25T08:54:36.402622+0000","last_unstale":"2024-04-25T08:54:37.386603+0000","last_undegraded":"2024-04-25T08:54:37.386603+0000","last_fullsized":"2024-04-25T08:54:37.386603+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:19.460450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933790+0000","last_change":"2024-04-25T08:54:36.415118+0000","last_active":"2024-04-25T08:54:37.933790+0000","last_peered":"2024-04-25T08:54:37.933790+0000","last_clean":"2024-04-25T08:54:37.933790+0000","last_became_active":"2024-04-25T08:54:36.414819+0000","last_became_peered":"2024-04-25T08:54:36.414819+0000","last_unstale":"2024-04-25T08:54:37.933790+0000","last_undegraded":"2024-04-25T08:54:37.933790+0000","last_fullsized":"2024-04-25T08:54:37.933790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:07.530091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.421771+0000","last_change":"2024-04-25T08:54:36.418746+0000","last_active":"2024-04-25T08:54:36.421771+0000","last_peered":"2024-04-25T08:54:36.421771+0000","last_clean":"2024-04-25T08:54:36.421771+0000","last_became_active":"2024-04-25T08:54:36.418469+0000","last_became_peered":"2024-04-25T08:54:36.418469+0000","last_unstale":"2024-04-25T08:54:36.421771+0000","last_undegraded":"2024-04-25T08:54:36.421771+0000","last_fullsized":"2024-04-25T08:54:36.421771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:41.670068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386385+0000","last_change":"2024-04-25T08:54:36.414382+0000","last_active":"2024-04-25T08:54:37.386385+0000","last_peered":"2024-04-25T08:54:37.386385+0000","last_clean":"2024-04-25T08:54:37.386385+0000","last_became_active":"2024-04-25T08:54:36.414148+0000","last_became_peered":"2024-04-25T08:54:36.414148+0000","last_unstale":"2024-04-25T08:54:37.386385+0000","last_undegraded":"2024-04-25T08:54:37.386385+0000","last_fullsized":"2024-04-25T08:54:37.386385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:13.262322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933228+0000","last_change":"2024-04-25T08:54:36.410669+0000","last_active":"2024-04-25T08:54:37.933228+0000","last_peered":"2024-04-25T08:54:37.933228+0000","last_clean":"2024-04-25T08:54:37.933228+0000","last_became_active":"2024-04-25T08:54:36.410348+0000","last_became_peered":"2024-04-25T08:54:36.410348+0000","last_unstale":"2024-04-25T08:54:37.933228+0000","last_undegraded":"2024-04-25T08:54:37.933228+0000","last_fullsized":"2024-04-25T08:54:37.933228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:27.653596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.737937+0000","last_change":"2024-04-25T08:54:36.412317+0000","last_active":"2024-04-25T08:54:37.737937+0000","last_peered":"2024-04-25T08:54:37.737937+0000","last_clean":"2024-04-25T08:54:37.737937+0000","last_became_active":"2024-04-25T08:54:36.412048+0000","last_became_peered":"2024-04-25T08:54:36.412048+0000","last_unstale":"2024-04-25T08:54:37.737937+0000","last_undegraded":"2024-04-25T08:54:37.737937+0000","last_fullsized":"2024-04-25T08:54:37.737937+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:58.198913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386973+0000","last_change":"2024-04-25T08:54:36.418749+0000","last_active":"2024-04-25T08:54:37.386973+0000","last_peered":"2024-04-25T08:54:37.386973+0000","last_clean":"2024-04-25T08:54:37.386973+0000","last_became_active":"2024-04-25T08:54:36.415455+0000","last_became_peered":"2024-04-25T08:54:36.415455+0000","last_unstale":"2024-04-25T08:54:37.386973+0000","last_undegraded":"2024-04-25T08:54:37.386973+0000","last_fullsized":"2024-04-25T08:54:37.386973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:19.460450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932796+0000","last_change":"2024-04-25T08:54:36.392906+0000","last_active":"2024-04-25T08:54:37.932796+0000","last_peered":"2024-04-25T08:54:37.932796+0000","last_clean":"2024-04-25T08:54:37.932796+0000","last_became_active":"2024-04-25T08:54:36.392561+0000","last_became_peered":"2024-04-25T08:54:36.392561+0000","last_unstale":"2024-04-25T08:54:37.932796+0000","last_undegraded":"2024-04-25T08:54:37.932796+0000","last_fullsized":"2024-04-25T08:54:37.932796+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:13.262322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386744+0000","last_change":"2024-04-25T08:54:36.417016+0000","last_active":"2024-04-25T08:54:37.386744+0000","last_peered":"2024-04-25T08:54:37.386744+0000","last_clean":"2024-04-25T08:54:37.386744+0000","last_became_active":"2024-04-25T08:54:36.416753+0000","last_became_peered":"2024-04-25T08:54:36.416753+0000","last_unstale":"2024-04-25T08:54:37.386744+0000","last_undegraded":"2024-04-25T08:54:37.386744+0000","last_fullsized":"2024-04-25T08:54:37.386744+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:35.985816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386962+0000","last_change":"2024-04-25T08:54:36.406485+0000","last_active":"2024-04-25T08:54:37.386962+0000","last_peered":"2024-04-25T08:54:37.386962+0000","last_clean":"2024-04-25T08:54:37.386962+0000","last_became_active":"2024-04-25T08:54:36.405919+0000","last_became_peered":"2024-04-25T08:54:36.405919+0000","last_unstale":"2024-04-25T08:54:37.386962+0000","last_undegraded":"2024-04-25T08:54:37.386962+0000","last_fullsized":"2024-04-25T08:54:37.386962+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:26.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387282+0000","last_change":"2024-04-25T08:54:36.418721+0000","last_active":"2024-04-25T08:54:37.387282+0000","last_peered":"2024-04-25T08:54:37.387282+0000","last_clean":"2024-04-25T08:54:37.387282+0000","last_became_active":"2024-04-25T08:54:36.418449+0000","last_became_peered":"2024-04-25T08:54:36.418449+0000","last_unstale":"2024-04-25T08:54:37.387282+0000","last_undegraded":"2024-04-25T08:54:37.387282+0000","last_fullsized":"2024-04-25T08:54:37.387282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:15.571233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387174+0000","last_change":"2024-04-25T08:54:36.416346+0000","last_active":"2024-04-25T08:54:37.387174+0000","last_peered":"2024-04-25T08:54:37.387174+0000","last_clean":"2024-04-25T08:54:37.387174+0000","last_became_active":"2024-04-25T08:54:36.416041+0000","last_became_peered":"2024-04-25T08:54:36.416041+0000","last_unstale":"2024-04-25T08:54:37.387174+0000","last_undegraded":"2024-04-25T08:54:37.387174+0000","last_fullsized":"2024-04-25T08:54:37.387174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:27.653596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.738214+0000","last_change":"2024-04-25T08:54:36.403608+0000","last_active":"2024-04-25T08:54:37.738214+0000","last_peered":"2024-04-25T08:54:37.738214+0000","last_clean":"2024-04-25T08:54:37.738214+0000","last_became_active":"2024-04-25T08:54:36.403335+0000","last_became_peered":"2024-04-25T08:54:36.403335+0000","last_unstale":"2024-04-25T08:54:37.738214+0000","last_undegraded":"2024-04-25T08:54:37.738214+0000","last_fullsized":"2024-04-25T08:54:37.738214+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:46.585615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933208+0000","last_change":"2024-04-25T08:54:36.409806+0000","last_active":"2024-04-25T08:54:37.933208+0000","last_peered":"2024-04-25T08:54:37.933208+0000","last_clean":"2024-04-25T08:54:37.933208+0000","last_became_active":"2024-04-25T08:54:36.409544+0000","last_became_peered":"2024-04-25T08:54:36.409544+0000","last_unstale":"2024-04-25T08:54:37.933208+0000","last_undegraded":"2024-04-25T08:54:37.933208+0000","last_fullsized":"2024-04-25T08:54:37.933208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:54.778453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933120+0000","last_change":"2024-04-25T08:54:36.421174+0000","last_active":"2024-04-25T08:54:37.933120+0000","last_peered":"2024-04-25T08:54:37.933120+0000","last_clean":"2024-04-25T08:54:37.933120+0000","last_became_active":"2024-04-25T08:54:36.420990+0000","last_became_peered":"2024-04-25T08:54:36.420990+0000","last_unstale":"2024-04-25T08:54:37.933120+0000","last_undegraded":"2024-04-25T08:54:37.933120+0000","last_fullsized":"2024-04-25T08:54:37.933120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:33.714811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932566+0000","last_change":"2024-04-25T08:54:36.410440+0000","last_active":"2024-04-25T08:54:37.932566+0000","last_peered":"2024-04-25T08:54:37.932566+0000","last_clean":"2024-04-25T08:54:37.932566+0000","last_became_active":"2024-04-25T08:54:36.410149+0000","last_became_peered":"2024-04-25T08:54:36.410149+0000","last_unstale":"2024-04-25T08:54:37.932566+0000","last_undegraded":"2024-04-25T08:54:37.932566+0000","last_fullsized":"2024-04-25T08:54:37.932566+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:23.813689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932998+0000","last_change":"2024-04-25T08:54:36.402295+0000","last_active":"2024-04-25T08:54:37.932998+0000","last_peered":"2024-04-25T08:54:37.932998+0000","last_clean":"2024-04-25T08:54:37.932998+0000","last_became_active":"2024-04-25T08:54:36.402010+0000","last_became_peered":"2024-04-25T08:54:36.402010+0000","last_unstale":"2024-04-25T08:54:37.932998+0000","last_undegraded":"2024-04-25T08:54:37.932998+0000","last_fullsized":"2024-04-25T08:54:37.932998+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:24.946875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415462+0000","last_change":"2024-04-25T08:54:36.409846+0000","last_active":"2024-04-25T08:54:36.415462+0000","last_peered":"2024-04-25T08:54:36.415462+0000","last_clean":"2024-04-25T08:54:36.415462+0000","last_became_active":"2024-04-25T08:54:36.409400+0000","last_became_peered":"2024-04-25T08:54:36.409400+0000","last_unstale":"2024-04-25T08:54:36.415462+0000","last_undegraded":"2024-04-25T08:54:36.415462+0000","last_fullsized":"2024-04-25T08:54:36.415462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:54.774408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387435+0000","last_change":"2024-04-25T08:54:36.414690+0000","last_active":"2024-04-25T08:54:37.387435+0000","last_peered":"2024-04-25T08:54:37.387435+0000","last_clean":"2024-04-25T08:54:37.387435+0000","last_became_active":"2024-04-25T08:54:36.414125+0000","last_became_peered":"2024-04-25T08:54:36.414125+0000","last_unstale":"2024-04-25T08:54:37.387435+0000","last_undegraded":"2024-04-25T08:54:37.387435+0000","last_fullsized":"2024-04-25T08:54:37.387435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:48.992952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417898+0000","last_change":"2024-04-25T08:54:36.413975+0000","last_active":"2024-04-25T08:54:36.417898+0000","last_peered":"2024-04-25T08:54:36.417898+0000","last_clean":"2024-04-25T08:54:36.417898+0000","last_became_active":"2024-04-25T08:54:36.413521+0000","last_became_peered":"2024-04-25T08:54:36.413521+0000","last_unstale":"2024-04-25T08:54:36.417898+0000","last_undegraded":"2024-04-25T08:54:36.417898+0000","last_fullsized":"2024-04-25T08:54:36.417898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:29.790880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933403+0000","last_change":"2024-04-25T08:54:36.410151+0000","last_active":"2024-04-25T08:54:37.933403+0000","last_peered":"2024-04-25T08:54:37.933403+0000","last_clean":"2024-04-25T08:54:37.933403+0000","last_became_active":"2024-04-25T08:54:36.409860+0000","last_became_peered":"2024-04-25T08:54:36.409860+0000","last_unstale":"2024-04-25T08:54:37.933403+0000","last_undegraded":"2024-04-25T08:54:37.933403+0000","last_fullsized":"2024-04-25T08:54:37.933403+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:15.571233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933545+0000","last_change":"2024-04-25T08:54:36.407313+0000","last_active":"2024-04-25T08:54:37.933545+0000","last_peered":"2024-04-25T08:54:37.933545+0000","last_clean":"2024-04-25T08:54:37.933545+0000","last_became_active":"2024-04-25T08:54:36.407007+0000","last_became_peered":"2024-04-25T08:54:36.407007+0000","last_unstale":"2024-04-25T08:54:37.933545+0000","last_undegraded":"2024-04-25T08:54:37.933545+0000","last_fullsized":"2024-04-25T08:54:37.933545+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:06.608856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386576+0000","last_change":"2024-04-25T08:54:36.406105+0000","last_active":"2024-04-25T08:54:37.386576+0000","last_peered":"2024-04-25T08:54:37.386576+0000","last_clean":"2024-04-25T08:54:37.386576+0000","last_became_active":"2024-04-25T08:54:36.405704+0000","last_became_peered":"2024-04-25T08:54:36.405704+0000","last_unstale":"2024-04-25T08:54:37.386576+0000","last_undegraded":"2024-04-25T08:54:37.386576+0000","last_fullsized":"2024-04-25T08:54:37.386576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:44.791216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.385952+0000","last_change":"2024-04-25T08:54:36.402441+0000","last_active":"2024-04-25T08:54:37.385952+0000","last_peered":"2024-04-25T08:54:37.385952+0000","last_clean":"2024-04-25T08:54:37.385952+0000","last_became_active":"2024-04-25T08:54:36.401791+0000","last_became_peered":"2024-04-25T08:54:36.401791+0000","last_unstale":"2024-04-25T08:54:37.385952+0000","last_undegraded":"2024-04-25T08:54:37.385952+0000","last_fullsized":"2024-04-25T08:54:37.385952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:46.585615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.385708+0000","last_change":"2024-04-25T08:54:36.407563+0000","last_active":"2024-04-25T08:54:37.385708+0000","last_peered":"2024-04-25T08:54:37.385708+0000","last_clean":"2024-04-25T08:54:37.385708+0000","last_became_active":"2024-04-25T08:54:36.407259+0000","last_became_peered":"2024-04-25T08:54:36.407259+0000","last_unstale":"2024-04-25T08:54:37.385708+0000","last_undegraded":"2024-04-25T08:54:37.385708+0000","last_fullsized":"2024-04-25T08:54:37.385708+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:58.866953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932661+0000","last_change":"2024-04-25T08:54:36.409713+0000","last_active":"2024-04-25T08:54:37.932661+0000","last_peered":"2024-04-25T08:54:37.932661+0000","last_clean":"2024-04-25T08:54:37.932661+0000","last_became_active":"2024-04-25T08:54:36.409413+0000","last_became_peered":"2024-04-25T08:54:36.409413+0000","last_unstale":"2024-04-25T08:54:37.932661+0000","last_undegraded":"2024-04-25T08:54:37.932661+0000","last_fullsized":"2024-04-25T08:54:37.932661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:28.549974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387009+0000","last_change":"2024-04-25T08:54:35.397200+0000","last_active":"2024-04-25T08:54:37.387009+0000","last_peered":"2024-04-25T08:54:37.387009+0000","last_clean":"2024-04-25T08:54:37.387009+0000","last_became_active":"2024-04-25T08:54:35.396905+0000","last_became_peered":"2024-04-25T08:54:35.396905+0000","last_unstale":"2024-04-25T08:54:37.387009+0000","last_undegraded":"2024-04-25T08:54:37.387009+0000","last_fullsized":"2024-04-25T08:54:37.387009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:53.034019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386948+0000","last_change":"2024-04-25T08:54:36.402951+0000","last_active":"2024-04-25T08:54:37.386948+0000","last_peered":"2024-04-25T08:54:37.386948+0000","last_clean":"2024-04-25T08:54:37.386948+0000","last_became_active":"2024-04-25T08:54:36.402655+0000","last_became_peered":"2024-04-25T08:54:36.402655+0000","last_unstale":"2024-04-25T08:54:37.386948+0000","last_undegraded":"2024-04-25T08:54:37.386948+0000","last_fullsized":"2024-04-25T08:54:37.386948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:28.549974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932589+0000","last_change":"2024-04-25T08:54:35.398363+0000","last_active":"2024-04-25T08:54:37.932589+0000","last_peered":"2024-04-25T08:54:37.932589+0000","last_clean":"2024-04-25T08:54:37.932589+0000","last_became_active":"2024-04-25T08:54:35.398047+0000","last_became_peered":"2024-04-25T08:54:35.398047+0000","last_unstale":"2024-04-25T08:54:37.932589+0000","last_undegraded":"2024-04-25T08:54:37.932589+0000","last_fullsized":"2024-04-25T08:54:37.932589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:42.528438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933807+0000","last_change":"2024-04-25T08:54:36.419393+0000","last_active":"2024-04-25T08:54:37.933807+0000","last_peered":"2024-04-25T08:54:37.933807+0000","last_clean":"2024-04-25T08:54:37.933807+0000","last_became_active":"2024-04-25T08:54:36.418929+0000","last_became_peered":"2024-04-25T08:54:36.418929+0000","last_unstale":"2024-04-25T08:54:37.933807+0000","last_undegraded":"2024-04-25T08:54:37.933807+0000","last_fullsized":"2024-04-25T08:54:37.933807+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:15.489761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387076+0000","last_change":"2024-04-25T08:54:35.409527+0000","last_active":"2024-04-25T08:54:37.387076+0000","last_peered":"2024-04-25T08:54:37.387076+0000","last_clean":"2024-04-25T08:54:37.387076+0000","last_became_active":"2024-04-25T08:54:35.409230+0000","last_became_peered":"2024-04-25T08:54:35.409230+0000","last_unstale":"2024-04-25T08:54:37.387076+0000","last_undegraded":"2024-04-25T08:54:37.387076+0000","last_fullsized":"2024-04-25T08:54:37.387076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:53.152232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.417876+0000","last_change":"2024-04-25T08:54:36.412868+0000","last_active":"2024-04-25T08:54:36.417876+0000","last_peered":"2024-04-25T08:54:36.417876+0000","last_clean":"2024-04-25T08:54:36.417876+0000","last_became_active":"2024-04-25T08:54:36.411685+0000","last_became_peered":"2024-04-25T08:54:36.411685+0000","last_unstale":"2024-04-25T08:54:36.417876+0000","last_undegraded":"2024-04-25T08:54:36.417876+0000","last_fullsized":"2024-04-25T08:54:36.417876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:20.842028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.738126+0000","last_change":"2024-04-25T08:54:35.408007+0000","last_active":"2024-04-25T08:54:37.738126+0000","last_peered":"2024-04-25T08:54:37.738126+0000","last_clean":"2024-04-25T08:54:37.738126+0000","last_became_active":"2024-04-25T08:54:35.407673+0000","last_became_peered":"2024-04-25T08:54:35.407673+0000","last_unstale":"2024-04-25T08:54:37.738126+0000","last_undegraded":"2024-04-25T08:54:37.738126+0000","last_fullsized":"2024-04-25T08:54:37.738126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:48.767743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386575+0000","last_change":"2024-04-25T08:54:36.408955+0000","last_active":"2024-04-25T08:54:37.386575+0000","last_peered":"2024-04-25T08:54:37.386575+0000","last_clean":"2024-04-25T08:54:37.386575+0000","last_became_active":"2024-04-25T08:54:36.408054+0000","last_became_peered":"2024-04-25T08:54:36.408054+0000","last_unstale":"2024-04-25T08:54:37.386575+0000","last_undegraded":"2024-04-25T08:54:37.386575+0000","last_fullsized":"2024-04-25T08:54:37.386575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:24.946875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933535+0000","last_change":"2024-04-25T08:54:35.404648+0000","last_active":"2024-04-25T08:54:37.933535+0000","last_peered":"2024-04-25T08:54:37.933535+0000","last_clean":"2024-04-25T08:54:37.933535+0000","last_became_active":"2024-04-25T08:54:35.404392+0000","last_became_peered":"2024-04-25T08:54:35.404392+0000","last_unstale":"2024-04-25T08:54:37.933535+0000","last_undegraded":"2024-04-25T08:54:37.933535+0000","last_fullsized":"2024-04-25T08:54:37.933535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:56.371370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932860+0000","last_change":"2024-04-25T08:54:36.410483+0000","last_active":"2024-04-25T08:54:37.932860+0000","last_peered":"2024-04-25T08:54:37.932860+0000","last_clean":"2024-04-25T08:54:37.932860+0000","last_became_active":"2024-04-25T08:54:36.409983+0000","last_became_peered":"2024-04-25T08:54:36.409983+0000","last_unstale":"2024-04-25T08:54:37.932860+0000","last_undegraded":"2024-04-25T08:54:37.932860+0000","last_fullsized":"2024-04-25T08:54:37.932860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:16.391684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933180+0000","last_change":"2024-04-25T08:54:35.404712+0000","last_active":"2024-04-25T08:54:37.933180+0000","last_peered":"2024-04-25T08:54:37.933180+0000","last_clean":"2024-04-25T08:54:37.933180+0000","last_became_active":"2024-04-25T08:54:35.404385+0000","last_became_peered":"2024-04-25T08:54:35.404385+0000","last_unstale":"2024-04-25T08:54:37.933180+0000","last_undegraded":"2024-04-25T08:54:37.933180+0000","last_fullsized":"2024-04-25T08:54:37.933180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:41.905881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933017+0000","last_change":"2024-04-25T08:54:36.404858+0000","last_active":"2024-04-25T08:54:37.933017+0000","last_peered":"2024-04-25T08:54:37.933017+0000","last_clean":"2024-04-25T08:54:37.933017+0000","last_became_active":"2024-04-25T08:54:36.404246+0000","last_became_peered":"2024-04-25T08:54:36.404246+0000","last_unstale":"2024-04-25T08:54:37.933017+0000","last_undegraded":"2024-04-25T08:54:37.933017+0000","last_fullsized":"2024-04-25T08:54:37.933017+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:43.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386805+0000","last_change":"2024-04-25T08:54:35.409717+0000","last_active":"2024-04-25T08:54:37.386805+0000","last_peered":"2024-04-25T08:54:37.386805+0000","last_clean":"2024-04-25T08:54:37.386805+0000","last_became_active":"2024-04-25T08:54:35.409403+0000","last_became_peered":"2024-04-25T08:54:35.409403+0000","last_unstale":"2024-04-25T08:54:37.386805+0000","last_undegraded":"2024-04-25T08:54:37.386805+0000","last_fullsized":"2024-04-25T08:54:37.386805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:27.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.412739+0000","last_change":"2024-04-25T08:54:36.407767+0000","last_active":"2024-04-25T08:54:36.412739+0000","last_peered":"2024-04-25T08:54:36.412739+0000","last_clean":"2024-04-25T08:54:36.412739+0000","last_became_active":"2024-04-25T08:54:36.407386+0000","last_became_peered":"2024-04-25T08:54:36.407386+0000","last_unstale":"2024-04-25T08:54:36.412739+0000","last_undegraded":"2024-04-25T08:54:36.412739+0000","last_fullsized":"2024-04-25T08:54:36.412739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:19.703713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933078+0000","last_change":"2024-04-25T08:54:35.395351+0000","last_active":"2024-04-25T08:54:37.933078+0000","last_peered":"2024-04-25T08:54:37.933078+0000","last_clean":"2024-04-25T08:54:37.933078+0000","last_became_active":"2024-04-25T08:54:35.395056+0000","last_became_peered":"2024-04-25T08:54:35.395056+0000","last_unstale":"2024-04-25T08:54:37.933078+0000","last_undegraded":"2024-04-25T08:54:37.933078+0000","last_fullsized":"2024-04-25T08:54:37.933078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:37.079096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933164+0000","last_change":"2024-04-25T08:54:36.417536+0000","last_active":"2024-04-25T08:54:37.933164+0000","last_peered":"2024-04-25T08:54:37.933164+0000","last_clean":"2024-04-25T08:54:37.933164+0000","last_became_active":"2024-04-25T08:54:36.417322+0000","last_became_peered":"2024-04-25T08:54:36.417322+0000","last_unstale":"2024-04-25T08:54:37.933164+0000","last_undegraded":"2024-04-25T08:54:37.933164+0000","last_fullsized":"2024-04-25T08:54:37.933164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:35.985816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387360+0000","last_change":"2024-04-25T08:54:35.402753+0000","last_active":"2024-04-25T08:54:37.387360+0000","last_peered":"2024-04-25T08:54:37.387360+0000","last_clean":"2024-04-25T08:54:37.387360+0000","last_became_active":"2024-04-25T08:54:35.402390+0000","last_became_peered":"2024-04-25T08:54:35.402390+0000","last_unstale":"2024-04-25T08:54:37.387360+0000","last_undegraded":"2024-04-25T08:54:37.387360+0000","last_fullsized":"2024-04-25T08:54:37.387360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:05.419864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387335+0000","last_change":"2024-04-25T08:54:36.416749+0000","last_active":"2024-04-25T08:54:37.387335+0000","last_peered":"2024-04-25T08:54:37.387335+0000","last_clean":"2024-04-25T08:54:37.387335+0000","last_became_active":"2024-04-25T08:54:36.416486+0000","last_became_peered":"2024-04-25T08:54:36.416486+0000","last_unstale":"2024-04-25T08:54:37.387335+0000","last_undegraded":"2024-04-25T08:54:37.387335+0000","last_fullsized":"2024-04-25T08:54:37.387335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:57.597879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932697+0000","last_change":"2024-04-25T08:54:35.404905+0000","last_active":"2024-04-25T08:54:37.932697+0000","last_peered":"2024-04-25T08:54:37.932697+0000","last_clean":"2024-04-25T08:54:37.932697+0000","last_became_active":"2024-04-25T08:54:35.404569+0000","last_became_peered":"2024-04-25T08:54:35.404569+0000","last_unstale":"2024-04-25T08:54:37.932697+0000","last_undegraded":"2024-04-25T08:54:37.932697+0000","last_fullsized":"2024-04-25T08:54:37.932697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:35.540652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387548+0000","last_change":"2024-04-25T08:54:36.416890+0000","last_active":"2024-04-25T08:54:37.387548+0000","last_peered":"2024-04-25T08:54:37.387548+0000","last_clean":"2024-04-25T08:54:37.387548+0000","last_became_active":"2024-04-25T08:54:36.416543+0000","last_became_peered":"2024-04-25T08:54:36.416543+0000","last_unstale":"2024-04-25T08:54:37.387548+0000","last_undegraded":"2024-04-25T08:54:37.387548+0000","last_fullsized":"2024-04-25T08:54:37.387548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:34.232898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933175+0000","last_change":"2024-04-25T08:54:35.397471+0000","last_active":"2024-04-25T08:54:37.933175+0000","last_peered":"2024-04-25T08:54:37.933175+0000","last_clean":"2024-04-25T08:54:37.933175+0000","last_became_active":"2024-04-25T08:54:35.397184+0000","last_became_peered":"2024-04-25T08:54:35.397184+0000","last_unstale":"2024-04-25T08:54:37.933175+0000","last_undegraded":"2024-04-25T08:54:37.933175+0000","last_fullsized":"2024-04-25T08:54:37.933175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:22.811542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932959+0000","last_change":"2024-04-25T08:54:36.411140+0000","last_active":"2024-04-25T08:54:37.932959+0000","last_peered":"2024-04-25T08:54:37.932959+0000","last_clean":"2024-04-25T08:54:37.932959+0000","last_became_active":"2024-04-25T08:54:36.410833+0000","last_became_peered":"2024-04-25T08:54:36.410833+0000","last_unstale":"2024-04-25T08:54:37.932959+0000","last_undegraded":"2024-04-25T08:54:37.932959+0000","last_fullsized":"2024-04-25T08:54:37.932959+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:44.791216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387443+0000","last_change":"2024-04-25T08:54:35.412164+0000","last_active":"2024-04-25T08:54:37.387443+0000","last_peered":"2024-04-25T08:54:37.387443+0000","last_clean":"2024-04-25T08:54:37.387443+0000","last_became_active":"2024-04-25T08:54:35.411849+0000","last_became_peered":"2024-04-25T08:54:35.411849+0000","last_unstale":"2024-04-25T08:54:37.387443+0000","last_undegraded":"2024-04-25T08:54:37.387443+0000","last_fullsized":"2024-04-25T08:54:37.387443+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:36.895546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415658+0000","last_change":"2024-04-25T08:54:36.410706+0000","last_active":"2024-04-25T08:54:36.415658+0000","last_peered":"2024-04-25T08:54:36.415658+0000","last_clean":"2024-04-25T08:54:36.415658+0000","last_became_active":"2024-04-25T08:54:36.410365+0000","last_became_peered":"2024-04-25T08:54:36.410365+0000","last_unstale":"2024-04-25T08:54:36.415658+0000","last_undegraded":"2024-04-25T08:54:36.415658+0000","last_fullsized":"2024-04-25T08:54:36.415658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:24.499466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933605+0000","last_change":"2024-04-25T08:54:35.397554+0000","last_active":"2024-04-25T08:54:37.933605+0000","last_peered":"2024-04-25T08:54:37.933605+0000","last_clean":"2024-04-25T08:54:37.933605+0000","last_became_active":"2024-04-25T08:54:35.397264+0000","last_became_peered":"2024-04-25T08:54:35.397264+0000","last_unstale":"2024-04-25T08:54:37.933605+0000","last_undegraded":"2024-04-25T08:54:37.933605+0000","last_fullsized":"2024-04-25T08:54:37.933605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:53.034019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387048+0000","last_change":"2024-04-25T08:54:36.414307+0000","last_active":"2024-04-25T08:54:37.387048+0000","last_peered":"2024-04-25T08:54:37.387048+0000","last_clean":"2024-04-25T08:54:37.387048+0000","last_became_active":"2024-04-25T08:54:36.414015+0000","last_became_peered":"2024-04-25T08:54:36.414015+0000","last_unstale":"2024-04-25T08:54:37.387048+0000","last_undegraded":"2024-04-25T08:54:37.387048+0000","last_fullsized":"2024-04-25T08:54:37.387048+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:35.985816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.390879+0000","last_change":"2024-04-25T08:54:35.406890+0000","last_active":"2024-04-25T08:54:36.390879+0000","last_peered":"2024-04-25T08:54:36.390879+0000","last_clean":"2024-04-25T08:54:36.390879+0000","last_became_active":"2024-04-25T08:54:35.406564+0000","last_became_peered":"2024-04-25T08:54:35.406564+0000","last_unstale":"2024-04-25T08:54:36.390879+0000","last_undegraded":"2024-04-25T08:54:36.390879+0000","last_fullsized":"2024-04-25T08:54:36.390879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:52.728522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386823+0000","last_change":"2024-04-25T08:54:36.408257+0000","last_active":"2024-04-25T08:54:37.386823+0000","last_peered":"2024-04-25T08:54:37.386823+0000","last_clean":"2024-04-25T08:54:37.386823+0000","last_became_active":"2024-04-25T08:54:36.407990+0000","last_became_peered":"2024-04-25T08:54:36.407990+0000","last_unstale":"2024-04-25T08:54:37.386823+0000","last_undegraded":"2024-04-25T08:54:37.386823+0000","last_fullsized":"2024-04-25T08:54:37.386823+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:27.653596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386720+0000","last_change":"2024-04-25T08:54:35.403745+0000","last_active":"2024-04-25T08:54:37.386720+0000","last_peered":"2024-04-25T08:54:37.386720+0000","last_clean":"2024-04-25T08:54:37.386720+0000","last_became_active":"2024-04-25T08:54:35.403119+0000","last_became_peered":"2024-04-25T08:54:35.403119+0000","last_unstale":"2024-04-25T08:54:37.386720+0000","last_undegraded":"2024-04-25T08:54:37.386720+0000","last_fullsized":"2024-04-25T08:54:37.386720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:22.811542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.385975+0000","last_change":"2024-04-25T08:54:36.403375+0000","last_active":"2024-04-25T08:54:37.385975+0000","last_peered":"2024-04-25T08:54:37.385975+0000","last_clean":"2024-04-25T08:54:37.385975+0000","last_became_active":"2024-04-25T08:54:36.403075+0000","last_became_peered":"2024-04-25T08:54:36.403075+0000","last_unstale":"2024-04-25T08:54:37.385975+0000","last_undegraded":"2024-04-25T08:54:37.385975+0000","last_fullsized":"2024-04-25T08:54:37.385975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:06.422011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386876+0000","last_change":"2024-04-25T08:54:35.412058+0000","last_active":"2024-04-25T08:54:37.386876+0000","last_peered":"2024-04-25T08:54:37.386876+0000","last_clean":"2024-04-25T08:54:37.386876+0000","last_became_active":"2024-04-25T08:54:35.411769+0000","last_became_peered":"2024-04-25T08:54:35.411769+0000","last_unstale":"2024-04-25T08:54:37.386876+0000","last_undegraded":"2024-04-25T08:54:37.386876+0000","last_fullsized":"2024-04-25T08:54:37.386876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:45.583467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933387+0000","last_change":"2024-04-25T08:54:36.402536+0000","last_active":"2024-04-25T08:54:37.933387+0000","last_peered":"2024-04-25T08:54:37.933387+0000","last_clean":"2024-04-25T08:54:37.933387+0000","last_became_active":"2024-04-25T08:54:36.402272+0000","last_became_peered":"2024-04-25T08:54:36.402272+0000","last_unstale":"2024-04-25T08:54:37.933387+0000","last_undegraded":"2024-04-25T08:54:37.933387+0000","last_fullsized":"2024-04-25T08:54:37.933387+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:24.231547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.420752+0000","last_change":"2024-04-25T08:54:35.406766+0000","last_active":"2024-04-25T08:54:36.420752+0000","last_peered":"2024-04-25T08:54:36.420752+0000","last_clean":"2024-04-25T08:54:36.420752+0000","last_became_active":"2024-04-25T08:54:35.406301+0000","last_became_peered":"2024-04-25T08:54:35.406301+0000","last_unstale":"2024-04-25T08:54:36.420752+0000","last_undegraded":"2024-04-25T08:54:36.420752+0000","last_fullsized":"2024-04-25T08:54:36.420752+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:20.198029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933575+0000","last_change":"2024-04-25T08:54:36.401605+0000","last_active":"2024-04-25T08:54:37.933575+0000","last_peered":"2024-04-25T08:54:37.933575+0000","last_clean":"2024-04-25T08:54:37.933575+0000","last_became_active":"2024-04-25T08:54:36.401291+0000","last_became_peered":"2024-04-25T08:54:36.401291+0000","last_unstale":"2024-04-25T08:54:37.933575+0000","last_undegraded":"2024-04-25T08:54:37.933575+0000","last_fullsized":"2024-04-25T08:54:37.933575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:57.597879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933298+0000","last_change":"2024-04-25T08:54:35.395543+0000","last_active":"2024-04-25T08:54:37.933298+0000","last_peered":"2024-04-25T08:54:37.933298+0000","last_clean":"2024-04-25T08:54:37.933298+0000","last_became_active":"2024-04-25T08:54:35.395234+0000","last_became_peered":"2024-04-25T08:54:35.395234+0000","last_unstale":"2024-04-25T08:54:37.933298+0000","last_undegraded":"2024-04-25T08:54:37.933298+0000","last_fullsized":"2024-04-25T08:54:37.933298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:42.528438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.415498+0000","last_change":"2024-04-25T08:54:36.408929+0000","last_active":"2024-04-25T08:54:36.415498+0000","last_peered":"2024-04-25T08:54:36.415498+0000","last_clean":"2024-04-25T08:54:36.415498+0000","last_became_active":"2024-04-25T08:54:36.408650+0000","last_became_peered":"2024-04-25T08:54:36.408650+0000","last_unstale":"2024-04-25T08:54:36.415498+0000","last_undegraded":"2024-04-25T08:54:36.415498+0000","last_fullsized":"2024-04-25T08:54:36.415498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:05.278920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933604+0000","last_change":"2024-04-25T08:54:35.398186+0000","last_active":"2024-04-25T08:54:37.933604+0000","last_peered":"2024-04-25T08:54:37.933604+0000","last_clean":"2024-04-25T08:54:37.933604+0000","last_became_active":"2024-04-25T08:54:35.397928+0000","last_became_peered":"2024-04-25T08:54:35.397928+0000","last_unstale":"2024-04-25T08:54:37.933604+0000","last_undegraded":"2024-04-25T08:54:37.933604+0000","last_fullsized":"2024-04-25T08:54:37.933604+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:35.540652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.738068+0000","last_change":"2024-04-25T08:54:36.402809+0000","last_active":"2024-04-25T08:54:37.738068+0000","last_peered":"2024-04-25T08:54:37.738068+0000","last_clean":"2024-04-25T08:54:37.738068+0000","last_became_active":"2024-04-25T08:54:36.402540+0000","last_became_peered":"2024-04-25T08:54:36.402540+0000","last_unstale":"2024-04-25T08:54:37.738068+0000","last_undegraded":"2024-04-25T08:54:37.738068+0000","last_fullsized":"2024-04-25T08:54:37.738068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:27.272228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933735+0000","last_change":"2024-04-25T08:54:35.404666+0000","last_active":"2024-04-25T08:54:37.933735+0000","last_peered":"2024-04-25T08:54:37.933735+0000","last_clean":"2024-04-25T08:54:37.933735+0000","last_became_active":"2024-04-25T08:54:35.404368+0000","last_became_peered":"2024-04-25T08:54:35.404368+0000","last_unstale":"2024-04-25T08:54:37.933735+0000","last_undegraded":"2024-04-25T08:54:37.933735+0000","last_fullsized":"2024-04-25T08:54:37.933735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:57.196765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.737955+0000","last_change":"2024-04-25T08:54:36.401207+0000","last_active":"2024-04-25T08:54:37.737955+0000","last_peered":"2024-04-25T08:54:37.737955+0000","last_clean":"2024-04-25T08:54:37.737955+0000","last_became_active":"2024-04-25T08:54:36.400880+0000","last_became_peered":"2024-04-25T08:54:36.400880+0000","last_unstale":"2024-04-25T08:54:37.737955+0000","last_undegraded":"2024-04-25T08:54:37.737955+0000","last_fullsized":"2024-04-25T08:54:37.737955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:43.530585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933172+0000","last_change":"2024-04-25T08:54:35.408125+0000","last_active":"2024-04-25T08:54:37.933172+0000","last_peered":"2024-04-25T08:54:37.933172+0000","last_clean":"2024-04-25T08:54:37.933172+0000","last_became_active":"2024-04-25T08:54:35.407816+0000","last_became_peered":"2024-04-25T08:54:35.407816+0000","last_unstale":"2024-04-25T08:54:37.933172+0000","last_undegraded":"2024-04-25T08:54:37.933172+0000","last_fullsized":"2024-04-25T08:54:37.933172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:53.034019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.738021+0000","last_change":"2024-04-25T08:54:36.411529+0000","last_active":"2024-04-25T08:54:37.738021+0000","last_peered":"2024-04-25T08:54:37.738021+0000","last_clean":"2024-04-25T08:54:37.738021+0000","last_became_active":"2024-04-25T08:54:36.411236+0000","last_became_peered":"2024-04-25T08:54:36.411236+0000","last_unstale":"2024-04-25T08:54:37.738021+0000","last_undegraded":"2024-04-25T08:54:37.738021+0000","last_fullsized":"2024-04-25T08:54:37.738021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:36.542800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386248+0000","last_change":"2024-04-25T08:54:35.407745+0000","last_active":"2024-04-25T08:54:37.386248+0000","last_peered":"2024-04-25T08:54:37.386248+0000","last_clean":"2024-04-25T08:54:37.386248+0000","last_became_active":"2024-04-25T08:54:35.407432+0000","last_became_peered":"2024-04-25T08:54:35.407432+0000","last_unstale":"2024-04-25T08:54:37.386248+0000","last_undegraded":"2024-04-25T08:54:37.386248+0000","last_fullsized":"2024-04-25T08:54:37.386248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:56.371370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.737905+0000","last_change":"2024-04-25T08:54:36.411470+0000","last_active":"2024-04-25T08:54:37.737905+0000","last_peered":"2024-04-25T08:54:37.737905+0000","last_clean":"2024-04-25T08:54:37.737905+0000","last_became_active":"2024-04-25T08:54:36.411177+0000","last_became_peered":"2024-04-25T08:54:36.411177+0000","last_unstale":"2024-04-25T08:54:37.737905+0000","last_undegraded":"2024-04-25T08:54:37.737905+0000","last_fullsized":"2024-04-25T08:54:37.737905+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:54.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932757+0000","last_change":"2024-04-25T08:54:35.403573+0000","last_active":"2024-04-25T08:54:37.932757+0000","last_peered":"2024-04-25T08:54:37.932757+0000","last_clean":"2024-04-25T08:54:37.932757+0000","last_became_active":"2024-04-25T08:54:35.403231+0000","last_became_peered":"2024-04-25T08:54:35.403231+0000","last_unstale":"2024-04-25T08:54:37.932757+0000","last_undegraded":"2024-04-25T08:54:37.932757+0000","last_fullsized":"2024-04-25T08:54:37.932757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:13.957812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386221+0000","last_change":"2024-04-25T08:54:36.405896+0000","last_active":"2024-04-25T08:54:37.386221+0000","last_peered":"2024-04-25T08:54:37.386221+0000","last_clean":"2024-04-25T08:54:37.386221+0000","last_became_active":"2024-04-25T08:54:36.405614+0000","last_became_peered":"2024-04-25T08:54:36.405614+0000","last_unstale":"2024-04-25T08:54:37.386221+0000","last_undegraded":"2024-04-25T08:54:37.386221+0000","last_fullsized":"2024-04-25T08:54:37.386221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:15.489761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932578+0000","last_change":"2024-04-25T08:54:35.397280+0000","last_active":"2024-04-25T08:54:37.932578+0000","last_peered":"2024-04-25T08:54:37.932578+0000","last_clean":"2024-04-25T08:54:37.932578+0000","last_became_active":"2024-04-25T08:54:35.396990+0000","last_became_peered":"2024-04-25T08:54:35.396990+0000","last_unstale":"2024-04-25T08:54:37.932578+0000","last_undegraded":"2024-04-25T08:54:37.932578+0000","last_fullsized":"2024-04-25T08:54:37.932578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:53.152232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.738067+0000","last_change":"2024-04-25T08:54:36.404421+0000","last_active":"2024-04-25T08:54:37.738067+0000","last_peered":"2024-04-25T08:54:37.738067+0000","last_clean":"2024-04-25T08:54:37.738067+0000","last_became_active":"2024-04-25T08:54:36.404091+0000","last_became_peered":"2024-04-25T08:54:36.404091+0000","last_unstale":"2024-04-25T08:54:37.738067+0000","last_undegraded":"2024-04-25T08:54:37.738067+0000","last_fullsized":"2024-04-25T08:54:37.738067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:37.832154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.412321+0000","last_change":"2024-04-25T08:54:35.406931+0000","last_active":"2024-04-25T08:54:36.412321+0000","last_peered":"2024-04-25T08:54:36.412321+0000","last_clean":"2024-04-25T08:54:36.412321+0000","last_became_active":"2024-04-25T08:54:35.406639+0000","last_became_peered":"2024-04-25T08:54:35.406639+0000","last_unstale":"2024-04-25T08:54:36.412321+0000","last_undegraded":"2024-04-25T08:54:36.412321+0000","last_fullsized":"2024-04-25T08:54:36.412321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:21.339601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933367+0000","last_change":"2024-04-25T08:54:36.408819+0000","last_active":"2024-04-25T08:54:37.933367+0000","last_peered":"2024-04-25T08:54:37.933367+0000","last_clean":"2024-04-25T08:54:37.933367+0000","last_became_active":"2024-04-25T08:54:36.408377+0000","last_became_peered":"2024-04-25T08:54:36.408377+0000","last_unstale":"2024-04-25T08:54:37.933367+0000","last_undegraded":"2024-04-25T08:54:37.933367+0000","last_fullsized":"2024-04-25T08:54:37.933367+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:26.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932766+0000","last_change":"2024-04-25T08:54:35.406814+0000","last_active":"2024-04-25T08:54:37.932766+0000","last_peered":"2024-04-25T08:54:37.932766+0000","last_clean":"2024-04-25T08:54:37.932766+0000","last_became_active":"2024-04-25T08:54:35.406527+0000","last_became_peered":"2024-04-25T08:54:35.406527+0000","last_unstale":"2024-04-25T08:54:37.932766+0000","last_undegraded":"2024-04-25T08:54:37.932766+0000","last_fullsized":"2024-04-25T08:54:37.932766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:26.270081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932992+0000","last_change":"2024-04-25T08:54:36.416957+0000","last_active":"2024-04-25T08:54:37.932992+0000","last_peered":"2024-04-25T08:54:37.932992+0000","last_clean":"2024-04-25T08:54:37.932992+0000","last_became_active":"2024-04-25T08:54:36.416679+0000","last_became_peered":"2024-04-25T08:54:36.416679+0000","last_unstale":"2024-04-25T08:54:37.932992+0000","last_undegraded":"2024-04-25T08:54:37.932992+0000","last_fullsized":"2024-04-25T08:54:37.932992+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:37.897694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.390875+0000","last_change":"2024-04-25T08:54:35.408435+0000","last_active":"2024-04-25T08:54:36.390875+0000","last_peered":"2024-04-25T08:54:36.390875+0000","last_clean":"2024-04-25T08:54:36.390875+0000","last_became_active":"2024-04-25T08:54:35.407831+0000","last_became_peered":"2024-04-25T08:54:35.407831+0000","last_unstale":"2024-04-25T08:54:36.390875+0000","last_undegraded":"2024-04-25T08:54:36.390875+0000","last_fullsized":"2024-04-25T08:54:36.390875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:11.392588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386184+0000","last_change":"2024-04-25T08:54:36.409228+0000","last_active":"2024-04-25T08:54:37.386184+0000","last_peered":"2024-04-25T08:54:37.386184+0000","last_clean":"2024-04-25T08:54:37.386184+0000","last_became_active":"2024-04-25T08:54:36.408925+0000","last_became_peered":"2024-04-25T08:54:36.408925+0000","last_unstale":"2024-04-25T08:54:37.386184+0000","last_undegraded":"2024-04-25T08:54:37.386184+0000","last_fullsized":"2024-04-25T08:54:37.386184+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:54.154379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933279+0000","last_change":"2024-04-25T08:54:35.400328+0000","last_active":"2024-04-25T08:54:37.933279+0000","last_peered":"2024-04-25T08:54:37.933279+0000","last_clean":"2024-04-25T08:54:37.933279+0000","last_became_active":"2024-04-25T08:54:35.400004+0000","last_became_peered":"2024-04-25T08:54:35.400004+0000","last_unstale":"2024-04-25T08:54:37.933279+0000","last_undegraded":"2024-04-25T08:54:37.933279+0000","last_fullsized":"2024-04-25T08:54:37.933279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:57.196765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933173+0000","last_change":"2024-04-25T08:54:36.412085+0000","last_active":"2024-04-25T08:54:37.933173+0000","last_peered":"2024-04-25T08:54:37.933173+0000","last_clean":"2024-04-25T08:54:37.933173+0000","last_became_active":"2024-04-25T08:54:36.411799+0000","last_became_peered":"2024-04-25T08:54:36.411799+0000","last_unstale":"2024-04-25T08:54:37.933173+0000","last_undegraded":"2024-04-25T08:54:37.933173+0000","last_fullsized":"2024-04-25T08:54:37.933173+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:43.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T08:54:36.391074+0000","last_change":"2024-04-25T08:54:35.406919+0000","last_active":"2024-04-25T08:54:36.391074+0000","last_peered":"2024-04-25T08:54:36.391074+0000","last_clean":"2024-04-25T08:54:36.391074+0000","last_became_active":"2024-04-25T08:54:35.406619+0000","last_became_peered":"2024-04-25T08:54:35.406619+0000","last_unstale":"2024-04-25T08:54:36.391074+0000","last_undegraded":"2024-04-25T08:54:36.391074+0000","last_fullsized":"2024-04-25T08:54:36.391074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:42.641822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386803+0000","last_change":"2024-04-25T08:54:36.417588+0000","last_active":"2024-04-25T08:54:37.386803+0000","last_peered":"2024-04-25T08:54:37.386803+0000","last_clean":"2024-04-25T08:54:37.386803+0000","last_became_active":"2024-04-25T08:54:36.417297+0000","last_became_peered":"2024-04-25T08:54:36.417297+0000","last_unstale":"2024-04-25T08:54:37.386803+0000","last_undegraded":"2024-04-25T08:54:37.386803+0000","last_fullsized":"2024-04-25T08:54:37.386803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:44.791216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932866+0000","last_change":"2024-04-25T08:54:35.397373+0000","last_active":"2024-04-25T08:54:37.932866+0000","last_peered":"2024-04-25T08:54:37.932866+0000","last_clean":"2024-04-25T08:54:37.932866+0000","last_became_active":"2024-04-25T08:54:35.396905+0000","last_became_peered":"2024-04-25T08:54:35.396905+0000","last_unstale":"2024-04-25T08:54:37.932866+0000","last_undegraded":"2024-04-25T08:54:37.932866+0000","last_fullsized":"2024-04-25T08:54:37.932866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:04.316677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933602+0000","last_change":"2024-04-25T08:54:36.419276+0000","last_active":"2024-04-25T08:54:37.933602+0000","last_peered":"2024-04-25T08:54:37.933602+0000","last_clean":"2024-04-25T08:54:37.933602+0000","last_became_active":"2024-04-25T08:54:36.418984+0000","last_became_peered":"2024-04-25T08:54:36.418984+0000","last_unstale":"2024-04-25T08:54:37.933602+0000","last_undegraded":"2024-04-25T08:54:37.933602+0000","last_fullsized":"2024-04-25T08:54:37.933602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:58.866953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386745+0000","last_change":"2024-04-25T08:54:35.400997+0000","last_active":"2024-04-25T08:54:37.386745+0000","last_peered":"2024-04-25T08:54:37.386745+0000","last_clean":"2024-04-25T08:54:37.386745+0000","last_became_active":"2024-04-25T08:54:35.400690+0000","last_became_peered":"2024-04-25T08:54:35.400690+0000","last_unstale":"2024-04-25T08:54:37.386745+0000","last_undegraded":"2024-04-25T08:54:37.386745+0000","last_fullsized":"2024-04-25T08:54:37.386745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:36.830007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.385949+0000","last_change":"2024-04-25T08:54:36.404244+0000","last_active":"2024-04-25T08:54:37.385949+0000","last_peered":"2024-04-25T08:54:37.385949+0000","last_clean":"2024-04-25T08:54:37.385949+0000","last_became_active":"2024-04-25T08:54:36.403974+0000","last_became_peered":"2024-04-25T08:54:36.403974+0000","last_unstale":"2024-04-25T08:54:37.385949+0000","last_undegraded":"2024-04-25T08:54:37.385949+0000","last_fullsized":"2024-04-25T08:54:37.385949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:07.530091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386484+0000","last_change":"2024-04-25T08:54:35.392085+0000","last_active":"2024-04-25T08:54:37.386484+0000","last_peered":"2024-04-25T08:54:37.386484+0000","last_clean":"2024-04-25T08:54:37.386484+0000","last_became_active":"2024-04-25T08:54:35.391764+0000","last_became_peered":"2024-04-25T08:54:35.391764+0000","last_unstale":"2024-04-25T08:54:37.386484+0000","last_undegraded":"2024-04-25T08:54:37.386484+0000","last_fullsized":"2024-04-25T08:54:37.386484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:04.316677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":193,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386809+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:54:37.386809+0000","last_peered":"2024-04-25T08:54:37.386809+0000","last_clean":"2024-04-25T08:54:37.386809+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:54:37.386809+0000","last_undegraded":"2024-04-25T08:54:37.386809+0000","last_fullsized":"2024-04-25T08:54:37.386809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":747367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":157525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":157581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":157013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":417792,"data_stored":158543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":156979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":995328,"data_stored":747277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":143834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:54:41.047 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T08:54:41.057+0000 7f2cdfba7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:54:43.835 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:54:43.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.960+0000 7fbbb5dd5640 1 Processor -- start 2024-04-25T08:54:43.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.960+0000 7fbbb5dd5640 1 -- start start 2024-04-25T08:54:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.960+0000 7fbbb5dd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbbb00d35b0 0x7fbbb00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.960+0000 7fbbb5dd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 0x7fbbb00b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.960+0000 7fbbb5dd5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb015e0c0 con 0x7fbbb015dce0 2024-04-25T08:54:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.960+0000 7fbbb5dd5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb00d2510 con 0x7fbbb00d35b0 2024-04-25T08:54:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.960+0000 7fbbb5dd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00d27f0 con 0x7fbbb00b5990 2024-04-25T08:54:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.961+0000 7fbbaeffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbbb00d35b0 0x7fbbb00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.961+0000 7fbbaf7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbbb015dce0 0x7fbbb00d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56282/0 (socket says 172.21.15.55:56282) 2024-04-25T08:54:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.961+0000 7fbbaf7fe640 1 -- 172.21.15.55:0/2741756543 learned_addr learned my addr 172.21.15.55:0/2741756543 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.961+0000 7fbbaffff640 1 --2- 172.21.15.55:0/2741756543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 0x7fbbb00b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.961+0000 7fbbaeffd640 1 -- 172.21.15.55:0/2741756543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 msgr2=0x7fbbb00b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.961+0000 7fbbaeffd640 1 --2- 172.21.15.55:0/2741756543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 0x7fbbb00b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:43.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.961+0000 7fbbaeffd640 1 -- 172.21.15.55:0/2741756543 >> v1:172.21.15.55:6789/0 conn(0x7fbbb015dce0 legacy=0x7fbbb00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:43.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.961+0000 7fbbae7fc640 1 -- 172.21.15.55:0/2741756543 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131563553 0 0) 0x7fbbb015e0c0 con 0x7fbbb015dce0 2024-04-25T08:54:43.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.961+0000 7fbbaeffd640 1 -- 172.21.15.55:0/2741756543 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00d2ad0 con 0x7fbbb00d35b0 2024-04-25T08:54:43.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.961+0000 7fbbaffff640 1 --2- 172.21.15.55:0/2741756543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 0x7fbbb00b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:43.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbaeffd640 1 --2- 172.21.15.55:0/2741756543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb00d35b0 0x7fbbb00b5450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbba40097a0 tx=0x7fbba402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f63ca1543421ea0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:43.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbae7fc640 1 -- 172.21.15.55:0/2741756543 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4037070 con 0x7fbbb00d35b0 2024-04-25T08:54:43.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbae7fc640 1 -- 172.21.15.55:0/2741756543 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba4032440 con 0x7fbbb00d35b0 2024-04-25T08:54:43.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbae7fc640 1 -- 172.21.15.55:0/2741756543 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4032810 con 0x7fbbb00d35b0 2024-04-25T08:54:43.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/2741756543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb00d35b0 msgr2=0x7fbbb00b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:43.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbb5dd5640 1 --2- 172.21.15.55:0/2741756543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb00d35b0 0x7fbbb00b5450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbba40097a0 tx=0x7fbba402a180 comp rx=0 tx=0).stop 2024-04-25T08:54:43.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/2741756543 shutdown_connections 2024-04-25T08:54:43.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbb5dd5640 1 --2- 172.21.15.55:0/2741756543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 0x7fbbb00b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:43.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbb5dd5640 1 --2- 172.21.15.55:0/2741756543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb00d35b0 0x7fbbb00b5450 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:43.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/2741756543 >> 172.21.15.55:0/2741756543 conn(0x7fbbb0072900 msgr2=0x7fbbb00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:43.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/2741756543 shutdown_connections 2024-04-25T08:54:43.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.962+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/2741756543 wait complete. 2024-04-25T08:54:43.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.964+0000 7fbbb5dd5640 1 Processor -- start 2024-04-25T08:54:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.964+0000 7fbbb5dd5640 1 -- start start 2024-04-25T08:54:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbb5dd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 0x7fbbb00b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbb5dd5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbb00d35b0 0x7fbbb014d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbb5dd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015dce0 0x7fbbb015e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbb5dd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00d2160 con 0x7fbbb015dce0 2024-04-25T08:54:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbb5dd5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00d3090 con 0x7fbbb00d35b0 2024-04-25T08:54:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbb5dd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb014bdd0 con 0x7fbbb00b5990 2024-04-25T08:54:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015dce0 0x7fbbb015e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015dce0 0x7fbbb015e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56696/0 (socket says 172.21.15.55:56696) 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaffff640 1 -- 172.21.15.55:0/3168356504 learned_addr learned my addr 172.21.15.55:0/3168356504 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaf7fe640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 0x7fbbb00b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaffff640 1 -- 172.21.15.55:0/3168356504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 msgr2=0x7fbbb00b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaeffd640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbb00d35b0 0x7fbbb014d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaffff640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 0x7fbbb00b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaffff640 1 -- 172.21.15.55:0/3168356504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbb00d35b0 msgr2=0x7fbbb014d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaffff640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbb00d35b0 0x7fbbb014d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaffff640 1 -- 172.21.15.55:0/3168356504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb015a0f0 con 0x7fbbb015dce0 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaf7fe640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 0x7fbbb00b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaeffd640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbb00d35b0 0x7fbbb014d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbaffff640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015dce0 0x7fbbb015e2b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbba800cef0 tx=0x7fbba800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbb97fff640 1 -- 172.21.15.55:0/3168356504 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba801a070 con 0x7fbbb015dce0 2024-04-25T08:54:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbb97fff640 1 -- 172.21.15.55:0/3168356504 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba800d860 con 0x7fbbb015dce0 2024-04-25T08:54:43.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.965+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/3168356504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb014dc90 con 0x7fbbb015dce0 2024-04-25T08:54:43.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.966+0000 7fbb97fff640 1 -- 172.21.15.55:0/3168356504 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba800dc50 con 0x7fbbb015dce0 2024-04-25T08:54:43.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.966+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/3168356504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb014b4a0 con 0x7fbbb015dce0 2024-04-25T08:54:43.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.967+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/3168356504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb00749b0 con 0x7fbbb015dce0 2024-04-25T08:54:43.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.967+0000 7fbb97fff640 1 -- 172.21.15.55:0/3168356504 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbba801d070 con 0x7fbbb015dce0 2024-04-25T08:54:43.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.968+0000 7fbb97fff640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb9c06b4d0 0x7fbb9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:43.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.968+0000 7fbb97fff640 1 -- 172.21.15.55:0/3168356504 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbba808aad0 con 0x7fbbb015dce0 2024-04-25T08:54:43.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.968+0000 7fbbaf7fe640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb9c06b4d0 0x7fbb9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:43.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.968+0000 7fbbaf7fe640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb9c06b4d0 0x7fbb9c06d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000f60 tx=0x7fbba0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:43.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:43.972+0000 7fbb97fff640 1 -- 172.21.15.55:0/3168356504 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbbb015a0f0 con 0x7fbbb015dce0 2024-04-25T08:54:44.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.150+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/3168356504 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbb014bf50 con 0x7fbb9c06b4d0 2024-04-25T08:54:44.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.156+0000 7fbb97fff640 1 -- 172.21.15.55:0/3168356504 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251939 (secure 0 0 0) 0x7fbbb014bf50 con 0x7fbb9c06b4d0 2024-04-25T08:54:44.148 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:44.149 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:54:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.158+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/3168356504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb9c06b4d0 msgr2=0x7fbb9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.158+0000 7fbbb5dd5640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb9c06b4d0 0x7fbb9c06d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000f60 tx=0x7fbba0009040 comp rx=0 tx=0).stop 2024-04-25T08:54:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.158+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/3168356504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015dce0 msgr2=0x7fbbb015e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.158+0000 7fbbb5dd5640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015dce0 0x7fbbb015e2b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbba800cef0 tx=0x7fbba800a710 comp rx=0 tx=0).stop 2024-04-25T08:54:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.158+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/3168356504 shutdown_connections 2024-04-25T08:54:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.158+0000 7fbbb5dd5640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb9c06b4d0 0x7fbb9c06d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.158+0000 7fbbb5dd5640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015dce0 0x7fbbb015e2b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.158+0000 7fbbb5dd5640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbb00d35b0 0x7fbbb014d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.158+0000 7fbbb5dd5640 1 --2- 172.21.15.55:0/3168356504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbb00b5990 0x7fbbb00b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.158+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/3168356504 >> 172.21.15.55:0/3168356504 conn(0x7fbbb0072900 msgr2=0x7fbbb00d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.159+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/3168356504 shutdown_connections 2024-04-25T08:54:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.159+0000 7fbbb5dd5640 1 -- 172.21.15.55:0/3168356504 wait complete. 2024-04-25T08:54:44.159 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-04-25T08:54:42.563193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237172,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737548,"statfs":{"total":773094113280,"available":772851249152,"internally_reserved":0,"allocated":4464640,"data_stored":2440828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.178093"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386790+0000","last_change":"2024-04-25T08:54:36.392752+0000","last_active":"2024-04-25T08:54:37.386790+0000","last_peered":"2024-04-25T08:54:37.386790+0000","last_clean":"2024-04-25T08:54:37.386790+0000","last_became_active":"2024-04-25T08:54:36.392423+0000","last_became_peered":"2024-04-25T08:54:36.392423+0000","last_unstale":"2024-04-25T08:54:37.386790+0000","last_undegraded":"2024-04-25T08:54:37.386790+0000","last_fullsized":"2024-04-25T08:54:37.386790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:23.813689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387417+0000","last_change":"2024-04-25T08:54:36.419350+0000","last_active":"2024-04-25T08:54:37.387417+0000","last_peered":"2024-04-25T08:54:37.387417+0000","last_clean":"2024-04-25T08:54:37.387417+0000","last_became_active":"2024-04-25T08:54:36.419045+0000","last_became_peered":"2024-04-25T08:54:36.419045+0000","last_unstale":"2024-04-25T08:54:37.387417+0000","last_undegraded":"2024-04-25T08:54:37.387417+0000","last_fullsized":"2024-04-25T08:54:37.387417+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:26.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933117+0000","last_change":"2024-04-25T08:54:36.410959+0000","last_active":"2024-04-25T08:54:37.933117+0000","last_peered":"2024-04-25T08:54:37.933117+0000","last_clean":"2024-04-25T08:54:37.933117+0000","last_became_active":"2024-04-25T08:54:36.410754+0000","last_became_peered":"2024-04-25T08:54:36.410754+0000","last_unstale":"2024-04-25T08:54:37.933117+0000","last_undegraded":"2024-04-25T08:54:37.933117+0000","last_fullsized":"2024-04-25T08:54:37.933117+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:19.460450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933054+0000","last_change":"2024-04-25T08:54:36.412325+0000","last_active":"2024-04-25T08:54:37.933054+0000","last_peered":"2024-04-25T08:54:37.933054+0000","last_clean":"2024-04-25T08:54:37.933054+0000","last_became_active":"2024-04-25T08:54:36.411987+0000","last_became_peered":"2024-04-25T08:54:36.411987+0000","last_unstale":"2024-04-25T08:54:37.933054+0000","last_undegraded":"2024-04-25T08:54:37.933054+0000","last_fullsized":"2024-04-25T08:54:37.933054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:45.633995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.737903+0000","last_change":"2024-04-25T08:54:36.418443+0000","last_active":"2024-04-25T08:54:37.737903+0000","last_peered":"2024-04-25T08:54:37.737903+0000","last_clean":"2024-04-25T08:54:37.737903+0000","last_became_active":"2024-04-25T08:54:36.418159+0000","last_became_peered":"2024-04-25T08:54:36.418159+0000","last_unstale":"2024-04-25T08:54:37.737903+0000","last_undegraded":"2024-04-25T08:54:37.737903+0000","last_fullsized":"2024-04-25T08:54:37.737903+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:57.373518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386861+0000","last_change":"2024-04-25T08:54:36.418404+0000","last_active":"2024-04-25T08:54:37.386861+0000","last_peered":"2024-04-25T08:54:37.386861+0000","last_clean":"2024-04-25T08:54:37.386861+0000","last_became_active":"2024-04-25T08:54:36.415172+0000","last_became_peered":"2024-04-25T08:54:36.415172+0000","last_unstale":"2024-04-25T08:54:37.386861+0000","last_undegraded":"2024-04-25T08:54:37.386861+0000","last_fullsized":"2024-04-25T08:54:37.386861+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:24.946875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386518+0000","last_change":"2024-04-25T08:54:36.406130+0000","last_active":"2024-04-25T08:54:37.386518+0000","last_peered":"2024-04-25T08:54:37.386518+0000","last_clean":"2024-04-25T08:54:37.386518+0000","last_became_active":"2024-04-25T08:54:36.405669+0000","last_became_peered":"2024-04-25T08:54:36.405669+0000","last_unstale":"2024-04-25T08:54:37.386518+0000","last_undegraded":"2024-04-25T08:54:37.386518+0000","last_fullsized":"2024-04-25T08:54:37.386518+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:16.391684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386603+0000","last_change":"2024-04-25T08:54:36.402940+0000","last_active":"2024-04-25T08:54:37.386603+0000","last_peered":"2024-04-25T08:54:37.386603+0000","last_clean":"2024-04-25T08:54:37.386603+0000","last_became_active":"2024-04-25T08:54:36.402622+0000","last_became_peered":"2024-04-25T08:54:36.402622+0000","last_unstale":"2024-04-25T08:54:37.386603+0000","last_undegraded":"2024-04-25T08:54:37.386603+0000","last_fullsized":"2024-04-25T08:54:37.386603+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:19.460450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933790+0000","last_change":"2024-04-25T08:54:36.415118+0000","last_active":"2024-04-25T08:54:37.933790+0000","last_peered":"2024-04-25T08:54:37.933790+0000","last_clean":"2024-04-25T08:54:37.933790+0000","last_became_active":"2024-04-25T08:54:36.414819+0000","last_became_peered":"2024-04-25T08:54:36.414819+0000","last_unstale":"2024-04-25T08:54:37.933790+0000","last_undegraded":"2024-04-25T08:54:37.933790+0000","last_fullsized":"2024-04-25T08:54:37.933790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:07.530091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932668+0000","last_change":"2024-04-25T08:54:36.418746+0000","last_active":"2024-04-25T08:54:37.932668+0000","last_peered":"2024-04-25T08:54:37.932668+0000","last_clean":"2024-04-25T08:54:37.932668+0000","last_became_active":"2024-04-25T08:54:36.418469+0000","last_became_peered":"2024-04-25T08:54:36.418469+0000","last_unstale":"2024-04-25T08:54:37.932668+0000","last_undegraded":"2024-04-25T08:54:37.932668+0000","last_fullsized":"2024-04-25T08:54:37.932668+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:17.547423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386385+0000","last_change":"2024-04-25T08:54:36.414382+0000","last_active":"2024-04-25T08:54:37.386385+0000","last_peered":"2024-04-25T08:54:37.386385+0000","last_clean":"2024-04-25T08:54:37.386385+0000","last_became_active":"2024-04-25T08:54:36.414148+0000","last_became_peered":"2024-04-25T08:54:36.414148+0000","last_unstale":"2024-04-25T08:54:37.386385+0000","last_undegraded":"2024-04-25T08:54:37.386385+0000","last_fullsized":"2024-04-25T08:54:37.386385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:13.262322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933228+0000","last_change":"2024-04-25T08:54:36.410669+0000","last_active":"2024-04-25T08:54:37.933228+0000","last_peered":"2024-04-25T08:54:37.933228+0000","last_clean":"2024-04-25T08:54:37.933228+0000","last_became_active":"2024-04-25T08:54:36.410348+0000","last_became_peered":"2024-04-25T08:54:36.410348+0000","last_unstale":"2024-04-25T08:54:37.933228+0000","last_undegraded":"2024-04-25T08:54:37.933228+0000","last_fullsized":"2024-04-25T08:54:37.933228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:27.653596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.737937+0000","last_change":"2024-04-25T08:54:36.412317+0000","last_active":"2024-04-25T08:54:37.737937+0000","last_peered":"2024-04-25T08:54:37.737937+0000","last_clean":"2024-04-25T08:54:37.737937+0000","last_became_active":"2024-04-25T08:54:36.412048+0000","last_became_peered":"2024-04-25T08:54:36.412048+0000","last_unstale":"2024-04-25T08:54:37.737937+0000","last_undegraded":"2024-04-25T08:54:37.737937+0000","last_fullsized":"2024-04-25T08:54:37.737937+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:58.198913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386973+0000","last_change":"2024-04-25T08:54:36.418749+0000","last_active":"2024-04-25T08:54:37.386973+0000","last_peered":"2024-04-25T08:54:37.386973+0000","last_clean":"2024-04-25T08:54:37.386973+0000","last_became_active":"2024-04-25T08:54:36.415455+0000","last_became_peered":"2024-04-25T08:54:36.415455+0000","last_unstale":"2024-04-25T08:54:37.386973+0000","last_undegraded":"2024-04-25T08:54:37.386973+0000","last_fullsized":"2024-04-25T08:54:37.386973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:19.460450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932796+0000","last_change":"2024-04-25T08:54:36.392906+0000","last_active":"2024-04-25T08:54:37.932796+0000","last_peered":"2024-04-25T08:54:37.932796+0000","last_clean":"2024-04-25T08:54:37.932796+0000","last_became_active":"2024-04-25T08:54:36.392561+0000","last_became_peered":"2024-04-25T08:54:36.392561+0000","last_unstale":"2024-04-25T08:54:37.932796+0000","last_undegraded":"2024-04-25T08:54:37.932796+0000","last_fullsized":"2024-04-25T08:54:37.932796+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:13.262322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386744+0000","last_change":"2024-04-25T08:54:36.417016+0000","last_active":"2024-04-25T08:54:37.386744+0000","last_peered":"2024-04-25T08:54:37.386744+0000","last_clean":"2024-04-25T08:54:37.386744+0000","last_became_active":"2024-04-25T08:54:36.416753+0000","last_became_peered":"2024-04-25T08:54:36.416753+0000","last_unstale":"2024-04-25T08:54:37.386744+0000","last_undegraded":"2024-04-25T08:54:37.386744+0000","last_fullsized":"2024-04-25T08:54:37.386744+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:35.985816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386962+0000","last_change":"2024-04-25T08:54:36.406485+0000","last_active":"2024-04-25T08:54:37.386962+0000","last_peered":"2024-04-25T08:54:37.386962+0000","last_clean":"2024-04-25T08:54:37.386962+0000","last_became_active":"2024-04-25T08:54:36.405919+0000","last_became_peered":"2024-04-25T08:54:36.405919+0000","last_unstale":"2024-04-25T08:54:37.386962+0000","last_undegraded":"2024-04-25T08:54:37.386962+0000","last_fullsized":"2024-04-25T08:54:37.386962+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:26.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387282+0000","last_change":"2024-04-25T08:54:36.418721+0000","last_active":"2024-04-25T08:54:37.387282+0000","last_peered":"2024-04-25T08:54:37.387282+0000","last_clean":"2024-04-25T08:54:37.387282+0000","last_became_active":"2024-04-25T08:54:36.418449+0000","last_became_peered":"2024-04-25T08:54:36.418449+0000","last_unstale":"2024-04-25T08:54:37.387282+0000","last_undegraded":"2024-04-25T08:54:37.387282+0000","last_fullsized":"2024-04-25T08:54:37.387282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:15.571233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387174+0000","last_change":"2024-04-25T08:54:36.416346+0000","last_active":"2024-04-25T08:54:37.387174+0000","last_peered":"2024-04-25T08:54:37.387174+0000","last_clean":"2024-04-25T08:54:37.387174+0000","last_became_active":"2024-04-25T08:54:36.416041+0000","last_became_peered":"2024-04-25T08:54:36.416041+0000","last_unstale":"2024-04-25T08:54:37.387174+0000","last_undegraded":"2024-04-25T08:54:37.387174+0000","last_fullsized":"2024-04-25T08:54:37.387174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:27.653596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.738214+0000","last_change":"2024-04-25T08:54:36.403608+0000","last_active":"2024-04-25T08:54:37.738214+0000","last_peered":"2024-04-25T08:54:37.738214+0000","last_clean":"2024-04-25T08:54:37.738214+0000","last_became_active":"2024-04-25T08:54:36.403335+0000","last_became_peered":"2024-04-25T08:54:36.403335+0000","last_unstale":"2024-04-25T08:54:37.738214+0000","last_undegraded":"2024-04-25T08:54:37.738214+0000","last_fullsized":"2024-04-25T08:54:37.738214+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:46.585615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933208+0000","last_change":"2024-04-25T08:54:36.409806+0000","last_active":"2024-04-25T08:54:37.933208+0000","last_peered":"2024-04-25T08:54:37.933208+0000","last_clean":"2024-04-25T08:54:37.933208+0000","last_became_active":"2024-04-25T08:54:36.409544+0000","last_became_peered":"2024-04-25T08:54:36.409544+0000","last_unstale":"2024-04-25T08:54:37.933208+0000","last_undegraded":"2024-04-25T08:54:37.933208+0000","last_fullsized":"2024-04-25T08:54:37.933208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:54.778453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933120+0000","last_change":"2024-04-25T08:54:36.421174+0000","last_active":"2024-04-25T08:54:37.933120+0000","last_peered":"2024-04-25T08:54:37.933120+0000","last_clean":"2024-04-25T08:54:37.933120+0000","last_became_active":"2024-04-25T08:54:36.420990+0000","last_became_peered":"2024-04-25T08:54:36.420990+0000","last_unstale":"2024-04-25T08:54:37.933120+0000","last_undegraded":"2024-04-25T08:54:37.933120+0000","last_fullsized":"2024-04-25T08:54:37.933120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:33.714811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932566+0000","last_change":"2024-04-25T08:54:36.410440+0000","last_active":"2024-04-25T08:54:37.932566+0000","last_peered":"2024-04-25T08:54:37.932566+0000","last_clean":"2024-04-25T08:54:37.932566+0000","last_became_active":"2024-04-25T08:54:36.410149+0000","last_became_peered":"2024-04-25T08:54:36.410149+0000","last_unstale":"2024-04-25T08:54:37.932566+0000","last_undegraded":"2024-04-25T08:54:37.932566+0000","last_fullsized":"2024-04-25T08:54:37.932566+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:23.813689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932998+0000","last_change":"2024-04-25T08:54:36.402295+0000","last_active":"2024-04-25T08:54:37.932998+0000","last_peered":"2024-04-25T08:54:37.932998+0000","last_clean":"2024-04-25T08:54:37.932998+0000","last_became_active":"2024-04-25T08:54:36.402010+0000","last_became_peered":"2024-04-25T08:54:36.402010+0000","last_unstale":"2024-04-25T08:54:37.932998+0000","last_undegraded":"2024-04-25T08:54:37.932998+0000","last_fullsized":"2024-04-25T08:54:37.932998+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:24.946875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932893+0000","last_change":"2024-04-25T08:54:36.409846+0000","last_active":"2024-04-25T08:54:37.932893+0000","last_peered":"2024-04-25T08:54:37.932893+0000","last_clean":"2024-04-25T08:54:37.932893+0000","last_became_active":"2024-04-25T08:54:36.409400+0000","last_became_peered":"2024-04-25T08:54:36.409400+0000","last_unstale":"2024-04-25T08:54:37.932893+0000","last_undegraded":"2024-04-25T08:54:37.932893+0000","last_fullsized":"2024-04-25T08:54:37.932893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:51.656671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387435+0000","last_change":"2024-04-25T08:54:36.414690+0000","last_active":"2024-04-25T08:54:37.387435+0000","last_peered":"2024-04-25T08:54:37.387435+0000","last_clean":"2024-04-25T08:54:37.387435+0000","last_became_active":"2024-04-25T08:54:36.414125+0000","last_became_peered":"2024-04-25T08:54:36.414125+0000","last_unstale":"2024-04-25T08:54:37.387435+0000","last_undegraded":"2024-04-25T08:54:37.387435+0000","last_fullsized":"2024-04-25T08:54:37.387435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:48.992952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933101+0000","last_change":"2024-04-25T08:54:36.413975+0000","last_active":"2024-04-25T08:54:37.933101+0000","last_peered":"2024-04-25T08:54:37.933101+0000","last_clean":"2024-04-25T08:54:37.933101+0000","last_became_active":"2024-04-25T08:54:36.413521+0000","last_became_peered":"2024-04-25T08:54:36.413521+0000","last_unstale":"2024-04-25T08:54:37.933101+0000","last_undegraded":"2024-04-25T08:54:37.933101+0000","last_fullsized":"2024-04-25T08:54:37.933101+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:31.334761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933403+0000","last_change":"2024-04-25T08:54:36.410151+0000","last_active":"2024-04-25T08:54:37.933403+0000","last_peered":"2024-04-25T08:54:37.933403+0000","last_clean":"2024-04-25T08:54:37.933403+0000","last_became_active":"2024-04-25T08:54:36.409860+0000","last_became_peered":"2024-04-25T08:54:36.409860+0000","last_unstale":"2024-04-25T08:54:37.933403+0000","last_undegraded":"2024-04-25T08:54:37.933403+0000","last_fullsized":"2024-04-25T08:54:37.933403+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:15.571233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933545+0000","last_change":"2024-04-25T08:54:36.407313+0000","last_active":"2024-04-25T08:54:37.933545+0000","last_peered":"2024-04-25T08:54:37.933545+0000","last_clean":"2024-04-25T08:54:37.933545+0000","last_became_active":"2024-04-25T08:54:36.407007+0000","last_became_peered":"2024-04-25T08:54:36.407007+0000","last_unstale":"2024-04-25T08:54:37.933545+0000","last_undegraded":"2024-04-25T08:54:37.933545+0000","last_fullsized":"2024-04-25T08:54:37.933545+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:06.608856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386576+0000","last_change":"2024-04-25T08:54:36.406105+0000","last_active":"2024-04-25T08:54:37.386576+0000","last_peered":"2024-04-25T08:54:37.386576+0000","last_clean":"2024-04-25T08:54:37.386576+0000","last_became_active":"2024-04-25T08:54:36.405704+0000","last_became_peered":"2024-04-25T08:54:36.405704+0000","last_unstale":"2024-04-25T08:54:37.386576+0000","last_undegraded":"2024-04-25T08:54:37.386576+0000","last_fullsized":"2024-04-25T08:54:37.386576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:44.791216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.385952+0000","last_change":"2024-04-25T08:54:36.402441+0000","last_active":"2024-04-25T08:54:37.385952+0000","last_peered":"2024-04-25T08:54:37.385952+0000","last_clean":"2024-04-25T08:54:37.385952+0000","last_became_active":"2024-04-25T08:54:36.401791+0000","last_became_peered":"2024-04-25T08:54:36.401791+0000","last_unstale":"2024-04-25T08:54:37.385952+0000","last_undegraded":"2024-04-25T08:54:37.385952+0000","last_fullsized":"2024-04-25T08:54:37.385952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:46.585615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.385708+0000","last_change":"2024-04-25T08:54:36.407563+0000","last_active":"2024-04-25T08:54:37.385708+0000","last_peered":"2024-04-25T08:54:37.385708+0000","last_clean":"2024-04-25T08:54:37.385708+0000","last_became_active":"2024-04-25T08:54:36.407259+0000","last_became_peered":"2024-04-25T08:54:36.407259+0000","last_unstale":"2024-04-25T08:54:37.385708+0000","last_undegraded":"2024-04-25T08:54:37.385708+0000","last_fullsized":"2024-04-25T08:54:37.385708+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:58.866953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932661+0000","last_change":"2024-04-25T08:54:36.409713+0000","last_active":"2024-04-25T08:54:37.932661+0000","last_peered":"2024-04-25T08:54:37.932661+0000","last_clean":"2024-04-25T08:54:37.932661+0000","last_became_active":"2024-04-25T08:54:36.409413+0000","last_became_peered":"2024-04-25T08:54:36.409413+0000","last_unstale":"2024-04-25T08:54:37.932661+0000","last_undegraded":"2024-04-25T08:54:37.932661+0000","last_fullsized":"2024-04-25T08:54:37.932661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:28.549974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387009+0000","last_change":"2024-04-25T08:54:35.397200+0000","last_active":"2024-04-25T08:54:37.387009+0000","last_peered":"2024-04-25T08:54:37.387009+0000","last_clean":"2024-04-25T08:54:37.387009+0000","last_became_active":"2024-04-25T08:54:35.396905+0000","last_became_peered":"2024-04-25T08:54:35.396905+0000","last_unstale":"2024-04-25T08:54:37.387009+0000","last_undegraded":"2024-04-25T08:54:37.387009+0000","last_fullsized":"2024-04-25T08:54:37.387009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:53.034019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386948+0000","last_change":"2024-04-25T08:54:36.402951+0000","last_active":"2024-04-25T08:54:37.386948+0000","last_peered":"2024-04-25T08:54:37.386948+0000","last_clean":"2024-04-25T08:54:37.386948+0000","last_became_active":"2024-04-25T08:54:36.402655+0000","last_became_peered":"2024-04-25T08:54:36.402655+0000","last_unstale":"2024-04-25T08:54:37.386948+0000","last_undegraded":"2024-04-25T08:54:37.386948+0000","last_fullsized":"2024-04-25T08:54:37.386948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:28.549974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932589+0000","last_change":"2024-04-25T08:54:35.398363+0000","last_active":"2024-04-25T08:54:37.932589+0000","last_peered":"2024-04-25T08:54:37.932589+0000","last_clean":"2024-04-25T08:54:37.932589+0000","last_became_active":"2024-04-25T08:54:35.398047+0000","last_became_peered":"2024-04-25T08:54:35.398047+0000","last_unstale":"2024-04-25T08:54:37.932589+0000","last_undegraded":"2024-04-25T08:54:37.932589+0000","last_fullsized":"2024-04-25T08:54:37.932589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:42.528438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933807+0000","last_change":"2024-04-25T08:54:36.419393+0000","last_active":"2024-04-25T08:54:37.933807+0000","last_peered":"2024-04-25T08:54:37.933807+0000","last_clean":"2024-04-25T08:54:37.933807+0000","last_became_active":"2024-04-25T08:54:36.418929+0000","last_became_peered":"2024-04-25T08:54:36.418929+0000","last_unstale":"2024-04-25T08:54:37.933807+0000","last_undegraded":"2024-04-25T08:54:37.933807+0000","last_fullsized":"2024-04-25T08:54:37.933807+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:15.489761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387076+0000","last_change":"2024-04-25T08:54:35.409527+0000","last_active":"2024-04-25T08:54:37.387076+0000","last_peered":"2024-04-25T08:54:37.387076+0000","last_clean":"2024-04-25T08:54:37.387076+0000","last_became_active":"2024-04-25T08:54:35.409230+0000","last_became_peered":"2024-04-25T08:54:35.409230+0000","last_unstale":"2024-04-25T08:54:37.387076+0000","last_undegraded":"2024-04-25T08:54:37.387076+0000","last_fullsized":"2024-04-25T08:54:37.387076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:53.152232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932899+0000","last_change":"2024-04-25T08:54:36.412868+0000","last_active":"2024-04-25T08:54:37.932899+0000","last_peered":"2024-04-25T08:54:37.932899+0000","last_clean":"2024-04-25T08:54:37.932899+0000","last_became_active":"2024-04-25T08:54:36.411685+0000","last_became_peered":"2024-04-25T08:54:36.411685+0000","last_unstale":"2024-04-25T08:54:37.932899+0000","last_undegraded":"2024-04-25T08:54:37.932899+0000","last_fullsized":"2024-04-25T08:54:37.932899+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:06.788713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.738126+0000","last_change":"2024-04-25T08:54:35.408007+0000","last_active":"2024-04-25T08:54:37.738126+0000","last_peered":"2024-04-25T08:54:37.738126+0000","last_clean":"2024-04-25T08:54:37.738126+0000","last_became_active":"2024-04-25T08:54:35.407673+0000","last_became_peered":"2024-04-25T08:54:35.407673+0000","last_unstale":"2024-04-25T08:54:37.738126+0000","last_undegraded":"2024-04-25T08:54:37.738126+0000","last_fullsized":"2024-04-25T08:54:37.738126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:48.767743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386575+0000","last_change":"2024-04-25T08:54:36.408955+0000","last_active":"2024-04-25T08:54:37.386575+0000","last_peered":"2024-04-25T08:54:37.386575+0000","last_clean":"2024-04-25T08:54:37.386575+0000","last_became_active":"2024-04-25T08:54:36.408054+0000","last_became_peered":"2024-04-25T08:54:36.408054+0000","last_unstale":"2024-04-25T08:54:37.386575+0000","last_undegraded":"2024-04-25T08:54:37.386575+0000","last_fullsized":"2024-04-25T08:54:37.386575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:24.946875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933535+0000","last_change":"2024-04-25T08:54:35.404648+0000","last_active":"2024-04-25T08:54:37.933535+0000","last_peered":"2024-04-25T08:54:37.933535+0000","last_clean":"2024-04-25T08:54:37.933535+0000","last_became_active":"2024-04-25T08:54:35.404392+0000","last_became_peered":"2024-04-25T08:54:35.404392+0000","last_unstale":"2024-04-25T08:54:37.933535+0000","last_undegraded":"2024-04-25T08:54:37.933535+0000","last_fullsized":"2024-04-25T08:54:37.933535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:56.371370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932860+0000","last_change":"2024-04-25T08:54:36.410483+0000","last_active":"2024-04-25T08:54:37.932860+0000","last_peered":"2024-04-25T08:54:37.932860+0000","last_clean":"2024-04-25T08:54:37.932860+0000","last_became_active":"2024-04-25T08:54:36.409983+0000","last_became_peered":"2024-04-25T08:54:36.409983+0000","last_unstale":"2024-04-25T08:54:37.932860+0000","last_undegraded":"2024-04-25T08:54:37.932860+0000","last_fullsized":"2024-04-25T08:54:37.932860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:16.391684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933180+0000","last_change":"2024-04-25T08:54:35.404712+0000","last_active":"2024-04-25T08:54:37.933180+0000","last_peered":"2024-04-25T08:54:37.933180+0000","last_clean":"2024-04-25T08:54:37.933180+0000","last_became_active":"2024-04-25T08:54:35.404385+0000","last_became_peered":"2024-04-25T08:54:35.404385+0000","last_unstale":"2024-04-25T08:54:37.933180+0000","last_undegraded":"2024-04-25T08:54:37.933180+0000","last_fullsized":"2024-04-25T08:54:37.933180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:41.905881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933017+0000","last_change":"2024-04-25T08:54:36.404858+0000","last_active":"2024-04-25T08:54:37.933017+0000","last_peered":"2024-04-25T08:54:37.933017+0000","last_clean":"2024-04-25T08:54:37.933017+0000","last_became_active":"2024-04-25T08:54:36.404246+0000","last_became_peered":"2024-04-25T08:54:36.404246+0000","last_unstale":"2024-04-25T08:54:37.933017+0000","last_undegraded":"2024-04-25T08:54:37.933017+0000","last_fullsized":"2024-04-25T08:54:37.933017+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:43.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386805+0000","last_change":"2024-04-25T08:54:35.409717+0000","last_active":"2024-04-25T08:54:37.386805+0000","last_peered":"2024-04-25T08:54:37.386805+0000","last_clean":"2024-04-25T08:54:37.386805+0000","last_became_active":"2024-04-25T08:54:35.409403+0000","last_became_peered":"2024-04-25T08:54:35.409403+0000","last_unstale":"2024-04-25T08:54:37.386805+0000","last_undegraded":"2024-04-25T08:54:37.386805+0000","last_fullsized":"2024-04-25T08:54:37.386805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:27.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932443+0000","last_change":"2024-04-25T08:54:36.407767+0000","last_active":"2024-04-25T08:54:37.932443+0000","last_peered":"2024-04-25T08:54:37.932443+0000","last_clean":"2024-04-25T08:54:37.932443+0000","last_became_active":"2024-04-25T08:54:36.407386+0000","last_became_peered":"2024-04-25T08:54:36.407386+0000","last_unstale":"2024-04-25T08:54:37.932443+0000","last_undegraded":"2024-04-25T08:54:37.932443+0000","last_fullsized":"2024-04-25T08:54:37.932443+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:59.696803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933078+0000","last_change":"2024-04-25T08:54:35.395351+0000","last_active":"2024-04-25T08:54:37.933078+0000","last_peered":"2024-04-25T08:54:37.933078+0000","last_clean":"2024-04-25T08:54:37.933078+0000","last_became_active":"2024-04-25T08:54:35.395056+0000","last_became_peered":"2024-04-25T08:54:35.395056+0000","last_unstale":"2024-04-25T08:54:37.933078+0000","last_undegraded":"2024-04-25T08:54:37.933078+0000","last_fullsized":"2024-04-25T08:54:37.933078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:37.079096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933164+0000","last_change":"2024-04-25T08:54:36.417536+0000","last_active":"2024-04-25T08:54:37.933164+0000","last_peered":"2024-04-25T08:54:37.933164+0000","last_clean":"2024-04-25T08:54:37.933164+0000","last_became_active":"2024-04-25T08:54:36.417322+0000","last_became_peered":"2024-04-25T08:54:36.417322+0000","last_unstale":"2024-04-25T08:54:37.933164+0000","last_undegraded":"2024-04-25T08:54:37.933164+0000","last_fullsized":"2024-04-25T08:54:37.933164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:35.985816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387360+0000","last_change":"2024-04-25T08:54:35.402753+0000","last_active":"2024-04-25T08:54:37.387360+0000","last_peered":"2024-04-25T08:54:37.387360+0000","last_clean":"2024-04-25T08:54:37.387360+0000","last_became_active":"2024-04-25T08:54:35.402390+0000","last_became_peered":"2024-04-25T08:54:35.402390+0000","last_unstale":"2024-04-25T08:54:37.387360+0000","last_undegraded":"2024-04-25T08:54:37.387360+0000","last_fullsized":"2024-04-25T08:54:37.387360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:05.419864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387335+0000","last_change":"2024-04-25T08:54:36.416749+0000","last_active":"2024-04-25T08:54:37.387335+0000","last_peered":"2024-04-25T08:54:37.387335+0000","last_clean":"2024-04-25T08:54:37.387335+0000","last_became_active":"2024-04-25T08:54:36.416486+0000","last_became_peered":"2024-04-25T08:54:36.416486+0000","last_unstale":"2024-04-25T08:54:37.387335+0000","last_undegraded":"2024-04-25T08:54:37.387335+0000","last_fullsized":"2024-04-25T08:54:37.387335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:57.597879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932697+0000","last_change":"2024-04-25T08:54:35.404905+0000","last_active":"2024-04-25T08:54:37.932697+0000","last_peered":"2024-04-25T08:54:37.932697+0000","last_clean":"2024-04-25T08:54:37.932697+0000","last_became_active":"2024-04-25T08:54:35.404569+0000","last_became_peered":"2024-04-25T08:54:35.404569+0000","last_unstale":"2024-04-25T08:54:37.932697+0000","last_undegraded":"2024-04-25T08:54:37.932697+0000","last_fullsized":"2024-04-25T08:54:37.932697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:35.540652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387548+0000","last_change":"2024-04-25T08:54:36.416890+0000","last_active":"2024-04-25T08:54:37.387548+0000","last_peered":"2024-04-25T08:54:37.387548+0000","last_clean":"2024-04-25T08:54:37.387548+0000","last_became_active":"2024-04-25T08:54:36.416543+0000","last_became_peered":"2024-04-25T08:54:36.416543+0000","last_unstale":"2024-04-25T08:54:37.387548+0000","last_undegraded":"2024-04-25T08:54:37.387548+0000","last_fullsized":"2024-04-25T08:54:37.387548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:34.232898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933175+0000","last_change":"2024-04-25T08:54:35.397471+0000","last_active":"2024-04-25T08:54:37.933175+0000","last_peered":"2024-04-25T08:54:37.933175+0000","last_clean":"2024-04-25T08:54:37.933175+0000","last_became_active":"2024-04-25T08:54:35.397184+0000","last_became_peered":"2024-04-25T08:54:35.397184+0000","last_unstale":"2024-04-25T08:54:37.933175+0000","last_undegraded":"2024-04-25T08:54:37.933175+0000","last_fullsized":"2024-04-25T08:54:37.933175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:22.811542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932959+0000","last_change":"2024-04-25T08:54:36.411140+0000","last_active":"2024-04-25T08:54:37.932959+0000","last_peered":"2024-04-25T08:54:37.932959+0000","last_clean":"2024-04-25T08:54:37.932959+0000","last_became_active":"2024-04-25T08:54:36.410833+0000","last_became_peered":"2024-04-25T08:54:36.410833+0000","last_unstale":"2024-04-25T08:54:37.932959+0000","last_undegraded":"2024-04-25T08:54:37.932959+0000","last_fullsized":"2024-04-25T08:54:37.932959+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:44.791216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387443+0000","last_change":"2024-04-25T08:54:35.412164+0000","last_active":"2024-04-25T08:54:37.387443+0000","last_peered":"2024-04-25T08:54:37.387443+0000","last_clean":"2024-04-25T08:54:37.387443+0000","last_became_active":"2024-04-25T08:54:35.411849+0000","last_became_peered":"2024-04-25T08:54:35.411849+0000","last_unstale":"2024-04-25T08:54:37.387443+0000","last_undegraded":"2024-04-25T08:54:37.387443+0000","last_fullsized":"2024-04-25T08:54:37.387443+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:36.895546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932382+0000","last_change":"2024-04-25T08:54:36.410706+0000","last_active":"2024-04-25T08:54:37.932382+0000","last_peered":"2024-04-25T08:54:37.932382+0000","last_clean":"2024-04-25T08:54:37.932382+0000","last_became_active":"2024-04-25T08:54:36.410365+0000","last_became_peered":"2024-04-25T08:54:36.410365+0000","last_unstale":"2024-04-25T08:54:37.932382+0000","last_undegraded":"2024-04-25T08:54:37.932382+0000","last_fullsized":"2024-04-25T08:54:37.932382+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:08.844280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933605+0000","last_change":"2024-04-25T08:54:35.397554+0000","last_active":"2024-04-25T08:54:37.933605+0000","last_peered":"2024-04-25T08:54:37.933605+0000","last_clean":"2024-04-25T08:54:37.933605+0000","last_became_active":"2024-04-25T08:54:35.397264+0000","last_became_peered":"2024-04-25T08:54:35.397264+0000","last_unstale":"2024-04-25T08:54:37.933605+0000","last_undegraded":"2024-04-25T08:54:37.933605+0000","last_fullsized":"2024-04-25T08:54:37.933605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:53.034019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.387048+0000","last_change":"2024-04-25T08:54:36.414307+0000","last_active":"2024-04-25T08:54:37.387048+0000","last_peered":"2024-04-25T08:54:37.387048+0000","last_clean":"2024-04-25T08:54:37.387048+0000","last_became_active":"2024-04-25T08:54:36.414015+0000","last_became_peered":"2024-04-25T08:54:36.414015+0000","last_unstale":"2024-04-25T08:54:37.387048+0000","last_undegraded":"2024-04-25T08:54:37.387048+0000","last_fullsized":"2024-04-25T08:54:37.387048+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:35.985816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932486+0000","last_change":"2024-04-25T08:54:35.406890+0000","last_active":"2024-04-25T08:54:37.932486+0000","last_peered":"2024-04-25T08:54:37.932486+0000","last_clean":"2024-04-25T08:54:37.932486+0000","last_became_active":"2024-04-25T08:54:35.406564+0000","last_became_peered":"2024-04-25T08:54:35.406564+0000","last_unstale":"2024-04-25T08:54:37.932486+0000","last_undegraded":"2024-04-25T08:54:37.932486+0000","last_fullsized":"2024-04-25T08:54:37.932486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:52.728522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386823+0000","last_change":"2024-04-25T08:54:36.408257+0000","last_active":"2024-04-25T08:54:37.386823+0000","last_peered":"2024-04-25T08:54:37.386823+0000","last_clean":"2024-04-25T08:54:37.386823+0000","last_became_active":"2024-04-25T08:54:36.407990+0000","last_became_peered":"2024-04-25T08:54:36.407990+0000","last_unstale":"2024-04-25T08:54:37.386823+0000","last_undegraded":"2024-04-25T08:54:37.386823+0000","last_fullsized":"2024-04-25T08:54:37.386823+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:27.653596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386720+0000","last_change":"2024-04-25T08:54:35.403745+0000","last_active":"2024-04-25T08:54:37.386720+0000","last_peered":"2024-04-25T08:54:37.386720+0000","last_clean":"2024-04-25T08:54:37.386720+0000","last_became_active":"2024-04-25T08:54:35.403119+0000","last_became_peered":"2024-04-25T08:54:35.403119+0000","last_unstale":"2024-04-25T08:54:37.386720+0000","last_undegraded":"2024-04-25T08:54:37.386720+0000","last_fullsized":"2024-04-25T08:54:37.386720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:22.811542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.385975+0000","last_change":"2024-04-25T08:54:36.403375+0000","last_active":"2024-04-25T08:54:37.385975+0000","last_peered":"2024-04-25T08:54:37.385975+0000","last_clean":"2024-04-25T08:54:37.385975+0000","last_became_active":"2024-04-25T08:54:36.403075+0000","last_became_peered":"2024-04-25T08:54:36.403075+0000","last_unstale":"2024-04-25T08:54:37.385975+0000","last_undegraded":"2024-04-25T08:54:37.385975+0000","last_fullsized":"2024-04-25T08:54:37.385975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:06.422011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386876+0000","last_change":"2024-04-25T08:54:35.412058+0000","last_active":"2024-04-25T08:54:37.386876+0000","last_peered":"2024-04-25T08:54:37.386876+0000","last_clean":"2024-04-25T08:54:37.386876+0000","last_became_active":"2024-04-25T08:54:35.411769+0000","last_became_peered":"2024-04-25T08:54:35.411769+0000","last_unstale":"2024-04-25T08:54:37.386876+0000","last_undegraded":"2024-04-25T08:54:37.386876+0000","last_fullsized":"2024-04-25T08:54:37.386876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:45.583467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933387+0000","last_change":"2024-04-25T08:54:36.402536+0000","last_active":"2024-04-25T08:54:37.933387+0000","last_peered":"2024-04-25T08:54:37.933387+0000","last_clean":"2024-04-25T08:54:37.933387+0000","last_became_active":"2024-04-25T08:54:36.402272+0000","last_became_peered":"2024-04-25T08:54:36.402272+0000","last_unstale":"2024-04-25T08:54:37.933387+0000","last_undegraded":"2024-04-25T08:54:37.933387+0000","last_fullsized":"2024-04-25T08:54:37.933387+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:24.231547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933001+0000","last_change":"2024-04-25T08:54:35.406766+0000","last_active":"2024-04-25T08:54:37.933001+0000","last_peered":"2024-04-25T08:54:37.933001+0000","last_clean":"2024-04-25T08:54:37.933001+0000","last_became_active":"2024-04-25T08:54:35.406301+0000","last_became_peered":"2024-04-25T08:54:35.406301+0000","last_unstale":"2024-04-25T08:54:37.933001+0000","last_undegraded":"2024-04-25T08:54:37.933001+0000","last_fullsized":"2024-04-25T08:54:37.933001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:20.198029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933575+0000","last_change":"2024-04-25T08:54:36.401605+0000","last_active":"2024-04-25T08:54:37.933575+0000","last_peered":"2024-04-25T08:54:37.933575+0000","last_clean":"2024-04-25T08:54:37.933575+0000","last_became_active":"2024-04-25T08:54:36.401291+0000","last_became_peered":"2024-04-25T08:54:36.401291+0000","last_unstale":"2024-04-25T08:54:37.933575+0000","last_undegraded":"2024-04-25T08:54:37.933575+0000","last_fullsized":"2024-04-25T08:54:37.933575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:57.597879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933298+0000","last_change":"2024-04-25T08:54:35.395543+0000","last_active":"2024-04-25T08:54:37.933298+0000","last_peered":"2024-04-25T08:54:37.933298+0000","last_clean":"2024-04-25T08:54:37.933298+0000","last_became_active":"2024-04-25T08:54:35.395234+0000","last_became_peered":"2024-04-25T08:54:35.395234+0000","last_unstale":"2024-04-25T08:54:37.933298+0000","last_undegraded":"2024-04-25T08:54:37.933298+0000","last_fullsized":"2024-04-25T08:54:37.933298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:42.528438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932617+0000","last_change":"2024-04-25T08:54:36.408929+0000","last_active":"2024-04-25T08:54:37.932617+0000","last_peered":"2024-04-25T08:54:37.932617+0000","last_clean":"2024-04-25T08:54:37.932617+0000","last_became_active":"2024-04-25T08:54:36.408650+0000","last_became_peered":"2024-04-25T08:54:36.408650+0000","last_unstale":"2024-04-25T08:54:37.932617+0000","last_undegraded":"2024-04-25T08:54:37.932617+0000","last_fullsized":"2024-04-25T08:54:37.932617+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:33.866553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933604+0000","last_change":"2024-04-25T08:54:35.398186+0000","last_active":"2024-04-25T08:54:37.933604+0000","last_peered":"2024-04-25T08:54:37.933604+0000","last_clean":"2024-04-25T08:54:37.933604+0000","last_became_active":"2024-04-25T08:54:35.397928+0000","last_became_peered":"2024-04-25T08:54:35.397928+0000","last_unstale":"2024-04-25T08:54:37.933604+0000","last_undegraded":"2024-04-25T08:54:37.933604+0000","last_fullsized":"2024-04-25T08:54:37.933604+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:35.540652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.738068+0000","last_change":"2024-04-25T08:54:36.402809+0000","last_active":"2024-04-25T08:54:37.738068+0000","last_peered":"2024-04-25T08:54:37.738068+0000","last_clean":"2024-04-25T08:54:37.738068+0000","last_became_active":"2024-04-25T08:54:36.402540+0000","last_became_peered":"2024-04-25T08:54:36.402540+0000","last_unstale":"2024-04-25T08:54:37.738068+0000","last_undegraded":"2024-04-25T08:54:37.738068+0000","last_fullsized":"2024-04-25T08:54:37.738068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:27.272228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933735+0000","last_change":"2024-04-25T08:54:35.404666+0000","last_active":"2024-04-25T08:54:37.933735+0000","last_peered":"2024-04-25T08:54:37.933735+0000","last_clean":"2024-04-25T08:54:37.933735+0000","last_became_active":"2024-04-25T08:54:35.404368+0000","last_became_peered":"2024-04-25T08:54:35.404368+0000","last_unstale":"2024-04-25T08:54:37.933735+0000","last_undegraded":"2024-04-25T08:54:37.933735+0000","last_fullsized":"2024-04-25T08:54:37.933735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:57.196765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.737955+0000","last_change":"2024-04-25T08:54:36.401207+0000","last_active":"2024-04-25T08:54:37.737955+0000","last_peered":"2024-04-25T08:54:37.737955+0000","last_clean":"2024-04-25T08:54:37.737955+0000","last_became_active":"2024-04-25T08:54:36.400880+0000","last_became_peered":"2024-04-25T08:54:36.400880+0000","last_unstale":"2024-04-25T08:54:37.737955+0000","last_undegraded":"2024-04-25T08:54:37.737955+0000","last_fullsized":"2024-04-25T08:54:37.737955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:43.530585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933172+0000","last_change":"2024-04-25T08:54:35.408125+0000","last_active":"2024-04-25T08:54:37.933172+0000","last_peered":"2024-04-25T08:54:37.933172+0000","last_clean":"2024-04-25T08:54:37.933172+0000","last_became_active":"2024-04-25T08:54:35.407816+0000","last_became_peered":"2024-04-25T08:54:35.407816+0000","last_unstale":"2024-04-25T08:54:37.933172+0000","last_undegraded":"2024-04-25T08:54:37.933172+0000","last_fullsized":"2024-04-25T08:54:37.933172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:53.034019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.738021+0000","last_change":"2024-04-25T08:54:36.411529+0000","last_active":"2024-04-25T08:54:37.738021+0000","last_peered":"2024-04-25T08:54:37.738021+0000","last_clean":"2024-04-25T08:54:37.738021+0000","last_became_active":"2024-04-25T08:54:36.411236+0000","last_became_peered":"2024-04-25T08:54:36.411236+0000","last_unstale":"2024-04-25T08:54:37.738021+0000","last_undegraded":"2024-04-25T08:54:37.738021+0000","last_fullsized":"2024-04-25T08:54:37.738021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:36.542800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386248+0000","last_change":"2024-04-25T08:54:35.407745+0000","last_active":"2024-04-25T08:54:37.386248+0000","last_peered":"2024-04-25T08:54:37.386248+0000","last_clean":"2024-04-25T08:54:37.386248+0000","last_became_active":"2024-04-25T08:54:35.407432+0000","last_became_peered":"2024-04-25T08:54:35.407432+0000","last_unstale":"2024-04-25T08:54:37.386248+0000","last_undegraded":"2024-04-25T08:54:37.386248+0000","last_fullsized":"2024-04-25T08:54:37.386248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:56.371370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.737905+0000","last_change":"2024-04-25T08:54:36.411470+0000","last_active":"2024-04-25T08:54:37.737905+0000","last_peered":"2024-04-25T08:54:37.737905+0000","last_clean":"2024-04-25T08:54:37.737905+0000","last_became_active":"2024-04-25T08:54:36.411177+0000","last_became_peered":"2024-04-25T08:54:36.411177+0000","last_unstale":"2024-04-25T08:54:37.737905+0000","last_undegraded":"2024-04-25T08:54:37.737905+0000","last_fullsized":"2024-04-25T08:54:37.737905+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:54.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932757+0000","last_change":"2024-04-25T08:54:35.403573+0000","last_active":"2024-04-25T08:54:37.932757+0000","last_peered":"2024-04-25T08:54:37.932757+0000","last_clean":"2024-04-25T08:54:37.932757+0000","last_became_active":"2024-04-25T08:54:35.403231+0000","last_became_peered":"2024-04-25T08:54:35.403231+0000","last_unstale":"2024-04-25T08:54:37.932757+0000","last_undegraded":"2024-04-25T08:54:37.932757+0000","last_fullsized":"2024-04-25T08:54:37.932757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:13.957812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386221+0000","last_change":"2024-04-25T08:54:36.405896+0000","last_active":"2024-04-25T08:54:37.386221+0000","last_peered":"2024-04-25T08:54:37.386221+0000","last_clean":"2024-04-25T08:54:37.386221+0000","last_became_active":"2024-04-25T08:54:36.405614+0000","last_became_peered":"2024-04-25T08:54:36.405614+0000","last_unstale":"2024-04-25T08:54:37.386221+0000","last_undegraded":"2024-04-25T08:54:37.386221+0000","last_fullsized":"2024-04-25T08:54:37.386221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:15.489761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932578+0000","last_change":"2024-04-25T08:54:35.397280+0000","last_active":"2024-04-25T08:54:37.932578+0000","last_peered":"2024-04-25T08:54:37.932578+0000","last_clean":"2024-04-25T08:54:37.932578+0000","last_became_active":"2024-04-25T08:54:35.396990+0000","last_became_peered":"2024-04-25T08:54:35.396990+0000","last_unstale":"2024-04-25T08:54:37.932578+0000","last_undegraded":"2024-04-25T08:54:37.932578+0000","last_fullsized":"2024-04-25T08:54:37.932578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:53.152232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.738067+0000","last_change":"2024-04-25T08:54:36.404421+0000","last_active":"2024-04-25T08:54:37.738067+0000","last_peered":"2024-04-25T08:54:37.738067+0000","last_clean":"2024-04-25T08:54:37.738067+0000","last_became_active":"2024-04-25T08:54:36.404091+0000","last_became_peered":"2024-04-25T08:54:36.404091+0000","last_unstale":"2024-04-25T08:54:37.738067+0000","last_undegraded":"2024-04-25T08:54:37.738067+0000","last_fullsized":"2024-04-25T08:54:37.738067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:37.832154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933017+0000","last_change":"2024-04-25T08:54:35.406931+0000","last_active":"2024-04-25T08:54:37.933017+0000","last_peered":"2024-04-25T08:54:37.933017+0000","last_clean":"2024-04-25T08:54:37.933017+0000","last_became_active":"2024-04-25T08:54:35.406639+0000","last_became_peered":"2024-04-25T08:54:35.406639+0000","last_unstale":"2024-04-25T08:54:37.933017+0000","last_undegraded":"2024-04-25T08:54:37.933017+0000","last_fullsized":"2024-04-25T08:54:37.933017+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:21.339601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933367+0000","last_change":"2024-04-25T08:54:36.408819+0000","last_active":"2024-04-25T08:54:37.933367+0000","last_peered":"2024-04-25T08:54:37.933367+0000","last_clean":"2024-04-25T08:54:37.933367+0000","last_became_active":"2024-04-25T08:54:36.408377+0000","last_became_peered":"2024-04-25T08:54:36.408377+0000","last_unstale":"2024-04-25T08:54:37.933367+0000","last_undegraded":"2024-04-25T08:54:37.933367+0000","last_fullsized":"2024-04-25T08:54:37.933367+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:26.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932766+0000","last_change":"2024-04-25T08:54:35.406814+0000","last_active":"2024-04-25T08:54:37.932766+0000","last_peered":"2024-04-25T08:54:37.932766+0000","last_clean":"2024-04-25T08:54:37.932766+0000","last_became_active":"2024-04-25T08:54:35.406527+0000","last_became_peered":"2024-04-25T08:54:35.406527+0000","last_unstale":"2024-04-25T08:54:37.932766+0000","last_undegraded":"2024-04-25T08:54:37.932766+0000","last_fullsized":"2024-04-25T08:54:37.932766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:26.270081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932992+0000","last_change":"2024-04-25T08:54:36.416957+0000","last_active":"2024-04-25T08:54:37.932992+0000","last_peered":"2024-04-25T08:54:37.932992+0000","last_clean":"2024-04-25T08:54:37.932992+0000","last_became_active":"2024-04-25T08:54:36.416679+0000","last_became_peered":"2024-04-25T08:54:36.416679+0000","last_unstale":"2024-04-25T08:54:37.932992+0000","last_undegraded":"2024-04-25T08:54:37.932992+0000","last_fullsized":"2024-04-25T08:54:37.932992+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:37.897694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932802+0000","last_change":"2024-04-25T08:54:35.408435+0000","last_active":"2024-04-25T08:54:37.932802+0000","last_peered":"2024-04-25T08:54:37.932802+0000","last_clean":"2024-04-25T08:54:37.932802+0000","last_became_active":"2024-04-25T08:54:35.407831+0000","last_became_peered":"2024-04-25T08:54:35.407831+0000","last_unstale":"2024-04-25T08:54:37.932802+0000","last_undegraded":"2024-04-25T08:54:37.932802+0000","last_fullsized":"2024-04-25T08:54:37.932802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:11.392588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386184+0000","last_change":"2024-04-25T08:54:36.409228+0000","last_active":"2024-04-25T08:54:37.386184+0000","last_peered":"2024-04-25T08:54:37.386184+0000","last_clean":"2024-04-25T08:54:37.386184+0000","last_became_active":"2024-04-25T08:54:36.408925+0000","last_became_peered":"2024-04-25T08:54:36.408925+0000","last_unstale":"2024-04-25T08:54:37.386184+0000","last_undegraded":"2024-04-25T08:54:37.386184+0000","last_fullsized":"2024-04-25T08:54:37.386184+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:54.154379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933279+0000","last_change":"2024-04-25T08:54:35.400328+0000","last_active":"2024-04-25T08:54:37.933279+0000","last_peered":"2024-04-25T08:54:37.933279+0000","last_clean":"2024-04-25T08:54:37.933279+0000","last_became_active":"2024-04-25T08:54:35.400004+0000","last_became_peered":"2024-04-25T08:54:35.400004+0000","last_unstale":"2024-04-25T08:54:37.933279+0000","last_undegraded":"2024-04-25T08:54:37.933279+0000","last_fullsized":"2024-04-25T08:54:37.933279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:57.196765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933173+0000","last_change":"2024-04-25T08:54:36.412085+0000","last_active":"2024-04-25T08:54:37.933173+0000","last_peered":"2024-04-25T08:54:37.933173+0000","last_clean":"2024-04-25T08:54:37.933173+0000","last_became_active":"2024-04-25T08:54:36.411799+0000","last_became_peered":"2024-04-25T08:54:36.411799+0000","last_unstale":"2024-04-25T08:54:37.933173+0000","last_undegraded":"2024-04-25T08:54:37.933173+0000","last_fullsized":"2024-04-25T08:54:37.933173+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:43.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932645+0000","last_change":"2024-04-25T08:54:35.406919+0000","last_active":"2024-04-25T08:54:37.932645+0000","last_peered":"2024-04-25T08:54:37.932645+0000","last_clean":"2024-04-25T08:54:37.932645+0000","last_became_active":"2024-04-25T08:54:35.406619+0000","last_became_peered":"2024-04-25T08:54:35.406619+0000","last_unstale":"2024-04-25T08:54:37.932645+0000","last_undegraded":"2024-04-25T08:54:37.932645+0000","last_fullsized":"2024-04-25T08:54:37.932645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:42.641822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386803+0000","last_change":"2024-04-25T08:54:36.417588+0000","last_active":"2024-04-25T08:54:37.386803+0000","last_peered":"2024-04-25T08:54:37.386803+0000","last_clean":"2024-04-25T08:54:37.386803+0000","last_became_active":"2024-04-25T08:54:36.417297+0000","last_became_peered":"2024-04-25T08:54:36.417297+0000","last_unstale":"2024-04-25T08:54:37.386803+0000","last_undegraded":"2024-04-25T08:54:37.386803+0000","last_fullsized":"2024-04-25T08:54:37.386803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:44.791216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.932866+0000","last_change":"2024-04-25T08:54:35.397373+0000","last_active":"2024-04-25T08:54:37.932866+0000","last_peered":"2024-04-25T08:54:37.932866+0000","last_clean":"2024-04-25T08:54:37.932866+0000","last_became_active":"2024-04-25T08:54:35.396905+0000","last_became_peered":"2024-04-25T08:54:35.396905+0000","last_unstale":"2024-04-25T08:54:37.932866+0000","last_undegraded":"2024-04-25T08:54:37.932866+0000","last_fullsized":"2024-04-25T08:54:37.932866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:04.316677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.933602+0000","last_change":"2024-04-25T08:54:36.419276+0000","last_active":"2024-04-25T08:54:37.933602+0000","last_peered":"2024-04-25T08:54:37.933602+0000","last_clean":"2024-04-25T08:54:37.933602+0000","last_became_active":"2024-04-25T08:54:36.418984+0000","last_became_peered":"2024-04-25T08:54:36.418984+0000","last_unstale":"2024-04-25T08:54:37.933602+0000","last_undegraded":"2024-04-25T08:54:37.933602+0000","last_fullsized":"2024-04-25T08:54:37.933602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:58.866953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386745+0000","last_change":"2024-04-25T08:54:35.400997+0000","last_active":"2024-04-25T08:54:37.386745+0000","last_peered":"2024-04-25T08:54:37.386745+0000","last_clean":"2024-04-25T08:54:37.386745+0000","last_became_active":"2024-04-25T08:54:35.400690+0000","last_became_peered":"2024-04-25T08:54:35.400690+0000","last_unstale":"2024-04-25T08:54:37.386745+0000","last_undegraded":"2024-04-25T08:54:37.386745+0000","last_fullsized":"2024-04-25T08:54:37.386745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:36.830007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.385949+0000","last_change":"2024-04-25T08:54:36.404244+0000","last_active":"2024-04-25T08:54:37.385949+0000","last_peered":"2024-04-25T08:54:37.385949+0000","last_clean":"2024-04-25T08:54:37.385949+0000","last_became_active":"2024-04-25T08:54:36.403974+0000","last_became_peered":"2024-04-25T08:54:36.403974+0000","last_unstale":"2024-04-25T08:54:37.385949+0000","last_undegraded":"2024-04-25T08:54:37.385949+0000","last_fullsized":"2024-04-25T08:54:37.385949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:35.374522+0000","last_clean_scrub_stamp":"2024-04-25T08:54:35.374522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:07.530091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386484+0000","last_change":"2024-04-25T08:54:35.392085+0000","last_active":"2024-04-25T08:54:37.386484+0000","last_peered":"2024-04-25T08:54:37.386484+0000","last_clean":"2024-04-25T08:54:37.386484+0000","last_became_active":"2024-04-25T08:54:35.391764+0000","last_became_peered":"2024-04-25T08:54:35.391764+0000","last_unstale":"2024-04-25T08:54:37.386484+0000","last_undegraded":"2024-04-25T08:54:37.386484+0000","last_fullsized":"2024-04-25T08:54:37.386484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:54:34.372375+0000","last_clean_scrub_stamp":"2024-04-25T08:54:34.372375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:04.316677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":193,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:54:37.386809+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:54:37.386809+0000","last_peered":"2024-04-25T08:54:37.386809+0000","last_clean":"2024-04-25T08:54:37.386809+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:54:37.386809+0000","last_undegraded":"2024-04-25T08:54:37.386809+0000","last_fullsized":"2024-04-25T08:54:37.386809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":747367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":157525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":157581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":157013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":417792,"data_stored":158543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":156979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":995328,"data_stored":747277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":158543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:54:44.163 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:54:44.163 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:54:44.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.318+0000 7f302cf34640 1 Processor -- start 2024-04-25T08:54:44.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.318+0000 7f302cf34640 1 -- start start 2024-04-25T08:54:44.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.319+0000 7f302cf34640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f302815ba50 0x7f30280b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.319+0000 7f302cf34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30280b66a0 con 0x7f3028070d40 2024-04-25T08:54:44.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.319+0000 7f302cf34640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30280b4ef0 con 0x7f3028071a80 2024-04-25T08:54:44.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.319+0000 7f302cf34640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30280b51d0 con 0x7f302815ba50 2024-04-25T08:54:44.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.319+0000 7f3026d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3028070d40 0x7f302815be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56288/0 (socket says 172.21.15.55:56288) 2024-04-25T08:54:44.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.319+0000 7f3026d9d640 1 -- 172.21.15.55:0/1071352834 learned_addr learned my addr 172.21.15.55:0/1071352834 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:44.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.319+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317903274 0 0) 0x7f30280b66a0 con 0x7f3028070d40 2024-04-25T08:54:44.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.319+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3010003520 con 0x7f3028070d40 2024-04-25T08:54:44.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.319+0000 7f302659c640 1 --2- 172.21.15.55:0/1071352834 >> v2:172.21.15.167:3300/0 conn(0x7f302815ba50 0x7f30280b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1184394942 0 0) 0x7f3010003520 con 0x7f3028070d40 2024-04-25T08:54:44.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 >> v2:172.21.15.167:3300/0 conn(0x7f302815ba50 msgr2=0x7f30280b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:44.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 --2- 172.21.15.55:0/1071352834 >> v2:172.21.15.167:3300/0 conn(0x7f302815ba50 0x7f30280b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 >> v1:172.21.15.167:6789/0 conn(0x7f3028071a80 legacy=0x7f30280b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30280b54b0 con 0x7f3028070d40 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f30180019f0 con 0x7f3028070d40 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302659c640 1 --2- 172.21.15.55:0/1071352834 >> v2:172.21.15.167:3300/0 conn(0x7f302815ba50 0x7f30280b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 >> v1:172.21.15.55:6789/0 conn(0x7f3028070d40 legacy=0x7f302815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 --2- 172.21.15.55:0/1071352834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30100039b0 0x7f3010003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 --2- 172.21.15.55:0/1071352834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3010004800 0x7f3010004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 --2- 172.21.15.55:0/1071352834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 0x7f301000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280b51d0 con 0x7f30100051c0 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301000c110 con 0x7f3010004800 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301000c310 con 0x7f30100039b0 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f3026d9d640 1 --2- 172.21.15.55:0/1071352834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 0x7f301000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f302659c640 1 --2- 172.21.15.55:0/1071352834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30100039b0 0x7f3010003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f3025d9b640 1 --2- 172.21.15.55:0/1071352834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3010004800 0x7f3010004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f3026d9d640 1 -- 172.21.15.55:0/1071352834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30100039b0 msgr2=0x7f3010003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f3026d9d640 1 --2- 172.21.15.55:0/1071352834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30100039b0 0x7f3010003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f3026d9d640 1 -- 172.21.15.55:0/1071352834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3010004800 msgr2=0x7f3010004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f3026d9d640 1 --2- 172.21.15.55:0/1071352834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3010004800 0x7f3010004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.320+0000 7f3026d9d640 1 -- 172.21.15.55:0/1071352834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010003520 con 0x7f30100051c0 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.321+0000 7f3026d9d640 1 -- 172.21.15.55:0/1071352834 reap_dead start 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.321+0000 7f3026d9d640 1 --2- 172.21.15.55:0/1071352834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 0x7f301000b9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f301800a850 tx=0x7f3010005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65949d78698b9d20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.321+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800a4a0 con 0x7f30100051c0 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.321+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301802f070 con 0x7f30100051c0 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.321+0000 7f302559a640 1 -- 172.21.15.55:0/1071352834 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301802bce0 con 0x7f30100051c0 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.321+0000 7f302cf34640 1 -- 172.21.15.55:0/1071352834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 msgr2=0x7f301000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.321+0000 7f302cf34640 1 --2- 172.21.15.55:0/1071352834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 0x7f301000b9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f301800a850 tx=0x7f3010005830 comp rx=0 tx=0).stop 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.322+0000 7f302cf34640 1 -- 172.21.15.55:0/1071352834 shutdown_connections 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.322+0000 7f302cf34640 1 --2- 172.21.15.55:0/1071352834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 0x7f301000b9c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.322+0000 7f302cf34640 1 -- 172.21.15.55:0/1071352834 >> 172.21.15.55:0/1071352834 conn(0x7f30280b34c0 msgr2=0x7f30280b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.322+0000 7f302cf34640 1 -- 172.21.15.55:0/1071352834 shutdown_connections 2024-04-25T08:54:44.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.322+0000 7f302cf34640 1 -- 172.21.15.55:0/1071352834 wait complete. 2024-04-25T08:54:44.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.323+0000 7f302cf34640 1 Processor -- start 2024-04-25T08:54:44.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.323+0000 7f302cf34640 1 -- start start 2024-04-25T08:54:44.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302cf34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 0x7f302814cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302cf34640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30280ac8b0 0x7f30281514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302cf34640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3028151a10 0x7f302814fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302cf34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280711f0 con 0x7f30100051c0 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302cf34640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280b5a70 con 0x7f30280ac8b0 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302cf34640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3028071370 con 0x7f3028151a10 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 0x7f302814cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 0x7f302814cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56724/0 (socket says 172.21.15.55:56724) 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302659c640 1 -- 172.21.15.55:0/3309498515 learned_addr learned my addr 172.21.15.55:0/3309498515 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f3025d9b640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30280ac8b0 0x7f30281514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f3026d9d640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3028151a10 0x7f302814fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302659c640 1 -- 172.21.15.55:0/3309498515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3028151a10 msgr2=0x7f302814fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302659c640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3028151a10 0x7f302814fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302659c640 1 -- 172.21.15.55:0/3309498515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30280ac8b0 msgr2=0x7f30281514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302659c640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30280ac8b0 0x7f30281514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302659c640 1 -- 172.21.15.55:0/3309498515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302814ec90 con 0x7f30100051c0 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.324+0000 7f302659c640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 0x7f302814cf60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f30200115c0 tx=0x7f3020011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:44.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.325+0000 7f3016ffd640 1 -- 172.21.15.55:0/3309498515 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020019070 con 0x7f30100051c0 2024-04-25T08:54:44.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.325+0000 7f3016ffd640 1 -- 172.21.15.55:0/3309498515 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3020004220 con 0x7f30100051c0 2024-04-25T08:54:44.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.325+0000 7f3016ffd640 1 -- 172.21.15.55:0/3309498515 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302000f040 con 0x7f30100051c0 2024-04-25T08:54:44.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.325+0000 7f302cf34640 1 -- 172.21.15.55:0/3309498515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302814ef70 con 0x7f30100051c0 2024-04-25T08:54:44.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.325+0000 7f302cf34640 1 -- 172.21.15.55:0/3309498515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302814ff90 con 0x7f30100051c0 2024-04-25T08:54:44.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.326+0000 7f302cf34640 1 -- 172.21.15.55:0/3309498515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30280749b0 con 0x7f30100051c0 2024-04-25T08:54:44.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.326+0000 7f3016ffd640 1 -- 172.21.15.55:0/3309498515 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f302000f6f0 con 0x7f30100051c0 2024-04-25T08:54:44.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.326+0000 7f3016ffd640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b500 0x7f300806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.326+0000 7f3016ffd640 1 -- 172.21.15.55:0/3309498515 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f302008a470 con 0x7f30100051c0 2024-04-25T08:54:44.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.327+0000 7f3025d9b640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b500 0x7f300806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.327+0000 7f3025d9b640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b500 0x7f300806d9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f301c000c00 tx=0x7f301c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:44.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.331+0000 7f3016ffd640 1 -- 172.21.15.55:0/3309498515 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3020058b70 con 0x7f30100051c0 2024-04-25T08:54:44.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.581+0000 7f302cf34640 1 -- 172.21.15.55:0/3309498515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3028151df0 con 0x7f30100051c0 2024-04-25T08:54:44.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.587+0000 7f3016ffd640 1 -- 172.21.15.55:0/3309498515 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f302005cc10 con 0x7f30100051c0 2024-04-25T08:54:44.577 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-04-25T08:54:44.578 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw== 2024-04-25T08:54:44.578 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2024-04-25T08:54:44.578 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2024-04-25T08:54:44.578 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:54:44.578 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-25T08:54:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 -- 172.21.15.55:0/3309498515 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b500 msgr2=0x7f300806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b500 0x7f300806d9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f301c000c00 tx=0x7f301c009040 comp rx=0 tx=0).stop 2024-04-25T08:54:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 -- 172.21.15.55:0/3309498515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 msgr2=0x7f302814cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 0x7f302814cf60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f30200115c0 tx=0x7f3020011a80 comp rx=0 tx=0).stop 2024-04-25T08:54:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 -- 172.21.15.55:0/3309498515 shutdown_connections 2024-04-25T08:54:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b500 0x7f300806d9c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3028151a10 0x7f302814fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30280ac8b0 0x7f30281514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 --2- 172.21.15.55:0/3309498515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30100051c0 0x7f302814cf60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 -- 172.21.15.55:0/3309498515 >> 172.21.15.55:0/3309498515 conn(0x7f30280b34c0 msgr2=0x7f30280d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:44.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 -- 172.21.15.55:0/3309498515 shutdown_connections 2024-04-25T08:54:44.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.590+0000 7f302cf34640 1 -- 172.21.15.55:0/3309498515 wait complete. 2024-04-25T08:54:44.590 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:54:44.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.702+0000 7f00290fc640 1 Processor -- start 2024-04-25T08:54:44.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.702+0000 7f00290fc640 1 -- start start 2024-04-25T08:54:44.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f00290fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f002415dce0 0x7f00240d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f00290fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00240b5b60 0x7f00240b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f00290fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002415e0c0 con 0x7f00240d35b0 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f00290fc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00240d2510 con 0x7f002415dce0 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f00290fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00240d27f0 con 0x7f00240b5b60 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f002259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f00240d35b0 0x7f00240b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56296/0 (socket says 172.21.15.55:56296) 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f002259c640 1 -- 172.21.15.55:0/2982129515 learned_addr learned my addr 172.21.15.55:0/2982129515 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f002359e640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00240b5b60 0x7f00240b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f0022d9d640 1 --2- 172.21.15.55:0/2982129515 >> v2:172.21.15.167:3300/0 conn(0x7f002415dce0 0x7f00240d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757491579 0 0) 0x7f002415e0c0 con 0x7f00240d35b0 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f000c003520 con 0x7f00240d35b0 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3752276035 0 0) 0x7f000c003520 con 0x7f00240d35b0 2024-04-25T08:54:44.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00240b5b60 msgr2=0x7f00240b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f0021d9b640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00240b5b60 0x7f00240b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 >> v2:172.21.15.167:3300/0 conn(0x7f002415dce0 msgr2=0x7f00240d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.703+0000 7f0021d9b640 1 --2- 172.21.15.55:0/2982129515 >> v2:172.21.15.167:3300/0 conn(0x7f002415dce0 0x7f00240d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240d2ad0 con 0x7f00240d35b0 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f0018001670 con 0x7f00240d35b0 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 >> v1:172.21.15.55:6789/0 conn(0x7f00240d35b0 legacy=0x7f00240b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f0021d9b640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00240b5b60 0x7f000c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f0021d9b640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f000c003f30 0x7f000c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f0021d9b640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c004d40 0x7f000c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240d2510 con 0x7f000c004d40 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240d27f0 con 0x7f000c003f30 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c00b9c0 con 0x7f00240b5b60 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f002359e640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c004d40 0x7f000c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f002259c640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f000c003f30 0x7f000c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f0022d9d640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00240b5b60 0x7f000c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f002359e640 1 -- 172.21.15.55:0/2982129515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00240b5b60 msgr2=0x7f000c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f002359e640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00240b5b60 0x7f000c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f002359e640 1 -- 172.21.15.55:0/2982129515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f000c003f30 msgr2=0x7f000c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f002359e640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f000c003f30 0x7f000c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.704+0000 7f002359e640 1 -- 172.21.15.55:0/2982129515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c003520 con 0x7f000c004d40 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.705+0000 7f002359e640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c004d40 0x7f000c0051c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f001c009fc0 tx=0x7f000c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a12b4997bd51a0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.705+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c009c10 con 0x7f000c004d40 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.705+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c036070 con 0x7f000c004d40 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.705+0000 7f0021d9b640 1 -- 172.21.15.55:0/2982129515 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c031670 con 0x7f000c004d40 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.705+0000 7f00290fc640 1 -- 172.21.15.55:0/2982129515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c004d40 msgr2=0x7f000c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.705+0000 7f00290fc640 1 --2- 172.21.15.55:0/2982129515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c004d40 0x7f000c0051c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f001c009fc0 tx=0x7f000c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.705+0000 7f002359e640 1 -- 172.21.15.55:0/2982129515 reap_dead start 2024-04-25T08:54:44.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.705+0000 7f00290fc640 1 -- 172.21.15.55:0/2982129515 shutdown_connections 2024-04-25T08:54:44.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.705+0000 7f00290fc640 1 -- 172.21.15.55:0/2982129515 >> 172.21.15.55:0/2982129515 conn(0x7f0024072900 msgr2=0x7f00240d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:44.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.705+0000 7f00290fc640 1 -- 172.21.15.55:0/2982129515 shutdown_connections 2024-04-25T08:54:44.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.705+0000 7f00290fc640 1 -- 172.21.15.55:0/2982129515 wait complete. 2024-04-25T08:54:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.707+0000 7f00290fc640 1 Processor -- start 2024-04-25T08:54:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.707+0000 7f00290fc640 1 -- start start 2024-04-25T08:54:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f00290fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0024146090 0x7f0024160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f00290fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0024160fa0 0x7f00240d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f00290fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0024159c40 0x7f00240d3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f00290fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240b9820 con 0x7f0024146090 2024-04-25T08:54:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f00290fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240d3090 con 0x7f0024159c40 2024-04-25T08:54:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f00290fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00240b99a0 con 0x7f0024160fa0 2024-04-25T08:54:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f0022d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0024146090 0x7f0024160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f0022d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0024146090 0x7f0024160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56734/0 (socket says 172.21.15.55:56734) 2024-04-25T08:54:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f0022d9d640 1 -- 172.21.15.55:0/1545449318 learned_addr learned my addr 172.21.15.55:0/1545449318 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f002259c640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0024160fa0 0x7f00240d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f002359e640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0024159c40 0x7f00240d3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f0022d9d640 1 -- 172.21.15.55:0/1545449318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0024160fa0 msgr2=0x7f00240d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f0022d9d640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0024160fa0 0x7f00240d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f0022d9d640 1 -- 172.21.15.55:0/1545449318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0024159c40 msgr2=0x7f00240d3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f0022d9d640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0024159c40 0x7f00240d3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f0022d9d640 1 -- 172.21.15.55:0/1545449318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002415a1e0 con 0x7f0024146090 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f002359e640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0024159c40 0x7f00240d3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f0022d9d640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0024146090 0x7f0024160a60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0014011a70 tx=0x7f0014011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.708+0000 7f000b7fe640 1 -- 172.21.15.55:0/1545449318 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400fb50 con 0x7f0024146090 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.709+0000 7f000b7fe640 1 -- 172.21.15.55:0/1545449318 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001400fcf0 con 0x7f0024146090 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.709+0000 7f00290fc640 1 -- 172.21.15.55:0/1545449318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002415fca0 con 0x7f0024146090 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.709+0000 7f000b7fe640 1 -- 172.21.15.55:0/1545449318 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400fea0 con 0x7f0024146090 2024-04-25T08:54:44.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.709+0000 7f00290fc640 1 -- 172.21.15.55:0/1545449318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0024160260 con 0x7f0024146090 2024-04-25T08:54:44.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.710+0000 7f00290fc640 1 -- 172.21.15.55:0/1545449318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00240749b0 con 0x7f0024146090 2024-04-25T08:54:44.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.710+0000 7f000b7fe640 1 -- 172.21.15.55:0/1545449318 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0014012040 con 0x7f0024146090 2024-04-25T08:54:44.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.710+0000 7f000b7fe640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f001006b4d0 0x7f001006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:44.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.710+0000 7f000b7fe640 1 -- 172.21.15.55:0/1545449318 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f001408a7f0 con 0x7f0024146090 2024-04-25T08:54:44.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.710+0000 7f002259c640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f001006b4d0 0x7f001006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:44.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.711+0000 7f002259c640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f001006b4d0 0x7f001006d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0018007fd0 tx=0x7f0018007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:44.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.715+0000 7f000b7fe640 1 -- 172.21.15.55:0/1545449318 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0014019030 con 0x7f0024146090 2024-04-25T08:54:44.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.932+0000 7f00290fc640 1 -- 172.21.15.55:0/1545449318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00240b3ee0 con 0x7f0024146090 2024-04-25T08:54:44.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.932+0000 7f000b7fe640 1 -- 172.21.15.55:0/1545449318 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f0014059700 con 0x7f0024146090 2024-04-25T08:54:44.923 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:44.923 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2362450653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2362450653},{"type":"v1","addr":"172.21.15.167:6835","nonce":2362450653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3897225045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3897225045},{"type":"v1","addr":"172.21.15.167:6834","nonce":3897225045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2007115110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2007115110},{"type":"v1","addr":"172.21.15.55:6836","nonce":2007115110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:54:35.752157+0000","modified":"2024-04-25T08:54:37.749451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1495159001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1495159001},{"type":"v1","addr":"172.21.15.55:6837","nonce":1495159001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:54:44.923 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-25T08:54:44.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 -- 172.21.15.55:0/1545449318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f001006b4d0 msgr2=0x7f001006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f001006b4d0 0x7f001006d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0018007fd0 tx=0x7f0018007970 comp rx=0 tx=0).stop 2024-04-25T08:54:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 -- 172.21.15.55:0/1545449318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0024146090 msgr2=0x7f0024160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0024146090 0x7f0024160a60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0014011a70 tx=0x7f0014011f30 comp rx=0 tx=0).stop 2024-04-25T08:54:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 -- 172.21.15.55:0/1545449318 shutdown_connections 2024-04-25T08:54:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f001006b4d0 0x7f001006d990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0024159c40 0x7f00240d3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0024160fa0 0x7f00240d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 --2- 172.21.15.55:0/1545449318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0024146090 0x7f0024160a60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 -- 172.21.15.55:0/1545449318 >> 172.21.15.55:0/1545449318 conn(0x7f0024072900 msgr2=0x7f00240b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 -- 172.21.15.55:0/1545449318 shutdown_connections 2024-04-25T08:54:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:44.934+0000 7f00290fc640 1 -- 172.21.15.55:0/1545449318 wait complete. 2024-04-25T08:54:45.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:54:35.752157+0000', 'modified': '2024-04-25T08:54:37.749451+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5127}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5127': {'gid': 5127, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/1495159001', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 1495159001}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 1495159001}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:54:45.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:54:45.339 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T08:54:45.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.456+0000 7f7abd4cb640 1 Processor -- start 2024-04-25T08:54:45.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.457+0000 7f7abd4cb640 1 -- start start 2024-04-25T08:54:45.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.457+0000 7f7abd4cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ab80d3580 0x7f7ab815ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.457+0000 7f7abd4cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab80b9980 con 0x7f7ab80b5c80 2024-04-25T08:54:45.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.457+0000 7f7abd4cb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab80ce140 con 0x7f7ab815dbe0 2024-04-25T08:54:45.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.457+0000 7f7abd4cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab815f210 con 0x7f7ab80d3580 2024-04-25T08:54:45.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.458+0000 7f7ab77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ab80d3580 0x7f7ab815ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.458+0000 7f7ab67fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7ab80b5c80 0x7f7ab8161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56300/0 (socket says 172.21.15.55:56300) 2024-04-25T08:54:45.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.458+0000 7f7ab67fc640 1 -- 172.21.15.55:0/2740957953 learned_addr learned my addr 172.21.15.55:0/2740957953 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:45.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.458+0000 7f7ab5ffb640 1 -- 172.21.15.55:0/2740957953 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336028901 0 0) 0x7f7ab80b9980 con 0x7f7ab80b5c80 2024-04-25T08:54:45.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.458+0000 7f7ab5ffb640 1 -- 172.21.15.55:0/2740957953 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa0003520 con 0x7f7ab80b5c80 2024-04-25T08:54:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.458+0000 7f7ab77fe640 1 -- 172.21.15.55:0/2740957953 >> v1:172.21.15.167:6789/0 conn(0x7f7ab815dbe0 legacy=0x7f7ab80b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.458+0000 7f7ab77fe640 1 -- 172.21.15.55:0/2740957953 >> v1:172.21.15.55:6789/0 conn(0x7f7ab80b5c80 legacy=0x7f7ab8161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.458+0000 7f7ab77fe640 1 -- 172.21.15.55:0/2740957953 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab80ce420 con 0x7f7ab80d3580 2024-04-25T08:54:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.459+0000 7f7ab77fe640 1 --2- 172.21.15.55:0/2740957953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab80d3580 0x7f7ab815ecd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009d90 tx=0x7f7aa802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728ddc9cb4e7987c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.459+0000 7f7ab5ffb640 1 -- 172.21.15.55:0/2740957953 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8007740 con 0x7f7ab80d3580 2024-04-25T08:54:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.459+0000 7f7ab5ffb640 1 -- 172.21.15.55:0/2740957953 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa80078e0 con 0x7f7ab80d3580 2024-04-25T08:54:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.459+0000 7f7ab5ffb640 1 -- 172.21.15.55:0/2740957953 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8007c90 con 0x7f7ab80d3580 2024-04-25T08:54:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.459+0000 7f7abd4cb640 1 -- 172.21.15.55:0/2740957953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab80d3580 msgr2=0x7f7ab815ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.459+0000 7f7abd4cb640 1 --2- 172.21.15.55:0/2740957953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab80d3580 0x7f7ab815ecd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009d90 tx=0x7f7aa802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.459+0000 7f7abd4cb640 1 -- 172.21.15.55:0/2740957953 shutdown_connections 2024-04-25T08:54:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.459+0000 7f7abd4cb640 1 --2- 172.21.15.55:0/2740957953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab80d3580 0x7f7ab815ecd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.459+0000 7f7abd4cb640 1 -- 172.21.15.55:0/2740957953 >> 172.21.15.55:0/2740957953 conn(0x7f7ab8072900 msgr2=0x7f7ab80d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.459+0000 7f7abd4cb640 1 -- 172.21.15.55:0/2740957953 shutdown_connections 2024-04-25T08:54:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.459+0000 7f7abd4cb640 1 -- 172.21.15.55:0/2740957953 wait complete. 2024-04-25T08:54:45.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.461+0000 7f7abd4cb640 1 Processor -- start 2024-04-25T08:54:45.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.461+0000 7f7abd4cb640 1 -- start start 2024-04-25T08:54:45.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.461+0000 7f7abd4cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab80b5c80 0x7f7ab814eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.461+0000 7f7abd4cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ab80d3580 0x7f7ab80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.461+0000 7f7abd4cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ab815dbe0 0x7f7ab80cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.461+0000 7f7abd4cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab815dfc0 con 0x7f7ab80b5c80 2024-04-25T08:54:45.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.461+0000 7f7abd4cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab80d3060 con 0x7f7ab815dbe0 2024-04-25T08:54:45.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.461+0000 7f7abd4cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab815e140 con 0x7f7ab80d3580 2024-04-25T08:54:45.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab80b5c80 0x7f7ab814eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab80b5c80 0x7f7ab814eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56760/0 (socket says 172.21.15.55:56760) 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab6ffd640 1 -- 172.21.15.55:0/1333864875 learned_addr learned my addr 172.21.15.55:0/1333864875 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ab80d3580 0x7f7ab80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab77fe640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ab815dbe0 0x7f7ab80cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab6ffd640 1 -- 172.21.15.55:0/1333864875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ab80d3580 msgr2=0x7f7ab80cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab6ffd640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ab80d3580 0x7f7ab80cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab6ffd640 1 -- 172.21.15.55:0/1333864875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ab815dbe0 msgr2=0x7f7ab80cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab6ffd640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ab815dbe0 0x7f7ab80cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab6ffd640 1 -- 172.21.15.55:0/1333864875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab80caf10 con 0x7f7ab80b5c80 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ab80d3580 0x7f7ab80cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab77fe640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ab815dbe0 0x7f7ab80cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7ab6ffd640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab80b5c80 0x7f7ab814eed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c3f0 tx=0x7f7ab000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7a9f7fe640 1 -- 172.21.15.55:0/1333864875 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00052d0 con 0x7f7ab80b5c80 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7a9f7fe640 1 -- 172.21.15.55:0/1333864875 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab0005490 con 0x7f7ab80b5c80 2024-04-25T08:54:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7abd4cb640 1 -- 172.21.15.55:0/1333864875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab80cb1f0 con 0x7f7ab80b5c80 2024-04-25T08:54:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7a9f7fe640 1 -- 172.21.15.55:0/1333864875 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0007260 con 0x7f7ab80b5c80 2024-04-25T08:54:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.462+0000 7f7abd4cb640 1 -- 172.21.15.55:0/1333864875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab80cb7b0 con 0x7f7ab80b5c80 2024-04-25T08:54:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.464+0000 7f7a9f7fe640 1 -- 172.21.15.55:0/1333864875 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ab0007400 con 0x7f7ab80b5c80 2024-04-25T08:54:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.464+0000 7f7a9f7fe640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7aa406b4d0 0x7f7aa406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.464+0000 7f7a9f7fe640 1 -- 172.21.15.55:0/1333864875 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ab00896e0 con 0x7f7ab80b5c80 2024-04-25T08:54:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.464+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7aa406b4d0 0x7f7aa406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.465+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7aa406b4d0 0x7f7aa406d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7ab815b3a0 tx=0x7f7aac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.465+0000 7f7ac01d2740 1 Processor -- start 2024-04-25T08:54:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.466+0000 7f7ac01d2740 1 -- start start 2024-04-25T08:54:45.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.466+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b0a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.466+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b28020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.466+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9adff10 0x55d5a9b26190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.466+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a9a42a10 con 0x55d5a9b27ad0 2024-04-25T08:54:45.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.466+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a99ebb30 con 0x55d5a9b0a230 2024-04-25T08:54:45.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.466+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5a9a3ec50 con 0x55d5a9adff10 2024-04-25T08:54:45.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.466+0000 7f7ab67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b28020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.466+0000 7f7ab67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b28020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56776/0 (socket says 172.21.15.55:56776) 2024-04-25T08:54:45.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.466+0000 7f7ab67fc640 1 -- 172.21.15.55:0/2596068784 learned_addr learned my addr 172.21.15.55:0/2596068784 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:45.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.467+0000 7f7ab67fc640 1 -- 172.21.15.55:0/2596068784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9adff10 msgr2=0x55d5a9b26190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:45.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.467+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/2596068784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9adff10 0x55d5a9b26190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.467+0000 7f7ab6ffd640 1 --2- 172.21.15.55:0/2596068784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b0a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.467+0000 7f7ab67fc640 1 -- 172.21.15.55:0/2596068784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 msgr2=0x55d5a9b0a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:45.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.467+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/2596068784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b0a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.467+0000 7f7ab67fc640 1 -- 172.21.15.55:0/2596068784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5a9a00e10 con 0x55d5a9b27ad0 2024-04-25T08:54:45.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.467+0000 7f7ab6ffd640 1 --2- 172.21.15.55:0/2596068784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b0a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:45.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.467+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/2596068784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b28020 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7aac005b60 tx=0x7f7aac010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a3780a33b02376 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:45.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.467+0000 7f7a9cff9640 1 -- 172.21.15.55:0/2596068784 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac007750 con 0x55d5a9b27ad0 2024-04-25T08:54:45.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.467+0000 7f7a9cff9640 1 -- 172.21.15.55:0/2596068784 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac00dbb0 con 0x55d5a9b27ad0 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.467+0000 7f7a9cff9640 1 -- 172.21.15.55:0/2596068784 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac020450 con 0x55d5a9b27ad0 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.468+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2596068784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 msgr2=0x55d5a9b28020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.468+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/2596068784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b28020 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7aac005b60 tx=0x7f7aac010000 comp rx=0 tx=0).stop 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.468+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2596068784 shutdown_connections 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.468+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/2596068784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9adff10 0x55d5a9b26190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.468+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/2596068784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b28020 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.468+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/2596068784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b0a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.468+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2596068784 >> 172.21.15.55:0/2596068784 conn(0x55d5a9adc840 msgr2=0x55d5a9b25040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.468+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2596068784 shutdown_connections 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.468+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2596068784 wait complete. 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.468+0000 7f7ac01d2740 1 -- start start 2024-04-25T08:54:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.469+0000 7f7ac01d2740 1 Processor -- start 2024-04-25T08:54:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.469+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b1cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.469+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b08c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.469+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b047f0 0x55d5a9b091b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.469+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a9ae0cb0 con 0x55d5a9b27ad0 2024-04-25T08:54:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.469+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a99ff0c0 con 0x55d5a9b0a230 2024-04-25T08:54:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.469+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5a9ada770 con 0x55d5a9b047f0 2024-04-25T08:54:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.469+0000 7f7ac01d2740 10 client.0 _ll_register_callbacks cb 0x55d5a99f2ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:54:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.469+0000 7f7ab67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b08c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.469+0000 7f7ab67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b08c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56790/0 (socket says 172.21.15.55:56790) 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.469+0000 7f7ab67fc640 1 -- 172.21.15.55:0/1375910582 learned_addr learned my addr 172.21.15.55:0/1375910582 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ab77fe640 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b047f0 0x55d5a9b091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ab67fc640 1 -- 172.21.15.55:0/1375910582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b047f0 msgr2=0x55d5a9b091b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ab6ffd640 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b1cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b047f0 0x55d5a9b091b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ab67fc640 1 -- 172.21.15.55:0/1375910582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 msgr2=0x55d5a9b1cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b1cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ab67fc640 1 -- 172.21.15.55:0/1375910582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5a97572d0 con 0x55d5a9b27ad0 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ab77fe640 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b047f0 0x55d5a9b091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b08c70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0074a0 tx=0x7f7aac012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1da784314b4c62c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7a95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7a95ffb640 1 -- 172.21.15.55:0/1375910582 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac007750 con 0x55d5a9b27ad0 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7a95ffb640 1 -- 172.21.15.55:0/1375910582 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7aac00d9b0 con 0x55d5a9b27ad0 2024-04-25T08:54:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ac01d2740 1 -- 172.21.15.55:0/1375910582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7aac00dbb0 con 0x55d5a9b27ad0 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7a95ffb640 1 -- 172.21.15.55:0/1375910582 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7aac033050 con 0x55d5a9b27ad0 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ac01d2740 10 client.5316 fetch_fsmap learned FSMap version 13 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ac01d2740 1 -- 172.21.15.55:0/1375910582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55d5a98216b0 con 0x55d5a9b27ad0 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7a95ffb640 1 -- 172.21.15.55:0/1375910582 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac00dbb0 con 0x55d5a9b27ad0 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7a95ffb640 1 -- 172.21.15.55:0/1375910582 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 13) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7aac036020 con 0x55d5a9b27ad0 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ac01d2740 10 client.5316 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ac01d2740 10 client.5316 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ac01d2740 20 client.5316 populate_metadata read hostname 'smithi055' 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.470+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.55:6835/1495159001,v1:172.21.15.55:6837/1495159001] conn(0x55d5a9b0b0d0 0x55d5a9b0b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.471+0000 7f7ac01d2740 4 client.5316 mds_command: new command op to 5127 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.471+0000 7f7ac01d2740 1 -- 172.21.15.55:0/1375910582 --> [v2:172.21.15.55:6835/1495159001,v1:172.21.15.55:6837/1495159001] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d5a9aa1920 con 0x55d5a9b0b0d0 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.471+0000 7f7ab6ffd640 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.55:6835/1495159001,v1:172.21.15.55:6837/1495159001] conn(0x55d5a9b0b0d0 0x55d5a9b0b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.471+0000 7f7a95ffb640 10 client.5316 ms_handle_connect on v2:172.21.15.55:6835/1495159001 2024-04-25T08:54:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.471+0000 7f7ab6ffd640 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.55:6835/1495159001,v1:172.21.15.55:6837/1495159001] conn(0x55d5a9b0b0d0 0x55d5a9b0b4b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47905ada8e3962aa server_cookie=de73731fe14c1beb in_seq=0 out_seq=0 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.471+0000 7f7a95ffb640 1 -- 172.21.15.55:0/1375910582 <== mds.0 v2:172.21.15.55:6835/1495159001 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d5a9aa1920 con 0x55d5a9b0b0d0 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7a95ffb640 10 client.5316 handle_command_reply: tid=0 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 1 client.5316 shutdown 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 1 -- 172.21.15.55:0/1375910582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 msgr2=0x55d5a9b08c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b08c70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0074a0 tx=0x7f7aac012000 comp rx=0 tx=0).stop 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 1 -- 172.21.15.55:0/1375910582 shutdown_connections 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.55:6835/1495159001,v1:172.21.15.55:6837/1495159001] conn(0x55d5a9b0b0d0 0x55d5a9b0b4b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b047f0 0x55d5a9b091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b08c70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7a95ffb640 0 client.5316 ms_handle_reset on v2:172.21.15.55:6835/1495159001 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/1375910582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b1cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 1 -- 172.21.15.55:0/1375910582 >> 172.21.15.55:0/1375910582 conn(0x55d5a9adff10 msgr2=0x55d5a9b285c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 1 -- 172.21.15.55:0/1375910582 shutdown_connections 2024-04-25T08:54:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 1 -- 172.21.15.55:0/1375910582 wait complete. 2024-04-25T08:54:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.472+0000 7f7ac01d2740 20 client.5316 trim_cache size 0 max 16384 2024-04-25T08:54:45.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.488+0000 7f7ac01d2740 1 Processor -- start 2024-04-25T08:54:45.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.488+0000 7f7ac01d2740 1 -- start start 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.488+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b047f0 0x55d5a9b0b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.488+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b0a230 0x55d5a9b33650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.488+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b27ad0 0x55d5a9b33b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.488+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab80c8af0 con 0x55d5a9b0a230 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.488+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab80c7ef0 con 0x55d5a9b047f0 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.488+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab80c84f0 con 0x55d5a9b27ad0 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.488+0000 7f7ab67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b0a230 0x55d5a9b33650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.489+0000 7f7ab67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b0a230 0x55d5a9b33650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56804/0 (socket says 172.21.15.55:56804) 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.489+0000 7f7ab67fc640 1 -- 172.21.15.55:0/670030239 learned_addr learned my addr 172.21.15.55:0/670030239 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.489+0000 7f7ab67fc640 1 -- 172.21.15.55:0/670030239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b27ad0 msgr2=0x55d5a9b33b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.489+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/670030239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b27ad0 0x55d5a9b33b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.489+0000 7f7ab67fc640 1 -- 172.21.15.55:0/670030239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b047f0 msgr2=0x55d5a9b0b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.489+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/670030239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b047f0 0x55d5a9b0b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.489+0000 7f7ab67fc640 1 -- 172.21.15.55:0/670030239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5a9a3edd0 con 0x55d5a9b0a230 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.489+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/670030239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b0a230 0x55d5a9b33650 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7aac007c90 tx=0x7f7aac01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae42983573261fe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.489+0000 7f7a97fff640 1 -- 172.21.15.55:0/670030239 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac022d50 con 0x55d5a9b0a230 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.489+0000 7f7a97fff640 1 -- 172.21.15.55:0/670030239 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac0058f0 con 0x55d5a9b0a230 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.489+0000 7f7a97fff640 1 -- 172.21.15.55:0/670030239 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0220b0 con 0x55d5a9b0a230 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.490+0000 7f7ac01d2740 1 -- 172.21.15.55:0/670030239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b0a230 msgr2=0x55d5a9b33650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.490+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/670030239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b0a230 0x55d5a9b33650 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7aac007c90 tx=0x7f7aac01c000 comp rx=0 tx=0).stop 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.490+0000 7f7ac01d2740 1 -- 172.21.15.55:0/670030239 shutdown_connections 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.490+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/670030239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b27ad0 0x55d5a9b33b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.490+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/670030239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b0a230 0x55d5a9b33650 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.490+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/670030239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b047f0 0x55d5a9b0b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.490+0000 7f7ac01d2740 1 -- 172.21.15.55:0/670030239 >> 172.21.15.55:0/670030239 conn(0x55d5a9adff10 msgr2=0x55d5a9b1bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:45.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.490+0000 7f7ac01d2740 1 -- 172.21.15.55:0/670030239 shutdown_connections 2024-04-25T08:54:45.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.490+0000 7f7ac01d2740 1 -- 172.21.15.55:0/670030239 wait complete. 2024-04-25T08:54:45.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.490+0000 7f7ac01d2740 1 -- start start 2024-04-25T08:54:45.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.490+0000 7f7ac01d2740 1 Processor -- start 2024-04-25T08:54:45.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b047f0 0x55d5a9b8a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b90cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ac01d2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b33860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a9b05110 con 0x55d5a9b27ad0 2024-04-25T08:54:45.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a9b0d250 con 0x55d5a9b0a230 2024-04-25T08:54:45.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ac01d2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5a9b0dbb0 con 0x55d5a9b047f0 2024-04-25T08:54:45.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ac01d2740 10 client.0 _ll_register_callbacks cb 0x55d5a9adac50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:54:45.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ab77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b33860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ab77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b33860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56814/0 (socket says 172.21.15.55:56814) 2024-04-25T08:54:45.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ab77fe640 1 -- 172.21.15.55:0/2615725409 learned_addr learned my addr 172.21.15.55:0/2615725409 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:45.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ab67fc640 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b90cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ab6ffd640 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b047f0 0x55d5a9b8a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ab77fe640 1 -- 172.21.15.55:0/2615725409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b047f0 msgr2=0x55d5a9b8a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ab77fe640 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b047f0 0x55d5a9b8a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ab77fe640 1 -- 172.21.15.55:0/2615725409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 msgr2=0x55d5a9b90cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ab77fe640 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b90cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ab77fe640 1 -- 172.21.15.55:0/2615725409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5a9b26910 con 0x55d5a9b27ad0 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7ab77fe640 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b33860 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009eb0 tx=0x7f7aa8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3582ecec77163c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.491+0000 7f7a95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7a95ffb640 1 -- 172.21.15.55:0/2615725409 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8009450 con 0x55d5a9b27ad0 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7a95ffb640 1 -- 172.21.15.55:0/2615725409 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7aa80047f0 con 0x55d5a9b27ad0 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2615725409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7aac0058f0 con 0x55d5a9b27ad0 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7a95ffb640 1 -- 172.21.15.55:0/2615725409 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7aa804e050 con 0x55d5a9b27ad0 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7ac01d2740 10 client.5322 fetch_fsmap learned FSMap version 13 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2615725409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55d5a9b24d40 con 0x55d5a9b27ad0 2024-04-25T08:54:45.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7a95ffb640 1 -- 172.21.15.55:0/2615725409 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac0058f0 con 0x55d5a9b27ad0 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7a95ffb640 1 -- 172.21.15.55:0/2615725409 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 13) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7aa8051020 con 0x55d5a9b27ad0 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7ac01d2740 10 client.5322 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7ac01d2740 10 client.5322 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7ac01d2740 20 client.5322 populate_metadata read hostname 'smithi055' 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.55:6835/1495159001,v1:172.21.15.55:6837/1495159001] conn(0x55d5a9b28540 0x55d5a9addcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7ac01d2740 4 client.5322 mds_command: new command op to 5127 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2615725409 --> [v2:172.21.15.55:6835/1495159001,v1:172.21.15.55:6837/1495159001] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d5a9a4ff50 con 0x55d5a9b28540 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7ab6ffd640 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.55:6835/1495159001,v1:172.21.15.55:6837/1495159001] conn(0x55d5a9b28540 0x55d5a9addcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7a95ffb640 10 client.5322 ms_handle_connect on v2:172.21.15.55:6835/1495159001 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.492+0000 7f7ab6ffd640 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.55:6835/1495159001,v1:172.21.15.55:6837/1495159001] conn(0x55d5a9b28540 0x55d5a9addcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=401ba0112ae64045 server_cookie=38c2422b50042098 in_seq=0 out_seq=0 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7a95ffb640 1 -- 172.21.15.55:0/2615725409 <== mds.0 v2:172.21.15.55:6835/1495159001 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d5a9a4ff50 con 0x55d5a9b28540 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7a95ffb640 10 client.5322 handle_command_reply: tid=0 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 1 client.5322 shutdown 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2615725409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 msgr2=0x55d5a9b33860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b33860 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009eb0 tx=0x7f7aa8004270 comp rx=0 tx=0).stop 2024-04-25T08:54:45.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2615725409 shutdown_connections 2024-04-25T08:54:45.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.55:6835/1495159001,v1:172.21.15.55:6837/1495159001] conn(0x55d5a9b28540 0x55d5a9addcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5a9b27ad0 0x55d5a9b33860 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5a9b0a230 0x55d5a9b90cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7a95ffb640 0 client.5322 ms_handle_reset on v2:172.21.15.55:6835/1495159001 2024-04-25T08:54:45.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 1 --2- 172.21.15.55:0/2615725409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d5a9b047f0 0x55d5a9b8a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2615725409 >> 172.21.15.55:0/2615725409 conn(0x55d5a9adff10 msgr2=0x55d5a9b1b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:45.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2615725409 shutdown_connections 2024-04-25T08:54:45.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 1 -- 172.21.15.55:0/2615725409 wait complete. 2024-04-25T08:54:45.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7ac01d2740 20 client.5322 trim_cache size 0 max 16384 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5127, 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 9.111318357, 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 13, 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 36, 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 36, 2024-04-25T08:54:45.490 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 16.293127372000001 2024-04-25T08:54:45.491 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:54:45.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7abd4cb640 1 -- 172.21.15.55:0/1333864875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7aa406b4d0 msgr2=0x7f7aa406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7abd4cb640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7aa406b4d0 0x7f7aa406d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7ab815b3a0 tx=0x7f7aac009040 comp rx=0 tx=0).stop 2024-04-25T08:54:45.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7abd4cb640 1 -- 172.21.15.55:0/1333864875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab80b5c80 msgr2=0x7f7ab814eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.493+0000 7f7abd4cb640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab80b5c80 0x7f7ab814eed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c3f0 tx=0x7f7ab000c8b0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.494+0000 7f7abd4cb640 1 -- 172.21.15.55:0/1333864875 shutdown_connections 2024-04-25T08:54:45.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.494+0000 7f7abd4cb640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7aa406b4d0 0x7f7aa406d990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.494+0000 7f7abd4cb640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ab815dbe0 0x7f7ab80cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.494+0000 7f7abd4cb640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ab80d3580 0x7f7ab80cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.494+0000 7f7abd4cb640 1 --2- 172.21.15.55:0/1333864875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab80b5c80 0x7f7ab814eed0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.494+0000 7f7abd4cb640 1 -- 172.21.15.55:0/1333864875 >> 172.21.15.55:0/1333864875 conn(0x7f7ab8072900 msgr2=0x7f7ab80d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:45.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.494+0000 7f7abd4cb640 1 -- 172.21.15.55:0/1333864875 shutdown_connections 2024-04-25T08:54:45.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.494+0000 7f7abd4cb640 1 -- 172.21.15.55:0/1333864875 wait complete. 2024-04-25T08:54:45.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:54:45.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.605+0000 7f203788f640 1 Processor -- start 2024-04-25T08:54:45.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.605+0000 7f203788f640 1 -- start start 2024-04-25T08:54:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.606+0000 7f203788f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f203009a150 0x7f203006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.606+0000 7f203788f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203006c660 con 0x7f203015ba10 2024-04-25T08:54:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.606+0000 7f203788f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203006c900 con 0x7f203006c1f0 2024-04-25T08:54:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.606+0000 7f203788f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20300cbe50 con 0x7f203009a150 2024-04-25T08:54:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.606+0000 7f203562b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f203015ba10 0x7f2030099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56306/0 (socket says 172.21.15.55:56306) 2024-04-25T08:54:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.606+0000 7f203562b640 1 -- 172.21.15.55:0/3572785893 learned_addr learned my addr 172.21.15.55:0/3572785893 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.606+0000 7f2034e2a640 1 --2- 172.21.15.55:0/3572785893 >> v2:172.21.15.167:3300/0 conn(0x7f203009a150 0x7f203006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.606+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579277511 0 0) 0x7f203006c660 con 0x7f203015ba10 2024-04-25T08:54:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.606+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f201c003520 con 0x7f203015ba10 2024-04-25T08:54:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3003136209 0 0) 0x7f201c003520 con 0x7f203015ba10 2024-04-25T08:54:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 >> v2:172.21.15.167:3300/0 conn(0x7f203009a150 msgr2=0x7f203006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 --2- 172.21.15.55:0/3572785893 >> v2:172.21.15.167:3300/0 conn(0x7f203009a150 0x7f203006bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 >> v1:172.21.15.167:6789/0 conn(0x7f203006c1f0 legacy=0x7f20300cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203006cbe0 con 0x7f203015ba10 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f202c001670 con 0x7f203015ba10 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 >> v1:172.21.15.55:6789/0 conn(0x7f203015ba10 legacy=0x7f2030099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f201c0039b0 0x7f201c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f201c004800 0x7f201c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f201c0051c0 0x7f201c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c00c030 con 0x7f201c004800 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c00c1e0 con 0x7f201c0039b0 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c00c3e0 con 0x7f201c0051c0 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2034e2a640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f201c004800 0x7f201c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f203562b640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f201c0039b0 0x7f201c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2035e2c640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f201c0051c0 0x7f201c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2034e2a640 1 -- 172.21.15.55:0/3572785893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f201c0051c0 msgr2=0x7f201c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2034e2a640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f201c0051c0 0x7f201c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2034e2a640 1 -- 172.21.15.55:0/3572785893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f201c0039b0 msgr2=0x7f201c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2034e2a640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f201c0039b0 0x7f201c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2034e2a640 1 -- 172.21.15.55:0/3572785893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c003520 con 0x7f201c004800 2024-04-25T08:54:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2035e2c640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f201c0051c0 0x7f201c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.607+0000 7f2035e2c640 1 -- 172.21.15.55:0/3572785893 reap_dead start 2024-04-25T08:54:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.608+0000 7f2034e2a640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f201c004800 0x7f201c004c80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2020009ac0 tx=0x7f201c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f947a88fba0ded4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.608+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020036070 con 0x7f201c004800 2024-04-25T08:54:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.608+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2020031400 con 0x7f201c004800 2024-04-25T08:54:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.608+0000 7f2027fff640 1 -- 172.21.15.55:0/3572785893 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020009690 con 0x7f201c004800 2024-04-25T08:54:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.608+0000 7f203788f640 1 -- 172.21.15.55:0/3572785893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f201c004800 msgr2=0x7f201c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.608+0000 7f203788f640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f201c004800 0x7f201c004c80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2020009ac0 tx=0x7f201c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.608+0000 7f203788f640 1 -- 172.21.15.55:0/3572785893 shutdown_connections 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.608+0000 7f203788f640 1 --2- 172.21.15.55:0/3572785893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f201c004800 0x7f201c004c80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.608+0000 7f203788f640 1 -- 172.21.15.55:0/3572785893 >> 172.21.15.55:0/3572785893 conn(0x7f20300b32f0 msgr2=0x7f20300b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.609+0000 7f203788f640 1 -- 172.21.15.55:0/3572785893 shutdown_connections 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.609+0000 7f203788f640 1 -- 172.21.15.55:0/3572785893 wait complete. 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.610+0000 7f203788f640 1 Processor -- start 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.610+0000 7f203788f640 1 -- start start 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.610+0000 7f203788f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f201c004800 0x7f2030152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.610+0000 7f203788f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20301605e0 0x7f20300ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.610+0000 7f203788f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20300ce7c0 0x7f2030158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.610+0000 7f203788f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203006bcb0 con 0x7f20300ce7c0 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.610+0000 7f203788f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20300cfe80 con 0x7f20301605e0 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.610+0000 7f203788f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203006be30 con 0x7f201c004800 2024-04-25T08:54:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2035e2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20300ce7c0 0x7f2030158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2035e2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20300ce7c0 0x7f2030158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56838/0 (socket says 172.21.15.55:56838) 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2035e2c640 1 -- 172.21.15.55:0/1652041845 learned_addr learned my addr 172.21.15.55:0/1652041845 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f203562b640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f201c004800 0x7f2030152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2034e2a640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20301605e0 0x7f20300ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2035e2c640 1 -- 172.21.15.55:0/1652041845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f201c004800 msgr2=0x7f2030152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2035e2c640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f201c004800 0x7f2030152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2035e2c640 1 -- 172.21.15.55:0/1652041845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20301605e0 msgr2=0x7f20300ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2035e2c640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20301605e0 0x7f20300ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2035e2c640 1 -- 172.21.15.55:0/1652041845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203015f820 con 0x7f20300ce7c0 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2035e2c640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20300ce7c0 0x7f2030158460 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f20300685f0 tx=0x7f202800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2025ffb640 1 -- 172.21.15.55:0/1652041845 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028003970 con 0x7f20300ce7c0 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2025ffb640 1 -- 172.21.15.55:0/1652041845 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2028003b50 con 0x7f20300ce7c0 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f203788f640 1 -- 172.21.15.55:0/1652041845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203015fb00 con 0x7f20300ce7c0 2024-04-25T08:54:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.611+0000 7f2025ffb640 1 -- 172.21.15.55:0/1652041845 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028005070 con 0x7f20300ce7c0 2024-04-25T08:54:45.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.612+0000 7f203788f640 1 -- 172.21.15.55:0/1652041845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20301589a0 con 0x7f20300ce7c0 2024-04-25T08:54:45.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.612+0000 7f203788f640 1 -- 172.21.15.55:0/1652041845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20300749b0 con 0x7f20300ce7c0 2024-04-25T08:54:45.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.613+0000 7f2025ffb640 1 -- 172.21.15.55:0/1652041845 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f202801b020 con 0x7f20300ce7c0 2024-04-25T08:54:45.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.613+0000 7f2025ffb640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f201406b4d0 0x7f201406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:45.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.613+0000 7f2025ffb640 1 -- 172.21.15.55:0/1652041845 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2028089ac0 con 0x7f20300ce7c0 2024-04-25T08:54:45.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.613+0000 7f203562b640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f201406b4d0 0x7f201406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:45.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.614+0000 7f203562b640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f201406b4d0 0x7f201406d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f202c001eb0 tx=0x7f202c001c30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:45.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.617+0000 7f2025ffb640 1 -- 172.21.15.55:0/1652041845 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20280582f0 con 0x7f20300ce7c0 2024-04-25T08:54:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.835+0000 7f203788f640 1 -- 172.21.15.55:0/1652041845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f203009a570 con 0x7f20300ce7c0 2024-04-25T08:54:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.835+0000 7f2025ffb640 1 -- 172.21.15.55:0/1652041845 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f202805c390 con 0x7f20300ce7c0 2024-04-25T08:54:45.826 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.837+0000 7f203788f640 1 -- 172.21.15.55:0/1652041845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f201406b4d0 msgr2=0x7f201406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.837+0000 7f203788f640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f201406b4d0 0x7f201406d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f202c001eb0 tx=0x7f202c001c30 comp rx=0 tx=0).stop 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.837+0000 7f203788f640 1 -- 172.21.15.55:0/1652041845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20300ce7c0 msgr2=0x7f2030158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.837+0000 7f203788f640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20300ce7c0 0x7f2030158460 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f20300685f0 tx=0x7f202800d9d0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.838+0000 7f203788f640 1 -- 172.21.15.55:0/1652041845 shutdown_connections 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.838+0000 7f203788f640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f201406b4d0 0x7f201406d990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.838+0000 7f203788f640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20300ce7c0 0x7f2030158460 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.838+0000 7f203788f640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20301605e0 0x7f20300ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.838+0000 7f203788f640 1 --2- 172.21.15.55:0/1652041845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f201c004800 0x7f2030152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.838+0000 7f203788f640 1 -- 172.21.15.55:0/1652041845 >> 172.21.15.55:0/1652041845 conn(0x7f20300b32f0 msgr2=0x7f20300b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.838+0000 7f203788f640 1 -- 172.21.15.55:0/1652041845 shutdown_connections 2024-04-25T08:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:45.838+0000 7f203788f640 1 -- 172.21.15.55:0/1652041845 wait complete. 2024-04-25T08:54:45.838 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:54:45.838 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:54:45.838 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T08:54:45.838 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:54:45.838 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:54:45.839 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:54:45.839 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:54:45.839 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:54:45.839 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:54:45.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:45.839 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T08:54:45.854 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:45.855 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42671sec preferred_lft 42671sec 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:54:45.856 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:54:45.857 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T08:54:45.857 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:45.857 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:54:45.857 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:54:45.857 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T08:54:45.857 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:54:45.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:45.857 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:54:45.917 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:54:45.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:45.919 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T08:54:45.975 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T08:54:45.976 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:54:45.976 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:54:45.976 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:54:45.976 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:54:45.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:45.976 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:54:45.976 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:54:45.976 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:54:45.976 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:54:45.977 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:54:45.977 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:54:46.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:46.062 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:54:46.077 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:54:46.077 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:54:46.077 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:54:46.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:46.077 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T08:54:46.141 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:54:46.142 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:54:46.197 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:54:46.197 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:54:46.197 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:54:46.253 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:54:46.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:46.253 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:54:46.335 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:54:46.336 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:54:46.336 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:54:46.344 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:54:46.344 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:54:46.344 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:54:46.344 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:54:46.344 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:54:46.351 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:54:46.351 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:54:46.351 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:54:46.351 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:54:46.351 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:54:46.351 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:54:46.351 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:54:46.351 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:54:46.352 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:54:46.352 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:54:46.352 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:54:46.353 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:54:46.353 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:54:46.353 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:54:46.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:46.354 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:54:46.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:46.419 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:54:46.479 INFO:teuthology.orchestra.run.smithi055.stdout:client4805 2024-04-25T08:54:46.480 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:54:46.480 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:46.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:46.536 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-04-25T08:54:46.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:46.597 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-04-25T08:54:46.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:46.655 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-04-25T08:54:46.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:46.711 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-04-25T08:54:46.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:46.770 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-04-25T08:54:46.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:46.827 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T08:54:46.891 INFO:teuthology.orchestra.run.smithi055.stdout:./ 2024-04-25T08:54:46.891 INFO:teuthology.orchestra.run.smithi055.stdout:./rfile 2024-04-25T08:54:46.891 INFO:teuthology.orchestra.run.smithi055.stdout:./parentdir 2024-04-25T08:54:46.891 INFO:teuthology.orchestra.run.smithi055.stdout:./parentdir/pfile 2024-04-25T08:54:46.891 INFO:teuthology.orchestra.run.smithi055.stdout:./parentdir/childdir 2024-04-25T08:54:46.891 INFO:teuthology.orchestra.run.smithi055.stdout:./parentdir/childdir/cfile 2024-04-25T08:54:46.891 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T08:54:46.892 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T08:54:46.892 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T08:54:46.892 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:54:46.892 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T08:54:46.892 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T08:54:46.997 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:54:46.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:54:47.006 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T08:54:47.007 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T08:54:47.007 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T08:54:47.007 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:54:47.007 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-04-25T08:54:47.007 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T08:54:47.114 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627778 2024-04-25T08:54:47.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:54:47.123 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T08:54:47.123 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T08:54:47.123 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T08:54:47.124 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:54:47.124 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-04-25T08:54:47.124 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T08:54:47.230 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-25T08:54:47.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:54:47.239 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T08:54:47.239 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T08:54:47.239 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T08:54:47.240 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:54:47.240 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-04-25T08:54:47.240 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T08:54:47.346 INFO:teuthology.orchestra.run.smithi055.stdout:1099511628279 2024-04-25T08:54:47.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:54:47.355 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T08:54:47.355 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T08:54:47.355 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T08:54:47.355 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:54:47.355 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-04-25T08:54:47.355 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T08:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-25T08:54:47.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:54:47.472 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T08:54:47.472 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T08:54:47.473 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T08:54:47.473 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:54:47.473 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-04-25T08:54:47.473 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T08:54:47.580 INFO:teuthology.orchestra.run.smithi055.stdout:1099511628280 2024-04-25T08:54:47.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:54:47.588 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:54:47.589 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:47.645 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:54:47.645 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:54:47.701 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:54:47.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.852+0000 7f35ef7e0640 1 Processor -- start 2024-04-25T08:54:47.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.853+0000 7f35ef7e0640 1 -- start start 2024-04-25T08:54:47.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.853+0000 7f35ef7e0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35e809a150 0x7f35e806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:47.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.853+0000 7f35ef7e0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e806c660 con 0x7f35e806c1f0 2024-04-25T08:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.853+0000 7f35ef7e0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e806c900 con 0x7f35e815ba10 2024-04-25T08:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.853+0000 7f35ef7e0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e80cbe50 con 0x7f35e809a150 2024-04-25T08:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.853+0000 7f35ecd7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35e809a150 0x7f35e806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.853+0000 7f35edd7d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35e806c1f0 0x7f35e80cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56310/0 (socket says 172.21.15.55:56310) 2024-04-25T08:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.854+0000 7f35edd7d640 1 -- 172.21.15.55:0/1122137968 learned_addr learned my addr 172.21.15.55:0/1122137968 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.854+0000 7f35ecd7b640 1 -- 172.21.15.55:0/1122137968 >> v1:172.21.15.167:6789/0 conn(0x7f35e815ba10 legacy=0x7f35e8099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:47.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.854+0000 7f35ecd7b640 1 -- 172.21.15.55:0/1122137968 >> v1:172.21.15.55:6789/0 conn(0x7f35e806c1f0 legacy=0x7f35e80cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:47.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.854+0000 7f35ecd7b640 1 -- 172.21.15.55:0/1122137968 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e806cbe0 con 0x7f35e809a150 2024-04-25T08:54:47.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.854+0000 7f35e7fff640 1 -- 172.21.15.55:0/1122137968 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005038838 0 0) 0x7f35e806c660 con 0x7f35e806c1f0 2024-04-25T08:54:47.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.855+0000 7f35ecd7b640 1 --2- 172.21.15.55:0/1122137968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e809a150 0x7f35e806bcb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0097a0 tx=0x7f35dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efe66f6643aec6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:47.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.855+0000 7f35e7fff640 1 -- 172.21.15.55:0/1122137968 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc037070 con 0x7f35e809a150 2024-04-25T08:54:47.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.855+0000 7f35e7fff640 1 -- 172.21.15.55:0/1122137968 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc032440 con 0x7f35e809a150 2024-04-25T08:54:47.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.855+0000 7f35e7fff640 1 -- 172.21.15.55:0/1122137968 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc032810 con 0x7f35e809a150 2024-04-25T08:54:47.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.855+0000 7f35ef7e0640 1 -- 172.21.15.55:0/1122137968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e809a150 msgr2=0x7f35e806bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:47.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.855+0000 7f35ef7e0640 1 --2- 172.21.15.55:0/1122137968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e809a150 0x7f35e806bcb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0097a0 tx=0x7f35dc02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:54:47.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.855+0000 7f35ef7e0640 1 -- 172.21.15.55:0/1122137968 shutdown_connections 2024-04-25T08:54:47.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.855+0000 7f35ef7e0640 1 --2- 172.21.15.55:0/1122137968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e809a150 0x7f35e806bcb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:47.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.855+0000 7f35ef7e0640 1 -- 172.21.15.55:0/1122137968 >> 172.21.15.55:0/1122137968 conn(0x7f35e80b32f0 msgr2=0x7f35e80b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:47.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.855+0000 7f35ef7e0640 1 -- 172.21.15.55:0/1122137968 shutdown_connections 2024-04-25T08:54:47.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.855+0000 7f35ef7e0640 1 -- 172.21.15.55:0/1122137968 wait complete. 2024-04-25T08:54:47.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.856+0000 7f35ef7e0640 1 Processor -- start 2024-04-25T08:54:47.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.857+0000 7f35ef7e0640 1 -- start start 2024-04-25T08:54:47.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.857+0000 7f35ef7e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35e806c1f0 0x7f35e8150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:47.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.857+0000 7f35ef7e0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e809a150 0x7f35e80c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:47.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.857+0000 7f35ef7e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e815ba10 0x7f35e80ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:47.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.857+0000 7f35ef7e0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80d1320 con 0x7f35e815ba10 2024-04-25T08:54:47.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.857+0000 7f35ef7e0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80cfe80 con 0x7f35e806c1f0 2024-04-25T08:54:47.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.857+0000 7f35ef7e0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80d14a0 con 0x7f35e809a150 2024-04-25T08:54:47.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.857+0000 7f35edd7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e815ba10 0x7f35e80ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:47.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.857+0000 7f35edd7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e815ba10 0x7f35e80ae4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56856/0 (socket says 172.21.15.55:56856) 2024-04-25T08:54:47.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.857+0000 7f35edd7d640 1 -- 172.21.15.55:0/2450559474 learned_addr learned my addr 172.21.15.55:0/2450559474 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:47.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35ecd7b640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e809a150 0x7f35e80c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35ed57c640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35e806c1f0 0x7f35e8150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35edd7d640 1 -- 172.21.15.55:0/2450559474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e809a150 msgr2=0x7f35e80c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35edd7d640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e809a150 0x7f35e80c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35edd7d640 1 -- 172.21.15.55:0/2450559474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35e806c1f0 msgr2=0x7f35e8150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35edd7d640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35e806c1f0 0x7f35e8150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35edd7d640 1 -- 172.21.15.55:0/2450559474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80b4dc0 con 0x7f35e815ba10 2024-04-25T08:54:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35edd7d640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e815ba10 0x7f35e80ae4b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f35d800c7b0 tx=0x7f35d800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35e5ffb640 1 -- 172.21.15.55:0/2450559474 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8018070 con 0x7f35e815ba10 2024-04-25T08:54:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35e5ffb640 1 -- 172.21.15.55:0/2450559474 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d800a640 con 0x7f35e815ba10 2024-04-25T08:54:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35ef7e0640 1 -- 172.21.15.55:0/2450559474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e80b50a0 con 0x7f35e815ba10 2024-04-25T08:54:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35e5ffb640 1 -- 172.21.15.55:0/2450559474 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d800aa30 con 0x7f35e815ba10 2024-04-25T08:54:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.858+0000 7f35ef7e0640 1 -- 172.21.15.55:0/2450559474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e80b5660 con 0x7f35e815ba10 2024-04-25T08:54:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.859+0000 7f35ef7e0640 1 -- 172.21.15.55:0/2450559474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e80749b0 con 0x7f35e815ba10 2024-04-25T08:54:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.859+0000 7f35e5ffb640 1 -- 172.21.15.55:0/2450559474 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f35d801b070 con 0x7f35e815ba10 2024-04-25T08:54:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.860+0000 7f35e5ffb640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35d406b4d0 0x7f35d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.860+0000 7f35e5ffb640 1 -- 172.21.15.55:0/2450559474 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35d8089750 con 0x7f35e815ba10 2024-04-25T08:54:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.860+0000 7f35ed57c640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35d406b4d0 0x7f35d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:47.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.860+0000 7f35ed57c640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35d406b4d0 0x7f35d406d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f35e0003d90 tx=0x7f35e0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:47.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:47.864+0000 7f35e5ffb640 1 -- 172.21.15.55:0/2450559474 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f35d8058660 con 0x7f35e815ba10 2024-04-25T08:54:48.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.048+0000 7f35ef7e0640 1 -- 172.21.15.55:0/2450559474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35e809a570 con 0x7f35e815ba10 2024-04-25T08:54:48.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.049+0000 7f35e5ffb640 1 -- 172.21.15.55:0/2450559474 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f35d8057f60 con 0x7f35e815ba10 2024-04-25T08:54:48.040 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:48.040 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":36,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:54:37.381878+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:54:34.023960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:54:34.730867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:54:48.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 -- 172.21.15.55:0/2450559474 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35d406b4d0 msgr2=0x7f35d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35d406b4d0 0x7f35d406d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f35e0003d90 tx=0x7f35e0009040 comp rx=0 tx=0).stop 2024-04-25T08:54:48.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 -- 172.21.15.55:0/2450559474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e815ba10 msgr2=0x7f35e80ae4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e815ba10 0x7f35e80ae4b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f35d800c7b0 tx=0x7f35d800cc70 comp rx=0 tx=0).stop 2024-04-25T08:54:48.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 -- 172.21.15.55:0/2450559474 shutdown_connections 2024-04-25T08:54:48.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35d406b4d0 0x7f35d406d990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e815ba10 0x7f35e80ae4b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e809a150 0x7f35e80c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 --2- 172.21.15.55:0/2450559474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35e806c1f0 0x7f35e8150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 -- 172.21.15.55:0/2450559474 >> 172.21.15.55:0/2450559474 conn(0x7f35e80b32f0 msgr2=0x7f35e815e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:48.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 -- 172.21.15.55:0/2450559474 shutdown_connections 2024-04-25T08:54:48.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.051+0000 7f35ef7e0640 1 -- 172.21.15.55:0/2450559474 wait complete. 2024-04-25T08:54:48.053 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:54:34.023960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:54:34.730867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:54:48.054 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:54:48.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.168+0000 7fee2c0fc640 1 Processor -- start 2024-04-25T08:54:48.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.169+0000 7fee2c0fc640 1 -- start start 2024-04-25T08:54:48.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.169+0000 7fee2c0fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fee2415dc80 0x7fee24161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.169+0000 7fee2c0fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee241627a0 con 0x7fee240b5c00 2024-04-25T08:54:48.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.169+0000 7fee2c0fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee241621e0 con 0x7fee240b97c0 2024-04-25T08:54:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.169+0000 7fee2c0fc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee241624c0 con 0x7fee2415dc80 2024-04-25T08:54:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.169+0000 7fee2a699640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fee240b5c00 0x7fee240d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56326/0 (socket says 172.21.15.55:56326) 2024-04-25T08:54:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.169+0000 7fee2a699640 1 -- 172.21.15.55:0/3239648468 learned_addr learned my addr 172.21.15.55:0/3239648468 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee29e98640 1 --2- 172.21.15.55:0/3239648468 >> v2:172.21.15.167:3300/0 conn(0x7fee2415dc80 0x7fee24161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889450409 0 0) 0x7fee241627a0 con 0x7fee240b5c00 2024-04-25T08:54:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee0c003520 con 0x7fee240b5c00 2024-04-25T08:54:48.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019336580 0 0) 0x7fee241621e0 con 0x7fee240b97c0 2024-04-25T08:54:48.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee241627a0 con 0x7fee240b97c0 2024-04-25T08:54:48.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1812077968 0 0) 0x7fee0c003520 con 0x7fee240b5c00 2024-04-25T08:54:48.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 >> v2:172.21.15.167:3300/0 conn(0x7fee2415dc80 msgr2=0x7fee24161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:48.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 --2- 172.21.15.55:0/3239648468 >> v2:172.21.15.167:3300/0 conn(0x7fee2415dc80 0x7fee24161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 >> v1:172.21.15.167:6789/0 conn(0x7fee240b97c0 legacy=0x7fee240b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240d1c70 con 0x7fee240b5c00 2024-04-25T08:54:48.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fee140019f0 con 0x7fee240b5c00 2024-04-25T08:54:48.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 >> v1:172.21.15.55:6789/0 conn(0x7fee240b5c00 legacy=0x7fee240d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee0c003b40 0x7fee0c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee0c004800 0x7fee0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee0c0051c0 0x7fee0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee241624c0 con 0x7fee0c0051c0 2024-04-25T08:54:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c00c040 con 0x7fee0c003b40 2024-04-25T08:54:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c00c240 con 0x7fee0c004800 2024-04-25T08:54:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee2a699640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee0c0051c0 0x7fee0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee29e98640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee0c003b40 0x7fee0c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.170+0000 7fee29697640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee0c004800 0x7fee0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.171+0000 7fee2a699640 1 -- 172.21.15.55:0/3239648468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee0c004800 msgr2=0x7fee0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:48.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.171+0000 7fee2a699640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee0c004800 0x7fee0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.171+0000 7fee2a699640 1 -- 172.21.15.55:0/3239648468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee0c003b40 msgr2=0x7fee0c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:48.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.171+0000 7fee2a699640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee0c003b40 0x7fee0c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.171+0000 7fee2a699640 1 -- 172.21.15.55:0/3239648468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c003520 con 0x7fee0c0051c0 2024-04-25T08:54:48.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.171+0000 7fee29e98640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee0c003b40 0x7fee0c003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:48.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.171+0000 7fee2a699640 1 -- 172.21.15.55:0/3239648468 reap_dead start 2024-04-25T08:54:48.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.171+0000 7fee2a699640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee0c0051c0 0x7fee0c00b9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fee1400a810 tx=0x7fee0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11eab4cd485dbfef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:48.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.171+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1400a430 con 0x7fee0c0051c0 2024-04-25T08:54:48.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.171+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1402f070 con 0x7fee0c0051c0 2024-04-25T08:54:48.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.171+0000 7fee28e96640 1 -- 172.21.15.55:0/3239648468 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1402bc50 con 0x7fee0c0051c0 2024-04-25T08:54:48.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.172+0000 7fee2c0fc640 1 -- 172.21.15.55:0/3239648468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee0c0051c0 msgr2=0x7fee0c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.172+0000 7fee2c0fc640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee0c0051c0 0x7fee0c00b9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fee1400a810 tx=0x7fee0c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:48.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.172+0000 7fee2c0fc640 1 -- 172.21.15.55:0/3239648468 shutdown_connections 2024-04-25T08:54:48.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.172+0000 7fee2c0fc640 1 --2- 172.21.15.55:0/3239648468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee0c0051c0 0x7fee0c00b9c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.172+0000 7fee2c0fc640 1 -- 172.21.15.55:0/3239648468 >> 172.21.15.55:0/3239648468 conn(0x7fee240d04f0 msgr2=0x7fee240d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:48.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.172+0000 7fee2c0fc640 1 -- 172.21.15.55:0/3239648468 shutdown_connections 2024-04-25T08:54:48.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.172+0000 7fee2c0fc640 1 -- 172.21.15.55:0/3239648468 wait complete. 2024-04-25T08:54:48.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.173+0000 7fee2c0fc640 1 Processor -- start 2024-04-25T08:54:48.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.173+0000 7fee2c0fc640 1 -- start start 2024-04-25T08:54:48.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee2c0fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee0c0051c0 0x7fee240aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee2c0fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee240cd940 0x7fee240ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee2c0fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2414ea90 0x7fee2414ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee2c0fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240b5670 con 0x7fee2414ea90 2024-04-25T08:54:48.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee2c0fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240b54f0 con 0x7fee0c0051c0 2024-04-25T08:54:48.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee2c0fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee240b57f0 con 0x7fee240cd940 2024-04-25T08:54:48.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee2a699640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2414ea90 0x7fee2414ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee2a699640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2414ea90 0x7fee2414ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56874/0 (socket says 172.21.15.55:56874) 2024-04-25T08:54:48.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee2a699640 1 -- 172.21.15.55:0/895378735 learned_addr learned my addr 172.21.15.55:0/895378735 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:48.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee29e98640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee0c0051c0 0x7fee240aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee29697640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee240cd940 0x7fee240ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee2a699640 1 -- 172.21.15.55:0/895378735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee240cd940 msgr2=0x7fee240ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.174+0000 7fee2a699640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee240cd940 0x7fee240ac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.175+0000 7fee2a699640 1 -- 172.21.15.55:0/895378735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee0c0051c0 msgr2=0x7fee240aae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.175+0000 7fee2a699640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee0c0051c0 0x7fee240aae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.175+0000 7fee2a699640 1 -- 172.21.15.55:0/895378735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240cabe0 con 0x7fee2414ea90 2024-04-25T08:54:48.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.175+0000 7fee29697640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee240cd940 0x7fee240ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:48.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.175+0000 7fee29e98640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee0c0051c0 0x7fee240aae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:48.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.175+0000 7fee2a699640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2414ea90 0x7fee2414ef40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fee1402b4a0 tx=0x7fee14001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:48.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.175+0000 7fee227fc640 1 -- 172.21.15.55:0/895378735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1400a430 con 0x7fee2414ea90 2024-04-25T08:54:48.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.175+0000 7fee227fc640 1 -- 172.21.15.55:0/895378735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee14004b60 con 0x7fee2414ea90 2024-04-25T08:54:48.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.175+0000 7fee227fc640 1 -- 172.21.15.55:0/895378735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14001f80 con 0x7fee2414ea90 2024-04-25T08:54:48.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.175+0000 7fee2c0fc640 1 -- 172.21.15.55:0/895378735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee240ab790 con 0x7fee2414ea90 2024-04-25T08:54:48.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.175+0000 7fee2c0fc640 1 -- 172.21.15.55:0/895378735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee240cae80 con 0x7fee2414ea90 2024-04-25T08:54:48.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.176+0000 7fee2c0fc640 1 -- 172.21.15.55:0/895378735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee240750b0 con 0x7fee2414ea90 2024-04-25T08:54:48.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.176+0000 7fee227fc640 1 -- 172.21.15.55:0/895378735 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fee14034470 con 0x7fee2414ea90 2024-04-25T08:54:48.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.177+0000 7fee227fc640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fee1006b4d0 0x7fee1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.177+0000 7fee227fc640 1 -- 172.21.15.55:0/895378735 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee140aa340 con 0x7fee2414ea90 2024-04-25T08:54:48.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.177+0000 7fee29e98640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fee1006b4d0 0x7fee1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.177+0000 7fee29e98640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fee1006b4d0 0x7fee1006d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009a50 tx=0x7fee1c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:48.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.181+0000 7fee227fc640 1 -- 172.21.15.55:0/895378735 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee140791c0 con 0x7fee2414ea90 2024-04-25T08:54:48.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.361+0000 7fee2c0fc640 1 -- 172.21.15.55:0/895378735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee240cb050 con 0x7fee2414ea90 2024-04-25T08:54:48.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.361+0000 7fee227fc640 1 -- 172.21.15.55:0/895378735 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee14078ac0 con 0x7fee2414ea90 2024-04-25T08:54:48.351 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 -- 172.21.15.55:0/895378735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fee1006b4d0 msgr2=0x7fee1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fee1006b4d0 0x7fee1006d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009a50 tx=0x7fee1c008040 comp rx=0 tx=0).stop 2024-04-25T08:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 -- 172.21.15.55:0/895378735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2414ea90 msgr2=0x7fee2414ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2414ea90 0x7fee2414ef40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fee1402b4a0 tx=0x7fee14001d40 comp rx=0 tx=0).stop 2024-04-25T08:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 -- 172.21.15.55:0/895378735 shutdown_connections 2024-04-25T08:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fee1006b4d0 0x7fee1006d990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2414ea90 0x7fee2414ef40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee240cd940 0x7fee240ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 --2- 172.21.15.55:0/895378735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee0c0051c0 0x7fee240aae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 -- 172.21.15.55:0/895378735 >> 172.21.15.55:0/895378735 conn(0x7fee240d04f0 msgr2=0x7fee240ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:48.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 -- 172.21.15.55:0/895378735 shutdown_connections 2024-04-25T08:54:48.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.363+0000 7fee2c0fc640 1 -- 172.21.15.55:0/895378735 wait complete. 2024-04-25T08:54:48.364 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:54:48.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.479+0000 7f3bdcf3b640 1 Processor -- start 2024-04-25T08:54:48.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.479+0000 7f3bdcf3b640 1 -- start start 2024-04-25T08:54:48.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bdcf3b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bd806aba0 0x7f3bd80b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bdcf3b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3bd815d450 0x7f3bd815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bdcf3b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd80b1f60 con 0x7f3bd80ce3a0 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bdcf3b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd80b0130 con 0x7f3bd815d450 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bdcf3b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80b09d0 con 0x7f3bd806aba0 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bcffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3bd80ce3a0 0x7f3bd806af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56330/0 (socket says 172.21.15.55:56330) 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bcffff640 1 -- 172.21.15.55:0/2126924602 learned_addr learned my addr 172.21.15.55:0/2126924602 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bd6d9d640 1 --2- 172.21.15.55:0/2126924602 >> v2:172.21.15.167:3300/0 conn(0x7f3bd815d450 0x7f3bd815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bd659c640 1 --2- 172.21.15.55:0/2126924602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bd806aba0 0x7f3bd80b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bd5d9b640 1 -- 172.21.15.55:0/2126924602 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325790684 0 0) 0x7f3bd80b1f60 con 0x7f3bd80ce3a0 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bd5d9b640 1 -- 172.21.15.55:0/2126924602 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc4003520 con 0x7f3bd80ce3a0 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bd6d9d640 1 -- 172.21.15.55:0/2126924602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bd806aba0 msgr2=0x7f3bd80b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bd6d9d640 1 --2- 172.21.15.55:0/2126924602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bd806aba0 0x7f3bd80b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bd6d9d640 1 -- 172.21.15.55:0/2126924602 >> v1:172.21.15.55:6789/0 conn(0x7f3bd80ce3a0 legacy=0x7f3bd806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.480+0000 7f3bd6d9d640 1 -- 172.21.15.55:0/2126924602 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80b0380 con 0x7f3bd815d450 2024-04-25T08:54:48.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.481+0000 7f3bd6d9d640 1 --2- 172.21.15.55:0/2126924602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd815d450 0x7f3bd815d8e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009dc0 tx=0x7f3bd002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=269a865c3b6e1f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:48.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.481+0000 7f3bd5d9b640 1 -- 172.21.15.55:0/2126924602 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd002ae60 con 0x7f3bd815d450 2024-04-25T08:54:48.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.481+0000 7f3bd5d9b640 1 -- 172.21.15.55:0/2126924602 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd0007740 con 0x7f3bd815d450 2024-04-25T08:54:48.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.481+0000 7f3bd5d9b640 1 -- 172.21.15.55:0/2126924602 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0007af0 con 0x7f3bd815d450 2024-04-25T08:54:48.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.482+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/2126924602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd815d450 msgr2=0x7f3bd815d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.482+0000 7f3bdcf3b640 1 --2- 172.21.15.55:0/2126924602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd815d450 0x7f3bd815d8e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009dc0 tx=0x7f3bd002a680 comp rx=0 tx=0).stop 2024-04-25T08:54:48.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.482+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/2126924602 shutdown_connections 2024-04-25T08:54:48.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.482+0000 7f3bdcf3b640 1 --2- 172.21.15.55:0/2126924602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd815d450 0x7f3bd815d8e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.482+0000 7f3bdcf3b640 1 --2- 172.21.15.55:0/2126924602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bd806aba0 0x7f3bd80b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.482+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/2126924602 >> 172.21.15.55:0/2126924602 conn(0x7f3bd80d07d0 msgr2=0x7f3bd80d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:48.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.482+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/2126924602 shutdown_connections 2024-04-25T08:54:48.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.482+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/2126924602 wait complete. 2024-04-25T08:54:48.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.483+0000 7f3bdcf3b640 1 Processor -- start 2024-04-25T08:54:48.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.483+0000 7f3bdcf3b640 1 -- start start 2024-04-25T08:54:48.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bdcf3b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bd806aba0 0x7f3bd814eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bdcf3b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd80ce3a0 0x7f3bd806f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bdcf3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd815d450 0x7f3bd806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bdcf3b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80b0e60 con 0x7f3bd815d450 2024-04-25T08:54:48.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bdcf3b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd806b880 con 0x7f3bd80ce3a0 2024-04-25T08:54:48.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bdcf3b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80b0fe0 con 0x7f3bd806aba0 2024-04-25T08:54:48.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bd6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd815d450 0x7f3bd806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bd6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd815d450 0x7f3bd806fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56890/0 (socket says 172.21.15.55:56890) 2024-04-25T08:54:48.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bd6d9d640 1 -- 172.21.15.55:0/3569433229 learned_addr learned my addr 172.21.15.55:0/3569433229 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:48.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bd659c640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bd806aba0 0x7f3bd814eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bcffff640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd80ce3a0 0x7f3bd806f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bd6d9d640 1 -- 172.21.15.55:0/3569433229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bd806aba0 msgr2=0x7f3bd814eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bd6d9d640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bd806aba0 0x7f3bd814eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bd6d9d640 1 -- 172.21.15.55:0/3569433229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd80ce3a0 msgr2=0x7f3bd806f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bd6d9d640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd80ce3a0 0x7f3bd806f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.484+0000 7f3bd6d9d640 1 -- 172.21.15.55:0/3569433229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80c54d0 con 0x7f3bd815d450 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.485+0000 7f3bd6d9d640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd815d450 0x7f3bd806fda0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3bd002ac70 tx=0x7f3bd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.485+0000 7f3bceffd640 1 -- 172.21.15.55:0/3569433229 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd003f070 con 0x7f3bd815d450 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.485+0000 7f3bceffd640 1 -- 172.21.15.55:0/3569433229 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd0031a40 con 0x7f3bd815d450 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.485+0000 7f3bceffd640 1 -- 172.21.15.55:0/3569433229 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0031c10 con 0x7f3bd815d450 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.485+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/3569433229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd81f7920 con 0x7f3bd815d450 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.485+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/3569433229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd81f7ee0 con 0x7f3bd815d450 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.486+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/3569433229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd80750b0 con 0x7f3bd815d450 2024-04-25T08:54:48.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.486+0000 7f3bceffd640 1 -- 172.21.15.55:0/3569433229 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3bd003b410 con 0x7f3bd815d450 2024-04-25T08:54:48.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.487+0000 7f3bceffd640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3bb806b4d0 0x7f3bb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.487+0000 7f3bceffd640 1 -- 172.21.15.55:0/3569433229 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bd00ab5f0 con 0x7f3bd815d450 2024-04-25T08:54:48.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.487+0000 7f3bd659c640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3bb806b4d0 0x7f3bb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.487+0000 7f3bd659c640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3bb806b4d0 0x7f3bb806d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80b3870 tx=0x7f3bc8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:48.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.491+0000 7f3bceffd640 1 -- 172.21.15.55:0/3569433229 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3bd0079e20 con 0x7f3bd815d450 2024-04-25T08:54:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.672+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/3569433229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bd8072f40 con 0x7f3bd815d450 2024-04-25T08:54:48.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.672+0000 7f3bceffd640 1 -- 172.21.15.55:0/3569433229 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3bd007dec0 con 0x7f3bd815d450 2024-04-25T08:54:48.663 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:54:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.674+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/3569433229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3bb806b4d0 msgr2=0x7f3bb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.674+0000 7f3bdcf3b640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3bb806b4d0 0x7f3bb806d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80b3870 tx=0x7f3bc8009190 comp rx=0 tx=0).stop 2024-04-25T08:54:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.674+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/3569433229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd815d450 msgr2=0x7f3bd806fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.674+0000 7f3bdcf3b640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd815d450 0x7f3bd806fda0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3bd002ac70 tx=0x7f3bd0004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.674+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/3569433229 shutdown_connections 2024-04-25T08:54:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.674+0000 7f3bdcf3b640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3bb806b4d0 0x7f3bb806d990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.674+0000 7f3bdcf3b640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd815d450 0x7f3bd806fda0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.674+0000 7f3bdcf3b640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd80ce3a0 0x7f3bd806f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.674+0000 7f3bdcf3b640 1 --2- 172.21.15.55:0/3569433229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3bd806aba0 0x7f3bd814eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.674+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/3569433229 >> 172.21.15.55:0/3569433229 conn(0x7f3bd80d07d0 msgr2=0x7f3bd80af510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:48.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.675+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/3569433229 shutdown_connections 2024-04-25T08:54:48.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.675+0000 7f3bdcf3b640 1 -- 172.21.15.55:0/3569433229 wait complete. 2024-04-25T08:54:48.676 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:54:48.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.791+0000 7ff4f5953640 1 Processor -- start 2024-04-25T08:54:48.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.791+0000 7ff4f5953640 1 -- start start 2024-04-25T08:54:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4f5953640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff4f015dca0 0x7ff4f00ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4f5953640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00d3b90 0x7ff4f00d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4f5953640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f00d4090 con 0x7ff4f00cee80 2024-04-25T08:54:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4f5953640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f00b6b20 con 0x7ff4f015dca0 2024-04-25T08:54:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4f5953640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00d4370 con 0x7ff4f00d3b90 2024-04-25T08:54:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4ee7fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00d3b90 0x7ff4f00d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4eeffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff4f015dca0 0x7ff4f00ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4ee7fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00d3b90 0x7ff4f00d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:54490/0 (socket says 172.21.15.55:54490) 2024-04-25T08:54:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4ee7fc640 1 -- 172.21.15.55:0/3251921797 learned_addr learned my addr 172.21.15.55:0/3251921797 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4ee7fc640 1 -- 172.21.15.55:0/3251921797 >> v2:172.21.15.167:3300/0 conn(0x7ff4f015dca0 msgr2=0x7ff4f00ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4ee7fc640 1 --2- 172.21.15.55:0/3251921797 >> v2:172.21.15.167:3300/0 conn(0x7ff4f015dca0 0x7ff4f00ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4ee7fc640 1 -- 172.21.15.55:0/3251921797 >> v1:172.21.15.167:6789/0 conn(0x7ff4f00cee80 legacy=0x7ff4f00b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4ee7fc640 1 -- 172.21.15.55:0/3251921797 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f00d4650 con 0x7ff4f00d3b90 2024-04-25T08:54:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.792+0000 7ff4eeffd640 1 --2- 172.21.15.55:0/3251921797 >> v2:172.21.15.167:3300/0 conn(0x7ff4f015dca0 0x7ff4f00ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:48.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.793+0000 7ff4ee7fc640 1 --2- 172.21.15.55:0/3251921797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00d3b90 0x7ff4f00d0a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009870 tx=0x7ff4e402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a22a18ae6ad81b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:48.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.793+0000 7ff4edffb640 1 -- 172.21.15.55:0/3251921797 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4037070 con 0x7ff4f00d3b90 2024-04-25T08:54:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.793+0000 7ff4edffb640 1 -- 172.21.15.55:0/3251921797 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4032440 con 0x7ff4f00d3b90 2024-04-25T08:54:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.793+0000 7ff4edffb640 1 -- 172.21.15.55:0/3251921797 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4032810 con 0x7ff4f00d3b90 2024-04-25T08:54:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.794+0000 7ff4f5953640 1 -- 172.21.15.55:0/3251921797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00d3b90 msgr2=0x7ff4f00d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.794+0000 7ff4f5953640 1 --2- 172.21.15.55:0/3251921797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00d3b90 0x7ff4f00d0a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009870 tx=0x7ff4e402a250 comp rx=0 tx=0).stop 2024-04-25T08:54:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.794+0000 7ff4f5953640 1 -- 172.21.15.55:0/3251921797 shutdown_connections 2024-04-25T08:54:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.794+0000 7ff4f5953640 1 --2- 172.21.15.55:0/3251921797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00d3b90 0x7ff4f00d0a20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.794+0000 7ff4f5953640 1 --2- 172.21.15.55:0/3251921797 >> v2:172.21.15.167:3300/0 conn(0x7ff4f015dca0 0x7ff4f00ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.794+0000 7ff4f5953640 1 -- 172.21.15.55:0/3251921797 >> 172.21.15.55:0/3251921797 conn(0x7ff4f00726c0 msgr2=0x7ff4f0072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.794+0000 7ff4f5953640 1 -- 172.21.15.55:0/3251921797 shutdown_connections 2024-04-25T08:54:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.794+0000 7ff4f5953640 1 -- 172.21.15.55:0/3251921797 wait complete. 2024-04-25T08:54:48.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.795+0000 7ff4f5953640 1 Processor -- start 2024-04-25T08:54:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.795+0000 7ff4f5953640 1 -- start start 2024-04-25T08:54:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.796+0000 7ff4f5953640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00cee80 0x7ff4f00ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.796+0000 7ff4f5953640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f00d3b90 0x7ff4f015ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.796+0000 7ff4f5953640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f015dca0 0x7ff4f0160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.796+0000 7ff4f5953640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f015e200 con 0x7ff4f015dca0 2024-04-25T08:54:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.796+0000 7ff4f5953640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f015e080 con 0x7ff4f00d3b90 2024-04-25T08:54:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.796+0000 7ff4f5953640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00d0f60 con 0x7ff4f00cee80 2024-04-25T08:54:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.796+0000 7ff4ef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f015dca0 0x7ff4f0160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.796+0000 7ff4ef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f015dca0 0x7ff4f0160450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54528/0 (socket says 172.21.15.55:54528) 2024-04-25T08:54:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.796+0000 7ff4eeffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00cee80 0x7ff4f00ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.796+0000 7ff4ef7fe640 1 -- 172.21.15.55:0/4098301759 learned_addr learned my addr 172.21.15.55:0/4098301759 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.796+0000 7ff4ee7fc640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f00d3b90 0x7ff4f015ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4ef7fe640 1 -- 172.21.15.55:0/4098301759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00cee80 msgr2=0x7ff4f00ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4ef7fe640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00cee80 0x7ff4f00ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4ef7fe640 1 -- 172.21.15.55:0/4098301759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f00d3b90 msgr2=0x7ff4f015ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4ef7fe640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f00d3b90 0x7ff4f015ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4ef7fe640 1 -- 172.21.15.55:0/4098301759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f014fd00 con 0x7ff4f015dca0 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4ee7fc640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f00d3b90 0x7ff4f015ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4eeffd640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00cee80 0x7ff4f00ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4ef7fe640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f015dca0 0x7ff4f0160450 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c7a0 tx=0x7ff4e800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4d7fff640 1 -- 172.21.15.55:0/4098301759 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8003b70 con 0x7ff4f015dca0 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4d7fff640 1 -- 172.21.15.55:0/4098301759 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8003d30 con 0x7ff4f015dca0 2024-04-25T08:54:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4f5953640 1 -- 172.21.15.55:0/4098301759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f0160ab0 con 0x7ff4f015dca0 2024-04-25T08:54:48.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4d7fff640 1 -- 172.21.15.55:0/4098301759 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e800aa90 con 0x7ff4f015dca0 2024-04-25T08:54:48.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.797+0000 7ff4f5953640 1 -- 172.21.15.55:0/4098301759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f0160d90 con 0x7ff4f015dca0 2024-04-25T08:54:48.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.798+0000 7ff4f5953640 1 -- 172.21.15.55:0/4098301759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f00750b0 con 0x7ff4f015dca0 2024-04-25T08:54:48.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.798+0000 7ff4d7fff640 1 -- 172.21.15.55:0/4098301759 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff4e800ac30 con 0x7ff4f015dca0 2024-04-25T08:54:48.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.799+0000 7ff4d7fff640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4dc06b4d0 0x7ff4dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:48.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.799+0000 7ff4d7fff640 1 -- 172.21.15.55:0/4098301759 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4e808a070 con 0x7ff4f015dca0 2024-04-25T08:54:48.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.799+0000 7ff4eeffd640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4dc06b4d0 0x7ff4dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:48.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.799+0000 7ff4eeffd640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4dc06b4d0 0x7ff4dc06d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009560 tx=0x7ff4e0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:48.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.803+0000 7ff4d7fff640 1 -- 172.21.15.55:0/4098301759 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff4e8058820 con 0x7ff4f015dca0 2024-04-25T08:54:48.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.987+0000 7ff4f5953640 1 -- 172.21.15.55:0/4098301759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4f015d280 con 0x7ff4f015dca0 2024-04-25T08:54:48.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.987+0000 7ff4d7fff640 1 -- 172.21.15.55:0/4098301759 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4e805c8c0 con 0x7ff4f015dca0 2024-04-25T08:54:48.978 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:54:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 -- 172.21.15.55:0/4098301759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4dc06b4d0 msgr2=0x7ff4dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4dc06b4d0 0x7ff4dc06d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009560 tx=0x7ff4e0009190 comp rx=0 tx=0).stop 2024-04-25T08:54:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 -- 172.21.15.55:0/4098301759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f015dca0 msgr2=0x7ff4f0160450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f015dca0 0x7ff4f0160450 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c7a0 tx=0x7ff4e800cc60 comp rx=0 tx=0).stop 2024-04-25T08:54:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 -- 172.21.15.55:0/4098301759 shutdown_connections 2024-04-25T08:54:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4dc06b4d0 0x7ff4dc06d990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f015dca0 0x7ff4f0160450 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f00d3b90 0x7ff4f015ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 --2- 172.21.15.55:0/4098301759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f00cee80 0x7ff4f00ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 -- 172.21.15.55:0/4098301759 >> 172.21.15.55:0/4098301759 conn(0x7ff4f00726c0 msgr2=0x7ff4f00b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 -- 172.21.15.55:0/4098301759 shutdown_connections 2024-04-25T08:54:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:48.989+0000 7ff4f5953640 1 -- 172.21.15.55:0/4098301759 wait complete. 2024-04-25T08:54:48.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:54:49.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.103+0000 7f7b371f9640 1 Processor -- start 2024-04-25T08:54:49.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.103+0000 7f7b371f9640 1 -- start start 2024-04-25T08:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.104+0000 7f7b371f9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7b300b35e0 0x7f7b30162350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.104+0000 7f7b371f9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b300cfed0 con 0x7f7b30161400 2024-04-25T08:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.104+0000 7f7b371f9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b300cf850 con 0x7f7b300b3f80 2024-04-25T08:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.104+0000 7f7b371f9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b30162890 con 0x7f7b300b35e0 2024-04-25T08:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.104+0000 7f7b35796640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7b30161400 0x7f7b300cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47454/0 (socket says 172.21.15.55:47454) 2024-04-25T08:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.104+0000 7f7b35796640 1 -- 172.21.15.55:0/2141209872 learned_addr learned my addr 172.21.15.55:0/2141209872 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b34f95640 1 --2- 172.21.15.55:0/2141209872 >> v2:172.21.15.167:3300/0 conn(0x7f7b300b35e0 0x7f7b30162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822259896 0 0) 0x7f7b300cfed0 con 0x7f7b30161400 2024-04-25T08:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b1c003520 con 0x7f7b30161400 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4042624585 0 0) 0x7f7b1c003520 con 0x7f7b30161400 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 >> v2:172.21.15.167:3300/0 conn(0x7f7b300b35e0 msgr2=0x7f7b30162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 --2- 172.21.15.55:0/2141209872 >> v2:172.21.15.167:3300/0 conn(0x7f7b300b35e0 0x7f7b30162350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 >> v1:172.21.15.167:6789/0 conn(0x7f7b300b3f80 legacy=0x7f7b30160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300cfb30 con 0x7f7b30161400 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f7b18001670 con 0x7f7b30161400 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 >> v1:172.21.15.55:6789/0 conn(0x7f7b30161400 legacy=0x7f7b300cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 --2- 172.21.15.55:0/2141209872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b1c0039b0 0x7f7b1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 --2- 172.21.15.55:0/2141209872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b1c004800 0x7f7b1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 --2- 172.21.15.55:0/2141209872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b1c0051c0 0x7f7b1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30162890 con 0x7f7b1c0039b0 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c00c160 con 0x7f7b1c0051c0 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c00c360 con 0x7f7b1c004800 2024-04-25T08:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b34f95640 1 --2- 172.21.15.55:0/2141209872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b1c0039b0 0x7f7b1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b35796640 1 --2- 172.21.15.55:0/2141209872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b1c0051c0 0x7f7b1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.105+0000 7f7b2ffff640 1 --2- 172.21.15.55:0/2141209872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b1c004800 0x7f7b1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.106+0000 7f7b34f95640 1 -- 172.21.15.55:0/2141209872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b1c004800 msgr2=0x7f7b1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.106+0000 7f7b34f95640 1 --2- 172.21.15.55:0/2141209872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b1c004800 0x7f7b1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.106+0000 7f7b34f95640 1 -- 172.21.15.55:0/2141209872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b1c0051c0 msgr2=0x7f7b1c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.106+0000 7f7b34f95640 1 --2- 172.21.15.55:0/2141209872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b1c0051c0 0x7f7b1c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.106+0000 7f7b35796640 1 -- 172.21.15.55:0/2141209872 reap_dead start 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.106+0000 7f7b34f95640 1 -- 172.21.15.55:0/2141209872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c003520 con 0x7f7b1c0039b0 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.106+0000 7f7b34f95640 1 --2- 172.21.15.55:0/2141209872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b1c0039b0 0x7f7b1c003dd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009aa0 tx=0x7f7b1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61d08e8fff79cf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.106+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28036070 con 0x7f7b1c0039b0 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.106+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b28031400 con 0x7f7b1c0039b0 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.106+0000 7f7b2f7fe640 1 -- 172.21.15.55:0/2141209872 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28009670 con 0x7f7b1c0039b0 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.107+0000 7f7b371f9640 1 -- 172.21.15.55:0/2141209872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b1c0039b0 msgr2=0x7f7b1c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.107+0000 7f7b371f9640 1 --2- 172.21.15.55:0/2141209872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b1c0039b0 0x7f7b1c003dd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009aa0 tx=0x7f7b1c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:49.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.107+0000 7f7b371f9640 1 -- 172.21.15.55:0/2141209872 shutdown_connections 2024-04-25T08:54:49.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.107+0000 7f7b371f9640 1 --2- 172.21.15.55:0/2141209872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b1c0039b0 0x7f7b1c003dd0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.107+0000 7f7b371f9640 1 -- 172.21.15.55:0/2141209872 >> 172.21.15.55:0/2141209872 conn(0x7f7b3006f4c0 msgr2=0x7f7b3006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:49.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.107+0000 7f7b371f9640 1 -- 172.21.15.55:0/2141209872 shutdown_connections 2024-04-25T08:54:49.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.107+0000 7f7b371f9640 1 -- 172.21.15.55:0/2141209872 wait complete. 2024-04-25T08:54:49.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.108+0000 7f7b371f9640 1 Processor -- start 2024-04-25T08:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.108+0000 7f7b371f9640 1 -- start start 2024-04-25T08:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b371f9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b1c0039b0 0x7f7b3014eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b371f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b300c9a10 0x7f7b300c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b371f9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b300af560 0x7f7b300af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b371f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300d05d0 con 0x7f7b300c9a10 2024-04-25T08:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b371f9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300d0450 con 0x7f7b300af560 2024-04-25T08:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b371f9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300b39c0 con 0x7f7b1c0039b0 2024-04-25T08:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b300c9a10 0x7f7b300c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b300c9a10 0x7f7b300c9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54544/0 (socket says 172.21.15.55:54544) 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b2ffff640 1 -- 172.21.15.55:0/4049436959 learned_addr learned my addr 172.21.15.55:0/4049436959 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b34f95640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b1c0039b0 0x7f7b3014eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b35796640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b300af560 0x7f7b300af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b2ffff640 1 -- 172.21.15.55:0/4049436959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b1c0039b0 msgr2=0x7f7b3014eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b2ffff640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b1c0039b0 0x7f7b3014eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b2ffff640 1 -- 172.21.15.55:0/4049436959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b300af560 msgr2=0x7f7b300af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b2ffff640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b300af560 0x7f7b300af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.109+0000 7f7b2ffff640 1 -- 172.21.15.55:0/4049436959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300ca4d0 con 0x7f7b300c9a10 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.110+0000 7f7b2ffff640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b300c9a10 0x7f7b300c9e90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000f960 tx=0x7f7b2000fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.110+0000 7f7b2d7fa640 1 -- 172.21.15.55:0/4049436959 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20003b80 con 0x7f7b300c9a10 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.110+0000 7f7b2d7fa640 1 -- 172.21.15.55:0/4049436959 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b20018070 con 0x7f7b300c9a10 2024-04-25T08:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.110+0000 7f7b371f9640 1 -- 172.21.15.55:0/4049436959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b300ca7b0 con 0x7f7b300c9a10 2024-04-25T08:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.110+0000 7f7b2d7fa640 1 -- 172.21.15.55:0/4049436959 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b200050d0 con 0x7f7b300c9a10 2024-04-25T08:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.110+0000 7f7b371f9640 1 -- 172.21.15.55:0/4049436959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b300cad70 con 0x7f7b300c9a10 2024-04-25T08:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.111+0000 7f7b371f9640 1 -- 172.21.15.55:0/4049436959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b300750b0 con 0x7f7b300c9a10 2024-04-25T08:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.111+0000 7f7b2d7fa640 1 -- 172.21.15.55:0/4049436959 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7b20005270 con 0x7f7b300c9a10 2024-04-25T08:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.112+0000 7f7b2d7fa640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7b1006b500 0x7f7b1006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.112+0000 7f7b2d7fa640 1 -- 172.21.15.55:0/4049436959 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b2008a1e0 con 0x7f7b300c9a10 2024-04-25T08:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.112+0000 7f7b34f95640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7b1006b500 0x7f7b1006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.112+0000 7f7b34f95640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7b1006b500 0x7f7b1006d9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b28033000 tx=0x7f7b28008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.116+0000 7f7b2d7fa640 1 -- 172.21.15.55:0/4049436959 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7b20059060 con 0x7f7b300c9a10 2024-04-25T08:54:49.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.312+0000 7f7b371f9640 1 -- 172.21.15.55:0/4049436959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7b300b7870 con 0x7f7b300c9a10 2024-04-25T08:54:49.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.313+0000 7f7b2d7fa640 1 -- 172.21.15.55:0/4049436959 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7b20058960 con 0x7f7b300c9a10 2024-04-25T08:54:49.304 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T08:54:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.314+0000 7f7b371f9640 1 -- 172.21.15.55:0/4049436959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7b1006b500 msgr2=0x7f7b1006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.314+0000 7f7b371f9640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7b1006b500 0x7f7b1006d9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b28033000 tx=0x7f7b28008030 comp rx=0 tx=0).stop 2024-04-25T08:54:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.314+0000 7f7b371f9640 1 -- 172.21.15.55:0/4049436959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b300c9a10 msgr2=0x7f7b300c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.314+0000 7f7b371f9640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b300c9a10 0x7f7b300c9e90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000f960 tx=0x7f7b2000fd60 comp rx=0 tx=0).stop 2024-04-25T08:54:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.315+0000 7f7b371f9640 1 -- 172.21.15.55:0/4049436959 shutdown_connections 2024-04-25T08:54:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.315+0000 7f7b371f9640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7b1006b500 0x7f7b1006d9c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.315+0000 7f7b371f9640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b300af560 0x7f7b300af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.315+0000 7f7b371f9640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b300c9a10 0x7f7b300c9e90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.315+0000 7f7b371f9640 1 --2- 172.21.15.55:0/4049436959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b1c0039b0 0x7f7b3014eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.315+0000 7f7b371f9640 1 -- 172.21.15.55:0/4049436959 >> 172.21.15.55:0/4049436959 conn(0x7f7b3006f4c0 msgr2=0x7f7b300b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.315+0000 7f7b371f9640 1 -- 172.21.15.55:0/4049436959 shutdown_connections 2024-04-25T08:54:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.315+0000 7f7b371f9640 1 -- 172.21.15.55:0/4049436959 wait complete. 2024-04-25T08:54:49.316 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:54:49.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:49.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:54:49.362 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:54:49.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:54:49.362 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:54:49.387 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:54:49.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.539+0000 7f128b01b640 1 Processor -- start 2024-04-25T08:54:49.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.539+0000 7f128b01b640 1 -- start start 2024-04-25T08:54:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.540+0000 7f128b01b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840cd320 0x7f12840cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.540+0000 7f128b01b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12840cd930 con 0x7f12840cfe80 2024-04-25T08:54:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.540+0000 7f128b01b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12840cdc10 con 0x7f128415df40 2024-04-25T08:54:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.540+0000 7f128b01b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12840cdef0 con 0x7f12840cd320 2024-04-25T08:54:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.540+0000 7f12895b8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f12840cfe80 0x7f12840cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47470/0 (socket says 172.21.15.55:47470) 2024-04-25T08:54:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.540+0000 7f12895b8640 1 -- 172.21.15.55:0/2224731756 learned_addr learned my addr 172.21.15.55:0/2224731756 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:54:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.540+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864682582 0 0) 0x7f12840cd930 con 0x7f12840cfe80 2024-04-25T08:54:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.540+0000 7f1283fff640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840cd320 0x7f12840cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.540+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f126c003520 con 0x7f12840cfe80 2024-04-25T08:54:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3658199617 0 0) 0x7f126c003520 con 0x7f12840cfe80 2024-04-25T08:54:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840cd320 msgr2=0x7f12840cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840cd320 0x7f12840cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 >> v1:172.21.15.167:6789/0 conn(0x7f128415df40 legacy=0x7f12840b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12840cada0 con 0x7f12840cfe80 2024-04-25T08:54:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f127c0019f0 con 0x7f12840cfe80 2024-04-25T08:54:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 >> v1:172.21.15.55:6789/0 conn(0x7f12840cfe80 legacy=0x7f12840cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0039e0 0x7f126c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c004800 0x7f126c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840cd320 0x7f126c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12840cdef0 con 0x7f126c0039e0 2024-04-25T08:54:49.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c00bb20 con 0x7f126c004800 2024-04-25T08:54:49.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c00bd20 con 0x7f12840cd320 2024-04-25T08:54:49.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f1288db7640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0039e0 0x7f126c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f12895b8640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840cd320 0x7f126c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f1283fff640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c004800 0x7f126c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f1288db7640 1 -- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840cd320 msgr2=0x7f126c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f1288db7640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840cd320 0x7f126c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f1288db7640 1 -- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c004800 msgr2=0x7f126c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f1288db7640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c004800 0x7f126c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f1288db7640 1 -- 172.21.15.55:0/2224731756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c003520 con 0x7f126c0039e0 2024-04-25T08:54:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.541+0000 7f1283fff640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c004800 0x7f126c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.542+0000 7f1288db7640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0039e0 0x7f126c003e00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1274001750 tx=0x7f126c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4e036fae50b5b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.542+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274001370 con 0x7f126c0039e0 2024-04-25T08:54:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.542+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12740052d0 con 0x7f126c0039e0 2024-04-25T08:54:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.542+0000 7f12837fe640 1 -- 172.21.15.55:0/2224731756 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127402abe0 con 0x7f126c0039e0 2024-04-25T08:54:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.542+0000 7f128b01b640 1 -- 172.21.15.55:0/2224731756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0039e0 msgr2=0x7f126c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.542+0000 7f128b01b640 1 --2- 172.21.15.55:0/2224731756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0039e0 0x7f126c003e00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1274001750 tx=0x7f126c005830 comp rx=0 tx=0).stop 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.542+0000 7f12895b8640 1 -- 172.21.15.55:0/2224731756 reap_dead start 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.543+0000 7f128b01b640 1 -- 172.21.15.55:0/2224731756 shutdown_connections 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.543+0000 7f128b01b640 1 -- 172.21.15.55:0/2224731756 >> 172.21.15.55:0/2224731756 conn(0x7f12840d06b0 msgr2=0x7f12840d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.543+0000 7f128b01b640 1 -- 172.21.15.55:0/2224731756 shutdown_connections 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.543+0000 7f128b01b640 1 -- 172.21.15.55:0/2224731756 wait complete. 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.544+0000 7f128b01b640 1 Processor -- start 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.544+0000 7f128b01b640 1 -- start start 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f128b01b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c0039e0 0x7f1284158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f128b01b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840ca780 0x7f1284160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f128b01b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f128415f560 0x7f12840b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f128b01b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12840c4200 con 0x7f128415f560 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f128b01b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12840d0310 con 0x7f126c0039e0 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f128b01b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12840c4380 con 0x7f12840ca780 2024-04-25T08:54:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12895b8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f128415f560 0x7f12840b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12895b8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f128415f560 0x7f12840b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54556/0 (socket says 172.21.15.55:54556) 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12895b8640 1 -- 172.21.15.55:0/4248245582 learned_addr learned my addr 172.21.15.55:0/4248245582 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f1283fff640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840ca780 0x7f1284160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f1288db7640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c0039e0 0x7f1284158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12895b8640 1 -- 172.21.15.55:0/4248245582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840ca780 msgr2=0x7f1284160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12895b8640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840ca780 0x7f1284160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12895b8640 1 -- 172.21.15.55:0/4248245582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c0039e0 msgr2=0x7f1284158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12895b8640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c0039e0 0x7f1284158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12895b8640 1 -- 172.21.15.55:0/4248245582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1284158ba0 con 0x7f128415f560 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12895b8640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f128415f560 0x7f12840b5540 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f128406bc60 tx=0x7f127c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12817fa640 1 -- 172.21.15.55:0/4248245582 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c00ac80 con 0x7f128415f560 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12817fa640 1 -- 172.21.15.55:0/4248245582 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c019070 con 0x7f128415f560 2024-04-25T08:54:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f128b01b640 1 -- 172.21.15.55:0/4248245582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128415e4c0 con 0x7f128415f560 2024-04-25T08:54:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f12817fa640 1 -- 172.21.15.55:0/4248245582 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c013630 con 0x7f128415f560 2024-04-25T08:54:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.545+0000 7f128b01b640 1 -- 172.21.15.55:0/4248245582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128415ea80 con 0x7f128415f560 2024-04-25T08:54:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.546+0000 7f128b01b640 1 -- 172.21.15.55:0/4248245582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1284071aa0 con 0x7f128415f560 2024-04-25T08:54:49.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.547+0000 7f12817fa640 1 -- 172.21.15.55:0/4248245582 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f127c0137d0 con 0x7f128415f560 2024-04-25T08:54:49.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.547+0000 7f12817fa640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f127006b4d0 0x7f127006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:49.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.547+0000 7f12817fa640 1 -- 172.21.15.55:0/4248245582 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f127c08a770 con 0x7f128415f560 2024-04-25T08:54:49.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.547+0000 7f1288db7640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f127006b4d0 0x7f127006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:49.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.548+0000 7f1288db7640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f127006b4d0 0x7f127006d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1274032000 tx=0x7f127402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:49.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.552+0000 7f12817fa640 1 -- 172.21.15.55:0/4248245582 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1284071aa0 con 0x7f128415f560 2024-04-25T08:54:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.775+0000 7f128b01b640 1 -- 172.21.15.55:0/4248245582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12840cef10 con 0x7f128415f560 2024-04-25T08:54:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.775+0000 7f12817fa640 1 -- 172.21.15.55:0/4248245582 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f1284158ba0 con 0x7f128415f560 2024-04-25T08:54:49.766 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:49.766 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2362450653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2362450653},{"type":"v1","addr":"172.21.15.167:6835","nonce":2362450653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3897225045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3897225045},{"type":"v1","addr":"172.21.15.167:6834","nonce":3897225045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2007115110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2007115110},{"type":"v1","addr":"172.21.15.55:6836","nonce":2007115110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:54:35.752157+0000","modified":"2024-04-25T08:54:37.749451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1495159001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1495159001},{"type":"v1","addr":"172.21.15.55:6837","nonce":1495159001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:54:49.766 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-25T08:54:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 -- 172.21.15.55:0/4248245582 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f127006b4d0 msgr2=0x7f127006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f127006b4d0 0x7f127006d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1274032000 tx=0x7f127402e000 comp rx=0 tx=0).stop 2024-04-25T08:54:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 -- 172.21.15.55:0/4248245582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f128415f560 msgr2=0x7f12840b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f128415f560 0x7f12840b5540 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f128406bc60 tx=0x7f127c007bd0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 -- 172.21.15.55:0/4248245582 shutdown_connections 2024-04-25T08:54:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f127006b4d0 0x7f127006d990 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f128415f560 0x7f12840b5540 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12840ca780 0x7f1284160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 --2- 172.21.15.55:0/4248245582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c0039e0 0x7f1284158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 -- 172.21.15.55:0/4248245582 >> 172.21.15.55:0/4248245582 conn(0x7f12840d06b0 msgr2=0x7f12840b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 -- 172.21.15.55:0/4248245582 shutdown_connections 2024-04-25T08:54:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:49.778+0000 7f128b01b640 1 -- 172.21.15.55:0/4248245582 wait complete. 2024-04-25T08:54:49.778 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T08:54:49.922 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-25T08:54:49.923 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T08:54:49.923 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:54:50.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.034+0000 7f8db4d34640 1 Processor -- start 2024-04-25T08:54:50.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.034+0000 7f8db4d34640 1 -- start start 2024-04-25T08:54:50.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8db4d34640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8db015dce0 0x7f8db00d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:50.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8db4d34640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8db00d35b0 0x7f8db00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:50.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8db4d34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8db00d1f90 0x7f8db00b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:50.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8db4d34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db015e0c0 con 0x7f8db00d1f90 2024-04-25T08:54:50.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8db4d34640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db00d2510 con 0x7f8db015dce0 2024-04-25T08:54:50.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8db4d34640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00d27f0 con 0x7f8db00d35b0 2024-04-25T08:54:50.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8daed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8db00d1f90 0x7f8db00b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:50.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8daed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8db00d1f90 0x7f8db00b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54568/0 (socket says 172.21.15.55:54568) 2024-04-25T08:54:50.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8daed9d640 1 -- 172.21.15.55:0/3656769967 learned_addr learned my addr 172.21.15.55:0/3656769967 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:50.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8da7fff640 1 --2- 172.21.15.55:0/3656769967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8db00d35b0 0x7f8db00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8dae59c640 1 --2- 172.21.15.55:0/3656769967 >> v2:172.21.15.167:3300/0 conn(0x7f8db015dce0 0x7f8db00d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8daed9d640 1 -- 172.21.15.55:0/3656769967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8db00d35b0 msgr2=0x7f8db00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8daed9d640 1 --2- 172.21.15.55:0/3656769967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8db00d35b0 0x7f8db00b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8daed9d640 1 -- 172.21.15.55:0/3656769967 >> v2:172.21.15.167:3300/0 conn(0x7f8db015dce0 msgr2=0x7f8db00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8daed9d640 1 --2- 172.21.15.55:0/3656769967 >> v2:172.21.15.167:3300/0 conn(0x7f8db015dce0 0x7f8db00d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8daed9d640 1 -- 172.21.15.55:0/3656769967 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00d2ad0 con 0x7f8db00d1f90 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8da7fff640 1 --2- 172.21.15.55:0/3656769967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8db00d35b0 0x7f8db00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.035+0000 7f8dae59c640 1 --2- 172.21.15.55:0/3656769967 >> v2:172.21.15.167:3300/0 conn(0x7f8db015dce0 0x7f8db00d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.036+0000 7f8daed9d640 1 --2- 172.21.15.55:0/3656769967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db00d1f90 0x7f8db00b5990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8db00ce220 tx=0x7f8da802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55dc30707ea4ff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.036+0000 7f8dadd9b640 1 -- 172.21.15.55:0/3656769967 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8036070 con 0x7f8db00d1f90 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.036+0000 7f8dadd9b640 1 -- 172.21.15.55:0/3656769967 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da8031600 con 0x7f8db00d1f90 2024-04-25T08:54:50.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.036+0000 7f8dadd9b640 1 -- 172.21.15.55:0/3656769967 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da80319d0 con 0x7f8db00d1f90 2024-04-25T08:54:50.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.037+0000 7f8db4d34640 1 -- 172.21.15.55:0/3656769967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db00d1f90 msgr2=0x7f8db00b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:50.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.037+0000 7f8db4d34640 1 --2- 172.21.15.55:0/3656769967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db00d1f90 0x7f8db00b5990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8db00ce220 tx=0x7f8da802a610 comp rx=0 tx=0).stop 2024-04-25T08:54:50.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.037+0000 7f8db4d34640 1 -- 172.21.15.55:0/3656769967 shutdown_connections 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.037+0000 7f8db4d34640 1 --2- 172.21.15.55:0/3656769967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db00d1f90 0x7f8db00b5990 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.037+0000 7f8db4d34640 1 --2- 172.21.15.55:0/3656769967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8db00d35b0 0x7f8db00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.037+0000 7f8db4d34640 1 --2- 172.21.15.55:0/3656769967 >> v2:172.21.15.167:3300/0 conn(0x7f8db015dce0 0x7f8db00d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.037+0000 7f8db4d34640 1 -- 172.21.15.55:0/3656769967 >> 172.21.15.55:0/3656769967 conn(0x7f8db0072900 msgr2=0x7f8db00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.037+0000 7f8db4d34640 1 -- 172.21.15.55:0/3656769967 shutdown_connections 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.037+0000 7f8db4d34640 1 -- 172.21.15.55:0/3656769967 wait complete. 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.038+0000 7f8db4d34640 1 Processor -- start 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.038+0000 7f8db4d34640 1 -- start start 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8db4d34640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8db00d1f90 0x7f8db00c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8db4d34640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8db00d35b0 0x7f8db0145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8db4d34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015dce0 0x7f8db01461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8db4d34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00b9820 con 0x7f8db015dce0 2024-04-25T08:54:50.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8db4d34640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00d3090 con 0x7f8db00d1f90 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8db4d34640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00b99a0 con 0x7f8db00d35b0 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8daed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015dce0 0x7f8db01461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8daed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015dce0 0x7f8db01461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54572/0 (socket says 172.21.15.55:54572) 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8daed9d640 1 -- 172.21.15.55:0/1710465321 learned_addr learned my addr 172.21.15.55:0/1710465321 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8da7fff640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8db00d35b0 0x7f8db0145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8dae59c640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8db00d1f90 0x7f8db00c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8daed9d640 1 -- 172.21.15.55:0/1710465321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8db00d35b0 msgr2=0x7f8db0145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8daed9d640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8db00d35b0 0x7f8db0145ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8daed9d640 1 -- 172.21.15.55:0/1710465321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8db00d1f90 msgr2=0x7f8db00c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8daed9d640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8db00d1f90 0x7f8db00c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8daed9d640 1 -- 172.21.15.55:0/1710465321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00cbac0 con 0x7f8db015dce0 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8dae59c640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8db00d1f90 0x7f8db00c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.039+0000 7f8daed9d640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015dce0 0x7f8db01461e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009f40 tx=0x7f8da8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:50.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.040+0000 7f8da6ffd640 1 -- 172.21.15.55:0/1710465321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8036050 con 0x7f8db015dce0 2024-04-25T08:54:50.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.040+0000 7f8da6ffd640 1 -- 172.21.15.55:0/1710465321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da8042070 con 0x7f8db015dce0 2024-04-25T08:54:50.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.040+0000 7f8db4d34640 1 -- 172.21.15.55:0/1710465321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db00cbd80 con 0x7f8db015dce0 2024-04-25T08:54:50.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.040+0000 7f8da6ffd640 1 -- 172.21.15.55:0/1710465321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8009510 con 0x7f8db015dce0 2024-04-25T08:54:50.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.040+0000 7f8db4d34640 1 -- 172.21.15.55:0/1710465321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db00cc340 con 0x7f8db015dce0 2024-04-25T08:54:50.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.041+0000 7f8db4d34640 1 -- 172.21.15.55:0/1710465321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db00749b0 con 0x7f8db015dce0 2024-04-25T08:54:50.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.041+0000 7f8da6ffd640 1 -- 172.21.15.55:0/1710465321 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8da8007bd0 con 0x7f8db015dce0 2024-04-25T08:54:50.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.042+0000 7f8da6ffd640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d9006b4d0 0x7f8d9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:54:50.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.042+0000 7f8da6ffd640 1 -- 172.21.15.55:0/1710465321 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8da80ab110 con 0x7f8db015dce0 2024-04-25T08:54:50.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.042+0000 7f8dae59c640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d9006b4d0 0x7f8d9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:54:50.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.042+0000 7f8dae59c640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d9006b4d0 0x7f8d9006d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8da0006fd0 tx=0x7f8da0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:54:50.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.046+0000 7f8da6ffd640 1 -- 172.21.15.55:0/1710465321 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8da8079f10 con 0x7f8db015dce0 2024-04-25T08:54:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.262+0000 7f8db4d34640 1 -- 172.21.15.55:0/1710465321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8db015ca70 con 0x7f8db015dce0 2024-04-25T08:54:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.263+0000 7f8da6ffd640 1 -- 172.21.15.55:0/1710465321 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f8da8079810 con 0x7f8db015dce0 2024-04-25T08:54:50.253 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:54:50.253 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2362450653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2362450653},{"type":"v1","addr":"172.21.15.167:6835","nonce":2362450653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3897225045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3897225045},{"type":"v1","addr":"172.21.15.167:6834","nonce":3897225045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2007115110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2007115110},{"type":"v1","addr":"172.21.15.55:6836","nonce":2007115110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:54:35.752157+0000","modified":"2024-04-25T08:54:37.749451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1495159001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1495159001},{"type":"v1","addr":"172.21.15.55:6837","nonce":1495159001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:54:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-25T08:54:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 -- 172.21.15.55:0/1710465321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d9006b4d0 msgr2=0x7f8d9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d9006b4d0 0x7f8d9006d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8da0006fd0 tx=0x7f8da0008040 comp rx=0 tx=0).stop 2024-04-25T08:54:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 -- 172.21.15.55:0/1710465321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015dce0 msgr2=0x7f8db01461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:54:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015dce0 0x7f8db01461e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009f40 tx=0x7f8da8004a40 comp rx=0 tx=0).stop 2024-04-25T08:54:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 -- 172.21.15.55:0/1710465321 shutdown_connections 2024-04-25T08:54:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d9006b4d0 0x7f8d9006d990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015dce0 0x7f8db01461e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8db00d35b0 0x7f8db0145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 --2- 172.21.15.55:0/1710465321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8db00d1f90 0x7f8db00c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:54:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 -- 172.21.15.55:0/1710465321 >> 172.21.15.55:0/1710465321 conn(0x7f8db0072900 msgr2=0x7f8db00b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:54:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 -- 172.21.15.55:0/1710465321 shutdown_connections 2024-04-25T08:54:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:54:50.265+0000 7f8db4d34640 1 -- 172.21.15.55:0/1710465321 wait complete. 2024-04-25T08:54:50.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json tag path /parentdir mytag 2024-04-25T08:54:50.385 INFO:teuthology.orchestra.run.smithi055.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-04-25T08:54:50.385 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-04-25T08:55:00.386 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-04-25T08:55:00.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.448+0000 7f54b60f6f40 1 Processor -- start 2024-04-25T08:55:00.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.448+0000 7f54b60f6f40 1 -- start start 2024-04-25T08:55:00.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b60f6f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563396557b00 0x5633965f9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b60f6f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563396557ee0 0x5633965527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b60f6f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 0x563396552cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b60f6f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633965fd540 con 0x563396600e50 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b60f6f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633964cedf0 con 0x563396557ee0 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b60f6f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56339656f5b0 con 0x563396557b00 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b43fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 0x563396552cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b43fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 0x563396552cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51300/0 (socket says 172.21.15.55:51300) 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b43fa640 1 -- 172.21.15.55:0/2461384392 learned_addr learned my addr 172.21.15.55:0/2461384392 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b3bf9640 1 --2- 172.21.15.55:0/2461384392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563396557b00 0x5633965f9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b33f8640 1 --2- 172.21.15.55:0/2461384392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563396557ee0 0x5633965527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b43fa640 1 -- 172.21.15.55:0/2461384392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563396557b00 msgr2=0x5633965f9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b43fa640 1 --2- 172.21.15.55:0/2461384392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563396557b00 0x5633965f9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b43fa640 1 -- 172.21.15.55:0/2461384392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563396557ee0 msgr2=0x5633965527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b43fa640 1 --2- 172.21.15.55:0/2461384392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563396557ee0 0x5633965527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.449+0000 7f54b43fa640 1 -- 172.21.15.55:0/2461384392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563396454c50 con 0x563396600e50 2024-04-25T08:55:00.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b43fa640 1 --2- 172.21.15.55:0/2461384392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 0x563396552cf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00a870 tx=0x7f54ac00ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b23ca6e08f12810 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b23f6640 1 -- 172.21.15.55:0/2461384392 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00d9c0 con 0x563396600e50 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b23f6640 1 -- 172.21.15.55:0/2461384392 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac00db60 con 0x563396600e50 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b23f6640 1 -- 172.21.15.55:0/2461384392 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac012470 con 0x563396600e50 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b60f6f40 1 -- 172.21.15.55:0/2461384392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 msgr2=0x563396552cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b60f6f40 1 --2- 172.21.15.55:0/2461384392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 0x563396552cf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00a870 tx=0x7f54ac00ad30 comp rx=0 tx=0).stop 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b60f6f40 1 -- 172.21.15.55:0/2461384392 shutdown_connections 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b60f6f40 1 --2- 172.21.15.55:0/2461384392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 0x563396552cf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b60f6f40 1 --2- 172.21.15.55:0/2461384392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563396557ee0 0x5633965527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b60f6f40 1 --2- 172.21.15.55:0/2461384392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563396557b00 0x5633965f9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b60f6f40 1 -- 172.21.15.55:0/2461384392 >> 172.21.15.55:0/2461384392 conn(0x5633965523d0 msgr2=0x563396529990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b60f6f40 1 -- 172.21.15.55:0/2461384392 shutdown_connections 2024-04-25T08:55:00.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.450+0000 7f54b60f6f40 1 -- 172.21.15.55:0/2461384392 wait complete. 2024-04-25T08:55:00.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.451+0000 7f54b60f6f40 1 Processor -- start 2024-04-25T08:55:00.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.451+0000 7f54b60f6f40 1 -- start start 2024-04-25T08:55:00.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b60f6f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563396557b00 0x563396699320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b60f6f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563396557ee0 0x5633965e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b60f6f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 0x56339656d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b60f6f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563396526080 con 0x563396600e50 2024-04-25T08:55:00.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b60f6f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563396551c90 con 0x563396557ee0 2024-04-25T08:55:00.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b60f6f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633965f8b30 con 0x563396557b00 2024-04-25T08:55:00.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b43fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 0x56339656d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b43fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 0x56339656d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51310/0 (socket says 172.21.15.55:51310) 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b43fa640 1 -- 172.21.15.55:0/294141008 learned_addr learned my addr 172.21.15.55:0/294141008 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b3bf9640 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563396557b00 0x563396699320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b33f8640 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563396557ee0 0x5633965e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b43fa640 1 -- 172.21.15.55:0/294141008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563396557b00 msgr2=0x563396699320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b43fa640 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563396557b00 0x563396699320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b43fa640 1 -- 172.21.15.55:0/294141008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563396557ee0 msgr2=0x5633965e7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b43fa640 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563396557ee0 0x5633965e7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.452+0000 7f54b43fa640 1 -- 172.21.15.55:0/294141008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56339656c750 con 0x563396600e50 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.453+0000 7f54b43fa640 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 0x56339656d7f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00d5a0 tx=0x7f54ac0033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.453+0000 7f54b13f4640 1 -- 172.21.15.55:0/294141008 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac020070 con 0x563396600e50 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.453+0000 7f54b13f4640 1 -- 172.21.15.55:0/294141008 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac025680 con 0x563396600e50 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.453+0000 7f54b13f4640 1 -- 172.21.15.55:0/294141008 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00d9c0 con 0x563396600e50 2024-04-25T08:55:00.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.453+0000 7f54b60f6f40 1 -- 172.21.15.55:0/294141008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56339656ca30 con 0x563396600e50 2024-04-25T08:55:00.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.453+0000 7f54b60f6f40 1 -- 172.21.15.55:0/294141008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56339656cff0 con 0x563396600e50 2024-04-25T08:55:00.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.454+0000 7f54b13f4640 1 -- 172.21.15.55:0/294141008 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f54ac00dd10 con 0x563396600e50 2024-04-25T08:55:00.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.455+0000 7f54b13f4640 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f54a0069eb0 0x7f54a006c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.455+0000 7f54b13f4640 1 -- 172.21.15.55:0/294141008 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54ac08b2b0 con 0x563396600e50 2024-04-25T08:55:00.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.455+0000 7f54b3bf9640 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f54a0069eb0 0x7f54a006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.455+0000 7f54b60f6f40 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x56339656dd30 0x5633965f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.455+0000 7f54b60f6f40 1 -- 172.21.15.55:0/294141008 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v9 -- 0x5633965539a0 con 0x56339656dd30 2024-04-25T08:55:00.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.455+0000 7f54b33f8640 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x56339656dd30 0x5633965f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.455+0000 7f54b3bf9640 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f54a0069eb0 0x7f54a006c370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5633965fc2b0 tx=0x7f54a4001770 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b33f8640 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x56339656dd30 0x5633965f2810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b33f8640 1 -- 172.21.15.55:0/294141008 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f54a805c040 con 0x56339656dd30 2024-04-25T08:55:00.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b60f6f40 1 -- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x56339656dd30 msgr2=0x5633965f2810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b60f6f40 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x56339656dd30 0x5633965f2810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b60f6f40 1 -- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f54a0069eb0 msgr2=0x7f54a006c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b60f6f40 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f54a0069eb0 0x7f54a006c370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5633965fc2b0 tx=0x7f54a4001770 comp rx=0 tx=0).stop 2024-04-25T08:55:00.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b60f6f40 1 -- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 msgr2=0x56339656d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b60f6f40 1 --2- 172.21.15.55:0/294141008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563396600e50 0x56339656d7f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00d5a0 tx=0x7f54ac0033a0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b43fa640 1 -- 172.21.15.55:0/294141008 reap_dead start 2024-04-25T08:55:00.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b60f6f40 1 -- 172.21.15.55:0/294141008 shutdown_connections 2024-04-25T08:55:00.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b60f6f40 1 -- 172.21.15.55:0/294141008 >> 172.21.15.55:0/294141008 conn(0x5633965523d0 msgr2=0x5633965fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:00.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b60f6f40 1 -- 172.21.15.55:0/294141008 shutdown_connections 2024-04-25T08:55:00.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.456+0000 7f54b60f6f40 1 -- 172.21.15.55:0/294141008 wait complete. 2024-04-25T08:55:00.450 INFO:teuthology.orchestra.run.smithi055.stdout:mytag 2024-04-25T08:55:00.450 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-04-25T08:55:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.506+0000 7fb20a51df40 1 Processor -- start 2024-04-25T08:55:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.506+0000 7fb20a51df40 1 -- start start 2024-04-25T08:55:00.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20a51df40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563ceac84b00 0x563cead15f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20a51df40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ceac84ee0 0x563cead19dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20a51df40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 0x563cead1a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20a51df40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ceabfbdf0 con 0x563cead2de50 2024-04-25T08:55:00.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20a51df40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ceabffd50 con 0x563ceac84ee0 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20a51df40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cead2a540 con 0x563ceac84b00 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20881f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 0x563cead1a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20881f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 0x563cead1a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51334/0 (socket says 172.21.15.55:51334) 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20881f640 1 -- 172.21.15.55:0/2433604677 learned_addr learned my addr 172.21.15.55:0/2433604677 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20801e640 1 --2- 172.21.15.55:0/2433604677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563ceac84b00 0x563cead15f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20781d640 1 --2- 172.21.15.55:0/2433604677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ceac84ee0 0x563cead19dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20881f640 1 -- 172.21.15.55:0/2433604677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563ceac84b00 msgr2=0x563cead15f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20881f640 1 --2- 172.21.15.55:0/2433604677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563ceac84b00 0x563cead15f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20881f640 1 -- 172.21.15.55:0/2433604677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ceac84ee0 msgr2=0x563cead19dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20881f640 1 --2- 172.21.15.55:0/2433604677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ceac84ee0 0x563cead19dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20881f640 1 -- 172.21.15.55:0/2433604677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ceac9c770 con 0x563cead2de50 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20881f640 1 --2- 172.21.15.55:0/2433604677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 0x563cead1a310 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb200001e80 tx=0x7fb20000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d573b00de6a5a1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20681b640 1 -- 172.21.15.55:0/2433604677 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200008070 con 0x563cead2de50 2024-04-25T08:55:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20681b640 1 -- 172.21.15.55:0/2433604677 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20000d500 con 0x563cead2de50 2024-04-25T08:55:00.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.507+0000 7fb20681b640 1 -- 172.21.15.55:0/2433604677 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20000d910 con 0x563cead2de50 2024-04-25T08:55:00.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.508+0000 7fb20a51df40 1 -- 172.21.15.55:0/2433604677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 msgr2=0x563cead1a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.508+0000 7fb20a51df40 1 --2- 172.21.15.55:0/2433604677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 0x563cead1a310 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb200001e80 tx=0x7fb20000b6a0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.508+0000 7fb20a51df40 1 -- 172.21.15.55:0/2433604677 shutdown_connections 2024-04-25T08:55:00.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.508+0000 7fb20a51df40 1 --2- 172.21.15.55:0/2433604677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 0x563cead1a310 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.508+0000 7fb20a51df40 1 --2- 172.21.15.55:0/2433604677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ceac84ee0 0x563cead19dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.508+0000 7fb20a51df40 1 --2- 172.21.15.55:0/2433604677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563ceac84b00 0x563cead15f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.508+0000 7fb20a51df40 1 -- 172.21.15.55:0/2433604677 >> 172.21.15.55:0/2433604677 conn(0x563ceac7f3d0 msgr2=0x563ceac80040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:00.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.508+0000 7fb20a51df40 1 -- 172.21.15.55:0/2433604677 shutdown_connections 2024-04-25T08:55:00.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.508+0000 7fb20a51df40 1 -- 172.21.15.55:0/2433604677 wait complete. 2024-04-25T08:55:00.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.509+0000 7fb20a51df40 1 Processor -- start 2024-04-25T08:55:00.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.509+0000 7fb20a51df40 1 -- start start 2024-04-25T08:55:00.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.509+0000 7fb20a51df40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ceac84b00 0x563ceac98fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.509+0000 7fb20a51df40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563ceac84ee0 0x563ceadc3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.509+0000 7fb20a51df40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 0x563ceadc41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.509+0000 7fb20a51df40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ceac57260 con 0x563cead2de50 2024-04-25T08:55:00.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.509+0000 7fb20a51df40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cead2d670 con 0x563ceac84b00 2024-04-25T08:55:00.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.509+0000 7fb20a51df40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cead2d8c0 con 0x563ceac84ee0 2024-04-25T08:55:00.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.509+0000 7fb20881f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 0x563ceadc41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.509+0000 7fb20781d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563ceac84ee0 0x563ceadc3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb20801e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ceac84b00 0x563ceac98fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.509+0000 7fb20881f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 0x563ceadc41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51336/0 (socket says 172.21.15.55:51336) 2024-04-25T08:55:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb20781d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563ceac84ee0 0x563ceadc3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:41020/0 (socket says 172.21.15.55:41020) 2024-04-25T08:55:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb20881f640 1 -- 172.21.15.55:0/1178354617 learned_addr learned my addr 172.21.15.55:0/1178354617 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb20881f640 1 -- 172.21.15.55:0/1178354617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563ceac84ee0 msgr2=0x563ceadc3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb20881f640 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563ceac84ee0 0x563ceadc3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb20881f640 1 -- 172.21.15.55:0/1178354617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ceac84b00 msgr2=0x563ceac98fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb20881f640 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ceac84b00 0x563ceac98fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb20881f640 1 -- 172.21.15.55:0/1178354617 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cead14fd0 con 0x563cead2de50 2024-04-25T08:55:00.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb20881f640 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 0x563ceadc41f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb200000fb0 tx=0x7fb200000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb205819640 1 -- 172.21.15.55:0/1178354617 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200019680 con 0x563cead2de50 2024-04-25T08:55:00.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb205819640 1 -- 172.21.15.55:0/1178354617 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb200019820 con 0x563cead2de50 2024-04-25T08:55:00.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb20a51df40 1 -- 172.21.15.55:0/1178354617 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563ceac80800 con 0x563cead2de50 2024-04-25T08:55:00.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb205819640 1 -- 172.21.15.55:0/1178354617 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200019bf0 con 0x563cead2de50 2024-04-25T08:55:00.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.510+0000 7fb20a51df40 1 -- 172.21.15.55:0/1178354617 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cead15410 con 0x563cead2de50 2024-04-25T08:55:00.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.512+0000 7fb205819640 1 -- 172.21.15.55:0/1178354617 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb200017040 con 0x563cead2de50 2024-04-25T08:55:00.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.512+0000 7fb205819640 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb1e8069eb0 0x7fb1e806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.512+0000 7fb205819640 1 -- 172.21.15.55:0/1178354617 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb20008b190 con 0x563cead2de50 2024-04-25T08:55:00.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.512+0000 7fb20801e640 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb1e8069eb0 0x7fb1e806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.512+0000 7fb20a51df40 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x563ceac994f0 0x563ceac97a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.512+0000 7fb20a51df40 1 -- 172.21.15.55:0/1178354617 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v9 -- 0x563cead1cae0 con 0x563ceac994f0 2024-04-25T08:55:00.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20781d640 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x563ceac994f0 0x563ceac97a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20801e640 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb1e8069eb0 0x7fb1e806c370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8056000 tx=0x7fb1f8007030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20781d640 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x563ceac994f0 0x563ceac97a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20781d640 1 -- 172.21.15.55:0/1178354617 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fb1f000e040 con 0x563ceac994f0 2024-04-25T08:55:00.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20a51df40 1 -- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x563ceac994f0 msgr2=0x563ceac97a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20a51df40 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x563ceac994f0 0x563ceac97a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20a51df40 1 -- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb1e8069eb0 msgr2=0x7fb1e806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20a51df40 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb1e8069eb0 0x7fb1e806c370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8056000 tx=0x7fb1f8007030 comp rx=0 tx=0).stop 2024-04-25T08:55:00.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20a51df40 1 -- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 msgr2=0x563ceadc41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20a51df40 1 --2- 172.21.15.55:0/1178354617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cead2de50 0x563ceadc41f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb200000fb0 tx=0x7fb200000ed0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20881f640 1 -- 172.21.15.55:0/1178354617 reap_dead start 2024-04-25T08:55:00.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20a51df40 1 -- 172.21.15.55:0/1178354617 shutdown_connections 2024-04-25T08:55:00.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20a51df40 1 -- 172.21.15.55:0/1178354617 >> 172.21.15.55:0/1178354617 conn(0x563ceac7f3d0 msgr2=0x563cead27dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:00.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.513+0000 7fb20a51df40 1 -- 172.21.15.55:0/1178354617 shutdown_connections 2024-04-25T08:55:00.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.514+0000 7fb20a51df40 1 -- 172.21.15.55:0/1178354617 wait complete. 2024-04-25T08:55:00.518 INFO:teuthology.orchestra.run.smithi055.stdout:mytag 2024-04-25T08:55:00.518 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-25T08:55:00.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.573+0000 7f8f83f1ff40 1 Processor -- start 2024-04-25T08:55:00.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.573+0000 7f8f83f1ff40 1 -- start start 2024-04-25T08:55:00.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f83f1ff40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 0x55a1d00b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f83f1ff40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a1d0020650 0x55a1d00b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f83f1ff40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1d00073b0 0x55a1d0007860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f83f1ff40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1cff80df0 con 0x7f8f70002850 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f83f1ff40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1cff84d50 con 0x55a1d00073b0 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f83f1ff40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1d0023ea0 con 0x55a1d0020650 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f810f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 0x55a1d00b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f810f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 0x55a1d00b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51356/0 (socket says 172.21.15.55:51356) 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f810f5640 1 -- 172.21.15.55:0/2183682355 learned_addr learned my addr 172.21.15.55:0/2183682355 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f818f6640 1 --2- 172.21.15.55:0/2183682355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1d00073b0 0x55a1d0007860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f808f4640 1 --2- 172.21.15.55:0/2183682355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a1d0020650 0x55a1d00b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f810f5640 1 -- 172.21.15.55:0/2183682355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a1d0020650 msgr2=0x55a1d00b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f810f5640 1 --2- 172.21.15.55:0/2183682355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a1d0020650 0x55a1d00b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f810f5640 1 -- 172.21.15.55:0/2183682355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1d00073b0 msgr2=0x55a1d0007860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f810f5640 1 --2- 172.21.15.55:0/2183682355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1d00073b0 0x55a1d0007860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.574+0000 7f8f810f5640 1 -- 172.21.15.55:0/2183682355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1d00b43e0 con 0x7f8f70002850 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f810f5640 1 --2- 172.21.15.55:0/2183682355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 0x55a1d00b0550 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009790 tx=0x7f8f7c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f62c03bbaeab79a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f7b7fe640 1 -- 172.21.15.55:0/2183682355 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0078f0 con 0x7f8f70002850 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f7b7fe640 1 -- 172.21.15.55:0/2183682355 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c007a90 con 0x7f8f70002850 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f7b7fe640 1 -- 172.21.15.55:0/2183682355 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c007e60 con 0x7f8f70002850 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/2183682355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 msgr2=0x55a1d00b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f83f1ff40 1 --2- 172.21.15.55:0/2183682355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 0x55a1d00b0550 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009790 tx=0x7f8f7c005a00 comp rx=0 tx=0).stop 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/2183682355 shutdown_connections 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f83f1ff40 1 --2- 172.21.15.55:0/2183682355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1d00073b0 0x55a1d0007860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f83f1ff40 1 --2- 172.21.15.55:0/2183682355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a1d0020650 0x55a1d00b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f83f1ff40 1 --2- 172.21.15.55:0/2183682355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 0x55a1d00b0550 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/2183682355 >> 172.21.15.55:0/2183682355 conn(0x55a1d00043d0 msgr2=0x55a1d0009df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/2183682355 shutdown_connections 2024-04-25T08:55:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.575+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/2183682355 wait complete. 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.576+0000 7f8f83f1ff40 1 Processor -- start 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.576+0000 7f8f83f1ff40 1 -- start start 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f83f1ff40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a1d00073b0 0x55a1d00ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f83f1ff40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1d0020650 0x55a1d0090cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f83f1ff40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 0x55a1d00b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f83f1ff40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d0093060 con 0x7f8f70002850 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f83f1ff40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d0092e10 con 0x55a1d0020650 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f83f1ff40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1d0093340 con 0x55a1d00073b0 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f818f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 0x55a1d00b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f818f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 0x55a1d00b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51372/0 (socket says 172.21.15.55:51372) 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f818f6640 1 -- 172.21.15.55:0/430159167 learned_addr learned my addr 172.21.15.55:0/430159167 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f810f5640 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a1d00073b0 0x55a1d00ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f808f4640 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1d0020650 0x55a1d0090cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f818f6640 1 -- 172.21.15.55:0/430159167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a1d00073b0 msgr2=0x55a1d00ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f818f6640 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a1d00073b0 0x55a1d00ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f818f6640 1 -- 172.21.15.55:0/430159167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1d0020650 msgr2=0x55a1d0090cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f818f6640 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1d0020650 0x55a1d0090cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f818f6640 1 -- 172.21.15.55:0/430159167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1d0091a80 con 0x7f8f70002850 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f810f5640 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a1d00073b0 0x55a1d00ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f818f6640 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 0x55a1d00b36f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55a1cffdd090 tx=0x7f8f74003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f7a7fc640 1 -- 172.21.15.55:0/430159167 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7401a070 con 0x7f8f70002850 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f7a7fc640 1 -- 172.21.15.55:0/430159167 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f74006e50 con 0x7f8f70002850 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/430159167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a1d0091d60 con 0x7f8f70002850 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.577+0000 7f8f7a7fc640 1 -- 172.21.15.55:0/430159167 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740137e0 con 0x7f8f70002850 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.578+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/430159167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1d0092320 con 0x7f8f70002850 2024-04-25T08:55:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.579+0000 7f8f7a7fc640 1 -- 172.21.15.55:0/430159167 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8f7401d070 con 0x7f8f70002850 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.579+0000 7f8f7a7fc640 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8f64069eb0 0x7f8f6406c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.579+0000 7f8f7a7fc640 1 -- 172.21.15.55:0/430159167 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f740889b0 con 0x7f8f70002850 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.579+0000 7f8f810f5640 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8f64069eb0 0x7f8f6406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.579+0000 7f8f83f1ff40 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55a1d001e610 0x55a1d001ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.579+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/430159167 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:1 5.36 5:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v9 -- 0x55a1d001ef90 con 0x55a1d001e610 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.580+0000 7f8f808f4640 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55a1d001e610 0x55a1d001ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.580+0000 7f8f810f5640 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8f64069eb0 0x7f8f6406c370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55a1d00afe30 tx=0x7f8f7c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.580+0000 7f8f808f4640 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55a1d001e610 0x55a1d001ea50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.580+0000 7f8f808f4640 1 -- 172.21.15.55:0/430159167 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f8f6c055810 con 0x55a1d001e610 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.580+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55a1d001e610 msgr2=0x55a1d001ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.580+0000 7f8f83f1ff40 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55a1d001e610 0x55a1d001ea50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.580+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8f64069eb0 msgr2=0x7f8f6406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.580+0000 7f8f83f1ff40 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8f64069eb0 0x7f8f6406c370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55a1d00afe30 tx=0x7f8f7c00b040 comp rx=0 tx=0).stop 2024-04-25T08:55:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.580+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 msgr2=0x55a1d00b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.580+0000 7f8f83f1ff40 1 --2- 172.21.15.55:0/430159167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f70002850 0x55a1d00b36f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55a1cffdd090 tx=0x7f8f74003820 comp rx=0 tx=0).stop 2024-04-25T08:55:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.580+0000 7f8f818f6640 1 -- 172.21.15.55:0/430159167 reap_dead start 2024-04-25T08:55:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.581+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/430159167 shutdown_connections 2024-04-25T08:55:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.581+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/430159167 >> 172.21.15.55:0/430159167 conn(0x55a1d00043d0 msgr2=0x55a1d00b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.581+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/430159167 shutdown_connections 2024-04-25T08:55:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.581+0000 7f8f83f1ff40 1 -- 172.21.15.55:0/430159167 wait complete. 2024-04-25T08:55:00.579 INFO:teuthology.orchestra.run.smithi055.stdout:mytag 2024-04-25T08:55:00.579 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.632+0000 7fdd1671ff40 1 Processor -- start 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.632+0000 7fdd1671ff40 1 -- start start 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1671ff40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a95841880 0x558a958e1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1671ff40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a958e4b60 0x558a95813b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1671ff40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558a958e75e0 0x558a958e56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1671ff40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9585baa0 con 0x558a95841880 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1671ff40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a958421d0 con 0x558a958e4b60 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1671ff40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a958e82f0 con 0x558a958e75e0 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1379a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a95841880 0x558a958e1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1379a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a95841880 0x558a958e1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51396/0 (socket says 172.21.15.55:51396) 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1379a640 1 -- 172.21.15.55:0/801425366 learned_addr learned my addr 172.21.15.55:0/801425366 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd12f99640 1 --2- 172.21.15.55:0/801425366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a958e4b60 0x558a95813b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd13f9b640 1 --2- 172.21.15.55:0/801425366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558a958e75e0 0x558a958e56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1379a640 1 -- 172.21.15.55:0/801425366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558a958e75e0 msgr2=0x558a958e56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1379a640 1 --2- 172.21.15.55:0/801425366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558a958e75e0 0x558a958e56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1379a640 1 -- 172.21.15.55:0/801425366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a958e4b60 msgr2=0x558a95813b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1379a640 1 --2- 172.21.15.55:0/801425366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a958e4b60 0x558a95813b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1379a640 1 -- 172.21.15.55:0/801425366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a95752de0 con 0x558a95841880 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd13f9b640 1 --2- 172.21.15.55:0/801425366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558a958e75e0 0x558a958e56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.633+0000 7fdd1379a640 1 --2- 172.21.15.55:0/801425366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a95841880 0x558a958e1330 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009730 tx=0x7fdd04009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f675bb93fd08c3b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd11f97640 1 -- 172.21.15.55:0/801425366 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04017070 con 0x558a95841880 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd11f97640 1 -- 172.21.15.55:0/801425366 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040090d0 con 0x558a95841880 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd11f97640 1 -- 172.21.15.55:0/801425366 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04006b60 con 0x558a95841880 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd1671ff40 1 -- 172.21.15.55:0/801425366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a95841880 msgr2=0x558a958e1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd1671ff40 1 --2- 172.21.15.55:0/801425366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a95841880 0x558a958e1330 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009730 tx=0x7fdd04009bf0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd1671ff40 1 -- 172.21.15.55:0/801425366 shutdown_connections 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd1671ff40 1 --2- 172.21.15.55:0/801425366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558a958e75e0 0x558a958e56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd1671ff40 1 --2- 172.21.15.55:0/801425366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a958e4b60 0x558a95813b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd1671ff40 1 --2- 172.21.15.55:0/801425366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a95841880 0x558a958e1330 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd1671ff40 1 -- 172.21.15.55:0/801425366 >> 172.21.15.55:0/801425366 conn(0x558a9583c3d0 msgr2=0x558a958596a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd1671ff40 1 -- 172.21.15.55:0/801425366 shutdown_connections 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.634+0000 7fdd1671ff40 1 -- 172.21.15.55:0/801425366 wait complete. 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.635+0000 7fdd1671ff40 1 Processor -- start 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.635+0000 7fdd1671ff40 1 -- start start 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.635+0000 7fdd1671ff40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a95841880 0x558a958e5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.635+0000 7fdd1671ff40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a958e4b60 0x558a958dfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd1671ff40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558a958e75e0 0x558a958e6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd1671ff40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a95842010 con 0x558a958e4b60 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd1671ff40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a958e3680 con 0x558a95841880 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd1671ff40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a95858590 con 0x558a958e75e0 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd12f99640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a958e4b60 0x558a958dfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd12f99640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a958e4b60 0x558a958dfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51408/0 (socket says 172.21.15.55:51408) 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd12f99640 1 -- 172.21.15.55:0/2343451256 learned_addr learned my addr 172.21.15.55:0/2343451256 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd1379a640 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a95841880 0x558a958e5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd13f9b640 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558a958e75e0 0x558a958e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd12f99640 1 -- 172.21.15.55:0/2343451256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558a958e75e0 msgr2=0x558a958e6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd12f99640 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558a958e75e0 0x558a958e6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd12f99640 1 -- 172.21.15.55:0/2343451256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a95841880 msgr2=0x558a958e5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd12f99640 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a95841880 0x558a958e5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd12f99640 1 -- 172.21.15.55:0/2343451256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a9573ec50 con 0x558a958e4b60 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd12f99640 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a958e4b60 0x558a958dfed0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdd08025ca0 tx=0x7fdd08002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd10f95640 1 -- 172.21.15.55:0/2343451256 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08054c30 con 0x558a958e4b60 2024-04-25T08:55:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd10f95640 1 -- 172.21.15.55:0/2343451256 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd08063070 con 0x558a958e4b60 2024-04-25T08:55:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd1671ff40 1 -- 172.21.15.55:0/2343451256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a958547b0 con 0x558a958e4b60 2024-04-25T08:55:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd10f95640 1 -- 172.21.15.55:0/2343451256 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08068470 con 0x558a958e4b60 2024-04-25T08:55:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.636+0000 7fdd1671ff40 1 -- 172.21.15.55:0/2343451256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a95854d70 con 0x558a958e4b60 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.638+0000 7fdd10f95640 1 -- 172.21.15.55:0/2343451256 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd0805e420 con 0x558a958e4b60 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.638+0000 7fdd10f95640 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd00069eb0 0x7fdd0006c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.638+0000 7fdd10f95640 1 -- 172.21.15.55:0/2343451256 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd080cd550 con 0x558a958e4b60 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.638+0000 7fdd1379a640 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd00069eb0 0x7fdd0006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.638+0000 7fdd1671ff40 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x558a95856c80 0x558a95857060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.638+0000 7fdd1671ff40 1 -- 172.21.15.55:0/2343451256 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:1 5.19 5:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v9 -- 0x558a958575a0 con 0x558a95856c80 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd13f9b640 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x558a95856c80 0x558a95857060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd1379a640 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd00069eb0 0x7fdd0006c370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdd04015040 tx=0x7fdd0400f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd13f9b640 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x558a95856c80 0x558a95857060 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd13f9b640 1 -- 172.21.15.55:0/2343451256 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fdd0c00e9c0 con 0x558a95856c80 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd1671ff40 1 -- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x558a95856c80 msgr2=0x558a95857060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd1671ff40 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x558a95856c80 0x558a95857060 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd1671ff40 1 -- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd00069eb0 msgr2=0x7fdd0006c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd1671ff40 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd00069eb0 0x7fdd0006c370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdd04015040 tx=0x7fdd0400f000 comp rx=0 tx=0).stop 2024-04-25T08:55:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd1671ff40 1 -- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a958e4b60 msgr2=0x558a958dfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd1671ff40 1 --2- 172.21.15.55:0/2343451256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a958e4b60 0x558a958dfed0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdd08025ca0 tx=0x7fdd08002fb0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd13f9b640 1 -- 172.21.15.55:0/2343451256 reap_dead start 2024-04-25T08:55:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd1671ff40 1 -- 172.21.15.55:0/2343451256 shutdown_connections 2024-04-25T08:55:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd1671ff40 1 -- 172.21.15.55:0/2343451256 >> 172.21.15.55:0/2343451256 conn(0x558a9583c3d0 msgr2=0x558a95840ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd1671ff40 1 -- 172.21.15.55:0/2343451256 shutdown_connections 2024-04-25T08:55:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.639+0000 7fdd1671ff40 1 -- 172.21.15.55:0/2343451256 wait complete. 2024-04-25T08:55:00.635 INFO:teuthology.orchestra.run.smithi055.stdout:mytag 2024-04-25T08:55:00.635 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T08:55:00.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:55:00.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.730+0000 7fcb0f4e4f40 1 Processor -- start 2024-04-25T08:55:00.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.730+0000 7fcb0f4e4f40 1 -- start start 2024-04-25T08:55:00.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.730+0000 7fcb0f4e4f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f18f51880 0x557f18f68360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.730+0000 7fcb0f4e4f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 0x557f18ff6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.730+0000 7fcb0f4e4f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f18ff75e0 0x557f18ff8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.730+0000 7fcb0f4e4f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f18ec8df0 con 0x557f18ff4b60 2024-04-25T08:55:00.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.730+0000 7fcb0f4e4f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f18f6baa0 con 0x557f18ff75e0 2024-04-25T08:55:00.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.730+0000 7fcb0f4e4f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f18ff1b70 con 0x557f18f51880 2024-04-25T08:55:00.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 0x557f18ff6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb0cfe5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f18f51880 0x557f18f68360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 0x557f18ff6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51414/0 (socket says 172.21.15.55:51414) 2024-04-25T08:55:00.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb07fff640 1 -- 172.21.15.55:0/4113968354 learned_addr learned my addr 172.21.15.55:0/4113968354 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb0d7e6640 1 --2- 172.21.15.55:0/4113968354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f18ff75e0 0x557f18ff8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb07fff640 1 -- 172.21.15.55:0/4113968354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f18f51880 msgr2=0x557f18f68360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb07fff640 1 --2- 172.21.15.55:0/4113968354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f18f51880 0x557f18f68360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb07fff640 1 -- 172.21.15.55:0/4113968354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f18ff75e0 msgr2=0x557f18ff8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb07fff640 1 --2- 172.21.15.55:0/4113968354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f18ff75e0 0x557f18ff8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb07fff640 1 -- 172.21.15.55:0/4113968354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f18e4ec50 con 0x557f18ff4b60 2024-04-25T08:55:00.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb07fff640 1 --2- 172.21.15.55:0/4113968354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 0x557f18ff6620 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009780 tx=0x7fcaf8005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e8f8e578b7c61a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb06ffd640 1 -- 172.21.15.55:0/4113968354 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8008870 con 0x557f18ff4b60 2024-04-25T08:55:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb06ffd640 1 -- 172.21.15.55:0/4113968354 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8018070 con 0x557f18ff4b60 2024-04-25T08:55:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.731+0000 7fcb06ffd640 1 -- 172.21.15.55:0/4113968354 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8008c30 con 0x557f18ff4b60 2024-04-25T08:55:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.732+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/4113968354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 msgr2=0x557f18ff6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.732+0000 7fcb0f4e4f40 1 --2- 172.21.15.55:0/4113968354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 0x557f18ff6620 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009780 tx=0x7fcaf8005a00 comp rx=0 tx=0).stop 2024-04-25T08:55:00.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.732+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/4113968354 shutdown_connections 2024-04-25T08:55:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.732+0000 7fcb0f4e4f40 1 --2- 172.21.15.55:0/4113968354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f18ff75e0 0x557f18ff8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.732+0000 7fcb0f4e4f40 1 --2- 172.21.15.55:0/4113968354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 0x557f18ff6620 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.732+0000 7fcb0f4e4f40 1 --2- 172.21.15.55:0/4113968354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f18f51880 0x557f18f68360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.732+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/4113968354 >> 172.21.15.55:0/4113968354 conn(0x557f18f4c3d0 msgr2=0x557f18ff79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.732+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/4113968354 shutdown_connections 2024-04-25T08:55:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.732+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/4113968354 wait complete. 2024-04-25T08:55:00.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.732+0000 7fcb0f4e4f40 1 Processor -- start 2024-04-25T08:55:00.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.732+0000 7fcb0f4e4f40 1 -- start start 2024-04-25T08:55:00.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb0f4e4f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f18f51880 0x557f19086440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb0f4e4f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 0x557f18fe7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb0f4e4f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f18ff75e0 0x557f18feb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb0f4e4f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f18ff42d0 con 0x557f18ff4b60 2024-04-25T08:55:00.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb0f4e4f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f18ff4030 con 0x557f18ff75e0 2024-04-25T08:55:00.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb0f4e4f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f18f69740 con 0x557f18f51880 2024-04-25T08:55:00.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 0x557f18fe7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 0x557f18fe7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51422/0 (socket says 172.21.15.55:51422) 2024-04-25T08:55:00.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb07fff640 1 -- 172.21.15.55:0/2498312300 learned_addr learned my addr 172.21.15.55:0/2498312300 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:00.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb0d7e6640 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f18ff75e0 0x557f18feb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb0cfe5640 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f18f51880 0x557f19086440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb07fff640 1 -- 172.21.15.55:0/2498312300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f18f51880 msgr2=0x557f19086440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb07fff640 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f18f51880 0x557f19086440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb07fff640 1 -- 172.21.15.55:0/2498312300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f18ff75e0 msgr2=0x557f18feb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb07fff640 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f18ff75e0 0x557f18feb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb07fff640 1 -- 172.21.15.55:0/2498312300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f18fe7d80 con 0x557f18ff4b60 2024-04-25T08:55:00.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.733+0000 7fcb0cfe5640 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f18f51880 0x557f19086440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:00.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.734+0000 7fcb07fff640 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 0x557f18fe7390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8000c00 tx=0x7fcaf8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.734+0000 7fcb05ffb640 1 -- 172.21.15.55:0/2498312300 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80056c0 con 0x557f18ff4b60 2024-04-25T08:55:00.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.734+0000 7fcb05ffb640 1 -- 172.21.15.55:0/2498312300 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8021030 con 0x557f18ff4b60 2024-04-25T08:55:00.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.734+0000 7fcb05ffb640 1 -- 172.21.15.55:0/2498312300 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8026660 con 0x557f18ff4b60 2024-04-25T08:55:00.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.734+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/2498312300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f18ff3c30 con 0x557f18ff4b60 2024-04-25T08:55:00.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.734+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/2498312300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f18f4bac0 con 0x557f18ff4b60 2024-04-25T08:55:00.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.735+0000 7fcb05ffb640 1 -- 172.21.15.55:0/2498312300 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcaf8013420 con 0x557f18ff4b60 2024-04-25T08:55:00.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.736+0000 7fcb05ffb640 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcaf0069ee0 0x7fcaf006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.736+0000 7fcb05ffb640 1 -- 172.21.15.55:0/2498312300 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaf808a660 con 0x557f18ff4b60 2024-04-25T08:55:00.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.736+0000 7fcb0cfe5640 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcaf0069ee0 0x7fcaf006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.736+0000 7fcb0f4e4f40 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x557f18fe78d0 0x557f18f50220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:00.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.736+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/2498312300 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:1 5.12 5:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v9 -- 0x557f18ff8e10 con 0x557f18fe78d0 2024-04-25T08:55:00.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.736+0000 7fcb0d7e6640 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x557f18fe78d0 0x557f18f50220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:00.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.736+0000 7fcb0cfe5640 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcaf0069ee0 0x7fcaf006c3a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcb00057000 tx=0x7fcb00052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.736+0000 7fcb0d7e6640 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x557f18fe78d0 0x557f18f50220 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:00.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0d7e6640 1 -- 172.21.15.55:0/2498312300 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fcb08002720 con 0x557f18fe78d0 2024-04-25T08:55:00.743 INFO:teuthology.orchestra.run.smithi055.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-04-25T08:55:00.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x557f18fe78d0 msgr2=0x557f18f50220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0f4e4f40 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x557f18fe78d0 0x557f18f50220 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:00.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcaf0069ee0 msgr2=0x7fcaf006c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0f4e4f40 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcaf0069ee0 0x7fcaf006c3a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcb00057000 tx=0x7fcb00052000 comp rx=0 tx=0).stop 2024-04-25T08:55:00.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 msgr2=0x557f18fe7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:00.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0f4e4f40 1 --2- 172.21.15.55:0/2498312300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557f18ff4b60 0x557f18fe7390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8000c00 tx=0x7fcaf8003020 comp rx=0 tx=0).stop 2024-04-25T08:55:00.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0d7e6640 1 -- 172.21.15.55:0/2498312300 reap_dead start 2024-04-25T08:55:00.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/2498312300 shutdown_connections 2024-04-25T08:55:00.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/2498312300 >> 172.21.15.55:0/2498312300 conn(0x557f18f4c3d0 msgr2=0x557f18ff79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:00.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/2498312300 shutdown_connections 2024-04-25T08:55:00.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:00.737+0000 7fcb0f4e4f40 1 -- 172.21.15.55:0/2498312300 wait complete. 2024-04-25T08:55:00.744 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:55:00.745 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:55:00.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:55:00.831 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:55:00.831 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:55:00.831 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:55:00.847 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:55:00.848 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:55:00.848 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:55:00.888 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:55:00.904 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:55:00.904 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:55:00.904 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:55:00.946 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:55:00.946 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:55:01.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.057+0000 7fcb32730640 1 Processor -- start 2024-04-25T08:55:01.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.057+0000 7fcb32730640 1 -- start start 2024-04-25T08:55:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.058+0000 7fcb32730640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb2c0d35b0 0x7fcb2c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.058+0000 7fcb32730640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb2c0b5990 0x7fcb2c0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.058+0000 7fcb32730640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2c15e0c0 con 0x7fcb2c15dce0 2024-04-25T08:55:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.058+0000 7fcb32730640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2c0b5de0 con 0x7fcb2c0b5990 2024-04-25T08:55:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.058+0000 7fcb32730640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c0d2510 con 0x7fcb2c0d35b0 2024-04-25T08:55:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.058+0000 7fcb30ccd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb2c0b5990 0x7fcb2c0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.058+0000 7fcb2bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcb2c15dce0 0x7fcb2c0d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48352/0 (socket says 172.21.15.55:48352) 2024-04-25T08:55:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.058+0000 7fcb2bfff640 1 -- 172.21.15.55:0/974377699 learned_addr learned my addr 172.21.15.55:0/974377699 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.058+0000 7fcb2b7fe640 1 --2- 172.21.15.55:0/974377699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb2c0d35b0 0x7fcb2c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.059+0000 7fcb30ccd640 1 -- 172.21.15.55:0/974377699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb2c0d35b0 msgr2=0x7fcb2c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.059+0000 7fcb30ccd640 1 --2- 172.21.15.55:0/974377699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb2c0d35b0 0x7fcb2c0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.059+0000 7fcb30ccd640 1 -- 172.21.15.55:0/974377699 >> v1:172.21.15.55:6789/0 conn(0x7fcb2c15dce0 legacy=0x7fcb2c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.059+0000 7fcb30ccd640 1 -- 172.21.15.55:0/974377699 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c0d27f0 con 0x7fcb2c0b5990 2024-04-25T08:55:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.059+0000 7fcb2affd640 1 -- 172.21.15.55:0/974377699 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118211613 0 0) 0x7fcb2c15e0c0 con 0x7fcb2c15dce0 2024-04-25T08:55:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.059+0000 7fcb2b7fe640 1 --2- 172.21.15.55:0/974377699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb2c0d35b0 0x7fcb2c0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.059+0000 7fcb30ccd640 1 --2- 172.21.15.55:0/974377699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb2c0b5990 0x7fcb2c0b6b00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009d90 tx=0x7fcb2402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd7ed094ab82886 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.060+0000 7fcb2affd640 1 -- 172.21.15.55:0/974377699 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24007740 con 0x7fcb2c0b5990 2024-04-25T08:55:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.060+0000 7fcb2affd640 1 -- 172.21.15.55:0/974377699 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb240078e0 con 0x7fcb2c0b5990 2024-04-25T08:55:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.060+0000 7fcb2affd640 1 -- 172.21.15.55:0/974377699 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24007cb0 con 0x7fcb2c0b5990 2024-04-25T08:55:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.060+0000 7fcb32730640 1 -- 172.21.15.55:0/974377699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb2c0b5990 msgr2=0x7fcb2c0b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.060+0000 7fcb32730640 1 --2- 172.21.15.55:0/974377699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb2c0b5990 0x7fcb2c0b6b00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009d90 tx=0x7fcb2402a660 comp rx=0 tx=0).stop 2024-04-25T08:55:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.060+0000 7fcb32730640 1 -- 172.21.15.55:0/974377699 shutdown_connections 2024-04-25T08:55:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.060+0000 7fcb32730640 1 --2- 172.21.15.55:0/974377699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb2c0d35b0 0x7fcb2c0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.060+0000 7fcb32730640 1 --2- 172.21.15.55:0/974377699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb2c0b5990 0x7fcb2c0b6b00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.060+0000 7fcb32730640 1 -- 172.21.15.55:0/974377699 >> 172.21.15.55:0/974377699 conn(0x7fcb2c072900 msgr2=0x7fcb2c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.060+0000 7fcb32730640 1 -- 172.21.15.55:0/974377699 shutdown_connections 2024-04-25T08:55:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.060+0000 7fcb32730640 1 -- 172.21.15.55:0/974377699 wait complete. 2024-04-25T08:55:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.061+0000 7fcb32730640 1 Processor -- start 2024-04-25T08:55:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.062+0000 7fcb32730640 1 -- start start 2024-04-25T08:55:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.062+0000 7fcb32730640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb2c0b5990 0x7fcb2c154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.062+0000 7fcb32730640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb2c0d35b0 0x7fcb2c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.062+0000 7fcb32730640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb2c15dce0 0x7fcb2c15fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.062+0000 7fcb32730640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c0d3090 con 0x7fcb2c0b5990 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.062+0000 7fcb32730640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c0d2db0 con 0x7fcb2c15dce0 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.062+0000 7fcb32730640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c0d2160 con 0x7fcb2c0d35b0 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.062+0000 7fcb2bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb2c0b5990 0x7fcb2c154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.062+0000 7fcb2bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb2c0b5990 0x7fcb2c154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51446/0 (socket says 172.21.15.55:51446) 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.062+0000 7fcb2bfff640 1 -- 172.21.15.55:0/793883726 learned_addr learned my addr 172.21.15.55:0/793883726 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb2bfff640 1 -- 172.21.15.55:0/793883726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb2c0d35b0 msgr2=0x7fcb2c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb2bfff640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb2c0d35b0 0x7fcb2c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb2bfff640 1 -- 172.21.15.55:0/793883726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb2c15dce0 msgr2=0x7fcb2c15fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb30ccd640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb2c15dce0 0x7fcb2c15fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb2bfff640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb2c15dce0 0x7fcb2c15fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb2bfff640 1 -- 172.21.15.55:0/793883726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c0cb210 con 0x7fcb2c0b5990 2024-04-25T08:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb30ccd640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb2c15dce0 0x7fcb2c15fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb2bfff640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb2c0b5990 0x7fcb2c154670 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00c460 tx=0x7fcb1c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb28ff9640 1 -- 172.21.15.55:0/793883726 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c018070 con 0x7fcb2c0b5990 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb28ff9640 1 -- 172.21.15.55:0/793883726 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c007500 con 0x7fcb2c0b5990 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb32730640 1 -- 172.21.15.55:0/793883726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c0cb4f0 con 0x7fcb2c0b5990 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb28ff9640 1 -- 172.21.15.55:0/793883726 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c004a20 con 0x7fcb2c0b5990 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.063+0000 7fcb32730640 1 -- 172.21.15.55:0/793883726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c0cbab0 con 0x7fcb2c0b5990 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.064+0000 7fcb32730640 1 -- 172.21.15.55:0/793883726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c0749b0 con 0x7fcb2c0b5990 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.065+0000 7fcb28ff9640 1 -- 172.21.15.55:0/793883726 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb1c01b070 con 0x7fcb2c0b5990 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.065+0000 7fcb28ff9640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb1806b500 0x7fcb1806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.065+0000 7fcb28ff9640 1 -- 172.21.15.55:0/793883726 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb1c0894f0 con 0x7fcb2c0b5990 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.065+0000 7fcb2b7fe640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb1806b500 0x7fcb1806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.066+0000 7fcb2b7fe640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb1806b500 0x7fcb1806d9c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcb20006f00 tx=0x7fcb20008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.069+0000 7fcb28ff9640 1 -- 172.21.15.55:0/793883726 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcb1c058370 con 0x7fcb2c0b5990 2024-04-25T08:55:01.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.286+0000 7fcb32730640 1 -- 172.21.15.55:0/793883726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb2c0b6c30 con 0x7fcb2c0b5990 2024-04-25T08:55:01.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.287+0000 7fcb28ff9640 1 -- 172.21.15.55:0/793883726 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fcb1c057c70 con 0x7fcb2c0b5990 2024-04-25T08:55:01.277 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:01.277 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2362450653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2362450653},{"type":"v1","addr":"172.21.15.167:6835","nonce":2362450653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3897225045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3897225045},{"type":"v1","addr":"172.21.15.167:6834","nonce":3897225045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2007115110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2007115110},{"type":"v1","addr":"172.21.15.55:6836","nonce":2007115110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:54:35.752157+0000","modified":"2024-04-25T08:54:37.749451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1495159001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1495159001},{"type":"v1","addr":"172.21.15.55:6837","nonce":1495159001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:55:01.277 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-25T08:55:01.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.288+0000 7fcb32730640 1 -- 172.21.15.55:0/793883726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb1806b500 msgr2=0x7fcb1806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.288+0000 7fcb32730640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb1806b500 0x7fcb1806d9c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcb20006f00 tx=0x7fcb20008040 comp rx=0 tx=0).stop 2024-04-25T08:55:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.288+0000 7fcb32730640 1 -- 172.21.15.55:0/793883726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb2c0b5990 msgr2=0x7fcb2c154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.288+0000 7fcb32730640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb2c0b5990 0x7fcb2c154670 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00c460 tx=0x7fcb1c00c920 comp rx=0 tx=0).stop 2024-04-25T08:55:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.288+0000 7fcb32730640 1 -- 172.21.15.55:0/793883726 shutdown_connections 2024-04-25T08:55:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.288+0000 7fcb32730640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb1806b500 0x7fcb1806d9c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.288+0000 7fcb32730640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb2c15dce0 0x7fcb2c15fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.288+0000 7fcb32730640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb2c0d35b0 0x7fcb2c0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.288+0000 7fcb32730640 1 --2- 172.21.15.55:0/793883726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb2c0b5990 0x7fcb2c154670 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.288+0000 7fcb32730640 1 -- 172.21.15.55:0/793883726 >> 172.21.15.55:0/793883726 conn(0x7fcb2c072900 msgr2=0x7fcb2c0ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.289+0000 7fcb32730640 1 -- 172.21.15.55:0/793883726 shutdown_connections 2024-04-25T08:55:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.289+0000 7fcb32730640 1 -- 172.21.15.55:0/793883726 wait complete. 2024-04-25T08:55:01.289 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:55:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.400+0000 7f2807858640 1 Processor -- start 2024-04-25T08:55:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.400+0000 7f2807858640 1 -- start start 2024-04-25T08:55:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.401+0000 7f2807858640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f280015dd50 0x7f28000d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.401+0000 7f2807858640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28000d2440 con 0x7f28000b9460 2024-04-25T08:55:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.401+0000 7f2807858640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28000d2720 con 0x7f28000ceeb0 2024-04-25T08:55:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.401+0000 7f2807858640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28000d2a00 con 0x7f280015dd50 2024-04-25T08:55:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.401+0000 7f2804df3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f28000b9460 0x7f28000ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48362/0 (socket says 172.21.15.55:48362) 2024-04-25T08:55:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.401+0000 7f2804df3640 1 -- 172.21.15.55:0/1505920768 learned_addr learned my addr 172.21.15.55:0/1505920768 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f28055f4640 1 --2- 172.21.15.55:0/1505920768 >> v2:172.21.15.167:3300/0 conn(0x7f280015dd50 0x7f28000d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273040953 0 0) 0x7f28000d2440 con 0x7f28000b9460 2024-04-25T08:55:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ec003520 con 0x7f28000b9460 2024-04-25T08:55:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 414047697 0 0) 0x7f27ec003520 con 0x7f28000b9460 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 >> v2:172.21.15.167:3300/0 conn(0x7f280015dd50 msgr2=0x7f28000d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 --2- 172.21.15.55:0/1505920768 >> v2:172.21.15.167:3300/0 conn(0x7f280015dd50 0x7f28000d1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 >> v1:172.21.15.167:6789/0 conn(0x7f28000ceeb0 legacy=0x7f28000b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000d2ce0 con 0x7f28000b9460 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f27f0001670 con 0x7f28000b9460 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 >> v1:172.21.15.55:6789/0 conn(0x7f28000b9460 legacy=0x7f28000ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27ec0039b0 0x7f27ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27ec0043b0 0x7f27ec004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27ec005120 0x7f27ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000d2a00 con 0x7f27ec005120 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec00c060 con 0x7f27ec0039b0 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec00c260 con 0x7f27ec0043b0 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f2805df5640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27ec005120 0x7f27ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f28055f4640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27ec0039b0 0x7f27ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.402+0000 7f2804df3640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27ec0043b0 0x7f27ec004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.403+0000 7f28055f4640 1 -- 172.21.15.55:0/1505920768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27ec0043b0 msgr2=0x7f27ec004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.403+0000 7f28055f4640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27ec0043b0 0x7f27ec004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.403+0000 7f28055f4640 1 -- 172.21.15.55:0/1505920768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27ec005120 msgr2=0x7f27ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.403+0000 7f28055f4640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27ec005120 0x7f27ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.403+0000 7f28055f4640 1 -- 172.21.15.55:0/1505920768 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec003520 con 0x7f27ec0039b0 2024-04-25T08:55:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.403+0000 7f2805df5640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27ec005120 0x7f27ec00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:55:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.403+0000 7f2805df5640 1 -- 172.21.15.55:0/1505920768 reap_dead start 2024-04-25T08:55:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.403+0000 7f28055f4640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27ec0039b0 0x7f27ec003d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009fc0 tx=0x7f27ec005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22718eff9100bafc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.404+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc009c10 con 0x7f27ec0039b0 2024-04-25T08:55:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.404+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc036070 con 0x7f27ec0039b0 2024-04-25T08:55:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.404+0000 7f27f7fff640 1 -- 172.21.15.55:0/1505920768 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc031880 con 0x7f27ec0039b0 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.404+0000 7f2807858640 1 -- 172.21.15.55:0/1505920768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27ec0039b0 msgr2=0x7f27ec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.404+0000 7f2807858640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27ec0039b0 0x7f27ec003d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009fc0 tx=0x7f27ec005830 comp rx=0 tx=0).stop 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.404+0000 7f2807858640 1 -- 172.21.15.55:0/1505920768 shutdown_connections 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.404+0000 7f2807858640 1 --2- 172.21.15.55:0/1505920768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27ec0039b0 0x7f27ec003d90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.404+0000 7f2807858640 1 -- 172.21.15.55:0/1505920768 >> 172.21.15.55:0/1505920768 conn(0x7f28000722d0 msgr2=0x7f28000726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.404+0000 7f2807858640 1 -- 172.21.15.55:0/1505920768 shutdown_connections 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.404+0000 7f2807858640 1 -- 172.21.15.55:0/1505920768 wait complete. 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.405+0000 7f2807858640 1 Processor -- start 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.405+0000 7f2807858640 1 -- start start 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.406+0000 7f2807858640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27ec0039b0 0x7f28000b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.406+0000 7f2807858640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f280014af50 0x7f28000b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.406+0000 7f2807858640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f280015f990 0x7f280015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.406+0000 7f2807858640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000d3660 con 0x7f280015f990 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.406+0000 7f2807858640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000d34e0 con 0x7f280014af50 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.406+0000 7f2807858640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28000d37e0 con 0x7f27ec0039b0 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.406+0000 7f2805df5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f280015f990 0x7f280015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.406+0000 7f2805df5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f280015f990 0x7f280015fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51476/0 (socket says 172.21.15.55:51476) 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.406+0000 7f2805df5640 1 -- 172.21.15.55:0/3850810430 learned_addr learned my addr 172.21.15.55:0/3850810430 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.406+0000 7f2804df3640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f280014af50 0x7f28000b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.406+0000 7f28055f4640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27ec0039b0 0x7f28000b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.407+0000 7f2805df5640 1 -- 172.21.15.55:0/3850810430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27ec0039b0 msgr2=0x7f28000b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.407+0000 7f2805df5640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27ec0039b0 0x7f28000b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.407+0000 7f2805df5640 1 -- 172.21.15.55:0/3850810430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f280014af50 msgr2=0x7f28000b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.407+0000 7f2805df5640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f280014af50 0x7f28000b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.407+0000 7f2805df5640 1 -- 172.21.15.55:0/3850810430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280015e2d0 con 0x7f280015f990 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.407+0000 7f2805df5640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f280015f990 0x7f280015fe10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f27f800f770 tx=0x7f27f800fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.407+0000 7f27f5ffb640 1 -- 172.21.15.55:0/3850810430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8001430 con 0x7f280015f990 2024-04-25T08:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.407+0000 7f27f5ffb640 1 -- 172.21.15.55:0/3850810430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f80050d0 con 0x7f280015f990 2024-04-25T08:55:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.407+0000 7f2807858640 1 -- 172.21.15.55:0/3850810430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280015e5b0 con 0x7f280015f990 2024-04-25T08:55:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.407+0000 7f27f5ffb640 1 -- 172.21.15.55:0/3850810430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f80052a0 con 0x7f280015f990 2024-04-25T08:55:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.407+0000 7f2807858640 1 -- 172.21.15.55:0/3850810430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280015eb70 con 0x7f280015f990 2024-04-25T08:55:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.408+0000 7f2807858640 1 -- 172.21.15.55:0/3850810430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28000749b0 con 0x7f280015f990 2024-04-25T08:55:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.409+0000 7f27f5ffb640 1 -- 172.21.15.55:0/3850810430 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f27f801b020 con 0x7f280015f990 2024-04-25T08:55:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.409+0000 7f27f5ffb640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f27e406b4d0 0x7f27e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.409+0000 7f28055f4640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f27e406b4d0 0x7f27e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.409+0000 7f27f5ffb640 1 -- 172.21.15.55:0/3850810430 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27f80897a0 con 0x7f280015f990 2024-04-25T08:55:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.410+0000 7f28055f4640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f27e406b4d0 0x7f27e406d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f27fc035000 tx=0x7f27fc02f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.414+0000 7f27f5ffb640 1 -- 172.21.15.55:0/3850810430 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f27f8057fc0 con 0x7f280015f990 2024-04-25T08:55:01.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.596+0000 7f2807858640 1 -- 172.21.15.55:0/3850810430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f280015ad70 con 0x7f280015f990 2024-04-25T08:55:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.597+0000 7f27f5ffb640 1 -- 172.21.15.55:0/3850810430 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f27f805c060 con 0x7f280015f990 2024-04-25T08:55:01.587 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:01.587 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":36,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:54:37.381878+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:54:34.023960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:54:34.730867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:55:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 -- 172.21.15.55:0/3850810430 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f27e406b4d0 msgr2=0x7f27e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f27e406b4d0 0x7f27e406d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f27fc035000 tx=0x7f27fc02f000 comp rx=0 tx=0).stop 2024-04-25T08:55:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 -- 172.21.15.55:0/3850810430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f280015f990 msgr2=0x7f280015fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f280015f990 0x7f280015fe10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f27f800f770 tx=0x7f27f800fb70 comp rx=0 tx=0).stop 2024-04-25T08:55:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 -- 172.21.15.55:0/3850810430 shutdown_connections 2024-04-25T08:55:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f27e406b4d0 0x7f27e406d990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f280015f990 0x7f280015fe10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f280014af50 0x7f28000b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 --2- 172.21.15.55:0/3850810430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27ec0039b0 0x7f28000b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 -- 172.21.15.55:0/3850810430 >> 172.21.15.55:0/3850810430 conn(0x7f28000722d0 msgr2=0x7f280015b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:01.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 -- 172.21.15.55:0/3850810430 shutdown_connections 2024-04-25T08:55:01.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.599+0000 7f2807858640 1 -- 172.21.15.55:0/3850810430 wait complete. 2024-04-25T08:55:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:54:34.023960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:54:34.730867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:55:01.600 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:55:01.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.715+0000 7fca7306b640 1 Processor -- start 2024-04-25T08:55:01.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.715+0000 7fca7306b640 1 -- start start 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca7306b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fca6c15dc80 0x7fca6c161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca7306b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca6c0b5c00 0x7fca6c0d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca7306b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c1627a0 con 0x7fca6c0b97c0 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca7306b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c1621e0 con 0x7fca6c0b5c00 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca7306b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c1624c0 con 0x7fca6c15dc80 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca71608640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca6c0b5c00 0x7fca6c0d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca6bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fca6c0b97c0 0x7fca6c0b54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48376/0 (socket says 172.21.15.55:48376) 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca71608640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca6c0b5c00 0x7fca6c0d2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51484/0 (socket says 172.21.15.55:51484) 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca6bfff640 1 -- 172.21.15.55:0/1487692689 learned_addr learned my addr 172.21.15.55:0/1487692689 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca71608640 1 -- 172.21.15.55:0/1487692689 >> v2:172.21.15.167:3300/0 conn(0x7fca6c15dc80 msgr2=0x7fca6c161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca70e07640 1 --2- 172.21.15.55:0/1487692689 >> v2:172.21.15.167:3300/0 conn(0x7fca6c15dc80 0x7fca6c161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca6b7fe640 1 -- 172.21.15.55:0/1487692689 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317209223 0 0) 0x7fca6c1627a0 con 0x7fca6c0b97c0 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca71608640 1 --2- 172.21.15.55:0/1487692689 >> v2:172.21.15.167:3300/0 conn(0x7fca6c15dc80 0x7fca6c161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca71608640 1 -- 172.21.15.55:0/1487692689 >> v1:172.21.15.55:6789/0 conn(0x7fca6c0b97c0 legacy=0x7fca6c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca71608640 1 -- 172.21.15.55:0/1487692689 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c0d1c70 con 0x7fca6c0b5c00 2024-04-25T08:55:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.716+0000 7fca70e07640 1 --2- 172.21.15.55:0/1487692689 >> v2:172.21.15.167:3300/0 conn(0x7fca6c15dc80 0x7fca6c161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.717+0000 7fca71608640 1 --2- 172.21.15.55:0/1487692689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6c0b5c00 0x7fca6c0d2470 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06dab0 tx=0x7fca6402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e713601a35cad4ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.717+0000 7fca6b7fe640 1 -- 172.21.15.55:0/1487692689 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64007740 con 0x7fca6c0b5c00 2024-04-25T08:55:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.717+0000 7fca6b7fe640 1 -- 172.21.15.55:0/1487692689 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca640078e0 con 0x7fca6c0b5c00 2024-04-25T08:55:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.717+0000 7fca6b7fe640 1 -- 172.21.15.55:0/1487692689 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64007cb0 con 0x7fca6c0b5c00 2024-04-25T08:55:01.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.717+0000 7fca7306b640 1 -- 172.21.15.55:0/1487692689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6c0b5c00 msgr2=0x7fca6c0d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.717+0000 7fca7306b640 1 --2- 172.21.15.55:0/1487692689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6c0b5c00 0x7fca6c0d2470 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06dab0 tx=0x7fca6402a680 comp rx=0 tx=0).stop 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.718+0000 7fca7306b640 1 -- 172.21.15.55:0/1487692689 shutdown_connections 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.718+0000 7fca7306b640 1 --2- 172.21.15.55:0/1487692689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6c0b5c00 0x7fca6c0d2470 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.718+0000 7fca7306b640 1 --2- 172.21.15.55:0/1487692689 >> v2:172.21.15.167:3300/0 conn(0x7fca6c15dc80 0x7fca6c161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.718+0000 7fca7306b640 1 -- 172.21.15.55:0/1487692689 >> 172.21.15.55:0/1487692689 conn(0x7fca6c0d04f0 msgr2=0x7fca6c0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.718+0000 7fca7306b640 1 -- 172.21.15.55:0/1487692689 shutdown_connections 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.718+0000 7fca7306b640 1 -- 172.21.15.55:0/1487692689 wait complete. 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.719+0000 7fca7306b640 1 Processor -- start 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.719+0000 7fca7306b640 1 -- start start 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca7306b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6c0b5c00 0x7fca6c0c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca7306b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c0b97c0 0x7fca6c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca7306b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca6c15dc80 0x7fca6c0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca7306b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c161f30 con 0x7fca6c0b5c00 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca7306b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c161db0 con 0x7fca6c0b97c0 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca7306b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c0d29b0 con 0x7fca6c15dc80 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca70e07640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6c0b5c00 0x7fca6c0c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca70e07640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6c0b5c00 0x7fca6c0c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51488/0 (socket says 172.21.15.55:51488) 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca70e07640 1 -- 172.21.15.55:0/1763113623 learned_addr learned my addr 172.21.15.55:0/1763113623 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca6bfff640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c0b97c0 0x7fca6c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca71608640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca6c15dc80 0x7fca6c0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca70e07640 1 -- 172.21.15.55:0/1763113623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca6c15dc80 msgr2=0x7fca6c0c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca70e07640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca6c15dc80 0x7fca6c0c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca70e07640 1 -- 172.21.15.55:0/1763113623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c0b97c0 msgr2=0x7fca6c0c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca70e07640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c0b97c0 0x7fca6c0c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca70e07640 1 -- 172.21.15.55:0/1763113623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c15ee90 con 0x7fca6c0b5c00 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca70e07640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6c0b5c00 0x7fca6c0c85f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c7f0 tx=0x7fca6000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca697fa640 1 -- 172.21.15.55:0/1763113623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60015070 con 0x7fca6c0b5c00 2024-04-25T08:55:01.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca697fa640 1 -- 172.21.15.55:0/1763113623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca60007820 con 0x7fca6c0b5c00 2024-04-25T08:55:01.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca7306b640 1 -- 172.21.15.55:0/1763113623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c15f170 con 0x7fca6c0b5c00 2024-04-25T08:55:01.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca697fa640 1 -- 172.21.15.55:0/1763113623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60007bd0 con 0x7fca6c0b5c00 2024-04-25T08:55:01.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.720+0000 7fca7306b640 1 -- 172.21.15.55:0/1763113623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c15f730 con 0x7fca6c0b5c00 2024-04-25T08:55:01.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.721+0000 7fca7306b640 1 -- 172.21.15.55:0/1763113623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c0750b0 con 0x7fca6c0b5c00 2024-04-25T08:55:01.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.722+0000 7fca697fa640 1 -- 172.21.15.55:0/1763113623 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca60018070 con 0x7fca6c0b5c00 2024-04-25T08:55:01.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.722+0000 7fca697fa640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca5006b4d0 0x7fca5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:01.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.722+0000 7fca697fa640 1 -- 172.21.15.55:0/1763113623 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca6008a0c0 con 0x7fca6c0b5c00 2024-04-25T08:55:01.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.722+0000 7fca6bfff640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca5006b4d0 0x7fca5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:01.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.723+0000 7fca6bfff640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca5006b4d0 0x7fca5006d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fca6c1f6b90 tx=0x7fca58007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:01.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.726+0000 7fca697fa640 1 -- 172.21.15.55:0/1763113623 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca60058f40 con 0x7fca6c0b5c00 2024-04-25T08:55:01.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.905+0000 7fca7306b640 1 -- 172.21.15.55:0/1763113623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca6c15a8a0 con 0x7fca6c0b5c00 2024-04-25T08:55:01.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.905+0000 7fca697fa640 1 -- 172.21.15.55:0/1763113623 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca60058840 con 0x7fca6c0b5c00 2024-04-25T08:55:01.895 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:55:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 -- 172.21.15.55:0/1763113623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca5006b4d0 msgr2=0x7fca5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca5006b4d0 0x7fca5006d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fca6c1f6b90 tx=0x7fca58007b50 comp rx=0 tx=0).stop 2024-04-25T08:55:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 -- 172.21.15.55:0/1763113623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6c0b5c00 msgr2=0x7fca6c0c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6c0b5c00 0x7fca6c0c85f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c7f0 tx=0x7fca6000ccb0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 -- 172.21.15.55:0/1763113623 shutdown_connections 2024-04-25T08:55:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca5006b4d0 0x7fca5006d990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca6c15dc80 0x7fca6c0c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca6c0b97c0 0x7fca6c0c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 --2- 172.21.15.55:0/1763113623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6c0b5c00 0x7fca6c0c85f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:01.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 -- 172.21.15.55:0/1763113623 >> 172.21.15.55:0/1763113623 conn(0x7fca6c0d04f0 msgr2=0x7fca6c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:01.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 -- 172.21.15.55:0/1763113623 shutdown_connections 2024-04-25T08:55:01.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:01.907+0000 7fca7306b640 1 -- 172.21.15.55:0/1763113623 wait complete. 2024-04-25T08:55:01.908 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:55:02.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.022+0000 7f4659d9d640 1 Processor -- start 2024-04-25T08:55:02.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.022+0000 7f4659d9d640 1 -- start start 2024-04-25T08:55:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.023+0000 7f4659d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f465415dca0 0x7f46540ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.023+0000 7f4659d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540d3b90 0x7f46540d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.023+0000 7f4659d9d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46540d4090 con 0x7f46540cee80 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.023+0000 7f4659d9d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46540b6b20 con 0x7f465415dca0 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.023+0000 7f4659d9d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540d4370 con 0x7f46540d3b90 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.023+0000 7f4652ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540d3b90 0x7f46540d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.024+0000 7f4652ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540d3b90 0x7f46540d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:41178/0 (socket says 172.21.15.55:41178) 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.024+0000 7f4652ffd640 1 -- 172.21.15.55:0/2057265632 learned_addr learned my addr 172.21.15.55:0/2057265632 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.024+0000 7f46537fe640 1 --2- 172.21.15.55:0/2057265632 >> v2:172.21.15.167:3300/0 conn(0x7f465415dca0 0x7f46540ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.024+0000 7f4652ffd640 1 -- 172.21.15.55:0/2057265632 >> v2:172.21.15.167:3300/0 conn(0x7f465415dca0 msgr2=0x7f46540ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.024+0000 7f4652ffd640 1 --2- 172.21.15.55:0/2057265632 >> v2:172.21.15.167:3300/0 conn(0x7f465415dca0 0x7f46540ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.024+0000 7f4652ffd640 1 -- 172.21.15.55:0/2057265632 >> v1:172.21.15.167:6789/0 conn(0x7f46540cee80 legacy=0x7f46540b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.024+0000 7f4652ffd640 1 -- 172.21.15.55:0/2057265632 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540d4650 con 0x7f46540d3b90 2024-04-25T08:55:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.025+0000 7f4652ffd640 1 --2- 172.21.15.55:0/2057265632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540d3b90 0x7f46540d0a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4648009870 tx=0x7f464802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4561242cc3994d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.025+0000 7f46527fc640 1 -- 172.21.15.55:0/2057265632 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648037070 con 0x7f46540d3b90 2024-04-25T08:55:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.025+0000 7f46527fc640 1 -- 172.21.15.55:0/2057265632 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4648032440 con 0x7f46540d3b90 2024-04-25T08:55:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.025+0000 7f46527fc640 1 -- 172.21.15.55:0/2057265632 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648032810 con 0x7f46540d3b90 2024-04-25T08:55:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.025+0000 7f4659d9d640 1 -- 172.21.15.55:0/2057265632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540d3b90 msgr2=0x7f46540d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.025+0000 7f4659d9d640 1 --2- 172.21.15.55:0/2057265632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540d3b90 0x7f46540d0a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4648009870 tx=0x7f464802a270 comp rx=0 tx=0).stop 2024-04-25T08:55:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.025+0000 7f4659d9d640 1 -- 172.21.15.55:0/2057265632 shutdown_connections 2024-04-25T08:55:02.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.025+0000 7f4659d9d640 1 --2- 172.21.15.55:0/2057265632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540d3b90 0x7f46540d0a20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.025+0000 7f4659d9d640 1 --2- 172.21.15.55:0/2057265632 >> v2:172.21.15.167:3300/0 conn(0x7f465415dca0 0x7f46540ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.025+0000 7f4659d9d640 1 -- 172.21.15.55:0/2057265632 >> 172.21.15.55:0/2057265632 conn(0x7f46540726c0 msgr2=0x7f4654072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:02.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.025+0000 7f4659d9d640 1 -- 172.21.15.55:0/2057265632 shutdown_connections 2024-04-25T08:55:02.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.026+0000 7f4659d9d640 1 -- 172.21.15.55:0/2057265632 wait complete. 2024-04-25T08:55:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.027+0000 7f4659d9d640 1 Processor -- start 2024-04-25T08:55:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.027+0000 7f4659d9d640 1 -- start start 2024-04-25T08:55:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4659d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540cee80 0x7f465415e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4659d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46540d3b90 0x7f46540ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4659d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f465415dca0 0x7f46541562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4659d9d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465415e200 con 0x7f46540d3b90 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4659d9d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465415e080 con 0x7f465415dca0 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4659d9d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540d0f60 con 0x7f46540cee80 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4652ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46540d3b90 0x7f46540ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4652ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46540d3b90 0x7f46540ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51494/0 (socket says 172.21.15.55:51494) 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4652ffd640 1 -- 172.21.15.55:0/947711798 learned_addr learned my addr 172.21.15.55:0/947711798 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f46537fe640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540cee80 0x7f465415e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4653fff640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f465415dca0 0x7f46541562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4652ffd640 1 -- 172.21.15.55:0/947711798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540cee80 msgr2=0x7f465415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4652ffd640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540cee80 0x7f465415e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4652ffd640 1 -- 172.21.15.55:0/947711798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f465415dca0 msgr2=0x7f46541562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4652ffd640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f465415dca0 0x7f46541562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4652ffd640 1 -- 172.21.15.55:0/947711798 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4654155230 con 0x7f46540d3b90 2024-04-25T08:55:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4652ffd640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46540d3b90 0x7f46540ca1f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f464802a2b0 tx=0x7f46480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f463bfff640 1 -- 172.21.15.55:0/947711798 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648037040 con 0x7f46540d3b90 2024-04-25T08:55:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f463bfff640 1 -- 172.21.15.55:0/947711798 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4648042070 con 0x7f46540d3b90 2024-04-25T08:55:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f4659d9d640 1 -- 172.21.15.55:0/947711798 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4654155510 con 0x7f46540d3b90 2024-04-25T08:55:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.028+0000 7f463bfff640 1 -- 172.21.15.55:0/947711798 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648030880 con 0x7f46540d3b90 2024-04-25T08:55:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.029+0000 7f4659d9d640 1 -- 172.21.15.55:0/947711798 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4654155ad0 con 0x7f46540d3b90 2024-04-25T08:55:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.030+0000 7f4659d9d640 1 -- 172.21.15.55:0/947711798 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46540750b0 con 0x7f46540d3b90 2024-04-25T08:55:02.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.030+0000 7f463bfff640 1 -- 172.21.15.55:0/947711798 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4648030a20 con 0x7f46540d3b90 2024-04-25T08:55:02.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.030+0000 7f463bfff640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f464006b4d0 0x7f464006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.031+0000 7f46537fe640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f464006b4d0 0x7f464006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.031+0000 7f463bfff640 1 -- 172.21.15.55:0/947711798 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46480aa8f0 con 0x7f46540d3b90 2024-04-25T08:55:02.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.031+0000 7f46537fe640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f464006b4d0 0x7f464006d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4644009aa0 tx=0x7f4644009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.035+0000 7f463bfff640 1 -- 172.21.15.55:0/947711798 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4648079120 con 0x7f46540d3b90 2024-04-25T08:55:02.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.213+0000 7f4659d9d640 1 -- 172.21.15.55:0/947711798 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46540b3690 con 0x7f46540d3b90 2024-04-25T08:55:02.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.214+0000 7f463bfff640 1 -- 172.21.15.55:0/947711798 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f464807d1c0 con 0x7f46540d3b90 2024-04-25T08:55:02.204 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:55:02.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.215+0000 7f4659d9d640 1 -- 172.21.15.55:0/947711798 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f464006b4d0 msgr2=0x7f464006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.215+0000 7f4659d9d640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f464006b4d0 0x7f464006d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4644009aa0 tx=0x7f4644009190 comp rx=0 tx=0).stop 2024-04-25T08:55:02.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.215+0000 7f4659d9d640 1 -- 172.21.15.55:0/947711798 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46540d3b90 msgr2=0x7f46540ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.215+0000 7f4659d9d640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46540d3b90 0x7f46540ca1f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f464802a2b0 tx=0x7f46480046c0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.216+0000 7f4659d9d640 1 -- 172.21.15.55:0/947711798 shutdown_connections 2024-04-25T08:55:02.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.216+0000 7f4659d9d640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f464006b4d0 0x7f464006d990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.216+0000 7f4659d9d640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f465415dca0 0x7f46541562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.216+0000 7f4659d9d640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46540d3b90 0x7f46540ca1f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.216+0000 7f4659d9d640 1 --2- 172.21.15.55:0/947711798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46540cee80 0x7f465415e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.216+0000 7f4659d9d640 1 -- 172.21.15.55:0/947711798 >> 172.21.15.55:0/947711798 conn(0x7f46540726c0 msgr2=0x7f46540d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:02.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.216+0000 7f4659d9d640 1 -- 172.21.15.55:0/947711798 shutdown_connections 2024-04-25T08:55:02.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.216+0000 7f4659d9d640 1 -- 172.21.15.55:0/947711798 wait complete. 2024-04-25T08:55:02.216 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:55:02.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.330+0000 7f3b3408f640 1 Processor -- start 2024-04-25T08:55:02.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.331+0000 7f3b3408f640 1 -- start start 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.331+0000 7f3b3408f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c0b97c0 0x7f3b2c0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.331+0000 7f3b3408f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b2c0b5a30 0x7f3b2c0d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.331+0000 7f3b3408f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c1627a0 con 0x7f3b2c15dc80 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.331+0000 7f3b3408f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c0b5ea0 con 0x7f3b2c0b5a30 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.331+0000 7f3b3408f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c161f80 con 0x7f3b2c0b97c0 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.331+0000 7f3b31e2b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3b2c15dc80 0x7f3b2c161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48380/0 (socket says 172.21.15.55:48380) 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.331+0000 7f3b31e2b640 1 -- 172.21.15.55:0/799490922 learned_addr learned my addr 172.21.15.55:0/799490922 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b3162a640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c0b97c0 0x7f3b2c0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409868180 0 0) 0x7f3b2c1627a0 con 0x7f3b2c15dc80 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b3262c640 1 --2- 172.21.15.55:0/799490922 >> v2:172.21.15.167:3300/0 conn(0x7f3b2c0b5a30 0x7f3b2c0d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b14003520 con 0x7f3b2c15dc80 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 31922819 0 0) 0x7f3b14003520 con 0x7f3b2c15dc80 2024-04-25T08:55:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c0b97c0 msgr2=0x7f3b2c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c0b97c0 0x7f3b2c0b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 >> v2:172.21.15.167:3300/0 conn(0x7f3b2c0b5a30 msgr2=0x7f3b2c0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 --2- 172.21.15.55:0/799490922 >> v2:172.21.15.167:3300/0 conn(0x7f3b2c0b5a30 0x7f3b2c0d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c1621e0 con 0x7f3b2c15dc80 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f3b24001670 con 0x7f3b2c15dc80 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 >> v1:172.21.15.55:6789/0 conn(0x7f3b2c15dc80 legacy=0x7f3b2c161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b140039e0 0x7f3b14003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c0b97c0 0x7f3b14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b14004d40 0x7f3b140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0b5ea0 con 0x7f3b14004d40 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c161f80 con 0x7f3b140039e0 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1400b9c0 con 0x7f3b2c0b97c0 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b3262c640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b14004d40 0x7f3b140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b3162a640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c0b97c0 0x7f3b14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b31e2b640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b140039e0 0x7f3b14003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b3262c640 1 -- 172.21.15.55:0/799490922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c0b97c0 msgr2=0x7f3b14004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b3262c640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c0b97c0 0x7f3b14004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b3262c640 1 -- 172.21.15.55:0/799490922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b140039e0 msgr2=0x7f3b14003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b3262c640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b140039e0 0x7f3b14003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.332+0000 7f3b3262c640 1 -- 172.21.15.55:0/799490922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14003520 con 0x7f3b14004d40 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.333+0000 7f3b3262c640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b14004d40 0x7f3b140051c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e170 tx=0x7f3b14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ebe8e83a620bdc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.333+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c034020 con 0x7f3b14004d40 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.333+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c030430 con 0x7f3b14004d40 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.333+0000 7f3b30e29640 1 -- 172.21.15.55:0/799490922 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c009c10 con 0x7f3b14004d40 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.334+0000 7f3b3408f640 1 -- 172.21.15.55:0/799490922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b14004d40 msgr2=0x7f3b140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.334+0000 7f3b3408f640 1 --2- 172.21.15.55:0/799490922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b14004d40 0x7f3b140051c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e170 tx=0x7f3b14005830 comp rx=0 tx=0).stop 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.334+0000 7f3b3262c640 1 -- 172.21.15.55:0/799490922 reap_dead start 2024-04-25T08:55:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.334+0000 7f3b3408f640 1 -- 172.21.15.55:0/799490922 shutdown_connections 2024-04-25T08:55:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.334+0000 7f3b3408f640 1 -- 172.21.15.55:0/799490922 >> 172.21.15.55:0/799490922 conn(0x7f3b2c0d04f0 msgr2=0x7f3b2c0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.334+0000 7f3b3408f640 1 -- 172.21.15.55:0/799490922 shutdown_connections 2024-04-25T08:55:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.334+0000 7f3b3408f640 1 -- 172.21.15.55:0/799490922 wait complete. 2024-04-25T08:55:02.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.335+0000 7f3b3408f640 1 Processor -- start 2024-04-25T08:55:02.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.335+0000 7f3b3408f640 1 -- start start 2024-04-25T08:55:02.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b3408f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b2c1f0d70 0x7f3b2c15ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b3408f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c0c8b90 0x7f3b2c0c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b3408f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c1f3700 0x7f3b2c1f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b3408f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c15e060 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b3408f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0d1c70 con 0x7f3b2c0c8b90 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b3408f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0b54f0 con 0x7f3b2c1f3700 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b31e2b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b2c1f0d70 0x7f3b2c15ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b31e2b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b2c1f0d70 0x7f3b2c15ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51500/0 (socket says 172.21.15.55:51500) 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b31e2b640 1 -- 172.21.15.55:0/840324828 learned_addr learned my addr 172.21.15.55:0/840324828 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b3262c640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c1f3700 0x7f3b2c1f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b3162a640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c0c8b90 0x7f3b2c0c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b31e2b640 1 -- 172.21.15.55:0/840324828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c1f3700 msgr2=0x7f3b2c1f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b31e2b640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c1f3700 0x7f3b2c1f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b31e2b640 1 -- 172.21.15.55:0/840324828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c0c8b90 msgr2=0x7f3b2c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b31e2b640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c0c8b90 0x7f3b2c0c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.336+0000 7f3b31e2b640 1 -- 172.21.15.55:0/840324828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c1f40c0 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.337+0000 7f3b31e2b640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b2c1f0d70 0x7f3b2c15ecc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3b24007290 tx=0x7f3b24007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.337+0000 7f3b2a7fc640 1 -- 172.21.15.55:0/840324828 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400f8e0 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.337+0000 7f3b2a7fc640 1 -- 172.21.15.55:0/840324828 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24018070 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.337+0000 7f3b3408f640 1 -- 172.21.15.55:0/840324828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c0ca300 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.337+0000 7f3b2a7fc640 1 -- 172.21.15.55:0/840324828 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400fc80 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.337+0000 7f3b3408f640 1 -- 172.21.15.55:0/840324828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c1f4640 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.338+0000 7f3b3408f640 1 -- 172.21.15.55:0/840324828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c0750b0 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.338+0000 7f3b2a7fc640 1 -- 172.21.15.55:0/840324828 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b2401d460 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.339+0000 7f3b2a7fc640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b1806b4d0 0x7f3b1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.339+0000 7f3b2a7fc640 1 -- 172.21.15.55:0/840324828 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b2408a1b0 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.339+0000 7f3b3162a640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b1806b4d0 0x7f3b1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.339+0000 7f3b3162a640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b1806b4d0 0x7f3b1806d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0d3920 tx=0x7f3b20009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.343+0000 7f3b2a7fc640 1 -- 172.21.15.55:0/840324828 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b24059030 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.523+0000 7f3b3408f640 1 -- 172.21.15.55:0/840324828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b2c15a910 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.523+0000 7f3b2a7fc640 1 -- 172.21.15.55:0/840324828 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b24058930 con 0x7f3b2c1f0d70 2024-04-25T08:55:02.514 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:55:02.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 -- 172.21.15.55:0/840324828 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b1806b4d0 msgr2=0x7f3b1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b1806b4d0 0x7f3b1806d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0d3920 tx=0x7f3b20009190 comp rx=0 tx=0).stop 2024-04-25T08:55:02.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 -- 172.21.15.55:0/840324828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b2c1f0d70 msgr2=0x7f3b2c15ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b2c1f0d70 0x7f3b2c15ecc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3b24007290 tx=0x7f3b24007690 comp rx=0 tx=0).stop 2024-04-25T08:55:02.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 -- 172.21.15.55:0/840324828 shutdown_connections 2024-04-25T08:55:02.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b1806b4d0 0x7f3b1806d990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b2c1f3700 0x7f3b2c1f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c0c8b90 0x7f3b2c0c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 --2- 172.21.15.55:0/840324828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b2c1f0d70 0x7f3b2c15ecc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 -- 172.21.15.55:0/840324828 >> 172.21.15.55:0/840324828 conn(0x7f3b2c0d04f0 msgr2=0x7f3b2c0ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:02.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 -- 172.21.15.55:0/840324828 shutdown_connections 2024-04-25T08:55:02.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.525+0000 7f3b3408f640 1 -- 172.21.15.55:0/840324828 wait complete. 2024-04-25T08:55:02.526 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:55:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.638+0000 7ff361a4a640 1 Processor -- start 2024-04-25T08:55:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.638+0000 7ff361a4a640 1 -- start start 2024-04-25T08:55:02.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.639+0000 7ff361a4a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff35c15df40 0x7ff35c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.639+0000 7ff361a4a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c0b19c0 0x7ff35c0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.639+0000 7ff361a4a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c0cd930 con 0x7ff35c0cfe80 2024-04-25T08:55:02.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.639+0000 7ff361a4a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c0cc5b0 con 0x7ff35c15df40 2024-04-25T08:55:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.639+0000 7ff361a4a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0cdc10 con 0x7ff35c0b19c0 2024-04-25T08:55:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.639+0000 7ff35b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff35c0cfe80 0x7ff35c06aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48388/0 (socket says 172.21.15.55:48388) 2024-04-25T08:55:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.639+0000 7ff35b7fe640 1 -- 172.21.15.55:0/1573485165 learned_addr learned my addr 172.21.15.55:0/1573485165 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.639+0000 7ff35affd640 1 --2- 172.21.15.55:0/1573485165 >> v2:172.21.15.167:3300/0 conn(0x7ff35c15df40 0x7ff35c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.639+0000 7ff35a7fc640 1 --2- 172.21.15.55:0/1573485165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c0b19c0 0x7ff35c0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.639+0000 7ff359ffb640 1 -- 172.21.15.55:0/1573485165 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440616451 0 0) 0x7ff35c0cd930 con 0x7ff35c0cfe80 2024-04-25T08:55:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.639+0000 7ff359ffb640 1 -- 172.21.15.55:0/1573485165 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff344003520 con 0x7ff35c0cfe80 2024-04-25T08:55:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.640+0000 7ff35a7fc640 1 -- 172.21.15.55:0/1573485165 >> v2:172.21.15.167:3300/0 conn(0x7ff35c15df40 msgr2=0x7ff35c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.640+0000 7ff35a7fc640 1 --2- 172.21.15.55:0/1573485165 >> v2:172.21.15.167:3300/0 conn(0x7ff35c15df40 0x7ff35c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.640+0000 7ff35a7fc640 1 -- 172.21.15.55:0/1573485165 >> v1:172.21.15.55:6789/0 conn(0x7ff35c0cfe80 legacy=0x7ff35c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.640+0000 7ff35a7fc640 1 -- 172.21.15.55:0/1573485165 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c0cdef0 con 0x7ff35c0b19c0 2024-04-25T08:55:02.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.640+0000 7ff35a7fc640 1 --2- 172.21.15.55:0/1573485165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c0b19c0 0x7ff35c0cf940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3500097a0 tx=0x7ff35002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=920ad44dc1caff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.641+0000 7ff359ffb640 1 -- 172.21.15.55:0/1573485165 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350037070 con 0x7ff35c0b19c0 2024-04-25T08:55:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.641+0000 7ff359ffb640 1 -- 172.21.15.55:0/1573485165 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35002ae50 con 0x7ff35c0b19c0 2024-04-25T08:55:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.641+0000 7ff359ffb640 1 -- 172.21.15.55:0/1573485165 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350032640 con 0x7ff35c0b19c0 2024-04-25T08:55:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.641+0000 7ff361a4a640 1 -- 172.21.15.55:0/1573485165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c0b19c0 msgr2=0x7ff35c0cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.641+0000 7ff361a4a640 1 --2- 172.21.15.55:0/1573485165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c0b19c0 0x7ff35c0cf940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3500097a0 tx=0x7ff35002a100 comp rx=0 tx=0).stop 2024-04-25T08:55:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.641+0000 7ff361a4a640 1 -- 172.21.15.55:0/1573485165 shutdown_connections 2024-04-25T08:55:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.641+0000 7ff361a4a640 1 --2- 172.21.15.55:0/1573485165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c0b19c0 0x7ff35c0cf940 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.641+0000 7ff361a4a640 1 --2- 172.21.15.55:0/1573485165 >> v2:172.21.15.167:3300/0 conn(0x7ff35c15df40 0x7ff35c0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.641+0000 7ff361a4a640 1 -- 172.21.15.55:0/1573485165 >> 172.21.15.55:0/1573485165 conn(0x7ff35c0d06b0 msgr2=0x7ff35c0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.641+0000 7ff361a4a640 1 -- 172.21.15.55:0/1573485165 shutdown_connections 2024-04-25T08:55:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.641+0000 7ff361a4a640 1 -- 172.21.15.55:0/1573485165 wait complete. 2024-04-25T08:55:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.642+0000 7ff361a4a640 1 Processor -- start 2024-04-25T08:55:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.643+0000 7ff361a4a640 1 -- start start 2024-04-25T08:55:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.643+0000 7ff361a4a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff35c0b19c0 0x7ff35c15edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.643+0000 7ff361a4a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c0cfe80 0x7ff35c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.643+0000 7ff361a4a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c15df40 0x7ff35c0b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.643+0000 7ff361a4a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0d0310 con 0x7ff35c0b19c0 2024-04-25T08:55:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.643+0000 7ff361a4a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0cb080 con 0x7ff35c0cfe80 2024-04-25T08:55:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.643+0000 7ff361a4a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0b1e20 con 0x7ff35c15df40 2024-04-25T08:55:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.643+0000 7ff35affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff35c0b19c0 0x7ff35c15edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.643+0000 7ff35affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff35c0b19c0 0x7ff35c15edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51502/0 (socket says 172.21.15.55:51502) 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.643+0000 7ff35affd640 1 -- 172.21.15.55:0/1053245199 learned_addr learned my addr 172.21.15.55:0/1053245199 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff35b7fe640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c15df40 0x7ff35c0b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff35a7fc640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c0cfe80 0x7ff35c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff35affd640 1 -- 172.21.15.55:0/1053245199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c15df40 msgr2=0x7ff35c0b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff35affd640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c15df40 0x7ff35c0b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff35affd640 1 -- 172.21.15.55:0/1053245199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c0cfe80 msgr2=0x7ff35c0b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff35affd640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c0cfe80 0x7ff35c0b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff35affd640 1 -- 172.21.15.55:0/1053245199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c1f3a90 con 0x7ff35c0b19c0 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff35b7fe640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c15df40 0x7ff35c0b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff35a7fc640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c0cfe80 0x7ff35c0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff35affd640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff35c0b19c0 0x7ff35c15edf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00e9e0 tx=0x7ff34c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff343fff640 1 -- 172.21.15.55:0/1053245199 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c017070 con 0x7ff35c0b19c0 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff343fff640 1 -- 172.21.15.55:0/1053245199 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c00c9d0 con 0x7ff35c0b19c0 2024-04-25T08:55:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff361a4a640 1 -- 172.21.15.55:0/1053245199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c1f3d50 con 0x7ff35c0b19c0 2024-04-25T08:55:02.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff343fff640 1 -- 172.21.15.55:0/1053245199 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c00cdc0 con 0x7ff35c0b19c0 2024-04-25T08:55:02.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.644+0000 7ff361a4a640 1 -- 172.21.15.55:0/1053245199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c1f4310 con 0x7ff35c0b19c0 2024-04-25T08:55:02.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.645+0000 7ff361a4a640 1 -- 172.21.15.55:0/1053245199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c0749b0 con 0x7ff35c0b19c0 2024-04-25T08:55:02.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.646+0000 7ff343fff640 1 -- 172.21.15.55:0/1053245199 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff34c01a070 con 0x7ff35c0b19c0 2024-04-25T08:55:02.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.646+0000 7ff343fff640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff34806b500 0x7ff34806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.646+0000 7ff343fff640 1 -- 172.21.15.55:0/1053245199 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff34c08a5b0 con 0x7ff35c0b19c0 2024-04-25T08:55:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.646+0000 7ff35a7fc640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff34806b500 0x7ff34806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.647+0000 7ff35a7fc640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff34806b500 0x7ff34806d9c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff350034000 tx=0x7ff35002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.650+0000 7ff343fff640 1 -- 172.21.15.55:0/1053245199 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff34c059430 con 0x7ff35c0b19c0 2024-04-25T08:55:02.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.868+0000 7ff361a4a640 1 -- 172.21.15.55:0/1053245199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff35c161660 con 0x7ff35c0b19c0 2024-04-25T08:55:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.868+0000 7ff343fff640 1 -- 172.21.15.55:0/1053245199 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4943 (secure 0 0 0) 0x7ff34c058d30 con 0x7ff35c0b19c0 2024-04-25T08:55:02.858 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:02.858 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2362450653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2362450653},{"type":"v1","addr":"172.21.15.167:6835","nonce":2362450653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3897225045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3897225045},{"type":"v1","addr":"172.21.15.167:6834","nonce":3897225045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2007115110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2007115110},{"type":"v1","addr":"172.21.15.55:6836","nonce":2007115110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:54:35.752157+0000","modified":"2024-04-25T08:54:37.749451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1495159001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1495159001},{"type":"v1","addr":"172.21.15.55:6837","nonce":1495159001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:55:02.859 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-25T08:55:02.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 -- 172.21.15.55:0/1053245199 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff34806b500 msgr2=0x7ff34806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff34806b500 0x7ff34806d9c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff350034000 tx=0x7ff35002e000 comp rx=0 tx=0).stop 2024-04-25T08:55:02.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 -- 172.21.15.55:0/1053245199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff35c0b19c0 msgr2=0x7ff35c15edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff35c0b19c0 0x7ff35c15edf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00e9e0 tx=0x7ff34c00eea0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 -- 172.21.15.55:0/1053245199 shutdown_connections 2024-04-25T08:55:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff34806b500 0x7ff34806d9c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff35c15df40 0x7ff35c0b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c0cfe80 0x7ff35c0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 --2- 172.21.15.55:0/1053245199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff35c0b19c0 0x7ff35c15edf0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 -- 172.21.15.55:0/1053245199 >> 172.21.15.55:0/1053245199 conn(0x7ff35c0d06b0 msgr2=0x7ff35c0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 -- 172.21.15.55:0/1053245199 shutdown_connections 2024-04-25T08:55:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.870+0000 7ff361a4a640 1 -- 172.21.15.55:0/1053245199 wait complete. 2024-04-25T08:55:02.871 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:55:02.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.982+0000 7fe6fa770640 1 Processor -- start 2024-04-25T08:55:02.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.982+0000 7fe6fa770640 1 -- start start 2024-04-25T08:55:02.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.983+0000 7fe6fa770640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe6f40d35b0 0x7fe6f40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.983+0000 7fe6fa770640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6f40b5990 0x7fe6f40b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.983+0000 7fe6fa770640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f415e0c0 con 0x7fe6f415dce0 2024-04-25T08:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.983+0000 7fe6fa770640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40d2510 con 0x7fe6f40b5990 2024-04-25T08:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.983+0000 7fe6fa770640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40d27f0 con 0x7fe6f40d35b0 2024-04-25T08:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.983+0000 7fe6f8d0d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6f40b5990 0x7fe6f40b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.983+0000 7fe6f8d0d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6f40b5990 0x7fe6f40b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51512/0 (socket says 172.21.15.55:51512) 2024-04-25T08:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.983+0000 7fe6f8d0d640 1 -- 172.21.15.55:0/1645657105 learned_addr learned my addr 172.21.15.55:0/1645657105 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.984+0000 7fe6f8d0d640 1 -- 172.21.15.55:0/1645657105 >> v2:172.21.15.167:3300/0 conn(0x7fe6f40d35b0 msgr2=0x7fe6f40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.984+0000 7fe6f8d0d640 1 --2- 172.21.15.55:0/1645657105 >> v2:172.21.15.167:3300/0 conn(0x7fe6f40d35b0 0x7fe6f40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.984+0000 7fe6f8d0d640 1 -- 172.21.15.55:0/1645657105 >> v1:172.21.15.167:6789/0 conn(0x7fe6f415dce0 legacy=0x7fe6f40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.984+0000 7fe6f8d0d640 1 -- 172.21.15.55:0/1645657105 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40d2ad0 con 0x7fe6f40b5990 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.984+0000 7fe6f8d0d640 1 --2- 172.21.15.55:0/1645657105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40b5990 0x7fe6f40b6b00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40cdfa0 tx=0x7fe6ec02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d7431dc5948342 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.984+0000 7fe6f2ffd640 1 -- 172.21.15.55:0/1645657105 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec036070 con 0x7fe6f40b5990 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.984+0000 7fe6f2ffd640 1 -- 172.21.15.55:0/1645657105 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec031600 con 0x7fe6f40b5990 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.984+0000 7fe6f2ffd640 1 -- 172.21.15.55:0/1645657105 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0319d0 con 0x7fe6f40b5990 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.985+0000 7fe6fa770640 1 -- 172.21.15.55:0/1645657105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40b5990 msgr2=0x7fe6f40b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.985+0000 7fe6fa770640 1 --2- 172.21.15.55:0/1645657105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40b5990 0x7fe6f40b6b00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40cdfa0 tx=0x7fe6ec02a6f0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.985+0000 7fe6fa770640 1 -- 172.21.15.55:0/1645657105 shutdown_connections 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.985+0000 7fe6fa770640 1 --2- 172.21.15.55:0/1645657105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40b5990 0x7fe6f40b6b00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.985+0000 7fe6fa770640 1 --2- 172.21.15.55:0/1645657105 >> v2:172.21.15.167:3300/0 conn(0x7fe6f40d35b0 0x7fe6f40b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.985+0000 7fe6fa770640 1 -- 172.21.15.55:0/1645657105 >> 172.21.15.55:0/1645657105 conn(0x7fe6f4072900 msgr2=0x7fe6f40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.985+0000 7fe6fa770640 1 -- 172.21.15.55:0/1645657105 shutdown_connections 2024-04-25T08:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.985+0000 7fe6fa770640 1 -- 172.21.15.55:0/1645657105 wait complete. 2024-04-25T08:55:02.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.986+0000 7fe6fa770640 1 Processor -- start 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.986+0000 7fe6fa770640 1 -- start start 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.987+0000 7fe6fa770640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6f40b5990 0x7fe6f4154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.987+0000 7fe6fa770640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40d35b0 0x7fe6f40c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.987+0000 7fe6fa770640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6f415dce0 0x7fe6f40c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.987+0000 7fe6fa770640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40d2160 con 0x7fe6f40d35b0 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.987+0000 7fe6fa770640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40d3090 con 0x7fe6f40b5990 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.987+0000 7fe6fa770640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f4160220 con 0x7fe6f415dce0 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.987+0000 7fe6f37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40d35b0 0x7fe6f40c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.987+0000 7fe6f37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40d35b0 0x7fe6f40c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51520/0 (socket says 172.21.15.55:51520) 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.987+0000 7fe6f37fe640 1 -- 172.21.15.55:0/3676472244 learned_addr learned my addr 172.21.15.55:0/3676472244 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.987+0000 7fe6f3fff640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6f40b5990 0x7fe6f4154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.987+0000 7fe6f8d0d640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6f415dce0 0x7fe6f40c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.988+0000 7fe6f37fe640 1 -- 172.21.15.55:0/3676472244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6f415dce0 msgr2=0x7fe6f40c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.988+0000 7fe6f37fe640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6f415dce0 0x7fe6f40c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.988+0000 7fe6f37fe640 1 -- 172.21.15.55:0/3676472244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6f40b5990 msgr2=0x7fe6f4154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.988+0000 7fe6f37fe640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6f40b5990 0x7fe6f4154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.988+0000 7fe6f37fe640 1 -- 172.21.15.55:0/3676472244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f41554c0 con 0x7fe6f40d35b0 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.988+0000 7fe6f37fe640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40d35b0 0x7fe6f40c90d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400b480 tx=0x7fe6e400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.988+0000 7fe6f0ff9640 1 -- 172.21.15.55:0/3676472244 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4014070 con 0x7fe6f40d35b0 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.988+0000 7fe6f0ff9640 1 -- 172.21.15.55:0/3676472244 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4010870 con 0x7fe6f40d35b0 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.988+0000 7fe6fa770640 1 -- 172.21.15.55:0/3676472244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f415f180 con 0x7fe6f40d35b0 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.988+0000 7fe6f0ff9640 1 -- 172.21.15.55:0/3676472244 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4010c60 con 0x7fe6f40d35b0 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.988+0000 7fe6fa770640 1 -- 172.21.15.55:0/3676472244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f415f740 con 0x7fe6f40d35b0 2024-04-25T08:55:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.989+0000 7fe6fa770640 1 -- 172.21.15.55:0/3676472244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f40749b0 con 0x7fe6f40d35b0 2024-04-25T08:55:02.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.990+0000 7fe6f0ff9640 1 -- 172.21.15.55:0/3676472244 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe6e4017070 con 0x7fe6f40d35b0 2024-04-25T08:55:02.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.990+0000 7fe6f0ff9640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6d406b4d0 0x7fe6d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:02.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.990+0000 7fe6f0ff9640 1 -- 172.21.15.55:0/3676472244 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6e4089f90 con 0x7fe6f40d35b0 2024-04-25T08:55:02.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.990+0000 7fe6f3fff640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6d406b4d0 0x7fe6d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:02.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.991+0000 7fe6f3fff640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6d406b4d0 0x7fe6d406d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc006fd0 tx=0x7fe6dc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:02.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:02.994+0000 7fe6f0ff9640 1 -- 172.21.15.55:0/3676472244 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe6f41554c0 con 0x7fe6f40d35b0 2024-04-25T08:55:03.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.174+0000 7fe6fa770640 1 -- 172.21.15.55:0/3676472244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6f40b9280 con 0x7fe6f40d35b0 2024-04-25T08:55:03.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.175+0000 7fe6f0ff9640 1 -- 172.21.15.55:0/3676472244 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16669 (secure 0 0 0) 0x7fe6e4058ea0 con 0x7fe6f40d35b0 2024-04-25T08:55:03.166 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:03.166 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":36,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:54:37.381878+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:54:34.023960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:54:34.730867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:55:03.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.177+0000 7fe6fa770640 1 -- 172.21.15.55:0/3676472244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6d406b4d0 msgr2=0x7fe6d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.177+0000 7fe6fa770640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6d406b4d0 0x7fe6d406d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc006fd0 tx=0x7fe6dc008040 comp rx=0 tx=0).stop 2024-04-25T08:55:03.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.177+0000 7fe6fa770640 1 -- 172.21.15.55:0/3676472244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40d35b0 msgr2=0x7fe6f40c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.177+0000 7fe6fa770640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40d35b0 0x7fe6f40c90d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400b480 tx=0x7fe6e400b940 comp rx=0 tx=0).stop 2024-04-25T08:55:03.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.177+0000 7fe6fa770640 1 -- 172.21.15.55:0/3676472244 shutdown_connections 2024-04-25T08:55:03.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.177+0000 7fe6fa770640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6d406b4d0 0x7fe6d406d990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.177+0000 7fe6fa770640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6f415dce0 0x7fe6f40c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.177+0000 7fe6fa770640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40d35b0 0x7fe6f40c90d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.177+0000 7fe6fa770640 1 --2- 172.21.15.55:0/3676472244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6f40b5990 0x7fe6f4154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.177+0000 7fe6fa770640 1 -- 172.21.15.55:0/3676472244 >> 172.21.15.55:0/3676472244 conn(0x7fe6f4072900 msgr2=0x7fe6f40ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:03.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.178+0000 7fe6fa770640 1 -- 172.21.15.55:0/3676472244 shutdown_connections 2024-04-25T08:55:03.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.178+0000 7fe6fa770640 1 -- 172.21.15.55:0/3676472244 wait complete. 2024-04-25T08:55:03.179 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:55:03.179 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:55:03.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.290+0000 7f6bbc8ee640 1 Processor -- start 2024-04-25T08:55:03.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.290+0000 7f6bbc8ee640 1 -- start start 2024-04-25T08:55:03.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bbc8ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bb80d35b0 0x7f6bb80b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bbc8ee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6bb80b5990 0x7f6bb80b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bbc8ee640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb815e0c0 con 0x7f6bb815dce0 2024-04-25T08:55:03.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bbc8ee640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb80b5de0 con 0x7f6bb80b5990 2024-04-25T08:55:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bbc8ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80d2510 con 0x7f6bb80d35b0 2024-04-25T08:55:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bb6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6bb80b5990 0x7f6bb80b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bb659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6bb815dce0 0x7f6bb80d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48398/0 (socket says 172.21.15.55:48398) 2024-04-25T08:55:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bb6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6bb80b5990 0x7f6bb80b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51536/0 (socket says 172.21.15.55:51536) 2024-04-25T08:55:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bb659c640 1 -- 172.21.15.55:0/3025684945 learned_addr learned my addr 172.21.15.55:0/3025684945 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bb5d9b640 1 --2- 172.21.15.55:0/3025684945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bb80d35b0 0x7f6bb80b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bb6d9d640 1 -- 172.21.15.55:0/3025684945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bb80d35b0 msgr2=0x7f6bb80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bb6d9d640 1 --2- 172.21.15.55:0/3025684945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bb80d35b0 0x7f6bb80b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bb6d9d640 1 -- 172.21.15.55:0/3025684945 >> v1:172.21.15.55:6789/0 conn(0x7f6bb815dce0 legacy=0x7f6bb80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bb559a640 1 -- 172.21.15.55:0/3025684945 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322866043 0 0) 0x7f6bb815e0c0 con 0x7f6bb815dce0 2024-04-25T08:55:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.291+0000 7f6bb6d9d640 1 -- 172.21.15.55:0/3025684945 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb80d27f0 con 0x7f6bb80b5990 2024-04-25T08:55:03.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.292+0000 7f6bb6d9d640 1 --2- 172.21.15.55:0/3025684945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb80b5990 0x7f6bb80b6b00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009d90 tx=0x7f6bb002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c1dfc969907e65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:03.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.292+0000 7f6bb559a640 1 -- 172.21.15.55:0/3025684945 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0007740 con 0x7f6bb80b5990 2024-04-25T08:55:03.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.292+0000 7f6bb559a640 1 -- 172.21.15.55:0/3025684945 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb00078e0 con 0x7f6bb80b5990 2024-04-25T08:55:03.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.292+0000 7f6bb559a640 1 -- 172.21.15.55:0/3025684945 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0007cb0 con 0x7f6bb80b5990 2024-04-25T08:55:03.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.293+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3025684945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb80b5990 msgr2=0x7f6bb80b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.293+0000 7f6bbc8ee640 1 --2- 172.21.15.55:0/3025684945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb80b5990 0x7f6bb80b6b00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009d90 tx=0x7f6bb002a660 comp rx=0 tx=0).stop 2024-04-25T08:55:03.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.293+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3025684945 shutdown_connections 2024-04-25T08:55:03.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.293+0000 7f6bbc8ee640 1 --2- 172.21.15.55:0/3025684945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bb80d35b0 0x7f6bb80b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.293+0000 7f6bbc8ee640 1 --2- 172.21.15.55:0/3025684945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb80b5990 0x7f6bb80b6b00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.293+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3025684945 >> 172.21.15.55:0/3025684945 conn(0x7f6bb8072900 msgr2=0x7f6bb80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:03.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.293+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3025684945 shutdown_connections 2024-04-25T08:55:03.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.293+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3025684945 wait complete. 2024-04-25T08:55:03.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.294+0000 7f6bbc8ee640 1 Processor -- start 2024-04-25T08:55:03.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.294+0000 7f6bbc8ee640 1 -- start start 2024-04-25T08:55:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bbc8ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bb80b5990 0x7f6bb8154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bbc8ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb80d35b0 0x7f6bb80caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bbc8ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bb815dce0 0x7f6bb815fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bbc8ee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80d3090 con 0x7f6bb80d35b0 2024-04-25T08:55:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bbc8ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80d2db0 con 0x7f6bb815dce0 2024-04-25T08:55:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bbc8ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80d2160 con 0x7f6bb80b5990 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bb5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb80d35b0 0x7f6bb80caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bb5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb80d35b0 0x7f6bb80caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51544/0 (socket says 172.21.15.55:51544) 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3364680734 learned_addr learned my addr 172.21.15.55:0/3364680734 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bb6d9d640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bb815dce0 0x7f6bb815fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bb659c640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bb80b5990 0x7f6bb8154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3364680734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bb80b5990 msgr2=0x7f6bb8154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bb5d9b640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bb80b5990 0x7f6bb8154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3364680734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bb815dce0 msgr2=0x7f6bb815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bb5d9b640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bb815dce0 0x7f6bb815fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.295+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3364680734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb80cb210 con 0x7f6bb80d35b0 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.296+0000 7f6bb5d9b640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb80d35b0 0x7f6bb80caaa0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000d830 tx=0x7f6ba000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.296+0000 7f6baeffd640 1 -- 172.21.15.55:0/3364680734 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000b6c0 con 0x7f6bb80d35b0 2024-04-25T08:55:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.296+0000 7f6baeffd640 1 -- 172.21.15.55:0/3364680734 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba0019070 con 0x7f6bb80d35b0 2024-04-25T08:55:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.296+0000 7f6baeffd640 1 -- 172.21.15.55:0/3364680734 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000bac0 con 0x7f6bb80d35b0 2024-04-25T08:55:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.296+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3364680734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb80cb4f0 con 0x7f6bb80d35b0 2024-04-25T08:55:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.296+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3364680734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb80cbab0 con 0x7f6bb80d35b0 2024-04-25T08:55:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.297+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3364680734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb80749b0 con 0x7f6bb80d35b0 2024-04-25T08:55:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.297+0000 7f6baeffd640 1 -- 172.21.15.55:0/3364680734 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6ba001e460 con 0x7f6bb80d35b0 2024-04-25T08:55:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.298+0000 7f6baeffd640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b9806b500 0x7f6b9806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.298+0000 7f6baeffd640 1 -- 172.21.15.55:0/3364680734 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ba008a740 con 0x7f6bb80d35b0 2024-04-25T08:55:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.298+0000 7f6bb659c640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b9806b500 0x7f6b9806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.298+0000 7f6bb659c640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b9806b500 0x7f6b9806d9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8007fd0 tx=0x7f6ba8007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:03.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.302+0000 7f6baeffd640 1 -- 172.21.15.55:0/3364680734 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6ba0058f70 con 0x7f6bb80d35b0 2024-04-25T08:55:03.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.520+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3364680734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bb80b6c30 con 0x7f6bb80d35b0 2024-04-25T08:55:03.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.521+0000 7f6baeffd640 1 -- 172.21.15.55:0/3364680734 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f6ba005d010 con 0x7f6bb80d35b0 2024-04-25T08:55:03.511 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:03.511 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2362450653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2362450653},{"type":"v1","addr":"172.21.15.167:6835","nonce":2362450653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3897225045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3897225045},{"type":"v1","addr":"172.21.15.167:6834","nonce":3897225045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2007115110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2007115110},{"type":"v1","addr":"172.21.15.55:6836","nonce":2007115110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:54:35.752157+0000","modified":"2024-04-25T08:54:37.749451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1495159001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1495159001},{"type":"v1","addr":"172.21.15.55:6837","nonce":1495159001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:55:03.511 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-25T08:55:03.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.522+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3364680734 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b9806b500 msgr2=0x7f6b9806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.522+0000 7f6bbc8ee640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b9806b500 0x7f6b9806d9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8007fd0 tx=0x7f6ba8007de0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.523+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3364680734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb80d35b0 msgr2=0x7f6bb80caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.523+0000 7f6bbc8ee640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb80d35b0 0x7f6bb80caaa0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000d830 tx=0x7f6ba000dcf0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.523+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3364680734 shutdown_connections 2024-04-25T08:55:03.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.523+0000 7f6bbc8ee640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b9806b500 0x7f6b9806d9c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.523+0000 7f6bbc8ee640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bb815dce0 0x7f6bb815fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.523+0000 7f6bbc8ee640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb80d35b0 0x7f6bb80caaa0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.523+0000 7f6bbc8ee640 1 --2- 172.21.15.55:0/3364680734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bb80b5990 0x7f6bb8154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.523+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3364680734 >> 172.21.15.55:0/3364680734 conn(0x7f6bb8072900 msgr2=0x7f6bb80ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:03.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.523+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3364680734 shutdown_connections 2024-04-25T08:55:03.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.523+0000 7f6bbc8ee640 1 -- 172.21.15.55:0/3364680734 wait complete. 2024-04-25T08:55:03.523 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:55:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.635+0000 7f15c586f640 1 Processor -- start 2024-04-25T08:55:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.635+0000 7f15c586f640 1 -- start start 2024-04-25T08:55:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.636+0000 7f15c586f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f15c006bef0 0x7f15c006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.636+0000 7f15c586f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00acd80 0x7f15c00ad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.636+0000 7f15c586f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c006dc70 con 0x7f15c006c2d0 2024-04-25T08:55:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.636+0000 7f15c586f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c006eb20 con 0x7f15c006bef0 2024-04-25T08:55:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.636+0000 7f15c586f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c006df10 con 0x7f15c00acd80 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.636+0000 7f15bf7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00acd80 0x7f15c00ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.636+0000 7f15beffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f15c006bef0 0x7f15c006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.636+0000 7f15bf7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00acd80 0x7f15c00ad210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:41276/0 (socket says 172.21.15.55:41276) 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.636+0000 7f15bf7fe640 1 -- 172.21.15.55:0/2485349332 learned_addr learned my addr 172.21.15.55:0/2485349332 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.637+0000 7f15bf7fe640 1 -- 172.21.15.55:0/2485349332 >> v2:172.21.15.167:3300/0 conn(0x7f15c006bef0 msgr2=0x7f15c006efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.637+0000 7f15bf7fe640 1 --2- 172.21.15.55:0/2485349332 >> v2:172.21.15.167:3300/0 conn(0x7f15c006bef0 0x7f15c006efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.637+0000 7f15bf7fe640 1 -- 172.21.15.55:0/2485349332 >> v1:172.21.15.167:6789/0 conn(0x7f15c006c2d0 legacy=0x7f15c015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.637+0000 7f15bf7fe640 1 -- 172.21.15.55:0/2485349332 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c006e1f0 con 0x7f15c00acd80 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.637+0000 7f15bf7fe640 1 --2- 172.21.15.55:0/2485349332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00acd80 0x7f15c00ad210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f15c006eca0 tx=0x7f15b802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7afcbe2ae262082 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.638+0000 7f15bdffb640 1 -- 172.21.15.55:0/2485349332 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8036070 con 0x7f15c00acd80 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.638+0000 7f15bdffb640 1 -- 172.21.15.55:0/2485349332 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b8031600 con 0x7f15c00acd80 2024-04-25T08:55:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.638+0000 7f15bdffb640 1 -- 172.21.15.55:0/2485349332 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b80319d0 con 0x7f15c00acd80 2024-04-25T08:55:03.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.638+0000 7f15c586f640 1 -- 172.21.15.55:0/2485349332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00acd80 msgr2=0x7f15c00ad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.638+0000 7f15c586f640 1 --2- 172.21.15.55:0/2485349332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00acd80 0x7f15c00ad210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f15c006eca0 tx=0x7f15b802a710 comp rx=0 tx=0).stop 2024-04-25T08:55:03.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.638+0000 7f15c586f640 1 -- 172.21.15.55:0/2485349332 shutdown_connections 2024-04-25T08:55:03.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.638+0000 7f15c586f640 1 --2- 172.21.15.55:0/2485349332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c00acd80 0x7f15c00ad210 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.638+0000 7f15c586f640 1 --2- 172.21.15.55:0/2485349332 >> v2:172.21.15.167:3300/0 conn(0x7f15c006bef0 0x7f15c006efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.638+0000 7f15c586f640 1 -- 172.21.15.55:0/2485349332 >> 172.21.15.55:0/2485349332 conn(0x7f15c00b2220 msgr2=0x7f15c00cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.638+0000 7f15c586f640 1 -- 172.21.15.55:0/2485349332 shutdown_connections 2024-04-25T08:55:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.638+0000 7f15c586f640 1 -- 172.21.15.55:0/2485349332 wait complete. 2024-04-25T08:55:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.639+0000 7f15c586f640 1 Processor -- start 2024-04-25T08:55:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15c586f640 1 -- start start 2024-04-25T08:55:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15c586f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15c006bef0 0x7f15c0152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15c586f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c006c2d0 0x7f15c00b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15c586f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c00acd80 0x7f15c015e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15c586f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00ada00 con 0x7f15c006bef0 2024-04-25T08:55:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15c586f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c006e7b0 con 0x7f15c00acd80 2024-04-25T08:55:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15c586f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00adb80 con 0x7f15c006c2d0 2024-04-25T08:55:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15beffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15c006bef0 0x7f15c0152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15beffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15c006bef0 0x7f15c0152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51558/0 (socket says 172.21.15.55:51558) 2024-04-25T08:55:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15beffd640 1 -- 172.21.15.55:0/3663192087 learned_addr learned my addr 172.21.15.55:0/3663192087 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15bf7fe640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c00acd80 0x7f15c015e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.640+0000 7f15be7fc640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c006c2d0 0x7f15c00b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.641+0000 7f15beffd640 1 -- 172.21.15.55:0/3663192087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c006c2d0 msgr2=0x7f15c00b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.641+0000 7f15beffd640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c006c2d0 0x7f15c00b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.641+0000 7f15beffd640 1 -- 172.21.15.55:0/3663192087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c00acd80 msgr2=0x7f15c015e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.641+0000 7f15beffd640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c00acd80 0x7f15c015e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.641+0000 7f15beffd640 1 -- 172.21.15.55:0/3663192087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c00b3810 con 0x7f15c006bef0 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.641+0000 7f15beffd640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15c006bef0 0x7f15c0152b00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f15b000e9b0 tx=0x7f15b000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.641+0000 7f15a7fff640 1 -- 172.21.15.55:0/3663192087 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0017070 con 0x7f15c006bef0 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.641+0000 7f15a7fff640 1 -- 172.21.15.55:0/3663192087 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b000c9a0 con 0x7f15c006bef0 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.641+0000 7f15c586f640 1 -- 172.21.15.55:0/3663192087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c00b3af0 con 0x7f15c006bef0 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.641+0000 7f15a7fff640 1 -- 172.21.15.55:0/3663192087 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b000cd90 con 0x7f15c006bef0 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.641+0000 7f15c586f640 1 -- 172.21.15.55:0/3663192087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c00b40b0 con 0x7f15c006bef0 2024-04-25T08:55:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.642+0000 7f15c586f640 1 -- 172.21.15.55:0/3663192087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c00749b0 con 0x7f15c006bef0 2024-04-25T08:55:03.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.643+0000 7f15a7fff640 1 -- 172.21.15.55:0/3663192087 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f15b001a070 con 0x7f15c006bef0 2024-04-25T08:55:03.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.643+0000 7f15a7fff640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f15ac06b4d0 0x7f15ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.643+0000 7f15a7fff640 1 -- 172.21.15.55:0/3663192087 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15b008a450 con 0x7f15c006bef0 2024-04-25T08:55:03.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.643+0000 7f15be7fc640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f15ac06b4d0 0x7f15ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.644+0000 7f15be7fc640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f15ac06b4d0 0x7f15ac06d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f15c009db50 tx=0x7f15b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:03.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.647+0000 7f15a7fff640 1 -- 172.21.15.55:0/3663192087 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f15b0058d10 con 0x7f15c006bef0 2024-04-25T08:55:03.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.866+0000 7f15c586f640 1 -- 172.21.15.55:0/3663192087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15c00d0b70 con 0x7f15c006bef0 2024-04-25T08:55:03.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.867+0000 7f15a7fff640 1 -- 172.21.15.55:0/3663192087 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f15b005cdb0 con 0x7f15c006bef0 2024-04-25T08:55:03.857 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:03.857 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2362450653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2362450653},{"type":"v1","addr":"172.21.15.167:6835","nonce":2362450653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3897225045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3897225045},{"type":"v1","addr":"172.21.15.167:6834","nonce":3897225045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2007115110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2007115110},{"type":"v1","addr":"172.21.15.55:6836","nonce":2007115110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:54:35.752157+0000","modified":"2024-04-25T08:54:37.749451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1495159001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1495159001},{"type":"v1","addr":"172.21.15.55:6837","nonce":1495159001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:55:03.857 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-25T08:55:03.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.868+0000 7f15c586f640 1 -- 172.21.15.55:0/3663192087 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f15ac06b4d0 msgr2=0x7f15ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.868+0000 7f15c586f640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f15ac06b4d0 0x7f15ac06d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f15c009db50 tx=0x7f15b4009040 comp rx=0 tx=0).stop 2024-04-25T08:55:03.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.868+0000 7f15c586f640 1 -- 172.21.15.55:0/3663192087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15c006bef0 msgr2=0x7f15c0152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.868+0000 7f15c586f640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15c006bef0 0x7f15c0152b00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f15b000e9b0 tx=0x7f15b000ee70 comp rx=0 tx=0).stop 2024-04-25T08:55:03.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.869+0000 7f15c586f640 1 -- 172.21.15.55:0/3663192087 shutdown_connections 2024-04-25T08:55:03.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.869+0000 7f15c586f640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f15ac06b4d0 0x7f15ac06d990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.869+0000 7f15c586f640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15c00acd80 0x7f15c015e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.869+0000 7f15c586f640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15c006c2d0 0x7f15c00b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.869+0000 7f15c586f640 1 --2- 172.21.15.55:0/3663192087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15c006bef0 0x7f15c0152b00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.869+0000 7f15c586f640 1 -- 172.21.15.55:0/3663192087 >> 172.21.15.55:0/3663192087 conn(0x7f15c00b2220 msgr2=0x7f15c00afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:03.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.869+0000 7f15c586f640 1 -- 172.21.15.55:0/3663192087 shutdown_connections 2024-04-25T08:55:03.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.869+0000 7f15c586f640 1 -- 172.21.15.55:0/3663192087 wait complete. 2024-04-25T08:55:03.869 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:55:03.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.980+0000 7fb3b1bf4640 1 Processor -- start 2024-04-25T08:55:03.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.980+0000 7fb3b1bf4640 1 -- start start 2024-04-25T08:55:03.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.981+0000 7fb3b1bf4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3ac15dce0 0x7fb3ac0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.981+0000 7fb3b1bf4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ac0d35b0 0x7fb3ac0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.981+0000 7fb3b1bf4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ac15e0c0 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.981+0000 7fb3b1bf4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ac0b7b10 con 0x7fb3ac15dce0 2024-04-25T08:55:03.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.981+0000 7fb3b1bf4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac0d2510 con 0x7fb3ac0d35b0 2024-04-25T08:55:03.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.981+0000 7fb3abfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb3ac0d1f90 0x7fb3ac06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48412/0 (socket says 172.21.15.55:48412) 2024-04-25T08:55:03.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.981+0000 7fb3abfff640 1 -- 172.21.15.55:0/2311789218 learned_addr learned my addr 172.21.15.55:0/2311789218 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:03.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.982+0000 7fb3aaffd640 1 --2- 172.21.15.55:0/2311789218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ac0d35b0 0x7fb3ac0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.982+0000 7fb3ab7fe640 1 --2- 172.21.15.55:0/2311789218 >> v2:172.21.15.167:3300/0 conn(0x7fb3ac15dce0 0x7fb3ac0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.982+0000 7fb3aa7fc640 1 -- 172.21.15.55:0/2311789218 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277050303 0 0) 0x7fb3ac15e0c0 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.982+0000 7fb3aa7fc640 1 -- 172.21.15.55:0/2311789218 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb394003520 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.982+0000 7fb3aa7fc640 1 -- 172.21.15.55:0/2311789218 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3077737609 0 0) 0x7fb394003520 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.982+0000 7fb3ab7fe640 1 -- 172.21.15.55:0/2311789218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ac0d35b0 msgr2=0x7fb3ac0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:03.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.982+0000 7fb3ab7fe640 1 --2- 172.21.15.55:0/2311789218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ac0d35b0 0x7fb3ac0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.982+0000 7fb3ab7fe640 1 -- 172.21.15.55:0/2311789218 >> v1:172.21.15.55:6789/0 conn(0x7fb3ac0d1f90 legacy=0x7fb3ac06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.982+0000 7fb3ab7fe640 1 -- 172.21.15.55:0/2311789218 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac0d27f0 con 0x7fb3ac15dce0 2024-04-25T08:55:03.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.982+0000 7fb3aaffd640 1 --2- 172.21.15.55:0/2311789218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ac0d35b0 0x7fb3ac0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:55:03.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.983+0000 7fb3ab7fe640 1 --2- 172.21.15.55:0/2311789218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ac15dce0 0x7fb3ac0d1a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0097a0 tx=0x7fb39c02a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c761150a4fd78fe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:03.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.983+0000 7fb3aa7fc640 1 -- 172.21.15.55:0/2311789218 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c037070 con 0x7fb3ac15dce0 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.983+0000 7fb3aa7fc640 1 -- 172.21.15.55:0/2311789218 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c02ab10 con 0x7fb3ac15dce0 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.983+0000 7fb3aa7fc640 1 -- 172.21.15.55:0/2311789218 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a40019f0 con 0x7fb3ac15dce0 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.983+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/2311789218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ac15dce0 msgr2=0x7fb3ac0d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.983+0000 7fb3b1bf4640 1 --2- 172.21.15.55:0/2311789218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ac15dce0 0x7fb3ac0d1a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0097a0 tx=0x7fb39c02a080 comp rx=0 tx=0).stop 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.983+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/2311789218 shutdown_connections 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.983+0000 7fb3b1bf4640 1 --2- 172.21.15.55:0/2311789218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ac0d35b0 0x7fb3ac0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.983+0000 7fb3b1bf4640 1 --2- 172.21.15.55:0/2311789218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ac15dce0 0x7fb3ac0d1a50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.983+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/2311789218 >> 172.21.15.55:0/2311789218 conn(0x7fb3ac072900 msgr2=0x7fb3ac0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.984+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/2311789218 shutdown_connections 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.984+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/2311789218 wait complete. 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.985+0000 7fb3b1bf4640 1 Processor -- start 2024-04-25T08:55:03.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.985+0000 7fb3b1bf4640 1 -- start start 2024-04-25T08:55:03.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3b1bf4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3ac0d1f90 0x7fb3ac15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3b1bf4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ac0d35b0 0x7fb3ac14bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3b1bf4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ac15dce0 0x7fb3ac14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3b1bf4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac0d3090 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3b1bf4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac0d2db0 con 0x7fb3ac15dce0 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3b1bf4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac0b9820 con 0x7fb3ac0d35b0 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3ab7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3ac0d1f90 0x7fb3ac15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3ab7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3ac0d1f90 0x7fb3ac15bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51562/0 (socket says 172.21.15.55:51562) 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3ab7fe640 1 -- 172.21.15.55:0/347012886 learned_addr learned my addr 172.21.15.55:0/347012886 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3aaffd640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ac0d35b0 0x7fb3ac14bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3abfff640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ac15dce0 0x7fb3ac14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3ab7fe640 1 -- 172.21.15.55:0/347012886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ac0d35b0 msgr2=0x7fb3ac14bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3ab7fe640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ac0d35b0 0x7fb3ac14bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3ab7fe640 1 -- 172.21.15.55:0/347012886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ac15dce0 msgr2=0x7fb3ac14e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3ab7fe640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ac15dce0 0x7fb3ac14e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:03.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3ab7fe640 1 -- 172.21.15.55:0/347012886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac161240 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3abfff640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ac15dce0 0x7fb3ac14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:03.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3ab7fe640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3ac0d1f90 0x7fb3ac15bb40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb39c035040 tx=0x7fb39c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:03.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb393fff640 1 -- 172.21.15.55:0/347012886 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c037050 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb393fff640 1 -- 172.21.15.55:0/347012886 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c043070 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/347012886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ac14c660 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.986+0000 7fb393fff640 1 -- 172.21.15.55:0/347012886 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c006e10 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.987+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/347012886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ac160f60 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.987+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/347012886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ac14c830 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.988+0000 7fb393fff640 1 -- 172.21.15.55:0/347012886 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb39c03ca10 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.988+0000 7fb393fff640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb39806b4d0 0x7fb39806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:03.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.988+0000 7fb393fff640 1 -- 172.21.15.55:0/347012886 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb39c0aae00 con 0x7fb3ac0d1f90 2024-04-25T08:55:03.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.988+0000 7fb3aaffd640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb39806b4d0 0x7fb39806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:03.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.989+0000 7fb3aaffd640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb39806b4d0 0x7fb39806d990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009560 tx=0x7fb3a0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:03.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:03.992+0000 7fb393fff640 1 -- 172.21.15.55:0/347012886 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb39c079e30 con 0x7fb3ac0d1f90 2024-04-25T08:55:04.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.176+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/347012886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3ac0749b0 con 0x7fb3ac0d1f90 2024-04-25T08:55:04.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.177+0000 7fb393fff640 1 -- 172.21.15.55:0/347012886 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16669 (secure 0 0 0) 0x7fb39c079730 con 0x7fb3ac0d1f90 2024-04-25T08:55:04.167 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:04.167 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":36,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:54:37.381878+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:54:34.023960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T08:54:34.730867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:55:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/347012886 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb39806b4d0 msgr2=0x7fb39806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb39806b4d0 0x7fb39806d990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009560 tx=0x7fb3a0009190 comp rx=0 tx=0).stop 2024-04-25T08:55:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/347012886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3ac0d1f90 msgr2=0x7fb3ac15bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3ac0d1f90 0x7fb3ac15bb40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb39c035040 tx=0x7fb39c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/347012886 shutdown_connections 2024-04-25T08:55:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb39806b4d0 0x7fb39806d990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ac15dce0 0x7fb3ac14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ac0d35b0 0x7fb3ac14bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 --2- 172.21.15.55:0/347012886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3ac0d1f90 0x7fb3ac15bb40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/347012886 >> 172.21.15.55:0/347012886 conn(0x7fb3ac072900 msgr2=0x7fb3ac0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:04.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/347012886 shutdown_connections 2024-04-25T08:55:04.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.179+0000 7fb3b1bf4640 1 -- 172.21.15.55:0/347012886 wait complete. 2024-04-25T08:55:04.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:55:04.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.292+0000 7f094e1e0640 1 Processor -- start 2024-04-25T08:55:04.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.292+0000 7f094e1e0640 1 -- start start 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f094e1e0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0948161090 0x7f0948161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f094e1e0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09480ceeb0 0x7f09480d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f094e1e0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0948161f80 con 0x7f09480b9720 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f094e1e0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09480d21a0 con 0x7f09480ceeb0 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f094e1e0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0948162260 con 0x7f0948161090 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f0947fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09480ceeb0 0x7f09480d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f0947fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09480ceeb0 0x7f09480d2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51572/0 (socket says 172.21.15.55:51572) 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f0947fff640 1 -- 172.21.15.55:0/3933950172 learned_addr learned my addr 172.21.15.55:0/3933950172 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f09477fe640 1 --2- 172.21.15.55:0/3933950172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0948161090 0x7f0948161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f0947fff640 1 -- 172.21.15.55:0/3933950172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0948161090 msgr2=0x7f0948161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f0947fff640 1 --2- 172.21.15.55:0/3933950172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0948161090 0x7f0948161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f0947fff640 1 -- 172.21.15.55:0/3933950172 >> v1:172.21.15.167:6789/0 conn(0x7f09480b9720 legacy=0x7f09480ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f0947fff640 1 -- 172.21.15.55:0/3933950172 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0948162540 con 0x7f09480ceeb0 2024-04-25T08:55:04.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.293+0000 7f09477fe640 1 --2- 172.21.15.55:0/3933950172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0948161090 0x7f0948161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:04.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.294+0000 7f0947fff640 1 --2- 172.21.15.55:0/3933950172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09480ceeb0 0x7f09480d2630 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0940009e50 tx=0x7f094002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb54fdfa84cf0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:04.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.294+0000 7f09467fc640 1 -- 172.21.15.55:0/3933950172 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940036070 con 0x7f09480ceeb0 2024-04-25T08:55:04.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.294+0000 7f09467fc640 1 -- 172.21.15.55:0/3933950172 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0940031600 con 0x7f09480ceeb0 2024-04-25T08:55:04.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.294+0000 7f09467fc640 1 -- 172.21.15.55:0/3933950172 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400319d0 con 0x7f09480ceeb0 2024-04-25T08:55:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.295+0000 7f094e1e0640 1 -- 172.21.15.55:0/3933950172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09480ceeb0 msgr2=0x7f09480d2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.295+0000 7f094e1e0640 1 --2- 172.21.15.55:0/3933950172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09480ceeb0 0x7f09480d2630 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0940009e50 tx=0x7f094002a730 comp rx=0 tx=0).stop 2024-04-25T08:55:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.295+0000 7f094e1e0640 1 -- 172.21.15.55:0/3933950172 shutdown_connections 2024-04-25T08:55:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.295+0000 7f094e1e0640 1 --2- 172.21.15.55:0/3933950172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09480ceeb0 0x7f09480d2630 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.295+0000 7f094e1e0640 1 --2- 172.21.15.55:0/3933950172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0948161090 0x7f0948161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.295+0000 7f094e1e0640 1 -- 172.21.15.55:0/3933950172 >> 172.21.15.55:0/3933950172 conn(0x7f09480b55e0 msgr2=0x7f09480b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.295+0000 7f094e1e0640 1 -- 172.21.15.55:0/3933950172 shutdown_connections 2024-04-25T08:55:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.295+0000 7f094e1e0640 1 -- 172.21.15.55:0/3933950172 wait complete. 2024-04-25T08:55:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.296+0000 7f094e1e0640 1 Processor -- start 2024-04-25T08:55:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.296+0000 7f094e1e0640 1 -- start start 2024-04-25T08:55:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f094e1e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09480b9720 0x7f09480c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f094e1e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09480ceeb0 0x7f094814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f094e1e0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0948161090 0x7f094814cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f094e1e0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948161c70 con 0x7f09480b9720 2024-04-25T08:55:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f094e1e0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948161470 con 0x7f09480ceeb0 2024-04-25T08:55:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f094e1e0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09480d2b70 con 0x7f0948161090 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f09477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09480b9720 0x7f09480c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f09477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09480b9720 0x7f09480c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51582/0 (socket says 172.21.15.55:51582) 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f09477fe640 1 -- 172.21.15.55:0/562768236 learned_addr learned my addr 172.21.15.55:0/562768236 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f0946ffd640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09480ceeb0 0x7f094814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f0947fff640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0948161090 0x7f094814cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f09477fe640 1 -- 172.21.15.55:0/562768236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0948161090 msgr2=0x7f094814cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f09477fe640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0948161090 0x7f094814cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f09477fe640 1 -- 172.21.15.55:0/562768236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09480ceeb0 msgr2=0x7f094814ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f09477fe640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09480ceeb0 0x7f094814ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f09477fe640 1 -- 172.21.15.55:0/562768236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094815d1b0 con 0x7f09480b9720 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f0946ffd640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09480ceeb0 0x7f094814ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.297+0000 7f09477fe640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09480b9720 0x7f09480c7e30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f093800c7f0 tx=0x7f093800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.298+0000 7f092ffff640 1 -- 172.21.15.55:0/562768236 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938015070 con 0x7f09480b9720 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.298+0000 7f092ffff640 1 -- 172.21.15.55:0/562768236 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0938007820 con 0x7f09480b9720 2024-04-25T08:55:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.298+0000 7f092ffff640 1 -- 172.21.15.55:0/562768236 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938007bd0 con 0x7f09480b9720 2024-04-25T08:55:04.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.298+0000 7f094e1e0640 1 -- 172.21.15.55:0/562768236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094814d5d0 con 0x7f09480b9720 2024-04-25T08:55:04.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.298+0000 7f094e1e0640 1 -- 172.21.15.55:0/562768236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094814de70 con 0x7f09480b9720 2024-04-25T08:55:04.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.299+0000 7f094e1e0640 1 -- 172.21.15.55:0/562768236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09480750b0 con 0x7f09480b9720 2024-04-25T08:55:04.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.299+0000 7f092ffff640 1 -- 172.21.15.55:0/562768236 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0938018070 con 0x7f09480b9720 2024-04-25T08:55:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.300+0000 7f092ffff640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f093406b4d0 0x7f093406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.300+0000 7f0946ffd640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f093406b4d0 0x7f093406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.300+0000 7f092ffff640 1 -- 172.21.15.55:0/562768236 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f093808a400 con 0x7f09480b9720 2024-04-25T08:55:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.300+0000 7f0946ffd640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f093406b4d0 0x7f093406d990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f094815f3d0 tx=0x7f093c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.304+0000 7f092ffff640 1 -- 172.21.15.55:0/562768236 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09380591f0 con 0x7f09480b9720 2024-04-25T08:55:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.523+0000 7f094e1e0640 1 -- 172.21.15.55:0/562768236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f09480d1700 con 0x7f09480b9720 2024-04-25T08:55:04.514 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T08:55:04.524+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:55:04.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.525+0000 7f092ffff640 1 -- 172.21.15.55:0/562768236 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0938058af0 con 0x7f09480b9720 2024-04-25T08:55:04.516 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:55:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.529+0000 7f094e1e0640 1 -- 172.21.15.55:0/562768236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f093406b4d0 msgr2=0x7f093406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.529+0000 7f094e1e0640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f093406b4d0 0x7f093406d990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f094815f3d0 tx=0x7f093c009040 comp rx=0 tx=0).stop 2024-04-25T08:55:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.529+0000 7f094e1e0640 1 -- 172.21.15.55:0/562768236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09480b9720 msgr2=0x7f09480c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.529+0000 7f094e1e0640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09480b9720 0x7f09480c7e30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f093800c7f0 tx=0x7f093800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.529+0000 7f094e1e0640 1 -- 172.21.15.55:0/562768236 shutdown_connections 2024-04-25T08:55:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.529+0000 7f094e1e0640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f093406b4d0 0x7f093406d990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.529+0000 7f094e1e0640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0948161090 0x7f094814cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.529+0000 7f094e1e0640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09480ceeb0 0x7f094814ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.529+0000 7f094e1e0640 1 --2- 172.21.15.55:0/562768236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09480b9720 0x7f09480c7e30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.529+0000 7f094e1e0640 1 -- 172.21.15.55:0/562768236 >> 172.21.15.55:0/562768236 conn(0x7f09480b55e0 msgr2=0x7f09480b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:04.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.530+0000 7f094e1e0640 1 -- 172.21.15.55:0/562768236 shutdown_connections 2024-04-25T08:55:04.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.530+0000 7f094e1e0640 1 -- 172.21.15.55:0/562768236 wait complete. 2024-04-25T08:55:04.522 INFO:tasks.ceph.mds.c.smithi055.stderr: -6508> 2024-04-25T08:54:41.057+0000 7f2cdfba7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:55:04.531 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:55:04.553 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T08:55:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.645+0000 7f7ef884c640 1 Processor -- start 2024-04-25T08:55:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.645+0000 7f7ef884c640 1 -- start start 2024-04-25T08:55:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.646+0000 7f7ef884c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ef4161120 0x7f7ef41617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.646+0000 7f7ef884c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7ef40b5c60 0x7f7ef40d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.646+0000 7f7ef884c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef4161500 con 0x7f7ef4161ce0 2024-04-25T08:55:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.646+0000 7f7ef884c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef4162740 con 0x7f7ef4161120 2024-04-25T08:55:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.646+0000 7f7ef884c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef4162180 con 0x7f7ef40b5c60 2024-04-25T08:55:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.646+0000 7f7ef259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ef4161120 0x7f7ef41617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.646+0000 7f7ef259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ef4161120 0x7f7ef41617a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51616/0 (socket says 172.21.15.55:51616) 2024-04-25T08:55:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.646+0000 7f7ef259c640 1 -- 172.21.15.55:0/2291012459 learned_addr learned my addr 172.21.15.55:0/2291012459 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.646+0000 7f7ef2d9d640 1 --2- 172.21.15.55:0/2291012459 >> v2:172.21.15.167:3300/0 conn(0x7f7ef40b5c60 0x7f7ef40d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.647+0000 7f7ef259c640 1 -- 172.21.15.55:0/2291012459 >> v2:172.21.15.167:3300/0 conn(0x7f7ef40b5c60 msgr2=0x7f7ef40d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.647+0000 7f7ef259c640 1 --2- 172.21.15.55:0/2291012459 >> v2:172.21.15.167:3300/0 conn(0x7f7ef40b5c60 0x7f7ef40d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.647+0000 7f7ef259c640 1 -- 172.21.15.55:0/2291012459 >> v1:172.21.15.167:6789/0 conn(0x7f7ef4161ce0 legacy=0x7f7ef40b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.647+0000 7f7ef259c640 1 -- 172.21.15.55:0/2291012459 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4162460 con 0x7f7ef4161120 2024-04-25T08:55:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.647+0000 7f7ef259c640 1 --2- 172.21.15.55:0/2291012459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef4161120 0x7f7ef41617a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40b3500 tx=0x7f7eec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4979b5a4854fe18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.647+0000 7f7ef159a640 1 -- 172.21.15.55:0/2291012459 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec037070 con 0x7f7ef4161120 2024-04-25T08:55:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.648+0000 7f7ef159a640 1 -- 172.21.15.55:0/2291012459 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec032440 con 0x7f7ef4161120 2024-04-25T08:55:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.648+0000 7f7ef159a640 1 -- 172.21.15.55:0/2291012459 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec032810 con 0x7f7ef4161120 2024-04-25T08:55:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.648+0000 7f7ef884c640 1 -- 172.21.15.55:0/2291012459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef4161120 msgr2=0x7f7ef41617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.648+0000 7f7ef884c640 1 --2- 172.21.15.55:0/2291012459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef4161120 0x7f7ef41617a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40b3500 tx=0x7f7eec02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.648+0000 7f7ef884c640 1 -- 172.21.15.55:0/2291012459 shutdown_connections 2024-04-25T08:55:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.648+0000 7f7ef884c640 1 --2- 172.21.15.55:0/2291012459 >> v2:172.21.15.167:3300/0 conn(0x7f7ef40b5c60 0x7f7ef40d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.648+0000 7f7ef884c640 1 --2- 172.21.15.55:0/2291012459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef4161120 0x7f7ef41617a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.648+0000 7f7ef884c640 1 -- 172.21.15.55:0/2291012459 >> 172.21.15.55:0/2291012459 conn(0x7f7ef40d0550 msgr2=0x7f7ef40d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.648+0000 7f7ef884c640 1 -- 172.21.15.55:0/2291012459 shutdown_connections 2024-04-25T08:55:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.648+0000 7f7ef884c640 1 -- 172.21.15.55:0/2291012459 wait complete. 2024-04-25T08:55:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.649+0000 7f7ef884c640 1 Processor -- start 2024-04-25T08:55:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.650+0000 7f7ef884c640 1 -- start start 2024-04-25T08:55:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.650+0000 7f7ef884c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ef40b5c60 0x7f7ef41f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.650+0000 7f7ef884c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ef4161120 0x7f7ef4156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.650+0000 7f7ef884c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef4161ce0 0x7f7ef415f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.650+0000 7f7ef884c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40b95f0 con 0x7f7ef4161ce0 2024-04-25T08:55:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.650+0000 7f7ef884c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40d2040 con 0x7f7ef40b5c60 2024-04-25T08:55:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.650+0000 7f7ef884c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40b9770 con 0x7f7ef4161120 2024-04-25T08:55:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.650+0000 7f7ef2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef4161ce0 0x7f7ef415f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.650+0000 7f7ef2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef4161ce0 0x7f7ef415f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51624/0 (socket says 172.21.15.55:51624) 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.650+0000 7f7ef2d9d640 1 -- 172.21.15.55:0/1935850250 learned_addr learned my addr 172.21.15.55:0/1935850250 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.650+0000 7f7ef1d9b640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ef4161120 0x7f7ef4156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7ef259c640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ef40b5c60 0x7f7ef41f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7ef2d9d640 1 -- 172.21.15.55:0/1935850250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ef4161120 msgr2=0x7f7ef4156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7ef2d9d640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ef4161120 0x7f7ef4156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7ef2d9d640 1 -- 172.21.15.55:0/1935850250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ef40b5c60 msgr2=0x7f7ef41f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7ef2d9d640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ef40b5c60 0x7f7ef41f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7ef2d9d640 1 -- 172.21.15.55:0/1935850250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4157090 con 0x7f7ef4161ce0 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7ef2d9d640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef4161ce0 0x7f7ef415f480 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4007e40 tx=0x7f7ee400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7eeaffd640 1 -- 172.21.15.55:0/1935850250 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4014620 con 0x7f7ef4161ce0 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7eeaffd640 1 -- 172.21.15.55:0/1935850250 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee4019070 con 0x7f7ef4161ce0 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7ef884c640 1 -- 172.21.15.55:0/1935850250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef415e740 con 0x7f7ef4161ce0 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7eeaffd640 1 -- 172.21.15.55:0/1935850250 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4014a20 con 0x7f7ef4161ce0 2024-04-25T08:55:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.651+0000 7f7ef884c640 1 -- 172.21.15.55:0/1935850250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef40cb370 con 0x7f7ef4161ce0 2024-04-25T08:55:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.652+0000 7f7ef884c640 1 -- 172.21.15.55:0/1935850250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef40750b0 con 0x7f7ef4161ce0 2024-04-25T08:55:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.652+0000 7f7eeaffd640 1 -- 172.21.15.55:0/1935850250 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ee4014bc0 con 0x7f7ef4161ce0 2024-04-25T08:55:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.653+0000 7f7eeaffd640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ed406b4d0 0x7f7ed406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.653+0000 7f7eeaffd640 1 -- 172.21.15.55:0/1935850250 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7ee408a9b0 con 0x7f7ef4161ce0 2024-04-25T08:55:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.653+0000 7f7ef259c640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ed406b4d0 0x7f7ed406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.653+0000 7f7ef259c640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ed406b4d0 0x7f7ed406d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7eec034000 tx=0x7f7eec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.657+0000 7f7eeaffd640 1 -- 172.21.15.55:0/1935850250 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7ee4059210 con 0x7f7ef4161ce0 2024-04-25T08:55:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:04.878+0000 7f7ef884c640 1 -- 172.21.15.55:0/1935850250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7ef40d17e0 con 0x7f7ef4161ce0 2024-04-25T08:55:05.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.528+0000 7f7eeaffd640 1 -- 172.21.15.55:0/1935850250 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7ee405d2b0 con 0x7f7ef4161ce0 2024-04-25T08:55:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 -- 172.21.15.55:0/1935850250 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ed406b4d0 msgr2=0x7f7ed406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ed406b4d0 0x7f7ed406d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7eec034000 tx=0x7f7eec02e000 comp rx=0 tx=0).stop 2024-04-25T08:55:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 -- 172.21.15.55:0/1935850250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef4161ce0 msgr2=0x7f7ef415f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef4161ce0 0x7f7ef415f480 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4007e40 tx=0x7f7ee400e4b0 comp rx=0 tx=0).stop 2024-04-25T08:55:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 -- 172.21.15.55:0/1935850250 shutdown_connections 2024-04-25T08:55:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ed406b4d0 0x7f7ed406d990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef4161ce0 0x7f7ef415f480 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ef4161120 0x7f7ef4156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 --2- 172.21.15.55:0/1935850250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ef40b5c60 0x7f7ef41f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:05.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 -- 172.21.15.55:0/1935850250 >> 172.21.15.55:0/1935850250 conn(0x7f7ef40d0550 msgr2=0x7f7ef40c7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:05.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 -- 172.21.15.55:0/1935850250 shutdown_connections 2024-04-25T08:55:05.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.531+0000 7f7ef884c640 1 -- 172.21.15.55:0/1935850250 wait complete. 2024-04-25T08:55:05.536 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:55:05.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.701+0000 7f0d2d79e640 1 Processor -- start 2024-04-25T08:55:05.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.701+0000 7f0d2d79e640 1 -- start start 2024-04-25T08:55:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.702+0000 7f0d2d79e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d28161090 0x7f0d28161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.702+0000 7f0d2d79e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d28161f80 con 0x7f0d280b9720 2024-04-25T08:55:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.702+0000 7f0d2d79e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d28162260 con 0x7f0d280ceeb0 2024-04-25T08:55:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.702+0000 7f0d2d79e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d280d21a0 con 0x7f0d28161090 2024-04-25T08:55:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.702+0000 7f0d26ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d28161090 0x7f0d28161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.702+0000 7f0d267fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0d280b9720 0x7f0d280ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48428/0 (socket says 172.21.15.55:48428) 2024-04-25T08:55:05.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.702+0000 7f0d267fc640 1 -- 172.21.15.55:0/684872796 learned_addr learned my addr 172.21.15.55:0/684872796 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:05.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.702+0000 7f0d26ffd640 1 -- 172.21.15.55:0/684872796 >> v1:172.21.15.167:6789/0 conn(0x7f0d280ceeb0 legacy=0x7f0d280d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:05.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.702+0000 7f0d26ffd640 1 -- 172.21.15.55:0/684872796 >> v1:172.21.15.55:6789/0 conn(0x7f0d280b9720 legacy=0x7f0d280ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:05.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.702+0000 7f0d26ffd640 1 -- 172.21.15.55:0/684872796 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d28162540 con 0x7f0d28161090 2024-04-25T08:55:05.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.702+0000 7f0d25ffb640 1 -- 172.21.15.55:0/684872796 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318776331 0 0) 0x7f0d28161f80 con 0x7f0d280b9720 2024-04-25T08:55:05.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.703+0000 7f0d26ffd640 1 --2- 172.21.15.55:0/684872796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d28161090 0x7f0d28161730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0d280d2320 tx=0x7f0d1802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760a6cc774af497e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:05.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.703+0000 7f0d25ffb640 1 -- 172.21.15.55:0/684872796 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18037070 con 0x7f0d28161090 2024-04-25T08:55:05.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.703+0000 7f0d25ffb640 1 -- 172.21.15.55:0/684872796 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18032440 con 0x7f0d28161090 2024-04-25T08:55:05.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.703+0000 7f0d25ffb640 1 -- 172.21.15.55:0/684872796 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18032810 con 0x7f0d28161090 2024-04-25T08:55:05.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.704+0000 7f0d2d79e640 1 -- 172.21.15.55:0/684872796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d28161090 msgr2=0x7f0d28161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:05.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.704+0000 7f0d2d79e640 1 --2- 172.21.15.55:0/684872796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d28161090 0x7f0d28161730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0d280d2320 tx=0x7f0d1802a180 comp rx=0 tx=0).stop 2024-04-25T08:55:05.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.704+0000 7f0d2d79e640 1 -- 172.21.15.55:0/684872796 shutdown_connections 2024-04-25T08:55:05.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.704+0000 7f0d2d79e640 1 --2- 172.21.15.55:0/684872796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d28161090 0x7f0d28161730 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:05.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.704+0000 7f0d2d79e640 1 -- 172.21.15.55:0/684872796 >> 172.21.15.55:0/684872796 conn(0x7f0d280b55e0 msgr2=0x7f0d280b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:05.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.704+0000 7f0d2d79e640 1 -- 172.21.15.55:0/684872796 shutdown_connections 2024-04-25T08:55:05.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.704+0000 7f0d2d79e640 1 -- 172.21.15.55:0/684872796 wait complete. 2024-04-25T08:55:05.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.705+0000 7f0d2d79e640 1 Processor -- start 2024-04-25T08:55:05.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.705+0000 7f0d2d79e640 1 -- start start 2024-04-25T08:55:05.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.706+0000 7f0d2d79e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d280b9720 0x7f0d2815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:05.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.706+0000 7f0d2d79e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d280ceeb0 0x7f0d2815e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:05.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.706+0000 7f0d2d79e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d28161090 0x7f0d281f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:05.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.706+0000 7f0d2d79e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28161c70 con 0x7f0d28161090 2024-04-25T08:55:05.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.706+0000 7f0d2d79e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28161470 con 0x7f0d280ceeb0 2024-04-25T08:55:05.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.706+0000 7f0d2d79e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280d2d40 con 0x7f0d280b9720 2024-04-25T08:55:05.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.706+0000 7f0d277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d28161090 0x7f0d281f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.706+0000 7f0d277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d28161090 0x7f0d281f6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51640/0 (socket says 172.21.15.55:51640) 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.706+0000 7f0d277fe640 1 -- 172.21.15.55:0/275178654 learned_addr learned my addr 172.21.15.55:0/275178654 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.706+0000 7f0d267fc640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d280ceeb0 0x7f0d2815e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.706+0000 7f0d26ffd640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d280b9720 0x7f0d2815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.707+0000 7f0d277fe640 1 -- 172.21.15.55:0/275178654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d280b9720 msgr2=0x7f0d2815ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.707+0000 7f0d277fe640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d280b9720 0x7f0d2815ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.707+0000 7f0d277fe640 1 -- 172.21.15.55:0/275178654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d280ceeb0 msgr2=0x7f0d2815e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.707+0000 7f0d277fe640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d280ceeb0 0x7f0d2815e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.707+0000 7f0d277fe640 1 -- 172.21.15.55:0/275178654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2815d860 con 0x7f0d28161090 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.707+0000 7f0d277fe640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d28161090 0x7f0d281f6b00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000c7d0 tx=0x7f0d2000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.707+0000 7f0d0f7fe640 1 -- 172.21.15.55:0/275178654 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20003b70 con 0x7f0d28161090 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.707+0000 7f0d0f7fe640 1 -- 172.21.15.55:0/275178654 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d20003d30 con 0x7f0d28161090 2024-04-25T08:55:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.707+0000 7f0d0f7fe640 1 -- 172.21.15.55:0/275178654 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000aa90 con 0x7f0d28161090 2024-04-25T08:55:05.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.707+0000 7f0d2d79e640 1 -- 172.21.15.55:0/275178654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2815db40 con 0x7f0d28161090 2024-04-25T08:55:05.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.707+0000 7f0d2d79e640 1 -- 172.21.15.55:0/275178654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2815e100 con 0x7f0d28161090 2024-04-25T08:55:05.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.708+0000 7f0d2d79e640 1 -- 172.21.15.55:0/275178654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d280750b0 con 0x7f0d28161090 2024-04-25T08:55:05.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.708+0000 7f0d0f7fe640 1 -- 172.21.15.55:0/275178654 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d2000ac30 con 0x7f0d28161090 2024-04-25T08:55:05.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.709+0000 7f0d0f7fe640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d1406b4d0 0x7f0d1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:05.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.709+0000 7f0d0f7fe640 1 -- 172.21.15.55:0/275178654 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0d2008a0d0 con 0x7f0d28161090 2024-04-25T08:55:05.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.709+0000 7f0d26ffd640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d1406b4d0 0x7f0d1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:05.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.709+0000 7f0d26ffd640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d1406b4d0 0x7f0d1406d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0d18034000 tx=0x7f0d1802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:05.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.713+0000 7f0d0f7fe640 1 -- 172.21.15.55:0/275178654 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0d20058800 con 0x7f0d28161090 2024-04-25T08:55:05.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:05.896+0000 7f0d2d79e640 1 -- 172.21.15.55:0/275178654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0d280d1700 con 0x7f0d28161090 2024-04-25T08:55:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.729+0000 7f0d0f7fe640 1 -- 172.21.15.55:0/275178654 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0d2005c8a0 con 0x7f0d28161090 2024-04-25T08:55:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:55:06.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 -- 172.21.15.55:0/275178654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d1406b4d0 msgr2=0x7f0d1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:06.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d1406b4d0 0x7f0d1406d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0d18034000 tx=0x7f0d1802e000 comp rx=0 tx=0).stop 2024-04-25T08:55:06.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 -- 172.21.15.55:0/275178654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d28161090 msgr2=0x7f0d281f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:06.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d28161090 0x7f0d281f6b00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000c7d0 tx=0x7f0d2000cc90 comp rx=0 tx=0).stop 2024-04-25T08:55:06.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 -- 172.21.15.55:0/275178654 shutdown_connections 2024-04-25T08:55:06.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d1406b4d0 0x7f0d1406d990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:06.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d28161090 0x7f0d281f6b00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:06.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d280ceeb0 0x7f0d2815e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:06.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 --2- 172.21.15.55:0/275178654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d280b9720 0x7f0d2815ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:06.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 -- 172.21.15.55:0/275178654 >> 172.21.15.55:0/275178654 conn(0x7f0d280b55e0 msgr2=0x7f0d280d3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:06.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 -- 172.21.15.55:0/275178654 shutdown_connections 2024-04-25T08:55:06.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.732+0000 7f0d2d79e640 1 -- 172.21.15.55:0/275178654 wait complete. 2024-04-25T08:55:06.738 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:55:06.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.860+0000 7f2b615f9640 1 Processor -- start 2024-04-25T08:55:06.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.860+0000 7f2b615f9640 1 -- start start 2024-04-25T08:55:06.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b615f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b5c15b910 0x7f2b5c0cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:06.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b615f9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b5c15e0b0 0x7f2b5c0d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:06.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b615f9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c15f2d0 con 0x7f2b5c15e510 2024-04-25T08:55:06.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b615f9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c15e9d0 con 0x7f2b5c15b910 2024-04-25T08:55:06.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b615f9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c15ecb0 con 0x7f2b5c15e0b0 2024-04-25T08:55:06.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b5affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b5c15b910 0x7f2b5c0cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b5affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b5c15b910 0x7f2b5c0cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51656/0 (socket says 172.21.15.55:51656) 2024-04-25T08:55:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b5affd640 1 -- 172.21.15.55:0/1447551258 learned_addr learned my addr 172.21.15.55:0/1447551258 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b5a7fc640 1 --2- 172.21.15.55:0/1447551258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b5c15e0b0 0x7f2b5c0d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b5affd640 1 -- 172.21.15.55:0/1447551258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b5c15e0b0 msgr2=0x7f2b5c0d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b5affd640 1 --2- 172.21.15.55:0/1447551258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b5c15e0b0 0x7f2b5c0d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b5affd640 1 -- 172.21.15.55:0/1447551258 >> v1:172.21.15.167:6789/0 conn(0x7f2b5c15e510 legacy=0x7f2b5c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.861+0000 7f2b5affd640 1 -- 172.21.15.55:0/1447551258 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c15ef90 con 0x7f2b5c15b910 2024-04-25T08:55:06.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.862+0000 7f2b5affd640 1 --2- 172.21.15.55:0/1447551258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5c15b910 0x7f2b5c0cece0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009870 tx=0x7f2b5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b12c376ed73c96a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:06.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.862+0000 7f2b59ffb640 1 -- 172.21.15.55:0/1447551258 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54037070 con 0x7f2b5c15b910 2024-04-25T08:55:06.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.862+0000 7f2b59ffb640 1 -- 172.21.15.55:0/1447551258 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b54032440 con 0x7f2b5c15b910 2024-04-25T08:55:06.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.862+0000 7f2b59ffb640 1 -- 172.21.15.55:0/1447551258 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54032810 con 0x7f2b5c15b910 2024-04-25T08:55:06.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.863+0000 7f2b615f9640 1 -- 172.21.15.55:0/1447551258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5c15b910 msgr2=0x7f2b5c0cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:06.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.863+0000 7f2b615f9640 1 --2- 172.21.15.55:0/1447551258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5c15b910 0x7f2b5c0cece0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009870 tx=0x7f2b5402a270 comp rx=0 tx=0).stop 2024-04-25T08:55:06.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.863+0000 7f2b615f9640 1 -- 172.21.15.55:0/1447551258 shutdown_connections 2024-04-25T08:55:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.863+0000 7f2b615f9640 1 --2- 172.21.15.55:0/1447551258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b5c15e0b0 0x7f2b5c0d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.863+0000 7f2b615f9640 1 --2- 172.21.15.55:0/1447551258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5c15b910 0x7f2b5c0cece0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.863+0000 7f2b615f9640 1 -- 172.21.15.55:0/1447551258 >> 172.21.15.55:0/1447551258 conn(0x7f2b5c0726c0 msgr2=0x7f2b5c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.863+0000 7f2b615f9640 1 -- 172.21.15.55:0/1447551258 shutdown_connections 2024-04-25T08:55:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.863+0000 7f2b615f9640 1 -- 172.21.15.55:0/1447551258 wait complete. 2024-04-25T08:55:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.864+0000 7f2b615f9640 1 Processor -- start 2024-04-25T08:55:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.864+0000 7f2b615f9640 1 -- start start 2024-04-25T08:55:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b615f9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b5c15b910 0x7f2b5c15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b615f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5c15e0b0 0x7f2b5c14fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b615f9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b5c15e510 0x7f2b5c150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b615f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c160c20 con 0x7f2b5c15e0b0 2024-04-25T08:55:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b615f9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c160aa0 con 0x7f2b5c15b910 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b615f9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c160da0 con 0x7f2b5c15e510 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b5a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5c15e0b0 0x7f2b5c14fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b5a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5c15e0b0 0x7f2b5c14fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51672/0 (socket says 172.21.15.55:51672) 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b5a7fc640 1 -- 172.21.15.55:0/2023498867 learned_addr learned my addr 172.21.15.55:0/2023498867 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b5affd640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b5c15b910 0x7f2b5c15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b5b7fe640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b5c15e510 0x7f2b5c150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b5a7fc640 1 -- 172.21.15.55:0/2023498867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b5c15e510 msgr2=0x7f2b5c150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b5a7fc640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b5c15e510 0x7f2b5c150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b5a7fc640 1 -- 172.21.15.55:0/2023498867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b5c15b910 msgr2=0x7f2b5c15fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b5a7fc640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b5c15b910 0x7f2b5c15fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.865+0000 7f2b5a7fc640 1 -- 172.21.15.55:0/2023498867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c0c8c70 con 0x7f2b5c15e0b0 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.866+0000 7f2b5a7fc640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5c15e0b0 0x7f2b5c14fdf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400d800 tx=0x7f2b4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.866+0000 7f2b537fe640 1 -- 172.21.15.55:0/2023498867 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400b6c0 con 0x7f2b5c15e0b0 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.866+0000 7f2b537fe640 1 -- 172.21.15.55:0/2023498867 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b44019070 con 0x7f2b5c15e0b0 2024-04-25T08:55:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.866+0000 7f2b615f9640 1 -- 172.21.15.55:0/2023498867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c0c8f50 con 0x7f2b5c15e0b0 2024-04-25T08:55:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.866+0000 7f2b537fe640 1 -- 172.21.15.55:0/2023498867 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400ba80 con 0x7f2b5c15e0b0 2024-04-25T08:55:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.866+0000 7f2b615f9640 1 -- 172.21.15.55:0/2023498867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c0c9230 con 0x7f2b5c15e0b0 2024-04-25T08:55:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.867+0000 7f2b615f9640 1 -- 172.21.15.55:0/2023498867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5c0750b0 con 0x7f2b5c15e0b0 2024-04-25T08:55:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.867+0000 7f2b537fe640 1 -- 172.21.15.55:0/2023498867 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2b4400bc20 con 0x7f2b5c15e0b0 2024-04-25T08:55:06.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.868+0000 7f2b537fe640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2b3c06b4d0 0x7f2b3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:06.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.868+0000 7f2b5affd640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2b3c06b4d0 0x7f2b3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:06.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.868+0000 7f2b537fe640 1 -- 172.21.15.55:0/2023498867 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f2b4408a550 con 0x7f2b5c15e0b0 2024-04-25T08:55:06.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.868+0000 7f2b5affd640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2b3c06b4d0 0x7f2b3c06d990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2b54034000 tx=0x7f2b5402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:06.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:06.872+0000 7f2b537fe640 1 -- 172.21.15.55:0/2023498867 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2b44059530 con 0x7f2b5c15e0b0 2024-04-25T08:55:07.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.060+0000 7f2b615f9640 1 -- 172.21.15.55:0/2023498867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2b5c15b210 con 0x7f2b5c15e0b0 2024-04-25T08:55:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.731+0000 7f2b537fe640 1 -- 172.21.15.55:0/2023498867 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2b44058e30 con 0x7f2b5c15e0b0 2024-04-25T08:55:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-25T08:55:07.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.735+0000 7f2b615f9640 1 -- 172.21.15.55:0/2023498867 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2b3c06b4d0 msgr2=0x7f2b3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:07.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.735+0000 7f2b615f9640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2b3c06b4d0 0x7f2b3c06d990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2b54034000 tx=0x7f2b5402e000 comp rx=0 tx=0).stop 2024-04-25T08:55:07.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.735+0000 7f2b615f9640 1 -- 172.21.15.55:0/2023498867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5c15e0b0 msgr2=0x7f2b5c14fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.735+0000 7f2b615f9640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5c15e0b0 0x7f2b5c14fdf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400d800 tx=0x7f2b4400dcc0 comp rx=0 tx=0).stop 2024-04-25T08:55:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.735+0000 7f2b615f9640 1 -- 172.21.15.55:0/2023498867 shutdown_connections 2024-04-25T08:55:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.735+0000 7f2b615f9640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2b3c06b4d0 0x7f2b3c06d990 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2b54034000 tx=0x7f2b5402e000 comp rx=0 tx=0).stop 2024-04-25T08:55:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.735+0000 7f2b615f9640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b5c15e510 0x7f2b5c150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.735+0000 7f2b615f9640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5c15e0b0 0x7f2b5c14fdf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.735+0000 7f2b615f9640 1 --2- 172.21.15.55:0/2023498867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b5c15b910 0x7f2b5c15fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.735+0000 7f2b615f9640 1 -- 172.21.15.55:0/2023498867 >> 172.21.15.55:0/2023498867 conn(0x7f2b5c0726c0 msgr2=0x7f2b5c0b89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.736+0000 7f2b615f9640 1 -- 172.21.15.55:0/2023498867 shutdown_connections 2024-04-25T08:55:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.736+0000 7f2b615f9640 1 -- 172.21.15.55:0/2023498867 wait complete. 2024-04-25T08:55:07.745 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:55:07.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.865+0000 7f2aa245a640 1 Processor -- start 2024-04-25T08:55:07.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.865+0000 7f2aa245a640 1 -- start start 2024-04-25T08:55:07.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.866+0000 7f2aa245a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a9c0b7030 0x7f2a9c0b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:07.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.866+0000 7f2aa245a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a9c0ce230 0x7f2a9c0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:07.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.866+0000 7f2aa245a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9c0cfcf0 con 0x7f2a9c15ba70 2024-04-25T08:55:07.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.866+0000 7f2aa245a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9c0cffd0 con 0x7f2a9c0b7030 2024-04-25T08:55:07.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.866+0000 7f2aa245a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c0d02b0 con 0x7f2a9c0ce230 2024-04-25T08:55:07.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.866+0000 7f2a9b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a9c0b7030 0x7f2a9c0b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:07.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.866+0000 7f2a9b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a9c0b7030 0x7f2a9c0b74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51682/0 (socket says 172.21.15.55:51682) 2024-04-25T08:55:07.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.866+0000 7f2a9b7fe640 1 -- 172.21.15.55:0/579680469 learned_addr learned my addr 172.21.15.55:0/579680469 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:07.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.866+0000 7f2aa09f7640 1 --2- 172.21.15.55:0/579680469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a9c0ce230 0x7f2a9c0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:07.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.866+0000 7f2a9b7fe640 1 -- 172.21.15.55:0/579680469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a9c0ce230 msgr2=0x7f2a9c0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:07.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.866+0000 7f2a9b7fe640 1 --2- 172.21.15.55:0/579680469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a9c0ce230 0x7f2a9c0ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:07.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.867+0000 7f2a9b7fe640 1 -- 172.21.15.55:0/579680469 >> v1:172.21.15.167:6789/0 conn(0x7f2a9c15ba70 legacy=0x7f2a9c0d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:07.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.867+0000 7f2a9b7fe640 1 -- 172.21.15.55:0/579680469 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c0d0590 con 0x7f2a9c0b7030 2024-04-25T08:55:07.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.867+0000 7f2a9b7fe640 1 --2- 172.21.15.55:0/579680469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0b7030 0x7f2a9c0b74c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009870 tx=0x7f2a8c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef12a369a511cc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:07.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.867+0000 7f2a9affd640 1 -- 172.21.15.55:0/579680469 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c037070 con 0x7f2a9c0b7030 2024-04-25T08:55:07.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.867+0000 7f2a9affd640 1 -- 172.21.15.55:0/579680469 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c032440 con 0x7f2a9c0b7030 2024-04-25T08:55:07.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.867+0000 7f2a9affd640 1 -- 172.21.15.55:0/579680469 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c032810 con 0x7f2a9c0b7030 2024-04-25T08:55:07.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.868+0000 7f2aa245a640 1 -- 172.21.15.55:0/579680469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0b7030 msgr2=0x7f2a9c0b74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:07.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.868+0000 7f2aa245a640 1 --2- 172.21.15.55:0/579680469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0b7030 0x7f2a9c0b74c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009870 tx=0x7f2a8c02a1c0 comp rx=0 tx=0).stop 2024-04-25T08:55:07.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.868+0000 7f2aa245a640 1 -- 172.21.15.55:0/579680469 shutdown_connections 2024-04-25T08:55:07.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.868+0000 7f2aa245a640 1 --2- 172.21.15.55:0/579680469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a9c0ce230 0x7f2a9c0ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:07.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.868+0000 7f2aa245a640 1 --2- 172.21.15.55:0/579680469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0b7030 0x7f2a9c0b74c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:07.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.868+0000 7f2aa245a640 1 -- 172.21.15.55:0/579680469 >> 172.21.15.55:0/579680469 conn(0x7f2a9c06f4a0 msgr2=0x7f2a9c06f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:07.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.868+0000 7f2aa245a640 1 -- 172.21.15.55:0/579680469 shutdown_connections 2024-04-25T08:55:07.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.868+0000 7f2aa245a640 1 -- 172.21.15.55:0/579680469 wait complete. 2024-04-25T08:55:07.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.869+0000 7f2aa245a640 1 Processor -- start 2024-04-25T08:55:07.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.869+0000 7f2aa245a640 1 -- start start 2024-04-25T08:55:07.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.870+0000 7f2aa245a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a9c0b7030 0x7f2a9c153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:07.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.870+0000 7f2aa245a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0ce230 0x7f2a9c155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:07.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.870+0000 7f2aa245a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a9c15ba70 0x7f2a9c0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:07.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.870+0000 7f2aa245a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c0cf980 con 0x7f2a9c0ce230 2024-04-25T08:55:07.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.870+0000 7f2aa245a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c0cebe0 con 0x7f2a9c15ba70 2024-04-25T08:55:07.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.870+0000 7f2aa245a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c15be50 con 0x7f2a9c0b7030 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.870+0000 7f2a9b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0ce230 0x7f2a9c155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.870+0000 7f2a9b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0ce230 0x7f2a9c155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51692/0 (socket says 172.21.15.55:51692) 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.870+0000 7f2a9b7fe640 1 -- 172.21.15.55:0/80965139 learned_addr learned my addr 172.21.15.55:0/80965139 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.870+0000 7f2aa09f7640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a9c15ba70 0x7f2a9c0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2a9bfff640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a9c0b7030 0x7f2a9c153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2a9b7fe640 1 -- 172.21.15.55:0/80965139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a9c0b7030 msgr2=0x7f2a9c153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2a9b7fe640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a9c0b7030 0x7f2a9c153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2a9b7fe640 1 -- 172.21.15.55:0/80965139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a9c15ba70 msgr2=0x7f2a9c0c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2a9b7fe640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a9c15ba70 0x7f2a9c0c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2a9b7fe640 1 -- 172.21.15.55:0/80965139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c0b1250 con 0x7f2a9c0ce230 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2aa09f7640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a9c15ba70 0x7f2a9c0c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2a9b7fe640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0ce230 0x7f2a9c155d80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c000c00 tx=0x7f2a8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2a98ff9640 1 -- 172.21.15.55:0/80965139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c041020 con 0x7f2a9c0ce230 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2a98ff9640 1 -- 172.21.15.55:0/80965139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c0306c0 con 0x7f2a9c0ce230 2024-04-25T08:55:07.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2aa245a640 1 -- 172.21.15.55:0/80965139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9c0b1530 con 0x7f2a9c0ce230 2024-04-25T08:55:07.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2a98ff9640 1 -- 172.21.15.55:0/80965139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c037040 con 0x7f2a9c0ce230 2024-04-25T08:55:07.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.871+0000 7f2aa245a640 1 -- 172.21.15.55:0/80965139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9c0b1af0 con 0x7f2a9c0ce230 2024-04-25T08:55:07.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.872+0000 7f2aa245a640 1 -- 172.21.15.55:0/80965139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9c0750b0 con 0x7f2a9c0ce230 2024-04-25T08:55:07.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.873+0000 7f2a98ff9640 1 -- 172.21.15.55:0/80965139 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2a8c044020 con 0x7f2a9c0ce230 2024-04-25T08:55:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.873+0000 7f2a98ff9640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a7c06b4d0 0x7f2a7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.873+0000 7f2a98ff9640 1 -- 172.21.15.55:0/80965139 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2a8c0aa6d0 con 0x7f2a9c0ce230 2024-04-25T08:55:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.873+0000 7f2a9bfff640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a7c06b4d0 0x7f2a7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.874+0000 7f2a9bfff640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a7c06b4d0 0x7f2a7c06d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2a84000f60 tx=0x7f2a84009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:07.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:07.877+0000 7f2a98ff9640 1 -- 172.21.15.55:0/80965139 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2a8c04b030 con 0x7f2a9c0ce230 2024-04-25T08:55:08.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.061+0000 7f2aa245a640 1 -- 172.21.15.55:0/80965139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2a9c0cbcb0 con 0x7f2a9c0ce230 2024-04-25T08:55:08.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.064+0000 7f2a98ff9640 1 -- 172.21.15.55:0/80965139 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2a8c079850 con 0x7f2a9c0ce230 2024-04-25T08:55:08.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.066+0000 7f2aa245a640 1 -- 172.21.15.55:0/80965139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a7c06b4d0 msgr2=0x7f2a7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.066+0000 7f2aa245a640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a7c06b4d0 0x7f2a7c06d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2a84000f60 tx=0x7f2a84009040 comp rx=0 tx=0).stop 2024-04-25T08:55:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.066+0000 7f2aa245a640 1 -- 172.21.15.55:0/80965139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0ce230 msgr2=0x7f2a9c155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.066+0000 7f2aa245a640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0ce230 0x7f2a9c155d80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c000c00 tx=0x7f2a8c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.066+0000 7f2aa245a640 1 -- 172.21.15.55:0/80965139 shutdown_connections 2024-04-25T08:55:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.066+0000 7f2aa245a640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a7c06b4d0 0x7f2a7c06d990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.066+0000 7f2aa245a640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a9c15ba70 0x7f2a9c0c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.066+0000 7f2aa245a640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0ce230 0x7f2a9c155d80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.066+0000 7f2aa245a640 1 --2- 172.21.15.55:0/80965139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a9c0b7030 0x7f2a9c153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.066+0000 7f2aa245a640 1 -- 172.21.15.55:0/80965139 >> 172.21.15.55:0/80965139 conn(0x7f2a9c06f4a0 msgr2=0x7f2a9c15cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.067+0000 7f2aa245a640 1 -- 172.21.15.55:0/80965139 shutdown_connections 2024-04-25T08:55:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.067+0000 7f2aa245a640 1 -- 172.21.15.55:0/80965139 wait complete. 2024-04-25T08:55:08.067 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T08:55:08.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.179+0000 7f0059bb0640 1 Processor -- start 2024-04-25T08:55:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.179+0000 7f0059bb0640 1 -- start start 2024-04-25T08:55:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.179+0000 7f0059bb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540ceeb0 0x7f0054168770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.179+0000 7f0059bb0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540d2440 con 0x7f005415dd50 2024-04-25T08:55:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.179+0000 7f0059bb0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540d2720 con 0x7f00540b9460 2024-04-25T08:55:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.179+0000 7f0059bb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00540d2a00 con 0x7f00540ceeb0 2024-04-25T08:55:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00537fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f005415dd50 0x7f00540d1c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48432/0 (socket says 172.21.15.55:48432) 2024-04-25T08:55:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00537fe640 1 -- 172.21.15.55:0/3446617347 learned_addr learned my addr 172.21.15.55:0/3446617347 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f0053fff640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540ceeb0 0x7f0054168770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85090313 0 0) 0x7f00540d2440 con 0x7f005415dd50 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0040003520 con 0x7f005415dd50 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095984858 0 0) 0x7f00540d2720 con 0x7f00540b9460 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00540d2440 con 0x7f00540b9460 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2554056708 0 0) 0x7f0040003520 con 0x7f005415dd50 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540ceeb0 msgr2=0x7f0054168770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540ceeb0 0x7f0054168770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 >> v1:172.21.15.167:6789/0 conn(0x7f00540b9460 legacy=0x7f00540ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540d2ce0 con 0x7f005415dd50 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f0044001670 con 0x7f005415dd50 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f0053fff640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540ceeb0 0x7f0054168770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 >> v1:172.21.15.55:6789/0 conn(0x7f005415dd50 legacy=0x7f00540d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540ceeb0 0x7f0040003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400040b0 0x7f0040004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0040004d40 0x7f00400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540d2a00 con 0x7f00400040b0 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004000bb00 con 0x7f0040004d40 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004000bd00 con 0x7f00540ceeb0 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.180+0000 7f0052ffd640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400040b0 0x7f0040004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.181+0000 7f0053fff640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0040004d40 0x7f00400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.181+0000 7f00537fe640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540ceeb0 0x7f0040003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.181+0000 7f0052ffd640 1 -- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540ceeb0 msgr2=0x7f0040003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.181+0000 7f0052ffd640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540ceeb0 0x7f0040003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.181+0000 7f0052ffd640 1 -- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0040004d40 msgr2=0x7f00400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.181+0000 7f0052ffd640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0040004d40 0x7f00400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.181+0000 7f0052ffd640 1 -- 172.21.15.55:0/3446617347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040003520 con 0x7f00400040b0 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.181+0000 7f0052ffd640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400040b0 0x7f0040004800 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f003c0018d0 tx=0x7f0040005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4622f86c2b3c61c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.182+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0014f0 con 0x7f00400040b0 2024-04-25T08:55:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.182+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c0052d0 con 0x7f00400040b0 2024-04-25T08:55:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.182+0000 7f00527fc640 1 -- 172.21.15.55:0/3446617347 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c02aca0 con 0x7f00400040b0 2024-04-25T08:55:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.182+0000 7f0059bb0640 1 -- 172.21.15.55:0/3446617347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400040b0 msgr2=0x7f0040004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.182+0000 7f0059bb0640 1 --2- 172.21.15.55:0/3446617347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400040b0 0x7f0040004800 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f003c0018d0 tx=0x7f0040005830 comp rx=0 tx=0).stop 2024-04-25T08:55:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.182+0000 7f0053fff640 1 -- 172.21.15.55:0/3446617347 reap_dead start 2024-04-25T08:55:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.182+0000 7f0059bb0640 1 -- 172.21.15.55:0/3446617347 shutdown_connections 2024-04-25T08:55:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.182+0000 7f0059bb0640 1 -- 172.21.15.55:0/3446617347 >> 172.21.15.55:0/3446617347 conn(0x7f00540722d0 msgr2=0x7f00540726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.182+0000 7f0059bb0640 1 -- 172.21.15.55:0/3446617347 shutdown_connections 2024-04-25T08:55:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.182+0000 7f0059bb0640 1 -- 172.21.15.55:0/3446617347 wait complete. 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.183+0000 7f0059bb0640 1 Processor -- start 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f0059bb0640 1 -- start start 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f0059bb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00400040b0 0x7f0054149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f0059bb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540b3510 0x7f00540caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f0059bb0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f005414a4f0 0x7f00540c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f0059bb0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540d3660 con 0x7f005414a4f0 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f0059bb0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540d34e0 con 0x7f00400040b0 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f0059bb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00540d37e0 con 0x7f00540b3510 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f0053fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f005414a4f0 0x7f00540c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f0053fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f005414a4f0 0x7f00540c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51716/0 (socket says 172.21.15.55:51716) 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f0053fff640 1 -- 172.21.15.55:0/3642367791 learned_addr learned my addr 172.21.15.55:0/3642367791 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f00537fe640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00400040b0 0x7f0054149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.184+0000 7f0052ffd640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540b3510 0x7f00540caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f0053fff640 1 -- 172.21.15.55:0/3642367791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540b3510 msgr2=0x7f00540caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f0053fff640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540b3510 0x7f00540caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f0053fff640 1 -- 172.21.15.55:0/3642367791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00400040b0 msgr2=0x7f0054149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f0053fff640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00400040b0 0x7f0054149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f0053fff640 1 -- 172.21.15.55:0/3642367791 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540cb510 con 0x7f005414a4f0 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f0052ffd640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540b3510 0x7f00540caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f0053fff640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f005414a4f0 0x7f00540c9630 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f004c009ed0 tx=0x7f004c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f004bfff640 1 -- 172.21.15.55:0/3642367791 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00fdb0 con 0x7f005414a4f0 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f004bfff640 1 -- 172.21.15.55:0/3642367791 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c003990 con 0x7f005414a4f0 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f004bfff640 1 -- 172.21.15.55:0/3642367791 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c003d80 con 0x7f005414a4f0 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f0059bb0640 1 -- 172.21.15.55:0/3642367791 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00540cb7f0 con 0x7f005414a4f0 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.185+0000 7f0059bb0640 1 -- 172.21.15.55:0/3642367791 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00540cbdb0 con 0x7f005414a4f0 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.186+0000 7f0059bb0640 1 -- 172.21.15.55:0/3642367791 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0054067850 con 0x7f005414a4f0 2024-04-25T08:55:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.187+0000 7f004bfff640 1 -- 172.21.15.55:0/3642367791 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f004c004030 con 0x7f005414a4f0 2024-04-25T08:55:08.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.187+0000 7f004bfff640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f003406b500 0x7f003406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.187+0000 7f004bfff640 1 -- 172.21.15.55:0/3642367791 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f004c08a7d0 con 0x7f005414a4f0 2024-04-25T08:55:08.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.187+0000 7f00537fe640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f003406b500 0x7f003406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.188+0000 7f00537fe640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f003406b500 0x7f003406d9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0044001200 tx=0x7f0044001e40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:08.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.191+0000 7f004bfff640 1 -- 172.21.15.55:0/3642367791 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f004c019070 con 0x7f005414a4f0 2024-04-25T08:55:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.444+0000 7f0059bb0640 1 -- 172.21.15.55:0/3642367791 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f00540d1750 con 0x7f005414a4f0 2024-04-25T08:55:08.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.742+0000 7f004bfff640 1 -- 172.21.15.55:0/3642367791 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v101) v1 ==== 142+0+0 (secure 0 0 0) 0x7f004c010040 con 0x7f005414a4f0 2024-04-25T08:55:08.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.744+0000 7f0059bb0640 1 -- 172.21.15.55:0/3642367791 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f003406b500 msgr2=0x7f003406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.744+0000 7f0059bb0640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f003406b500 0x7f003406d9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0044001200 tx=0x7f0044001e40 comp rx=0 tx=0).stop 2024-04-25T08:55:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.744+0000 7f0059bb0640 1 -- 172.21.15.55:0/3642367791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f005414a4f0 msgr2=0x7f00540c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.744+0000 7f0059bb0640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f005414a4f0 0x7f00540c9630 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f004c009ed0 tx=0x7f004c00f580 comp rx=0 tx=0).stop 2024-04-25T08:55:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.744+0000 7f0059bb0640 1 -- 172.21.15.55:0/3642367791 shutdown_connections 2024-04-25T08:55:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.745+0000 7f0059bb0640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f003406b500 0x7f003406d9c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.745+0000 7f0059bb0640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f005414a4f0 0x7f00540c9630 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.745+0000 7f0059bb0640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00540b3510 0x7f00540caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.745+0000 7f0059bb0640 1 --2- 172.21.15.55:0/3642367791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00400040b0 0x7f0054149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.745+0000 7f0059bb0640 1 -- 172.21.15.55:0/3642367791 >> 172.21.15.55:0/3642367791 conn(0x7f00540722d0 msgr2=0x7f005415b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.745+0000 7f0059bb0640 1 -- 172.21.15.55:0/3642367791 shutdown_connections 2024-04-25T08:55:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.745+0000 7f0059bb0640 1 -- 172.21.15.55:0/3642367791 wait complete. 2024-04-25T08:55:08.747 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T08:55:08.747 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-04-25T08:55:08.747 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T08:55:08.747 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:55:08.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.861+0000 7fbeb2c6b640 1 Processor -- start 2024-04-25T08:55:08.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.861+0000 7fbeb2c6b640 1 -- start start 2024-04-25T08:55:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbeb2c6b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac15a870 0x7fbeac0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbeb2c6b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbeac0cfc40 0x7fbeac15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbeb2c6b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac0cdb10 con 0x7fbeac06e2e0 2024-04-25T08:55:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbeb2c6b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac0ce720 con 0x7fbeac0cfc40 2024-04-25T08:55:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbeb2c6b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0cddf0 con 0x7fbeac15a870 2024-04-25T08:55:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbea3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbeac06e2e0 0x7fbeac0cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41638/0 (socket says 172.21.15.55:41638) 2024-04-25T08:55:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbea3fff640 1 -- 172.21.15.55:0/1760750733 learned_addr learned my addr 172.21.15.55:0/1760750733 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425482813 0 0) 0x7fbeac0cdb10 con 0x7fbeac06e2e0 2024-04-25T08:55:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe94005730 con 0x7fbeac06e2e0 2024-04-25T08:55:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbeb1208640 1 --2- 172.21.15.55:0/1760750733 >> v2:172.21.15.167:3300/0 conn(0x7fbeac0cfc40 0x7fbeac15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbeb0a07640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac15a870 0x7fbeac0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2656083839 0 0) 0x7fbe94005730 con 0x7fbeac06e2e0 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac15a870 msgr2=0x7fbeac0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbea37fe640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac15a870 0x7fbeac0cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 >> v2:172.21.15.167:3300/0 conn(0x7fbeac0cfc40 msgr2=0x7fbeac15ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbea37fe640 1 --2- 172.21.15.55:0/1760750733 >> v2:172.21.15.167:3300/0 conn(0x7fbeac0cfc40 0x7fbeac15ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac0ce0d0 con 0x7fbeac06e2e0 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.862+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fbe9c001670 con 0x7fbeac06e2e0 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 >> v1:172.21.15.55:6789/0 conn(0x7fbeac06e2e0 legacy=0x7fbeac0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbea37fe640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe94005bc0 0x7fbe94005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbea37fe640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac15a870 0x7fbe94006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbea37fe640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe94006f50 0x7fbe940073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0ce720 con 0x7fbe94006f50 2024-04-25T08:55:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0cddf0 con 0x7fbe94005bc0 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9400dbd0 con 0x7fbeac15a870 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbeb1208640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe94006f50 0x7fbe940073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbeb0a07640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe94005bc0 0x7fbe94005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbea3fff640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac15a870 0x7fbe94006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbeb1208640 1 -- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac15a870 msgr2=0x7fbe94006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbeb1208640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac15a870 0x7fbe94006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbeb1208640 1 -- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe94005bc0 msgr2=0x7fbe94005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbeb1208640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe94005bc0 0x7fbe94005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbeb1208640 1 -- 172.21.15.55:0/1760750733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe94005730 con 0x7fbe94006f50 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.863+0000 7fbeb0a07640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe94005bc0 0x7fbe94005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.864+0000 7fbeb1208640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe94006f50 0x7fbe940073d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009f90 tx=0x7fbe94007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f781a6dbe3e09f9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.864+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4009c10 con 0x7fbe94006f50 2024-04-25T08:55:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.864+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea4036070 con 0x7fbe94006f50 2024-04-25T08:55:08.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.864+0000 7fbea37fe640 1 -- 172.21.15.55:0/1760750733 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4031880 con 0x7fbe94006f50 2024-04-25T08:55:08.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.864+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/1760750733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe94006f50 msgr2=0x7fbe940073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.864+0000 7fbeb2c6b640 1 --2- 172.21.15.55:0/1760750733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe94006f50 0x7fbe940073d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009f90 tx=0x7fbe94007a40 comp rx=0 tx=0).stop 2024-04-25T08:55:08.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.864+0000 7fbeb1208640 1 -- 172.21.15.55:0/1760750733 reap_dead start 2024-04-25T08:55:08.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.864+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/1760750733 shutdown_connections 2024-04-25T08:55:08.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.864+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/1760750733 >> 172.21.15.55:0/1760750733 conn(0x7fbeac06aba0 msgr2=0x7fbeac06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:08.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.864+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/1760750733 shutdown_connections 2024-04-25T08:55:08.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.865+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/1760750733 wait complete. 2024-04-25T08:55:08.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.866+0000 7fbeb2c6b640 1 Processor -- start 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.866+0000 7fbeb2c6b640 1 -- start start 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb2c6b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac152a10 0x7fbeac1e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb2c6b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac1e3520 0x7fbeac159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb2c6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeac152df0 0x7fbeac159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb2c6b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0cd700 con 0x7fbeac152df0 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb2c6b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0cd580 con 0x7fbeac1e3520 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb2c6b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0cd880 con 0x7fbeac152a10 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb1208640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeac152df0 0x7fbeac159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb1208640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeac152df0 0x7fbeac159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42440/0 (socket says 172.21.15.55:42440) 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb1208640 1 -- 172.21.15.55:0/3392006464 learned_addr learned my addr 172.21.15.55:0/3392006464 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbea3fff640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac1e3520 0x7fbeac159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb0a07640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac152a10 0x7fbeac1e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb1208640 1 -- 172.21.15.55:0/3392006464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac152a10 msgr2=0x7fbeac1e2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb1208640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac152a10 0x7fbeac1e2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb1208640 1 -- 172.21.15.55:0/3392006464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac1e3520 msgr2=0x7fbeac159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb1208640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac1e3520 0x7fbeac159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb1208640 1 -- 172.21.15.55:0/3392006464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac158690 con 0x7fbeac152df0 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbeb1208640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeac152df0 0x7fbeac159c70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009f90 tx=0x7fbea4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.867+0000 7fbea17fa640 1 -- 172.21.15.55:0/3392006464 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea8009690 con 0x7fbeac152df0 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.868+0000 7fbea17fa640 1 -- 172.21.15.55:0/3392006464 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea4031dd0 con 0x7fbeac152df0 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.868+0000 7fbea17fa640 1 -- 172.21.15.55:0/3392006464 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4009c10 con 0x7fbeac152df0 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.868+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/3392006464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac158970 con 0x7fbeac152df0 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.868+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/3392006464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac158f30 con 0x7fbeac152df0 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.869+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/3392006464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac0749b0 con 0x7fbeac152df0 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.869+0000 7fbea17fa640 1 -- 172.21.15.55:0/3392006464 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbea4005d10 con 0x7fbeac152df0 2024-04-25T08:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.870+0000 7fbea17fa640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe9806b4d0 0x7fbe9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.870+0000 7fbeb0a07640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe9806b4d0 0x7fbe9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.870+0000 7fbea17fa640 1 -- 172.21.15.55:0/3392006464 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbea40aaf10 con 0x7fbeac152df0 2024-04-25T08:55:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.870+0000 7fbeb0a07640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe9806b4d0 0x7fbe9806d990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbeac1f2b70 tx=0x7fbea8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:08.874+0000 7fbea17fa640 1 -- 172.21.15.55:0/3392006464 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbea404a060 con 0x7fbeac152df0 2024-04-25T08:55:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.054+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/3392006464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbeac0cf6a0 con 0x7fbeac152df0 2024-04-25T08:55:09.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.055+0000 7fbea17fa640 1 -- 172.21.15.55:0/3392006464 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13020 (secure 0 0 0) 0x7fbea407a150 con 0x7fbeac152df0 2024-04-25T08:55:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:09.045 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":39,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:55:07.730455+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/1495159001":"2024-04-26T08:55:04.525117+0000","172.21.15.55:6835/1495159001":"2024-04-26T08:55:04.525117+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/3392006464 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe9806b4d0 msgr2=0x7fbe9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe9806b4d0 0x7fbe9806d990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbeac1f2b70 tx=0x7fbea8009190 comp rx=0 tx=0).stop 2024-04-25T08:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/3392006464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeac152df0 msgr2=0x7fbeac159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeac152df0 0x7fbeac159c70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009f90 tx=0x7fbea4009750 comp rx=0 tx=0).stop 2024-04-25T08:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/3392006464 shutdown_connections 2024-04-25T08:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbe9806b4d0 0x7fbe9806d990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeac152df0 0x7fbeac159c70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac1e3520 0x7fbeac159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 --2- 172.21.15.55:0/3392006464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac152a10 0x7fbeac1e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/3392006464 >> 172.21.15.55:0/3392006464 conn(0x7fbeac06aba0 msgr2=0x7fbeac0af150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:09.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/3392006464 shutdown_connections 2024-04-25T08:55:09.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.057+0000 7fbeb2c6b640 1 -- 172.21.15.55:0/3392006464 wait complete. 2024-04-25T08:55:09.058 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:55:09.059 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:55:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.173+0000 7fb7362a3640 1 Processor -- start 2024-04-25T08:55:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.173+0000 7fb7362a3640 1 -- start start 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.174+0000 7fb7362a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb73015bbe0 0x7fb7300cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.174+0000 7fb7362a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7300cc830 con 0x7fb7300cf510 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.174+0000 7fb7362a3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7300ccb10 con 0x7fb7300d0610 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.174+0000 7fb7362a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7300ccdf0 con 0x7fb73015bbe0 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.174+0000 7fb72ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb73015bbe0 0x7fb7300cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.174+0000 7fb72f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb7300cf510 0x7fb7300cff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41640/0 (socket says 172.21.15.55:41640) 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.174+0000 7fb72f7fe640 1 -- 172.21.15.55:0/1643927428 learned_addr learned my addr 172.21.15.55:0/1643927428 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.174+0000 7fb72ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb73015bbe0 0x7fb7300cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42450/0 (socket says 172.21.15.55:42450) 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.175+0000 7fb72ffff640 1 -- 172.21.15.55:0/1643927428 >> v1:172.21.15.167:6789/0 conn(0x7fb7300d0610 legacy=0x7fb7300c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.175+0000 7fb72ffff640 1 -- 172.21.15.55:0/1643927428 >> v1:172.21.15.55:6789/0 conn(0x7fb7300cf510 legacy=0x7fb7300cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.175+0000 7fb72ffff640 1 -- 172.21.15.55:0/1643927428 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300cd0d0 con 0x7fb73015bbe0 2024-04-25T08:55:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.175+0000 7fb72effd640 1 -- 172.21.15.55:0/1643927428 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932395164 0 0) 0x7fb7300cc830 con 0x7fb7300cf510 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.175+0000 7fb72ffff640 1 --2- 172.21.15.55:0/1643927428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73015bbe0 0x7fb7300cd8d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097a0 tx=0x7fb72002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee67f0821a21d242 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.176+0000 7fb72effd640 1 -- 172.21.15.55:0/1643927428 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720037070 con 0x7fb73015bbe0 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.176+0000 7fb72effd640 1 -- 172.21.15.55:0/1643927428 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb720032440 con 0x7fb73015bbe0 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.176+0000 7fb72effd640 1 -- 172.21.15.55:0/1643927428 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720032810 con 0x7fb73015bbe0 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.176+0000 7fb7362a3640 1 -- 172.21.15.55:0/1643927428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73015bbe0 msgr2=0x7fb7300cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.176+0000 7fb7362a3640 1 --2- 172.21.15.55:0/1643927428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73015bbe0 0x7fb7300cd8d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097a0 tx=0x7fb72002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.176+0000 7fb7362a3640 1 -- 172.21.15.55:0/1643927428 shutdown_connections 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.176+0000 7fb7362a3640 1 --2- 172.21.15.55:0/1643927428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73015bbe0 0x7fb7300cd8d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.176+0000 7fb7362a3640 1 -- 172.21.15.55:0/1643927428 >> 172.21.15.55:0/1643927428 conn(0x7fb7300b3430 msgr2=0x7fb7300b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.176+0000 7fb7362a3640 1 -- 172.21.15.55:0/1643927428 shutdown_connections 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.176+0000 7fb7362a3640 1 -- 172.21.15.55:0/1643927428 wait complete. 2024-04-25T08:55:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.177+0000 7fb7362a3640 1 Processor -- start 2024-04-25T08:55:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb7362a3640 1 -- start start 2024-04-25T08:55:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb7362a3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7300cf510 0x7fb7300cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb7362a3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7300d0610 0x7fb73015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb7362a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73015bbe0 0x7fb730070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb7362a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7300cde10 con 0x7fb73015bbe0 2024-04-25T08:55:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb7362a3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73015bfc0 con 0x7fb7300d0610 2024-04-25T08:55:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb7362a3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7300cc450 con 0x7fb7300cf510 2024-04-25T08:55:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb734840640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73015bbe0 0x7fb730070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb734840640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73015bbe0 0x7fb730070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42464/0 (socket says 172.21.15.55:42464) 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb734840640 1 -- 172.21.15.55:0/785034884 learned_addr learned my addr 172.21.15.55:0/785034884 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb72ffff640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7300cf510 0x7fb7300cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.178+0000 7fb72f7fe640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7300d0610 0x7fb73015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb734840640 1 -- 172.21.15.55:0/785034884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7300cf510 msgr2=0x7fb7300cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb734840640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7300cf510 0x7fb7300cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb734840640 1 -- 172.21.15.55:0/785034884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7300d0610 msgr2=0x7fb73015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb734840640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7300d0610 0x7fb73015e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb734840640 1 -- 172.21.15.55:0/785034884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73015e100 con 0x7fb73015bbe0 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb72ffff640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7300cf510 0x7fb7300cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb734840640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73015bbe0 0x7fb730070640 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c700 tx=0x7fb72800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb72cff9640 1 -- 172.21.15.55:0/785034884 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728016020 con 0x7fb73015bbe0 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb72cff9640 1 -- 172.21.15.55:0/785034884 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72800aa50 con 0x7fb73015bbe0 2024-04-25T08:55:09.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb7362a3640 1 -- 172.21.15.55:0/785034884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73015d790 con 0x7fb73015bbe0 2024-04-25T08:55:09.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb72cff9640 1 -- 172.21.15.55:0/785034884 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800ae40 con 0x7fb73015bbe0 2024-04-25T08:55:09.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.179+0000 7fb7362a3640 1 -- 172.21.15.55:0/785034884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7300cbc60 con 0x7fb73015bbe0 2024-04-25T08:55:09.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.180+0000 7fb7362a3640 1 -- 172.21.15.55:0/785034884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7300750b0 con 0x7fb73015bbe0 2024-04-25T08:55:09.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.180+0000 7fb72cff9640 1 -- 172.21.15.55:0/785034884 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb728019020 con 0x7fb73015bbe0 2024-04-25T08:55:09.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.181+0000 7fb72cff9640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb71c06b4d0 0x7fb71c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.181+0000 7fb72cff9640 1 -- 172.21.15.55:0/785034884 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb72808a160 con 0x7fb73015bbe0 2024-04-25T08:55:09.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.181+0000 7fb72ffff640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb71c06b4d0 0x7fb71c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.181+0000 7fb72ffff640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb71c06b4d0 0x7fb71c06d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb720034000 tx=0x7fb72002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:09.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.185+0000 7fb72cff9640 1 -- 172.21.15.55:0/785034884 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb728020020 con 0x7fb73015bbe0 2024-04-25T08:55:09.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:55:09.235 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:55:09.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.366+0000 7fb7362a3640 1 -- 172.21.15.55:0/785034884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7300b42d0 con 0x7fb73015bbe0 2024-04-25T08:55:09.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.366+0000 7fb72cff9640 1 -- 172.21.15.55:0/785034884 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb728059230 con 0x7fb73015bbe0 2024-04-25T08:55:09.356 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:55:09.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 -- 172.21.15.55:0/785034884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb71c06b4d0 msgr2=0x7fb71c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb71c06b4d0 0x7fb71c06d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb720034000 tx=0x7fb72002e000 comp rx=0 tx=0).stop 2024-04-25T08:55:09.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 -- 172.21.15.55:0/785034884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73015bbe0 msgr2=0x7fb730070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73015bbe0 0x7fb730070640 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c700 tx=0x7fb72800cbc0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 -- 172.21.15.55:0/785034884 shutdown_connections 2024-04-25T08:55:09.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb71c06b4d0 0x7fb71c06d990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73015bbe0 0x7fb730070640 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7300d0610 0x7fb73015e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 --2- 172.21.15.55:0/785034884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7300cf510 0x7fb7300cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 -- 172.21.15.55:0/785034884 >> 172.21.15.55:0/785034884 conn(0x7fb7300b3430 msgr2=0x7fb7300c7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:09.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 -- 172.21.15.55:0/785034884 shutdown_connections 2024-04-25T08:55:09.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.368+0000 7fb7362a3640 1 -- 172.21.15.55:0/785034884 wait complete. 2024-04-25T08:55:09.369 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T08:55:09.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.480+0000 7f103b08f640 1 Processor -- start 2024-04-25T08:55:09.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.480+0000 7f103b08f640 1 -- start start 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.481+0000 7f103b08f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f103415dce0 0x7f10340d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.481+0000 7f103b08f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f10340b5b60 0x7f10340b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.481+0000 7f103b08f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103415e0c0 con 0x7f10340d35b0 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.481+0000 7f103b08f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10340d2510 con 0x7f10340b5b60 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.481+0000 7f103b08f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10340d27f0 con 0x7f103415dce0 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.481+0000 7f1033fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f10340d35b0 0x7f10340b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41648/0 (socket says 172.21.15.55:41648) 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.481+0000 7f1033fff640 1 -- 172.21.15.55:0/2438494339 learned_addr learned my addr 172.21.15.55:0/2438494339 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.481+0000 7f1038e2b640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f103415dce0 0x7f10340d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.481+0000 7f103962c640 1 --2- 172.21.15.55:0/2438494339 >> v2:172.21.15.167:3300/0 conn(0x7f10340b5b60 0x7f10340b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.481+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488721193 0 0) 0x7f103415e0c0 con 0x7f10340d35b0 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.481+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f101c003520 con 0x7f10340d35b0 2024-04-25T08:55:09.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 436710383 0 0) 0x7f101c003520 con 0x7f10340d35b0 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f103415dce0 msgr2=0x7f10340d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f103415dce0 0x7f10340d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 >> v2:172.21.15.167:3300/0 conn(0x7f10340b5b60 msgr2=0x7f10340b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 --2- 172.21.15.55:0/2438494339 >> v2:172.21.15.167:3300/0 conn(0x7f10340b5b60 0x7f10340b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10340d2ad0 con 0x7f10340d35b0 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f1028001670 con 0x7f10340d35b0 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 >> v1:172.21.15.55:6789/0 conn(0x7f10340d35b0 legacy=0x7f10340b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f103415dce0 0x7f101c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c003f30 0x7f101c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f101c004d40 0x7f101c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10340d2510 con 0x7f101c004d40 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10340d27f0 con 0x7f101c003f30 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c00b9c0 con 0x7f103415dce0 2024-04-25T08:55:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f103962c640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f101c004d40 0x7f101c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f1038e2b640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f103415dce0 0x7f101c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f1033fff640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c003f30 0x7f101c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f103962c640 1 -- 172.21.15.55:0/2438494339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f103415dce0 msgr2=0x7f101c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f103962c640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f103415dce0 0x7f101c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f103962c640 1 -- 172.21.15.55:0/2438494339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c003f30 msgr2=0x7f101c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f103962c640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c003f30 0x7f101c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.482+0000 7f103962c640 1 -- 172.21.15.55:0/2438494339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c003520 con 0x7f101c004d40 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.483+0000 7f103962c640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f101c004d40 0x7f101c0051c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f102c009fc0 tx=0x7f101c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4644b9ce7af3afde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.483+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c009c10 con 0x7f101c004d40 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.483+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c036070 con 0x7f101c004d40 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.483+0000 7f10337fe640 1 -- 172.21.15.55:0/2438494339 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c02d070 con 0x7f101c004d40 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.483+0000 7f103b08f640 1 -- 172.21.15.55:0/2438494339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f101c004d40 msgr2=0x7f101c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.483+0000 7f103b08f640 1 --2- 172.21.15.55:0/2438494339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f101c004d40 0x7f101c0051c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f102c009fc0 tx=0x7f101c005830 comp rx=0 tx=0).stop 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.483+0000 7f103962c640 1 -- 172.21.15.55:0/2438494339 reap_dead start 2024-04-25T08:55:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.484+0000 7f103b08f640 1 -- 172.21.15.55:0/2438494339 shutdown_connections 2024-04-25T08:55:09.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.484+0000 7f103b08f640 1 -- 172.21.15.55:0/2438494339 >> 172.21.15.55:0/2438494339 conn(0x7f1034072900 msgr2=0x7f10340d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:09.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.484+0000 7f103b08f640 1 -- 172.21.15.55:0/2438494339 shutdown_connections 2024-04-25T08:55:09.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.484+0000 7f103b08f640 1 -- 172.21.15.55:0/2438494339 wait complete. 2024-04-25T08:55:09.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.485+0000 7f103b08f640 1 Processor -- start 2024-04-25T08:55:09.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.485+0000 7f103b08f640 1 -- start start 2024-04-25T08:55:09.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103b08f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f101c004d40 0x7f1034156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103b08f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10340cccd0 0x7f103415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103b08f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10340cd150 0x7f103415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103b08f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10340b9820 con 0x7f10340cd150 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103b08f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10340d3090 con 0x7f10340cccd0 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103b08f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10340b99a0 con 0x7f101c004d40 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103962c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10340cd150 0x7f103415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103962c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10340cd150 0x7f103415e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42488/0 (socket says 172.21.15.55:42488) 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103962c640 1 -- 172.21.15.55:0/3009961022 learned_addr learned my addr 172.21.15.55:0/3009961022 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f1033fff640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10340cccd0 0x7f103415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f1038e2b640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f101c004d40 0x7f1034156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103962c640 1 -- 172.21.15.55:0/3009961022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f101c004d40 msgr2=0x7f1034156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103962c640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f101c004d40 0x7f1034156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103962c640 1 -- 172.21.15.55:0/3009961022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10340cccd0 msgr2=0x7f103415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103962c640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10340cccd0 0x7f103415e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103962c640 1 -- 172.21.15.55:0/3009961022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10340c8020 con 0x7f10340cd150 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103962c640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10340cd150 0x7f103415e7f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f102c033040 tx=0x7f102c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f10317fa640 1 -- 172.21.15.55:0/3009961022 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c009c10 con 0x7f10340cd150 2024-04-25T08:55:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f10317fa640 1 -- 172.21.15.55:0/3009961022 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c003990 con 0x7f10340cd150 2024-04-25T08:55:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f103b08f640 1 -- 172.21.15.55:0/3009961022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10340c8300 con 0x7f10340cd150 2024-04-25T08:55:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.486+0000 7f10317fa640 1 -- 172.21.15.55:0/3009961022 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c003d60 con 0x7f10340cd150 2024-04-25T08:55:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.487+0000 7f103b08f640 1 -- 172.21.15.55:0/3009961022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10340c88c0 con 0x7f10340cd150 2024-04-25T08:55:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.487+0000 7f103b08f640 1 -- 172.21.15.55:0/3009961022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10340749b0 con 0x7f10340cd150 2024-04-25T08:55:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.488+0000 7f10317fa640 1 -- 172.21.15.55:0/3009961022 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f102c005d10 con 0x7f10340cd150 2024-04-25T08:55:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.488+0000 7f10317fa640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102006b4d0 0x7f102006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.488+0000 7f10317fa640 1 -- 172.21.15.55:0/3009961022 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f102c0ab520 con 0x7f10340cd150 2024-04-25T08:55:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.488+0000 7f1038e2b640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102006b4d0 0x7f102006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.489+0000 7f1038e2b640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102006b4d0 0x7f102006d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1024009b00 tx=0x7f1024008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.493+0000 7f10317fa640 1 -- 172.21.15.55:0/3009961022 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f102c04a060 con 0x7f10340cd150 2024-04-25T08:55:09.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:09.742+0000 7f103b08f640 1 -- 172.21.15.55:0/3009961022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f10340b3c20 con 0x7f10340cd150 2024-04-25T08:55:10.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.761+0000 7f10317fa640 1 -- 172.21.15.55:0/3009961022 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v103) v1 ==== 152+0+0 (secure 0 0 0) 0x7f102c07a6a0 con 0x7f10340cd150 2024-04-25T08:55:10.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 -- 172.21.15.55:0/3009961022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102006b4d0 msgr2=0x7f102006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:10.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102006b4d0 0x7f102006d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1024009b00 tx=0x7f1024008040 comp rx=0 tx=0).stop 2024-04-25T08:55:10.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 -- 172.21.15.55:0/3009961022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10340cd150 msgr2=0x7f103415e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:10.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10340cd150 0x7f103415e7f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f102c033040 tx=0x7f102c009750 comp rx=0 tx=0).stop 2024-04-25T08:55:10.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 -- 172.21.15.55:0/3009961022 shutdown_connections 2024-04-25T08:55:10.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f102006b4d0 0x7f102006d990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:10.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10340cd150 0x7f103415e7f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:10.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10340cccd0 0x7f103415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:10.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 --2- 172.21.15.55:0/3009961022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f101c004d40 0x7f1034156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:10.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 -- 172.21.15.55:0/3009961022 >> 172.21.15.55:0/3009961022 conn(0x7f1034072900 msgr2=0x7f10340b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:10.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 -- 172.21.15.55:0/3009961022 shutdown_connections 2024-04-25T08:55:10.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.763+0000 7f103b08f640 1 -- 172.21.15.55:0/3009961022 wait complete. 2024-04-25T08:55:10.767 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:55:10.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.888+0000 7f892aa07640 1 Processor -- start 2024-04-25T08:55:10.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.888+0000 7f892aa07640 1 -- start start 2024-04-25T08:55:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.889+0000 7f892aa07640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240d1130 0x7f89240b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.889+0000 7f892aa07640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89240d4090 con 0x7f89240d3b90 2024-04-25T08:55:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.889+0000 7f892aa07640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89240d4370 con 0x7f892415dca0 2024-04-25T08:55:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.889+0000 7f892aa07640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89240b6b20 con 0x7f89240d1130 2024-04-25T08:55:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.889+0000 7f89237fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f89240d3b90 0x7f89240d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41660/0 (socket says 172.21.15.55:41660) 2024-04-25T08:55:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.889+0000 7f89237fe640 1 -- 172.21.15.55:0/1667629844 learned_addr learned my addr 172.21.15.55:0/1667629844 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.889+0000 7f8928fa4640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240d1130 0x7f89240b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.889+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989114984 0 0) 0x7f89240d4090 con 0x7f89240d3b90 2024-04-25T08:55:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.889+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8910003520 con 0x7f89240d3b90 2024-04-25T08:55:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3999136931 0 0) 0x7f8910003520 con 0x7f89240d3b90 2024-04-25T08:55:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240d1130 msgr2=0x7f89240b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240d1130 0x7f89240b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 >> v1:172.21.15.167:6789/0 conn(0x7f892415dca0 legacy=0x7f89240ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89240d4650 con 0x7f89240d3b90 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f8914001670 con 0x7f89240d3b90 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 >> v1:172.21.15.55:6789/0 conn(0x7f89240d3b90 legacy=0x7f89240d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 0x7f8910003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240d1130 0x7f8910004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8910004d40 0x7f89100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891000ba70 con 0x7f89100039e0 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891000bc20 con 0x7f8910004d40 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891000be20 con 0x7f89240d1130 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8923fff640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 0x7f8910003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f89237fe640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240d1130 0x7f8910004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8928fa4640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8910004d40 0x7f89100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8923fff640 1 -- 172.21.15.55:0/1667629844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240d1130 msgr2=0x7f8910004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8923fff640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240d1130 0x7f8910004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8923fff640 1 -- 172.21.15.55:0/1667629844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8910004d40 msgr2=0x7f89100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8923fff640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8910004d40 0x7f89100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.890+0000 7f8923fff640 1 -- 172.21.15.55:0/1667629844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910003520 con 0x7f89100039e0 2024-04-25T08:55:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.891+0000 7f8923fff640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 0x7f8910003e00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f890c001720 tx=0x7f8910005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751f1ebec7bc6098 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.891+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c001370 con 0x7f89100039e0 2024-04-25T08:55:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.891+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c0052d0 con 0x7f89100039e0 2024-04-25T08:55:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.891+0000 7f8922ffd640 1 -- 172.21.15.55:0/1667629844 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c02abc0 con 0x7f89100039e0 2024-04-25T08:55:10.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.892+0000 7f892aa07640 1 -- 172.21.15.55:0/1667629844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 msgr2=0x7f8910003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:10.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.892+0000 7f892aa07640 1 --2- 172.21.15.55:0/1667629844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 0x7f8910003e00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f890c001720 tx=0x7f8910005830 comp rx=0 tx=0).stop 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.892+0000 7f8928fa4640 1 -- 172.21.15.55:0/1667629844 reap_dead start 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.892+0000 7f892aa07640 1 -- 172.21.15.55:0/1667629844 shutdown_connections 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.892+0000 7f892aa07640 1 -- 172.21.15.55:0/1667629844 >> 172.21.15.55:0/1667629844 conn(0x7f89240726c0 msgr2=0x7f8924072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.892+0000 7f892aa07640 1 -- 172.21.15.55:0/1667629844 shutdown_connections 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.892+0000 7f892aa07640 1 -- 172.21.15.55:0/1667629844 wait complete. 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.893+0000 7f892aa07640 1 Processor -- start 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.893+0000 7f892aa07640 1 -- start start 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f892aa07640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 0x7f892414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f892aa07640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8924157930 0x7f89240aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f892aa07640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240ccbc0 0x7f89240d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f892aa07640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892415e080 con 0x7f89100039e0 2024-04-25T08:55:10.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f892aa07640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240cf050 con 0x7f8924157930 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f892aa07640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892415e200 con 0x7f89240ccbc0 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f8923fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 0x7f892414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f8923fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 0x7f892414dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42516/0 (socket says 172.21.15.55:42516) 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f8923fff640 1 -- 172.21.15.55:0/619411055 learned_addr learned my addr 172.21.15.55:0/619411055 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f8928fa4640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240ccbc0 0x7f89240d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f89237fe640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8924157930 0x7f89240aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f8923fff640 1 -- 172.21.15.55:0/619411055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240ccbc0 msgr2=0x7f89240d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f8923fff640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240ccbc0 0x7f89240d1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f8923fff640 1 -- 172.21.15.55:0/619411055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8924157930 msgr2=0x7f89240aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f8923fff640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8924157930 0x7f89240aa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f8923fff640 1 -- 172.21.15.55:0/619411055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8924157ea0 con 0x7f89100039e0 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f8928fa4640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240ccbc0 0x7f89240d1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f89237fe640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8924157930 0x7f89240aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.894+0000 7f8923fff640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 0x7f892414dfb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f890c008fd0 tx=0x7f890c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:10.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.895+0000 7f8920ff9640 1 -- 172.21.15.55:0/619411055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c037040 con 0x7f89100039e0 2024-04-25T08:55:10.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.895+0000 7f8920ff9640 1 -- 172.21.15.55:0/619411055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c005480 con 0x7f89100039e0 2024-04-25T08:55:10.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.895+0000 7f892aa07640 1 -- 172.21.15.55:0/619411055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8924158180 con 0x7f89100039e0 2024-04-25T08:55:10.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.895+0000 7f8920ff9640 1 -- 172.21.15.55:0/619411055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c007a30 con 0x7f89100039e0 2024-04-25T08:55:10.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.895+0000 7f892aa07640 1 -- 172.21.15.55:0/619411055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8924158740 con 0x7f89100039e0 2024-04-25T08:55:10.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.896+0000 7f892aa07640 1 -- 172.21.15.55:0/619411055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89240750b0 con 0x7f89100039e0 2024-04-25T08:55:10.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.896+0000 7f8920ff9640 1 -- 172.21.15.55:0/619411055 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f890c044020 con 0x7f89100039e0 2024-04-25T08:55:10.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.896+0000 7f8920ff9640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f890406b500 0x7f890406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:10.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.897+0000 7f8920ff9640 1 -- 172.21.15.55:0/619411055 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f890c0a98c0 con 0x7f89100039e0 2024-04-25T08:55:10.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.897+0000 7f89237fe640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f890406b500 0x7f890406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:10.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.897+0000 7f89237fe640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f890406b500 0x7f890406d9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f89240b5430 tx=0x7f8914009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:10.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:10.901+0000 7f8920ff9640 1 -- 172.21.15.55:0/619411055 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f890c04b020 con 0x7f89100039e0 2024-04-25T08:55:11.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.086+0000 7f892aa07640 1 -- 172.21.15.55:0/619411055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f89240b5180 con 0x7f89100039e0 2024-04-25T08:55:11.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.089+0000 7f8920ff9640 1 -- 172.21.15.55:0/619411055 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f890c078ad0 con 0x7f89100039e0 2024-04-25T08:55:11.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.091+0000 7f892aa07640 1 -- 172.21.15.55:0/619411055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f890406b500 msgr2=0x7f890406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.091+0000 7f892aa07640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f890406b500 0x7f890406d9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f89240b5430 tx=0x7f8914009040 comp rx=0 tx=0).stop 2024-04-25T08:55:11.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.091+0000 7f892aa07640 1 -- 172.21.15.55:0/619411055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 msgr2=0x7f892414dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.091+0000 7f892aa07640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 0x7f892414dfb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f890c008fd0 tx=0x7f890c001120 comp rx=0 tx=0).stop 2024-04-25T08:55:11.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.091+0000 7f892aa07640 1 -- 172.21.15.55:0/619411055 shutdown_connections 2024-04-25T08:55:11.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.091+0000 7f892aa07640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f890406b500 0x7f890406d9c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.091+0000 7f892aa07640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89240ccbc0 0x7f89240d1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.091+0000 7f892aa07640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8924157930 0x7f89240aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.091+0000 7f892aa07640 1 --2- 172.21.15.55:0/619411055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89100039e0 0x7f892414dfb0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.091+0000 7f892aa07640 1 -- 172.21.15.55:0/619411055 >> 172.21.15.55:0/619411055 conn(0x7f89240726c0 msgr2=0x7f89240b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:11.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.092+0000 7f892aa07640 1 -- 172.21.15.55:0/619411055 shutdown_connections 2024-04-25T08:55:11.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.092+0000 7f892aa07640 1 -- 172.21.15.55:0/619411055 wait complete. 2024-04-25T08:55:11.094 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:55:11.095 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:55:11.143 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:55:11.183 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:55:11.183 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:55:11.183 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:55:11.198 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:55:11.199 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:55:11.199 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:55:11.241 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:55:11.241 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:55:11.241 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:55:11.256 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:55:11.256 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:55:11.257 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:55:11.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:55:11.300 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:55:11.300 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:55:11.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.411+0000 7fa6e257e640 1 Processor -- start 2024-04-25T08:55:11.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.411+0000 7fa6e257e640 1 -- start start 2024-04-25T08:55:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6e257e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6dc06e2e0 0x7fa6dc0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6e257e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6dc0cfc40 0x7fa6dc15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6e257e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6dc0cdb10 con 0x7fa6dc15a870 2024-04-25T08:55:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6e257e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc0ce720 con 0x7fa6dc0cfc40 2024-04-25T08:55:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6e257e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0cddf0 con 0x7fa6dc06e2e0 2024-04-25T08:55:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6e0b1b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6dc0cfc40 0x7fa6dc15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6dbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa6dc15a870 0x7fa6dc0cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41676/0 (socket says 172.21.15.55:41676) 2024-04-25T08:55:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6dbfff640 1 -- 172.21.15.55:0/4038118137 learned_addr learned my addr 172.21.15.55:0/4038118137 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6db7fe640 1 --2- 172.21.15.55:0/4038118137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6dc06e2e0 0x7fa6dc0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6e0b1b640 1 -- 172.21.15.55:0/4038118137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6dc06e2e0 msgr2=0x7fa6dc0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6e0b1b640 1 --2- 172.21.15.55:0/4038118137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6dc06e2e0 0x7fa6dc0cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6e0b1b640 1 -- 172.21.15.55:0/4038118137 >> v1:172.21.15.55:6789/0 conn(0x7fa6dc15a870 legacy=0x7fa6dc0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.412+0000 7fa6e0b1b640 1 -- 172.21.15.55:0/4038118137 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc0ce0d0 con 0x7fa6dc0cfc40 2024-04-25T08:55:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.413+0000 7fa6e0b1b640 1 --2- 172.21.15.55:0/4038118137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc0cfc40 0x7fa6dc15ac50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009d90 tx=0x7fa6d402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcbb8d31c7970eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.413+0000 7fa6daffd640 1 -- 172.21.15.55:0/4038118137 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4007740 con 0x7fa6dc0cfc40 2024-04-25T08:55:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.413+0000 7fa6daffd640 1 -- 172.21.15.55:0/4038118137 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d40078e0 con 0x7fa6dc0cfc40 2024-04-25T08:55:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.413+0000 7fa6daffd640 1 -- 172.21.15.55:0/4038118137 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4007cb0 con 0x7fa6dc0cfc40 2024-04-25T08:55:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.413+0000 7fa6e257e640 1 -- 172.21.15.55:0/4038118137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc0cfc40 msgr2=0x7fa6dc15ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.413+0000 7fa6e257e640 1 --2- 172.21.15.55:0/4038118137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc0cfc40 0x7fa6dc15ac50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009d90 tx=0x7fa6d402a660 comp rx=0 tx=0).stop 2024-04-25T08:55:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.414+0000 7fa6e257e640 1 -- 172.21.15.55:0/4038118137 shutdown_connections 2024-04-25T08:55:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.414+0000 7fa6e257e640 1 --2- 172.21.15.55:0/4038118137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6dc06e2e0 0x7fa6dc0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.414+0000 7fa6e257e640 1 --2- 172.21.15.55:0/4038118137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc0cfc40 0x7fa6dc15ac50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.414+0000 7fa6e257e640 1 -- 172.21.15.55:0/4038118137 >> 172.21.15.55:0/4038118137 conn(0x7fa6dc06aba0 msgr2=0x7fa6dc06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.414+0000 7fa6e257e640 1 -- 172.21.15.55:0/4038118137 shutdown_connections 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.414+0000 7fa6e257e640 1 -- 172.21.15.55:0/4038118137 wait complete. 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.415+0000 7fa6e257e640 1 Processor -- start 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.415+0000 7fa6e257e640 1 -- start start 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e257e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6dc06e2e0 0x7fa6dc14b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e257e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6dc0cfc40 0x7fa6dc0a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e257e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a870 0x7fa6dc0a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e257e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0cd700 con 0x7fa6dc15a870 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e257e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0cd580 con 0x7fa6dc0cfc40 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e257e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0cd880 con 0x7fa6dc06e2e0 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e0b1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a870 0x7fa6dc0a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e0b1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a870 0x7fa6dc0a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42540/0 (socket says 172.21.15.55:42540) 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e0b1b640 1 -- 172.21.15.55:0/1364537940 learned_addr learned my addr 172.21.15.55:0/1364537940 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6dbfff640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6dc06e2e0 0x7fa6dc14b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6db7fe640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6dc0cfc40 0x7fa6dc0a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e0b1b640 1 -- 172.21.15.55:0/1364537940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6dc06e2e0 msgr2=0x7fa6dc14b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e0b1b640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6dc06e2e0 0x7fa6dc14b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e0b1b640 1 -- 172.21.15.55:0/1364537940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6dc0cfc40 msgr2=0x7fa6dc0a94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e0b1b640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6dc0cfc40 0x7fa6dc0a94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e0b1b640 1 -- 172.21.15.55:0/1364537940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc1e46b0 con 0x7fa6dc15a870 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6db7fe640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6dc0cfc40 0x7fa6dc0a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e0b1b640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a870 0x7fa6dc0a84a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa6d402ac50 tx=0x7fa6d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6d8ff9640 1 -- 172.21.15.55:0/1364537940 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4040070 con 0x7fa6dc15a870 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6d8ff9640 1 -- 172.21.15.55:0/1364537940 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d4031bc0 con 0x7fa6dc15a870 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e257e640 1 -- 172.21.15.55:0/1364537940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6dc1e4990 con 0x7fa6dc15a870 2024-04-25T08:55:11.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6d8ff9640 1 -- 172.21.15.55:0/1364537940 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4009450 con 0x7fa6dc15a870 2024-04-25T08:55:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.416+0000 7fa6e257e640 1 -- 172.21.15.55:0/1364537940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc1e4f50 con 0x7fa6dc15a870 2024-04-25T08:55:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.417+0000 7fa6e257e640 1 -- 172.21.15.55:0/1364537940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc0749b0 con 0x7fa6dc15a870 2024-04-25T08:55:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.418+0000 7fa6d8ff9640 1 -- 172.21.15.55:0/1364537940 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa6d4039040 con 0x7fa6dc15a870 2024-04-25T08:55:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.418+0000 7fa6d8ff9640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa6c806b4d0 0x7fa6c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.418+0000 7fa6d8ff9640 1 -- 172.21.15.55:0/1364537940 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa6d40ab6b0 con 0x7fa6dc15a870 2024-04-25T08:55:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.418+0000 7fa6dbfff640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa6c806b4d0 0x7fa6c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.419+0000 7fa6dbfff640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa6c806b4d0 0x7fa6c806d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc000f60 tx=0x7fa6cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:11.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.423+0000 7fa6d8ff9640 1 -- 172.21.15.55:0/1364537940 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa6d407a9e0 con 0x7fa6dc15a870 2024-04-25T08:55:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.644+0000 7fa6e257e640 1 -- 172.21.15.55:0/1364537940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6dc0cf1f0 con 0x7fa6dc15a870 2024-04-25T08:55:11.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.645+0000 7fa6d8ff9640 1 -- 172.21.15.55:0/1364537940 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3704 (secure 0 0 0) 0x7fa6d407a2e0 con 0x7fa6dc15a870 2024-04-25T08:55:11.635 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:11.635 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2362450653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2362450653},{"type":"v1","addr":"172.21.15.167:6835","nonce":2362450653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3897225045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3897225045},{"type":"v1","addr":"172.21.15.167:6834","nonce":3897225045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2007115110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2007115110},{"type":"v1","addr":"172.21.15.55:6836","nonce":2007115110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5490,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1170685091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1170685091},{"type":"v1","addr":"172.21.15.55:6837","nonce":1170685091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":15}],"filesystems":[]} 2024-04-25T08:55:11.635 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 15 2024-04-25T08:55:11.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 -- 172.21.15.55:0/1364537940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa6c806b4d0 msgr2=0x7fa6c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa6c806b4d0 0x7fa6c806d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc000f60 tx=0x7fa6cc009040 comp rx=0 tx=0).stop 2024-04-25T08:55:11.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 -- 172.21.15.55:0/1364537940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a870 msgr2=0x7fa6dc0a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a870 0x7fa6dc0a84a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa6d402ac50 tx=0x7fa6d4004a40 comp rx=0 tx=0).stop 2024-04-25T08:55:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 -- 172.21.15.55:0/1364537940 shutdown_connections 2024-04-25T08:55:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa6c806b4d0 0x7fa6c806d990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a870 0x7fa6dc0a84a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6dc0cfc40 0x7fa6dc0a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 --2- 172.21.15.55:0/1364537940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6dc06e2e0 0x7fa6dc14b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 -- 172.21.15.55:0/1364537940 >> 172.21.15.55:0/1364537940 conn(0x7fa6dc06aba0 msgr2=0x7fa6dc0b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 -- 172.21.15.55:0/1364537940 shutdown_connections 2024-04-25T08:55:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.647+0000 7fa6e257e640 1 -- 172.21.15.55:0/1364537940 wait complete. 2024-04-25T08:55:11.649 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:55:11.650 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:55:11.650 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:55:11.650 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:55:11.650 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:55:11.650 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:55:11.650 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:55:11.650 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:55:11.651 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:55:11.651 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:55:11.651 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:55:11.651 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:55:11.651 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:55:11.651 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:55:11.651 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:55:11.652 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:55:11.659 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:55:11.659 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:55:11.660 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:55:11.660 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:55:11.663 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:55:11.663 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:55:11.664 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:55:11.664 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:55:11.702 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:55:11.702 DEBUG:teuthology.parallel:result is None 2024-04-25T08:55:11.703 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:55:11.703 DEBUG:teuthology.parallel:result is None 2024-04-25T08:55:11.706 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:55:11.707 DEBUG:teuthology.parallel:result is None 2024-04-25T08:55:11.707 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:55:11.707 DEBUG:teuthology.parallel:result is None 2024-04-25T08:55:11.707 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:55:11.778 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-25T08:55:11.778 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T08:55:11.788 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T08:55:11.789 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T08:55:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.825+0000 7fe0a566b640 1 Processor -- start 2024-04-25T08:55:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.825+0000 7fe0a566b640 1 -- start start 2024-04-25T08:55:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe0a566b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0a00b0740 0x7fe0a00b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe0a566b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0a00cfd60 0x7fe0a00d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe0a566b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a015f660 con 0x7fe0a015ef60 2024-04-25T08:55:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe0a566b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a015f940 con 0x7fe0a00cfd60 2024-04-25T08:55:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe0a566b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a015fc20 con 0x7fe0a00b0740 2024-04-25T08:55:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe09f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0a00cfd60 0x7fe0a00d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe09effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe0a015ef60 0x7fe0a00ce4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41714/0 (socket says 172.21.15.55:41714) 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe09effd640 1 -- 172.21.15.55:0/162039380 learned_addr learned my addr 172.21.15.55:0/162039380 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe09e7fc640 1 --2- 172.21.15.55:0/162039380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0a00b0740 0x7fe0a00b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe09f7fe640 1 -- 172.21.15.55:0/162039380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0a00b0740 msgr2=0x7fe0a00b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe09dffb640 1 -- 172.21.15.55:0/162039380 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723098230 0 0) 0x7fe0a015f660 con 0x7fe0a015ef60 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe09f7fe640 1 --2- 172.21.15.55:0/162039380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0a00b0740 0x7fe0a00b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.826+0000 7fe09f7fe640 1 -- 172.21.15.55:0/162039380 >> v1:172.21.15.55:6789/0 conn(0x7fe0a015ef60 legacy=0x7fe0a00ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.827+0000 7fe09f7fe640 1 -- 172.21.15.55:0/162039380 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a015ff00 con 0x7fe0a00cfd60 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.827+0000 7fe09f7fe640 1 --2- 172.21.15.55:0/162039380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a00cfd60 0x7fe0a00d01b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe098009d90 tx=0x7fe09802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d2491d1834a50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.827+0000 7fe09dffb640 1 -- 172.21.15.55:0/162039380 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098007740 con 0x7fe0a00cfd60 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.827+0000 7fe09dffb640 1 -- 172.21.15.55:0/162039380 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0980078e0 con 0x7fe0a00cfd60 2024-04-25T08:55:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.827+0000 7fe09dffb640 1 -- 172.21.15.55:0/162039380 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098007cb0 con 0x7fe0a00cfd60 2024-04-25T08:55:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.828+0000 7fe0a566b640 1 -- 172.21.15.55:0/162039380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a00cfd60 msgr2=0x7fe0a00d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.828+0000 7fe0a566b640 1 --2- 172.21.15.55:0/162039380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a00cfd60 0x7fe0a00d01b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe098009d90 tx=0x7fe09802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.828+0000 7fe0a566b640 1 -- 172.21.15.55:0/162039380 shutdown_connections 2024-04-25T08:55:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.828+0000 7fe0a566b640 1 --2- 172.21.15.55:0/162039380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0a00b0740 0x7fe0a00b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.828+0000 7fe0a566b640 1 --2- 172.21.15.55:0/162039380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a00cfd60 0x7fe0a00d01b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.828+0000 7fe0a566b640 1 -- 172.21.15.55:0/162039380 >> 172.21.15.55:0/162039380 conn(0x7fe0a006f4c0 msgr2=0x7fe0a006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.828+0000 7fe0a566b640 1 -- 172.21.15.55:0/162039380 shutdown_connections 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.828+0000 7fe0a566b640 1 -- 172.21.15.55:0/162039380 wait complete. 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.829+0000 7fe0a566b640 1 Processor -- start 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.829+0000 7fe0a566b640 1 -- start start 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.830+0000 7fe0a566b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0a00b0740 0x7fe0a00b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.830+0000 7fe0a566b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a00cfd60 0x7fe0a00ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.830+0000 7fe0a566b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0a015ef60 0x7fe0a00ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.830+0000 7fe0a566b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a015f340 con 0x7fe0a00cfd60 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.830+0000 7fe0a566b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a01604c0 con 0x7fe0a00b0740 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.830+0000 7fe0a566b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00cebd0 con 0x7fe0a015ef60 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.830+0000 7fe09e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a00cfd60 0x7fe0a00ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.830+0000 7fe09e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a00cfd60 0x7fe0a00ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42564/0 (socket says 172.21.15.55:42564) 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.830+0000 7fe09e7fc640 1 -- 172.21.15.55:0/2909215238 learned_addr learned my addr 172.21.15.55:0/2909215238 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.830+0000 7fe09f7fe640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0a015ef60 0x7fe0a00ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.830+0000 7fe09effd640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0a00b0740 0x7fe0a00b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.831+0000 7fe09e7fc640 1 -- 172.21.15.55:0/2909215238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0a015ef60 msgr2=0x7fe0a00ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.831+0000 7fe09e7fc640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0a015ef60 0x7fe0a00ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.831+0000 7fe09e7fc640 1 -- 172.21.15.55:0/2909215238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0a00b0740 msgr2=0x7fe0a00b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.831+0000 7fe09e7fc640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0a00b0740 0x7fe0a00b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.831+0000 7fe09e7fc640 1 -- 172.21.15.55:0/2909215238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a00b2ab0 con 0x7fe0a00cfd60 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.831+0000 7fe09e7fc640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a00cfd60 0x7fe0a00ca460 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c7f0 tx=0x7fe09000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.831+0000 7fe0877fe640 1 -- 172.21.15.55:0/2909215238 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090015070 con 0x7fe0a00cfd60 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.831+0000 7fe0877fe640 1 -- 172.21.15.55:0/2909215238 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090004240 con 0x7fe0a00cfd60 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.831+0000 7fe0877fe640 1 -- 172.21.15.55:0/2909215238 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090007620 con 0x7fe0a00cfd60 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.831+0000 7fe0a566b640 1 -- 172.21.15.55:0/2909215238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a00b2d90 con 0x7fe0a00cfd60 2024-04-25T08:55:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.831+0000 7fe0a566b640 1 -- 172.21.15.55:0/2909215238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a00b3350 con 0x7fe0a00cfd60 2024-04-25T08:55:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.832+0000 7fe0a566b640 1 -- 172.21.15.55:0/2909215238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a00750b0 con 0x7fe0a00cfd60 2024-04-25T08:55:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.833+0000 7fe0877fe640 1 -- 172.21.15.55:0/2909215238 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe0900079d0 con 0x7fe0a00cfd60 2024-04-25T08:55:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.833+0000 7fe0877fe640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe08c06b500 0x7fe08c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.833+0000 7fe0877fe640 1 -- 172.21.15.55:0/2909215238 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe090089e30 con 0x7fe0a00cfd60 2024-04-25T08:55:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.833+0000 7fe09effd640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe08c06b500 0x7fe08c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.834+0000 7fe09effd640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe08c06b500 0x7fe08c06d9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe094007fd0 tx=0x7fe094007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:11.837+0000 7fe0877fe640 1 -- 172.21.15.55:0/2909215238 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe0900589f0 con 0x7fe0a00cfd60 2024-04-25T08:55:12.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.032+0000 7fe0a566b640 1 -- 172.21.15.55:0/2909215238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe0a015e110 con 0x7fe0a00cfd60 2024-04-25T08:55:12.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.781+0000 7fe0877fe640 1 -- 172.21.15.55:0/2909215238 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe09005ca90 con 0x7fe0a00cfd60 2024-04-25T08:55:12.772 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-25T08:55:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.784+0000 7fe0a566b640 1 -- 172.21.15.55:0/2909215238 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe08c06b500 msgr2=0x7fe08c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.784+0000 7fe0a566b640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe08c06b500 0x7fe08c06d9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe094007fd0 tx=0x7fe094007de0 comp rx=0 tx=0).stop 2024-04-25T08:55:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.784+0000 7fe0a566b640 1 -- 172.21.15.55:0/2909215238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a00cfd60 msgr2=0x7fe0a00ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.784+0000 7fe0a566b640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a00cfd60 0x7fe0a00ca460 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c7f0 tx=0x7fe09000ccb0 comp rx=0 tx=0).stop 2024-04-25T08:55:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.784+0000 7fe0a566b640 1 -- 172.21.15.55:0/2909215238 shutdown_connections 2024-04-25T08:55:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.784+0000 7fe0a566b640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe08c06b500 0x7fe08c06d9c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.784+0000 7fe0a566b640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0a015ef60 0x7fe0a00ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.784+0000 7fe0a566b640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a00cfd60 0x7fe0a00ca460 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.784+0000 7fe0a566b640 1 --2- 172.21.15.55:0/2909215238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0a00b0740 0x7fe0a00b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.784+0000 7fe0a566b640 1 -- 172.21.15.55:0/2909215238 >> 172.21.15.55:0/2909215238 conn(0x7fe0a006f4c0 msgr2=0x7fe0a00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.784+0000 7fe0a566b640 1 -- 172.21.15.55:0/2909215238 shutdown_connections 2024-04-25T08:55:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.785+0000 7fe0a566b640 1 -- 172.21.15.55:0/2909215238 wait complete. 2024-04-25T08:55:12.789 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:55:12.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.907+0000 7f2fdc709640 1 Processor -- start 2024-04-25T08:55:12.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.907+0000 7f2fdc709640 1 -- start start 2024-04-25T08:55:12.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fdc709640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2fd415dce0 0x7f2fd40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:12.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fdc709640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fd40d35b0 0x7f2fd40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:12.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fdc709640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd415e0c0 con 0x7f2fd40d1f90 2024-04-25T08:55:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fdc709640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd40b7b10 con 0x7f2fd40d35b0 2024-04-25T08:55:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fdc709640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd40d2510 con 0x7f2fd415dce0 2024-04-25T08:55:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fd9ca4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fd40d35b0 0x7f2fd40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fd9ca4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fd40d35b0 0x7f2fd40b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42570/0 (socket says 172.21.15.55:42570) 2024-04-25T08:55:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fd9ca4640 1 -- 172.21.15.55:0/42994378 learned_addr learned my addr 172.21.15.55:0/42994378 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fda4a5640 1 --2- 172.21.15.55:0/42994378 >> v2:172.21.15.167:3300/0 conn(0x7f2fd415dce0 0x7f2fd40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fd9ca4640 1 -- 172.21.15.55:0/42994378 >> v2:172.21.15.167:3300/0 conn(0x7f2fd415dce0 msgr2=0x7f2fd40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fd9ca4640 1 --2- 172.21.15.55:0/42994378 >> v2:172.21.15.167:3300/0 conn(0x7f2fd415dce0 0x7f2fd40d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fd9ca4640 1 -- 172.21.15.55:0/42994378 >> v1:172.21.15.167:6789/0 conn(0x7f2fd40d1f90 legacy=0x7f2fd406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.908+0000 7f2fd9ca4640 1 -- 172.21.15.55:0/42994378 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd40d27f0 con 0x7f2fd40d35b0 2024-04-25T08:55:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.909+0000 7f2fd9ca4640 1 --2- 172.21.15.55:0/42994378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd40d35b0 0x7f2fd40b5450 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40ce220 tx=0x7f2fc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b793df71bc304e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.909+0000 7f2fd94a3640 1 -- 172.21.15.55:0/42994378 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4037070 con 0x7f2fd40d35b0 2024-04-25T08:55:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.909+0000 7f2fd94a3640 1 -- 172.21.15.55:0/42994378 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc4032440 con 0x7f2fd40d35b0 2024-04-25T08:55:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.909+0000 7f2fd94a3640 1 -- 172.21.15.55:0/42994378 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4032810 con 0x7f2fd40d35b0 2024-04-25T08:55:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.910+0000 7f2fdc709640 1 -- 172.21.15.55:0/42994378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd40d35b0 msgr2=0x7f2fd40b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.910+0000 7f2fdc709640 1 --2- 172.21.15.55:0/42994378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd40d35b0 0x7f2fd40b5450 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40ce220 tx=0x7f2fc402a270 comp rx=0 tx=0).stop 2024-04-25T08:55:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.910+0000 7f2fdc709640 1 -- 172.21.15.55:0/42994378 shutdown_connections 2024-04-25T08:55:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.910+0000 7f2fdc709640 1 --2- 172.21.15.55:0/42994378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd40d35b0 0x7f2fd40b5450 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.910+0000 7f2fdc709640 1 --2- 172.21.15.55:0/42994378 >> v2:172.21.15.167:3300/0 conn(0x7f2fd415dce0 0x7f2fd40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.910+0000 7f2fdc709640 1 -- 172.21.15.55:0/42994378 >> 172.21.15.55:0/42994378 conn(0x7f2fd4072900 msgr2=0x7f2fd40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.910+0000 7f2fdc709640 1 -- 172.21.15.55:0/42994378 shutdown_connections 2024-04-25T08:55:12.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.910+0000 7f2fdc709640 1 -- 172.21.15.55:0/42994378 wait complete. 2024-04-25T08:55:12.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.911+0000 7f2fdc709640 1 Processor -- start 2024-04-25T08:55:12.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.911+0000 7f2fdc709640 1 -- start start 2024-04-25T08:55:12.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fdc709640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fd40d1f90 0x7f2fd415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fdc709640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd40d35b0 0x7f2fd40cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fdc709640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fd415dce0 0x7f2fd40c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fdc709640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40d3090 con 0x7f2fd40d35b0 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fdc709640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40d2db0 con 0x7f2fd40d1f90 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fdc709640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40b9820 con 0x7f2fd415dce0 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fd9ca4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd40d35b0 0x7f2fd40cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fd9ca4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd40d35b0 0x7f2fd40cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42576/0 (socket says 172.21.15.55:42576) 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fd9ca4640 1 -- 172.21.15.55:0/3854112787 learned_addr learned my addr 172.21.15.55:0/3854112787 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fda4a5640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fd40d1f90 0x7f2fd415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fdaca6640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fd415dce0 0x7f2fd40c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fd9ca4640 1 -- 172.21.15.55:0/3854112787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fd415dce0 msgr2=0x7f2fd40c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fd9ca4640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fd415dce0 0x7f2fd40c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fd9ca4640 1 -- 172.21.15.55:0/3854112787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fd40d1f90 msgr2=0x7f2fd415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fd9ca4640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fd40d1f90 0x7f2fd415f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.912+0000 7f2fd9ca4640 1 -- 172.21.15.55:0/3854112787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd4160f50 con 0x7f2fd40d35b0 2024-04-25T08:55:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.913+0000 7f2fd9ca4640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd40d35b0 0x7f2fd40cd200 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2fc402a2b0 tx=0x7f2fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.913+0000 7f2fcaffd640 1 -- 172.21.15.55:0/3854112787 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4041030 con 0x7f2fd40d35b0 2024-04-25T08:55:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.913+0000 7f2fcaffd640 1 -- 172.21.15.55:0/3854112787 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc4030440 con 0x7f2fd40d35b0 2024-04-25T08:55:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.913+0000 7f2fcaffd640 1 -- 172.21.15.55:0/3854112787 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4037040 con 0x7f2fd40d35b0 2024-04-25T08:55:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.913+0000 7f2fdc709640 1 -- 172.21.15.55:0/3854112787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd4161230 con 0x7f2fd40d35b0 2024-04-25T08:55:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.913+0000 7f2fdc709640 1 -- 172.21.15.55:0/3854112787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd40cd740 con 0x7f2fd40d35b0 2024-04-25T08:55:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.914+0000 7f2fdc709640 1 -- 172.21.15.55:0/3854112787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd40749b0 con 0x7f2fd40d35b0 2024-04-25T08:55:12.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.914+0000 7f2fcaffd640 1 -- 172.21.15.55:0/3854112787 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2fc4044070 con 0x7f2fd40d35b0 2024-04-25T08:55:12.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.915+0000 7f2fcaffd640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fb806b4d0 0x7f2fb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:12.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.915+0000 7f2fda4a5640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fb806b4d0 0x7f2fb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:12.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.915+0000 7f2fcaffd640 1 -- 172.21.15.55:0/3854112787 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2fc40aa330 con 0x7f2fd40d35b0 2024-04-25T08:55:12.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.915+0000 7f2fda4a5640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fb806b4d0 0x7f2fb806d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009aa0 tx=0x7f2fd0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:12.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:12.919+0000 7f2fcaffd640 1 -- 172.21.15.55:0/3854112787 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2fc4079060 con 0x7f2fd40d35b0 2024-04-25T08:55:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.172+0000 7f2fdc709640 1 -- 172.21.15.55:0/3854112787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2fd415d1e0 con 0x7f2fd40d35b0 2024-04-25T08:55:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.172+0000 7f2fcaffd640 1 -- 172.21.15.55:0/3854112787 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2fc407d100 con 0x7f2fd40d35b0 2024-04-25T08:55:13.162 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:13.162 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:55:13.162 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-25T08:55:13.162 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm4IxeGBAAwuzfw8fkgBWLS/OHkVRPdA==", 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmz17MIxAAOjfHLP2pVtyOH1KkaFBdpw==", 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.163 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcJlOHxAAWRBqx21VaZdp7n+bG6QdjA==", 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.164 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmbKyTKhAARg7pgR8TeZKNHV38FuAv+g==", 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.165 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDgGSpmMDqwHRAAte7ZpF14thK4VEsC4getWg==", 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDjGSpm7bEhHRAALQKewGfpKljGFsW75+h/Dg==", 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:55:13.166 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDmGSpmjg2RHBAA+DxXqJHuPIGUsVvwUirEwg==", 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDpGSpmxft1HBAAsIYtKh97QF4WhdL9kI2QeA==", 2024-04-25T08:55:13.167 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDvGSpm4QDFIRAAlMSvRI/gNR4p8BgQdRUcBA==", 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.168 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyGSpmARfiHxAABn3CWZTkyRxXpTUxKGi71A==", 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1GSpmLHBmHRAA4xXuyYK95pq8g+DAXREvKQ==", 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4GSpmMbpPGxAAP7YWBUzcafaowcZG1ZWhDA==", 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.170 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw==", 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcP0TNxAA02w2xuYx7fMlMbZpgy53hQ==", 2024-04-25T08:55:13.171 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmpD8INBAA29l06IV/RnM5qxOD6VL3MA==", 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:55:13.172 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDaGSpm8xftABAADCQqbD2gknLM2w+MV/H29A==", 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDYGSpmHI4oORAAQoQL0ylKsbBRG+EldcMd4g==", 2024-04-25T08:55:13.173 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmk2Q/FRAAwGHbq7UsFI+OdwcBOqLnlA==", 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T08:55:13.174 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm6NfaERAAtb5ZheEavSDdOCOxeM0a2Q==", 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-25T08:55:13.175 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:55:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 -- 172.21.15.55:0/3854112787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fb806b4d0 msgr2=0x7f2fb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fb806b4d0 0x7f2fb806d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009aa0 tx=0x7f2fd0009190 comp rx=0 tx=0).stop 2024-04-25T08:55:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 -- 172.21.15.55:0/3854112787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd40d35b0 msgr2=0x7f2fd40cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd40d35b0 0x7f2fd40cd200 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2fc402a2b0 tx=0x7f2fc40046c0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 -- 172.21.15.55:0/3854112787 shutdown_connections 2024-04-25T08:55:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fb806b4d0 0x7f2fb806d990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fd415dce0 0x7f2fd40c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd40d35b0 0x7f2fd40cd200 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 --2- 172.21.15.55:0/3854112787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fd40d1f90 0x7f2fd415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 -- 172.21.15.55:0/3854112787 >> 172.21.15.55:0/3854112787 conn(0x7f2fd4072900 msgr2=0x7f2fd40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:13.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 -- 172.21.15.55:0/3854112787 shutdown_connections 2024-04-25T08:55:13.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.174+0000 7f2fdc709640 1 -- 172.21.15.55:0/3854112787 wait complete. 2024-04-25T08:55:13.178 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:55:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.289+0000 7fc2bbfdb640 1 Processor -- start 2024-04-25T08:55:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.290+0000 7fc2bbfdb640 1 -- start start 2024-04-25T08:55:13.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.290+0000 7fc2bbfdb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc2b40d35b0 0x7fc2b40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.290+0000 7fc2bbfdb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b415e0c0 con 0x7fc2b415dce0 2024-04-25T08:55:13.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.290+0000 7fc2bbfdb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b40d2510 con 0x7fc2b40b5990 2024-04-25T08:55:13.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.290+0000 7fc2bbfdb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b40d27f0 con 0x7fc2b40d35b0 2024-04-25T08:55:13.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.290+0000 7fc2b9d77640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc2b415dce0 0x7fc2b40d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41728/0 (socket says 172.21.15.55:41728) 2024-04-25T08:55:13.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.290+0000 7fc2b9d77640 1 -- 172.21.15.55:0/3636816191 learned_addr learned my addr 172.21.15.55:0/3636816191 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:13.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323557368 0 0) 0x7fc2b415e0c0 con 0x7fc2b415dce0 2024-04-25T08:55:13.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a0003520 con 0x7fc2b415dce0 2024-04-25T08:55:13.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b9576640 1 --2- 172.21.15.55:0/3636816191 >> v2:172.21.15.167:3300/0 conn(0x7fc2b40d35b0 0x7fc2b40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2845736091 0 0) 0x7fc2a0003520 con 0x7fc2b415dce0 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 >> v2:172.21.15.167:3300/0 conn(0x7fc2b40d35b0 msgr2=0x7fc2b40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 --2- 172.21.15.55:0/3636816191 >> v2:172.21.15.167:3300/0 conn(0x7fc2b40d35b0 0x7fc2b40b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 >> v1:172.21.15.167:6789/0 conn(0x7fc2b40b5990 legacy=0x7fc2b40b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b40d2ad0 con 0x7fc2b415dce0 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc2b0001670 con 0x7fc2b415dce0 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 >> v1:172.21.15.55:6789/0 conn(0x7fc2b415dce0 legacy=0x7fc2b40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2a00039b0 0x7fc2a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a0004800 0x7fc2a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2a00051c0 0x7fc2a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40d27f0 con 0x7fc2a0004800 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a000c060 con 0x7fc2a00039b0 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a000c260 con 0x7fc2a00051c0 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b9576640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a0004800 0x7fc2a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2b9d77640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2a00039b0 0x7fc2a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.291+0000 7fc2ba578640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2a00051c0 0x7fc2a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.292+0000 7fc2b9576640 1 -- 172.21.15.55:0/3636816191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2a00051c0 msgr2=0x7fc2a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.292+0000 7fc2b9576640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2a00051c0 0x7fc2a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.292+0000 7fc2b9576640 1 -- 172.21.15.55:0/3636816191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2a00039b0 msgr2=0x7fc2a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.292+0000 7fc2b9576640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2a00039b0 0x7fc2a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.292+0000 7fc2b9576640 1 -- 172.21.15.55:0/3636816191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0003520 con 0x7fc2a0004800 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.292+0000 7fc2ba578640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2a00051c0 0x7fc2a000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.292+0000 7fc2ba578640 1 -- 172.21.15.55:0/3636816191 reap_dead start 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.292+0000 7fc2b9576640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a0004800 0x7fc2a0004c80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009a90 tx=0x7fc2a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a64da143cdda36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.292+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4036070 con 0x7fc2a0004800 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.292+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a4031400 con 0x7fc2a0004800 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.292+0000 7fc2b8d75640 1 -- 172.21.15.55:0/3636816191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4009690 con 0x7fc2a0004800 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.293+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3636816191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a0004800 msgr2=0x7fc2a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.293+0000 7fc2bbfdb640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a0004800 0x7fc2a0004c80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009a90 tx=0x7fc2a0005830 comp rx=0 tx=0).stop 2024-04-25T08:55:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.293+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3636816191 shutdown_connections 2024-04-25T08:55:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.293+0000 7fc2bbfdb640 1 --2- 172.21.15.55:0/3636816191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a0004800 0x7fc2a0004c80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.293+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3636816191 >> 172.21.15.55:0/3636816191 conn(0x7fc2b4072900 msgr2=0x7fc2b40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.293+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3636816191 shutdown_connections 2024-04-25T08:55:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.293+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3636816191 wait complete. 2024-04-25T08:55:13.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.294+0000 7fc2bbfdb640 1 Processor -- start 2024-04-25T08:55:13.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.294+0000 7fc2bbfdb640 1 -- start start 2024-04-25T08:55:13.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.295+0000 7fc2bbfdb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2a0004800 0x7fc2b41f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.295+0000 7fc2bbfdb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b40b7db0 0x7fc2b40b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.295+0000 7fc2bbfdb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40cad40 0x7fc2b40cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.295+0000 7fc2bbfdb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40b9820 con 0x7fc2b40cad40 2024-04-25T08:55:13.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.295+0000 7fc2bbfdb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40d3090 con 0x7fc2b40b7db0 2024-04-25T08:55:13.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.295+0000 7fc2bbfdb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40b99a0 con 0x7fc2a0004800 2024-04-25T08:55:13.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.295+0000 7fc2ba578640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40cad40 0x7fc2b40cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.295+0000 7fc2ba578640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40cad40 0x7fc2b40cb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42592/0 (socket says 172.21.15.55:42592) 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.295+0000 7fc2ba578640 1 -- 172.21.15.55:0/3645148701 learned_addr learned my addr 172.21.15.55:0/3645148701 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.295+0000 7fc2b9d77640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2a0004800 0x7fc2b41f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.295+0000 7fc2b9576640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b40b7db0 0x7fc2b40b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.296+0000 7fc2ba578640 1 -- 172.21.15.55:0/3645148701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2a0004800 msgr2=0x7fc2b41f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.296+0000 7fc2ba578640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2a0004800 0x7fc2b41f0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.296+0000 7fc2ba578640 1 -- 172.21.15.55:0/3645148701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b40b7db0 msgr2=0x7fc2b40b8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.296+0000 7fc2ba578640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b40b7db0 0x7fc2b40b8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.296+0000 7fc2ba578640 1 -- 172.21.15.55:0/3645148701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b41f1200 con 0x7fc2b40cad40 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.296+0000 7fc2ba578640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40cad40 0x7fc2b40cb1c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc2b408ce80 tx=0x7fc2ac00ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.296+0000 7fc2aa7fc640 1 -- 172.21.15.55:0/3645148701 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac019070 con 0x7fc2b40cad40 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.296+0000 7fc2aa7fc640 1 -- 172.21.15.55:0/3645148701 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac003b80 con 0x7fc2b40cad40 2024-04-25T08:55:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.296+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3645148701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b41f6ff0 con 0x7fc2b40cad40 2024-04-25T08:55:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.296+0000 7fc2aa7fc640 1 -- 172.21.15.55:0/3645148701 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac0050d0 con 0x7fc2b40cad40 2024-04-25T08:55:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.296+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3645148701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b41f75b0 con 0x7fc2b40cad40 2024-04-25T08:55:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.297+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3645148701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b40749b0 con 0x7fc2b40cad40 2024-04-25T08:55:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.297+0000 7fc2aa7fc640 1 -- 172.21.15.55:0/3645148701 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc2ac01c070 con 0x7fc2b40cad40 2024-04-25T08:55:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.298+0000 7fc2aa7fc640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc29806b500 0x7fc29806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.298+0000 7fc2aa7fc640 1 -- 172.21.15.55:0/3645148701 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc2ac089290 con 0x7fc2b40cad40 2024-04-25T08:55:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.298+0000 7fc2b9d77640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc29806b500 0x7fc29806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.298+0000 7fc2b9d77640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc29806b500 0x7fc29806d9c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc2b406ca30 tx=0x7fc2b0001110 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.302+0000 7fc2aa7fc640 1 -- 172.21.15.55:0/3645148701 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2ac057ea0 con 0x7fc2b40cad40 2024-04-25T08:55:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.484+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3645148701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2b40d1580 con 0x7fc2b40cad40 2024-04-25T08:55:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.485+0000 7fc2aa7fc640 1 -- 172.21.15.55:0/3645148701 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12891 (secure 0 0 0) 0x7fc2ac05bf40 con 0x7fc2b40cad40 2024-04-25T08:55:13.475 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:13.475 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:55:12.794701+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:55:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3645148701 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc29806b500 msgr2=0x7fc29806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc29806b500 0x7fc29806d9c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc2b406ca30 tx=0x7fc2b0001110 comp rx=0 tx=0).stop 2024-04-25T08:55:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3645148701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40cad40 msgr2=0x7fc2b40cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40cad40 0x7fc2b40cb1c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc2b408ce80 tx=0x7fc2ac00ead0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3645148701 shutdown_connections 2024-04-25T08:55:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc29806b500 0x7fc29806d9c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40cad40 0x7fc2b40cb1c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2b40b7db0 0x7fc2b40b8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 --2- 172.21.15.55:0/3645148701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2a0004800 0x7fc2b41f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3645148701 >> 172.21.15.55:0/3645148701 conn(0x7fc2b4072900 msgr2=0x7fc2b406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:13.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3645148701 shutdown_connections 2024-04-25T08:55:13.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.487+0000 7fc2bbfdb640 1 -- 172.21.15.55:0/3645148701 wait complete. 2024-04-25T08:55:13.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:55:13.488 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:55:13.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.602+0000 7f5d5cb5c640 1 Processor -- start 2024-04-25T08:55:13.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.602+0000 7f5d5cb5c640 1 -- start start 2024-04-25T08:55:13.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d5cb5c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d580b2740 0x7f5d5815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d5cb5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d580ce1a0 0x7f5d580ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d5cb5c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5806c150 con 0x7f5d580d0490 2024-04-25T08:55:13.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d5cb5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d580d2000 con 0x7f5d580ce1a0 2024-04-25T08:55:13.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d5cb5c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5806cd60 con 0x7f5d580b2740 2024-04-25T08:55:13.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d56d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d580ce1a0 0x7f5d580ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d56d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d580ce1a0 0x7f5d580ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42594/0 (socket says 172.21.15.55:42594) 2024-04-25T08:55:13.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d56d9d640 1 -- 172.21.15.55:0/3061878283 learned_addr learned my addr 172.21.15.55:0/3061878283 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:13.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d4ffff640 1 --2- 172.21.15.55:0/3061878283 >> v2:172.21.15.167:3300/0 conn(0x7f5d580b2740 0x7f5d5815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d56d9d640 1 -- 172.21.15.55:0/3061878283 >> v2:172.21.15.167:3300/0 conn(0x7f5d580b2740 msgr2=0x7f5d5815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:13.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d56d9d640 1 --2- 172.21.15.55:0/3061878283 >> v2:172.21.15.167:3300/0 conn(0x7f5d580b2740 0x7f5d5815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d56d9d640 1 -- 172.21.15.55:0/3061878283 >> v1:172.21.15.167:6789/0 conn(0x7f5d580d0490 legacy=0x7f5d580d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:13.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.603+0000 7f5d56d9d640 1 -- 172.21.15.55:0/3061878283 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5806c430 con 0x7f5d580ce1a0 2024-04-25T08:55:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.604+0000 7f5d56d9d640 1 --2- 172.21.15.55:0/3061878283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ce1a0 0x7f5d580ce630 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5d580d1540 tx=0x7f5d5002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3b8e4499063599 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.604+0000 7f5d55d9b640 1 -- 172.21.15.55:0/3061878283 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50036070 con 0x7f5d580ce1a0 2024-04-25T08:55:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.604+0000 7f5d55d9b640 1 -- 172.21.15.55:0/3061878283 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d50031600 con 0x7f5d580ce1a0 2024-04-25T08:55:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.604+0000 7f5d55d9b640 1 -- 172.21.15.55:0/3061878283 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d500319d0 con 0x7f5d580ce1a0 2024-04-25T08:55:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.605+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/3061878283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ce1a0 msgr2=0x7f5d580ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.605+0000 7f5d5cb5c640 1 --2- 172.21.15.55:0/3061878283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ce1a0 0x7f5d580ce630 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5d580d1540 tx=0x7f5d5002a660 comp rx=0 tx=0).stop 2024-04-25T08:55:13.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.605+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/3061878283 shutdown_connections 2024-04-25T08:55:13.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.605+0000 7f5d5cb5c640 1 --2- 172.21.15.55:0/3061878283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ce1a0 0x7f5d580ce630 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.605+0000 7f5d5cb5c640 1 --2- 172.21.15.55:0/3061878283 >> v2:172.21.15.167:3300/0 conn(0x7f5d580b2740 0x7f5d5815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.605+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/3061878283 >> 172.21.15.55:0/3061878283 conn(0x7f5d580b5660 msgr2=0x7f5d580b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:13.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.605+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/3061878283 shutdown_connections 2024-04-25T08:55:13.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.605+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/3061878283 wait complete. 2024-04-25T08:55:13.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.606+0000 7f5d5cb5c640 1 Processor -- start 2024-04-25T08:55:13.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.606+0000 7f5d5cb5c640 1 -- start start 2024-04-25T08:55:13.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d5cb5c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d580b2740 0x7f5d580ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d5cb5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ce1a0 0x7f5d58145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d5cb5c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d580d0490 0x7f5d581617a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d5cb5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5806c9f0 con 0x7f5d580ce1a0 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d5cb5c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5815f1d0 con 0x7f5d580b2740 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d5cb5c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5815e020 con 0x7f5d580d0490 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d4ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ce1a0 0x7f5d58145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d4ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ce1a0 0x7f5d58145c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42596/0 (socket says 172.21.15.55:42596) 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d4ffff640 1 -- 172.21.15.55:0/31263501 learned_addr learned my addr 172.21.15.55:0/31263501 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d56d9d640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d580d0490 0x7f5d581617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d5659c640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d580b2740 0x7f5d580ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d4ffff640 1 -- 172.21.15.55:0/31263501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d580d0490 msgr2=0x7f5d581617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d4ffff640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d580d0490 0x7f5d581617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d4ffff640 1 -- 172.21.15.55:0/31263501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d580b2740 msgr2=0x7f5d580ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d4ffff640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d580b2740 0x7f5d580ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d4ffff640 1 -- 172.21.15.55:0/31263501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d580cacc0 con 0x7f5d580ce1a0 2024-04-25T08:55:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d56d9d640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d580d0490 0x7f5d581617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d5659c640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d580b2740 0x7f5d580ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.607+0000 7f5d4ffff640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ce1a0 0x7f5d58145c00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000d800 tx=0x7f5d4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.608+0000 7f5d4effd640 1 -- 172.21.15.55:0/31263501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000b6c0 con 0x7f5d580ce1a0 2024-04-25T08:55:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.608+0000 7f5d4effd640 1 -- 172.21.15.55:0/31263501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d40019070 con 0x7f5d580ce1a0 2024-04-25T08:55:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.608+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/31263501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d58160260 con 0x7f5d580ce1a0 2024-04-25T08:55:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.608+0000 7f5d4effd640 1 -- 172.21.15.55:0/31263501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000ba80 con 0x7f5d580ce1a0 2024-04-25T08:55:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.608+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/31263501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d58160820 con 0x7f5d580ce1a0 2024-04-25T08:55:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.609+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/31263501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d580ca9d0 con 0x7f5d580ce1a0 2024-04-25T08:55:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.609+0000 7f5d4effd640 1 -- 172.21.15.55:0/31263501 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d4000bc20 con 0x7f5d580ce1a0 2024-04-25T08:55:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.610+0000 7f5d4effd640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d3806b4d0 0x7f5d3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.610+0000 7f5d5659c640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d3806b4d0 0x7f5d3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.610+0000 7f5d4effd640 1 -- 172.21.15.55:0/31263501 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d4008a390 con 0x7f5d580ce1a0 2024-04-25T08:55:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.610+0000 7f5d5659c640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d3806b4d0 0x7f5d3806d990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5d48006fd0 tx=0x7f5d48008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.614+0000 7f5d4effd640 1 -- 172.21.15.55:0/31263501 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d580ca9d0 con 0x7f5d580ce1a0 2024-04-25T08:55:13.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.796+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/31263501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d580d18d0 con 0x7f5d580ce1a0 2024-04-25T08:55:13.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.796+0000 7f5d4effd640 1 -- 172.21.15.55:0/31263501 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d4001c360 con 0x7f5d580ce1a0 2024-04-25T08:55:13.786 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:55:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/31263501 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d3806b4d0 msgr2=0x7f5d3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d3806b4d0 0x7f5d3806d990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5d48006fd0 tx=0x7f5d48008040 comp rx=0 tx=0).stop 2024-04-25T08:55:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/31263501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ce1a0 msgr2=0x7f5d58145c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ce1a0 0x7f5d58145c00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000d800 tx=0x7f5d4000dcc0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/31263501 shutdown_connections 2024-04-25T08:55:13.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d3806b4d0 0x7f5d3806d990 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d580d0490 0x7f5d581617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ce1a0 0x7f5d58145c00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 --2- 172.21.15.55:0/31263501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d580b2740 0x7f5d580ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/31263501 >> 172.21.15.55:0/31263501 conn(0x7f5d580b5660 msgr2=0x7f5d580b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:13.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/31263501 shutdown_connections 2024-04-25T08:55:13.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.798+0000 7f5d5cb5c640 1 -- 172.21.15.55:0/31263501 wait complete. 2024-04-25T08:55:13.799 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:55:13.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.910+0000 7fad85729640 1 Processor -- start 2024-04-25T08:55:13.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.910+0000 7fad85729640 1 -- start start 2024-04-25T08:55:13.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.911+0000 7fad85729640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad80160f00 0x7fad800ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.911+0000 7fad85729640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad80161bf0 con 0x7fad801616f0 2024-04-25T08:55:13.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.911+0000 7fad85729640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad80161ed0 con 0x7fad8006aba0 2024-04-25T08:55:13.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.911+0000 7fad85729640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8006fab0 con 0x7fad80160f00 2024-04-25T08:55:13.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.911+0000 7fad7e7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fad801616f0 0x7fad80072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41738/0 (socket says 172.21.15.55:41738) 2024-04-25T08:55:13.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.911+0000 7fad7e7fc640 1 -- 172.21.15.55:0/1144940691 learned_addr learned my addr 172.21.15.55:0/1144940691 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7effd640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad80160f00 0x7fad800ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110213710 0 0) 0x7fad80161bf0 con 0x7fad801616f0 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad6c003520 con 0x7fad801616f0 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1607871411 0 0) 0x7fad6c003520 con 0x7fad801616f0 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad80160f00 msgr2=0x7fad800ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad80160f00 0x7fad800ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 >> v1:172.21.15.167:6789/0 conn(0x7fad8006aba0 legacy=0x7fad8006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad801621b0 con 0x7fad801616f0 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fad68001670 con 0x7fad801616f0 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 >> v1:172.21.15.55:6789/0 conn(0x7fad801616f0 legacy=0x7fad80072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad80160f00 0x7fad6c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad6c003f80 0x7fad6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad6c004d40 0x7fad6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8006fab0 con 0x7fad6c003f80 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c00bad0 con 0x7fad6c004d40 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c00bcd0 con 0x7fad80160f00 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7e7fc640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad6c003f80 0x7fad6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7effd640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad80160f00 0x7fad6c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7f7fe640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad6c004d40 0x7fad6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7e7fc640 1 -- 172.21.15.55:0/1144940691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad80160f00 msgr2=0x7fad6c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7e7fc640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad80160f00 0x7fad6c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7e7fc640 1 -- 172.21.15.55:0/1144940691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad6c004d40 msgr2=0x7fad6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7e7fc640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad6c004d40 0x7fad6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.912+0000 7fad7e7fc640 1 -- 172.21.15.55:0/1144940691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c003520 con 0x7fad6c003f80 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.913+0000 7fad7e7fc640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad6c003f80 0x7fad6c004800 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fad6800c210 tx=0x7fad6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3b85a53c991680 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.913+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68007cf0 con 0x7fad6c003f80 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.913+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad68005af0 con 0x7fad6c003f80 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.913+0000 7fad7dffb640 1 -- 172.21.15.55:0/1144940691 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68007070 con 0x7fad6c003f80 2024-04-25T08:55:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.914+0000 7fad85729640 1 -- 172.21.15.55:0/1144940691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad6c003f80 msgr2=0x7fad6c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.914+0000 7fad85729640 1 --2- 172.21.15.55:0/1144940691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad6c003f80 0x7fad6c004800 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fad6800c210 tx=0x7fad6c005830 comp rx=0 tx=0).stop 2024-04-25T08:55:13.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.914+0000 7fad7f7fe640 1 -- 172.21.15.55:0/1144940691 reap_dead start 2024-04-25T08:55:13.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.914+0000 7fad85729640 1 -- 172.21.15.55:0/1144940691 shutdown_connections 2024-04-25T08:55:13.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.914+0000 7fad85729640 1 -- 172.21.15.55:0/1144940691 >> 172.21.15.55:0/1144940691 conn(0x7fad800b2370 msgr2=0x7fad800b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:13.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.914+0000 7fad85729640 1 -- 172.21.15.55:0/1144940691 shutdown_connections 2024-04-25T08:55:13.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.914+0000 7fad85729640 1 -- 172.21.15.55:0/1144940691 wait complete. 2024-04-25T08:55:13.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.915+0000 7fad85729640 1 Processor -- start 2024-04-25T08:55:13.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.915+0000 7fad85729640 1 -- start start 2024-04-25T08:55:13.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad85729640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad6c003f80 0x7fad80154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad85729640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad800b1aa0 0x7fad8015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad85729640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad800b1f20 0x7fad8015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad85729640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad80161460 con 0x7fad800b1f20 2024-04-25T08:55:13.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad85729640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad801612e0 con 0x7fad6c003f80 2024-04-25T08:55:13.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad85729640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad800ce640 con 0x7fad800b1aa0 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad7f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad800b1f20 0x7fad8015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad7f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad800b1f20 0x7fad8015bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42628/0 (socket says 172.21.15.55:42628) 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad7f7fe640 1 -- 172.21.15.55:0/4068171106 learned_addr learned my addr 172.21.15.55:0/4068171106 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad7effd640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad6c003f80 0x7fad80154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad7e7fc640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad800b1aa0 0x7fad8015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad7f7fe640 1 -- 172.21.15.55:0/4068171106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad800b1aa0 msgr2=0x7fad8015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad7f7fe640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad800b1aa0 0x7fad8015b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad7f7fe640 1 -- 172.21.15.55:0/4068171106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad6c003f80 msgr2=0x7fad80154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad7f7fe640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad6c003f80 0x7fad80154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.916+0000 7fad7f7fe640 1 -- 172.21.15.55:0/4068171106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad801568e0 con 0x7fad800b1f20 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.917+0000 7fad7f7fe640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad800b1f20 0x7fad8015bce0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fad8006de20 tx=0x7fad7000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.917+0000 7fad777fe640 1 -- 172.21.15.55:0/4068171106 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70003b80 con 0x7fad800b1f20 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.917+0000 7fad777fe640 1 -- 172.21.15.55:0/4068171106 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad70018070 con 0x7fad800b1f20 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.917+0000 7fad85729640 1 -- 172.21.15.55:0/4068171106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad80156bc0 con 0x7fad800b1f20 2024-04-25T08:55:13.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.917+0000 7fad777fe640 1 -- 172.21.15.55:0/4068171106 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad700050d0 con 0x7fad800b1f20 2024-04-25T08:55:13.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.917+0000 7fad85729640 1 -- 172.21.15.55:0/4068171106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad80157180 con 0x7fad800b1f20 2024-04-25T08:55:13.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.918+0000 7fad85729640 1 -- 172.21.15.55:0/4068171106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad800749b0 con 0x7fad800b1f20 2024-04-25T08:55:13.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.918+0000 7fad777fe640 1 -- 172.21.15.55:0/4068171106 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fad70005270 con 0x7fad800b1f20 2024-04-25T08:55:13.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.919+0000 7fad777fe640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fad6006b4d0 0x7fad6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:13.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.919+0000 7fad7effd640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fad6006b4d0 0x7fad6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:13.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.919+0000 7fad777fe640 1 -- 172.21.15.55:0/4068171106 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad70089c70 con 0x7fad800b1f20 2024-04-25T08:55:13.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.919+0000 7fad7effd640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fad6006b4d0 0x7fad6006d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fad78009bc0 tx=0x7fad78009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:13.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:13.923+0000 7fad777fe640 1 -- 172.21.15.55:0/4068171106 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fad70058e40 con 0x7fad800b1f20 2024-04-25T08:55:14.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.105+0000 7fad85729640 1 -- 172.21.15.55:0/4068171106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fad800cdc40 con 0x7fad800b1f20 2024-04-25T08:55:14.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.106+0000 7fad777fe640 1 -- 172.21.15.55:0/4068171106 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+65 (secure 0 0 0) 0x7fad70058740 con 0x7fad800b1f20 2024-04-25T08:55:14.096 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:14.096 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T08:55:14.096 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:14.096 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-25T08:55:14.096 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-25T08:55:14.096 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:14.096 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T08:55:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.107+0000 7fad85729640 1 -- 172.21.15.55:0/4068171106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fad6006b4d0 msgr2=0x7fad6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.107+0000 7fad85729640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fad6006b4d0 0x7fad6006d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fad78009bc0 tx=0x7fad78009190 comp rx=0 tx=0).stop 2024-04-25T08:55:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.107+0000 7fad85729640 1 -- 172.21.15.55:0/4068171106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad800b1f20 msgr2=0x7fad8015bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.107+0000 7fad85729640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad800b1f20 0x7fad8015bce0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fad8006de20 tx=0x7fad7000fc80 comp rx=0 tx=0).stop 2024-04-25T08:55:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.108+0000 7fad85729640 1 -- 172.21.15.55:0/4068171106 shutdown_connections 2024-04-25T08:55:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.108+0000 7fad85729640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fad6006b4d0 0x7fad6006d990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.108+0000 7fad85729640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad800b1f20 0x7fad8015bce0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.108+0000 7fad85729640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad800b1aa0 0x7fad8015b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.108+0000 7fad85729640 1 --2- 172.21.15.55:0/4068171106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad6c003f80 0x7fad80154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.108+0000 7fad85729640 1 -- 172.21.15.55:0/4068171106 >> 172.21.15.55:0/4068171106 conn(0x7fad800b2370 msgr2=0x7fad8006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.108+0000 7fad85729640 1 -- 172.21.15.55:0/4068171106 shutdown_connections 2024-04-25T08:55:14.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.108+0000 7fad85729640 1 -- 172.21.15.55:0/4068171106 wait complete. 2024-04-25T08:55:14.108 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:55:14.108 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:55:14.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.223+0000 7fc836dd5640 1 Processor -- start 2024-04-25T08:55:14.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.223+0000 7fc836dd5640 1 -- start start 2024-04-25T08:55:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.224+0000 7fc836dd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc830161780 0x7fc8300b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.224+0000 7fc836dd5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83006bb70 con 0x7fc830147550 2024-04-25T08:55:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.224+0000 7fc836dd5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8300b3190 con 0x7fc83006e900 2024-04-25T08:55:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.224+0000 7fc836dd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300b3470 con 0x7fc830161780 2024-04-25T08:55:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.224+0000 7fc834b71640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc830147550 0x7fc8300acf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41748/0 (socket says 172.21.15.55:41748) 2024-04-25T08:55:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.224+0000 7fc834b71640 1 -- 172.21.15.55:0/2621128412 learned_addr learned my addr 172.21.15.55:0/2621128412 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.224+0000 7fc82ffff640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc830161780 0x7fc8300b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623081853 0 0) 0x7fc83006bb70 con 0x7fc830147550 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc81c003520 con 0x7fc830147550 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3831862686 0 0) 0x7fc81c003520 con 0x7fc830147550 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc830161780 msgr2=0x7fc8300b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc830161780 0x7fc8300b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 >> v1:172.21.15.167:6789/0 conn(0x7fc83006e900 legacy=0x7fc8300b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300b3750 con 0x7fc830147550 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc8280019f0 con 0x7fc830147550 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 >> v1:172.21.15.55:6789/0 conn(0x7fc830147550 legacy=0x7fc8300acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc81c0039e0 0x7fc81c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81c004390 0x7fc81c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc81c005010 0x7fc81c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300b3470 con 0x7fc81c0039e0 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c00bf30 con 0x7fc81c005010 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c00c130 con 0x7fc81c004390 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82ffff640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc830161780 0x7fc8300b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc834b71640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc81c0039e0 0x7fc81c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc835372640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc81c005010 0x7fc81c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82ffff640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81c004390 0x7fc81c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc834b71640 1 -- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81c004390 msgr2=0x7fc81c004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc834b71640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81c004390 0x7fc81c004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc834b71640 1 -- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc81c005010 msgr2=0x7fc81c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc834b71640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc81c005010 0x7fc81c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc834b71640 1 -- 172.21.15.55:0/2621128412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c003520 con 0x7fc81c0039e0 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.225+0000 7fc82ffff640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81c004390 0x7fc81c004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.226+0000 7fc834b71640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc81c0039e0 0x7fc81c003dc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc82800a800 tx=0x7fc81c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1e40cd27eb648a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.226+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800a450 con 0x7fc81c0039e0 2024-04-25T08:55:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.226+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82802f070 con 0x7fc81c0039e0 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.226+0000 7fc82f7fe640 1 -- 172.21.15.55:0/2621128412 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82802bc70 con 0x7fc81c0039e0 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.227+0000 7fc836dd5640 1 -- 172.21.15.55:0/2621128412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc81c0039e0 msgr2=0x7fc81c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.227+0000 7fc836dd5640 1 --2- 172.21.15.55:0/2621128412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc81c0039e0 0x7fc81c003dc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc82800a800 tx=0x7fc81c005830 comp rx=0 tx=0).stop 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.227+0000 7fc835372640 1 -- 172.21.15.55:0/2621128412 reap_dead start 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.227+0000 7fc836dd5640 1 -- 172.21.15.55:0/2621128412 shutdown_connections 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.227+0000 7fc836dd5640 1 -- 172.21.15.55:0/2621128412 >> 172.21.15.55:0/2621128412 conn(0x7fc83006aba0 msgr2=0x7fc83006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.227+0000 7fc836dd5640 1 -- 172.21.15.55:0/2621128412 shutdown_connections 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.227+0000 7fc836dd5640 1 -- 172.21.15.55:0/2621128412 wait complete. 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.228+0000 7fc836dd5640 1 Processor -- start 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.228+0000 7fc836dd5640 1 -- start start 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc836dd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81c0039e0 0x7fc8300cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc836dd5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8301373b0 0x7fc8301606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc836dd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8300afe80 0x7fc8300b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc836dd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300ad6a0 con 0x7fc8300afe80 2024-04-25T08:55:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc836dd5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300b3d10 con 0x7fc8301373b0 2024-04-25T08:55:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc836dd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc830147930 con 0x7fc81c0039e0 2024-04-25T08:55:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc835372640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8300afe80 0x7fc8300b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc835372640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8300afe80 0x7fc8300b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42640/0 (socket says 172.21.15.55:42640) 2024-04-25T08:55:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc835372640 1 -- 172.21.15.55:0/1616207268 learned_addr learned my addr 172.21.15.55:0/1616207268 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc834b71640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81c0039e0 0x7fc8300cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc82ffff640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8301373b0 0x7fc8301606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc835372640 1 -- 172.21.15.55:0/1616207268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81c0039e0 msgr2=0x7fc8300cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc835372640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81c0039e0 0x7fc8300cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc835372640 1 -- 172.21.15.55:0/1616207268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8301373b0 msgr2=0x7fc8301606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc835372640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8301373b0 0x7fc8301606b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.229+0000 7fc835372640 1 -- 172.21.15.55:0/1616207268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300cd540 con 0x7fc8300afe80 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.230+0000 7fc835372640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8300afe80 0x7fc8300b0300 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc8300732e0 tx=0x7fc82000fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.230+0000 7fc82d7fa640 1 -- 172.21.15.55:0/1616207268 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820019070 con 0x7fc8300afe80 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.230+0000 7fc82d7fa640 1 -- 172.21.15.55:0/1616207268 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8200050d0 con 0x7fc8300afe80 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.230+0000 7fc836dd5640 1 -- 172.21.15.55:0/1616207268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8300cd820 con 0x7fc8300afe80 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.230+0000 7fc82d7fa640 1 -- 172.21.15.55:0/1616207268 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200067d0 con 0x7fc8300afe80 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.230+0000 7fc836dd5640 1 -- 172.21.15.55:0/1616207268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8300cd230 con 0x7fc8300afe80 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.231+0000 7fc836dd5640 1 -- 172.21.15.55:0/1616207268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8300b0840 con 0x7fc8300afe80 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.231+0000 7fc82d7fa640 1 -- 172.21.15.55:0/1616207268 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc82001c070 con 0x7fc8300afe80 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.232+0000 7fc82d7fa640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc81006b4d0 0x7fc81006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.232+0000 7fc834b71640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc81006b4d0 0x7fc81006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.232+0000 7fc82d7fa640 1 -- 172.21.15.55:0/1616207268 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc820088e60 con 0x7fc8300afe80 2024-04-25T08:55:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.232+0000 7fc834b71640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc81006b4d0 0x7fc81006d990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc828033000 tx=0x7fc828009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:14.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.236+0000 7fc82d7fa640 1 -- 172.21.15.55:0/1616207268 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc820057a70 con 0x7fc8300afe80 2024-04-25T08:55:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.417+0000 7fc836dd5640 1 -- 172.21.15.55:0/1616207268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc8300cdd40 con 0x7fc8300afe80 2024-04-25T08:55:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.784+0000 7fc82d7fa640 1 -- 172.21.15.55:0/1616207268 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc82005bb10 con 0x7fc8300afe80 2024-04-25T08:55:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-25T08:55:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.786+0000 7fc836dd5640 1 -- 172.21.15.55:0/1616207268 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc81006b4d0 msgr2=0x7fc81006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.787+0000 7fc836dd5640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc81006b4d0 0x7fc81006d990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc828033000 tx=0x7fc828009030 comp rx=0 tx=0).stop 2024-04-25T08:55:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.787+0000 7fc836dd5640 1 -- 172.21.15.55:0/1616207268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8300afe80 msgr2=0x7fc8300b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.787+0000 7fc836dd5640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8300afe80 0x7fc8300b0300 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc8300732e0 tx=0x7fc82000fb40 comp rx=0 tx=0).stop 2024-04-25T08:55:14.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.787+0000 7fc836dd5640 1 -- 172.21.15.55:0/1616207268 shutdown_connections 2024-04-25T08:55:14.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.787+0000 7fc836dd5640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc81006b4d0 0x7fc81006d990 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.787+0000 7fc836dd5640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8300afe80 0x7fc8300b0300 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.787+0000 7fc836dd5640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8301373b0 0x7fc8301606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.787+0000 7fc836dd5640 1 --2- 172.21.15.55:0/1616207268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81c0039e0 0x7fc8300cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.787+0000 7fc836dd5640 1 -- 172.21.15.55:0/1616207268 >> 172.21.15.55:0/1616207268 conn(0x7fc83006aba0 msgr2=0x7fc8300b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:14.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.787+0000 7fc836dd5640 1 -- 172.21.15.55:0/1616207268 shutdown_connections 2024-04-25T08:55:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.787+0000 7fc836dd5640 1 -- 172.21.15.55:0/1616207268 wait complete. 2024-04-25T08:55:14.792 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:55:14.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.912+0000 7f4269b69640 1 Processor -- start 2024-04-25T08:55:14.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.912+0000 7f4269b69640 1 -- start start 2024-04-25T08:55:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f4269b69640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f426406b2b0 0x7f426415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f4269b69640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42640cd0f0 con 0x7f42640cc7a0 2024-04-25T08:55:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f4269b69640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42640cd3d0 con 0x7f42640ce390 2024-04-25T08:55:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f4269b69640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640cbdb0 con 0x7f426406b2b0 2024-04-25T08:55:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f42637fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f42640cc7a0 0x7f42640b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41764/0 (socket says 172.21.15.55:41764) 2024-04-25T08:55:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f42637fe640 1 -- 172.21.15.55:0/3574397711 learned_addr learned my addr 172.21.15.55:0/3574397711 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756772985 0 0) 0x7f42640cd0f0 con 0x7f42640cc7a0 2024-04-25T08:55:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f424c003520 con 0x7f42640cc7a0 2024-04-25T08:55:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f4263fff640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f426406b2b0 0x7f426415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1965894699 0 0) 0x7f424c003520 con 0x7f42640cc7a0 2024-04-25T08:55:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f426406b2b0 msgr2=0x7f426415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f42627fc640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f426406b2b0 0x7f426415d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 >> v1:172.21.15.167:6789/0 conn(0x7f42640ce390 legacy=0x7f426406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640cd6b0 con 0x7f42640cc7a0 2024-04-25T08:55:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.913+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f4254001670 con 0x7f42640cc7a0 2024-04-25T08:55:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 >> v1:172.21.15.55:6789/0 conn(0x7f42640cc7a0 legacy=0x7f42640b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f42627fc640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f424c0039e0 0x7f424c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f42627fc640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f426406b2b0 0x7f424c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f42627fc640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f424c004d40 0x7f424c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c00ba70 con 0x7f424c004d40 2024-04-25T08:55:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c00bc20 con 0x7f424c0039e0 2024-04-25T08:55:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424c00be20 con 0x7f426406b2b0 2024-04-25T08:55:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f4263fff640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f424c004d40 0x7f424c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f42637fe640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f424c0039e0 0x7f424c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f4262ffd640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f426406b2b0 0x7f424c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f4263fff640 1 -- 172.21.15.55:0/3574397711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f426406b2b0 msgr2=0x7f424c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f4263fff640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f426406b2b0 0x7f424c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f4263fff640 1 -- 172.21.15.55:0/3574397711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f424c0039e0 msgr2=0x7f424c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f4263fff640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f424c0039e0 0x7f424c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.914+0000 7f4263fff640 1 -- 172.21.15.55:0/3574397711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c003520 con 0x7f424c004d40 2024-04-25T08:55:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.915+0000 7f4263fff640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f424c004d40 0x7f424c0051c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f425c009f90 tx=0x7f424c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e3160953ec45d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.915+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c009c10 con 0x7f424c004d40 2024-04-25T08:55:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.915+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c036070 con 0x7f424c004d40 2024-04-25T08:55:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.915+0000 7f42627fc640 1 -- 172.21.15.55:0/3574397711 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c031850 con 0x7f424c004d40 2024-04-25T08:55:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.915+0000 7f4269b69640 1 -- 172.21.15.55:0/3574397711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f424c004d40 msgr2=0x7f424c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.915+0000 7f4269b69640 1 --2- 172.21.15.55:0/3574397711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f424c004d40 0x7f424c0051c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f425c009f90 tx=0x7f424c005830 comp rx=0 tx=0).stop 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.915+0000 7f4263fff640 1 -- 172.21.15.55:0/3574397711 reap_dead start 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.915+0000 7f4269b69640 1 -- 172.21.15.55:0/3574397711 shutdown_connections 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.915+0000 7f4269b69640 1 -- 172.21.15.55:0/3574397711 >> 172.21.15.55:0/3574397711 conn(0x7f42640d0750 msgr2=0x7f42640d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.916+0000 7f4269b69640 1 -- 172.21.15.55:0/3574397711 shutdown_connections 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.916+0000 7f4269b69640 1 -- 172.21.15.55:0/3574397711 wait complete. 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.917+0000 7f4269b69640 1 Processor -- start 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.917+0000 7f4269b69640 1 -- start start 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4269b69640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f424c004d40 0x7f4264150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4269b69640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640af510 0x7f42640af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4269b69640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42641535f0 0x7f4264153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4269b69640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640ccb80 con 0x7f42640af510 2024-04-25T08:55:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4269b69640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640cda20 con 0x7f424c004d40 2024-04-25T08:55:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4269b69640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640ccd00 con 0x7f42641535f0 2024-04-25T08:55:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640af510 0x7f42640af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640af510 0x7f42640af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42664/0 (socket says 172.21.15.55:42664) 2024-04-25T08:55:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4262ffd640 1 -- 172.21.15.55:0/3879489981 learned_addr learned my addr 172.21.15.55:0/3879489981 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4263fff640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42641535f0 0x7f4264153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f42637fe640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f424c004d40 0x7f4264150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4262ffd640 1 -- 172.21.15.55:0/3879489981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42641535f0 msgr2=0x7f4264153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4262ffd640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42641535f0 0x7f4264153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4262ffd640 1 -- 172.21.15.55:0/3879489981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f424c004d40 msgr2=0x7f4264150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4262ffd640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f424c004d40 0x7f4264150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4262ffd640 1 -- 172.21.15.55:0/3879489981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264154360 con 0x7f42640af510 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4262ffd640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640af510 0x7f42640af990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f425800f7f0 tx=0x7f425800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f424bfff640 1 -- 172.21.15.55:0/3879489981 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42580050d0 con 0x7f42640af510 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f424bfff640 1 -- 172.21.15.55:0/3879489981 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4258018070 con 0x7f42640af510 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4269b69640 1 -- 172.21.15.55:0/3879489981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42641514b0 con 0x7f42640af510 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f424bfff640 1 -- 172.21.15.55:0/3879489981 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800d6d0 con 0x7f42640af510 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.918+0000 7f4269b69640 1 -- 172.21.15.55:0/3879489981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4264151a70 con 0x7f42640af510 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.919+0000 7f4269b69640 1 -- 172.21.15.55:0/3879489981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426406cc40 con 0x7f42640af510 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.920+0000 7f424bfff640 1 -- 172.21.15.55:0/3879489981 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f425800d870 con 0x7f42640af510 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.920+0000 7f424bfff640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f425006b500 0x7f425006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.921+0000 7f42637fe640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f425006b500 0x7f425006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.921+0000 7f424bfff640 1 -- 172.21.15.55:0/3879489981 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4258089d00 con 0x7f42640af510 2024-04-25T08:55:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.921+0000 7f42637fe640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f425006b500 0x7f425006d9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f42640cabf0 tx=0x7f4254000fa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:14.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:14.925+0000 7f424bfff640 1 -- 172.21.15.55:0/3879489981 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4258058710 con 0x7f42640af510 2024-04-25T08:55:15.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.108+0000 7f4269b69640 1 -- 172.21.15.55:0/3879489981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f42640b0530 con 0x7f42640af510 2024-04-25T08:55:15.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.787+0000 7f424bfff640 1 -- 172.21.15.55:0/3879489981 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) v1 ==== 170+0+0 (secure 0 0 0) 0x7f425805c7b0 con 0x7f42640af510 2024-04-25T08:55:15.777 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.789+0000 7f4269b69640 1 -- 172.21.15.55:0/3879489981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f425006b500 msgr2=0x7f425006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.789+0000 7f4269b69640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f425006b500 0x7f425006d9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f42640cabf0 tx=0x7f4254000fa0 comp rx=0 tx=0).stop 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.790+0000 7f4269b69640 1 -- 172.21.15.55:0/3879489981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640af510 msgr2=0x7f42640af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.790+0000 7f4269b69640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640af510 0x7f42640af990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f425800f7f0 tx=0x7f425800fcb0 comp rx=0 tx=0).stop 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.790+0000 7f4269b69640 1 -- 172.21.15.55:0/3879489981 shutdown_connections 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.790+0000 7f4269b69640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f425006b500 0x7f425006d9c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.790+0000 7f4269b69640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42641535f0 0x7f4264153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.790+0000 7f4269b69640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640af510 0x7f42640af990 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.790+0000 7f4269b69640 1 --2- 172.21.15.55:0/3879489981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f424c004d40 0x7f4264150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.790+0000 7f4269b69640 1 -- 172.21.15.55:0/3879489981 >> 172.21.15.55:0/3879489981 conn(0x7f42640d0750 msgr2=0x7f42640cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.790+0000 7f4269b69640 1 -- 172.21.15.55:0/3879489981 shutdown_connections 2024-04-25T08:55:15.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.790+0000 7f4269b69640 1 -- 172.21.15.55:0/3879489981 wait complete. 2024-04-25T08:55:15.808 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:55:15.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.927+0000 7f8d637bd640 1 Processor -- start 2024-04-25T08:55:15.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.928+0000 7f8d637bd640 1 -- start start 2024-04-25T08:55:15.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.928+0000 7f8d637bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c15dc80 0x7f8d5c161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:15.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.928+0000 7f8d637bd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5c1627a0 con 0x7f8d5c0b97c0 2024-04-25T08:55:15.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.928+0000 7f8d637bd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5c1621e0 con 0x7f8d5c0b5c00 2024-04-25T08:55:15.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.928+0000 7f8d637bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c1624c0 con 0x7f8d5c15dc80 2024-04-25T08:55:15.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.928+0000 7f8d60d58640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8d5c0b97c0 0x7f8d5c0b54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41766/0 (socket says 172.21.15.55:41766) 2024-04-25T08:55:15.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d60d58640 1 -- 172.21.15.55:0/2430342622 learned_addr learned my addr 172.21.15.55:0/2430342622 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d61559640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c15dc80 0x7f8d5c161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464692481 0 0) 0x7f8d5c1627a0 con 0x7f8d5c0b97c0 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d44003520 con 0x7f8d5c0b97c0 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20338518 0 0) 0x7f8d5c1621e0 con 0x7f8d5c0b5c00 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d5c1627a0 con 0x7f8d5c0b5c00 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 124166648 0 0) 0x7f8d44003520 con 0x7f8d5c0b97c0 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c15dc80 msgr2=0x7f8d5c161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c15dc80 0x7f8d5c161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 >> v1:172.21.15.167:6789/0 conn(0x7f8d5c0b5c00 legacy=0x7f8d5c0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c0d1c70 con 0x7f8d5c0b97c0 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f8d50001670 con 0x7f8d5c0b97c0 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 >> v1:172.21.15.55:6789/0 conn(0x7f8d5c0b97c0 legacy=0x7f8d5c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:15.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d44003b70 0x7f8d44003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c15dc80 0x7f8d44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d44004d40 0x7f8d440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c1624c0 con 0x7f8d44003b70 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4400ba70 con 0x7f8d44004d40 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4400bc20 con 0x7f8d5c15dc80 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d61559640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d44003b70 0x7f8d44003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d60d58640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c15dc80 0x7f8d44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.929+0000 7f8d61d5a640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d44004d40 0x7f8d440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.930+0000 7f8d61559640 1 -- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c15dc80 msgr2=0x7f8d44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.930+0000 7f8d61559640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c15dc80 0x7f8d44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.930+0000 7f8d61559640 1 -- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d44004d40 msgr2=0x7f8d440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.930+0000 7f8d61559640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d44004d40 0x7f8d440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.930+0000 7f8d61559640 1 -- 172.21.15.55:0/2430342622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44003520 con 0x7f8d44003b70 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.930+0000 7f8d60d58640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c15dc80 0x7f8d44004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.930+0000 7f8d61559640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d44003b70 0x7f8d44003f70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009ac0 tx=0x7f8d44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6468251c51469dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.930+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54036070 con 0x7f8d44003b70 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.930+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d54031400 con 0x7f8d44003b70 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.930+0000 7f8d5bfff640 1 -- 172.21.15.55:0/2430342622 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54009690 con 0x7f8d44003b70 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.931+0000 7f8d637bd640 1 -- 172.21.15.55:0/2430342622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d44003b70 msgr2=0x7f8d44003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.931+0000 7f8d637bd640 1 --2- 172.21.15.55:0/2430342622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d44003b70 0x7f8d44003f70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009ac0 tx=0x7f8d44005830 comp rx=0 tx=0).stop 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.931+0000 7f8d61d5a640 1 -- 172.21.15.55:0/2430342622 reap_dead start 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.931+0000 7f8d637bd640 1 -- 172.21.15.55:0/2430342622 shutdown_connections 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.931+0000 7f8d637bd640 1 -- 172.21.15.55:0/2430342622 >> 172.21.15.55:0/2430342622 conn(0x7f8d5c0d04f0 msgr2=0x7f8d5c0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.931+0000 7f8d637bd640 1 -- 172.21.15.55:0/2430342622 shutdown_connections 2024-04-25T08:55:15.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.931+0000 7f8d637bd640 1 -- 172.21.15.55:0/2430342622 wait complete. 2024-04-25T08:55:15.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.932+0000 7f8d637bd640 1 Processor -- start 2024-04-25T08:55:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.932+0000 7f8d637bd640 1 -- start start 2024-04-25T08:55:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d637bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c156d10 0x7f8d5c1e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d637bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d5c15a520 0x7f8d5c15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d637bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d5c0cb450 0x7f8d5c0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d637bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c1619f0 con 0x7f8d5c0cb450 2024-04-25T08:55:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d637bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c161870 con 0x7f8d5c15a520 2024-04-25T08:55:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d637bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c161b70 con 0x7f8d5c156d10 2024-04-25T08:55:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d61d5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d5c0cb450 0x7f8d5c0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d61d5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d5c0cb450 0x7f8d5c0cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42684/0 (socket says 172.21.15.55:42684) 2024-04-25T08:55:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d61d5a640 1 -- 172.21.15.55:0/3546342887 learned_addr learned my addr 172.21.15.55:0/3546342887 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d61559640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c156d10 0x7f8d5c1e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d60d58640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d5c15a520 0x7f8d5c15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d61d5a640 1 -- 172.21.15.55:0/3546342887 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c156d10 msgr2=0x7f8d5c1e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d61d5a640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c156d10 0x7f8d5c1e8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d61d5a640 1 -- 172.21.15.55:0/3546342887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d5c15a520 msgr2=0x7f8d5c15e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d61d5a640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d5c15a520 0x7f8d5c15e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d61d5a640 1 -- 172.21.15.55:0/3546342887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c1e91d0 con 0x7f8d5c0cb450 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.933+0000 7f8d61d5a640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d5c0cb450 0x7f8d5c0cb8e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0ce070 tx=0x7f8d4c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.934+0000 7f8d59ffb640 1 -- 172.21.15.55:0/3546342887 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c003970 con 0x7f8d5c0cb450 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.934+0000 7f8d59ffb640 1 -- 172.21.15.55:0/3546342887 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c018070 con 0x7f8d5c0cb450 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.934+0000 7f8d59ffb640 1 -- 172.21.15.55:0/3546342887 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c003d50 con 0x7f8d5c0cb450 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.934+0000 7f8d637bd640 1 -- 172.21.15.55:0/3546342887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5c1e94b0 con 0x7f8d5c0cb450 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.934+0000 7f8d637bd640 1 -- 172.21.15.55:0/3546342887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5c157630 con 0x7f8d5c0cb450 2024-04-25T08:55:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.935+0000 7f8d637bd640 1 -- 172.21.15.55:0/3546342887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5c0750b0 con 0x7f8d5c0cb450 2024-04-25T08:55:15.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.935+0000 7f8d59ffb640 1 -- 172.21.15.55:0/3546342887 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8d4c0050d0 con 0x7f8d5c0cb450 2024-04-25T08:55:15.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.936+0000 7f8d59ffb640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d4806b4d0 0x7f8d4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:15.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.936+0000 7f8d59ffb640 1 -- 172.21.15.55:0/3546342887 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8d4c089dd0 con 0x7f8d5c0cb450 2024-04-25T08:55:15.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.936+0000 7f8d61559640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d4806b4d0 0x7f8d4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:15.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.936+0000 7f8d61559640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d4806b4d0 0x7f8d4806d990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8d54033000 tx=0x7f8d54008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:15.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:15.940+0000 7f8d59ffb640 1 -- 172.21.15.55:0/3546342887 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d4c058d40 con 0x7f8d5c0cb450 2024-04-25T08:55:16.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.157+0000 7f8d637bd640 1 -- 172.21.15.55:0/3546342887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8d5c0ca900 con 0x7f8d5c0cb450 2024-04-25T08:55:16.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.820+0000 7f8d59ffb640 1 -- 172.21.15.55:0/3546342887 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8d4c08b020 con 0x7f8d5c0cb450 2024-04-25T08:55:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 6 and data pool 7 2024-04-25T08:55:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.833+0000 7f8d637bd640 1 -- 172.21.15.55:0/3546342887 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d4806b4d0 msgr2=0x7f8d4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.833+0000 7f8d637bd640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d4806b4d0 0x7f8d4806d990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8d54033000 tx=0x7f8d54008030 comp rx=0 tx=0).stop 2024-04-25T08:55:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.833+0000 7f8d637bd640 1 -- 172.21.15.55:0/3546342887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d5c0cb450 msgr2=0x7f8d5c0cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.833+0000 7f8d637bd640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d5c0cb450 0x7f8d5c0cb8e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0ce070 tx=0x7f8d4c00eb20 comp rx=0 tx=0).stop 2024-04-25T08:55:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.834+0000 7f8d637bd640 1 -- 172.21.15.55:0/3546342887 shutdown_connections 2024-04-25T08:55:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.834+0000 7f8d637bd640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d4806b4d0 0x7f8d4806d990 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8d54033000 tx=0x7f8d54008030 comp rx=0 tx=0).stop 2024-04-25T08:55:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.834+0000 7f8d637bd640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d5c0cb450 0x7f8d5c0cb8e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.834+0000 7f8d637bd640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d5c15a520 0x7f8d5c15e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.834+0000 7f8d637bd640 1 --2- 172.21.15.55:0/3546342887 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d5c156d10 0x7f8d5c1e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.834+0000 7f8d637bd640 1 -- 172.21.15.55:0/3546342887 >> 172.21.15.55:0/3546342887 conn(0x7f8d5c0d04f0 msgr2=0x7f8d5c0ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.836+0000 7f8d637bd640 1 -- 172.21.15.55:0/3546342887 shutdown_connections 2024-04-25T08:55:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.836+0000 7f8d637bd640 1 -- 172.21.15.55:0/3546342887 wait complete. 2024-04-25T08:55:16.870 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:55:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.986+0000 7f609809a640 1 Processor -- start 2024-04-25T08:55:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.986+0000 7f609809a640 1 -- start start 2024-04-25T08:55:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f609809a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f609006e2e0 0x7f60900cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f609809a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60900cfc40 0x7f609015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f609809a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60900cdb10 con 0x7f609015a870 2024-04-25T08:55:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f609809a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60900ce720 con 0x7f609006e2e0 2024-04-25T08:55:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f609809a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60900cddf0 con 0x7f60900cfc40 2024-04-25T08:55:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f6095635640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f609006e2e0 0x7f60900cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f6095635640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f609006e2e0 0x7f60900cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42686/0 (socket says 172.21.15.55:42686) 2024-04-25T08:55:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f6095635640 1 -- 172.21.15.55:0/3775330439 learned_addr learned my addr 172.21.15.55:0/3775330439 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f6096637640 1 --2- 172.21.15.55:0/3775330439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60900cfc40 0x7f609015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f6095635640 1 -- 172.21.15.55:0/3775330439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60900cfc40 msgr2=0x7f609015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f6095635640 1 --2- 172.21.15.55:0/3775330439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60900cfc40 0x7f609015ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f6095635640 1 -- 172.21.15.55:0/3775330439 >> v1:172.21.15.167:6789/0 conn(0x7f609015a870 legacy=0x7f60900cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f6095635640 1 -- 172.21.15.55:0/3775330439 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60900ce0d0 con 0x7f609006e2e0 2024-04-25T08:55:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.987+0000 7f6096637640 1 --2- 172.21.15.55:0/3775330439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60900cfc40 0x7f609015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.988+0000 7f6095635640 1 --2- 172.21.15.55:0/3775330439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f609006e2e0 0x7f60900cebb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6080009870 tx=0x7f608002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5fa47944d3ff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.988+0000 7f6094e34640 1 -- 172.21.15.55:0/3775330439 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080037070 con 0x7f609006e2e0 2024-04-25T08:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.988+0000 7f6094e34640 1 -- 172.21.15.55:0/3775330439 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6080032440 con 0x7f609006e2e0 2024-04-25T08:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.988+0000 7f6094e34640 1 -- 172.21.15.55:0/3775330439 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080032810 con 0x7f609006e2e0 2024-04-25T08:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.989+0000 7f609809a640 1 -- 172.21.15.55:0/3775330439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f609006e2e0 msgr2=0x7f60900cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.989+0000 7f609809a640 1 --2- 172.21.15.55:0/3775330439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f609006e2e0 0x7f60900cebb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6080009870 tx=0x7f608002a270 comp rx=0 tx=0).stop 2024-04-25T08:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.989+0000 7f609809a640 1 -- 172.21.15.55:0/3775330439 shutdown_connections 2024-04-25T08:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.989+0000 7f609809a640 1 --2- 172.21.15.55:0/3775330439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60900cfc40 0x7f609015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.989+0000 7f609809a640 1 --2- 172.21.15.55:0/3775330439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f609006e2e0 0x7f60900cebb0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.989+0000 7f609809a640 1 -- 172.21.15.55:0/3775330439 >> 172.21.15.55:0/3775330439 conn(0x7f609006aba0 msgr2=0x7f609006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.989+0000 7f609809a640 1 -- 172.21.15.55:0/3775330439 shutdown_connections 2024-04-25T08:55:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.989+0000 7f609809a640 1 -- 172.21.15.55:0/3775330439 wait complete. 2024-04-25T08:55:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.990+0000 7f609809a640 1 Processor -- start 2024-04-25T08:55:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.990+0000 7f609809a640 1 -- start start 2024-04-25T08:55:16.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f609809a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f609006e2e0 0x7f6090147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:16.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f609809a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60900cfc40 0x7f609015d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f609809a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f609015a870 0x7f609015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f609809a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60900cd700 con 0x7f609015a870 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f609809a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60900cd580 con 0x7f609006e2e0 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f609809a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60900cd880 con 0x7f60900cfc40 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f6096637640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f609015a870 0x7f609015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f6096637640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f609015a870 0x7f609015d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42690/0 (socket says 172.21.15.55:42690) 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f6096637640 1 -- 172.21.15.55:0/2522942672 learned_addr learned my addr 172.21.15.55:0/2522942672 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f6095e36640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f609006e2e0 0x7f6090147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f6095635640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60900cfc40 0x7f609015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f6096637640 1 -- 172.21.15.55:0/2522942672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60900cfc40 msgr2=0x7f609015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f6096637640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60900cfc40 0x7f609015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f6096637640 1 -- 172.21.15.55:0/2522942672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f609006e2e0 msgr2=0x7f6090147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f6096637640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f609006e2e0 0x7f6090147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.991+0000 7f6096637640 1 -- 172.21.15.55:0/2522942672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60901475a0 con 0x7f609015a870 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.992+0000 7f6096637640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f609015a870 0x7f609015d680 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6088009fa0 tx=0x7f608800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.992+0000 7f60867fc640 1 -- 172.21.15.55:0/2522942672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608801a070 con 0x7f609015a870 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.992+0000 7f60867fc640 1 -- 172.21.15.55:0/2522942672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6088003bb0 con 0x7f609015a870 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.992+0000 7f609809a640 1 -- 172.21.15.55:0/2522942672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60900aba90 con 0x7f609015a870 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.992+0000 7f60867fc640 1 -- 172.21.15.55:0/2522942672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6088004030 con 0x7f609015a870 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.992+0000 7f609809a640 1 -- 172.21.15.55:0/2522942672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60900a9560 con 0x7f609015a870 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.993+0000 7f609809a640 1 -- 172.21.15.55:0/2522942672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60900749b0 con 0x7f609015a870 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.993+0000 7f60867fc640 1 -- 172.21.15.55:0/2522942672 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f608801d070 con 0x7f609015a870 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.994+0000 7f60867fc640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f607406b4d0 0x7f607406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.994+0000 7f60867fc640 1 -- 172.21.15.55:0/2522942672 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f608808a3c0 con 0x7f609015a870 2024-04-25T08:55:16.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.994+0000 7f6095e36640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f607406b4d0 0x7f607406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:16.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.994+0000 7f6095e36640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f607406b4d0 0x7f607406d990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f60900b0f00 tx=0x7f608c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:16.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:16.998+0000 7f60867fc640 1 -- 172.21.15.55:0/2522942672 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f60901475a0 con 0x7f609015a870 2024-04-25T08:55:17.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.181+0000 7f609809a640 1 -- 172.21.15.55:0/2522942672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f609015ba10 con 0x7f609015a870 2024-04-25T08:55:17.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.183+0000 7f60867fc640 1 -- 172.21.15.55:0/2522942672 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16626 (secure 0 0 0) 0x7f6088010070 con 0x7f609015a870 2024-04-25T08:55:17.173 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:17.173 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":46,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:55:16.158969+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:55:14.449282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:55:15.139740+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:55:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.184+0000 7f609809a640 1 -- 172.21.15.55:0/2522942672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f607406b4d0 msgr2=0x7f607406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.184+0000 7f609809a640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f607406b4d0 0x7f607406d990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f60900b0f00 tx=0x7f608c009040 comp rx=0 tx=0).stop 2024-04-25T08:55:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.184+0000 7f609809a640 1 -- 172.21.15.55:0/2522942672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f609015a870 msgr2=0x7f609015d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.184+0000 7f609809a640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f609015a870 0x7f609015d680 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6088009fa0 tx=0x7f608800d560 comp rx=0 tx=0).stop 2024-04-25T08:55:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.185+0000 7f609809a640 1 -- 172.21.15.55:0/2522942672 shutdown_connections 2024-04-25T08:55:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.185+0000 7f609809a640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f607406b4d0 0x7f607406d990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.185+0000 7f609809a640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f609015a870 0x7f609015d680 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.185+0000 7f609809a640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60900cfc40 0x7f609015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.185+0000 7f609809a640 1 --2- 172.21.15.55:0/2522942672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f609006e2e0 0x7f6090147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.185+0000 7f609809a640 1 -- 172.21.15.55:0/2522942672 >> 172.21.15.55:0/2522942672 conn(0x7f609006aba0 msgr2=0x7f60900af150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:17.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.185+0000 7f609809a640 1 -- 172.21.15.55:0/2522942672 shutdown_connections 2024-04-25T08:55:17.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.185+0000 7f609809a640 1 -- 172.21.15.55:0/2522942672 wait complete. 2024-04-25T08:55:17.186 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:55:17.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.296+0000 7facfdaf5640 1 Processor -- start 2024-04-25T08:55:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.296+0000 7facfdaf5640 1 -- start start 2024-04-25T08:55:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.297+0000 7facfdaf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7facf80709b0 0x7facf806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.297+0000 7facfdaf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf806b2b0 0x7facf80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.297+0000 7facfdaf5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf80c5910 con 0x7facf815eb00 2024-04-25T08:55:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.297+0000 7facfdaf5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf80c5bf0 con 0x7facf80709b0 2024-04-25T08:55:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.297+0000 7facfdaf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf80c5ed0 con 0x7facf806b2b0 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.297+0000 7facf77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7facf80709b0 0x7facf806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.297+0000 7facf77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7facf80709b0 0x7facf806fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42698/0 (socket says 172.21.15.55:42698) 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.297+0000 7facf77fe640 1 -- 172.21.15.55:0/1254948060 learned_addr learned my addr 172.21.15.55:0/1254948060 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.297+0000 7facf7fff640 1 --2- 172.21.15.55:0/1254948060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf806b2b0 0x7facf80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.298+0000 7facf77fe640 1 -- 172.21.15.55:0/1254948060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf806b2b0 msgr2=0x7facf80cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.298+0000 7facf77fe640 1 --2- 172.21.15.55:0/1254948060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf806b2b0 0x7facf80cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.298+0000 7facf77fe640 1 -- 172.21.15.55:0/1254948060 >> v1:172.21.15.167:6789/0 conn(0x7facf815eb00 legacy=0x7facf806aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.298+0000 7facf77fe640 1 -- 172.21.15.55:0/1254948060 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf80c61b0 con 0x7facf80709b0 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.298+0000 7facf7fff640 1 --2- 172.21.15.55:0/1254948060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf806b2b0 0x7facf80cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.298+0000 7facf77fe640 1 --2- 172.21.15.55:0/1254948060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf80709b0 0x7facf806fab0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7face80098a0 tx=0x7face802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc6964e90545c9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.298+0000 7facf67fc640 1 -- 172.21.15.55:0/1254948060 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8037070 con 0x7facf80709b0 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.298+0000 7facf67fc640 1 -- 172.21.15.55:0/1254948060 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face8032440 con 0x7facf80709b0 2024-04-25T08:55:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.298+0000 7facf67fc640 1 -- 172.21.15.55:0/1254948060 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8032810 con 0x7facf80709b0 2024-04-25T08:55:17.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.299+0000 7facfdaf5640 1 -- 172.21.15.55:0/1254948060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf80709b0 msgr2=0x7facf806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.299+0000 7facfdaf5640 1 --2- 172.21.15.55:0/1254948060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf80709b0 0x7facf806fab0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7face80098a0 tx=0x7face802a290 comp rx=0 tx=0).stop 2024-04-25T08:55:17.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.299+0000 7facfdaf5640 1 -- 172.21.15.55:0/1254948060 shutdown_connections 2024-04-25T08:55:17.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.299+0000 7facfdaf5640 1 --2- 172.21.15.55:0/1254948060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf806b2b0 0x7facf80cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.299+0000 7facfdaf5640 1 --2- 172.21.15.55:0/1254948060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf80709b0 0x7facf806fab0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.299+0000 7facfdaf5640 1 -- 172.21.15.55:0/1254948060 >> 172.21.15.55:0/1254948060 conn(0x7facf80b2370 msgr2=0x7facf80b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.299+0000 7facfdaf5640 1 -- 172.21.15.55:0/1254948060 shutdown_connections 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.299+0000 7facfdaf5640 1 -- 172.21.15.55:0/1254948060 wait complete. 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.300+0000 7facfdaf5640 1 Processor -- start 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.301+0000 7facfdaf5640 1 -- start start 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.301+0000 7facfdaf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf806b2b0 0x7facf80c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.301+0000 7facfdaf5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf80709b0 0x7facf815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.301+0000 7facfdaf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf815eb00 0x7facf81570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.301+0000 7facfdaf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf815ef90 con 0x7facf815eb00 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.301+0000 7facfdaf5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf80c55e0 con 0x7facf80709b0 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.301+0000 7facfdaf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf80728a0 con 0x7facf806b2b0 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.301+0000 7facf7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf815eb00 0x7facf81570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.301+0000 7facf7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf815eb00 0x7facf81570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42706/0 (socket says 172.21.15.55:42706) 2024-04-25T08:55:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.301+0000 7facf7fff640 1 -- 172.21.15.55:0/1938476255 learned_addr learned my addr 172.21.15.55:0/1938476255 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facf77fe640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf806b2b0 0x7facf80c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facf6ffd640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf80709b0 0x7facf815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facf7fff640 1 -- 172.21.15.55:0/1938476255 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf806b2b0 msgr2=0x7facf80c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facf7fff640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf806b2b0 0x7facf80c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facf7fff640 1 -- 172.21.15.55:0/1938476255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf80709b0 msgr2=0x7facf815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facf7fff640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf80709b0 0x7facf815d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facf7fff640 1 -- 172.21.15.55:0/1938476255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf80c9ef0 con 0x7facf815eb00 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facf7fff640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf815eb00 0x7facf81570a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7facf0007ef0 tx=0x7facf000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facdffff640 1 -- 172.21.15.55:0/1938476255 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf001a070 con 0x7facf815eb00 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facdffff640 1 -- 172.21.15.55:0/1938476255 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf0003b90 con 0x7facf815eb00 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facfdaf5640 1 -- 172.21.15.55:0/1938476255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf80ca1d0 con 0x7facf815eb00 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facdffff640 1 -- 172.21.15.55:0/1938476255 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0004030 con 0x7facf815eb00 2024-04-25T08:55:17.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.302+0000 7facfdaf5640 1 -- 172.21.15.55:0/1938476255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf815f320 con 0x7facf815eb00 2024-04-25T08:55:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.303+0000 7facfdaf5640 1 -- 172.21.15.55:0/1938476255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf806cc40 con 0x7facf815eb00 2024-04-25T08:55:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.304+0000 7facdffff640 1 -- 172.21.15.55:0/1938476255 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7facf001d070 con 0x7facf815eb00 2024-04-25T08:55:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.304+0000 7facdffff640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7face406b4d0 0x7face406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.304+0000 7facf77fe640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7face406b4d0 0x7face406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.304+0000 7facdffff640 1 -- 172.21.15.55:0/1938476255 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facf008a4f0 con 0x7facf815eb00 2024-04-25T08:55:17.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.305+0000 7facf77fe640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7face406b4d0 0x7face406d990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7face8034000 tx=0x7face802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:17.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.308+0000 7facdffff640 1 -- 172.21.15.55:0/1938476255 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7facf0010070 con 0x7facf815eb00 2024-04-25T08:55:17.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.489+0000 7facfdaf5640 1 -- 172.21.15.55:0/1938476255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facf815f110 con 0x7facf815eb00 2024-04-25T08:55:17.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.490+0000 7facdffff640 1 -- 172.21.15.55:0/1938476255 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16626 (secure 0 0 0) 0x7facf0059370 con 0x7facf815eb00 2024-04-25T08:55:17.480 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:17.481 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":46,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:55:16.158969+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:55:14.449282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:55:15.139740+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:55:17.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 -- 172.21.15.55:0/1938476255 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7face406b4d0 msgr2=0x7face406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7face406b4d0 0x7face406d990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7face8034000 tx=0x7face802e000 comp rx=0 tx=0).stop 2024-04-25T08:55:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 -- 172.21.15.55:0/1938476255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf815eb00 msgr2=0x7facf81570a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf815eb00 0x7facf81570a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7facf0007ef0 tx=0x7facf000d4a0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 -- 172.21.15.55:0/1938476255 shutdown_connections 2024-04-25T08:55:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7face406b4d0 0x7face406d990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf815eb00 0x7facf81570a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf80709b0 0x7facf815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 --2- 172.21.15.55:0/1938476255 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf806b2b0 0x7facf80c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 -- 172.21.15.55:0/1938476255 >> 172.21.15.55:0/1938476255 conn(0x7facf80b2370 msgr2=0x7facf815a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 -- 172.21.15.55:0/1938476255 shutdown_connections 2024-04-25T08:55:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.492+0000 7facfdaf5640 1 -- 172.21.15.55:0/1938476255 wait complete. 2024-04-25T08:55:17.493 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:55:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.608+0000 7fdda8d49640 1 Processor -- start 2024-04-25T08:55:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.608+0000 7fdda8d49640 1 -- start start 2024-04-25T08:55:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.609+0000 7fdda8d49640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda40d3b90 0x7fdda40d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.609+0000 7fdda8d49640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdda40d0f60 0x7fdda40b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.609+0000 7fdda8d49640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda40d4090 con 0x7fdda415dca0 2024-04-25T08:55:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.609+0000 7fdda8d49640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda40b6b20 con 0x7fdda40d0f60 2024-04-25T08:55:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.609+0000 7fdda8d49640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40d4370 con 0x7fdda40d3b90 2024-04-25T08:55:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.609+0000 7fdda1d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda40d3b90 0x7fdda40d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.609+0000 7fdda1d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda40d3b90 0x7fdda40d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:48030/0 (socket says 172.21.15.55:48030) 2024-04-25T08:55:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.609+0000 7fdda1d9b640 1 -- 172.21.15.55:0/3162927734 learned_addr learned my addr 172.21.15.55:0/3162927734 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.609+0000 7fdda2d9d640 1 --2- 172.21.15.55:0/3162927734 >> v2:172.21.15.167:3300/0 conn(0x7fdda40d0f60 0x7fdda40b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.609+0000 7fdda259c640 1 --1- 172.21.15.55:0/3162927734 >> v1:172.21.15.167:6789/0 conn(0x7fdda415dca0 0x7fdda40ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:37862/0 (socket says 172.21.15.55:37862) 2024-04-25T08:55:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.610+0000 7fdda1d9b640 1 -- 172.21.15.55:0/3162927734 >> v2:172.21.15.167:3300/0 conn(0x7fdda40d0f60 msgr2=0x7fdda40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.610+0000 7fdda1d9b640 1 --2- 172.21.15.55:0/3162927734 >> v2:172.21.15.167:3300/0 conn(0x7fdda40d0f60 0x7fdda40b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.610+0000 7fdda1d9b640 1 -- 172.21.15.55:0/3162927734 >> v1:172.21.15.167:6789/0 conn(0x7fdda415dca0 legacy=0x7fdda40ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.610+0000 7fdda1d9b640 1 -- 172.21.15.55:0/3162927734 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda40d4650 con 0x7fdda40d3b90 2024-04-25T08:55:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.610+0000 7fdda1d9b640 1 --2- 172.21.15.55:0/3162927734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda40d3b90 0x7fdda40d0a20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009870 tx=0x7fdd8c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb9ffc49ba5beb1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.611+0000 7fdda159a640 1 -- 172.21.15.55:0/3162927734 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c037070 con 0x7fdda40d3b90 2024-04-25T08:55:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.611+0000 7fdda159a640 1 -- 172.21.15.55:0/3162927734 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c032440 con 0x7fdda40d3b90 2024-04-25T08:55:17.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.611+0000 7fdda159a640 1 -- 172.21.15.55:0/3162927734 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c032810 con 0x7fdda40d3b90 2024-04-25T08:55:17.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.611+0000 7fdda8d49640 1 -- 172.21.15.55:0/3162927734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda40d3b90 msgr2=0x7fdda40d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.611+0000 7fdda8d49640 1 --2- 172.21.15.55:0/3162927734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda40d3b90 0x7fdda40d0a20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009870 tx=0x7fdd8c02a270 comp rx=0 tx=0).stop 2024-04-25T08:55:17.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.611+0000 7fdda8d49640 1 -- 172.21.15.55:0/3162927734 shutdown_connections 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.611+0000 7fdda8d49640 1 --2- 172.21.15.55:0/3162927734 >> v2:172.21.15.167:3300/0 conn(0x7fdda40d0f60 0x7fdda40b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.611+0000 7fdda8d49640 1 --2- 172.21.15.55:0/3162927734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda40d3b90 0x7fdda40d0a20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.611+0000 7fdda8d49640 1 -- 172.21.15.55:0/3162927734 >> 172.21.15.55:0/3162927734 conn(0x7fdda40726c0 msgr2=0x7fdda4072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.611+0000 7fdda8d49640 1 -- 172.21.15.55:0/3162927734 shutdown_connections 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.611+0000 7fdda8d49640 1 -- 172.21.15.55:0/3162927734 wait complete. 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.613+0000 7fdda8d49640 1 Processor -- start 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.613+0000 7fdda8d49640 1 -- start start 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.613+0000 7fdda8d49640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda40d0f60 0x7fdda40ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.613+0000 7fdda8d49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdda40d3b90 0x7fdda40cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.613+0000 7fdda8d49640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda415dca0 0x7fdda4155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.613+0000 7fdda8d49640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda415e080 con 0x7fdda40d3b90 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.613+0000 7fdda8d49640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40cf050 con 0x7fdda40d0f60 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.613+0000 7fdda8d49640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda415e200 con 0x7fdda415dca0 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdda40d3b90 0x7fdda40cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdda40d3b90 0x7fdda40cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42710/0 (socket says 172.21.15.55:42710) 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda1d9b640 1 -- 172.21.15.55:0/2398895592 learned_addr learned my addr 172.21.15.55:0/2398895592 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda259c640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda40d0f60 0x7fdda40ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda2d9d640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda415dca0 0x7fdda4155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda1d9b640 1 -- 172.21.15.55:0/2398895592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda415dca0 msgr2=0x7fdda4155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda1d9b640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda415dca0 0x7fdda4155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda1d9b640 1 -- 172.21.15.55:0/2398895592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda40d0f60 msgr2=0x7fdda40ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda1d9b640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda40d0f60 0x7fdda40ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda1d9b640 1 -- 172.21.15.55:0/2398895592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda4154da0 con 0x7fdda40d3b90 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda1d9b640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdda40d3b90 0x7fdda40cb190 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c000c00 tx=0x7fdd8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdd9affd640 1 -- 172.21.15.55:0/2398895592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c037040 con 0x7fdda40d3b90 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdd9affd640 1 -- 172.21.15.55:0/2398895592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c042070 con 0x7fdda40d3b90 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda8d49640 1 -- 172.21.15.55:0/2398895592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda4155080 con 0x7fdda40d3b90 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdd9affd640 1 -- 172.21.15.55:0/2398895592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c030880 con 0x7fdda40d3b90 2024-04-25T08:55:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.614+0000 7fdda8d49640 1 -- 172.21.15.55:0/2398895592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda4155640 con 0x7fdda40d3b90 2024-04-25T08:55:17.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.615+0000 7fdda8d49640 1 -- 172.21.15.55:0/2398895592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda40750b0 con 0x7fdda40d3b90 2024-04-25T08:55:17.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.616+0000 7fdd9affd640 1 -- 172.21.15.55:0/2398895592 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd8c030a20 con 0x7fdda40d3b90 2024-04-25T08:55:17.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.616+0000 7fdd9affd640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd8406b4d0 0x7fdd8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:17.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.616+0000 7fdd9affd640 1 -- 172.21.15.55:0/2398895592 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd8c0aa850 con 0x7fdda40d3b90 2024-04-25T08:55:17.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.617+0000 7fdda259c640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd8406b4d0 0x7fdd8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:17.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.617+0000 7fdda259c640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd8406b4d0 0x7fdd8406d990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdda415ede0 tx=0x7fdd9c007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:17.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.621+0000 7fdd9affd640 1 -- 172.21.15.55:0/2398895592 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdd8c079230 con 0x7fdda40d3b90 2024-04-25T08:55:17.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:17.845+0000 7fdda8d49640 1 -- 172.21.15.55:0/2398895592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdda406b1d0 con 0x7fdda40d3b90 2024-04-25T08:55:18.772 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T08:55:18.782+0000 7fd2cfdc7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:55:18.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.835+0000 7fdd9affd640 1 -- 172.21.15.55:0/2398895592 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdd8c07d2d0 con 0x7fdda40d3b90 2024-04-25T08:55:18.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 -- 172.21.15.55:0/2398895592 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd8406b4d0 msgr2=0x7fdd8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:18.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd8406b4d0 0x7fdd8406d990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdda415ede0 tx=0x7fdd9c007e80 comp rx=0 tx=0).stop 2024-04-25T08:55:18.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 -- 172.21.15.55:0/2398895592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdda40d3b90 msgr2=0x7fdda40cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:18.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdda40d3b90 0x7fdda40cb190 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c000c00 tx=0x7fdd8c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:55:18.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 -- 172.21.15.55:0/2398895592 shutdown_connections 2024-04-25T08:55:18.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd8406b4d0 0x7fdd8406d990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:18.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda415dca0 0x7fdda4155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:18.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdda40d3b90 0x7fdda40cb190 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:18.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 --2- 172.21.15.55:0/2398895592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda40d0f60 0x7fdda40ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:18.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 -- 172.21.15.55:0/2398895592 >> 172.21.15.55:0/2398895592 conn(0x7fdda40726c0 msgr2=0x7fdda40d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:18.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 -- 172.21.15.55:0/2398895592 shutdown_connections 2024-04-25T08:55:18.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.837+0000 7fdda8d49640 1 -- 172.21.15.55:0/2398895592 wait complete. 2024-04-25T08:55:18.842 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:55:18.842 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:55:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.962+0000 7fcbcfa4a640 1 Processor -- start 2024-04-25T08:55:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.962+0000 7fcbcfa4a640 1 -- start start 2024-04-25T08:55:18.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.963+0000 7fcbcfa4a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcbc815dc80 0x7fcbc8161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:18.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.963+0000 7fcbcfa4a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcbc80b5c00 0x7fcbc80d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:18.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.963+0000 7fcbcfa4a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc81627a0 con 0x7fcbc80b97c0 2024-04-25T08:55:18.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.963+0000 7fcbcfa4a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc81621e0 con 0x7fcbc815dc80 2024-04-25T08:55:18.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.963+0000 7fcbcfa4a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc81624c0 con 0x7fcbc80b5c00 2024-04-25T08:55:18.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.963+0000 7fcbcd7e6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcbc815dc80 0x7fcbc8161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:18.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.963+0000 7fcbccfe5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcbc80b97c0 0x7fcbc80b54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50852/0 (socket says 172.21.15.55:50852) 2024-04-25T08:55:18.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.963+0000 7fcbccfe5640 1 -- 172.21.15.55:0/4029463528 learned_addr learned my addr 172.21.15.55:0/4029463528 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:18.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.964+0000 7fcbcdfe7640 1 --2- 172.21.15.55:0/4029463528 >> v2:172.21.15.167:3300/0 conn(0x7fcbc80b5c00 0x7fcbc80d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:18.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.964+0000 7fcbcd7e6640 1 -- 172.21.15.55:0/4029463528 >> v2:172.21.15.167:3300/0 conn(0x7fcbc80b5c00 msgr2=0x7fcbc80d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:18.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.964+0000 7fcbcd7e6640 1 --2- 172.21.15.55:0/4029463528 >> v2:172.21.15.167:3300/0 conn(0x7fcbc80b5c00 0x7fcbc80d2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:18.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.964+0000 7fcbcd7e6640 1 -- 172.21.15.55:0/4029463528 >> v1:172.21.15.55:6789/0 conn(0x7fcbc80b97c0 legacy=0x7fcbc80b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:18.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.964+0000 7fcbbffff640 1 -- 172.21.15.55:0/4029463528 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468502994 0 0) 0x7fcbc81627a0 con 0x7fcbc80b97c0 2024-04-25T08:55:18.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.964+0000 7fcbcd7e6640 1 -- 172.21.15.55:0/4029463528 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc80d1c70 con 0x7fcbc815dc80 2024-04-25T08:55:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.964+0000 7fcbcd7e6640 1 --2- 172.21.15.55:0/4029463528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc815dc80 0x7fcbc8161870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80b6300 tx=0x7fcbc402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35aa6a273795a044 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.964+0000 7fcbbffff640 1 -- 172.21.15.55:0/4029463528 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4037070 con 0x7fcbc815dc80 2024-04-25T08:55:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.965+0000 7fcbbffff640 1 -- 172.21.15.55:0/4029463528 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc4032440 con 0x7fcbc815dc80 2024-04-25T08:55:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.965+0000 7fcbbffff640 1 -- 172.21.15.55:0/4029463528 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4032810 con 0x7fcbc815dc80 2024-04-25T08:55:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.965+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/4029463528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc815dc80 msgr2=0x7fcbc8161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.965+0000 7fcbcfa4a640 1 --2- 172.21.15.55:0/4029463528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc815dc80 0x7fcbc8161870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80b6300 tx=0x7fcbc402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:55:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.965+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/4029463528 shutdown_connections 2024-04-25T08:55:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.965+0000 7fcbcfa4a640 1 --2- 172.21.15.55:0/4029463528 >> v2:172.21.15.167:3300/0 conn(0x7fcbc80b5c00 0x7fcbc80d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.965+0000 7fcbcfa4a640 1 --2- 172.21.15.55:0/4029463528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc815dc80 0x7fcbc8161870 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.965+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/4029463528 >> 172.21.15.55:0/4029463528 conn(0x7fcbc80d04f0 msgr2=0x7fcbc80d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.965+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/4029463528 shutdown_connections 2024-04-25T08:55:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.965+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/4029463528 wait complete. 2024-04-25T08:55:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.966+0000 7fcbcfa4a640 1 Processor -- start 2024-04-25T08:55:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.966+0000 7fcbcfa4a640 1 -- start start 2024-04-25T08:55:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.967+0000 7fcbcfa4a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbc80b5c00 0x7fcbc80b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.967+0000 7fcbcfa4a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc80b97c0 0x7fcbc81f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.967+0000 7fcbcfa4a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc815dc80 0x7fcbc814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.967+0000 7fcbcfa4a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8161f30 con 0x7fcbc80b97c0 2024-04-25T08:55:18.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.967+0000 7fcbcfa4a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8161db0 con 0x7fcbc80b5c00 2024-04-25T08:55:18.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.967+0000 7fcbcfa4a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80d29b0 con 0x7fcbc815dc80 2024-04-25T08:55:18.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.967+0000 7fcbccfe5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc80b97c0 0x7fcbc81f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:18.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.967+0000 7fcbccfe5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc80b97c0 0x7fcbc81f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42398/0 (socket says 172.21.15.55:42398) 2024-04-25T08:55:18.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.967+0000 7fcbccfe5640 1 -- 172.21.15.55:0/28981278 learned_addr learned my addr 172.21.15.55:0/28981278 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:18.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.967+0000 7fcbcdfe7640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc815dc80 0x7fcbc814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:18.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.967+0000 7fcbcd7e6640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbc80b5c00 0x7fcbc80b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:18.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbccfe5640 1 -- 172.21.15.55:0/28981278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc815dc80 msgr2=0x7fcbc814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:18.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbccfe5640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc815dc80 0x7fcbc814f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:18.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbccfe5640 1 -- 172.21.15.55:0/28981278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbc80b5c00 msgr2=0x7fcbc80b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:18.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbccfe5640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbc80b5c00 0x7fcbc80b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:18.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbccfe5640 1 -- 172.21.15.55:0/28981278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc815efd0 con 0x7fcbc80b97c0 2024-04-25T08:55:18.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbcdfe7640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc815dc80 0x7fcbc814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:18.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbcd7e6640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbc80b5c00 0x7fcbc80b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:18.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbccfe5640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc80b97c0 0x7fcbc81f6dc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800c4d0 tx=0x7fcbb800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:18.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbbdffb640 1 -- 172.21.15.55:0/28981278 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8018070 con 0x7fcbc80b97c0 2024-04-25T08:55:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbbdffb640 1 -- 172.21.15.55:0/28981278 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb8007500 con 0x7fcbc80b97c0 2024-04-25T08:55:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/28981278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc814fd90 con 0x7fcbc80b97c0 2024-04-25T08:55:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbbdffb640 1 -- 172.21.15.55:0/28981278 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8004a20 con 0x7fcbc80b97c0 2024-04-25T08:55:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.968+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/28981278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc81f7810 con 0x7fcbc80b97c0 2024-04-25T08:55:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.969+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/28981278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc80750b0 con 0x7fcbc80b97c0 2024-04-25T08:55:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.970+0000 7fcbbdffb640 1 -- 172.21.15.55:0/28981278 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcbb801b070 con 0x7fcbc80b97c0 2024-04-25T08:55:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.970+0000 7fcbbdffb640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcbac06b4d0 0x7fcbac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.970+0000 7fcbbdffb640 1 -- 172.21.15.55:0/28981278 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbb8089510 con 0x7fcbc80b97c0 2024-04-25T08:55:18.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.970+0000 7fcbcd7e6640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcbac06b4d0 0x7fcbac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:18.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.970+0000 7fcbcd7e6640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcbac06b4d0 0x7fcbac06d990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4034000 tx=0x7fcbc402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:18.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:18.975+0000 7fcbbdffb640 1 -- 172.21.15.55:0/28981278 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcbb8058390 con 0x7fcbc80b97c0 2024-04-25T08:55:19.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.198+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/28981278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcbc80d1780 con 0x7fcbc80b97c0 2024-04-25T08:55:19.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.842+0000 7fcbbdffb640 1 -- 172.21.15.55:0/28981278 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcbb8057c90 con 0x7fcbc80b97c0 2024-04-25T08:55:19.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/28981278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcbac06b4d0 msgr2=0x7fcbac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:19.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcbac06b4d0 0x7fcbac06d990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4034000 tx=0x7fcbc402e000 comp rx=0 tx=0).stop 2024-04-25T08:55:19.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/28981278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc80b97c0 msgr2=0x7fcbc81f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:19.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc80b97c0 0x7fcbc81f6dc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800c4d0 tx=0x7fcbb800c990 comp rx=0 tx=0).stop 2024-04-25T08:55:19.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/28981278 shutdown_connections 2024-04-25T08:55:19.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcbac06b4d0 0x7fcbac06d990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:19.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc815dc80 0x7fcbc814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:19.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc80b97c0 0x7fcbc81f6dc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:19.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 --2- 172.21.15.55:0/28981278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbc80b5c00 0x7fcbc80b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:19.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/28981278 >> 172.21.15.55:0/28981278 conn(0x7fcbc80d04f0 msgr2=0x7fcbc80b8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:19.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/28981278 shutdown_connections 2024-04-25T08:55:19.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.846+0000 7fcbcfa4a640 1 -- 172.21.15.55:0/28981278 wait complete. 2024-04-25T08:55:19.849 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:55:19.849 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:55:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.965+0000 7f5457c5d640 1 Processor -- start 2024-04-25T08:55:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.966+0000 7f5457c5d640 1 -- start start 2024-04-25T08:55:19.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.966+0000 7f5457c5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f545015dce0 0x7f54500d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:19.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.966+0000 7f5457c5d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545015e0c0 con 0x7f54500b5b60 2024-04-25T08:55:19.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.966+0000 7f5457c5d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54500d2510 con 0x7f54500d35b0 2024-04-25T08:55:19.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.966+0000 7f5457c5d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54500d27f0 con 0x7f545015dce0 2024-04-25T08:55:19.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54561fa640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f54500b5b60 0x7f54500b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50856/0 (socket says 172.21.15.55:50856) 2024-04-25T08:55:19.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54561fa640 1 -- 172.21.15.55:0/1836396939 learned_addr learned my addr 172.21.15.55:0/1836396939 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:19.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022396104 0 0) 0x7f545015e0c0 con 0x7f54500b5b60 2024-04-25T08:55:19.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f543c003520 con 0x7f54500b5b60 2024-04-25T08:55:19.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54559f9640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f545015dce0 0x7f54500d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:19.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 299539462 0 0) 0x7f543c003520 con 0x7f54500b5b60 2024-04-25T08:55:19.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f545015dce0 msgr2=0x7f54500d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:19.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f545015dce0 0x7f54500d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:19.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 >> v1:172.21.15.167:6789/0 conn(0x7f54500d35b0 legacy=0x7f54500b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:19.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54500d2ad0 con 0x7f54500b5b60 2024-04-25T08:55:19.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f54480019f0 con 0x7f54500b5b60 2024-04-25T08:55:19.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 >> v1:172.21.15.55:6789/0 conn(0x7f54500b5b60 legacy=0x7f54500b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:19.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c0039e0 0x7f543c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:19.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f543c004800 0x7f543c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:19.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f545015dce0 0x7f543c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54500d27f0 con 0x7f543c004800 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c00ba70 con 0x7f543c0039e0 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c00bc70 con 0x7f545015dce0 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54551f8640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f543c004800 0x7f543c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54559f9640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c0039e0 0x7f543c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.967+0000 7f54561fa640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f545015dce0 0x7f543c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.968+0000 7f54551f8640 1 -- 172.21.15.55:0/1836396939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f545015dce0 msgr2=0x7f543c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.968+0000 7f54551f8640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f545015dce0 0x7f543c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.968+0000 7f54551f8640 1 -- 172.21.15.55:0/1836396939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c0039e0 msgr2=0x7f543c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.968+0000 7f54551f8640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c0039e0 0x7f543c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.968+0000 7f54551f8640 1 -- 172.21.15.55:0/1836396939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c003520 con 0x7f543c004800 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.968+0000 7f54551f8640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f543c004800 0x7f543c004c80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5440001720 tx=0x7f543c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aacddbe2b72fec5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.968+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440001370 con 0x7f543c004800 2024-04-25T08:55:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.968+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54400052d0 con 0x7f543c004800 2024-04-25T08:55:19.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.968+0000 7f54549f7640 1 -- 172.21.15.55:0/1836396939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544002ab90 con 0x7f543c004800 2024-04-25T08:55:19.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.969+0000 7f5457c5d640 1 -- 172.21.15.55:0/1836396939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f543c004800 msgr2=0x7f543c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:19.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.969+0000 7f5457c5d640 1 --2- 172.21.15.55:0/1836396939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f543c004800 0x7f543c004c80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5440001720 tx=0x7f543c005830 comp rx=0 tx=0).stop 2024-04-25T08:55:19.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.969+0000 7f54561fa640 1 -- 172.21.15.55:0/1836396939 reap_dead start 2024-04-25T08:55:19.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.969+0000 7f5457c5d640 1 -- 172.21.15.55:0/1836396939 shutdown_connections 2024-04-25T08:55:19.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.969+0000 7f5457c5d640 1 -- 172.21.15.55:0/1836396939 >> 172.21.15.55:0/1836396939 conn(0x7f5450072900 msgr2=0x7f54500d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:19.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.969+0000 7f5457c5d640 1 -- 172.21.15.55:0/1836396939 shutdown_connections 2024-04-25T08:55:19.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.969+0000 7f5457c5d640 1 -- 172.21.15.55:0/1836396939 wait complete. 2024-04-25T08:55:19.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.970+0000 7f5457c5d640 1 Processor -- start 2024-04-25T08:55:19.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.970+0000 7f5457c5d640 1 -- start start 2024-04-25T08:55:19.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f5457c5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f543c004800 0x7f54501f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:19.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f5457c5d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5450157300 0x7f5450157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f5457c5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5450159b10 0x7f5450159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f5457c5d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54500b9820 con 0x7f5450159b10 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f5457c5d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54500d3090 con 0x7f5450157300 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f5457c5d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54500b99a0 con 0x7f543c004800 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f54561fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5450159b10 0x7f5450159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f54561fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5450159b10 0x7f5450159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42414/0 (socket says 172.21.15.55:42414) 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f54561fa640 1 -- 172.21.15.55:0/3337377425 learned_addr learned my addr 172.21.15.55:0/3337377425 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f54561fa640 1 -- 172.21.15.55:0/3337377425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f543c004800 msgr2=0x7f54501f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f54561fa640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f543c004800 0x7f54501f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f54561fa640 1 -- 172.21.15.55:0/3337377425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5450157300 msgr2=0x7f5450157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.971+0000 7f54561fa640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5450157300 0x7f5450157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.972+0000 7f54561fa640 1 -- 172.21.15.55:0/3337377425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5450157dc0 con 0x7f5450159b10 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.972+0000 7f54561fa640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5450159b10 0x7f5450159f90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5448000f80 tx=0x7f5448007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:19.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.972+0000 7f54467fc640 1 -- 172.21.15.55:0/3337377425 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544800ac80 con 0x7f5450159b10 2024-04-25T08:55:19.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.972+0000 7f54467fc640 1 -- 172.21.15.55:0/3337377425 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5448019070 con 0x7f5450159b10 2024-04-25T08:55:19.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.972+0000 7f5457c5d640 1 -- 172.21.15.55:0/3337377425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54501580a0 con 0x7f5450159b10 2024-04-25T08:55:19.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.972+0000 7f54467fc640 1 -- 172.21.15.55:0/3337377425 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544800ae60 con 0x7f5450159b10 2024-04-25T08:55:19.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.972+0000 7f5457c5d640 1 -- 172.21.15.55:0/3337377425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54500cbe80 con 0x7f5450159b10 2024-04-25T08:55:19.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.973+0000 7f5457c5d640 1 -- 172.21.15.55:0/3337377425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54501585c0 con 0x7f5450159b10 2024-04-25T08:55:19.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.973+0000 7f54467fc640 1 -- 172.21.15.55:0/3337377425 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5448013630 con 0x7f5450159b10 2024-04-25T08:55:19.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.974+0000 7f54467fc640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f543406b500 0x7f543406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:19.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.974+0000 7f54467fc640 1 -- 172.21.15.55:0/3337377425 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f544808a7c0 con 0x7f5450159b10 2024-04-25T08:55:19.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.974+0000 7f54559f9640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f543406b500 0x7f543406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:19.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.974+0000 7f54559f9640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f543406b500 0x7f543406d9c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5450156880 tx=0x7f544c009320 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:19.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:19.978+0000 7f54467fc640 1 -- 172.21.15.55:0/3337377425 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f54501585c0 con 0x7f5450159b10 2024-04-25T08:55:20.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.195+0000 7f5457c5d640 1 -- 172.21.15.55:0/3337377425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54500749b0 con 0x7f5450159b10 2024-04-25T08:55:20.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.196+0000 7f54467fc640 1 -- 172.21.15.55:0/3337377425 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f5448059640 con 0x7f5450159b10 2024-04-25T08:55:20.186 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:20.186 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3267261156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3267261156},{"type":"v1","addr":"172.21.15.167:6834","nonce":3267261156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/588514159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":588514159},{"type":"v1","addr":"172.21.15.167:6835","nonce":588514159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2276997137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2276997137},{"type":"v1","addr":"172.21.15.55:6835","nonce":2276997137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:55:16.159284+0000","modified":"2024-04-25T08:55:19.200438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/2070394524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":2070394524},{"type":"v1","addr":"172.21.15.55:6837","nonce":2070394524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:55:20.186 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 22 2024-04-25T08:55:20.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 -- 172.21.15.55:0/3337377425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f543406b500 msgr2=0x7f543406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f543406b500 0x7f543406d9c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5450156880 tx=0x7f544c009320 comp rx=0 tx=0).stop 2024-04-25T08:55:20.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 -- 172.21.15.55:0/3337377425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5450159b10 msgr2=0x7f5450159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5450159b10 0x7f5450159f90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5448000f80 tx=0x7f5448007bd0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 -- 172.21.15.55:0/3337377425 shutdown_connections 2024-04-25T08:55:20.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f543406b500 0x7f543406d9c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5450159b10 0x7f5450159f90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5450157300 0x7f5450157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 --2- 172.21.15.55:0/3337377425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f543c004800 0x7f54501f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 -- 172.21.15.55:0/3337377425 >> 172.21.15.55:0/3337377425 conn(0x7f5450072900 msgr2=0x7f54500b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:20.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 -- 172.21.15.55:0/3337377425 shutdown_connections 2024-04-25T08:55:20.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.198+0000 7f5457c5d640 1 -- 172.21.15.55:0/3337377425 wait complete. 2024-04-25T08:55:20.199 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:55:20.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.310+0000 7f96d1ce2640 1 Processor -- start 2024-04-25T08:55:20.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.310+0000 7f96d1ce2640 1 -- start start 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.311+0000 7f96d1ce2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96cc15f120 0x7f96cc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.311+0000 7f96d1ce2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f96cc0ce830 0x7f96cc0cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.311+0000 7f96d1ce2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc0cdfe0 con 0x7f96cc0cfbe0 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.311+0000 7f96d1ce2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc0d09f0 con 0x7f96cc15f120 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.311+0000 7f96d1ce2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc0cec70 con 0x7f96cc0ce830 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.311+0000 7f96cb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96cc15f120 0x7f96cc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.311+0000 7f96cb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96cc15f120 0x7f96cc0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42426/0 (socket says 172.21.15.55:42426) 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.311+0000 7f96cb7fe640 1 -- 172.21.15.55:0/3718366901 learned_addr learned my addr 172.21.15.55:0/3718366901 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.312+0000 7f96caffd640 1 --2- 172.21.15.55:0/3718366901 >> v2:172.21.15.167:3300/0 conn(0x7f96cc0ce830 0x7f96cc0cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.312+0000 7f96cb7fe640 1 -- 172.21.15.55:0/3718366901 >> v2:172.21.15.167:3300/0 conn(0x7f96cc0ce830 msgr2=0x7f96cc0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.312+0000 7f96cb7fe640 1 --2- 172.21.15.55:0/3718366901 >> v2:172.21.15.167:3300/0 conn(0x7f96cc0ce830 0x7f96cc0cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.312+0000 7f96cb7fe640 1 -- 172.21.15.55:0/3718366901 >> v1:172.21.15.167:6789/0 conn(0x7f96cc0cfbe0 legacy=0x7f96cc099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.312+0000 7f96cb7fe640 1 -- 172.21.15.55:0/3718366901 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0d0430 con 0x7f96cc15f120 2024-04-25T08:55:20.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96cb7fe640 1 --2- 172.21.15.55:0/3718366901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96cc15f120 0x7f96cc0ce2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f96cc071d90 tx=0x7f96bc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c5b5d48f36170f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:20.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96ca7fc640 1 -- 172.21.15.55:0/3718366901 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc037070 con 0x7f96cc15f120 2024-04-25T08:55:20.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96ca7fc640 1 -- 172.21.15.55:0/3718366901 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc02ae50 con 0x7f96cc15f120 2024-04-25T08:55:20.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96ca7fc640 1 -- 172.21.15.55:0/3718366901 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc032860 con 0x7f96cc15f120 2024-04-25T08:55:20.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96d1ce2640 1 -- 172.21.15.55:0/3718366901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96cc15f120 msgr2=0x7f96cc0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96d1ce2640 1 --2- 172.21.15.55:0/3718366901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96cc15f120 0x7f96cc0ce2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f96cc071d90 tx=0x7f96bc02a300 comp rx=0 tx=0).stop 2024-04-25T08:55:20.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96d1ce2640 1 -- 172.21.15.55:0/3718366901 shutdown_connections 2024-04-25T08:55:20.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96d1ce2640 1 --2- 172.21.15.55:0/3718366901 >> v2:172.21.15.167:3300/0 conn(0x7f96cc0ce830 0x7f96cc0cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96d1ce2640 1 --2- 172.21.15.55:0/3718366901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96cc15f120 0x7f96cc0ce2f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96d1ce2640 1 -- 172.21.15.55:0/3718366901 >> 172.21.15.55:0/3718366901 conn(0x7f96cc0d1900 msgr2=0x7f96cc0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96d1ce2640 1 -- 172.21.15.55:0/3718366901 shutdown_connections 2024-04-25T08:55:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.313+0000 7f96d1ce2640 1 -- 172.21.15.55:0/3718366901 wait complete. 2024-04-25T08:55:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.314+0000 7f96d1ce2640 1 Processor -- start 2024-04-25T08:55:20.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.315+0000 7f96d1ce2640 1 -- start start 2024-04-25T08:55:20.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.315+0000 7f96d1ce2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96cc0ce830 0x7f96cc0b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.315+0000 7f96d1ce2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96cc0cfbe0 0x7f96cc06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.315+0000 7f96d1ce2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96cc15f120 0x7f96cc15d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.315+0000 7f96d1ce2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0ccab0 con 0x7f96cc15f120 2024-04-25T08:55:20.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.315+0000 7f96d1ce2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0cc7d0 con 0x7f96cc0ce830 2024-04-25T08:55:20.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.315+0000 7f96d1ce2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0cc480 con 0x7f96cc0cfbe0 2024-04-25T08:55:20.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96cbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96cc15f120 0x7f96cc15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96cbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96cc15f120 0x7f96cc15d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42438/0 (socket says 172.21.15.55:42438) 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96cbfff640 1 -- 172.21.15.55:0/4156180561 learned_addr learned my addr 172.21.15.55:0/4156180561 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96caffd640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96cc0cfbe0 0x7f96cc06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96cb7fe640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96cc0ce830 0x7f96cc0b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96cbfff640 1 -- 172.21.15.55:0/4156180561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96cc0cfbe0 msgr2=0x7f96cc06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96cbfff640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96cc0cfbe0 0x7f96cc06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96cbfff640 1 -- 172.21.15.55:0/4156180561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96cc0ce830 msgr2=0x7f96cc0b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96cbfff640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96cc0ce830 0x7f96cc0b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96cbfff640 1 -- 172.21.15.55:0/4156180561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0af510 con 0x7f96cc15f120 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96cb7fe640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96cc0ce830 0x7f96cc0b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96caffd640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96cc0cfbe0 0x7f96cc06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96cbfff640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96cc15f120 0x7f96cc15d170 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f96c400c730 tx=0x7f96c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96b3fff640 1 -- 172.21.15.55:0/4156180561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4003b90 con 0x7f96cc15f120 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96b3fff640 1 -- 172.21.15.55:0/4156180561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c4003d30 con 0x7f96cc15f120 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96d1ce2640 1 -- 172.21.15.55:0/4156180561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc0af7f0 con 0x7f96cc15f120 2024-04-25T08:55:20.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96b3fff640 1 -- 172.21.15.55:0/4156180561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c400aa90 con 0x7f96cc15f120 2024-04-25T08:55:20.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.316+0000 7f96d1ce2640 1 -- 172.21.15.55:0/4156180561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc0afdb0 con 0x7f96cc15f120 2024-04-25T08:55:20.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.317+0000 7f96d1ce2640 1 -- 172.21.15.55:0/4156180561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc067850 con 0x7f96cc15f120 2024-04-25T08:55:20.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.318+0000 7f96b3fff640 1 -- 172.21.15.55:0/4156180561 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f96c400ac30 con 0x7f96cc15f120 2024-04-25T08:55:20.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.318+0000 7f96b3fff640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f96b806b4d0 0x7f96b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.318+0000 7f96b3fff640 1 -- 172.21.15.55:0/4156180561 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96c408a100 con 0x7f96cc15f120 2024-04-25T08:55:20.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.318+0000 7f96cb7fe640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f96b806b4d0 0x7f96b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.319+0000 7f96cb7fe640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f96b806b4d0 0x7f96b806d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f96bc034000 tx=0x7f96bc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:20.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.322+0000 7f96b3fff640 1 -- 172.21.15.55:0/4156180561 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f96c4058f70 con 0x7f96cc15f120 2024-04-25T08:55:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.503+0000 7f96d1ce2640 1 -- 172.21.15.55:0/4156180561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96cc0d1f00 con 0x7f96cc15f120 2024-04-25T08:55:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.504+0000 7f96b3fff640 1 -- 172.21.15.55:0/4156180561 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16613 (secure 0 0 0) 0x7f96c4058870 con 0x7f96cc15f120 2024-04-25T08:55:20.494 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:20.495 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":47,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:55:17.820889+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:55:14.449282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:55:15.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:55:20.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 -- 172.21.15.55:0/4156180561 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f96b806b4d0 msgr2=0x7f96b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f96b806b4d0 0x7f96b806d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f96bc034000 tx=0x7f96bc02e000 comp rx=0 tx=0).stop 2024-04-25T08:55:20.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 -- 172.21.15.55:0/4156180561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96cc15f120 msgr2=0x7f96cc15d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96cc15f120 0x7f96cc15d170 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f96c400c730 tx=0x7f96c400cbf0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 -- 172.21.15.55:0/4156180561 shutdown_connections 2024-04-25T08:55:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f96b806b4d0 0x7f96b806d990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96cc15f120 0x7f96cc15d170 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96cc0cfbe0 0x7f96cc06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 --2- 172.21.15.55:0/4156180561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96cc0ce830 0x7f96cc0b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 -- 172.21.15.55:0/4156180561 >> 172.21.15.55:0/4156180561 conn(0x7f96cc0d1900 msgr2=0x7f96cc0cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 -- 172.21.15.55:0/4156180561 shutdown_connections 2024-04-25T08:55:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.506+0000 7f96d1ce2640 1 -- 172.21.15.55:0/4156180561 wait complete. 2024-04-25T08:55:20.508 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:55:20.508 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:55:20.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.620+0000 7f0677789640 1 Processor -- start 2024-04-25T08:55:20.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.620+0000 7f0677789640 1 -- start start 2024-04-25T08:55:20.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.620+0000 7f0677789640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f067015dce0 0x7f06700d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0677789640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f06700b5b60 0x7f06700b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0677789640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067015e0c0 con 0x7f06700d35b0 2024-04-25T08:55:20.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0677789640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06700d2510 con 0x7f06700b5b60 2024-04-25T08:55:20.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0677789640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06700d27f0 con 0x7f067015dce0 2024-04-25T08:55:20.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0675d26640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f06700b5b60 0x7f06700b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0675525640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f067015dce0 0x7f06700d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0674d24640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f06700d35b0 0x7f06700b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:60272/0 (socket says 172.21.15.55:60272) 2024-04-25T08:55:20.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0675d26640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f06700b5b60 0x7f06700b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:42982/0 (socket says 172.21.15.55:42982) 2024-04-25T08:55:20.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0674d24640 1 -- 172.21.15.55:0/1682409609 learned_addr learned my addr 172.21.15.55:0/1682409609 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:20.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0675525640 1 --2- 172.21.15.55:0/1682409609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f067015dce0 0x7f06700d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:40034/0 (socket says 172.21.15.55:40034) 2024-04-25T08:55:20.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0675d26640 1 -- 172.21.15.55:0/1682409609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f067015dce0 msgr2=0x7f06700d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:20.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0675d26640 1 --2- 172.21.15.55:0/1682409609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f067015dce0 0x7f06700d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0675d26640 1 -- 172.21.15.55:0/1682409609 >> v1:172.21.15.167:6789/0 conn(0x7f06700d35b0 legacy=0x7f06700b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0675d26640 1 -- 172.21.15.55:0/1682409609 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06700d2ad0 con 0x7f06700b5b60 2024-04-25T08:55:20.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0667fff640 1 -- 172.21.15.55:0/1682409609 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719906703 0 0) 0x7f067015e0c0 con 0x7f06700d35b0 2024-04-25T08:55:20.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.621+0000 7f0675525640 1 --2- 172.21.15.55:0/1682409609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f067015dce0 0x7f06700d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:55:20.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.622+0000 7f0675d26640 1 --2- 172.21.15.55:0/1682409609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06700b5b60 0x7f06700b6b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0668009d90 tx=0x7f066802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1e83a38e2ef1538 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:20.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.622+0000 7f0667fff640 1 -- 172.21.15.55:0/1682409609 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668007740 con 0x7f06700b5b60 2024-04-25T08:55:20.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.622+0000 7f0667fff640 1 -- 172.21.15.55:0/1682409609 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06680078e0 con 0x7f06700b5b60 2024-04-25T08:55:20.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.622+0000 7f0667fff640 1 -- 172.21.15.55:0/1682409609 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668007cb0 con 0x7f06700b5b60 2024-04-25T08:55:20.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.623+0000 7f0677789640 1 -- 172.21.15.55:0/1682409609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06700b5b60 msgr2=0x7f06700b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.623+0000 7f0677789640 1 --2- 172.21.15.55:0/1682409609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06700b5b60 0x7f06700b6b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0668009d90 tx=0x7f066802a660 comp rx=0 tx=0).stop 2024-04-25T08:55:20.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.623+0000 7f0677789640 1 -- 172.21.15.55:0/1682409609 shutdown_connections 2024-04-25T08:55:20.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.623+0000 7f0677789640 1 --2- 172.21.15.55:0/1682409609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06700b5b60 0x7f06700b6b00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.623+0000 7f0677789640 1 --2- 172.21.15.55:0/1682409609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f067015dce0 0x7f06700d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.623+0000 7f0677789640 1 -- 172.21.15.55:0/1682409609 >> 172.21.15.55:0/1682409609 conn(0x7f0670072900 msgr2=0x7f06700d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:20.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.623+0000 7f0677789640 1 -- 172.21.15.55:0/1682409609 shutdown_connections 2024-04-25T08:55:20.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.623+0000 7f0677789640 1 -- 172.21.15.55:0/1682409609 wait complete. 2024-04-25T08:55:20.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.624+0000 7f0677789640 1 Processor -- start 2024-04-25T08:55:20.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.624+0000 7f0677789640 1 -- start start 2024-04-25T08:55:20.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0677789640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06700b5b60 0x7f06701f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0677789640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700d35b0 0x7f06700cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0677789640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f067015dce0 0x7f067015e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0677789640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06700b9820 con 0x7f06700b5b60 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0677789640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06700d3090 con 0x7f067015dce0 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0677789640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06700b99a0 con 0x7f06700d35b0 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0675525640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06700b5b60 0x7f06701f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0675525640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06700b5b60 0x7f06701f6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42442/0 (socket says 172.21.15.55:42442) 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0675525640 1 -- 172.21.15.55:0/774825706 learned_addr learned my addr 172.21.15.55:0/774825706 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0675d26640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f067015dce0 0x7f067015e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0674d24640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700d35b0 0x7f06700cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0675525640 1 -- 172.21.15.55:0/774825706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700d35b0 msgr2=0x7f06700cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0675525640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700d35b0 0x7f06700cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0675525640 1 -- 172.21.15.55:0/774825706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f067015dce0 msgr2=0x7f067015e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0675525640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f067015dce0 0x7f067015e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0675525640 1 -- 172.21.15.55:0/774825706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06700cc3d0 con 0x7f06700b5b60 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.625+0000 7f0675525640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06700b5b60 0x7f06701f6600 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f066c00e960 tx=0x7f066c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.626+0000 7f0665ffb640 1 -- 172.21.15.55:0/774825706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c017070 con 0x7f06700b5b60 2024-04-25T08:55:20.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.626+0000 7f0665ffb640 1 -- 172.21.15.55:0/774825706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c00ca00 con 0x7f06700b5b60 2024-04-25T08:55:20.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.626+0000 7f0677789640 1 -- 172.21.15.55:0/774825706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06700cc6b0 con 0x7f06700b5b60 2024-04-25T08:55:20.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.626+0000 7f0665ffb640 1 -- 172.21.15.55:0/774825706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c00cdd0 con 0x7f06700b5b60 2024-04-25T08:55:20.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.626+0000 7f0677789640 1 -- 172.21.15.55:0/774825706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06700ccc70 con 0x7f06700b5b60 2024-04-25T08:55:20.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.627+0000 7f0677789640 1 -- 172.21.15.55:0/774825706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06700749b0 con 0x7f06700b5b60 2024-04-25T08:55:20.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.627+0000 7f0665ffb640 1 -- 172.21.15.55:0/774825706 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f066c01a070 con 0x7f06700b5b60 2024-04-25T08:55:20.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.628+0000 7f0665ffb640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065406b4d0 0x7f065406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.628+0000 7f0665ffb640 1 -- 172.21.15.55:0/774825706 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f066c08a000 con 0x7f06700b5b60 2024-04-25T08:55:20.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.628+0000 7f0674d24640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065406b4d0 0x7f065406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.628+0000 7f0674d24640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065406b4d0 0x7f065406d990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f06700c82d0 tx=0x7f0660007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:20.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.632+0000 7f0665ffb640 1 -- 172.21.15.55:0/774825706 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f066c058840 con 0x7f06700b5b60 2024-04-25T08:55:20.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.809+0000 7f0677789640 1 -- 172.21.15.55:0/774825706 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06700b5540 con 0x7f065406b4d0 2024-04-25T08:55:20.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.815+0000 7f0665ffb640 1 -- 172.21.15.55:0/774825706 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251706 (secure 0 0 0) 0x7f06700b5540 con 0x7f065406b4d0 2024-04-25T08:55:20.808 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.818+0000 7f0677789640 1 -- 172.21.15.55:0/774825706 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065406b4d0 msgr2=0x7f065406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.818+0000 7f0677789640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065406b4d0 0x7f065406d990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f06700c82d0 tx=0x7f0660007d50 comp rx=0 tx=0).stop 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.818+0000 7f0677789640 1 -- 172.21.15.55:0/774825706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06700b5b60 msgr2=0x7f06701f6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.818+0000 7f0677789640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06700b5b60 0x7f06701f6600 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f066c00e960 tx=0x7f066c00ee20 comp rx=0 tx=0).stop 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.818+0000 7f0677789640 1 -- 172.21.15.55:0/774825706 shutdown_connections 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.818+0000 7f0677789640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065406b4d0 0x7f065406d990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.818+0000 7f0677789640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f067015dce0 0x7f067015e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.818+0000 7f0677789640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700d35b0 0x7f06700cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.818+0000 7f0677789640 1 --2- 172.21.15.55:0/774825706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06700b5b60 0x7f06701f6600 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.818+0000 7f0677789640 1 -- 172.21.15.55:0/774825706 >> 172.21.15.55:0/774825706 conn(0x7f0670072900 msgr2=0x7f06700b8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.819+0000 7f0677789640 1 -- 172.21.15.55:0/774825706 shutdown_connections 2024-04-25T08:55:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.819+0000 7f0677789640 1 -- 172.21.15.55:0/774825706 wait complete. 2024-04-25T08:55:20.819 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-04-25T08:55:20.571126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238272,"kb_used_data":5452,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736448,"statfs":{"total":773094113280,"available":772850122752,"internally_reserved":0,"allocated":5582848,"data_stored":2933219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.785197"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836959+0000","last_change":"2024-04-25T08:55:16.832561+0000","last_active":"2024-04-25T08:55:17.836959+0000","last_peered":"2024-04-25T08:55:17.836959+0000","last_clean":"2024-04-25T08:55:17.836959+0000","last_became_active":"2024-04-25T08:55:16.832224+0000","last_became_peered":"2024-04-25T08:55:16.832224+0000","last_unstale":"2024-04-25T08:55:17.836959+0000","last_undegraded":"2024-04-25T08:55:17.836959+0000","last_fullsized":"2024-04-25T08:55:17.836959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540207+0000","last_change":"2024-04-25T08:55:16.842805+0000","last_active":"2024-04-25T08:55:18.540207+0000","last_peered":"2024-04-25T08:55:18.540207+0000","last_clean":"2024-04-25T08:55:18.540207+0000","last_became_active":"2024-04-25T08:55:16.842348+0000","last_became_peered":"2024-04-25T08:55:16.842348+0000","last_unstale":"2024-04-25T08:55:18.540207+0000","last_undegraded":"2024-04-25T08:55:18.540207+0000","last_fullsized":"2024-04-25T08:55:18.540207+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539800+0000","last_change":"2024-04-25T08:55:16.829363+0000","last_active":"2024-04-25T08:55:18.539800+0000","last_peered":"2024-04-25T08:55:18.539800+0000","last_clean":"2024-04-25T08:55:18.539800+0000","last_became_active":"2024-04-25T08:55:16.828941+0000","last_became_peered":"2024-04-25T08:55:16.828941+0000","last_unstale":"2024-04-25T08:55:18.539800+0000","last_undegraded":"2024-04-25T08:55:18.539800+0000","last_fullsized":"2024-04-25T08:55:18.539800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540318+0000","last_change":"2024-04-25T08:55:16.841043+0000","last_active":"2024-04-25T08:55:18.540318+0000","last_peered":"2024-04-25T08:55:18.540318+0000","last_clean":"2024-04-25T08:55:18.540318+0000","last_became_active":"2024-04-25T08:55:16.838610+0000","last_became_peered":"2024-04-25T08:55:16.838610+0000","last_unstale":"2024-04-25T08:55:18.540318+0000","last_undegraded":"2024-04-25T08:55:18.540318+0000","last_fullsized":"2024-04-25T08:55:18.540318+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539972+0000","last_change":"2024-04-25T08:55:16.843435+0000","last_active":"2024-04-25T08:55:18.539972+0000","last_peered":"2024-04-25T08:55:18.539972+0000","last_clean":"2024-04-25T08:55:18.539972+0000","last_became_active":"2024-04-25T08:55:16.842897+0000","last_became_peered":"2024-04-25T08:55:16.842897+0000","last_unstale":"2024-04-25T08:55:18.539972+0000","last_undegraded":"2024-04-25T08:55:18.539972+0000","last_fullsized":"2024-04-25T08:55:18.539972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837578+0000","last_change":"2024-04-25T08:55:16.826490+0000","last_active":"2024-04-25T08:55:17.837578+0000","last_peered":"2024-04-25T08:55:17.837578+0000","last_clean":"2024-04-25T08:55:17.837578+0000","last_became_active":"2024-04-25T08:55:16.826201+0000","last_became_peered":"2024-04-25T08:55:16.826201+0000","last_unstale":"2024-04-25T08:55:17.837578+0000","last_undegraded":"2024-04-25T08:55:17.837578+0000","last_fullsized":"2024-04-25T08:55:17.837578+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:34.683007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837295+0000","last_change":"2024-04-25T08:55:16.829027+0000","last_active":"2024-04-25T08:55:17.837295+0000","last_peered":"2024-04-25T08:55:17.837295+0000","last_clean":"2024-04-25T08:55:17.837295+0000","last_became_active":"2024-04-25T08:55:16.828724+0000","last_became_peered":"2024-04-25T08:55:16.828724+0000","last_unstale":"2024-04-25T08:55:17.837295+0000","last_undegraded":"2024-04-25T08:55:17.837295+0000","last_fullsized":"2024-04-25T08:55:17.837295+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539748+0000","last_change":"2024-04-25T08:55:16.840752+0000","last_active":"2024-04-25T08:55:18.539748+0000","last_peered":"2024-04-25T08:55:18.539748+0000","last_clean":"2024-04-25T08:55:18.539748+0000","last_became_active":"2024-04-25T08:55:16.838830+0000","last_became_peered":"2024-04-25T08:55:16.838830+0000","last_unstale":"2024-04-25T08:55:18.539748+0000","last_undegraded":"2024-04-25T08:55:18.539748+0000","last_fullsized":"2024-04-25T08:55:18.539748+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:11.677071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540796+0000","last_change":"2024-04-25T08:55:16.840080+0000","last_active":"2024-04-25T08:55:18.540796+0000","last_peered":"2024-04-25T08:55:18.540796+0000","last_clean":"2024-04-25T08:55:18.540796+0000","last_became_active":"2024-04-25T08:55:16.837974+0000","last_became_peered":"2024-04-25T08:55:16.837974+0000","last_unstale":"2024-04-25T08:55:18.540796+0000","last_undegraded":"2024-04-25T08:55:18.540796+0000","last_fullsized":"2024-04-25T08:55:18.540796+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540698+0000","last_change":"2024-04-25T08:55:16.838746+0000","last_active":"2024-04-25T08:55:18.540698+0000","last_peered":"2024-04-25T08:55:18.540698+0000","last_clean":"2024-04-25T08:55:18.540698+0000","last_became_active":"2024-04-25T08:55:16.838330+0000","last_became_peered":"2024-04-25T08:55:16.838330+0000","last_unstale":"2024-04-25T08:55:18.540698+0000","last_undegraded":"2024-04-25T08:55:18.540698+0000","last_fullsized":"2024-04-25T08:55:18.540698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540035+0000","last_change":"2024-04-25T08:55:16.841755+0000","last_active":"2024-04-25T08:55:18.540035+0000","last_peered":"2024-04-25T08:55:18.540035+0000","last_clean":"2024-04-25T08:55:18.540035+0000","last_became_active":"2024-04-25T08:55:16.840957+0000","last_became_peered":"2024-04-25T08:55:16.840957+0000","last_unstale":"2024-04-25T08:55:18.540035+0000","last_undegraded":"2024-04-25T08:55:18.540035+0000","last_fullsized":"2024-04-25T08:55:18.540035+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.956125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540100+0000","last_change":"2024-04-25T08:55:16.834783+0000","last_active":"2024-04-25T08:55:18.540100+0000","last_peered":"2024-04-25T08:55:18.540100+0000","last_clean":"2024-04-25T08:55:18.540100+0000","last_became_active":"2024-04-25T08:55:16.834516+0000","last_became_peered":"2024-04-25T08:55:16.834516+0000","last_unstale":"2024-04-25T08:55:18.540100+0000","last_undegraded":"2024-04-25T08:55:18.540100+0000","last_fullsized":"2024-04-25T08:55:18.540100+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540279+0000","last_change":"2024-04-25T08:55:16.846385+0000","last_active":"2024-04-25T08:55:18.540279+0000","last_peered":"2024-04-25T08:55:18.540279+0000","last_clean":"2024-04-25T08:55:18.540279+0000","last_became_active":"2024-04-25T08:55:16.846086+0000","last_became_peered":"2024-04-25T08:55:16.846086+0000","last_unstale":"2024-04-25T08:55:18.540279+0000","last_undegraded":"2024-04-25T08:55:18.540279+0000","last_fullsized":"2024-04-25T08:55:18.540279+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:37.559936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539706+0000","last_change":"2024-04-25T08:55:16.843288+0000","last_active":"2024-04-25T08:55:18.539706+0000","last_peered":"2024-04-25T08:55:18.539706+0000","last_clean":"2024-04-25T08:55:18.539706+0000","last_became_active":"2024-04-25T08:55:16.838291+0000","last_became_peered":"2024-04-25T08:55:16.838291+0000","last_unstale":"2024-04-25T08:55:18.539706+0000","last_undegraded":"2024-04-25T08:55:18.539706+0000","last_fullsized":"2024-04-25T08:55:18.539706+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:09.916126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837424+0000","last_change":"2024-04-25T08:55:16.828188+0000","last_active":"2024-04-25T08:55:17.837424+0000","last_peered":"2024-04-25T08:55:17.837424+0000","last_clean":"2024-04-25T08:55:17.837424+0000","last_became_active":"2024-04-25T08:55:16.827799+0000","last_became_peered":"2024-04-25T08:55:16.827799+0000","last_unstale":"2024-04-25T08:55:17.837424+0000","last_undegraded":"2024-04-25T08:55:17.837424+0000","last_fullsized":"2024-04-25T08:55:17.837424+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:44.172513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837279+0000","last_change":"2024-04-25T08:55:16.843112+0000","last_active":"2024-04-25T08:55:17.837279+0000","last_peered":"2024-04-25T08:55:17.837279+0000","last_clean":"2024-04-25T08:55:17.837279+0000","last_became_active":"2024-04-25T08:55:16.842799+0000","last_became_peered":"2024-04-25T08:55:16.842799+0000","last_unstale":"2024-04-25T08:55:17.837279+0000","last_undegraded":"2024-04-25T08:55:17.837279+0000","last_fullsized":"2024-04-25T08:55:17.837279+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:23.800462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540545+0000","last_change":"2024-04-25T08:55:16.833189+0000","last_active":"2024-04-25T08:55:18.540545+0000","last_peered":"2024-04-25T08:55:18.540545+0000","last_clean":"2024-04-25T08:55:18.540545+0000","last_became_active":"2024-04-25T08:55:16.831963+0000","last_became_peered":"2024-04-25T08:55:16.831963+0000","last_unstale":"2024-04-25T08:55:18.540545+0000","last_undegraded":"2024-04-25T08:55:18.540545+0000","last_fullsized":"2024-04-25T08:55:18.540545+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540421+0000","last_change":"2024-04-25T08:55:16.841886+0000","last_active":"2024-04-25T08:55:18.540421+0000","last_peered":"2024-04-25T08:55:18.540421+0000","last_clean":"2024-04-25T08:55:18.540421+0000","last_became_active":"2024-04-25T08:55:16.841578+0000","last_became_peered":"2024-04-25T08:55:16.841578+0000","last_unstale":"2024-04-25T08:55:18.540421+0000","last_undegraded":"2024-04-25T08:55:18.540421+0000","last_fullsized":"2024-04-25T08:55:18.540421+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837789+0000","last_change":"2024-04-25T08:55:16.843485+0000","last_active":"2024-04-25T08:55:17.837789+0000","last_peered":"2024-04-25T08:55:17.837789+0000","last_clean":"2024-04-25T08:55:17.837789+0000","last_became_active":"2024-04-25T08:55:16.843130+0000","last_became_peered":"2024-04-25T08:55:16.843130+0000","last_unstale":"2024-04-25T08:55:17.837789+0000","last_undegraded":"2024-04-25T08:55:17.837789+0000","last_fullsized":"2024-04-25T08:55:17.837789+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:12.657487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540145+0000","last_change":"2024-04-25T08:55:16.841939+0000","last_active":"2024-04-25T08:55:18.540145+0000","last_peered":"2024-04-25T08:55:18.540145+0000","last_clean":"2024-04-25T08:55:18.540145+0000","last_became_active":"2024-04-25T08:55:16.841657+0000","last_became_peered":"2024-04-25T08:55:16.841657+0000","last_unstale":"2024-04-25T08:55:18.540145+0000","last_undegraded":"2024-04-25T08:55:18.540145+0000","last_fullsized":"2024-04-25T08:55:18.540145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:14.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837507+0000","last_change":"2024-04-25T08:55:16.821355+0000","last_active":"2024-04-25T08:55:17.837507+0000","last_peered":"2024-04-25T08:55:17.837507+0000","last_clean":"2024-04-25T08:55:17.837507+0000","last_became_active":"2024-04-25T08:55:16.821067+0000","last_became_peered":"2024-04-25T08:55:16.821067+0000","last_unstale":"2024-04-25T08:55:17.837507+0000","last_undegraded":"2024-04-25T08:55:17.837507+0000","last_fullsized":"2024-04-25T08:55:17.837507+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.333983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539859+0000","last_change":"2024-04-25T08:55:16.838547+0000","last_active":"2024-04-25T08:55:18.539859+0000","last_peered":"2024-04-25T08:55:18.539859+0000","last_clean":"2024-04-25T08:55:18.539859+0000","last_became_active":"2024-04-25T08:55:16.837583+0000","last_became_peered":"2024-04-25T08:55:16.837583+0000","last_unstale":"2024-04-25T08:55:18.539859+0000","last_undegraded":"2024-04-25T08:55:18.539859+0000","last_fullsized":"2024-04-25T08:55:18.539859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:36.671667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836896+0000","last_change":"2024-04-25T08:55:16.828541+0000","last_active":"2024-04-25T08:55:17.836896+0000","last_peered":"2024-04-25T08:55:17.836896+0000","last_clean":"2024-04-25T08:55:17.836896+0000","last_became_active":"2024-04-25T08:55:16.828068+0000","last_became_peered":"2024-04-25T08:55:16.828068+0000","last_unstale":"2024-04-25T08:55:17.836896+0000","last_undegraded":"2024-04-25T08:55:17.836896+0000","last_fullsized":"2024-04-25T08:55:17.836896+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:58.797425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837412+0000","last_change":"2024-04-25T08:55:16.828256+0000","last_active":"2024-04-25T08:55:17.837412+0000","last_peered":"2024-04-25T08:55:17.837412+0000","last_clean":"2024-04-25T08:55:17.837412+0000","last_became_active":"2024-04-25T08:55:16.827956+0000","last_became_peered":"2024-04-25T08:55:16.827956+0000","last_unstale":"2024-04-25T08:55:17.837412+0000","last_undegraded":"2024-04-25T08:55:17.837412+0000","last_fullsized":"2024-04-25T08:55:17.837412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.294126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837937+0000","last_change":"2024-04-25T08:55:16.831080+0000","last_active":"2024-04-25T08:55:17.837937+0000","last_peered":"2024-04-25T08:55:17.837937+0000","last_clean":"2024-04-25T08:55:17.837937+0000","last_became_active":"2024-04-25T08:55:16.830803+0000","last_became_peered":"2024-04-25T08:55:16.830803+0000","last_unstale":"2024-04-25T08:55:17.837937+0000","last_undegraded":"2024-04-25T08:55:17.837937+0000","last_fullsized":"2024-04-25T08:55:17.837937+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:44.216939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540190+0000","last_change":"2024-04-25T08:55:16.846495+0000","last_active":"2024-04-25T08:55:18.540190+0000","last_peered":"2024-04-25T08:55:18.540190+0000","last_clean":"2024-04-25T08:55:18.540190+0000","last_became_active":"2024-04-25T08:55:16.846097+0000","last_became_peered":"2024-04-25T08:55:16.846097+0000","last_unstale":"2024-04-25T08:55:18.540190+0000","last_undegraded":"2024-04-25T08:55:18.540190+0000","last_fullsized":"2024-04-25T08:55:18.540190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:00.833210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540297+0000","last_change":"2024-04-25T08:55:16.832406+0000","last_active":"2024-04-25T08:55:18.540297+0000","last_peered":"2024-04-25T08:55:18.540297+0000","last_clean":"2024-04-25T08:55:18.540297+0000","last_became_active":"2024-04-25T08:55:16.832117+0000","last_became_peered":"2024-04-25T08:55:16.832117+0000","last_unstale":"2024-04-25T08:55:18.540297+0000","last_undegraded":"2024-04-25T08:55:18.540297+0000","last_fullsized":"2024-04-25T08:55:18.540297+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540182+0000","last_change":"2024-04-25T08:55:16.831162+0000","last_active":"2024-04-25T08:55:18.540182+0000","last_peered":"2024-04-25T08:55:18.540182+0000","last_clean":"2024-04-25T08:55:18.540182+0000","last_became_active":"2024-04-25T08:55:16.830889+0000","last_became_peered":"2024-04-25T08:55:16.830889+0000","last_unstale":"2024-04-25T08:55:18.540182+0000","last_undegraded":"2024-04-25T08:55:18.540182+0000","last_fullsized":"2024-04-25T08:55:18.540182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836963+0000","last_change":"2024-04-25T08:55:16.829707+0000","last_active":"2024-04-25T08:55:17.836963+0000","last_peered":"2024-04-25T08:55:17.836963+0000","last_clean":"2024-04-25T08:55:17.836963+0000","last_became_active":"2024-04-25T08:55:16.829062+0000","last_became_peered":"2024-04-25T08:55:16.829062+0000","last_unstale":"2024-04-25T08:55:17.836963+0000","last_undegraded":"2024-04-25T08:55:17.836963+0000","last_fullsized":"2024-04-25T08:55:17.836963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:15.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539758+0000","last_change":"2024-04-25T08:55:16.830080+0000","last_active":"2024-04-25T08:55:18.539758+0000","last_peered":"2024-04-25T08:55:18.539758+0000","last_clean":"2024-04-25T08:55:18.539758+0000","last_became_active":"2024-04-25T08:55:16.829695+0000","last_became_peered":"2024-04-25T08:55:16.829695+0000","last_unstale":"2024-04-25T08:55:18.539758+0000","last_undegraded":"2024-04-25T08:55:18.539758+0000","last_fullsized":"2024-04-25T08:55:18.539758+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:36.671667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837487+0000","last_change":"2024-04-25T08:55:16.822654+0000","last_active":"2024-04-25T08:55:17.837487+0000","last_peered":"2024-04-25T08:55:17.837487+0000","last_clean":"2024-04-25T08:55:17.837487+0000","last_became_active":"2024-04-25T08:55:16.822381+0000","last_became_peered":"2024-04-25T08:55:16.822381+0000","last_unstale":"2024-04-25T08:55:17.837487+0000","last_undegraded":"2024-04-25T08:55:17.837487+0000","last_fullsized":"2024-04-25T08:55:17.837487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:26.668007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539713+0000","last_change":"2024-04-25T08:55:16.838404+0000","last_active":"2024-04-25T08:55:18.539713+0000","last_peered":"2024-04-25T08:55:18.539713+0000","last_clean":"2024-04-25T08:55:18.539713+0000","last_became_active":"2024-04-25T08:55:16.838105+0000","last_became_peered":"2024-04-25T08:55:16.838105+0000","last_unstale":"2024-04-25T08:55:18.539713+0000","last_undegraded":"2024-04-25T08:55:18.539713+0000","last_fullsized":"2024-04-25T08:55:18.539713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:38.008819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.804067+0000","last_change":"2024-04-25T08:55:15.804067+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.804067+0000","last_undegraded":"2024-04-25T08:55:15.804067+0000","last_fullsized":"2024-04-25T08:55:15.804067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837824+0000","last_change":"2024-04-25T08:55:15.812917+0000","last_active":"2024-04-25T08:55:17.837824+0000","last_peered":"2024-04-25T08:55:17.837824+0000","last_clean":"2024-04-25T08:55:17.837824+0000","last_became_active":"2024-04-25T08:55:15.812416+0000","last_became_peered":"2024-04-25T08:55:15.812416+0000","last_unstale":"2024-04-25T08:55:17.837824+0000","last_undegraded":"2024-04-25T08:55:17.837824+0000","last_fullsized":"2024-04-25T08:55:17.837824+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:08.909603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837905+0000","last_change":"2024-04-25T08:55:16.832501+0000","last_active":"2024-04-25T08:55:17.837905+0000","last_peered":"2024-04-25T08:55:17.837905+0000","last_clean":"2024-04-25T08:55:17.837905+0000","last_became_active":"2024-04-25T08:55:16.832159+0000","last_became_peered":"2024-04-25T08:55:16.832159+0000","last_unstale":"2024-04-25T08:55:17.837905+0000","last_undegraded":"2024-04-25T08:55:17.837905+0000","last_fullsized":"2024-04-25T08:55:17.837905+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:46.528440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540498+0000","last_change":"2024-04-25T08:55:15.804587+0000","last_active":"2024-04-25T08:55:18.540498+0000","last_peered":"2024-04-25T08:55:18.540498+0000","last_clean":"2024-04-25T08:55:18.540498+0000","last_became_active":"2024-04-25T08:55:15.802674+0000","last_became_peered":"2024-04-25T08:55:15.802674+0000","last_unstale":"2024-04-25T08:55:18.540498+0000","last_undegraded":"2024-04-25T08:55:18.540498+0000","last_fullsized":"2024-04-25T08:55:18.540498+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:14.287603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540254+0000","last_change":"2024-04-25T08:55:16.836374+0000","last_active":"2024-04-25T08:55:18.540254+0000","last_peered":"2024-04-25T08:55:18.540254+0000","last_clean":"2024-04-25T08:55:18.540254+0000","last_became_active":"2024-04-25T08:55:16.835872+0000","last_became_peered":"2024-04-25T08:55:16.835872+0000","last_unstale":"2024-04-25T08:55:18.540254+0000","last_undegraded":"2024-04-25T08:55:18.540254+0000","last_fullsized":"2024-04-25T08:55:18.540254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811418+0000","last_change":"2024-04-25T08:55:15.805969+0000","last_active":"2024-04-25T08:55:15.811418+0000","last_peered":"2024-04-25T08:55:15.811418+0000","last_clean":"2024-04-25T08:55:15.811418+0000","last_became_active":"2024-04-25T08:55:15.805679+0000","last_became_peered":"2024-04-25T08:55:15.805679+0000","last_unstale":"2024-04-25T08:55:15.811418+0000","last_undegraded":"2024-04-25T08:55:15.811418+0000","last_fullsized":"2024-04-25T08:55:15.811418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:23.227100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.803300+0000","last_change":"2024-04-25T08:55:15.803300+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.803300+0000","last_undegraded":"2024-04-25T08:55:15.803300+0000","last_fullsized":"2024-04-25T08:55:15.803300+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837602+0000","last_change":"2024-04-25T08:55:15.810287+0000","last_active":"2024-04-25T08:55:17.837602+0000","last_peered":"2024-04-25T08:55:17.837602+0000","last_clean":"2024-04-25T08:55:17.837602+0000","last_became_active":"2024-04-25T08:55:15.810000+0000","last_became_peered":"2024-04-25T08:55:15.810000+0000","last_unstale":"2024-04-25T08:55:17.837602+0000","last_undegraded":"2024-04-25T08:55:17.837602+0000","last_fullsized":"2024-04-25T08:55:17.837602+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:43.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539785+0000","last_change":"2024-04-25T08:55:16.832716+0000","last_active":"2024-04-25T08:55:18.539785+0000","last_peered":"2024-04-25T08:55:18.539785+0000","last_clean":"2024-04-25T08:55:18.539785+0000","last_became_active":"2024-04-25T08:55:16.832332+0000","last_became_peered":"2024-04-25T08:55:16.832332+0000","last_unstale":"2024-04-25T08:55:18.539785+0000","last_undegraded":"2024-04-25T08:55:18.539785+0000","last_fullsized":"2024-04-25T08:55:18.539785+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.956125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837620+0000","last_change":"2024-04-25T08:55:15.810523+0000","last_active":"2024-04-25T08:55:17.837620+0000","last_peered":"2024-04-25T08:55:17.837620+0000","last_clean":"2024-04-25T08:55:17.837620+0000","last_became_active":"2024-04-25T08:55:15.809802+0000","last_became_peered":"2024-04-25T08:55:15.809802+0000","last_unstale":"2024-04-25T08:55:17.837620+0000","last_undegraded":"2024-04-25T08:55:17.837620+0000","last_fullsized":"2024-04-25T08:55:17.837620+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.053850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540961+0000","last_change":"2024-04-25T08:55:16.841348+0000","last_active":"2024-04-25T08:55:18.540961+0000","last_peered":"2024-04-25T08:55:18.540961+0000","last_clean":"2024-04-25T08:55:18.540961+0000","last_became_active":"2024-04-25T08:55:16.840890+0000","last_became_peered":"2024-04-25T08:55:16.840890+0000","last_unstale":"2024-04-25T08:55:18.540961+0000","last_undegraded":"2024-04-25T08:55:18.540961+0000","last_fullsized":"2024-04-25T08:55:18.540961+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:36.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539863+0000","last_change":"2024-04-25T08:55:15.808364+0000","last_active":"2024-04-25T08:55:18.539863+0000","last_peered":"2024-04-25T08:55:18.539863+0000","last_clean":"2024-04-25T08:55:18.539863+0000","last_became_active":"2024-04-25T08:55:15.808068+0000","last_became_peered":"2024-04-25T08:55:15.808068+0000","last_unstale":"2024-04-25T08:55:18.539863+0000","last_undegraded":"2024-04-25T08:55:18.539863+0000","last_fullsized":"2024-04-25T08:55:18.539863+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:00.314074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539499+0000","last_change":"2024-04-25T08:55:16.840358+0000","last_active":"2024-04-25T08:55:18.539499+0000","last_peered":"2024-04-25T08:55:18.539499+0000","last_clean":"2024-04-25T08:55:18.539499+0000","last_became_active":"2024-04-25T08:55:16.837947+0000","last_became_peered":"2024-04-25T08:55:16.837947+0000","last_unstale":"2024-04-25T08:55:18.539499+0000","last_undegraded":"2024-04-25T08:55:18.539499+0000","last_fullsized":"2024-04-25T08:55:18.539499+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:25.830198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539474+0000","last_change":"2024-04-25T08:55:15.809376+0000","last_active":"2024-04-25T08:55:18.539474+0000","last_peered":"2024-04-25T08:55:18.539474+0000","last_clean":"2024-04-25T08:55:18.539474+0000","last_became_active":"2024-04-25T08:55:15.808982+0000","last_became_peered":"2024-04-25T08:55:15.808982+0000","last_unstale":"2024-04-25T08:55:18.539474+0000","last_undegraded":"2024-04-25T08:55:18.539474+0000","last_fullsized":"2024-04-25T08:55:18.539474+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:43.806513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836650+0000","last_change":"2024-04-25T08:55:16.829231+0000","last_active":"2024-04-25T08:55:17.836650+0000","last_peered":"2024-04-25T08:55:17.836650+0000","last_clean":"2024-04-25T08:55:17.836650+0000","last_became_active":"2024-04-25T08:55:16.828876+0000","last_became_peered":"2024-04-25T08:55:16.828876+0000","last_unstale":"2024-04-25T08:55:17.836650+0000","last_undegraded":"2024-04-25T08:55:17.836650+0000","last_fullsized":"2024-04-25T08:55:17.836650+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:23.778385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540129+0000","last_change":"2024-04-25T08:55:15.810673+0000","last_active":"2024-04-25T08:55:18.540129+0000","last_peered":"2024-04-25T08:55:18.540129+0000","last_clean":"2024-04-25T08:55:18.540129+0000","last_became_active":"2024-04-25T08:55:15.809289+0000","last_became_peered":"2024-04-25T08:55:15.809289+0000","last_unstale":"2024-04-25T08:55:18.540129+0000","last_undegraded":"2024-04-25T08:55:18.540129+0000","last_fullsized":"2024-04-25T08:55:18.540129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.016665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540504+0000","last_change":"2024-04-25T08:55:16.841663+0000","last_active":"2024-04-25T08:55:18.540504+0000","last_peered":"2024-04-25T08:55:18.540504+0000","last_clean":"2024-04-25T08:55:18.540504+0000","last_became_active":"2024-04-25T08:55:16.841397+0000","last_became_peered":"2024-04-25T08:55:16.841397+0000","last_unstale":"2024-04-25T08:55:18.540504+0000","last_undegraded":"2024-04-25T08:55:18.540504+0000","last_fullsized":"2024-04-25T08:55:18.540504+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540624+0000","last_change":"2024-04-25T08:55:15.808307+0000","last_active":"2024-04-25T08:55:18.540624+0000","last_peered":"2024-04-25T08:55:18.540624+0000","last_clean":"2024-04-25T08:55:18.540624+0000","last_became_active":"2024-04-25T08:55:15.808012+0000","last_became_peered":"2024-04-25T08:55:15.808012+0000","last_unstale":"2024-04-25T08:55:18.540624+0000","last_undegraded":"2024-04-25T08:55:18.540624+0000","last_fullsized":"2024-04-25T08:55:18.540624+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:11.650964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837119+0000","last_change":"2024-04-25T08:55:16.824657+0000","last_active":"2024-04-25T08:55:17.837119+0000","last_peered":"2024-04-25T08:55:17.837119+0000","last_clean":"2024-04-25T08:55:17.837119+0000","last_became_active":"2024-04-25T08:55:16.824372+0000","last_became_peered":"2024-04-25T08:55:16.824372+0000","last_unstale":"2024-04-25T08:55:17.837119+0000","last_undegraded":"2024-04-25T08:55:17.837119+0000","last_fullsized":"2024-04-25T08:55:17.837119+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541025+0000","last_change":"2024-04-25T08:55:15.808834+0000","last_active":"2024-04-25T08:55:18.541025+0000","last_peered":"2024-04-25T08:55:18.541025+0000","last_clean":"2024-04-25T08:55:18.541025+0000","last_became_active":"2024-04-25T08:55:15.808535+0000","last_became_peered":"2024-04-25T08:55:15.808535+0000","last_unstale":"2024-04-25T08:55:18.541025+0000","last_undegraded":"2024-04-25T08:55:18.541025+0000","last_fullsized":"2024-04-25T08:55:18.541025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:51.724373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837714+0000","last_change":"2024-04-25T08:55:16.829816+0000","last_active":"2024-04-25T08:55:17.837714+0000","last_peered":"2024-04-25T08:55:17.837714+0000","last_clean":"2024-04-25T08:55:17.837714+0000","last_became_active":"2024-04-25T08:55:16.829214+0000","last_became_peered":"2024-04-25T08:55:16.829214+0000","last_unstale":"2024-04-25T08:55:17.837714+0000","last_undegraded":"2024-04-25T08:55:17.837714+0000","last_fullsized":"2024-04-25T08:55:17.837714+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:34.646693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837921+0000","last_change":"2024-04-25T08:55:15.803912+0000","last_active":"2024-04-25T08:55:17.837921+0000","last_peered":"2024-04-25T08:55:17.837921+0000","last_clean":"2024-04-25T08:55:17.837921+0000","last_became_active":"2024-04-25T08:55:15.803618+0000","last_became_peered":"2024-04-25T08:55:15.803618+0000","last_unstale":"2024-04-25T08:55:17.837921+0000","last_undegraded":"2024-04-25T08:55:17.837921+0000","last_fullsized":"2024-04-25T08:55:17.837921+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:21.098215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837797+0000","last_change":"2024-04-25T08:55:16.836929+0000","last_active":"2024-04-25T08:55:17.837797+0000","last_peered":"2024-04-25T08:55:17.837797+0000","last_clean":"2024-04-25T08:55:17.837797+0000","last_became_active":"2024-04-25T08:55:16.836637+0000","last_became_peered":"2024-04-25T08:55:16.836637+0000","last_unstale":"2024-04-25T08:55:17.837797+0000","last_undegraded":"2024-04-25T08:55:17.837797+0000","last_fullsized":"2024-04-25T08:55:17.837797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:36.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540179+0000","last_change":"2024-04-25T08:55:15.804532+0000","last_active":"2024-04-25T08:55:18.540179+0000","last_peered":"2024-04-25T08:55:18.540179+0000","last_clean":"2024-04-25T08:55:18.540179+0000","last_became_active":"2024-04-25T08:55:15.804121+0000","last_became_peered":"2024-04-25T08:55:15.804121+0000","last_unstale":"2024-04-25T08:55:18.540179+0000","last_undegraded":"2024-04-25T08:55:18.540179+0000","last_fullsized":"2024-04-25T08:55:18.540179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.796101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837148+0000","last_change":"2024-04-25T08:55:16.841731+0000","last_active":"2024-04-25T08:55:17.837148+0000","last_peered":"2024-04-25T08:55:17.837148+0000","last_clean":"2024-04-25T08:55:17.837148+0000","last_became_active":"2024-04-25T08:55:16.841469+0000","last_became_peered":"2024-04-25T08:55:16.841469+0000","last_unstale":"2024-04-25T08:55:17.837148+0000","last_undegraded":"2024-04-25T08:55:17.837148+0000","last_fullsized":"2024-04-25T08:55:17.837148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:01.320597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837682+0000","last_change":"2024-04-25T08:55:15.810787+0000","last_active":"2024-04-25T08:55:17.837682+0000","last_peered":"2024-04-25T08:55:17.837682+0000","last_clean":"2024-04-25T08:55:17.837682+0000","last_became_active":"2024-04-25T08:55:15.810228+0000","last_became_peered":"2024-04-25T08:55:15.810228+0000","last_unstale":"2024-04-25T08:55:17.837682+0000","last_undegraded":"2024-04-25T08:55:17.837682+0000","last_fullsized":"2024-04-25T08:55:17.837682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:10.670548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540521+0000","last_change":"2024-04-25T08:55:16.841653+0000","last_active":"2024-04-25T08:55:18.540521+0000","last_peered":"2024-04-25T08:55:18.540521+0000","last_clean":"2024-04-25T08:55:18.540521+0000","last_became_active":"2024-04-25T08:55:16.840792+0000","last_became_peered":"2024-04-25T08:55:16.840792+0000","last_unstale":"2024-04-25T08:55:18.540521+0000","last_undegraded":"2024-04-25T08:55:18.540521+0000","last_fullsized":"2024-04-25T08:55:18.540521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837375+0000","last_change":"2024-04-25T08:55:15.809556+0000","last_active":"2024-04-25T08:55:17.837375+0000","last_peered":"2024-04-25T08:55:17.837375+0000","last_clean":"2024-04-25T08:55:17.837375+0000","last_became_active":"2024-04-25T08:55:15.809080+0000","last_became_peered":"2024-04-25T08:55:15.809080+0000","last_unstale":"2024-04-25T08:55:17.837375+0000","last_undegraded":"2024-04-25T08:55:17.837375+0000","last_fullsized":"2024-04-25T08:55:17.837375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:25.637156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837378+0000","last_change":"2024-04-25T08:55:16.829568+0000","last_active":"2024-04-25T08:55:17.837378+0000","last_peered":"2024-04-25T08:55:17.837378+0000","last_clean":"2024-04-25T08:55:17.837378+0000","last_became_active":"2024-04-25T08:55:16.829248+0000","last_became_peered":"2024-04-25T08:55:16.829248+0000","last_unstale":"2024-04-25T08:55:17.837378+0000","last_undegraded":"2024-04-25T08:55:17.837378+0000","last_fullsized":"2024-04-25T08:55:17.837378+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:56.165607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837529+0000","last_change":"2024-04-25T08:55:15.812602+0000","last_active":"2024-04-25T08:55:17.837529+0000","last_peered":"2024-04-25T08:55:17.837529+0000","last_clean":"2024-04-25T08:55:17.837529+0000","last_became_active":"2024-04-25T08:55:15.812277+0000","last_became_peered":"2024-04-25T08:55:15.812277+0000","last_unstale":"2024-04-25T08:55:17.837529+0000","last_undegraded":"2024-04-25T08:55:17.837529+0000","last_fullsized":"2024-04-25T08:55:17.837529+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:15.861856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837530+0000","last_change":"2024-04-25T08:55:16.828073+0000","last_active":"2024-04-25T08:55:17.837530+0000","last_peered":"2024-04-25T08:55:17.837530+0000","last_clean":"2024-04-25T08:55:17.837530+0000","last_became_active":"2024-04-25T08:55:16.827811+0000","last_became_peered":"2024-04-25T08:55:16.827811+0000","last_unstale":"2024-04-25T08:55:17.837530+0000","last_undegraded":"2024-04-25T08:55:17.837530+0000","last_fullsized":"2024-04-25T08:55:17.837530+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539870+0000","last_change":"2024-04-25T08:55:15.809552+0000","last_active":"2024-04-25T08:55:18.539870+0000","last_peered":"2024-04-25T08:55:18.539870+0000","last_clean":"2024-04-25T08:55:18.539870+0000","last_became_active":"2024-04-25T08:55:15.809065+0000","last_became_peered":"2024-04-25T08:55:15.809065+0000","last_unstale":"2024-04-25T08:55:18.539870+0000","last_undegraded":"2024-04-25T08:55:18.539870+0000","last_fullsized":"2024-04-25T08:55:18.539870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:36.553413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540362+0000","last_change":"2024-04-25T08:55:16.833303+0000","last_active":"2024-04-25T08:55:18.540362+0000","last_peered":"2024-04-25T08:55:18.540362+0000","last_clean":"2024-04-25T08:55:18.540362+0000","last_became_active":"2024-04-25T08:55:16.832435+0000","last_became_peered":"2024-04-25T08:55:16.832435+0000","last_unstale":"2024-04-25T08:55:18.540362+0000","last_undegraded":"2024-04-25T08:55:18.540362+0000","last_fullsized":"2024-04-25T08:55:18.540362+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:15.812095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541163+0000","last_change":"2024-04-25T08:55:15.806916+0000","last_active":"2024-04-25T08:55:18.541163+0000","last_peered":"2024-04-25T08:55:18.541163+0000","last_clean":"2024-04-25T08:55:18.541163+0000","last_became_active":"2024-04-25T08:55:15.806584+0000","last_became_peered":"2024-04-25T08:55:15.806584+0000","last_unstale":"2024-04-25T08:55:18.541163+0000","last_undegraded":"2024-04-25T08:55:18.541163+0000","last_fullsized":"2024-04-25T08:55:18.541163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:52.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540974+0000","last_change":"2024-04-25T08:55:16.846605+0000","last_active":"2024-04-25T08:55:18.540974+0000","last_peered":"2024-04-25T08:55:18.540974+0000","last_clean":"2024-04-25T08:55:18.540974+0000","last_became_active":"2024-04-25T08:55:16.846304+0000","last_became_peered":"2024-04-25T08:55:16.846304+0000","last_unstale":"2024-04-25T08:55:18.540974+0000","last_undegraded":"2024-04-25T08:55:18.540974+0000","last_fullsized":"2024-04-25T08:55:18.540974+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540594+0000","last_change":"2024-04-25T08:55:15.806841+0000","last_active":"2024-04-25T08:55:18.540594+0000","last_peered":"2024-04-25T08:55:18.540594+0000","last_clean":"2024-04-25T08:55:18.540594+0000","last_became_active":"2024-04-25T08:55:15.806563+0000","last_became_peered":"2024-04-25T08:55:15.806563+0000","last_unstale":"2024-04-25T08:55:18.540594+0000","last_undegraded":"2024-04-25T08:55:18.540594+0000","last_fullsized":"2024-04-25T08:55:18.540594+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:19.717985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837109+0000","last_change":"2024-04-25T08:55:16.838841+0000","last_active":"2024-04-25T08:55:17.837109+0000","last_peered":"2024-04-25T08:55:17.837109+0000","last_clean":"2024-04-25T08:55:17.837109+0000","last_became_active":"2024-04-25T08:55:16.838592+0000","last_became_peered":"2024-04-25T08:55:16.838592+0000","last_unstale":"2024-04-25T08:55:17.837109+0000","last_undegraded":"2024-04-25T08:55:17.837109+0000","last_fullsized":"2024-04-25T08:55:17.837109+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:16.953838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540102+0000","last_change":"2024-04-25T08:55:15.809119+0000","last_active":"2024-04-25T08:55:18.540102+0000","last_peered":"2024-04-25T08:55:18.540102+0000","last_clean":"2024-04-25T08:55:18.540102+0000","last_became_active":"2024-04-25T08:55:15.808770+0000","last_became_peered":"2024-04-25T08:55:15.808770+0000","last_unstale":"2024-04-25T08:55:18.540102+0000","last_undegraded":"2024-04-25T08:55:18.540102+0000","last_fullsized":"2024-04-25T08:55:18.540102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:25.637156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837451+0000","last_change":"2024-04-25T08:55:16.831158+0000","last_active":"2024-04-25T08:55:17.837451+0000","last_peered":"2024-04-25T08:55:17.837451+0000","last_clean":"2024-04-25T08:55:17.837451+0000","last_became_active":"2024-04-25T08:55:16.830883+0000","last_became_peered":"2024-04-25T08:55:16.830883+0000","last_unstale":"2024-04-25T08:55:17.837451+0000","last_undegraded":"2024-04-25T08:55:17.837451+0000","last_fullsized":"2024-04-25T08:55:17.837451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:20.724508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837803+0000","last_change":"2024-04-25T08:55:15.811663+0000","last_active":"2024-04-25T08:55:17.837803+0000","last_peered":"2024-04-25T08:55:17.837803+0000","last_clean":"2024-04-25T08:55:17.837803+0000","last_became_active":"2024-04-25T08:55:15.811372+0000","last_became_peered":"2024-04-25T08:55:15.811372+0000","last_unstale":"2024-04-25T08:55:17.837803+0000","last_undegraded":"2024-04-25T08:55:17.837803+0000","last_fullsized":"2024-04-25T08:55:17.837803+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:00.529017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837681+0000","last_change":"2024-04-25T08:55:16.830366+0000","last_active":"2024-04-25T08:55:17.837681+0000","last_peered":"2024-04-25T08:55:17.837681+0000","last_clean":"2024-04-25T08:55:17.837681+0000","last_became_active":"2024-04-25T08:55:16.830101+0000","last_became_peered":"2024-04-25T08:55:16.830101+0000","last_unstale":"2024-04-25T08:55:17.837681+0000","last_undegraded":"2024-04-25T08:55:17.837681+0000","last_fullsized":"2024-04-25T08:55:17.837681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:56.842647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837784+0000","last_change":"2024-04-25T08:55:15.811103+0000","last_active":"2024-04-25T08:55:17.837784+0000","last_peered":"2024-04-25T08:55:17.837784+0000","last_clean":"2024-04-25T08:55:17.837784+0000","last_became_active":"2024-04-25T08:55:15.810409+0000","last_became_peered":"2024-04-25T08:55:15.810409+0000","last_unstale":"2024-04-25T08:55:17.837784+0000","last_undegraded":"2024-04-25T08:55:17.837784+0000","last_fullsized":"2024-04-25T08:55:17.837784+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:35.665144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.802692+0000","last_change":"2024-04-25T08:55:15.802692+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.802692+0000","last_undegraded":"2024-04-25T08:55:15.802692+0000","last_fullsized":"2024-04-25T08:55:15.802692+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539589+0000","last_change":"2024-04-25T08:55:15.808197+0000","last_active":"2024-04-25T08:55:18.539589+0000","last_peered":"2024-04-25T08:55:18.539589+0000","last_clean":"2024-04-25T08:55:18.539589+0000","last_became_active":"2024-04-25T08:55:15.806676+0000","last_became_peered":"2024-04-25T08:55:15.806676+0000","last_unstale":"2024-04-25T08:55:18.539589+0000","last_undegraded":"2024-04-25T08:55:18.539589+0000","last_fullsized":"2024-04-25T08:55:18.539589+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:21.098215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539986+0000","last_change":"2024-04-25T08:55:16.829187+0000","last_active":"2024-04-25T08:55:18.539986+0000","last_peered":"2024-04-25T08:55:18.539986+0000","last_clean":"2024-04-25T08:55:18.539986+0000","last_became_active":"2024-04-25T08:55:16.828772+0000","last_became_peered":"2024-04-25T08:55:16.828772+0000","last_unstale":"2024-04-25T08:55:18.539986+0000","last_undegraded":"2024-04-25T08:55:18.539986+0000","last_fullsized":"2024-04-25T08:55:18.539986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:29.403892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539546+0000","last_change":"2024-04-25T08:55:15.810669+0000","last_active":"2024-04-25T08:55:18.539546+0000","last_peered":"2024-04-25T08:55:18.539546+0000","last_clean":"2024-04-25T08:55:18.539546+0000","last_became_active":"2024-04-25T08:55:15.810364+0000","last_became_peered":"2024-04-25T08:55:15.810364+0000","last_unstale":"2024-04-25T08:55:18.539546+0000","last_undegraded":"2024-04-25T08:55:18.539546+0000","last_fullsized":"2024-04-25T08:55:18.539546+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:39.011045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539570+0000","last_change":"2024-04-25T08:55:16.844563+0000","last_active":"2024-04-25T08:55:18.539570+0000","last_peered":"2024-04-25T08:55:18.539570+0000","last_clean":"2024-04-25T08:55:18.539570+0000","last_became_active":"2024-04-25T08:55:16.844276+0000","last_became_peered":"2024-04-25T08:55:16.844276+0000","last_unstale":"2024-04-25T08:55:18.539570+0000","last_undegraded":"2024-04-25T08:55:18.539570+0000","last_fullsized":"2024-04-25T08:55:18.539570+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:36.060373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837697+0000","last_change":"2024-04-25T08:55:15.810567+0000","last_active":"2024-04-25T08:55:17.837697+0000","last_peered":"2024-04-25T08:55:17.837697+0000","last_clean":"2024-04-25T08:55:17.837697+0000","last_became_active":"2024-04-25T08:55:15.809948+0000","last_became_peered":"2024-04-25T08:55:15.809948+0000","last_unstale":"2024-04-25T08:55:17.837697+0000","last_undegraded":"2024-04-25T08:55:17.837697+0000","last_fullsized":"2024-04-25T08:55:17.837697+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.053850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.838063+0000","last_change":"2024-04-25T08:55:16.842345+0000","last_active":"2024-04-25T08:55:17.838063+0000","last_peered":"2024-04-25T08:55:17.838063+0000","last_clean":"2024-04-25T08:55:17.838063+0000","last_became_active":"2024-04-25T08:55:16.841261+0000","last_became_peered":"2024-04-25T08:55:16.841261+0000","last_unstale":"2024-04-25T08:55:17.838063+0000","last_undegraded":"2024-04-25T08:55:17.838063+0000","last_fullsized":"2024-04-25T08:55:17.838063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:44.813036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837927+0000","last_change":"2024-04-25T08:55:15.810587+0000","last_active":"2024-04-25T08:55:17.837927+0000","last_peered":"2024-04-25T08:55:17.837927+0000","last_clean":"2024-04-25T08:55:17.837927+0000","last_became_active":"2024-04-25T08:55:15.810279+0000","last_became_peered":"2024-04-25T08:55:15.810279+0000","last_unstale":"2024-04-25T08:55:17.837927+0000","last_undegraded":"2024-04-25T08:55:17.837927+0000","last_fullsized":"2024-04-25T08:55:17.837927+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:02.949602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540495+0000","last_change":"2024-04-25T08:55:16.845748+0000","last_active":"2024-04-25T08:55:18.540495+0000","last_peered":"2024-04-25T08:55:18.540495+0000","last_clean":"2024-04-25T08:55:18.540495+0000","last_became_active":"2024-04-25T08:55:16.845270+0000","last_became_peered":"2024-04-25T08:55:16.845270+0000","last_unstale":"2024-04-25T08:55:18.540495+0000","last_undegraded":"2024-04-25T08:55:18.540495+0000","last_fullsized":"2024-04-25T08:55:18.540495+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837918+0000","last_change":"2024-04-25T08:55:15.808197+0000","last_active":"2024-04-25T08:55:17.837918+0000","last_peered":"2024-04-25T08:55:17.837918+0000","last_clean":"2024-04-25T08:55:17.837918+0000","last_became_active":"2024-04-25T08:55:15.807712+0000","last_became_peered":"2024-04-25T08:55:15.807712+0000","last_unstale":"2024-04-25T08:55:17.837918+0000","last_undegraded":"2024-04-25T08:55:17.837918+0000","last_fullsized":"2024-04-25T08:55:17.837918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:24.823675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837799+0000","last_change":"2024-04-25T08:55:16.829720+0000","last_active":"2024-04-25T08:55:17.837799+0000","last_peered":"2024-04-25T08:55:17.837799+0000","last_clean":"2024-04-25T08:55:17.837799+0000","last_became_active":"2024-04-25T08:55:16.829479+0000","last_became_peered":"2024-04-25T08:55:16.829479+0000","last_unstale":"2024-04-25T08:55:17.837799+0000","last_undegraded":"2024-04-25T08:55:17.837799+0000","last_fullsized":"2024-04-25T08:55:17.837799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811361+0000","last_change":"2024-04-25T08:55:15.805828+0000","last_active":"2024-04-25T08:55:15.811361+0000","last_peered":"2024-04-25T08:55:15.811361+0000","last_clean":"2024-04-25T08:55:15.811361+0000","last_became_active":"2024-04-25T08:55:15.805528+0000","last_became_peered":"2024-04-25T08:55:15.805528+0000","last_unstale":"2024-04-25T08:55:15.811361+0000","last_undegraded":"2024-04-25T08:55:15.811361+0000","last_fullsized":"2024-04-25T08:55:15.811361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:27.984110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837868+0000","last_change":"2024-04-25T08:55:16.828363+0000","last_active":"2024-04-25T08:55:17.837868+0000","last_peered":"2024-04-25T08:55:17.837868+0000","last_clean":"2024-04-25T08:55:17.837868+0000","last_became_active":"2024-04-25T08:55:16.825857+0000","last_became_peered":"2024-04-25T08:55:16.825857+0000","last_unstale":"2024-04-25T08:55:17.837868+0000","last_undegraded":"2024-04-25T08:55:17.837868+0000","last_fullsized":"2024-04-25T08:55:17.837868+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:31.555032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837553+0000","last_change":"2024-04-25T08:55:15.804862+0000","last_active":"2024-04-25T08:55:17.837553+0000","last_peered":"2024-04-25T08:55:17.837553+0000","last_clean":"2024-04-25T08:55:17.837553+0000","last_became_active":"2024-04-25T08:55:15.804575+0000","last_became_peered":"2024-04-25T08:55:15.804575+0000","last_unstale":"2024-04-25T08:55:17.837553+0000","last_undegraded":"2024-04-25T08:55:17.837553+0000","last_fullsized":"2024-04-25T08:55:17.837553+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:43.806513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837565+0000","last_change":"2024-04-25T08:55:16.830603+0000","last_active":"2024-04-25T08:55:17.837565+0000","last_peered":"2024-04-25T08:55:17.837565+0000","last_clean":"2024-04-25T08:55:17.837565+0000","last_became_active":"2024-04-25T08:55:16.830277+0000","last_became_peered":"2024-04-25T08:55:16.830277+0000","last_unstale":"2024-04-25T08:55:17.837565+0000","last_undegraded":"2024-04-25T08:55:17.837565+0000","last_fullsized":"2024-04-25T08:55:17.837565+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:29.707648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539870+0000","last_change":"2024-04-25T08:55:15.810936+0000","last_active":"2024-04-25T08:55:18.539870+0000","last_peered":"2024-04-25T08:55:18.539870+0000","last_clean":"2024-04-25T08:55:18.539870+0000","last_became_active":"2024-04-25T08:55:15.810469+0000","last_became_peered":"2024-04-25T08:55:15.810469+0000","last_unstale":"2024-04-25T08:55:18.539870+0000","last_undegraded":"2024-04-25T08:55:18.539870+0000","last_fullsized":"2024-04-25T08:55:18.539870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:22.793939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539713+0000","last_change":"2024-04-25T08:55:16.820981+0000","last_active":"2024-04-25T08:55:18.539713+0000","last_peered":"2024-04-25T08:55:18.539713+0000","last_clean":"2024-04-25T08:55:18.539713+0000","last_became_active":"2024-04-25T08:55:16.820654+0000","last_became_peered":"2024-04-25T08:55:16.820654+0000","last_unstale":"2024-04-25T08:55:18.539713+0000","last_undegraded":"2024-04-25T08:55:18.539713+0000","last_fullsized":"2024-04-25T08:55:18.539713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811393+0000","last_change":"2024-04-25T08:55:15.806700+0000","last_active":"2024-04-25T08:55:15.811393+0000","last_peered":"2024-04-25T08:55:15.811393+0000","last_clean":"2024-04-25T08:55:15.811393+0000","last_became_active":"2024-04-25T08:55:15.806407+0000","last_became_peered":"2024-04-25T08:55:15.806407+0000","last_unstale":"2024-04-25T08:55:15.811393+0000","last_undegraded":"2024-04-25T08:55:15.811393+0000","last_fullsized":"2024-04-25T08:55:15.811393+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:58.012479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539725+0000","last_change":"2024-04-25T08:55:16.843737+0000","last_active":"2024-04-25T08:55:18.539725+0000","last_peered":"2024-04-25T08:55:18.539725+0000","last_clean":"2024-04-25T08:55:18.539725+0000","last_became_active":"2024-04-25T08:55:16.843213+0000","last_became_peered":"2024-04-25T08:55:16.843213+0000","last_unstale":"2024-04-25T08:55:18.539725+0000","last_undegraded":"2024-04-25T08:55:18.539725+0000","last_fullsized":"2024-04-25T08:55:18.539725+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:09.916126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540000+0000","last_change":"2024-04-25T08:55:15.810186+0000","last_active":"2024-04-25T08:55:18.540000+0000","last_peered":"2024-04-25T08:55:18.540000+0000","last_clean":"2024-04-25T08:55:18.540000+0000","last_became_active":"2024-04-25T08:55:15.809881+0000","last_became_peered":"2024-04-25T08:55:15.809881+0000","last_unstale":"2024-04-25T08:55:18.540000+0000","last_undegraded":"2024-04-25T08:55:18.540000+0000","last_fullsized":"2024-04-25T08:55:18.540000+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:14.805572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540870+0000","last_change":"2024-04-25T08:55:16.840505+0000","last_active":"2024-04-25T08:55:18.540870+0000","last_peered":"2024-04-25T08:55:18.540870+0000","last_clean":"2024-04-25T08:55:18.540870+0000","last_became_active":"2024-04-25T08:55:16.837418+0000","last_became_peered":"2024-04-25T08:55:16.837418+0000","last_unstale":"2024-04-25T08:55:18.540870+0000","last_undegraded":"2024-04-25T08:55:18.540870+0000","last_fullsized":"2024-04-25T08:55:18.540870+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540226+0000","last_change":"2024-04-25T08:55:15.815889+0000","last_active":"2024-04-25T08:55:18.540226+0000","last_peered":"2024-04-25T08:55:18.540226+0000","last_clean":"2024-04-25T08:55:18.540226+0000","last_became_active":"2024-04-25T08:55:15.815594+0000","last_became_peered":"2024-04-25T08:55:15.815594+0000","last_unstale":"2024-04-25T08:55:18.540226+0000","last_undegraded":"2024-04-25T08:55:18.540226+0000","last_fullsized":"2024-04-25T08:55:18.540226+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:43.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":214,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837683+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:55:17.837683+0000","last_peered":"2024-04-25T08:55:17.837683+0000","last_clean":"2024-04-25T08:55:17.837683+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:55:17.837683+0000","last_undegraded":"2024-04-25T08:55:17.837683+0000","last_fullsized":"2024-04-25T08:55:17.837683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1142784,"data_stored":810559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":220773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":220171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":557056,"data_stored":221713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":220739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":221735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1142784,"data_stored":810503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":520192,"data_stored":207026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:55:20.824 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:55:20.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.971+0000 7f6d4bfab640 1 Processor -- start 2024-04-25T08:55:20.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.971+0000 7f6d4bfab640 1 -- start start 2024-04-25T08:55:20.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d4bfab640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4409a9c0 0x7f6d44166910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d4bfab640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d440cfb90 con 0x7f6d44099a40 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d4bfab640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4415c210 con 0x7f6d4415bd40 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d4bfab640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4415cfd0 con 0x7f6d4409a9c0 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d49d47640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6d44099a40 0x7f6d440cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50860/0 (socket says 172.21.15.55:50860) 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d49d47640 1 -- 172.21.15.55:0/1936850133 learned_addr learned my addr 172.21.15.55:0/1936850133 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d4a548640 1 --2- 172.21.15.55:0/1936850133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4409a9c0 0x7f6d44166910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d48d45640 1 -- 172.21.15.55:0/1936850133 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295964125 0 0) 0x7f6d440cfb90 con 0x7f6d44099a40 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d48d45640 1 -- 172.21.15.55:0/1936850133 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d30003520 con 0x7f6d44099a40 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d48d45640 1 -- 172.21.15.55:0/1936850133 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314624354 0 0) 0x7f6d4415c210 con 0x7f6d4415bd40 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d48d45640 1 -- 172.21.15.55:0/1936850133 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d440cfb90 con 0x7f6d4415bd40 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d48d45640 1 -- 172.21.15.55:0/1936850133 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1322333991 0 0) 0x7f6d30003520 con 0x7f6d44099a40 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d4a548640 1 -- 172.21.15.55:0/1936850133 >> v1:172.21.15.167:6789/0 conn(0x7f6d4415bd40 legacy=0x7f6d44099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.972+0000 7f6d4a548640 1 -- 172.21.15.55:0/1936850133 >> v1:172.21.15.55:6789/0 conn(0x7f6d44099a40 legacy=0x7f6d440cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.973+0000 7f6d4a548640 1 -- 172.21.15.55:0/1936850133 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4415c4f0 con 0x7f6d4409a9c0 2024-04-25T08:55:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.973+0000 7f6d4a548640 1 --2- 172.21.15.55:0/1936850133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4409a9c0 0x7f6d44166910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009dc0 tx=0x7f6d3c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9476090bd0c2254c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.973+0000 7f6d48d45640 1 -- 172.21.15.55:0/1936850133 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40001690 con 0x7f6d4409a9c0 2024-04-25T08:55:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.973+0000 7f6d48d45640 1 -- 172.21.15.55:0/1936850133 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c007540 con 0x7f6d4409a9c0 2024-04-25T08:55:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.973+0000 7f6d48d45640 1 -- 172.21.15.55:0/1936850133 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0078f0 con 0x7f6d4409a9c0 2024-04-25T08:55:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.974+0000 7f6d4bfab640 1 -- 172.21.15.55:0/1936850133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4409a9c0 msgr2=0x7f6d44166910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.974+0000 7f6d4bfab640 1 --2- 172.21.15.55:0/1936850133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4409a9c0 0x7f6d44166910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009dc0 tx=0x7f6d3c02a660 comp rx=0 tx=0).stop 2024-04-25T08:55:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.974+0000 7f6d4bfab640 1 -- 172.21.15.55:0/1936850133 shutdown_connections 2024-04-25T08:55:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.974+0000 7f6d4bfab640 1 --2- 172.21.15.55:0/1936850133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4409a9c0 0x7f6d44166910 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.974+0000 7f6d4bfab640 1 -- 172.21.15.55:0/1936850133 >> 172.21.15.55:0/1936850133 conn(0x7f6d440b32f0 msgr2=0x7f6d440b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.974+0000 7f6d4bfab640 1 -- 172.21.15.55:0/1936850133 shutdown_connections 2024-04-25T08:55:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.974+0000 7f6d4bfab640 1 -- 172.21.15.55:0/1936850133 wait complete. 2024-04-25T08:55:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.975+0000 7f6d4bfab640 1 Processor -- start 2024-04-25T08:55:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.975+0000 7f6d4bfab640 1 -- start start 2024-04-25T08:55:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.976+0000 7f6d4bfab640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d44099a40 0x7f6d440c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.976+0000 7f6d4bfab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4409a9c0 0x7f6d44153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.976+0000 7f6d4bfab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d4415bd40 0x7f6d4415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.976+0000 7f6d4bfab640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4415cab0 con 0x7f6d4415bd40 2024-04-25T08:55:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.976+0000 7f6d4bfab640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4409ae10 con 0x7f6d4409a9c0 2024-04-25T08:55:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.976+0000 7f6d4bfab640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d440cd400 con 0x7f6d44099a40 2024-04-25T08:55:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.976+0000 7f6d4a548640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d4415bd40 0x7f6d4415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.976+0000 7f6d4a548640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d4415bd40 0x7f6d4415aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42448/0 (socket says 172.21.15.55:42448) 2024-04-25T08:55:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.976+0000 7f6d4a548640 1 -- 172.21.15.55:0/2647642774 learned_addr learned my addr 172.21.15.55:0/2647642774 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.976+0000 7f6d49d47640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d44099a40 0x7f6d440c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.976+0000 7f6d49546640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4409a9c0 0x7f6d44153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d4a548640 1 -- 172.21.15.55:0/2647642774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d44099a40 msgr2=0x7f6d440c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d4a548640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d44099a40 0x7f6d440c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d4a548640 1 -- 172.21.15.55:0/2647642774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4409a9c0 msgr2=0x7f6d44153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d4a548640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4409a9c0 0x7f6d44153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d4a548640 1 -- 172.21.15.55:0/2647642774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d440c5580 con 0x7f6d4415bd40 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d49546640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4409a9c0 0x7f6d44153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d4a548640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d4415bd40 0x7f6d4415aa60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009ee0 tx=0x7f6d3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d3a7fc640 1 -- 172.21.15.55:0/2647642774 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c040070 con 0x7f6d4415bd40 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d3a7fc640 1 -- 172.21.15.55:0/2647642774 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c031c40 con 0x7f6d4415bd40 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d3a7fc640 1 -- 172.21.15.55:0/2647642774 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c009450 con 0x7f6d4415bd40 2024-04-25T08:55:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d4bfab640 1 -- 172.21.15.55:0/2647642774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d440c5860 con 0x7f6d4415bd40 2024-04-25T08:55:20.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.977+0000 7f6d4bfab640 1 -- 172.21.15.55:0/2647642774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d440c5e20 con 0x7f6d4415bd40 2024-04-25T08:55:20.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.978+0000 7f6d4bfab640 1 -- 172.21.15.55:0/2647642774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d440749b0 con 0x7f6d4415bd40 2024-04-25T08:55:20.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.978+0000 7f6d3a7fc640 1 -- 172.21.15.55:0/2647642774 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6d3c039040 con 0x7f6d4415bd40 2024-04-25T08:55:20.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.979+0000 7f6d3a7fc640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d2806b4d0 0x7f6d2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:20.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.979+0000 7f6d3a7fc640 1 -- 172.21.15.55:0/2647642774 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d3c0ab450 con 0x7f6d4415bd40 2024-04-25T08:55:20.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.979+0000 7f6d49d47640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d2806b4d0 0x7f6d2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:20.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.979+0000 7f6d49d47640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d2806b4d0 0x7f6d2806d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6d440b2320 tx=0x7f6d400016d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:20.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:20.983+0000 7f6d3a7fc640 1 -- 172.21.15.55:0/2647642774 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6d3c07a360 con 0x7f6d4415bd40 2024-04-25T08:55:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.162+0000 7f6d4bfab640 1 -- 172.21.15.55:0/2647642774 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d440c5330 con 0x7f6d2806b4d0 2024-04-25T08:55:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.168+0000 7f6d3a7fc640 1 -- 172.21.15.55:0/2647642774 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251706 (secure 0 0 0) 0x7f6d440c5330 con 0x7f6d2806b4d0 2024-04-25T08:55:21.160 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:21.161 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:55:21.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 -- 172.21.15.55:0/2647642774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d2806b4d0 msgr2=0x7f6d2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d2806b4d0 0x7f6d2806d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6d440b2320 tx=0x7f6d400016d0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 -- 172.21.15.55:0/2647642774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d4415bd40 msgr2=0x7f6d4415aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d4415bd40 0x7f6d4415aa60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009ee0 tx=0x7f6d3c004a40 comp rx=0 tx=0).stop 2024-04-25T08:55:21.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 -- 172.21.15.55:0/2647642774 shutdown_connections 2024-04-25T08:55:21.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d2806b4d0 0x7f6d2806d990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d4415bd40 0x7f6d4415aa60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4409a9c0 0x7f6d44153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 --2- 172.21.15.55:0/2647642774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d44099a40 0x7f6d440c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 -- 172.21.15.55:0/2647642774 >> 172.21.15.55:0/2647642774 conn(0x7f6d440b32f0 msgr2=0x7f6d4415f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:21.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 -- 172.21.15.55:0/2647642774 shutdown_connections 2024-04-25T08:55:21.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.171+0000 7f6d4bfab640 1 -- 172.21.15.55:0/2647642774 wait complete. 2024-04-25T08:55:21.172 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-04-25T08:55:20.571126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238272,"kb_used_data":5452,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736448,"statfs":{"total":773094113280,"available":772850122752,"internally_reserved":0,"allocated":5582848,"data_stored":2933219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.785197"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836959+0000","last_change":"2024-04-25T08:55:16.832561+0000","last_active":"2024-04-25T08:55:17.836959+0000","last_peered":"2024-04-25T08:55:17.836959+0000","last_clean":"2024-04-25T08:55:17.836959+0000","last_became_active":"2024-04-25T08:55:16.832224+0000","last_became_peered":"2024-04-25T08:55:16.832224+0000","last_unstale":"2024-04-25T08:55:17.836959+0000","last_undegraded":"2024-04-25T08:55:17.836959+0000","last_fullsized":"2024-04-25T08:55:17.836959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540207+0000","last_change":"2024-04-25T08:55:16.842805+0000","last_active":"2024-04-25T08:55:18.540207+0000","last_peered":"2024-04-25T08:55:18.540207+0000","last_clean":"2024-04-25T08:55:18.540207+0000","last_became_active":"2024-04-25T08:55:16.842348+0000","last_became_peered":"2024-04-25T08:55:16.842348+0000","last_unstale":"2024-04-25T08:55:18.540207+0000","last_undegraded":"2024-04-25T08:55:18.540207+0000","last_fullsized":"2024-04-25T08:55:18.540207+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539800+0000","last_change":"2024-04-25T08:55:16.829363+0000","last_active":"2024-04-25T08:55:18.539800+0000","last_peered":"2024-04-25T08:55:18.539800+0000","last_clean":"2024-04-25T08:55:18.539800+0000","last_became_active":"2024-04-25T08:55:16.828941+0000","last_became_peered":"2024-04-25T08:55:16.828941+0000","last_unstale":"2024-04-25T08:55:18.539800+0000","last_undegraded":"2024-04-25T08:55:18.539800+0000","last_fullsized":"2024-04-25T08:55:18.539800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540318+0000","last_change":"2024-04-25T08:55:16.841043+0000","last_active":"2024-04-25T08:55:18.540318+0000","last_peered":"2024-04-25T08:55:18.540318+0000","last_clean":"2024-04-25T08:55:18.540318+0000","last_became_active":"2024-04-25T08:55:16.838610+0000","last_became_peered":"2024-04-25T08:55:16.838610+0000","last_unstale":"2024-04-25T08:55:18.540318+0000","last_undegraded":"2024-04-25T08:55:18.540318+0000","last_fullsized":"2024-04-25T08:55:18.540318+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539972+0000","last_change":"2024-04-25T08:55:16.843435+0000","last_active":"2024-04-25T08:55:18.539972+0000","last_peered":"2024-04-25T08:55:18.539972+0000","last_clean":"2024-04-25T08:55:18.539972+0000","last_became_active":"2024-04-25T08:55:16.842897+0000","last_became_peered":"2024-04-25T08:55:16.842897+0000","last_unstale":"2024-04-25T08:55:18.539972+0000","last_undegraded":"2024-04-25T08:55:18.539972+0000","last_fullsized":"2024-04-25T08:55:18.539972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837578+0000","last_change":"2024-04-25T08:55:16.826490+0000","last_active":"2024-04-25T08:55:17.837578+0000","last_peered":"2024-04-25T08:55:17.837578+0000","last_clean":"2024-04-25T08:55:17.837578+0000","last_became_active":"2024-04-25T08:55:16.826201+0000","last_became_peered":"2024-04-25T08:55:16.826201+0000","last_unstale":"2024-04-25T08:55:17.837578+0000","last_undegraded":"2024-04-25T08:55:17.837578+0000","last_fullsized":"2024-04-25T08:55:17.837578+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:34.683007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837295+0000","last_change":"2024-04-25T08:55:16.829027+0000","last_active":"2024-04-25T08:55:17.837295+0000","last_peered":"2024-04-25T08:55:17.837295+0000","last_clean":"2024-04-25T08:55:17.837295+0000","last_became_active":"2024-04-25T08:55:16.828724+0000","last_became_peered":"2024-04-25T08:55:16.828724+0000","last_unstale":"2024-04-25T08:55:17.837295+0000","last_undegraded":"2024-04-25T08:55:17.837295+0000","last_fullsized":"2024-04-25T08:55:17.837295+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539748+0000","last_change":"2024-04-25T08:55:16.840752+0000","last_active":"2024-04-25T08:55:18.539748+0000","last_peered":"2024-04-25T08:55:18.539748+0000","last_clean":"2024-04-25T08:55:18.539748+0000","last_became_active":"2024-04-25T08:55:16.838830+0000","last_became_peered":"2024-04-25T08:55:16.838830+0000","last_unstale":"2024-04-25T08:55:18.539748+0000","last_undegraded":"2024-04-25T08:55:18.539748+0000","last_fullsized":"2024-04-25T08:55:18.539748+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:11.677071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540796+0000","last_change":"2024-04-25T08:55:16.840080+0000","last_active":"2024-04-25T08:55:18.540796+0000","last_peered":"2024-04-25T08:55:18.540796+0000","last_clean":"2024-04-25T08:55:18.540796+0000","last_became_active":"2024-04-25T08:55:16.837974+0000","last_became_peered":"2024-04-25T08:55:16.837974+0000","last_unstale":"2024-04-25T08:55:18.540796+0000","last_undegraded":"2024-04-25T08:55:18.540796+0000","last_fullsized":"2024-04-25T08:55:18.540796+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540698+0000","last_change":"2024-04-25T08:55:16.838746+0000","last_active":"2024-04-25T08:55:18.540698+0000","last_peered":"2024-04-25T08:55:18.540698+0000","last_clean":"2024-04-25T08:55:18.540698+0000","last_became_active":"2024-04-25T08:55:16.838330+0000","last_became_peered":"2024-04-25T08:55:16.838330+0000","last_unstale":"2024-04-25T08:55:18.540698+0000","last_undegraded":"2024-04-25T08:55:18.540698+0000","last_fullsized":"2024-04-25T08:55:18.540698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540035+0000","last_change":"2024-04-25T08:55:16.841755+0000","last_active":"2024-04-25T08:55:18.540035+0000","last_peered":"2024-04-25T08:55:18.540035+0000","last_clean":"2024-04-25T08:55:18.540035+0000","last_became_active":"2024-04-25T08:55:16.840957+0000","last_became_peered":"2024-04-25T08:55:16.840957+0000","last_unstale":"2024-04-25T08:55:18.540035+0000","last_undegraded":"2024-04-25T08:55:18.540035+0000","last_fullsized":"2024-04-25T08:55:18.540035+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.956125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540100+0000","last_change":"2024-04-25T08:55:16.834783+0000","last_active":"2024-04-25T08:55:18.540100+0000","last_peered":"2024-04-25T08:55:18.540100+0000","last_clean":"2024-04-25T08:55:18.540100+0000","last_became_active":"2024-04-25T08:55:16.834516+0000","last_became_peered":"2024-04-25T08:55:16.834516+0000","last_unstale":"2024-04-25T08:55:18.540100+0000","last_undegraded":"2024-04-25T08:55:18.540100+0000","last_fullsized":"2024-04-25T08:55:18.540100+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540279+0000","last_change":"2024-04-25T08:55:16.846385+0000","last_active":"2024-04-25T08:55:18.540279+0000","last_peered":"2024-04-25T08:55:18.540279+0000","last_clean":"2024-04-25T08:55:18.540279+0000","last_became_active":"2024-04-25T08:55:16.846086+0000","last_became_peered":"2024-04-25T08:55:16.846086+0000","last_unstale":"2024-04-25T08:55:18.540279+0000","last_undegraded":"2024-04-25T08:55:18.540279+0000","last_fullsized":"2024-04-25T08:55:18.540279+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:37.559936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539706+0000","last_change":"2024-04-25T08:55:16.843288+0000","last_active":"2024-04-25T08:55:18.539706+0000","last_peered":"2024-04-25T08:55:18.539706+0000","last_clean":"2024-04-25T08:55:18.539706+0000","last_became_active":"2024-04-25T08:55:16.838291+0000","last_became_peered":"2024-04-25T08:55:16.838291+0000","last_unstale":"2024-04-25T08:55:18.539706+0000","last_undegraded":"2024-04-25T08:55:18.539706+0000","last_fullsized":"2024-04-25T08:55:18.539706+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:09.916126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837424+0000","last_change":"2024-04-25T08:55:16.828188+0000","last_active":"2024-04-25T08:55:17.837424+0000","last_peered":"2024-04-25T08:55:17.837424+0000","last_clean":"2024-04-25T08:55:17.837424+0000","last_became_active":"2024-04-25T08:55:16.827799+0000","last_became_peered":"2024-04-25T08:55:16.827799+0000","last_unstale":"2024-04-25T08:55:17.837424+0000","last_undegraded":"2024-04-25T08:55:17.837424+0000","last_fullsized":"2024-04-25T08:55:17.837424+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:44.172513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837279+0000","last_change":"2024-04-25T08:55:16.843112+0000","last_active":"2024-04-25T08:55:17.837279+0000","last_peered":"2024-04-25T08:55:17.837279+0000","last_clean":"2024-04-25T08:55:17.837279+0000","last_became_active":"2024-04-25T08:55:16.842799+0000","last_became_peered":"2024-04-25T08:55:16.842799+0000","last_unstale":"2024-04-25T08:55:17.837279+0000","last_undegraded":"2024-04-25T08:55:17.837279+0000","last_fullsized":"2024-04-25T08:55:17.837279+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:23.800462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540545+0000","last_change":"2024-04-25T08:55:16.833189+0000","last_active":"2024-04-25T08:55:18.540545+0000","last_peered":"2024-04-25T08:55:18.540545+0000","last_clean":"2024-04-25T08:55:18.540545+0000","last_became_active":"2024-04-25T08:55:16.831963+0000","last_became_peered":"2024-04-25T08:55:16.831963+0000","last_unstale":"2024-04-25T08:55:18.540545+0000","last_undegraded":"2024-04-25T08:55:18.540545+0000","last_fullsized":"2024-04-25T08:55:18.540545+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540421+0000","last_change":"2024-04-25T08:55:16.841886+0000","last_active":"2024-04-25T08:55:18.540421+0000","last_peered":"2024-04-25T08:55:18.540421+0000","last_clean":"2024-04-25T08:55:18.540421+0000","last_became_active":"2024-04-25T08:55:16.841578+0000","last_became_peered":"2024-04-25T08:55:16.841578+0000","last_unstale":"2024-04-25T08:55:18.540421+0000","last_undegraded":"2024-04-25T08:55:18.540421+0000","last_fullsized":"2024-04-25T08:55:18.540421+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837789+0000","last_change":"2024-04-25T08:55:16.843485+0000","last_active":"2024-04-25T08:55:17.837789+0000","last_peered":"2024-04-25T08:55:17.837789+0000","last_clean":"2024-04-25T08:55:17.837789+0000","last_became_active":"2024-04-25T08:55:16.843130+0000","last_became_peered":"2024-04-25T08:55:16.843130+0000","last_unstale":"2024-04-25T08:55:17.837789+0000","last_undegraded":"2024-04-25T08:55:17.837789+0000","last_fullsized":"2024-04-25T08:55:17.837789+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:12.657487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540145+0000","last_change":"2024-04-25T08:55:16.841939+0000","last_active":"2024-04-25T08:55:18.540145+0000","last_peered":"2024-04-25T08:55:18.540145+0000","last_clean":"2024-04-25T08:55:18.540145+0000","last_became_active":"2024-04-25T08:55:16.841657+0000","last_became_peered":"2024-04-25T08:55:16.841657+0000","last_unstale":"2024-04-25T08:55:18.540145+0000","last_undegraded":"2024-04-25T08:55:18.540145+0000","last_fullsized":"2024-04-25T08:55:18.540145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:14.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837507+0000","last_change":"2024-04-25T08:55:16.821355+0000","last_active":"2024-04-25T08:55:17.837507+0000","last_peered":"2024-04-25T08:55:17.837507+0000","last_clean":"2024-04-25T08:55:17.837507+0000","last_became_active":"2024-04-25T08:55:16.821067+0000","last_became_peered":"2024-04-25T08:55:16.821067+0000","last_unstale":"2024-04-25T08:55:17.837507+0000","last_undegraded":"2024-04-25T08:55:17.837507+0000","last_fullsized":"2024-04-25T08:55:17.837507+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.333983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539859+0000","last_change":"2024-04-25T08:55:16.838547+0000","last_active":"2024-04-25T08:55:18.539859+0000","last_peered":"2024-04-25T08:55:18.539859+0000","last_clean":"2024-04-25T08:55:18.539859+0000","last_became_active":"2024-04-25T08:55:16.837583+0000","last_became_peered":"2024-04-25T08:55:16.837583+0000","last_unstale":"2024-04-25T08:55:18.539859+0000","last_undegraded":"2024-04-25T08:55:18.539859+0000","last_fullsized":"2024-04-25T08:55:18.539859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:36.671667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836896+0000","last_change":"2024-04-25T08:55:16.828541+0000","last_active":"2024-04-25T08:55:17.836896+0000","last_peered":"2024-04-25T08:55:17.836896+0000","last_clean":"2024-04-25T08:55:17.836896+0000","last_became_active":"2024-04-25T08:55:16.828068+0000","last_became_peered":"2024-04-25T08:55:16.828068+0000","last_unstale":"2024-04-25T08:55:17.836896+0000","last_undegraded":"2024-04-25T08:55:17.836896+0000","last_fullsized":"2024-04-25T08:55:17.836896+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:58.797425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837412+0000","last_change":"2024-04-25T08:55:16.828256+0000","last_active":"2024-04-25T08:55:17.837412+0000","last_peered":"2024-04-25T08:55:17.837412+0000","last_clean":"2024-04-25T08:55:17.837412+0000","last_became_active":"2024-04-25T08:55:16.827956+0000","last_became_peered":"2024-04-25T08:55:16.827956+0000","last_unstale":"2024-04-25T08:55:17.837412+0000","last_undegraded":"2024-04-25T08:55:17.837412+0000","last_fullsized":"2024-04-25T08:55:17.837412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.294126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837937+0000","last_change":"2024-04-25T08:55:16.831080+0000","last_active":"2024-04-25T08:55:17.837937+0000","last_peered":"2024-04-25T08:55:17.837937+0000","last_clean":"2024-04-25T08:55:17.837937+0000","last_became_active":"2024-04-25T08:55:16.830803+0000","last_became_peered":"2024-04-25T08:55:16.830803+0000","last_unstale":"2024-04-25T08:55:17.837937+0000","last_undegraded":"2024-04-25T08:55:17.837937+0000","last_fullsized":"2024-04-25T08:55:17.837937+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:44.216939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540190+0000","last_change":"2024-04-25T08:55:16.846495+0000","last_active":"2024-04-25T08:55:18.540190+0000","last_peered":"2024-04-25T08:55:18.540190+0000","last_clean":"2024-04-25T08:55:18.540190+0000","last_became_active":"2024-04-25T08:55:16.846097+0000","last_became_peered":"2024-04-25T08:55:16.846097+0000","last_unstale":"2024-04-25T08:55:18.540190+0000","last_undegraded":"2024-04-25T08:55:18.540190+0000","last_fullsized":"2024-04-25T08:55:18.540190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:00.833210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540297+0000","last_change":"2024-04-25T08:55:16.832406+0000","last_active":"2024-04-25T08:55:18.540297+0000","last_peered":"2024-04-25T08:55:18.540297+0000","last_clean":"2024-04-25T08:55:18.540297+0000","last_became_active":"2024-04-25T08:55:16.832117+0000","last_became_peered":"2024-04-25T08:55:16.832117+0000","last_unstale":"2024-04-25T08:55:18.540297+0000","last_undegraded":"2024-04-25T08:55:18.540297+0000","last_fullsized":"2024-04-25T08:55:18.540297+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540182+0000","last_change":"2024-04-25T08:55:16.831162+0000","last_active":"2024-04-25T08:55:18.540182+0000","last_peered":"2024-04-25T08:55:18.540182+0000","last_clean":"2024-04-25T08:55:18.540182+0000","last_became_active":"2024-04-25T08:55:16.830889+0000","last_became_peered":"2024-04-25T08:55:16.830889+0000","last_unstale":"2024-04-25T08:55:18.540182+0000","last_undegraded":"2024-04-25T08:55:18.540182+0000","last_fullsized":"2024-04-25T08:55:18.540182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836963+0000","last_change":"2024-04-25T08:55:16.829707+0000","last_active":"2024-04-25T08:55:17.836963+0000","last_peered":"2024-04-25T08:55:17.836963+0000","last_clean":"2024-04-25T08:55:17.836963+0000","last_became_active":"2024-04-25T08:55:16.829062+0000","last_became_peered":"2024-04-25T08:55:16.829062+0000","last_unstale":"2024-04-25T08:55:17.836963+0000","last_undegraded":"2024-04-25T08:55:17.836963+0000","last_fullsized":"2024-04-25T08:55:17.836963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:15.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539758+0000","last_change":"2024-04-25T08:55:16.830080+0000","last_active":"2024-04-25T08:55:18.539758+0000","last_peered":"2024-04-25T08:55:18.539758+0000","last_clean":"2024-04-25T08:55:18.539758+0000","last_became_active":"2024-04-25T08:55:16.829695+0000","last_became_peered":"2024-04-25T08:55:16.829695+0000","last_unstale":"2024-04-25T08:55:18.539758+0000","last_undegraded":"2024-04-25T08:55:18.539758+0000","last_fullsized":"2024-04-25T08:55:18.539758+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:36.671667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837487+0000","last_change":"2024-04-25T08:55:16.822654+0000","last_active":"2024-04-25T08:55:17.837487+0000","last_peered":"2024-04-25T08:55:17.837487+0000","last_clean":"2024-04-25T08:55:17.837487+0000","last_became_active":"2024-04-25T08:55:16.822381+0000","last_became_peered":"2024-04-25T08:55:16.822381+0000","last_unstale":"2024-04-25T08:55:17.837487+0000","last_undegraded":"2024-04-25T08:55:17.837487+0000","last_fullsized":"2024-04-25T08:55:17.837487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:26.668007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539713+0000","last_change":"2024-04-25T08:55:16.838404+0000","last_active":"2024-04-25T08:55:18.539713+0000","last_peered":"2024-04-25T08:55:18.539713+0000","last_clean":"2024-04-25T08:55:18.539713+0000","last_became_active":"2024-04-25T08:55:16.838105+0000","last_became_peered":"2024-04-25T08:55:16.838105+0000","last_unstale":"2024-04-25T08:55:18.539713+0000","last_undegraded":"2024-04-25T08:55:18.539713+0000","last_fullsized":"2024-04-25T08:55:18.539713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:38.008819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.804067+0000","last_change":"2024-04-25T08:55:15.804067+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.804067+0000","last_undegraded":"2024-04-25T08:55:15.804067+0000","last_fullsized":"2024-04-25T08:55:15.804067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837824+0000","last_change":"2024-04-25T08:55:15.812917+0000","last_active":"2024-04-25T08:55:17.837824+0000","last_peered":"2024-04-25T08:55:17.837824+0000","last_clean":"2024-04-25T08:55:17.837824+0000","last_became_active":"2024-04-25T08:55:15.812416+0000","last_became_peered":"2024-04-25T08:55:15.812416+0000","last_unstale":"2024-04-25T08:55:17.837824+0000","last_undegraded":"2024-04-25T08:55:17.837824+0000","last_fullsized":"2024-04-25T08:55:17.837824+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:08.909603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837905+0000","last_change":"2024-04-25T08:55:16.832501+0000","last_active":"2024-04-25T08:55:17.837905+0000","last_peered":"2024-04-25T08:55:17.837905+0000","last_clean":"2024-04-25T08:55:17.837905+0000","last_became_active":"2024-04-25T08:55:16.832159+0000","last_became_peered":"2024-04-25T08:55:16.832159+0000","last_unstale":"2024-04-25T08:55:17.837905+0000","last_undegraded":"2024-04-25T08:55:17.837905+0000","last_fullsized":"2024-04-25T08:55:17.837905+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:46.528440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540498+0000","last_change":"2024-04-25T08:55:15.804587+0000","last_active":"2024-04-25T08:55:18.540498+0000","last_peered":"2024-04-25T08:55:18.540498+0000","last_clean":"2024-04-25T08:55:18.540498+0000","last_became_active":"2024-04-25T08:55:15.802674+0000","last_became_peered":"2024-04-25T08:55:15.802674+0000","last_unstale":"2024-04-25T08:55:18.540498+0000","last_undegraded":"2024-04-25T08:55:18.540498+0000","last_fullsized":"2024-04-25T08:55:18.540498+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:14.287603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540254+0000","last_change":"2024-04-25T08:55:16.836374+0000","last_active":"2024-04-25T08:55:18.540254+0000","last_peered":"2024-04-25T08:55:18.540254+0000","last_clean":"2024-04-25T08:55:18.540254+0000","last_became_active":"2024-04-25T08:55:16.835872+0000","last_became_peered":"2024-04-25T08:55:16.835872+0000","last_unstale":"2024-04-25T08:55:18.540254+0000","last_undegraded":"2024-04-25T08:55:18.540254+0000","last_fullsized":"2024-04-25T08:55:18.540254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811418+0000","last_change":"2024-04-25T08:55:15.805969+0000","last_active":"2024-04-25T08:55:15.811418+0000","last_peered":"2024-04-25T08:55:15.811418+0000","last_clean":"2024-04-25T08:55:15.811418+0000","last_became_active":"2024-04-25T08:55:15.805679+0000","last_became_peered":"2024-04-25T08:55:15.805679+0000","last_unstale":"2024-04-25T08:55:15.811418+0000","last_undegraded":"2024-04-25T08:55:15.811418+0000","last_fullsized":"2024-04-25T08:55:15.811418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:23.227100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.803300+0000","last_change":"2024-04-25T08:55:15.803300+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.803300+0000","last_undegraded":"2024-04-25T08:55:15.803300+0000","last_fullsized":"2024-04-25T08:55:15.803300+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837602+0000","last_change":"2024-04-25T08:55:15.810287+0000","last_active":"2024-04-25T08:55:17.837602+0000","last_peered":"2024-04-25T08:55:17.837602+0000","last_clean":"2024-04-25T08:55:17.837602+0000","last_became_active":"2024-04-25T08:55:15.810000+0000","last_became_peered":"2024-04-25T08:55:15.810000+0000","last_unstale":"2024-04-25T08:55:17.837602+0000","last_undegraded":"2024-04-25T08:55:17.837602+0000","last_fullsized":"2024-04-25T08:55:17.837602+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:43.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539785+0000","last_change":"2024-04-25T08:55:16.832716+0000","last_active":"2024-04-25T08:55:18.539785+0000","last_peered":"2024-04-25T08:55:18.539785+0000","last_clean":"2024-04-25T08:55:18.539785+0000","last_became_active":"2024-04-25T08:55:16.832332+0000","last_became_peered":"2024-04-25T08:55:16.832332+0000","last_unstale":"2024-04-25T08:55:18.539785+0000","last_undegraded":"2024-04-25T08:55:18.539785+0000","last_fullsized":"2024-04-25T08:55:18.539785+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.956125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837620+0000","last_change":"2024-04-25T08:55:15.810523+0000","last_active":"2024-04-25T08:55:17.837620+0000","last_peered":"2024-04-25T08:55:17.837620+0000","last_clean":"2024-04-25T08:55:17.837620+0000","last_became_active":"2024-04-25T08:55:15.809802+0000","last_became_peered":"2024-04-25T08:55:15.809802+0000","last_unstale":"2024-04-25T08:55:17.837620+0000","last_undegraded":"2024-04-25T08:55:17.837620+0000","last_fullsized":"2024-04-25T08:55:17.837620+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.053850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540961+0000","last_change":"2024-04-25T08:55:16.841348+0000","last_active":"2024-04-25T08:55:18.540961+0000","last_peered":"2024-04-25T08:55:18.540961+0000","last_clean":"2024-04-25T08:55:18.540961+0000","last_became_active":"2024-04-25T08:55:16.840890+0000","last_became_peered":"2024-04-25T08:55:16.840890+0000","last_unstale":"2024-04-25T08:55:18.540961+0000","last_undegraded":"2024-04-25T08:55:18.540961+0000","last_fullsized":"2024-04-25T08:55:18.540961+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:36.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539863+0000","last_change":"2024-04-25T08:55:15.808364+0000","last_active":"2024-04-25T08:55:18.539863+0000","last_peered":"2024-04-25T08:55:18.539863+0000","last_clean":"2024-04-25T08:55:18.539863+0000","last_became_active":"2024-04-25T08:55:15.808068+0000","last_became_peered":"2024-04-25T08:55:15.808068+0000","last_unstale":"2024-04-25T08:55:18.539863+0000","last_undegraded":"2024-04-25T08:55:18.539863+0000","last_fullsized":"2024-04-25T08:55:18.539863+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:00.314074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539499+0000","last_change":"2024-04-25T08:55:16.840358+0000","last_active":"2024-04-25T08:55:18.539499+0000","last_peered":"2024-04-25T08:55:18.539499+0000","last_clean":"2024-04-25T08:55:18.539499+0000","last_became_active":"2024-04-25T08:55:16.837947+0000","last_became_peered":"2024-04-25T08:55:16.837947+0000","last_unstale":"2024-04-25T08:55:18.539499+0000","last_undegraded":"2024-04-25T08:55:18.539499+0000","last_fullsized":"2024-04-25T08:55:18.539499+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:25.830198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539474+0000","last_change":"2024-04-25T08:55:15.809376+0000","last_active":"2024-04-25T08:55:18.539474+0000","last_peered":"2024-04-25T08:55:18.539474+0000","last_clean":"2024-04-25T08:55:18.539474+0000","last_became_active":"2024-04-25T08:55:15.808982+0000","last_became_peered":"2024-04-25T08:55:15.808982+0000","last_unstale":"2024-04-25T08:55:18.539474+0000","last_undegraded":"2024-04-25T08:55:18.539474+0000","last_fullsized":"2024-04-25T08:55:18.539474+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:43.806513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836650+0000","last_change":"2024-04-25T08:55:16.829231+0000","last_active":"2024-04-25T08:55:17.836650+0000","last_peered":"2024-04-25T08:55:17.836650+0000","last_clean":"2024-04-25T08:55:17.836650+0000","last_became_active":"2024-04-25T08:55:16.828876+0000","last_became_peered":"2024-04-25T08:55:16.828876+0000","last_unstale":"2024-04-25T08:55:17.836650+0000","last_undegraded":"2024-04-25T08:55:17.836650+0000","last_fullsized":"2024-04-25T08:55:17.836650+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:23.778385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540129+0000","last_change":"2024-04-25T08:55:15.810673+0000","last_active":"2024-04-25T08:55:18.540129+0000","last_peered":"2024-04-25T08:55:18.540129+0000","last_clean":"2024-04-25T08:55:18.540129+0000","last_became_active":"2024-04-25T08:55:15.809289+0000","last_became_peered":"2024-04-25T08:55:15.809289+0000","last_unstale":"2024-04-25T08:55:18.540129+0000","last_undegraded":"2024-04-25T08:55:18.540129+0000","last_fullsized":"2024-04-25T08:55:18.540129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.016665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540504+0000","last_change":"2024-04-25T08:55:16.841663+0000","last_active":"2024-04-25T08:55:18.540504+0000","last_peered":"2024-04-25T08:55:18.540504+0000","last_clean":"2024-04-25T08:55:18.540504+0000","last_became_active":"2024-04-25T08:55:16.841397+0000","last_became_peered":"2024-04-25T08:55:16.841397+0000","last_unstale":"2024-04-25T08:55:18.540504+0000","last_undegraded":"2024-04-25T08:55:18.540504+0000","last_fullsized":"2024-04-25T08:55:18.540504+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540624+0000","last_change":"2024-04-25T08:55:15.808307+0000","last_active":"2024-04-25T08:55:18.540624+0000","last_peered":"2024-04-25T08:55:18.540624+0000","last_clean":"2024-04-25T08:55:18.540624+0000","last_became_active":"2024-04-25T08:55:15.808012+0000","last_became_peered":"2024-04-25T08:55:15.808012+0000","last_unstale":"2024-04-25T08:55:18.540624+0000","last_undegraded":"2024-04-25T08:55:18.540624+0000","last_fullsized":"2024-04-25T08:55:18.540624+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:11.650964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837119+0000","last_change":"2024-04-25T08:55:16.824657+0000","last_active":"2024-04-25T08:55:17.837119+0000","last_peered":"2024-04-25T08:55:17.837119+0000","last_clean":"2024-04-25T08:55:17.837119+0000","last_became_active":"2024-04-25T08:55:16.824372+0000","last_became_peered":"2024-04-25T08:55:16.824372+0000","last_unstale":"2024-04-25T08:55:17.837119+0000","last_undegraded":"2024-04-25T08:55:17.837119+0000","last_fullsized":"2024-04-25T08:55:17.837119+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541025+0000","last_change":"2024-04-25T08:55:15.808834+0000","last_active":"2024-04-25T08:55:18.541025+0000","last_peered":"2024-04-25T08:55:18.541025+0000","last_clean":"2024-04-25T08:55:18.541025+0000","last_became_active":"2024-04-25T08:55:15.808535+0000","last_became_peered":"2024-04-25T08:55:15.808535+0000","last_unstale":"2024-04-25T08:55:18.541025+0000","last_undegraded":"2024-04-25T08:55:18.541025+0000","last_fullsized":"2024-04-25T08:55:18.541025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:51.724373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837714+0000","last_change":"2024-04-25T08:55:16.829816+0000","last_active":"2024-04-25T08:55:17.837714+0000","last_peered":"2024-04-25T08:55:17.837714+0000","last_clean":"2024-04-25T08:55:17.837714+0000","last_became_active":"2024-04-25T08:55:16.829214+0000","last_became_peered":"2024-04-25T08:55:16.829214+0000","last_unstale":"2024-04-25T08:55:17.837714+0000","last_undegraded":"2024-04-25T08:55:17.837714+0000","last_fullsized":"2024-04-25T08:55:17.837714+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:34.646693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837921+0000","last_change":"2024-04-25T08:55:15.803912+0000","last_active":"2024-04-25T08:55:17.837921+0000","last_peered":"2024-04-25T08:55:17.837921+0000","last_clean":"2024-04-25T08:55:17.837921+0000","last_became_active":"2024-04-25T08:55:15.803618+0000","last_became_peered":"2024-04-25T08:55:15.803618+0000","last_unstale":"2024-04-25T08:55:17.837921+0000","last_undegraded":"2024-04-25T08:55:17.837921+0000","last_fullsized":"2024-04-25T08:55:17.837921+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:21.098215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837797+0000","last_change":"2024-04-25T08:55:16.836929+0000","last_active":"2024-04-25T08:55:17.837797+0000","last_peered":"2024-04-25T08:55:17.837797+0000","last_clean":"2024-04-25T08:55:17.837797+0000","last_became_active":"2024-04-25T08:55:16.836637+0000","last_became_peered":"2024-04-25T08:55:16.836637+0000","last_unstale":"2024-04-25T08:55:17.837797+0000","last_undegraded":"2024-04-25T08:55:17.837797+0000","last_fullsized":"2024-04-25T08:55:17.837797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:36.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540179+0000","last_change":"2024-04-25T08:55:15.804532+0000","last_active":"2024-04-25T08:55:18.540179+0000","last_peered":"2024-04-25T08:55:18.540179+0000","last_clean":"2024-04-25T08:55:18.540179+0000","last_became_active":"2024-04-25T08:55:15.804121+0000","last_became_peered":"2024-04-25T08:55:15.804121+0000","last_unstale":"2024-04-25T08:55:18.540179+0000","last_undegraded":"2024-04-25T08:55:18.540179+0000","last_fullsized":"2024-04-25T08:55:18.540179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.796101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837148+0000","last_change":"2024-04-25T08:55:16.841731+0000","last_active":"2024-04-25T08:55:17.837148+0000","last_peered":"2024-04-25T08:55:17.837148+0000","last_clean":"2024-04-25T08:55:17.837148+0000","last_became_active":"2024-04-25T08:55:16.841469+0000","last_became_peered":"2024-04-25T08:55:16.841469+0000","last_unstale":"2024-04-25T08:55:17.837148+0000","last_undegraded":"2024-04-25T08:55:17.837148+0000","last_fullsized":"2024-04-25T08:55:17.837148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:01.320597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837682+0000","last_change":"2024-04-25T08:55:15.810787+0000","last_active":"2024-04-25T08:55:17.837682+0000","last_peered":"2024-04-25T08:55:17.837682+0000","last_clean":"2024-04-25T08:55:17.837682+0000","last_became_active":"2024-04-25T08:55:15.810228+0000","last_became_peered":"2024-04-25T08:55:15.810228+0000","last_unstale":"2024-04-25T08:55:17.837682+0000","last_undegraded":"2024-04-25T08:55:17.837682+0000","last_fullsized":"2024-04-25T08:55:17.837682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:10.670548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540521+0000","last_change":"2024-04-25T08:55:16.841653+0000","last_active":"2024-04-25T08:55:18.540521+0000","last_peered":"2024-04-25T08:55:18.540521+0000","last_clean":"2024-04-25T08:55:18.540521+0000","last_became_active":"2024-04-25T08:55:16.840792+0000","last_became_peered":"2024-04-25T08:55:16.840792+0000","last_unstale":"2024-04-25T08:55:18.540521+0000","last_undegraded":"2024-04-25T08:55:18.540521+0000","last_fullsized":"2024-04-25T08:55:18.540521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837375+0000","last_change":"2024-04-25T08:55:15.809556+0000","last_active":"2024-04-25T08:55:17.837375+0000","last_peered":"2024-04-25T08:55:17.837375+0000","last_clean":"2024-04-25T08:55:17.837375+0000","last_became_active":"2024-04-25T08:55:15.809080+0000","last_became_peered":"2024-04-25T08:55:15.809080+0000","last_unstale":"2024-04-25T08:55:17.837375+0000","last_undegraded":"2024-04-25T08:55:17.837375+0000","last_fullsized":"2024-04-25T08:55:17.837375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:25.637156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837378+0000","last_change":"2024-04-25T08:55:16.829568+0000","last_active":"2024-04-25T08:55:17.837378+0000","last_peered":"2024-04-25T08:55:17.837378+0000","last_clean":"2024-04-25T08:55:17.837378+0000","last_became_active":"2024-04-25T08:55:16.829248+0000","last_became_peered":"2024-04-25T08:55:16.829248+0000","last_unstale":"2024-04-25T08:55:17.837378+0000","last_undegraded":"2024-04-25T08:55:17.837378+0000","last_fullsized":"2024-04-25T08:55:17.837378+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:56.165607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837529+0000","last_change":"2024-04-25T08:55:15.812602+0000","last_active":"2024-04-25T08:55:17.837529+0000","last_peered":"2024-04-25T08:55:17.837529+0000","last_clean":"2024-04-25T08:55:17.837529+0000","last_became_active":"2024-04-25T08:55:15.812277+0000","last_became_peered":"2024-04-25T08:55:15.812277+0000","last_unstale":"2024-04-25T08:55:17.837529+0000","last_undegraded":"2024-04-25T08:55:17.837529+0000","last_fullsized":"2024-04-25T08:55:17.837529+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:15.861856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837530+0000","last_change":"2024-04-25T08:55:16.828073+0000","last_active":"2024-04-25T08:55:17.837530+0000","last_peered":"2024-04-25T08:55:17.837530+0000","last_clean":"2024-04-25T08:55:17.837530+0000","last_became_active":"2024-04-25T08:55:16.827811+0000","last_became_peered":"2024-04-25T08:55:16.827811+0000","last_unstale":"2024-04-25T08:55:17.837530+0000","last_undegraded":"2024-04-25T08:55:17.837530+0000","last_fullsized":"2024-04-25T08:55:17.837530+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539870+0000","last_change":"2024-04-25T08:55:15.809552+0000","last_active":"2024-04-25T08:55:18.539870+0000","last_peered":"2024-04-25T08:55:18.539870+0000","last_clean":"2024-04-25T08:55:18.539870+0000","last_became_active":"2024-04-25T08:55:15.809065+0000","last_became_peered":"2024-04-25T08:55:15.809065+0000","last_unstale":"2024-04-25T08:55:18.539870+0000","last_undegraded":"2024-04-25T08:55:18.539870+0000","last_fullsized":"2024-04-25T08:55:18.539870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:36.553413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540362+0000","last_change":"2024-04-25T08:55:16.833303+0000","last_active":"2024-04-25T08:55:18.540362+0000","last_peered":"2024-04-25T08:55:18.540362+0000","last_clean":"2024-04-25T08:55:18.540362+0000","last_became_active":"2024-04-25T08:55:16.832435+0000","last_became_peered":"2024-04-25T08:55:16.832435+0000","last_unstale":"2024-04-25T08:55:18.540362+0000","last_undegraded":"2024-04-25T08:55:18.540362+0000","last_fullsized":"2024-04-25T08:55:18.540362+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:15.812095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541163+0000","last_change":"2024-04-25T08:55:15.806916+0000","last_active":"2024-04-25T08:55:18.541163+0000","last_peered":"2024-04-25T08:55:18.541163+0000","last_clean":"2024-04-25T08:55:18.541163+0000","last_became_active":"2024-04-25T08:55:15.806584+0000","last_became_peered":"2024-04-25T08:55:15.806584+0000","last_unstale":"2024-04-25T08:55:18.541163+0000","last_undegraded":"2024-04-25T08:55:18.541163+0000","last_fullsized":"2024-04-25T08:55:18.541163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:52.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540974+0000","last_change":"2024-04-25T08:55:16.846605+0000","last_active":"2024-04-25T08:55:18.540974+0000","last_peered":"2024-04-25T08:55:18.540974+0000","last_clean":"2024-04-25T08:55:18.540974+0000","last_became_active":"2024-04-25T08:55:16.846304+0000","last_became_peered":"2024-04-25T08:55:16.846304+0000","last_unstale":"2024-04-25T08:55:18.540974+0000","last_undegraded":"2024-04-25T08:55:18.540974+0000","last_fullsized":"2024-04-25T08:55:18.540974+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540594+0000","last_change":"2024-04-25T08:55:15.806841+0000","last_active":"2024-04-25T08:55:18.540594+0000","last_peered":"2024-04-25T08:55:18.540594+0000","last_clean":"2024-04-25T08:55:18.540594+0000","last_became_active":"2024-04-25T08:55:15.806563+0000","last_became_peered":"2024-04-25T08:55:15.806563+0000","last_unstale":"2024-04-25T08:55:18.540594+0000","last_undegraded":"2024-04-25T08:55:18.540594+0000","last_fullsized":"2024-04-25T08:55:18.540594+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:19.717985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837109+0000","last_change":"2024-04-25T08:55:16.838841+0000","last_active":"2024-04-25T08:55:17.837109+0000","last_peered":"2024-04-25T08:55:17.837109+0000","last_clean":"2024-04-25T08:55:17.837109+0000","last_became_active":"2024-04-25T08:55:16.838592+0000","last_became_peered":"2024-04-25T08:55:16.838592+0000","last_unstale":"2024-04-25T08:55:17.837109+0000","last_undegraded":"2024-04-25T08:55:17.837109+0000","last_fullsized":"2024-04-25T08:55:17.837109+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:16.953838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540102+0000","last_change":"2024-04-25T08:55:15.809119+0000","last_active":"2024-04-25T08:55:18.540102+0000","last_peered":"2024-04-25T08:55:18.540102+0000","last_clean":"2024-04-25T08:55:18.540102+0000","last_became_active":"2024-04-25T08:55:15.808770+0000","last_became_peered":"2024-04-25T08:55:15.808770+0000","last_unstale":"2024-04-25T08:55:18.540102+0000","last_undegraded":"2024-04-25T08:55:18.540102+0000","last_fullsized":"2024-04-25T08:55:18.540102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:25.637156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837451+0000","last_change":"2024-04-25T08:55:16.831158+0000","last_active":"2024-04-25T08:55:17.837451+0000","last_peered":"2024-04-25T08:55:17.837451+0000","last_clean":"2024-04-25T08:55:17.837451+0000","last_became_active":"2024-04-25T08:55:16.830883+0000","last_became_peered":"2024-04-25T08:55:16.830883+0000","last_unstale":"2024-04-25T08:55:17.837451+0000","last_undegraded":"2024-04-25T08:55:17.837451+0000","last_fullsized":"2024-04-25T08:55:17.837451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:20.724508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837803+0000","last_change":"2024-04-25T08:55:15.811663+0000","last_active":"2024-04-25T08:55:17.837803+0000","last_peered":"2024-04-25T08:55:17.837803+0000","last_clean":"2024-04-25T08:55:17.837803+0000","last_became_active":"2024-04-25T08:55:15.811372+0000","last_became_peered":"2024-04-25T08:55:15.811372+0000","last_unstale":"2024-04-25T08:55:17.837803+0000","last_undegraded":"2024-04-25T08:55:17.837803+0000","last_fullsized":"2024-04-25T08:55:17.837803+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:00.529017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837681+0000","last_change":"2024-04-25T08:55:16.830366+0000","last_active":"2024-04-25T08:55:17.837681+0000","last_peered":"2024-04-25T08:55:17.837681+0000","last_clean":"2024-04-25T08:55:17.837681+0000","last_became_active":"2024-04-25T08:55:16.830101+0000","last_became_peered":"2024-04-25T08:55:16.830101+0000","last_unstale":"2024-04-25T08:55:17.837681+0000","last_undegraded":"2024-04-25T08:55:17.837681+0000","last_fullsized":"2024-04-25T08:55:17.837681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:56.842647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837784+0000","last_change":"2024-04-25T08:55:15.811103+0000","last_active":"2024-04-25T08:55:17.837784+0000","last_peered":"2024-04-25T08:55:17.837784+0000","last_clean":"2024-04-25T08:55:17.837784+0000","last_became_active":"2024-04-25T08:55:15.810409+0000","last_became_peered":"2024-04-25T08:55:15.810409+0000","last_unstale":"2024-04-25T08:55:17.837784+0000","last_undegraded":"2024-04-25T08:55:17.837784+0000","last_fullsized":"2024-04-25T08:55:17.837784+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:35.665144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.802692+0000","last_change":"2024-04-25T08:55:15.802692+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.802692+0000","last_undegraded":"2024-04-25T08:55:15.802692+0000","last_fullsized":"2024-04-25T08:55:15.802692+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539589+0000","last_change":"2024-04-25T08:55:15.808197+0000","last_active":"2024-04-25T08:55:18.539589+0000","last_peered":"2024-04-25T08:55:18.539589+0000","last_clean":"2024-04-25T08:55:18.539589+0000","last_became_active":"2024-04-25T08:55:15.806676+0000","last_became_peered":"2024-04-25T08:55:15.806676+0000","last_unstale":"2024-04-25T08:55:18.539589+0000","last_undegraded":"2024-04-25T08:55:18.539589+0000","last_fullsized":"2024-04-25T08:55:18.539589+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:21.098215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539986+0000","last_change":"2024-04-25T08:55:16.829187+0000","last_active":"2024-04-25T08:55:18.539986+0000","last_peered":"2024-04-25T08:55:18.539986+0000","last_clean":"2024-04-25T08:55:18.539986+0000","last_became_active":"2024-04-25T08:55:16.828772+0000","last_became_peered":"2024-04-25T08:55:16.828772+0000","last_unstale":"2024-04-25T08:55:18.539986+0000","last_undegraded":"2024-04-25T08:55:18.539986+0000","last_fullsized":"2024-04-25T08:55:18.539986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:29.403892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539546+0000","last_change":"2024-04-25T08:55:15.810669+0000","last_active":"2024-04-25T08:55:18.539546+0000","last_peered":"2024-04-25T08:55:18.539546+0000","last_clean":"2024-04-25T08:55:18.539546+0000","last_became_active":"2024-04-25T08:55:15.810364+0000","last_became_peered":"2024-04-25T08:55:15.810364+0000","last_unstale":"2024-04-25T08:55:18.539546+0000","last_undegraded":"2024-04-25T08:55:18.539546+0000","last_fullsized":"2024-04-25T08:55:18.539546+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:39.011045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539570+0000","last_change":"2024-04-25T08:55:16.844563+0000","last_active":"2024-04-25T08:55:18.539570+0000","last_peered":"2024-04-25T08:55:18.539570+0000","last_clean":"2024-04-25T08:55:18.539570+0000","last_became_active":"2024-04-25T08:55:16.844276+0000","last_became_peered":"2024-04-25T08:55:16.844276+0000","last_unstale":"2024-04-25T08:55:18.539570+0000","last_undegraded":"2024-04-25T08:55:18.539570+0000","last_fullsized":"2024-04-25T08:55:18.539570+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:36.060373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837697+0000","last_change":"2024-04-25T08:55:15.810567+0000","last_active":"2024-04-25T08:55:17.837697+0000","last_peered":"2024-04-25T08:55:17.837697+0000","last_clean":"2024-04-25T08:55:17.837697+0000","last_became_active":"2024-04-25T08:55:15.809948+0000","last_became_peered":"2024-04-25T08:55:15.809948+0000","last_unstale":"2024-04-25T08:55:17.837697+0000","last_undegraded":"2024-04-25T08:55:17.837697+0000","last_fullsized":"2024-04-25T08:55:17.837697+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.053850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.838063+0000","last_change":"2024-04-25T08:55:16.842345+0000","last_active":"2024-04-25T08:55:17.838063+0000","last_peered":"2024-04-25T08:55:17.838063+0000","last_clean":"2024-04-25T08:55:17.838063+0000","last_became_active":"2024-04-25T08:55:16.841261+0000","last_became_peered":"2024-04-25T08:55:16.841261+0000","last_unstale":"2024-04-25T08:55:17.838063+0000","last_undegraded":"2024-04-25T08:55:17.838063+0000","last_fullsized":"2024-04-25T08:55:17.838063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:44.813036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837927+0000","last_change":"2024-04-25T08:55:15.810587+0000","last_active":"2024-04-25T08:55:17.837927+0000","last_peered":"2024-04-25T08:55:17.837927+0000","last_clean":"2024-04-25T08:55:17.837927+0000","last_became_active":"2024-04-25T08:55:15.810279+0000","last_became_peered":"2024-04-25T08:55:15.810279+0000","last_unstale":"2024-04-25T08:55:17.837927+0000","last_undegraded":"2024-04-25T08:55:17.837927+0000","last_fullsized":"2024-04-25T08:55:17.837927+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:02.949602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540495+0000","last_change":"2024-04-25T08:55:16.845748+0000","last_active":"2024-04-25T08:55:18.540495+0000","last_peered":"2024-04-25T08:55:18.540495+0000","last_clean":"2024-04-25T08:55:18.540495+0000","last_became_active":"2024-04-25T08:55:16.845270+0000","last_became_peered":"2024-04-25T08:55:16.845270+0000","last_unstale":"2024-04-25T08:55:18.540495+0000","last_undegraded":"2024-04-25T08:55:18.540495+0000","last_fullsized":"2024-04-25T08:55:18.540495+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837918+0000","last_change":"2024-04-25T08:55:15.808197+0000","last_active":"2024-04-25T08:55:17.837918+0000","last_peered":"2024-04-25T08:55:17.837918+0000","last_clean":"2024-04-25T08:55:17.837918+0000","last_became_active":"2024-04-25T08:55:15.807712+0000","last_became_peered":"2024-04-25T08:55:15.807712+0000","last_unstale":"2024-04-25T08:55:17.837918+0000","last_undegraded":"2024-04-25T08:55:17.837918+0000","last_fullsized":"2024-04-25T08:55:17.837918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:24.823675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837799+0000","last_change":"2024-04-25T08:55:16.829720+0000","last_active":"2024-04-25T08:55:17.837799+0000","last_peered":"2024-04-25T08:55:17.837799+0000","last_clean":"2024-04-25T08:55:17.837799+0000","last_became_active":"2024-04-25T08:55:16.829479+0000","last_became_peered":"2024-04-25T08:55:16.829479+0000","last_unstale":"2024-04-25T08:55:17.837799+0000","last_undegraded":"2024-04-25T08:55:17.837799+0000","last_fullsized":"2024-04-25T08:55:17.837799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811361+0000","last_change":"2024-04-25T08:55:15.805828+0000","last_active":"2024-04-25T08:55:15.811361+0000","last_peered":"2024-04-25T08:55:15.811361+0000","last_clean":"2024-04-25T08:55:15.811361+0000","last_became_active":"2024-04-25T08:55:15.805528+0000","last_became_peered":"2024-04-25T08:55:15.805528+0000","last_unstale":"2024-04-25T08:55:15.811361+0000","last_undegraded":"2024-04-25T08:55:15.811361+0000","last_fullsized":"2024-04-25T08:55:15.811361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:27.984110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837868+0000","last_change":"2024-04-25T08:55:16.828363+0000","last_active":"2024-04-25T08:55:17.837868+0000","last_peered":"2024-04-25T08:55:17.837868+0000","last_clean":"2024-04-25T08:55:17.837868+0000","last_became_active":"2024-04-25T08:55:16.825857+0000","last_became_peered":"2024-04-25T08:55:16.825857+0000","last_unstale":"2024-04-25T08:55:17.837868+0000","last_undegraded":"2024-04-25T08:55:17.837868+0000","last_fullsized":"2024-04-25T08:55:17.837868+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:31.555032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837553+0000","last_change":"2024-04-25T08:55:15.804862+0000","last_active":"2024-04-25T08:55:17.837553+0000","last_peered":"2024-04-25T08:55:17.837553+0000","last_clean":"2024-04-25T08:55:17.837553+0000","last_became_active":"2024-04-25T08:55:15.804575+0000","last_became_peered":"2024-04-25T08:55:15.804575+0000","last_unstale":"2024-04-25T08:55:17.837553+0000","last_undegraded":"2024-04-25T08:55:17.837553+0000","last_fullsized":"2024-04-25T08:55:17.837553+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:43.806513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837565+0000","last_change":"2024-04-25T08:55:16.830603+0000","last_active":"2024-04-25T08:55:17.837565+0000","last_peered":"2024-04-25T08:55:17.837565+0000","last_clean":"2024-04-25T08:55:17.837565+0000","last_became_active":"2024-04-25T08:55:16.830277+0000","last_became_peered":"2024-04-25T08:55:16.830277+0000","last_unstale":"2024-04-25T08:55:17.837565+0000","last_undegraded":"2024-04-25T08:55:17.837565+0000","last_fullsized":"2024-04-25T08:55:17.837565+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:29.707648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539870+0000","last_change":"2024-04-25T08:55:15.810936+0000","last_active":"2024-04-25T08:55:18.539870+0000","last_peered":"2024-04-25T08:55:18.539870+0000","last_clean":"2024-04-25T08:55:18.539870+0000","last_became_active":"2024-04-25T08:55:15.810469+0000","last_became_peered":"2024-04-25T08:55:15.810469+0000","last_unstale":"2024-04-25T08:55:18.539870+0000","last_undegraded":"2024-04-25T08:55:18.539870+0000","last_fullsized":"2024-04-25T08:55:18.539870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:22.793939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539713+0000","last_change":"2024-04-25T08:55:16.820981+0000","last_active":"2024-04-25T08:55:18.539713+0000","last_peered":"2024-04-25T08:55:18.539713+0000","last_clean":"2024-04-25T08:55:18.539713+0000","last_became_active":"2024-04-25T08:55:16.820654+0000","last_became_peered":"2024-04-25T08:55:16.820654+0000","last_unstale":"2024-04-25T08:55:18.539713+0000","last_undegraded":"2024-04-25T08:55:18.539713+0000","last_fullsized":"2024-04-25T08:55:18.539713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811393+0000","last_change":"2024-04-25T08:55:15.806700+0000","last_active":"2024-04-25T08:55:15.811393+0000","last_peered":"2024-04-25T08:55:15.811393+0000","last_clean":"2024-04-25T08:55:15.811393+0000","last_became_active":"2024-04-25T08:55:15.806407+0000","last_became_peered":"2024-04-25T08:55:15.806407+0000","last_unstale":"2024-04-25T08:55:15.811393+0000","last_undegraded":"2024-04-25T08:55:15.811393+0000","last_fullsized":"2024-04-25T08:55:15.811393+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:58.012479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539725+0000","last_change":"2024-04-25T08:55:16.843737+0000","last_active":"2024-04-25T08:55:18.539725+0000","last_peered":"2024-04-25T08:55:18.539725+0000","last_clean":"2024-04-25T08:55:18.539725+0000","last_became_active":"2024-04-25T08:55:16.843213+0000","last_became_peered":"2024-04-25T08:55:16.843213+0000","last_unstale":"2024-04-25T08:55:18.539725+0000","last_undegraded":"2024-04-25T08:55:18.539725+0000","last_fullsized":"2024-04-25T08:55:18.539725+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:09.916126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540000+0000","last_change":"2024-04-25T08:55:15.810186+0000","last_active":"2024-04-25T08:55:18.540000+0000","last_peered":"2024-04-25T08:55:18.540000+0000","last_clean":"2024-04-25T08:55:18.540000+0000","last_became_active":"2024-04-25T08:55:15.809881+0000","last_became_peered":"2024-04-25T08:55:15.809881+0000","last_unstale":"2024-04-25T08:55:18.540000+0000","last_undegraded":"2024-04-25T08:55:18.540000+0000","last_fullsized":"2024-04-25T08:55:18.540000+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:14.805572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540870+0000","last_change":"2024-04-25T08:55:16.840505+0000","last_active":"2024-04-25T08:55:18.540870+0000","last_peered":"2024-04-25T08:55:18.540870+0000","last_clean":"2024-04-25T08:55:18.540870+0000","last_became_active":"2024-04-25T08:55:16.837418+0000","last_became_peered":"2024-04-25T08:55:16.837418+0000","last_unstale":"2024-04-25T08:55:18.540870+0000","last_undegraded":"2024-04-25T08:55:18.540870+0000","last_fullsized":"2024-04-25T08:55:18.540870+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540226+0000","last_change":"2024-04-25T08:55:15.815889+0000","last_active":"2024-04-25T08:55:18.540226+0000","last_peered":"2024-04-25T08:55:18.540226+0000","last_clean":"2024-04-25T08:55:18.540226+0000","last_became_active":"2024-04-25T08:55:15.815594+0000","last_became_peered":"2024-04-25T08:55:15.815594+0000","last_unstale":"2024-04-25T08:55:18.540226+0000","last_undegraded":"2024-04-25T08:55:18.540226+0000","last_fullsized":"2024-04-25T08:55:18.540226+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:43.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":214,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837683+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:55:17.837683+0000","last_peered":"2024-04-25T08:55:17.837683+0000","last_clean":"2024-04-25T08:55:17.837683+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:55:17.837683+0000","last_undegraded":"2024-04-25T08:55:17.837683+0000","last_fullsized":"2024-04-25T08:55:17.837683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1142784,"data_stored":810559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":220773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":220171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":557056,"data_stored":221713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":220739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":221735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1142784,"data_stored":810503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":520192,"data_stored":207026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:55:21.175 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:55:21.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.324+0000 7fd9285d5640 1 Processor -- start 2024-04-25T08:55:21.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.324+0000 7fd9285d5640 1 -- start start 2024-04-25T08:55:21.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.325+0000 7fd9285d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200ccdc0 0x7fd9200722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.325+0000 7fd9285d5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd9200727e0 0x7fd92015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.325+0000 7fd9285d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9200cd2c0 con 0x7fd920144450 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.325+0000 7fd9285d5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9200cdb60 con 0x7fd9200727e0 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.325+0000 7fd9285d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9200cd5a0 con 0x7fd9200ccdc0 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.325+0000 7fd926371640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd920144450 0x7fd9200c7080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50864/0 (socket says 172.21.15.55:50864) 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.325+0000 7fd926371640 1 -- 172.21.15.55:0/1557404043 learned_addr learned my addr 172.21.15.55:0/1557404043 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.326+0000 7fd925b70640 1 --2- 172.21.15.55:0/1557404043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200ccdc0 0x7fd9200722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.326+0000 7fd926b72640 1 --2- 172.21.15.55:0/1557404043 >> v2:172.21.15.167:3300/0 conn(0x7fd9200727e0 0x7fd92015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.326+0000 7fd92536f640 1 -- 172.21.15.55:0/1557404043 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255307349 0 0) 0x7fd9200cd2c0 con 0x7fd920144450 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.326+0000 7fd92536f640 1 -- 172.21.15.55:0/1557404043 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd908003520 con 0x7fd920144450 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.326+0000 7fd92536f640 1 -- 172.21.15.55:0/1557404043 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1799866992 0 0) 0x7fd908003520 con 0x7fd920144450 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.326+0000 7fd925b70640 1 -- 172.21.15.55:0/1557404043 >> v2:172.21.15.167:3300/0 conn(0x7fd9200727e0 msgr2=0x7fd92015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.326+0000 7fd925b70640 1 --2- 172.21.15.55:0/1557404043 >> v2:172.21.15.167:3300/0 conn(0x7fd9200727e0 0x7fd92015eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.326+0000 7fd925b70640 1 -- 172.21.15.55:0/1557404043 >> v1:172.21.15.55:6789/0 conn(0x7fd920144450 legacy=0x7fd9200c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.326+0000 7fd925b70640 1 -- 172.21.15.55:0/1557404043 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9200cd880 con 0x7fd9200ccdc0 2024-04-25T08:55:21.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.326+0000 7fd926b72640 1 --2- 172.21.15.55:0/1557404043 >> v2:172.21.15.167:3300/0 conn(0x7fd9200727e0 0x7fd92015eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:55:21.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.327+0000 7fd925b70640 1 --2- 172.21.15.55:0/1557404043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200ccdc0 0x7fd9200722a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd9140097d0 tx=0x7fd91402a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0e22b743da0a457 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:21.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.327+0000 7fd92536f640 1 -- 172.21.15.55:0/1557404043 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd914037070 con 0x7fd9200ccdc0 2024-04-25T08:55:21.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.327+0000 7fd92536f640 1 -- 172.21.15.55:0/1557404043 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91402ab40 con 0x7fd9200ccdc0 2024-04-25T08:55:21.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.327+0000 7fd92536f640 1 -- 172.21.15.55:0/1557404043 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918001670 con 0x7fd9200ccdc0 2024-04-25T08:55:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.327+0000 7fd9285d5640 1 -- 172.21.15.55:0/1557404043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200ccdc0 msgr2=0x7fd9200722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.327+0000 7fd9285d5640 1 --2- 172.21.15.55:0/1557404043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200ccdc0 0x7fd9200722a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd9140097d0 tx=0x7fd91402a0b0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.327+0000 7fd9285d5640 1 -- 172.21.15.55:0/1557404043 shutdown_connections 2024-04-25T08:55:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.327+0000 7fd9285d5640 1 --2- 172.21.15.55:0/1557404043 >> v2:172.21.15.167:3300/0 conn(0x7fd9200727e0 0x7fd92015eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.327+0000 7fd9285d5640 1 --2- 172.21.15.55:0/1557404043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200ccdc0 0x7fd9200722a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.328+0000 7fd9285d5640 1 -- 172.21.15.55:0/1557404043 >> 172.21.15.55:0/1557404043 conn(0x7fd9200b2370 msgr2=0x7fd9200b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.328+0000 7fd9285d5640 1 -- 172.21.15.55:0/1557404043 shutdown_connections 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.328+0000 7fd9285d5640 1 -- 172.21.15.55:0/1557404043 wait complete. 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.329+0000 7fd9285d5640 1 Processor -- start 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.329+0000 7fd9285d5640 1 -- start start 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.329+0000 7fd9285d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200727e0 0x7fd9201599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.329+0000 7fd9285d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9200ccdc0 0x7fd9201391d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.329+0000 7fd9285d5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd920144450 0x7fd92013c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.329+0000 7fd9285d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92015f160 con 0x7fd9200ccdc0 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.329+0000 7fd9285d5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92015efe0 con 0x7fd920144450 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.329+0000 7fd9285d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92015f2e0 con 0x7fd9200727e0 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd925b70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9200ccdc0 0x7fd9201391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd925b70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9200ccdc0 0x7fd9201391d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42460/0 (socket says 172.21.15.55:42460) 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd925b70640 1 -- 172.21.15.55:0/879663271 learned_addr learned my addr 172.21.15.55:0/879663271 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd926b72640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd920144450 0x7fd92013c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd926371640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200727e0 0x7fd9201599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd925b70640 1 -- 172.21.15.55:0/879663271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200727e0 msgr2=0x7fd9201599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd925b70640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200727e0 0x7fd9201599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd925b70640 1 -- 172.21.15.55:0/879663271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd920144450 msgr2=0x7fd92013c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd925b70640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd920144450 0x7fd92013c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd925b70640 1 -- 172.21.15.55:0/879663271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd920159f10 con 0x7fd9200ccdc0 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd926371640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200727e0 0x7fd9201599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd925b70640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9200ccdc0 0x7fd9201391d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd91402a6a0 tx=0x7fd9140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd91effd640 1 -- 172.21.15.55:0/879663271 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd914041020 con 0x7fd9200ccdc0 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd91effd640 1 -- 172.21.15.55:0/879663271 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91403d620 con 0x7fd9200ccdc0 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd91effd640 1 -- 172.21.15.55:0/879663271 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd914037040 con 0x7fd9200ccdc0 2024-04-25T08:55:21.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd9285d5640 1 -- 172.21.15.55:0/879663271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd920139ab0 con 0x7fd9200ccdc0 2024-04-25T08:55:21.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.330+0000 7fd9285d5640 1 -- 172.21.15.55:0/879663271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92013a070 con 0x7fd9200ccdc0 2024-04-25T08:55:21.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.331+0000 7fd9285d5640 1 -- 172.21.15.55:0/879663271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9200749b0 con 0x7fd9200ccdc0 2024-04-25T08:55:21.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.332+0000 7fd91effd640 1 -- 172.21.15.55:0/879663271 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd914044020 con 0x7fd9200ccdc0 2024-04-25T08:55:21.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.332+0000 7fd91effd640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd90c06b4d0 0x7fd90c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.332+0000 7fd91effd640 1 -- 172.21.15.55:0/879663271 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9140aa690 con 0x7fd9200ccdc0 2024-04-25T08:55:21.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.332+0000 7fd926371640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd90c06b4d0 0x7fd90c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.333+0000 7fd926371640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd90c06b4d0 0x7fd90c06d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd918005880 tx=0x7fd918009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:21.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.336+0000 7fd91effd640 1 -- 172.21.15.55:0/879663271 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd91404b030 con 0x7fd9200ccdc0 2024-04-25T08:55:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.514+0000 7fd9285d5640 1 -- 172.21.15.55:0/879663271 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd92006fb80 con 0x7fd90c06b4d0 2024-04-25T08:55:21.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.520+0000 7fd91effd640 1 -- 172.21.15.55:0/879663271 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251706 (secure 0 0 0) 0x7fd92006fb80 con 0x7fd90c06b4d0 2024-04-25T08:55:21.513 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:55:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.523+0000 7fd9285d5640 1 -- 172.21.15.55:0/879663271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd90c06b4d0 msgr2=0x7fd90c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.523+0000 7fd9285d5640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd90c06b4d0 0x7fd90c06d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd918005880 tx=0x7fd918009040 comp rx=0 tx=0).stop 2024-04-25T08:55:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.523+0000 7fd9285d5640 1 -- 172.21.15.55:0/879663271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9200ccdc0 msgr2=0x7fd9201391d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.523+0000 7fd9285d5640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9200ccdc0 0x7fd9201391d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd91402a6a0 tx=0x7fd9140046c0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.523+0000 7fd9285d5640 1 -- 172.21.15.55:0/879663271 shutdown_connections 2024-04-25T08:55:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.523+0000 7fd9285d5640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd90c06b4d0 0x7fd90c06d990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.523+0000 7fd9285d5640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd920144450 0x7fd92013c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.523+0000 7fd9285d5640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9200ccdc0 0x7fd9201391d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.524+0000 7fd9285d5640 1 --2- 172.21.15.55:0/879663271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9200727e0 0x7fd9201599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.524+0000 7fd9285d5640 1 -- 172.21.15.55:0/879663271 >> 172.21.15.55:0/879663271 conn(0x7fd9200b2370 msgr2=0x7fd9200b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.524+0000 7fd9285d5640 1 -- 172.21.15.55:0/879663271 shutdown_connections 2024-04-25T08:55:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.524+0000 7fd9285d5640 1 -- 172.21.15.55:0/879663271 wait complete. 2024-04-25T08:55:21.524 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-04-25T08:55:20.571126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238272,"kb_used_data":5452,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736448,"statfs":{"total":773094113280,"available":772850122752,"internally_reserved":0,"allocated":5582848,"data_stored":2933219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.785197"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836959+0000","last_change":"2024-04-25T08:55:16.832561+0000","last_active":"2024-04-25T08:55:17.836959+0000","last_peered":"2024-04-25T08:55:17.836959+0000","last_clean":"2024-04-25T08:55:17.836959+0000","last_became_active":"2024-04-25T08:55:16.832224+0000","last_became_peered":"2024-04-25T08:55:16.832224+0000","last_unstale":"2024-04-25T08:55:17.836959+0000","last_undegraded":"2024-04-25T08:55:17.836959+0000","last_fullsized":"2024-04-25T08:55:17.836959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540207+0000","last_change":"2024-04-25T08:55:16.842805+0000","last_active":"2024-04-25T08:55:18.540207+0000","last_peered":"2024-04-25T08:55:18.540207+0000","last_clean":"2024-04-25T08:55:18.540207+0000","last_became_active":"2024-04-25T08:55:16.842348+0000","last_became_peered":"2024-04-25T08:55:16.842348+0000","last_unstale":"2024-04-25T08:55:18.540207+0000","last_undegraded":"2024-04-25T08:55:18.540207+0000","last_fullsized":"2024-04-25T08:55:18.540207+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539800+0000","last_change":"2024-04-25T08:55:16.829363+0000","last_active":"2024-04-25T08:55:18.539800+0000","last_peered":"2024-04-25T08:55:18.539800+0000","last_clean":"2024-04-25T08:55:18.539800+0000","last_became_active":"2024-04-25T08:55:16.828941+0000","last_became_peered":"2024-04-25T08:55:16.828941+0000","last_unstale":"2024-04-25T08:55:18.539800+0000","last_undegraded":"2024-04-25T08:55:18.539800+0000","last_fullsized":"2024-04-25T08:55:18.539800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540318+0000","last_change":"2024-04-25T08:55:16.841043+0000","last_active":"2024-04-25T08:55:18.540318+0000","last_peered":"2024-04-25T08:55:18.540318+0000","last_clean":"2024-04-25T08:55:18.540318+0000","last_became_active":"2024-04-25T08:55:16.838610+0000","last_became_peered":"2024-04-25T08:55:16.838610+0000","last_unstale":"2024-04-25T08:55:18.540318+0000","last_undegraded":"2024-04-25T08:55:18.540318+0000","last_fullsized":"2024-04-25T08:55:18.540318+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539972+0000","last_change":"2024-04-25T08:55:16.843435+0000","last_active":"2024-04-25T08:55:18.539972+0000","last_peered":"2024-04-25T08:55:18.539972+0000","last_clean":"2024-04-25T08:55:18.539972+0000","last_became_active":"2024-04-25T08:55:16.842897+0000","last_became_peered":"2024-04-25T08:55:16.842897+0000","last_unstale":"2024-04-25T08:55:18.539972+0000","last_undegraded":"2024-04-25T08:55:18.539972+0000","last_fullsized":"2024-04-25T08:55:18.539972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837578+0000","last_change":"2024-04-25T08:55:16.826490+0000","last_active":"2024-04-25T08:55:17.837578+0000","last_peered":"2024-04-25T08:55:17.837578+0000","last_clean":"2024-04-25T08:55:17.837578+0000","last_became_active":"2024-04-25T08:55:16.826201+0000","last_became_peered":"2024-04-25T08:55:16.826201+0000","last_unstale":"2024-04-25T08:55:17.837578+0000","last_undegraded":"2024-04-25T08:55:17.837578+0000","last_fullsized":"2024-04-25T08:55:17.837578+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:34.683007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837295+0000","last_change":"2024-04-25T08:55:16.829027+0000","last_active":"2024-04-25T08:55:17.837295+0000","last_peered":"2024-04-25T08:55:17.837295+0000","last_clean":"2024-04-25T08:55:17.837295+0000","last_became_active":"2024-04-25T08:55:16.828724+0000","last_became_peered":"2024-04-25T08:55:16.828724+0000","last_unstale":"2024-04-25T08:55:17.837295+0000","last_undegraded":"2024-04-25T08:55:17.837295+0000","last_fullsized":"2024-04-25T08:55:17.837295+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539748+0000","last_change":"2024-04-25T08:55:16.840752+0000","last_active":"2024-04-25T08:55:18.539748+0000","last_peered":"2024-04-25T08:55:18.539748+0000","last_clean":"2024-04-25T08:55:18.539748+0000","last_became_active":"2024-04-25T08:55:16.838830+0000","last_became_peered":"2024-04-25T08:55:16.838830+0000","last_unstale":"2024-04-25T08:55:18.539748+0000","last_undegraded":"2024-04-25T08:55:18.539748+0000","last_fullsized":"2024-04-25T08:55:18.539748+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:11.677071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540796+0000","last_change":"2024-04-25T08:55:16.840080+0000","last_active":"2024-04-25T08:55:18.540796+0000","last_peered":"2024-04-25T08:55:18.540796+0000","last_clean":"2024-04-25T08:55:18.540796+0000","last_became_active":"2024-04-25T08:55:16.837974+0000","last_became_peered":"2024-04-25T08:55:16.837974+0000","last_unstale":"2024-04-25T08:55:18.540796+0000","last_undegraded":"2024-04-25T08:55:18.540796+0000","last_fullsized":"2024-04-25T08:55:18.540796+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540698+0000","last_change":"2024-04-25T08:55:16.838746+0000","last_active":"2024-04-25T08:55:18.540698+0000","last_peered":"2024-04-25T08:55:18.540698+0000","last_clean":"2024-04-25T08:55:18.540698+0000","last_became_active":"2024-04-25T08:55:16.838330+0000","last_became_peered":"2024-04-25T08:55:16.838330+0000","last_unstale":"2024-04-25T08:55:18.540698+0000","last_undegraded":"2024-04-25T08:55:18.540698+0000","last_fullsized":"2024-04-25T08:55:18.540698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540035+0000","last_change":"2024-04-25T08:55:16.841755+0000","last_active":"2024-04-25T08:55:18.540035+0000","last_peered":"2024-04-25T08:55:18.540035+0000","last_clean":"2024-04-25T08:55:18.540035+0000","last_became_active":"2024-04-25T08:55:16.840957+0000","last_became_peered":"2024-04-25T08:55:16.840957+0000","last_unstale":"2024-04-25T08:55:18.540035+0000","last_undegraded":"2024-04-25T08:55:18.540035+0000","last_fullsized":"2024-04-25T08:55:18.540035+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.956125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540100+0000","last_change":"2024-04-25T08:55:16.834783+0000","last_active":"2024-04-25T08:55:18.540100+0000","last_peered":"2024-04-25T08:55:18.540100+0000","last_clean":"2024-04-25T08:55:18.540100+0000","last_became_active":"2024-04-25T08:55:16.834516+0000","last_became_peered":"2024-04-25T08:55:16.834516+0000","last_unstale":"2024-04-25T08:55:18.540100+0000","last_undegraded":"2024-04-25T08:55:18.540100+0000","last_fullsized":"2024-04-25T08:55:18.540100+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540279+0000","last_change":"2024-04-25T08:55:16.846385+0000","last_active":"2024-04-25T08:55:18.540279+0000","last_peered":"2024-04-25T08:55:18.540279+0000","last_clean":"2024-04-25T08:55:18.540279+0000","last_became_active":"2024-04-25T08:55:16.846086+0000","last_became_peered":"2024-04-25T08:55:16.846086+0000","last_unstale":"2024-04-25T08:55:18.540279+0000","last_undegraded":"2024-04-25T08:55:18.540279+0000","last_fullsized":"2024-04-25T08:55:18.540279+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:37.559936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539706+0000","last_change":"2024-04-25T08:55:16.843288+0000","last_active":"2024-04-25T08:55:18.539706+0000","last_peered":"2024-04-25T08:55:18.539706+0000","last_clean":"2024-04-25T08:55:18.539706+0000","last_became_active":"2024-04-25T08:55:16.838291+0000","last_became_peered":"2024-04-25T08:55:16.838291+0000","last_unstale":"2024-04-25T08:55:18.539706+0000","last_undegraded":"2024-04-25T08:55:18.539706+0000","last_fullsized":"2024-04-25T08:55:18.539706+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:09.916126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837424+0000","last_change":"2024-04-25T08:55:16.828188+0000","last_active":"2024-04-25T08:55:17.837424+0000","last_peered":"2024-04-25T08:55:17.837424+0000","last_clean":"2024-04-25T08:55:17.837424+0000","last_became_active":"2024-04-25T08:55:16.827799+0000","last_became_peered":"2024-04-25T08:55:16.827799+0000","last_unstale":"2024-04-25T08:55:17.837424+0000","last_undegraded":"2024-04-25T08:55:17.837424+0000","last_fullsized":"2024-04-25T08:55:17.837424+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:44.172513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837279+0000","last_change":"2024-04-25T08:55:16.843112+0000","last_active":"2024-04-25T08:55:17.837279+0000","last_peered":"2024-04-25T08:55:17.837279+0000","last_clean":"2024-04-25T08:55:17.837279+0000","last_became_active":"2024-04-25T08:55:16.842799+0000","last_became_peered":"2024-04-25T08:55:16.842799+0000","last_unstale":"2024-04-25T08:55:17.837279+0000","last_undegraded":"2024-04-25T08:55:17.837279+0000","last_fullsized":"2024-04-25T08:55:17.837279+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:23.800462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540545+0000","last_change":"2024-04-25T08:55:16.833189+0000","last_active":"2024-04-25T08:55:18.540545+0000","last_peered":"2024-04-25T08:55:18.540545+0000","last_clean":"2024-04-25T08:55:18.540545+0000","last_became_active":"2024-04-25T08:55:16.831963+0000","last_became_peered":"2024-04-25T08:55:16.831963+0000","last_unstale":"2024-04-25T08:55:18.540545+0000","last_undegraded":"2024-04-25T08:55:18.540545+0000","last_fullsized":"2024-04-25T08:55:18.540545+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540421+0000","last_change":"2024-04-25T08:55:16.841886+0000","last_active":"2024-04-25T08:55:18.540421+0000","last_peered":"2024-04-25T08:55:18.540421+0000","last_clean":"2024-04-25T08:55:18.540421+0000","last_became_active":"2024-04-25T08:55:16.841578+0000","last_became_peered":"2024-04-25T08:55:16.841578+0000","last_unstale":"2024-04-25T08:55:18.540421+0000","last_undegraded":"2024-04-25T08:55:18.540421+0000","last_fullsized":"2024-04-25T08:55:18.540421+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837789+0000","last_change":"2024-04-25T08:55:16.843485+0000","last_active":"2024-04-25T08:55:17.837789+0000","last_peered":"2024-04-25T08:55:17.837789+0000","last_clean":"2024-04-25T08:55:17.837789+0000","last_became_active":"2024-04-25T08:55:16.843130+0000","last_became_peered":"2024-04-25T08:55:16.843130+0000","last_unstale":"2024-04-25T08:55:17.837789+0000","last_undegraded":"2024-04-25T08:55:17.837789+0000","last_fullsized":"2024-04-25T08:55:17.837789+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:12.657487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540145+0000","last_change":"2024-04-25T08:55:16.841939+0000","last_active":"2024-04-25T08:55:18.540145+0000","last_peered":"2024-04-25T08:55:18.540145+0000","last_clean":"2024-04-25T08:55:18.540145+0000","last_became_active":"2024-04-25T08:55:16.841657+0000","last_became_peered":"2024-04-25T08:55:16.841657+0000","last_unstale":"2024-04-25T08:55:18.540145+0000","last_undegraded":"2024-04-25T08:55:18.540145+0000","last_fullsized":"2024-04-25T08:55:18.540145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:14.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837507+0000","last_change":"2024-04-25T08:55:16.821355+0000","last_active":"2024-04-25T08:55:17.837507+0000","last_peered":"2024-04-25T08:55:17.837507+0000","last_clean":"2024-04-25T08:55:17.837507+0000","last_became_active":"2024-04-25T08:55:16.821067+0000","last_became_peered":"2024-04-25T08:55:16.821067+0000","last_unstale":"2024-04-25T08:55:17.837507+0000","last_undegraded":"2024-04-25T08:55:17.837507+0000","last_fullsized":"2024-04-25T08:55:17.837507+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.333983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539859+0000","last_change":"2024-04-25T08:55:16.838547+0000","last_active":"2024-04-25T08:55:18.539859+0000","last_peered":"2024-04-25T08:55:18.539859+0000","last_clean":"2024-04-25T08:55:18.539859+0000","last_became_active":"2024-04-25T08:55:16.837583+0000","last_became_peered":"2024-04-25T08:55:16.837583+0000","last_unstale":"2024-04-25T08:55:18.539859+0000","last_undegraded":"2024-04-25T08:55:18.539859+0000","last_fullsized":"2024-04-25T08:55:18.539859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:36.671667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836896+0000","last_change":"2024-04-25T08:55:16.828541+0000","last_active":"2024-04-25T08:55:17.836896+0000","last_peered":"2024-04-25T08:55:17.836896+0000","last_clean":"2024-04-25T08:55:17.836896+0000","last_became_active":"2024-04-25T08:55:16.828068+0000","last_became_peered":"2024-04-25T08:55:16.828068+0000","last_unstale":"2024-04-25T08:55:17.836896+0000","last_undegraded":"2024-04-25T08:55:17.836896+0000","last_fullsized":"2024-04-25T08:55:17.836896+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:58.797425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837412+0000","last_change":"2024-04-25T08:55:16.828256+0000","last_active":"2024-04-25T08:55:17.837412+0000","last_peered":"2024-04-25T08:55:17.837412+0000","last_clean":"2024-04-25T08:55:17.837412+0000","last_became_active":"2024-04-25T08:55:16.827956+0000","last_became_peered":"2024-04-25T08:55:16.827956+0000","last_unstale":"2024-04-25T08:55:17.837412+0000","last_undegraded":"2024-04-25T08:55:17.837412+0000","last_fullsized":"2024-04-25T08:55:17.837412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.294126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837937+0000","last_change":"2024-04-25T08:55:16.831080+0000","last_active":"2024-04-25T08:55:17.837937+0000","last_peered":"2024-04-25T08:55:17.837937+0000","last_clean":"2024-04-25T08:55:17.837937+0000","last_became_active":"2024-04-25T08:55:16.830803+0000","last_became_peered":"2024-04-25T08:55:16.830803+0000","last_unstale":"2024-04-25T08:55:17.837937+0000","last_undegraded":"2024-04-25T08:55:17.837937+0000","last_fullsized":"2024-04-25T08:55:17.837937+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:44.216939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540190+0000","last_change":"2024-04-25T08:55:16.846495+0000","last_active":"2024-04-25T08:55:18.540190+0000","last_peered":"2024-04-25T08:55:18.540190+0000","last_clean":"2024-04-25T08:55:18.540190+0000","last_became_active":"2024-04-25T08:55:16.846097+0000","last_became_peered":"2024-04-25T08:55:16.846097+0000","last_unstale":"2024-04-25T08:55:18.540190+0000","last_undegraded":"2024-04-25T08:55:18.540190+0000","last_fullsized":"2024-04-25T08:55:18.540190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:00.833210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540297+0000","last_change":"2024-04-25T08:55:16.832406+0000","last_active":"2024-04-25T08:55:18.540297+0000","last_peered":"2024-04-25T08:55:18.540297+0000","last_clean":"2024-04-25T08:55:18.540297+0000","last_became_active":"2024-04-25T08:55:16.832117+0000","last_became_peered":"2024-04-25T08:55:16.832117+0000","last_unstale":"2024-04-25T08:55:18.540297+0000","last_undegraded":"2024-04-25T08:55:18.540297+0000","last_fullsized":"2024-04-25T08:55:18.540297+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540182+0000","last_change":"2024-04-25T08:55:16.831162+0000","last_active":"2024-04-25T08:55:18.540182+0000","last_peered":"2024-04-25T08:55:18.540182+0000","last_clean":"2024-04-25T08:55:18.540182+0000","last_became_active":"2024-04-25T08:55:16.830889+0000","last_became_peered":"2024-04-25T08:55:16.830889+0000","last_unstale":"2024-04-25T08:55:18.540182+0000","last_undegraded":"2024-04-25T08:55:18.540182+0000","last_fullsized":"2024-04-25T08:55:18.540182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836963+0000","last_change":"2024-04-25T08:55:16.829707+0000","last_active":"2024-04-25T08:55:17.836963+0000","last_peered":"2024-04-25T08:55:17.836963+0000","last_clean":"2024-04-25T08:55:17.836963+0000","last_became_active":"2024-04-25T08:55:16.829062+0000","last_became_peered":"2024-04-25T08:55:16.829062+0000","last_unstale":"2024-04-25T08:55:17.836963+0000","last_undegraded":"2024-04-25T08:55:17.836963+0000","last_fullsized":"2024-04-25T08:55:17.836963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:15.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539758+0000","last_change":"2024-04-25T08:55:16.830080+0000","last_active":"2024-04-25T08:55:18.539758+0000","last_peered":"2024-04-25T08:55:18.539758+0000","last_clean":"2024-04-25T08:55:18.539758+0000","last_became_active":"2024-04-25T08:55:16.829695+0000","last_became_peered":"2024-04-25T08:55:16.829695+0000","last_unstale":"2024-04-25T08:55:18.539758+0000","last_undegraded":"2024-04-25T08:55:18.539758+0000","last_fullsized":"2024-04-25T08:55:18.539758+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:36.671667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837487+0000","last_change":"2024-04-25T08:55:16.822654+0000","last_active":"2024-04-25T08:55:17.837487+0000","last_peered":"2024-04-25T08:55:17.837487+0000","last_clean":"2024-04-25T08:55:17.837487+0000","last_became_active":"2024-04-25T08:55:16.822381+0000","last_became_peered":"2024-04-25T08:55:16.822381+0000","last_unstale":"2024-04-25T08:55:17.837487+0000","last_undegraded":"2024-04-25T08:55:17.837487+0000","last_fullsized":"2024-04-25T08:55:17.837487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:26.668007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539713+0000","last_change":"2024-04-25T08:55:16.838404+0000","last_active":"2024-04-25T08:55:18.539713+0000","last_peered":"2024-04-25T08:55:18.539713+0000","last_clean":"2024-04-25T08:55:18.539713+0000","last_became_active":"2024-04-25T08:55:16.838105+0000","last_became_peered":"2024-04-25T08:55:16.838105+0000","last_unstale":"2024-04-25T08:55:18.539713+0000","last_undegraded":"2024-04-25T08:55:18.539713+0000","last_fullsized":"2024-04-25T08:55:18.539713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:38.008819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.804067+0000","last_change":"2024-04-25T08:55:15.804067+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.804067+0000","last_undegraded":"2024-04-25T08:55:15.804067+0000","last_fullsized":"2024-04-25T08:55:15.804067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837824+0000","last_change":"2024-04-25T08:55:15.812917+0000","last_active":"2024-04-25T08:55:17.837824+0000","last_peered":"2024-04-25T08:55:17.837824+0000","last_clean":"2024-04-25T08:55:17.837824+0000","last_became_active":"2024-04-25T08:55:15.812416+0000","last_became_peered":"2024-04-25T08:55:15.812416+0000","last_unstale":"2024-04-25T08:55:17.837824+0000","last_undegraded":"2024-04-25T08:55:17.837824+0000","last_fullsized":"2024-04-25T08:55:17.837824+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:08.909603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837905+0000","last_change":"2024-04-25T08:55:16.832501+0000","last_active":"2024-04-25T08:55:17.837905+0000","last_peered":"2024-04-25T08:55:17.837905+0000","last_clean":"2024-04-25T08:55:17.837905+0000","last_became_active":"2024-04-25T08:55:16.832159+0000","last_became_peered":"2024-04-25T08:55:16.832159+0000","last_unstale":"2024-04-25T08:55:17.837905+0000","last_undegraded":"2024-04-25T08:55:17.837905+0000","last_fullsized":"2024-04-25T08:55:17.837905+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:46.528440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540498+0000","last_change":"2024-04-25T08:55:15.804587+0000","last_active":"2024-04-25T08:55:18.540498+0000","last_peered":"2024-04-25T08:55:18.540498+0000","last_clean":"2024-04-25T08:55:18.540498+0000","last_became_active":"2024-04-25T08:55:15.802674+0000","last_became_peered":"2024-04-25T08:55:15.802674+0000","last_unstale":"2024-04-25T08:55:18.540498+0000","last_undegraded":"2024-04-25T08:55:18.540498+0000","last_fullsized":"2024-04-25T08:55:18.540498+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:14.287603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540254+0000","last_change":"2024-04-25T08:55:16.836374+0000","last_active":"2024-04-25T08:55:18.540254+0000","last_peered":"2024-04-25T08:55:18.540254+0000","last_clean":"2024-04-25T08:55:18.540254+0000","last_became_active":"2024-04-25T08:55:16.835872+0000","last_became_peered":"2024-04-25T08:55:16.835872+0000","last_unstale":"2024-04-25T08:55:18.540254+0000","last_undegraded":"2024-04-25T08:55:18.540254+0000","last_fullsized":"2024-04-25T08:55:18.540254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811418+0000","last_change":"2024-04-25T08:55:15.805969+0000","last_active":"2024-04-25T08:55:15.811418+0000","last_peered":"2024-04-25T08:55:15.811418+0000","last_clean":"2024-04-25T08:55:15.811418+0000","last_became_active":"2024-04-25T08:55:15.805679+0000","last_became_peered":"2024-04-25T08:55:15.805679+0000","last_unstale":"2024-04-25T08:55:15.811418+0000","last_undegraded":"2024-04-25T08:55:15.811418+0000","last_fullsized":"2024-04-25T08:55:15.811418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:23.227100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.803300+0000","last_change":"2024-04-25T08:55:15.803300+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.803300+0000","last_undegraded":"2024-04-25T08:55:15.803300+0000","last_fullsized":"2024-04-25T08:55:15.803300+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837602+0000","last_change":"2024-04-25T08:55:15.810287+0000","last_active":"2024-04-25T08:55:17.837602+0000","last_peered":"2024-04-25T08:55:17.837602+0000","last_clean":"2024-04-25T08:55:17.837602+0000","last_became_active":"2024-04-25T08:55:15.810000+0000","last_became_peered":"2024-04-25T08:55:15.810000+0000","last_unstale":"2024-04-25T08:55:17.837602+0000","last_undegraded":"2024-04-25T08:55:17.837602+0000","last_fullsized":"2024-04-25T08:55:17.837602+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:43.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539785+0000","last_change":"2024-04-25T08:55:16.832716+0000","last_active":"2024-04-25T08:55:18.539785+0000","last_peered":"2024-04-25T08:55:18.539785+0000","last_clean":"2024-04-25T08:55:18.539785+0000","last_became_active":"2024-04-25T08:55:16.832332+0000","last_became_peered":"2024-04-25T08:55:16.832332+0000","last_unstale":"2024-04-25T08:55:18.539785+0000","last_undegraded":"2024-04-25T08:55:18.539785+0000","last_fullsized":"2024-04-25T08:55:18.539785+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.956125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837620+0000","last_change":"2024-04-25T08:55:15.810523+0000","last_active":"2024-04-25T08:55:17.837620+0000","last_peered":"2024-04-25T08:55:17.837620+0000","last_clean":"2024-04-25T08:55:17.837620+0000","last_became_active":"2024-04-25T08:55:15.809802+0000","last_became_peered":"2024-04-25T08:55:15.809802+0000","last_unstale":"2024-04-25T08:55:17.837620+0000","last_undegraded":"2024-04-25T08:55:17.837620+0000","last_fullsized":"2024-04-25T08:55:17.837620+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.053850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540961+0000","last_change":"2024-04-25T08:55:16.841348+0000","last_active":"2024-04-25T08:55:18.540961+0000","last_peered":"2024-04-25T08:55:18.540961+0000","last_clean":"2024-04-25T08:55:18.540961+0000","last_became_active":"2024-04-25T08:55:16.840890+0000","last_became_peered":"2024-04-25T08:55:16.840890+0000","last_unstale":"2024-04-25T08:55:18.540961+0000","last_undegraded":"2024-04-25T08:55:18.540961+0000","last_fullsized":"2024-04-25T08:55:18.540961+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:36.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539863+0000","last_change":"2024-04-25T08:55:15.808364+0000","last_active":"2024-04-25T08:55:18.539863+0000","last_peered":"2024-04-25T08:55:18.539863+0000","last_clean":"2024-04-25T08:55:18.539863+0000","last_became_active":"2024-04-25T08:55:15.808068+0000","last_became_peered":"2024-04-25T08:55:15.808068+0000","last_unstale":"2024-04-25T08:55:18.539863+0000","last_undegraded":"2024-04-25T08:55:18.539863+0000","last_fullsized":"2024-04-25T08:55:18.539863+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:00.314074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539499+0000","last_change":"2024-04-25T08:55:16.840358+0000","last_active":"2024-04-25T08:55:18.539499+0000","last_peered":"2024-04-25T08:55:18.539499+0000","last_clean":"2024-04-25T08:55:18.539499+0000","last_became_active":"2024-04-25T08:55:16.837947+0000","last_became_peered":"2024-04-25T08:55:16.837947+0000","last_unstale":"2024-04-25T08:55:18.539499+0000","last_undegraded":"2024-04-25T08:55:18.539499+0000","last_fullsized":"2024-04-25T08:55:18.539499+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:25.830198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539474+0000","last_change":"2024-04-25T08:55:15.809376+0000","last_active":"2024-04-25T08:55:18.539474+0000","last_peered":"2024-04-25T08:55:18.539474+0000","last_clean":"2024-04-25T08:55:18.539474+0000","last_became_active":"2024-04-25T08:55:15.808982+0000","last_became_peered":"2024-04-25T08:55:15.808982+0000","last_unstale":"2024-04-25T08:55:18.539474+0000","last_undegraded":"2024-04-25T08:55:18.539474+0000","last_fullsized":"2024-04-25T08:55:18.539474+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:43.806513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836650+0000","last_change":"2024-04-25T08:55:16.829231+0000","last_active":"2024-04-25T08:55:17.836650+0000","last_peered":"2024-04-25T08:55:17.836650+0000","last_clean":"2024-04-25T08:55:17.836650+0000","last_became_active":"2024-04-25T08:55:16.828876+0000","last_became_peered":"2024-04-25T08:55:16.828876+0000","last_unstale":"2024-04-25T08:55:17.836650+0000","last_undegraded":"2024-04-25T08:55:17.836650+0000","last_fullsized":"2024-04-25T08:55:17.836650+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:23.778385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540129+0000","last_change":"2024-04-25T08:55:15.810673+0000","last_active":"2024-04-25T08:55:18.540129+0000","last_peered":"2024-04-25T08:55:18.540129+0000","last_clean":"2024-04-25T08:55:18.540129+0000","last_became_active":"2024-04-25T08:55:15.809289+0000","last_became_peered":"2024-04-25T08:55:15.809289+0000","last_unstale":"2024-04-25T08:55:18.540129+0000","last_undegraded":"2024-04-25T08:55:18.540129+0000","last_fullsized":"2024-04-25T08:55:18.540129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.016665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540504+0000","last_change":"2024-04-25T08:55:16.841663+0000","last_active":"2024-04-25T08:55:18.540504+0000","last_peered":"2024-04-25T08:55:18.540504+0000","last_clean":"2024-04-25T08:55:18.540504+0000","last_became_active":"2024-04-25T08:55:16.841397+0000","last_became_peered":"2024-04-25T08:55:16.841397+0000","last_unstale":"2024-04-25T08:55:18.540504+0000","last_undegraded":"2024-04-25T08:55:18.540504+0000","last_fullsized":"2024-04-25T08:55:18.540504+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540624+0000","last_change":"2024-04-25T08:55:15.808307+0000","last_active":"2024-04-25T08:55:18.540624+0000","last_peered":"2024-04-25T08:55:18.540624+0000","last_clean":"2024-04-25T08:55:18.540624+0000","last_became_active":"2024-04-25T08:55:15.808012+0000","last_became_peered":"2024-04-25T08:55:15.808012+0000","last_unstale":"2024-04-25T08:55:18.540624+0000","last_undegraded":"2024-04-25T08:55:18.540624+0000","last_fullsized":"2024-04-25T08:55:18.540624+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:11.650964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837119+0000","last_change":"2024-04-25T08:55:16.824657+0000","last_active":"2024-04-25T08:55:17.837119+0000","last_peered":"2024-04-25T08:55:17.837119+0000","last_clean":"2024-04-25T08:55:17.837119+0000","last_became_active":"2024-04-25T08:55:16.824372+0000","last_became_peered":"2024-04-25T08:55:16.824372+0000","last_unstale":"2024-04-25T08:55:17.837119+0000","last_undegraded":"2024-04-25T08:55:17.837119+0000","last_fullsized":"2024-04-25T08:55:17.837119+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541025+0000","last_change":"2024-04-25T08:55:15.808834+0000","last_active":"2024-04-25T08:55:18.541025+0000","last_peered":"2024-04-25T08:55:18.541025+0000","last_clean":"2024-04-25T08:55:18.541025+0000","last_became_active":"2024-04-25T08:55:15.808535+0000","last_became_peered":"2024-04-25T08:55:15.808535+0000","last_unstale":"2024-04-25T08:55:18.541025+0000","last_undegraded":"2024-04-25T08:55:18.541025+0000","last_fullsized":"2024-04-25T08:55:18.541025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:51.724373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837714+0000","last_change":"2024-04-25T08:55:16.829816+0000","last_active":"2024-04-25T08:55:17.837714+0000","last_peered":"2024-04-25T08:55:17.837714+0000","last_clean":"2024-04-25T08:55:17.837714+0000","last_became_active":"2024-04-25T08:55:16.829214+0000","last_became_peered":"2024-04-25T08:55:16.829214+0000","last_unstale":"2024-04-25T08:55:17.837714+0000","last_undegraded":"2024-04-25T08:55:17.837714+0000","last_fullsized":"2024-04-25T08:55:17.837714+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:34.646693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837921+0000","last_change":"2024-04-25T08:55:15.803912+0000","last_active":"2024-04-25T08:55:17.837921+0000","last_peered":"2024-04-25T08:55:17.837921+0000","last_clean":"2024-04-25T08:55:17.837921+0000","last_became_active":"2024-04-25T08:55:15.803618+0000","last_became_peered":"2024-04-25T08:55:15.803618+0000","last_unstale":"2024-04-25T08:55:17.837921+0000","last_undegraded":"2024-04-25T08:55:17.837921+0000","last_fullsized":"2024-04-25T08:55:17.837921+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:21.098215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837797+0000","last_change":"2024-04-25T08:55:16.836929+0000","last_active":"2024-04-25T08:55:17.837797+0000","last_peered":"2024-04-25T08:55:17.837797+0000","last_clean":"2024-04-25T08:55:17.837797+0000","last_became_active":"2024-04-25T08:55:16.836637+0000","last_became_peered":"2024-04-25T08:55:16.836637+0000","last_unstale":"2024-04-25T08:55:17.837797+0000","last_undegraded":"2024-04-25T08:55:17.837797+0000","last_fullsized":"2024-04-25T08:55:17.837797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:36.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540179+0000","last_change":"2024-04-25T08:55:15.804532+0000","last_active":"2024-04-25T08:55:18.540179+0000","last_peered":"2024-04-25T08:55:18.540179+0000","last_clean":"2024-04-25T08:55:18.540179+0000","last_became_active":"2024-04-25T08:55:15.804121+0000","last_became_peered":"2024-04-25T08:55:15.804121+0000","last_unstale":"2024-04-25T08:55:18.540179+0000","last_undegraded":"2024-04-25T08:55:18.540179+0000","last_fullsized":"2024-04-25T08:55:18.540179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.796101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837148+0000","last_change":"2024-04-25T08:55:16.841731+0000","last_active":"2024-04-25T08:55:17.837148+0000","last_peered":"2024-04-25T08:55:17.837148+0000","last_clean":"2024-04-25T08:55:17.837148+0000","last_became_active":"2024-04-25T08:55:16.841469+0000","last_became_peered":"2024-04-25T08:55:16.841469+0000","last_unstale":"2024-04-25T08:55:17.837148+0000","last_undegraded":"2024-04-25T08:55:17.837148+0000","last_fullsized":"2024-04-25T08:55:17.837148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:01.320597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837682+0000","last_change":"2024-04-25T08:55:15.810787+0000","last_active":"2024-04-25T08:55:17.837682+0000","last_peered":"2024-04-25T08:55:17.837682+0000","last_clean":"2024-04-25T08:55:17.837682+0000","last_became_active":"2024-04-25T08:55:15.810228+0000","last_became_peered":"2024-04-25T08:55:15.810228+0000","last_unstale":"2024-04-25T08:55:17.837682+0000","last_undegraded":"2024-04-25T08:55:17.837682+0000","last_fullsized":"2024-04-25T08:55:17.837682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:10.670548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540521+0000","last_change":"2024-04-25T08:55:16.841653+0000","last_active":"2024-04-25T08:55:18.540521+0000","last_peered":"2024-04-25T08:55:18.540521+0000","last_clean":"2024-04-25T08:55:18.540521+0000","last_became_active":"2024-04-25T08:55:16.840792+0000","last_became_peered":"2024-04-25T08:55:16.840792+0000","last_unstale":"2024-04-25T08:55:18.540521+0000","last_undegraded":"2024-04-25T08:55:18.540521+0000","last_fullsized":"2024-04-25T08:55:18.540521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837375+0000","last_change":"2024-04-25T08:55:15.809556+0000","last_active":"2024-04-25T08:55:17.837375+0000","last_peered":"2024-04-25T08:55:17.837375+0000","last_clean":"2024-04-25T08:55:17.837375+0000","last_became_active":"2024-04-25T08:55:15.809080+0000","last_became_peered":"2024-04-25T08:55:15.809080+0000","last_unstale":"2024-04-25T08:55:17.837375+0000","last_undegraded":"2024-04-25T08:55:17.837375+0000","last_fullsized":"2024-04-25T08:55:17.837375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:25.637156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837378+0000","last_change":"2024-04-25T08:55:16.829568+0000","last_active":"2024-04-25T08:55:17.837378+0000","last_peered":"2024-04-25T08:55:17.837378+0000","last_clean":"2024-04-25T08:55:17.837378+0000","last_became_active":"2024-04-25T08:55:16.829248+0000","last_became_peered":"2024-04-25T08:55:16.829248+0000","last_unstale":"2024-04-25T08:55:17.837378+0000","last_undegraded":"2024-04-25T08:55:17.837378+0000","last_fullsized":"2024-04-25T08:55:17.837378+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:56.165607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837529+0000","last_change":"2024-04-25T08:55:15.812602+0000","last_active":"2024-04-25T08:55:17.837529+0000","last_peered":"2024-04-25T08:55:17.837529+0000","last_clean":"2024-04-25T08:55:17.837529+0000","last_became_active":"2024-04-25T08:55:15.812277+0000","last_became_peered":"2024-04-25T08:55:15.812277+0000","last_unstale":"2024-04-25T08:55:17.837529+0000","last_undegraded":"2024-04-25T08:55:17.837529+0000","last_fullsized":"2024-04-25T08:55:17.837529+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:15.861856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837530+0000","last_change":"2024-04-25T08:55:16.828073+0000","last_active":"2024-04-25T08:55:17.837530+0000","last_peered":"2024-04-25T08:55:17.837530+0000","last_clean":"2024-04-25T08:55:17.837530+0000","last_became_active":"2024-04-25T08:55:16.827811+0000","last_became_peered":"2024-04-25T08:55:16.827811+0000","last_unstale":"2024-04-25T08:55:17.837530+0000","last_undegraded":"2024-04-25T08:55:17.837530+0000","last_fullsized":"2024-04-25T08:55:17.837530+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539870+0000","last_change":"2024-04-25T08:55:15.809552+0000","last_active":"2024-04-25T08:55:18.539870+0000","last_peered":"2024-04-25T08:55:18.539870+0000","last_clean":"2024-04-25T08:55:18.539870+0000","last_became_active":"2024-04-25T08:55:15.809065+0000","last_became_peered":"2024-04-25T08:55:15.809065+0000","last_unstale":"2024-04-25T08:55:18.539870+0000","last_undegraded":"2024-04-25T08:55:18.539870+0000","last_fullsized":"2024-04-25T08:55:18.539870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:36.553413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540362+0000","last_change":"2024-04-25T08:55:16.833303+0000","last_active":"2024-04-25T08:55:18.540362+0000","last_peered":"2024-04-25T08:55:18.540362+0000","last_clean":"2024-04-25T08:55:18.540362+0000","last_became_active":"2024-04-25T08:55:16.832435+0000","last_became_peered":"2024-04-25T08:55:16.832435+0000","last_unstale":"2024-04-25T08:55:18.540362+0000","last_undegraded":"2024-04-25T08:55:18.540362+0000","last_fullsized":"2024-04-25T08:55:18.540362+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:15.812095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541163+0000","last_change":"2024-04-25T08:55:15.806916+0000","last_active":"2024-04-25T08:55:18.541163+0000","last_peered":"2024-04-25T08:55:18.541163+0000","last_clean":"2024-04-25T08:55:18.541163+0000","last_became_active":"2024-04-25T08:55:15.806584+0000","last_became_peered":"2024-04-25T08:55:15.806584+0000","last_unstale":"2024-04-25T08:55:18.541163+0000","last_undegraded":"2024-04-25T08:55:18.541163+0000","last_fullsized":"2024-04-25T08:55:18.541163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:52.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540974+0000","last_change":"2024-04-25T08:55:16.846605+0000","last_active":"2024-04-25T08:55:18.540974+0000","last_peered":"2024-04-25T08:55:18.540974+0000","last_clean":"2024-04-25T08:55:18.540974+0000","last_became_active":"2024-04-25T08:55:16.846304+0000","last_became_peered":"2024-04-25T08:55:16.846304+0000","last_unstale":"2024-04-25T08:55:18.540974+0000","last_undegraded":"2024-04-25T08:55:18.540974+0000","last_fullsized":"2024-04-25T08:55:18.540974+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540594+0000","last_change":"2024-04-25T08:55:15.806841+0000","last_active":"2024-04-25T08:55:18.540594+0000","last_peered":"2024-04-25T08:55:18.540594+0000","last_clean":"2024-04-25T08:55:18.540594+0000","last_became_active":"2024-04-25T08:55:15.806563+0000","last_became_peered":"2024-04-25T08:55:15.806563+0000","last_unstale":"2024-04-25T08:55:18.540594+0000","last_undegraded":"2024-04-25T08:55:18.540594+0000","last_fullsized":"2024-04-25T08:55:18.540594+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:19.717985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837109+0000","last_change":"2024-04-25T08:55:16.838841+0000","last_active":"2024-04-25T08:55:17.837109+0000","last_peered":"2024-04-25T08:55:17.837109+0000","last_clean":"2024-04-25T08:55:17.837109+0000","last_became_active":"2024-04-25T08:55:16.838592+0000","last_became_peered":"2024-04-25T08:55:16.838592+0000","last_unstale":"2024-04-25T08:55:17.837109+0000","last_undegraded":"2024-04-25T08:55:17.837109+0000","last_fullsized":"2024-04-25T08:55:17.837109+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:16.953838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540102+0000","last_change":"2024-04-25T08:55:15.809119+0000","last_active":"2024-04-25T08:55:18.540102+0000","last_peered":"2024-04-25T08:55:18.540102+0000","last_clean":"2024-04-25T08:55:18.540102+0000","last_became_active":"2024-04-25T08:55:15.808770+0000","last_became_peered":"2024-04-25T08:55:15.808770+0000","last_unstale":"2024-04-25T08:55:18.540102+0000","last_undegraded":"2024-04-25T08:55:18.540102+0000","last_fullsized":"2024-04-25T08:55:18.540102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:25.637156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837451+0000","last_change":"2024-04-25T08:55:16.831158+0000","last_active":"2024-04-25T08:55:17.837451+0000","last_peered":"2024-04-25T08:55:17.837451+0000","last_clean":"2024-04-25T08:55:17.837451+0000","last_became_active":"2024-04-25T08:55:16.830883+0000","last_became_peered":"2024-04-25T08:55:16.830883+0000","last_unstale":"2024-04-25T08:55:17.837451+0000","last_undegraded":"2024-04-25T08:55:17.837451+0000","last_fullsized":"2024-04-25T08:55:17.837451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:20.724508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837803+0000","last_change":"2024-04-25T08:55:15.811663+0000","last_active":"2024-04-25T08:55:17.837803+0000","last_peered":"2024-04-25T08:55:17.837803+0000","last_clean":"2024-04-25T08:55:17.837803+0000","last_became_active":"2024-04-25T08:55:15.811372+0000","last_became_peered":"2024-04-25T08:55:15.811372+0000","last_unstale":"2024-04-25T08:55:17.837803+0000","last_undegraded":"2024-04-25T08:55:17.837803+0000","last_fullsized":"2024-04-25T08:55:17.837803+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:00.529017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837681+0000","last_change":"2024-04-25T08:55:16.830366+0000","last_active":"2024-04-25T08:55:17.837681+0000","last_peered":"2024-04-25T08:55:17.837681+0000","last_clean":"2024-04-25T08:55:17.837681+0000","last_became_active":"2024-04-25T08:55:16.830101+0000","last_became_peered":"2024-04-25T08:55:16.830101+0000","last_unstale":"2024-04-25T08:55:17.837681+0000","last_undegraded":"2024-04-25T08:55:17.837681+0000","last_fullsized":"2024-04-25T08:55:17.837681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:56.842647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837784+0000","last_change":"2024-04-25T08:55:15.811103+0000","last_active":"2024-04-25T08:55:17.837784+0000","last_peered":"2024-04-25T08:55:17.837784+0000","last_clean":"2024-04-25T08:55:17.837784+0000","last_became_active":"2024-04-25T08:55:15.810409+0000","last_became_peered":"2024-04-25T08:55:15.810409+0000","last_unstale":"2024-04-25T08:55:17.837784+0000","last_undegraded":"2024-04-25T08:55:17.837784+0000","last_fullsized":"2024-04-25T08:55:17.837784+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:35.665144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.802692+0000","last_change":"2024-04-25T08:55:15.802692+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.802692+0000","last_undegraded":"2024-04-25T08:55:15.802692+0000","last_fullsized":"2024-04-25T08:55:15.802692+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539589+0000","last_change":"2024-04-25T08:55:15.808197+0000","last_active":"2024-04-25T08:55:18.539589+0000","last_peered":"2024-04-25T08:55:18.539589+0000","last_clean":"2024-04-25T08:55:18.539589+0000","last_became_active":"2024-04-25T08:55:15.806676+0000","last_became_peered":"2024-04-25T08:55:15.806676+0000","last_unstale":"2024-04-25T08:55:18.539589+0000","last_undegraded":"2024-04-25T08:55:18.539589+0000","last_fullsized":"2024-04-25T08:55:18.539589+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:21.098215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539986+0000","last_change":"2024-04-25T08:55:16.829187+0000","last_active":"2024-04-25T08:55:18.539986+0000","last_peered":"2024-04-25T08:55:18.539986+0000","last_clean":"2024-04-25T08:55:18.539986+0000","last_became_active":"2024-04-25T08:55:16.828772+0000","last_became_peered":"2024-04-25T08:55:16.828772+0000","last_unstale":"2024-04-25T08:55:18.539986+0000","last_undegraded":"2024-04-25T08:55:18.539986+0000","last_fullsized":"2024-04-25T08:55:18.539986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:29.403892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539546+0000","last_change":"2024-04-25T08:55:15.810669+0000","last_active":"2024-04-25T08:55:18.539546+0000","last_peered":"2024-04-25T08:55:18.539546+0000","last_clean":"2024-04-25T08:55:18.539546+0000","last_became_active":"2024-04-25T08:55:15.810364+0000","last_became_peered":"2024-04-25T08:55:15.810364+0000","last_unstale":"2024-04-25T08:55:18.539546+0000","last_undegraded":"2024-04-25T08:55:18.539546+0000","last_fullsized":"2024-04-25T08:55:18.539546+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:39.011045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539570+0000","last_change":"2024-04-25T08:55:16.844563+0000","last_active":"2024-04-25T08:55:18.539570+0000","last_peered":"2024-04-25T08:55:18.539570+0000","last_clean":"2024-04-25T08:55:18.539570+0000","last_became_active":"2024-04-25T08:55:16.844276+0000","last_became_peered":"2024-04-25T08:55:16.844276+0000","last_unstale":"2024-04-25T08:55:18.539570+0000","last_undegraded":"2024-04-25T08:55:18.539570+0000","last_fullsized":"2024-04-25T08:55:18.539570+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:36.060373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837697+0000","last_change":"2024-04-25T08:55:15.810567+0000","last_active":"2024-04-25T08:55:17.837697+0000","last_peered":"2024-04-25T08:55:17.837697+0000","last_clean":"2024-04-25T08:55:17.837697+0000","last_became_active":"2024-04-25T08:55:15.809948+0000","last_became_peered":"2024-04-25T08:55:15.809948+0000","last_unstale":"2024-04-25T08:55:17.837697+0000","last_undegraded":"2024-04-25T08:55:17.837697+0000","last_fullsized":"2024-04-25T08:55:17.837697+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.053850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.838063+0000","last_change":"2024-04-25T08:55:16.842345+0000","last_active":"2024-04-25T08:55:17.838063+0000","last_peered":"2024-04-25T08:55:17.838063+0000","last_clean":"2024-04-25T08:55:17.838063+0000","last_became_active":"2024-04-25T08:55:16.841261+0000","last_became_peered":"2024-04-25T08:55:16.841261+0000","last_unstale":"2024-04-25T08:55:17.838063+0000","last_undegraded":"2024-04-25T08:55:17.838063+0000","last_fullsized":"2024-04-25T08:55:17.838063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:44.813036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837927+0000","last_change":"2024-04-25T08:55:15.810587+0000","last_active":"2024-04-25T08:55:17.837927+0000","last_peered":"2024-04-25T08:55:17.837927+0000","last_clean":"2024-04-25T08:55:17.837927+0000","last_became_active":"2024-04-25T08:55:15.810279+0000","last_became_peered":"2024-04-25T08:55:15.810279+0000","last_unstale":"2024-04-25T08:55:17.837927+0000","last_undegraded":"2024-04-25T08:55:17.837927+0000","last_fullsized":"2024-04-25T08:55:17.837927+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:02.949602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540495+0000","last_change":"2024-04-25T08:55:16.845748+0000","last_active":"2024-04-25T08:55:18.540495+0000","last_peered":"2024-04-25T08:55:18.540495+0000","last_clean":"2024-04-25T08:55:18.540495+0000","last_became_active":"2024-04-25T08:55:16.845270+0000","last_became_peered":"2024-04-25T08:55:16.845270+0000","last_unstale":"2024-04-25T08:55:18.540495+0000","last_undegraded":"2024-04-25T08:55:18.540495+0000","last_fullsized":"2024-04-25T08:55:18.540495+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837918+0000","last_change":"2024-04-25T08:55:15.808197+0000","last_active":"2024-04-25T08:55:17.837918+0000","last_peered":"2024-04-25T08:55:17.837918+0000","last_clean":"2024-04-25T08:55:17.837918+0000","last_became_active":"2024-04-25T08:55:15.807712+0000","last_became_peered":"2024-04-25T08:55:15.807712+0000","last_unstale":"2024-04-25T08:55:17.837918+0000","last_undegraded":"2024-04-25T08:55:17.837918+0000","last_fullsized":"2024-04-25T08:55:17.837918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:24.823675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837799+0000","last_change":"2024-04-25T08:55:16.829720+0000","last_active":"2024-04-25T08:55:17.837799+0000","last_peered":"2024-04-25T08:55:17.837799+0000","last_clean":"2024-04-25T08:55:17.837799+0000","last_became_active":"2024-04-25T08:55:16.829479+0000","last_became_peered":"2024-04-25T08:55:16.829479+0000","last_unstale":"2024-04-25T08:55:17.837799+0000","last_undegraded":"2024-04-25T08:55:17.837799+0000","last_fullsized":"2024-04-25T08:55:17.837799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811361+0000","last_change":"2024-04-25T08:55:15.805828+0000","last_active":"2024-04-25T08:55:15.811361+0000","last_peered":"2024-04-25T08:55:15.811361+0000","last_clean":"2024-04-25T08:55:15.811361+0000","last_became_active":"2024-04-25T08:55:15.805528+0000","last_became_peered":"2024-04-25T08:55:15.805528+0000","last_unstale":"2024-04-25T08:55:15.811361+0000","last_undegraded":"2024-04-25T08:55:15.811361+0000","last_fullsized":"2024-04-25T08:55:15.811361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:27.984110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837868+0000","last_change":"2024-04-25T08:55:16.828363+0000","last_active":"2024-04-25T08:55:17.837868+0000","last_peered":"2024-04-25T08:55:17.837868+0000","last_clean":"2024-04-25T08:55:17.837868+0000","last_became_active":"2024-04-25T08:55:16.825857+0000","last_became_peered":"2024-04-25T08:55:16.825857+0000","last_unstale":"2024-04-25T08:55:17.837868+0000","last_undegraded":"2024-04-25T08:55:17.837868+0000","last_fullsized":"2024-04-25T08:55:17.837868+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:31.555032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837553+0000","last_change":"2024-04-25T08:55:15.804862+0000","last_active":"2024-04-25T08:55:17.837553+0000","last_peered":"2024-04-25T08:55:17.837553+0000","last_clean":"2024-04-25T08:55:17.837553+0000","last_became_active":"2024-04-25T08:55:15.804575+0000","last_became_peered":"2024-04-25T08:55:15.804575+0000","last_unstale":"2024-04-25T08:55:17.837553+0000","last_undegraded":"2024-04-25T08:55:17.837553+0000","last_fullsized":"2024-04-25T08:55:17.837553+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:43.806513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837565+0000","last_change":"2024-04-25T08:55:16.830603+0000","last_active":"2024-04-25T08:55:17.837565+0000","last_peered":"2024-04-25T08:55:17.837565+0000","last_clean":"2024-04-25T08:55:17.837565+0000","last_became_active":"2024-04-25T08:55:16.830277+0000","last_became_peered":"2024-04-25T08:55:16.830277+0000","last_unstale":"2024-04-25T08:55:17.837565+0000","last_undegraded":"2024-04-25T08:55:17.837565+0000","last_fullsized":"2024-04-25T08:55:17.837565+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:29.707648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539870+0000","last_change":"2024-04-25T08:55:15.810936+0000","last_active":"2024-04-25T08:55:18.539870+0000","last_peered":"2024-04-25T08:55:18.539870+0000","last_clean":"2024-04-25T08:55:18.539870+0000","last_became_active":"2024-04-25T08:55:15.810469+0000","last_became_peered":"2024-04-25T08:55:15.810469+0000","last_unstale":"2024-04-25T08:55:18.539870+0000","last_undegraded":"2024-04-25T08:55:18.539870+0000","last_fullsized":"2024-04-25T08:55:18.539870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:22.793939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539713+0000","last_change":"2024-04-25T08:55:16.820981+0000","last_active":"2024-04-25T08:55:18.539713+0000","last_peered":"2024-04-25T08:55:18.539713+0000","last_clean":"2024-04-25T08:55:18.539713+0000","last_became_active":"2024-04-25T08:55:16.820654+0000","last_became_peered":"2024-04-25T08:55:16.820654+0000","last_unstale":"2024-04-25T08:55:18.539713+0000","last_undegraded":"2024-04-25T08:55:18.539713+0000","last_fullsized":"2024-04-25T08:55:18.539713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811393+0000","last_change":"2024-04-25T08:55:15.806700+0000","last_active":"2024-04-25T08:55:15.811393+0000","last_peered":"2024-04-25T08:55:15.811393+0000","last_clean":"2024-04-25T08:55:15.811393+0000","last_became_active":"2024-04-25T08:55:15.806407+0000","last_became_peered":"2024-04-25T08:55:15.806407+0000","last_unstale":"2024-04-25T08:55:15.811393+0000","last_undegraded":"2024-04-25T08:55:15.811393+0000","last_fullsized":"2024-04-25T08:55:15.811393+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:58.012479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539725+0000","last_change":"2024-04-25T08:55:16.843737+0000","last_active":"2024-04-25T08:55:18.539725+0000","last_peered":"2024-04-25T08:55:18.539725+0000","last_clean":"2024-04-25T08:55:18.539725+0000","last_became_active":"2024-04-25T08:55:16.843213+0000","last_became_peered":"2024-04-25T08:55:16.843213+0000","last_unstale":"2024-04-25T08:55:18.539725+0000","last_undegraded":"2024-04-25T08:55:18.539725+0000","last_fullsized":"2024-04-25T08:55:18.539725+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:09.916126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540000+0000","last_change":"2024-04-25T08:55:15.810186+0000","last_active":"2024-04-25T08:55:18.540000+0000","last_peered":"2024-04-25T08:55:18.540000+0000","last_clean":"2024-04-25T08:55:18.540000+0000","last_became_active":"2024-04-25T08:55:15.809881+0000","last_became_peered":"2024-04-25T08:55:15.809881+0000","last_unstale":"2024-04-25T08:55:18.540000+0000","last_undegraded":"2024-04-25T08:55:18.540000+0000","last_fullsized":"2024-04-25T08:55:18.540000+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:14.805572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540870+0000","last_change":"2024-04-25T08:55:16.840505+0000","last_active":"2024-04-25T08:55:18.540870+0000","last_peered":"2024-04-25T08:55:18.540870+0000","last_clean":"2024-04-25T08:55:18.540870+0000","last_became_active":"2024-04-25T08:55:16.837418+0000","last_became_peered":"2024-04-25T08:55:16.837418+0000","last_unstale":"2024-04-25T08:55:18.540870+0000","last_undegraded":"2024-04-25T08:55:18.540870+0000","last_fullsized":"2024-04-25T08:55:18.540870+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540226+0000","last_change":"2024-04-25T08:55:15.815889+0000","last_active":"2024-04-25T08:55:18.540226+0000","last_peered":"2024-04-25T08:55:18.540226+0000","last_clean":"2024-04-25T08:55:18.540226+0000","last_became_active":"2024-04-25T08:55:15.815594+0000","last_became_peered":"2024-04-25T08:55:15.815594+0000","last_unstale":"2024-04-25T08:55:18.540226+0000","last_undegraded":"2024-04-25T08:55:18.540226+0000","last_fullsized":"2024-04-25T08:55:18.540226+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:43.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":214,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837683+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:55:17.837683+0000","last_peered":"2024-04-25T08:55:17.837683+0000","last_clean":"2024-04-25T08:55:17.837683+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:55:17.837683+0000","last_undegraded":"2024-04-25T08:55:17.837683+0000","last_fullsized":"2024-04-25T08:55:17.837683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1142784,"data_stored":810559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":220773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":220171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":557056,"data_stored":221713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":220739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":221735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1142784,"data_stored":810503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":520192,"data_stored":207026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:55:21.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-04-25T08:55:21.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:55:15.804067+0000', 'last_change': '2024-04-25T08:55:15.804067+0000', 'last_active': '2024-04-25T08:55:15.785462+0000', 'last_peered': '2024-04-25T08:55:15.785462+0000', 'last_clean': '2024-04-25T08:55:15.785462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:55:15.804067+0000', 'last_undegraded': '2024-04-25T08:55:15.804067+0000', 'last_fullsized': '2024-04-25T08:55:15.804067+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:55:15.785462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:55:15.785462+0000', 'last_clean_scrub_stamp': '2024-04-25T08:55:15.785462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:55:21.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-04-25T08:55:21.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:55:15.803300+0000', 'last_change': '2024-04-25T08:55:15.803300+0000', 'last_active': '2024-04-25T08:55:15.785462+0000', 'last_peered': '2024-04-25T08:55:15.785462+0000', 'last_clean': '2024-04-25T08:55:15.785462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:55:15.803300+0000', 'last_undegraded': '2024-04-25T08:55:15.803300+0000', 'last_fullsized': '2024-04-25T08:55:15.803300+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:55:15.785462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:55:15.785462+0000', 'last_clean_scrub_stamp': '2024-04-25T08:55:15.785462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:55:21.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-04-25T08:55:21.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:55:15.802692+0000', 'last_change': '2024-04-25T08:55:15.802692+0000', 'last_active': '2024-04-25T08:55:15.785462+0000', 'last_peered': '2024-04-25T08:55:15.785462+0000', 'last_clean': '2024-04-25T08:55:15.785462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:55:15.802692+0000', 'last_undegraded': '2024-04-25T08:55:15.802692+0000', 'last_fullsized': '2024-04-25T08:55:15.802692+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:55:15.785462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:55:15.785462+0000', 'last_clean_scrub_stamp': '2024-04-25T08:55:15.785462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:55:21.529 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:55:21.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.675+0000 7ff2c1e4a640 1 Processor -- start 2024-04-25T08:55:21.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.675+0000 7ff2c1e4a640 1 -- start start 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2c1e4a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff2bc15ba10 0x7ff2bc099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2c1e4a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2bc099f80 0x7ff2bc06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2c1e4a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2bc06c1f0 0x7ff2bc0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2c1e4a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2bc0cbe50 con 0x7ff2bc06c1f0 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2c1e4a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2bc0cfe80 con 0x7ff2bc15ba10 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2c1e4a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc09a3a0 con 0x7ff2bc099f80 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2bbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2bc06c1f0 0x7ff2bc0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2bbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2bc06c1f0 0x7ff2bc0cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42476/0 (socket says 172.21.15.55:42476) 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2bbfff640 1 -- 172.21.15.55:0/748910984 learned_addr learned my addr 172.21.15.55:0/748910984 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2bb7fe640 1 --2- 172.21.15.55:0/748910984 >> v2:172.21.15.167:3300/0 conn(0x7ff2bc15ba10 0x7ff2bc099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2baffd640 1 --2- 172.21.15.55:0/748910984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2bc099f80 0x7ff2bc06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2bbfff640 1 -- 172.21.15.55:0/748910984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2bc099f80 msgr2=0x7ff2bc06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2bbfff640 1 --2- 172.21.15.55:0/748910984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2bc099f80 0x7ff2bc06bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2bbfff640 1 -- 172.21.15.55:0/748910984 >> v2:172.21.15.167:3300/0 conn(0x7ff2bc15ba10 msgr2=0x7ff2bc099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2bbfff640 1 --2- 172.21.15.55:0/748910984 >> v2:172.21.15.167:3300/0 conn(0x7ff2bc15ba10 0x7ff2bc099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2bbfff640 1 -- 172.21.15.55:0/748910984 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc06c680 con 0x7ff2bc06c1f0 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.676+0000 7ff2bb7fe640 1 --2- 172.21.15.55:0/748910984 >> v2:172.21.15.167:3300/0 conn(0x7ff2bc15ba10 0x7ff2bc099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.677+0000 7ff2bbfff640 1 --2- 172.21.15.55:0/748910984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2bc06c1f0 0x7ff2bc0cd220 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc09b2f0 tx=0x7ff2b402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed042139a05d4a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.677+0000 7ff2ba7fc640 1 -- 172.21.15.55:0/748910984 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4036070 con 0x7ff2bc06c1f0 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.677+0000 7ff2ba7fc640 1 -- 172.21.15.55:0/748910984 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b4031600 con 0x7ff2bc06c1f0 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.677+0000 7ff2ba7fc640 1 -- 172.21.15.55:0/748910984 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b40319d0 con 0x7ff2bc06c1f0 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.678+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/748910984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2bc06c1f0 msgr2=0x7ff2bc0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.678+0000 7ff2c1e4a640 1 --2- 172.21.15.55:0/748910984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2bc06c1f0 0x7ff2bc0cd220 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc09b2f0 tx=0x7ff2b402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.678+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/748910984 shutdown_connections 2024-04-25T08:55:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.678+0000 7ff2c1e4a640 1 --2- 172.21.15.55:0/748910984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2bc06c1f0 0x7ff2bc0cd220 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.678+0000 7ff2c1e4a640 1 --2- 172.21.15.55:0/748910984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2bc099f80 0x7ff2bc06bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.678+0000 7ff2c1e4a640 1 --2- 172.21.15.55:0/748910984 >> v2:172.21.15.167:3300/0 conn(0x7ff2bc15ba10 0x7ff2bc099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.678+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/748910984 >> 172.21.15.55:0/748910984 conn(0x7ff2bc0b32f0 msgr2=0x7ff2bc0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.678+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/748910984 shutdown_connections 2024-04-25T08:55:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.678+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/748910984 wait complete. 2024-04-25T08:55:21.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.679+0000 7ff2c1e4a640 1 Processor -- start 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.679+0000 7ff2c1e4a640 1 -- start start 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2c1e4a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2bc06c1f0 0x7ff2bc159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2c1e4a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2bc099f80 0x7ff2bc0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2c1e4a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2bc15ba10 0x7ff2bc0c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2c1e4a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc06cec0 con 0x7ff2bc15ba10 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2c1e4a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc06cbe0 con 0x7ff2bc06c1f0 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2c1e4a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc0cd760 con 0x7ff2bc099f80 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2bc15ba10 0x7ff2bc0c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2bc15ba10 0x7ff2bc0c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42482/0 (socket says 172.21.15.55:42482) 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2bbfff640 1 -- 172.21.15.55:0/1190925591 learned_addr learned my addr 172.21.15.55:0/1190925591 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2bb7fe640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2bc06c1f0 0x7ff2bc159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2baffd640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2bc099f80 0x7ff2bc0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2bbfff640 1 -- 172.21.15.55:0/1190925591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2bc099f80 msgr2=0x7ff2bc0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2bbfff640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2bc099f80 0x7ff2bc0b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2bbfff640 1 -- 172.21.15.55:0/1190925591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2bc06c1f0 msgr2=0x7ff2bc159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2bbfff640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2bc06c1f0 0x7ff2bc159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2bbfff640 1 -- 172.21.15.55:0/1190925591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc1e88f0 con 0x7ff2bc15ba10 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2bb7fe640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2bc06c1f0 0x7ff2bc159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.680+0000 7ff2bbfff640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2bc15ba10 0x7ff2bc0c68f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4034040 tx=0x7ff2b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.681+0000 7ff2a3fff640 1 -- 172.21.15.55:0/1190925591 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4036050 con 0x7ff2bc15ba10 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.681+0000 7ff2a3fff640 1 -- 172.21.15.55:0/1190925591 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b4042070 con 0x7ff2bc15ba10 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.681+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/1190925591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1e8bd0 con 0x7ff2bc15ba10 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.681+0000 7ff2a3fff640 1 -- 172.21.15.55:0/1190925591 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4009510 con 0x7ff2bc15ba10 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.681+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/1190925591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2bc0b5140 con 0x7ff2bc15ba10 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.682+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/1190925591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2bc0749b0 con 0x7ff2bc15ba10 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.682+0000 7ff2a3fff640 1 -- 172.21.15.55:0/1190925591 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff2b4007bf0 con 0x7ff2bc15ba10 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.682+0000 7ff2a3fff640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2a806b4d0 0x7ff2a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.682+0000 7ff2a3fff640 1 -- 172.21.15.55:0/1190925591 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2b40ab130 con 0x7ff2bc15ba10 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.683+0000 7ff2bb7fe640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2a806b4d0 0x7ff2a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.683+0000 7ff2bb7fe640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2a806b4d0 0x7ff2a806d990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac006fd0 tx=0x7ff2ac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.686+0000 7ff2a3fff640 1 -- 172.21.15.55:0/1190925591 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff2bc06c680 con 0x7ff2bc15ba10 2024-04-25T08:55:21.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.938+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/1190925591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff2bc06bfd0 con 0x7ff2bc15ba10 2024-04-25T08:55:21.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.938+0000 7ff2a3fff640 1 -- 172.21.15.55:0/1190925591 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1518 (secure 0 0 0) 0x7ff2b407a160 con 0x7ff2bc15ba10 2024-04-25T08:55:21.928 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:21.928 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":123,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":47,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035209,"num_in_osds":8,"osd_in_since":1714035200,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":94},{"state_name":"creating+peering","count":3}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":243990528,"bytes_avail":772850122752,"bytes_total":773094113280,"inactive_pgs_ratio":0.030927835032343864,"write_bytes_sec":2478,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":22,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5571}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-04-25T08:55:04.567808+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:55:21.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/1190925591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2a806b4d0 msgr2=0x7ff2a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2a806b4d0 0x7ff2a806d990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac006fd0 tx=0x7ff2ac008040 comp rx=0 tx=0).stop 2024-04-25T08:55:21.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/1190925591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2bc15ba10 msgr2=0x7ff2bc0c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:21.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2bc15ba10 0x7ff2bc0c68f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4034040 tx=0x7ff2b4004a40 comp rx=0 tx=0).stop 2024-04-25T08:55:21.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/1190925591 shutdown_connections 2024-04-25T08:55:21.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2a806b4d0 0x7ff2a806d990 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2bc15ba10 0x7ff2bc0c68f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2bc099f80 0x7ff2bc0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 --2- 172.21.15.55:0/1190925591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2bc06c1f0 0x7ff2bc159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:21.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/1190925591 >> 172.21.15.55:0/1190925591 conn(0x7ff2bc0b32f0 msgr2=0x7ff2bc06fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:21.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/1190925591 shutdown_connections 2024-04-25T08:55:21.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:21.940+0000 7ff2c1e4a640 1 -- 172.21.15.55:0/1190925591 wait complete. 2024-04-25T08:55:21.942 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:55:21.942 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:55:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.054+0000 7fe484876640 1 Processor -- start 2024-04-25T08:55:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.054+0000 7fe484876640 1 -- start start 2024-04-25T08:55:22.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.054+0000 7fe484876640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015dce0 0x7fe4800d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:22.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.054+0000 7fe484876640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe4800d35b0 0x7fe4800b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:22.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe484876640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48015e0c0 con 0x7fe4800d1f90 2024-04-25T08:55:22.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe484876640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4800b7b10 con 0x7fe4800d35b0 2024-04-25T08:55:22.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe484876640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800d2510 con 0x7fe48015dce0 2024-04-25T08:55:22.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe4800d1f90 0x7fe48006bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50874/0 (socket says 172.21.15.55:50874) 2024-04-25T08:55:22.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47ed9d640 1 -- 172.21.15.55:0/1856551972 learned_addr learned my addr 172.21.15.55:0/1856551972 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47e59c640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015dce0 0x7fe4800d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47dd9b640 1 --2- 172.21.15.55:0/1856551972 >> v2:172.21.15.167:3300/0 conn(0x7fe4800d35b0 0x7fe4800b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173347873 0 0) 0x7fe48015e0c0 con 0x7fe4800d1f90 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe468003520 con 0x7fe4800d1f90 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3313907865 0 0) 0x7fe468003520 con 0x7fe4800d1f90 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015dce0 msgr2=0x7fe4800d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015dce0 0x7fe4800d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 >> v2:172.21.15.167:3300/0 conn(0x7fe4800d35b0 msgr2=0x7fe4800b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 --2- 172.21.15.55:0/1856551972 >> v2:172.21.15.167:3300/0 conn(0x7fe4800d35b0 0x7fe4800b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4800d27f0 con 0x7fe4800d1f90 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fe4700019f0 con 0x7fe4800d1f90 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 >> v1:172.21.15.55:6789/0 conn(0x7fe4800d1f90 legacy=0x7fe48006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 0x7fe468003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe468004800 0x7fe468004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015dce0 0x7fe4680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800b7b10 con 0x7fe4680039b0 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800d2510 con 0x7fe468004800 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46800b9c0 con 0x7fe48015dce0 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.055+0000 7fe47e59c640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 0x7fe468003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.056+0000 7fe47dd9b640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe468004800 0x7fe468004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.056+0000 7fe47ed9d640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015dce0 0x7fe4680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.056+0000 7fe47e59c640 1 -- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015dce0 msgr2=0x7fe4680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.056+0000 7fe47e59c640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015dce0 0x7fe4680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.056+0000 7fe47e59c640 1 -- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe468004800 msgr2=0x7fe468004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.056+0000 7fe47e59c640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe468004800 0x7fe468004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.056+0000 7fe47e59c640 1 -- 172.21.15.55:0/1856551972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468003520 con 0x7fe4680039b0 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.056+0000 7fe47ed9d640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015dce0 0x7fe4680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.056+0000 7fe47e59c640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 0x7fe468003dd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe478009af0 tx=0x7fe468005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ecab50f015ac49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:22.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.057+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478036070 con 0x7fe4680039b0 2024-04-25T08:55:22.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.057+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe478031400 con 0x7fe4680039b0 2024-04-25T08:55:22.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.057+0000 7fe47d59a640 1 -- 172.21.15.55:0/1856551972 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478009690 con 0x7fe4680039b0 2024-04-25T08:55:22.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.057+0000 7fe484876640 1 -- 172.21.15.55:0/1856551972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 msgr2=0x7fe468003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:22.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.057+0000 7fe484876640 1 --2- 172.21.15.55:0/1856551972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 0x7fe468003dd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe478009af0 tx=0x7fe468005830 comp rx=0 tx=0).stop 2024-04-25T08:55:22.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.057+0000 7fe47ed9d640 1 -- 172.21.15.55:0/1856551972 reap_dead start 2024-04-25T08:55:22.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.057+0000 7fe484876640 1 -- 172.21.15.55:0/1856551972 shutdown_connections 2024-04-25T08:55:22.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.057+0000 7fe484876640 1 -- 172.21.15.55:0/1856551972 >> 172.21.15.55:0/1856551972 conn(0x7fe480072900 msgr2=0x7fe4800d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:22.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.057+0000 7fe484876640 1 -- 172.21.15.55:0/1856551972 shutdown_connections 2024-04-25T08:55:22.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.057+0000 7fe484876640 1 -- 172.21.15.55:0/1856551972 wait complete. 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.058+0000 7fe484876640 1 Processor -- start 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.059+0000 7fe484876640 1 -- start start 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.059+0000 7fe484876640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 0x7fe4801f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.059+0000 7fe484876640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015f070 0x7fe48015fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.059+0000 7fe484876640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe480160090 0x7fe4800ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.059+0000 7fe484876640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800d3090 con 0x7fe4680039b0 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.059+0000 7fe484876640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800d2db0 con 0x7fe480160090 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.059+0000 7fe484876640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800b9820 con 0x7fe48015f070 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.059+0000 7fe47e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 0x7fe4801f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.059+0000 7fe47e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 0x7fe4801f6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42506/0 (socket says 172.21.15.55:42506) 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.059+0000 7fe47e59c640 1 -- 172.21.15.55:0/851283560 learned_addr learned my addr 172.21.15.55:0/851283560 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.059+0000 7fe47dd9b640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015f070 0x7fe48015fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe47ed9d640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe480160090 0x7fe4800ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe47e59c640 1 -- 172.21.15.55:0/851283560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015f070 msgr2=0x7fe48015fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe47e59c640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015f070 0x7fe48015fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe47e59c640 1 -- 172.21.15.55:0/851283560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe480160090 msgr2=0x7fe4800ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe47e59c640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe480160090 0x7fe4800ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe47e59c640 1 -- 172.21.15.55:0/851283560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480160530 con 0x7fe4680039b0 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe47dd9b640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015f070 0x7fe48015fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe47e59c640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 0x7fe4801f6190 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe478034040 tx=0x7fe478004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe46effd640 1 -- 172.21.15.55:0/851283560 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478041020 con 0x7fe4680039b0 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe46effd640 1 -- 172.21.15.55:0/851283560 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47803c470 con 0x7fe4680039b0 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe484876640 1 -- 172.21.15.55:0/851283560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe480157880 con 0x7fe4680039b0 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe46effd640 1 -- 172.21.15.55:0/851283560 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478036040 con 0x7fe4680039b0 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.060+0000 7fe484876640 1 -- 172.21.15.55:0/851283560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe480157e40 con 0x7fe4680039b0 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.061+0000 7fe484876640 1 -- 172.21.15.55:0/851283560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe480158280 con 0x7fe4680039b0 2024-04-25T08:55:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.062+0000 7fe46effd640 1 -- 172.21.15.55:0/851283560 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe478044020 con 0x7fe4680039b0 2024-04-25T08:55:22.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.062+0000 7fe46effd640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe46006b4d0 0x7fe46006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:22.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.062+0000 7fe46effd640 1 -- 172.21.15.55:0/851283560 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4780aaa30 con 0x7fe4680039b0 2024-04-25T08:55:22.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.062+0000 7fe47dd9b640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe46006b4d0 0x7fe46006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:22.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.063+0000 7fe47dd9b640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe46006b4d0 0x7fe46006d990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe48015a7c0 tx=0x7fe474008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:22.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.067+0000 7fe46effd640 1 -- 172.21.15.55:0/851283560 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe47804b030 con 0x7fe4680039b0 2024-04-25T08:55:22.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.246+0000 7fe484876640 1 -- 172.21.15.55:0/851283560 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4800b2e40 con 0x7fe46006b4d0 2024-04-25T08:55:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.252+0000 7fe46effd640 1 -- 172.21.15.55:0/851283560 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251706 (secure 0 0 0) 0x7fe4800b2e40 con 0x7fe46006b4d0 2024-04-25T08:55:22.244 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:22.246 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:55:22.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.254+0000 7fe484876640 1 -- 172.21.15.55:0/851283560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe46006b4d0 msgr2=0x7fe46006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:22.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.254+0000 7fe484876640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe46006b4d0 0x7fe46006d990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe48015a7c0 tx=0x7fe474008040 comp rx=0 tx=0).stop 2024-04-25T08:55:22.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.254+0000 7fe484876640 1 -- 172.21.15.55:0/851283560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 msgr2=0x7fe4801f6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.254+0000 7fe484876640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 0x7fe4801f6190 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe478034040 tx=0x7fe478004730 comp rx=0 tx=0).stop 2024-04-25T08:55:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.254+0000 7fe484876640 1 -- 172.21.15.55:0/851283560 shutdown_connections 2024-04-25T08:55:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.254+0000 7fe484876640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe46006b4d0 0x7fe46006d990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.254+0000 7fe484876640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe480160090 0x7fe4800ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.254+0000 7fe484876640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe48015f070 0x7fe48015fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.254+0000 7fe484876640 1 --2- 172.21.15.55:0/851283560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680039b0 0x7fe4801f6190 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.254+0000 7fe484876640 1 -- 172.21.15.55:0/851283560 >> 172.21.15.55:0/851283560 conn(0x7fe480072900 msgr2=0x7fe4800d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.255+0000 7fe484876640 1 -- 172.21.15.55:0/851283560 shutdown_connections 2024-04-25T08:55:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:22.255+0000 7fe484876640 1 -- 172.21.15.55:0/851283560 wait complete. 2024-04-25T08:55:22.255 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-04-25T08:55:20.571126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238272,"kb_used_data":5452,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736448,"statfs":{"total":773094113280,"available":772850122752,"internally_reserved":0,"allocated":5582848,"data_stored":2933219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.785197"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836959+0000","last_change":"2024-04-25T08:55:16.832561+0000","last_active":"2024-04-25T08:55:17.836959+0000","last_peered":"2024-04-25T08:55:17.836959+0000","last_clean":"2024-04-25T08:55:17.836959+0000","last_became_active":"2024-04-25T08:55:16.832224+0000","last_became_peered":"2024-04-25T08:55:16.832224+0000","last_unstale":"2024-04-25T08:55:17.836959+0000","last_undegraded":"2024-04-25T08:55:17.836959+0000","last_fullsized":"2024-04-25T08:55:17.836959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540207+0000","last_change":"2024-04-25T08:55:16.842805+0000","last_active":"2024-04-25T08:55:18.540207+0000","last_peered":"2024-04-25T08:55:18.540207+0000","last_clean":"2024-04-25T08:55:18.540207+0000","last_became_active":"2024-04-25T08:55:16.842348+0000","last_became_peered":"2024-04-25T08:55:16.842348+0000","last_unstale":"2024-04-25T08:55:18.540207+0000","last_undegraded":"2024-04-25T08:55:18.540207+0000","last_fullsized":"2024-04-25T08:55:18.540207+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539800+0000","last_change":"2024-04-25T08:55:16.829363+0000","last_active":"2024-04-25T08:55:18.539800+0000","last_peered":"2024-04-25T08:55:18.539800+0000","last_clean":"2024-04-25T08:55:18.539800+0000","last_became_active":"2024-04-25T08:55:16.828941+0000","last_became_peered":"2024-04-25T08:55:16.828941+0000","last_unstale":"2024-04-25T08:55:18.539800+0000","last_undegraded":"2024-04-25T08:55:18.539800+0000","last_fullsized":"2024-04-25T08:55:18.539800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540318+0000","last_change":"2024-04-25T08:55:16.841043+0000","last_active":"2024-04-25T08:55:18.540318+0000","last_peered":"2024-04-25T08:55:18.540318+0000","last_clean":"2024-04-25T08:55:18.540318+0000","last_became_active":"2024-04-25T08:55:16.838610+0000","last_became_peered":"2024-04-25T08:55:16.838610+0000","last_unstale":"2024-04-25T08:55:18.540318+0000","last_undegraded":"2024-04-25T08:55:18.540318+0000","last_fullsized":"2024-04-25T08:55:18.540318+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539972+0000","last_change":"2024-04-25T08:55:16.843435+0000","last_active":"2024-04-25T08:55:18.539972+0000","last_peered":"2024-04-25T08:55:18.539972+0000","last_clean":"2024-04-25T08:55:18.539972+0000","last_became_active":"2024-04-25T08:55:16.842897+0000","last_became_peered":"2024-04-25T08:55:16.842897+0000","last_unstale":"2024-04-25T08:55:18.539972+0000","last_undegraded":"2024-04-25T08:55:18.539972+0000","last_fullsized":"2024-04-25T08:55:18.539972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837578+0000","last_change":"2024-04-25T08:55:16.826490+0000","last_active":"2024-04-25T08:55:17.837578+0000","last_peered":"2024-04-25T08:55:17.837578+0000","last_clean":"2024-04-25T08:55:17.837578+0000","last_became_active":"2024-04-25T08:55:16.826201+0000","last_became_peered":"2024-04-25T08:55:16.826201+0000","last_unstale":"2024-04-25T08:55:17.837578+0000","last_undegraded":"2024-04-25T08:55:17.837578+0000","last_fullsized":"2024-04-25T08:55:17.837578+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:34.683007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837295+0000","last_change":"2024-04-25T08:55:16.829027+0000","last_active":"2024-04-25T08:55:17.837295+0000","last_peered":"2024-04-25T08:55:17.837295+0000","last_clean":"2024-04-25T08:55:17.837295+0000","last_became_active":"2024-04-25T08:55:16.828724+0000","last_became_peered":"2024-04-25T08:55:16.828724+0000","last_unstale":"2024-04-25T08:55:17.837295+0000","last_undegraded":"2024-04-25T08:55:17.837295+0000","last_fullsized":"2024-04-25T08:55:17.837295+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539748+0000","last_change":"2024-04-25T08:55:16.840752+0000","last_active":"2024-04-25T08:55:18.539748+0000","last_peered":"2024-04-25T08:55:18.539748+0000","last_clean":"2024-04-25T08:55:18.539748+0000","last_became_active":"2024-04-25T08:55:16.838830+0000","last_became_peered":"2024-04-25T08:55:16.838830+0000","last_unstale":"2024-04-25T08:55:18.539748+0000","last_undegraded":"2024-04-25T08:55:18.539748+0000","last_fullsized":"2024-04-25T08:55:18.539748+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:11.677071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540796+0000","last_change":"2024-04-25T08:55:16.840080+0000","last_active":"2024-04-25T08:55:18.540796+0000","last_peered":"2024-04-25T08:55:18.540796+0000","last_clean":"2024-04-25T08:55:18.540796+0000","last_became_active":"2024-04-25T08:55:16.837974+0000","last_became_peered":"2024-04-25T08:55:16.837974+0000","last_unstale":"2024-04-25T08:55:18.540796+0000","last_undegraded":"2024-04-25T08:55:18.540796+0000","last_fullsized":"2024-04-25T08:55:18.540796+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540698+0000","last_change":"2024-04-25T08:55:16.838746+0000","last_active":"2024-04-25T08:55:18.540698+0000","last_peered":"2024-04-25T08:55:18.540698+0000","last_clean":"2024-04-25T08:55:18.540698+0000","last_became_active":"2024-04-25T08:55:16.838330+0000","last_became_peered":"2024-04-25T08:55:16.838330+0000","last_unstale":"2024-04-25T08:55:18.540698+0000","last_undegraded":"2024-04-25T08:55:18.540698+0000","last_fullsized":"2024-04-25T08:55:18.540698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540035+0000","last_change":"2024-04-25T08:55:16.841755+0000","last_active":"2024-04-25T08:55:18.540035+0000","last_peered":"2024-04-25T08:55:18.540035+0000","last_clean":"2024-04-25T08:55:18.540035+0000","last_became_active":"2024-04-25T08:55:16.840957+0000","last_became_peered":"2024-04-25T08:55:16.840957+0000","last_unstale":"2024-04-25T08:55:18.540035+0000","last_undegraded":"2024-04-25T08:55:18.540035+0000","last_fullsized":"2024-04-25T08:55:18.540035+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.956125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540100+0000","last_change":"2024-04-25T08:55:16.834783+0000","last_active":"2024-04-25T08:55:18.540100+0000","last_peered":"2024-04-25T08:55:18.540100+0000","last_clean":"2024-04-25T08:55:18.540100+0000","last_became_active":"2024-04-25T08:55:16.834516+0000","last_became_peered":"2024-04-25T08:55:16.834516+0000","last_unstale":"2024-04-25T08:55:18.540100+0000","last_undegraded":"2024-04-25T08:55:18.540100+0000","last_fullsized":"2024-04-25T08:55:18.540100+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540279+0000","last_change":"2024-04-25T08:55:16.846385+0000","last_active":"2024-04-25T08:55:18.540279+0000","last_peered":"2024-04-25T08:55:18.540279+0000","last_clean":"2024-04-25T08:55:18.540279+0000","last_became_active":"2024-04-25T08:55:16.846086+0000","last_became_peered":"2024-04-25T08:55:16.846086+0000","last_unstale":"2024-04-25T08:55:18.540279+0000","last_undegraded":"2024-04-25T08:55:18.540279+0000","last_fullsized":"2024-04-25T08:55:18.540279+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:37.559936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539706+0000","last_change":"2024-04-25T08:55:16.843288+0000","last_active":"2024-04-25T08:55:18.539706+0000","last_peered":"2024-04-25T08:55:18.539706+0000","last_clean":"2024-04-25T08:55:18.539706+0000","last_became_active":"2024-04-25T08:55:16.838291+0000","last_became_peered":"2024-04-25T08:55:16.838291+0000","last_unstale":"2024-04-25T08:55:18.539706+0000","last_undegraded":"2024-04-25T08:55:18.539706+0000","last_fullsized":"2024-04-25T08:55:18.539706+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:09.916126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837424+0000","last_change":"2024-04-25T08:55:16.828188+0000","last_active":"2024-04-25T08:55:17.837424+0000","last_peered":"2024-04-25T08:55:17.837424+0000","last_clean":"2024-04-25T08:55:17.837424+0000","last_became_active":"2024-04-25T08:55:16.827799+0000","last_became_peered":"2024-04-25T08:55:16.827799+0000","last_unstale":"2024-04-25T08:55:17.837424+0000","last_undegraded":"2024-04-25T08:55:17.837424+0000","last_fullsized":"2024-04-25T08:55:17.837424+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:44.172513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837279+0000","last_change":"2024-04-25T08:55:16.843112+0000","last_active":"2024-04-25T08:55:17.837279+0000","last_peered":"2024-04-25T08:55:17.837279+0000","last_clean":"2024-04-25T08:55:17.837279+0000","last_became_active":"2024-04-25T08:55:16.842799+0000","last_became_peered":"2024-04-25T08:55:16.842799+0000","last_unstale":"2024-04-25T08:55:17.837279+0000","last_undegraded":"2024-04-25T08:55:17.837279+0000","last_fullsized":"2024-04-25T08:55:17.837279+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:23.800462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540545+0000","last_change":"2024-04-25T08:55:16.833189+0000","last_active":"2024-04-25T08:55:18.540545+0000","last_peered":"2024-04-25T08:55:18.540545+0000","last_clean":"2024-04-25T08:55:18.540545+0000","last_became_active":"2024-04-25T08:55:16.831963+0000","last_became_peered":"2024-04-25T08:55:16.831963+0000","last_unstale":"2024-04-25T08:55:18.540545+0000","last_undegraded":"2024-04-25T08:55:18.540545+0000","last_fullsized":"2024-04-25T08:55:18.540545+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540421+0000","last_change":"2024-04-25T08:55:16.841886+0000","last_active":"2024-04-25T08:55:18.540421+0000","last_peered":"2024-04-25T08:55:18.540421+0000","last_clean":"2024-04-25T08:55:18.540421+0000","last_became_active":"2024-04-25T08:55:16.841578+0000","last_became_peered":"2024-04-25T08:55:16.841578+0000","last_unstale":"2024-04-25T08:55:18.540421+0000","last_undegraded":"2024-04-25T08:55:18.540421+0000","last_fullsized":"2024-04-25T08:55:18.540421+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837789+0000","last_change":"2024-04-25T08:55:16.843485+0000","last_active":"2024-04-25T08:55:17.837789+0000","last_peered":"2024-04-25T08:55:17.837789+0000","last_clean":"2024-04-25T08:55:17.837789+0000","last_became_active":"2024-04-25T08:55:16.843130+0000","last_became_peered":"2024-04-25T08:55:16.843130+0000","last_unstale":"2024-04-25T08:55:17.837789+0000","last_undegraded":"2024-04-25T08:55:17.837789+0000","last_fullsized":"2024-04-25T08:55:17.837789+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:12.657487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540145+0000","last_change":"2024-04-25T08:55:16.841939+0000","last_active":"2024-04-25T08:55:18.540145+0000","last_peered":"2024-04-25T08:55:18.540145+0000","last_clean":"2024-04-25T08:55:18.540145+0000","last_became_active":"2024-04-25T08:55:16.841657+0000","last_became_peered":"2024-04-25T08:55:16.841657+0000","last_unstale":"2024-04-25T08:55:18.540145+0000","last_undegraded":"2024-04-25T08:55:18.540145+0000","last_fullsized":"2024-04-25T08:55:18.540145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:14.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837507+0000","last_change":"2024-04-25T08:55:16.821355+0000","last_active":"2024-04-25T08:55:17.837507+0000","last_peered":"2024-04-25T08:55:17.837507+0000","last_clean":"2024-04-25T08:55:17.837507+0000","last_became_active":"2024-04-25T08:55:16.821067+0000","last_became_peered":"2024-04-25T08:55:16.821067+0000","last_unstale":"2024-04-25T08:55:17.837507+0000","last_undegraded":"2024-04-25T08:55:17.837507+0000","last_fullsized":"2024-04-25T08:55:17.837507+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.333983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539859+0000","last_change":"2024-04-25T08:55:16.838547+0000","last_active":"2024-04-25T08:55:18.539859+0000","last_peered":"2024-04-25T08:55:18.539859+0000","last_clean":"2024-04-25T08:55:18.539859+0000","last_became_active":"2024-04-25T08:55:16.837583+0000","last_became_peered":"2024-04-25T08:55:16.837583+0000","last_unstale":"2024-04-25T08:55:18.539859+0000","last_undegraded":"2024-04-25T08:55:18.539859+0000","last_fullsized":"2024-04-25T08:55:18.539859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:36.671667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836896+0000","last_change":"2024-04-25T08:55:16.828541+0000","last_active":"2024-04-25T08:55:17.836896+0000","last_peered":"2024-04-25T08:55:17.836896+0000","last_clean":"2024-04-25T08:55:17.836896+0000","last_became_active":"2024-04-25T08:55:16.828068+0000","last_became_peered":"2024-04-25T08:55:16.828068+0000","last_unstale":"2024-04-25T08:55:17.836896+0000","last_undegraded":"2024-04-25T08:55:17.836896+0000","last_fullsized":"2024-04-25T08:55:17.836896+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:58.797425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837412+0000","last_change":"2024-04-25T08:55:16.828256+0000","last_active":"2024-04-25T08:55:17.837412+0000","last_peered":"2024-04-25T08:55:17.837412+0000","last_clean":"2024-04-25T08:55:17.837412+0000","last_became_active":"2024-04-25T08:55:16.827956+0000","last_became_peered":"2024-04-25T08:55:16.827956+0000","last_unstale":"2024-04-25T08:55:17.837412+0000","last_undegraded":"2024-04-25T08:55:17.837412+0000","last_fullsized":"2024-04-25T08:55:17.837412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.294126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837937+0000","last_change":"2024-04-25T08:55:16.831080+0000","last_active":"2024-04-25T08:55:17.837937+0000","last_peered":"2024-04-25T08:55:17.837937+0000","last_clean":"2024-04-25T08:55:17.837937+0000","last_became_active":"2024-04-25T08:55:16.830803+0000","last_became_peered":"2024-04-25T08:55:16.830803+0000","last_unstale":"2024-04-25T08:55:17.837937+0000","last_undegraded":"2024-04-25T08:55:17.837937+0000","last_fullsized":"2024-04-25T08:55:17.837937+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:44.216939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540190+0000","last_change":"2024-04-25T08:55:16.846495+0000","last_active":"2024-04-25T08:55:18.540190+0000","last_peered":"2024-04-25T08:55:18.540190+0000","last_clean":"2024-04-25T08:55:18.540190+0000","last_became_active":"2024-04-25T08:55:16.846097+0000","last_became_peered":"2024-04-25T08:55:16.846097+0000","last_unstale":"2024-04-25T08:55:18.540190+0000","last_undegraded":"2024-04-25T08:55:18.540190+0000","last_fullsized":"2024-04-25T08:55:18.540190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:00.833210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540297+0000","last_change":"2024-04-25T08:55:16.832406+0000","last_active":"2024-04-25T08:55:18.540297+0000","last_peered":"2024-04-25T08:55:18.540297+0000","last_clean":"2024-04-25T08:55:18.540297+0000","last_became_active":"2024-04-25T08:55:16.832117+0000","last_became_peered":"2024-04-25T08:55:16.832117+0000","last_unstale":"2024-04-25T08:55:18.540297+0000","last_undegraded":"2024-04-25T08:55:18.540297+0000","last_fullsized":"2024-04-25T08:55:18.540297+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540182+0000","last_change":"2024-04-25T08:55:16.831162+0000","last_active":"2024-04-25T08:55:18.540182+0000","last_peered":"2024-04-25T08:55:18.540182+0000","last_clean":"2024-04-25T08:55:18.540182+0000","last_became_active":"2024-04-25T08:55:16.830889+0000","last_became_peered":"2024-04-25T08:55:16.830889+0000","last_unstale":"2024-04-25T08:55:18.540182+0000","last_undegraded":"2024-04-25T08:55:18.540182+0000","last_fullsized":"2024-04-25T08:55:18.540182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836963+0000","last_change":"2024-04-25T08:55:16.829707+0000","last_active":"2024-04-25T08:55:17.836963+0000","last_peered":"2024-04-25T08:55:17.836963+0000","last_clean":"2024-04-25T08:55:17.836963+0000","last_became_active":"2024-04-25T08:55:16.829062+0000","last_became_peered":"2024-04-25T08:55:16.829062+0000","last_unstale":"2024-04-25T08:55:17.836963+0000","last_undegraded":"2024-04-25T08:55:17.836963+0000","last_fullsized":"2024-04-25T08:55:17.836963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:15.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539758+0000","last_change":"2024-04-25T08:55:16.830080+0000","last_active":"2024-04-25T08:55:18.539758+0000","last_peered":"2024-04-25T08:55:18.539758+0000","last_clean":"2024-04-25T08:55:18.539758+0000","last_became_active":"2024-04-25T08:55:16.829695+0000","last_became_peered":"2024-04-25T08:55:16.829695+0000","last_unstale":"2024-04-25T08:55:18.539758+0000","last_undegraded":"2024-04-25T08:55:18.539758+0000","last_fullsized":"2024-04-25T08:55:18.539758+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:36.671667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837487+0000","last_change":"2024-04-25T08:55:16.822654+0000","last_active":"2024-04-25T08:55:17.837487+0000","last_peered":"2024-04-25T08:55:17.837487+0000","last_clean":"2024-04-25T08:55:17.837487+0000","last_became_active":"2024-04-25T08:55:16.822381+0000","last_became_peered":"2024-04-25T08:55:16.822381+0000","last_unstale":"2024-04-25T08:55:17.837487+0000","last_undegraded":"2024-04-25T08:55:17.837487+0000","last_fullsized":"2024-04-25T08:55:17.837487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:26.668007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539713+0000","last_change":"2024-04-25T08:55:16.838404+0000","last_active":"2024-04-25T08:55:18.539713+0000","last_peered":"2024-04-25T08:55:18.539713+0000","last_clean":"2024-04-25T08:55:18.539713+0000","last_became_active":"2024-04-25T08:55:16.838105+0000","last_became_peered":"2024-04-25T08:55:16.838105+0000","last_unstale":"2024-04-25T08:55:18.539713+0000","last_undegraded":"2024-04-25T08:55:18.539713+0000","last_fullsized":"2024-04-25T08:55:18.539713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:38.008819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.804067+0000","last_change":"2024-04-25T08:55:15.804067+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.804067+0000","last_undegraded":"2024-04-25T08:55:15.804067+0000","last_fullsized":"2024-04-25T08:55:15.804067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837824+0000","last_change":"2024-04-25T08:55:15.812917+0000","last_active":"2024-04-25T08:55:17.837824+0000","last_peered":"2024-04-25T08:55:17.837824+0000","last_clean":"2024-04-25T08:55:17.837824+0000","last_became_active":"2024-04-25T08:55:15.812416+0000","last_became_peered":"2024-04-25T08:55:15.812416+0000","last_unstale":"2024-04-25T08:55:17.837824+0000","last_undegraded":"2024-04-25T08:55:17.837824+0000","last_fullsized":"2024-04-25T08:55:17.837824+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:08.909603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837905+0000","last_change":"2024-04-25T08:55:16.832501+0000","last_active":"2024-04-25T08:55:17.837905+0000","last_peered":"2024-04-25T08:55:17.837905+0000","last_clean":"2024-04-25T08:55:17.837905+0000","last_became_active":"2024-04-25T08:55:16.832159+0000","last_became_peered":"2024-04-25T08:55:16.832159+0000","last_unstale":"2024-04-25T08:55:17.837905+0000","last_undegraded":"2024-04-25T08:55:17.837905+0000","last_fullsized":"2024-04-25T08:55:17.837905+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:46.528440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540498+0000","last_change":"2024-04-25T08:55:15.804587+0000","last_active":"2024-04-25T08:55:18.540498+0000","last_peered":"2024-04-25T08:55:18.540498+0000","last_clean":"2024-04-25T08:55:18.540498+0000","last_became_active":"2024-04-25T08:55:15.802674+0000","last_became_peered":"2024-04-25T08:55:15.802674+0000","last_unstale":"2024-04-25T08:55:18.540498+0000","last_undegraded":"2024-04-25T08:55:18.540498+0000","last_fullsized":"2024-04-25T08:55:18.540498+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:14.287603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540254+0000","last_change":"2024-04-25T08:55:16.836374+0000","last_active":"2024-04-25T08:55:18.540254+0000","last_peered":"2024-04-25T08:55:18.540254+0000","last_clean":"2024-04-25T08:55:18.540254+0000","last_became_active":"2024-04-25T08:55:16.835872+0000","last_became_peered":"2024-04-25T08:55:16.835872+0000","last_unstale":"2024-04-25T08:55:18.540254+0000","last_undegraded":"2024-04-25T08:55:18.540254+0000","last_fullsized":"2024-04-25T08:55:18.540254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811418+0000","last_change":"2024-04-25T08:55:15.805969+0000","last_active":"2024-04-25T08:55:15.811418+0000","last_peered":"2024-04-25T08:55:15.811418+0000","last_clean":"2024-04-25T08:55:15.811418+0000","last_became_active":"2024-04-25T08:55:15.805679+0000","last_became_peered":"2024-04-25T08:55:15.805679+0000","last_unstale":"2024-04-25T08:55:15.811418+0000","last_undegraded":"2024-04-25T08:55:15.811418+0000","last_fullsized":"2024-04-25T08:55:15.811418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:23.227100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.803300+0000","last_change":"2024-04-25T08:55:15.803300+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.803300+0000","last_undegraded":"2024-04-25T08:55:15.803300+0000","last_fullsized":"2024-04-25T08:55:15.803300+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837602+0000","last_change":"2024-04-25T08:55:15.810287+0000","last_active":"2024-04-25T08:55:17.837602+0000","last_peered":"2024-04-25T08:55:17.837602+0000","last_clean":"2024-04-25T08:55:17.837602+0000","last_became_active":"2024-04-25T08:55:15.810000+0000","last_became_peered":"2024-04-25T08:55:15.810000+0000","last_unstale":"2024-04-25T08:55:17.837602+0000","last_undegraded":"2024-04-25T08:55:17.837602+0000","last_fullsized":"2024-04-25T08:55:17.837602+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:43.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539785+0000","last_change":"2024-04-25T08:55:16.832716+0000","last_active":"2024-04-25T08:55:18.539785+0000","last_peered":"2024-04-25T08:55:18.539785+0000","last_clean":"2024-04-25T08:55:18.539785+0000","last_became_active":"2024-04-25T08:55:16.832332+0000","last_became_peered":"2024-04-25T08:55:16.832332+0000","last_unstale":"2024-04-25T08:55:18.539785+0000","last_undegraded":"2024-04-25T08:55:18.539785+0000","last_fullsized":"2024-04-25T08:55:18.539785+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.956125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837620+0000","last_change":"2024-04-25T08:55:15.810523+0000","last_active":"2024-04-25T08:55:17.837620+0000","last_peered":"2024-04-25T08:55:17.837620+0000","last_clean":"2024-04-25T08:55:17.837620+0000","last_became_active":"2024-04-25T08:55:15.809802+0000","last_became_peered":"2024-04-25T08:55:15.809802+0000","last_unstale":"2024-04-25T08:55:17.837620+0000","last_undegraded":"2024-04-25T08:55:17.837620+0000","last_fullsized":"2024-04-25T08:55:17.837620+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.053850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540961+0000","last_change":"2024-04-25T08:55:16.841348+0000","last_active":"2024-04-25T08:55:18.540961+0000","last_peered":"2024-04-25T08:55:18.540961+0000","last_clean":"2024-04-25T08:55:18.540961+0000","last_became_active":"2024-04-25T08:55:16.840890+0000","last_became_peered":"2024-04-25T08:55:16.840890+0000","last_unstale":"2024-04-25T08:55:18.540961+0000","last_undegraded":"2024-04-25T08:55:18.540961+0000","last_fullsized":"2024-04-25T08:55:18.540961+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:36.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539863+0000","last_change":"2024-04-25T08:55:15.808364+0000","last_active":"2024-04-25T08:55:18.539863+0000","last_peered":"2024-04-25T08:55:18.539863+0000","last_clean":"2024-04-25T08:55:18.539863+0000","last_became_active":"2024-04-25T08:55:15.808068+0000","last_became_peered":"2024-04-25T08:55:15.808068+0000","last_unstale":"2024-04-25T08:55:18.539863+0000","last_undegraded":"2024-04-25T08:55:18.539863+0000","last_fullsized":"2024-04-25T08:55:18.539863+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:00.314074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539499+0000","last_change":"2024-04-25T08:55:16.840358+0000","last_active":"2024-04-25T08:55:18.539499+0000","last_peered":"2024-04-25T08:55:18.539499+0000","last_clean":"2024-04-25T08:55:18.539499+0000","last_became_active":"2024-04-25T08:55:16.837947+0000","last_became_peered":"2024-04-25T08:55:16.837947+0000","last_unstale":"2024-04-25T08:55:18.539499+0000","last_undegraded":"2024-04-25T08:55:18.539499+0000","last_fullsized":"2024-04-25T08:55:18.539499+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:25.830198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539474+0000","last_change":"2024-04-25T08:55:15.809376+0000","last_active":"2024-04-25T08:55:18.539474+0000","last_peered":"2024-04-25T08:55:18.539474+0000","last_clean":"2024-04-25T08:55:18.539474+0000","last_became_active":"2024-04-25T08:55:15.808982+0000","last_became_peered":"2024-04-25T08:55:15.808982+0000","last_unstale":"2024-04-25T08:55:18.539474+0000","last_undegraded":"2024-04-25T08:55:18.539474+0000","last_fullsized":"2024-04-25T08:55:18.539474+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:43.806513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836650+0000","last_change":"2024-04-25T08:55:16.829231+0000","last_active":"2024-04-25T08:55:17.836650+0000","last_peered":"2024-04-25T08:55:17.836650+0000","last_clean":"2024-04-25T08:55:17.836650+0000","last_became_active":"2024-04-25T08:55:16.828876+0000","last_became_peered":"2024-04-25T08:55:16.828876+0000","last_unstale":"2024-04-25T08:55:17.836650+0000","last_undegraded":"2024-04-25T08:55:17.836650+0000","last_fullsized":"2024-04-25T08:55:17.836650+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:23.778385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540129+0000","last_change":"2024-04-25T08:55:15.810673+0000","last_active":"2024-04-25T08:55:18.540129+0000","last_peered":"2024-04-25T08:55:18.540129+0000","last_clean":"2024-04-25T08:55:18.540129+0000","last_became_active":"2024-04-25T08:55:15.809289+0000","last_became_peered":"2024-04-25T08:55:15.809289+0000","last_unstale":"2024-04-25T08:55:18.540129+0000","last_undegraded":"2024-04-25T08:55:18.540129+0000","last_fullsized":"2024-04-25T08:55:18.540129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.016665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540504+0000","last_change":"2024-04-25T08:55:16.841663+0000","last_active":"2024-04-25T08:55:18.540504+0000","last_peered":"2024-04-25T08:55:18.540504+0000","last_clean":"2024-04-25T08:55:18.540504+0000","last_became_active":"2024-04-25T08:55:16.841397+0000","last_became_peered":"2024-04-25T08:55:16.841397+0000","last_unstale":"2024-04-25T08:55:18.540504+0000","last_undegraded":"2024-04-25T08:55:18.540504+0000","last_fullsized":"2024-04-25T08:55:18.540504+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540624+0000","last_change":"2024-04-25T08:55:15.808307+0000","last_active":"2024-04-25T08:55:18.540624+0000","last_peered":"2024-04-25T08:55:18.540624+0000","last_clean":"2024-04-25T08:55:18.540624+0000","last_became_active":"2024-04-25T08:55:15.808012+0000","last_became_peered":"2024-04-25T08:55:15.808012+0000","last_unstale":"2024-04-25T08:55:18.540624+0000","last_undegraded":"2024-04-25T08:55:18.540624+0000","last_fullsized":"2024-04-25T08:55:18.540624+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:11.650964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837119+0000","last_change":"2024-04-25T08:55:16.824657+0000","last_active":"2024-04-25T08:55:17.837119+0000","last_peered":"2024-04-25T08:55:17.837119+0000","last_clean":"2024-04-25T08:55:17.837119+0000","last_became_active":"2024-04-25T08:55:16.824372+0000","last_became_peered":"2024-04-25T08:55:16.824372+0000","last_unstale":"2024-04-25T08:55:17.837119+0000","last_undegraded":"2024-04-25T08:55:17.837119+0000","last_fullsized":"2024-04-25T08:55:17.837119+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541025+0000","last_change":"2024-04-25T08:55:15.808834+0000","last_active":"2024-04-25T08:55:18.541025+0000","last_peered":"2024-04-25T08:55:18.541025+0000","last_clean":"2024-04-25T08:55:18.541025+0000","last_became_active":"2024-04-25T08:55:15.808535+0000","last_became_peered":"2024-04-25T08:55:15.808535+0000","last_unstale":"2024-04-25T08:55:18.541025+0000","last_undegraded":"2024-04-25T08:55:18.541025+0000","last_fullsized":"2024-04-25T08:55:18.541025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:51.724373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837714+0000","last_change":"2024-04-25T08:55:16.829816+0000","last_active":"2024-04-25T08:55:17.837714+0000","last_peered":"2024-04-25T08:55:17.837714+0000","last_clean":"2024-04-25T08:55:17.837714+0000","last_became_active":"2024-04-25T08:55:16.829214+0000","last_became_peered":"2024-04-25T08:55:16.829214+0000","last_unstale":"2024-04-25T08:55:17.837714+0000","last_undegraded":"2024-04-25T08:55:17.837714+0000","last_fullsized":"2024-04-25T08:55:17.837714+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:34.646693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837921+0000","last_change":"2024-04-25T08:55:15.803912+0000","last_active":"2024-04-25T08:55:17.837921+0000","last_peered":"2024-04-25T08:55:17.837921+0000","last_clean":"2024-04-25T08:55:17.837921+0000","last_became_active":"2024-04-25T08:55:15.803618+0000","last_became_peered":"2024-04-25T08:55:15.803618+0000","last_unstale":"2024-04-25T08:55:17.837921+0000","last_undegraded":"2024-04-25T08:55:17.837921+0000","last_fullsized":"2024-04-25T08:55:17.837921+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:21.098215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837797+0000","last_change":"2024-04-25T08:55:16.836929+0000","last_active":"2024-04-25T08:55:17.837797+0000","last_peered":"2024-04-25T08:55:17.837797+0000","last_clean":"2024-04-25T08:55:17.837797+0000","last_became_active":"2024-04-25T08:55:16.836637+0000","last_became_peered":"2024-04-25T08:55:16.836637+0000","last_unstale":"2024-04-25T08:55:17.837797+0000","last_undegraded":"2024-04-25T08:55:17.837797+0000","last_fullsized":"2024-04-25T08:55:17.837797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:36.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540179+0000","last_change":"2024-04-25T08:55:15.804532+0000","last_active":"2024-04-25T08:55:18.540179+0000","last_peered":"2024-04-25T08:55:18.540179+0000","last_clean":"2024-04-25T08:55:18.540179+0000","last_became_active":"2024-04-25T08:55:15.804121+0000","last_became_peered":"2024-04-25T08:55:15.804121+0000","last_unstale":"2024-04-25T08:55:18.540179+0000","last_undegraded":"2024-04-25T08:55:18.540179+0000","last_fullsized":"2024-04-25T08:55:18.540179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.796101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837148+0000","last_change":"2024-04-25T08:55:16.841731+0000","last_active":"2024-04-25T08:55:17.837148+0000","last_peered":"2024-04-25T08:55:17.837148+0000","last_clean":"2024-04-25T08:55:17.837148+0000","last_became_active":"2024-04-25T08:55:16.841469+0000","last_became_peered":"2024-04-25T08:55:16.841469+0000","last_unstale":"2024-04-25T08:55:17.837148+0000","last_undegraded":"2024-04-25T08:55:17.837148+0000","last_fullsized":"2024-04-25T08:55:17.837148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:01.320597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837682+0000","last_change":"2024-04-25T08:55:15.810787+0000","last_active":"2024-04-25T08:55:17.837682+0000","last_peered":"2024-04-25T08:55:17.837682+0000","last_clean":"2024-04-25T08:55:17.837682+0000","last_became_active":"2024-04-25T08:55:15.810228+0000","last_became_peered":"2024-04-25T08:55:15.810228+0000","last_unstale":"2024-04-25T08:55:17.837682+0000","last_undegraded":"2024-04-25T08:55:17.837682+0000","last_fullsized":"2024-04-25T08:55:17.837682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:10.670548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540521+0000","last_change":"2024-04-25T08:55:16.841653+0000","last_active":"2024-04-25T08:55:18.540521+0000","last_peered":"2024-04-25T08:55:18.540521+0000","last_clean":"2024-04-25T08:55:18.540521+0000","last_became_active":"2024-04-25T08:55:16.840792+0000","last_became_peered":"2024-04-25T08:55:16.840792+0000","last_unstale":"2024-04-25T08:55:18.540521+0000","last_undegraded":"2024-04-25T08:55:18.540521+0000","last_fullsized":"2024-04-25T08:55:18.540521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837375+0000","last_change":"2024-04-25T08:55:15.809556+0000","last_active":"2024-04-25T08:55:17.837375+0000","last_peered":"2024-04-25T08:55:17.837375+0000","last_clean":"2024-04-25T08:55:17.837375+0000","last_became_active":"2024-04-25T08:55:15.809080+0000","last_became_peered":"2024-04-25T08:55:15.809080+0000","last_unstale":"2024-04-25T08:55:17.837375+0000","last_undegraded":"2024-04-25T08:55:17.837375+0000","last_fullsized":"2024-04-25T08:55:17.837375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:25.637156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837378+0000","last_change":"2024-04-25T08:55:16.829568+0000","last_active":"2024-04-25T08:55:17.837378+0000","last_peered":"2024-04-25T08:55:17.837378+0000","last_clean":"2024-04-25T08:55:17.837378+0000","last_became_active":"2024-04-25T08:55:16.829248+0000","last_became_peered":"2024-04-25T08:55:16.829248+0000","last_unstale":"2024-04-25T08:55:17.837378+0000","last_undegraded":"2024-04-25T08:55:17.837378+0000","last_fullsized":"2024-04-25T08:55:17.837378+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:56.165607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837529+0000","last_change":"2024-04-25T08:55:15.812602+0000","last_active":"2024-04-25T08:55:17.837529+0000","last_peered":"2024-04-25T08:55:17.837529+0000","last_clean":"2024-04-25T08:55:17.837529+0000","last_became_active":"2024-04-25T08:55:15.812277+0000","last_became_peered":"2024-04-25T08:55:15.812277+0000","last_unstale":"2024-04-25T08:55:17.837529+0000","last_undegraded":"2024-04-25T08:55:17.837529+0000","last_fullsized":"2024-04-25T08:55:17.837529+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:15.861856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837530+0000","last_change":"2024-04-25T08:55:16.828073+0000","last_active":"2024-04-25T08:55:17.837530+0000","last_peered":"2024-04-25T08:55:17.837530+0000","last_clean":"2024-04-25T08:55:17.837530+0000","last_became_active":"2024-04-25T08:55:16.827811+0000","last_became_peered":"2024-04-25T08:55:16.827811+0000","last_unstale":"2024-04-25T08:55:17.837530+0000","last_undegraded":"2024-04-25T08:55:17.837530+0000","last_fullsized":"2024-04-25T08:55:17.837530+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539870+0000","last_change":"2024-04-25T08:55:15.809552+0000","last_active":"2024-04-25T08:55:18.539870+0000","last_peered":"2024-04-25T08:55:18.539870+0000","last_clean":"2024-04-25T08:55:18.539870+0000","last_became_active":"2024-04-25T08:55:15.809065+0000","last_became_peered":"2024-04-25T08:55:15.809065+0000","last_unstale":"2024-04-25T08:55:18.539870+0000","last_undegraded":"2024-04-25T08:55:18.539870+0000","last_fullsized":"2024-04-25T08:55:18.539870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:36.553413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540362+0000","last_change":"2024-04-25T08:55:16.833303+0000","last_active":"2024-04-25T08:55:18.540362+0000","last_peered":"2024-04-25T08:55:18.540362+0000","last_clean":"2024-04-25T08:55:18.540362+0000","last_became_active":"2024-04-25T08:55:16.832435+0000","last_became_peered":"2024-04-25T08:55:16.832435+0000","last_unstale":"2024-04-25T08:55:18.540362+0000","last_undegraded":"2024-04-25T08:55:18.540362+0000","last_fullsized":"2024-04-25T08:55:18.540362+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:15.812095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541163+0000","last_change":"2024-04-25T08:55:15.806916+0000","last_active":"2024-04-25T08:55:18.541163+0000","last_peered":"2024-04-25T08:55:18.541163+0000","last_clean":"2024-04-25T08:55:18.541163+0000","last_became_active":"2024-04-25T08:55:15.806584+0000","last_became_peered":"2024-04-25T08:55:15.806584+0000","last_unstale":"2024-04-25T08:55:18.541163+0000","last_undegraded":"2024-04-25T08:55:18.541163+0000","last_fullsized":"2024-04-25T08:55:18.541163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:52.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540974+0000","last_change":"2024-04-25T08:55:16.846605+0000","last_active":"2024-04-25T08:55:18.540974+0000","last_peered":"2024-04-25T08:55:18.540974+0000","last_clean":"2024-04-25T08:55:18.540974+0000","last_became_active":"2024-04-25T08:55:16.846304+0000","last_became_peered":"2024-04-25T08:55:16.846304+0000","last_unstale":"2024-04-25T08:55:18.540974+0000","last_undegraded":"2024-04-25T08:55:18.540974+0000","last_fullsized":"2024-04-25T08:55:18.540974+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540594+0000","last_change":"2024-04-25T08:55:15.806841+0000","last_active":"2024-04-25T08:55:18.540594+0000","last_peered":"2024-04-25T08:55:18.540594+0000","last_clean":"2024-04-25T08:55:18.540594+0000","last_became_active":"2024-04-25T08:55:15.806563+0000","last_became_peered":"2024-04-25T08:55:15.806563+0000","last_unstale":"2024-04-25T08:55:18.540594+0000","last_undegraded":"2024-04-25T08:55:18.540594+0000","last_fullsized":"2024-04-25T08:55:18.540594+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:19.717985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837109+0000","last_change":"2024-04-25T08:55:16.838841+0000","last_active":"2024-04-25T08:55:17.837109+0000","last_peered":"2024-04-25T08:55:17.837109+0000","last_clean":"2024-04-25T08:55:17.837109+0000","last_became_active":"2024-04-25T08:55:16.838592+0000","last_became_peered":"2024-04-25T08:55:16.838592+0000","last_unstale":"2024-04-25T08:55:17.837109+0000","last_undegraded":"2024-04-25T08:55:17.837109+0000","last_fullsized":"2024-04-25T08:55:17.837109+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:16.953838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540102+0000","last_change":"2024-04-25T08:55:15.809119+0000","last_active":"2024-04-25T08:55:18.540102+0000","last_peered":"2024-04-25T08:55:18.540102+0000","last_clean":"2024-04-25T08:55:18.540102+0000","last_became_active":"2024-04-25T08:55:15.808770+0000","last_became_peered":"2024-04-25T08:55:15.808770+0000","last_unstale":"2024-04-25T08:55:18.540102+0000","last_undegraded":"2024-04-25T08:55:18.540102+0000","last_fullsized":"2024-04-25T08:55:18.540102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:25.637156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837451+0000","last_change":"2024-04-25T08:55:16.831158+0000","last_active":"2024-04-25T08:55:17.837451+0000","last_peered":"2024-04-25T08:55:17.837451+0000","last_clean":"2024-04-25T08:55:17.837451+0000","last_became_active":"2024-04-25T08:55:16.830883+0000","last_became_peered":"2024-04-25T08:55:16.830883+0000","last_unstale":"2024-04-25T08:55:17.837451+0000","last_undegraded":"2024-04-25T08:55:17.837451+0000","last_fullsized":"2024-04-25T08:55:17.837451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:20.724508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837803+0000","last_change":"2024-04-25T08:55:15.811663+0000","last_active":"2024-04-25T08:55:17.837803+0000","last_peered":"2024-04-25T08:55:17.837803+0000","last_clean":"2024-04-25T08:55:17.837803+0000","last_became_active":"2024-04-25T08:55:15.811372+0000","last_became_peered":"2024-04-25T08:55:15.811372+0000","last_unstale":"2024-04-25T08:55:17.837803+0000","last_undegraded":"2024-04-25T08:55:17.837803+0000","last_fullsized":"2024-04-25T08:55:17.837803+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:00.529017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837681+0000","last_change":"2024-04-25T08:55:16.830366+0000","last_active":"2024-04-25T08:55:17.837681+0000","last_peered":"2024-04-25T08:55:17.837681+0000","last_clean":"2024-04-25T08:55:17.837681+0000","last_became_active":"2024-04-25T08:55:16.830101+0000","last_became_peered":"2024-04-25T08:55:16.830101+0000","last_unstale":"2024-04-25T08:55:17.837681+0000","last_undegraded":"2024-04-25T08:55:17.837681+0000","last_fullsized":"2024-04-25T08:55:17.837681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:56.842647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837784+0000","last_change":"2024-04-25T08:55:15.811103+0000","last_active":"2024-04-25T08:55:17.837784+0000","last_peered":"2024-04-25T08:55:17.837784+0000","last_clean":"2024-04-25T08:55:17.837784+0000","last_became_active":"2024-04-25T08:55:15.810409+0000","last_became_peered":"2024-04-25T08:55:15.810409+0000","last_unstale":"2024-04-25T08:55:17.837784+0000","last_undegraded":"2024-04-25T08:55:17.837784+0000","last_fullsized":"2024-04-25T08:55:17.837784+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:35.665144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-04-25T08:55:15.802692+0000","last_change":"2024-04-25T08:55:15.802692+0000","last_active":"2024-04-25T08:55:15.785462+0000","last_peered":"2024-04-25T08:55:15.785462+0000","last_clean":"2024-04-25T08:55:15.785462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:55:15.802692+0000","last_undegraded":"2024-04-25T08:55:15.802692+0000","last_fullsized":"2024-04-25T08:55:15.802692+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539589+0000","last_change":"2024-04-25T08:55:15.808197+0000","last_active":"2024-04-25T08:55:18.539589+0000","last_peered":"2024-04-25T08:55:18.539589+0000","last_clean":"2024-04-25T08:55:18.539589+0000","last_became_active":"2024-04-25T08:55:15.806676+0000","last_became_peered":"2024-04-25T08:55:15.806676+0000","last_unstale":"2024-04-25T08:55:18.539589+0000","last_undegraded":"2024-04-25T08:55:18.539589+0000","last_fullsized":"2024-04-25T08:55:18.539589+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:21.098215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539986+0000","last_change":"2024-04-25T08:55:16.829187+0000","last_active":"2024-04-25T08:55:18.539986+0000","last_peered":"2024-04-25T08:55:18.539986+0000","last_clean":"2024-04-25T08:55:18.539986+0000","last_became_active":"2024-04-25T08:55:16.828772+0000","last_became_peered":"2024-04-25T08:55:16.828772+0000","last_unstale":"2024-04-25T08:55:18.539986+0000","last_undegraded":"2024-04-25T08:55:18.539986+0000","last_fullsized":"2024-04-25T08:55:18.539986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:29.403892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539546+0000","last_change":"2024-04-25T08:55:15.810669+0000","last_active":"2024-04-25T08:55:18.539546+0000","last_peered":"2024-04-25T08:55:18.539546+0000","last_clean":"2024-04-25T08:55:18.539546+0000","last_became_active":"2024-04-25T08:55:15.810364+0000","last_became_peered":"2024-04-25T08:55:15.810364+0000","last_unstale":"2024-04-25T08:55:18.539546+0000","last_undegraded":"2024-04-25T08:55:18.539546+0000","last_fullsized":"2024-04-25T08:55:18.539546+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:39.011045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539570+0000","last_change":"2024-04-25T08:55:16.844563+0000","last_active":"2024-04-25T08:55:18.539570+0000","last_peered":"2024-04-25T08:55:18.539570+0000","last_clean":"2024-04-25T08:55:18.539570+0000","last_became_active":"2024-04-25T08:55:16.844276+0000","last_became_peered":"2024-04-25T08:55:16.844276+0000","last_unstale":"2024-04-25T08:55:18.539570+0000","last_undegraded":"2024-04-25T08:55:18.539570+0000","last_fullsized":"2024-04-25T08:55:18.539570+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:36.060373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837697+0000","last_change":"2024-04-25T08:55:15.810567+0000","last_active":"2024-04-25T08:55:17.837697+0000","last_peered":"2024-04-25T08:55:17.837697+0000","last_clean":"2024-04-25T08:55:17.837697+0000","last_became_active":"2024-04-25T08:55:15.809948+0000","last_became_peered":"2024-04-25T08:55:15.809948+0000","last_unstale":"2024-04-25T08:55:17.837697+0000","last_undegraded":"2024-04-25T08:55:17.837697+0000","last_fullsized":"2024-04-25T08:55:17.837697+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.053850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.838063+0000","last_change":"2024-04-25T08:55:16.842345+0000","last_active":"2024-04-25T08:55:17.838063+0000","last_peered":"2024-04-25T08:55:17.838063+0000","last_clean":"2024-04-25T08:55:17.838063+0000","last_became_active":"2024-04-25T08:55:16.841261+0000","last_became_peered":"2024-04-25T08:55:16.841261+0000","last_unstale":"2024-04-25T08:55:17.838063+0000","last_undegraded":"2024-04-25T08:55:17.838063+0000","last_fullsized":"2024-04-25T08:55:17.838063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:44.813036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837927+0000","last_change":"2024-04-25T08:55:15.810587+0000","last_active":"2024-04-25T08:55:17.837927+0000","last_peered":"2024-04-25T08:55:17.837927+0000","last_clean":"2024-04-25T08:55:17.837927+0000","last_became_active":"2024-04-25T08:55:15.810279+0000","last_became_peered":"2024-04-25T08:55:15.810279+0000","last_unstale":"2024-04-25T08:55:17.837927+0000","last_undegraded":"2024-04-25T08:55:17.837927+0000","last_fullsized":"2024-04-25T08:55:17.837927+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:02.949602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540495+0000","last_change":"2024-04-25T08:55:16.845748+0000","last_active":"2024-04-25T08:55:18.540495+0000","last_peered":"2024-04-25T08:55:18.540495+0000","last_clean":"2024-04-25T08:55:18.540495+0000","last_became_active":"2024-04-25T08:55:16.845270+0000","last_became_peered":"2024-04-25T08:55:16.845270+0000","last_unstale":"2024-04-25T08:55:18.540495+0000","last_undegraded":"2024-04-25T08:55:18.540495+0000","last_fullsized":"2024-04-25T08:55:18.540495+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837918+0000","last_change":"2024-04-25T08:55:15.808197+0000","last_active":"2024-04-25T08:55:17.837918+0000","last_peered":"2024-04-25T08:55:17.837918+0000","last_clean":"2024-04-25T08:55:17.837918+0000","last_became_active":"2024-04-25T08:55:15.807712+0000","last_became_peered":"2024-04-25T08:55:15.807712+0000","last_unstale":"2024-04-25T08:55:17.837918+0000","last_undegraded":"2024-04-25T08:55:17.837918+0000","last_fullsized":"2024-04-25T08:55:17.837918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:24.823675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837799+0000","last_change":"2024-04-25T08:55:16.829720+0000","last_active":"2024-04-25T08:55:17.837799+0000","last_peered":"2024-04-25T08:55:17.837799+0000","last_clean":"2024-04-25T08:55:17.837799+0000","last_became_active":"2024-04-25T08:55:16.829479+0000","last_became_peered":"2024-04-25T08:55:16.829479+0000","last_unstale":"2024-04-25T08:55:17.837799+0000","last_undegraded":"2024-04-25T08:55:17.837799+0000","last_fullsized":"2024-04-25T08:55:17.837799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811361+0000","last_change":"2024-04-25T08:55:15.805828+0000","last_active":"2024-04-25T08:55:15.811361+0000","last_peered":"2024-04-25T08:55:15.811361+0000","last_clean":"2024-04-25T08:55:15.811361+0000","last_became_active":"2024-04-25T08:55:15.805528+0000","last_became_peered":"2024-04-25T08:55:15.805528+0000","last_unstale":"2024-04-25T08:55:15.811361+0000","last_undegraded":"2024-04-25T08:55:15.811361+0000","last_fullsized":"2024-04-25T08:55:15.811361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:27.984110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837868+0000","last_change":"2024-04-25T08:55:16.828363+0000","last_active":"2024-04-25T08:55:17.837868+0000","last_peered":"2024-04-25T08:55:17.837868+0000","last_clean":"2024-04-25T08:55:17.837868+0000","last_became_active":"2024-04-25T08:55:16.825857+0000","last_became_peered":"2024-04-25T08:55:16.825857+0000","last_unstale":"2024-04-25T08:55:17.837868+0000","last_undegraded":"2024-04-25T08:55:17.837868+0000","last_fullsized":"2024-04-25T08:55:17.837868+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:31.555032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837553+0000","last_change":"2024-04-25T08:55:15.804862+0000","last_active":"2024-04-25T08:55:17.837553+0000","last_peered":"2024-04-25T08:55:17.837553+0000","last_clean":"2024-04-25T08:55:17.837553+0000","last_became_active":"2024-04-25T08:55:15.804575+0000","last_became_peered":"2024-04-25T08:55:15.804575+0000","last_unstale":"2024-04-25T08:55:17.837553+0000","last_undegraded":"2024-04-25T08:55:17.837553+0000","last_fullsized":"2024-04-25T08:55:17.837553+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:43.806513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837565+0000","last_change":"2024-04-25T08:55:16.830603+0000","last_active":"2024-04-25T08:55:17.837565+0000","last_peered":"2024-04-25T08:55:17.837565+0000","last_clean":"2024-04-25T08:55:17.837565+0000","last_became_active":"2024-04-25T08:55:16.830277+0000","last_became_peered":"2024-04-25T08:55:16.830277+0000","last_unstale":"2024-04-25T08:55:17.837565+0000","last_undegraded":"2024-04-25T08:55:17.837565+0000","last_fullsized":"2024-04-25T08:55:17.837565+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:29.707648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539870+0000","last_change":"2024-04-25T08:55:15.810936+0000","last_active":"2024-04-25T08:55:18.539870+0000","last_peered":"2024-04-25T08:55:18.539870+0000","last_clean":"2024-04-25T08:55:18.539870+0000","last_became_active":"2024-04-25T08:55:15.810469+0000","last_became_peered":"2024-04-25T08:55:15.810469+0000","last_unstale":"2024-04-25T08:55:18.539870+0000","last_undegraded":"2024-04-25T08:55:18.539870+0000","last_fullsized":"2024-04-25T08:55:18.539870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:22.793939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539713+0000","last_change":"2024-04-25T08:55:16.820981+0000","last_active":"2024-04-25T08:55:18.539713+0000","last_peered":"2024-04-25T08:55:18.539713+0000","last_clean":"2024-04-25T08:55:18.539713+0000","last_became_active":"2024-04-25T08:55:16.820654+0000","last_became_peered":"2024-04-25T08:55:16.820654+0000","last_unstale":"2024-04-25T08:55:18.539713+0000","last_undegraded":"2024-04-25T08:55:18.539713+0000","last_fullsized":"2024-04-25T08:55:18.539713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T08:55:15.811393+0000","last_change":"2024-04-25T08:55:15.806700+0000","last_active":"2024-04-25T08:55:15.811393+0000","last_peered":"2024-04-25T08:55:15.811393+0000","last_clean":"2024-04-25T08:55:15.811393+0000","last_became_active":"2024-04-25T08:55:15.806407+0000","last_became_peered":"2024-04-25T08:55:15.806407+0000","last_unstale":"2024-04-25T08:55:15.811393+0000","last_undegraded":"2024-04-25T08:55:15.811393+0000","last_fullsized":"2024-04-25T08:55:15.811393+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:58.012479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539725+0000","last_change":"2024-04-25T08:55:16.843737+0000","last_active":"2024-04-25T08:55:18.539725+0000","last_peered":"2024-04-25T08:55:18.539725+0000","last_clean":"2024-04-25T08:55:18.539725+0000","last_became_active":"2024-04-25T08:55:16.843213+0000","last_became_peered":"2024-04-25T08:55:16.843213+0000","last_unstale":"2024-04-25T08:55:18.539725+0000","last_undegraded":"2024-04-25T08:55:18.539725+0000","last_fullsized":"2024-04-25T08:55:18.539725+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:09.916126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540000+0000","last_change":"2024-04-25T08:55:15.810186+0000","last_active":"2024-04-25T08:55:18.540000+0000","last_peered":"2024-04-25T08:55:18.540000+0000","last_clean":"2024-04-25T08:55:18.540000+0000","last_became_active":"2024-04-25T08:55:15.809881+0000","last_became_peered":"2024-04-25T08:55:15.809881+0000","last_unstale":"2024-04-25T08:55:18.540000+0000","last_undegraded":"2024-04-25T08:55:18.540000+0000","last_fullsized":"2024-04-25T08:55:18.540000+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:14.805572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540870+0000","last_change":"2024-04-25T08:55:16.840505+0000","last_active":"2024-04-25T08:55:18.540870+0000","last_peered":"2024-04-25T08:55:18.540870+0000","last_clean":"2024-04-25T08:55:18.540870+0000","last_became_active":"2024-04-25T08:55:16.837418+0000","last_became_peered":"2024-04-25T08:55:16.837418+0000","last_unstale":"2024-04-25T08:55:18.540870+0000","last_undegraded":"2024-04-25T08:55:18.540870+0000","last_fullsized":"2024-04-25T08:55:18.540870+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540226+0000","last_change":"2024-04-25T08:55:15.815889+0000","last_active":"2024-04-25T08:55:18.540226+0000","last_peered":"2024-04-25T08:55:18.540226+0000","last_clean":"2024-04-25T08:55:18.540226+0000","last_became_active":"2024-04-25T08:55:15.815594+0000","last_became_peered":"2024-04-25T08:55:15.815594+0000","last_unstale":"2024-04-25T08:55:18.540226+0000","last_undegraded":"2024-04-25T08:55:18.540226+0000","last_fullsized":"2024-04-25T08:55:18.540226+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:43.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":214,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837683+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:55:17.837683+0000","last_peered":"2024-04-25T08:55:17.837683+0000","last_clean":"2024-04-25T08:55:17.837683+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:55:17.837683+0000","last_undegraded":"2024-04-25T08:55:17.837683+0000","last_fullsized":"2024-04-25T08:55:17.837683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1142784,"data_stored":810559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":220773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":220171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":557056,"data_stored":221713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":220739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":221735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1142784,"data_stored":810503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":520192,"data_stored":207026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:55:25.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:55:25.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.385+0000 7f96b2bb6640 1 Processor -- start 2024-04-25T08:55:25.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.385+0000 7f96b2bb6640 1 -- start start 2024-04-25T08:55:25.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96b2bb6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f96ac15ba10 0x7f96ac099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:25.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96b2bb6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ac06c900 con 0x7f96ac099f80 2024-04-25T08:55:25.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96b2bb6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ac06cbe0 con 0x7f96ac06c3c0 2024-04-25T08:55:25.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96b2bb6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ac0cbe50 con 0x7f96ac15ba10 2024-04-25T08:55:25.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96abfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f96ac099f80 0x7f96ac06bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50888/0 (socket says 172.21.15.55:50888) 2024-04-25T08:55:25.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96abfff640 1 -- 172.21.15.55:0/3479058088 learned_addr learned my addr 172.21.15.55:0/3479058088 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96b0952640 1 --2- 172.21.15.55:0/3479058088 >> v2:172.21.15.167:3300/0 conn(0x7f96ac15ba10 0x7f96ac099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96ab7fe640 1 -- 172.21.15.55:0/3479058088 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505171948 0 0) 0x7f96ac06c900 con 0x7f96ac099f80 2024-04-25T08:55:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96ab7fe640 1 -- 172.21.15.55:0/3479058088 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f969c003520 con 0x7f96ac099f80 2024-04-25T08:55:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96b0952640 1 -- 172.21.15.55:0/3479058088 >> v1:172.21.15.167:6789/0 conn(0x7f96ac06c3c0 legacy=0x7f96ac0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96b0952640 1 -- 172.21.15.55:0/3479058088 >> v1:172.21.15.55:6789/0 conn(0x7f96ac099f80 legacy=0x7f96ac06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96ab7fe640 1 -- 172.21.15.55:0/3479058088 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1588359595 0 0) 0x7f969c003520 con 0x7f96ac099f80 2024-04-25T08:55:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.386+0000 7f96b0952640 1 -- 172.21.15.55:0/3479058088 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac06cec0 con 0x7f96ac15ba10 2024-04-25T08:55:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.387+0000 7f96b0952640 1 --2- 172.21.15.55:0/3479058088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96ac15ba10 0x7f96ac099a40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96a00097a0 tx=0x7f96a002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=797d94696140a7dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.387+0000 7f96ab7fe640 1 -- 172.21.15.55:0/3479058088 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0037070 con 0x7f96ac15ba10 2024-04-25T08:55:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.387+0000 7f96ab7fe640 1 -- 172.21.15.55:0/3479058088 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a002ac50 con 0x7f96ac15ba10 2024-04-25T08:55:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.387+0000 7f96ab7fe640 1 -- 172.21.15.55:0/3479058088 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698001670 con 0x7f96ac15ba10 2024-04-25T08:55:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.388+0000 7f96b2bb6640 1 -- 172.21.15.55:0/3479058088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96ac15ba10 msgr2=0x7f96ac099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.388+0000 7f96b2bb6640 1 --2- 172.21.15.55:0/3479058088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96ac15ba10 0x7f96ac099a40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96a00097a0 tx=0x7f96a002a1c0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.388+0000 7f96b2bb6640 1 -- 172.21.15.55:0/3479058088 shutdown_connections 2024-04-25T08:55:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.388+0000 7f96b2bb6640 1 --2- 172.21.15.55:0/3479058088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96ac15ba10 0x7f96ac099a40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.388+0000 7f96b2bb6640 1 -- 172.21.15.55:0/3479058088 >> 172.21.15.55:0/3479058088 conn(0x7f96ac0b32f0 msgr2=0x7f96ac0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.388+0000 7f96b2bb6640 1 -- 172.21.15.55:0/3479058088 shutdown_connections 2024-04-25T08:55:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.388+0000 7f96b2bb6640 1 -- 172.21.15.55:0/3479058088 wait complete. 2024-04-25T08:55:25.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.389+0000 7f96b2bb6640 1 Processor -- start 2024-04-25T08:55:25.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.389+0000 7f96b2bb6640 1 -- start start 2024-04-25T08:55:25.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.390+0000 7f96b2bb6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96ac06c3c0 0x7f96ac15cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:25.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.390+0000 7f96b2bb6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96ac099f80 0x7f96ac1f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:25.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.390+0000 7f96b2bb6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96ac15ba10 0x7f96ac0af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.390+0000 7f96b2bb6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac09a3d0 con 0x7f96ac15ba10 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.390+0000 7f96b2bb6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac0d1530 con 0x7f96ac06c3c0 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.390+0000 7f96b2bb6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac0cfe80 con 0x7f96ac099f80 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.390+0000 7f96b1153640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96ac15ba10 0x7f96ac0af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.390+0000 7f96b1153640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96ac15ba10 0x7f96ac0af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42518/0 (socket says 172.21.15.55:42518) 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.390+0000 7f96b1153640 1 -- 172.21.15.55:0/492287029 learned_addr learned my addr 172.21.15.55:0/492287029 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96abfff640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96ac099f80 0x7f96ac1f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96b0952640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96ac06c3c0 0x7f96ac15cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96b1153640 1 -- 172.21.15.55:0/492287029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96ac099f80 msgr2=0x7f96ac1f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96b1153640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96ac099f80 0x7f96ac1f3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96b1153640 1 -- 172.21.15.55:0/492287029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96ac06c3c0 msgr2=0x7f96ac15cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96b1153640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96ac06c3c0 0x7f96ac15cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96b1153640 1 -- 172.21.15.55:0/492287029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac1f40f0 con 0x7f96ac15ba10 2024-04-25T08:55:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96abfff640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96ac099f80 0x7f96ac1f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:25.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96b0952640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96ac06c3c0 0x7f96ac15cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:25.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96b1153640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96ac15ba10 0x7f96ac0af500 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c730 tx=0x7f96a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:25.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96a97fa640 1 -- 172.21.15.55:0/492287029 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4003b70 con 0x7f96ac15ba10 2024-04-25T08:55:25.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96a97fa640 1 -- 172.21.15.55:0/492287029 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a4003d10 con 0x7f96ac15ba10 2024-04-25T08:55:25.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96b2bb6640 1 -- 172.21.15.55:0/492287029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ac0c61d0 con 0x7f96ac15ba10 2024-04-25T08:55:25.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96a97fa640 1 -- 172.21.15.55:0/492287029 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a400aa90 con 0x7f96ac15ba10 2024-04-25T08:55:25.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.391+0000 7f96b2bb6640 1 -- 172.21.15.55:0/492287029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ac15c170 con 0x7f96ac15ba10 2024-04-25T08:55:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.392+0000 7f96b2bb6640 1 -- 172.21.15.55:0/492287029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ac0749b0 con 0x7f96ac15ba10 2024-04-25T08:55:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.393+0000 7f96a97fa640 1 -- 172.21.15.55:0/492287029 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f96a400ac30 con 0x7f96ac15ba10 2024-04-25T08:55:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.393+0000 7f96a97fa640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f969006b4d0 0x7f969006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.393+0000 7f96b0952640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f969006b4d0 0x7f969006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.393+0000 7f96a97fa640 1 -- 172.21.15.55:0/492287029 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f96a408a0e0 con 0x7f96ac15ba10 2024-04-25T08:55:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.394+0000 7f96b0952640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f969006b4d0 0x7f969006d990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f96a0034000 tx=0x7f96a002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:25.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.398+0000 7f96a97fa640 1 -- 172.21.15.55:0/492287029 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f96a4058f20 con 0x7f96ac15ba10 2024-04-25T08:55:25.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.579+0000 7f96b2bb6640 1 -- 172.21.15.55:0/492287029 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96ac09a570 con 0x7f969006b4d0 2024-04-25T08:55:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.585+0000 7f96a97fa640 1 -- 172.21.15.55:0/492287029 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251958 (secure 0 0 0) 0x7f96ac09a570 con 0x7f969006b4d0 2024-04-25T08:55:25.577 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 -- 172.21.15.55:0/492287029 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f969006b4d0 msgr2=0x7f969006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f969006b4d0 0x7f969006d990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f96a0034000 tx=0x7f96a002e000 comp rx=0 tx=0).stop 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 -- 172.21.15.55:0/492287029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96ac15ba10 msgr2=0x7f96ac0af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96ac15ba10 0x7f96ac0af500 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c730 tx=0x7f96a400cbf0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 -- 172.21.15.55:0/492287029 shutdown_connections 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f969006b4d0 0x7f969006d990 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96ac15ba10 0x7f96ac0af500 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96ac099f80 0x7f96ac1f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 --2- 172.21.15.55:0/492287029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96ac06c3c0 0x7f96ac15cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 -- 172.21.15.55:0/492287029 >> 172.21.15.55:0/492287029 conn(0x7f96ac0b32f0 msgr2=0x7f96ac15acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 -- 172.21.15.55:0/492287029 shutdown_connections 2024-04-25T08:55:25.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.588+0000 7f96b2bb6640 1 -- 172.21.15.55:0/492287029 wait complete. 2024-04-25T08:55:25.588 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-04-25T08:55:24.571914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238300,"kb_used_data":5480,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736420,"statfs":{"total":773094113280,"available":772850094080,"internally_reserved":0,"allocated":5611520,"data_stored":2946364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.740072"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836959+0000","last_change":"2024-04-25T08:55:16.832561+0000","last_active":"2024-04-25T08:55:17.836959+0000","last_peered":"2024-04-25T08:55:17.836959+0000","last_clean":"2024-04-25T08:55:17.836959+0000","last_became_active":"2024-04-25T08:55:16.832224+0000","last_became_peered":"2024-04-25T08:55:16.832224+0000","last_unstale":"2024-04-25T08:55:17.836959+0000","last_undegraded":"2024-04-25T08:55:17.836959+0000","last_fullsized":"2024-04-25T08:55:17.836959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540207+0000","last_change":"2024-04-25T08:55:16.842805+0000","last_active":"2024-04-25T08:55:18.540207+0000","last_peered":"2024-04-25T08:55:18.540207+0000","last_clean":"2024-04-25T08:55:18.540207+0000","last_became_active":"2024-04-25T08:55:16.842348+0000","last_became_peered":"2024-04-25T08:55:16.842348+0000","last_unstale":"2024-04-25T08:55:18.540207+0000","last_undegraded":"2024-04-25T08:55:18.540207+0000","last_fullsized":"2024-04-25T08:55:18.540207+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539800+0000","last_change":"2024-04-25T08:55:16.829363+0000","last_active":"2024-04-25T08:55:18.539800+0000","last_peered":"2024-04-25T08:55:18.539800+0000","last_clean":"2024-04-25T08:55:18.539800+0000","last_became_active":"2024-04-25T08:55:16.828941+0000","last_became_peered":"2024-04-25T08:55:16.828941+0000","last_unstale":"2024-04-25T08:55:18.539800+0000","last_undegraded":"2024-04-25T08:55:18.539800+0000","last_fullsized":"2024-04-25T08:55:18.539800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540318+0000","last_change":"2024-04-25T08:55:16.841043+0000","last_active":"2024-04-25T08:55:18.540318+0000","last_peered":"2024-04-25T08:55:18.540318+0000","last_clean":"2024-04-25T08:55:18.540318+0000","last_became_active":"2024-04-25T08:55:16.838610+0000","last_became_peered":"2024-04-25T08:55:16.838610+0000","last_unstale":"2024-04-25T08:55:18.540318+0000","last_undegraded":"2024-04-25T08:55:18.540318+0000","last_fullsized":"2024-04-25T08:55:18.540318+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539972+0000","last_change":"2024-04-25T08:55:16.843435+0000","last_active":"2024-04-25T08:55:18.539972+0000","last_peered":"2024-04-25T08:55:18.539972+0000","last_clean":"2024-04-25T08:55:18.539972+0000","last_became_active":"2024-04-25T08:55:16.842897+0000","last_became_peered":"2024-04-25T08:55:16.842897+0000","last_unstale":"2024-04-25T08:55:18.539972+0000","last_undegraded":"2024-04-25T08:55:18.539972+0000","last_fullsized":"2024-04-25T08:55:18.539972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837578+0000","last_change":"2024-04-25T08:55:16.826490+0000","last_active":"2024-04-25T08:55:17.837578+0000","last_peered":"2024-04-25T08:55:17.837578+0000","last_clean":"2024-04-25T08:55:17.837578+0000","last_became_active":"2024-04-25T08:55:16.826201+0000","last_became_peered":"2024-04-25T08:55:16.826201+0000","last_unstale":"2024-04-25T08:55:17.837578+0000","last_undegraded":"2024-04-25T08:55:17.837578+0000","last_fullsized":"2024-04-25T08:55:17.837578+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:34.683007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837295+0000","last_change":"2024-04-25T08:55:16.829027+0000","last_active":"2024-04-25T08:55:17.837295+0000","last_peered":"2024-04-25T08:55:17.837295+0000","last_clean":"2024-04-25T08:55:17.837295+0000","last_became_active":"2024-04-25T08:55:16.828724+0000","last_became_peered":"2024-04-25T08:55:16.828724+0000","last_unstale":"2024-04-25T08:55:17.837295+0000","last_undegraded":"2024-04-25T08:55:17.837295+0000","last_fullsized":"2024-04-25T08:55:17.837295+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539748+0000","last_change":"2024-04-25T08:55:16.840752+0000","last_active":"2024-04-25T08:55:18.539748+0000","last_peered":"2024-04-25T08:55:18.539748+0000","last_clean":"2024-04-25T08:55:18.539748+0000","last_became_active":"2024-04-25T08:55:16.838830+0000","last_became_peered":"2024-04-25T08:55:16.838830+0000","last_unstale":"2024-04-25T08:55:18.539748+0000","last_undegraded":"2024-04-25T08:55:18.539748+0000","last_fullsized":"2024-04-25T08:55:18.539748+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:11.677071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540796+0000","last_change":"2024-04-25T08:55:16.840080+0000","last_active":"2024-04-25T08:55:18.540796+0000","last_peered":"2024-04-25T08:55:18.540796+0000","last_clean":"2024-04-25T08:55:18.540796+0000","last_became_active":"2024-04-25T08:55:16.837974+0000","last_became_peered":"2024-04-25T08:55:16.837974+0000","last_unstale":"2024-04-25T08:55:18.540796+0000","last_undegraded":"2024-04-25T08:55:18.540796+0000","last_fullsized":"2024-04-25T08:55:18.540796+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540698+0000","last_change":"2024-04-25T08:55:16.838746+0000","last_active":"2024-04-25T08:55:18.540698+0000","last_peered":"2024-04-25T08:55:18.540698+0000","last_clean":"2024-04-25T08:55:18.540698+0000","last_became_active":"2024-04-25T08:55:16.838330+0000","last_became_peered":"2024-04-25T08:55:16.838330+0000","last_unstale":"2024-04-25T08:55:18.540698+0000","last_undegraded":"2024-04-25T08:55:18.540698+0000","last_fullsized":"2024-04-25T08:55:18.540698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540035+0000","last_change":"2024-04-25T08:55:16.841755+0000","last_active":"2024-04-25T08:55:18.540035+0000","last_peered":"2024-04-25T08:55:18.540035+0000","last_clean":"2024-04-25T08:55:18.540035+0000","last_became_active":"2024-04-25T08:55:16.840957+0000","last_became_peered":"2024-04-25T08:55:16.840957+0000","last_unstale":"2024-04-25T08:55:18.540035+0000","last_undegraded":"2024-04-25T08:55:18.540035+0000","last_fullsized":"2024-04-25T08:55:18.540035+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.956125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540100+0000","last_change":"2024-04-25T08:55:16.834783+0000","last_active":"2024-04-25T08:55:18.540100+0000","last_peered":"2024-04-25T08:55:18.540100+0000","last_clean":"2024-04-25T08:55:18.540100+0000","last_became_active":"2024-04-25T08:55:16.834516+0000","last_became_peered":"2024-04-25T08:55:16.834516+0000","last_unstale":"2024-04-25T08:55:18.540100+0000","last_undegraded":"2024-04-25T08:55:18.540100+0000","last_fullsized":"2024-04-25T08:55:18.540100+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540279+0000","last_change":"2024-04-25T08:55:16.846385+0000","last_active":"2024-04-25T08:55:18.540279+0000","last_peered":"2024-04-25T08:55:18.540279+0000","last_clean":"2024-04-25T08:55:18.540279+0000","last_became_active":"2024-04-25T08:55:16.846086+0000","last_became_peered":"2024-04-25T08:55:16.846086+0000","last_unstale":"2024-04-25T08:55:18.540279+0000","last_undegraded":"2024-04-25T08:55:18.540279+0000","last_fullsized":"2024-04-25T08:55:18.540279+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:37.559936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539706+0000","last_change":"2024-04-25T08:55:16.843288+0000","last_active":"2024-04-25T08:55:18.539706+0000","last_peered":"2024-04-25T08:55:18.539706+0000","last_clean":"2024-04-25T08:55:18.539706+0000","last_became_active":"2024-04-25T08:55:16.838291+0000","last_became_peered":"2024-04-25T08:55:16.838291+0000","last_unstale":"2024-04-25T08:55:18.539706+0000","last_undegraded":"2024-04-25T08:55:18.539706+0000","last_fullsized":"2024-04-25T08:55:18.539706+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:09.916126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837424+0000","last_change":"2024-04-25T08:55:16.828188+0000","last_active":"2024-04-25T08:55:17.837424+0000","last_peered":"2024-04-25T08:55:17.837424+0000","last_clean":"2024-04-25T08:55:17.837424+0000","last_became_active":"2024-04-25T08:55:16.827799+0000","last_became_peered":"2024-04-25T08:55:16.827799+0000","last_unstale":"2024-04-25T08:55:17.837424+0000","last_undegraded":"2024-04-25T08:55:17.837424+0000","last_fullsized":"2024-04-25T08:55:17.837424+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:44.172513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837279+0000","last_change":"2024-04-25T08:55:16.843112+0000","last_active":"2024-04-25T08:55:17.837279+0000","last_peered":"2024-04-25T08:55:17.837279+0000","last_clean":"2024-04-25T08:55:17.837279+0000","last_became_active":"2024-04-25T08:55:16.842799+0000","last_became_peered":"2024-04-25T08:55:16.842799+0000","last_unstale":"2024-04-25T08:55:17.837279+0000","last_undegraded":"2024-04-25T08:55:17.837279+0000","last_fullsized":"2024-04-25T08:55:17.837279+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:23.800462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540545+0000","last_change":"2024-04-25T08:55:16.833189+0000","last_active":"2024-04-25T08:55:18.540545+0000","last_peered":"2024-04-25T08:55:18.540545+0000","last_clean":"2024-04-25T08:55:18.540545+0000","last_became_active":"2024-04-25T08:55:16.831963+0000","last_became_peered":"2024-04-25T08:55:16.831963+0000","last_unstale":"2024-04-25T08:55:18.540545+0000","last_undegraded":"2024-04-25T08:55:18.540545+0000","last_fullsized":"2024-04-25T08:55:18.540545+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:15.726754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540421+0000","last_change":"2024-04-25T08:55:16.841886+0000","last_active":"2024-04-25T08:55:18.540421+0000","last_peered":"2024-04-25T08:55:18.540421+0000","last_clean":"2024-04-25T08:55:18.540421+0000","last_became_active":"2024-04-25T08:55:16.841578+0000","last_became_peered":"2024-04-25T08:55:16.841578+0000","last_unstale":"2024-04-25T08:55:18.540421+0000","last_undegraded":"2024-04-25T08:55:18.540421+0000","last_fullsized":"2024-04-25T08:55:18.540421+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837789+0000","last_change":"2024-04-25T08:55:16.843485+0000","last_active":"2024-04-25T08:55:17.837789+0000","last_peered":"2024-04-25T08:55:17.837789+0000","last_clean":"2024-04-25T08:55:17.837789+0000","last_became_active":"2024-04-25T08:55:16.843130+0000","last_became_peered":"2024-04-25T08:55:16.843130+0000","last_unstale":"2024-04-25T08:55:17.837789+0000","last_undegraded":"2024-04-25T08:55:17.837789+0000","last_fullsized":"2024-04-25T08:55:17.837789+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:12.657487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540145+0000","last_change":"2024-04-25T08:55:16.841939+0000","last_active":"2024-04-25T08:55:18.540145+0000","last_peered":"2024-04-25T08:55:18.540145+0000","last_clean":"2024-04-25T08:55:18.540145+0000","last_became_active":"2024-04-25T08:55:16.841657+0000","last_became_peered":"2024-04-25T08:55:16.841657+0000","last_unstale":"2024-04-25T08:55:18.540145+0000","last_undegraded":"2024-04-25T08:55:18.540145+0000","last_fullsized":"2024-04-25T08:55:18.540145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:14.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837507+0000","last_change":"2024-04-25T08:55:16.821355+0000","last_active":"2024-04-25T08:55:17.837507+0000","last_peered":"2024-04-25T08:55:17.837507+0000","last_clean":"2024-04-25T08:55:17.837507+0000","last_became_active":"2024-04-25T08:55:16.821067+0000","last_became_peered":"2024-04-25T08:55:16.821067+0000","last_unstale":"2024-04-25T08:55:17.837507+0000","last_undegraded":"2024-04-25T08:55:17.837507+0000","last_fullsized":"2024-04-25T08:55:17.837507+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.333983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539859+0000","last_change":"2024-04-25T08:55:16.838547+0000","last_active":"2024-04-25T08:55:18.539859+0000","last_peered":"2024-04-25T08:55:18.539859+0000","last_clean":"2024-04-25T08:55:18.539859+0000","last_became_active":"2024-04-25T08:55:16.837583+0000","last_became_peered":"2024-04-25T08:55:16.837583+0000","last_unstale":"2024-04-25T08:55:18.539859+0000","last_undegraded":"2024-04-25T08:55:18.539859+0000","last_fullsized":"2024-04-25T08:55:18.539859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:36.671667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836896+0000","last_change":"2024-04-25T08:55:16.828541+0000","last_active":"2024-04-25T08:55:17.836896+0000","last_peered":"2024-04-25T08:55:17.836896+0000","last_clean":"2024-04-25T08:55:17.836896+0000","last_became_active":"2024-04-25T08:55:16.828068+0000","last_became_peered":"2024-04-25T08:55:16.828068+0000","last_unstale":"2024-04-25T08:55:17.836896+0000","last_undegraded":"2024-04-25T08:55:17.836896+0000","last_fullsized":"2024-04-25T08:55:17.836896+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:58.797425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837412+0000","last_change":"2024-04-25T08:55:16.828256+0000","last_active":"2024-04-25T08:55:17.837412+0000","last_peered":"2024-04-25T08:55:17.837412+0000","last_clean":"2024-04-25T08:55:17.837412+0000","last_became_active":"2024-04-25T08:55:16.827956+0000","last_became_peered":"2024-04-25T08:55:16.827956+0000","last_unstale":"2024-04-25T08:55:17.837412+0000","last_undegraded":"2024-04-25T08:55:17.837412+0000","last_fullsized":"2024-04-25T08:55:17.837412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.294126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837937+0000","last_change":"2024-04-25T08:55:16.831080+0000","last_active":"2024-04-25T08:55:17.837937+0000","last_peered":"2024-04-25T08:55:17.837937+0000","last_clean":"2024-04-25T08:55:17.837937+0000","last_became_active":"2024-04-25T08:55:16.830803+0000","last_became_peered":"2024-04-25T08:55:16.830803+0000","last_unstale":"2024-04-25T08:55:17.837937+0000","last_undegraded":"2024-04-25T08:55:17.837937+0000","last_fullsized":"2024-04-25T08:55:17.837937+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:44.216939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540190+0000","last_change":"2024-04-25T08:55:16.846495+0000","last_active":"2024-04-25T08:55:18.540190+0000","last_peered":"2024-04-25T08:55:18.540190+0000","last_clean":"2024-04-25T08:55:18.540190+0000","last_became_active":"2024-04-25T08:55:16.846097+0000","last_became_peered":"2024-04-25T08:55:16.846097+0000","last_unstale":"2024-04-25T08:55:18.540190+0000","last_undegraded":"2024-04-25T08:55:18.540190+0000","last_fullsized":"2024-04-25T08:55:18.540190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:00.833210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540297+0000","last_change":"2024-04-25T08:55:16.832406+0000","last_active":"2024-04-25T08:55:18.540297+0000","last_peered":"2024-04-25T08:55:18.540297+0000","last_clean":"2024-04-25T08:55:18.540297+0000","last_became_active":"2024-04-25T08:55:16.832117+0000","last_became_peered":"2024-04-25T08:55:16.832117+0000","last_unstale":"2024-04-25T08:55:18.540297+0000","last_undegraded":"2024-04-25T08:55:18.540297+0000","last_fullsized":"2024-04-25T08:55:18.540297+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540182+0000","last_change":"2024-04-25T08:55:16.831162+0000","last_active":"2024-04-25T08:55:18.540182+0000","last_peered":"2024-04-25T08:55:18.540182+0000","last_clean":"2024-04-25T08:55:18.540182+0000","last_became_active":"2024-04-25T08:55:16.830889+0000","last_became_peered":"2024-04-25T08:55:16.830889+0000","last_unstale":"2024-04-25T08:55:18.540182+0000","last_undegraded":"2024-04-25T08:55:18.540182+0000","last_fullsized":"2024-04-25T08:55:18.540182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836963+0000","last_change":"2024-04-25T08:55:16.829707+0000","last_active":"2024-04-25T08:55:17.836963+0000","last_peered":"2024-04-25T08:55:17.836963+0000","last_clean":"2024-04-25T08:55:17.836963+0000","last_became_active":"2024-04-25T08:55:16.829062+0000","last_became_peered":"2024-04-25T08:55:16.829062+0000","last_unstale":"2024-04-25T08:55:17.836963+0000","last_undegraded":"2024-04-25T08:55:17.836963+0000","last_fullsized":"2024-04-25T08:55:17.836963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:15.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539758+0000","last_change":"2024-04-25T08:55:16.830080+0000","last_active":"2024-04-25T08:55:18.539758+0000","last_peered":"2024-04-25T08:55:18.539758+0000","last_clean":"2024-04-25T08:55:18.539758+0000","last_became_active":"2024-04-25T08:55:16.829695+0000","last_became_peered":"2024-04-25T08:55:16.829695+0000","last_unstale":"2024-04-25T08:55:18.539758+0000","last_undegraded":"2024-04-25T08:55:18.539758+0000","last_fullsized":"2024-04-25T08:55:18.539758+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:36.671667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837487+0000","last_change":"2024-04-25T08:55:16.822654+0000","last_active":"2024-04-25T08:55:17.837487+0000","last_peered":"2024-04-25T08:55:17.837487+0000","last_clean":"2024-04-25T08:55:17.837487+0000","last_became_active":"2024-04-25T08:55:16.822381+0000","last_became_peered":"2024-04-25T08:55:16.822381+0000","last_unstale":"2024-04-25T08:55:17.837487+0000","last_undegraded":"2024-04-25T08:55:17.837487+0000","last_fullsized":"2024-04-25T08:55:17.837487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:26.668007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539713+0000","last_change":"2024-04-25T08:55:16.838404+0000","last_active":"2024-04-25T08:55:18.539713+0000","last_peered":"2024-04-25T08:55:18.539713+0000","last_clean":"2024-04-25T08:55:18.539713+0000","last_became_active":"2024-04-25T08:55:16.838105+0000","last_became_peered":"2024-04-25T08:55:16.838105+0000","last_unstale":"2024-04-25T08:55:18.539713+0000","last_undegraded":"2024-04-25T08:55:18.539713+0000","last_fullsized":"2024-04-25T08:55:18.539713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:38.008819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541005+0000","last_change":"2024-04-25T08:55:16.822561+0000","last_active":"2024-04-25T08:55:18.541005+0000","last_peered":"2024-04-25T08:55:18.541005+0000","last_clean":"2024-04-25T08:55:18.541005+0000","last_became_active":"2024-04-25T08:55:16.822270+0000","last_became_peered":"2024-04-25T08:55:16.822270+0000","last_unstale":"2024-04-25T08:55:18.541005+0000","last_undegraded":"2024-04-25T08:55:18.541005+0000","last_fullsized":"2024-04-25T08:55:18.541005+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:30.330866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837824+0000","last_change":"2024-04-25T08:55:15.812917+0000","last_active":"2024-04-25T08:55:17.837824+0000","last_peered":"2024-04-25T08:55:17.837824+0000","last_clean":"2024-04-25T08:55:17.837824+0000","last_became_active":"2024-04-25T08:55:15.812416+0000","last_became_peered":"2024-04-25T08:55:15.812416+0000","last_unstale":"2024-04-25T08:55:17.837824+0000","last_undegraded":"2024-04-25T08:55:17.837824+0000","last_fullsized":"2024-04-25T08:55:17.837824+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:08.909603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837905+0000","last_change":"2024-04-25T08:55:16.832501+0000","last_active":"2024-04-25T08:55:17.837905+0000","last_peered":"2024-04-25T08:55:17.837905+0000","last_clean":"2024-04-25T08:55:17.837905+0000","last_became_active":"2024-04-25T08:55:16.832159+0000","last_became_peered":"2024-04-25T08:55:16.832159+0000","last_unstale":"2024-04-25T08:55:17.837905+0000","last_undegraded":"2024-04-25T08:55:17.837905+0000","last_fullsized":"2024-04-25T08:55:17.837905+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:46.528440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540498+0000","last_change":"2024-04-25T08:55:15.804587+0000","last_active":"2024-04-25T08:55:18.540498+0000","last_peered":"2024-04-25T08:55:18.540498+0000","last_clean":"2024-04-25T08:55:18.540498+0000","last_became_active":"2024-04-25T08:55:15.802674+0000","last_became_peered":"2024-04-25T08:55:15.802674+0000","last_unstale":"2024-04-25T08:55:18.540498+0000","last_undegraded":"2024-04-25T08:55:18.540498+0000","last_fullsized":"2024-04-25T08:55:18.540498+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:14.287603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540254+0000","last_change":"2024-04-25T08:55:16.836374+0000","last_active":"2024-04-25T08:55:18.540254+0000","last_peered":"2024-04-25T08:55:18.540254+0000","last_clean":"2024-04-25T08:55:18.540254+0000","last_became_active":"2024-04-25T08:55:16.835872+0000","last_became_peered":"2024-04-25T08:55:16.835872+0000","last_unstale":"2024-04-25T08:55:18.540254+0000","last_undegraded":"2024-04-25T08:55:18.540254+0000","last_fullsized":"2024-04-25T08:55:18.540254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541092+0000","last_change":"2024-04-25T08:55:15.805969+0000","last_active":"2024-04-25T08:55:18.541092+0000","last_peered":"2024-04-25T08:55:18.541092+0000","last_clean":"2024-04-25T08:55:18.541092+0000","last_became_active":"2024-04-25T08:55:15.805679+0000","last_became_peered":"2024-04-25T08:55:15.805679+0000","last_unstale":"2024-04-25T08:55:18.541092+0000","last_undegraded":"2024-04-25T08:55:18.541092+0000","last_fullsized":"2024-04-25T08:55:18.541092+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.438246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540868+0000","last_change":"2024-04-25T08:55:16.826662+0000","last_active":"2024-04-25T08:55:18.540868+0000","last_peered":"2024-04-25T08:55:18.540868+0000","last_clean":"2024-04-25T08:55:18.540868+0000","last_became_active":"2024-04-25T08:55:16.826342+0000","last_became_peered":"2024-04-25T08:55:16.826342+0000","last_unstale":"2024-04-25T08:55:18.540868+0000","last_undegraded":"2024-04-25T08:55:18.540868+0000","last_fullsized":"2024-04-25T08:55:18.540868+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:07:26.954488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837602+0000","last_change":"2024-04-25T08:55:15.810287+0000","last_active":"2024-04-25T08:55:17.837602+0000","last_peered":"2024-04-25T08:55:17.837602+0000","last_clean":"2024-04-25T08:55:17.837602+0000","last_became_active":"2024-04-25T08:55:15.810000+0000","last_became_peered":"2024-04-25T08:55:15.810000+0000","last_unstale":"2024-04-25T08:55:17.837602+0000","last_undegraded":"2024-04-25T08:55:17.837602+0000","last_fullsized":"2024-04-25T08:55:17.837602+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:43.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539785+0000","last_change":"2024-04-25T08:55:16.832716+0000","last_active":"2024-04-25T08:55:18.539785+0000","last_peered":"2024-04-25T08:55:18.539785+0000","last_clean":"2024-04-25T08:55:18.539785+0000","last_became_active":"2024-04-25T08:55:16.832332+0000","last_became_peered":"2024-04-25T08:55:16.832332+0000","last_unstale":"2024-04-25T08:55:18.539785+0000","last_undegraded":"2024-04-25T08:55:18.539785+0000","last_fullsized":"2024-04-25T08:55:18.539785+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.956125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837620+0000","last_change":"2024-04-25T08:55:15.810523+0000","last_active":"2024-04-25T08:55:17.837620+0000","last_peered":"2024-04-25T08:55:17.837620+0000","last_clean":"2024-04-25T08:55:17.837620+0000","last_became_active":"2024-04-25T08:55:15.809802+0000","last_became_peered":"2024-04-25T08:55:15.809802+0000","last_unstale":"2024-04-25T08:55:17.837620+0000","last_undegraded":"2024-04-25T08:55:17.837620+0000","last_fullsized":"2024-04-25T08:55:17.837620+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.053850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540961+0000","last_change":"2024-04-25T08:55:16.841348+0000","last_active":"2024-04-25T08:55:18.540961+0000","last_peered":"2024-04-25T08:55:18.540961+0000","last_clean":"2024-04-25T08:55:18.540961+0000","last_became_active":"2024-04-25T08:55:16.840890+0000","last_became_peered":"2024-04-25T08:55:16.840890+0000","last_unstale":"2024-04-25T08:55:18.540961+0000","last_undegraded":"2024-04-25T08:55:18.540961+0000","last_fullsized":"2024-04-25T08:55:18.540961+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:36.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539863+0000","last_change":"2024-04-25T08:55:15.808364+0000","last_active":"2024-04-25T08:55:18.539863+0000","last_peered":"2024-04-25T08:55:18.539863+0000","last_clean":"2024-04-25T08:55:18.539863+0000","last_became_active":"2024-04-25T08:55:15.808068+0000","last_became_peered":"2024-04-25T08:55:15.808068+0000","last_unstale":"2024-04-25T08:55:18.539863+0000","last_undegraded":"2024-04-25T08:55:18.539863+0000","last_fullsized":"2024-04-25T08:55:18.539863+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:00.314074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539499+0000","last_change":"2024-04-25T08:55:16.840358+0000","last_active":"2024-04-25T08:55:18.539499+0000","last_peered":"2024-04-25T08:55:18.539499+0000","last_clean":"2024-04-25T08:55:18.539499+0000","last_became_active":"2024-04-25T08:55:16.837947+0000","last_became_peered":"2024-04-25T08:55:16.837947+0000","last_unstale":"2024-04-25T08:55:18.539499+0000","last_undegraded":"2024-04-25T08:55:18.539499+0000","last_fullsized":"2024-04-25T08:55:18.539499+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:25.830198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539474+0000","last_change":"2024-04-25T08:55:15.809376+0000","last_active":"2024-04-25T08:55:18.539474+0000","last_peered":"2024-04-25T08:55:18.539474+0000","last_clean":"2024-04-25T08:55:18.539474+0000","last_became_active":"2024-04-25T08:55:15.808982+0000","last_became_peered":"2024-04-25T08:55:15.808982+0000","last_unstale":"2024-04-25T08:55:18.539474+0000","last_undegraded":"2024-04-25T08:55:18.539474+0000","last_fullsized":"2024-04-25T08:55:18.539474+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:43.806513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.836650+0000","last_change":"2024-04-25T08:55:16.829231+0000","last_active":"2024-04-25T08:55:17.836650+0000","last_peered":"2024-04-25T08:55:17.836650+0000","last_clean":"2024-04-25T08:55:17.836650+0000","last_became_active":"2024-04-25T08:55:16.828876+0000","last_became_peered":"2024-04-25T08:55:16.828876+0000","last_unstale":"2024-04-25T08:55:17.836650+0000","last_undegraded":"2024-04-25T08:55:17.836650+0000","last_fullsized":"2024-04-25T08:55:17.836650+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:23.778385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540129+0000","last_change":"2024-04-25T08:55:15.810673+0000","last_active":"2024-04-25T08:55:18.540129+0000","last_peered":"2024-04-25T08:55:18.540129+0000","last_clean":"2024-04-25T08:55:18.540129+0000","last_became_active":"2024-04-25T08:55:15.809289+0000","last_became_peered":"2024-04-25T08:55:15.809289+0000","last_unstale":"2024-04-25T08:55:18.540129+0000","last_undegraded":"2024-04-25T08:55:18.540129+0000","last_fullsized":"2024-04-25T08:55:18.540129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.016665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540504+0000","last_change":"2024-04-25T08:55:16.841663+0000","last_active":"2024-04-25T08:55:18.540504+0000","last_peered":"2024-04-25T08:55:18.540504+0000","last_clean":"2024-04-25T08:55:18.540504+0000","last_became_active":"2024-04-25T08:55:16.841397+0000","last_became_peered":"2024-04-25T08:55:16.841397+0000","last_unstale":"2024-04-25T08:55:18.540504+0000","last_undegraded":"2024-04-25T08:55:18.540504+0000","last_fullsized":"2024-04-25T08:55:18.540504+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540624+0000","last_change":"2024-04-25T08:55:15.808307+0000","last_active":"2024-04-25T08:55:18.540624+0000","last_peered":"2024-04-25T08:55:18.540624+0000","last_clean":"2024-04-25T08:55:18.540624+0000","last_became_active":"2024-04-25T08:55:15.808012+0000","last_became_peered":"2024-04-25T08:55:15.808012+0000","last_unstale":"2024-04-25T08:55:18.540624+0000","last_undegraded":"2024-04-25T08:55:18.540624+0000","last_fullsized":"2024-04-25T08:55:18.540624+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:11.650964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837119+0000","last_change":"2024-04-25T08:55:16.824657+0000","last_active":"2024-04-25T08:55:17.837119+0000","last_peered":"2024-04-25T08:55:17.837119+0000","last_clean":"2024-04-25T08:55:17.837119+0000","last_became_active":"2024-04-25T08:55:16.824372+0000","last_became_peered":"2024-04-25T08:55:16.824372+0000","last_unstale":"2024-04-25T08:55:17.837119+0000","last_undegraded":"2024-04-25T08:55:17.837119+0000","last_fullsized":"2024-04-25T08:55:17.837119+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:15.153971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541025+0000","last_change":"2024-04-25T08:55:15.808834+0000","last_active":"2024-04-25T08:55:18.541025+0000","last_peered":"2024-04-25T08:55:18.541025+0000","last_clean":"2024-04-25T08:55:18.541025+0000","last_became_active":"2024-04-25T08:55:15.808535+0000","last_became_peered":"2024-04-25T08:55:15.808535+0000","last_unstale":"2024-04-25T08:55:18.541025+0000","last_undegraded":"2024-04-25T08:55:18.541025+0000","last_fullsized":"2024-04-25T08:55:18.541025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:51.724373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837714+0000","last_change":"2024-04-25T08:55:16.829816+0000","last_active":"2024-04-25T08:55:17.837714+0000","last_peered":"2024-04-25T08:55:17.837714+0000","last_clean":"2024-04-25T08:55:17.837714+0000","last_became_active":"2024-04-25T08:55:16.829214+0000","last_became_peered":"2024-04-25T08:55:16.829214+0000","last_unstale":"2024-04-25T08:55:17.837714+0000","last_undegraded":"2024-04-25T08:55:17.837714+0000","last_fullsized":"2024-04-25T08:55:17.837714+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:34.646693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837921+0000","last_change":"2024-04-25T08:55:15.803912+0000","last_active":"2024-04-25T08:55:17.837921+0000","last_peered":"2024-04-25T08:55:17.837921+0000","last_clean":"2024-04-25T08:55:17.837921+0000","last_became_active":"2024-04-25T08:55:15.803618+0000","last_became_peered":"2024-04-25T08:55:15.803618+0000","last_unstale":"2024-04-25T08:55:17.837921+0000","last_undegraded":"2024-04-25T08:55:17.837921+0000","last_fullsized":"2024-04-25T08:55:17.837921+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:21.098215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837797+0000","last_change":"2024-04-25T08:55:16.836929+0000","last_active":"2024-04-25T08:55:17.837797+0000","last_peered":"2024-04-25T08:55:17.837797+0000","last_clean":"2024-04-25T08:55:17.837797+0000","last_became_active":"2024-04-25T08:55:16.836637+0000","last_became_peered":"2024-04-25T08:55:16.836637+0000","last_unstale":"2024-04-25T08:55:17.837797+0000","last_undegraded":"2024-04-25T08:55:17.837797+0000","last_fullsized":"2024-04-25T08:55:17.837797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:36.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540179+0000","last_change":"2024-04-25T08:55:15.804532+0000","last_active":"2024-04-25T08:55:18.540179+0000","last_peered":"2024-04-25T08:55:18.540179+0000","last_clean":"2024-04-25T08:55:18.540179+0000","last_became_active":"2024-04-25T08:55:15.804121+0000","last_became_peered":"2024-04-25T08:55:15.804121+0000","last_unstale":"2024-04-25T08:55:18.540179+0000","last_undegraded":"2024-04-25T08:55:18.540179+0000","last_fullsized":"2024-04-25T08:55:18.540179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.796101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837148+0000","last_change":"2024-04-25T08:55:16.841731+0000","last_active":"2024-04-25T08:55:17.837148+0000","last_peered":"2024-04-25T08:55:17.837148+0000","last_clean":"2024-04-25T08:55:17.837148+0000","last_became_active":"2024-04-25T08:55:16.841469+0000","last_became_peered":"2024-04-25T08:55:16.841469+0000","last_unstale":"2024-04-25T08:55:17.837148+0000","last_undegraded":"2024-04-25T08:55:17.837148+0000","last_fullsized":"2024-04-25T08:55:17.837148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:01.320597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837682+0000","last_change":"2024-04-25T08:55:15.810787+0000","last_active":"2024-04-25T08:55:17.837682+0000","last_peered":"2024-04-25T08:55:17.837682+0000","last_clean":"2024-04-25T08:55:17.837682+0000","last_became_active":"2024-04-25T08:55:15.810228+0000","last_became_peered":"2024-04-25T08:55:15.810228+0000","last_unstale":"2024-04-25T08:55:17.837682+0000","last_undegraded":"2024-04-25T08:55:17.837682+0000","last_fullsized":"2024-04-25T08:55:17.837682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:10.670548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540521+0000","last_change":"2024-04-25T08:55:16.841653+0000","last_active":"2024-04-25T08:55:18.540521+0000","last_peered":"2024-04-25T08:55:18.540521+0000","last_clean":"2024-04-25T08:55:18.540521+0000","last_became_active":"2024-04-25T08:55:16.840792+0000","last_became_peered":"2024-04-25T08:55:16.840792+0000","last_unstale":"2024-04-25T08:55:18.540521+0000","last_undegraded":"2024-04-25T08:55:18.540521+0000","last_fullsized":"2024-04-25T08:55:18.540521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:26.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837375+0000","last_change":"2024-04-25T08:55:15.809556+0000","last_active":"2024-04-25T08:55:17.837375+0000","last_peered":"2024-04-25T08:55:17.837375+0000","last_clean":"2024-04-25T08:55:17.837375+0000","last_became_active":"2024-04-25T08:55:15.809080+0000","last_became_peered":"2024-04-25T08:55:15.809080+0000","last_unstale":"2024-04-25T08:55:17.837375+0000","last_undegraded":"2024-04-25T08:55:17.837375+0000","last_fullsized":"2024-04-25T08:55:17.837375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:25.637156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837378+0000","last_change":"2024-04-25T08:55:16.829568+0000","last_active":"2024-04-25T08:55:17.837378+0000","last_peered":"2024-04-25T08:55:17.837378+0000","last_clean":"2024-04-25T08:55:17.837378+0000","last_became_active":"2024-04-25T08:55:16.829248+0000","last_became_peered":"2024-04-25T08:55:16.829248+0000","last_unstale":"2024-04-25T08:55:17.837378+0000","last_undegraded":"2024-04-25T08:55:17.837378+0000","last_fullsized":"2024-04-25T08:55:17.837378+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:56.165607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837529+0000","last_change":"2024-04-25T08:55:15.812602+0000","last_active":"2024-04-25T08:55:17.837529+0000","last_peered":"2024-04-25T08:55:17.837529+0000","last_clean":"2024-04-25T08:55:17.837529+0000","last_became_active":"2024-04-25T08:55:15.812277+0000","last_became_peered":"2024-04-25T08:55:15.812277+0000","last_unstale":"2024-04-25T08:55:17.837529+0000","last_undegraded":"2024-04-25T08:55:17.837529+0000","last_fullsized":"2024-04-25T08:55:17.837529+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:15.861856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837530+0000","last_change":"2024-04-25T08:55:16.828073+0000","last_active":"2024-04-25T08:55:17.837530+0000","last_peered":"2024-04-25T08:55:17.837530+0000","last_clean":"2024-04-25T08:55:17.837530+0000","last_became_active":"2024-04-25T08:55:16.827811+0000","last_became_peered":"2024-04-25T08:55:16.827811+0000","last_unstale":"2024-04-25T08:55:17.837530+0000","last_undegraded":"2024-04-25T08:55:17.837530+0000","last_fullsized":"2024-04-25T08:55:17.837530+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539870+0000","last_change":"2024-04-25T08:55:15.809552+0000","last_active":"2024-04-25T08:55:18.539870+0000","last_peered":"2024-04-25T08:55:18.539870+0000","last_clean":"2024-04-25T08:55:18.539870+0000","last_became_active":"2024-04-25T08:55:15.809065+0000","last_became_peered":"2024-04-25T08:55:15.809065+0000","last_unstale":"2024-04-25T08:55:18.539870+0000","last_undegraded":"2024-04-25T08:55:18.539870+0000","last_fullsized":"2024-04-25T08:55:18.539870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:36.553413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540362+0000","last_change":"2024-04-25T08:55:16.833303+0000","last_active":"2024-04-25T08:55:18.540362+0000","last_peered":"2024-04-25T08:55:18.540362+0000","last_clean":"2024-04-25T08:55:18.540362+0000","last_became_active":"2024-04-25T08:55:16.832435+0000","last_became_peered":"2024-04-25T08:55:16.832435+0000","last_unstale":"2024-04-25T08:55:18.540362+0000","last_undegraded":"2024-04-25T08:55:18.540362+0000","last_fullsized":"2024-04-25T08:55:18.540362+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:15.812095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.541163+0000","last_change":"2024-04-25T08:55:15.806916+0000","last_active":"2024-04-25T08:55:18.541163+0000","last_peered":"2024-04-25T08:55:18.541163+0000","last_clean":"2024-04-25T08:55:18.541163+0000","last_became_active":"2024-04-25T08:55:15.806584+0000","last_became_peered":"2024-04-25T08:55:15.806584+0000","last_unstale":"2024-04-25T08:55:18.541163+0000","last_undegraded":"2024-04-25T08:55:18.541163+0000","last_fullsized":"2024-04-25T08:55:18.541163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:52.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540974+0000","last_change":"2024-04-25T08:55:16.846605+0000","last_active":"2024-04-25T08:55:18.540974+0000","last_peered":"2024-04-25T08:55:18.540974+0000","last_clean":"2024-04-25T08:55:18.540974+0000","last_became_active":"2024-04-25T08:55:16.846304+0000","last_became_peered":"2024-04-25T08:55:16.846304+0000","last_unstale":"2024-04-25T08:55:18.540974+0000","last_undegraded":"2024-04-25T08:55:18.540974+0000","last_fullsized":"2024-04-25T08:55:18.540974+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540594+0000","last_change":"2024-04-25T08:55:15.806841+0000","last_active":"2024-04-25T08:55:18.540594+0000","last_peered":"2024-04-25T08:55:18.540594+0000","last_clean":"2024-04-25T08:55:18.540594+0000","last_became_active":"2024-04-25T08:55:15.806563+0000","last_became_peered":"2024-04-25T08:55:15.806563+0000","last_unstale":"2024-04-25T08:55:18.540594+0000","last_undegraded":"2024-04-25T08:55:18.540594+0000","last_fullsized":"2024-04-25T08:55:18.540594+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:19.717985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837109+0000","last_change":"2024-04-25T08:55:16.838841+0000","last_active":"2024-04-25T08:55:17.837109+0000","last_peered":"2024-04-25T08:55:17.837109+0000","last_clean":"2024-04-25T08:55:17.837109+0000","last_became_active":"2024-04-25T08:55:16.838592+0000","last_became_peered":"2024-04-25T08:55:16.838592+0000","last_unstale":"2024-04-25T08:55:17.837109+0000","last_undegraded":"2024-04-25T08:55:17.837109+0000","last_fullsized":"2024-04-25T08:55:17.837109+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:16.953838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540102+0000","last_change":"2024-04-25T08:55:15.809119+0000","last_active":"2024-04-25T08:55:18.540102+0000","last_peered":"2024-04-25T08:55:18.540102+0000","last_clean":"2024-04-25T08:55:18.540102+0000","last_became_active":"2024-04-25T08:55:15.808770+0000","last_became_peered":"2024-04-25T08:55:15.808770+0000","last_unstale":"2024-04-25T08:55:18.540102+0000","last_undegraded":"2024-04-25T08:55:18.540102+0000","last_fullsized":"2024-04-25T08:55:18.540102+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:25.637156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837451+0000","last_change":"2024-04-25T08:55:16.831158+0000","last_active":"2024-04-25T08:55:17.837451+0000","last_peered":"2024-04-25T08:55:17.837451+0000","last_clean":"2024-04-25T08:55:17.837451+0000","last_became_active":"2024-04-25T08:55:16.830883+0000","last_became_peered":"2024-04-25T08:55:16.830883+0000","last_unstale":"2024-04-25T08:55:17.837451+0000","last_undegraded":"2024-04-25T08:55:17.837451+0000","last_fullsized":"2024-04-25T08:55:17.837451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:20.724508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837803+0000","last_change":"2024-04-25T08:55:15.811663+0000","last_active":"2024-04-25T08:55:17.837803+0000","last_peered":"2024-04-25T08:55:17.837803+0000","last_clean":"2024-04-25T08:55:17.837803+0000","last_became_active":"2024-04-25T08:55:15.811372+0000","last_became_peered":"2024-04-25T08:55:15.811372+0000","last_unstale":"2024-04-25T08:55:17.837803+0000","last_undegraded":"2024-04-25T08:55:17.837803+0000","last_fullsized":"2024-04-25T08:55:17.837803+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:00.529017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837681+0000","last_change":"2024-04-25T08:55:16.830366+0000","last_active":"2024-04-25T08:55:17.837681+0000","last_peered":"2024-04-25T08:55:17.837681+0000","last_clean":"2024-04-25T08:55:17.837681+0000","last_became_active":"2024-04-25T08:55:16.830101+0000","last_became_peered":"2024-04-25T08:55:16.830101+0000","last_unstale":"2024-04-25T08:55:17.837681+0000","last_undegraded":"2024-04-25T08:55:17.837681+0000","last_fullsized":"2024-04-25T08:55:17.837681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:56.842647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837784+0000","last_change":"2024-04-25T08:55:15.811103+0000","last_active":"2024-04-25T08:55:17.837784+0000","last_peered":"2024-04-25T08:55:17.837784+0000","last_clean":"2024-04-25T08:55:17.837784+0000","last_became_active":"2024-04-25T08:55:15.810409+0000","last_became_peered":"2024-04-25T08:55:15.810409+0000","last_unstale":"2024-04-25T08:55:17.837784+0000","last_undegraded":"2024-04-25T08:55:17.837784+0000","last_fullsized":"2024-04-25T08:55:17.837784+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:35.665144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540573+0000","last_change":"2024-04-25T08:55:16.826713+0000","last_active":"2024-04-25T08:55:18.540573+0000","last_peered":"2024-04-25T08:55:18.540573+0000","last_clean":"2024-04-25T08:55:18.540573+0000","last_became_active":"2024-04-25T08:55:16.826401+0000","last_became_peered":"2024-04-25T08:55:16.826401+0000","last_unstale":"2024-04-25T08:55:18.540573+0000","last_undegraded":"2024-04-25T08:55:18.540573+0000","last_fullsized":"2024-04-25T08:55:18.540573+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:00.609605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539589+0000","last_change":"2024-04-25T08:55:15.808197+0000","last_active":"2024-04-25T08:55:18.539589+0000","last_peered":"2024-04-25T08:55:18.539589+0000","last_clean":"2024-04-25T08:55:18.539589+0000","last_became_active":"2024-04-25T08:55:15.806676+0000","last_became_peered":"2024-04-25T08:55:15.806676+0000","last_unstale":"2024-04-25T08:55:18.539589+0000","last_undegraded":"2024-04-25T08:55:18.539589+0000","last_fullsized":"2024-04-25T08:55:18.539589+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:21.098215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539986+0000","last_change":"2024-04-25T08:55:16.829187+0000","last_active":"2024-04-25T08:55:18.539986+0000","last_peered":"2024-04-25T08:55:18.539986+0000","last_clean":"2024-04-25T08:55:18.539986+0000","last_became_active":"2024-04-25T08:55:16.828772+0000","last_became_peered":"2024-04-25T08:55:16.828772+0000","last_unstale":"2024-04-25T08:55:18.539986+0000","last_undegraded":"2024-04-25T08:55:18.539986+0000","last_fullsized":"2024-04-25T08:55:18.539986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:29.403892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539546+0000","last_change":"2024-04-25T08:55:15.810669+0000","last_active":"2024-04-25T08:55:18.539546+0000","last_peered":"2024-04-25T08:55:18.539546+0000","last_clean":"2024-04-25T08:55:18.539546+0000","last_became_active":"2024-04-25T08:55:15.810364+0000","last_became_peered":"2024-04-25T08:55:15.810364+0000","last_unstale":"2024-04-25T08:55:18.539546+0000","last_undegraded":"2024-04-25T08:55:18.539546+0000","last_fullsized":"2024-04-25T08:55:18.539546+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:39.011045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539570+0000","last_change":"2024-04-25T08:55:16.844563+0000","last_active":"2024-04-25T08:55:18.539570+0000","last_peered":"2024-04-25T08:55:18.539570+0000","last_clean":"2024-04-25T08:55:18.539570+0000","last_became_active":"2024-04-25T08:55:16.844276+0000","last_became_peered":"2024-04-25T08:55:16.844276+0000","last_unstale":"2024-04-25T08:55:18.539570+0000","last_undegraded":"2024-04-25T08:55:18.539570+0000","last_fullsized":"2024-04-25T08:55:18.539570+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:36.060373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837697+0000","last_change":"2024-04-25T08:55:15.810567+0000","last_active":"2024-04-25T08:55:17.837697+0000","last_peered":"2024-04-25T08:55:17.837697+0000","last_clean":"2024-04-25T08:55:17.837697+0000","last_became_active":"2024-04-25T08:55:15.809948+0000","last_became_peered":"2024-04-25T08:55:15.809948+0000","last_unstale":"2024-04-25T08:55:17.837697+0000","last_undegraded":"2024-04-25T08:55:17.837697+0000","last_fullsized":"2024-04-25T08:55:17.837697+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.053850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.838063+0000","last_change":"2024-04-25T08:55:16.842345+0000","last_active":"2024-04-25T08:55:17.838063+0000","last_peered":"2024-04-25T08:55:17.838063+0000","last_clean":"2024-04-25T08:55:17.838063+0000","last_became_active":"2024-04-25T08:55:16.841261+0000","last_became_peered":"2024-04-25T08:55:16.841261+0000","last_unstale":"2024-04-25T08:55:17.838063+0000","last_undegraded":"2024-04-25T08:55:17.838063+0000","last_fullsized":"2024-04-25T08:55:17.838063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:44.813036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837927+0000","last_change":"2024-04-25T08:55:15.810587+0000","last_active":"2024-04-25T08:55:17.837927+0000","last_peered":"2024-04-25T08:55:17.837927+0000","last_clean":"2024-04-25T08:55:17.837927+0000","last_became_active":"2024-04-25T08:55:15.810279+0000","last_became_peered":"2024-04-25T08:55:15.810279+0000","last_unstale":"2024-04-25T08:55:17.837927+0000","last_undegraded":"2024-04-25T08:55:17.837927+0000","last_fullsized":"2024-04-25T08:55:17.837927+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:02.949602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540495+0000","last_change":"2024-04-25T08:55:16.845748+0000","last_active":"2024-04-25T08:55:18.540495+0000","last_peered":"2024-04-25T08:55:18.540495+0000","last_clean":"2024-04-25T08:55:18.540495+0000","last_became_active":"2024-04-25T08:55:16.845270+0000","last_became_peered":"2024-04-25T08:55:16.845270+0000","last_unstale":"2024-04-25T08:55:18.540495+0000","last_undegraded":"2024-04-25T08:55:18.540495+0000","last_fullsized":"2024-04-25T08:55:18.540495+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:16.868379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837918+0000","last_change":"2024-04-25T08:55:15.808197+0000","last_active":"2024-04-25T08:55:17.837918+0000","last_peered":"2024-04-25T08:55:17.837918+0000","last_clean":"2024-04-25T08:55:17.837918+0000","last_became_active":"2024-04-25T08:55:15.807712+0000","last_became_peered":"2024-04-25T08:55:15.807712+0000","last_unstale":"2024-04-25T08:55:17.837918+0000","last_undegraded":"2024-04-25T08:55:17.837918+0000","last_fullsized":"2024-04-25T08:55:17.837918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:24.823675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837799+0000","last_change":"2024-04-25T08:55:16.829720+0000","last_active":"2024-04-25T08:55:17.837799+0000","last_peered":"2024-04-25T08:55:17.837799+0000","last_clean":"2024-04-25T08:55:17.837799+0000","last_became_active":"2024-04-25T08:55:16.829479+0000","last_became_peered":"2024-04-25T08:55:16.829479+0000","last_unstale":"2024-04-25T08:55:17.837799+0000","last_undegraded":"2024-04-25T08:55:17.837799+0000","last_fullsized":"2024-04-25T08:55:17.837799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:15.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540710+0000","last_change":"2024-04-25T08:55:15.805828+0000","last_active":"2024-04-25T08:55:18.540710+0000","last_peered":"2024-04-25T08:55:18.540710+0000","last_clean":"2024-04-25T08:55:18.540710+0000","last_became_active":"2024-04-25T08:55:15.805528+0000","last_became_peered":"2024-04-25T08:55:15.805528+0000","last_unstale":"2024-04-25T08:55:18.540710+0000","last_undegraded":"2024-04-25T08:55:18.540710+0000","last_fullsized":"2024-04-25T08:55:18.540710+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:53.131499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837868+0000","last_change":"2024-04-25T08:55:16.828363+0000","last_active":"2024-04-25T08:55:17.837868+0000","last_peered":"2024-04-25T08:55:17.837868+0000","last_clean":"2024-04-25T08:55:17.837868+0000","last_became_active":"2024-04-25T08:55:16.825857+0000","last_became_peered":"2024-04-25T08:55:16.825857+0000","last_unstale":"2024-04-25T08:55:17.837868+0000","last_undegraded":"2024-04-25T08:55:17.837868+0000","last_fullsized":"2024-04-25T08:55:17.837868+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:31.555032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837553+0000","last_change":"2024-04-25T08:55:15.804862+0000","last_active":"2024-04-25T08:55:17.837553+0000","last_peered":"2024-04-25T08:55:17.837553+0000","last_clean":"2024-04-25T08:55:17.837553+0000","last_became_active":"2024-04-25T08:55:15.804575+0000","last_became_peered":"2024-04-25T08:55:15.804575+0000","last_unstale":"2024-04-25T08:55:17.837553+0000","last_undegraded":"2024-04-25T08:55:17.837553+0000","last_fullsized":"2024-04-25T08:55:17.837553+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:43.806513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837565+0000","last_change":"2024-04-25T08:55:16.830603+0000","last_active":"2024-04-25T08:55:17.837565+0000","last_peered":"2024-04-25T08:55:17.837565+0000","last_clean":"2024-04-25T08:55:17.837565+0000","last_became_active":"2024-04-25T08:55:16.830277+0000","last_became_peered":"2024-04-25T08:55:16.830277+0000","last_unstale":"2024-04-25T08:55:17.837565+0000","last_undegraded":"2024-04-25T08:55:17.837565+0000","last_fullsized":"2024-04-25T08:55:17.837565+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:29.707648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539870+0000","last_change":"2024-04-25T08:55:15.810936+0000","last_active":"2024-04-25T08:55:18.539870+0000","last_peered":"2024-04-25T08:55:18.539870+0000","last_clean":"2024-04-25T08:55:18.539870+0000","last_became_active":"2024-04-25T08:55:15.810469+0000","last_became_peered":"2024-04-25T08:55:15.810469+0000","last_unstale":"2024-04-25T08:55:18.539870+0000","last_undegraded":"2024-04-25T08:55:18.539870+0000","last_fullsized":"2024-04-25T08:55:18.539870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:22.793939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539713+0000","last_change":"2024-04-25T08:55:16.820981+0000","last_active":"2024-04-25T08:55:18.539713+0000","last_peered":"2024-04-25T08:55:18.539713+0000","last_clean":"2024-04-25T08:55:18.539713+0000","last_became_active":"2024-04-25T08:55:16.820654+0000","last_became_peered":"2024-04-25T08:55:16.820654+0000","last_unstale":"2024-04-25T08:55:18.539713+0000","last_undegraded":"2024-04-25T08:55:18.539713+0000","last_fullsized":"2024-04-25T08:55:18.539713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:01.535541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540449+0000","last_change":"2024-04-25T08:55:15.806700+0000","last_active":"2024-04-25T08:55:18.540449+0000","last_peered":"2024-04-25T08:55:18.540449+0000","last_clean":"2024-04-25T08:55:18.540449+0000","last_became_active":"2024-04-25T08:55:15.806407+0000","last_became_peered":"2024-04-25T08:55:15.806407+0000","last_unstale":"2024-04-25T08:55:18.540449+0000","last_undegraded":"2024-04-25T08:55:18.540449+0000","last_fullsized":"2024-04-25T08:55:18.540449+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:17.412365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.539725+0000","last_change":"2024-04-25T08:55:16.843737+0000","last_active":"2024-04-25T08:55:18.539725+0000","last_peered":"2024-04-25T08:55:18.539725+0000","last_clean":"2024-04-25T08:55:18.539725+0000","last_became_active":"2024-04-25T08:55:16.843213+0000","last_became_peered":"2024-04-25T08:55:16.843213+0000","last_unstale":"2024-04-25T08:55:18.539725+0000","last_undegraded":"2024-04-25T08:55:18.539725+0000","last_fullsized":"2024-04-25T08:55:18.539725+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:09.916126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540000+0000","last_change":"2024-04-25T08:55:15.810186+0000","last_active":"2024-04-25T08:55:18.540000+0000","last_peered":"2024-04-25T08:55:18.540000+0000","last_clean":"2024-04-25T08:55:18.540000+0000","last_became_active":"2024-04-25T08:55:15.809881+0000","last_became_peered":"2024-04-25T08:55:15.809881+0000","last_unstale":"2024-04-25T08:55:18.540000+0000","last_undegraded":"2024-04-25T08:55:18.540000+0000","last_fullsized":"2024-04-25T08:55:18.540000+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:14.805572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540870+0000","last_change":"2024-04-25T08:55:16.840505+0000","last_active":"2024-04-25T08:55:18.540870+0000","last_peered":"2024-04-25T08:55:18.540870+0000","last_clean":"2024-04-25T08:55:18.540870+0000","last_became_active":"2024-04-25T08:55:16.837418+0000","last_became_peered":"2024-04-25T08:55:16.837418+0000","last_unstale":"2024-04-25T08:55:18.540870+0000","last_undegraded":"2024-04-25T08:55:18.540870+0000","last_fullsized":"2024-04-25T08:55:18.540870+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:15.785462+0000","last_clean_scrub_stamp":"2024-04-25T08:55:15.785462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:11.227250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:18.540226+0000","last_change":"2024-04-25T08:55:15.815889+0000","last_active":"2024-04-25T08:55:18.540226+0000","last_peered":"2024-04-25T08:55:18.540226+0000","last_clean":"2024-04-25T08:55:18.540226+0000","last_became_active":"2024-04-25T08:55:15.815594+0000","last_became_peered":"2024-04-25T08:55:15.815594+0000","last_unstale":"2024-04-25T08:55:18.540226+0000","last_undegraded":"2024-04-25T08:55:18.540226+0000","last_fullsized":"2024-04-25T08:55:18.540226+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:55:14.778939+0000","last_clean_scrub_stamp":"2024-04-25T08:55:14.778939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:43.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":214,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T08:55:17.837683+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:55:17.837683+0000","last_peered":"2024-04-25T08:55:17.837683+0000","last_clean":"2024-04-25T08:55:17.837683+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:55:17.837683+0000","last_undegraded":"2024-04-25T08:55:17.837683+0000","last_fullsized":"2024-04-25T08:55:17.837683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1142784,"data_stored":810559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":220773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":220171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":557056,"data_stored":221713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":220739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":221735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1142784,"data_stored":810503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":220171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:55:25.593 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:55:25.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:55:25.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.746+0000 7f9b5b8b3640 1 Processor -- start 2024-04-25T08:55:25.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.746+0000 7f9b5b8b3640 1 -- start start 2024-04-25T08:55:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.747+0000 7f9b5b8b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b540cc7a0 0x7f9b540b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.747+0000 7f9b5b8b3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9b540ce390 0x7f9b5406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.747+0000 7f9b5b8b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b540cd0f0 con 0x7f9b5406b0e0 2024-04-25T08:55:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.747+0000 7f9b5b8b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540cbdb0 con 0x7f9b540cc7a0 2024-04-25T08:55:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.747+0000 7f9b5b8b3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540cda20 con 0x7f9b540ce390 2024-04-25T08:55:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.747+0000 7f9b5964f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b540cc7a0 0x7f9b540b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.747+0000 7f9b59e50640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9b5406b0e0 0x7f9b5415d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50890/0 (socket says 172.21.15.55:50890) 2024-04-25T08:55:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.747+0000 7f9b59e50640 1 -- 172.21.15.55:0/4231315308 learned_addr learned my addr 172.21.15.55:0/4231315308 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.747+0000 7f9b5964f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b540cc7a0 0x7f9b540b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42526/0 (socket says 172.21.15.55:42526) 2024-04-25T08:55:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.748+0000 7f9b5964f640 1 -- 172.21.15.55:0/4231315308 >> v2:172.21.15.167:3300/0 conn(0x7f9b540ce390 msgr2=0x7f9b5406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.748+0000 7f9b5964f640 1 --2- 172.21.15.55:0/4231315308 >> v2:172.21.15.167:3300/0 conn(0x7f9b540ce390 0x7f9b5406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.748+0000 7f9b5964f640 1 -- 172.21.15.55:0/4231315308 >> v1:172.21.15.55:6789/0 conn(0x7f9b5406b0e0 legacy=0x7f9b5415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.748+0000 7f9b5964f640 1 -- 172.21.15.55:0/4231315308 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b540cd3d0 con 0x7f9b540cc7a0 2024-04-25T08:55:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.748+0000 7f9b4bfff640 1 -- 172.21.15.55:0/4231315308 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978131548 0 0) 0x7f9b540cd0f0 con 0x7f9b5406b0e0 2024-04-25T08:55:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.748+0000 7f9b5964f640 1 --2- 172.21.15.55:0/4231315308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540cc7a0 0x7f9b540b1890 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9b540b3340 tx=0x7f9b4c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0e2bbe127e501b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.749+0000 7f9b4bfff640 1 -- 172.21.15.55:0/4231315308 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c037070 con 0x7f9b540cc7a0 2024-04-25T08:55:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.749+0000 7f9b4bfff640 1 -- 172.21.15.55:0/4231315308 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c032440 con 0x7f9b540cc7a0 2024-04-25T08:55:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.749+0000 7f9b4bfff640 1 -- 172.21.15.55:0/4231315308 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c032810 con 0x7f9b540cc7a0 2024-04-25T08:55:25.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.749+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/4231315308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540cc7a0 msgr2=0x7f9b540b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:25.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.749+0000 7f9b5b8b3640 1 --2- 172.21.15.55:0/4231315308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540cc7a0 0x7f9b540b1890 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9b540b3340 tx=0x7f9b4c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.749+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/4231315308 shutdown_connections 2024-04-25T08:55:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.749+0000 7f9b5b8b3640 1 --2- 172.21.15.55:0/4231315308 >> v2:172.21.15.167:3300/0 conn(0x7f9b540ce390 0x7f9b5406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.749+0000 7f9b5b8b3640 1 --2- 172.21.15.55:0/4231315308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540cc7a0 0x7f9b540b1890 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.749+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/4231315308 >> 172.21.15.55:0/4231315308 conn(0x7f9b540d0750 msgr2=0x7f9b540d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.749+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/4231315308 shutdown_connections 2024-04-25T08:55:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.749+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/4231315308 wait complete. 2024-04-25T08:55:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.750+0000 7f9b5b8b3640 1 Processor -- start 2024-04-25T08:55:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.750+0000 7f9b5b8b3640 1 -- start start 2024-04-25T08:55:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.751+0000 7f9b5b8b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5406b0e0 0x7f9b541e7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.751+0000 7f9b5b8b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b540cc7a0 0x7f9b540ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.751+0000 7f9b5b8b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b540ce390 0x7f9b541dcee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.751+0000 7f9b5b8b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540b1f50 con 0x7f9b5406b0e0 2024-04-25T08:55:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.751+0000 7f9b5b8b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540b1dd0 con 0x7f9b540ce390 2024-04-25T08:55:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.751+0000 7f9b5b8b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540cdeb0 con 0x7f9b540cc7a0 2024-04-25T08:55:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.751+0000 7f9b5964f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5406b0e0 0x7f9b541e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.751+0000 7f9b5964f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5406b0e0 0x7f9b541e7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42530/0 (socket says 172.21.15.55:42530) 2024-04-25T08:55:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.751+0000 7f9b5964f640 1 -- 172.21.15.55:0/689082421 learned_addr learned my addr 172.21.15.55:0/689082421 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.752+0000 7f9b5964f640 1 -- 172.21.15.55:0/689082421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b540cc7a0 msgr2=0x7f9b540ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.752+0000 7f9b5964f640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b540cc7a0 0x7f9b540ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.752+0000 7f9b5964f640 1 -- 172.21.15.55:0/689082421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b540ce390 msgr2=0x7f9b541dcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.752+0000 7f9b5964f640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b540ce390 0x7f9b541dcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.752+0000 7f9b5964f640 1 -- 172.21.15.55:0/689082421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b541e6b40 con 0x7f9b5406b0e0 2024-04-25T08:55:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.752+0000 7f9b5964f640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5406b0e0 0x7f9b541e7900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c000c00 tx=0x7f9b4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.752+0000 7f9b49ffb640 1 -- 172.21.15.55:0/689082421 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c041070 con 0x7f9b5406b0e0 2024-04-25T08:55:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.752+0000 7f9b49ffb640 1 -- 172.21.15.55:0/689082421 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c03c950 con 0x7f9b5406b0e0 2024-04-25T08:55:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.752+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/689082421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b541e6e20 con 0x7f9b5406b0e0 2024-04-25T08:55:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.752+0000 7f9b49ffb640 1 -- 172.21.15.55:0/689082421 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c037040 con 0x7f9b5406b0e0 2024-04-25T08:55:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.752+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/689082421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b541e7e40 con 0x7f9b5406b0e0 2024-04-25T08:55:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.753+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/689082421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b541e6ff0 con 0x7f9b5406b0e0 2024-04-25T08:55:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.754+0000 7f9b49ffb640 1 -- 172.21.15.55:0/689082421 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b4c044070 con 0x7f9b5406b0e0 2024-04-25T08:55:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.754+0000 7f9b49ffb640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b3806b4d0 0x7f9b3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.754+0000 7f9b49ffb640 1 -- 172.21.15.55:0/689082421 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9b4c0ab160 con 0x7f9b5406b0e0 2024-04-25T08:55:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.754+0000 7f9b58e4e640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b3806b4d0 0x7f9b3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.755+0000 7f9b58e4e640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b3806b4d0 0x7f9b3806d990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9b541e8270 tx=0x7f9b44006bf0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:25.758+0000 7f9b49ffb640 1 -- 172.21.15.55:0/689082421 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b4c07a0c0 con 0x7f9b5406b0e0 2024-04-25T08:55:26.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.012+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/689082421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9b5406cc40 con 0x7f9b5406b0e0 2024-04-25T08:55:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.015+0000 7f9b49ffb640 1 -- 172.21.15.55:0/689082421 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9b4c0799c0 con 0x7f9b5406b0e0 2024-04-25T08:55:26.004 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-04-25T08:55:26.005 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw== 2024-04-25T08:55:26.005 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2024-04-25T08:55:26.005 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2024-04-25T08:55:26.005 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:55:26.005 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-25T08:55:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/689082421 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b3806b4d0 msgr2=0x7f9b3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b3806b4d0 0x7f9b3806d990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9b541e8270 tx=0x7f9b44006bf0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/689082421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5406b0e0 msgr2=0x7f9b541e7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5406b0e0 0x7f9b541e7900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c000c00 tx=0x7f9b4c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/689082421 shutdown_connections 2024-04-25T08:55:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9b3806b4d0 0x7f9b3806d990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b540ce390 0x7f9b541dcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b540cc7a0 0x7f9b540ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 --2- 172.21.15.55:0/689082421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b5406b0e0 0x7f9b541e7900 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/689082421 >> 172.21.15.55:0/689082421 conn(0x7f9b540d0750 msgr2=0x7f9b540b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/689082421 shutdown_connections 2024-04-25T08:55:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.017+0000 7f9b5b8b3640 1 -- 172.21.15.55:0/689082421 wait complete. 2024-04-25T08:55:26.018 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:55:26.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.128+0000 7ff60cc12640 1 Processor -- start 2024-04-25T08:55:26.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.128+0000 7ff60cc12640 1 -- start start 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.129+0000 7ff60cc12640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff608071190 0x7ff6080ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.129+0000 7ff60cc12640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff608071570 0x7ff60815daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.129+0000 7ff60cc12640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff60815e030 0x7ff60815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.129+0000 7ff60cc12640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6080aeee0 con 0x7ff608071190 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.129+0000 7ff60cc12640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60806d550 con 0x7ff608071570 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.129+0000 7ff60cc12640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60806d830 con 0x7ff60815e030 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.130+0000 7ff60659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff608071190 0x7ff6080ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.130+0000 7ff60659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff608071190 0x7ff6080ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42546/0 (socket says 172.21.15.55:42546) 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.130+0000 7ff60659c640 1 -- 172.21.15.55:0/2892380972 learned_addr learned my addr 172.21.15.55:0/2892380972 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.130+0000 7ff606d9d640 1 --2- 172.21.15.55:0/2892380972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff60815e030 0x7ff60815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.130+0000 7ff605d9b640 1 --2- 172.21.15.55:0/2892380972 >> v2:172.21.15.167:3300/0 conn(0x7ff608071570 0x7ff60815daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.130+0000 7ff60659c640 1 -- 172.21.15.55:0/2892380972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff60815e030 msgr2=0x7ff60815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.130+0000 7ff60659c640 1 --2- 172.21.15.55:0/2892380972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff60815e030 0x7ff60815e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.130+0000 7ff60659c640 1 -- 172.21.15.55:0/2892380972 >> v2:172.21.15.167:3300/0 conn(0x7ff608071570 msgr2=0x7ff60815daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:26.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.130+0000 7ff60659c640 1 --2- 172.21.15.55:0/2892380972 >> v2:172.21.15.167:3300/0 conn(0x7ff608071570 0x7ff60815daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.130+0000 7ff60659c640 1 -- 172.21.15.55:0/2892380972 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60806db10 con 0x7ff608071190 2024-04-25T08:55:26.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.131+0000 7ff60659c640 1 --2- 172.21.15.55:0/2892380972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff608071190 0x7ff6080ae9a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009870 tx=0x7ff5f802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a2e76713815210 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:26.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.131+0000 7ff60559a640 1 -- 172.21.15.55:0/2892380972 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8037070 con 0x7ff608071190 2024-04-25T08:55:26.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.131+0000 7ff60559a640 1 -- 172.21.15.55:0/2892380972 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f8032440 con 0x7ff608071190 2024-04-25T08:55:26.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.131+0000 7ff60559a640 1 -- 172.21.15.55:0/2892380972 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8032810 con 0x7ff608071190 2024-04-25T08:55:26.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.131+0000 7ff60cc12640 1 -- 172.21.15.55:0/2892380972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff608071190 msgr2=0x7ff6080ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.131+0000 7ff60cc12640 1 --2- 172.21.15.55:0/2892380972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff608071190 0x7ff6080ae9a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009870 tx=0x7ff5f802a210 comp rx=0 tx=0).stop 2024-04-25T08:55:26.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.132+0000 7ff60cc12640 1 -- 172.21.15.55:0/2892380972 shutdown_connections 2024-04-25T08:55:26.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.132+0000 7ff60cc12640 1 --2- 172.21.15.55:0/2892380972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff60815e030 0x7ff60815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.132+0000 7ff60cc12640 1 --2- 172.21.15.55:0/2892380972 >> v2:172.21.15.167:3300/0 conn(0x7ff608071570 0x7ff60815daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.132+0000 7ff60cc12640 1 --2- 172.21.15.55:0/2892380972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff608071190 0x7ff6080ae9a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.132+0000 7ff60cc12640 1 -- 172.21.15.55:0/2892380972 >> 172.21.15.55:0/2892380972 conn(0x7ff60806aba0 msgr2=0x7ff60806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:26.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.132+0000 7ff60cc12640 1 -- 172.21.15.55:0/2892380972 shutdown_connections 2024-04-25T08:55:26.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.132+0000 7ff60cc12640 1 -- 172.21.15.55:0/2892380972 wait complete. 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.133+0000 7ff60cc12640 1 Processor -- start 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.133+0000 7ff60cc12640 1 -- start start 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60cc12640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff608071190 0x7ff6081f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60cc12640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff608071570 0x7ff608156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60cc12640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff60815e030 0x7ff608142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60cc12640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff608071a00 con 0x7ff608071190 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60cc12640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60806e0d0 con 0x7ff60815e030 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60cc12640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60806e8b0 con 0x7ff608071570 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff608071190 0x7ff6081f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff608071190 0x7ff6081f1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42550/0 (socket says 172.21.15.55:42550) 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60659c640 1 -- 172.21.15.55:0/4133398251 learned_addr learned my addr 172.21.15.55:0/4133398251 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff605d9b640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff608071570 0x7ff608156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff606d9d640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff60815e030 0x7ff608142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60659c640 1 -- 172.21.15.55:0/4133398251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff608071570 msgr2=0x7ff608156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60659c640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff608071570 0x7ff608156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60659c640 1 -- 172.21.15.55:0/4133398251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff60815e030 msgr2=0x7ff608142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60659c640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff60815e030 0x7ff608142d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60659c640 1 -- 172.21.15.55:0/4133398251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608141cb0 con 0x7ff608071190 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff605d9b640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff608071570 0x7ff608156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff606d9d640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff60815e030 0x7ff608142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60659c640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff608071190 0x7ff6081f1010 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff5f802a250 tx=0x7ff5f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff5f6ffd640 1 -- 172.21.15.55:0/4133398251 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8041020 con 0x7ff608071190 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff5f6ffd640 1 -- 172.21.15.55:0/4133398251 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f803d620 con 0x7ff608071190 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff60cc12640 1 -- 172.21.15.55:0/4133398251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff608141f90 con 0x7ff608071190 2024-04-25T08:55:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.134+0000 7ff5f6ffd640 1 -- 172.21.15.55:0/4133398251 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8037040 con 0x7ff608071190 2024-04-25T08:55:26.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.135+0000 7ff60cc12640 1 -- 172.21.15.55:0/4133398251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff608142550 con 0x7ff608071190 2024-04-25T08:55:26.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.135+0000 7ff60cc12640 1 -- 172.21.15.55:0/4133398251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6080749b0 con 0x7ff608071190 2024-04-25T08:55:26.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.136+0000 7ff5f6ffd640 1 -- 172.21.15.55:0/4133398251 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff5f8044020 con 0x7ff608071190 2024-04-25T08:55:26.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.136+0000 7ff5f6ffd640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5e806b4d0 0x7ff5e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.136+0000 7ff5f6ffd640 1 -- 172.21.15.55:0/4133398251 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff5f80aa8a0 con 0x7ff608071190 2024-04-25T08:55:26.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.136+0000 7ff605d9b640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5e806b4d0 0x7ff5e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.137+0000 7ff605d9b640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5e806b4d0 0x7ff5e806d990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff6080b1120 tx=0x7ff5fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:26.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.140+0000 7ff5f6ffd640 1 -- 172.21.15.55:0/4133398251 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff5f804b030 con 0x7ff608071190 2024-04-25T08:55:26.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.359+0000 7ff60cc12640 1 -- 172.21.15.55:0/4133398251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff60806e470 con 0x7ff608071190 2024-04-25T08:55:26.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.360+0000 7ff5f6ffd640 1 -- 172.21.15.55:0/4133398251 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4941 (secure 0 0 0) 0x7ff5f80aa020 con 0x7ff608071190 2024-04-25T08:55:26.350 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:26.350 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3267261156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3267261156},{"type":"v1","addr":"172.21.15.167:6834","nonce":3267261156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/588514159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":588514159},{"type":"v1","addr":"172.21.15.167:6835","nonce":588514159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2276997137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2276997137},{"type":"v1","addr":"172.21.15.55:6835","nonce":2276997137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:55:16.159284+0000","modified":"2024-04-25T08:55:19.200438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/2070394524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":2070394524},{"type":"v1","addr":"172.21.15.55:6837","nonce":2070394524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:55:26.350 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 22 2024-04-25T08:55:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 -- 172.21.15.55:0/4133398251 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5e806b4d0 msgr2=0x7ff5e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5e806b4d0 0x7ff5e806d990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff6080b1120 tx=0x7ff5fc008040 comp rx=0 tx=0).stop 2024-04-25T08:55:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 -- 172.21.15.55:0/4133398251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff608071190 msgr2=0x7ff6081f1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff608071190 0x7ff6081f1010 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff5f802a250 tx=0x7ff5f80046c0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 -- 172.21.15.55:0/4133398251 shutdown_connections 2024-04-25T08:55:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5e806b4d0 0x7ff5e806d990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff60815e030 0x7ff608142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff608071570 0x7ff608156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 --2- 172.21.15.55:0/4133398251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff608071190 0x7ff6081f1010 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 -- 172.21.15.55:0/4133398251 >> 172.21.15.55:0/4133398251 conn(0x7ff60806aba0 msgr2=0x7ff6081529b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:26.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 -- 172.21.15.55:0/4133398251 shutdown_connections 2024-04-25T08:55:26.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.362+0000 7ff60cc12640 1 -- 172.21.15.55:0/4133398251 wait complete. 2024-04-25T08:55:26.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:55:16.159284+0000', 'modified': '2024-04-25T08:55:19.200438+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5571}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5571': {'gid': 5571, 'name': 'c', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/2070394524', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6836', 'nonce': 2070394524}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 2070394524}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:55:26.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:55:26.766 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T08:55:26.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.882+0000 7f6112cea640 1 Processor -- start 2024-04-25T08:55:26.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.882+0000 7f6112cea640 1 -- start start 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.883+0000 7f6112cea640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f610c15bc00 0x7f610c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.883+0000 7f6112cea640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c15c7e0 con 0x7f610c0d1240 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.883+0000 7f6112cea640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c15cac0 con 0x7f610c06aba0 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.883+0000 7f6112cea640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c15d080 con 0x7f610c15bc00 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.883+0000 7f6103fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f610c0d1240 0x7f610c15bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50902/0 (socket says 172.21.15.55:50902) 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.883+0000 7f6103fff640 1 -- 172.21.15.55:0/3909947152 learned_addr learned my addr 172.21.15.55:0/3909947152 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.883+0000 7f6110a86640 1 --2- 172.21.15.55:0/3909947152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f610c15bc00 0x7f610c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.884+0000 7f61037fe640 1 -- 172.21.15.55:0/3909947152 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935823901 0 0) 0x7f610c15c7e0 con 0x7f610c0d1240 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.884+0000 7f61037fe640 1 -- 172.21.15.55:0/3909947152 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f4003520 con 0x7f610c0d1240 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.884+0000 7f6110a86640 1 -- 172.21.15.55:0/3909947152 >> v1:172.21.15.167:6789/0 conn(0x7f610c06aba0 legacy=0x7f610c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.884+0000 7f6110a86640 1 -- 172.21.15.55:0/3909947152 >> v1:172.21.15.55:6789/0 conn(0x7f610c0d1240 legacy=0x7f610c15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.884+0000 7f61037fe640 1 -- 172.21.15.55:0/3909947152 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2193566409 0 0) 0x7f60f4003520 con 0x7f610c0d1240 2024-04-25T08:55:26.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.884+0000 7f6110a86640 1 -- 172.21.15.55:0/3909947152 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c15cda0 con 0x7f610c15bc00 2024-04-25T08:55:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.885+0000 7f6110a86640 1 --2- 172.21.15.55:0/3909947152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f610c15bc00 0x7f610c0cc2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f61080097d0 tx=0x7f610802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=188ca89312ec4e53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.885+0000 7f61037fe640 1 -- 172.21.15.55:0/3909947152 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108037070 con 0x7f610c15bc00 2024-04-25T08:55:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.885+0000 7f61037fe640 1 -- 172.21.15.55:0/3909947152 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6108032440 con 0x7f610c15bc00 2024-04-25T08:55:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.885+0000 7f61037fe640 1 -- 172.21.15.55:0/3909947152 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108032810 con 0x7f610c15bc00 2024-04-25T08:55:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.885+0000 7f6112cea640 1 -- 172.21.15.55:0/3909947152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f610c15bc00 msgr2=0x7f610c0cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.885+0000 7f6112cea640 1 --2- 172.21.15.55:0/3909947152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f610c15bc00 0x7f610c0cc2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f61080097d0 tx=0x7f610802a180 comp rx=0 tx=0).stop 2024-04-25T08:55:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.885+0000 7f6112cea640 1 -- 172.21.15.55:0/3909947152 shutdown_connections 2024-04-25T08:55:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.885+0000 7f6112cea640 1 --2- 172.21.15.55:0/3909947152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f610c15bc00 0x7f610c0cc2c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.885+0000 7f6112cea640 1 -- 172.21.15.55:0/3909947152 >> 172.21.15.55:0/3909947152 conn(0x7f610c099a40 msgr2=0x7f610c0d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.885+0000 7f6112cea640 1 -- 172.21.15.55:0/3909947152 shutdown_connections 2024-04-25T08:55:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.885+0000 7f6112cea640 1 -- 172.21.15.55:0/3909947152 wait complete. 2024-04-25T08:55:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.887+0000 7f6112cea640 1 Processor -- start 2024-04-25T08:55:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.887+0000 7f6112cea640 1 -- start start 2024-04-25T08:55:26.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.887+0000 7f6112cea640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f610c06aba0 0x7f610c09b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.887+0000 7f6112cea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f610c0d1240 0x7f610c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.887+0000 7f6112cea640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f610c15bc00 0x7f610c09df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.887+0000 7f6112cea640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c06b170 con 0x7f610c15bc00 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.887+0000 7f6112cea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c06aff0 con 0x7f610c0d1240 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.887+0000 7f6112cea640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c06b2f0 con 0x7f610c06aba0 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6111287640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f610c15bc00 0x7f610c09df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6111287640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f610c15bc00 0x7f610c09df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42556/0 (socket says 172.21.15.55:42556) 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6111287640 1 -- 172.21.15.55:0/3189547282 learned_addr learned my addr 172.21.15.55:0/3189547282 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6110a86640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f610c06aba0 0x7f610c09b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6103fff640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f610c0d1240 0x7f610c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6111287640 1 -- 172.21.15.55:0/3189547282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f610c06aba0 msgr2=0x7f610c09b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6111287640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f610c06aba0 0x7f610c09b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6111287640 1 -- 172.21.15.55:0/3189547282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f610c0d1240 msgr2=0x7f610c1560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6111287640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f610c0d1240 0x7f610c1560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6111287640 1 -- 172.21.15.55:0/3189547282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c09a680 con 0x7f610c15bc00 2024-04-25T08:55:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6111287640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f610c15bc00 0x7f610c09df20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f610400c6b0 tx=0x7f610400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f61017fa640 1 -- 172.21.15.55:0/3189547282 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104003b70 con 0x7f610c15bc00 2024-04-25T08:55:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f61017fa640 1 -- 172.21.15.55:0/3189547282 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104003d30 con 0x7f610c15bc00 2024-04-25T08:55:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6112cea640 1 -- 172.21.15.55:0/3189547282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c09a940 con 0x7f610c15bc00 2024-04-25T08:55:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f61017fa640 1 -- 172.21.15.55:0/3189547282 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104005310 con 0x7f610c15bc00 2024-04-25T08:55:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.888+0000 7f6112cea640 1 -- 172.21.15.55:0/3189547282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c09af00 con 0x7f610c15bc00 2024-04-25T08:55:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.890+0000 7f61017fa640 1 -- 172.21.15.55:0/3189547282 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f61040054b0 con 0x7f610c15bc00 2024-04-25T08:55:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.890+0000 7f61017fa640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f60f806b500 0x7f60f806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.890+0000 7f61017fa640 1 -- 172.21.15.55:0/3189547282 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f610408a030 con 0x7f610c15bc00 2024-04-25T08:55:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.890+0000 7f6110a86640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f60f806b500 0x7f60f806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.891+0000 7f6110a86640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f60f806b500 0x7f60f806d9c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6108034000 tx=0x7f610802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.891+0000 7f61159ea740 1 Processor -- start 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.891+0000 7f61159ea740 1 -- start start 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f61159ea740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f61159ea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56254686bad0 0x56254686c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f61159ea740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562546823f10 0x56254686a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f61159ea740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562546786a10 con 0x56254684e230 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f61159ea740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56254672fb30 con 0x56254686bad0 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f61159ea740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562546782c50 con 0x562546823f10 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f6110a86640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f6110a86640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42558/0 (socket says 172.21.15.55:42558) 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f6110a86640 1 -- 172.21.15.55:0/407916057 learned_addr learned my addr 172.21.15.55:0/407916057 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f6103fff640 1 --2- 172.21.15.55:0/407916057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56254686bad0 0x56254686c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f6111287640 1 --2- 172.21.15.55:0/407916057 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562546823f10 0x56254686a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f6110a86640 1 -- 172.21.15.55:0/407916057 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562546823f10 msgr2=0x56254686a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f6110a86640 1 --2- 172.21.15.55:0/407916057 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562546823f10 0x56254686a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f6110a86640 1 -- 172.21.15.55:0/407916057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56254686bad0 msgr2=0x56254686c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f6110a86640 1 --2- 172.21.15.55:0/407916057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56254686bad0 0x56254686c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f6110a86640 1 -- 172.21.15.55:0/407916057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562546744e10 con 0x56254684e230 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.892+0000 7f6110a86640 1 --2- 172.21.15.55:0/407916057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684e610 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6108000c00 tx=0x7f610802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104663a9b958ddd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f60f27fc640 1 -- 172.21.15.55:0/407916057 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610804d070 con 0x56254684e230 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f60f27fc640 1 -- 172.21.15.55:0/407916057 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610803d670 con 0x56254684e230 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f60f27fc640 1 -- 172.21.15.55:0/407916057 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108037040 con 0x56254684e230 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f61159ea740 1 -- 172.21.15.55:0/407916057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 msgr2=0x56254684e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f61159ea740 1 --2- 172.21.15.55:0/407916057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684e610 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6108000c00 tx=0x7f610802c000 comp rx=0 tx=0).stop 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f61159ea740 1 -- 172.21.15.55:0/407916057 shutdown_connections 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f61159ea740 1 --2- 172.21.15.55:0/407916057 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562546823f10 0x56254686a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f61159ea740 1 --2- 172.21.15.55:0/407916057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56254686bad0 0x56254686c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f61159ea740 1 --2- 172.21.15.55:0/407916057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684e610 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f61159ea740 1 -- 172.21.15.55:0/407916057 >> 172.21.15.55:0/407916057 conn(0x562546820840 msgr2=0x562546869040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f61159ea740 1 -- 172.21.15.55:0/407916057 shutdown_connections 2024-04-25T08:55:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.893+0000 7f61159ea740 1 -- 172.21.15.55:0/407916057 wait complete. 2024-04-25T08:55:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.894+0000 7f61159ea740 1 -- start start 2024-04-25T08:55:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.894+0000 7f61159ea740 1 Processor -- start 2024-04-25T08:55:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f61159ea740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f61159ea740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56254686bad0 0x5625468619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f61159ea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562546861f30 0x56254686c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f61159ea740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562546824cb0 con 0x56254684e230 2024-04-25T08:55:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f61159ea740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625467430c0 con 0x562546861f30 2024-04-25T08:55:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f61159ea740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56254681e770 con 0x56254686bad0 2024-04-25T08:55:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f61159ea740 10 client.0 _ll_register_callbacks cb 0x562546736ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:55:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f6110a86640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f6110a86640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42566/0 (socket says 172.21.15.55:42566) 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f6110a86640 1 -- 172.21.15.55:0/1836406376 learned_addr learned my addr 172.21.15.55:0/1836406376 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f6103fff640 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56254686bad0 0x5625468619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f6111287640 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562546861f30 0x56254686c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f6110a86640 1 -- 172.21.15.55:0/1836406376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56254686bad0 msgr2=0x5625468619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f6110a86640 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56254686bad0 0x5625468619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f6110a86640 1 -- 172.21.15.55:0/1836406376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562546861f30 msgr2=0x56254686c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f6110a86640 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562546861f30 0x56254686c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f6110a86640 1 -- 172.21.15.55:0/1836406376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56254649b2d0 con 0x56254684e230 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f6110a86640 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684f8e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f61080098f0 tx=0x7f6108004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd8ed7e78402726 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.895+0000 7f60eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f60eb7fe640 1 -- 172.21.15.55:0/1836406376 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108058060 con 0x56254684e230 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f60eb7fe640 1 -- 172.21.15.55:0/1836406376 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f610803e610 con 0x56254684e230 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f61159ea740 1 -- 172.21.15.55:0/1836406376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f610803d670 con 0x56254684e230 2024-04-25T08:55:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f60eb7fe640 1 -- 172.21.15.55:0/1836406376 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f610805e050 con 0x56254684e230 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f61159ea740 10 client.5733 fetch_fsmap learned FSMap version 22 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f61159ea740 1 -- 172.21.15.55:0/1836406376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5625465656b0 con 0x56254684e230 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f60eb7fe640 1 -- 172.21.15.55:0/1836406376 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610803d670 con 0x56254684e230 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f60eb7fe640 1 -- 172.21.15.55:0/1836406376 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6108061020 con 0x56254684e230 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f61159ea740 10 client.5733 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f61159ea740 10 client.5733 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f61159ea740 20 client.5733 populate_metadata read hostname 'smithi055' 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f61159ea740 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5625468606a0 0x562546860a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f61159ea740 4 client.5733 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f61159ea740 1 -- 172.21.15.55:0/1836406376 --> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625467e5920 con 0x5625468606a0 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.896+0000 7f6103fff640 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5625468606a0 0x562546860a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.897+0000 7f60eb7fe640 10 client.5733 ms_handle_connect on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.897+0000 7f6103fff640 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5625468606a0 0x562546860a80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c036a695070dbbb9 server_cookie=e26749034c3b5e3c in_seq=0 out_seq=0 2024-04-25T08:55:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.897+0000 7f60eb7fe640 1 -- 172.21.15.55:0/1836406376 <== mds.0 v2:172.21.15.55:6836/2070394524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5625467e5920 con 0x5625468606a0 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.897+0000 7f60eb7fe640 10 client.5733 handle_command_reply: tid=0 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.897+0000 7f61159ea740 1 client.5733 shutdown 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.897+0000 7f61159ea740 1 -- 172.21.15.55:0/1836406376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 msgr2=0x56254684f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.897+0000 7f61159ea740 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684f8e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f61080098f0 tx=0x7f6108004730 comp rx=0 tx=0).stop 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.898+0000 7f61159ea740 1 -- 172.21.15.55:0/1836406376 shutdown_connections 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.898+0000 7f61159ea740 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5625468606a0 0x562546860a80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.898+0000 7f61159ea740 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562546861f30 0x56254686c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.898+0000 7f61159ea740 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56254686bad0 0x5625468619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.898+0000 7f61159ea740 1 --2- 172.21.15.55:0/1836406376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x56254684f8e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.898+0000 7f60eb7fe640 0 client.5733 ms_handle_reset on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.898+0000 7f61159ea740 1 -- 172.21.15.55:0/1836406376 >> 172.21.15.55:0/1836406376 conn(0x562546823f10 msgr2=0x5625468227f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.898+0000 7f61159ea740 1 -- 172.21.15.55:0/1836406376 shutdown_connections 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.898+0000 7f61159ea740 1 -- 172.21.15.55:0/1836406376 wait complete. 2024-04-25T08:55:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.898+0000 7f61159ea740 20 client.5733 trim_cache size 0 max 16384 2024-04-25T08:55:26.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.914+0000 7f61159ea740 1 Processor -- start 2024-04-25T08:55:26.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.914+0000 7f61159ea740 1 -- start start 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.914+0000 7f61159ea740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56254684e230 0x562546824970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.914+0000 7f61159ea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562546861f30 0x562546860fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.914+0000 7f61159ea740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254686bad0 0x562546850360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.914+0000 7f61159ea740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0b5910 con 0x56254686bad0 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.914+0000 7f61159ea740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c09c230 con 0x562546861f30 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.914+0000 7f61159ea740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c09c830 con 0x56254684e230 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.914+0000 7f6111287640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254686bad0 0x562546850360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.914+0000 7f6111287640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254686bad0 0x562546850360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42574/0 (socket says 172.21.15.55:42574) 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.914+0000 7f6111287640 1 -- 172.21.15.55:0/3685306868 learned_addr learned my addr 172.21.15.55:0/3685306868 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f6111287640 1 -- 172.21.15.55:0/3685306868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56254684e230 msgr2=0x562546824970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f6111287640 1 --2- 172.21.15.55:0/3685306868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56254684e230 0x562546824970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f6111287640 1 -- 172.21.15.55:0/3685306868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562546861f30 msgr2=0x562546860fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:26.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f6111287640 1 --2- 172.21.15.55:0/3685306868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562546861f30 0x562546860fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f6111287640 1 -- 172.21.15.55:0/3685306868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56254687d6a0 con 0x56254686bad0 2024-04-25T08:55:26.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f6111287640 1 --2- 172.21.15.55:0/3685306868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254686bad0 0x562546850360 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f610400cfd0 tx=0x7f6104059010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbc391ddda6423f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:26.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f60f1ffb640 1 -- 172.21.15.55:0/3685306868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104086070 con 0x56254686bad0 2024-04-25T08:55:26.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f60f1ffb640 1 -- 172.21.15.55:0/3685306868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104060f10 con 0x56254686bad0 2024-04-25T08:55:26.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f60f1ffb640 1 -- 172.21.15.55:0/3685306868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104056b00 con 0x56254686bad0 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f61159ea740 1 -- 172.21.15.55:0/3685306868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254686bad0 msgr2=0x562546850360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f61159ea740 1 --2- 172.21.15.55:0/3685306868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254686bad0 0x562546850360 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f610400cfd0 tx=0x7f6104059010 comp rx=0 tx=0).stop 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f61159ea740 1 -- 172.21.15.55:0/3685306868 shutdown_connections 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f61159ea740 1 --2- 172.21.15.55:0/3685306868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254686bad0 0x562546850360 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f61159ea740 1 --2- 172.21.15.55:0/3685306868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562546861f30 0x562546860fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.915+0000 7f61159ea740 1 --2- 172.21.15.55:0/3685306868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56254684e230 0x562546824970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.916+0000 7f61159ea740 1 -- 172.21.15.55:0/3685306868 >> 172.21.15.55:0/3685306868 conn(0x562546823f10 msgr2=0x56254684f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.916+0000 7f61159ea740 1 -- 172.21.15.55:0/3685306868 shutdown_connections 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.916+0000 7f61159ea740 1 -- 172.21.15.55:0/3685306868 wait complete. 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.916+0000 7f61159ea740 1 -- start start 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.916+0000 7f61159ea740 1 Processor -- start 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f61159ea740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x5625468242f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f61159ea740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562546861f30 0x562546824830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f61159ea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56254686bad0 0x5625468d8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f61159ea740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562546850ed0 con 0x56254684e230 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f61159ea740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56254687a120 con 0x56254686bad0 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f61159ea740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56254687d3d0 con 0x562546861f30 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f61159ea740 10 client.0 _ll_register_callbacks cb 0x56254681ec50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f6110a86640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x5625468242f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f6110a86640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x5625468242f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42582/0 (socket says 172.21.15.55:42582) 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f6110a86640 1 -- 172.21.15.55:0/677412812 learned_addr learned my addr 172.21.15.55:0/677412812 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f6111287640 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56254686bad0 0x5625468d8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f6103fff640 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562546861f30 0x562546824830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f6110a86640 1 -- 172.21.15.55:0/677412812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562546861f30 msgr2=0x562546824830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f6110a86640 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562546861f30 0x562546824830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f6110a86640 1 -- 172.21.15.55:0/677412812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56254686bad0 msgr2=0x5625468d8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:26.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.917+0000 7f6110a86640 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56254686bad0 0x5625468d8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f6110a86640 1 -- 172.21.15.55:0/677412812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625468610d0 con 0x56254684e230 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f6110a86640 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x5625468242f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f610802a770 tx=0x7f61080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b01a0e803fbe53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f60eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f60eb7fe640 1 -- 172.21.15.55:0/677412812 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108067060 con 0x56254684e230 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f60eb7fe640 1 -- 172.21.15.55:0/677412812 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6108053460 con 0x56254684e230 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f61159ea740 1 -- 172.21.15.55:0/677412812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6104060f10 con 0x56254684e230 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f60eb7fe640 1 -- 172.21.15.55:0/677412812 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f610806d050 con 0x56254684e230 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f61159ea740 10 client.5739 fetch_fsmap learned FSMap version 22 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f61159ea740 1 -- 172.21.15.55:0/677412812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5625468d9a60 con 0x56254684e230 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f60eb7fe640 1 -- 172.21.15.55:0/677412812 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104060f10 con 0x56254684e230 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f60eb7fe640 1 -- 172.21.15.55:0/677412812 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6108070020 con 0x56254684e230 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f61159ea740 10 client.5739 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f61159ea740 10 client.5739 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:55:26.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f61159ea740 20 client.5739 populate_metadata read hostname 'smithi055' 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f61159ea740 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5625468d90f0 0x56254685e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f61159ea740 4 client.5739 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.918+0000 7f61159ea740 1 -- 172.21.15.55:0/677412812 --> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562546793f50 con 0x5625468d90f0 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f6103fff640 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5625468d90f0 0x56254685e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f6103fff640 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5625468d90f0 0x56254685e9d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e438bd650179d63 server_cookie=fc79824228cb83d6 in_seq=0 out_seq=0 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f60eb7fe640 10 client.5739 ms_handle_connect on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f60eb7fe640 1 -- 172.21.15.55:0/677412812 <== mds.0 v2:172.21.15.55:6836/2070394524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x562546793f50 con 0x5625468d90f0 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f60eb7fe640 10 client.5739 handle_command_reply: tid=0 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 1 client.5739 shutdown 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 1 -- 172.21.15.55:0/677412812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 msgr2=0x5625468242f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x5625468242f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f610802a770 tx=0x7f61080046c0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 1 -- 172.21.15.55:0/677412812 shutdown_connections 2024-04-25T08:55:26.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5625468d90f0 0x56254685e9d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56254686bad0 0x5625468d8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f60eb7fe640 0 client.5739 ms_handle_reset on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:26.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562546861f30 0x562546824830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 1 --2- 172.21.15.55:0/677412812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254684e230 0x5625468242f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 1 -- 172.21.15.55:0/677412812 >> 172.21.15.55:0/677412812 conn(0x562546823f10 msgr2=0x56254684c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:26.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 1 -- 172.21.15.55:0/677412812 shutdown_connections 2024-04-25T08:55:26.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 1 -- 172.21.15.55:0/677412812 wait complete. 2024-04-25T08:55:26.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.919+0000 7f61159ea740 20 client.5739 trim_cache size 0 max 16384 2024-04-25T08:55:26.915 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:55:26.915 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T08:55:26.915 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T08:55:26.916 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5571, 2024-04-25T08:55:26.916 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T08:55:26.916 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T08:55:26.916 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T08:55:26.916 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.098146963, 2024-04-25T08:55:26.916 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 22, 2024-04-25T08:55:26.916 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 49, 2024-04-25T08:55:26.916 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 47, 2024-04-25T08:55:26.916 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 15.127764754999999 2024-04-25T08:55:26.916 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:55:26.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 -- 172.21.15.55:0/3189547282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f60f806b500 msgr2=0x7f60f806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f60f806b500 0x7f60f806d9c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6108034000 tx=0x7f610802e000 comp rx=0 tx=0).stop 2024-04-25T08:55:26.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 -- 172.21.15.55:0/3189547282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f610c15bc00 msgr2=0x7f610c09df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:26.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f610c15bc00 0x7f610c09df20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f610400c6b0 tx=0x7f610400cb70 comp rx=0 tx=0).stop 2024-04-25T08:55:26.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 -- 172.21.15.55:0/3189547282 shutdown_connections 2024-04-25T08:55:26.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f60f806b500 0x7f60f806d9c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f610c15bc00 0x7f610c09df20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f610c0d1240 0x7f610c1560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 --2- 172.21.15.55:0/3189547282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f610c06aba0 0x7f610c09b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:26.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 -- 172.21.15.55:0/3189547282 >> 172.21.15.55:0/3189547282 conn(0x7f610c099a40 msgr2=0x7f610c15ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:26.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 -- 172.21.15.55:0/3189547282 shutdown_connections 2024-04-25T08:55:26.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:26.920+0000 7f6112cea640 1 -- 172.21.15.55:0/3189547282 wait complete. 2024-04-25T08:55:26.920 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:55:27.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.032+0000 7ffb11f90640 1 Processor -- start 2024-04-25T08:55:27.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.032+0000 7ffb11f90640 1 -- start start 2024-04-25T08:55:27.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb11f90640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffb0c0d1320 0x7ffb0c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb11f90640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c06c900 con 0x7ffb0c15ba10 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb11f90640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c06cbe0 con 0x7ffb0c09a150 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb11f90640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c0cbe50 con 0x7ffb0c0d1320 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffb0c15ba10 0x7ffb0c099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50908/0 (socket says 172.21.15.55:50908) 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0b7fe640 1 -- 172.21.15.55:0/702275563 learned_addr learned my addr 172.21.15.55:0/702275563 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095189179 0 0) 0x7ffb0c06c900 con 0x7ffb0c15ba10 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaf4003520 con 0x7ffb0c15ba10 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0bfff640 1 --2- 172.21.15.55:0/702275563 >> v2:172.21.15.167:3300/0 conn(0x7ffb0c0d1320 0x7ffb0c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2911484946 0 0) 0x7ffaf4003520 con 0x7ffb0c15ba10 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 >> v2:172.21.15.167:3300/0 conn(0x7ffb0c0d1320 msgr2=0x7ffb0c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0a7fc640 1 --2- 172.21.15.55:0/702275563 >> v2:172.21.15.167:3300/0 conn(0x7ffb0c0d1320 0x7ffb0c0cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 >> v1:172.21.15.167:6789/0 conn(0x7ffb0c09a150 legacy=0x7ffb0c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:27.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c06cec0 con 0x7ffb0c15ba10 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7ffafc001670 con 0x7ffb0c15ba10 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 >> v1:172.21.15.55:6789/0 conn(0x7ffb0c15ba10 legacy=0x7ffb0c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.033+0000 7ffb0a7fc640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffaf40039b0 0x7ffaf4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0a7fc640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4004800 0x7ffaf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0a7fc640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf40051c0 0x7ffaf400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf400c0e0 con 0x7ffaf4004800 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf400c290 con 0x7ffaf40051c0 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf400c490 con 0x7ffaf40039b0 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0affd640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4004800 0x7ffaf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0b7fe640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffaf40039b0 0x7ffaf4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0bfff640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf40051c0 0x7ffaf400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0affd640 1 -- 172.21.15.55:0/702275563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffaf40039b0 msgr2=0x7ffaf4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:27.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0affd640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffaf40039b0 0x7ffaf4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0affd640 1 -- 172.21.15.55:0/702275563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf40051c0 msgr2=0x7ffaf400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0affd640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf40051c0 0x7ffaf400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0affd640 1 -- 172.21.15.55:0/702275563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf4003520 con 0x7ffaf4004800 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0bfff640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf40051c0 0x7ffaf400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.034+0000 7ffb0bfff640 1 -- 172.21.15.55:0/702275563 reap_dead start 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.035+0000 7ffb0affd640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4004800 0x7ffaf4004c80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ffb00001750 tx=0x7ffaf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e0aeb4345cb020 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.035+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00001370 con 0x7ffaf4004800 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.035+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb000052d0 con 0x7ffaf4004800 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.035+0000 7ffb0a7fc640 1 -- 172.21.15.55:0/702275563 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0002abc0 con 0x7ffaf4004800 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.035+0000 7ffb11f90640 1 -- 172.21.15.55:0/702275563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4004800 msgr2=0x7ffaf4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.035+0000 7ffb11f90640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4004800 0x7ffaf4004c80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ffb00001750 tx=0x7ffaf4005830 comp rx=0 tx=0).stop 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.035+0000 7ffb11f90640 1 -- 172.21.15.55:0/702275563 shutdown_connections 2024-04-25T08:55:27.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.035+0000 7ffb11f90640 1 --2- 172.21.15.55:0/702275563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4004800 0x7ffaf4004c80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:27.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.035+0000 7ffb11f90640 1 -- 172.21.15.55:0/702275563 >> 172.21.15.55:0/702275563 conn(0x7ffb0c0b32f0 msgr2=0x7ffb0c0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:27.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.035+0000 7ffb11f90640 1 -- 172.21.15.55:0/702275563 shutdown_connections 2024-04-25T08:55:27.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.035+0000 7ffb11f90640 1 -- 172.21.15.55:0/702275563 wait complete. 2024-04-25T08:55:27.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.037+0000 7ffb11f90640 1 Processor -- start 2024-04-25T08:55:27.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.037+0000 7ffb11f90640 1 -- start start 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb11f90640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf4004800 0x7ffb0c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb11f90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c0c7cd0 0x7ffb0c1616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb11f90640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c0c8150 0x7ffb0c161c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb11f90640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c099dd0 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb11f90640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c099c50 con 0x7ffaf4004800 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb11f90640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c099f50 con 0x7ffb0c0c8150 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c0c7cd0 0x7ffb0c1616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c0c7cd0 0x7ffb0c1616f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42600/0 (socket says 172.21.15.55:42600) 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0affd640 1 -- 172.21.15.55:0/536581981 learned_addr learned my addr 172.21.15.55:0/536581981 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0bfff640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c0c8150 0x7ffb0c161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0b7fe640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf4004800 0x7ffb0c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0affd640 1 -- 172.21.15.55:0/536581981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c0c8150 msgr2=0x7ffb0c161c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0affd640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c0c8150 0x7ffb0c161c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:27.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0affd640 1 -- 172.21.15.55:0/536581981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf4004800 msgr2=0x7ffb0c159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0affd640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf4004800 0x7ffb0c159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0affd640 1 -- 172.21.15.55:0/536581981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c0c6ca0 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0bfff640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c0c8150 0x7ffb0c161c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb0affd640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c0c7cd0 0x7ffb0c1616f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffb00001870 tx=0x7ffb00001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffaf3fff640 1 -- 172.21.15.55:0/536581981 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0003f030 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffaf3fff640 1 -- 172.21.15.55:0/536581981 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb00005480 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb11f90640 1 -- 172.21.15.55:0/536581981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c0c6120 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffaf3fff640 1 -- 172.21.15.55:0/536581981 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00037040 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.038+0000 7ffb11f90640 1 -- 172.21.15.55:0/536581981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c0c66e0 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.039+0000 7ffb11f90640 1 -- 172.21.15.55:0/536581981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c0749b0 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.040+0000 7ffaf3fff640 1 -- 172.21.15.55:0/536581981 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb00042070 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.040+0000 7ffaf3fff640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf806b500 0x7ffaf806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:27.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.040+0000 7ffaf3fff640 1 -- 172.21.15.55:0/536581981 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffb000a9940 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.040+0000 7ffb0b7fe640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf806b500 0x7ffaf806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:27.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.041+0000 7ffb0b7fe640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf806b500 0x7ffaf806d9c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffafc007fd0 tx=0x7ffafc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:27.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.044+0000 7ffaf3fff640 1 -- 172.21.15.55:0/536581981 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb00049070 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.269+0000 7ffb11f90640 1 -- 172.21.15.55:0/536581981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb0c09a570 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.269+0000 7ffaf3fff640 1 -- 172.21.15.55:0/536581981 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffb00078780 con 0x7ffb0c0c7cd0 2024-04-25T08:55:27.259 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:55:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 -- 172.21.15.55:0/536581981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf806b500 msgr2=0x7ffaf806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf806b500 0x7ffaf806d9c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffafc007fd0 tx=0x7ffafc009040 comp rx=0 tx=0).stop 2024-04-25T08:55:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 -- 172.21.15.55:0/536581981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c0c7cd0 msgr2=0x7ffb0c1616f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c0c7cd0 0x7ffb0c1616f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffb00001870 tx=0x7ffb00001120 comp rx=0 tx=0).stop 2024-04-25T08:55:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 -- 172.21.15.55:0/536581981 shutdown_connections 2024-04-25T08:55:27.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf806b500 0x7ffaf806d9c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:27.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c0c8150 0x7ffb0c161c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:27.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c0c7cd0 0x7ffb0c1616f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:27.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 --2- 172.21.15.55:0/536581981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffaf4004800 0x7ffb0c159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:27.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 -- 172.21.15.55:0/536581981 >> 172.21.15.55:0/536581981 conn(0x7ffb0c0b32f0 msgr2=0x7ffb0c15ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:27.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 -- 172.21.15.55:0/536581981 shutdown_connections 2024-04-25T08:55:27.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:27.271+0000 7ffb11f90640 1 -- 172.21.15.55:0/536581981 wait complete. 2024-04-25T08:55:27.272 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:55:27.272 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:55:27.272 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T08:55:27.272 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:55:27.272 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:55:27.272 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:55:27.272 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:55:27.272 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:55:27.272 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:55:27.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:27.273 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T08:55:27.288 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:55:27.289 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:55:27.289 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:55:27.289 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:55:27.289 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:55:27.289 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:55:27.289 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:55:27.289 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:55:27.289 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T08:55:27.289 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:55:27.289 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:55:27.289 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T08:55:27.290 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:55:27.290 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:55:27.290 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T08:55:27.290 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:55:27.290 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42630sec preferred_lft 42630sec 2024-04-25T08:55:27.290 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T08:55:27.290 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:55:27.290 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:55:27.291 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:55:27.292 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T08:55:27.292 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:55:27.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:27.292 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:55:27.352 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:55:27.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:27.353 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T08:55:27.409 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T08:55:27.410 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:55:27.410 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:55:27.410 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:55:27.410 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:55:27.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:27.410 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:55:27.410 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:55:27.410 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:55:27.411 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:55:27.411 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:55:27.411 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:55:27.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:27.495 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:55:27.510 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:55:27.511 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:55:27.511 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:55:27.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:27.511 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T08:55:27.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:55:27.575 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:55:27.631 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:55:27.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:55:27.631 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:55:27.686 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:55:27.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:27.687 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:55:27.768 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:55:27.768 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:55:27.768 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:55:27.777 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:55:27.777 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:55:27.777 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:55:27.777 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:55:27.777 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:55:27.782 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:55:27.783 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:55:27.783 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:55:27.783 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:55:27.783 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:55:27.783 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:55:27.783 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:55:27.783 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:55:27.783 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:55:27.784 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:55:27.784 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:55:27.784 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:55:27.784 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:55:27.785 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:55:27.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:27.785 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:55:27.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:27.851 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:55:27.912 INFO:teuthology.orchestra.run.smithi055.stdout:client5102 2024-04-25T08:55:27.912 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:55:27.912 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:55:27.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:27.968 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-04-25T08:55:28.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:28.028 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-04-25T08:55:28.085 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T08:55:28.085 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T08:55:28.085 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T08:55:28.085 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:55:28.085 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-04-25T08:55:28.085 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T08:55:28.192 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-25T08:55:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:55:28.201 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:55:28.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.352+0000 7efed0d22640 1 Processor -- start 2024-04-25T08:55:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.353+0000 7efed0d22640 1 -- start start 2024-04-25T08:55:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.353+0000 7efed0d22640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efecc15dce0 0x7efecc0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.353+0000 7efed0d22640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efecc0d35b0 0x7efecc0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.353+0000 7efed0d22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efecc0d1f90 0x7efecc0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.353+0000 7efed0d22640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc15e0c0 con 0x7efecc15dce0 2024-04-25T08:55:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.353+0000 7efed0d22640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc0d2510 con 0x7efecc0d35b0 2024-04-25T08:55:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.353+0000 7efed0d22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0d27f0 con 0x7efecc0d1f90 2024-04-25T08:55:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.354+0000 7efeca59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efecc15dce0 0x7efecc0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.354+0000 7efeca59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efecc15dce0 0x7efecc0d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42616/0 (socket says 172.21.15.55:42616) 2024-04-25T08:55:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.354+0000 7efeca59c640 1 -- 172.21.15.55:0/2401790404 learned_addr learned my addr 172.21.15.55:0/2401790404 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.354+0000 7efeca59c640 1 -- 172.21.15.55:0/2401790404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efecc0d1f90 msgr2=0x7efecc0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.354+0000 7efeca59c640 1 --2- 172.21.15.55:0/2401790404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efecc0d1f90 0x7efecc0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.354+0000 7efeca59c640 1 -- 172.21.15.55:0/2401790404 >> v2:172.21.15.167:3300/0 conn(0x7efecc0d35b0 msgr2=0x7efecc0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.354+0000 7efeca59c640 1 --2- 172.21.15.55:0/2401790404 >> v2:172.21.15.167:3300/0 conn(0x7efecc0d35b0 0x7efecc0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.354+0000 7efeca59c640 1 -- 172.21.15.55:0/2401790404 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0d2ad0 con 0x7efecc15dce0 2024-04-25T08:55:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efeca59c640 1 --2- 172.21.15.55:0/2401790404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc15dce0 0x7efecc0d1a50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efecc0cdfa0 tx=0x7efec402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c25169a7d6d49d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efec959a640 1 -- 172.21.15.55:0/2401790404 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4037070 con 0x7efecc15dce0 2024-04-25T08:55:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efec959a640 1 -- 172.21.15.55:0/2401790404 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec4032440 con 0x7efecc15dce0 2024-04-25T08:55:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efec959a640 1 -- 172.21.15.55:0/2401790404 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4032810 con 0x7efecc15dce0 2024-04-25T08:55:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efed0d22640 1 -- 172.21.15.55:0/2401790404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc15dce0 msgr2=0x7efecc0d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efed0d22640 1 --2- 172.21.15.55:0/2401790404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc15dce0 0x7efecc0d1a50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efecc0cdfa0 tx=0x7efec402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efed0d22640 1 -- 172.21.15.55:0/2401790404 shutdown_connections 2024-04-25T08:55:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efed0d22640 1 --2- 172.21.15.55:0/2401790404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efecc0d1f90 0x7efecc0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efed0d22640 1 --2- 172.21.15.55:0/2401790404 >> v2:172.21.15.167:3300/0 conn(0x7efecc0d35b0 0x7efecc0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efed0d22640 1 --2- 172.21.15.55:0/2401790404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc15dce0 0x7efecc0d1a50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efed0d22640 1 -- 172.21.15.55:0/2401790404 >> 172.21.15.55:0/2401790404 conn(0x7efecc072900 msgr2=0x7efecc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efed0d22640 1 -- 172.21.15.55:0/2401790404 shutdown_connections 2024-04-25T08:55:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.355+0000 7efed0d22640 1 -- 172.21.15.55:0/2401790404 wait complete. 2024-04-25T08:55:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.357+0000 7efed0d22640 1 Processor -- start 2024-04-25T08:55:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.357+0000 7efed0d22640 1 -- start start 2024-04-25T08:55:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.357+0000 7efed0d22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efecc0d1f90 0x7efecc15e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.357+0000 7efed0d22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efecc0d35b0 0x7efecc14d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.357+0000 7efed0d22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc15dce0 0x7efecc0aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.357+0000 7efed0d22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0b9820 con 0x7efecc15dce0 2024-04-25T08:55:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.357+0000 7efed0d22640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0d3090 con 0x7efecc0d35b0 2024-04-25T08:55:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.357+0000 7efed0d22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0b99a0 con 0x7efecc0d1f90 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efecad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc15dce0 0x7efecc0aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efecad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc15dce0 0x7efecc0aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42618/0 (socket says 172.21.15.55:42618) 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efecad9d640 1 -- 172.21.15.55:0/1177139683 learned_addr learned my addr 172.21.15.55:0/1177139683 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efeca59c640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efecc0d1f90 0x7efecc15e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efec9d9b640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efecc0d35b0 0x7efecc14d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efecad9d640 1 -- 172.21.15.55:0/1177139683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efecc0d1f90 msgr2=0x7efecc15e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efecad9d640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efecc0d1f90 0x7efecc15e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efecad9d640 1 -- 172.21.15.55:0/1177139683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efecc0d35b0 msgr2=0x7efecc14d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efecad9d640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efecc0d35b0 0x7efecc14d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efecad9d640 1 -- 172.21.15.55:0/1177139683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0aa9d0 con 0x7efecc15dce0 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efeca59c640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efecc0d1f90 0x7efecc15e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efec9d9b640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efecc0d35b0 0x7efecc14d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efecad9d640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc15dce0 0x7efecc0aa490 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efebc00b970 tx=0x7efebc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efebaffd640 1 -- 172.21.15.55:0/1177139683 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc019070 con 0x7efecc15dce0 2024-04-25T08:55:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efebaffd640 1 -- 172.21.15.55:0/1177139683 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc00cb60 con 0x7efecc15dce0 2024-04-25T08:55:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efed0d22640 1 -- 172.21.15.55:0/1177139683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc15eb80 con 0x7efecc15dce0 2024-04-25T08:55:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efebaffd640 1 -- 172.21.15.55:0/1177139683 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc014440 con 0x7efecc15dce0 2024-04-25T08:55:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.358+0000 7efed0d22640 1 -- 172.21.15.55:0/1177139683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc15f140 con 0x7efecc15dce0 2024-04-25T08:55:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.359+0000 7efed0d22640 1 -- 172.21.15.55:0/1177139683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc0749b0 con 0x7efecc15dce0 2024-04-25T08:55:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.360+0000 7efebaffd640 1 -- 172.21.15.55:0/1177139683 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efebc01c070 con 0x7efecc15dce0 2024-04-25T08:55:28.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.360+0000 7efebaffd640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efeac06b4d0 0x7efeac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.360+0000 7efebaffd640 1 -- 172.21.15.55:0/1177139683 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efebc089f90 con 0x7efecc15dce0 2024-04-25T08:55:28.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.360+0000 7efeca59c640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efeac06b4d0 0x7efeac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.361+0000 7efeca59c640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efeac06b4d0 0x7efeac06d990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efec4034000 tx=0x7efec402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:28.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.364+0000 7efebaffd640 1 -- 172.21.15.55:0/1177139683 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efebc058dd0 con 0x7efecc15dce0 2024-04-25T08:55:28.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.586+0000 7efed0d22640 1 -- 172.21.15.55:0/1177139683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efecc15a4d0 con 0x7efecc15dce0 2024-04-25T08:55:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.586+0000 7efebaffd640 1 -- 172.21.15.55:0/1177139683 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4941 (secure 0 0 0) 0x7efebc0586d0 con 0x7efecc15dce0 2024-04-25T08:55:28.576 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:28.576 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3267261156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3267261156},{"type":"v1","addr":"172.21.15.167:6834","nonce":3267261156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/588514159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":588514159},{"type":"v1","addr":"172.21.15.167:6835","nonce":588514159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2276997137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2276997137},{"type":"v1","addr":"172.21.15.55:6835","nonce":2276997137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:55:16.159284+0000","modified":"2024-04-25T08:55:19.200438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/2070394524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":2070394524},{"type":"v1","addr":"172.21.15.55:6837","nonce":2070394524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:55:28.577 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 22 2024-04-25T08:55:28.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 -- 172.21.15.55:0/1177139683 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efeac06b4d0 msgr2=0x7efeac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:28.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efeac06b4d0 0x7efeac06d990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efec4034000 tx=0x7efec402e000 comp rx=0 tx=0).stop 2024-04-25T08:55:28.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 -- 172.21.15.55:0/1177139683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc15dce0 msgr2=0x7efecc0aa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:28.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc15dce0 0x7efecc0aa490 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efebc00b970 tx=0x7efebc00be30 comp rx=0 tx=0).stop 2024-04-25T08:55:28.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 -- 172.21.15.55:0/1177139683 shutdown_connections 2024-04-25T08:55:28.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efeac06b4d0 0x7efeac06d990 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc15dce0 0x7efecc0aa490 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efecc0d35b0 0x7efecc14d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 --2- 172.21.15.55:0/1177139683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efecc0d1f90 0x7efecc15e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 -- 172.21.15.55:0/1177139683 >> 172.21.15.55:0/1177139683 conn(0x7efecc072900 msgr2=0x7efecc0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:28.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 -- 172.21.15.55:0/1177139683 shutdown_connections 2024-04-25T08:55:28.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.588+0000 7efed0d22640 1 -- 172.21.15.55:0/1177139683 wait complete. 2024-04-25T08:55:28.589 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T08:55:28.735 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-25T08:55:28.735 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T08:55:28.735 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T08:55:28.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.788+0000 7f66b2528f40 1 Processor -- start 2024-04-25T08:55:28.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.788+0000 7f66b2528f40 1 -- start start 2024-04-25T08:55:28.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.789+0000 7f66b2528f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d3bb2a0 0x55dc9d42fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.789+0000 7f66b2528f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc9d3bd860 0x55dc9d3b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.789+0000 7f66b2528f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dc9d42e270 0x55dc9d42cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.789+0000 7f66b2528f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc9d3bdea0 con 0x55dc9d3bb2a0 2024-04-25T08:55:28.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.789+0000 7f66b2528f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc9d31adf0 con 0x55dc9d3bd860 2024-04-25T08:55:28.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.789+0000 7f66b2528f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc9d3be140 con 0x55dc9d42e270 2024-04-25T08:55:28.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.789+0000 7f66b002b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d3bb2a0 0x55dc9d42fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.789+0000 7f66b002b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d3bb2a0 0x55dc9d42fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39638/0 (socket says 172.21.15.55:39638) 2024-04-25T08:55:28.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.789+0000 7f66b002b640 1 -- 172.21.15.55:0/1585171569 learned_addr learned my addr 172.21.15.55:0/1585171569 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:28.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.789+0000 7f66af82a640 1 --2- 172.21.15.55:0/1585171569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc9d3bd860 0x55dc9d3b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.789+0000 7f66b082c640 1 --2- 172.21.15.55:0/1585171569 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dc9d42e270 0x55dc9d42cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b002b640 1 -- 172.21.15.55:0/1585171569 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dc9d42e270 msgr2=0x55dc9d42cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b002b640 1 --2- 172.21.15.55:0/1585171569 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dc9d42e270 0x55dc9d42cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b002b640 1 -- 172.21.15.55:0/1585171569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc9d3bd860 msgr2=0x55dc9d3b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b002b640 1 --2- 172.21.15.55:0/1585171569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc9d3bd860 0x55dc9d3b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b002b640 1 -- 172.21.15.55:0/1585171569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc9d2a0c50 con 0x55dc9d3bb2a0 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66af82a640 1 --2- 172.21.15.55:0/1585171569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc9d3bd860 0x55dc9d3b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b002b640 1 --2- 172.21.15.55:0/1585171569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d3bb2a0 0x55dc9d42fe20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f66a0025d20 tx=0x7f66a0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89883c2c7865e71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66ae828640 1 -- 172.21.15.55:0/1585171569 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0053900 con 0x55dc9d3bb2a0 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66ae828640 1 -- 172.21.15.55:0/1585171569 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a0063070 con 0x55dc9d3bb2a0 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66ae828640 1 -- 172.21.15.55:0/1585171569 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0053cc0 con 0x55dc9d3bb2a0 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b2528f40 1 -- 172.21.15.55:0/1585171569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d3bb2a0 msgr2=0x55dc9d42fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b2528f40 1 --2- 172.21.15.55:0/1585171569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d3bb2a0 0x55dc9d42fe20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f66a0025d20 tx=0x7f66a0051000 comp rx=0 tx=0).stop 2024-04-25T08:55:28.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b2528f40 1 -- 172.21.15.55:0/1585171569 shutdown_connections 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b2528f40 1 --2- 172.21.15.55:0/1585171569 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dc9d42e270 0x55dc9d42cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b2528f40 1 --2- 172.21.15.55:0/1585171569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc9d3bd860 0x55dc9d3b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b2528f40 1 --2- 172.21.15.55:0/1585171569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d3bb2a0 0x55dc9d42fe20 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b2528f40 1 -- 172.21.15.55:0/1585171569 >> 172.21.15.55:0/1585171569 conn(0x55dc9d39e3d0 msgr2=0x55dc9d42b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b2528f40 1 -- 172.21.15.55:0/1585171569 shutdown_connections 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.790+0000 7f66b2528f40 1 -- 172.21.15.55:0/1585171569 wait complete. 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.791+0000 7f66b2528f40 1 Processor -- start 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.791+0000 7f66b2528f40 1 -- start start 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b2528f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dc9d3bb2a0 0x55dc9d449480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b2528f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc9d3bd860 0x55dc9d429430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b2528f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d42e270 0x55dc9d39ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b2528f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc9d3a3d20 con 0x55dc9d42e270 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b2528f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc9d3a3f60 con 0x55dc9d3bd860 2024-04-25T08:55:28.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b2528f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc9d3a3ab0 con 0x55dc9d3bb2a0 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b082c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d42e270 0x55dc9d39ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b082c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d42e270 0x55dc9d39ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39642/0 (socket says 172.21.15.55:39642) 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b082c640 1 -- 172.21.15.55:0/3328979417 learned_addr learned my addr 172.21.15.55:0/3328979417 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66af82a640 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc9d3bd860 0x55dc9d429430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b002b640 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dc9d3bb2a0 0x55dc9d449480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b082c640 1 -- 172.21.15.55:0/3328979417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dc9d3bb2a0 msgr2=0x55dc9d449480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b082c640 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dc9d3bb2a0 0x55dc9d449480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b082c640 1 -- 172.21.15.55:0/3328979417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc9d3bd860 msgr2=0x55dc9d429430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b082c640 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dc9d3bd860 0x55dc9d429430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b082c640 1 -- 172.21.15.55:0/3328979417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc9d427480 con 0x55dc9d42e270 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66b082c640 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d42e270 0x55dc9d39ed50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f66a800b4b0 tx=0x7f66a800b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.792+0000 7f66ad826640 1 -- 172.21.15.55:0/3328979417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8016020 con 0x55dc9d42e270 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.793+0000 7f66ad826640 1 -- 172.21.15.55:0/3328979417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a8012660 con 0x55dc9d42e270 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.793+0000 7f66b2528f40 1 -- 172.21.15.55:0/3328979417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dc9d427760 con 0x55dc9d42e270 2024-04-25T08:55:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.793+0000 7f66ad826640 1 -- 172.21.15.55:0/3328979417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8012830 con 0x55dc9d42e270 2024-04-25T08:55:28.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.793+0000 7f66b2528f40 1 -- 172.21.15.55:0/3328979417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc9d427d20 con 0x55dc9d42e270 2024-04-25T08:55:28.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.794+0000 7f66ad826640 1 -- 172.21.15.55:0/3328979417 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f66a8019020 con 0x55dc9d42e270 2024-04-25T08:55:28.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.794+0000 7f66ad826640 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f669c069eb0 0x7f669c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.794+0000 7f66ad826640 1 -- 172.21.15.55:0/3328979417 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f66a8089060 con 0x55dc9d42e270 2024-04-25T08:55:28.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.794+0000 7f66b002b640 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f669c069eb0 0x7f669c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.795+0000 7f66b2528f40 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55dc9d3b9820 0x55dc9d425a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:28.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.795+0000 7f66b2528f40 1 -- 172.21.15.55:0/3328979417 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v9 -- 0x55dc9d425f60 con 0x55dc9d3b9820 2024-04-25T08:55:28.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.795+0000 7f66af82a640 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55dc9d3b9820 0x55dc9d425a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:28.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.795+0000 7f66b002b640 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f669c069eb0 0x7f669c06c370 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f66a0025d20 tx=0x7f66a0053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:28.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.795+0000 7f66af82a640 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55dc9d3b9820 0x55dc9d425a20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:28.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.795+0000 7f66af82a640 1 -- 172.21.15.55:0/3328979417 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f66a400e040 con 0x55dc9d3b9820 2024-04-25T08:55:28.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.796+0000 7f66b2528f40 1 -- 172.21.15.55:0/3328979417 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55dc9d3b9820 msgr2=0x55dc9d425a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.796+0000 7f66b2528f40 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55dc9d3b9820 0x55dc9d425a20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.796+0000 7f66b2528f40 1 -- 172.21.15.55:0/3328979417 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f669c069eb0 msgr2=0x7f669c06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.796+0000 7f66b2528f40 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f669c069eb0 0x7f669c06c370 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f66a0025d20 tx=0x7f66a0053000 comp rx=0 tx=0).stop 2024-04-25T08:55:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.796+0000 7f66b2528f40 1 -- 172.21.15.55:0/3328979417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d42e270 msgr2=0x55dc9d39ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.796+0000 7f66b2528f40 1 --2- 172.21.15.55:0/3328979417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dc9d42e270 0x55dc9d39ed50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f66a800b4b0 tx=0x7f66a800b970 comp rx=0 tx=0).stop 2024-04-25T08:55:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.796+0000 7f66b082c640 1 -- 172.21.15.55:0/3328979417 reap_dead start 2024-04-25T08:55:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.796+0000 7f66b2528f40 1 -- 172.21.15.55:0/3328979417 shutdown_connections 2024-04-25T08:55:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.796+0000 7f66b2528f40 1 -- 172.21.15.55:0/3328979417 >> 172.21.15.55:0/3328979417 conn(0x55dc9d39e3d0 msgr2=0x55dc9d42cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.796+0000 7f66b2528f40 1 -- 172.21.15.55:0/3328979417 shutdown_connections 2024-04-25T08:55:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:28.796+0000 7f66b2528f40 1 -- 172.21.15.55:0/3328979417 wait complete. 2024-04-25T08:55:28.792 INFO:teuthology.orchestra.run.smithi055.stdout:Yalphaparent_a 2024-04-25T08:55:28.793 DEBUG:teuthology.orchestra.run.smithi055:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T08:55:28.909 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:55:28.909 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-25T08:55:28.909 INFO:teuthology.orchestra.run.smithi055.stdout: "ancestors": [ 2024-04-25T08:55:28.909 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:28.909 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1099511627776, 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "alpha", 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 2 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1, 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "parent_a", 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 4 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: "pool": 7, 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: "old_pools": [] 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:55:28.910 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:28.931 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-04-25T08:55:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.031+0000 7f57280b1f40 1 Processor -- start 2024-04-25T08:55:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.031+0000 7f57280b1f40 1 -- start start 2024-04-25T08:55:29.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57280b1f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55edfccf0570 0x55edfcd0b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57280b1f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfccf2990 0x55edfcd86ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57280b1f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edfcd96d90 0x55edfcd87530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57280b1f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfccf1530 con 0x55edfccf2990 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57280b1f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfcc69df0 con 0x55edfcd96d90 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57280b1f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edfccf17d0 con 0x55edfccf0570 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57253b1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfccf2990 0x55edfcd86ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57253b1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfccf2990 0x55edfcd86ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39658/0 (socket says 172.21.15.55:39658) 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57253b1640 1 -- 172.21.15.55:0/576226191 learned_addr learned my addr 172.21.15.55:0/576226191 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57253b1640 1 -- 172.21.15.55:0/576226191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55edfccf0570 msgr2=0x55edfcd0b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57253b1640 1 --2- 172.21.15.55:0/576226191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55edfccf0570 0x55edfcd0b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57253b1640 1 -- 172.21.15.55:0/576226191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edfcd96d90 msgr2=0x55edfcd87530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57253b1640 1 --2- 172.21.15.55:0/576226191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edfcd96d90 0x55edfcd87530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57253b1640 1 -- 172.21.15.55:0/576226191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edfcbefc50 con 0x55edfccf2990 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f57253b1640 1 --2- 172.21.15.55:0/576226191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfccf2990 0x55edfcd86ff0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f571c0098b0 tx=0x7f571c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1a87779301f93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f5717fff640 1 -- 172.21.15.55:0/576226191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c008930 con 0x55edfccf2990 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f5717fff640 1 -- 172.21.15.55:0/576226191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c018070 con 0x55edfccf2990 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.032+0000 7f5717fff640 1 -- 172.21.15.55:0/576226191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c008cd0 con 0x55edfccf2990 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.033+0000 7f57280b1f40 1 -- 172.21.15.55:0/576226191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfccf2990 msgr2=0x55edfcd86ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.033+0000 7f57280b1f40 1 --2- 172.21.15.55:0/576226191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfccf2990 0x55edfcd86ff0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f571c0098b0 tx=0x7f571c005a00 comp rx=0 tx=0).stop 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.033+0000 7f57280b1f40 1 -- 172.21.15.55:0/576226191 shutdown_connections 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.033+0000 7f57280b1f40 1 --2- 172.21.15.55:0/576226191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edfcd96d90 0x55edfcd87530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.033+0000 7f57280b1f40 1 --2- 172.21.15.55:0/576226191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfccf2990 0x55edfcd86ff0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.033+0000 7f57280b1f40 1 --2- 172.21.15.55:0/576226191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55edfccf0570 0x55edfcd0b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.033+0000 7f57280b1f40 1 -- 172.21.15.55:0/576226191 >> 172.21.15.55:0/576226191 conn(0x55edfcced3d0 msgr2=0x55edfcd95f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.033+0000 7f57280b1f40 1 -- 172.21.15.55:0/576226191 shutdown_connections 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.033+0000 7f57280b1f40 1 -- 172.21.15.55:0/576226191 wait complete. 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.033+0000 7f57280b1f40 1 Processor -- start 2024-04-25T08:55:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.034+0000 7f57280b1f40 1 -- start start 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.034+0000 7f57280b1f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edfccf0570 0x55edfcced9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.034+0000 7f57280b1f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55edfccf2990 0x55edfccedee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.034+0000 7f57280b1f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfcd96d90 0x55edfce2fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.034+0000 7f57280b1f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfcd09bb0 con 0x55edfcd96d90 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.034+0000 7f57280b1f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfcceecb0 con 0x55edfccf0570 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.034+0000 7f57280b1f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edfccc1530 con 0x55edfccf2990 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.034+0000 7f57263b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfcd96d90 0x55edfce2fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.034+0000 7f57263b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfcd96d90 0x55edfce2fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39668/0 (socket says 172.21.15.55:39668) 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.034+0000 7f57263b3640 1 -- 172.21.15.55:0/1958716421 learned_addr learned my addr 172.21.15.55:0/1958716421 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f57253b1640 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55edfccf2990 0x55edfccedee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f5725bb2640 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edfccf0570 0x55edfcced9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f57263b3640 1 -- 172.21.15.55:0/1958716421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55edfccf2990 msgr2=0x55edfccedee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f57263b3640 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55edfccf2990 0x55edfccedee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f57263b3640 1 -- 172.21.15.55:0/1958716421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edfccf0570 msgr2=0x55edfcced9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f57263b3640 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edfccf0570 0x55edfcced9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f57263b3640 1 -- 172.21.15.55:0/1958716421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edfcd877f0 con 0x55edfcd96d90 2024-04-25T08:55:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f57263b3640 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfcd96d90 0x55edfce2fd50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5720055040 tx=0x7f5720053430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f5716ffd640 1 -- 172.21.15.55:0/1958716421 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720053860 con 0x55edfcd96d90 2024-04-25T08:55:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f5716ffd640 1 -- 172.21.15.55:0/1958716421 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720053a20 con 0x55edfcd96d90 2024-04-25T08:55:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f57280b1f40 1 -- 172.21.15.55:0/1958716421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55edfcd97940 con 0x55edfcd96d90 2024-04-25T08:55:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f5716ffd640 1 -- 172.21.15.55:0/1958716421 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720053e10 con 0x55edfcd96d90 2024-04-25T08:55:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.035+0000 7f57280b1f40 1 -- 172.21.15.55:0/1958716421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edfccc4a90 con 0x55edfcd96d90 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.036+0000 7f5716ffd640 1 -- 172.21.15.55:0/1958716421 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f572006f440 con 0x55edfcd96d90 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.037+0000 7f5716ffd640 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5708069eb0 0x7f570806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.037+0000 7f5716ffd640 1 -- 172.21.15.55:0/1958716421 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5720050030 con 0x55edfcd96d90 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.037+0000 7f5725bb2640 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5708069eb0 0x7f570806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.037+0000 7f57280b1f40 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55edfcd8be60 0x55edfce39020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.037+0000 7f57280b1f40 1 -- 172.21.15.55:0/1958716421 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v9 -- 0x55edfccee420 con 0x55edfcd8be60 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.037+0000 7f57253b1640 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55edfcd8be60 0x55edfce39020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.037+0000 7f5725bb2640 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5708069eb0 0x7f570806c370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5718004170 tx=0x7f5718000bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.038+0000 7f57253b1640 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55edfcd8be60 0x55edfce39020 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57253b1640 1 -- 172.21.15.55:0/1958716421 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v49'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f571c008730 con 0x55edfcd8be60 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57280b1f40 1 -- 172.21.15.55:0/1958716421 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55edfcd8be60 msgr2=0x55edfce39020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57280b1f40 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55edfcd8be60 0x55edfce39020 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57280b1f40 1 -- 172.21.15.55:0/1958716421 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5708069eb0 msgr2=0x7f570806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57280b1f40 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5708069eb0 0x7f570806c370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5718004170 tx=0x7f5718000bc0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57280b1f40 1 -- 172.21.15.55:0/1958716421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfcd96d90 msgr2=0x55edfce2fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57280b1f40 1 --2- 172.21.15.55:0/1958716421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55edfcd96d90 0x55edfce2fd50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5720055040 tx=0x7f5720053430 comp rx=0 tx=0).stop 2024-04-25T08:55:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57263b3640 1 -- 172.21.15.55:0/1958716421 reap_dead start 2024-04-25T08:55:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57280b1f40 1 -- 172.21.15.55:0/1958716421 shutdown_connections 2024-04-25T08:55:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57280b1f40 1 -- 172.21.15.55:0/1958716421 >> 172.21.15.55:0/1958716421 conn(0x55edfcced3d0 msgr2=0x55edfcd95f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57280b1f40 1 -- 172.21.15.55:0/1958716421 shutdown_connections 2024-04-25T08:55:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.039+0000 7f57280b1f40 1 -- 172.21.15.55:0/1958716421 wait complete. 2024-04-25T08:55:29.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T08:55:29.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:29.036 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-04-25T08:55:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.150+0000 7f5481d1d640 1 Processor -- start 2024-04-25T08:55:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.150+0000 7f5481d1d640 1 -- start start 2024-04-25T08:55:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.151+0000 7f5481d1d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c06b040 0x7f547c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.151+0000 7f5481d1d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c0cf980 con 0x7f547c06b420 2024-04-25T08:55:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.151+0000 7f5481d1d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c0cfc20 con 0x7f547c161f10 2024-04-25T08:55:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.151+0000 7f5481d1d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0cff00 con 0x7f547c06b040 2024-04-25T08:55:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.151+0000 7f547affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f547c06b420 0x7f547c0b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54064/0 (socket says 172.21.15.55:54064) 2024-04-25T08:55:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.151+0000 7f547affd640 1 -- 172.21.15.55:0/355807125 learned_addr learned my addr 172.21.15.55:0/355807125 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.151+0000 7f547b7fe640 1 --2- 172.21.15.55:0/355807125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c06b040 0x7f547c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.152+0000 7f547a7fc640 1 -- 172.21.15.55:0/355807125 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534640291 0 0) 0x7f547c0cf980 con 0x7f547c06b420 2024-04-25T08:55:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.152+0000 7f547a7fc640 1 -- 172.21.15.55:0/355807125 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5464003520 con 0x7f547c06b420 2024-04-25T08:55:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.152+0000 7f547a7fc640 1 -- 172.21.15.55:0/355807125 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157964472 0 0) 0x7f547c0cfc20 con 0x7f547c161f10 2024-04-25T08:55:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.152+0000 7f547b7fe640 1 -- 172.21.15.55:0/355807125 >> v1:172.21.15.167:6789/0 conn(0x7f547c161f10 legacy=0x7f547c06f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.152+0000 7f547b7fe640 1 -- 172.21.15.55:0/355807125 >> v1:172.21.15.55:6789/0 conn(0x7f547c06b420 legacy=0x7f547c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.152+0000 7f547b7fe640 1 -- 172.21.15.55:0/355807125 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0d01e0 con 0x7f547c06b040 2024-04-25T08:55:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.153+0000 7f547b7fe640 1 --2- 172.21.15.55:0/355807125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c06b040 0x7f547c0ccff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f546c0097d0 tx=0x7f546c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebd785ccf5c8584f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.153+0000 7f547a7fc640 1 -- 172.21.15.55:0/355807125 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c037070 con 0x7f547c06b040 2024-04-25T08:55:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.153+0000 7f547a7fc640 1 -- 172.21.15.55:0/355807125 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c032440 con 0x7f547c06b040 2024-04-25T08:55:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.153+0000 7f547a7fc640 1 -- 172.21.15.55:0/355807125 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c032810 con 0x7f547c06b040 2024-04-25T08:55:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.153+0000 7f5481d1d640 1 -- 172.21.15.55:0/355807125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c06b040 msgr2=0x7f547c0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.153+0000 7f5481d1d640 1 --2- 172.21.15.55:0/355807125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c06b040 0x7f547c0ccff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f546c0097d0 tx=0x7f546c02a210 comp rx=0 tx=0).stop 2024-04-25T08:55:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.154+0000 7f5481d1d640 1 -- 172.21.15.55:0/355807125 shutdown_connections 2024-04-25T08:55:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.154+0000 7f5481d1d640 1 --2- 172.21.15.55:0/355807125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c06b040 0x7f547c0ccff0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.154+0000 7f5481d1d640 1 -- 172.21.15.55:0/355807125 >> 172.21.15.55:0/355807125 conn(0x7f547c099a40 msgr2=0x7f547c0b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.154+0000 7f5481d1d640 1 -- 172.21.15.55:0/355807125 shutdown_connections 2024-04-25T08:55:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.154+0000 7f5481d1d640 1 -- 172.21.15.55:0/355807125 wait complete. 2024-04-25T08:55:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.155+0000 7f5481d1d640 1 Processor -- start 2024-04-25T08:55:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.155+0000 7f5481d1d640 1 -- start start 2024-04-25T08:55:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f5481d1d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f547c06b040 0x7f547c14cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f5481d1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c06b420 0x7f547c0b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f5481d1d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c161f10 0x7f547c0b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f5481d1d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0d04c0 con 0x7f547c06b040 2024-04-25T08:55:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f5481d1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0ccba0 con 0x7f547c06b420 2024-04-25T08:55:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f5481d1d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0cd530 con 0x7f547c161f10 2024-04-25T08:55:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f547c06b040 0x7f547c14cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f547c06b040 0x7f547c14cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39684/0 (socket says 172.21.15.55:39684) 2024-04-25T08:55:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547b7fe640 1 -- 172.21.15.55:0/3091334191 learned_addr learned my addr 172.21.15.55:0/3091334191 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547affd640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c06b420 0x7f547c0b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547bfff640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c161f10 0x7f547c0b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547b7fe640 1 -- 172.21.15.55:0/3091334191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c161f10 msgr2=0x7f547c0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547b7fe640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c161f10 0x7f547c0b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547b7fe640 1 -- 172.21.15.55:0/3091334191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c06b420 msgr2=0x7f547c0b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547b7fe640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c06b420 0x7f547c0b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547b7fe640 1 -- 172.21.15.55:0/3091334191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0b4bd0 con 0x7f547c06b040 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547affd640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c06b420 0x7f547c0b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f547b7fe640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f547c06b040 0x7f547c14cc90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f546c035040 tx=0x7f546c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f5463fff640 1 -- 172.21.15.55:0/3091334191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c041020 con 0x7f547c06b040 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.156+0000 7f5463fff640 1 -- 172.21.15.55:0/3091334191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c03d6e0 con 0x7f547c06b040 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.157+0000 7f5481d1d640 1 -- 172.21.15.55:0/3091334191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c0b4e40 con 0x7f547c06b040 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.157+0000 7f5463fff640 1 -- 172.21.15.55:0/3091334191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c037040 con 0x7f547c06b040 2024-04-25T08:55:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.157+0000 7f5481d1d640 1 -- 172.21.15.55:0/3091334191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c0b5400 con 0x7f547c06b040 2024-04-25T08:55:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.159+0000 7f5463fff640 1 -- 172.21.15.55:0/3091334191 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f546c044020 con 0x7f547c06b040 2024-04-25T08:55:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.159+0000 7f5463fff640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f546806b4d0 0x7f546806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.159+0000 7f5463fff640 1 -- 172.21.15.55:0/3091334191 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f546c0aaaf0 con 0x7f547c06b040 2024-04-25T08:55:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.159+0000 7f547affd640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f546806b4d0 0x7f546806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.160+0000 7f547affd640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f546806b4d0 0x7f546806d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5470007fd0 tx=0x7f5470009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.160+0000 7f5484a1c740 1 Processor -- start 2024-04-25T08:55:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.160+0000 7f5484a1c740 1 -- start start 2024-04-25T08:55:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c26bb0 0x558e67c26f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c21830 0x558e67c257b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c25cf0 0x558e67c26130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f5484a1c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e67b8aac0 con 0x558e67c21830 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f5484a1c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e67b33d80 con 0x558e67c25cf0 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f5484a1c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e67b86b60 con 0x558e67c26bb0 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c21830 0x558e67c257b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c21830 0x558e67c257b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39692/0 (socket says 172.21.15.55:39692) 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547affd640 1 -- 172.21.15.55:0/1958354678 learned_addr learned my addr 172.21.15.55:0/1958354678 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547b7fe640 1 --2- 172.21.15.55:0/1958354678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c26bb0 0x558e67c26f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547bfff640 1 --2- 172.21.15.55:0/1958354678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c25cf0 0x558e67c26130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547affd640 1 -- 172.21.15.55:0/1958354678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c26bb0 msgr2=0x558e67c26f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547affd640 1 --2- 172.21.15.55:0/1958354678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c26bb0 0x558e67c26f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547affd640 1 -- 172.21.15.55:0/1958354678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c25cf0 msgr2=0x558e67c26130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547affd640 1 --2- 172.21.15.55:0/1958354678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c25cf0 0x558e67c26130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547affd640 1 -- 172.21.15.55:0/1958354678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e679677e0 con 0x558e67c21830 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547bfff640 1 --2- 172.21.15.55:0/1958354678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c25cf0 0x558e67c26130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547b7fe640 1 --2- 172.21.15.55:0/1958354678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c26bb0 0x558e67c26f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f547affd640 1 --2- 172.21.15.55:0/1958354678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c21830 0x558e67c257b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5470000f60 tx=0x7f5470011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508c97ceba53e669 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.161+0000 7f54617fa640 1 -- 172.21.15.55:0/1958354678 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470007710 con 0x558e67c21830 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.162+0000 7f54617fa640 1 -- 172.21.15.55:0/1958354678 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547000e7b0 con 0x558e67c21830 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.162+0000 7f54617fa640 1 -- 172.21.15.55:0/1958354678 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000eb60 con 0x558e67c21830 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.162+0000 7f5484a1c740 1 -- 172.21.15.55:0/1958354678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c21830 msgr2=0x558e67c257b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.162+0000 7f5484a1c740 1 --2- 172.21.15.55:0/1958354678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c21830 0x558e67c257b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5470000f60 tx=0x7f5470011000 comp rx=0 tx=0).stop 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.162+0000 7f5484a1c740 1 -- 172.21.15.55:0/1958354678 shutdown_connections 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.162+0000 7f5484a1c740 1 --2- 172.21.15.55:0/1958354678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c25cf0 0x558e67c26130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.162+0000 7f5484a1c740 1 --2- 172.21.15.55:0/1958354678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c21830 0x558e67c257b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.162+0000 7f5484a1c740 1 --2- 172.21.15.55:0/1958354678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c26bb0 0x558e67c26f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.162+0000 7f5484a1c740 1 -- 172.21.15.55:0/1958354678 >> 172.21.15.55:0/1958354678 conn(0x558e67c23cb0 msgr2=0x558e67c6c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.162+0000 7f5484a1c740 1 -- 172.21.15.55:0/1958354678 shutdown_connections 2024-04-25T08:55:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.162+0000 7f5484a1c740 1 -- 172.21.15.55:0/1958354678 wait complete. 2024-04-25T08:55:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.163+0000 7f5484a1c740 1 -- start start 2024-04-25T08:55:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.163+0000 7f5484a1c740 1 Processor -- start 2024-04-25T08:55:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c25cf0 0x558e67c749c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c26bb0 0x558e67c70050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c70590 0x558e67c711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f5484a1c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e67c52740 con 0x558e67c25cf0 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f5484a1c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e67b29530 con 0x558e67c70590 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f5484a1c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e67c51bc0 con 0x558e67c26bb0 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f5484a1c740 10 client.0 _ll_register_callbacks cb 0x558e67b81130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c25cf0 0x558e67c749c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c25cf0 0x558e67c749c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39696/0 (socket says 172.21.15.55:39696) 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547b7fe640 1 -- 172.21.15.55:0/156672893 learned_addr learned my addr 172.21.15.55:0/156672893 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547affd640 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c26bb0 0x558e67c70050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547bfff640 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c70590 0x558e67c711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547b7fe640 1 -- 172.21.15.55:0/156672893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c26bb0 msgr2=0x558e67c70050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547b7fe640 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c26bb0 0x558e67c70050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547b7fe640 1 -- 172.21.15.55:0/156672893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c70590 msgr2=0x558e67c711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547b7fe640 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c70590 0x558e67c711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547b7fe640 1 -- 172.21.15.55:0/156672893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e679c7f70 con 0x558e67c25cf0 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547bfff640 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c70590 0x558e67c711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f547b7fe640 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c25cf0 0x558e67c749c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f546c075600 tx=0x7f546c0799e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb873b006873e35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.164+0000 7f545a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f545a7fc640 1 -- 172.21.15.55:0/156672893 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c03dc90 con 0x558e67c25cf0 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f545a7fc640 1 -- 172.21.15.55:0/156672893 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f546c079400 con 0x558e67c25cf0 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f5484a1c740 1 -- 172.21.15.55:0/156672893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f547000e7b0 con 0x558e67c25cf0 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f545a7fc640 1 -- 172.21.15.55:0/156672893 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f546c081940 con 0x558e67c25cf0 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f5484a1c740 10 client.5784 fetch_fsmap learned FSMap version 22 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f5484a1c740 1 -- 172.21.15.55:0/156672893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x558e6785f170 con 0x558e67c25cf0 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f545a7fc640 1 -- 172.21.15.55:0/156672893 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547000e7b0 con 0x558e67c25cf0 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f545a7fc640 1 -- 172.21.15.55:0/156672893 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f546c03a030 con 0x558e67c25cf0 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f5484a1c740 10 client.5784 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:55:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f5484a1c740 10 client.5784 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f5484a1c740 20 client.5784 populate_metadata read hostname 'smithi055' 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f5484a1c740 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x558e67c71d00 0x558e67c47910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f5484a1c740 4 client.5784 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f5484a1c740 1 -- 172.21.15.55:0/156672893 --> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e67b98000 con 0x558e67c71d00 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.165+0000 7f547affd640 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x558e67c71d00 0x558e67c47910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f545a7fc640 10 client.5784 ms_handle_connect on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f547affd640 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x558e67c71d00 0x558e67c47910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0154d584cc06d7c server_cookie=fc004f9000d18440 in_seq=0 out_seq=0 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f545a7fc640 1 -- 172.21.15.55:0/156672893 <== mds.0 v2:172.21.15.55:6836/2070394524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558e67b98000 con 0x558e67c71d00 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f545a7fc640 10 client.5784 handle_command_reply: tid=0 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f5484a1c740 1 client.5784 shutdown 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f5484a1c740 1 -- 172.21.15.55:0/156672893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c25cf0 msgr2=0x558e67c749c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f5484a1c740 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c25cf0 0x558e67c749c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f546c075600 tx=0x7f546c0799e0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f5484a1c740 1 -- 172.21.15.55:0/156672893 shutdown_connections 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f5484a1c740 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x558e67c71d00 0x558e67c47910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f5484a1c740 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c70590 0x558e67c711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f5484a1c740 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c26bb0 0x558e67c70050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f545a7fc640 0 client.5784 ms_handle_reset on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f5484a1c740 1 --2- 172.21.15.55:0/156672893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c25cf0 0x558e67c749c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f5484a1c740 1 -- 172.21.15.55:0/156672893 >> 172.21.15.55:0/156672893 conn(0x558e67c21830 msgr2=0x558e67c276a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f5484a1c740 1 -- 172.21.15.55:0/156672893 shutdown_connections 2024-04-25T08:55:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.166+0000 7f5484a1c740 1 -- 172.21.15.55:0/156672893 wait complete. 2024-04-25T08:55:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.167+0000 7f5484a1c740 20 client.5784 trim_cache size 0 max 16384 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.172+0000 7fdf9f8f5640 1 Processor -- start 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.172+0000 7fdf9f8f5640 1 -- start start 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.173+0000 7fdf9f8f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf98162290 0x7fdf980cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.173+0000 7fdf9f8f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf980cfba0 con 0x7fdf9815dd70 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.173+0000 7fdf9f8f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf980cfe80 con 0x7fdf980cc010 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.173+0000 7fdf9f8f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9806c180 con 0x7fdf98162290 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.173+0000 7fdf9ce90640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf98162290 0x7fdf980cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.173+0000 7fdf9d691640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdf9815dd70 0x7fdf9806c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54068/0 (socket says 172.21.15.55:54068) 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.173+0000 7fdf9ce90640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf98162290 0x7fdf980cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39710/0 (socket says 172.21.15.55:39710) 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.173+0000 7fdf9d691640 1 -- 172.21.15.55:0/2139564329 learned_addr learned my addr 172.21.15.55:0/2139564329 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.173+0000 7fdf9ce90640 1 -- 172.21.15.55:0/2139564329 >> v1:172.21.15.167:6789/0 conn(0x7fdf980cc010 legacy=0x7fdf980ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.173+0000 7fdf9ce90640 1 -- 172.21.15.55:0/2139564329 >> v1:172.21.15.55:6789/0 conn(0x7fdf9815dd70 legacy=0x7fdf9806c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.173+0000 7fdf9ce90640 1 -- 172.21.15.55:0/2139564329 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980d0160 con 0x7fdf98162290 2024-04-25T08:55:29.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.174+0000 7fdf9ce90640 1 --2- 172.21.15.55:0/2139564329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf98162290 0x7fdf980cf400 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdf880097a0 tx=0x7fdf8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71cf70a20cd4617 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.174+0000 7fdf8ffff640 1 -- 172.21.15.55:0/2139564329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88037070 con 0x7fdf98162290 2024-04-25T08:55:29.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.174+0000 7fdf8ffff640 1 -- 172.21.15.55:0/2139564329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf88032440 con 0x7fdf98162290 2024-04-25T08:55:29.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.174+0000 7fdf8ffff640 1 -- 172.21.15.55:0/2139564329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88032810 con 0x7fdf98162290 2024-04-25T08:55:29.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.174+0000 7fdf9f8f5640 1 -- 172.21.15.55:0/2139564329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf98162290 msgr2=0x7fdf980cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.174+0000 7fdf9f8f5640 1 --2- 172.21.15.55:0/2139564329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf98162290 0x7fdf980cf400 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdf880097a0 tx=0x7fdf8802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.175+0000 7fdf9f8f5640 1 -- 172.21.15.55:0/2139564329 shutdown_connections 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.175+0000 7fdf9f8f5640 1 --2- 172.21.15.55:0/2139564329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf98162290 0x7fdf980cf400 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.175+0000 7fdf9f8f5640 1 -- 172.21.15.55:0/2139564329 >> 172.21.15.55:0/2139564329 conn(0x7fdf9806f4a0 msgr2=0x7fdf9806f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.175+0000 7fdf9f8f5640 1 -- 172.21.15.55:0/2139564329 shutdown_connections 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.175+0000 7fdf9f8f5640 1 -- 172.21.15.55:0/2139564329 wait complete. 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.176+0000 7fdf9f8f5640 1 Processor -- start 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.176+0000 7fdf9f8f5640 1 -- start start 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.176+0000 7fdf9f8f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf980cc010 0x7fdf98153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9f8f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf9815dd70 0x7fdf980c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9f8f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf98162290 0x7fdf980c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9f8f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9806c3d0 con 0x7fdf980cc010 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9f8f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980cf940 con 0x7fdf9815dd70 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9f8f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9806d000 con 0x7fdf98162290 2024-04-25T08:55:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9d691640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf980cc010 0x7fdf98153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9d691640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf980cc010 0x7fdf98153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39714/0 (socket says 172.21.15.55:39714) 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9d691640 1 -- 172.21.15.55:0/1368834302 learned_addr learned my addr 172.21.15.55:0/1368834302 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9de92640 1 --2- 172.21.15.55:0/1368834302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf98162290 0x7fdf980c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9d691640 1 -- 172.21.15.55:0/1368834302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf98162290 msgr2=0x7fdf980c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9ce90640 1 --2- 172.21.15.55:0/1368834302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf9815dd70 0x7fdf980c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9d691640 1 --2- 172.21.15.55:0/1368834302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf98162290 0x7fdf980c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9d691640 1 -- 172.21.15.55:0/1368834302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf9815dd70 msgr2=0x7fdf980c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9d691640 1 --2- 172.21.15.55:0/1368834302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf9815dd70 0x7fdf980c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9d691640 1 -- 172.21.15.55:0/1368834302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980c8b50 con 0x7fdf980cc010 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9de92640 1 --2- 172.21.15.55:0/1368834302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf98162290 0x7fdf980c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9ce90640 1 --2- 172.21.15.55:0/1368834302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf9815dd70 0x7fdf980c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9d691640 1 --2- 172.21.15.55:0/1368834302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf980cc010 0x7fdf98153c80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400c400 tx=0x7fdf9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf8dffb640 1 -- 172.21.15.55:0/1368834302 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94017070 con 0x7fdf980cc010 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf8dffb640 1 -- 172.21.15.55:0/1368834302 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf94005ce0 con 0x7fdf980cc010 2024-04-25T08:55:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf9f8f5640 1 -- 172.21.15.55:0/1368834302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf980c8e30 con 0x7fdf980cc010 2024-04-25T08:55:29.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.177+0000 7fdf8dffb640 1 -- 172.21.15.55:0/1368834302 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf940072f0 con 0x7fdf980cc010 2024-04-25T08:55:29.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.178+0000 7fdf9f8f5640 1 -- 172.21.15.55:0/1368834302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf981541c0 con 0x7fdf980cc010 2024-04-25T08:55:29.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.178+0000 7fdf9f8f5640 1 -- 172.21.15.55:0/1368834302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fdf9806dec0 con 0x7fdf980cc010 2024-04-25T08:55:29.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.179+0000 7fdf8dffb640 1 -- 172.21.15.55:0/1368834302 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf9401a070 con 0x7fdf980cc010 2024-04-25T08:55:29.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.179+0000 7fdf8dffb640 1 --2- 172.21.15.55:0/1368834302 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf7c06b4d0 0x7fdf7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.179+0000 7fdf8dffb640 1 -- 172.21.15.55:0/1368834302 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdf94089650 con 0x7fdf980cc010 2024-04-25T08:55:29.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.179+0000 7fdf9ce90640 1 --2- 172.21.15.55:0/1368834302 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf7c06b4d0 0x7fdf7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.180+0000 7fdf8dffb640 1 -- 172.21.15.55:0/1368834302 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+497 (secure 0 0 0) 0x7fdf9408c210 con 0x7fdf980cc010 2024-04-25T08:55:29.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.180+0000 7fdf9f8f5640 1 -- 172.21.15.55:0/1368834302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fdf980749b0 con 0x7fdf980cc010 2024-04-25T08:55:29.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.180+0000 7fdf9ce90640 1 --2- 172.21.15.55:0/1368834302 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdf7c06b4d0 0x7fdf7c06d990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdf88034000 tx=0x7fdf8802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.183+0000 7f5484a1c740 1 Processor -- start 2024-04-25T08:55:29.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.183+0000 7f5484a1c740 1 -- start start 2024-04-25T08:55:29.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.184+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c21830 0x558e67c74a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.184+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c25cf0 0x558e67c8e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.184+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.184+0000 7f5484a1c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c1ffc80 con 0x558e67c26bb0 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.184+0000 7f5484a1c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c14b0c0 con 0x558e67c21830 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.184+0000 7f5484a1c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c14a4c0 con 0x558e67c25cf0 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.184+0000 7f547bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.184+0000 7f547bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39716/0 (socket says 172.21.15.55:39716) 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.184+0000 7f547bfff640 1 -- 172.21.15.55:0/4234029832 learned_addr learned my addr 172.21.15.55:0/4234029832 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f547b7fe640 1 --2- 172.21.15.55:0/4234029832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c21830 0x558e67c74a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f547bfff640 1 -- 172.21.15.55:0/4234029832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c25cf0 msgr2=0x558e67c8e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f547affd640 1 --2- 172.21.15.55:0/4234029832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c25cf0 0x558e67c8e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f547bfff640 1 --2- 172.21.15.55:0/4234029832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c25cf0 0x558e67c8e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f547bfff640 1 -- 172.21.15.55:0/4234029832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c21830 msgr2=0x558e67c74a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f547bfff640 1 --2- 172.21.15.55:0/4234029832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c21830 0x558e67c74a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f547bfff640 1 -- 172.21.15.55:0/4234029832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e67c6d870 con 0x558e67c26bb0 2024-04-25T08:55:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f547b7fe640 1 --2- 172.21.15.55:0/4234029832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c21830 0x558e67c74a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f547bfff640 1 --2- 172.21.15.55:0/4234029832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5474003f70 tx=0x7f54740054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4525eca1e50e58b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f5460ff9640 1 -- 172.21.15.55:0/4234029832 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474005730 con 0x558e67c26bb0 2024-04-25T08:55:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f5460ff9640 1 -- 172.21.15.55:0/4234029832 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547401b070 con 0x558e67c26bb0 2024-04-25T08:55:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.185+0000 7f5460ff9640 1 -- 172.21.15.55:0/4234029832 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474001d00 con 0x558e67c26bb0 2024-04-25T08:55:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.186+0000 7f5484a1c740 1 -- 172.21.15.55:0/4234029832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 msgr2=0x558e67c6f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.186+0000 7f5484a1c740 1 --2- 172.21.15.55:0/4234029832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5474003f70 tx=0x7f54740054e0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.186+0000 7f5484a1c740 1 -- 172.21.15.55:0/4234029832 shutdown_connections 2024-04-25T08:55:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.186+0000 7f5484a1c740 1 --2- 172.21.15.55:0/4234029832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.186+0000 7f5484a1c740 1 --2- 172.21.15.55:0/4234029832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c25cf0 0x558e67c8e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.186+0000 7f5484a1c740 1 --2- 172.21.15.55:0/4234029832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c21830 0x558e67c74a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.186+0000 7f5484a1c740 1 -- 172.21.15.55:0/4234029832 >> 172.21.15.55:0/4234029832 conn(0x558e67c24bc0 msgr2=0x558e67c62150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.186+0000 7f5484a1c740 1 -- 172.21.15.55:0/4234029832 shutdown_connections 2024-04-25T08:55:29.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.186+0000 7f5484a1c740 1 -- 172.21.15.55:0/4234029832 wait complete. 2024-04-25T08:55:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.186+0000 7f5484a1c740 1 -- start start 2024-04-25T08:55:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.187+0000 7f5484a1c740 1 Processor -- start 2024-04-25T08:55:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.187+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c21830 0x558e67ccebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.187+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c25cf0 0x558e67c26f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.187+0000 7f5484a1c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.187+0000 7f5484a1c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c14aac0 con 0x558e67c26bb0 2024-04-25T08:55:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.187+0000 7f5484a1c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e67b98000 con 0x558e67c21830 2024-04-25T08:55:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.187+0000 7f5484a1c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e67cdbcf0 con 0x558e67c25cf0 2024-04-25T08:55:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.187+0000 7f5484a1c740 10 client.0 _ll_register_callbacks cb 0x7f5470007e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:55:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.187+0000 7f547bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.187+0000 7f547bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39728/0 (socket says 172.21.15.55:39728) 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f547bfff640 1 -- 172.21.15.55:0/696812372 learned_addr learned my addr 172.21.15.55:0/696812372 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f547affd640 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c25cf0 0x558e67c26f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f547b7fe640 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c21830 0x558e67ccebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f547bfff640 1 -- 172.21.15.55:0/696812372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c25cf0 msgr2=0x558e67c26f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f547bfff640 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c25cf0 0x558e67c26f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f547bfff640 1 -- 172.21.15.55:0/696812372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c21830 msgr2=0x558e67ccebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f547bfff640 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c21830 0x558e67ccebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f547bfff640 1 -- 172.21.15.55:0/696812372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e67c85450 con 0x558e67c26bb0 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f547bfff640 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5474017000 tx=0x7f5474015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1d1a74f8f4db8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f545a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f545a7fc640 1 -- 172.21.15.55:0/696812372 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474026020 con 0x558e67c26bb0 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f545a7fc640 1 -- 172.21.15.55:0/696812372 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5474006d30 con 0x558e67c26bb0 2024-04-25T08:55:29.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f5484a1c740 1 -- 172.21.15.55:0/696812372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f547401b070 con 0x558e67c26bb0 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f545a7fc640 1 -- 172.21.15.55:0/696812372 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5474030050 con 0x558e67c26bb0 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f5484a1c740 10 client.5799 fetch_fsmap learned FSMap version 22 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f5484a1c740 1 -- 172.21.15.55:0/696812372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x558e67cdb770 con 0x558e67c26bb0 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.188+0000 7f545a7fc640 1 -- 172.21.15.55:0/696812372 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547401b070 con 0x558e67c26bb0 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.189+0000 7f545a7fc640 1 -- 172.21.15.55:0/696812372 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5474033020 con 0x558e67c26bb0 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.189+0000 7f5484a1c740 10 client.5799 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.189+0000 7f5484a1c740 10 client.5799 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.189+0000 7f5484a1c740 20 client.5799 populate_metadata read hostname 'smithi055' 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.189+0000 7f5484a1c740 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x558e67c70590 0x558e67c6ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.189+0000 7f5484a1c740 4 client.5799 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.189+0000 7f5484a1c740 1 -- 172.21.15.55:0/696812372 --> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x558e67b92350 con 0x558e67c70590 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.189+0000 7f547b7fe640 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x558e67c70590 0x558e67c6ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.189+0000 7f547b7fe640 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x558e67c70590 0x558e67c6ff20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86733813530243f2 server_cookie=44044026560f4959 in_seq=0 out_seq=0 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.189+0000 7f545a7fc640 10 client.5799 ms_handle_connect on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f545a7fc640 1 -- 172.21.15.55:0/696812372 <== mds.0 v2:172.21.15.55:6836/2070394524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558e67b92350 con 0x558e67c70590 2024-04-25T08:55:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f545a7fc640 10 client.5799 handle_command_reply: tid=0 2024-04-25T08:55:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 1 client.5799 shutdown 2024-04-25T08:55:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 1 -- 172.21.15.55:0/696812372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 msgr2=0x558e67c6f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5474017000 tx=0x7f5474015000 comp rx=0 tx=0).stop 2024-04-25T08:55:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 1 -- 172.21.15.55:0/696812372 shutdown_connections 2024-04-25T08:55:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x558e67c70590 0x558e67c6ff20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e67c26bb0 0x558e67c6f9e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f545a7fc640 0 client.5799 ms_handle_reset on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e67c25cf0 0x558e67c26f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 1 --2- 172.21.15.55:0/696812372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e67c21830 0x558e67ccebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 1 -- 172.21.15.55:0/696812372 >> 172.21.15.55:0/696812372 conn(0x558e67c24bc0 msgr2=0x558e67c4e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.186 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T08:55:29.190+0000 7fd2cbdbf640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5102=0-4194304@1} caps={5102=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5102 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55929f80a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T08:55:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 1 -- 172.21.15.55:0/696812372 shutdown_connections 2024-04-25T08:55:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 1 -- 172.21.15.55:0/696812372 wait complete. 2024-04-25T08:55:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.190+0000 7f5484a1c740 20 client.5799 trim_cache size 0 max 16384 2024-04-25T08:55:29.186 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:55:29.187 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-25T08:55:29.187 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "eddc4325-76f4-45cf-9dfe-e3e999c511af", 2024-04-25T08:55:29.187 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-25T08:55:29.187 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 -- 172.21.15.55:0/3091334191 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f546806b4d0 msgr2=0x7f546806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f546806b4d0 0x7f546806d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5470007fd0 tx=0x7f5470009040 comp rx=0 tx=0).stop 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 -- 172.21.15.55:0/3091334191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f547c06b040 msgr2=0x7f547c14cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f547c06b040 0x7f547c14cc90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f546c035040 tx=0x7f546c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 -- 172.21.15.55:0/3091334191 shutdown_connections 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f546806b4d0 0x7f546806d990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c161f10 0x7f547c0b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c06b420 0x7f547c0b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 --2- 172.21.15.55:0/3091334191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f547c06b040 0x7f547c14cc90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 -- 172.21.15.55:0/3091334191 >> 172.21.15.55:0/3091334191 conn(0x7f547c099a40 msgr2=0x7f547c1601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 -- 172.21.15.55:0/3091334191 shutdown_connections 2024-04-25T08:55:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.191+0000 7f5481d1d640 1 -- 172.21.15.55:0/3091334191 wait complete. 2024-04-25T08:55:29.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:29.192 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T08:55:29.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.305+0000 7faeb0a6f640 1 Processor -- start 2024-04-25T08:55:29.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.305+0000 7faeb0a6f640 1 -- start start 2024-04-25T08:55:29.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeb0a6f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faeac15b7b0 0x7faeac0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeb0a6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faeac15e820 0x7faeac0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeb0a6f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac15f000 con 0x7faeac0cf760 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeb0a6f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeac0ced00 con 0x7faeac15e820 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeb0a6f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeac0ce330 con 0x7faeac15b7b0 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeaad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faeac15e820 0x7faeac0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeaad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faeac15e820 0x7faeac0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39730/0 (socket says 172.21.15.55:39730) 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeaad9d640 1 -- 172.21.15.55:0/1452179723 learned_addr learned my addr 172.21.15.55:0/1452179723 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeaa59c640 1 --2- 172.21.15.55:0/1452179723 >> v2:172.21.15.167:3300/0 conn(0x7faeac15b7b0 0x7faeac0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeaad9d640 1 -- 172.21.15.55:0/1452179723 >> v2:172.21.15.167:3300/0 conn(0x7faeac15b7b0 msgr2=0x7faeac0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeaad9d640 1 --2- 172.21.15.55:0/1452179723 >> v2:172.21.15.167:3300/0 conn(0x7faeac15b7b0 0x7faeac0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeaad9d640 1 -- 172.21.15.55:0/1452179723 >> v1:172.21.15.167:6789/0 conn(0x7faeac0cf760 legacy=0x7faeac15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeaad9d640 1 -- 172.21.15.55:0/1452179723 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac15ed20 con 0x7faeac15e820 2024-04-25T08:55:29.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.306+0000 7faeaa59c640 1 --2- 172.21.15.55:0/1452179723 >> v2:172.21.15.167:3300/0 conn(0x7faeac15b7b0 0x7faeac0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:29.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.307+0000 7faeaad9d640 1 --2- 172.21.15.55:0/1452179723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac15e820 0x7faeac0cfbf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7faea4009e50 tx=0x7faea402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc84170115f7397f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.307+0000 7faea959a640 1 -- 172.21.15.55:0/1452179723 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4036070 con 0x7faeac15e820 2024-04-25T08:55:29.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.307+0000 7faea959a640 1 -- 172.21.15.55:0/1452179723 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4031600 con 0x7faeac15e820 2024-04-25T08:55:29.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.307+0000 7faea959a640 1 -- 172.21.15.55:0/1452179723 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea40319d0 con 0x7faeac15e820 2024-04-25T08:55:29.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.307+0000 7faeb0a6f640 1 -- 172.21.15.55:0/1452179723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac15e820 msgr2=0x7faeac0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.308+0000 7faeb0a6f640 1 --2- 172.21.15.55:0/1452179723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac15e820 0x7faeac0cfbf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7faea4009e50 tx=0x7faea402a710 comp rx=0 tx=0).stop 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.308+0000 7faeb0a6f640 1 -- 172.21.15.55:0/1452179723 shutdown_connections 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.308+0000 7faeb0a6f640 1 --2- 172.21.15.55:0/1452179723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac15e820 0x7faeac0cfbf0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.308+0000 7faeb0a6f640 1 --2- 172.21.15.55:0/1452179723 >> v2:172.21.15.167:3300/0 conn(0x7faeac15b7b0 0x7faeac0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.308+0000 7faeb0a6f640 1 -- 172.21.15.55:0/1452179723 >> 172.21.15.55:0/1452179723 conn(0x7faeac06f4a0 msgr2=0x7faeac06f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.308+0000 7faeb0a6f640 1 -- 172.21.15.55:0/1452179723 shutdown_connections 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.308+0000 7faeb0a6f640 1 -- 172.21.15.55:0/1452179723 wait complete. 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.309+0000 7faeb0a6f640 1 Processor -- start 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.309+0000 7faeb0a6f640 1 -- start start 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeb0a6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0cf760 0x7faeac1592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeb0a6f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faeac15b7b0 0x7faeac0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeb0a6f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faeac15e820 0x7faeac15cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeb0a6f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1619f0 con 0x7faeac0cf760 2024-04-25T08:55:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeb0a6f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0cdfc0 con 0x7faeac15b7b0 2024-04-25T08:55:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeb0a6f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0cc080 con 0x7faeac15e820 2024-04-25T08:55:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeaa59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0cf760 0x7faeac1592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeaa59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0cf760 0x7faeac1592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39740/0 (socket says 172.21.15.55:39740) 2024-04-25T08:55:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeaa59c640 1 -- 172.21.15.55:0/3564049581 learned_addr learned my addr 172.21.15.55:0/3564049581 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeaa59c640 1 -- 172.21.15.55:0/3564049581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faeac15e820 msgr2=0x7faeac15cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeaad9d640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faeac15e820 0x7faeac15cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeaa59c640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faeac15e820 0x7faeac15cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faea9d9b640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faeac15b7b0 0x7faeac0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeaa59c640 1 -- 172.21.15.55:0/3564049581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faeac15b7b0 msgr2=0x7faeac0b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeaa59c640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faeac15b7b0 0x7faeac0b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeaa59c640 1 -- 172.21.15.55:0/3564049581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac15bf50 con 0x7faeac0cf760 2024-04-25T08:55:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.310+0000 7faeaa59c640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0cf760 0x7faeac1592e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c7f0 tx=0x7fae9c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.311+0000 7fae9affd640 1 -- 172.21.15.55:0/3564049581 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c015070 con 0x7faeac0cf760 2024-04-25T08:55:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.311+0000 7fae9affd640 1 -- 172.21.15.55:0/3564049581 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c007a30 con 0x7faeac0cf760 2024-04-25T08:55:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.311+0000 7faeb0a6f640 1 -- 172.21.15.55:0/3564049581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac15c230 con 0x7faeac0cf760 2024-04-25T08:55:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.311+0000 7fae9affd640 1 -- 172.21.15.55:0/3564049581 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c007e00 con 0x7faeac0cf760 2024-04-25T08:55:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.311+0000 7faeb0a6f640 1 -- 172.21.15.55:0/3564049581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac15c7f0 con 0x7faeac0cf760 2024-04-25T08:55:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.312+0000 7fae9affd640 1 -- 172.21.15.55:0/3564049581 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae9c018070 con 0x7faeac0cf760 2024-04-25T08:55:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.313+0000 7fae9affd640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae8c06b4d0 0x7fae8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.313+0000 7fae9affd640 1 -- 172.21.15.55:0/3564049581 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fae9c08a1f0 con 0x7faeac0cf760 2024-04-25T08:55:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.313+0000 7faea9d9b640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae8c06b4d0 0x7fae8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.313+0000 7faea9d9b640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae8c06b4d0 0x7fae8c06d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faeac0cb970 tx=0x7faea0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.314+0000 7faeb377a740 1 Processor -- start 2024-04-25T08:55:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.314+0000 7faeb377a740 1 -- start start 2024-04-25T08:55:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeb377a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83b10 0x5605e6f86320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeb377a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f83ef0 0x5605e6f86860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeb377a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f56770 0x5605e6f59f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeb377a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e6ebfda0 con 0x5605e6f56770 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeb377a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e6e68b80 con 0x5605e6f83ef0 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeb377a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605e6ebbe40 con 0x5605e6f83b10 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeaad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f56770 0x5605e6f59f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeaad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f56770 0x5605e6f59f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39754/0 (socket says 172.21.15.55:39754) 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeaad9d640 1 -- 172.21.15.55:0/1491036644 learned_addr learned my addr 172.21.15.55:0/1491036644 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeaa59c640 1 --2- 172.21.15.55:0/1491036644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83b10 0x5605e6f86320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faea9d9b640 1 --2- 172.21.15.55:0/1491036644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f83ef0 0x5605e6f86860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeaad9d640 1 -- 172.21.15.55:0/1491036644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83b10 msgr2=0x5605e6f86320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeaad9d640 1 --2- 172.21.15.55:0/1491036644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83b10 0x5605e6f86320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeaad9d640 1 -- 172.21.15.55:0/1491036644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f83ef0 msgr2=0x5605e6f86860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeaad9d640 1 --2- 172.21.15.55:0/1491036644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f83ef0 0x5605e6f86860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeaad9d640 1 -- 172.21.15.55:0/1491036644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605e6e72f10 con 0x5605e6f56770 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faea9d9b640 1 --2- 172.21.15.55:0/1491036644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f83ef0 0x5605e6f86860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7faeaad9d640 1 --2- 172.21.15.55:0/1491036644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f56770 0x5605e6f59f80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7faea402ad00 tx=0x7faea402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d034a8b7a1921199 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7fae8bfff640 1 -- 172.21.15.55:0/1491036644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4036040 con 0x5605e6f56770 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7fae8bfff640 1 -- 172.21.15.55:0/1491036644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4041070 con 0x5605e6f56770 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.315+0000 7fae8bfff640 1 -- 172.21.15.55:0/1491036644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4003dd0 con 0x5605e6f56770 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.316+0000 7faeb377a740 1 -- 172.21.15.55:0/1491036644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f56770 msgr2=0x5605e6f59f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.316+0000 7faeb377a740 1 --2- 172.21.15.55:0/1491036644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f56770 0x5605e6f59f80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7faea402ad00 tx=0x7faea402e000 comp rx=0 tx=0).stop 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.316+0000 7faeb377a740 1 -- 172.21.15.55:0/1491036644 shutdown_connections 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.316+0000 7faeb377a740 1 --2- 172.21.15.55:0/1491036644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f56770 0x5605e6f59f80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.316+0000 7faeb377a740 1 --2- 172.21.15.55:0/1491036644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f83ef0 0x5605e6f86860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.316+0000 7faeb377a740 1 --2- 172.21.15.55:0/1491036644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83b10 0x5605e6f86320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.316+0000 7faeb377a740 1 -- 172.21.15.55:0/1491036644 >> 172.21.15.55:0/1491036644 conn(0x5605e6f589e0 msgr2=0x5605e6fa1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.316+0000 7faeb377a740 1 -- 172.21.15.55:0/1491036644 shutdown_connections 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.316+0000 7faeb377a740 1 -- 172.21.15.55:0/1491036644 wait complete. 2024-04-25T08:55:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.317+0000 7faeb377a740 1 -- start start 2024-04-25T08:55:29.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.317+0000 7faeb377a740 1 Processor -- start 2024-04-25T08:55:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeb377a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e6f7c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeb377a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83ef0 0x5605e6fb45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeb377a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f7ec10 0x5605e6fa4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeb377a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e6f5bb90 con 0x5605e6f83b10 2024-04-25T08:55:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeb377a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e6e5e4b0 con 0x5605e6f7ec10 2024-04-25T08:55:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeb377a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605e6f5be70 con 0x5605e6f83ef0 2024-04-25T08:55:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeb377a740 10 client.0 _ll_register_callbacks cb 0x5605e6e9e180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:55:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeaa59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e6f7c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeaa59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e6f7c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39756/0 (socket says 172.21.15.55:39756) 2024-04-25T08:55:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeaa59c640 1 -- 172.21.15.55:0/3677959773 learned_addr learned my addr 172.21.15.55:0/3677959773 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faea9d9b640 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83ef0 0x5605e6fb45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeaad9d640 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f7ec10 0x5605e6fa4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeaa59c640 1 -- 172.21.15.55:0/3677959773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83ef0 msgr2=0x5605e6fb45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeaa59c640 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83ef0 0x5605e6fb45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeaa59c640 1 -- 172.21.15.55:0/3677959773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f7ec10 msgr2=0x5605e6fa4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeaa59c640 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f7ec10 0x5605e6fa4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeaa59c640 1 -- 172.21.15.55:0/3677959773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605e6c9e7d0 con 0x5605e6f83b10 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faea9d9b640 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83ef0 0x5605e6fb45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeaa59c640 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e6f7c300 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fae9c007410 tx=0x7fae9c0589f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52afa923ca8e168 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7fae897fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7fae897fa640 1 -- 172.21.15.55:0/3677959773 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c070020 con 0x5605e6f83b10 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7fae897fa640 1 -- 172.21.15.55:0/3677959773 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fae9c0703c0 con 0x5605e6f83b10 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeb377a740 1 -- 172.21.15.55:0/3677959773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faea4041070 con 0x5605e6f83b10 2024-04-25T08:55:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7fae897fa640 1 -- 172.21.15.55:0/3677959773 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae9c01f050 con 0x5605e6f83b10 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.318+0000 7faeb377a740 10 client.5811 fetch_fsmap learned FSMap version 22 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7faeb377a740 1 -- 172.21.15.55:0/3677959773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5605e6bd43f0 con 0x5605e6f83b10 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7fae897fa640 1 -- 172.21.15.55:0/3677959773 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4041070 con 0x5605e6f83b10 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7fae897fa640 1 -- 172.21.15.55:0/3677959773 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fae9c057d80 con 0x5605e6f83b10 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7faeb377a740 10 client.5811 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7faeb377a740 10 client.5811 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7faeb377a740 20 client.5811 populate_metadata read hostname 'smithi055' 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7faeb377a740 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5605e6f82660 0x5605e6fa2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7faeb377a740 4 client.5811 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7faeb377a740 1 -- 172.21.15.55:0/3677959773 --> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5605e6ecd2e0 con 0x5605e6f82660 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7faea9d9b640 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5605e6f82660 0x5605e6fa2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7fae897fa640 10 client.5811 ms_handle_connect on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.319+0000 7faea9d9b640 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5605e6f82660 0x5605e6fa2450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5930e78bcece16b server_cookie=d2b20bec8394e079 in_seq=0 out_seq=0 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7fae897fa640 1 -- 172.21.15.55:0/3677959773 <== mds.0 v2:172.21.15.55:6836/2070394524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5605e6ecd2e0 con 0x5605e6f82660 2024-04-25T08:55:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7fae897fa640 10 client.5811 handle_command_reply: tid=0 2024-04-25T08:55:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 1 client.5811 shutdown 2024-04-25T08:55:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 1 -- 172.21.15.55:0/3677959773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 msgr2=0x5605e6f7c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e6f7c300 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fae9c007410 tx=0x7fae9c0589f0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 1 -- 172.21.15.55:0/3677959773 shutdown_connections 2024-04-25T08:55:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5605e6f82660 0x5605e6fa2450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f7ec10 0x5605e6fa4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83ef0 0x5605e6fb45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 1 --2- 172.21.15.55:0/3677959773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e6f7c300 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7fae897fa640 0 client.5811 ms_handle_reset on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 1 -- 172.21.15.55:0/3677959773 >> 172.21.15.55:0/3677959773 conn(0x5605e6f56770 msgr2=0x5605e6f57420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 1 -- 172.21.15.55:0/3677959773 shutdown_connections 2024-04-25T08:55:29.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 1 -- 172.21.15.55:0/3677959773 wait complete. 2024-04-25T08:55:29.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.320+0000 7faeb377a740 20 client.5811 trim_cache size 0 max 16384 2024-04-25T08:55:29.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.335+0000 7faeb377a740 1 Processor -- start 2024-04-25T08:55:29.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.335+0000 7faeb377a740 1 -- start start 2024-04-25T08:55:29.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeb377a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f7ec10 0x5605e6f57a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeb377a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f83b10 0x5605e6f5b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeb377a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83ef0 0x5605e6f82dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeb377a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1ffe30 con 0x5605e6f83ef0 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeb377a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac158ab0 con 0x5605e6f83b10 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeb377a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac157ee0 con 0x5605e6f7ec10 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeaad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83ef0 0x5605e6f82dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeaad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83ef0 0x5605e6f82dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39772/0 (socket says 172.21.15.55:39772) 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeaad9d640 1 -- 172.21.15.55:0/4265713698 learned_addr learned my addr 172.21.15.55:0/4265713698 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeaa59c640 1 --2- 172.21.15.55:0/4265713698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f7ec10 0x5605e6f57a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faea9d9b640 1 --2- 172.21.15.55:0/4265713698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f83b10 0x5605e6f5b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeaad9d640 1 -- 172.21.15.55:0/4265713698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f7ec10 msgr2=0x5605e6f57a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeaad9d640 1 --2- 172.21.15.55:0/4265713698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f7ec10 0x5605e6f57a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeaad9d640 1 -- 172.21.15.55:0/4265713698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f83b10 msgr2=0x5605e6f5b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeaad9d640 1 --2- 172.21.15.55:0/4265713698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f83b10 0x5605e6f5b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.336+0000 7faeaad9d640 1 -- 172.21.15.55:0/4265713698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605e6b940f0 con 0x5605e6f83ef0 2024-04-25T08:55:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7faeaad9d640 1 --2- 172.21.15.55:0/4265713698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83ef0 0x5605e6f82dc0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7faea4009e50 tx=0x7faea4009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d6037e41a9d2b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7fae8b7fe640 1 -- 172.21.15.55:0/4265713698 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4003b90 con 0x5605e6f83ef0 2024-04-25T08:55:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7fae8b7fe640 1 -- 172.21.15.55:0/4265713698 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4041040 con 0x5605e6f83ef0 2024-04-25T08:55:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7fae8b7fe640 1 -- 172.21.15.55:0/4265713698 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4004040 con 0x5605e6f83ef0 2024-04-25T08:55:29.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7faeb377a740 1 -- 172.21.15.55:0/4265713698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83ef0 msgr2=0x5605e6f82dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7faeb377a740 1 --2- 172.21.15.55:0/4265713698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83ef0 0x5605e6f82dc0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7faea4009e50 tx=0x7faea4009810 comp rx=0 tx=0).stop 2024-04-25T08:55:29.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7faeb377a740 1 -- 172.21.15.55:0/4265713698 shutdown_connections 2024-04-25T08:55:29.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7faeb377a740 1 --2- 172.21.15.55:0/4265713698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83ef0 0x5605e6f82dc0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7faeb377a740 1 --2- 172.21.15.55:0/4265713698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f83b10 0x5605e6f5b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7faeb377a740 1 --2- 172.21.15.55:0/4265713698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f7ec10 0x5605e6f57a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7faeb377a740 1 -- 172.21.15.55:0/4265713698 >> 172.21.15.55:0/4265713698 conn(0x5605e6f56770 msgr2=0x5605e6f7f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7faeb377a740 1 -- 172.21.15.55:0/4265713698 shutdown_connections 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.337+0000 7faeb377a740 1 -- 172.21.15.55:0/4265713698 wait complete. 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.338+0000 7faeb377a740 1 -- start start 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.338+0000 7faeb377a740 1 Processor -- start 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faeb377a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f7ec10 0x5605e6fb08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faeb377a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e700b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faeb377a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83ef0 0x5605e6f82d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faeb377a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1584b0 con 0x5605e6f83b10 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faeb377a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605e6f86520 con 0x5605e6f7ec10 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faeb377a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605e6fb3790 con 0x5605e6f83ef0 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faeb377a740 10 client.0 _ll_register_callbacks cb 0x7faea4034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:55:29.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faea9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e700b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faea9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e700b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39774/0 (socket says 172.21.15.55:39774) 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faea9d9b640 1 -- 172.21.15.55:0/3940582751 learned_addr learned my addr 172.21.15.55:0/3940582751 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faeaad9d640 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83ef0 0x5605e6f82d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faeaa59c640 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f7ec10 0x5605e6fb08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faea9d9b640 1 -- 172.21.15.55:0/3940582751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83ef0 msgr2=0x5605e6f82d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faea9d9b640 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83ef0 0x5605e6f82d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faea9d9b640 1 -- 172.21.15.55:0/3940582751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f7ec10 msgr2=0x5605e6fb08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faea9d9b640 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f7ec10 0x5605e6fb08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.339+0000 7faea9d9b640 1 -- 172.21.15.55:0/3940582751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605e6f784a0 con 0x5605e6f83b10 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7faea9d9b640 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e700b840 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7faeac0b77c0 tx=0x7faea0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe9a80a8a8c0cd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7fae897fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7fae897fa640 1 -- 172.21.15.55:0/3940582751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0032060 con 0x5605e6f83b10 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7fae897fa640 1 -- 172.21.15.55:0/3940582751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7faea000d690 con 0x5605e6f83b10 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7faeb377a740 1 -- 172.21.15.55:0/3940582751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faea4041040 con 0x5605e6f83b10 2024-04-25T08:55:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7fae897fa640 1 -- 172.21.15.55:0/3940582751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7faea0038050 con 0x5605e6f83b10 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7faeb377a740 10 client.5817 fetch_fsmap learned FSMap version 22 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7faeb377a740 1 -- 172.21.15.55:0/3940582751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5605e6fb31a0 con 0x5605e6f83b10 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7fae897fa640 1 -- 172.21.15.55:0/3940582751 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4041040 con 0x5605e6f83b10 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7fae897fa640 1 -- 172.21.15.55:0/3940582751 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7faea003b020 con 0x5605e6f83b10 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7faeb377a740 10 client.5817 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7faeb377a740 10 client.5817 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7faeb377a740 20 client.5817 populate_metadata read hostname 'smithi055' 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7faeb377a740 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5605e6f83270 0x5605e700c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7faeb377a740 4 client.5817 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7faeb377a740 1 -- 172.21.15.55:0/3940582751 --> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5605e6ec7630 con 0x5605e6f83270 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.340+0000 7faeaa59c640 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5605e6f83270 0x5605e700c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7fae897fa640 10 client.5817 ms_handle_connect on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeaa59c640 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5605e6f83270 0x5605e700c220 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b375e44534086e server_cookie=b1c8c1b81f2beabd in_seq=0 out_seq=0 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7fae897fa640 1 -- 172.21.15.55:0/3940582751 <== mds.0 v2:172.21.15.55:6836/2070394524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x5605e6ec7630 con 0x5605e6f83270 2024-04-25T08:55:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7fae897fa640 10 client.5817 handle_command_reply: tid=0 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 1 client.5817 shutdown 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 1 -- 172.21.15.55:0/3940582751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 msgr2=0x5605e700b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e700b840 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7faeac0b77c0 tx=0x7faea0010000 comp rx=0 tx=0).stop 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 1 -- 172.21.15.55:0/3940582751 shutdown_connections 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5605e6f83270 0x5605e700c220 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5605e6f83ef0 0x5605e6f82d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605e6f83b10 0x5605e700b840 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 1 --2- 172.21.15.55:0/3940582751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e6f7ec10 0x5605e6fb08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7fae897fa640 0 client.5817 ms_handle_reset on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 1 -- 172.21.15.55:0/3940582751 >> 172.21.15.55:0/3940582751 conn(0x5605e6f56770 msgr2=0x5605e6f5b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 1 -- 172.21.15.55:0/3940582751 shutdown_connections 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 1 -- 172.21.15.55:0/3940582751 wait complete. 2024-04-25T08:55:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.341+0000 7faeb377a740 20 client.5817 trim_cache size 0 max 16384 2024-04-25T08:55:29.337 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:55:29.337 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:55:29.337 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-25T08:55:29.337 INFO:teuthology.orchestra.run.smithi055.stdout: "eddc4325-76f4-45cf-9dfe-e3e999c511af": { 2024-04-25T08:55:29.337 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-04-25T08:55:29.337 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "eddc4325-76f4-45cf-9dfe-e3e999c511af", 2024-04-25T08:55:29.337 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-25T08:55:29.337 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:29.337 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:55:29.337 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:55:29.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 -- 172.21.15.55:0/3564049581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae8c06b4d0 msgr2=0x7fae8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae8c06b4d0 0x7fae8c06d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faeac0cb970 tx=0x7faea0009040 comp rx=0 tx=0).stop 2024-04-25T08:55:29.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 -- 172.21.15.55:0/3564049581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0cf760 msgr2=0x7faeac1592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:29.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0cf760 0x7faeac1592e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c7f0 tx=0x7fae9c00cbf0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 -- 172.21.15.55:0/3564049581 shutdown_connections 2024-04-25T08:55:29.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae8c06b4d0 0x7fae8c06d990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faeac15e820 0x7faeac15cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faeac15b7b0 0x7faeac0b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 --2- 172.21.15.55:0/3564049581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0cf760 0x7faeac1592e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:29.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 -- 172.21.15.55:0/3564049581 >> 172.21.15.55:0/3564049581 conn(0x7faeac06f4a0 msgr2=0x7faeac06cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:29.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 -- 172.21.15.55:0/3564049581 shutdown_connections 2024-04-25T08:55:29.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:29.342+0000 7faeb0a6f640 1 -- 172.21.15.55:0/3564049581 wait complete. 2024-04-25T08:55:29.342 INFO:tasks.cephfs.filesystem:scrub status for tag:eddc4325-76f4-45cf-9dfe-e3e999c511af - {'path': '/', 'tag': 'eddc4325-76f4-45cf-9dfe-e3e999c511af', 'options': 'recursive,repair'} 2024-04-25T08:55:30.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:30.030+0000 7fdf8dffb640 1 -- 172.21.15.55:0/1368834302 <== mon.0 v2:172.21.15.55:3300/0 7 ==== log(6 entries from seq 1 at 2024-04-25T08:55:29.190726+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7fdf9405ce00 con 0x7fdf980cc010 2024-04-25T08:55:30.021 INFO:teuthology.orchestra.run.smithi055.stdout: cluster: 2024-04-25T08:55:30.021 INFO:teuthology.orchestra.run.smithi055.stdout: id: c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T08:55:30.021 INFO:teuthology.orchestra.run.smithi055.stdout: health: HEALTH_OK 2024-04-25T08:55:30.021 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:30.021 INFO:teuthology.orchestra.run.smithi055.stdout: services: 2024-04-25T08:55:30.021 INFO:teuthology.orchestra.run.smithi055.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-25T08:55:30.021 INFO:teuthology.orchestra.run.smithi055.stdout: mgr: y(active, since 2m), standbys: x 2024-04-25T08:55:30.021 INFO:teuthology.orchestra.run.smithi055.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T08:55:30.021 INFO:teuthology.orchestra.run.smithi055.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2024-04-25T08:55:30.021 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:30.021 INFO:teuthology.orchestra.run.smithi055.stdout: data: 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout: volumes: 1/1 healthy 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout: pools: 3 pools, 97 pgs 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout: objects: 24 objects, 579 KiB 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout: usage: 233 MiB used, 720 GiB / 720 GiB avail 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout: pgs: 97 active+clean 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout: io: 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout: client: 0 B/s wr, 0 op/s rd, 0 op/s wr 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T08:55:29.190726+0000 mds.c [INF] scrub queued for path: / 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T08:55:29.190730+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T08:55:30.022 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T08:55:29.190734+0000 mds.c [INF] scrub summary: active paths [/] 2024-04-25T08:55:30.023 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T08:55:29.191522+0000 mds.c [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-04-25T08:55:30.023 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T08:55:29.191533+0000 mds.c [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-04-25T08:55:30.023 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T08:55:29.192052+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T08:55:32.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:32.034+0000 7fdf8dffb640 1 -- 172.21.15.55:0/1368834302 <== mon.0 v2:172.21.15.55:3300/0 8 ==== log(1 entries from seq 7 at 2024-04-25T08:55:31.794991+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7fdf94087c50 con 0x7fdf980cc010 2024-04-25T08:55:32.024 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T08:55:31.794991+0000 mds.c [INF] scrub summary: idle 2024-04-25T08:55:39.356 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:55:39.359 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:55:59.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:55:59.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T08:55:59.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.470+0000 7fd92e14f640 1 Processor -- start 2024-04-25T08:55:59.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.470+0000 7fd92e14f640 1 -- start start 2024-04-25T08:55:59.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.470+0000 7fd92e14f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9280d1130 0x7fd9280b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.470+0000 7fd92e14f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9280d4090 con 0x7fd9280d3b90 2024-04-25T08:55:59.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.470+0000 7fd92e14f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9280d4370 con 0x7fd92815dca0 2024-04-25T08:55:59.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.470+0000 7fd92e14f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9280b6b20 con 0x7fd9280d1130 2024-04-25T08:55:59.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.471+0000 7fd927fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9280d1130 0x7fd9280b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.471+0000 7fd926ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd9280d3b90 0x7fd9280d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44276/0 (socket says 172.21.15.55:44276) 2024-04-25T08:55:59.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.471+0000 7fd926ffd640 1 -- 172.21.15.55:0/1193206440 learned_addr learned my addr 172.21.15.55:0/1193206440 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:59.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.471+0000 7fd927fff640 1 -- 172.21.15.55:0/1193206440 >> v1:172.21.15.167:6789/0 conn(0x7fd92815dca0 legacy=0x7fd9280ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:59.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.471+0000 7fd927fff640 1 -- 172.21.15.55:0/1193206440 >> v1:172.21.15.55:6789/0 conn(0x7fd9280d3b90 legacy=0x7fd9280d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.471+0000 7fd927fff640 1 -- 172.21.15.55:0/1193206440 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9280d4650 con 0x7fd9280d1130 2024-04-25T08:55:59.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.471+0000 7fd9267fc640 1 -- 172.21.15.55:0/1193206440 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593203367 0 0) 0x7fd9280d4090 con 0x7fd9280d3b90 2024-04-25T08:55:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.472+0000 7fd927fff640 1 --2- 172.21.15.55:0/1193206440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9280d1130 0x7fd9280b2500 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd920009d90 tx=0x7fd92002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ede763f62ecd0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.472+0000 7fd9267fc640 1 -- 172.21.15.55:0/1193206440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920007740 con 0x7fd9280d1130 2024-04-25T08:55:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.472+0000 7fd9267fc640 1 -- 172.21.15.55:0/1193206440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9200078e0 con 0x7fd9280d1130 2024-04-25T08:55:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.472+0000 7fd9267fc640 1 -- 172.21.15.55:0/1193206440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920007cb0 con 0x7fd9280d1130 2024-04-25T08:55:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.472+0000 7fd92e14f640 1 -- 172.21.15.55:0/1193206440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9280d1130 msgr2=0x7fd9280b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.472+0000 7fd92e14f640 1 --2- 172.21.15.55:0/1193206440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9280d1130 0x7fd9280b2500 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd920009d90 tx=0x7fd92002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.472+0000 7fd92e14f640 1 -- 172.21.15.55:0/1193206440 shutdown_connections 2024-04-25T08:55:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.472+0000 7fd92e14f640 1 --2- 172.21.15.55:0/1193206440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9280d1130 0x7fd9280b2500 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.472+0000 7fd92e14f640 1 -- 172.21.15.55:0/1193206440 >> 172.21.15.55:0/1193206440 conn(0x7fd9280726c0 msgr2=0x7fd928072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.472+0000 7fd92e14f640 1 -- 172.21.15.55:0/1193206440 shutdown_connections 2024-04-25T08:55:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.473+0000 7fd92e14f640 1 -- 172.21.15.55:0/1193206440 wait complete. 2024-04-25T08:55:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.474+0000 7fd92e14f640 1 Processor -- start 2024-04-25T08:55:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.474+0000 7fd92e14f640 1 -- start start 2024-04-25T08:55:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd92e14f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9280d1130 0x7fd9281f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd92e14f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9280d3b90 0x7fd92815b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd92e14f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd92815dca0 0x7fd92815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd92e14f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92815e080 con 0x7fd92815dca0 2024-04-25T08:55:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd92e14f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9280cf050 con 0x7fd9280d1130 2024-04-25T08:55:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd92e14f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92815e200 con 0x7fd9280d3b90 2024-04-25T08:55:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd927fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd92815dca0 0x7fd92815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd927fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd92815dca0 0x7fd92815bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38322/0 (socket says 172.21.15.55:38322) 2024-04-25T08:55:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd927fff640 1 -- 172.21.15.55:0/16657279 learned_addr learned my addr 172.21.15.55:0/16657279 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd9277fe640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9280d1130 0x7fd9281f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd926ffd640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9280d3b90 0x7fd92815b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd927fff640 1 -- 172.21.15.55:0/16657279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9280d3b90 msgr2=0x7fd92815b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd927fff640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9280d3b90 0x7fd92815b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd927fff640 1 -- 172.21.15.55:0/16657279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9280d1130 msgr2=0x7fd9281f7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd927fff640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9280d1130 0x7fd9281f7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd927fff640 1 -- 172.21.15.55:0/16657279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928153b00 con 0x7fd92815dca0 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd927fff640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd92815dca0 0x7fd92815bb90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd920009eb0 tx=0x7fd920004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd90ffff640 1 -- 172.21.15.55:0/16657279 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920040070 con 0x7fd92815dca0 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd90ffff640 1 -- 172.21.15.55:0/16657279 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd920031c90 con 0x7fd92815dca0 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd92e14f640 1 -- 172.21.15.55:0/16657279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9280cd480 con 0x7fd92815dca0 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.475+0000 7fd90ffff640 1 -- 172.21.15.55:0/16657279 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920045680 con 0x7fd92815dca0 2024-04-25T08:55:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.476+0000 7fd92e14f640 1 -- 172.21.15.55:0/16657279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd928153da0 con 0x7fd92815dca0 2024-04-25T08:55:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.477+0000 7fd90ffff640 1 -- 172.21.15.55:0/16657279 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd920039040 con 0x7fd92815dca0 2024-04-25T08:55:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.477+0000 7fd90ffff640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd91406b4d0 0x7fd91406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.478+0000 7fd90ffff640 1 -- 172.21.15.55:0/16657279 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd9200aba80 con 0x7fd92815dca0 2024-04-25T08:55:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.478+0000 7fd9277fe640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd91406b4d0 0x7fd91406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.478+0000 7fd9277fe640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd91406b4d0 0x7fd91406d990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd918006fd0 tx=0x7fd918009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.478+0000 7fd930e4b740 1 Processor -- start 2024-04-25T08:55:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.479+0000 7fd930e4b740 1 -- start start 2024-04-25T08:55:59.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.479+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d19a4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.479+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d19a1ef0 0x5585d19a4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.479+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d1974770 0x5585d1977f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.479+0000 7fd930e4b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d18ddda0 con 0x5585d1974770 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.479+0000 7fd930e4b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d1886b80 con 0x5585d19a1ef0 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.479+0000 7fd930e4b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585d18d9e40 con 0x5585d19a1b10 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd927fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d1974770 0x5585d1977f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd927fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d1974770 0x5585d1977f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38336/0 (socket says 172.21.15.55:38336) 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd927fff640 1 -- 172.21.15.55:0/2219465732 learned_addr learned my addr 172.21.15.55:0/2219465732 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd9277fe640 1 --2- 172.21.15.55:0/2219465732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d19a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd926ffd640 1 --2- 172.21.15.55:0/2219465732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d19a1ef0 0x5585d19a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd927fff640 1 -- 172.21.15.55:0/2219465732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 msgr2=0x5585d19a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd927fff640 1 --2- 172.21.15.55:0/2219465732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d19a4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd927fff640 1 -- 172.21.15.55:0/2219465732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d19a1ef0 msgr2=0x5585d19a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd927fff640 1 --2- 172.21.15.55:0/2219465732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d19a1ef0 0x5585d19a4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd927fff640 1 -- 172.21.15.55:0/2219465732 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585d1890f10 con 0x5585d1974770 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd927fff640 1 --2- 172.21.15.55:0/2219465732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d1974770 0x5585d1977f80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd9200aa000 tx=0x7fd92007a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c089d552301b0a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:59.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd90d7fa640 1 -- 172.21.15.55:0/2219465732 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92007e460 con 0x5585d1974770 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd90d7fa640 1 -- 172.21.15.55:0/2219465732 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd920082a20 con 0x5585d1974770 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.480+0000 7fd90d7fa640 1 -- 172.21.15.55:0/2219465732 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920007840 con 0x5585d1974770 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.481+0000 7fd930e4b740 1 -- 172.21.15.55:0/2219465732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d1974770 msgr2=0x5585d1977f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.481+0000 7fd930e4b740 1 --2- 172.21.15.55:0/2219465732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d1974770 0x5585d1977f80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd9200aa000 tx=0x7fd92007a030 comp rx=0 tx=0).stop 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.481+0000 7fd930e4b740 1 -- 172.21.15.55:0/2219465732 shutdown_connections 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.481+0000 7fd930e4b740 1 --2- 172.21.15.55:0/2219465732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d1974770 0x5585d1977f80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.481+0000 7fd930e4b740 1 --2- 172.21.15.55:0/2219465732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d19a1ef0 0x5585d19a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.481+0000 7fd930e4b740 1 --2- 172.21.15.55:0/2219465732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d19a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.481+0000 7fd930e4b740 1 -- 172.21.15.55:0/2219465732 >> 172.21.15.55:0/2219465732 conn(0x5585d19769e0 msgr2=0x5585d19bf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.481+0000 7fd930e4b740 1 -- 172.21.15.55:0/2219465732 shutdown_connections 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.481+0000 7fd930e4b740 1 -- 172.21.15.55:0/2219465732 wait complete. 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.482+0000 7fd930e4b740 1 -- start start 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.482+0000 7fd930e4b740 1 Processor -- start 2024-04-25T08:55:59.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.482+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d199d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.482+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1ef0 0x5585d19c0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.482+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d199e260 0x5585d19c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.482+0000 7fd930e4b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d1979b90 con 0x5585d19a1ef0 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.482+0000 7fd930e4b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d187c4b0 con 0x5585d199e260 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.482+0000 7fd930e4b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585d1979e70 con 0x5585d19a1b10 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.482+0000 7fd930e4b740 10 client.0 _ll_register_callbacks cb 0x5585d18bc180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.482+0000 7fd926ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1ef0 0x5585d19c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd926ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1ef0 0x5585d19c0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38344/0 (socket says 172.21.15.55:38344) 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd926ffd640 1 -- 172.21.15.55:0/2383441909 learned_addr learned my addr 172.21.15.55:0/2383441909 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd9277fe640 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d199d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd927fff640 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d199e260 0x5585d19c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd926ffd640 1 -- 172.21.15.55:0/2383441909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 msgr2=0x5585d199d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd926ffd640 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d199d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd926ffd640 1 -- 172.21.15.55:0/2383441909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d199e260 msgr2=0x5585d19c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd926ffd640 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d199e260 0x5585d19c0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd926ffd640 1 -- 172.21.15.55:0/2383441909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585d16bc7d0 con 0x5585d19a1ef0 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd927fff640 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d199e260 0x5585d19c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd926ffd640 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1ef0 0x5585d19c0550 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0011e0 tx=0x7fd91c004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667ef20b968f8b34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd9067fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd9067fc640 1 -- 172.21.15.55:0/2383441909 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c001bb0 con 0x5585d19a1ef0 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd9067fc640 1 -- 172.21.15.55:0/2383441909 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd91c00c7c0 con 0x5585d19a1ef0 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd930e4b740 1 -- 172.21.15.55:0/2383441909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd920082a20 con 0x5585d19a1ef0 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd9067fc640 1 -- 172.21.15.55:0/2383441909 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd91c00c9e0 con 0x5585d19a1ef0 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd930e4b740 10 client.5832 fetch_fsmap learned FSMap version 22 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.483+0000 7fd930e4b740 1 -- 172.21.15.55:0/2383441909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5585d15f23f0 con 0x5585d19a1ef0 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.484+0000 7fd9067fc640 1 -- 172.21.15.55:0/2383441909 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd920082a20 con 0x5585d19a1ef0 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.484+0000 7fd9067fc640 1 -- 172.21.15.55:0/2383441909 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd91c00cb80 con 0x5585d19a1ef0 2024-04-25T08:55:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.484+0000 7fd930e4b740 10 client.5832 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.484+0000 7fd930e4b740 10 client.5832 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.484+0000 7fd930e4b740 20 client.5832 populate_metadata read hostname 'smithi055' 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.484+0000 7fd930e4b740 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5585d199b7a0 0x5585d19dc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.484+0000 7fd930e4b740 4 client.5832 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.484+0000 7fd930e4b740 1 -- 172.21.15.55:0/2383441909 --> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585d18eb2e0 con 0x5585d199b7a0 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.484+0000 7fd9277fe640 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5585d199b7a0 0x5585d19dc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.484+0000 7fd9277fe640 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5585d199b7a0 0x5585d19dc700 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c684d79f5cf772 server_cookie=991036bd8ab533d3 in_seq=0 out_seq=0 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.484+0000 7fd9067fc640 10 client.5832 ms_handle_connect on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd9067fc640 1 -- 172.21.15.55:0/2383441909 <== mds.0 v2:172.21.15.55:6836/2070394524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5585d18eb2e0 con 0x5585d199b7a0 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd9067fc640 10 client.5832 handle_command_reply: tid=0 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 1 client.5832 shutdown 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 1 -- 172.21.15.55:0/2383441909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1ef0 msgr2=0x5585d19c0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1ef0 0x5585d19c0550 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0011e0 tx=0x7fd91c004f60 comp rx=0 tx=0).stop 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 1 -- 172.21.15.55:0/2383441909 shutdown_connections 2024-04-25T08:55:59.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5585d199b7a0 0x5585d19dc700 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d199e260 0x5585d19c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1ef0 0x5585d19c0550 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd9067fc640 0 client.5832 ms_handle_reset on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:59.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 1 --2- 172.21.15.55:0/2383441909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d199d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 1 -- 172.21.15.55:0/2383441909 >> 172.21.15.55:0/2383441909 conn(0x5585d1974770 msgr2=0x5585d19a0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:59.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 1 -- 172.21.15.55:0/2383441909 shutdown_connections 2024-04-25T08:55:59.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 1 -- 172.21.15.55:0/2383441909 wait complete. 2024-04-25T08:55:59.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.485+0000 7fd930e4b740 20 client.5832 trim_cache size 0 max 16384 2024-04-25T08:55:59.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.500+0000 7fd930e4b740 1 Processor -- start 2024-04-25T08:55:59.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.500+0000 7fd930e4b740 1 -- start start 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.501+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d1974770 0x5585d1973cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.501+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d199e260 0x5585d19e0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.501+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d19e1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.501+0000 7fd930e4b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9281ffcd0 con 0x5585d199e260 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.501+0000 7fd930e4b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd928155530 con 0x5585d1974770 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.501+0000 7fd930e4b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9280cb8c0 con 0x5585d19a1b10 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.501+0000 7fd926ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d199e260 0x5585d19e0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.501+0000 7fd926ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d199e260 0x5585d19e0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38350/0 (socket says 172.21.15.55:38350) 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.501+0000 7fd926ffd640 1 -- 172.21.15.55:0/534745403 learned_addr learned my addr 172.21.15.55:0/534745403 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.502+0000 7fd927fff640 1 --2- 172.21.15.55:0/534745403 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d19e1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.502+0000 7fd9277fe640 1 --2- 172.21.15.55:0/534745403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d1974770 0x5585d1973cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.502+0000 7fd926ffd640 1 -- 172.21.15.55:0/534745403 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 msgr2=0x5585d19e1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.502+0000 7fd926ffd640 1 --2- 172.21.15.55:0/534745403 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d19e1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.502+0000 7fd926ffd640 1 -- 172.21.15.55:0/534745403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d1974770 msgr2=0x5585d1973cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:59.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.502+0000 7fd926ffd640 1 --2- 172.21.15.55:0/534745403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d1974770 0x5585d1973cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.502+0000 7fd926ffd640 1 -- 172.21.15.55:0/534745403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585d15b20f0 con 0x5585d199e260 2024-04-25T08:55:59.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.502+0000 7fd926ffd640 1 --2- 172.21.15.55:0/534745403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d199e260 0x5585d19e0ae0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd91c007780 tx=0x7fd91c00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7812490390a7a8eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:59.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.502+0000 7fd90cff9640 1 -- 172.21.15.55:0/534745403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c00cb80 con 0x5585d199e260 2024-04-25T08:55:59.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.502+0000 7fd90cff9640 1 -- 172.21.15.55:0/534745403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c019070 con 0x5585d199e260 2024-04-25T08:55:59.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.502+0000 7fd90cff9640 1 -- 172.21.15.55:0/534745403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c00c140 con 0x5585d199e260 2024-04-25T08:55:59.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.503+0000 7fd930e4b740 1 -- 172.21.15.55:0/534745403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d199e260 msgr2=0x5585d19e0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.503+0000 7fd930e4b740 1 --2- 172.21.15.55:0/534745403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d199e260 0x5585d19e0ae0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd91c007780 tx=0x7fd91c00e000 comp rx=0 tx=0).stop 2024-04-25T08:55:59.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.503+0000 7fd930e4b740 1 -- 172.21.15.55:0/534745403 shutdown_connections 2024-04-25T08:55:59.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.503+0000 7fd930e4b740 1 --2- 172.21.15.55:0/534745403 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d19a1b10 0x5585d19e1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.503+0000 7fd930e4b740 1 --2- 172.21.15.55:0/534745403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d199e260 0x5585d19e0ae0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.503+0000 7fd930e4b740 1 --2- 172.21.15.55:0/534745403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d1974770 0x5585d1973cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.503+0000 7fd930e4b740 1 -- 172.21.15.55:0/534745403 >> 172.21.15.55:0/534745403 conn(0x5585d199bef0 msgr2=0x5585d19c0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:59.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.503+0000 7fd930e4b740 1 -- 172.21.15.55:0/534745403 shutdown_connections 2024-04-25T08:55:59.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.503+0000 7fd930e4b740 1 -- 172.21.15.55:0/534745403 wait complete. 2024-04-25T08:55:59.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.503+0000 7fd930e4b740 1 -- start start 2024-04-25T08:55:59.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.503+0000 7fd930e4b740 1 Processor -- start 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d1974770 0x5585d19a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d199e260 0x5585d1a10610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd930e4b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1b10 0x5585d1a0fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd930e4b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d19c0180 con 0x5585d19a1b10 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd930e4b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd928154f30 con 0x5585d199e260 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd930e4b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585d19a5060 con 0x5585d1974770 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd930e4b740 10 client.0 _ll_register_callbacks cb 0x7fd920076660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd927fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1b10 0x5585d1a0fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd927fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1b10 0x5585d1a0fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38354/0 (socket says 172.21.15.55:38354) 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd927fff640 1 -- 172.21.15.55:0/450007570 learned_addr learned my addr 172.21.15.55:0/450007570 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd9277fe640 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d1974770 0x5585d19a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.504+0000 7fd926ffd640 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d199e260 0x5585d1a10610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd927fff640 1 -- 172.21.15.55:0/450007570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d1974770 msgr2=0x5585d19a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:59.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd927fff640 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d1974770 0x5585d19a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd927fff640 1 -- 172.21.15.55:0/450007570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d199e260 msgr2=0x5585d1a10610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd927fff640 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d199e260 0x5585d1a10610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd927fff640 1 -- 172.21.15.55:0/450007570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585d19790f0 con 0x5585d19a1b10 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd927fff640 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1b10 0x5585d1a0fd40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd92002a6e0 tx=0x7fd920047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad55630b4c6042d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd9067fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd9067fc640 1 -- 172.21.15.55:0/450007570 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9200786c0 con 0x5585d19a1b10 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd9067fc640 1 -- 172.21.15.55:0/450007570 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd92007e170 con 0x5585d19a1b10 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd930e4b740 1 -- 172.21.15.55:0/450007570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd91c019070 con 0x5585d19a1b10 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd9067fc640 1 -- 172.21.15.55:0/450007570 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd92007a620 con 0x5585d19a1b10 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd930e4b740 10 client.5838 fetch_fsmap learned FSMap version 22 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd930e4b740 1 -- 172.21.15.55:0/450007570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5585d1978e70 con 0x5585d19a1b10 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd9067fc640 1 -- 172.21.15.55:0/450007570 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c019070 con 0x5585d19a1b10 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd9067fc640 1 -- 172.21.15.55:0/450007570 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd920082590 con 0x5585d19a1b10 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd930e4b740 10 client.5838 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T08:55:59.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd930e4b740 10 client.5838 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd930e4b740 20 client.5838 populate_metadata read hostname 'smithi055' 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd930e4b740 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5585d19a1ef0 0x5585d19d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd930e4b740 4 client.5838 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.505+0000 7fd930e4b740 1 -- 172.21.15.55:0/450007570 --> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5585d18e5630 con 0x5585d19a1ef0 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd9277fe640 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5585d19a1ef0 0x5585d19d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd9277fe640 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5585d19a1ef0 0x5585d19d15e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad5679e15b605ead server_cookie=db26e2833f2a35cc in_seq=0 out_seq=0 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd9067fc640 10 client.5838 ms_handle_connect on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd9067fc640 1 -- 172.21.15.55:0/450007570 <== mds.0 v2:172.21.15.55:6836/2070394524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5585d18e5630 con 0x5585d19a1ef0 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd9067fc640 10 client.5838 handle_command_reply: tid=0 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 1 client.5838 shutdown 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 1 -- 172.21.15.55:0/450007570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1b10 msgr2=0x5585d1a0fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1b10 0x5585d1a0fd40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd92002a6e0 tx=0x7fd920047040 comp rx=0 tx=0).stop 2024-04-25T08:55:59.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 1 -- 172.21.15.55:0/450007570 shutdown_connections 2024-04-25T08:55:59.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.55:6836/2070394524,v1:172.21.15.55:6837/2070394524] conn(0x5585d19a1ef0 0x5585d19d15e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5585d19a1b10 0x5585d1a0fd40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585d199e260 0x5585d1a10610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 1 --2- 172.21.15.55:0/450007570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5585d1974770 0x5585d19a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 1 -- 172.21.15.55:0/450007570 >> 172.21.15.55:0/450007570 conn(0x5585d199bef0 msgr2=0x5585d19a1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:59.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd9067fc640 0 client.5838 ms_handle_reset on v2:172.21.15.55:6836/2070394524 2024-04-25T08:55:59.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 1 -- 172.21.15.55:0/450007570 shutdown_connections 2024-04-25T08:55:59.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 1 -- 172.21.15.55:0/450007570 wait complete. 2024-04-25T08:55:59.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.506+0000 7fd930e4b740 20 client.5838 trim_cache size 0 max 16384 2024-04-25T08:55:59.502 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:55:59.503 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-25T08:55:59.503 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-25T08:55:59.503 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:55:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 -- 172.21.15.55:0/16657279 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd91406b4d0 msgr2=0x7fd91406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd91406b4d0 0x7fd91406d990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd918006fd0 tx=0x7fd918009060 comp rx=0 tx=0).stop 2024-04-25T08:55:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 -- 172.21.15.55:0/16657279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd92815dca0 msgr2=0x7fd92815bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd92815dca0 0x7fd92815bb90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd920009eb0 tx=0x7fd920004a40 comp rx=0 tx=0).stop 2024-04-25T08:55:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 -- 172.21.15.55:0/16657279 shutdown_connections 2024-04-25T08:55:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd91406b4d0 0x7fd91406d990 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd92815dca0 0x7fd92815bb90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9280d3b90 0x7fd92815b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 --2- 172.21.15.55:0/16657279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9280d1130 0x7fd9281f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 -- 172.21.15.55:0/16657279 >> 172.21.15.55:0/16657279 conn(0x7fd9280726c0 msgr2=0x7fd9280b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:59.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 -- 172.21.15.55:0/16657279 shutdown_connections 2024-04-25T08:55:59.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.507+0000 7fd92e14f640 1 -- 172.21.15.55:0/16657279 wait complete. 2024-04-25T08:55:59.507 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:55:59.609 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:55:59.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.722+0000 7f05e07d5640 1 Processor -- start 2024-04-25T08:55:59.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.722+0000 7f05e07d5640 1 -- start start 2024-04-25T08:55:59.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05e07d5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f05d815dce0 0x7f05d80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05e07d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05d80b5b60 0x7f05d80b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05e07d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d815e0c0 con 0x7f05d80d35b0 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05e07d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d80d2510 con 0x7f05d80b5b60 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05e07d5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d80d27f0 con 0x7f05d815dce0 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05ded72640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05d80b5b60 0x7f05d80b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05ddd70640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f05d80d35b0 0x7f05d80b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44290/0 (socket says 172.21.15.55:44290) 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05ded72640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05d80b5b60 0x7f05d80b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38366/0 (socket says 172.21.15.55:38366) 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05ddd70640 1 -- 172.21.15.55:0/2177646712 learned_addr learned my addr 172.21.15.55:0/2177646712 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05de571640 1 --2- 172.21.15.55:0/2177646712 >> v2:172.21.15.167:3300/0 conn(0x7f05d815dce0 0x7f05d80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05ded72640 1 -- 172.21.15.55:0/2177646712 >> v2:172.21.15.167:3300/0 conn(0x7f05d815dce0 msgr2=0x7f05d80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05ded72640 1 --2- 172.21.15.55:0/2177646712 >> v2:172.21.15.167:3300/0 conn(0x7f05d815dce0 0x7f05d80d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05ded72640 1 -- 172.21.15.55:0/2177646712 >> v1:172.21.15.55:6789/0 conn(0x7f05d80d35b0 legacy=0x7f05d80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05ded72640 1 -- 172.21.15.55:0/2177646712 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d80d2ad0 con 0x7f05d80b5b60 2024-04-25T08:55:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.723+0000 7f05de571640 1 --2- 172.21.15.55:0/2177646712 >> v2:172.21.15.167:3300/0 conn(0x7f05d815dce0 0x7f05d80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.724+0000 7f05ded72640 1 --2- 172.21.15.55:0/2177646712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d80b5b60 0x7f05d80b6b00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f05d80ce220 tx=0x7f05d002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d34e24be13836 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.724+0000 7f05dd56f640 1 -- 172.21.15.55:0/2177646712 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0007740 con 0x7f05d80b5b60 2024-04-25T08:55:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.724+0000 7f05dd56f640 1 -- 172.21.15.55:0/2177646712 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d00078e0 con 0x7f05d80b5b60 2024-04-25T08:55:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.724+0000 7f05dd56f640 1 -- 172.21.15.55:0/2177646712 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0007cb0 con 0x7f05d80b5b60 2024-04-25T08:55:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.725+0000 7f05e07d5640 1 -- 172.21.15.55:0/2177646712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d80b5b60 msgr2=0x7f05d80b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.725+0000 7f05e07d5640 1 --2- 172.21.15.55:0/2177646712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d80b5b60 0x7f05d80b6b00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f05d80ce220 tx=0x7f05d002a680 comp rx=0 tx=0).stop 2024-04-25T08:55:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.725+0000 7f05e07d5640 1 -- 172.21.15.55:0/2177646712 shutdown_connections 2024-04-25T08:55:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.725+0000 7f05e07d5640 1 --2- 172.21.15.55:0/2177646712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d80b5b60 0x7f05d80b6b00 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.725+0000 7f05e07d5640 1 --2- 172.21.15.55:0/2177646712 >> v2:172.21.15.167:3300/0 conn(0x7f05d815dce0 0x7f05d80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.725+0000 7f05e07d5640 1 -- 172.21.15.55:0/2177646712 >> 172.21.15.55:0/2177646712 conn(0x7f05d8072900 msgr2=0x7f05d80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.725+0000 7f05e07d5640 1 -- 172.21.15.55:0/2177646712 shutdown_connections 2024-04-25T08:55:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.725+0000 7f05e07d5640 1 -- 172.21.15.55:0/2177646712 wait complete. 2024-04-25T08:55:59.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.726+0000 7f05e07d5640 1 Processor -- start 2024-04-25T08:55:59.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.726+0000 7f05e07d5640 1 -- start start 2024-04-25T08:55:59.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05e07d5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05d80b5b60 0x7f05d81539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05e07d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05d80d35b0 0x7f05d80c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05e07d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d815dce0 0x7f05d815ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05e07d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80b9820 con 0x7f05d815dce0 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05e07d5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80d3090 con 0x7f05d80b5b60 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05e07d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80b99a0 con 0x7f05d80d35b0 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ded72640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d815dce0 0x7f05d815ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ded72640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d815dce0 0x7f05d815ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38380/0 (socket says 172.21.15.55:38380) 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ded72640 1 -- 172.21.15.55:0/1602880124 learned_addr learned my addr 172.21.15.55:0/1602880124 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ded72640 1 -- 172.21.15.55:0/1602880124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05d80d35b0 msgr2=0x7f05d80c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05de571640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05d80b5b60 0x7f05d81539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ddd70640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05d80d35b0 0x7f05d80c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ded72640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05d80d35b0 0x7f05d80c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ded72640 1 -- 172.21.15.55:0/1602880124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05d80b5b60 msgr2=0x7f05d81539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ded72640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05d80b5b60 0x7f05d81539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ded72640 1 -- 172.21.15.55:0/1602880124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d8153f20 con 0x7f05d815dce0 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05de571640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05d80b5b60 0x7f05d81539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ddd70640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05d80d35b0 0x7f05d80c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ded72640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d815dce0 0x7f05d815ed60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f05d002ac70 tx=0x7f05d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ceffd640 1 -- 172.21.15.55:0/1602880124 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0040070 con 0x7f05d815dce0 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05ceffd640 1 -- 172.21.15.55:0/1602880124 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d0031c90 con 0x7f05d815dce0 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.727+0000 7f05e07d5640 1 -- 172.21.15.55:0/1602880124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d80c9030 con 0x7f05d815dce0 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.728+0000 7f05ceffd640 1 -- 172.21.15.55:0/1602880124 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0045680 con 0x7f05d815dce0 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.728+0000 7f05e07d5640 1 -- 172.21.15.55:0/1602880124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d80c98d0 con 0x7f05d815dce0 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.728+0000 7f05e07d5640 1 -- 172.21.15.55:0/1602880124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d80c9420 con 0x7f05d815dce0 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.729+0000 7f05ceffd640 1 -- 172.21.15.55:0/1602880124 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05d0039040 con 0x7f05d815dce0 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.729+0000 7f05ceffd640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05bc06b4d0 0x7f05bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.730+0000 7f05ceffd640 1 -- 172.21.15.55:0/1602880124 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f05d00abc20 con 0x7f05d815dce0 2024-04-25T08:55:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.730+0000 7f05de571640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05bc06b4d0 0x7f05bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:55:59.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.730+0000 7f05de571640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05bc06b4d0 0x7f05bc06d990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f05d4006fd0 tx=0x7f05d4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:55:59.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.734+0000 7f05ceffd640 1 -- 172.21.15.55:0/1602880124 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05d007ab20 con 0x7f05d815dce0 2024-04-25T08:55:59.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.951+0000 7f05e07d5640 1 -- 172.21.15.55:0/1602880124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05d8067490 con 0x7f05d815dce0 2024-04-25T08:55:59.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.952+0000 7f05ceffd640 1 -- 172.21.15.55:0/1602880124 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f05d8067490 con 0x7f05d815dce0 2024-04-25T08:55:59.941 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:55:59.941 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3267261156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3267261156},{"type":"v1","addr":"172.21.15.167:6834","nonce":3267261156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/588514159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":588514159},{"type":"v1","addr":"172.21.15.167:6835","nonce":588514159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2276997137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2276997137},{"type":"v1","addr":"172.21.15.55:6835","nonce":2276997137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:55:16.159284+0000","modified":"2024-04-25T08:55:19.200438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/2070394524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":2070394524},{"type":"v1","addr":"172.21.15.55:6837","nonce":2070394524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:55:59.942 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 22 2024-04-25T08:55:59.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.953+0000 7f05e07d5640 1 -- 172.21.15.55:0/1602880124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05bc06b4d0 msgr2=0x7f05bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.953+0000 7f05e07d5640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05bc06b4d0 0x7f05bc06d990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f05d4006fd0 tx=0x7f05d4008040 comp rx=0 tx=0).stop 2024-04-25T08:55:59.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.953+0000 7f05e07d5640 1 -- 172.21.15.55:0/1602880124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d815dce0 msgr2=0x7f05d815ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:55:59.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.953+0000 7f05e07d5640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d815dce0 0x7f05d815ed60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f05d002ac70 tx=0x7f05d0004a40 comp rx=0 tx=0).stop 2024-04-25T08:55:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.953+0000 7f05e07d5640 1 -- 172.21.15.55:0/1602880124 shutdown_connections 2024-04-25T08:55:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.953+0000 7f05e07d5640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05bc06b4d0 0x7f05bc06d990 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.953+0000 7f05e07d5640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d815dce0 0x7f05d815ed60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.953+0000 7f05e07d5640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05d80d35b0 0x7f05d80c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.953+0000 7f05e07d5640 1 --2- 172.21.15.55:0/1602880124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05d80b5b60 0x7f05d81539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:55:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.953+0000 7f05e07d5640 1 -- 172.21.15.55:0/1602880124 >> 172.21.15.55:0/1602880124 conn(0x7f05d8072900 msgr2=0x7f05d80d3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:55:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.954+0000 7f05e07d5640 1 -- 172.21.15.55:0/1602880124 shutdown_connections 2024-04-25T08:55:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:55:59.954+0000 7f05e07d5640 1 -- 172.21.15.55:0/1602880124 wait complete. 2024-04-25T08:55:59.954 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T08:56:00.077 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-25T08:56:00.077 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T08:56:00.077 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T08:56:00.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.130+0000 7f9e4ac80f40 1 Processor -- start 2024-04-25T08:56:00.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.130+0000 7f9e4ac80f40 1 -- start start 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e4ac80f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bf0e302880 0x55bf0e2d3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e4ac80f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e3a5b60 0x55bf0e2fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e4ac80f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bf0e3a85e0 0x55bf0e2fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e4ac80f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf0e31caa0 con 0x55bf0e3a5b60 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e4ac80f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf0e3031d0 con 0x55bf0e302880 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e4ac80f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf0e3a92f0 con 0x55bf0e3a85e0 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e3ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e3a5b60 0x55bf0e2fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e3ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e3a5b60 0x55bf0e2fd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38400/0 (socket says 172.21.15.55:38400) 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e3ffff640 1 -- 172.21.15.55:0/3847331290 learned_addr learned my addr 172.21.15.55:0/3847331290 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e48781640 1 --2- 172.21.15.55:0/3847331290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bf0e302880 0x55bf0e2d3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e48f82640 1 --2- 172.21.15.55:0/3847331290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bf0e3a85e0 0x55bf0e2fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e3ffff640 1 -- 172.21.15.55:0/3847331290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bf0e3a85e0 msgr2=0x55bf0e2fdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e3ffff640 1 --2- 172.21.15.55:0/3847331290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bf0e3a85e0 0x55bf0e2fdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e3ffff640 1 -- 172.21.15.55:0/3847331290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bf0e302880 msgr2=0x55bf0e2d3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e3ffff640 1 --2- 172.21.15.55:0/3847331290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bf0e302880 0x55bf0e2d3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.131+0000 7f9e3ffff640 1 -- 172.21.15.55:0/3847331290 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf0e213de0 con 0x55bf0e3a5b60 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e3ffff640 1 --2- 172.21.15.55:0/3847331290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e3a5b60 0x55bf0e2fd7b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000a7a0 tx=0x7f9e3000a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0637825433f61ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4777f640 1 -- 172.21.15.55:0/3847331290 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30019070 con 0x55bf0e3a5b60 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4777f640 1 -- 172.21.15.55:0/3847331290 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e30007600 con 0x55bf0e3a5b60 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4777f640 1 -- 172.21.15.55:0/3847331290 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e300079d0 con 0x55bf0e3a5b60 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3847331290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e3a5b60 msgr2=0x55bf0e2fd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4ac80f40 1 --2- 172.21.15.55:0/3847331290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e3a5b60 0x55bf0e2fd7b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000a7a0 tx=0x7f9e3000a890 comp rx=0 tx=0).stop 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3847331290 shutdown_connections 2024-04-25T08:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4ac80f40 1 --2- 172.21.15.55:0/3847331290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bf0e3a85e0 0x55bf0e2fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4ac80f40 1 --2- 172.21.15.55:0/3847331290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e3a5b60 0x55bf0e2fd7b0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4ac80f40 1 --2- 172.21.15.55:0/3847331290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bf0e302880 0x55bf0e2d3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3847331290 >> 172.21.15.55:0/3847331290 conn(0x55bf0e2fd3d0 msgr2=0x55bf0e319560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3847331290 shutdown_connections 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.132+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3847331290 wait complete. 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.133+0000 7f9e4ac80f40 1 Processor -- start 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.133+0000 7f9e4ac80f40 1 -- start start 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e4ac80f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e302880 0x55bf0e39d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e4ac80f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bf0e3a5b60 0x55bf0e39ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e4ac80f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bf0e3a85e0 0x55bf0e3a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e4ac80f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf0e3a7110 con 0x55bf0e302880 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e4ac80f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf0e2d4db0 con 0x55bf0e3a85e0 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e4ac80f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf0e39db90 con 0x55bf0e3a5b60 2024-04-25T08:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e48781640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e302880 0x55bf0e39d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e48781640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e302880 0x55bf0e39d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38404/0 (socket says 172.21.15.55:38404) 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e48781640 1 -- 172.21.15.55:0/3612594843 learned_addr learned my addr 172.21.15.55:0/3612594843 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e3ffff640 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bf0e3a5b60 0x55bf0e39ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e48f82640 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bf0e3a85e0 0x55bf0e3a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e48781640 1 -- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bf0e3a5b60 msgr2=0x55bf0e39ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e48781640 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bf0e3a5b60 0x55bf0e39ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e48781640 1 -- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bf0e3a85e0 msgr2=0x55bf0e3a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e48781640 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bf0e3a85e0 0x55bf0e3a9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e48781640 1 -- 172.21.15.55:0/3612594843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf0e1ffc50 con 0x55bf0e302880 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e48f82640 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bf0e3a85e0 0x55bf0e3a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e48781640 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e302880 0x55bf0e39d650 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009f90 tx=0x7f9e380084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:00.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e4677d640 1 -- 172.21.15.55:0/3612594843 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e380145f0 con 0x55bf0e302880 2024-04-25T08:56:00.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e4677d640 1 -- 172.21.15.55:0/3612594843 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e38019070 con 0x55bf0e302880 2024-04-25T08:56:00.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3612594843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bf0e3aa9e0 con 0x55bf0e302880 2024-04-25T08:56:00.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.134+0000 7f9e4677d640 1 -- 172.21.15.55:0/3612594843 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e380149d0 con 0x55bf0e302880 2024-04-25T08:56:00.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.135+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3612594843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf0e3aafa0 con 0x55bf0e302880 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.136+0000 7f9e4677d640 1 -- 172.21.15.55:0/3612594843 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9e38014b70 con 0x55bf0e302880 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.136+0000 7f9e4677d640 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9e28069eb0 0x7f9e2806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.136+0000 7f9e4677d640 1 -- 172.21.15.55:0/3612594843 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9e38088d30 con 0x55bf0e302880 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.136+0000 7f9e3ffff640 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9e28069eb0 0x7f9e2806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.136+0000 7f9e4ac80f40 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55bf0e3a46f0 0x55bf0e39fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.136+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3612594843 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v9 -- 0x55bf0e3a0020 con 0x55bf0e3a46f0 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.137+0000 7f9e3ffff640 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9e28069eb0 0x7f9e2806c370 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55bf0e2d1880 tx=0x7f9e3000c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.137+0000 7f9e48f82640 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55bf0e3a46f0 0x55bf0e39fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.137+0000 7f9e48f82640 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55bf0e3a46f0 0x55bf0e39fae0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e48f82640 1 -- 172.21.15.55:0/3612594843 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f9e40051860 con 0x55bf0e3a46f0 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55bf0e3a46f0 msgr2=0x55bf0e39fae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e4ac80f40 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55bf0e3a46f0 0x55bf0e39fae0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3612594843 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9e28069eb0 msgr2=0x7f9e2806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e4ac80f40 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9e28069eb0 0x7f9e2806c370 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55bf0e2d1880 tx=0x7f9e3000c000 comp rx=0 tx=0).stop 2024-04-25T08:56:00.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3612594843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e302880 msgr2=0x55bf0e39d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e4ac80f40 1 --2- 172.21.15.55:0/3612594843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf0e302880 0x55bf0e39d650 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009f90 tx=0x7f9e380084c0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e48f82640 1 -- 172.21.15.55:0/3612594843 reap_dead start 2024-04-25T08:56:00.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3612594843 shutdown_connections 2024-04-25T08:56:00.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3612594843 >> 172.21.15.55:0/3612594843 conn(0x55bf0e2fd3d0 msgr2=0x55bf0e319510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:00.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3612594843 shutdown_connections 2024-04-25T08:56:00.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.138+0000 7f9e4ac80f40 1 -- 172.21.15.55:0/3612594843 wait complete. 2024-04-25T08:56:00.133 INFO:teuthology.orchestra.run.smithi055.stdout:Yalphaparent_a 2024-04-25T08:56:00.133 DEBUG:teuthology.orchestra.run.smithi055:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T08:56:00.220 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:56:00.220 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-25T08:56:00.220 INFO:teuthology.orchestra.run.smithi055.stdout: "ancestors": [ 2024-04-25T08:56:00.220 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:00.220 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1099511627776, 2024-04-25T08:56:00.220 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "alpha", 2024-04-25T08:56:00.220 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 2 2024-04-25T08:56:00.220 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:00.220 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:00.221 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1, 2024-04-25T08:56:00.221 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "parent_a", 2024-04-25T08:56:00.221 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 4 2024-04-25T08:56:00.221 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:00.221 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-25T08:56:00.221 INFO:teuthology.orchestra.run.smithi055.stdout: "pool": 7, 2024-04-25T08:56:00.221 INFO:teuthology.orchestra.run.smithi055.stdout: "old_pools": [] 2024-04-25T08:56:00.221 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:56:00.221 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:00.222 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:56:00.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:56:00.304 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:56:00.352 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:56:00.352 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:56:00.352 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:56:00.368 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:56:00.368 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:56:00.424 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:00.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.574+0000 7f4e6e441640 1 Processor -- start 2024-04-25T08:56:00.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.574+0000 7f4e6e441640 1 -- start start 2024-04-25T08:56:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e6e441640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e680b5b60 0x7f4e681687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e6e441640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6815e0c0 con 0x7f4e680d35b0 2024-04-25T08:56:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e6e441640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e680d2510 con 0x7f4e6815dce0 2024-04-25T08:56:00.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e6e441640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680b7b10 con 0x7f4e680b5b60 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e677fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4e680d35b0 0x7f4e680b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44304/0 (socket says 172.21.15.55:44304) 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e677fe640 1 -- 172.21.15.55:0/458959502 learned_addr learned my addr 172.21.15.55:0/458959502 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925978128 0 0) 0x7f4e6815e0c0 con 0x7f4e680d35b0 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e6c9de640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e680b5b60 0x7f4e681687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e50003520 con 0x7f4e680d35b0 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 347496378 0 0) 0x7f4e50003520 con 0x7f4e680d35b0 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e680b5b60 msgr2=0x7f4e681687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e66ffd640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e680b5b60 0x7f4e681687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 >> v1:172.21.15.167:6789/0 conn(0x7f4e6815dce0 legacy=0x7f4e680d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e680d27f0 con 0x7f4e680d35b0 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f4e58001670 con 0x7f4e680d35b0 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 >> v1:172.21.15.55:6789/0 conn(0x7f4e680d35b0 legacy=0x7f4e680b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e66ffd640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e500039e0 0x7f4e50003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.575+0000 7f4e66ffd640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e680b5b60 0x7f4e50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e66ffd640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50004d40 0x7f4e500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680b7b10 con 0x7f4e500039e0 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5000ba70 con 0x7f4e50004d40 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e50014480 con 0x7f4e680b5b60 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e67fff640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e500039e0 0x7f4e50003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e677fe640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e680b5b60 0x7f4e50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e6c9de640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50004d40 0x7f4e500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e67fff640 1 -- 172.21.15.55:0/458959502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e680b5b60 msgr2=0x7f4e50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e67fff640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e680b5b60 0x7f4e50004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e67fff640 1 -- 172.21.15.55:0/458959502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50004d40 msgr2=0x7f4e500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e67fff640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50004d40 0x7f4e500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.576+0000 7f4e67fff640 1 -- 172.21.15.55:0/458959502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50003520 con 0x7f4e500039e0 2024-04-25T08:56:00.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.577+0000 7f4e67fff640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e500039e0 0x7f4e50003e00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c001720 tx=0x7f4e50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669e17048f7ba64e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.577+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c001370 con 0x7f4e500039e0 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.577+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c0052d0 con 0x7f4e500039e0 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.577+0000 7f4e66ffd640 1 -- 172.21.15.55:0/458959502 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c02abc0 con 0x7f4e500039e0 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.577+0000 7f4e6e441640 1 -- 172.21.15.55:0/458959502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e500039e0 msgr2=0x7f4e50003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.577+0000 7f4e6e441640 1 --2- 172.21.15.55:0/458959502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e500039e0 0x7f4e50003e00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c001720 tx=0x7f4e50005830 comp rx=0 tx=0).stop 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.577+0000 7f4e6c9de640 1 -- 172.21.15.55:0/458959502 reap_dead start 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.577+0000 7f4e6e441640 1 -- 172.21.15.55:0/458959502 shutdown_connections 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.577+0000 7f4e6e441640 1 -- 172.21.15.55:0/458959502 >> 172.21.15.55:0/458959502 conn(0x7f4e68072900 msgr2=0x7f4e680d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.577+0000 7f4e6e441640 1 -- 172.21.15.55:0/458959502 shutdown_connections 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.577+0000 7f4e6e441640 1 -- 172.21.15.55:0/458959502 wait complete. 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.578+0000 7f4e6e441640 1 Processor -- start 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.579+0000 7f4e6e441640 1 -- start start 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.579+0000 7f4e6e441640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e500039e0 0x7f4e68157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.579+0000 7f4e6e441640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e68160950 0x7f4e68158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.579+0000 7f4e6e441640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e6815a980 0x7f4e6815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.579+0000 7f4e6e441640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680d3090 con 0x7f4e6815a980 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.579+0000 7f4e6e441640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680d2db0 con 0x7f4e500039e0 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.579+0000 7f4e6e441640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680d2160 con 0x7f4e68160950 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.580+0000 7f4e6c9de640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e6815a980 0x7f4e6815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.580+0000 7f4e677fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e68160950 0x7f4e68158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.580+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e500039e0 0x7f4e68157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.580+0000 7f4e6c9de640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e6815a980 0x7f4e6815ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38416/0 (socket says 172.21.15.55:38416) 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.580+0000 7f4e6c9de640 1 -- 172.21.15.55:0/1872544223 learned_addr learned my addr 172.21.15.55:0/1872544223 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.580+0000 7f4e6c9de640 1 -- 172.21.15.55:0/1872544223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e68160950 msgr2=0x7f4e68158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.580+0000 7f4e6c9de640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e68160950 0x7f4e68158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.580+0000 7f4e6c9de640 1 -- 172.21.15.55:0/1872544223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e500039e0 msgr2=0x7f4e68157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.580+0000 7f4e6c9de640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e500039e0 0x7f4e68157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.580+0000 7f4e6c9de640 1 -- 172.21.15.55:0/1872544223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e68158e90 con 0x7f4e6815a980 2024-04-25T08:56:00.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.580+0000 7f4e6c9de640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e6815a980 0x7f4e6815ae30 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4e68161710 tx=0x7f4e600115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.581+0000 7f4e64ff9640 1 -- 172.21.15.55:0/1872544223 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60011de0 con 0x7f4e6815a980 2024-04-25T08:56:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.581+0000 7f4e64ff9640 1 -- 172.21.15.55:0/1872544223 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6001b070 con 0x7f4e6815a980 2024-04-25T08:56:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.581+0000 7f4e6e441640 1 -- 172.21.15.55:0/1872544223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e68159170 con 0x7f4e6815a980 2024-04-25T08:56:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.581+0000 7f4e64ff9640 1 -- 172.21.15.55:0/1872544223 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60003990 con 0x7f4e6815a980 2024-04-25T08:56:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.581+0000 7f4e6e441640 1 -- 172.21.15.55:0/1872544223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e68159730 con 0x7f4e6815a980 2024-04-25T08:56:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.582+0000 7f4e6e441640 1 -- 172.21.15.55:0/1872544223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e680749b0 con 0x7f4e6815a980 2024-04-25T08:56:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.582+0000 7f4e64ff9640 1 -- 172.21.15.55:0/1872544223 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4e60005d10 con 0x7f4e6815a980 2024-04-25T08:56:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.582+0000 7f4e64ff9640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e5406b500 0x7f4e5406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.583+0000 7f4e64ff9640 1 -- 172.21.15.55:0/1872544223 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4e6008a560 con 0x7f4e6815a980 2024-04-25T08:56:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.583+0000 7f4e67fff640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e5406b500 0x7f4e5406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.583+0000 7f4e67fff640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e5406b500 0x7f4e5406d9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c032000 tx=0x7f4e5c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:00.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.587+0000 7f4e64ff9640 1 -- 172.21.15.55:0/1872544223 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e60025020 con 0x7f4e6815a980 2024-04-25T08:56:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.767+0000 7f4e6e441640 1 -- 172.21.15.55:0/1872544223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e6815c100 con 0x7f4e6815a980 2024-04-25T08:56:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.768+0000 7f4e64ff9640 1 -- 172.21.15.55:0/1872544223 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16709 (secure 0 0 0) 0x7f4e60058d50 con 0x7f4e6815a980 2024-04-25T08:56:00.758 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:00.759 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:55:23.857114+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:55:14.449282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:55:15.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:00.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.770+0000 7f4e6e441640 1 -- 172.21.15.55:0/1872544223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e5406b500 msgr2=0x7f4e5406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.770+0000 7f4e6e441640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e5406b500 0x7f4e5406d9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c032000 tx=0x7f4e5c02e000 comp rx=0 tx=0).stop 2024-04-25T08:56:00.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.770+0000 7f4e6e441640 1 -- 172.21.15.55:0/1872544223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e6815a980 msgr2=0x7f4e6815ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.770+0000 7f4e6e441640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e6815a980 0x7f4e6815ae30 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4e68161710 tx=0x7f4e600115a0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.771+0000 7f4e6e441640 1 -- 172.21.15.55:0/1872544223 shutdown_connections 2024-04-25T08:56:00.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.771+0000 7f4e6e441640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e5406b500 0x7f4e5406d9c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.771+0000 7f4e6e441640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e6815a980 0x7f4e6815ae30 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.771+0000 7f4e6e441640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e68160950 0x7f4e68158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.771+0000 7f4e6e441640 1 --2- 172.21.15.55:0/1872544223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e500039e0 0x7f4e68157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.771+0000 7f4e6e441640 1 -- 172.21.15.55:0/1872544223 >> 172.21.15.55:0/1872544223 conn(0x7f4e68072900 msgr2=0x7f4e6806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:00.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.771+0000 7f4e6e441640 1 -- 172.21.15.55:0/1872544223 shutdown_connections 2024-04-25T08:56:00.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.771+0000 7f4e6e441640 1 -- 172.21.15.55:0/1872544223 wait complete. 2024-04-25T08:56:00.771 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:55:14.449282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:55:15.139740+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:56:00.772 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:56:00.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.886+0000 7f373949e640 1 Processor -- start 2024-04-25T08:56:00.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.886+0000 7f373949e640 1 -- start start 2024-04-25T08:56:00.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.887+0000 7f373949e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f373406b2b0 0x7f373415af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.887+0000 7f373949e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3734158930 con 0x7f3734158550 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.887+0000 7f373949e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373415bb60 con 0x7f373415b4c0 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.887+0000 7f373949e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37340ce7a0 con 0x7f373406b2b0 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.887+0000 7f3732ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3734158550 0x7f373406aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44310/0 (socket says 172.21.15.55:44310) 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.887+0000 7f3732ffd640 1 -- 172.21.15.55:0/2171255076 learned_addr learned my addr 172.21.15.55:0/2171255076 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.887+0000 7f37327fc640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f373406b2b0 0x7f373415af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.887+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577296205 0 0) 0x7f3734158930 con 0x7f3734158550 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.887+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3720005730 con 0x7f3734158550 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4217508497 0 0) 0x7f3720005730 con 0x7f3734158550 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f373406b2b0 msgr2=0x7f373415af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f373406b2b0 0x7f373415af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 >> v1:172.21.15.167:6789/0 conn(0x7f373415b4c0 legacy=0x7f37340b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37340b3b60 con 0x7f3734158550 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f372c001670 con 0x7f3734158550 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f37327fc640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f373406b2b0 0x7f373415af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 >> v1:172.21.15.55:6789/0 conn(0x7f3734158550 legacy=0x7f373406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3720005bf0 0x7f3720005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37200065a0 0x7f3720006a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f373406b2b0 0x7f3720007290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372000dbd0 con 0x7f37200065a0 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372000dd50 con 0x7f3720005bf0 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372000df00 con 0x7f373406b2b0 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f37327fc640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37200065a0 0x7f3720006a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f3732ffd640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3720005bf0 0x7f3720005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f37337fe640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f373406b2b0 0x7f3720007290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f37327fc640 1 -- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f373406b2b0 msgr2=0x7f3720007290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f37327fc640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f373406b2b0 0x7f3720007290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f37327fc640 1 -- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3720005bf0 msgr2=0x7f3720005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f37327fc640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3720005bf0 0x7f3720005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.888+0000 7f37327fc640 1 -- 172.21.15.55:0/2171255076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3720005730 con 0x7f37200065a0 2024-04-25T08:56:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.889+0000 7f37327fc640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37200065a0 0x7f3720006a70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f371c009c90 tx=0x7f3720007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1bb6726261c252 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.889+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c036070 con 0x7f37200065a0 2024-04-25T08:56:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.889+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c031400 con 0x7f37200065a0 2024-04-25T08:56:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.889+0000 7f3731ffb640 1 -- 172.21.15.55:0/2171255076 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c009860 con 0x7f37200065a0 2024-04-25T08:56:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.889+0000 7f373949e640 1 -- 172.21.15.55:0/2171255076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37200065a0 msgr2=0x7f3720006a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.889+0000 7f373949e640 1 --2- 172.21.15.55:0/2171255076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37200065a0 0x7f3720006a70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f371c009c90 tx=0x7f3720007a40 comp rx=0 tx=0).stop 2024-04-25T08:56:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.889+0000 7f37337fe640 1 -- 172.21.15.55:0/2171255076 reap_dead start 2024-04-25T08:56:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.889+0000 7f373949e640 1 -- 172.21.15.55:0/2171255076 shutdown_connections 2024-04-25T08:56:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.889+0000 7f373949e640 1 -- 172.21.15.55:0/2171255076 >> 172.21.15.55:0/2171255076 conn(0x7f37340cc5e0 msgr2=0x7f37340cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.890+0000 7f373949e640 1 -- 172.21.15.55:0/2171255076 shutdown_connections 2024-04-25T08:56:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.890+0000 7f373949e640 1 -- 172.21.15.55:0/2171255076 wait complete. 2024-04-25T08:56:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.891+0000 7f373949e640 1 Processor -- start 2024-04-25T08:56:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.891+0000 7f373949e640 1 -- start start 2024-04-25T08:56:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f373949e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37200065a0 0x7f373415d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f373949e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3734143830 0x7f3734151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f373949e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373415bff0 0x7f37341594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f373949e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37340b4120 con 0x7f373415bff0 2024-04-25T08:56:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f373949e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373415be40 con 0x7f37200065a0 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f373949e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373406d780 con 0x7f3734143830 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f37337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373415bff0 0x7f37341594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f37337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373415bff0 0x7f37341594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38436/0 (socket says 172.21.15.55:38436) 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f37337fe640 1 -- 172.21.15.55:0/1130060392 learned_addr learned my addr 172.21.15.55:0/1130060392 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f3732ffd640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37200065a0 0x7f373415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f37327fc640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3734143830 0x7f3734151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f37337fe640 1 -- 172.21.15.55:0/1130060392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3734143830 msgr2=0x7f3734151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f37337fe640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3734143830 0x7f3734151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f37337fe640 1 -- 172.21.15.55:0/1130060392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37200065a0 msgr2=0x7f373415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f37337fe640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37200065a0 0x7f373415d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f37337fe640 1 -- 172.21.15.55:0/1130060392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373415c7d0 con 0x7f373415bff0 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f3732ffd640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37200065a0 0x7f373415d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f37327fc640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3734143830 0x7f3734151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f37337fe640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373415bff0 0x7f37341594d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f373406bd20 tx=0x7f372400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f372b7fe640 1 -- 172.21.15.55:0/1130060392 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724019070 con 0x7f373415bff0 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f372b7fe640 1 -- 172.21.15.55:0/1130060392 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3724006d60 con 0x7f373415bff0 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f373949e640 1 -- 172.21.15.55:0/1130060392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373415cab0 con 0x7f373415bff0 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f372b7fe640 1 -- 172.21.15.55:0/1130060392 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724003b90 con 0x7f373415bff0 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.892+0000 7f373949e640 1 -- 172.21.15.55:0/1130060392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373415d070 con 0x7f373415bff0 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.894+0000 7f373949e640 1 -- 172.21.15.55:0/1130060392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37340750b0 con 0x7f373415bff0 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.894+0000 7f372b7fe640 1 -- 172.21.15.55:0/1130060392 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f372401c070 con 0x7f373415bff0 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.894+0000 7f372b7fe640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f371406b4d0 0x7f371406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.894+0000 7f372b7fe640 1 -- 172.21.15.55:0/1130060392 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3724089a80 con 0x7f373415bff0 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.894+0000 7f3732ffd640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f371406b4d0 0x7f371406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.895+0000 7f3732ffd640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f371406b4d0 0x7f371406d990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f37340cc2c0 tx=0x7f372c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:00.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:00.898+0000 7f372b7fe640 1 -- 172.21.15.55:0/1130060392 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f37240588c0 con 0x7f373415bff0 2024-04-25T08:56:01.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.083+0000 7f373949e640 1 -- 172.21.15.55:0/1130060392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3734158b30 con 0x7f373415bff0 2024-04-25T08:56:01.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.083+0000 7f372b7fe640 1 -- 172.21.15.55:0/1130060392 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37240581c0 con 0x7f373415bff0 2024-04-25T08:56:01.073 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:56:01.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 -- 172.21.15.55:0/1130060392 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f371406b4d0 msgr2=0x7f371406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f371406b4d0 0x7f371406d990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f37340cc2c0 tx=0x7f372c009040 comp rx=0 tx=0).stop 2024-04-25T08:56:01.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 -- 172.21.15.55:0/1130060392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373415bff0 msgr2=0x7f37341594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373415bff0 0x7f37341594d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f373406bd20 tx=0x7f372400ec80 comp rx=0 tx=0).stop 2024-04-25T08:56:01.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 -- 172.21.15.55:0/1130060392 shutdown_connections 2024-04-25T08:56:01.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f371406b4d0 0x7f371406d990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373415bff0 0x7f37341594d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3734143830 0x7f3734151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 --2- 172.21.15.55:0/1130060392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37200065a0 0x7f373415d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 -- 172.21.15.55:0/1130060392 >> 172.21.15.55:0/1130060392 conn(0x7f37340cc5e0 msgr2=0x7f373406ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:01.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 -- 172.21.15.55:0/1130060392 shutdown_connections 2024-04-25T08:56:01.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.085+0000 7f373949e640 1 -- 172.21.15.55:0/1130060392 wait complete. 2024-04-25T08:56:01.086 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:56:01.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.201+0000 7f64e7031640 1 Processor -- start 2024-04-25T08:56:01.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.201+0000 7f64e7031640 1 -- start start 2024-04-25T08:56:01.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e7031640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64e00b97c0 0x7f64e00b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e7031640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64e00b5a30 0x7f64e00d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e7031640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e01627a0 con 0x7f64e015dc80 2024-04-25T08:56:01.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e7031640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e00b5ea0 con 0x7f64e00b5a30 2024-04-25T08:56:01.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e7031640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e0161f80 con 0x7f64e00b97c0 2024-04-25T08:56:01.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e4dcd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f64e015dc80 0x7f64e0161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44312/0 (socket says 172.21.15.55:44312) 2024-04-25T08:56:01.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e4dcd640 1 -- 172.21.15.55:0/3386255067 learned_addr learned my addr 172.21.15.55:0/3386255067 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:01.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e55ce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64e00b5a30 0x7f64e00d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64dffff640 1 --2- 172.21.15.55:0/3386255067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64e00b97c0 0x7f64e00b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e55ce640 1 -- 172.21.15.55:0/3386255067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64e00b97c0 msgr2=0x7f64e00b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:01.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e55ce640 1 --2- 172.21.15.55:0/3386255067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64e00b97c0 0x7f64e00b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e55ce640 1 -- 172.21.15.55:0/3386255067 >> v1:172.21.15.55:6789/0 conn(0x7f64e015dc80 legacy=0x7f64e0161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.202+0000 7f64e55ce640 1 -- 172.21.15.55:0/3386255067 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e01621e0 con 0x7f64e00b5a30 2024-04-25T08:56:01.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.203+0000 7f64e55ce640 1 --2- 172.21.15.55:0/3386255067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e00b5a30 0x7f64e00d2470 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009dc0 tx=0x7f64d802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf93ce0c0332acc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.203+0000 7f64df7fe640 1 -- 172.21.15.55:0/3386255067 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d802ae60 con 0x7f64e00b5a30 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.203+0000 7f64df7fe640 1 -- 172.21.15.55:0/3386255067 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d8007740 con 0x7f64e00b5a30 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.203+0000 7f64df7fe640 1 -- 172.21.15.55:0/3386255067 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8007b10 con 0x7f64e00b5a30 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.204+0000 7f64e7031640 1 -- 172.21.15.55:0/3386255067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e00b5a30 msgr2=0x7f64e00d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.204+0000 7f64e7031640 1 --2- 172.21.15.55:0/3386255067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e00b5a30 0x7f64e00d2470 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009dc0 tx=0x7f64d802a680 comp rx=0 tx=0).stop 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.204+0000 7f64e7031640 1 -- 172.21.15.55:0/3386255067 shutdown_connections 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.204+0000 7f64e7031640 1 --2- 172.21.15.55:0/3386255067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64e00b97c0 0x7f64e00b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.204+0000 7f64e7031640 1 --2- 172.21.15.55:0/3386255067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e00b5a30 0x7f64e00d2470 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.204+0000 7f64e7031640 1 -- 172.21.15.55:0/3386255067 >> 172.21.15.55:0/3386255067 conn(0x7f64e00d04f0 msgr2=0x7f64e00d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.204+0000 7f64e7031640 1 -- 172.21.15.55:0/3386255067 shutdown_connections 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.204+0000 7f64e7031640 1 -- 172.21.15.55:0/3386255067 wait complete. 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.205+0000 7f64e7031640 1 Processor -- start 2024-04-25T08:56:01.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.205+0000 7f64e7031640 1 -- start start 2024-04-25T08:56:01.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.206+0000 7f64e7031640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64e00b5a30 0x7f64e01e8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.206+0000 7f64e7031640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e00b97c0 0x7f64e00c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.206+0000 7f64e7031640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64e015dc80 0x7f64e00c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.206+0000 7f64e7031640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e015e060 con 0x7f64e00b97c0 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.206+0000 7f64e7031640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00d1c70 con 0x7f64e00b5a30 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.206+0000 7f64e7031640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00d29b0 con 0x7f64e015dc80 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.206+0000 7f64dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e00b97c0 0x7f64e00c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.206+0000 7f64dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e00b97c0 0x7f64e00c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38462/0 (socket says 172.21.15.55:38462) 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.206+0000 7f64dffff640 1 -- 172.21.15.55:0/862143597 learned_addr learned my addr 172.21.15.55:0/862143597 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.206+0000 7f64e55ce640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64e015dc80 0x7f64e00c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.206+0000 7f64e4dcd640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64e00b5a30 0x7f64e01e8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64dffff640 1 -- 172.21.15.55:0/862143597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64e015dc80 msgr2=0x7f64e00c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64dffff640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64e015dc80 0x7f64e00c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64dffff640 1 -- 172.21.15.55:0/862143597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64e00b5a30 msgr2=0x7f64e01e8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64dffff640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64e00b5a30 0x7f64e01e8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64dffff640 1 -- 172.21.15.55:0/862143597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0159360 con 0x7f64e00b97c0 2024-04-25T08:56:01.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64e4dcd640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64e00b5a30 0x7f64e01e8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:01.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64dffff640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e00b97c0 0x7f64e00c9a40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f64d400d7d0 tx=0x7f64d400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:01.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64dd7fa640 1 -- 172.21.15.55:0/862143597 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400b6c0 con 0x7f64e00b97c0 2024-04-25T08:56:01.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64dd7fa640 1 -- 172.21.15.55:0/862143597 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d4019070 con 0x7f64e00b97c0 2024-04-25T08:56:01.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64dd7fa640 1 -- 172.21.15.55:0/862143597 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400ba80 con 0x7f64e00b97c0 2024-04-25T08:56:01.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64e7031640 1 -- 172.21.15.55:0/862143597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e01e76b0 con 0x7f64e00b97c0 2024-04-25T08:56:01.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.207+0000 7f64e7031640 1 -- 172.21.15.55:0/862143597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e01e7f50 con 0x7f64e00b97c0 2024-04-25T08:56:01.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.208+0000 7f64e7031640 1 -- 172.21.15.55:0/862143597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e00750b0 con 0x7f64e00b97c0 2024-04-25T08:56:01.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.208+0000 7f64dd7fa640 1 -- 172.21.15.55:0/862143597 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64d400bc20 con 0x7f64e00b97c0 2024-04-25T08:56:01.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.209+0000 7f64dd7fa640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64cc06b4d0 0x7f64cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.209+0000 7f64dd7fa640 1 -- 172.21.15.55:0/862143597 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f64d408a600 con 0x7f64e00b97c0 2024-04-25T08:56:01.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.209+0000 7f64e4dcd640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64cc06b4d0 0x7f64cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.209+0000 7f64e4dcd640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64cc06b4d0 0x7f64cc06d990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f64e015b870 tx=0x7f64d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:01.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.213+0000 7f64dd7fa640 1 -- 172.21.15.55:0/862143597 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f64d4059440 con 0x7f64e00b97c0 2024-04-25T08:56:01.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.393+0000 7f64e7031640 1 -- 172.21.15.55:0/862143597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64e00d1780 con 0x7f64e00b97c0 2024-04-25T08:56:01.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.393+0000 7f64dd7fa640 1 -- 172.21.15.55:0/862143597 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64d4058d40 con 0x7f64e00b97c0 2024-04-25T08:56:01.383 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:56:01.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 -- 172.21.15.55:0/862143597 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64cc06b4d0 msgr2=0x7f64cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64cc06b4d0 0x7f64cc06d990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f64e015b870 tx=0x7f64d0009040 comp rx=0 tx=0).stop 2024-04-25T08:56:01.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 -- 172.21.15.55:0/862143597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e00b97c0 msgr2=0x7f64e00c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e00b97c0 0x7f64e00c9a40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f64d400d7d0 tx=0x7f64d400dc90 comp rx=0 tx=0).stop 2024-04-25T08:56:01.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 -- 172.21.15.55:0/862143597 shutdown_connections 2024-04-25T08:56:01.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64cc06b4d0 0x7f64cc06d990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64e015dc80 0x7f64e00c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e00b97c0 0x7f64e00c9a40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 --2- 172.21.15.55:0/862143597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64e00b5a30 0x7f64e01e8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 -- 172.21.15.55:0/862143597 >> 172.21.15.55:0/862143597 conn(0x7f64e00d04f0 msgr2=0x7f64e006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:01.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 -- 172.21.15.55:0/862143597 shutdown_connections 2024-04-25T08:56:01.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.395+0000 7f64e7031640 1 -- 172.21.15.55:0/862143597 wait complete. 2024-04-25T08:56:01.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:56:01.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.510+0000 7fa0e535c640 1 Processor -- start 2024-04-25T08:56:01.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.510+0000 7fa0e535c640 1 -- start start 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0e535c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa0e00cfe70 0x7fa0e00ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0e535c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa0e015e110 0x7fa0e015e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0e535c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e015f000 con 0x7fa0e015b7b0 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0e535c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e00ced00 con 0x7fa0e00cfe70 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0e535c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e00ce330 con 0x7fa0e015e110 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0d67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa0e00cfe70 0x7fa0e00ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0d67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa0e00cfe70 0x7fa0e00ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38470/0 (socket says 172.21.15.55:38470) 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0d67fc640 1 -- 172.21.15.55:0/1018692535 learned_addr learned my addr 172.21.15.55:0/1018692535 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0d67fc640 1 -- 172.21.15.55:0/1018692535 >> v2:172.21.15.167:3300/0 conn(0x7fa0e015e110 msgr2=0x7fa0e015e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0d67fc640 1 --2- 172.21.15.55:0/1018692535 >> v2:172.21.15.167:3300/0 conn(0x7fa0e015e110 0x7fa0e015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0d67fc640 1 -- 172.21.15.55:0/1018692535 >> v1:172.21.15.167:6789/0 conn(0x7fa0e015b7b0 legacy=0x7fa0e00cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.511+0000 7fa0d67fc640 1 -- 172.21.15.55:0/1018692535 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e015ea60 con 0x7fa0e00cfe70 2024-04-25T08:56:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.512+0000 7fa0d67fc640 1 --2- 172.21.15.55:0/1018692535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00cfe70 0x7fa0e00ce7c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0161670 tx=0x7fa0c802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cce3aa85ba5663 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.512+0000 7fa0de7fc640 1 -- 172.21.15.55:0/1018692535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8037070 con 0x7fa0e00cfe70 2024-04-25T08:56:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.512+0000 7fa0de7fc640 1 -- 172.21.15.55:0/1018692535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c8032440 con 0x7fa0e00cfe70 2024-04-25T08:56:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.512+0000 7fa0de7fc640 1 -- 172.21.15.55:0/1018692535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8032810 con 0x7fa0e00cfe70 2024-04-25T08:56:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.513+0000 7fa0e535c640 1 -- 172.21.15.55:0/1018692535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00cfe70 msgr2=0x7fa0e00ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.513+0000 7fa0e535c640 1 --2- 172.21.15.55:0/1018692535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00cfe70 0x7fa0e00ce7c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0161670 tx=0x7fa0c802a230 comp rx=0 tx=0).stop 2024-04-25T08:56:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.513+0000 7fa0e535c640 1 -- 172.21.15.55:0/1018692535 shutdown_connections 2024-04-25T08:56:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.513+0000 7fa0e535c640 1 --2- 172.21.15.55:0/1018692535 >> v2:172.21.15.167:3300/0 conn(0x7fa0e015e110 0x7fa0e015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.513+0000 7fa0e535c640 1 --2- 172.21.15.55:0/1018692535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00cfe70 0x7fa0e00ce7c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.513+0000 7fa0e535c640 1 -- 172.21.15.55:0/1018692535 >> 172.21.15.55:0/1018692535 conn(0x7fa0e006f4a0 msgr2=0x7fa0e006f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.513+0000 7fa0e535c640 1 -- 172.21.15.55:0/1018692535 shutdown_connections 2024-04-25T08:56:01.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.513+0000 7fa0e535c640 1 -- 172.21.15.55:0/1018692535 wait complete. 2024-04-25T08:56:01.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.514+0000 7fa0e535c640 1 Processor -- start 2024-04-25T08:56:01.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.514+0000 7fa0e535c640 1 -- start start 2024-04-25T08:56:01.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0e535c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00cfe70 0x7fa0e0157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0e535c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0e015b7b0 0x7fa0e00b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0e535c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0e015e110 0x7fa0e015d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0e535c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00cdfc0 con 0x7fa0e00cfe70 2024-04-25T08:56:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0e535c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00cdce0 con 0x7fa0e015b7b0 2024-04-25T08:56:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0e535c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e01619f0 con 0x7fa0e015e110 2024-04-25T08:56:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0deffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00cfe70 0x7fa0e0157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0deffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00cfe70 0x7fa0e0157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38486/0 (socket says 172.21.15.55:38486) 2024-04-25T08:56:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0deffd640 1 -- 172.21.15.55:0/2895502786 learned_addr learned my addr 172.21.15.55:0/2895502786 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0d67fc640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0e015b7b0 0x7fa0e00b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0df7fe640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0e015e110 0x7fa0e015d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0deffd640 1 -- 172.21.15.55:0/2895502786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0e015e110 msgr2=0x7fa0e015d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0deffd640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0e015e110 0x7fa0e015d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0deffd640 1 -- 172.21.15.55:0/2895502786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0e015b7b0 msgr2=0x7fa0e00b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0deffd640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0e015b7b0 0x7fa0e00b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0deffd640 1 -- 172.21.15.55:0/2895502786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e00b59a0 con 0x7fa0e00cfe70 2024-04-25T08:56:01.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0df7fe640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0e015e110 0x7fa0e015d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:01.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0deffd640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00cfe70 0x7fa0e0157170 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c430 tx=0x7fa0d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:01.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.515+0000 7fa0d7fff640 1 -- 172.21.15.55:0/2895502786 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0011790 con 0x7fa0e00cfe70 2024-04-25T08:56:01.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.516+0000 7fa0d7fff640 1 -- 172.21.15.55:0/2895502786 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d0017070 con 0x7fa0e00cfe70 2024-04-25T08:56:01.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.516+0000 7fa0e535c640 1 -- 172.21.15.55:0/2895502786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e00b5c80 con 0x7fa0e00cfe70 2024-04-25T08:56:01.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.516+0000 7fa0d7fff640 1 -- 172.21.15.55:0/2895502786 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0011bb0 con 0x7fa0e00cfe70 2024-04-25T08:56:01.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.516+0000 7fa0e535c640 1 -- 172.21.15.55:0/2895502786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e00b6240 con 0x7fa0e00cfe70 2024-04-25T08:56:01.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.517+0000 7fa0e535c640 1 -- 172.21.15.55:0/2895502786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e00750b0 con 0x7fa0e00cfe70 2024-04-25T08:56:01.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.517+0000 7fa0d7fff640 1 -- 172.21.15.55:0/2895502786 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa0d001c460 con 0x7fa0e00cfe70 2024-04-25T08:56:01.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.517+0000 7fa0d7fff640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c006b4d0 0x7fa0c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.518+0000 7fa0d7fff640 1 -- 172.21.15.55:0/2895502786 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa0d008a0e0 con 0x7fa0e00cfe70 2024-04-25T08:56:01.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.518+0000 7fa0d67fc640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c006b4d0 0x7fa0c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.518+0000 7fa0d67fc640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c006b4d0 0x7fa0c006d990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8034000 tx=0x7fa0c802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:01.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.522+0000 7fa0d7fff640 1 -- 172.21.15.55:0/2895502786 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0d0058fb0 con 0x7fa0e00cfe70 2024-04-25T08:56:01.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.701+0000 7fa0e535c640 1 -- 172.21.15.55:0/2895502786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0e00b7870 con 0x7fa0e00cfe70 2024-04-25T08:56:01.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.702+0000 7fa0d7fff640 1 -- 172.21.15.55:0/2895502786 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0d00588b0 con 0x7fa0e00cfe70 2024-04-25T08:56:01.692 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 -- 172.21.15.55:0/2895502786 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c006b4d0 msgr2=0x7fa0c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c006b4d0 0x7fa0c006d990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8034000 tx=0x7fa0c802e000 comp rx=0 tx=0).stop 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 -- 172.21.15.55:0/2895502786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00cfe70 msgr2=0x7fa0e0157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00cfe70 0x7fa0e0157170 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c430 tx=0x7fa0d000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 -- 172.21.15.55:0/2895502786 shutdown_connections 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c006b4d0 0x7fa0c006d990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0e015e110 0x7fa0e015d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0e015b7b0 0x7fa0e00b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 --2- 172.21.15.55:0/2895502786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00cfe70 0x7fa0e0157170 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 -- 172.21.15.55:0/2895502786 >> 172.21.15.55:0/2895502786 conn(0x7fa0e006f4a0 msgr2=0x7fa0e006ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 -- 172.21.15.55:0/2895502786 shutdown_connections 2024-04-25T08:56:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.704+0000 7fa0e535c640 1 -- 172.21.15.55:0/2895502786 wait complete. 2024-04-25T08:56:01.704 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:56:01.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.816+0000 7fae6e5b0640 1 Processor -- start 2024-04-25T08:56:01.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.816+0000 7fae6e5b0640 1 -- start start 2024-04-25T08:56:01.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.817+0000 7fae6e5b0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fae68071590 0x7fae680cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.817+0000 7fae6e5b0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6806c220 con 0x7fae680cd940 2024-04-25T08:56:01.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.817+0000 7fae6e5b0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae680cec10 con 0x7fae6815dc50 2024-04-25T08:56:01.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.817+0000 7fae6e5b0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae680cfe00 con 0x7fae68071590 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.817+0000 7fae6cb4d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fae680cd940 0x7fae680ccb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44326/0 (socket says 172.21.15.55:44326) 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.817+0000 7fae6cb4d640 1 -- 172.21.15.55:0/517736491 learned_addr learned my addr 172.21.15.55:0/517736491 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.817+0000 7fae677fe640 1 --2- 172.21.15.55:0/517736491 >> v2:172.21.15.167:3300/0 conn(0x7fae68071590 0x7fae680cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.817+0000 7fae66ffd640 1 -- 172.21.15.55:0/517736491 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573715701 0 0) 0x7fae6806c220 con 0x7fae680cd940 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.818+0000 7fae66ffd640 1 -- 172.21.15.55:0/517736491 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae54003520 con 0x7fae680cd940 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.818+0000 7fae66ffd640 1 -- 172.21.15.55:0/517736491 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177119624 0 0) 0x7fae680cec10 con 0x7fae6815dc50 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.818+0000 7fae66ffd640 1 -- 172.21.15.55:0/517736491 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae6806c220 con 0x7fae6815dc50 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.818+0000 7fae677fe640 1 -- 172.21.15.55:0/517736491 >> v1:172.21.15.167:6789/0 conn(0x7fae6815dc50 legacy=0x7fae68070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.818+0000 7fae677fe640 1 -- 172.21.15.55:0/517736491 >> v1:172.21.15.55:6789/0 conn(0x7fae680cd940 legacy=0x7fae680ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.818+0000 7fae677fe640 1 -- 172.21.15.55:0/517736491 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680d0050 con 0x7fae68071590 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.819+0000 7fae677fe640 1 --2- 172.21.15.55:0/517736491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae68071590 0x7fae680cc610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae500097a0 tx=0x7fae5002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c66a8e09e1a0df4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.819+0000 7fae66ffd640 1 -- 172.21.15.55:0/517736491 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50037070 con 0x7fae68071590 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.819+0000 7fae66ffd640 1 -- 172.21.15.55:0/517736491 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae50032440 con 0x7fae68071590 2024-04-25T08:56:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.819+0000 7fae66ffd640 1 -- 172.21.15.55:0/517736491 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50032810 con 0x7fae68071590 2024-04-25T08:56:01.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.819+0000 7fae6e5b0640 1 -- 172.21.15.55:0/517736491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae68071590 msgr2=0x7fae680cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.819+0000 7fae6e5b0640 1 --2- 172.21.15.55:0/517736491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae68071590 0x7fae680cc610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae500097a0 tx=0x7fae5002a230 comp rx=0 tx=0).stop 2024-04-25T08:56:01.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.819+0000 7fae6e5b0640 1 -- 172.21.15.55:0/517736491 shutdown_connections 2024-04-25T08:56:01.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.819+0000 7fae6e5b0640 1 --2- 172.21.15.55:0/517736491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae68071590 0x7fae680cc610 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.819+0000 7fae6e5b0640 1 -- 172.21.15.55:0/517736491 >> 172.21.15.55:0/517736491 conn(0x7fae6806f430 msgr2=0x7fae6806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.819+0000 7fae6e5b0640 1 -- 172.21.15.55:0/517736491 shutdown_connections 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.819+0000 7fae6e5b0640 1 -- 172.21.15.55:0/517736491 wait complete. 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.820+0000 7fae6e5b0640 1 Processor -- start 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.821+0000 7fae6e5b0640 1 -- start start 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.821+0000 7fae6e5b0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae68071590 0x7fae6815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.821+0000 7fae6e5b0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae680cd940 0x7fae6815a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.821+0000 7fae6e5b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6815dc50 0x7fae680c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.821+0000 7fae6e5b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae680ce8a0 con 0x7fae6815dc50 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.821+0000 7fae6e5b0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae680cc0c0 con 0x7fae680cd940 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.821+0000 7fae6e5b0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6815e030 con 0x7fae68071590 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.821+0000 7fae6cb4d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6815dc50 0x7fae680c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae6cb4d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6815dc50 0x7fae680c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38490/0 (socket says 172.21.15.55:38490) 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae6cb4d640 1 -- 172.21.15.55:0/1107471088 learned_addr learned my addr 172.21.15.55:0/1107471088 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae677fe640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae680cd940 0x7fae6815a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae67fff640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae68071590 0x7fae6815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae6cb4d640 1 -- 172.21.15.55:0/1107471088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae68071590 msgr2=0x7fae6815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae6cb4d640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae68071590 0x7fae6815fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae6cb4d640 1 -- 172.21.15.55:0/1107471088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae680cd940 msgr2=0x7fae6815a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae6cb4d640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae680cd940 0x7fae6815a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae6cb4d640 1 -- 172.21.15.55:0/1107471088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae68160670 con 0x7fae6815dc50 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae677fe640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae680cd940 0x7fae6815a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae6cb4d640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6815dc50 0x7fae680c5350 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fae6000cbf0 tx=0x7fae6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae64ff9640 1 -- 172.21.15.55:0/1107471088 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60017070 con 0x7fae6815dc50 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae64ff9640 1 -- 172.21.15.55:0/1107471088 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6000acf0 con 0x7fae6815dc50 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae6e5b0640 1 -- 172.21.15.55:0/1107471088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae68160950 con 0x7fae6815dc50 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae64ff9640 1 -- 172.21.15.55:0/1107471088 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60012600 con 0x7fae6815dc50 2024-04-25T08:56:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.822+0000 7fae6e5b0640 1 -- 172.21.15.55:0/1107471088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6815e780 con 0x7fae6815dc50 2024-04-25T08:56:01.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.823+0000 7fae6e5b0640 1 -- 172.21.15.55:0/1107471088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae680750b0 con 0x7fae6815dc50 2024-04-25T08:56:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.824+0000 7fae64ff9640 1 -- 172.21.15.55:0/1107471088 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae6001a070 con 0x7fae6815dc50 2024-04-25T08:56:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.824+0000 7fae64ff9640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4806b4d0 0x7fae4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.824+0000 7fae64ff9640 1 -- 172.21.15.55:0/1107471088 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fae60089fa0 con 0x7fae6815dc50 2024-04-25T08:56:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.824+0000 7fae67fff640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4806b4d0 0x7fae4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.825+0000 7fae67fff640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4806b4d0 0x7fae4806d990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fae58007fd0 tx=0x7fae58009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:01.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:01.828+0000 7fae64ff9640 1 -- 172.21.15.55:0/1107471088 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae600587a0 con 0x7fae6815dc50 2024-04-25T08:56:02.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.020+0000 7fae6e5b0640 1 -- 172.21.15.55:0/1107471088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fae6806d700 con 0x7fae6815dc50 2024-04-25T08:56:02.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.020+0000 7fae64ff9640 1 -- 172.21.15.55:0/1107471088 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7fae6005c840 con 0x7fae6815dc50 2024-04-25T08:56:02.010 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T08:56:02.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 -- 172.21.15.55:0/1107471088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4806b4d0 msgr2=0x7fae4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4806b4d0 0x7fae4806d990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fae58007fd0 tx=0x7fae58009040 comp rx=0 tx=0).stop 2024-04-25T08:56:02.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 -- 172.21.15.55:0/1107471088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6815dc50 msgr2=0x7fae680c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6815dc50 0x7fae680c5350 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fae6000cbf0 tx=0x7fae6000a430 comp rx=0 tx=0).stop 2024-04-25T08:56:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 -- 172.21.15.55:0/1107471088 shutdown_connections 2024-04-25T08:56:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae4806b4d0 0x7fae4806d990 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6815dc50 0x7fae680c5350 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae680cd940 0x7fae6815a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 --2- 172.21.15.55:0/1107471088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae68071590 0x7fae6815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 -- 172.21.15.55:0/1107471088 >> 172.21.15.55:0/1107471088 conn(0x7fae6806f430 msgr2=0x7fae68161660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 -- 172.21.15.55:0/1107471088 shutdown_connections 2024-04-25T08:56:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.022+0000 7fae6e5b0640 1 -- 172.21.15.55:0/1107471088 wait complete. 2024-04-25T08:56:02.022 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:56:02.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:02.023 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:56:02.060 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:56:02.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:02.060 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:56:02.119 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:56:02.119 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:56:02.136 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:56:02.136 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:56:02.136 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:56:02.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:56:02.175 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:56:02.176 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:56:02.194 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:56:02.194 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:02.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.327+0000 7f30230dd640 1 Processor -- start 2024-04-25T08:56:02.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.327+0000 7f30230dd640 1 -- start start 2024-04-25T08:56:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.328+0000 7f30230dd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f301c0b5b60 0x7f301c1687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.328+0000 7f30230dd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301c15e0c0 con 0x7f301c0d35b0 2024-04-25T08:56:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.328+0000 7f30230dd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301c0d2510 con 0x7f301c15dce0 2024-04-25T08:56:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.328+0000 7f30230dd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301c0b7b10 con 0x7f301c0b5b60 2024-04-25T08:56:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.328+0000 7f302167a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f301c0b5b60 0x7f301c1687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.328+0000 7f301bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f301c0d35b0 0x7f301c0b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44330/0 (socket says 172.21.15.55:44330) 2024-04-25T08:56:02.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.328+0000 7f301bfff640 1 -- 172.21.15.55:0/2107043325 learned_addr learned my addr 172.21.15.55:0/2107043325 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:02.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.328+0000 7f302167a640 1 -- 172.21.15.55:0/2107043325 >> v1:172.21.15.167:6789/0 conn(0x7f301c15dce0 legacy=0x7f301c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:02.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.328+0000 7f302167a640 1 -- 172.21.15.55:0/2107043325 >> v1:172.21.15.55:6789/0 conn(0x7f301c0d35b0 legacy=0x7f301c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.328+0000 7f302167a640 1 -- 172.21.15.55:0/2107043325 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c0d27f0 con 0x7f301c0b5b60 2024-04-25T08:56:02.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.329+0000 7f302167a640 1 --2- 172.21.15.55:0/2107043325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f301c0b5b60 0x7f301c1687f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3014009d90 tx=0x7f301402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0ef950dbebe531 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:02.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.329+0000 7f301b7fe640 1 -- 172.21.15.55:0/2107043325 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014007740 con 0x7f301c0b5b60 2024-04-25T08:56:02.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.329+0000 7f301b7fe640 1 -- 172.21.15.55:0/2107043325 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30140078e0 con 0x7f301c0b5b60 2024-04-25T08:56:02.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.329+0000 7f301b7fe640 1 -- 172.21.15.55:0/2107043325 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014007cb0 con 0x7f301c0b5b60 2024-04-25T08:56:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.330+0000 7f30230dd640 1 -- 172.21.15.55:0/2107043325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f301c0b5b60 msgr2=0x7f301c1687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.330+0000 7f30230dd640 1 --2- 172.21.15.55:0/2107043325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f301c0b5b60 0x7f301c1687f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3014009d90 tx=0x7f301402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.330+0000 7f30230dd640 1 -- 172.21.15.55:0/2107043325 shutdown_connections 2024-04-25T08:56:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.330+0000 7f30230dd640 1 --2- 172.21.15.55:0/2107043325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f301c0b5b60 0x7f301c1687f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.330+0000 7f30230dd640 1 -- 172.21.15.55:0/2107043325 >> 172.21.15.55:0/2107043325 conn(0x7f301c072900 msgr2=0x7f301c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.330+0000 7f30230dd640 1 -- 172.21.15.55:0/2107043325 shutdown_connections 2024-04-25T08:56:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.330+0000 7f30230dd640 1 -- 172.21.15.55:0/2107043325 wait complete. 2024-04-25T08:56:02.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.331+0000 7f30230dd640 1 Processor -- start 2024-04-25T08:56:02.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.331+0000 7f30230dd640 1 -- start start 2024-04-25T08:56:02.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f30230dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f301c0b5b60 0x7f301c15e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f30230dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f301c0d35b0 0x7f301c1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f30230dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f301c15dce0 0x7f301c1604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f30230dd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c0d3090 con 0x7f301c15dce0 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f30230dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c0d2db0 con 0x7f301c0b5b60 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f30230dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301c0d2160 con 0x7f301c0d35b0 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f302167a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f301c15dce0 0x7f301c1604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f302167a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f301c15dce0 0x7f301c1604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38500/0 (socket says 172.21.15.55:38500) 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f302167a640 1 -- 172.21.15.55:0/4196845473 learned_addr learned my addr 172.21.15.55:0/4196845473 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f301bfff640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f301c0d35b0 0x7f301c1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f3020e79640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f301c0b5b60 0x7f301c15e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f302167a640 1 -- 172.21.15.55:0/4196845473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f301c0d35b0 msgr2=0x7f301c1525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f302167a640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f301c0d35b0 0x7f301c1525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f302167a640 1 -- 172.21.15.55:0/4196845473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f301c0b5b60 msgr2=0x7f301c15e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.332+0000 7f302167a640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f301c0b5b60 0x7f301c15e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.333+0000 7f302167a640 1 -- 172.21.15.55:0/4196845473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c0cb610 con 0x7f301c15dce0 2024-04-25T08:56:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.333+0000 7f302167a640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f301c15dce0 0x7f301c1604b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3014009eb0 tx=0x7f3014004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.333+0000 7f30197fa640 1 -- 172.21.15.55:0/4196845473 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014040070 con 0x7f301c15dce0 2024-04-25T08:56:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.333+0000 7f30197fa640 1 -- 172.21.15.55:0/4196845473 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3014031c90 con 0x7f301c15dce0 2024-04-25T08:56:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.333+0000 7f30197fa640 1 -- 172.21.15.55:0/4196845473 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301403c640 con 0x7f301c15dce0 2024-04-25T08:56:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.333+0000 7f30230dd640 1 -- 172.21.15.55:0/4196845473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301c15e920 con 0x7f301c15dce0 2024-04-25T08:56:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.333+0000 7f30230dd640 1 -- 172.21.15.55:0/4196845473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301c0cb880 con 0x7f301c15dce0 2024-04-25T08:56:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.334+0000 7f30230dd640 1 -- 172.21.15.55:0/4196845473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301c0749b0 con 0x7f301c15dce0 2024-04-25T08:56:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.334+0000 7f30197fa640 1 -- 172.21.15.55:0/4196845473 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3014039040 con 0x7f301c15dce0 2024-04-25T08:56:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.335+0000 7f30197fa640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b4d0 0x7f300806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.335+0000 7f30197fa640 1 -- 172.21.15.55:0/4196845473 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f30140ab720 con 0x7f301c15dce0 2024-04-25T08:56:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.335+0000 7f3020e79640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b4d0 0x7f300806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.335+0000 7f3020e79640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b4d0 0x7f300806d990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f300c006fd0 tx=0x7f300c009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:02.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.339+0000 7f30197fa640 1 -- 172.21.15.55:0/4196845473 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3014079fd0 con 0x7f301c15dce0 2024-04-25T08:56:02.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.557+0000 7f30230dd640 1 -- 172.21.15.55:0/4196845473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f301c0cba50 con 0x7f301c15dce0 2024-04-25T08:56:02.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.558+0000 7f30197fa640 1 -- 172.21.15.55:0/4196845473 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f301407e070 con 0x7f301c15dce0 2024-04-25T08:56:02.548 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:02.548 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3267261156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3267261156},{"type":"v1","addr":"172.21.15.167:6834","nonce":3267261156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/588514159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":588514159},{"type":"v1","addr":"172.21.15.167:6835","nonce":588514159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2276997137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2276997137},{"type":"v1","addr":"172.21.15.55:6835","nonce":2276997137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:55:16.159284+0000","modified":"2024-04-25T08:55:19.200438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/2070394524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":2070394524},{"type":"v1","addr":"172.21.15.55:6837","nonce":2070394524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:56:02.548 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 22 2024-04-25T08:56:02.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 -- 172.21.15.55:0/4196845473 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b4d0 msgr2=0x7f300806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b4d0 0x7f300806d990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f300c006fd0 tx=0x7f300c009060 comp rx=0 tx=0).stop 2024-04-25T08:56:02.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 -- 172.21.15.55:0/4196845473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f301c15dce0 msgr2=0x7f301c1604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f301c15dce0 0x7f301c1604b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3014009eb0 tx=0x7f3014004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:02.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 -- 172.21.15.55:0/4196845473 shutdown_connections 2024-04-25T08:56:02.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f300806b4d0 0x7f300806d990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f301c15dce0 0x7f301c1604b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f301c0d35b0 0x7f301c1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 --2- 172.21.15.55:0/4196845473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f301c0b5b60 0x7f301c15e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 -- 172.21.15.55:0/4196845473 >> 172.21.15.55:0/4196845473 conn(0x7f301c072900 msgr2=0x7f301c0b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:02.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 -- 172.21.15.55:0/4196845473 shutdown_connections 2024-04-25T08:56:02.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.560+0000 7f30230dd640 1 -- 172.21.15.55:0/4196845473 wait complete. 2024-04-25T08:56:02.561 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.673+0000 7f2e4d75c640 1 Processor -- start 2024-04-25T08:56:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.673+0000 7f2e4d75c640 1 -- start start 2024-04-25T08:56:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.673+0000 7f2e4d75c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e4815ba10 0x7f2e48099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.673+0000 7f2e4d75c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e48099f80 0x7f2e4806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.673+0000 7f2e4d75c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4809a3a0 con 0x7f2e4806c1f0 2024-04-25T08:56:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.673+0000 7f2e4d75c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e480cbe50 con 0x7f2e48099f80 2024-04-25T08:56:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.673+0000 7f2e4d75c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480cfe80 con 0x7f2e4815ba10 2024-04-25T08:56:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.674+0000 7f2e467fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e48099f80 0x7f2e4806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.674+0000 7f2e467fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e48099f80 0x7f2e4806bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38510/0 (socket says 172.21.15.55:38510) 2024-04-25T08:56:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.674+0000 7f2e467fc640 1 -- 172.21.15.55:0/1424823001 learned_addr learned my addr 172.21.15.55:0/1424823001 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.674+0000 7f2e46ffd640 1 --2- 172.21.15.55:0/1424823001 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e4815ba10 0x7f2e48099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.674+0000 7f2e467fc640 1 -- 172.21.15.55:0/1424823001 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e4815ba10 msgr2=0x7f2e48099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.674+0000 7f2e467fc640 1 --2- 172.21.15.55:0/1424823001 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e4815ba10 0x7f2e48099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.674+0000 7f2e467fc640 1 -- 172.21.15.55:0/1424823001 >> v1:172.21.15.167:6789/0 conn(0x7f2e4806c1f0 legacy=0x7f2e480cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.674+0000 7f2e467fc640 1 -- 172.21.15.55:0/1424823001 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4806c680 con 0x7f2e48099f80 2024-04-25T08:56:02.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e467fc640 1 --2- 172.21.15.55:0/1424823001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e48099f80 0x7f2e4806bcb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009870 tx=0x7f2e3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a096094f33f912 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e45ffb640 1 -- 172.21.15.55:0/1424823001 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c037070 con 0x7f2e48099f80 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e45ffb640 1 -- 172.21.15.55:0/1424823001 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c032440 con 0x7f2e48099f80 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e45ffb640 1 -- 172.21.15.55:0/1424823001 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c032810 con 0x7f2e48099f80 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e4d75c640 1 -- 172.21.15.55:0/1424823001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e48099f80 msgr2=0x7f2e4806bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e4d75c640 1 --2- 172.21.15.55:0/1424823001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e48099f80 0x7f2e4806bcb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009870 tx=0x7f2e3c02a270 comp rx=0 tx=0).stop 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e4d75c640 1 -- 172.21.15.55:0/1424823001 shutdown_connections 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e4d75c640 1 --2- 172.21.15.55:0/1424823001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e48099f80 0x7f2e4806bcb0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e4d75c640 1 --2- 172.21.15.55:0/1424823001 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e4815ba10 0x7f2e48099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e4d75c640 1 -- 172.21.15.55:0/1424823001 >> 172.21.15.55:0/1424823001 conn(0x7f2e480b32f0 msgr2=0x7f2e480b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e4d75c640 1 -- 172.21.15.55:0/1424823001 shutdown_connections 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.675+0000 7f2e4d75c640 1 -- 172.21.15.55:0/1424823001 wait complete. 2024-04-25T08:56:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.677+0000 7f2e4d75c640 1 Processor -- start 2024-04-25T08:56:02.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.677+0000 7f2e4d75c640 1 -- start start 2024-04-25T08:56:02.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.677+0000 7f2e4d75c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4806c1f0 0x7f2e48157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.677+0000 7f2e4d75c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e48099f80 0x7f2e480b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.677+0000 7f2e4d75c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e4815ba10 0x7f2e480b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e4d75c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4806cec0 con 0x7f2e4806c1f0 2024-04-25T08:56:02.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e4d75c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4806cbe0 con 0x7f2e48099f80 2024-04-25T08:56:02.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e4d75c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480cd930 con 0x7f2e4815ba10 2024-04-25T08:56:02.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4806c1f0 0x7f2e48157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4806c1f0 0x7f2e48157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38520/0 (socket says 172.21.15.55:38520) 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e46ffd640 1 -- 172.21.15.55:0/2260393759 learned_addr learned my addr 172.21.15.55:0/2260393759 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e467fc640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e48099f80 0x7f2e480b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e477fe640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e4815ba10 0x7f2e480b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e46ffd640 1 -- 172.21.15.55:0/2260393759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e4815ba10 msgr2=0x7f2e480b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e46ffd640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e4815ba10 0x7f2e480b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e46ffd640 1 -- 172.21.15.55:0/2260393759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e48099f80 msgr2=0x7f2e480b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e46ffd640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e48099f80 0x7f2e480b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e46ffd640 1 -- 172.21.15.55:0/2260393759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e480cb950 con 0x7f2e4806c1f0 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e477fe640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e4815ba10 0x7f2e480b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e46ffd640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4806c1f0 0x7f2e48157680 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800e870 tx=0x7f2e3800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e2f7fe640 1 -- 172.21.15.55:0/2260393759 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38017070 con 0x7f2e4806c1f0 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e2f7fe640 1 -- 172.21.15.55:0/2260393759 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3800c940 con 0x7f2e4806c1f0 2024-04-25T08:56:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e4d75c640 1 -- 172.21.15.55:0/2260393759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e480cad60 con 0x7f2e4806c1f0 2024-04-25T08:56:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e2f7fe640 1 -- 172.21.15.55:0/2260393759 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800cd30 con 0x7f2e4806c1f0 2024-04-25T08:56:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.678+0000 7f2e4d75c640 1 -- 172.21.15.55:0/2260393759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e480cb300 con 0x7f2e4806c1f0 2024-04-25T08:56:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.679+0000 7f2e4d75c640 1 -- 172.21.15.55:0/2260393759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e480749b0 con 0x7f2e4806c1f0 2024-04-25T08:56:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.680+0000 7f2e2f7fe640 1 -- 172.21.15.55:0/2260393759 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e3801a070 con 0x7f2e4806c1f0 2024-04-25T08:56:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.680+0000 7f2e2f7fe640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e3406b4d0 0x7f2e3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.680+0000 7f2e2f7fe640 1 -- 172.21.15.55:0/2260393759 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2e3808a120 con 0x7f2e4806c1f0 2024-04-25T08:56:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.680+0000 7f2e467fc640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e3406b4d0 0x7f2e3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.681+0000 7f2e467fc640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e3406b4d0 0x7f2e3406d990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c034000 tx=0x7f2e3c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.684+0000 7f2e2f7fe640 1 -- 172.21.15.55:0/2260393759 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e38058f60 con 0x7f2e4806c1f0 2024-04-25T08:56:02.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.867+0000 7f2e4d75c640 1 -- 172.21.15.55:0/2260393759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e4809a570 con 0x7f2e4806c1f0 2024-04-25T08:56:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.869+0000 7f2e2f7fe640 1 -- 172.21.15.55:0/2260393759 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16709 (secure 0 0 0) 0x7f2e38058860 con 0x7f2e4806c1f0 2024-04-25T08:56:02.858 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:02.859 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:55:23.857114+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:55:14.449282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:55:15.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 -- 172.21.15.55:0/2260393759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e3406b4d0 msgr2=0x7f2e3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e3406b4d0 0x7f2e3406d990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c034000 tx=0x7f2e3c02e000 comp rx=0 tx=0).stop 2024-04-25T08:56:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 -- 172.21.15.55:0/2260393759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4806c1f0 msgr2=0x7f2e48157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4806c1f0 0x7f2e48157680 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800e870 tx=0x7f2e3800ed30 comp rx=0 tx=0).stop 2024-04-25T08:56:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 -- 172.21.15.55:0/2260393759 shutdown_connections 2024-04-25T08:56:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e3406b4d0 0x7f2e3406d990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e4815ba10 0x7f2e480b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e48099f80 0x7f2e480b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 --2- 172.21.15.55:0/2260393759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4806c1f0 0x7f2e48157680 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 -- 172.21.15.55:0/2260393759 >> 172.21.15.55:0/2260393759 conn(0x7f2e480b32f0 msgr2=0x7f2e480cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 -- 172.21.15.55:0/2260393759 shutdown_connections 2024-04-25T08:56:02.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.871+0000 7f2e4d75c640 1 -- 172.21.15.55:0/2260393759 wait complete. 2024-04-25T08:56:02.872 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:55:14.449282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:55:15.139740+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:56:02.872 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:56:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.986+0000 7f5ee25a5640 1 Processor -- start 2024-04-25T08:56:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.986+0000 7f5ee25a5640 1 -- start start 2024-04-25T08:56:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee25a5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc15dca0 0x7f5edc0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee25a5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5edc0d1130 0x7f5edc0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee25a5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc0d4090 con 0x7f5edc0d3b90 2024-04-25T08:56:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee25a5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc0b6b20 con 0x7f5edc0d1130 2024-04-25T08:56:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee25a5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0d4370 con 0x7f5edc15dca0 2024-04-25T08:56:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee0b42640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5edc0d1130 0x7f5edc0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee0b42640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5edc0d1130 0x7f5edc0b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38524/0 (socket says 172.21.15.55:38524) 2024-04-25T08:56:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee0b42640 1 -- 172.21.15.55:0/1820876595 learned_addr learned my addr 172.21.15.55:0/1820876595 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5edbfff640 1 --2- 172.21.15.55:0/1820876595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc15dca0 0x7f5edc0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee0b42640 1 -- 172.21.15.55:0/1820876595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc15dca0 msgr2=0x7f5edc0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee0b42640 1 --2- 172.21.15.55:0/1820876595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc15dca0 0x7f5edc0ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee0b42640 1 -- 172.21.15.55:0/1820876595 >> v1:172.21.15.167:6789/0 conn(0x7f5edc0d3b90 legacy=0x7f5edc0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5ee0b42640 1 -- 172.21.15.55:0/1820876595 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc0d4650 con 0x7f5edc0d1130 2024-04-25T08:56:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.987+0000 7f5edbfff640 1 --2- 172.21.15.55:0/1820876595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc15dca0 0x7f5edc0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.988+0000 7f5ee0b42640 1 --2- 172.21.15.55:0/1820876595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc0d1130 0x7f5edc0b2500 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009e50 tx=0x7f5ed402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f76c23c1ddbfab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.988+0000 7f5edaffd640 1 -- 172.21.15.55:0/1820876595 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4036070 con 0x7f5edc0d1130 2024-04-25T08:56:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.988+0000 7f5edaffd640 1 -- 172.21.15.55:0/1820876595 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed4031600 con 0x7f5edc0d1130 2024-04-25T08:56:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.988+0000 7f5edaffd640 1 -- 172.21.15.55:0/1820876595 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40319d0 con 0x7f5edc0d1130 2024-04-25T08:56:02.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.989+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1820876595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc0d1130 msgr2=0x7f5edc0b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.989+0000 7f5ee25a5640 1 --2- 172.21.15.55:0/1820876595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc0d1130 0x7f5edc0b2500 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009e50 tx=0x7f5ed402a6c0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.989+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1820876595 shutdown_connections 2024-04-25T08:56:02.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.989+0000 7f5ee25a5640 1 --2- 172.21.15.55:0/1820876595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc0d1130 0x7f5edc0b2500 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.989+0000 7f5ee25a5640 1 --2- 172.21.15.55:0/1820876595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc15dca0 0x7f5edc0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.989+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1820876595 >> 172.21.15.55:0/1820876595 conn(0x7f5edc0726c0 msgr2=0x7f5edc072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:02.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.989+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1820876595 shutdown_connections 2024-04-25T08:56:02.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.989+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1820876595 wait complete. 2024-04-25T08:56:02.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.990+0000 7f5ee25a5640 1 Processor -- start 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.990+0000 7f5ee25a5640 1 -- start start 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee25a5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5edc0d1130 0x7f5edc1f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee25a5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc0d3b90 0x7f5edc14dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee25a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15dca0 0x7f5edc0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee25a5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc15e200 con 0x7f5edc15dca0 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee25a5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc15e080 con 0x7f5edc0d1130 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee25a5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0cee80 con 0x7f5edc0d3b90 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee0b42640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15dca0 0x7f5edc0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee0b42640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15dca0 0x7f5edc0ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38528/0 (socket says 172.21.15.55:38528) 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee0b42640 1 -- 172.21.15.55:0/1950538344 learned_addr learned my addr 172.21.15.55:0/1950538344 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5edbfff640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5edc0d1130 0x7f5edc1f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5edb7fe640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc0d3b90 0x7f5edc14dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee0b42640 1 -- 172.21.15.55:0/1950538344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc0d3b90 msgr2=0x7f5edc14dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee0b42640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc0d3b90 0x7f5edc14dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee0b42640 1 -- 172.21.15.55:0/1950538344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5edc0d1130 msgr2=0x7f5edc1f3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:02.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee0b42640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5edc0d1130 0x7f5edc1f3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:02.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5ee0b42640 1 -- 172.21.15.55:0/1950538344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc0cac00 con 0x7f5edc15dca0 2024-04-25T08:56:02.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.991+0000 7f5edb7fe640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc0d3b90 0x7f5edc14dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:02.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.992+0000 7f5ee0b42640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15dca0 0x7f5edc0ccdb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009e50 tx=0x7f5ed4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:02.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.992+0000 7f5ed8ff9640 1 -- 172.21.15.55:0/1950538344 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4036050 con 0x7f5edc15dca0 2024-04-25T08:56:02.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.992+0000 7f5ed8ff9640 1 -- 172.21.15.55:0/1950538344 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed4042070 con 0x7f5edc15dca0 2024-04-25T08:56:02.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.992+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1950538344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc0caee0 con 0x7f5edc15dca0 2024-04-25T08:56:02.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.992+0000 7f5ed8ff9640 1 -- 172.21.15.55:0/1950538344 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4009510 con 0x7f5edc15dca0 2024-04-25T08:56:02.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.992+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1950538344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc0cb4a0 con 0x7f5edc15dca0 2024-04-25T08:56:02.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.993+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1950538344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc0750b0 con 0x7f5edc15dca0 2024-04-25T08:56:02.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.993+0000 7f5ed8ff9640 1 -- 172.21.15.55:0/1950538344 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5ed4007bd0 con 0x7f5edc15dca0 2024-04-25T08:56:02.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.994+0000 7f5ed8ff9640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ebc06b4d0 0x7f5ebc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:02.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.994+0000 7f5ed8ff9640 1 -- 172.21.15.55:0/1950538344 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5ed40ab190 con 0x7f5edc15dca0 2024-04-25T08:56:02.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.994+0000 7f5edbfff640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ebc06b4d0 0x7f5ebc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:02.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.994+0000 7f5edbfff640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ebc06b4d0 0x7f5ebc06d990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400aac0 tx=0x7f5ec4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:02.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:02.998+0000 7f5ed8ff9640 1 -- 172.21.15.55:0/1950538344 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5ed4079fd0 con 0x7f5edc15dca0 2024-04-25T08:56:03.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.180+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1950538344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5edc0b8400 con 0x7f5edc15dca0 2024-04-25T08:56:03.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.181+0000 7f5ed8ff9640 1 -- 172.21.15.55:0/1950538344 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ed40798d0 con 0x7f5edc15dca0 2024-04-25T08:56:03.171 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:56:03.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1950538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ebc06b4d0 msgr2=0x7f5ebc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ebc06b4d0 0x7f5ebc06d990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400aac0 tx=0x7f5ec4008040 comp rx=0 tx=0).stop 2024-04-25T08:56:03.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1950538344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15dca0 msgr2=0x7f5edc0ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15dca0 0x7f5edc0ccdb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009e50 tx=0x7f5ed4004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:03.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1950538344 shutdown_connections 2024-04-25T08:56:03.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ebc06b4d0 0x7f5ebc06d990 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15dca0 0x7f5edc0ccdb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5edc0d3b90 0x7f5edc14dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 --2- 172.21.15.55:0/1950538344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5edc0d1130 0x7f5edc1f3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1950538344 >> 172.21.15.55:0/1950538344 conn(0x7f5edc0726c0 msgr2=0x7f5edc0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:03.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1950538344 shutdown_connections 2024-04-25T08:56:03.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.183+0000 7f5ee25a5640 1 -- 172.21.15.55:0/1950538344 wait complete. 2024-04-25T08:56:03.183 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:56:03.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.297+0000 7f6731015640 1 Processor -- start 2024-04-25T08:56:03.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.297+0000 7f6731015640 1 -- start start 2024-04-25T08:56:03.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6731015640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f672c0b97c0 0x7f672c0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6731015640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f672c0b5a30 0x7f672c0d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6731015640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c0b5e40 con 0x7f672c15dc80 2024-04-25T08:56:03.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6731015640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c161f80 con 0x7f672c0b97c0 2024-04-25T08:56:03.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6731015640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c1627a0 con 0x7f672c0b5a30 2024-04-25T08:56:03.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6723fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f672c0b97c0 0x7f672c0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6723fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f672c0b97c0 0x7f672c0b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38532/0 (socket says 172.21.15.55:38532) 2024-04-25T08:56:03.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6723fff640 1 -- 172.21.15.55:0/644547391 learned_addr learned my addr 172.21.15.55:0/644547391 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6723fff640 1 -- 172.21.15.55:0/644547391 >> v2:172.21.15.167:3300/0 conn(0x7f672c0b5a30 msgr2=0x7f672c0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f672b59e640 1 --2- 172.21.15.55:0/644547391 >> v2:172.21.15.167:3300/0 conn(0x7f672c0b5a30 0x7f672c0d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6723fff640 1 --2- 172.21.15.55:0/644547391 >> v2:172.21.15.167:3300/0 conn(0x7f672c0b5a30 0x7f672c0d2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6723fff640 1 -- 172.21.15.55:0/644547391 >> v1:172.21.15.167:6789/0 conn(0x7f672c15dc80 legacy=0x7f672c161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.298+0000 7f6723fff640 1 -- 172.21.15.55:0/644547391 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c1621e0 con 0x7f672c0b97c0 2024-04-25T08:56:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.299+0000 7f6723fff640 1 --2- 172.21.15.55:0/644547391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c0b97c0 0x7f672c0b54f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f672c0b6300 tx=0x7f671402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89713e80adba2b2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.299+0000 7f672a59c640 1 -- 172.21.15.55:0/644547391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714037070 con 0x7f672c0b97c0 2024-04-25T08:56:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.299+0000 7f672a59c640 1 -- 172.21.15.55:0/644547391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6714032440 con 0x7f672c0b97c0 2024-04-25T08:56:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.299+0000 7f672a59c640 1 -- 172.21.15.55:0/644547391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714032810 con 0x7f672c0b97c0 2024-04-25T08:56:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.300+0000 7f6731015640 1 -- 172.21.15.55:0/644547391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c0b97c0 msgr2=0x7f672c0b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.300+0000 7f6731015640 1 --2- 172.21.15.55:0/644547391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c0b97c0 0x7f672c0b54f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f672c0b6300 tx=0x7f671402a230 comp rx=0 tx=0).stop 2024-04-25T08:56:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.300+0000 7f6731015640 1 -- 172.21.15.55:0/644547391 shutdown_connections 2024-04-25T08:56:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.300+0000 7f6731015640 1 --2- 172.21.15.55:0/644547391 >> v2:172.21.15.167:3300/0 conn(0x7f672c0b5a30 0x7f672c0d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.300+0000 7f6731015640 1 --2- 172.21.15.55:0/644547391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c0b97c0 0x7f672c0b54f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.300+0000 7f6731015640 1 -- 172.21.15.55:0/644547391 >> 172.21.15.55:0/644547391 conn(0x7f672c0d04f0 msgr2=0x7f672c0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.300+0000 7f6731015640 1 -- 172.21.15.55:0/644547391 shutdown_connections 2024-04-25T08:56:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.300+0000 7f6731015640 1 -- 172.21.15.55:0/644547391 wait complete. 2024-04-25T08:56:03.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.301+0000 7f6731015640 1 Processor -- start 2024-04-25T08:56:03.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.301+0000 7f6731015640 1 -- start start 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6731015640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f672c0b5a30 0x7f672c14efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6731015640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c0b97c0 0x7f672c15ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6731015640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f672c15dc80 0x7f672c0d2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6731015640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c15e060 con 0x7f672c0b97c0 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6731015640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0d1c70 con 0x7f672c0b5a30 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6731015640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0d29b0 con 0x7f672c15dc80 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6723fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c0b97c0 0x7f672c15ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6723fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c0b97c0 0x7f672c15ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38546/0 (socket says 172.21.15.55:38546) 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6723fff640 1 -- 172.21.15.55:0/2480173118 learned_addr learned my addr 172.21.15.55:0/2480173118 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f672ad9d640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f672c0b5a30 0x7f672c14efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f672b59e640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f672c15dc80 0x7f672c0d2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6723fff640 1 -- 172.21.15.55:0/2480173118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f672c15dc80 msgr2=0x7f672c0d2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6723fff640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f672c15dc80 0x7f672c0d2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6723fff640 1 -- 172.21.15.55:0/2480173118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f672c0b5a30 msgr2=0x7f672c14efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6723fff640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f672c0b5a30 0x7f672c14efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6723fff640 1 -- 172.21.15.55:0/2480173118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c15e3a0 con 0x7f672c0b97c0 2024-04-25T08:56:03.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f672b59e640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f672c15dc80 0x7f672c0d2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:03.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f6723fff640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c0b97c0 0x7f672c15ff30 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f671402a270 tx=0x7f67140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:03.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.302+0000 7f67237fe640 1 -- 172.21.15.55:0/2480173118 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714037040 con 0x7f672c0b97c0 2024-04-25T08:56:03.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.303+0000 7f67237fe640 1 -- 172.21.15.55:0/2480173118 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6714042070 con 0x7f672c0b97c0 2024-04-25T08:56:03.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.303+0000 7f6731015640 1 -- 172.21.15.55:0/2480173118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c15e680 con 0x7f672c0b97c0 2024-04-25T08:56:03.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.303+0000 7f67237fe640 1 -- 172.21.15.55:0/2480173118 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714030bb0 con 0x7f672c0b97c0 2024-04-25T08:56:03.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.303+0000 7f6731015640 1 -- 172.21.15.55:0/2480173118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c15ec40 con 0x7f672c0b97c0 2024-04-25T08:56:03.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.304+0000 7f6731015640 1 -- 172.21.15.55:0/2480173118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c0750b0 con 0x7f672c0b97c0 2024-04-25T08:56:03.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.304+0000 7f67237fe640 1 -- 172.21.15.55:0/2480173118 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6714047460 con 0x7f672c0b97c0 2024-04-25T08:56:03.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.305+0000 7f67237fe640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f670c06b500 0x7f670c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.305+0000 7f67237fe640 1 -- 172.21.15.55:0/2480173118 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f67140aaee0 con 0x7f672c0b97c0 2024-04-25T08:56:03.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.305+0000 7f672ad9d640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f670c06b500 0x7f670c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.305+0000 7f672ad9d640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f670c06b500 0x7f670c06d9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f671c006fd0 tx=0x7f671c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:03.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.309+0000 7f67237fe640 1 -- 172.21.15.55:0/2480173118 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f672c0b5e40 con 0x7f672c0b97c0 2024-04-25T08:56:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.488+0000 7f6731015640 1 -- 172.21.15.55:0/2480173118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f672c0d1780 con 0x7f672c0b97c0 2024-04-25T08:56:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.488+0000 7f67237fe640 1 -- 172.21.15.55:0/2480173118 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6714045360 con 0x7f672c0b97c0 2024-04-25T08:56:03.478 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:56:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 -- 172.21.15.55:0/2480173118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f670c06b500 msgr2=0x7f670c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f670c06b500 0x7f670c06d9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f671c006fd0 tx=0x7f671c008040 comp rx=0 tx=0).stop 2024-04-25T08:56:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 -- 172.21.15.55:0/2480173118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c0b97c0 msgr2=0x7f672c15ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c0b97c0 0x7f672c15ff30 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f671402a270 tx=0x7f67140046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 -- 172.21.15.55:0/2480173118 shutdown_connections 2024-04-25T08:56:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f670c06b500 0x7f670c06d9c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f672c15dc80 0x7f672c0d2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c0b97c0 0x7f672c15ff30 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 --2- 172.21.15.55:0/2480173118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f672c0b5a30 0x7f672c14efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 -- 172.21.15.55:0/2480173118 >> 172.21.15.55:0/2480173118 conn(0x7f672c0d04f0 msgr2=0x7f672c0b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 -- 172.21.15.55:0/2480173118 shutdown_connections 2024-04-25T08:56:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.490+0000 7f6731015640 1 -- 172.21.15.55:0/2480173118 wait complete. 2024-04-25T08:56:03.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:56:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.605+0000 7f2948e4a640 1 Processor -- start 2024-04-25T08:56:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.605+0000 7f2948e4a640 1 -- start start 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.606+0000 7f2948e4a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f29440d0610 0x7f29440cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.606+0000 7f2948e4a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29440cc830 con 0x7f29440cf510 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.606+0000 7f2948e4a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29440ccb10 con 0x7f294415bbe0 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.606+0000 7f2948e4a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29440ccdf0 con 0x7f29440d0610 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.606+0000 7f2941d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f29440cf510 0x7f29440cff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44334/0 (socket says 172.21.15.55:44334) 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.606+0000 7f2941d9b640 1 -- 172.21.15.55:0/1323504641 learned_addr learned my addr 172.21.15.55:0/1323504641 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.607+0000 7f2942d9d640 1 --2- 172.21.15.55:0/1323504641 >> v2:172.21.15.167:3300/0 conn(0x7f29440d0610 0x7f29440cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.607+0000 7f294159a640 1 -- 172.21.15.55:0/1323504641 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246791578 0 0) 0x7f29440cc830 con 0x7f29440cf510 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.607+0000 7f294159a640 1 -- 172.21.15.55:0/1323504641 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f292c003520 con 0x7f29440cf510 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.607+0000 7f294159a640 1 -- 172.21.15.55:0/1323504641 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944631115 0 0) 0x7f29440ccb10 con 0x7f294415bbe0 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.607+0000 7f294159a640 1 -- 172.21.15.55:0/1323504641 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29440cc830 con 0x7f294415bbe0 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.607+0000 7f2942d9d640 1 -- 172.21.15.55:0/1323504641 >> v1:172.21.15.167:6789/0 conn(0x7f294415bbe0 legacy=0x7f29440cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.607+0000 7f2942d9d640 1 -- 172.21.15.55:0/1323504641 >> v1:172.21.15.55:6789/0 conn(0x7f29440cf510 legacy=0x7f29440cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.607+0000 7f2942d9d640 1 -- 172.21.15.55:0/1323504641 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440cd0d0 con 0x7f29440d0610 2024-04-25T08:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.608+0000 7f2942d9d640 1 --2- 172.21.15.55:0/1323504641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29440d0610 0x7f29440cf970 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f293c009d90 tx=0x7f293c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e61a7b1890a8dcbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.608+0000 7f294159a640 1 -- 172.21.15.55:0/1323504641 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c007740 con 0x7f29440d0610 2024-04-25T08:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.608+0000 7f294159a640 1 -- 172.21.15.55:0/1323504641 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c0078e0 con 0x7f29440d0610 2024-04-25T08:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.608+0000 7f294159a640 1 -- 172.21.15.55:0/1323504641 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c007cb0 con 0x7f29440d0610 2024-04-25T08:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.608+0000 7f2948e4a640 1 -- 172.21.15.55:0/1323504641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29440d0610 msgr2=0x7f29440cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.608+0000 7f2948e4a640 1 --2- 172.21.15.55:0/1323504641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29440d0610 0x7f29440cf970 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f293c009d90 tx=0x7f293c02a6f0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.609+0000 7f2948e4a640 1 -- 172.21.15.55:0/1323504641 shutdown_connections 2024-04-25T08:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.609+0000 7f2948e4a640 1 --2- 172.21.15.55:0/1323504641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29440d0610 0x7f29440cf970 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.609+0000 7f2948e4a640 1 -- 172.21.15.55:0/1323504641 >> 172.21.15.55:0/1323504641 conn(0x7f29440b3430 msgr2=0x7f29440b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.609+0000 7f2948e4a640 1 -- 172.21.15.55:0/1323504641 shutdown_connections 2024-04-25T08:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.609+0000 7f2948e4a640 1 -- 172.21.15.55:0/1323504641 wait complete. 2024-04-25T08:56:03.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.610+0000 7f2948e4a640 1 Processor -- start 2024-04-25T08:56:03.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.610+0000 7f2948e4a640 1 -- start start 2024-04-25T08:56:03.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f2948e4a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29440cf510 0x7f2944156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f2948e4a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29440d0610 0x7f29441f1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f2948e4a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f294415bbe0 0x7f294414bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f2948e4a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29440cc450 con 0x7f29440cf510 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f2948e4a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294415bfc0 con 0x7f294415bbe0 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f2948e4a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29440cc5d0 con 0x7f29440d0610 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f294259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29440cf510 0x7f2944156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f294259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29440cf510 0x7f2944156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38556/0 (socket says 172.21.15.55:38556) 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f294259c640 1 -- 172.21.15.55:0/2433901200 learned_addr learned my addr 172.21.15.55:0/2433901200 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f294259c640 1 -- 172.21.15.55:0/2433901200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29440d0610 msgr2=0x7f29441f1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f294259c640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29440d0610 0x7f29441f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f294259c640 1 -- 172.21.15.55:0/2433901200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f294415bbe0 msgr2=0x7f294414bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f294259c640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f294415bbe0 0x7f294414bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f294259c640 1 -- 172.21.15.55:0/2433901200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944158bf0 con 0x7f29440cf510 2024-04-25T08:56:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f294259c640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29440cf510 0x7f2944156dc0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f293400c460 tx=0x7f293400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f2932ffd640 1 -- 172.21.15.55:0/2433901200 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934017070 con 0x7f29440cf510 2024-04-25T08:56:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f2932ffd640 1 -- 172.21.15.55:0/2433901200 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29340052f0 con 0x7f29440cf510 2024-04-25T08:56:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f2948e4a640 1 -- 172.21.15.55:0/2433901200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294415d9b0 con 0x7f29440cf510 2024-04-25T08:56:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f2932ffd640 1 -- 172.21.15.55:0/2433901200 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934003830 con 0x7f29440cf510 2024-04-25T08:56:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.611+0000 7f2948e4a640 1 -- 172.21.15.55:0/2433901200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294415df70 con 0x7f29440cf510 2024-04-25T08:56:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.612+0000 7f2948e4a640 1 -- 172.21.15.55:0/2433901200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29440750b0 con 0x7f29440cf510 2024-04-25T08:56:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.613+0000 7f2932ffd640 1 -- 172.21.15.55:0/2433901200 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f293401a070 con 0x7f29440cf510 2024-04-25T08:56:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.613+0000 7f2932ffd640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f292406b4d0 0x7f292406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.613+0000 7f2932ffd640 1 -- 172.21.15.55:0/2433901200 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2934089730 con 0x7f29440cf510 2024-04-25T08:56:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.613+0000 7f2941d9b640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f292406b4d0 0x7f292406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.614+0000 7f2941d9b640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f292406b4d0 0x7f292406d990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f294415adb0 tx=0x7f2938007930 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.618+0000 7f2932ffd640 1 -- 172.21.15.55:0/2433901200 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2934058460 con 0x7f29440cf510 2024-04-25T08:56:03.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.796+0000 7f2948e4a640 1 -- 172.21.15.55:0/2433901200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29440b42d0 con 0x7f29440cf510 2024-04-25T08:56:03.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.797+0000 7f2932ffd640 1 -- 172.21.15.55:0/2433901200 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2934057d60 con 0x7f29440cf510 2024-04-25T08:56:03.787 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:56:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 -- 172.21.15.55:0/2433901200 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f292406b4d0 msgr2=0x7f292406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f292406b4d0 0x7f292406d990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f294415adb0 tx=0x7f2938007930 comp rx=0 tx=0).stop 2024-04-25T08:56:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 -- 172.21.15.55:0/2433901200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29440cf510 msgr2=0x7f2944156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29440cf510 0x7f2944156dc0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f293400c460 tx=0x7f293400c920 comp rx=0 tx=0).stop 2024-04-25T08:56:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 -- 172.21.15.55:0/2433901200 shutdown_connections 2024-04-25T08:56:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f292406b4d0 0x7f292406d990 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f294415bbe0 0x7f294414bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29440d0610 0x7f29441f1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 --2- 172.21.15.55:0/2433901200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29440cf510 0x7f2944156dc0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 -- 172.21.15.55:0/2433901200 >> 172.21.15.55:0/2433901200 conn(0x7f29440b3430 msgr2=0x7f294406f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:03.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 -- 172.21.15.55:0/2433901200 shutdown_connections 2024-04-25T08:56:03.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.799+0000 7f2948e4a640 1 -- 172.21.15.55:0/2433901200 wait complete. 2024-04-25T08:56:03.800 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:03.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.911+0000 7f54febd5640 1 Processor -- start 2024-04-25T08:56:03.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.911+0000 7f54febd5640 1 -- start start 2024-04-25T08:56:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.912+0000 7f54febd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54f80ae9a0 0x7f54f80b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.912+0000 7f54febd5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f54f80b2c60 0x7f54f80b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.912+0000 7f54febd5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f806d550 con 0x7f54f8071190 2024-04-25T08:56:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.912+0000 7f54febd5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f806d830 con 0x7f54f80ae9a0 2024-04-25T08:56:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.912+0000 7f54febd5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f806db10 con 0x7f54f80b2c60 2024-04-25T08:56:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.912+0000 7f54f7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54f80ae9a0 0x7f54f80b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.912+0000 7f54fc971640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f54f8071190 0x7f54f8071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44336/0 (socket says 172.21.15.55:44336) 2024-04-25T08:56:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.912+0000 7f54fc971640 1 -- 172.21.15.55:0/3807523974 learned_addr learned my addr 172.21.15.55:0/3807523974 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.912+0000 7f54fd172640 1 --2- 172.21.15.55:0/3807523974 >> v2:172.21.15.167:3300/0 conn(0x7f54f80b2c60 0x7f54f80b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.913+0000 7f54f7fff640 1 -- 172.21.15.55:0/3807523974 >> v2:172.21.15.167:3300/0 conn(0x7f54f80b2c60 msgr2=0x7f54f80b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.913+0000 7f54f7fff640 1 --2- 172.21.15.55:0/3807523974 >> v2:172.21.15.167:3300/0 conn(0x7f54f80b2c60 0x7f54f80b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.913+0000 7f54f7fff640 1 -- 172.21.15.55:0/3807523974 >> v1:172.21.15.55:6789/0 conn(0x7f54f8071190 legacy=0x7f54f8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.913+0000 7f54f7fff640 1 -- 172.21.15.55:0/3807523974 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f806ddf0 con 0x7f54f80ae9a0 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.913+0000 7f54f77fe640 1 -- 172.21.15.55:0/3807523974 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142266046 0 0) 0x7f54f806d550 con 0x7f54f8071190 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.913+0000 7f54f7fff640 1 --2- 172.21.15.55:0/3807523974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f80ae9a0 0x7f54f80b2720 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0097a0 tx=0x7f54ec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dab2c4c2b2860e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.913+0000 7f54f77fe640 1 -- 172.21.15.55:0/3807523974 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec037070 con 0x7f54f80ae9a0 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.913+0000 7f54f77fe640 1 -- 172.21.15.55:0/3807523974 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec032440 con 0x7f54f80ae9a0 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.913+0000 7f54f77fe640 1 -- 172.21.15.55:0/3807523974 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec032810 con 0x7f54f80ae9a0 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.914+0000 7f54febd5640 1 -- 172.21.15.55:0/3807523974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f80ae9a0 msgr2=0x7f54f80b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.914+0000 7f54febd5640 1 --2- 172.21.15.55:0/3807523974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f80ae9a0 0x7f54f80b2720 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0097a0 tx=0x7f54ec02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.914+0000 7f54febd5640 1 -- 172.21.15.55:0/3807523974 shutdown_connections 2024-04-25T08:56:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.914+0000 7f54febd5640 1 --2- 172.21.15.55:0/3807523974 >> v2:172.21.15.167:3300/0 conn(0x7f54f80b2c60 0x7f54f80b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.914+0000 7f54febd5640 1 --2- 172.21.15.55:0/3807523974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f80ae9a0 0x7f54f80b2720 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.914+0000 7f54febd5640 1 -- 172.21.15.55:0/3807523974 >> 172.21.15.55:0/3807523974 conn(0x7f54f806aba0 msgr2=0x7f54f806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.914+0000 7f54febd5640 1 -- 172.21.15.55:0/3807523974 shutdown_connections 2024-04-25T08:56:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.914+0000 7f54febd5640 1 -- 172.21.15.55:0/3807523974 wait complete. 2024-04-25T08:56:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.915+0000 7f54febd5640 1 Processor -- start 2024-04-25T08:56:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.915+0000 7f54febd5640 1 -- start start 2024-04-25T08:56:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.916+0000 7f54febd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f8071190 0x7f54f8154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.916+0000 7f54febd5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54f80ae9a0 0x7f54f81f1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.916+0000 7f54febd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54f80b2c60 0x7f54f81f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.916+0000 7f54febd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f806e8b0 con 0x7f54f8071190 2024-04-25T08:56:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.916+0000 7f54febd5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80aee30 con 0x7f54f80ae9a0 2024-04-25T08:56:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.916+0000 7f54febd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f806d1b0 con 0x7f54f80b2c60 2024-04-25T08:56:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.916+0000 7f54fc971640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f8071190 0x7f54f8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.916+0000 7f54fc971640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f8071190 0x7f54f8154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38570/0 (socket says 172.21.15.55:38570) 2024-04-25T08:56:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.916+0000 7f54fc971640 1 -- 172.21.15.55:0/3877289209 learned_addr learned my addr 172.21.15.55:0/3877289209 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.916+0000 7f54f7fff640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54f80ae9a0 0x7f54f81f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.916+0000 7f54fd172640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54f80b2c60 0x7f54f81f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54fc971640 1 -- 172.21.15.55:0/3877289209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54f80b2c60 msgr2=0x7f54f81f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54fc971640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54f80b2c60 0x7f54f81f4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54fc971640 1 -- 172.21.15.55:0/3877289209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54f80ae9a0 msgr2=0x7f54f81f1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54fc971640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54f80ae9a0 0x7f54f81f1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54fc971640 1 -- 172.21.15.55:0/3877289209 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f814d7d0 con 0x7f54f8071190 2024-04-25T08:56:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54f7fff640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54f80ae9a0 0x7f54f81f1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54fc971640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f8071190 0x7f54f8154810 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c890 tx=0x7f54f000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54f57fa640 1 -- 172.21.15.55:0/3877289209 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0018070 con 0x7f54f8071190 2024-04-25T08:56:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54f57fa640 1 -- 172.21.15.55:0/3877289209 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f000a640 con 0x7f54f8071190 2024-04-25T08:56:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54febd5640 1 -- 172.21.15.55:0/3877289209 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f8154d50 con 0x7f54f8071190 2024-04-25T08:56:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54f57fa640 1 -- 172.21.15.55:0/3877289209 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f000aa30 con 0x7f54f8071190 2024-04-25T08:56:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.917+0000 7f54febd5640 1 -- 172.21.15.55:0/3877289209 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f814dd50 con 0x7f54f8071190 2024-04-25T08:56:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.918+0000 7f54febd5640 1 -- 172.21.15.55:0/3877289209 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f80749b0 con 0x7f54f8071190 2024-04-25T08:56:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.918+0000 7f54f57fa640 1 -- 172.21.15.55:0/3877289209 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f54f001b070 con 0x7f54f8071190 2024-04-25T08:56:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.919+0000 7f54f57fa640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f54e406b4d0 0x7f54e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.919+0000 7f54f57fa640 1 -- 172.21.15.55:0/3877289209 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f54f0089850 con 0x7f54f8071190 2024-04-25T08:56:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.919+0000 7f54f7fff640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f54e406b4d0 0x7f54e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.919+0000 7f54f7fff640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f54e406b4d0 0x7f54e406d990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f54ec034000 tx=0x7f54ec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:03.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:03.923+0000 7f54f57fa640 1 -- 172.21.15.55:0/3877289209 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f54f0058720 con 0x7f54f8071190 2024-04-25T08:56:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.140+0000 7f54febd5640 1 -- 172.21.15.55:0/3877289209 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54f806e470 con 0x7f54f8071190 2024-04-25T08:56:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.141+0000 7f54f57fa640 1 -- 172.21.15.55:0/3877289209 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f54f0058020 con 0x7f54f8071190 2024-04-25T08:56:04.131 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:04.131 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3267261156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3267261156},{"type":"v1","addr":"172.21.15.167:6834","nonce":3267261156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/588514159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":588514159},{"type":"v1","addr":"172.21.15.167:6835","nonce":588514159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2276997137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2276997137},{"type":"v1","addr":"172.21.15.55:6835","nonce":2276997137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:55:16.159284+0000","modified":"2024-04-25T08:55:19.200438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/2070394524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":2070394524},{"type":"v1","addr":"172.21.15.55:6837","nonce":2070394524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:56:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 22 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 -- 172.21.15.55:0/3877289209 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f54e406b4d0 msgr2=0x7f54e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f54e406b4d0 0x7f54e406d990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f54ec034000 tx=0x7f54ec02e000 comp rx=0 tx=0).stop 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 -- 172.21.15.55:0/3877289209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f8071190 msgr2=0x7f54f8154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f8071190 0x7f54f8154810 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c890 tx=0x7f54f000cd50 comp rx=0 tx=0).stop 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 -- 172.21.15.55:0/3877289209 shutdown_connections 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f54e406b4d0 0x7f54e406d990 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54f80b2c60 0x7f54f81f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54f80ae9a0 0x7f54f81f1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 --2- 172.21.15.55:0/3877289209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f8071190 0x7f54f8154810 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 -- 172.21.15.55:0/3877289209 >> 172.21.15.55:0/3877289209 conn(0x7f54f806aba0 msgr2=0x7f54f815bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 -- 172.21.15.55:0/3877289209 shutdown_connections 2024-04-25T08:56:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.143+0000 7f54febd5640 1 -- 172.21.15.55:0/3877289209 wait complete. 2024-04-25T08:56:04.143 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.254+0000 7f4894038640 1 Processor -- start 2024-04-25T08:56:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.254+0000 7f4894038640 1 -- start start 2024-04-25T08:56:04.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.255+0000 7f4894038640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f488c06aba0 0x7f488c072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.255+0000 7f4894038640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f488c072e50 0x7f488c0ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.255+0000 7f4894038640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488c06b030 con 0x7f488c15dca0 2024-04-25T08:56:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.255+0000 7f4894038640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c06b310 con 0x7f488c072e50 2024-04-25T08:56:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.255+0000 7f4894038640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0cf8a0 con 0x7f488c06aba0 2024-04-25T08:56:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.255+0000 7f48925d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f488c072e50 0x7f488c0ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.255+0000 7f48925d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f488c072e50 0x7f488c0ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38586/0 (socket says 172.21.15.55:38586) 2024-04-25T08:56:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.255+0000 7f48925d5640 1 -- 172.21.15.55:0/2627528760 learned_addr learned my addr 172.21.15.55:0/2627528760 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.256+0000 7f48915d3640 1 --2- 172.21.15.55:0/2627528760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f488c06aba0 0x7f488c072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.256+0000 7f48925d5640 1 -- 172.21.15.55:0/2627528760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f488c06aba0 msgr2=0x7f488c072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.256+0000 7f48925d5640 1 --2- 172.21.15.55:0/2627528760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f488c06aba0 0x7f488c072910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.256+0000 7f48925d5640 1 -- 172.21.15.55:0/2627528760 >> v1:172.21.15.167:6789/0 conn(0x7f488c15dca0 legacy=0x7f488c0c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.256+0000 7f48925d5640 1 -- 172.21.15.55:0/2627528760 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c0cfb80 con 0x7f488c072e50 2024-04-25T08:56:04.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.256+0000 7f48925d5640 1 --2- 172.21.15.55:0/2627528760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c072e50 0x7f488c0ce5f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f487c009e50 tx=0x7f487c02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc14668e8e6402ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:04.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.257+0000 7f4890dd2640 1 -- 172.21.15.55:0/2627528760 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c036070 con 0x7f488c072e50 2024-04-25T08:56:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.257+0000 7f4890dd2640 1 -- 172.21.15.55:0/2627528760 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c031600 con 0x7f488c072e50 2024-04-25T08:56:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.257+0000 7f4890dd2640 1 -- 172.21.15.55:0/2627528760 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c0319d0 con 0x7f488c072e50 2024-04-25T08:56:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.257+0000 7f4894038640 1 -- 172.21.15.55:0/2627528760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c072e50 msgr2=0x7f488c0ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.257+0000 7f4894038640 1 --2- 172.21.15.55:0/2627528760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c072e50 0x7f488c0ce5f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f487c009e50 tx=0x7f487c02a750 comp rx=0 tx=0).stop 2024-04-25T08:56:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.257+0000 7f4894038640 1 -- 172.21.15.55:0/2627528760 shutdown_connections 2024-04-25T08:56:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.257+0000 7f4894038640 1 --2- 172.21.15.55:0/2627528760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c072e50 0x7f488c0ce5f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.257+0000 7f4894038640 1 --2- 172.21.15.55:0/2627528760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f488c06aba0 0x7f488c072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.257+0000 7f4894038640 1 -- 172.21.15.55:0/2627528760 >> 172.21.15.55:0/2627528760 conn(0x7f488c0b2370 msgr2=0x7f488c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.257+0000 7f4894038640 1 -- 172.21.15.55:0/2627528760 shutdown_connections 2024-04-25T08:56:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.257+0000 7f4894038640 1 -- 172.21.15.55:0/2627528760 wait complete. 2024-04-25T08:56:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.258+0000 7f4894038640 1 Processor -- start 2024-04-25T08:56:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.259+0000 7f4894038640 1 -- start start 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.259+0000 7f4894038640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f488c072e50 0x7f488c14a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.259+0000 7f4894038640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c15dca0 0x7f488c14a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.259+0000 7f4894038640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f488c15a110 0x7f488c14bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.259+0000 7f4894038640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0d0220 con 0x7f488c15dca0 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.259+0000 7f4894038640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0d00a0 con 0x7f488c072e50 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.259+0000 7f4894038640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0ceb30 con 0x7f488c15a110 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.259+0000 7f48915d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c15dca0 0x7f488c14a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.259+0000 7f48915d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c15dca0 0x7f488c14a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38602/0 (socket says 172.21.15.55:38602) 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.259+0000 7f48915d3640 1 -- 172.21.15.55:0/2635995972 learned_addr learned my addr 172.21.15.55:0/2635995972 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.260+0000 7f48915d3640 1 -- 172.21.15.55:0/2635995972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f488c15a110 msgr2=0x7f488c14bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.260+0000 7f48915d3640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f488c15a110 0x7f488c14bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.260+0000 7f48915d3640 1 -- 172.21.15.55:0/2635995972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f488c072e50 msgr2=0x7f488c14a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.260+0000 7f48915d3640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f488c072e50 0x7f488c14a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.260+0000 7f48915d3640 1 -- 172.21.15.55:0/2635995972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c14ae40 con 0x7f488c15dca0 2024-04-25T08:56:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.260+0000 7f48915d3640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c15dca0 0x7f488c14a040 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f488000c820 tx=0x7f488000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.260+0000 7f488a7fc640 1 -- 172.21.15.55:0/2635995972 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880015070 con 0x7f488c15dca0 2024-04-25T08:56:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.260+0000 7f488a7fc640 1 -- 172.21.15.55:0/2635995972 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880004240 con 0x7f488c15dca0 2024-04-25T08:56:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.260+0000 7f4894038640 1 -- 172.21.15.55:0/2635995972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c14b120 con 0x7f488c15dca0 2024-04-25T08:56:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.260+0000 7f488a7fc640 1 -- 172.21.15.55:0/2635995972 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000ce10 con 0x7f488c15dca0 2024-04-25T08:56:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.260+0000 7f4894038640 1 -- 172.21.15.55:0/2635995972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c14b6e0 con 0x7f488c15dca0 2024-04-25T08:56:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.261+0000 7f4894038640 1 -- 172.21.15.55:0/2635995972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c0749b0 con 0x7f488c15dca0 2024-04-25T08:56:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.261+0000 7f488a7fc640 1 -- 172.21.15.55:0/2635995972 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4880007830 con 0x7f488c15dca0 2024-04-25T08:56:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.262+0000 7f488a7fc640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f487806b4d0 0x7f487806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.262+0000 7f488a7fc640 1 -- 172.21.15.55:0/2635995972 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f488008a120 con 0x7f488c15dca0 2024-04-25T08:56:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.262+0000 7f4891dd4640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f487806b4d0 0x7f487806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.262+0000 7f4891dd4640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f487806b4d0 0x7f487806d990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4884006fd0 tx=0x7f4884006bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:04.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.266+0000 7f488a7fc640 1 -- 172.21.15.55:0/2635995972 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4880058f60 con 0x7f488c15dca0 2024-04-25T08:56:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.447+0000 7f4894038640 1 -- 172.21.15.55:0/2635995972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f488c0afca0 con 0x7f488c15dca0 2024-04-25T08:56:04.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.448+0000 7f488a7fc640 1 -- 172.21.15.55:0/2635995972 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16709 (secure 0 0 0) 0x7f4880058860 con 0x7f488c15dca0 2024-04-25T08:56:04.438 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:04.438 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:55:23.857114+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:55:14.449282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:55:15.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 -- 172.21.15.55:0/2635995972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f487806b4d0 msgr2=0x7f487806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f487806b4d0 0x7f487806d990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4884006fd0 tx=0x7f4884006bc0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 -- 172.21.15.55:0/2635995972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c15dca0 msgr2=0x7f488c14a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c15dca0 0x7f488c14a040 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f488000c820 tx=0x7f488000cce0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 -- 172.21.15.55:0/2635995972 shutdown_connections 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f487806b4d0 0x7f487806d990 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f488c15a110 0x7f488c14bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c15dca0 0x7f488c14a040 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 --2- 172.21.15.55:0/2635995972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f488c072e50 0x7f488c14a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 -- 172.21.15.55:0/2635995972 >> 172.21.15.55:0/2635995972 conn(0x7f488c0b2370 msgr2=0x7f488c0cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 -- 172.21.15.55:0/2635995972 shutdown_connections 2024-04-25T08:56:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.450+0000 7f4894038640 1 -- 172.21.15.55:0/2635995972 wait complete. 2024-04-25T08:56:04.450 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:56:04.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:04.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.562+0000 7f736c2f5640 1 Processor -- start 2024-04-25T08:56:04.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.562+0000 7f736c2f5640 1 -- start start 2024-04-25T08:56:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.563+0000 7f736c2f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73641451d0 0x7f73640cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.563+0000 7f736c2f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736406d570 con 0x7f736406e8f0 2024-04-25T08:56:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.563+0000 7f736c2f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736406d850 con 0x7f73640718a0 2024-04-25T08:56:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.563+0000 7f736c2f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736406e460 con 0x7f73641451d0 2024-04-25T08:56:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.563+0000 7f736a091640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73641451d0 0x7f73640cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.563+0000 7f7369890640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f736406e8f0 0x7f7364071190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44340/0 (socket says 172.21.15.55:44340) 2024-04-25T08:56:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.563+0000 7f7369890640 1 -- 172.21.15.55:0/1000602990 learned_addr learned my addr 172.21.15.55:0/1000602990 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:04.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.564+0000 7f736a091640 1 -- 172.21.15.55:0/1000602990 >> v1:172.21.15.167:6789/0 conn(0x7f73640718a0 legacy=0x7f73640ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.564+0000 7f736a091640 1 -- 172.21.15.55:0/1000602990 >> v1:172.21.15.55:6789/0 conn(0x7f736406e8f0 legacy=0x7f7364071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.564+0000 7f736a091640 1 -- 172.21.15.55:0/1000602990 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736406db30 con 0x7f73641451d0 2024-04-25T08:56:04.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.564+0000 7f736908f640 1 -- 172.21.15.55:0/1000602990 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479574554 0 0) 0x7f736406d570 con 0x7f736406e8f0 2024-04-25T08:56:04.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.564+0000 7f736a091640 1 --2- 172.21.15.55:0/1000602990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73641451d0 0x7f73640cce70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f735c0097a0 tx=0x7f735c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e011d7c6e696aada server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:04.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.564+0000 7f736908f640 1 -- 172.21.15.55:0/1000602990 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c037070 con 0x7f73641451d0 2024-04-25T08:56:04.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.564+0000 7f736908f640 1 -- 172.21.15.55:0/1000602990 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c032440 con 0x7f73641451d0 2024-04-25T08:56:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.564+0000 7f736908f640 1 -- 172.21.15.55:0/1000602990 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c032810 con 0x7f73641451d0 2024-04-25T08:56:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.565+0000 7f736c2f5640 1 -- 172.21.15.55:0/1000602990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73641451d0 msgr2=0x7f73640cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.565+0000 7f736c2f5640 1 --2- 172.21.15.55:0/1000602990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73641451d0 0x7f73640cce70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f735c0097a0 tx=0x7f735c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.565+0000 7f736c2f5640 1 -- 172.21.15.55:0/1000602990 shutdown_connections 2024-04-25T08:56:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.565+0000 7f736c2f5640 1 --2- 172.21.15.55:0/1000602990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73641451d0 0x7f73640cce70 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.565+0000 7f736c2f5640 1 -- 172.21.15.55:0/1000602990 >> 172.21.15.55:0/1000602990 conn(0x7f736406aba0 msgr2=0x7f736406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.565+0000 7f736c2f5640 1 -- 172.21.15.55:0/1000602990 shutdown_connections 2024-04-25T08:56:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.565+0000 7f736c2f5640 1 -- 172.21.15.55:0/1000602990 wait complete. 2024-04-25T08:56:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.566+0000 7f736c2f5640 1 Processor -- start 2024-04-25T08:56:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.566+0000 7f736c2f5640 1 -- start start 2024-04-25T08:56:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736c2f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f736406e8f0 0x7f7364137430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736c2f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73640718a0 0x7f73640aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736c2f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73641451d0 0x7f73640ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736c2f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73641455b0 con 0x7f73641451d0 2024-04-25T08:56:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736c2f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736406e0f0 con 0x7f736406e8f0 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736c2f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7364145730 con 0x7f73640718a0 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736a892640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73641451d0 0x7f73640ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736a892640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73641451d0 0x7f73640ab490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38628/0 (socket says 172.21.15.55:38628) 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736a892640 1 -- 172.21.15.55:0/149870959 learned_addr learned my addr 172.21.15.55:0/149870959 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736a091640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f736406e8f0 0x7f7364137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f7369890640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73640718a0 0x7f73640aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736a892640 1 -- 172.21.15.55:0/149870959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73640718a0 msgr2=0x7f73640aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736a892640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73640718a0 0x7f73640aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736a892640 1 -- 172.21.15.55:0/149870959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f736406e8f0 msgr2=0x7f7364137430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736a892640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f736406e8f0 0x7f7364137430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.567+0000 7f736a892640 1 -- 172.21.15.55:0/149870959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73640ad1c0 con 0x7f73641451d0 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.568+0000 7f736a892640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73641451d0 0x7f73640ab490 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f735400c7a0 tx=0x7f735400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.568+0000 7f7362ffd640 1 -- 172.21.15.55:0/149870959 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354003b70 con 0x7f73641451d0 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.568+0000 7f7362ffd640 1 -- 172.21.15.55:0/149870959 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7354003d30 con 0x7f73641451d0 2024-04-25T08:56:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.568+0000 7f7362ffd640 1 -- 172.21.15.55:0/149870959 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735400aa90 con 0x7f73641451d0 2024-04-25T08:56:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.568+0000 7f736c2f5640 1 -- 172.21.15.55:0/149870959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73640abac0 con 0x7f73641451d0 2024-04-25T08:56:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.568+0000 7f736c2f5640 1 -- 172.21.15.55:0/149870959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73640ac360 con 0x7f73641451d0 2024-04-25T08:56:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.569+0000 7f736c2f5640 1 -- 172.21.15.55:0/149870959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73640749b0 con 0x7f73641451d0 2024-04-25T08:56:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.569+0000 7f7362ffd640 1 -- 172.21.15.55:0/149870959 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f735400ac30 con 0x7f73641451d0 2024-04-25T08:56:04.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.570+0000 7f7362ffd640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f735006b4d0 0x7f735006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.570+0000 7f7362ffd640 1 -- 172.21.15.55:0/149870959 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7354089f80 con 0x7f73641451d0 2024-04-25T08:56:04.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.570+0000 7f736a091640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f735006b4d0 0x7f735006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.570+0000 7f736a091640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f735006b4d0 0x7f735006d990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f735c034000 tx=0x7f735c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:04.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.574+0000 7f7362ffd640 1 -- 172.21.15.55:0/149870959 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7354058800 con 0x7f73641451d0 2024-04-25T08:56:04.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.794+0000 7f736c2f5640 1 -- 172.21.15.55:0/149870959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73640af600 con 0x7f73641451d0 2024-04-25T08:56:04.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.795+0000 7f7362ffd640 1 -- 172.21.15.55:0/149870959 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f735405c8a0 con 0x7f73641451d0 2024-04-25T08:56:04.785 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3267261156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3267261156},{"type":"v1","addr":"172.21.15.167:6834","nonce":3267261156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/588514159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":588514159},{"type":"v1","addr":"172.21.15.167:6835","nonce":588514159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2276997137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2276997137},{"type":"v1","addr":"172.21.15.55:6835","nonce":2276997137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:55:16.159284+0000","modified":"2024-04-25T08:55:19.200438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/2070394524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":2070394524},{"type":"v1","addr":"172.21.15.55:6837","nonce":2070394524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:56:04.785 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 22 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 -- 172.21.15.55:0/149870959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f735006b4d0 msgr2=0x7f735006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f735006b4d0 0x7f735006d990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f735c034000 tx=0x7f735c02e000 comp rx=0 tx=0).stop 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 -- 172.21.15.55:0/149870959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73641451d0 msgr2=0x7f73640ab490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73641451d0 0x7f73640ab490 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f735400c7a0 tx=0x7f735400cc60 comp rx=0 tx=0).stop 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 -- 172.21.15.55:0/149870959 shutdown_connections 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f735006b4d0 0x7f735006d990 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73641451d0 0x7f73640ab490 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73640718a0 0x7f73640aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 --2- 172.21.15.55:0/149870959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f736406e8f0 0x7f7364137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 -- 172.21.15.55:0/149870959 >> 172.21.15.55:0/149870959 conn(0x7f736406aba0 msgr2=0x7f73640aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 -- 172.21.15.55:0/149870959 shutdown_connections 2024-04-25T08:56:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.797+0000 7f736c2f5640 1 -- 172.21.15.55:0/149870959 wait complete. 2024-04-25T08:56:04.797 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.911+0000 7f5b58e15640 1 Processor -- start 2024-04-25T08:56:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.911+0000 7f5b58e15640 1 -- start start 2024-04-25T08:56:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b58e15640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5b5415dce0 0x7f5b540d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b58e15640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b540d35b0 0x7f5b540b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b58e15640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b540d1f90 0x7f5b540b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b58e15640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5415e0c0 con 0x7f5b540d1f90 2024-04-25T08:56:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b58e15640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b540d2510 con 0x7f5b5415dce0 2024-04-25T08:56:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b58e15640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540d27f0 con 0x7f5b540d35b0 2024-04-25T08:56:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b52d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b540d1f90 0x7f5b540b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b52d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b540d1f90 0x7f5b540b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38632/0 (socket says 172.21.15.55:38632) 2024-04-25T08:56:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b52d9d640 1 -- 172.21.15.55:0/1164023844 learned_addr learned my addr 172.21.15.55:0/1164023844 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b51d9b640 1 --2- 172.21.15.55:0/1164023844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b540d35b0 0x7f5b540b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b5259c640 1 --2- 172.21.15.55:0/1164023844 >> v2:172.21.15.167:3300/0 conn(0x7f5b5415dce0 0x7f5b540d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b52d9d640 1 -- 172.21.15.55:0/1164023844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b540d35b0 msgr2=0x7f5b540b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b52d9d640 1 --2- 172.21.15.55:0/1164023844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b540d35b0 0x7f5b540b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b52d9d640 1 -- 172.21.15.55:0/1164023844 >> v2:172.21.15.167:3300/0 conn(0x7f5b5415dce0 msgr2=0x7f5b540d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b52d9d640 1 --2- 172.21.15.55:0/1164023844 >> v2:172.21.15.167:3300/0 conn(0x7f5b5415dce0 0x7f5b540d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.912+0000 7f5b52d9d640 1 -- 172.21.15.55:0/1164023844 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b540d2ad0 con 0x7f5b540d1f90 2024-04-25T08:56:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.913+0000 7f5b52d9d640 1 --2- 172.21.15.55:0/1164023844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b540d1f90 0x7f5b540b5990 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5b540ce220 tx=0x7f5b4402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd58d86dd2723cec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.913+0000 7f5b5159a640 1 -- 172.21.15.55:0/1164023844 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b44036070 con 0x7f5b540d1f90 2024-04-25T08:56:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.913+0000 7f5b5159a640 1 -- 172.21.15.55:0/1164023844 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b44031600 con 0x7f5b540d1f90 2024-04-25T08:56:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.913+0000 7f5b5159a640 1 -- 172.21.15.55:0/1164023844 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b440319d0 con 0x7f5b540d1f90 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.914+0000 7f5b58e15640 1 -- 172.21.15.55:0/1164023844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b540d1f90 msgr2=0x7f5b540b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.914+0000 7f5b58e15640 1 --2- 172.21.15.55:0/1164023844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b540d1f90 0x7f5b540b5990 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5b540ce220 tx=0x7f5b4402a610 comp rx=0 tx=0).stop 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.914+0000 7f5b58e15640 1 -- 172.21.15.55:0/1164023844 shutdown_connections 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.914+0000 7f5b58e15640 1 --2- 172.21.15.55:0/1164023844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b540d1f90 0x7f5b540b5990 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.914+0000 7f5b58e15640 1 --2- 172.21.15.55:0/1164023844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b540d35b0 0x7f5b540b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.914+0000 7f5b58e15640 1 --2- 172.21.15.55:0/1164023844 >> v2:172.21.15.167:3300/0 conn(0x7f5b5415dce0 0x7f5b540d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.914+0000 7f5b58e15640 1 -- 172.21.15.55:0/1164023844 >> 172.21.15.55:0/1164023844 conn(0x7f5b54072900 msgr2=0x7f5b540d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.914+0000 7f5b58e15640 1 -- 172.21.15.55:0/1164023844 shutdown_connections 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.914+0000 7f5b58e15640 1 -- 172.21.15.55:0/1164023844 wait complete. 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.915+0000 7f5b58e15640 1 Processor -- start 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.915+0000 7f5b58e15640 1 -- start start 2024-04-25T08:56:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b58e15640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b540d1f90 0x7f5b540c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b58e15640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b540d35b0 0x7f5b54145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b58e15640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b5415dce0 0x7f5b541461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b58e15640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540b9820 con 0x7f5b540d35b0 2024-04-25T08:56:04.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b58e15640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540d3090 con 0x7f5b5415dce0 2024-04-25T08:56:04.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b58e15640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540b99a0 con 0x7f5b540d1f90 2024-04-25T08:56:04.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b51d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b540d35b0 0x7f5b54145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b51d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b540d35b0 0x7f5b54145ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38634/0 (socket says 172.21.15.55:38634) 2024-04-25T08:56:04.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b51d9b640 1 -- 172.21.15.55:0/2908210975 learned_addr learned my addr 172.21.15.55:0/2908210975 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:04.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b52d9d640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b5415dce0 0x7f5b541461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b5259c640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b540d1f90 0x7f5b540c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b51d9b640 1 -- 172.21.15.55:0/2908210975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b540d1f90 msgr2=0x7f5b540c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b51d9b640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b540d1f90 0x7f5b540c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b51d9b640 1 -- 172.21.15.55:0/2908210975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b5415dce0 msgr2=0x7f5b541461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.916+0000 7f5b51d9b640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b5415dce0 0x7f5b541461e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.917+0000 7f5b51d9b640 1 -- 172.21.15.55:0/2908210975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b540cbac0 con 0x7f5b540d35b0 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.917+0000 7f5b51d9b640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b540d35b0 0x7f5b54145ca0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00e870 tx=0x7f5b3c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.917+0000 7f5b4affd640 1 -- 172.21.15.55:0/2908210975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c017070 con 0x7f5b540d35b0 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.917+0000 7f5b4affd640 1 -- 172.21.15.55:0/2908210975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c00ee60 con 0x7f5b540d35b0 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.917+0000 7f5b58e15640 1 -- 172.21.15.55:0/2908210975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b540cbd80 con 0x7f5b540d35b0 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.917+0000 7f5b4affd640 1 -- 172.21.15.55:0/2908210975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c00cb80 con 0x7f5b540d35b0 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.917+0000 7f5b58e15640 1 -- 172.21.15.55:0/2908210975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b540cc340 con 0x7f5b540d35b0 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.918+0000 7f5b58e15640 1 -- 172.21.15.55:0/2908210975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b540749b0 con 0x7f5b540d35b0 2024-04-25T08:56:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.918+0000 7f5b4affd640 1 -- 172.21.15.55:0/2908210975 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b3c01a070 con 0x7f5b540d35b0 2024-04-25T08:56:04.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.919+0000 7f5b4affd640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b3406b4d0 0x7f5b3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:04.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.919+0000 7f5b4affd640 1 -- 172.21.15.55:0/2908210975 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5b3c08a0c0 con 0x7f5b540d35b0 2024-04-25T08:56:04.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.919+0000 7f5b5259c640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b3406b4d0 0x7f5b3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:04.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.919+0000 7f5b5259c640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b3406b4d0 0x7f5b3406d990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009ad0 tx=0x7f5b4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:04.923+0000 7f5b4affd640 1 -- 172.21.15.55:0/2908210975 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b3c058f00 con 0x7f5b540d35b0 2024-04-25T08:56:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.143+0000 7f5b58e15640 1 -- 172.21.15.55:0/2908210975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b5415ca70 con 0x7f5b540d35b0 2024-04-25T08:56:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.144+0000 7f5b4affd640 1 -- 172.21.15.55:0/2908210975 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f5b3c058800 con 0x7f5b540d35b0 2024-04-25T08:56:05.134 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:05.134 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3267261156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3267261156},{"type":"v1","addr":"172.21.15.167:6834","nonce":3267261156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/588514159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":588514159},{"type":"v1","addr":"172.21.15.167:6835","nonce":588514159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2276997137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2276997137},{"type":"v1","addr":"172.21.15.55:6835","nonce":2276997137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:55:16.159284+0000","modified":"2024-04-25T08:55:19.200438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/2070394524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":2070394524},{"type":"v1","addr":"172.21.15.55:6837","nonce":2070394524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:56:05.134 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 22 2024-04-25T08:56:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 -- 172.21.15.55:0/2908210975 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b3406b4d0 msgr2=0x7f5b3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b3406b4d0 0x7f5b3406d990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009ad0 tx=0x7f5b4c008040 comp rx=0 tx=0).stop 2024-04-25T08:56:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 -- 172.21.15.55:0/2908210975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b540d35b0 msgr2=0x7f5b54145ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b540d35b0 0x7f5b54145ca0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00e870 tx=0x7f5b3c00ed30 comp rx=0 tx=0).stop 2024-04-25T08:56:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 -- 172.21.15.55:0/2908210975 shutdown_connections 2024-04-25T08:56:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b3406b4d0 0x7f5b3406d990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b5415dce0 0x7f5b541461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b540d35b0 0x7f5b54145ca0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 --2- 172.21.15.55:0/2908210975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b540d1f90 0x7f5b540c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 -- 172.21.15.55:0/2908210975 >> 172.21.15.55:0/2908210975 conn(0x7f5b54072900 msgr2=0x7f5b540b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:05.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 -- 172.21.15.55:0/2908210975 shutdown_connections 2024-04-25T08:56:05.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.146+0000 7f5b58e15640 1 -- 172.21.15.55:0/2908210975 wait complete. 2024-04-25T08:56:05.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:05.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.258+0000 7fb1abe76640 1 Processor -- start 2024-04-25T08:56:05.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.258+0000 7fb1abe76640 1 -- start start 2024-04-25T08:56:05.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1abe76640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1a40d35b0 0x7fb1a40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1abe76640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a40b5990 0x7fb1a40b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1abe76640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a415e0c0 con 0x7fb1a415dce0 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1abe76640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a40d2510 con 0x7fb1a40d35b0 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1abe76640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40d27f0 con 0x7fb1a40b5990 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1a9411640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1a40d35b0 0x7fb1a40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1a9411640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1a40d35b0 0x7fb1a40b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38644/0 (socket says 172.21.15.55:38644) 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1a9411640 1 -- 172.21.15.55:0/2573998814 learned_addr learned my addr 172.21.15.55:0/2573998814 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1aa413640 1 --2- 172.21.15.55:0/2573998814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a40b5990 0x7fb1a40b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1a9411640 1 -- 172.21.15.55:0/2573998814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a40b5990 msgr2=0x7fb1a40b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1a9411640 1 --2- 172.21.15.55:0/2573998814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a40b5990 0x7fb1a40b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.259+0000 7fb1a9411640 1 -- 172.21.15.55:0/2573998814 >> v1:172.21.15.167:6789/0 conn(0x7fb1a415dce0 legacy=0x7fb1a40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.260+0000 7fb1a9411640 1 -- 172.21.15.55:0/2573998814 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40d2ad0 con 0x7fb1a40d35b0 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.260+0000 7fb1aa413640 1 --2- 172.21.15.55:0/2573998814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a40b5990 0x7fb1a40b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.260+0000 7fb1a9411640 1 --2- 172.21.15.55:0/2573998814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a40d35b0 0x7fb1a40b5450 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb198009870 tx=0x7fb19802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd3739529476689 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.260+0000 7fb1a8c10640 1 -- 172.21.15.55:0/2573998814 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb198037070 con 0x7fb1a40d35b0 2024-04-25T08:56:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.260+0000 7fb1a8c10640 1 -- 172.21.15.55:0/2573998814 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb198032440 con 0x7fb1a40d35b0 2024-04-25T08:56:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.260+0000 7fb1a8c10640 1 -- 172.21.15.55:0/2573998814 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb198032810 con 0x7fb1a40d35b0 2024-04-25T08:56:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.261+0000 7fb1abe76640 1 -- 172.21.15.55:0/2573998814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a40d35b0 msgr2=0x7fb1a40b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.261+0000 7fb1abe76640 1 --2- 172.21.15.55:0/2573998814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a40d35b0 0x7fb1a40b5450 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb198009870 tx=0x7fb19802a210 comp rx=0 tx=0).stop 2024-04-25T08:56:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.261+0000 7fb1abe76640 1 -- 172.21.15.55:0/2573998814 shutdown_connections 2024-04-25T08:56:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.261+0000 7fb1abe76640 1 --2- 172.21.15.55:0/2573998814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a40b5990 0x7fb1a40b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.261+0000 7fb1abe76640 1 --2- 172.21.15.55:0/2573998814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a40d35b0 0x7fb1a40b5450 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.261+0000 7fb1abe76640 1 -- 172.21.15.55:0/2573998814 >> 172.21.15.55:0/2573998814 conn(0x7fb1a4072900 msgr2=0x7fb1a40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.261+0000 7fb1abe76640 1 -- 172.21.15.55:0/2573998814 shutdown_connections 2024-04-25T08:56:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.261+0000 7fb1abe76640 1 -- 172.21.15.55:0/2573998814 wait complete. 2024-04-25T08:56:05.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.262+0000 7fb1abe76640 1 Processor -- start 2024-04-25T08:56:05.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.262+0000 7fb1abe76640 1 -- start start 2024-04-25T08:56:05.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1abe76640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a40b5990 0x7fb1a4160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1abe76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1a40d35b0 0x7fb1a40caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1abe76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a415dce0 0x7fb1a41547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1abe76640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40d2160 con 0x7fb1a415dce0 2024-04-25T08:56:05.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1abe76640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40d3090 con 0x7fb1a40d35b0 2024-04-25T08:56:05.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1abe76640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40cafe0 con 0x7fb1a40b5990 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1aa413640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a415dce0 0x7fb1a41547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1aa413640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a415dce0 0x7fb1a41547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38654/0 (socket says 172.21.15.55:38654) 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1aa413640 1 -- 172.21.15.55:0/4064899106 learned_addr learned my addr 172.21.15.55:0/4064899106 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1a9c12640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a40b5990 0x7fb1a4160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1a9411640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1a40d35b0 0x7fb1a40caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1aa413640 1 -- 172.21.15.55:0/4064899106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a40b5990 msgr2=0x7fb1a4160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1aa413640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a40b5990 0x7fb1a4160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1aa413640 1 -- 172.21.15.55:0/4064899106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1a40d35b0 msgr2=0x7fb1a40caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1aa413640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1a40d35b0 0x7fb1a40caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1aa413640 1 -- 172.21.15.55:0/4064899106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40c8400 con 0x7fb1a415dce0 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.263+0000 7fb1a9411640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1a40d35b0 0x7fb1a40caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.264+0000 7fb1aa413640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a415dce0 0x7fb1a41547c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c7f0 tx=0x7fb19c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.264+0000 7fb1a27fc640 1 -- 172.21.15.55:0/4064899106 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c015070 con 0x7fb1a415dce0 2024-04-25T08:56:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.264+0000 7fb1a27fc640 1 -- 172.21.15.55:0/4064899106 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c007820 con 0x7fb1a415dce0 2024-04-25T08:56:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.264+0000 7fb1abe76640 1 -- 172.21.15.55:0/4064899106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a40cb270 con 0x7fb1a415dce0 2024-04-25T08:56:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.264+0000 7fb1a27fc640 1 -- 172.21.15.55:0/4064899106 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c007c50 con 0x7fb1a415dce0 2024-04-25T08:56:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.264+0000 7fb1abe76640 1 -- 172.21.15.55:0/4064899106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a40cbab0 con 0x7fb1a415dce0 2024-04-25T08:56:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.265+0000 7fb1abe76640 1 -- 172.21.15.55:0/4064899106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a40749b0 con 0x7fb1a415dce0 2024-04-25T08:56:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.265+0000 7fb1a27fc640 1 -- 172.21.15.55:0/4064899106 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb19c018070 con 0x7fb1a415dce0 2024-04-25T08:56:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.266+0000 7fb1a27fc640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19006b4d0 0x7fb19006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.266+0000 7fb1a27fc640 1 -- 172.21.15.55:0/4064899106 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb19c08a360 con 0x7fb1a415dce0 2024-04-25T08:56:05.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.266+0000 7fb1a9c12640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19006b4d0 0x7fb19006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.266+0000 7fb1a9c12640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19006b4d0 0x7fb19006d990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40ca1b0 tx=0x7fb19400d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:05.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.270+0000 7fb1a27fc640 1 -- 172.21.15.55:0/4064899106 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb1a40cb270 con 0x7fb1a415dce0 2024-04-25T08:56:05.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.452+0000 7fb1abe76640 1 -- 172.21.15.55:0/4064899106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1a41611a0 con 0x7fb1a415dce0 2024-04-25T08:56:05.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.454+0000 7fb1a27fc640 1 -- 172.21.15.55:0/4064899106 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16709 (secure 0 0 0) 0x7fb19c058ab0 con 0x7fb1a415dce0 2024-04-25T08:56:05.443 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:05.444 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:55:23.857114+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:55:14.449282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T08:55:15.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:05.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.455+0000 7fb1abe76640 1 -- 172.21.15.55:0/4064899106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19006b4d0 msgr2=0x7fb19006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.455+0000 7fb1abe76640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19006b4d0 0x7fb19006d990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40ca1b0 tx=0x7fb19400d040 comp rx=0 tx=0).stop 2024-04-25T08:56:05.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.455+0000 7fb1abe76640 1 -- 172.21.15.55:0/4064899106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a415dce0 msgr2=0x7fb1a41547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.455+0000 7fb1abe76640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a415dce0 0x7fb1a41547c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c7f0 tx=0x7fb19c00ccb0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.456+0000 7fb1abe76640 1 -- 172.21.15.55:0/4064899106 shutdown_connections 2024-04-25T08:56:05.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.456+0000 7fb1abe76640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19006b4d0 0x7fb19006d990 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.456+0000 7fb1abe76640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a415dce0 0x7fb1a41547c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.456+0000 7fb1abe76640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1a40d35b0 0x7fb1a40caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.456+0000 7fb1abe76640 1 --2- 172.21.15.55:0/4064899106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a40b5990 0x7fb1a4160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.456+0000 7fb1abe76640 1 -- 172.21.15.55:0/4064899106 >> 172.21.15.55:0/4064899106 conn(0x7fb1a4072900 msgr2=0x7fb1a40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:05.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.456+0000 7fb1abe76640 1 -- 172.21.15.55:0/4064899106 shutdown_connections 2024-04-25T08:56:05.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.456+0000 7fb1abe76640 1 -- 172.21.15.55:0/4064899106 wait complete. 2024-04-25T08:56:05.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:56:05.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.568+0000 7f273264a640 1 Processor -- start 2024-04-25T08:56:05.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.568+0000 7f273264a640 1 -- start start 2024-04-25T08:56:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f273264a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f272c15db80 0x7f272c0b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f273264a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0d0a10 0x7f272c0d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f273264a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c0d1cb0 con 0x7f272c0b2dc0 2024-04-25T08:56:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f273264a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0d2880 con 0x7f272c15db80 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f272b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f272c0b2dc0 0x7f272c0b6bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44346/0 (socket says 172.21.15.55:44346) 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f272b7fe640 1 -- 172.21.15.55:0/2697441345 learned_addr learned my addr 172.21.15.55:0/2697441345 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f273264a640 1 -- 172.21.15.55:0/2697441345 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0d13a0 con 0x7f272c0d0a10 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f272bfff640 1 --2- 172.21.15.55:0/2697441345 >> v2:172.21.15.167:3300/0 conn(0x7f272c15db80 0x7f272c0b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f2730be7640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0d0a10 0x7f272c0d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48996566 0 0) 0x7f272c0d1cb0 con 0x7f272c0b2dc0 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2714003520 con 0x7f272c0b2dc0 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.569+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 367639095 0 0) 0x7f2714003520 con 0x7f272c0b2dc0 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0d0a10 msgr2=0x7f272c0d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0d0a10 0x7f272c0d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 >> v2:172.21.15.167:3300/0 conn(0x7f272c15db80 msgr2=0x7f272c0b93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 --2- 172.21.15.55:0/2697441345 >> v2:172.21.15.167:3300/0 conn(0x7f272c15db80 0x7f272c0b93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c0d1f50 con 0x7f272c0b2dc0 2024-04-25T08:56:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f2720001670 con 0x7f272c0b2dc0 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272bfff640 1 --2- 172.21.15.55:0/2697441345 >> v2:172.21.15.167:3300/0 conn(0x7f272c15db80 0x7f272c0b93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f2730be7640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0d0a10 0x7f272c0d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 >> v1:172.21.15.55:6789/0 conn(0x7f272c0b2dc0 legacy=0x7f272c0b6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 0x7f2714003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2714004800 0x7f2714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0d0a10 0x7f27140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0d13a0 con 0x7f27140039b0 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271400b9c0 con 0x7f2714004800 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271400bb40 con 0x7f272c0d0a10 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272bfff640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 0x7f2714003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272b7fe640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2714004800 0x7f2714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f2730be7640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0d0a10 0x7f27140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272bfff640 1 -- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0d0a10 msgr2=0x7f27140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272bfff640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0d0a10 0x7f27140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272bfff640 1 -- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2714004800 msgr2=0x7f2714004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272bfff640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2714004800 0x7f2714004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f272bfff640 1 -- 172.21.15.55:0/2697441345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714003520 con 0x7f27140039b0 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.570+0000 7f2730be7640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0d0a10 0x7f27140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.571+0000 7f272bfff640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 0x7f2714003dd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f271c009c90 tx=0x7f2714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c012c03c1dcd9ada server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.571+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c036070 con 0x7f27140039b0 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.571+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c031400 con 0x7f27140039b0 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.571+0000 7f272affd640 1 -- 172.21.15.55:0/2697441345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c009860 con 0x7f27140039b0 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.571+0000 7f273264a640 1 -- 172.21.15.55:0/2697441345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 msgr2=0x7f2714003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.571+0000 7f273264a640 1 --2- 172.21.15.55:0/2697441345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 0x7f2714003dd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f271c009c90 tx=0x7f2714005830 comp rx=0 tx=0).stop 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.571+0000 7f2730be7640 1 -- 172.21.15.55:0/2697441345 reap_dead start 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.572+0000 7f273264a640 1 -- 172.21.15.55:0/2697441345 shutdown_connections 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.572+0000 7f273264a640 1 -- 172.21.15.55:0/2697441345 >> 172.21.15.55:0/2697441345 conn(0x7f272c0726c0 msgr2=0x7f272c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.572+0000 7f273264a640 1 -- 172.21.15.55:0/2697441345 shutdown_connections 2024-04-25T08:56:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.572+0000 7f273264a640 1 -- 172.21.15.55:0/2697441345 wait complete. 2024-04-25T08:56:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.573+0000 7f273264a640 1 Processor -- start 2024-04-25T08:56:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.573+0000 7f273264a640 1 -- start start 2024-04-25T08:56:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f273264a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 0x7f272c1e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f273264a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f272c0ccfa0 0x7f272c1e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f273264a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0cd420 0x7f272c1e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f273264a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0b72d0 con 0x7f27140039b0 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f273264a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0d2510 con 0x7f272c0ccfa0 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f273264a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c15df60 con 0x7f272c0cd420 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f272bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 0x7f272c1e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f272bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 0x7f272c1e7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38672/0 (socket says 172.21.15.55:38672) 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f272bfff640 1 -- 172.21.15.55:0/647877631 learned_addr learned my addr 172.21.15.55:0/647877631 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f272b7fe640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f272c0ccfa0 0x7f272c1e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f2730be7640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0cd420 0x7f272c1e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f272bfff640 1 -- 172.21.15.55:0/647877631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0cd420 msgr2=0x7f272c1e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f272bfff640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0cd420 0x7f272c1e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f272bfff640 1 -- 172.21.15.55:0/647877631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f272c0ccfa0 msgr2=0x7f272c1e61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f272bfff640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f272c0ccfa0 0x7f272c1e61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f272bfff640 1 -- 172.21.15.55:0/647877631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c1e6e70 con 0x7f27140039b0 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f272bfff640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 0x7f272c1e7ef0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f271c000c00 tx=0x7f271c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.574+0000 7f2728ff9640 1 -- 172.21.15.55:0/647877631 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c040070 con 0x7f27140039b0 2024-04-25T08:56:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.575+0000 7f2728ff9640 1 -- 172.21.15.55:0/647877631 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c03b680 con 0x7f27140039b0 2024-04-25T08:56:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.575+0000 7f273264a640 1 -- 172.21.15.55:0/647877631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c1e7150 con 0x7f27140039b0 2024-04-25T08:56:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.575+0000 7f2728ff9640 1 -- 172.21.15.55:0/647877631 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c036040 con 0x7f27140039b0 2024-04-25T08:56:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.575+0000 7f273264a640 1 -- 172.21.15.55:0/647877631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c1e7710 con 0x7f27140039b0 2024-04-25T08:56:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.576+0000 7f273264a640 1 -- 172.21.15.55:0/647877631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c0750b0 con 0x7f27140039b0 2024-04-25T08:56:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.576+0000 7f2728ff9640 1 -- 172.21.15.55:0/647877631 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f271c043070 con 0x7f27140039b0 2024-04-25T08:56:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.577+0000 7f2728ff9640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271806b4d0 0x7f271806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.577+0000 7f272b7fe640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271806b4d0 0x7f271806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.577+0000 7f2728ff9640 1 -- 172.21.15.55:0/647877631 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f271c0aa890 con 0x7f27140039b0 2024-04-25T08:56:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.577+0000 7f272b7fe640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271806b4d0 0x7f271806d990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f272c15ca60 tx=0x7f2720009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.581+0000 7f2728ff9640 1 -- 172.21.15.55:0/647877631 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f271c078ff0 con 0x7f27140039b0 2024-04-25T08:56:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.800+0000 7f273264a640 1 -- 172.21.15.55:0/647877631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f272c15d210 con 0x7f27140039b0 2024-04-25T08:56:05.790 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T08:56:05.800+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:56:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.807+0000 7f2728ff9640 1 -- 172.21.15.55:0/647877631 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f271c07d090 con 0x7f27140039b0 2024-04-25T08:56:05.796 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 -- 172.21.15.55:0/647877631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271806b4d0 msgr2=0x7f271806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271806b4d0 0x7f271806d990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f272c15ca60 tx=0x7f2720009040 comp rx=0 tx=0).stop 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 -- 172.21.15.55:0/647877631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 msgr2=0x7f272c1e7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 0x7f272c1e7ef0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f271c000c00 tx=0x7f271c004730 comp rx=0 tx=0).stop 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 -- 172.21.15.55:0/647877631 shutdown_connections 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f271806b4d0 0x7f271806d990 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f272c0cd420 0x7f272c1e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f272c0ccfa0 0x7f272c1e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 --2- 172.21.15.55:0/647877631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27140039b0 0x7f272c1e7ef0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 -- 172.21.15.55:0/647877631 >> 172.21.15.55:0/647877631 conn(0x7f272c0726c0 msgr2=0x7f272c0d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 -- 172.21.15.55:0/647877631 shutdown_connections 2024-04-25T08:56:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.809+0000 7f273264a640 1 -- 172.21.15.55:0/647877631 wait complete. 2024-04-25T08:56:05.801 INFO:tasks.ceph.mds.c.smithi055.stderr: -5994> 2024-04-25T08:55:18.782+0000 7fd2cfdc7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:56:05.804 INFO:tasks.ceph.mds.c.smithi055.stderr: -3134> 2024-04-25T08:55:29.190+0000 7fd2cbdbf640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5102=0-4194304@1} caps={5102=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5102 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55929f80a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T08:56:05.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:56:05.833 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T08:56:05.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.925+0000 7f44a929e640 1 Processor -- start 2024-04-25T08:56:05.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.926+0000 7f44a929e640 1 -- start start 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.926+0000 7f44a929e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44a40b42c0 0x7f44a415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.926+0000 7f44a929e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44a415aef0 0x7f44a40cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.926+0000 7f44a929e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a415b370 con 0x7f44a40b46a0 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.926+0000 7f44a929e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a40d05d0 con 0x7f44a40b42c0 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.926+0000 7f44a929e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a415b650 con 0x7f44a415aef0 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.926+0000 7f44a2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44a40b42c0 0x7f44a415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.927+0000 7f44a37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f44a40b46a0 0x7f44a41549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44362/0 (socket says 172.21.15.55:44362) 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.927+0000 7f44a37fe640 1 -- 172.21.15.55:0/4065452735 learned_addr learned my addr 172.21.15.55:0/4065452735 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.927+0000 7f44a27fc640 1 --2- 172.21.15.55:0/4065452735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44a415aef0 0x7f44a40cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.927+0000 7f44a2ffd640 1 -- 172.21.15.55:0/4065452735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44a415aef0 msgr2=0x7f44a40cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.927+0000 7f44a2ffd640 1 --2- 172.21.15.55:0/4065452735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44a415aef0 0x7f44a40cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.927+0000 7f44a2ffd640 1 -- 172.21.15.55:0/4065452735 >> v1:172.21.15.55:6789/0 conn(0x7f44a40b46a0 legacy=0x7f44a41549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.927+0000 7f44a2ffd640 1 -- 172.21.15.55:0/4065452735 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a415b930 con 0x7f44a40b42c0 2024-04-25T08:56:05.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.927+0000 7f44a27fc640 1 --2- 172.21.15.55:0/4065452735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44a415aef0 0x7f44a40cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:05.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a2ffd640 1 --2- 172.21.15.55:0/4065452735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a40b42c0 0x7f44a415ef40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f44940097d0 tx=0x7f449402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d931113ce41925d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:05.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a1ffb640 1 -- 172.21.15.55:0/4065452735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494037070 con 0x7f44a40b42c0 2024-04-25T08:56:05.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a1ffb640 1 -- 172.21.15.55:0/4065452735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449402adb0 con 0x7f44a40b42c0 2024-04-25T08:56:05.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a1ffb640 1 -- 172.21.15.55:0/4065452735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494032660 con 0x7f44a40b42c0 2024-04-25T08:56:05.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a929e640 1 -- 172.21.15.55:0/4065452735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a40b42c0 msgr2=0x7f44a415ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a929e640 1 --2- 172.21.15.55:0/4065452735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a40b42c0 0x7f44a415ef40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f44940097d0 tx=0x7f449402a0a0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a929e640 1 -- 172.21.15.55:0/4065452735 shutdown_connections 2024-04-25T08:56:05.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a929e640 1 --2- 172.21.15.55:0/4065452735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44a415aef0 0x7f44a40cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a929e640 1 --2- 172.21.15.55:0/4065452735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a40b42c0 0x7f44a415ef40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a929e640 1 -- 172.21.15.55:0/4065452735 >> 172.21.15.55:0/4065452735 conn(0x7f44a406aba0 msgr2=0x7f44a406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:05.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a929e640 1 -- 172.21.15.55:0/4065452735 shutdown_connections 2024-04-25T08:56:05.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.928+0000 7f44a929e640 1 -- 172.21.15.55:0/4065452735 wait complete. 2024-04-25T08:56:05.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.930+0000 7f44a929e640 1 Processor -- start 2024-04-25T08:56:05.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.930+0000 7f44a929e640 1 -- start start 2024-04-25T08:56:05.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.930+0000 7f44a929e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44a40b42c0 0x7f44a41f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.930+0000 7f44a929e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44a40b46a0 0x7f44a41e56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.930+0000 7f44a929e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a415aef0 0x7f44a41e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.930+0000 7f44a929e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a406eae0 con 0x7f44a415aef0 2024-04-25T08:56:05.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.930+0000 7f44a929e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40cf980 con 0x7f44a40b46a0 2024-04-25T08:56:05.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.930+0000 7f44a929e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a406ec60 con 0x7f44a40b42c0 2024-04-25T08:56:05.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a415aef0 0x7f44a41e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a415aef0 0x7f44a41e3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38700/0 (socket says 172.21.15.55:38700) 2024-04-25T08:56:05.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a37fe640 1 -- 172.21.15.55:0/3550888826 learned_addr learned my addr 172.21.15.55:0/3550888826 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a2ffd640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44a40b42c0 0x7f44a41f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a27fc640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44a40b46a0 0x7f44a41e56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a37fe640 1 -- 172.21.15.55:0/3550888826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44a40b42c0 msgr2=0x7f44a41f1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a37fe640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44a40b42c0 0x7f44a41f1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a37fe640 1 -- 172.21.15.55:0/3550888826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44a40b46a0 msgr2=0x7f44a41e56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a37fe640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44a40b46a0 0x7f44a41e56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a37fe640 1 -- 172.21.15.55:0/3550888826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a41e4350 con 0x7f44a415aef0 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a37fe640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a415aef0 0x7f44a41e3e10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f449c00caf0 tx=0x7f449c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f448b7fe640 1 -- 172.21.15.55:0/3550888826 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c017070 con 0x7f44a415aef0 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f448b7fe640 1 -- 172.21.15.55:0/3550888826 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c00aca0 con 0x7f44a415aef0 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a929e640 1 -- 172.21.15.55:0/3550888826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a4151ac0 con 0x7f44a415aef0 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f448b7fe640 1 -- 172.21.15.55:0/3550888826 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c012600 con 0x7f44a415aef0 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.931+0000 7f44a929e640 1 -- 172.21.15.55:0/3550888826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a4152060 con 0x7f44a415aef0 2024-04-25T08:56:05.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.932+0000 7f44a929e640 1 -- 172.21.15.55:0/3550888826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a40750b0 con 0x7f44a415aef0 2024-04-25T08:56:05.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.933+0000 7f448b7fe640 1 -- 172.21.15.55:0/3550888826 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f449c01a070 con 0x7f44a415aef0 2024-04-25T08:56:05.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.933+0000 7f448b7fe640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f449006b4d0 0x7f449006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:05.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.933+0000 7f448b7fe640 1 -- 172.21.15.55:0/3550888826 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f449c089eb0 con 0x7f44a415aef0 2024-04-25T08:56:05.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.933+0000 7f44a2ffd640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f449006b4d0 0x7f449006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:05.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.934+0000 7f44a2ffd640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f449006b4d0 0x7f449006d990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4494034000 tx=0x7f449402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:05.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:05.937+0000 7f448b7fe640 1 -- 172.21.15.55:0/3550888826 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f449c058650 con 0x7f44a415aef0 2024-04-25T08:56:06.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.156+0000 7f44a929e640 1 -- 172.21.15.55:0/3550888826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f44a40b1c20 con 0x7f44a415aef0 2024-04-25T08:56:06.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.812+0000 7f448b7fe640 1 -- 172.21.15.55:0/3550888826 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f449c05c6f0 con 0x7f44a415aef0 2024-04-25T08:56:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 -- 172.21.15.55:0/3550888826 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f449006b4d0 msgr2=0x7f449006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f449006b4d0 0x7f449006d990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4494034000 tx=0x7f449402e000 comp rx=0 tx=0).stop 2024-04-25T08:56:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 -- 172.21.15.55:0/3550888826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a415aef0 msgr2=0x7f44a41e3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a415aef0 0x7f44a41e3e10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f449c00caf0 tx=0x7f449c00a060 comp rx=0 tx=0).stop 2024-04-25T08:56:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 -- 172.21.15.55:0/3550888826 shutdown_connections 2024-04-25T08:56:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f449006b4d0 0x7f449006d990 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a415aef0 0x7f44a41e3e10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44a40b46a0 0x7f44a41e56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 --2- 172.21.15.55:0/3550888826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44a40b42c0 0x7f44a41f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 -- 172.21.15.55:0/3550888826 >> 172.21.15.55:0/3550888826 conn(0x7f44a406aba0 msgr2=0x7f44a406af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 -- 172.21.15.55:0/3550888826 shutdown_connections 2024-04-25T08:56:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.815+0000 7f44a929e640 1 -- 172.21.15.55:0/3550888826 wait complete. 2024-04-25T08:56:06.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:56:06.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.982+0000 7f867d4a3640 1 Processor -- start 2024-04-25T08:56:06.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.982+0000 7f867d4a3640 1 -- start start 2024-04-25T08:56:06.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.983+0000 7f867d4a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86780b35e0 0x7f8678162350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:06.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.983+0000 7f867d4a3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86780b3f80 0x7f8678160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:06.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.983+0000 7f867d4a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86780cfed0 con 0x7f86780b39c0 2024-04-25T08:56:06.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.983+0000 7f867d4a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8678162890 con 0x7f86780b35e0 2024-04-25T08:56:06.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.983+0000 7f867d4a3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780cf850 con 0x7f86780b3f80 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.983+0000 7f8676ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86780b35e0 0x7f8678162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.983+0000 7f86777fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f86780b39c0 0x7f86780cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44374/0 (socket says 172.21.15.55:44374) 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.983+0000 7f86777fe640 1 -- 172.21.15.55:0/464453264 learned_addr learned my addr 172.21.15.55:0/464453264 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.984+0000 7f8675ffb640 1 -- 172.21.15.55:0/464453264 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066265585 0 0) 0x7f86780cfed0 con 0x7f86780b39c0 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.984+0000 7f8675ffb640 1 -- 172.21.15.55:0/464453264 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8664003520 con 0x7f86780b39c0 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.984+0000 7f8676ffd640 1 -- 172.21.15.55:0/464453264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86780b3f80 msgr2=0x7f8678160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.984+0000 7f86767fc640 1 --2- 172.21.15.55:0/464453264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86780b3f80 0x7f8678160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.984+0000 7f8676ffd640 1 --2- 172.21.15.55:0/464453264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86780b3f80 0x7f8678160cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.984+0000 7f8676ffd640 1 -- 172.21.15.55:0/464453264 >> v1:172.21.15.55:6789/0 conn(0x7f86780b39c0 legacy=0x7f86780cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.984+0000 7f8676ffd640 1 -- 172.21.15.55:0/464453264 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86780cfb30 con 0x7f86780b35e0 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.984+0000 7f86767fc640 1 --2- 172.21.15.55:0/464453264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86780b3f80 0x7f8678160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f8676ffd640 1 --2- 172.21.15.55:0/464453264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86780b35e0 0x7f8678162350 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f86700097a0 tx=0x7f867002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f481047ab2b579e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f8675ffb640 1 -- 172.21.15.55:0/464453264 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670037070 con 0x7f86780b35e0 2024-04-25T08:56:06.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f8675ffb640 1 -- 172.21.15.55:0/464453264 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867002ae50 con 0x7f86780b35e0 2024-04-25T08:56:06.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f8675ffb640 1 -- 172.21.15.55:0/464453264 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670032660 con 0x7f86780b35e0 2024-04-25T08:56:06.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f867d4a3640 1 -- 172.21.15.55:0/464453264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86780b35e0 msgr2=0x7f8678162350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f867d4a3640 1 --2- 172.21.15.55:0/464453264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86780b35e0 0x7f8678162350 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f86700097a0 tx=0x7f867002a100 comp rx=0 tx=0).stop 2024-04-25T08:56:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f867d4a3640 1 -- 172.21.15.55:0/464453264 shutdown_connections 2024-04-25T08:56:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f867d4a3640 1 --2- 172.21.15.55:0/464453264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86780b3f80 0x7f8678160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f867d4a3640 1 --2- 172.21.15.55:0/464453264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86780b35e0 0x7f8678162350 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f867d4a3640 1 -- 172.21.15.55:0/464453264 >> 172.21.15.55:0/464453264 conn(0x7f867806f4c0 msgr2=0x7f867806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f867d4a3640 1 -- 172.21.15.55:0/464453264 shutdown_connections 2024-04-25T08:56:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.985+0000 7f867d4a3640 1 -- 172.21.15.55:0/464453264 wait complete. 2024-04-25T08:56:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.987+0000 7f867d4a3640 1 Processor -- start 2024-04-25T08:56:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.987+0000 7f867d4a3640 1 -- start start 2024-04-25T08:56:06.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.987+0000 7f867d4a3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86780b35e0 0x7f8678154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:06.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.987+0000 7f867d4a3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86780b39c0 0x7f86780b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:06.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.987+0000 7f867d4a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86780b3f80 0x7f8678160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.987+0000 7f867d4a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780d05d0 con 0x7f86780b3f80 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.987+0000 7f867d4a3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780d0450 con 0x7f86780b39c0 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.987+0000 7f867d4a3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780cd510 con 0x7f86780b35e0 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f86777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86780b3f80 0x7f8678160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f86777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86780b3f80 0x7f8678160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38726/0 (socket says 172.21.15.55:38726) 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f86777fe640 1 -- 172.21.15.55:0/2516295689 learned_addr learned my addr 172.21.15.55:0/2516295689 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f8676ffd640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86780b35e0 0x7f8678154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f86777fe640 1 -- 172.21.15.55:0/2516295689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86780b35e0 msgr2=0x7f8678154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f86777fe640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86780b35e0 0x7f8678154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f86777fe640 1 -- 172.21.15.55:0/2516295689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86780b39c0 msgr2=0x7f86780b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f86777fe640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86780b39c0 0x7f86780b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f86777fe640 1 -- 172.21.15.55:0/2516295689 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86780c8da0 con 0x7f86780b3f80 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f86777fe640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86780b3f80 0x7f8678160ac0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f866800cb40 tx=0x7f866800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:06.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f866f7fe640 1 -- 172.21.15.55:0/2516295689 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8668017070 con 0x7f86780b3f80 2024-04-25T08:56:06.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f866f7fe640 1 -- 172.21.15.55:0/2516295689 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866800aca0 con 0x7f86780b3f80 2024-04-25T08:56:06.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f867d4a3640 1 -- 172.21.15.55:0/2516295689 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86780c9080 con 0x7f86780b3f80 2024-04-25T08:56:06.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f866f7fe640 1 -- 172.21.15.55:0/2516295689 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8668012620 con 0x7f86780b3f80 2024-04-25T08:56:06.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.988+0000 7f867d4a3640 1 -- 172.21.15.55:0/2516295689 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86780c9640 con 0x7f86780b3f80 2024-04-25T08:56:06.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.989+0000 7f867d4a3640 1 -- 172.21.15.55:0/2516295689 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86780750b0 con 0x7f86780b3f80 2024-04-25T08:56:06.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.990+0000 7f866f7fe640 1 -- 172.21.15.55:0/2516295689 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f866801a070 con 0x7f86780b3f80 2024-04-25T08:56:06.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.990+0000 7f866f7fe640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f865806b4d0 0x7f865806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:06.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.990+0000 7f8676ffd640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f865806b4d0 0x7f865806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:06.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.990+0000 7f866f7fe640 1 -- 172.21.15.55:0/2516295689 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f866808a140 con 0x7f86780b3f80 2024-04-25T08:56:06.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.991+0000 7f8676ffd640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f865806b4d0 0x7f865806d990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8670034000 tx=0x7f867002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:06.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:06.994+0000 7f866f7fe640 1 -- 172.21.15.55:0/2516295689 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8668058f30 con 0x7f86780b3f80 2024-04-25T08:56:07.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.175+0000 7f867d4a3640 1 -- 172.21.15.55:0/2516295689 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8678160480 con 0x7f86780b3f80 2024-04-25T08:56:07.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.817+0000 7f866f7fe640 1 -- 172.21.15.55:0/2516295689 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8668058830 con 0x7f86780b3f80 2024-04-25T08:56:07.807 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:56:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 -- 172.21.15.55:0/2516295689 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f865806b4d0 msgr2=0x7f865806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f865806b4d0 0x7f865806d990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8670034000 tx=0x7f867002e000 comp rx=0 tx=0).stop 2024-04-25T08:56:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 -- 172.21.15.55:0/2516295689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86780b3f80 msgr2=0x7f8678160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86780b3f80 0x7f8678160ac0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f866800cb40 tx=0x7f866800a060 comp rx=0 tx=0).stop 2024-04-25T08:56:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 -- 172.21.15.55:0/2516295689 shutdown_connections 2024-04-25T08:56:07.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f865806b4d0 0x7f865806d990 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:07.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86780b3f80 0x7f8678160ac0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:07.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86780b39c0 0x7f86780b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:07.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 --2- 172.21.15.55:0/2516295689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86780b35e0 0x7f8678154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:07.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 -- 172.21.15.55:0/2516295689 >> 172.21.15.55:0/2516295689 conn(0x7f867806f4c0 msgr2=0x7f867806c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:07.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 -- 172.21.15.55:0/2516295689 shutdown_connections 2024-04-25T08:56:07.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.819+0000 7f867d4a3640 1 -- 172.21.15.55:0/2516295689 wait complete. 2024-04-25T08:56:07.827 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:56:07.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.947+0000 7f00b7bd5640 1 Processor -- start 2024-04-25T08:56:07.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.948+0000 7f00b7bd5640 1 -- start start 2024-04-25T08:56:07.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.948+0000 7f00b7bd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f00b00cc8c0 0x7f00b00cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:07.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.948+0000 7f00b7bd5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b0070440 con 0x7f00b006aba0 2024-04-25T08:56:07.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.948+0000 7f00b7bd5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b00caed0 con 0x7f00b006f980 2024-04-25T08:56:07.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.948+0000 7f00b7bd5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b015e280 con 0x7f00b00cc8c0 2024-04-25T08:56:07.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.949+0000 7f00b6172640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f00b00cc8c0 0x7f00b00cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:07.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.949+0000 7f00b5971640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f00b006aba0 0x7f00b006af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44380/0 (socket says 172.21.15.55:44380) 2024-04-25T08:56:07.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.949+0000 7f00b6172640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f00b00cc8c0 0x7f00b00cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38736/0 (socket says 172.21.15.55:38736) 2024-04-25T08:56:07.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.949+0000 7f00b5971640 1 -- 172.21.15.55:0/4036317843 learned_addr learned my addr 172.21.15.55:0/4036317843 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:07.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.949+0000 7f00b6172640 1 -- 172.21.15.55:0/4036317843 >> v1:172.21.15.167:6789/0 conn(0x7f00b006f980 legacy=0x7f00b00cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:07.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.949+0000 7f00b6172640 1 -- 172.21.15.55:0/4036317843 >> v1:172.21.15.55:6789/0 conn(0x7f00b006aba0 legacy=0x7f00b006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:07.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.949+0000 7f00b6172640 1 -- 172.21.15.55:0/4036317843 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b006fe80 con 0x7f00b00cc8c0 2024-04-25T08:56:07.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.949+0000 7f00b496f640 1 -- 172.21.15.55:0/4036317843 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077711033 0 0) 0x7f00b0070440 con 0x7f00b006aba0 2024-04-25T08:56:07.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.950+0000 7f00b6172640 1 --2- 172.21.15.55:0/4036317843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00b00cc8c0 0x7f00b00cbda0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009d90 tx=0x7f00a802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f631c596a28b247 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:07.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.950+0000 7f00b496f640 1 -- 172.21.15.55:0/4036317843 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8007740 con 0x7f00b00cc8c0 2024-04-25T08:56:07.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.950+0000 7f00b496f640 1 -- 172.21.15.55:0/4036317843 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a80078e0 con 0x7f00b00cc8c0 2024-04-25T08:56:07.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.950+0000 7f00b496f640 1 -- 172.21.15.55:0/4036317843 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8007cb0 con 0x7f00b00cc8c0 2024-04-25T08:56:07.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.950+0000 7f00b7bd5640 1 -- 172.21.15.55:0/4036317843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00b00cc8c0 msgr2=0x7f00b00cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:07.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.950+0000 7f00b7bd5640 1 --2- 172.21.15.55:0/4036317843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00b00cc8c0 0x7f00b00cbda0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009d90 tx=0x7f00a802a6a0 comp rx=0 tx=0).stop 2024-04-25T08:56:07.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.950+0000 7f00b7bd5640 1 -- 172.21.15.55:0/4036317843 shutdown_connections 2024-04-25T08:56:07.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.950+0000 7f00b7bd5640 1 --2- 172.21.15.55:0/4036317843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00b00cc8c0 0x7f00b00cbda0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:07.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.950+0000 7f00b7bd5640 1 -- 172.21.15.55:0/4036317843 >> 172.21.15.55:0/4036317843 conn(0x7f00b00d0750 msgr2=0x7f00b00d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:07.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.950+0000 7f00b7bd5640 1 -- 172.21.15.55:0/4036317843 shutdown_connections 2024-04-25T08:56:07.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.951+0000 7f00b7bd5640 1 -- 172.21.15.55:0/4036317843 wait complete. 2024-04-25T08:56:07.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.952+0000 7f00b7bd5640 1 Processor -- start 2024-04-25T08:56:07.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.952+0000 7f00b7bd5640 1 -- start start 2024-04-25T08:56:07.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.952+0000 7f00b7bd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00b006aba0 0x7f00b014fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.952+0000 7f00b7bd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b006f980 0x7f00b014f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.952+0000 7f00b7bd5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b00cc8c0 0x7f00b01527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.952+0000 7f00b7bd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b006b950 con 0x7f00b006aba0 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.952+0000 7f00b7bd5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00cb170 con 0x7f00b00cc8c0 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.952+0000 7f00b7bd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b006bad0 con 0x7f00b006f980 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.952+0000 7f00b5971640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00b006aba0 0x7f00b014fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b5971640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00b006aba0 0x7f00b014fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38744/0 (socket says 172.21.15.55:38744) 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b5971640 1 -- 172.21.15.55:0/326184273 learned_addr learned my addr 172.21.15.55:0/326184273 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b6172640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b00cc8c0 0x7f00b01527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b5170640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b006f980 0x7f00b014f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b5971640 1 -- 172.21.15.55:0/326184273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b006f980 msgr2=0x7f00b014f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b5971640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b006f980 0x7f00b014f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b5971640 1 -- 172.21.15.55:0/326184273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b00cc8c0 msgr2=0x7f00b01527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:07.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b5971640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b00cc8c0 0x7f00b01527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:07.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b5971640 1 -- 172.21.15.55:0/326184273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0152d00 con 0x7f00b006aba0 2024-04-25T08:56:07.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b5971640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00b006aba0 0x7f00b014fd20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c4d0 tx=0x7f00ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:07.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00a67fc640 1 -- 172.21.15.55:0/326184273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac018070 con 0x7f00b006aba0 2024-04-25T08:56:07.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00a67fc640 1 -- 172.21.15.55:0/326184273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac007500 con 0x7f00b006aba0 2024-04-25T08:56:07.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b7bd5640 1 -- 172.21.15.55:0/326184273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b0150300 con 0x7f00b006aba0 2024-04-25T08:56:07.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00a67fc640 1 -- 172.21.15.55:0/326184273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac004a20 con 0x7f00b006aba0 2024-04-25T08:56:07.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.953+0000 7f00b7bd5640 1 -- 172.21.15.55:0/326184273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b01508c0 con 0x7f00b006aba0 2024-04-25T08:56:07.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.954+0000 7f00b7bd5640 1 -- 172.21.15.55:0/326184273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b00750b0 con 0x7f00b006aba0 2024-04-25T08:56:07.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.955+0000 7f00a67fc640 1 -- 172.21.15.55:0/326184273 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f00ac01b070 con 0x7f00b006aba0 2024-04-25T08:56:07.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.955+0000 7f00a67fc640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f009406b4d0 0x7f009406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:07.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.955+0000 7f00a67fc640 1 -- 172.21.15.55:0/326184273 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f00ac089360 con 0x7f00b006aba0 2024-04-25T08:56:07.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.955+0000 7f00b5170640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f009406b4d0 0x7f009406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:07.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.956+0000 7f00b5170640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f009406b4d0 0x7f009406d990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f00b015c350 tx=0x7f00a0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:07.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:07.960+0000 7f00a67fc640 1 -- 172.21.15.55:0/326184273 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f00b0152d00 con 0x7f00b006aba0 2024-04-25T08:56:08.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.141+0000 7f00b7bd5640 1 -- 172.21.15.55:0/326184273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f00b00cfe00 con 0x7f00b006aba0 2024-04-25T08:56:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.823+0000 7f00a67fc640 1 -- 172.21.15.55:0/326184273 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7f00ac058390 con 0x7f00b006aba0 2024-04-25T08:56:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-25T08:56:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 -- 172.21.15.55:0/326184273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f009406b4d0 msgr2=0x7f009406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f009406b4d0 0x7f009406d990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f00b015c350 tx=0x7f00a0009040 comp rx=0 tx=0).stop 2024-04-25T08:56:08.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 -- 172.21.15.55:0/326184273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00b006aba0 msgr2=0x7f00b014fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:08.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00b006aba0 0x7f00b014fd20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c4d0 tx=0x7f00ac00c990 comp rx=0 tx=0).stop 2024-04-25T08:56:08.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 -- 172.21.15.55:0/326184273 shutdown_connections 2024-04-25T08:56:08.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f009406b4d0 0x7f009406d990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:08.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b00cc8c0 0x7f00b01527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:08.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b006f980 0x7f00b014f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:08.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 --2- 172.21.15.55:0/326184273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00b006aba0 0x7f00b014fd20 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:08.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 -- 172.21.15.55:0/326184273 >> 172.21.15.55:0/326184273 conn(0x7f00b00d0750 msgr2=0x7f00b00d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:08.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 -- 172.21.15.55:0/326184273 shutdown_connections 2024-04-25T08:56:08.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.826+0000 7f00b7bd5640 1 -- 172.21.15.55:0/326184273 wait complete. 2024-04-25T08:56:08.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:56:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.961+0000 7fc46c732640 1 Processor -- start 2024-04-25T08:56:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.961+0000 7fc46c732640 1 -- start start 2024-04-25T08:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.962+0000 7fc46c732640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4640d3b90 0x7fc4640d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.962+0000 7fc46c732640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4640d0f60 0x7fc4640b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.962+0000 7fc46c732640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4640d4090 con 0x7fc46415dca0 2024-04-25T08:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.962+0000 7fc46c732640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4640b6b20 con 0x7fc4640d3b90 2024-04-25T08:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.962+0000 7fc46c732640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640d1390 con 0x7fc4640d0f60 2024-04-25T08:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.962+0000 7fc46accf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4640d0f60 0x7fc4640b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.962+0000 7fc469ccd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4640d3b90 0x7fc4640d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.962+0000 7fc46a4ce640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc46415dca0 0x7fc4640ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:34392/0 (socket says 172.21.15.55:34392) 2024-04-25T08:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.962+0000 7fc46a4ce640 1 -- 172.21.15.55:0/3691267200 learned_addr learned my addr 172.21.15.55:0/3691267200 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.963+0000 7fc46accf640 1 -- 172.21.15.55:0/3691267200 >> v2:172.21.15.167:3300/0 conn(0x7fc4640d3b90 msgr2=0x7fc4640d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.963+0000 7fc46accf640 1 --2- 172.21.15.55:0/3691267200 >> v2:172.21.15.167:3300/0 conn(0x7fc4640d3b90 0x7fc4640d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.963+0000 7fc46accf640 1 -- 172.21.15.55:0/3691267200 >> v1:172.21.15.167:6789/0 conn(0x7fc46415dca0 legacy=0x7fc4640ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.963+0000 7fc46accf640 1 -- 172.21.15.55:0/3691267200 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640d4370 con 0x7fc4640d0f60 2024-04-25T08:56:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.963+0000 7fc46accf640 1 --2- 172.21.15.55:0/3691267200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4640d0f60 0x7fc4640b2500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009d90 tx=0x7fc45c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e5016dcfedb7cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.964+0000 7fc4694cc640 1 -- 172.21.15.55:0/3691267200 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c007740 con 0x7fc4640d0f60 2024-04-25T08:56:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.964+0000 7fc4694cc640 1 -- 172.21.15.55:0/3691267200 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45c0078e0 con 0x7fc4640d0f60 2024-04-25T08:56:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.964+0000 7fc4694cc640 1 -- 172.21.15.55:0/3691267200 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c007cb0 con 0x7fc4640d0f60 2024-04-25T08:56:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.964+0000 7fc46c732640 1 -- 172.21.15.55:0/3691267200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4640d0f60 msgr2=0x7fc4640b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.964+0000 7fc46c732640 1 --2- 172.21.15.55:0/3691267200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4640d0f60 0x7fc4640b2500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009d90 tx=0x7fc45c02a660 comp rx=0 tx=0).stop 2024-04-25T08:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.964+0000 7fc46c732640 1 -- 172.21.15.55:0/3691267200 shutdown_connections 2024-04-25T08:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.964+0000 7fc46c732640 1 --2- 172.21.15.55:0/3691267200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4640d0f60 0x7fc4640b2500 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.964+0000 7fc46c732640 1 --2- 172.21.15.55:0/3691267200 >> v2:172.21.15.167:3300/0 conn(0x7fc4640d3b90 0x7fc4640d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.964+0000 7fc46c732640 1 -- 172.21.15.55:0/3691267200 >> 172.21.15.55:0/3691267200 conn(0x7fc4640726c0 msgr2=0x7fc464072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.964+0000 7fc46c732640 1 -- 172.21.15.55:0/3691267200 shutdown_connections 2024-04-25T08:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.964+0000 7fc46c732640 1 -- 172.21.15.55:0/3691267200 wait complete. 2024-04-25T08:56:08.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.966+0000 7fc46c732640 1 Processor -- start 2024-04-25T08:56:08.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.966+0000 7fc46c732640 1 -- start start 2024-04-25T08:56:08.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.966+0000 7fc46c732640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4640d0f60 0x7fc4640c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:08.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.966+0000 7fc46c732640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4640d3b90 0x7fc464160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.966+0000 7fc46c732640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc46415dca0 0x7fc4640b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.966+0000 7fc46c732640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640cf050 con 0x7fc46415dca0 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.966+0000 7fc46c732640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640b6d50 con 0x7fc4640d3b90 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.966+0000 7fc46c732640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46415e080 con 0x7fc4640d0f60 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46accf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc46415dca0 0x7fc4640b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46accf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc46415dca0 0x7fc4640b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55746/0 (socket says 172.21.15.55:55746) 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46accf640 1 -- 172.21.15.55:0/1349948281 learned_addr learned my addr 172.21.15.55:0/1349948281 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46a4ce640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4640d0f60 0x7fc4640c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc469ccd640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4640d3b90 0x7fc464160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46accf640 1 -- 172.21.15.55:0/1349948281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4640d0f60 msgr2=0x7fc4640c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46accf640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4640d0f60 0x7fc4640c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46accf640 1 -- 172.21.15.55:0/1349948281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4640d3b90 msgr2=0x7fc464160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46accf640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4640d3b90 0x7fc464160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46accf640 1 -- 172.21.15.55:0/1349948281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4641f6e60 con 0x7fc46415dca0 2024-04-25T08:56:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46accf640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc46415dca0 0x7fc4640b3d20 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc45c02ac50 tx=0x7fc45c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc45affd640 1 -- 172.21.15.55:0/1349948281 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c040070 con 0x7fc46415dca0 2024-04-25T08:56:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc45affd640 1 -- 172.21.15.55:0/1349948281 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45c031bc0 con 0x7fc46415dca0 2024-04-25T08:56:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc45affd640 1 -- 172.21.15.55:0/1349948281 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c009450 con 0x7fc46415dca0 2024-04-25T08:56:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46c732640 1 -- 172.21.15.55:0/1349948281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4641f7120 con 0x7fc46415dca0 2024-04-25T08:56:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.967+0000 7fc46c732640 1 -- 172.21.15.55:0/1349948281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4641f76e0 con 0x7fc46415dca0 2024-04-25T08:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.968+0000 7fc46c732640 1 -- 172.21.15.55:0/1349948281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4641f7c00 con 0x7fc46415dca0 2024-04-25T08:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.969+0000 7fc45affd640 1 -- 172.21.15.55:0/1349948281 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc45c039040 con 0x7fc46415dca0 2024-04-25T08:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.969+0000 7fc45affd640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc44806b4d0 0x7fc44806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.969+0000 7fc45affd640 1 -- 172.21.15.55:0/1349948281 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc45c0ab600 con 0x7fc46415dca0 2024-04-25T08:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.969+0000 7fc46a4ce640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc44806b4d0 0x7fc44806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.970+0000 7fc46a4ce640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc44806b4d0 0x7fc44806d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc460007fd0 tx=0x7fc460007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:08.974+0000 7fc45affd640 1 -- 172.21.15.55:0/1349948281 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc45c07a120 con 0x7fc46415dca0 2024-04-25T08:56:09.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.154+0000 7fc46c732640 1 -- 172.21.15.55:0/1349948281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc464160860 con 0x7fc46415dca0 2024-04-25T08:56:09.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.157+0000 7fc45affd640 1 -- 172.21.15.55:0/1349948281 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc45c0ab070 con 0x7fc46415dca0 2024-04-25T08:56:09.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 -- 172.21.15.55:0/1349948281 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc44806b4d0 msgr2=0x7fc44806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:09.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc44806b4d0 0x7fc44806d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc460007fd0 tx=0x7fc460007e80 comp rx=0 tx=0).stop 2024-04-25T08:56:09.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 -- 172.21.15.55:0/1349948281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc46415dca0 msgr2=0x7fc4640b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:09.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc46415dca0 0x7fc4640b3d20 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc45c02ac50 tx=0x7fc45c004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:09.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 -- 172.21.15.55:0/1349948281 shutdown_connections 2024-04-25T08:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc44806b4d0 0x7fc44806d990 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc46415dca0 0x7fc4640b3d20 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4640d3b90 0x7fc464160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 --2- 172.21.15.55:0/1349948281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4640d0f60 0x7fc4640c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 -- 172.21.15.55:0/1349948281 >> 172.21.15.55:0/1349948281 conn(0x7fc4640726c0 msgr2=0x7fc4640d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 -- 172.21.15.55:0/1349948281 shutdown_connections 2024-04-25T08:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.159+0000 7fc46c732640 1 -- 172.21.15.55:0/1349948281 wait complete. 2024-04-25T08:56:09.160 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T08:56:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.272+0000 7fc8ad691640 1 Processor -- start 2024-04-25T08:56:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.272+0000 7fc8ad691640 1 -- start start 2024-04-25T08:56:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8ad691640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8a815dce0 0x7fc8a80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8ad691640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8a80d35b0 0x7fc8a80b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8ad691640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8a80d1f90 0x7fc8a80b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8ad691640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a815e0c0 con 0x7fc8a80d35b0 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8ad691640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a80d2510 con 0x7fc8a815dce0 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8ad691640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80d27f0 con 0x7fc8a80d1f90 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8a67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8a80d35b0 0x7fc8a80b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8a67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8a80d35b0 0x7fc8a80b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55752/0 (socket says 172.21.15.55:55752) 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8a67fc640 1 -- 172.21.15.55:0/2055322938 learned_addr learned my addr 172.21.15.55:0/2055322938 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8a6ffd640 1 --2- 172.21.15.55:0/2055322938 >> v2:172.21.15.167:3300/0 conn(0x7fc8a815dce0 0x7fc8a80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8a77fe640 1 --2- 172.21.15.55:0/2055322938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8a80d1f90 0x7fc8a80b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.273+0000 7fc8a67fc640 1 -- 172.21.15.55:0/2055322938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8a80d1f90 msgr2=0x7fc8a80b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.274+0000 7fc8a67fc640 1 --2- 172.21.15.55:0/2055322938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8a80d1f90 0x7fc8a80b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.274+0000 7fc8a67fc640 1 -- 172.21.15.55:0/2055322938 >> v2:172.21.15.167:3300/0 conn(0x7fc8a815dce0 msgr2=0x7fc8a80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.274+0000 7fc8a67fc640 1 --2- 172.21.15.55:0/2055322938 >> v2:172.21.15.167:3300/0 conn(0x7fc8a815dce0 0x7fc8a80d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.274+0000 7fc8a67fc640 1 -- 172.21.15.55:0/2055322938 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80d2ad0 con 0x7fc8a80d35b0 2024-04-25T08:56:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.274+0000 7fc8a6ffd640 1 --2- 172.21.15.55:0/2055322938 >> v2:172.21.15.167:3300/0 conn(0x7fc8a815dce0 0x7fc8a80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.274+0000 7fc8a77fe640 1 --2- 172.21.15.55:0/2055322938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8a80d1f90 0x7fc8a80b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.274+0000 7fc8a67fc640 1 --2- 172.21.15.55:0/2055322938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8a80d35b0 0x7fc8a80b5450 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80ce220 tx=0x7fc89002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efbed289f30535a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.274+0000 7fc8a5ffb640 1 -- 172.21.15.55:0/2055322938 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890037070 con 0x7fc8a80d35b0 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.274+0000 7fc8a5ffb640 1 -- 172.21.15.55:0/2055322938 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc890032440 con 0x7fc8a80d35b0 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.274+0000 7fc8a5ffb640 1 -- 172.21.15.55:0/2055322938 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890032810 con 0x7fc8a80d35b0 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.275+0000 7fc8ad691640 1 -- 172.21.15.55:0/2055322938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8a80d35b0 msgr2=0x7fc8a80b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.275+0000 7fc8ad691640 1 --2- 172.21.15.55:0/2055322938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8a80d35b0 0x7fc8a80b5450 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80ce220 tx=0x7fc89002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.275+0000 7fc8ad691640 1 -- 172.21.15.55:0/2055322938 shutdown_connections 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.275+0000 7fc8ad691640 1 --2- 172.21.15.55:0/2055322938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8a80d1f90 0x7fc8a80b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.275+0000 7fc8ad691640 1 --2- 172.21.15.55:0/2055322938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8a80d35b0 0x7fc8a80b5450 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.275+0000 7fc8ad691640 1 --2- 172.21.15.55:0/2055322938 >> v2:172.21.15.167:3300/0 conn(0x7fc8a815dce0 0x7fc8a80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.275+0000 7fc8ad691640 1 -- 172.21.15.55:0/2055322938 >> 172.21.15.55:0/2055322938 conn(0x7fc8a8072900 msgr2=0x7fc8a80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.275+0000 7fc8ad691640 1 -- 172.21.15.55:0/2055322938 shutdown_connections 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.275+0000 7fc8ad691640 1 -- 172.21.15.55:0/2055322938 wait complete. 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.276+0000 7fc8ad691640 1 Processor -- start 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.276+0000 7fc8ad691640 1 -- start start 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8ad691640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8a80d1f90 0x7fc8a815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8ad691640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a80d35b0 0x7fc8a80b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8ad691640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8a815dce0 0x7fc8a80b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8ad691640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80b9820 con 0x7fc8a80d1f90 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8ad691640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80d3090 con 0x7fc8a80d35b0 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8ad691640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80b99a0 con 0x7fc8a815dce0 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8a6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8a80d1f90 0x7fc8a815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8a6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8a80d1f90 0x7fc8a815fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55766/0 (socket says 172.21.15.55:55766) 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8a6ffd640 1 -- 172.21.15.55:0/449644070 learned_addr learned my addr 172.21.15.55:0/449644070 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8a67fc640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a80d35b0 0x7fc8a80b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8a6ffd640 1 -- 172.21.15.55:0/449644070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8a815dce0 msgr2=0x7fc8a80b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8a6ffd640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8a815dce0 0x7fc8a80b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.277+0000 7fc8a6ffd640 1 -- 172.21.15.55:0/449644070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a80d35b0 msgr2=0x7fc8a80b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.278+0000 7fc8a6ffd640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a80d35b0 0x7fc8a80b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.278+0000 7fc8a6ffd640 1 -- 172.21.15.55:0/449644070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80b22d0 con 0x7fc8a80d1f90 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.278+0000 7fc8a6ffd640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8a80d1f90 0x7fc8a815fab0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc898009fc0 tx=0x7fc89800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.278+0000 7fc89f7fe640 1 -- 172.21.15.55:0/449644070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89801a070 con 0x7fc8a80d1f90 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.278+0000 7fc89f7fe640 1 -- 172.21.15.55:0/449644070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc898003bb0 con 0x7fc8a80d1f90 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.278+0000 7fc8ad691640 1 -- 172.21.15.55:0/449644070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a81f6e00 con 0x7fc8a80d1f90 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.278+0000 7fc89f7fe640 1 -- 172.21.15.55:0/449644070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc898004030 con 0x7fc8a80d1f90 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.278+0000 7fc8ad691640 1 -- 172.21.15.55:0/449644070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a81f7380 con 0x7fc8a80d1f90 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.279+0000 7fc8ad691640 1 -- 172.21.15.55:0/449644070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a80749b0 con 0x7fc8a80d1f90 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.279+0000 7fc89f7fe640 1 -- 172.21.15.55:0/449644070 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc89801d070 con 0x7fc8a80d1f90 2024-04-25T08:56:09.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.280+0000 7fc89f7fe640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc88806b500 0x7fc88806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.280+0000 7fc89f7fe640 1 -- 172.21.15.55:0/449644070 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc89808a0d0 con 0x7fc8a80d1f90 2024-04-25T08:56:09.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.280+0000 7fc8a67fc640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc88806b500 0x7fc88806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.280+0000 7fc8a67fc640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc88806b500 0x7fc88806d9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc890034000 tx=0x7fc89002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:09.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.284+0000 7fc89f7fe640 1 -- 172.21.15.55:0/449644070 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc898010070 con 0x7fc8a80d1f90 2024-04-25T08:56:09.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:56:09.488 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:56:09.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.539+0000 7fc8ad691640 1 -- 172.21.15.55:0/449644070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7fc8a81f7a40 con 0x7fc8a80d1f90 2024-04-25T08:56:09.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.826+0000 7fc89f7fe640 1 -- 172.21.15.55:0/449644070 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v146) v1 ==== 149+0+0 (secure 0 0 0) 0x7fc898058c00 con 0x7fc8a80d1f90 2024-04-25T08:56:09.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 -- 172.21.15.55:0/449644070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc88806b500 msgr2=0x7fc88806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:09.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc88806b500 0x7fc88806d9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc890034000 tx=0x7fc89002e000 comp rx=0 tx=0).stop 2024-04-25T08:56:09.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 -- 172.21.15.55:0/449644070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8a80d1f90 msgr2=0x7fc8a815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:09.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8a80d1f90 0x7fc8a815fab0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc898009fc0 tx=0x7fc89800d560 comp rx=0 tx=0).stop 2024-04-25T08:56:09.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 -- 172.21.15.55:0/449644070 shutdown_connections 2024-04-25T08:56:09.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc88806b500 0x7fc88806d9c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8a815dce0 0x7fc8a80b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a80d35b0 0x7fc8a80b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 --2- 172.21.15.55:0/449644070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8a80d1f90 0x7fc8a815fab0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 -- 172.21.15.55:0/449644070 >> 172.21.15.55:0/449644070 conn(0x7fc8a8072900 msgr2=0x7fc8a80b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 -- 172.21.15.55:0/449644070 shutdown_connections 2024-04-25T08:56:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.828+0000 7fc8ad691640 1 -- 172.21.15.55:0/449644070 wait complete. 2024-04-25T08:56:09.830 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-04-25T08:56:09.830 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T08:56:09.830 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T08:56:09.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:09.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.944+0000 7ff47aff9640 1 Processor -- start 2024-04-25T08:56:09.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.944+0000 7ff47aff9640 1 -- start start 2024-04-25T08:56:09.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.944+0000 7ff47aff9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff474071190 0x7ff4740ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.944+0000 7ff47aff9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff474071570 0x7ff47415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.944+0000 7ff47aff9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47406d550 con 0x7ff47415e030 2024-04-25T08:56:09.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.944+0000 7ff47aff9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4740aeee0 con 0x7ff474071190 2024-04-25T08:56:09.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.944+0000 7ff47aff9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47406d830 con 0x7ff474071570 2024-04-25T08:56:09.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff479596640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff47415e030 0x7ff4740b2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59770/0 (socket says 172.21.15.55:59770) 2024-04-25T08:56:09.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff479596640 1 -- 172.21.15.55:0/1385411951 learned_addr learned my addr 172.21.15.55:0/1385411951 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:09.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff478d95640 1 --2- 172.21.15.55:0/1385411951 >> v2:172.21.15.167:3300/0 conn(0x7ff474071190 0x7ff4740ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff473fff640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff474071570 0x7ff47415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128536046 0 0) 0x7ff47406d550 con 0x7ff47415e030 2024-04-25T08:56:09.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff464003520 con 0x7ff47415e030 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4179224060 0 0) 0x7ff464003520 con 0x7ff47415e030 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff474071570 msgr2=0x7ff47415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff474071570 0x7ff47415daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 >> v2:172.21.15.167:3300/0 conn(0x7ff474071190 msgr2=0x7ff4740ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 --2- 172.21.15.55:0/1385411951 >> v2:172.21.15.167:3300/0 conn(0x7ff474071190 0x7ff4740ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47406db10 con 0x7ff47415e030 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7ff46c0019f0 con 0x7ff47415e030 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 >> v1:172.21.15.55:6789/0 conn(0x7ff47415e030 legacy=0x7ff4740b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff474071570 0x7ff4640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff464003f30 0x7ff464004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d40 0x7ff4640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740aeee0 con 0x7ff464004d40 2024-04-25T08:56:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47406d830 con 0x7ff464003f30 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46400b9c0 con 0x7ff474071570 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff479596640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d40 0x7ff4640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff478d95640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff474071570 0x7ff4640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.945+0000 7ff473fff640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff464003f30 0x7ff464004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.946+0000 7ff479596640 1 -- 172.21.15.55:0/1385411951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff474071570 msgr2=0x7ff4640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.946+0000 7ff479596640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff474071570 0x7ff4640039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.946+0000 7ff479596640 1 -- 172.21.15.55:0/1385411951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff464003f30 msgr2=0x7ff464004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.946+0000 7ff479596640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff464003f30 0x7ff464004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.946+0000 7ff479596640 1 -- 172.21.15.55:0/1385411951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464003520 con 0x7ff464004d40 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.946+0000 7ff479596640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d40 0x7ff4640051c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00a870 tx=0x7ff464005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71ad3c8882490a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.947+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00a4c0 con 0x7ff464004d40 2024-04-25T08:56:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.947+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c02f070 con 0x7ff464004d40 2024-04-25T08:56:09.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.947+0000 7ff4737fe640 1 -- 172.21.15.55:0/1385411951 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c02bcb0 con 0x7ff464004d40 2024-04-25T08:56:09.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.947+0000 7ff47aff9640 1 -- 172.21.15.55:0/1385411951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d40 msgr2=0x7ff4640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:09.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.947+0000 7ff47aff9640 1 --2- 172.21.15.55:0/1385411951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d40 0x7ff4640051c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00a870 tx=0x7ff464005830 comp rx=0 tx=0).stop 2024-04-25T08:56:09.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.947+0000 7ff479596640 1 -- 172.21.15.55:0/1385411951 reap_dead start 2024-04-25T08:56:09.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.947+0000 7ff47aff9640 1 -- 172.21.15.55:0/1385411951 shutdown_connections 2024-04-25T08:56:09.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.947+0000 7ff47aff9640 1 -- 172.21.15.55:0/1385411951 >> 172.21.15.55:0/1385411951 conn(0x7ff47406aba0 msgr2=0x7ff47406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:09.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.947+0000 7ff47aff9640 1 -- 172.21.15.55:0/1385411951 shutdown_connections 2024-04-25T08:56:09.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.947+0000 7ff47aff9640 1 -- 172.21.15.55:0/1385411951 wait complete. 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.948+0000 7ff47aff9640 1 Processor -- start 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.948+0000 7ff47aff9640 1 -- start start 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.949+0000 7ff47aff9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff464004d40 0x7ff47414e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.949+0000 7ff47aff9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff474153990 0x7ff4740af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.949+0000 7ff47aff9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4741e4150 0x7ff4741e45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.949+0000 7ff47aff9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47406e8b0 con 0x7ff474153990 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.949+0000 7ff47aff9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47406e0d0 con 0x7ff464004d40 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.949+0000 7ff47aff9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740719d0 con 0x7ff4741e4150 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.949+0000 7ff473fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff474153990 0x7ff4740af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.949+0000 7ff473fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff474153990 0x7ff4740af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55782/0 (socket says 172.21.15.55:55782) 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.949+0000 7ff473fff640 1 -- 172.21.15.55:0/160143565 learned_addr learned my addr 172.21.15.55:0/160143565 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.949+0000 7ff478d95640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff464004d40 0x7ff47414e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.949+0000 7ff479596640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4741e4150 0x7ff4741e45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.950+0000 7ff473fff640 1 -- 172.21.15.55:0/160143565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4741e4150 msgr2=0x7ff4741e45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.950+0000 7ff473fff640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4741e4150 0x7ff4741e45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.950+0000 7ff473fff640 1 -- 172.21.15.55:0/160143565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff464004d40 msgr2=0x7ff47414e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.950+0000 7ff473fff640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff464004d40 0x7ff47414e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.950+0000 7ff473fff640 1 -- 172.21.15.55:0/160143565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740af8f0 con 0x7ff474153990 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.950+0000 7ff473fff640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff474153990 0x7ff4740af060 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff4600117f0 tx=0x7ff460011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.950+0000 7ff4717fa640 1 -- 172.21.15.55:0/160143565 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46000b040 con 0x7ff474153990 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.950+0000 7ff4717fa640 1 -- 172.21.15.55:0/160143565 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46000fd30 con 0x7ff474153990 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.950+0000 7ff47aff9640 1 -- 172.21.15.55:0/160143565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4740afbd0 con 0x7ff474153990 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.950+0000 7ff4717fa640 1 -- 172.21.15.55:0/160143565 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46001c6c0 con 0x7ff474153990 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.950+0000 7ff47aff9640 1 -- 172.21.15.55:0/160143565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4740b06b0 con 0x7ff474153990 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.951+0000 7ff47aff9640 1 -- 172.21.15.55:0/160143565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4740749b0 con 0x7ff474153990 2024-04-25T08:56:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.951+0000 7ff4717fa640 1 -- 172.21.15.55:0/160143565 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff46001c860 con 0x7ff474153990 2024-04-25T08:56:09.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.952+0000 7ff4717fa640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff45806b500 0x7ff45806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:09.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.952+0000 7ff4717fa640 1 -- 172.21.15.55:0/160143565 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff46008ac20 con 0x7ff474153990 2024-04-25T08:56:09.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.952+0000 7ff478d95640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff45806b500 0x7ff45806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:09.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.952+0000 7ff478d95640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff45806b500 0x7ff45806d9c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff468009b80 tx=0x7ff468008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:09.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:09.956+0000 7ff4717fa640 1 -- 172.21.15.55:0/160143565 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff460059da0 con 0x7ff474153990 2024-04-25T08:56:10.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.137+0000 7ff47aff9640 1 -- 172.21.15.55:0/160143565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff47406e470 con 0x7ff474153990 2024-04-25T08:56:10.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.138+0000 7ff4717fa640 1 -- 172.21.15.55:0/160143565 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13020 (secure 0 0 0) 0x7ff4600596a0 con 0x7ff474153990 2024-04-25T08:56:10.128 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:10.128 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":52,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:56:08.818809+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/2070394524":"2024-04-26T08:56:05.801676+0000","172.21.15.55:6836/2070394524":"2024-04-26T08:56:05.801676+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 -- 172.21.15.55:0/160143565 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff45806b500 msgr2=0x7ff45806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff45806b500 0x7ff45806d9c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff468009b80 tx=0x7ff468008040 comp rx=0 tx=0).stop 2024-04-25T08:56:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 -- 172.21.15.55:0/160143565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff474153990 msgr2=0x7ff4740af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff474153990 0x7ff4740af060 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff4600117f0 tx=0x7ff460011cb0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 -- 172.21.15.55:0/160143565 shutdown_connections 2024-04-25T08:56:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff45806b500 0x7ff45806d9c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4741e4150 0x7ff4741e45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff474153990 0x7ff4740af060 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 --2- 172.21.15.55:0/160143565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff464004d40 0x7ff47414e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 -- 172.21.15.55:0/160143565 >> 172.21.15.55:0/160143565 conn(0x7ff47406aba0 msgr2=0x7ff47414fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 -- 172.21.15.55:0/160143565 shutdown_connections 2024-04-25T08:56:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.140+0000 7ff47aff9640 1 -- 172.21.15.55:0/160143565 wait complete. 2024-04-25T08:56:10.141 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:56:10.141 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:56:10.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.256+0000 7f7f1bd29640 1 Processor -- start 2024-04-25T08:56:10.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.256+0000 7f7f1bd29640 1 -- start start 2024-04-25T08:56:10.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f1bd29640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7f1415dca0 0x7f7f140ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f1bd29640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f140d3b90 0x7f7f140d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f1bd29640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f140d4090 con 0x7f7f140cee80 2024-04-25T08:56:10.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f1bd29640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f140b6b20 con 0x7f7f140d3b90 2024-04-25T08:56:10.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f1bd29640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f140d4370 con 0x7f7f1415dca0 2024-04-25T08:56:10.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f192c4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f140d3b90 0x7f7f140d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f192c4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f140d3b90 0x7f7f140d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55790/0 (socket says 172.21.15.55:55790) 2024-04-25T08:56:10.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f192c4640 1 -- 172.21.15.55:0/4084966491 learned_addr learned my addr 172.21.15.55:0/4084966491 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:10.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f19ac5640 1 --2- 172.21.15.55:0/4084966491 >> v2:172.21.15.167:3300/0 conn(0x7f7f1415dca0 0x7f7f140ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f192c4640 1 -- 172.21.15.55:0/4084966491 >> v2:172.21.15.167:3300/0 conn(0x7f7f1415dca0 msgr2=0x7f7f140ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:10.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f192c4640 1 --2- 172.21.15.55:0/4084966491 >> v2:172.21.15.167:3300/0 conn(0x7f7f1415dca0 0x7f7f140ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f192c4640 1 -- 172.21.15.55:0/4084966491 >> v1:172.21.15.167:6789/0 conn(0x7f7f140cee80 legacy=0x7f7f140b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:10.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.257+0000 7f7f192c4640 1 -- 172.21.15.55:0/4084966491 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f140d4650 con 0x7f7f140d3b90 2024-04-25T08:56:10.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.258+0000 7f7f192c4640 1 --2- 172.21.15.55:0/4084966491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f140d3b90 0x7f7f140d0a20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7f140b6340 tx=0x7f7f0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1336753aebbb696a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:10.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.258+0000 7f7f18ac3640 1 -- 172.21.15.55:0/4084966491 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04037070 con 0x7f7f140d3b90 2024-04-25T08:56:10.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.258+0000 7f7f18ac3640 1 -- 172.21.15.55:0/4084966491 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f04032440 con 0x7f7f140d3b90 2024-04-25T08:56:10.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.258+0000 7f7f18ac3640 1 -- 172.21.15.55:0/4084966491 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04032810 con 0x7f7f140d3b90 2024-04-25T08:56:10.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.259+0000 7f7f1bd29640 1 -- 172.21.15.55:0/4084966491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f140d3b90 msgr2=0x7f7f140d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:10.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.259+0000 7f7f1bd29640 1 --2- 172.21.15.55:0/4084966491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f140d3b90 0x7f7f140d0a20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7f140b6340 tx=0x7f7f0402a270 comp rx=0 tx=0).stop 2024-04-25T08:56:10.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.259+0000 7f7f1bd29640 1 -- 172.21.15.55:0/4084966491 shutdown_connections 2024-04-25T08:56:10.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.259+0000 7f7f1bd29640 1 --2- 172.21.15.55:0/4084966491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f140d3b90 0x7f7f140d0a20 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.259+0000 7f7f1bd29640 1 --2- 172.21.15.55:0/4084966491 >> v2:172.21.15.167:3300/0 conn(0x7f7f1415dca0 0x7f7f140ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.259+0000 7f7f1bd29640 1 -- 172.21.15.55:0/4084966491 >> 172.21.15.55:0/4084966491 conn(0x7f7f140726c0 msgr2=0x7f7f14072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:10.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.259+0000 7f7f1bd29640 1 -- 172.21.15.55:0/4084966491 shutdown_connections 2024-04-25T08:56:10.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.259+0000 7f7f1bd29640 1 -- 172.21.15.55:0/4084966491 wait complete. 2024-04-25T08:56:10.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.260+0000 7f7f1bd29640 1 Processor -- start 2024-04-25T08:56:10.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.260+0000 7f7f1bd29640 1 -- start start 2024-04-25T08:56:10.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f1bd29640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f140cee80 0x7f7f1415a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f1bd29640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f140d3b90 0x7f7f141f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f1bd29640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f1415dca0 0x7f7f141f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f1bd29640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1415e200 con 0x7f7f140cee80 2024-04-25T08:56:10.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f1bd29640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1415e080 con 0x7f7f1415dca0 2024-04-25T08:56:10.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f1bd29640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140d0f60 con 0x7f7f140d3b90 2024-04-25T08:56:10.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f19ac5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f140cee80 0x7f7f1415a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f19ac5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f140cee80 0x7f7f1415a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55792/0 (socket says 172.21.15.55:55792) 2024-04-25T08:56:10.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f19ac5640 1 -- 172.21.15.55:0/3217540711 learned_addr learned my addr 172.21.15.55:0/3217540711 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:10.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f192c4640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f140d3b90 0x7f7f141f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f1a2c6640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f1415dca0 0x7f7f141f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f19ac5640 1 -- 172.21.15.55:0/3217540711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f140d3b90 msgr2=0x7f7f141f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f19ac5640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f140d3b90 0x7f7f141f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f19ac5640 1 -- 172.21.15.55:0/3217540711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f1415dca0 msgr2=0x7f7f141f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f19ac5640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f1415dca0 0x7f7f141f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f19ac5640 1 -- 172.21.15.55:0/3217540711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f141591d0 con 0x7f7f140cee80 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f19ac5640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f140cee80 0x7f7f1415a510 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000e870 tx=0x7f7f1000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f0a7fc640 1 -- 172.21.15.55:0/3217540711 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10017070 con 0x7f7f140cee80 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f0a7fc640 1 -- 172.21.15.55:0/3217540711 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1000c940 con 0x7f7f140cee80 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f1bd29640 1 -- 172.21.15.55:0/3217540711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f14159470 con 0x7f7f140cee80 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f0a7fc640 1 -- 172.21.15.55:0/3217540711 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000cd30 con 0x7f7f140cee80 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.261+0000 7f7f1bd29640 1 -- 172.21.15.55:0/3217540711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f14159a30 con 0x7f7f140cee80 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.263+0000 7f7f1bd29640 1 -- 172.21.15.55:0/3217540711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f140750b0 con 0x7f7f140cee80 2024-04-25T08:56:10.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.263+0000 7f7f0a7fc640 1 -- 172.21.15.55:0/3217540711 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7f1001a070 con 0x7f7f140cee80 2024-04-25T08:56:10.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.263+0000 7f7f0a7fc640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ef806b4d0 0x7f7ef806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.263+0000 7f7f0a7fc640 1 -- 172.21.15.55:0/3217540711 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7f10089d70 con 0x7f7f140cee80 2024-04-25T08:56:10.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.263+0000 7f7f192c4640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ef806b4d0 0x7f7ef806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.264+0000 7f7f192c4640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ef806b4d0 0x7f7ef806d990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7f04034000 tx=0x7f7f0402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:10.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.267+0000 7f7f0a7fc640 1 -- 172.21.15.55:0/3217540711 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7f10058ef0 con 0x7f7f140cee80 2024-04-25T08:56:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.449+0000 7f7f1bd29640 1 -- 172.21.15.55:0/3217540711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f140b84a0 con 0x7f7f140cee80 2024-04-25T08:56:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.450+0000 7f7f0a7fc640 1 -- 172.21.15.55:0/3217540711 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f100587f0 con 0x7f7f140cee80 2024-04-25T08:56:10.440 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:56:10.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.451+0000 7f7f1bd29640 1 -- 172.21.15.55:0/3217540711 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ef806b4d0 msgr2=0x7f7ef806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:10.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.451+0000 7f7f1bd29640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ef806b4d0 0x7f7ef806d990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7f04034000 tx=0x7f7f0402e000 comp rx=0 tx=0).stop 2024-04-25T08:56:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.451+0000 7f7f1bd29640 1 -- 172.21.15.55:0/3217540711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f140cee80 msgr2=0x7f7f1415a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.451+0000 7f7f1bd29640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f140cee80 0x7f7f1415a510 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000e870 tx=0x7f7f1000ed30 comp rx=0 tx=0).stop 2024-04-25T08:56:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.452+0000 7f7f1bd29640 1 -- 172.21.15.55:0/3217540711 shutdown_connections 2024-04-25T08:56:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.452+0000 7f7f1bd29640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7ef806b4d0 0x7f7ef806d990 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.452+0000 7f7f1bd29640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f1415dca0 0x7f7f141f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.452+0000 7f7f1bd29640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f140d3b90 0x7f7f141f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.452+0000 7f7f1bd29640 1 --2- 172.21.15.55:0/3217540711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f140cee80 0x7f7f1415a510 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.452+0000 7f7f1bd29640 1 -- 172.21.15.55:0/3217540711 >> 172.21.15.55:0/3217540711 conn(0x7f7f140726c0 msgr2=0x7f7f140b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.452+0000 7f7f1bd29640 1 -- 172.21.15.55:0/3217540711 shutdown_connections 2024-04-25T08:56:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.452+0000 7f7f1bd29640 1 -- 172.21.15.55:0/3217540711 wait complete. 2024-04-25T08:56:10.452 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T08:56:10.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.564+0000 7ffb33329640 1 Processor -- start 2024-04-25T08:56:10.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.564+0000 7ffb33329640 1 -- start start 2024-04-25T08:56:10.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb33329640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb2c15dce0 0x7ffb2c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb33329640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffb2c0b5b60 0x7ffb2c0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb33329640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c15e0c0 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb33329640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c0d2510 con 0x7ffb2c15dce0 2024-04-25T08:56:10.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb33329640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c0d27f0 con 0x7ffb2c0b5b60 2024-04-25T08:56:10.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb310c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb2c15dce0 0x7ffb2c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb310c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb2c15dce0 0x7ffb2c0d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55808/0 (socket says 172.21.15.55:55808) 2024-04-25T08:56:10.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb310c5640 1 -- 172.21.15.55:0/615838747 learned_addr learned my addr 172.21.15.55:0/615838747 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:10.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb318c6640 1 --2- 172.21.15.55:0/615838747 >> v2:172.21.15.167:3300/0 conn(0x7ffb2c0b5b60 0x7ffb2c0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb310c5640 1 -- 172.21.15.55:0/615838747 >> v2:172.21.15.167:3300/0 conn(0x7ffb2c0b5b60 msgr2=0x7ffb2c0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:10.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb310c5640 1 --2- 172.21.15.55:0/615838747 >> v2:172.21.15.167:3300/0 conn(0x7ffb2c0b5b60 0x7ffb2c0b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb310c5640 1 -- 172.21.15.55:0/615838747 >> v1:172.21.15.167:6789/0 conn(0x7ffb2c0d35b0 legacy=0x7ffb2c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:10.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb310c5640 1 -- 172.21.15.55:0/615838747 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c0d2ad0 con 0x7ffb2c15dce0 2024-04-25T08:56:10.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.565+0000 7ffb318c6640 1 --2- 172.21.15.55:0/615838747 >> v2:172.21.15.167:3300/0 conn(0x7ffb2c0b5b60 0x7ffb2c0b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:10.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.566+0000 7ffb310c5640 1 --2- 172.21.15.55:0/615838747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c15dce0 0x7ffb2c0d1a50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0b3390 tx=0x7ffb2802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5900e2eb2e9f49c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:10.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.566+0000 7ffb23fff640 1 -- 172.21.15.55:0/615838747 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28037070 con 0x7ffb2c15dce0 2024-04-25T08:56:10.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.566+0000 7ffb23fff640 1 -- 172.21.15.55:0/615838747 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb28032440 con 0x7ffb2c15dce0 2024-04-25T08:56:10.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.566+0000 7ffb23fff640 1 -- 172.21.15.55:0/615838747 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28032810 con 0x7ffb2c15dce0 2024-04-25T08:56:10.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.567+0000 7ffb33329640 1 -- 172.21.15.55:0/615838747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c15dce0 msgr2=0x7ffb2c0d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:10.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.567+0000 7ffb33329640 1 --2- 172.21.15.55:0/615838747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c15dce0 0x7ffb2c0d1a50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0b3390 tx=0x7ffb2802a230 comp rx=0 tx=0).stop 2024-04-25T08:56:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.567+0000 7ffb33329640 1 -- 172.21.15.55:0/615838747 shutdown_connections 2024-04-25T08:56:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.567+0000 7ffb33329640 1 --2- 172.21.15.55:0/615838747 >> v2:172.21.15.167:3300/0 conn(0x7ffb2c0b5b60 0x7ffb2c0b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.567+0000 7ffb33329640 1 --2- 172.21.15.55:0/615838747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c15dce0 0x7ffb2c0d1a50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.567+0000 7ffb33329640 1 -- 172.21.15.55:0/615838747 >> 172.21.15.55:0/615838747 conn(0x7ffb2c072900 msgr2=0x7ffb2c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.567+0000 7ffb33329640 1 -- 172.21.15.55:0/615838747 shutdown_connections 2024-04-25T08:56:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.567+0000 7ffb33329640 1 -- 172.21.15.55:0/615838747 wait complete. 2024-04-25T08:56:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.568+0000 7ffb33329640 1 Processor -- start 2024-04-25T08:56:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.568+0000 7ffb33329640 1 -- start start 2024-04-25T08:56:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb33329640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb2c0b5b60 0x7ffb2c153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb33329640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c0d35b0 0x7ffb2c0c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb33329640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb2c15dce0 0x7ffb2c0b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb33329640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0b9820 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb33329640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0d3090 con 0x7ffb2c0b5b60 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb33329640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0b99a0 con 0x7ffb2c15dce0 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb308c4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c0d35b0 0x7ffb2c0c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb308c4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c0d35b0 0x7ffb2c0c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55822/0 (socket says 172.21.15.55:55822) 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb308c4640 1 -- 172.21.15.55:0/100228772 learned_addr learned my addr 172.21.15.55:0/100228772 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb310c5640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb2c0b5b60 0x7ffb2c153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb318c6640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb2c15dce0 0x7ffb2c0b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb308c4640 1 -- 172.21.15.55:0/100228772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb2c15dce0 msgr2=0x7ffb2c0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb308c4640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb2c15dce0 0x7ffb2c0b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb308c4640 1 -- 172.21.15.55:0/100228772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb2c0b5b60 msgr2=0x7ffb2c153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb308c4640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb2c0b5b60 0x7ffb2c153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb308c4640 1 -- 172.21.15.55:0/100228772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c15e620 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb318c6640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb2c15dce0 0x7ffb2c0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb310c5640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb2c0b5b60 0x7ffb2c153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.569+0000 7ffb308c4640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c0d35b0 0x7ffb2c0c9240 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00c400 tx=0x7ffb1c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.570+0000 7ffb21ffb640 1 -- 172.21.15.55:0/100228772 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c011790 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.570+0000 7ffb21ffb640 1 -- 172.21.15.55:0/100228772 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c017070 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.570+0000 7ffb33329640 1 -- 172.21.15.55:0/100228772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c15e900 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.570+0000 7ffb21ffb640 1 -- 172.21.15.55:0/100228772 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c011bb0 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.570+0000 7ffb33329640 1 -- 172.21.15.55:0/100228772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c15eec0 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.571+0000 7ffb33329640 1 -- 172.21.15.55:0/100228772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c0749b0 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.571+0000 7ffb21ffb640 1 -- 172.21.15.55:0/100228772 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb1c01c460 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.571+0000 7ffb21ffb640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffb1006b4d0 0x7ffb1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.572+0000 7ffb21ffb640 1 -- 172.21.15.55:0/100228772 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffb1c089d50 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.572+0000 7ffb310c5640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffb1006b4d0 0x7ffb1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.572+0000 7ffb310c5640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffb1006b4d0 0x7ffb1006d990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb28034000 tx=0x7ffb2802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.576+0000 7ffb21ffb640 1 -- 172.21.15.55:0/100228772 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb1c08d030 con 0x7ffb2c0d35b0 2024-04-25T08:56:10.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:10.831+0000 7ffb33329640 1 -- 172.21.15.55:0/100228772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7ffb2c0b7500 con 0x7ffb2c0d35b0 2024-04-25T08:56:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.834+0000 7ffb21ffb640 1 -- 172.21.15.55:0/100228772 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v148) v1 ==== 172+0+0 (secure 0 0 0) 0x7ffb1c058ed0 con 0x7ffb2c0d35b0 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 -- 172.21.15.55:0/100228772 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffb1006b4d0 msgr2=0x7ffb1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffb1006b4d0 0x7ffb1006d990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb28034000 tx=0x7ffb2802e000 comp rx=0 tx=0).stop 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 -- 172.21.15.55:0/100228772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c0d35b0 msgr2=0x7ffb2c0c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c0d35b0 0x7ffb2c0c9240 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00c400 tx=0x7ffb1c00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 -- 172.21.15.55:0/100228772 shutdown_connections 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffb1006b4d0 0x7ffb1006d990 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb2c15dce0 0x7ffb2c0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c0d35b0 0x7ffb2c0c9240 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 --2- 172.21.15.55:0/100228772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb2c0b5b60 0x7ffb2c153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 -- 172.21.15.55:0/100228772 >> 172.21.15.55:0/100228772 conn(0x7ffb2c072900 msgr2=0x7ffb2c0ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 -- 172.21.15.55:0/100228772 shutdown_connections 2024-04-25T08:56:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.837+0000 7ffb33329640 1 -- 172.21.15.55:0/100228772 wait complete. 2024-04-25T08:56:11.840 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:56:11.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.961+0000 7f46eb9f9640 1 Processor -- start 2024-04-25T08:56:11.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.961+0000 7f46eb9f9640 1 -- start start 2024-04-25T08:56:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46eb9f9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e415dca0 0x7f46e40ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46eb9f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46e40d1130 0x7f46e40b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46eb9f9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e40d4090 con 0x7f46e40d3b90 2024-04-25T08:56:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46eb9f9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e40b6b20 con 0x7f46e40d1130 2024-04-25T08:56:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46eb9f9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40d4370 con 0x7f46e415dca0 2024-04-25T08:56:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46e9f96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46e40d1130 0x7f46e40b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46e9f96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46e40d1130 0x7f46e40b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55828/0 (socket says 172.21.15.55:55828) 2024-04-25T08:56:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46e9f96640 1 -- 172.21.15.55:0/10133061 learned_addr learned my addr 172.21.15.55:0/10133061 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46e9795640 1 --2- 172.21.15.55:0/10133061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e415dca0 0x7f46e40ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46e9f96640 1 -- 172.21.15.55:0/10133061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e415dca0 msgr2=0x7f46e40ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46e9f96640 1 --2- 172.21.15.55:0/10133061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e415dca0 0x7f46e40ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.962+0000 7f46e9f96640 1 -- 172.21.15.55:0/10133061 >> v1:172.21.15.167:6789/0 conn(0x7f46e40d3b90 legacy=0x7f46e40d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.963+0000 7f46e9f96640 1 -- 172.21.15.55:0/10133061 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40d4650 con 0x7f46e40d1130 2024-04-25T08:56:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.963+0000 7f46e9795640 1 --2- 172.21.15.55:0/10133061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e415dca0 0x7f46e40ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.963+0000 7f46e9f96640 1 --2- 172.21.15.55:0/10133061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e40d1130 0x7f46e40b2500 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009e50 tx=0x7f46dc02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff61689faab5f658 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.963+0000 7f46dbfff640 1 -- 172.21.15.55:0/10133061 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc036070 con 0x7f46e40d1130 2024-04-25T08:56:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.963+0000 7f46dbfff640 1 -- 172.21.15.55:0/10133061 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc031600 con 0x7f46e40d1130 2024-04-25T08:56:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.963+0000 7f46dbfff640 1 -- 172.21.15.55:0/10133061 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0319d0 con 0x7f46e40d1130 2024-04-25T08:56:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.964+0000 7f46eb9f9640 1 -- 172.21.15.55:0/10133061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e40d1130 msgr2=0x7f46e40b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.964+0000 7f46eb9f9640 1 --2- 172.21.15.55:0/10133061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e40d1130 0x7f46e40b2500 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009e50 tx=0x7f46dc02a6c0 comp rx=0 tx=0).stop 2024-04-25T08:56:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.964+0000 7f46eb9f9640 1 -- 172.21.15.55:0/10133061 shutdown_connections 2024-04-25T08:56:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.964+0000 7f46eb9f9640 1 --2- 172.21.15.55:0/10133061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e40d1130 0x7f46e40b2500 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.964+0000 7f46eb9f9640 1 --2- 172.21.15.55:0/10133061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e415dca0 0x7f46e40ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.964+0000 7f46eb9f9640 1 -- 172.21.15.55:0/10133061 >> 172.21.15.55:0/10133061 conn(0x7f46e40726c0 msgr2=0x7f46e4072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.964+0000 7f46eb9f9640 1 -- 172.21.15.55:0/10133061 shutdown_connections 2024-04-25T08:56:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.964+0000 7f46eb9f9640 1 -- 172.21.15.55:0/10133061 wait complete. 2024-04-25T08:56:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.965+0000 7f46eb9f9640 1 Processor -- start 2024-04-25T08:56:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.965+0000 7f46eb9f9640 1 -- start start 2024-04-25T08:56:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46eb9f9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e40d1130 0x7f46e41f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46eb9f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e40d3b90 0x7f46e4160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46eb9f9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46e415dca0 0x7f46e4160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46eb9f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e415e200 con 0x7f46e40d3b90 2024-04-25T08:56:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46eb9f9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e415e080 con 0x7f46e415dca0 2024-04-25T08:56:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46eb9f9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40cee80 con 0x7f46e40d1130 2024-04-25T08:56:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46e8f94640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e40d3b90 0x7f46e4160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46e8f94640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e40d3b90 0x7f46e4160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55836/0 (socket says 172.21.15.55:55836) 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46e8f94640 1 -- 172.21.15.55:0/45696374 learned_addr learned my addr 172.21.15.55:0/45696374 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46e9795640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e40d1130 0x7f46e41f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46e9f96640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46e415dca0 0x7f46e4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46e8f94640 1 -- 172.21.15.55:0/45696374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e40d1130 msgr2=0x7f46e41f68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46e8f94640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e40d1130 0x7f46e41f68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46e8f94640 1 -- 172.21.15.55:0/45696374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46e415dca0 msgr2=0x7f46e4160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46e8f94640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46e415dca0 0x7f46e4160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.966+0000 7f46e8f94640 1 -- 172.21.15.55:0/45696374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e415ed90 con 0x7f46e40d3b90 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.967+0000 7f46e8f94640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e40d3b90 0x7f46e4160a50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f46d400c460 tx=0x7f46d400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.967+0000 7f46d9ffb640 1 -- 172.21.15.55:0/45696374 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4016020 con 0x7f46e40d3b90 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.967+0000 7f46d9ffb640 1 -- 172.21.15.55:0/45696374 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d4012870 con 0x7f46e40d3b90 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.967+0000 7f46d9ffb640 1 -- 172.21.15.55:0/45696374 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4012c60 con 0x7f46e40d3b90 2024-04-25T08:56:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.967+0000 7f46eb9f9640 1 -- 172.21.15.55:0/45696374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e415f070 con 0x7f46e40d3b90 2024-04-25T08:56:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.967+0000 7f46eb9f9640 1 -- 172.21.15.55:0/45696374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e415f630 con 0x7f46e40d3b90 2024-04-25T08:56:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.968+0000 7f46eb9f9640 1 -- 172.21.15.55:0/45696374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e40750b0 con 0x7f46e40d3b90 2024-04-25T08:56:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.968+0000 7f46d9ffb640 1 -- 172.21.15.55:0/45696374 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f46d4019020 con 0x7f46e40d3b90 2024-04-25T08:56:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.969+0000 7f46d9ffb640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f46c806b4d0 0x7f46c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.969+0000 7f46d9ffb640 1 -- 172.21.15.55:0/45696374 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f46d4089b00 con 0x7f46e40d3b90 2024-04-25T08:56:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.969+0000 7f46e9795640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f46c806b4d0 0x7f46c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.969+0000 7f46e9795640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f46c806b4d0 0x7f46c806d990 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f46e000aac0 tx=0x7f46e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:11.973+0000 7f46d9ffb640 1 -- 172.21.15.55:0/45696374 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f46d4020030 con 0x7f46e40d3b90 2024-04-25T08:56:12.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.153+0000 7f46eb9f9640 1 -- 172.21.15.55:0/45696374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f46e40b4990 con 0x7f46e40d3b90 2024-04-25T08:56:12.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.157+0000 7f46d9ffb640 1 -- 172.21.15.55:0/45696374 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f46d4089e20 con 0x7f46e40d3b90 2024-04-25T08:56:12.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.159+0000 7f46eb9f9640 1 -- 172.21.15.55:0/45696374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f46c806b4d0 msgr2=0x7f46c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.159+0000 7f46eb9f9640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f46c806b4d0 0x7f46c806d990 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f46e000aac0 tx=0x7f46e0008040 comp rx=0 tx=0).stop 2024-04-25T08:56:12.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.159+0000 7f46eb9f9640 1 -- 172.21.15.55:0/45696374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e40d3b90 msgr2=0x7f46e4160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.159+0000 7f46eb9f9640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e40d3b90 0x7f46e4160a50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f46d400c460 tx=0x7f46d400c920 comp rx=0 tx=0).stop 2024-04-25T08:56:12.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.159+0000 7f46eb9f9640 1 -- 172.21.15.55:0/45696374 shutdown_connections 2024-04-25T08:56:12.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.159+0000 7f46eb9f9640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f46c806b4d0 0x7f46c806d990 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.160+0000 7f46eb9f9640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46e415dca0 0x7f46e4160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.160+0000 7f46eb9f9640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e40d3b90 0x7f46e4160a50 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.160+0000 7f46eb9f9640 1 --2- 172.21.15.55:0/45696374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46e40d1130 0x7f46e41f68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.160+0000 7f46eb9f9640 1 -- 172.21.15.55:0/45696374 >> 172.21.15.55:0/45696374 conn(0x7f46e40726c0 msgr2=0x7f46e415d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:12.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.160+0000 7f46eb9f9640 1 -- 172.21.15.55:0/45696374 shutdown_connections 2024-04-25T08:56:12.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.160+0000 7f46eb9f9640 1 -- 172.21.15.55:0/45696374 wait complete. 2024-04-25T08:56:12.160 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:56:12.160 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:56:12.202 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:56:12.243 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:56:12.244 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:56:12.244 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:56:12.260 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:56:12.260 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:56:12.260 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:56:12.302 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:56:12.302 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:56:12.302 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:56:12.319 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:56:12.320 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:56:12.320 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:56:12.359 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:56:12.359 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:56:12.359 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.472+0000 7f4f22676640 1 Processor -- start 2024-04-25T08:56:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.472+0000 7f4f22676640 1 -- start start 2024-04-25T08:56:12.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.472+0000 7f4f22676640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4f1c0b5b60 0x7f4f1c1687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.472+0000 7f4f22676640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1c15e0c0 con 0x7f4f1c15dce0 2024-04-25T08:56:12.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.472+0000 7f4f22676640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1c0d2510 con 0x7f4f1c0d35b0 2024-04-25T08:56:12.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.472+0000 7f4f22676640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1c0b7b10 con 0x7f4f1c0b5b60 2024-04-25T08:56:12.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.472+0000 7f4f1bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4f1c15dce0 0x7f4f1c0d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59782/0 (socket says 172.21.15.55:59782) 2024-04-25T08:56:12.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1bfff640 1 -- 172.21.15.55:0/1113317962 learned_addr learned my addr 172.21.15.55:0/1113317962 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:12.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717248693 0 0) 0x7f4f1c15e0c0 con 0x7f4f1c15dce0 2024-04-25T08:56:12.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f20c13640 1 --2- 172.21.15.55:0/1113317962 >> v2:172.21.15.167:3300/0 conn(0x7f4f1c0b5b60 0x7f4f1c1687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f08003520 con 0x7f4f1c15dce0 2024-04-25T08:56:12.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2382330230 0 0) 0x7f4f08003520 con 0x7f4f1c15dce0 2024-04-25T08:56:12.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 >> v2:172.21.15.167:3300/0 conn(0x7f4f1c0b5b60 msgr2=0x7f4f1c1687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:12.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 --2- 172.21.15.55:0/1113317962 >> v2:172.21.15.167:3300/0 conn(0x7f4f1c0b5b60 0x7f4f1c1687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 >> v1:172.21.15.167:6789/0 conn(0x7f4f1c0d35b0 legacy=0x7f4f1c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c0d27f0 con 0x7f4f1c15dce0 2024-04-25T08:56:12.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f4f04001670 con 0x7f4f1c15dce0 2024-04-25T08:56:12.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 >> v1:172.21.15.55:6789/0 conn(0x7f4f1c15dce0 legacy=0x7f4f1c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 --2- 172.21.15.55:0/1113317962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f080039b0 0x7f4f08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 --2- 172.21.15.55:0/1113317962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f08004800 0x7f4f08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 --2- 172.21.15.55:0/1113317962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f080051c0 0x7f4f0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0b7b10 con 0x7f4f08004800 2024-04-25T08:56:12.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0800c060 con 0x7f4f080039b0 2024-04-25T08:56:12.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0800c260 con 0x7f4f080051c0 2024-04-25T08:56:12.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1b7fe640 1 --2- 172.21.15.55:0/1113317962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f08004800 0x7f4f08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f1bfff640 1 --2- 172.21.15.55:0/1113317962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f080039b0 0x7f4f08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.473+0000 7f4f20c13640 1 --2- 172.21.15.55:0/1113317962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f080051c0 0x7f4f0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.474+0000 7f4f1b7fe640 1 -- 172.21.15.55:0/1113317962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f080051c0 msgr2=0x7f4f0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.474+0000 7f4f1b7fe640 1 --2- 172.21.15.55:0/1113317962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f080051c0 0x7f4f0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.474+0000 7f4f1b7fe640 1 -- 172.21.15.55:0/1113317962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f080039b0 msgr2=0x7f4f08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.474+0000 7f4f1b7fe640 1 --2- 172.21.15.55:0/1113317962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f080039b0 0x7f4f08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.474+0000 7f4f1b7fe640 1 -- 172.21.15.55:0/1113317962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08003520 con 0x7f4f08004800 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.474+0000 7f4f20c13640 1 -- 172.21.15.55:0/1113317962 reap_dead start 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.474+0000 7f4f1b7fe640 1 --2- 172.21.15.55:0/1113317962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f08004800 0x7f4f08004c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c001720 tx=0x7f4f08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982a5816a753a347 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.474+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c001370 con 0x7f4f08004800 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.474+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0052d0 con 0x7f4f08004800 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.474+0000 7f4f1affd640 1 -- 172.21.15.55:0/1113317962 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c02ab90 con 0x7f4f08004800 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.475+0000 7f4f22676640 1 -- 172.21.15.55:0/1113317962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f08004800 msgr2=0x7f4f08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.475+0000 7f4f22676640 1 --2- 172.21.15.55:0/1113317962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f08004800 0x7f4f08004c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c001720 tx=0x7f4f08005830 comp rx=0 tx=0).stop 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.475+0000 7f4f22676640 1 -- 172.21.15.55:0/1113317962 shutdown_connections 2024-04-25T08:56:12.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.475+0000 7f4f22676640 1 --2- 172.21.15.55:0/1113317962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f08004800 0x7f4f08004c80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.475+0000 7f4f22676640 1 -- 172.21.15.55:0/1113317962 >> 172.21.15.55:0/1113317962 conn(0x7f4f1c072900 msgr2=0x7f4f1c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:12.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.475+0000 7f4f22676640 1 -- 172.21.15.55:0/1113317962 shutdown_connections 2024-04-25T08:56:12.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.475+0000 7f4f22676640 1 -- 172.21.15.55:0/1113317962 wait complete. 2024-04-25T08:56:12.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.476+0000 7f4f22676640 1 Processor -- start 2024-04-25T08:56:12.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.476+0000 7f4f22676640 1 -- start start 2024-04-25T08:56:12.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.477+0000 7f4f22676640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f08004800 0x7f4f1c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.477+0000 7f4f22676640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c1f2e60 0x7f4f1c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.477+0000 7f4f22676640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0cd690 0x7f4f1c155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.477+0000 7f4f22676640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0d3090 con 0x7f4f1c0cd690 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.477+0000 7f4f22676640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0d2db0 con 0x7f4f1c1f2e60 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.477+0000 7f4f22676640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0b9820 con 0x7f4f08004800 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.477+0000 7f4f20c13640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0cd690 0x7f4f1c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.477+0000 7f4f20c13640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0cd690 0x7f4f1c155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55858/0 (socket says 172.21.15.55:55858) 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.477+0000 7f4f20c13640 1 -- 172.21.15.55:0/1298156345 learned_addr learned my addr 172.21.15.55:0/1298156345 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.477+0000 7f4f1bfff640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f08004800 0x7f4f1c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.477+0000 7f4f1b7fe640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c1f2e60 0x7f4f1c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f20c13640 1 -- 172.21.15.55:0/1298156345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f08004800 msgr2=0x7f4f1c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f20c13640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f08004800 0x7f4f1c0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f20c13640 1 -- 172.21.15.55:0/1298156345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c1f2e60 msgr2=0x7f4f1c0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f20c13640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c1f2e60 0x7f4f1c0cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f20c13640 1 -- 172.21.15.55:0/1298156345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c153eb0 con 0x7f4f1c0cd690 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f1bfff640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f08004800 0x7f4f1c0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f1b7fe640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c1f2e60 0x7f4f1c0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f20c13640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0cd690 0x7f4f1c155890 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c08ce80 tx=0x7f4f1400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f18ff9640 1 -- 172.21.15.55:0/1298156345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400fce0 con 0x7f4f1c0cd690 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f18ff9640 1 -- 172.21.15.55:0/1298156345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1401d070 con 0x7f4f1c0cd690 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f22676640 1 -- 172.21.15.55:0/1298156345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1c160f40 con 0x7f4f1c0cd690 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f18ff9640 1 -- 172.21.15.55:0/1298156345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14015670 con 0x7f4f1c0cd690 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.478+0000 7f4f22676640 1 -- 172.21.15.55:0/1298156345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c160140 con 0x7f4f1c0cd690 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.479+0000 7f4f22676640 1 -- 172.21.15.55:0/1298156345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c0749b0 con 0x7f4f1c0cd690 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.479+0000 7f4f18ff9640 1 -- 172.21.15.55:0/1298156345 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4f14015810 con 0x7f4f1c0cd690 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.480+0000 7f4f18ff9640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4efc06b4d0 0x7f4efc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.480+0000 7f4f18ff9640 1 -- 172.21.15.55:0/1298156345 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4f1408a8d0 con 0x7f4f1c0cd690 2024-04-25T08:56:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.480+0000 7f4f1bfff640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4efc06b4d0 0x7f4efc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.480+0000 7f4f1bfff640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4efc06b4d0 0x7f4efc06d990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007cb0 tx=0x7f4f04009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:12.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.484+0000 7f4f18ff9640 1 -- 172.21.15.55:0/1298156345 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4f14010040 con 0x7f4f1c0cd690 2024-04-25T08:56:12.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.701+0000 7f4f22676640 1 -- 172.21.15.55:0/1298156345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f1c0ca040 con 0x7f4f1c0cd690 2024-04-25T08:56:12.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.701+0000 7f4f18ff9640 1 -- 172.21.15.55:0/1298156345 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f4f140599b0 con 0x7f4f1c0cd690 2024-04-25T08:56:12.691 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:12.691 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3267261156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3267261156},{"type":"v1","addr":"172.21.15.167:6834","nonce":3267261156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/588514159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":588514159},{"type":"v1","addr":"172.21.15.167:6835","nonce":588514159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2276997137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2276997137},{"type":"v1","addr":"172.21.15.55:6835","nonce":2276997137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5970,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/846860659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":846860659},{"type":"v1","addr":"172.21.15.55:6837","nonce":846860659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[]} 2024-04-25T08:56:12.691 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2024-04-25T08:56:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 -- 172.21.15.55:0/1298156345 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4efc06b4d0 msgr2=0x7f4efc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4efc06b4d0 0x7f4efc06d990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007cb0 tx=0x7f4f04009040 comp rx=0 tx=0).stop 2024-04-25T08:56:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 -- 172.21.15.55:0/1298156345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0cd690 msgr2=0x7f4f1c155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0cd690 0x7f4f1c155890 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c08ce80 tx=0x7f4f1400f1b0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 -- 172.21.15.55:0/1298156345 shutdown_connections 2024-04-25T08:56:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4efc06b4d0 0x7f4efc06d990 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0cd690 0x7f4f1c155890 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c1f2e60 0x7f4f1c0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 --2- 172.21.15.55:0/1298156345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f08004800 0x7f4f1c0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 -- 172.21.15.55:0/1298156345 >> 172.21.15.55:0/1298156345 conn(0x7f4f1c072900 msgr2=0x7f4f1c0d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 -- 172.21.15.55:0/1298156345 shutdown_connections 2024-04-25T08:56:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.703+0000 7f4f22676640 1 -- 172.21.15.55:0/1298156345 wait complete. 2024-04-25T08:56:12.704 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:56:12.704 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:56:12.704 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:56:12.705 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:56:12.705 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:56:12.705 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:56:12.705 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:56:12.705 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:56:12.705 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:56:12.705 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:56:12.706 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:56:12.706 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:56:12.706 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:56:12.706 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:56:12.706 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:56:12.706 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:56:12.714 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:56:12.714 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:56:12.715 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:56:12.715 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:56:12.719 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:56:12.719 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:56:12.720 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:56:12.720 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:56:12.757 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:56:12.757 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:12.758 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:56:12.758 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:12.761 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:56:12.761 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:12.762 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:56:12.762 DEBUG:teuthology.parallel:result is None 2024-04-25T08:56:12.763 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:56:12.833 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T08:56:12.833 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-25T08:56:12.843 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T08:56:12.844 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T08:56:12.844 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-04-25T08:56:12.854+0000 7fb0cf7e5640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-25T08:56:12.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.880+0000 7fe851fb7640 1 Processor -- start 2024-04-25T08:56:12.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.880+0000 7fe851fb7640 1 -- start start 2024-04-25T08:56:12.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.881+0000 7fe851fb7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe84c0cd190 0x7fe84c0b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.881+0000 7fe851fb7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cba90 0x7fe84c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.881+0000 7fe851fb7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84c15b840 con 0x7fe84c0cd570 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.881+0000 7fe851fb7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84c15bb20 con 0x7fe84c0cd190 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.881+0000 7fe851fb7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c15be00 con 0x7fe84c0cba90 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.881+0000 7fe84b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe84c0cd190 0x7fe84c0b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.881+0000 7fe84bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cba90 0x7fe84c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.881+0000 7fe84affd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe84c0cd570 0x7fe84c15acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:34444/0 (socket says 172.21.15.55:34444) 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.881+0000 7fe84affd640 1 -- 172.21.15.55:0/1289953094 learned_addr learned my addr 172.21.15.55:0/1289953094 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.882+0000 7fe84a7fc640 1 -- 172.21.15.55:0/1289953094 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302483694 0 0) 0x7fe84c15b840 con 0x7fe84c0cd570 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.882+0000 7fe84a7fc640 1 -- 172.21.15.55:0/1289953094 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe834003520 con 0x7fe84c0cd570 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.882+0000 7fe84b7fe640 1 -- 172.21.15.55:0/1289953094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cba90 msgr2=0x7fe84c0cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.882+0000 7fe84b7fe640 1 --2- 172.21.15.55:0/1289953094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cba90 0x7fe84c0cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.882+0000 7fe84b7fe640 1 -- 172.21.15.55:0/1289953094 >> v1:172.21.15.167:6789/0 conn(0x7fe84c0cd570 legacy=0x7fe84c15acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.882+0000 7fe84b7fe640 1 -- 172.21.15.55:0/1289953094 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c0cb570 con 0x7fe84c0cd190 2024-04-25T08:56:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.882+0000 7fe84bfff640 1 --2- 172.21.15.55:0/1289953094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cba90 0x7fe84c0cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.882+0000 7fe84b7fe640 1 --2- 172.21.15.55:0/1289953094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c0cd190 0x7fe84c0b2d60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0097a0 tx=0x7fe83c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a6848ed3f7862f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.883+0000 7fe84a7fc640 1 -- 172.21.15.55:0/1289953094 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c037070 con 0x7fe84c0cd190 2024-04-25T08:56:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.883+0000 7fe84a7fc640 1 -- 172.21.15.55:0/1289953094 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c032440 con 0x7fe84c0cd190 2024-04-25T08:56:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.883+0000 7fe84a7fc640 1 -- 172.21.15.55:0/1289953094 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c032810 con 0x7fe84c0cd190 2024-04-25T08:56:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.883+0000 7fe851fb7640 1 -- 172.21.15.55:0/1289953094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c0cd190 msgr2=0x7fe84c0b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.883+0000 7fe851fb7640 1 --2- 172.21.15.55:0/1289953094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c0cd190 0x7fe84c0b2d60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0097a0 tx=0x7fe83c02a180 comp rx=0 tx=0).stop 2024-04-25T08:56:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.883+0000 7fe851fb7640 1 -- 172.21.15.55:0/1289953094 shutdown_connections 2024-04-25T08:56:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.883+0000 7fe851fb7640 1 --2- 172.21.15.55:0/1289953094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cba90 0x7fe84c0cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.883+0000 7fe851fb7640 1 --2- 172.21.15.55:0/1289953094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c0cd190 0x7fe84c0b2d60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.883+0000 7fe851fb7640 1 -- 172.21.15.55:0/1289953094 >> 172.21.15.55:0/1289953094 conn(0x7fe84c099a40 msgr2=0x7fe84c0b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.883+0000 7fe851fb7640 1 -- 172.21.15.55:0/1289953094 shutdown_connections 2024-04-25T08:56:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.883+0000 7fe851fb7640 1 -- 172.21.15.55:0/1289953094 wait complete. 2024-04-25T08:56:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.884+0000 7fe851fb7640 1 Processor -- start 2024-04-25T08:56:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.884+0000 7fe851fb7640 1 -- start start 2024-04-25T08:56:12.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.885+0000 7fe851fb7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c0cba90 0x7fe84c14bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.885+0000 7fe851fb7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe84c0cd190 0x7fe84c14a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.885+0000 7fe851fb7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cd570 0x7fe84c14d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.885+0000 7fe851fb7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0cdb00 con 0x7fe84c0cd190 2024-04-25T08:56:12.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.885+0000 7fe851fb7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0cd980 con 0x7fe84c0cba90 2024-04-25T08:56:12.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.885+0000 7fe851fb7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c15b3d0 con 0x7fe84c0cd570 2024-04-25T08:56:12.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.885+0000 7fe84affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe84c0cd190 0x7fe84c14a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.885+0000 7fe84affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe84c0cd190 0x7fe84c14a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55890/0 (socket says 172.21.15.55:55890) 2024-04-25T08:56:12.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.885+0000 7fe84affd640 1 -- 172.21.15.55:0/182658129 learned_addr learned my addr 172.21.15.55:0/182658129 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:12.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.885+0000 7fe84b7fe640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c0cba90 0x7fe84c14bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.885+0000 7fe84bfff640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cd570 0x7fe84c14d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe84affd640 1 -- 172.21.15.55:0/182658129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cd570 msgr2=0x7fe84c14d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe84affd640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cd570 0x7fe84c14d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe84affd640 1 -- 172.21.15.55:0/182658129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c0cba90 msgr2=0x7fe84c14bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:12.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe84affd640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c0cba90 0x7fe84c14bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:12.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe84affd640 1 -- 172.21.15.55:0/182658129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c14c530 con 0x7fe84c0cd190 2024-04-25T08:56:12.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe84bfff640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cd570 0x7fe84c14d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:12.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe84affd640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe84c0cd190 0x7fe84c14a770 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe84000c430 tx=0x7fe84000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:12.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe833fff640 1 -- 172.21.15.55:0/182658129 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe840017070 con 0x7fe84c0cd190 2024-04-25T08:56:12.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe833fff640 1 -- 172.21.15.55:0/182658129 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe840005ce0 con 0x7fe84c0cd190 2024-04-25T08:56:12.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe833fff640 1 -- 172.21.15.55:0/182658129 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8400072d0 con 0x7fe84c0cd190 2024-04-25T08:56:12.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe851fb7640 1 -- 172.21.15.55:0/182658129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84c14df10 con 0x7fe84c0cd190 2024-04-25T08:56:12.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.886+0000 7fe851fb7640 1 -- 172.21.15.55:0/182658129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84c14e4d0 con 0x7fe84c0cd190 2024-04-25T08:56:12.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.887+0000 7fe851fb7640 1 -- 172.21.15.55:0/182658129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84c0750b0 con 0x7fe84c0cd190 2024-04-25T08:56:12.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.888+0000 7fe833fff640 1 -- 172.21.15.55:0/182658129 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe84001a070 con 0x7fe84c0cd190 2024-04-25T08:56:12.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.888+0000 7fe833fff640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe83806b4d0 0x7fe83806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:12.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.888+0000 7fe833fff640 1 -- 172.21.15.55:0/182658129 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe840089240 con 0x7fe84c0cd190 2024-04-25T08:56:12.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.888+0000 7fe84b7fe640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe83806b4d0 0x7fe83806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:12.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.889+0000 7fe84b7fe640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe83806b4d0 0x7fe83806d990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe83c034000 tx=0x7fe83c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:12.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:12.892+0000 7fe833fff640 1 -- 172.21.15.55:0/182658129 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe840057cf0 con 0x7fe84c0cd190 2024-04-25T08:56:13.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:13.084+0000 7fe851fb7640 1 -- 172.21.15.55:0/182658129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe84c09a000 con 0x7fe84c0cd190 2024-04-25T08:56:14.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.174+0000 7fe833fff640 1 -- 172.21.15.55:0/182658129 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe84005bd90 con 0x7fe84c0cd190 2024-04-25T08:56:14.164 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-25T08:56:14.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 -- 172.21.15.55:0/182658129 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe83806b4d0 msgr2=0x7fe83806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe83806b4d0 0x7fe83806d990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe83c034000 tx=0x7fe83c02e000 comp rx=0 tx=0).stop 2024-04-25T08:56:14.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 -- 172.21.15.55:0/182658129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe84c0cd190 msgr2=0x7fe84c14a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe84c0cd190 0x7fe84c14a770 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe84000c430 tx=0x7fe84000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 -- 172.21.15.55:0/182658129 shutdown_connections 2024-04-25T08:56:14.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe83806b4d0 0x7fe83806d990 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe84c0cd570 0x7fe84c14d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe84c0cd190 0x7fe84c14a770 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 --2- 172.21.15.55:0/182658129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c0cba90 0x7fe84c14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 -- 172.21.15.55:0/182658129 >> 172.21.15.55:0/182658129 conn(0x7fe84c099a40 msgr2=0x7fe84c154e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:14.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 -- 172.21.15.55:0/182658129 shutdown_connections 2024-04-25T08:56:14.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.178+0000 7fe851fb7640 1 -- 172.21.15.55:0/182658129 wait complete. 2024-04-25T08:56:14.181 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:56:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.299+0000 7fded78ee640 1 Processor -- start 2024-04-25T08:56:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.299+0000 7fded78ee640 1 -- start start 2024-04-25T08:56:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.300+0000 7fded78ee640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fded00d35b0 0x7fded00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.300+0000 7fded78ee640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded015e0c0 con 0x7fded00b5990 2024-04-25T08:56:14.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.300+0000 7fded78ee640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded00d2510 con 0x7fded015dce0 2024-04-25T08:56:14.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.300+0000 7fded78ee640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded00d27f0 con 0x7fded00d35b0 2024-04-25T08:56:14.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.300+0000 7fded5e8b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fded00b5990 0x7fded00b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59792/0 (socket says 172.21.15.55:59792) 2024-04-25T08:56:14.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.300+0000 7fded5e8b640 1 -- 172.21.15.55:0/3530388360 learned_addr learned my addr 172.21.15.55:0/3530388360 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:14.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.300+0000 7fded4e89640 1 --2- 172.21.15.55:0/3530388360 >> v2:172.21.15.167:3300/0 conn(0x7fded00d35b0 0x7fded00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.301+0000 7fdec7fff640 1 -- 172.21.15.55:0/3530388360 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074656488 0 0) 0x7fded015e0c0 con 0x7fded00b5990 2024-04-25T08:56:14.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.301+0000 7fdec7fff640 1 -- 172.21.15.55:0/3530388360 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdebc003520 con 0x7fded00b5990 2024-04-25T08:56:14.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.301+0000 7fdec7fff640 1 -- 172.21.15.55:0/3530388360 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1618014416 0 0) 0x7fdebc003520 con 0x7fded00b5990 2024-04-25T08:56:14.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.301+0000 7fded4e89640 1 -- 172.21.15.55:0/3530388360 >> v1:172.21.15.167:6789/0 conn(0x7fded015dce0 legacy=0x7fded00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.301+0000 7fded4e89640 1 -- 172.21.15.55:0/3530388360 >> v1:172.21.15.55:6789/0 conn(0x7fded00b5990 legacy=0x7fded00b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.301+0000 7fded4e89640 1 -- 172.21.15.55:0/3530388360 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded00d2ad0 con 0x7fded00d35b0 2024-04-25T08:56:14.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.302+0000 7fded4e89640 1 --2- 172.21.15.55:0/3530388360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fded00d35b0 0x7fded00b5450 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdec00097a0 tx=0x7fdec002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bd71a9b9ecce9e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:14.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.302+0000 7fdec7fff640 1 -- 172.21.15.55:0/3530388360 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0037070 con 0x7fded00d35b0 2024-04-25T08:56:14.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.302+0000 7fdec7fff640 1 -- 172.21.15.55:0/3530388360 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec002ac50 con 0x7fded00d35b0 2024-04-25T08:56:14.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.302+0000 7fdec7fff640 1 -- 172.21.15.55:0/3530388360 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec80019f0 con 0x7fded00d35b0 2024-04-25T08:56:14.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.302+0000 7fded78ee640 1 -- 172.21.15.55:0/3530388360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fded00d35b0 msgr2=0x7fded00b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.302+0000 7fded78ee640 1 --2- 172.21.15.55:0/3530388360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fded00d35b0 0x7fded00b5450 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdec00097a0 tx=0x7fdec002a1c0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.302+0000 7fded78ee640 1 -- 172.21.15.55:0/3530388360 shutdown_connections 2024-04-25T08:56:14.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.302+0000 7fded78ee640 1 --2- 172.21.15.55:0/3530388360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fded00d35b0 0x7fded00b5450 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.302+0000 7fded78ee640 1 -- 172.21.15.55:0/3530388360 >> 172.21.15.55:0/3530388360 conn(0x7fded0072900 msgr2=0x7fded00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:14.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.302+0000 7fded78ee640 1 -- 172.21.15.55:0/3530388360 shutdown_connections 2024-04-25T08:56:14.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.302+0000 7fded78ee640 1 -- 172.21.15.55:0/3530388360 wait complete. 2024-04-25T08:56:14.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.304+0000 7fded78ee640 1 Processor -- start 2024-04-25T08:56:14.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.304+0000 7fded78ee640 1 -- start start 2024-04-25T08:56:14.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.304+0000 7fded78ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fded00b5990 0x7fded01f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.304+0000 7fded78ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded00d35b0 0x7fded0154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.304+0000 7fded78ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fded015dce0 0x7fded00ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.304+0000 7fded78ee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00d2160 con 0x7fded00d35b0 2024-04-25T08:56:14.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.304+0000 7fded78ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00d3090 con 0x7fded00b5990 2024-04-25T08:56:14.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.304+0000 7fded78ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded01f3090 con 0x7fded015dce0 2024-04-25T08:56:14.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.304+0000 7fded4e89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded00d35b0 0x7fded0154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.304+0000 7fded4e89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded00d35b0 0x7fded0154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55904/0 (socket says 172.21.15.55:55904) 2024-04-25T08:56:14.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.304+0000 7fded4e89640 1 -- 172.21.15.55:0/1450285329 learned_addr learned my addr 172.21.15.55:0/1450285329 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fded568a640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fded00b5990 0x7fded01f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fded5e8b640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fded015dce0 0x7fded00ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fded4e89640 1 -- 172.21.15.55:0/1450285329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fded015dce0 msgr2=0x7fded00ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fded4e89640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fded015dce0 0x7fded00ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fded4e89640 1 -- 172.21.15.55:0/1450285329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fded00b5990 msgr2=0x7fded01f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fded4e89640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fded00b5990 0x7fded01f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fded4e89640 1 -- 172.21.15.55:0/1450285329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded0158670 con 0x7fded00d35b0 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fded4e89640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded00d35b0 0x7fded0154590 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdec0035040 tx=0x7fdec00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fdec5ffb640 1 -- 172.21.15.55:0/1450285329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0042020 con 0x7fded00d35b0 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fdec5ffb640 1 -- 172.21.15.55:0/1450285329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec003d470 con 0x7fded00d35b0 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fded78ee640 1 -- 172.21.15.55:0/1450285329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded0158950 con 0x7fded00d35b0 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fdec5ffb640 1 -- 172.21.15.55:0/1450285329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0037040 con 0x7fded00d35b0 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.305+0000 7fded78ee640 1 -- 172.21.15.55:0/1450285329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded0158f10 con 0x7fded00d35b0 2024-04-25T08:56:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.306+0000 7fded78ee640 1 -- 172.21.15.55:0/1450285329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded00749b0 con 0x7fded00d35b0 2024-04-25T08:56:14.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.307+0000 7fdec5ffb640 1 -- 172.21.15.55:0/1450285329 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdec0045020 con 0x7fded00d35b0 2024-04-25T08:56:14.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.307+0000 7fdec5ffb640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb406b4d0 0x7fdeb406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.307+0000 7fdec5ffb640 1 -- 172.21.15.55:0/1450285329 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdec00aa480 con 0x7fded00d35b0 2024-04-25T08:56:14.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.307+0000 7fded568a640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb406b4d0 0x7fdeb406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.308+0000 7fded568a640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb406b4d0 0x7fdeb406d990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdecc000f60 tx=0x7fdecc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:14.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.311+0000 7fdec5ffb640 1 -- 172.21.15.55:0/1450285329 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdec004c030 con 0x7fded00d35b0 2024-04-25T08:56:14.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.567+0000 7fded78ee640 1 -- 172.21.15.55:0/1450285329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fded015f860 con 0x7fded00d35b0 2024-04-25T08:56:14.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.567+0000 7fdec5ffb640 1 -- 172.21.15.55:0/1450285329 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdec00791b0 con 0x7fded00d35b0 2024-04-25T08:56:14.557 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:14.557 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm4IxeGBAAwuzfw8fkgBWLS/OHkVRPdA==", 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmz17MIxAAOjfHLP2pVtyOH1KkaFBdpw==", 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcJlOHxAAWRBqx21VaZdp7n+bG6QdjA==", 2024-04-25T08:56:14.559 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmbKyTKhAARg7pgR8TeZKNHV38FuAv+g==", 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:56:14.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDgGSpmMDqwHRAAte7ZpF14thK4VEsC4getWg==", 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-25T08:56:14.561 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDjGSpm7bEhHRAALQKewGfpKljGFsW75+h/Dg==", 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDmGSpmjg2RHBAA+DxXqJHuPIGUsVvwUirEwg==", 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:56:14.562 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDpGSpmxft1HBAAsIYtKh97QF4WhdL9kI2QeA==", 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDvGSpm4QDFIRAAlMSvRI/gNR4p8BgQdRUcBA==", 2024-04-25T08:56:14.563 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.564 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:56:14.564 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:56:14.564 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.564 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.564 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.564 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.564 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyGSpmARfiHxAABn3CWZTkyRxXpTUxKGi71A==", 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1GSpmLHBmHRAA4xXuyYK95pq8g+DAXREvKQ==", 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4GSpmMbpPGxAAP7YWBUzcafaowcZG1ZWhDA==", 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.566 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw==", 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.567 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcP0TNxAA02w2xuYx7fMlMbZpgy53hQ==", 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmpD8INBAA29l06IV/RnM5qxOD6VL3MA==", 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:56:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDaGSpm8xftABAADCQqbD2gknLM2w+MV/H29A==", 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.569 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDYGSpmHI4oORAAQoQL0ylKsbBRG+EldcMd4g==", 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmk2Q/FRAAwGHbq7UsFI+OdwcBOqLnlA==", 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:56:14.570 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm6NfaERAAtb5ZheEavSDdOCOxeM0a2Q==", 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.571 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:14.572 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-25T08:56:14.572 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:56:14.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 -- 172.21.15.55:0/1450285329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb406b4d0 msgr2=0x7fdeb406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb406b4d0 0x7fdeb406d990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdecc000f60 tx=0x7fdecc009040 comp rx=0 tx=0).stop 2024-04-25T08:56:14.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 -- 172.21.15.55:0/1450285329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded00d35b0 msgr2=0x7fded0154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded00d35b0 0x7fded0154590 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdec0035040 tx=0x7fdec00046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 -- 172.21.15.55:0/1450285329 shutdown_connections 2024-04-25T08:56:14.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb406b4d0 0x7fdeb406d990 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fded015dce0 0x7fded00ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded00d35b0 0x7fded0154590 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 --2- 172.21.15.55:0/1450285329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fded00b5990 0x7fded01f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 -- 172.21.15.55:0/1450285329 >> 172.21.15.55:0/1450285329 conn(0x7fded0072900 msgr2=0x7fded015cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:14.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 -- 172.21.15.55:0/1450285329 shutdown_connections 2024-04-25T08:56:14.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.570+0000 7fded78ee640 1 -- 172.21.15.55:0/1450285329 wait complete. 2024-04-25T08:56:14.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.687+0000 7fe9f086f640 1 Processor -- start 2024-04-25T08:56:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.687+0000 7fe9f086f640 1 -- start start 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.687+0000 7fe9f086f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ec15dce0 0x7fe9ec0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.687+0000 7fe9f086f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec15e0c0 con 0x7fe9ec0b5b60 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.687+0000 7fe9f086f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec0d2510 con 0x7fe9ec0d35b0 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.687+0000 7fe9f086f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0d27f0 con 0x7fe9ec15dce0 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9ead9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe9ec0b5b60 0x7fe9ec0b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59802/0 (socket says 172.21.15.55:59802) 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9ead9d640 1 -- 172.21.15.55:0/753747366 learned_addr learned my addr 172.21.15.55:0/753747366 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9ea59c640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ec15dce0 0x7fe9ec0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485626946 0 0) 0x7fe9ec15e0c0 con 0x7fe9ec0b5b60 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d8003520 con 0x7fe9ec0b5b60 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2072545718 0 0) 0x7fe9d8003520 con 0x7fe9ec0b5b60 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ec15dce0 msgr2=0x7fe9ec0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ec15dce0 0x7fe9ec0d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 >> v1:172.21.15.167:6789/0 conn(0x7fe9ec0d35b0 legacy=0x7fe9ec0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0d2ad0 con 0x7fe9ec0b5b60 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fe9e40019f0 con 0x7fe9ec0b5b60 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 >> v1:172.21.15.55:6789/0 conn(0x7fe9ec0b5b60 legacy=0x7fe9ec0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d80039e0 0x7fe9d8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9d8004390 0x7fe9d8004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ec15dce0 0x7fe9d80050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0d27f0 con 0x7fe9d80039e0 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d800b9c0 con 0x7fe9d8004390 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d800bbc0 con 0x7fe9ec15dce0 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9ea59c640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d80039e0 0x7fe9d8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9e3fff640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9d8004390 0x7fe9d8004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.688+0000 7fe9ead9d640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ec15dce0 0x7fe9d80050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.689+0000 7fe9ea59c640 1 -- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ec15dce0 msgr2=0x7fe9d80050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.689+0000 7fe9ea59c640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ec15dce0 0x7fe9d80050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.689+0000 7fe9ea59c640 1 -- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9d8004390 msgr2=0x7fe9d8004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.689+0000 7fe9ea59c640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9d8004390 0x7fe9d8004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.689+0000 7fe9ea59c640 1 -- 172.21.15.55:0/753747366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d8003520 con 0x7fe9d80039e0 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.689+0000 7fe9e3fff640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9d8004390 0x7fe9d8004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.689+0000 7fe9ea59c640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d80039e0 0x7fe9d8003dc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009ac0 tx=0x7fe9d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea84eba3cf343e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.689+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc036070 con 0x7fe9d80039e0 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.689+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc031400 con 0x7fe9d80039e0 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.689+0000 7fe9e9d9b640 1 -- 172.21.15.55:0/753747366 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc009690 con 0x7fe9d80039e0 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.690+0000 7fe9f086f640 1 -- 172.21.15.55:0/753747366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d80039e0 msgr2=0x7fe9d8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.690+0000 7fe9f086f640 1 --2- 172.21.15.55:0/753747366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d80039e0 0x7fe9d8003dc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009ac0 tx=0x7fe9d8005830 comp rx=0 tx=0).stop 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.690+0000 7fe9ead9d640 1 -- 172.21.15.55:0/753747366 reap_dead start 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.690+0000 7fe9f086f640 1 -- 172.21.15.55:0/753747366 shutdown_connections 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.690+0000 7fe9f086f640 1 -- 172.21.15.55:0/753747366 >> 172.21.15.55:0/753747366 conn(0x7fe9ec072900 msgr2=0x7fe9ec0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.690+0000 7fe9f086f640 1 -- 172.21.15.55:0/753747366 shutdown_connections 2024-04-25T08:56:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.690+0000 7fe9f086f640 1 -- 172.21.15.55:0/753747366 wait complete. 2024-04-25T08:56:14.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.691+0000 7fe9f086f640 1 Processor -- start 2024-04-25T08:56:14.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.691+0000 7fe9f086f640 1 -- start start 2024-04-25T08:56:14.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.692+0000 7fe9f086f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9d80039e0 0x7fe9ec0aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.692+0000 7fe9f086f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9ec15a000 0x7fe9ec0ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.692+0000 7fe9f086f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ec160b60 0x7fe9ec1f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.692+0000 7fe9f086f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0b9820 con 0x7fe9ec160b60 2024-04-25T08:56:14.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.692+0000 7fe9f086f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0d3090 con 0x7fe9ec15a000 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.692+0000 7fe9f086f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0b99a0 con 0x7fe9d80039e0 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.692+0000 7fe9ead9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ec160b60 0x7fe9ec1f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.692+0000 7fe9ead9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ec160b60 0x7fe9ec1f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55928/0 (socket says 172.21.15.55:55928) 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.692+0000 7fe9ead9d640 1 -- 172.21.15.55:0/3258201813 learned_addr learned my addr 172.21.15.55:0/3258201813 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.692+0000 7fe9e3fff640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9ec15a000 0x7fe9ec0ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.692+0000 7fe9ea59c640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9d80039e0 0x7fe9ec0aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.693+0000 7fe9ead9d640 1 -- 172.21.15.55:0/3258201813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9d80039e0 msgr2=0x7fe9ec0aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.693+0000 7fe9ead9d640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9d80039e0 0x7fe9ec0aacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.693+0000 7fe9ead9d640 1 -- 172.21.15.55:0/3258201813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9ec15a000 msgr2=0x7fe9ec0ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.693+0000 7fe9ead9d640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9ec15a000 0x7fe9ec0ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.693+0000 7fe9ead9d640 1 -- 172.21.15.55:0/3258201813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec15fe00 con 0x7fe9ec160b60 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.693+0000 7fe9ead9d640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ec160b60 0x7fe9ec1f38e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0ce220 tx=0x7fe9e400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.693+0000 7fe9e2ffd640 1 -- 172.21.15.55:0/3258201813 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400eb90 con 0x7fe9ec160b60 2024-04-25T08:56:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.693+0000 7fe9e2ffd640 1 -- 172.21.15.55:0/3258201813 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e4018070 con 0x7fe9ec160b60 2024-04-25T08:56:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.693+0000 7fe9e2ffd640 1 -- 172.21.15.55:0/3258201813 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4013420 con 0x7fe9ec160b60 2024-04-25T08:56:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.693+0000 7fe9f086f640 1 -- 172.21.15.55:0/3258201813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec15a7e0 con 0x7fe9ec160b60 2024-04-25T08:56:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.693+0000 7fe9f086f640 1 -- 172.21.15.55:0/3258201813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec160380 con 0x7fe9ec160b60 2024-04-25T08:56:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.694+0000 7fe9f086f640 1 -- 172.21.15.55:0/3258201813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec0749b0 con 0x7fe9ec160b60 2024-04-25T08:56:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.694+0000 7fe9e2ffd640 1 -- 172.21.15.55:0/3258201813 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe9e40135c0 con 0x7fe9ec160b60 2024-04-25T08:56:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.695+0000 7fe9e2ffd640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9cc06b500 0x7fe9cc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.695+0000 7fe9e2ffd640 1 -- 172.21.15.55:0/3258201813 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe9e4089f40 con 0x7fe9ec160b60 2024-04-25T08:56:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.695+0000 7fe9ea59c640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9cc06b500 0x7fe9cc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.696+0000 7fe9ea59c640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9cc06b500 0x7fe9cc06d9c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009ac0 tx=0x7fe9dc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:14.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.699+0000 7fe9e2ffd640 1 -- 172.21.15.55:0/3258201813 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe9e4058b50 con 0x7fe9ec160b60 2024-04-25T08:56:14.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.881+0000 7fe9f086f640 1 -- 172.21.15.55:0/3258201813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9ec0b5460 con 0x7fe9ec160b60 2024-04-25T08:56:14.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.882+0000 7fe9e2ffd640 1 -- 172.21.15.55:0/3258201813 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+12891 (secure 0 0 0) 0x7fe9e4086270 con 0x7fe9ec160b60 2024-04-25T08:56:14.871 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:14.872 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":57,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:56:14.173609+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:14.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 -- 172.21.15.55:0/3258201813 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9cc06b500 msgr2=0x7fe9cc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9cc06b500 0x7fe9cc06d9c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009ac0 tx=0x7fe9dc008030 comp rx=0 tx=0).stop 2024-04-25T08:56:14.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 -- 172.21.15.55:0/3258201813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ec160b60 msgr2=0x7fe9ec1f38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ec160b60 0x7fe9ec1f38e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0ce220 tx=0x7fe9e400e530 comp rx=0 tx=0).stop 2024-04-25T08:56:14.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 -- 172.21.15.55:0/3258201813 shutdown_connections 2024-04-25T08:56:14.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe9cc06b500 0x7fe9cc06d9c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ec160b60 0x7fe9ec1f38e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9ec15a000 0x7fe9ec0ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 --2- 172.21.15.55:0/3258201813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9d80039e0 0x7fe9ec0aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 -- 172.21.15.55:0/3258201813 >> 172.21.15.55:0/3258201813 conn(0x7fe9ec072900 msgr2=0x7fe9ec0b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:14.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 -- 172.21.15.55:0/3258201813 shutdown_connections 2024-04-25T08:56:14.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:14.884+0000 7fe9f086f640 1 -- 172.21.15.55:0/3258201813 wait complete. 2024-04-25T08:56:14.885 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:56:14.885 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:56:14.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.000+0000 7ff19506b640 1 Processor -- start 2024-04-25T08:56:14.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.000+0000 7ff19506b640 1 -- start start 2024-04-25T08:56:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.000+0000 7ff19506b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1900b5580 0x7ff1900b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.000+0000 7ff19506b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1900b24c0 0x7ff1900b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.000+0000 7ff19506b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19006c4b0 con 0x7ff1900b98b0 2024-04-25T08:56:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.000+0000 7ff19506b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19015bb80 con 0x7ff1900b5580 2024-04-25T08:56:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.000+0000 7ff19506b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19006c790 con 0x7ff1900b24c0 2024-04-25T08:56:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.001+0000 7ff187fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1900b5580 0x7ff1900b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.001+0000 7ff18ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff1900b98b0 0x7ff19015eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59816/0 (socket says 172.21.15.55:59816) 2024-04-25T08:56:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.001+0000 7ff18ed9d640 1 -- 172.21.15.55:0/317101155 learned_addr learned my addr 172.21.15.55:0/317101155 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.001+0000 7ff18f59e640 1 --2- 172.21.15.55:0/317101155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1900b24c0 0x7ff1900b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.001+0000 7ff18e59c640 1 -- 172.21.15.55:0/317101155 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294677528 0 0) 0x7ff19006c4b0 con 0x7ff1900b98b0 2024-04-25T08:56:14.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.001+0000 7ff18e59c640 1 -- 172.21.15.55:0/317101155 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff17c003520 con 0x7ff1900b98b0 2024-04-25T08:56:14.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.001+0000 7ff187fff640 1 -- 172.21.15.55:0/317101155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1900b24c0 msgr2=0x7ff1900b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:14.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.001+0000 7ff187fff640 1 --2- 172.21.15.55:0/317101155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1900b24c0 0x7ff1900b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.001+0000 7ff187fff640 1 -- 172.21.15.55:0/317101155 >> v1:172.21.15.55:6789/0 conn(0x7ff1900b98b0 legacy=0x7ff19015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.001+0000 7ff187fff640 1 -- 172.21.15.55:0/317101155 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19006ca70 con 0x7ff1900b5580 2024-04-25T08:56:14.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff187fff640 1 --2- 172.21.15.55:0/317101155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900b5580 0x7ff1900b5a30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff1780097a0 tx=0x7ff17802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91494ebd027dda34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:14.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff18e59c640 1 -- 172.21.15.55:0/317101155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178037070 con 0x7ff1900b5580 2024-04-25T08:56:14.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff18e59c640 1 -- 172.21.15.55:0/317101155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17802adb0 con 0x7ff1900b5580 2024-04-25T08:56:14.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff18e59c640 1 -- 172.21.15.55:0/317101155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178032660 con 0x7ff1900b5580 2024-04-25T08:56:14.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff19506b640 1 -- 172.21.15.55:0/317101155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900b5580 msgr2=0x7ff1900b5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff19506b640 1 --2- 172.21.15.55:0/317101155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900b5580 0x7ff1900b5a30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff1780097a0 tx=0x7ff17802a060 comp rx=0 tx=0).stop 2024-04-25T08:56:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff19506b640 1 -- 172.21.15.55:0/317101155 shutdown_connections 2024-04-25T08:56:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff19506b640 1 --2- 172.21.15.55:0/317101155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1900b24c0 0x7ff1900b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff19506b640 1 --2- 172.21.15.55:0/317101155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900b5580 0x7ff1900b5a30 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff19506b640 1 -- 172.21.15.55:0/317101155 >> 172.21.15.55:0/317101155 conn(0x7ff1900d0580 msgr2=0x7ff1900d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff19506b640 1 -- 172.21.15.55:0/317101155 shutdown_connections 2024-04-25T08:56:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.002+0000 7ff19506b640 1 -- 172.21.15.55:0/317101155 wait complete. 2024-04-25T08:56:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.004+0000 7ff19506b640 1 Processor -- start 2024-04-25T08:56:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.004+0000 7ff19506b640 1 -- start start 2024-04-25T08:56:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.004+0000 7ff19506b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900b24c0 0x7ff190158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.004+0000 7ff19506b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1900b5580 0x7ff1900c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.004+0000 7ff19506b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1900ca160 0x7ff190160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.004+0000 7ff19506b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900cec40 con 0x7ff1900b24c0 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.004+0000 7ff19506b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19006c140 con 0x7ff1900ca160 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.004+0000 7ff19506b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900b2e70 con 0x7ff1900b5580 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff18ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900b24c0 0x7ff190158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff18ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900b24c0 0x7ff190158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55940/0 (socket says 172.21.15.55:55940) 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff18ed9d640 1 -- 172.21.15.55:0/3991227726 learned_addr learned my addr 172.21.15.55:0/3991227726 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff18f59e640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1900ca160 0x7ff190160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff187fff640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1900b5580 0x7ff1900c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff18ed9d640 1 -- 172.21.15.55:0/3991227726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1900b5580 msgr2=0x7ff1900c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff18ed9d640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1900b5580 0x7ff1900c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff18ed9d640 1 -- 172.21.15.55:0/3991227726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1900ca160 msgr2=0x7ff190160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff18ed9d640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1900ca160 0x7ff190160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff18ed9d640 1 -- 172.21.15.55:0/3991227726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1901f4740 con 0x7ff1900b24c0 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff18f59e640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1900ca160 0x7ff190160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff187fff640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1900b5580 0x7ff1900c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff18ed9d640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900b24c0 0x7ff190158390 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff18000c390 tx=0x7ff18000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff1877fe640 1 -- 172.21.15.55:0/3991227726 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff180017070 con 0x7ff1900b24c0 2024-04-25T08:56:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff1877fe640 1 -- 172.21.15.55:0/3991227726 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff180005ce0 con 0x7ff1900b24c0 2024-04-25T08:56:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff19506b640 1 -- 172.21.15.55:0/3991227726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1901f3b30 con 0x7ff1900b24c0 2024-04-25T08:56:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff1877fe640 1 -- 172.21.15.55:0/3991227726 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1800072f0 con 0x7ff1900b24c0 2024-04-25T08:56:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.005+0000 7ff19506b640 1 -- 172.21.15.55:0/3991227726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1901f40f0 con 0x7ff1900b24c0 2024-04-25T08:56:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.006+0000 7ff19506b640 1 -- 172.21.15.55:0/3991227726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1900750b0 con 0x7ff1900b24c0 2024-04-25T08:56:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.007+0000 7ff1877fe640 1 -- 172.21.15.55:0/3991227726 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff18001a070 con 0x7ff1900b24c0 2024-04-25T08:56:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.007+0000 7ff1877fe640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff17006b500 0x7ff17006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.007+0000 7ff1877fe640 1 -- 172.21.15.55:0/3991227726 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff180089310 con 0x7ff1900b24c0 2024-04-25T08:56:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.007+0000 7ff187fff640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff17006b500 0x7ff17006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.008+0000 7ff187fff640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff17006b500 0x7ff17006d9c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff178034000 tx=0x7ff17802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.012+0000 7ff1877fe640 1 -- 172.21.15.55:0/3991227726 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff180058450 con 0x7ff1900b24c0 2024-04-25T08:56:15.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.193+0000 7ff19506b640 1 -- 172.21.15.55:0/3991227726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff190161a90 con 0x7ff1900b24c0 2024-04-25T08:56:15.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.194+0000 7ff1877fe640 1 -- 172.21.15.55:0/3991227726 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff180057d50 con 0x7ff1900b24c0 2024-04-25T08:56:15.183 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:56:15.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 -- 172.21.15.55:0/3991227726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff17006b500 msgr2=0x7ff17006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff17006b500 0x7ff17006d9c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff178034000 tx=0x7ff17802e000 comp rx=0 tx=0).stop 2024-04-25T08:56:15.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 -- 172.21.15.55:0/3991227726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900b24c0 msgr2=0x7ff190158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900b24c0 0x7ff190158390 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff18000c390 tx=0x7ff18000c850 comp rx=0 tx=0).stop 2024-04-25T08:56:15.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 -- 172.21.15.55:0/3991227726 shutdown_connections 2024-04-25T08:56:15.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff17006b500 0x7ff17006d9c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1900ca160 0x7ff190160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1900b5580 0x7ff1900c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 --2- 172.21.15.55:0/3991227726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900b24c0 0x7ff190158390 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 -- 172.21.15.55:0/3991227726 >> 172.21.15.55:0/3991227726 conn(0x7ff1900d0580 msgr2=0x7ff1900d1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:15.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 -- 172.21.15.55:0/3991227726 shutdown_connections 2024-04-25T08:56:15.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.196+0000 7ff19506b640 1 -- 172.21.15.55:0/3991227726 wait complete. 2024-04-25T08:56:15.197 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:56:15.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.308+0000 7fb1b6f5c640 1 Processor -- start 2024-04-25T08:56:15.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.308+0000 7fb1b6f5c640 1 -- start start 2024-04-25T08:56:15.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1b6f5c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b015dce0 0x7fb1b00d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1b6f5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b015e0c0 con 0x7fb1b00d35b0 2024-04-25T08:56:15.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1b6f5c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b00d2510 con 0x7fb1b00b5b60 2024-04-25T08:56:15.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1b6f5c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00d27f0 con 0x7fb1b015dce0 2024-04-25T08:56:15.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1affff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb1b00d35b0 0x7fb1b00b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59822/0 (socket says 172.21.15.55:59822) 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1affff640 1 -- 172.21.15.55:0/3778665928 learned_addr learned my addr 172.21.15.55:0/3778665928 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1b4cf8640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b015dce0 0x7fb1b00d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759397484 0 0) 0x7fb1b015e0c0 con 0x7fb1b00d35b0 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a0003520 con 0x7fb1b00d35b0 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1114532272 0 0) 0x7fb1a0003520 con 0x7fb1b00d35b0 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b015dce0 msgr2=0x7fb1b00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b015dce0 0x7fb1b00d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 >> v1:172.21.15.167:6789/0 conn(0x7fb1b00b5b60 legacy=0x7fb1b00b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b00d2ad0 con 0x7fb1b00d35b0 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fb19c001670 con 0x7fb1b00d35b0 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 >> v1:172.21.15.55:6789/0 conn(0x7fb1b00d35b0 legacy=0x7fb1b00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b015dce0 0x7fb1a00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a0003f20 0x7fb1a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1a0004d40 0x7fb1a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00d27f0 con 0x7fb1a0003f20 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a000ba20 con 0x7fb1a0004d40 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.309+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a000bc20 con 0x7fb1b015dce0 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.310+0000 7fb1affff640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a0003f20 0x7fb1a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.310+0000 7fb1b54f9640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1a0004d40 0x7fb1a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.310+0000 7fb1b4cf8640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b015dce0 0x7fb1a00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.310+0000 7fb1affff640 1 -- 172.21.15.55:0/3778665928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b015dce0 msgr2=0x7fb1a00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.310+0000 7fb1affff640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1b015dce0 0x7fb1a00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.310+0000 7fb1affff640 1 -- 172.21.15.55:0/3778665928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1a0004d40 msgr2=0x7fb1a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.310+0000 7fb1affff640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1a0004d40 0x7fb1a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.310+0000 7fb1affff640 1 -- 172.21.15.55:0/3778665928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0003520 con 0x7fb1a0003f20 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.311+0000 7fb1affff640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a0003f20 0x7fb1a0004800 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c240 tx=0x7fb1a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fda75335f2093e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.311+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c007d30 con 0x7fb1a0003f20 2024-04-25T08:56:15.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.311+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c005af0 con 0x7fb1a0003f20 2024-04-25T08:56:15.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.311+0000 7fb1af7fe640 1 -- 172.21.15.55:0/3778665928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c007070 con 0x7fb1a0003f20 2024-04-25T08:56:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.311+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/3778665928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a0003f20 msgr2=0x7fb1a0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.311+0000 7fb1b6f5c640 1 --2- 172.21.15.55:0/3778665928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a0003f20 0x7fb1a0004800 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c240 tx=0x7fb1a0005830 comp rx=0 tx=0).stop 2024-04-25T08:56:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.311+0000 7fb1b54f9640 1 -- 172.21.15.55:0/3778665928 reap_dead start 2024-04-25T08:56:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.311+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/3778665928 shutdown_connections 2024-04-25T08:56:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.311+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/3778665928 >> 172.21.15.55:0/3778665928 conn(0x7fb1b0072900 msgr2=0x7fb1b00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.311+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/3778665928 shutdown_connections 2024-04-25T08:56:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.311+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/3778665928 wait complete. 2024-04-25T08:56:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.312+0000 7fb1b6f5c640 1 Processor -- start 2024-04-25T08:56:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.312+0000 7fb1b6f5c640 1 -- start start 2024-04-25T08:56:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.313+0000 7fb1b6f5c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a0003f20 0x7fb1b0156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.313+0000 7fb1b6f5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b00cc7c0 0x7fb1b0153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.313+0000 7fb1b6f5c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b00ccc20 0x7fb1b01542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.313+0000 7fb1b6f5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00b9820 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.313+0000 7fb1b6f5c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00d3090 con 0x7fb1b00ccc20 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.313+0000 7fb1b6f5c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00b99a0 con 0x7fb1a0003f20 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.313+0000 7fb1affff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b00cc7c0 0x7fb1b0153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.313+0000 7fb1affff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b00cc7c0 0x7fb1b0153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55958/0 (socket says 172.21.15.55:55958) 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.313+0000 7fb1affff640 1 -- 172.21.15.55:0/2037944054 learned_addr learned my addr 172.21.15.55:0/2037944054 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1b54f9640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b00ccc20 0x7fb1b01542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1b4cf8640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a0003f20 0x7fb1b0156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1affff640 1 -- 172.21.15.55:0/2037944054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a0003f20 msgr2=0x7fb1b0156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1affff640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a0003f20 0x7fb1b0156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1affff640 1 -- 172.21.15.55:0/2037944054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b00ccc20 msgr2=0x7fb1b01542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1affff640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b00ccc20 0x7fb1b01542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1affff640 1 -- 172.21.15.55:0/2037944054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b01470c0 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1affff640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b00cc7c0 0x7fb1b0153d80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb19c02ad60 tx=0x7fb1b00d26e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1ad7fa640 1 -- 172.21.15.55:0/2037944054 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c001630 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1ad7fa640 1 -- 172.21.15.55:0/2037944054 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c042070 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1ad7fa640 1 -- 172.21.15.55:0/2037944054 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c007290 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/2037944054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b0146de0 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.314+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/2037944054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b0156240 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.315+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/2037944054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b0155d70 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.316+0000 7fb1ad7fa640 1 -- 172.21.15.55:0/2037944054 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb19c007430 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.316+0000 7fb1ad7fa640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19406b500 0x7fb19406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.316+0000 7fb1ad7fa640 1 -- 172.21.15.55:0/2037944054 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb19c0a9de0 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.316+0000 7fb1b4cf8640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19406b500 0x7fb19406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.317+0000 7fb1b4cf8640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19406b500 0x7fb19406d9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009bc0 tx=0x7fb1a4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:15.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.320+0000 7fb1ad7fa640 1 -- 172.21.15.55:0/2037944054 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb19c0790d0 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.503+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/2037944054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb1b00749b0 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.503+0000 7fb1ad7fa640 1 -- 172.21.15.55:0/2037944054 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb19c0789d0 con 0x7fb1b00cc7c0 2024-04-25T08:56:15.493 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:15.493 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T08:56:15.493 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:15.493 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-25T08:56:15.493 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-25T08:56:15.493 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:15.493 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T08:56:15.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/2037944054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19406b500 msgr2=0x7fb19406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19406b500 0x7fb19406d9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009bc0 tx=0x7fb1a4009190 comp rx=0 tx=0).stop 2024-04-25T08:56:15.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/2037944054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b00cc7c0 msgr2=0x7fb1b0153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b00cc7c0 0x7fb1b0153d80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb19c02ad60 tx=0x7fb1b00d26e0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/2037944054 shutdown_connections 2024-04-25T08:56:15.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb19406b500 0x7fb19406d9c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b00ccc20 0x7fb1b01542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b00cc7c0 0x7fb1b0153d80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 --2- 172.21.15.55:0/2037944054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1a0003f20 0x7fb1b0156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/2037944054 >> 172.21.15.55:0/2037944054 conn(0x7fb1b0072900 msgr2=0x7fb1b00d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:15.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/2037944054 shutdown_connections 2024-04-25T08:56:15.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.505+0000 7fb1b6f5c640 1 -- 172.21.15.55:0/2037944054 wait complete. 2024-04-25T08:56:15.506 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:56:15.506 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:56:15.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.621+0000 7f447e3a5640 1 Processor -- start 2024-04-25T08:56:15.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.621+0000 7f447e3a5640 1 -- start start 2024-04-25T08:56:15.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f447e3a5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44780b9580 0x7f44781618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f447e3a5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4478162040 con 0x7f44780cef40 2024-04-25T08:56:15.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f447e3a5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4478162320 con 0x7f44781610b0 2024-04-25T08:56:15.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f447e3a5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44780b9a30 con 0x7f44780b9580 2024-04-25T08:56:15.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f44777fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f44780cef40 0x7f44780d2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59832/0 (socket says 172.21.15.55:59832) 2024-04-25T08:56:15.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f44777fe640 1 -- 172.21.15.55:0/949776794 learned_addr learned my addr 172.21.15.55:0/949776794 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:15.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f447c942640 1 --2- 172.21.15.55:0/949776794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44780b9580 0x7f44781618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f4476ffd640 1 -- 172.21.15.55:0/949776794 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334118978 0 0) 0x7f4478162040 con 0x7f44780cef40 2024-04-25T08:56:15.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f4476ffd640 1 -- 172.21.15.55:0/949776794 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4460003520 con 0x7f44780cef40 2024-04-25T08:56:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f4476ffd640 1 -- 172.21.15.55:0/949776794 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386752503 0 0) 0x7f4478162320 con 0x7f44781610b0 2024-04-25T08:56:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f4476ffd640 1 -- 172.21.15.55:0/949776794 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4478162040 con 0x7f44781610b0 2024-04-25T08:56:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f447c942640 1 -- 172.21.15.55:0/949776794 >> v1:172.21.15.167:6789/0 conn(0x7f44781610b0 legacy=0x7f44780ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f447c942640 1 -- 172.21.15.55:0/949776794 >> v1:172.21.15.55:6789/0 conn(0x7f44780cef40 legacy=0x7f44780d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.622+0000 7f447c942640 1 -- 172.21.15.55:0/949776794 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478162600 con 0x7f44780b9580 2024-04-25T08:56:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.623+0000 7f447c942640 1 --2- 172.21.15.55:0/949776794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44780b9580 0x7f44781618d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4470009dc0 tx=0x7f447002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f5d562df415272e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.623+0000 7f4476ffd640 1 -- 172.21.15.55:0/949776794 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447002ae60 con 0x7f44780b9580 2024-04-25T08:56:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.623+0000 7f4476ffd640 1 -- 172.21.15.55:0/949776794 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4470007740 con 0x7f44780b9580 2024-04-25T08:56:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.623+0000 7f4476ffd640 1 -- 172.21.15.55:0/949776794 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470007b10 con 0x7f44780b9580 2024-04-25T08:56:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.624+0000 7f447e3a5640 1 -- 172.21.15.55:0/949776794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44780b9580 msgr2=0x7f44781618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.624+0000 7f447e3a5640 1 --2- 172.21.15.55:0/949776794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44780b9580 0x7f44781618d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4470009dc0 tx=0x7f447002a640 comp rx=0 tx=0).stop 2024-04-25T08:56:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.624+0000 7f447e3a5640 1 -- 172.21.15.55:0/949776794 shutdown_connections 2024-04-25T08:56:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.624+0000 7f447e3a5640 1 --2- 172.21.15.55:0/949776794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44780b9580 0x7f44781618d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.624+0000 7f447e3a5640 1 -- 172.21.15.55:0/949776794 >> 172.21.15.55:0/949776794 conn(0x7f44780b5570 msgr2=0x7f44780b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.624+0000 7f447e3a5640 1 -- 172.21.15.55:0/949776794 shutdown_connections 2024-04-25T08:56:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.624+0000 7f447e3a5640 1 -- 172.21.15.55:0/949776794 wait complete. 2024-04-25T08:56:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.625+0000 7f447e3a5640 1 Processor -- start 2024-04-25T08:56:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.625+0000 7f447e3a5640 1 -- start start 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.626+0000 7f447e3a5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44780b9580 0x7f447813de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.626+0000 7f447e3a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44780cef40 0x7f447815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.626+0000 7f447e3a5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44781610b0 0x7f44780c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.626+0000 7f447e3a5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44780d1ea0 con 0x7f44780cef40 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.626+0000 7f447e3a5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44780b6c00 con 0x7f44780b9580 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.626+0000 7f447e3a5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4478161490 con 0x7f44781610b0 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.626+0000 7f44777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44780cef40 0x7f447815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.626+0000 7f44777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44780cef40 0x7f447815f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55968/0 (socket says 172.21.15.55:55968) 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.626+0000 7f44777fe640 1 -- 172.21.15.55:0/1906283611 learned_addr learned my addr 172.21.15.55:0/1906283611 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.626+0000 7f4477fff640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44780b9580 0x7f447813de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.626+0000 7f447c942640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44781610b0 0x7f44780c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.627+0000 7f44777fe640 1 -- 172.21.15.55:0/1906283611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44781610b0 msgr2=0x7f44780c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.627+0000 7f44777fe640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44781610b0 0x7f44780c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.627+0000 7f44777fe640 1 -- 172.21.15.55:0/1906283611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44780b9580 msgr2=0x7f447813de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.627+0000 7f44777fe640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44780b9580 0x7f447813de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.627+0000 7f44777fe640 1 -- 172.21.15.55:0/1906283611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478160480 con 0x7f44780cef40 2024-04-25T08:56:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.627+0000 7f44777fe640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44780cef40 0x7f447815f0b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f446800c500 tx=0x7f446800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.627+0000 7f4474ff9640 1 -- 172.21.15.55:0/1906283611 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468017070 con 0x7f44780cef40 2024-04-25T08:56:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.627+0000 7f4474ff9640 1 -- 172.21.15.55:0/1906283611 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4468005ce0 con 0x7f44780cef40 2024-04-25T08:56:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.627+0000 7f447e3a5640 1 -- 172.21.15.55:0/1906283611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44780caea0 con 0x7f44780cef40 2024-04-25T08:56:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.627+0000 7f4474ff9640 1 -- 172.21.15.55:0/1906283611 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680072f0 con 0x7f44780cef40 2024-04-25T08:56:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.627+0000 7f447e3a5640 1 -- 172.21.15.55:0/1906283611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44780cb460 con 0x7f44780cef40 2024-04-25T08:56:15.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.628+0000 7f447e3a5640 1 -- 172.21.15.55:0/1906283611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44780750b0 con 0x7f44780cef40 2024-04-25T08:56:15.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.628+0000 7f4474ff9640 1 -- 172.21.15.55:0/1906283611 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f446801a070 con 0x7f44780cef40 2024-04-25T08:56:15.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.629+0000 7f4474ff9640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f446406b500 0x7f446406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:15.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.629+0000 7f4474ff9640 1 -- 172.21.15.55:0/1906283611 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f44680890a0 con 0x7f44780cef40 2024-04-25T08:56:15.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.629+0000 7f4477fff640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f446406b500 0x7f446406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:15.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.629+0000 7f4477fff640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f446406b500 0x7f446406d9c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f446c007fd0 tx=0x7f446c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:15.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.633+0000 7f4474ff9640 1 -- 172.21.15.55:0/1906283611 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4468057cb0 con 0x7f44780cef40 2024-04-25T08:56:15.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:15.815+0000 7f447e3a5640 1 -- 172.21.15.55:0/1906283611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f44780d1770 con 0x7f44780cef40 2024-04-25T08:56:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.181+0000 7f4474ff9640 1 -- 172.21.15.55:0/1906283611 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v58) v1 ==== 138+0+0 (secure 0 0 0) 0x7f446805bd50 con 0x7f44780cef40 2024-04-25T08:56:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-25T08:56:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.183+0000 7f447e3a5640 1 -- 172.21.15.55:0/1906283611 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f446406b500 msgr2=0x7f446406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.183+0000 7f447e3a5640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f446406b500 0x7f446406d9c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f446c007fd0 tx=0x7f446c009040 comp rx=0 tx=0).stop 2024-04-25T08:56:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.183+0000 7f447e3a5640 1 -- 172.21.15.55:0/1906283611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44780cef40 msgr2=0x7f447815f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.183+0000 7f447e3a5640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44780cef40 0x7f447815f0b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f446800c500 tx=0x7f446800c9c0 comp rx=0 tx=0).stop 2024-04-25T08:56:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.183+0000 7f447e3a5640 1 -- 172.21.15.55:0/1906283611 shutdown_connections 2024-04-25T08:56:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.183+0000 7f447e3a5640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f446406b500 0x7f446406d9c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.183+0000 7f447e3a5640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44781610b0 0x7f44780c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.183+0000 7f447e3a5640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44780cef40 0x7f447815f0b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.183+0000 7f447e3a5640 1 --2- 172.21.15.55:0/1906283611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44780b9580 0x7f447813de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.183+0000 7f447e3a5640 1 -- 172.21.15.55:0/1906283611 >> 172.21.15.55:0/1906283611 conn(0x7f44780b5570 msgr2=0x7f44780b6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.184+0000 7f447e3a5640 1 -- 172.21.15.55:0/1906283611 shutdown_connections 2024-04-25T08:56:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.184+0000 7f447e3a5640 1 -- 172.21.15.55:0/1906283611 wait complete. 2024-04-25T08:56:16.188 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:56:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.308+0000 7f06480f7640 1 Processor -- start 2024-04-25T08:56:16.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.308+0000 7f06480f7640 1 -- start start 2024-04-25T08:56:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.309+0000 7f06480f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06400b9290 0x7f06400d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.309+0000 7f06480f7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06400b9700 0x7f06400d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.309+0000 7f06480f7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064015e070 con 0x7f064015dc90 2024-04-25T08:56:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.309+0000 7f06480f7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06400d1b10 con 0x7f06400b9290 2024-04-25T08:56:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.309+0000 7f06480f7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06400d1df0 con 0x7f06400b9700 2024-04-25T08:56:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.309+0000 7f0645692640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06400b9290 0x7f06400d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.309+0000 7f0645e93640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f064015dc90 0x7f06400d2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59840/0 (socket says 172.21.15.55:59840) 2024-04-25T08:56:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.309+0000 7f0645e93640 1 -- 172.21.15.55:0/227293859 learned_addr learned my addr 172.21.15.55:0/227293859 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.310+0000 7f0646694640 1 --2- 172.21.15.55:0/227293859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06400b9700 0x7f06400d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.310+0000 7f0645692640 1 -- 172.21.15.55:0/227293859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06400b9700 msgr2=0x7f06400d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.310+0000 7f0645692640 1 --2- 172.21.15.55:0/227293859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06400b9700 0x7f06400d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.310+0000 7f0645692640 1 -- 172.21.15.55:0/227293859 >> v1:172.21.15.55:6789/0 conn(0x7f064015dc90 legacy=0x7f06400d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.310+0000 7f0645692640 1 -- 172.21.15.55:0/227293859 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06400d20d0 con 0x7f06400b9290 2024-04-25T08:56:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.310+0000 7f0644e91640 1 -- 172.21.15.55:0/227293859 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42415428 0 0) 0x7f064015e070 con 0x7f064015dc90 2024-04-25T08:56:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.310+0000 7f0645692640 1 --2- 172.21.15.55:0/227293859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06400b9290 0x7f06400d0420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f06340097a0 tx=0x7f063402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7065aae0840ff68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.311+0000 7f0644e91640 1 -- 172.21.15.55:0/227293859 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634037070 con 0x7f06400b9290 2024-04-25T08:56:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.311+0000 7f0644e91640 1 -- 172.21.15.55:0/227293859 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634032440 con 0x7f06400b9290 2024-04-25T08:56:16.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.311+0000 7f0644e91640 1 -- 172.21.15.55:0/227293859 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634032810 con 0x7f06400b9290 2024-04-25T08:56:16.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.311+0000 7f06480f7640 1 -- 172.21.15.55:0/227293859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06400b9290 msgr2=0x7f06400d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:16.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.311+0000 7f06480f7640 1 --2- 172.21.15.55:0/227293859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06400b9290 0x7f06400d0420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f06340097a0 tx=0x7f063402a180 comp rx=0 tx=0).stop 2024-04-25T08:56:16.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.311+0000 7f06480f7640 1 -- 172.21.15.55:0/227293859 shutdown_connections 2024-04-25T08:56:16.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.311+0000 7f06480f7640 1 --2- 172.21.15.55:0/227293859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06400b9700 0x7f06400d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:16.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.311+0000 7f06480f7640 1 --2- 172.21.15.55:0/227293859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06400b9290 0x7f06400d0420 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:16.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.311+0000 7f06480f7640 1 -- 172.21.15.55:0/227293859 >> 172.21.15.55:0/227293859 conn(0x7f0640072900 msgr2=0x7f064006c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:16.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.311+0000 7f06480f7640 1 -- 172.21.15.55:0/227293859 shutdown_connections 2024-04-25T08:56:16.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.311+0000 7f06480f7640 1 -- 172.21.15.55:0/227293859 wait complete. 2024-04-25T08:56:16.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.312+0000 7f06480f7640 1 Processor -- start 2024-04-25T08:56:16.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.312+0000 7f06480f7640 1 -- start start 2024-04-25T08:56:16.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.313+0000 7f06480f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06400b9290 0x7f064014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:16.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.313+0000 7f06480f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06400b9700 0x7f06400b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:16.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.313+0000 7f06480f7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064015dc90 0x7f06400b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.313+0000 7f06480f7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06400d3480 con 0x7f06400b9700 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.313+0000 7f06480f7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06400d2690 con 0x7f06400b9290 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.313+0000 7f06480f7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06400d3600 con 0x7f064015dc90 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.313+0000 7f0645692640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06400b9700 0x7f06400b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.313+0000 7f0645692640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06400b9700 0x7f06400b4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55972/0 (socket says 172.21.15.55:55972) 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.313+0000 7f0645692640 1 -- 172.21.15.55:0/308330757 learned_addr learned my addr 172.21.15.55:0/308330757 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.313+0000 7f0645e93640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06400b9290 0x7f064014dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.313+0000 7f0646694640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064015dc90 0x7f06400b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f0645692640 1 -- 172.21.15.55:0/308330757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064015dc90 msgr2=0x7f06400b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f0645692640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064015dc90 0x7f06400b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f0645692640 1 -- 172.21.15.55:0/308330757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06400b9290 msgr2=0x7f064014dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f0645692640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06400b9290 0x7f064014dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f0645692640 1 -- 172.21.15.55:0/308330757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0640158fa0 con 0x7f06400b9700 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f0645e93640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06400b9290 0x7f064014dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:16.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f0646694640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064015dc90 0x7f06400b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:16.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f0645692640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06400b9700 0x7f06400b4e50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0634035040 tx=0x7f06340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:16.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f063e7fc640 1 -- 172.21.15.55:0/308330757 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634037040 con 0x7f06400b9700 2024-04-25T08:56:16.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f063e7fc640 1 -- 172.21.15.55:0/308330757 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634030770 con 0x7f06400b9700 2024-04-25T08:56:16.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f063e7fc640 1 -- 172.21.15.55:0/308330757 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634030b80 con 0x7f06400b9700 2024-04-25T08:56:16.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f06480f7640 1 -- 172.21.15.55:0/308330757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0640159280 con 0x7f06400b9700 2024-04-25T08:56:16.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.314+0000 7f06480f7640 1 -- 172.21.15.55:0/308330757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0640159840 con 0x7f06400b9700 2024-04-25T08:56:16.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.315+0000 7f06480f7640 1 -- 172.21.15.55:0/308330757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06400749b0 con 0x7f06400b9700 2024-04-25T08:56:16.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.316+0000 7f063e7fc640 1 -- 172.21.15.55:0/308330757 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0634044020 con 0x7f06400b9700 2024-04-25T08:56:16.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.316+0000 7f063e7fc640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f062c06b4d0 0x7f062c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:16.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.316+0000 7f0645e93640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f062c06b4d0 0x7f062c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:16.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.316+0000 7f063e7fc640 1 -- 172.21.15.55:0/308330757 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f06340aa4d0 con 0x7f06400b9700 2024-04-25T08:56:16.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.317+0000 7f0645e93640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f062c06b4d0 0x7f062c06d990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0638000f60 tx=0x7f0638007ca0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:16.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.321+0000 7f063e7fc640 1 -- 172.21.15.55:0/308330757 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0634032e20 con 0x7f06400b9700 2024-04-25T08:56:16.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:16.505+0000 7f06480f7640 1 -- 172.21.15.55:0/308330757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f06400b8760 con 0x7f06400b9700 2024-04-25T08:56:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.188+0000 7f063e7fc640 1 -- 172.21.15.55:0/308330757 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v59) v1 ==== 170+0+0 (secure 0 0 0) 0x7f06340795c0 con 0x7f06400b9700 2024-04-25T08:56:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-25T08:56:17.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.191+0000 7f06480f7640 1 -- 172.21.15.55:0/308330757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f062c06b4d0 msgr2=0x7f062c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:17.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.191+0000 7f06480f7640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f062c06b4d0 0x7f062c06d990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0638000f60 tx=0x7f0638007ca0 comp rx=0 tx=0).stop 2024-04-25T08:56:17.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.191+0000 7f06480f7640 1 -- 172.21.15.55:0/308330757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06400b9700 msgr2=0x7f06400b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:17.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.191+0000 7f06480f7640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06400b9700 0x7f06400b4e50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0634035040 tx=0x7f06340046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:17.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.191+0000 7f06480f7640 1 -- 172.21.15.55:0/308330757 shutdown_connections 2024-04-25T08:56:17.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.191+0000 7f06480f7640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f062c06b4d0 0x7f062c06d990 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:17.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.191+0000 7f06480f7640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f064015dc90 0x7f06400b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:17.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.191+0000 7f06480f7640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06400b9700 0x7f06400b4e50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:17.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.191+0000 7f06480f7640 1 --2- 172.21.15.55:0/308330757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06400b9290 0x7f064014dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:17.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.191+0000 7f06480f7640 1 -- 172.21.15.55:0/308330757 >> 172.21.15.55:0/308330757 conn(0x7f0640072900 msgr2=0x7f06400d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:17.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.192+0000 7f06480f7640 1 -- 172.21.15.55:0/308330757 shutdown_connections 2024-04-25T08:56:17.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.192+0000 7f06480f7640 1 -- 172.21.15.55:0/308330757 wait complete. 2024-04-25T08:56:17.205 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:56:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.325+0000 7f4384fc1640 1 Processor -- start 2024-04-25T08:56:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.325+0000 7f4384fc1640 1 -- start start 2024-04-25T08:56:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.326+0000 7f4384fc1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f438015dc80 0x7f4380161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.326+0000 7f4384fc1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43801627a0 con 0x7f43800b5c00 2024-04-25T08:56:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.326+0000 7f4384fc1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43801621e0 con 0x7f43800b97c0 2024-04-25T08:56:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.326+0000 7f4384fc1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43801624c0 con 0x7f438015dc80 2024-04-25T08:56:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.326+0000 7f437e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f438015dc80 0x7f4380161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.326+0000 7f437ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f43800b5c00 0x7f43800d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59850/0 (socket says 172.21.15.55:59850) 2024-04-25T08:56:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.326+0000 7f437ed9d640 1 -- 172.21.15.55:0/3611444217 learned_addr learned my addr 172.21.15.55:0/3611444217 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.326+0000 7f437e59c640 1 -- 172.21.15.55:0/3611444217 >> v1:172.21.15.167:6789/0 conn(0x7f43800b97c0 legacy=0x7f43800b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.326+0000 7f437e59c640 1 -- 172.21.15.55:0/3611444217 >> v1:172.21.15.55:6789/0 conn(0x7f43800b5c00 legacy=0x7f43800d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.326+0000 7f437e59c640 1 -- 172.21.15.55:0/3611444217 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800d1c70 con 0x7f438015dc80 2024-04-25T08:56:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.327+0000 7f437e59c640 1 --2- 172.21.15.55:0/3611444217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438015dc80 0x7f4380161870 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f43700097a0 tx=0x7f437002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fa6a3676bf08f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.327+0000 7f437d59a640 1 -- 172.21.15.55:0/3611444217 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370037070 con 0x7f438015dc80 2024-04-25T08:56:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.327+0000 7f437d59a640 1 -- 172.21.15.55:0/3611444217 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4370032440 con 0x7f438015dc80 2024-04-25T08:56:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.327+0000 7f437d59a640 1 -- 172.21.15.55:0/3611444217 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370032810 con 0x7f438015dc80 2024-04-25T08:56:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.328+0000 7f4384fc1640 1 -- 172.21.15.55:0/3611444217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438015dc80 msgr2=0x7f4380161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.328+0000 7f4384fc1640 1 --2- 172.21.15.55:0/3611444217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438015dc80 0x7f4380161870 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f43700097a0 tx=0x7f437002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.328+0000 7f4384fc1640 1 -- 172.21.15.55:0/3611444217 shutdown_connections 2024-04-25T08:56:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.328+0000 7f4384fc1640 1 --2- 172.21.15.55:0/3611444217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438015dc80 0x7f4380161870 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.328+0000 7f4384fc1640 1 -- 172.21.15.55:0/3611444217 >> 172.21.15.55:0/3611444217 conn(0x7f43800d04f0 msgr2=0x7f43800d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.328+0000 7f4384fc1640 1 -- 172.21.15.55:0/3611444217 shutdown_connections 2024-04-25T08:56:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.328+0000 7f4384fc1640 1 -- 172.21.15.55:0/3611444217 wait complete. 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.329+0000 7f4384fc1640 1 Processor -- start 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.329+0000 7f4384fc1640 1 -- start start 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.330+0000 7f4384fc1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43800b5c00 0x7f4380160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.330+0000 7f4384fc1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43800b97c0 0x7f43801f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.330+0000 7f4384fc1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f438015dc80 0x7f43800c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.330+0000 7f4384fc1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4380161f30 con 0x7f43800b5c00 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.330+0000 7f4384fc1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4380161db0 con 0x7f43800b97c0 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.330+0000 7f4384fc1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43800d2b80 con 0x7f438015dc80 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.330+0000 7f437e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43800b5c00 0x7f4380160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.330+0000 7f437e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43800b5c00 0x7f4380160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55982/0 (socket says 172.21.15.55:55982) 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.330+0000 7f437e59c640 1 -- 172.21.15.55:0/3526259552 learned_addr learned my addr 172.21.15.55:0/3526259552 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.330+0000 7f437dd9b640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43800b97c0 0x7f43801f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.330+0000 7f437ed9d640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f438015dc80 0x7f43800c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.331+0000 7f437e59c640 1 -- 172.21.15.55:0/3526259552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f438015dc80 msgr2=0x7f43800c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.331+0000 7f437e59c640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f438015dc80 0x7f43800c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.331+0000 7f437e59c640 1 -- 172.21.15.55:0/3526259552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43800b97c0 msgr2=0x7f43801f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.331+0000 7f437e59c640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43800b97c0 0x7f43801f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.331+0000 7f437e59c640 1 -- 172.21.15.55:0/3526259552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380161260 con 0x7f43800b5c00 2024-04-25T08:56:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.331+0000 7f437e59c640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43800b5c00 0x7f4380160d20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4370000c00 tx=0x7f43700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.331+0000 7f436effd640 1 -- 172.21.15.55:0/3526259552 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370037040 con 0x7f43800b5c00 2024-04-25T08:56:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.331+0000 7f436effd640 1 -- 172.21.15.55:0/3526259552 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4370042070 con 0x7f43800b5c00 2024-04-25T08:56:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.331+0000 7f436effd640 1 -- 172.21.15.55:0/3526259552 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370030a70 con 0x7f43800b5c00 2024-04-25T08:56:17.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.331+0000 7f4384fc1640 1 -- 172.21.15.55:0/3526259552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43801f3e20 con 0x7f43800b5c00 2024-04-25T08:56:17.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.331+0000 7f4384fc1640 1 -- 172.21.15.55:0/3526259552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43801f43e0 con 0x7f43800b5c00 2024-04-25T08:56:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.332+0000 7f4384fc1640 1 -- 172.21.15.55:0/3526259552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43800750b0 con 0x7f43800b5c00 2024-04-25T08:56:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.332+0000 7f436effd640 1 -- 172.21.15.55:0/3526259552 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4370030c10 con 0x7f43800b5c00 2024-04-25T08:56:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.333+0000 7f436effd640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f436006b4d0 0x7f436006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.333+0000 7f436effd640 1 -- 172.21.15.55:0/3526259552 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f43700aac20 con 0x7f43800b5c00 2024-04-25T08:56:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.333+0000 7f437dd9b640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f436006b4d0 0x7f436006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.333+0000 7f437dd9b640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f436006b4d0 0x7f436006d990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4380160cb0 tx=0x7f4374009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:17.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.337+0000 7f436effd640 1 -- 172.21.15.55:0/3526259552 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4370045360 con 0x7f43800b5c00 2024-04-25T08:56:17.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:17.560+0000 7f4384fc1640 1 -- 172.21.15.55:0/3526259552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f43800d1780 con 0x7f43800b5c00 2024-04-25T08:56:18.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.190+0000 7f436effd640 1 -- 172.21.15.55:0/3526259552 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4370079b90 con 0x7f43800b5c00 2024-04-25T08:56:18.180 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 8 and data pool 9 2024-04-25T08:56:18.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.194+0000 7f4384fc1640 1 -- 172.21.15.55:0/3526259552 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f436006b4d0 msgr2=0x7f436006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.194+0000 7f4384fc1640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f436006b4d0 0x7f436006d990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4380160cb0 tx=0x7f4374009040 comp rx=0 tx=0).stop 2024-04-25T08:56:18.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.194+0000 7f4384fc1640 1 -- 172.21.15.55:0/3526259552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43800b5c00 msgr2=0x7f4380160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.194+0000 7f4384fc1640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43800b5c00 0x7f4380160d20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4370000c00 tx=0x7f43700046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.196+0000 7f4384fc1640 1 -- 172.21.15.55:0/3526259552 shutdown_connections 2024-04-25T08:56:18.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.196+0000 7f4384fc1640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f436006b4d0 0x7f436006d990 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.196+0000 7f4384fc1640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f438015dc80 0x7f43800c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.196+0000 7f4384fc1640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43800b97c0 0x7f43801f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.196+0000 7f4384fc1640 1 --2- 172.21.15.55:0/3526259552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43800b5c00 0x7f4380160d20 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.196+0000 7f4384fc1640 1 -- 172.21.15.55:0/3526259552 >> 172.21.15.55:0/3526259552 conn(0x7f43800d04f0 msgr2=0x7f43800b7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:18.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.196+0000 7f4384fc1640 1 -- 172.21.15.55:0/3526259552 shutdown_connections 2024-04-25T08:56:18.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.199+0000 7f4384fc1640 1 -- 172.21.15.55:0/3526259552 wait complete. 2024-04-25T08:56:18.219 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:18.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.336+0000 7f7e974b3640 1 Processor -- start 2024-04-25T08:56:18.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.336+0000 7f7e974b3640 1 -- start start 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.336+0000 7f7e974b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900d35b0 0x7f7e900b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e974b3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7e900b5990 0x7f7e900b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e974b3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9015e0c0 con 0x7f7e9015dce0 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e974b3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e900b5de0 con 0x7f7e900b5990 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e974b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900d2510 con 0x7f7e900d35b0 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e94a4e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900d35b0 0x7f7e900b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e95a50640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7e900b5990 0x7f7e900b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e94a4e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900d35b0 0x7f7e900b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:55426/0 (socket says 172.21.15.55:55426) 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e9524f640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7e9015dce0 0x7f7e900d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:34496/0 (socket says 172.21.15.55:34496) 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e9524f640 1 -- 172.21.15.55:0/2401500190 learned_addr learned my addr 172.21.15.55:0/2401500190 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e95a50640 1 -- 172.21.15.55:0/2401500190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900d35b0 msgr2=0x7f7e900b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e95a50640 1 --2- 172.21.15.55:0/2401500190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900d35b0 0x7f7e900b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e95a50640 1 -- 172.21.15.55:0/2401500190 >> v1:172.21.15.167:6789/0 conn(0x7f7e9015dce0 legacy=0x7f7e900d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e95a50640 1 -- 172.21.15.55:0/2401500190 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e900d27f0 con 0x7f7e900b5990 2024-04-25T08:56:18.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e87fff640 1 -- 172.21.15.55:0/2401500190 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073963823 0 0) 0x7f7e9015e0c0 con 0x7f7e9015dce0 2024-04-25T08:56:18.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.337+0000 7f7e94a4e640 1 --2- 172.21.15.55:0/2401500190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900d35b0 0x7f7e900b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.338+0000 7f7e95a50640 1 --2- 172.21.15.55:0/2401500190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e900b5990 0x7f7e900b6b00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009d90 tx=0x7f7e8802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c62722e94e57a8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.338+0000 7f7e87fff640 1 -- 172.21.15.55:0/2401500190 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88007740 con 0x7f7e900b5990 2024-04-25T08:56:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.338+0000 7f7e87fff640 1 -- 172.21.15.55:0/2401500190 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e880078e0 con 0x7f7e900b5990 2024-04-25T08:56:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.338+0000 7f7e87fff640 1 -- 172.21.15.55:0/2401500190 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88007cb0 con 0x7f7e900b5990 2024-04-25T08:56:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.339+0000 7f7e974b3640 1 -- 172.21.15.55:0/2401500190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e900b5990 msgr2=0x7f7e900b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.339+0000 7f7e974b3640 1 --2- 172.21.15.55:0/2401500190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e900b5990 0x7f7e900b6b00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009d90 tx=0x7f7e8802a660 comp rx=0 tx=0).stop 2024-04-25T08:56:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.339+0000 7f7e974b3640 1 -- 172.21.15.55:0/2401500190 shutdown_connections 2024-04-25T08:56:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.339+0000 7f7e974b3640 1 --2- 172.21.15.55:0/2401500190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e900b5990 0x7f7e900b6b00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.339+0000 7f7e974b3640 1 --2- 172.21.15.55:0/2401500190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900d35b0 0x7f7e900b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.339+0000 7f7e974b3640 1 -- 172.21.15.55:0/2401500190 >> 172.21.15.55:0/2401500190 conn(0x7f7e90072900 msgr2=0x7f7e900d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:18.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.339+0000 7f7e974b3640 1 -- 172.21.15.55:0/2401500190 shutdown_connections 2024-04-25T08:56:18.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.339+0000 7f7e974b3640 1 -- 172.21.15.55:0/2401500190 wait complete. 2024-04-25T08:56:18.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.340+0000 7f7e974b3640 1 Processor -- start 2024-04-25T08:56:18.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.340+0000 7f7e974b3640 1 -- start start 2024-04-25T08:56:18.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e974b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900b5990 0x7f7e9015f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e974b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e900d35b0 0x7f7e900c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e974b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9015dce0 0x7f7e900c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e974b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900d3090 con 0x7f7e9015dce0 2024-04-25T08:56:18.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e974b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900d2db0 con 0x7f7e900d35b0 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e974b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900d2160 con 0x7f7e900b5990 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e95a50640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9015dce0 0x7f7e900c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e95a50640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9015dce0 0x7f7e900c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55990/0 (socket says 172.21.15.55:55990) 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e95a50640 1 -- 172.21.15.55:0/3279521623 learned_addr learned my addr 172.21.15.55:0/3279521623 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e94a4e640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e900d35b0 0x7f7e900c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e9524f640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900b5990 0x7f7e9015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e95a50640 1 -- 172.21.15.55:0/3279521623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900b5990 msgr2=0x7f7e9015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e95a50640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900b5990 0x7f7e9015f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e95a50640 1 -- 172.21.15.55:0/3279521623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e900d35b0 msgr2=0x7f7e900c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e95a50640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e900d35b0 0x7f7e900c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e95a50640 1 -- 172.21.15.55:0/3279521623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9015f770 con 0x7f7e9015dce0 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e94a4e640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e900d35b0 0x7f7e900c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.341+0000 7f7e95a50640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9015dce0 0x7f7e900c9d90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009d90 tx=0x7f7e88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.342+0000 7f7e85ffb640 1 -- 172.21.15.55:0/3279521623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88040070 con 0x7f7e9015dce0 2024-04-25T08:56:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.342+0000 7f7e85ffb640 1 -- 172.21.15.55:0/3279521623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e88031c40 con 0x7f7e9015dce0 2024-04-25T08:56:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.342+0000 7f7e85ffb640 1 -- 172.21.15.55:0/3279521623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88009450 con 0x7f7e9015dce0 2024-04-25T08:56:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.342+0000 7f7e974b3640 1 -- 172.21.15.55:0/3279521623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9015fa50 con 0x7f7e9015dce0 2024-04-25T08:56:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.342+0000 7f7e974b3640 1 -- 172.21.15.55:0/3279521623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e900c9870 con 0x7f7e9015dce0 2024-04-25T08:56:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.343+0000 7f7e974b3640 1 -- 172.21.15.55:0/3279521623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e900749b0 con 0x7f7e9015dce0 2024-04-25T08:56:18.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.343+0000 7f7e85ffb640 1 -- 172.21.15.55:0/3279521623 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7e88039040 con 0x7f7e9015dce0 2024-04-25T08:56:18.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.344+0000 7f7e85ffb640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7406b500 0x7f7e7406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.344+0000 7f7e85ffb640 1 -- 172.21.15.55:0/3279521623 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e880aaef0 con 0x7f7e9015dce0 2024-04-25T08:56:18.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.344+0000 7f7e9524f640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7406b500 0x7f7e7406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.344+0000 7f7e9524f640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7406b500 0x7f7e7406d9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c007fd0 tx=0x7f7e8c007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:18.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.348+0000 7f7e85ffb640 1 -- 172.21.15.55:0/3279521623 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e880797b0 con 0x7f7e9015dce0 2024-04-25T08:56:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.529+0000 7f7e974b3640 1 -- 172.21.15.55:0/3279521623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e900ceff0 con 0x7f7e9015dce0 2024-04-25T08:56:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.530+0000 7f7e85ffb640 1 -- 172.21.15.55:0/3279521623 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16678 (secure 0 0 0) 0x7f7e8807d850 con 0x7f7e9015dce0 2024-04-25T08:56:18.520 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:18.521 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:56:17.562118+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:15.846477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:16.537036+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 -- 172.21.15.55:0/3279521623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7406b500 msgr2=0x7f7e7406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7406b500 0x7f7e7406d9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c007fd0 tx=0x7f7e8c007de0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 -- 172.21.15.55:0/3279521623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9015dce0 msgr2=0x7f7e900c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9015dce0 0x7f7e900c9d90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009d90 tx=0x7f7e88004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 -- 172.21.15.55:0/3279521623 shutdown_connections 2024-04-25T08:56:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7406b500 0x7f7e7406d9c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9015dce0 0x7f7e900c9d90 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e900d35b0 0x7f7e900c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 --2- 172.21.15.55:0/3279521623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e900b5990 0x7f7e9015f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 -- 172.21.15.55:0/3279521623 >> 172.21.15.55:0/3279521623 conn(0x7f7e90072900 msgr2=0x7f7e900b6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 -- 172.21.15.55:0/3279521623 shutdown_connections 2024-04-25T08:56:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.533+0000 7f7e974b3640 1 -- 172.21.15.55:0/3279521623 wait complete. 2024-04-25T08:56:18.533 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:18.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.645+0000 7f45d8510640 1 Processor -- start 2024-04-25T08:56:18.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.645+0000 7f45d8510640 1 -- start start 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d8510640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45d015ec10 0x7f45d006dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d8510640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d006e1b0 0x7f45d00b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d8510640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d006e6c0 con 0x7f45d00b3580 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d8510640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d006f2d0 con 0x7f45d015ec10 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d8510640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d006e9a0 con 0x7f45d006e1b0 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d62ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45d015ec10 0x7f45d006dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d62ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45d015ec10 0x7f45d006dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56002/0 (socket says 172.21.15.55:56002) 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d62ac640 1 -- 172.21.15.55:0/169549227 learned_addr learned my addr 172.21.15.55:0/169549227 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d5aab640 1 --2- 172.21.15.55:0/169549227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d006e1b0 0x7f45d00b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d62ac640 1 -- 172.21.15.55:0/169549227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d006e1b0 msgr2=0x7f45d00b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d62ac640 1 --2- 172.21.15.55:0/169549227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d006e1b0 0x7f45d00b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d62ac640 1 -- 172.21.15.55:0/169549227 >> v1:172.21.15.167:6789/0 conn(0x7f45d00b3580 legacy=0x7f45d01616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d52aa640 1 -- 172.21.15.55:0/169549227 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885869072 0 0) 0x7f45d006e6c0 con 0x7f45d00b3580 2024-04-25T08:56:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.647+0000 7f45d62ac640 1 -- 172.21.15.55:0/169549227 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d006ec80 con 0x7f45d015ec10 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.648+0000 7f45d62ac640 1 --2- 172.21.15.55:0/169549227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45d015ec10 0x7f45d006dc70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009e80 tx=0x7f45cc02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d58581fb0deffb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.648+0000 7f45d52aa640 1 -- 172.21.15.55:0/169549227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc036070 con 0x7f45d015ec10 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.648+0000 7f45d52aa640 1 -- 172.21.15.55:0/169549227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc031600 con 0x7f45d015ec10 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.648+0000 7f45d52aa640 1 -- 172.21.15.55:0/169549227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0319d0 con 0x7f45d015ec10 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.648+0000 7f45d8510640 1 -- 172.21.15.55:0/169549227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45d015ec10 msgr2=0x7f45d006dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.648+0000 7f45d8510640 1 --2- 172.21.15.55:0/169549227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45d015ec10 0x7f45d006dc70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009e80 tx=0x7f45cc02a630 comp rx=0 tx=0).stop 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.649+0000 7f45d8510640 1 -- 172.21.15.55:0/169549227 shutdown_connections 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.649+0000 7f45d8510640 1 --2- 172.21.15.55:0/169549227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d006e1b0 0x7f45d00b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.649+0000 7f45d8510640 1 --2- 172.21.15.55:0/169549227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45d015ec10 0x7f45d006dc70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.649+0000 7f45d8510640 1 -- 172.21.15.55:0/169549227 >> 172.21.15.55:0/169549227 conn(0x7f45d00b2220 msgr2=0x7f45d00cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.649+0000 7f45d8510640 1 -- 172.21.15.55:0/169549227 shutdown_connections 2024-04-25T08:56:18.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.649+0000 7f45d8510640 1 -- 172.21.15.55:0/169549227 wait complete. 2024-04-25T08:56:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.650+0000 7f45d8510640 1 Processor -- start 2024-04-25T08:56:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.650+0000 7f45d8510640 1 -- start start 2024-04-25T08:56:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d8510640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006e1b0 0x7f45d0152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d8510640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45d00b3580 0x7f45d014e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d8510640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d015ec10 0x7f45d014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d8510640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d015e2e0 con 0x7f45d00b3580 2024-04-25T08:56:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d8510640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d015eff0 con 0x7f45d006e1b0 2024-04-25T08:56:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d8510640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d015e460 con 0x7f45d015ec10 2024-04-25T08:56:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d5aab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45d00b3580 0x7f45d014e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d5aab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45d00b3580 0x7f45d014e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56012/0 (socket says 172.21.15.55:56012) 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d5aab640 1 -- 172.21.15.55:0/1587421213 learned_addr learned my addr 172.21.15.55:0/1587421213 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d62ac640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006e1b0 0x7f45d0152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d6aad640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d015ec10 0x7f45d014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d5aab640 1 -- 172.21.15.55:0/1587421213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d015ec10 msgr2=0x7f45d014d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d5aab640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d015ec10 0x7f45d014d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d5aab640 1 -- 172.21.15.55:0/1587421213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006e1b0 msgr2=0x7f45d0152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d5aab640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006e1b0 0x7f45d0152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d5aab640 1 -- 172.21.15.55:0/1587421213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d014ecf0 con 0x7f45d00b3580 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d62ac640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006e1b0 0x7f45d0152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d5aab640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45d00b3580 0x7f45d014e7b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f45c000e870 tx=0x7f45c000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45c6ffd640 1 -- 172.21.15.55:0/1587421213 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0017070 con 0x7f45d00b3580 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45c6ffd640 1 -- 172.21.15.55:0/1587421213 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c000c940 con 0x7f45d00b3580 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d8510640 1 -- 172.21.15.55:0/1587421213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d014dc30 con 0x7f45d00b3580 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45c6ffd640 1 -- 172.21.15.55:0/1587421213 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c000cd30 con 0x7f45d00b3580 2024-04-25T08:56:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.651+0000 7f45d8510640 1 -- 172.21.15.55:0/1587421213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d014f270 con 0x7f45d00b3580 2024-04-25T08:56:18.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.652+0000 7f45d8510640 1 -- 172.21.15.55:0/1587421213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d00749b0 con 0x7f45d00b3580 2024-04-25T08:56:18.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.653+0000 7f45c6ffd640 1 -- 172.21.15.55:0/1587421213 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f45c001a070 con 0x7f45d00b3580 2024-04-25T08:56:18.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.653+0000 7f45c6ffd640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f45b406b4d0 0x7f45b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.653+0000 7f45c6ffd640 1 -- 172.21.15.55:0/1587421213 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45c0089ff0 con 0x7f45d00b3580 2024-04-25T08:56:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.653+0000 7f45d62ac640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f45b406b4d0 0x7f45b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.654+0000 7f45d62ac640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f45b406b4d0 0x7f45b406d990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45cc033000 tx=0x7f45cc009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:18.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.658+0000 7f45c6ffd640 1 -- 172.21.15.55:0/1587421213 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f45c0058f00 con 0x7f45d00b3580 2024-04-25T08:56:18.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.839+0000 7f45d8510640 1 -- 172.21.15.55:0/1587421213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45d00d0b00 con 0x7f45d00b3580 2024-04-25T08:56:18.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.840+0000 7f45c6ffd640 1 -- 172.21.15.55:0/1587421213 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16678 (secure 0 0 0) 0x7f45c0058800 con 0x7f45d00b3580 2024-04-25T08:56:18.830 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:18.831 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:56:17.562118+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:15.846477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:16.537036+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:18.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 -- 172.21.15.55:0/1587421213 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f45b406b4d0 msgr2=0x7f45b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f45b406b4d0 0x7f45b406d990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45cc033000 tx=0x7f45cc009000 comp rx=0 tx=0).stop 2024-04-25T08:56:18.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 -- 172.21.15.55:0/1587421213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45d00b3580 msgr2=0x7f45d014e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45d00b3580 0x7f45d014e7b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f45c000e870 tx=0x7f45c000ed30 comp rx=0 tx=0).stop 2024-04-25T08:56:18.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 -- 172.21.15.55:0/1587421213 shutdown_connections 2024-04-25T08:56:18.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f45b406b4d0 0x7f45b406d990 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45d015ec10 0x7f45d014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45d00b3580 0x7f45d014e7b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 --2- 172.21.15.55:0/1587421213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d006e1b0 0x7f45d0152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 -- 172.21.15.55:0/1587421213 >> 172.21.15.55:0/1587421213 conn(0x7f45d00b2220 msgr2=0x7f45d00ae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:18.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 -- 172.21.15.55:0/1587421213 shutdown_connections 2024-04-25T08:56:18.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.842+0000 7f45d8510640 1 -- 172.21.15.55:0/1587421213 wait complete. 2024-04-25T08:56:18.843 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:56:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.957+0000 7fa7a0973640 1 Processor -- start 2024-04-25T08:56:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.957+0000 7fa7a0973640 1 -- start start 2024-04-25T08:56:18.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.958+0000 7fa7a0973640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c15b7e0 0x7fa79c15e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.958+0000 7fa7a0973640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa79c0d07b0 0x7fa79c0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.958+0000 7fa7a0973640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c0b5710 con 0x7fa79c0ce860 2024-04-25T08:56:18.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.958+0000 7fa7a0973640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c0b59f0 con 0x7fa79c0d07b0 2024-04-25T08:56:18.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.958+0000 7fa7a0973640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b5cd0 con 0x7fa79c15b7e0 2024-04-25T08:56:18.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.958+0000 7fa79affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa79c0ce860 0x7fa79c0d00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37502/0 (socket says 172.21.15.55:37502) 2024-04-25T08:56:18.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.958+0000 7fa79affd640 1 -- 172.21.15.55:0/1739734702 learned_addr learned my addr 172.21.15.55:0/1739734702 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:18.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.958+0000 7fa79bfff640 1 --2- 172.21.15.55:0/1739734702 >> v2:172.21.15.167:3300/0 conn(0x7fa79c0d07b0 0x7fa79c0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79b7fe640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c15b7e0 0x7fa79c15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885024156 0 0) 0x7fa79c0b5710 con 0x7fa79c0ce860 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa784003520 con 0x7fa79c0ce860 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 911638505 0 0) 0x7fa784003520 con 0x7fa79c0ce860 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c15b7e0 msgr2=0x7fa79c15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c15b7e0 0x7fa79c15e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 >> v2:172.21.15.167:3300/0 conn(0x7fa79c0d07b0 msgr2=0x7fa79c0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 --2- 172.21.15.55:0/1739734702 >> v2:172.21.15.167:3300/0 conn(0x7fa79c0d07b0 0x7fa79c0cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c0b5fb0 con 0x7fa79c0ce860 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fa790001670 con 0x7fa79c0ce860 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 >> v1:172.21.15.55:6789/0 conn(0x7fa79c0ce860 legacy=0x7fa79c0d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7840039b0 0x7fa784003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c15b7e0 0x7fa784004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 0x7fa7840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b59f0 con 0x7fa784004d40 2024-04-25T08:56:18.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b5cd0 con 0x7fa7840039b0 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78400ba40 con 0x7fa79c15b7e0 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79bfff640 1 --2- 172.21.15.55:0/1739734702 >> v2:172.21.15.167:3300/0 conn(0x7fa79c0d07b0 0x7fa79c0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79bfff640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 0x7fa7840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79affd640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c15b7e0 0x7fa784004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79b7fe640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7840039b0 0x7fa784003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79bfff640 1 -- 172.21.15.55:0/1739734702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c15b7e0 msgr2=0x7fa784004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79bfff640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c15b7e0 0x7fa784004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79bfff640 1 -- 172.21.15.55:0/1739734702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7840039b0 msgr2=0x7fa784003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79bfff640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7840039b0 0x7fa784003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.959+0000 7fa79bfff640 1 -- 172.21.15.55:0/1739734702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa784003520 con 0x7fa784004d40 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.960+0000 7fa79bfff640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 0x7fa7840051c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa79400e320 tx=0x7fa784005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf0d7ba06054960 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.960+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794009de0 con 0x7fa784004d40 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.960+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79402e620 con 0x7fa784004d40 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.960+0000 7fa79a7fc640 1 -- 172.21.15.55:0/1739734702 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79402ea10 con 0x7fa784004d40 2024-04-25T08:56:18.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.961+0000 7fa7a0973640 1 -- 172.21.15.55:0/1739734702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 msgr2=0x7fa7840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.961+0000 7fa7a0973640 1 --2- 172.21.15.55:0/1739734702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 0x7fa7840051c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa79400e320 tx=0x7fa784005830 comp rx=0 tx=0).stop 2024-04-25T08:56:18.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.961+0000 7fa79bfff640 1 -- 172.21.15.55:0/1739734702 reap_dead start 2024-04-25T08:56:18.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.961+0000 7fa7a0973640 1 -- 172.21.15.55:0/1739734702 shutdown_connections 2024-04-25T08:56:18.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.961+0000 7fa7a0973640 1 -- 172.21.15.55:0/1739734702 >> 172.21.15.55:0/1739734702 conn(0x7fa79c0722d0 msgr2=0x7fa79c0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:18.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.961+0000 7fa7a0973640 1 -- 172.21.15.55:0/1739734702 shutdown_connections 2024-04-25T08:56:18.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.961+0000 7fa7a0973640 1 -- 172.21.15.55:0/1739734702 wait complete. 2024-04-25T08:56:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.962+0000 7fa7a0973640 1 Processor -- start 2024-04-25T08:56:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.962+0000 7fa7a0973640 1 -- start start 2024-04-25T08:56:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa7a0973640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 0x7fa79c0c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa7a0973640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa79c0caac0 0x7fa79c13ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa7a0973640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0caf40 0x7fa79c13cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa7a0973640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c15e180 con 0x7fa784004d40 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa7a0973640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c15e000 con 0x7fa79c0caac0 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa7a0973640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c15e300 con 0x7fa79c0caf40 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 0x7fa79c0c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 0x7fa79c0c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39086/0 (socket says 172.21.15.55:39086) 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79b7fe640 1 -- 172.21.15.55:0/492803568 learned_addr learned my addr 172.21.15.55:0/492803568 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79affd640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa79c0caac0 0x7fa79c13ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79bfff640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0caf40 0x7fa79c13cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79b7fe640 1 -- 172.21.15.55:0/492803568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0caf40 msgr2=0x7fa79c13cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79b7fe640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0caf40 0x7fa79c13cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79b7fe640 1 -- 172.21.15.55:0/492803568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa79c0caac0 msgr2=0x7fa79c13ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:18.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79b7fe640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa79c0caac0 0x7fa79c13ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79b7fe640 1 -- 172.21.15.55:0/492803568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c0cb4d0 con 0x7fa784004d40 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79bfff640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0caf40 0x7fa79c13cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.963+0000 7fa79b7fe640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 0x7fa79c0c78c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0118e0 tx=0x7fa78c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.964+0000 7fa783fff640 1 -- 172.21.15.55:0/492803568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00fa90 con 0x7fa784004d40 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.964+0000 7fa783fff640 1 -- 172.21.15.55:0/492803568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c00fc30 con 0x7fa784004d40 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.964+0000 7fa783fff640 1 -- 172.21.15.55:0/492803568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c014440 con 0x7fa784004d40 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.964+0000 7fa7a0973640 1 -- 172.21.15.55:0/492803568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c1f39d0 con 0x7fa784004d40 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.964+0000 7fa7a0973640 1 -- 172.21.15.55:0/492803568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c1f3f90 con 0x7fa784004d40 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.965+0000 7fa7a0973640 1 -- 172.21.15.55:0/492803568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c0749b0 con 0x7fa784004d40 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.965+0000 7fa783fff640 1 -- 172.21.15.55:0/492803568 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa78c012040 con 0x7fa784004d40 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.965+0000 7fa783fff640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa78806b500 0x7fa78806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.966+0000 7fa79affd640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa78806b500 0x7fa78806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.966+0000 7fa783fff640 1 -- 172.21.15.55:0/492803568 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa78c08a790 con 0x7fa784004d40 2024-04-25T08:56:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.966+0000 7fa79affd640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa78806b500 0x7fa78806d9c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa790001d00 tx=0x7fa7900078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:18.970+0000 7fa783fff640 1 -- 172.21.15.55:0/492803568 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa78c019030 con 0x7fa784004d40 2024-04-25T08:56:19.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.197+0000 7fa7a0973640 1 -- 172.21.15.55:0/492803568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa79c0d1650 con 0x7fa784004d40 2024-04-25T08:56:19.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.207+0000 7fa783fff640 1 -- 172.21.15.55:0/492803568 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa78c059610 con 0x7fa784004d40 2024-04-25T08:56:19.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 -- 172.21.15.55:0/492803568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa78806b500 msgr2=0x7fa78806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:19.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa78806b500 0x7fa78806d9c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa790001d00 tx=0x7fa7900078f0 comp rx=0 tx=0).stop 2024-04-25T08:56:19.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 -- 172.21.15.55:0/492803568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 msgr2=0x7fa79c0c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:19.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 0x7fa79c0c78c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0118e0 tx=0x7fa78c011da0 comp rx=0 tx=0).stop 2024-04-25T08:56:19.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 -- 172.21.15.55:0/492803568 shutdown_connections 2024-04-25T08:56:19.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa78806b500 0x7fa78806d9c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:19.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa79c0caf40 0x7fa79c13cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:19.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa79c0caac0 0x7fa79c13ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:19.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 --2- 172.21.15.55:0/492803568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa784004d40 0x7fa79c0c78c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:19.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 -- 172.21.15.55:0/492803568 >> 172.21.15.55:0/492803568 conn(0x7fa79c0722d0 msgr2=0x7fa79c0d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:19.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 -- 172.21.15.55:0/492803568 shutdown_connections 2024-04-25T08:56:19.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.210+0000 7fa7a0973640 1 -- 172.21.15.55:0/492803568 wait complete. 2024-04-25T08:56:19.210 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:56:19.210 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:56:19.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.324+0000 7f57adaac640 1 Processor -- start 2024-04-25T08:56:19.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.324+0000 7f57adaac640 1 -- start start 2024-04-25T08:56:19.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.325+0000 7f57adaac640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f57a815dca0 0x7f57a80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:19.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.325+0000 7f57adaac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57a80d1130 0x7f57a80b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.325+0000 7f57adaac640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a80d4090 con 0x7f57a80d3b90 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.325+0000 7f57adaac640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a80b6b20 con 0x7f57a815dca0 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.325+0000 7f57adaac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80d4370 con 0x7f57a80d1130 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.325+0000 7f57a7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57a80d1130 0x7f57a80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.325+0000 7f57a77fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f57a815dca0 0x7f57a80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.325+0000 7f57a6ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f57a80d3b90 0x7f57a80d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:54400/0 (socket says 172.21.15.55:54400) 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.325+0000 7f57a7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57a80d1130 0x7f57a80b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:46686/0 (socket says 172.21.15.55:46686) 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.325+0000 7f57a77fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f57a815dca0 0x7f57a80ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:47504/0 (socket says 172.21.15.55:47504) 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.325+0000 7f57a6ffd640 1 -- 172.21.15.55:0/42767500 learned_addr learned my addr 172.21.15.55:0/42767500 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.326+0000 7f57a77fe640 1 -- 172.21.15.55:0/42767500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57a80d1130 msgr2=0x7f57a80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.326+0000 7f57a77fe640 1 --2- 172.21.15.55:0/42767500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57a80d1130 0x7f57a80b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.326+0000 7f57a77fe640 1 -- 172.21.15.55:0/42767500 >> v1:172.21.15.167:6789/0 conn(0x7f57a80d3b90 legacy=0x7f57a80d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:19.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.326+0000 7f57a67fc640 1 -- 172.21.15.55:0/42767500 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385610766 0 0) 0x7f57a80d4090 con 0x7f57a80d3b90 2024-04-25T08:56:19.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.326+0000 7f57a77fe640 1 -- 172.21.15.55:0/42767500 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80d4650 con 0x7f57a815dca0 2024-04-25T08:56:19.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57a77fe640 1 --2- 172.21.15.55:0/42767500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57a815dca0 0x7f57a80ce940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f57980097a0 tx=0x7f579802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab53c6cd64f8b25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:19.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57a67fc640 1 -- 172.21.15.55:0/42767500 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798037070 con 0x7f57a815dca0 2024-04-25T08:56:19.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57a67fc640 1 -- 172.21.15.55:0/42767500 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5798032440 con 0x7f57a815dca0 2024-04-25T08:56:19.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57a67fc640 1 -- 172.21.15.55:0/42767500 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798032810 con 0x7f57a815dca0 2024-04-25T08:56:19.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57adaac640 1 -- 172.21.15.55:0/42767500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57a815dca0 msgr2=0x7f57a80ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:19.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57adaac640 1 --2- 172.21.15.55:0/42767500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57a815dca0 0x7f57a80ce940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f57980097a0 tx=0x7f579802a180 comp rx=0 tx=0).stop 2024-04-25T08:56:19.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57adaac640 1 -- 172.21.15.55:0/42767500 shutdown_connections 2024-04-25T08:56:19.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57adaac640 1 --2- 172.21.15.55:0/42767500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57a80d1130 0x7f57a80b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:19.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57adaac640 1 --2- 172.21.15.55:0/42767500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57a815dca0 0x7f57a80ce940 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:19.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57adaac640 1 -- 172.21.15.55:0/42767500 >> 172.21.15.55:0/42767500 conn(0x7f57a80726c0 msgr2=0x7f57a8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:19.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57adaac640 1 -- 172.21.15.55:0/42767500 shutdown_connections 2024-04-25T08:56:19.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.327+0000 7f57adaac640 1 -- 172.21.15.55:0/42767500 wait complete. 2024-04-25T08:56:19.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.328+0000 7f57adaac640 1 Processor -- start 2024-04-25T08:56:19.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.329+0000 7f57adaac640 1 -- start start 2024-04-25T08:56:19.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.329+0000 7f57adaac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57a80d1130 0x7f57a81f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:19.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.329+0000 7f57adaac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57a80d3b90 0x7f57a81606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:19.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.329+0000 7f57adaac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57a815dca0 0x7f57a8160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:19.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.329+0000 7f57adaac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a815e200 con 0x7f57a80d1130 2024-04-25T08:56:19.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.329+0000 7f57adaac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a815e080 con 0x7f57a80d3b90 2024-04-25T08:56:19.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.329+0000 7f57adaac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80cee80 con 0x7f57a815dca0 2024-04-25T08:56:19.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.329+0000 7f57a77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57a80d1130 0x7f57a81f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.329+0000 7f57a77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57a80d1130 0x7f57a81f3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39098/0 (socket says 172.21.15.55:39098) 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.329+0000 7f57a77fe640 1 -- 172.21.15.55:0/2495781367 learned_addr learned my addr 172.21.15.55:0/2495781367 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f57a6ffd640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57a80d3b90 0x7f57a81606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f57a7fff640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57a815dca0 0x7f57a8160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f57a77fe640 1 -- 172.21.15.55:0/2495781367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57a815dca0 msgr2=0x7f57a8160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f57a77fe640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57a815dca0 0x7f57a8160be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f57a77fe640 1 -- 172.21.15.55:0/2495781367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57a80d3b90 msgr2=0x7f57a81606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f57a77fe640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57a80d3b90 0x7f57a81606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f57a77fe640 1 -- 172.21.15.55:0/2495781367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a81f49c0 con 0x7f57a80d1130 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f57a77fe640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57a80d1130 0x7f57a81f3f50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5798000c00 tx=0x7f57980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f578ffff640 1 -- 172.21.15.55:0/2495781367 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798037050 con 0x7f57a80d1130 2024-04-25T08:56:19.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f578ffff640 1 -- 172.21.15.55:0/2495781367 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5798038040 con 0x7f57a80d1130 2024-04-25T08:56:19.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f57adaac640 1 -- 172.21.15.55:0/2495781367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a81f13a0 con 0x7f57a80d1130 2024-04-25T08:56:19.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f578ffff640 1 -- 172.21.15.55:0/2495781367 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798004470 con 0x7f57a80d1130 2024-04-25T08:56:19.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.330+0000 7f57adaac640 1 -- 172.21.15.55:0/2495781367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a81f4f10 con 0x7f57a80d1130 2024-04-25T08:56:19.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.331+0000 7f57adaac640 1 -- 172.21.15.55:0/2495781367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a80750b0 con 0x7f57a80d1130 2024-04-25T08:56:19.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.332+0000 7f578ffff640 1 -- 172.21.15.55:0/2495781367 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f579803c6d0 con 0x7f57a80d1130 2024-04-25T08:56:19.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.332+0000 7f578ffff640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f579406b4d0 0x7f579406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:19.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.332+0000 7f578ffff640 1 -- 172.21.15.55:0/2495781367 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57980aaa40 con 0x7f57a80d1130 2024-04-25T08:56:19.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.332+0000 7f57a6ffd640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f579406b4d0 0x7f579406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:19.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.333+0000 7f57a6ffd640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f579406b4d0 0x7f579406d990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f57a8161350 tx=0x7f579c007f00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:19.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.337+0000 7f578ffff640 1 -- 172.21.15.55:0/2495781367 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f57a81f13a0 con 0x7f57a80d1130 2024-04-25T08:56:19.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:19.556+0000 7f57adaac640 1 -- 172.21.15.55:0/2495781367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f57a80743d0 con 0x7f57a80d1130 2024-04-25T08:56:20.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.209+0000 7f578ffff640 1 -- 172.21.15.55:0/2495781367 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f57980aae20 con 0x7f57a80d1130 2024-04-25T08:56:20.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 -- 172.21.15.55:0/2495781367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f579406b4d0 msgr2=0x7f579406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f579406b4d0 0x7f579406d990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f57a8161350 tx=0x7f579c007f00 comp rx=0 tx=0).stop 2024-04-25T08:56:20.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 -- 172.21.15.55:0/2495781367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57a80d1130 msgr2=0x7f57a81f3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57a80d1130 0x7f57a81f3f50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5798000c00 tx=0x7f57980046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 -- 172.21.15.55:0/2495781367 shutdown_connections 2024-04-25T08:56:20.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f579406b4d0 0x7f579406d990 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57a815dca0 0x7f57a8160be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57a80d3b90 0x7f57a81606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 --2- 172.21.15.55:0/2495781367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57a80d1130 0x7f57a81f3f50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 -- 172.21.15.55:0/2495781367 >> 172.21.15.55:0/2495781367 conn(0x7f57a80726c0 msgr2=0x7f57a80b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:20.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 -- 172.21.15.55:0/2495781367 shutdown_connections 2024-04-25T08:56:20.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.212+0000 7f57adaac640 1 -- 172.21.15.55:0/2495781367 wait complete. 2024-04-25T08:56:20.215 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:56:20.216 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:20.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.334+0000 7f5c2a99e640 1 Processor -- start 2024-04-25T08:56:20.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.334+0000 7f5c2a99e640 1 -- start start 2024-04-25T08:56:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.335+0000 7f5c2a99e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c240b5b60 0x7f5c241687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.335+0000 7f5c2a99e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2415e0c0 con 0x7f5c2415dce0 2024-04-25T08:56:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.335+0000 7f5c2a99e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c240d2510 con 0x7f5c240d35b0 2024-04-25T08:56:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.335+0000 7f5c2a99e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c240b7b10 con 0x7f5c240b5b60 2024-04-25T08:56:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.335+0000 7f5c28f3b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c240b5b60 0x7f5c241687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.335+0000 7f5c23fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5c2415dce0 0x7f5c240d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37512/0 (socket says 172.21.15.55:37512) 2024-04-25T08:56:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.335+0000 7f5c23fff640 1 -- 172.21.15.55:0/606790534 learned_addr learned my addr 172.21.15.55:0/606790534 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.335+0000 7f5c28f3b640 1 -- 172.21.15.55:0/606790534 >> v1:172.21.15.167:6789/0 conn(0x7f5c240d35b0 legacy=0x7f5c240b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.335+0000 7f5c28f3b640 1 -- 172.21.15.55:0/606790534 >> v1:172.21.15.55:6789/0 conn(0x7f5c2415dce0 legacy=0x7f5c240d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.336+0000 7f5c22ffd640 1 -- 172.21.15.55:0/606790534 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397245707 0 0) 0x7f5c2415e0c0 con 0x7f5c2415dce0 2024-04-25T08:56:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.336+0000 7f5c28f3b640 1 -- 172.21.15.55:0/606790534 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c240d27f0 con 0x7f5c240b5b60 2024-04-25T08:56:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.336+0000 7f5c28f3b640 1 --2- 172.21.15.55:0/606790534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240b5b60 0x7f5c241687f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009d90 tx=0x7f5c1c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6dc1155987f1faf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.336+0000 7f5c22ffd640 1 -- 172.21.15.55:0/606790534 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c007740 con 0x7f5c240b5b60 2024-04-25T08:56:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.336+0000 7f5c22ffd640 1 -- 172.21.15.55:0/606790534 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1c0078e0 con 0x7f5c240b5b60 2024-04-25T08:56:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.336+0000 7f5c22ffd640 1 -- 172.21.15.55:0/606790534 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c007cb0 con 0x7f5c240b5b60 2024-04-25T08:56:20.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.337+0000 7f5c2a99e640 1 -- 172.21.15.55:0/606790534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240b5b60 msgr2=0x7f5c241687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.337+0000 7f5c2a99e640 1 --2- 172.21.15.55:0/606790534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240b5b60 0x7f5c241687f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009d90 tx=0x7f5c1c02a6f0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.337+0000 7f5c2a99e640 1 -- 172.21.15.55:0/606790534 shutdown_connections 2024-04-25T08:56:20.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.337+0000 7f5c2a99e640 1 --2- 172.21.15.55:0/606790534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240b5b60 0x7f5c241687f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.337+0000 7f5c2a99e640 1 -- 172.21.15.55:0/606790534 >> 172.21.15.55:0/606790534 conn(0x7f5c24072900 msgr2=0x7f5c240d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.337+0000 7f5c2a99e640 1 -- 172.21.15.55:0/606790534 shutdown_connections 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.337+0000 7f5c2a99e640 1 -- 172.21.15.55:0/606790534 wait complete. 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.338+0000 7f5c2a99e640 1 Processor -- start 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.338+0000 7f5c2a99e640 1 -- start start 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.339+0000 7f5c2a99e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240b5b60 0x7f5c240ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.339+0000 7f5c2a99e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c240d35b0 0x7f5c24160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.339+0000 7f5c2a99e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c2415dce0 0x7f5c24145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.339+0000 7f5c2a99e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240d3090 con 0x7f5c240b5b60 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.339+0000 7f5c2a99e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240d2db0 con 0x7f5c240d35b0 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.339+0000 7f5c2a99e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240d2160 con 0x7f5c2415dce0 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.339+0000 7f5c23fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240b5b60 0x7f5c240ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.339+0000 7f5c23fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240b5b60 0x7f5c240ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39120/0 (socket says 172.21.15.55:39120) 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.339+0000 7f5c23fff640 1 -- 172.21.15.55:0/2944654394 learned_addr learned my addr 172.21.15.55:0/2944654394 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.339+0000 7f5c237fe640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c240d35b0 0x7f5c24160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.339+0000 7f5c28f3b640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c2415dce0 0x7f5c24145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c23fff640 1 -- 172.21.15.55:0/2944654394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c2415dce0 msgr2=0x7f5c24145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c23fff640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c2415dce0 0x7f5c24145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c23fff640 1 -- 172.21.15.55:0/2944654394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c240d35b0 msgr2=0x7f5c24160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c23fff640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c240d35b0 0x7f5c24160e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c23fff640 1 -- 172.21.15.55:0/2944654394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c24153dd0 con 0x7f5c240b5b60 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c237fe640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c240d35b0 0x7f5c24160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c23fff640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240b5b60 0x7f5c240ccfc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800c3f0 tx=0x7f5c1800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c20ff9640 1 -- 172.21.15.55:0/2944654394 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c180074e0 con 0x7f5c240b5b60 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c20ff9640 1 -- 172.21.15.55:0/2944654394 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c180047e0 con 0x7f5c240b5b60 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c20ff9640 1 -- 172.21.15.55:0/2944654394 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18004c10 con 0x7f5c240b5b60 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c2a99e640 1 -- 172.21.15.55:0/2944654394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c241540b0 con 0x7f5c240b5b60 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.340+0000 7f5c2a99e640 1 -- 172.21.15.55:0/2944654394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c240ccaa0 con 0x7f5c240b5b60 2024-04-25T08:56:20.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.341+0000 7f5c2a99e640 1 -- 172.21.15.55:0/2944654394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c240ccca0 con 0x7f5c240b5b60 2024-04-25T08:56:20.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.341+0000 7f5c20ff9640 1 -- 172.21.15.55:0/2944654394 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5c18011070 con 0x7f5c240b5b60 2024-04-25T08:56:20.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.342+0000 7f5c20ff9640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c1006b4d0 0x7f5c1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.342+0000 7f5c20ff9640 1 -- 172.21.15.55:0/2944654394 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c18089da0 con 0x7f5c240b5b60 2024-04-25T08:56:20.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.342+0000 7f5c237fe640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c1006b4d0 0x7f5c1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.342+0000 7f5c237fe640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c1006b4d0 0x7f5c1006d990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5c14007fd0 tx=0x7f5c14009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.346+0000 7f5c20ff9640 1 -- 172.21.15.55:0/2944654394 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5c1801a2b0 con 0x7f5c240b5b60 2024-04-25T08:56:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.570+0000 7f5c2a99e640 1 -- 172.21.15.55:0/2944654394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c240749b0 con 0x7f5c240b5b60 2024-04-25T08:56:20.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.571+0000 7f5c20ff9640 1 -- 172.21.15.55:0/2944654394 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f5c18058c20 con 0x7f5c240b5b60 2024-04-25T08:56:20.561 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:20.561 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1092467772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1092467772},{"type":"v1","addr":"172.21.15.167:6834","nonce":1092467772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/651597245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":651597245},{"type":"v1","addr":"172.21.15.55:6837","nonce":651597245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3980280949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3980280949},{"type":"v1","addr":"172.21.15.55:6836","nonce":3980280949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:17.562426+0000","modified":"2024-04-25T08:56:19.557433+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/238831666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":238831666},{"type":"v1","addr":"172.21.15.167:6835","nonce":238831666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:56:20.561 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 28 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 -- 172.21.15.55:0/2944654394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c1006b4d0 msgr2=0x7f5c1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c1006b4d0 0x7f5c1006d990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5c14007fd0 tx=0x7f5c14009040 comp rx=0 tx=0).stop 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 -- 172.21.15.55:0/2944654394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240b5b60 msgr2=0x7f5c240ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240b5b60 0x7f5c240ccfc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800c3f0 tx=0x7f5c1800c8b0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 -- 172.21.15.55:0/2944654394 shutdown_connections 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c1006b4d0 0x7f5c1006d990 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c2415dce0 0x7f5c24145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c240d35b0 0x7f5c24160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 --2- 172.21.15.55:0/2944654394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240b5b60 0x7f5c240ccfc0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 -- 172.21.15.55:0/2944654394 >> 172.21.15.55:0/2944654394 conn(0x7f5c24072900 msgr2=0x7f5c240ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 -- 172.21.15.55:0/2944654394 shutdown_connections 2024-04-25T08:56:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.573+0000 7f5c2a99e640 1 -- 172.21.15.55:0/2944654394 wait complete. 2024-04-25T08:56:20.574 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:56:20.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.685+0000 7fac7a493640 1 Processor -- start 2024-04-25T08:56:20.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.685+0000 7fac7a493640 1 -- start start 2024-04-25T08:56:20.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.686+0000 7fac7a493640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fac7415dd50 0x7fac740d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.686+0000 7fac7a493640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac740ceeb0 0x7fac740b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.686+0000 7fac7a493640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac740d2440 con 0x7fac740b9460 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.686+0000 7fac7a493640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac740d2720 con 0x7fac740ceeb0 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.686+0000 7fac7a493640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac740d2a00 con 0x7fac7415dd50 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.686+0000 7fac78a30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac740ceeb0 0x7fac740b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.686+0000 7fac737fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fac740b9460 0x7fac740ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37528/0 (socket says 172.21.15.55:37528) 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.686+0000 7fac78a30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac740ceeb0 0x7fac740b6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39126/0 (socket says 172.21.15.55:39126) 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.686+0000 7fac737fe640 1 -- 172.21.15.55:0/2494963949 learned_addr learned my addr 172.21.15.55:0/2494963949 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.687+0000 7fac73fff640 1 --2- 172.21.15.55:0/2494963949 >> v2:172.21.15.167:3300/0 conn(0x7fac7415dd50 0x7fac740d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.687+0000 7fac78a30640 1 -- 172.21.15.55:0/2494963949 >> v2:172.21.15.167:3300/0 conn(0x7fac7415dd50 msgr2=0x7fac740d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.687+0000 7fac78a30640 1 --2- 172.21.15.55:0/2494963949 >> v2:172.21.15.167:3300/0 conn(0x7fac7415dd50 0x7fac740d1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.687+0000 7fac78a30640 1 -- 172.21.15.55:0/2494963949 >> v1:172.21.15.55:6789/0 conn(0x7fac740b9460 legacy=0x7fac740ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.687+0000 7fac78a30640 1 -- 172.21.15.55:0/2494963949 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac740d2ce0 con 0x7fac740ceeb0 2024-04-25T08:56:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.687+0000 7fac72ffd640 1 -- 172.21.15.55:0/2494963949 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333571201 0 0) 0x7fac740d2440 con 0x7fac740b9460 2024-04-25T08:56:20.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.687+0000 7fac78a30640 1 --2- 172.21.15.55:0/2494963949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740ceeb0 0x7fac740b6c70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fac7406b9a0 tx=0x7fac6c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4433fd3e548c08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.688+0000 7fac72ffd640 1 -- 172.21.15.55:0/2494963949 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c007740 con 0x7fac740ceeb0 2024-04-25T08:56:20.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.688+0000 7fac72ffd640 1 -- 172.21.15.55:0/2494963949 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c0078e0 con 0x7fac740ceeb0 2024-04-25T08:56:20.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.688+0000 7fac72ffd640 1 -- 172.21.15.55:0/2494963949 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c007cb0 con 0x7fac740ceeb0 2024-04-25T08:56:20.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.688+0000 7fac7a493640 1 -- 172.21.15.55:0/2494963949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740ceeb0 msgr2=0x7fac740b6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.688+0000 7fac7a493640 1 --2- 172.21.15.55:0/2494963949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740ceeb0 0x7fac740b6c70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fac7406b9a0 tx=0x7fac6c02a5f0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.688+0000 7fac7a493640 1 -- 172.21.15.55:0/2494963949 shutdown_connections 2024-04-25T08:56:20.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.688+0000 7fac7a493640 1 --2- 172.21.15.55:0/2494963949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740ceeb0 0x7fac740b6c70 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.688+0000 7fac7a493640 1 --2- 172.21.15.55:0/2494963949 >> v2:172.21.15.167:3300/0 conn(0x7fac7415dd50 0x7fac740d1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.688+0000 7fac7a493640 1 -- 172.21.15.55:0/2494963949 >> 172.21.15.55:0/2494963949 conn(0x7fac740722d0 msgr2=0x7fac740726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:20.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.688+0000 7fac7a493640 1 -- 172.21.15.55:0/2494963949 shutdown_connections 2024-04-25T08:56:20.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.688+0000 7fac7a493640 1 -- 172.21.15.55:0/2494963949 wait complete. 2024-04-25T08:56:20.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.689+0000 7fac7a493640 1 Processor -- start 2024-04-25T08:56:20.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.690+0000 7fac7a493640 1 -- start start 2024-04-25T08:56:20.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.690+0000 7fac7a493640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac740b9460 0x7fac7414d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.690+0000 7fac7a493640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac740ceeb0 0x7fac740b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.690+0000 7fac7a493640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac7415dd50 0x7fac740b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.690+0000 7fac7a493640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac740d34e0 con 0x7fac7415dd50 2024-04-25T08:56:20.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.690+0000 7fac7a493640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac740d2150 con 0x7fac740ceeb0 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.690+0000 7fac7a493640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac740d3660 con 0x7fac740b9460 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.690+0000 7fac78a30640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac7415dd50 0x7fac740b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.690+0000 7fac78a30640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac7415dd50 0x7fac740b7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39136/0 (socket says 172.21.15.55:39136) 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.690+0000 7fac78a30640 1 -- 172.21.15.55:0/2132632144 learned_addr learned my addr 172.21.15.55:0/2132632144 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac737fe640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac740ceeb0 0x7fac740b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac73fff640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac740b9460 0x7fac7414d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac78a30640 1 -- 172.21.15.55:0/2132632144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac740b9460 msgr2=0x7fac7414d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac78a30640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac740b9460 0x7fac7414d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac78a30640 1 -- 172.21.15.55:0/2132632144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac740ceeb0 msgr2=0x7fac740b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac78a30640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac740ceeb0 0x7fac740b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac78a30640 1 -- 172.21.15.55:0/2132632144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac740c9600 con 0x7fac7415dd50 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac78a30640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac7415dd50 0x7fac740b7d10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009e50 tx=0x7fac6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac70ff9640 1 -- 172.21.15.55:0/2132632144 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c03f070 con 0x7fac7415dd50 2024-04-25T08:56:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac70ff9640 1 -- 172.21.15.55:0/2132632144 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c031bf0 con 0x7fac7415dd50 2024-04-25T08:56:20.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac7a493640 1 -- 172.21.15.55:0/2132632144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac740c98e0 con 0x7fac7415dd50 2024-04-25T08:56:20.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac70ff9640 1 -- 172.21.15.55:0/2132632144 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c009450 con 0x7fac7415dd50 2024-04-25T08:56:20.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.691+0000 7fac7a493640 1 -- 172.21.15.55:0/2132632144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac740c9ea0 con 0x7fac7415dd50 2024-04-25T08:56:20.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.692+0000 7fac7a493640 1 -- 172.21.15.55:0/2132632144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac74067850 con 0x7fac7415dd50 2024-04-25T08:56:20.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.693+0000 7fac70ff9640 1 -- 172.21.15.55:0/2132632144 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac6c03b410 con 0x7fac7415dd50 2024-04-25T08:56:20.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.693+0000 7fac70ff9640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac6006b4d0 0x7fac6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.693+0000 7fac73fff640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac6006b4d0 0x7fac6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.693+0000 7fac70ff9640 1 -- 172.21.15.55:0/2132632144 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac6c0ab8b0 con 0x7fac7415dd50 2024-04-25T08:56:20.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.694+0000 7fac73fff640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac6006b4d0 0x7fac6006d990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fac64009a10 tx=0x7fac64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.697+0000 7fac70ff9640 1 -- 172.21.15.55:0/2132632144 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac6c07a0e0 con 0x7fac7415dd50 2024-04-25T08:56:20.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.878+0000 7fac7a493640 1 -- 172.21.15.55:0/2132632144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac740749b0 con 0x7fac7415dd50 2024-04-25T08:56:20.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.879+0000 7fac70ff9640 1 -- 172.21.15.55:0/2132632144 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16665 (secure 0 0 0) 0x7fac6c07e180 con 0x7fac7415dd50 2024-04-25T08:56:20.869 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:20.869 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":61,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:56:19.191031+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:15.846477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:16.537036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:56:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 -- 172.21.15.55:0/2132632144 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac6006b4d0 msgr2=0x7fac6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac6006b4d0 0x7fac6006d990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fac64009a10 tx=0x7fac64008040 comp rx=0 tx=0).stop 2024-04-25T08:56:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 -- 172.21.15.55:0/2132632144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac7415dd50 msgr2=0x7fac740b7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac7415dd50 0x7fac740b7d10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009e50 tx=0x7fac6c004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 -- 172.21.15.55:0/2132632144 shutdown_connections 2024-04-25T08:56:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac6006b4d0 0x7fac6006d990 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac7415dd50 0x7fac740b7d10 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac740ceeb0 0x7fac740b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 --2- 172.21.15.55:0/2132632144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac740b9460 0x7fac7414d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 -- 172.21.15.55:0/2132632144 >> 172.21.15.55:0/2132632144 conn(0x7fac740722d0 msgr2=0x7fac74158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:20.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 -- 172.21.15.55:0/2132632144 shutdown_connections 2024-04-25T08:56:20.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.881+0000 7fac7a493640 1 -- 172.21.15.55:0/2132632144 wait complete. 2024-04-25T08:56:20.882 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:56:20.882 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:56:20.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.994+0000 7f155b0f7640 1 Processor -- start 2024-04-25T08:56:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.994+0000 7f155b0f7640 1 -- start start 2024-04-25T08:56:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.994+0000 7f155b0f7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f155415dce0 0x7f15540d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f155b0f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15540b5b60 0x7f15540b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f155b0f7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155415e0c0 con 0x7f15540d35b0 2024-04-25T08:56:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f155b0f7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15540d2510 con 0x7f15540b5b60 2024-04-25T08:56:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f155b0f7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15540d27f0 con 0x7f155415dce0 2024-04-25T08:56:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f1559694640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15540b5b60 0x7f15540b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f1559694640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15540b5b60 0x7f15540b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39144/0 (socket says 172.21.15.55:39144) 2024-04-25T08:56:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f1559694640 1 -- 172.21.15.55:0/2683259572 learned_addr learned my addr 172.21.15.55:0/2683259572 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f1558e93640 1 --2- 172.21.15.55:0/2683259572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f155415dce0 0x7f15540d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f1559694640 1 -- 172.21.15.55:0/2683259572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f155415dce0 msgr2=0x7f15540d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:20.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f1559694640 1 --2- 172.21.15.55:0/2683259572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f155415dce0 0x7f15540d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f1559694640 1 -- 172.21.15.55:0/2683259572 >> v1:172.21.15.167:6789/0 conn(0x7f15540d35b0 legacy=0x7f15540b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.995+0000 7f1559694640 1 -- 172.21.15.55:0/2683259572 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540d2ad0 con 0x7f15540b5b60 2024-04-25T08:56:20.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.996+0000 7f1559694640 1 --2- 172.21.15.55:0/2683259572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15540b5b60 0x7f15540b6b00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1544009870 tx=0x7f154402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77b58e32827ec41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.996+0000 7f15537fe640 1 -- 172.21.15.55:0/2683259572 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544037070 con 0x7f15540b5b60 2024-04-25T08:56:20.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.996+0000 7f15537fe640 1 -- 172.21.15.55:0/2683259572 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1544032440 con 0x7f15540b5b60 2024-04-25T08:56:20.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.996+0000 7f15537fe640 1 -- 172.21.15.55:0/2683259572 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544032810 con 0x7f15540b5b60 2024-04-25T08:56:20.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.996+0000 7f155b0f7640 1 -- 172.21.15.55:0/2683259572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15540b5b60 msgr2=0x7f15540b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.996+0000 7f155b0f7640 1 --2- 172.21.15.55:0/2683259572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15540b5b60 0x7f15540b6b00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1544009870 tx=0x7f154402a270 comp rx=0 tx=0).stop 2024-04-25T08:56:20.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.996+0000 7f155b0f7640 1 -- 172.21.15.55:0/2683259572 shutdown_connections 2024-04-25T08:56:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.996+0000 7f155b0f7640 1 --2- 172.21.15.55:0/2683259572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15540b5b60 0x7f15540b6b00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.996+0000 7f155b0f7640 1 --2- 172.21.15.55:0/2683259572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f155415dce0 0x7f15540d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.996+0000 7f155b0f7640 1 -- 172.21.15.55:0/2683259572 >> 172.21.15.55:0/2683259572 conn(0x7f1554072900 msgr2=0x7f15540d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.997+0000 7f155b0f7640 1 -- 172.21.15.55:0/2683259572 shutdown_connections 2024-04-25T08:56:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.997+0000 7f155b0f7640 1 -- 172.21.15.55:0/2683259572 wait complete. 2024-04-25T08:56:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.998+0000 7f155b0f7640 1 Processor -- start 2024-04-25T08:56:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.998+0000 7f155b0f7640 1 -- start start 2024-04-25T08:56:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f155b0f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15540b5b60 0x7f1554152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f155b0f7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15540d35b0 0x7f15540c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f155b0f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155415dce0 0x7f15540c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f155b0f7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540b9820 con 0x7f155415dce0 2024-04-25T08:56:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f155b0f7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540d3090 con 0x7f15540b5b60 2024-04-25T08:56:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f155b0f7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15540b99a0 con 0x7f15540d35b0 2024-04-25T08:56:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f1559694640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155415dce0 0x7f15540c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f1559694640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155415dce0 0x7f15540c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39156/0 (socket says 172.21.15.55:39156) 2024-04-25T08:56:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f1559694640 1 -- 172.21.15.55:0/1981604107 learned_addr learned my addr 172.21.15.55:0/1981604107 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f1553fff640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15540d35b0 0x7f15540c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f1558e93640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15540b5b60 0x7f1554152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f1559694640 1 -- 172.21.15.55:0/1981604107 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15540d35b0 msgr2=0x7f15540c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f1559694640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15540d35b0 0x7f15540c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f1559694640 1 -- 172.21.15.55:0/1981604107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15540b5b60 msgr2=0x7f1554152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f1559694640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15540b5b60 0x7f1554152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f1559694640 1 -- 172.21.15.55:0/1981604107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540c8b90 con 0x7f155415dce0 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f1559694640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155415dce0 0x7f15540c9830 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1544009870 tx=0x7f15440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f15517fa640 1 -- 172.21.15.55:0/1981604107 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544037040 con 0x7f155415dce0 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f15517fa640 1 -- 172.21.15.55:0/1981604107 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1544042070 con 0x7f155415dce0 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:20.999+0000 7f15517fa640 1 -- 172.21.15.55:0/1981604107 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544030920 con 0x7f155415dce0 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.000+0000 7f155b0f7640 1 -- 172.21.15.55:0/1981604107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15540c82f0 con 0x7f155415dce0 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.000+0000 7f155b0f7640 1 -- 172.21.15.55:0/1981604107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15540c88b0 con 0x7f155415dce0 2024-04-25T08:56:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.001+0000 7f155b0f7640 1 -- 172.21.15.55:0/1981604107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15540749b0 con 0x7f155415dce0 2024-04-25T08:56:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.001+0000 7f15517fa640 1 -- 172.21.15.55:0/1981604107 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1544030ac0 con 0x7f155415dce0 2024-04-25T08:56:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.001+0000 7f15517fa640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f153406b4d0 0x7f153406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.001+0000 7f15517fa640 1 -- 172.21.15.55:0/1981604107 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15440aa990 con 0x7f155415dce0 2024-04-25T08:56:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.001+0000 7f1558e93640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f153406b4d0 0x7f153406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.002+0000 7f1558e93640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f153406b4d0 0x7f153406d990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f154c003aa0 tx=0x7f154c009830 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:20.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.006+0000 7f15517fa640 1 -- 172.21.15.55:0/1981604107 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f15440791c0 con 0x7f155415dce0 2024-04-25T08:56:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.182+0000 7f155b0f7640 1 -- 172.21.15.55:0/1981604107 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15540b27a0 con 0x7f153406b4d0 2024-04-25T08:56:21.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.188+0000 7f15517fa640 1 -- 172.21.15.55:0/1981604107 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250694 (secure 0 0 0) 0x7f15540b27a0 con 0x7f153406b4d0 2024-04-25T08:56:21.181 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:21.182 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 -- 172.21.15.55:0/1981604107 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f153406b4d0 msgr2=0x7f153406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f153406b4d0 0x7f153406d990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f154c003aa0 tx=0x7f154c009830 comp rx=0 tx=0).stop 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 -- 172.21.15.55:0/1981604107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155415dce0 msgr2=0x7f15540c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155415dce0 0x7f15540c9830 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1544009870 tx=0x7f15440046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 -- 172.21.15.55:0/1981604107 shutdown_connections 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f153406b4d0 0x7f153406d990 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155415dce0 0x7f15540c9830 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15540d35b0 0x7f15540c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 --2- 172.21.15.55:0/1981604107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15540b5b60 0x7f1554152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 -- 172.21.15.55:0/1981604107 >> 172.21.15.55:0/1981604107 conn(0x7f1554072900 msgr2=0x7f15540d39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 -- 172.21.15.55:0/1981604107 shutdown_connections 2024-04-25T08:56:21.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.191+0000 7f155b0f7640 1 -- 172.21.15.55:0/1981604107 wait complete. 2024-04-25T08:56:21.192 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-25T08:56:20.583778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239620,"kb_used_data":6788,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735100,"statfs":{"total":773094113280,"available":772848742400,"internally_reserved":0,"allocated":6950912,"data_stored":3540752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.399277"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197228+0000","last_change":"2024-04-25T08:56:18.216097+0000","last_active":"2024-04-25T08:56:19.197228+0000","last_peered":"2024-04-25T08:56:19.197228+0000","last_clean":"2024-04-25T08:56:19.197228+0000","last_became_active":"2024-04-25T08:56:18.215813+0000","last_became_peered":"2024-04-25T08:56:18.215813+0000","last_unstale":"2024-04-25T08:56:19.197228+0000","last_undegraded":"2024-04-25T08:56:19.197228+0000","last_fullsized":"2024-04-25T08:56:19.197228+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:16.551427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196183+0000","last_change":"2024-04-25T08:56:18.216111+0000","last_active":"2024-04-25T08:56:19.196183+0000","last_peered":"2024-04-25T08:56:19.196183+0000","last_clean":"2024-04-25T08:56:19.196183+0000","last_became_active":"2024-04-25T08:56:18.215825+0000","last_became_peered":"2024-04-25T08:56:18.215825+0000","last_unstale":"2024-04-25T08:56:19.196183+0000","last_undegraded":"2024-04-25T08:56:19.196183+0000","last_fullsized":"2024-04-25T08:56:19.196183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:27.852434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481340+0000","last_change":"2024-04-25T08:56:18.216482+0000","last_active":"2024-04-25T08:56:19.481340+0000","last_peered":"2024-04-25T08:56:19.481340+0000","last_clean":"2024-04-25T08:56:19.481340+0000","last_became_active":"2024-04-25T08:56:18.216109+0000","last_became_peered":"2024-04-25T08:56:18.216109+0000","last_unstale":"2024-04-25T08:56:19.481340+0000","last_undegraded":"2024-04-25T08:56:19.481340+0000","last_fullsized":"2024-04-25T08:56:19.481340+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:34:03.547004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222711+0000","last_change":"2024-04-25T08:56:18.215504+0000","last_active":"2024-04-25T08:56:18.222711+0000","last_peered":"2024-04-25T08:56:18.222711+0000","last_clean":"2024-04-25T08:56:18.222711+0000","last_became_active":"2024-04-25T08:56:18.215231+0000","last_became_peered":"2024-04-25T08:56:18.215231+0000","last_unstale":"2024-04-25T08:56:18.222711+0000","last_undegraded":"2024-04-25T08:56:18.222711+0000","last_fullsized":"2024-04-25T08:56:18.222711+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:55.008870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196987+0000","last_change":"2024-04-25T08:56:18.215438+0000","last_active":"2024-04-25T08:56:19.196987+0000","last_peered":"2024-04-25T08:56:19.196987+0000","last_clean":"2024-04-25T08:56:19.196987+0000","last_became_active":"2024-04-25T08:56:18.215127+0000","last_became_peered":"2024-04-25T08:56:18.215127+0000","last_unstale":"2024-04-25T08:56:19.196987+0000","last_undegraded":"2024-04-25T08:56:19.196987+0000","last_fullsized":"2024-04-25T08:56:19.196987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:18.265835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359240+0000","last_change":"2024-04-25T08:56:18.219404+0000","last_active":"2024-04-25T08:56:19.359240+0000","last_peered":"2024-04-25T08:56:19.359240+0000","last_clean":"2024-04-25T08:56:19.359240+0000","last_became_active":"2024-04-25T08:56:18.219126+0000","last_became_peered":"2024-04-25T08:56:18.219126+0000","last_unstale":"2024-04-25T08:56:19.359240+0000","last_undegraded":"2024-04-25T08:56:19.359240+0000","last_fullsized":"2024-04-25T08:56:19.359240+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:10.524577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.211594+0000","last_change":"2024-04-25T08:56:18.207889+0000","last_active":"2024-04-25T08:56:18.211594+0000","last_peered":"2024-04-25T08:56:18.211594+0000","last_clean":"2024-04-25T08:56:18.211594+0000","last_became_active":"2024-04-25T08:56:18.207533+0000","last_became_peered":"2024-04-25T08:56:18.207533+0000","last_unstale":"2024-04-25T08:56:18.211594+0000","last_undegraded":"2024-04-25T08:56:18.211594+0000","last_fullsized":"2024-04-25T08:56:18.211594+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:05.251215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195447+0000","last_change":"2024-04-25T08:56:18.201722+0000","last_active":"2024-04-25T08:56:19.195447+0000","last_peered":"2024-04-25T08:56:19.195447+0000","last_clean":"2024-04-25T08:56:19.195447+0000","last_became_active":"2024-04-25T08:56:18.201409+0000","last_became_peered":"2024-04-25T08:56:18.201409+0000","last_unstale":"2024-04-25T08:56:19.195447+0000","last_undegraded":"2024-04-25T08:56:19.195447+0000","last_fullsized":"2024-04-25T08:56:19.195447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:02.179797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222016+0000","last_change":"2024-04-25T08:56:18.218239+0000","last_active":"2024-04-25T08:56:18.222016+0000","last_peered":"2024-04-25T08:56:18.222016+0000","last_clean":"2024-04-25T08:56:18.222016+0000","last_became_active":"2024-04-25T08:56:18.217954+0000","last_became_peered":"2024-04-25T08:56:18.217954+0000","last_unstale":"2024-04-25T08:56:18.222016+0000","last_undegraded":"2024-04-25T08:56:18.222016+0000","last_fullsized":"2024-04-25T08:56:18.222016+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:21.994569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.219587+0000","last_change":"2024-04-25T08:56:18.211963+0000","last_active":"2024-04-25T08:56:18.219587+0000","last_peered":"2024-04-25T08:56:18.219587+0000","last_clean":"2024-04-25T08:56:18.219587+0000","last_became_active":"2024-04-25T08:56:18.211651+0000","last_became_peered":"2024-04-25T08:56:18.211651+0000","last_unstale":"2024-04-25T08:56:18.219587+0000","last_undegraded":"2024-04-25T08:56:18.219587+0000","last_fullsized":"2024-04-25T08:56:18.219587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:13.460350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196604+0000","last_change":"2024-04-25T08:56:18.218212+0000","last_active":"2024-04-25T08:56:19.196604+0000","last_peered":"2024-04-25T08:56:19.196604+0000","last_clean":"2024-04-25T08:56:19.196604+0000","last_became_active":"2024-04-25T08:56:18.217523+0000","last_became_peered":"2024-04-25T08:56:18.217523+0000","last_unstale":"2024-04-25T08:56:19.196604+0000","last_undegraded":"2024-04-25T08:56:19.196604+0000","last_fullsized":"2024-04-25T08:56:19.196604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:12.024798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.212508+0000","last_change":"2024-04-25T08:56:18.210940+0000","last_active":"2024-04-25T08:56:18.212508+0000","last_peered":"2024-04-25T08:56:18.212508+0000","last_clean":"2024-04-25T08:56:18.212508+0000","last_became_active":"2024-04-25T08:56:18.210548+0000","last_became_peered":"2024-04-25T08:56:18.210548+0000","last_unstale":"2024-04-25T08:56:18.212508+0000","last_undegraded":"2024-04-25T08:56:18.212508+0000","last_fullsized":"2024-04-25T08:56:18.212508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:51.274029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.216299+0000","last_change":"2024-04-25T08:56:18.215336+0000","last_active":"2024-04-25T08:56:18.216299+0000","last_peered":"2024-04-25T08:56:18.216299+0000","last_clean":"2024-04-25T08:56:18.216299+0000","last_became_active":"2024-04-25T08:56:18.214922+0000","last_became_peered":"2024-04-25T08:56:18.214922+0000","last_unstale":"2024-04-25T08:56:18.216299+0000","last_undegraded":"2024-04-25T08:56:18.216299+0000","last_fullsized":"2024-04-25T08:56:18.216299+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:00.693003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359208+0000","last_change":"2024-04-25T08:56:18.216067+0000","last_active":"2024-04-25T08:56:19.359208+0000","last_peered":"2024-04-25T08:56:19.359208+0000","last_clean":"2024-04-25T08:56:19.359208+0000","last_became_active":"2024-04-25T08:56:18.215750+0000","last_became_peered":"2024-04-25T08:56:18.215750+0000","last_unstale":"2024-04-25T08:56:19.359208+0000","last_undegraded":"2024-04-25T08:56:19.359208+0000","last_fullsized":"2024-04-25T08:56:19.359208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196193+0000","last_change":"2024-04-25T08:56:18.205704+0000","last_active":"2024-04-25T08:56:19.196193+0000","last_peered":"2024-04-25T08:56:19.196193+0000","last_clean":"2024-04-25T08:56:19.196193+0000","last_became_active":"2024-04-25T08:56:18.205432+0000","last_became_peered":"2024-04-25T08:56:18.205432+0000","last_unstale":"2024-04-25T08:56:19.196193+0000","last_undegraded":"2024-04-25T08:56:19.196193+0000","last_fullsized":"2024-04-25T08:56:19.196193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:50.798086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481529+0000","last_change":"2024-04-25T08:56:18.220201+0000","last_active":"2024-04-25T08:56:19.481529+0000","last_peered":"2024-04-25T08:56:19.481529+0000","last_clean":"2024-04-25T08:56:19.481529+0000","last_became_active":"2024-04-25T08:56:18.219890+0000","last_became_peered":"2024-04-25T08:56:18.219890+0000","last_unstale":"2024-04-25T08:56:19.481529+0000","last_undegraded":"2024-04-25T08:56:19.481529+0000","last_fullsized":"2024-04-25T08:56:19.481529+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.388864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196996+0000","last_change":"2024-04-25T08:56:18.216067+0000","last_active":"2024-04-25T08:56:19.196996+0000","last_peered":"2024-04-25T08:56:19.196996+0000","last_clean":"2024-04-25T08:56:19.196996+0000","last_became_active":"2024-04-25T08:56:18.215793+0000","last_became_peered":"2024-04-25T08:56:18.215793+0000","last_unstale":"2024-04-25T08:56:19.196996+0000","last_undegraded":"2024-04-25T08:56:19.196996+0000","last_fullsized":"2024-04-25T08:56:19.196996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:27.576959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196082+0000","last_change":"2024-04-25T08:56:18.221843+0000","last_active":"2024-04-25T08:56:19.196082+0000","last_peered":"2024-04-25T08:56:19.196082+0000","last_clean":"2024-04-25T08:56:19.196082+0000","last_became_active":"2024-04-25T08:56:18.221585+0000","last_became_peered":"2024-04-25T08:56:18.221585+0000","last_unstale":"2024-04-25T08:56:19.196082+0000","last_undegraded":"2024-04-25T08:56:19.196082+0000","last_fullsized":"2024-04-25T08:56:19.196082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:54.520655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481188+0000","last_change":"2024-04-25T08:56:18.208528+0000","last_active":"2024-04-25T08:56:19.481188+0000","last_peered":"2024-04-25T08:56:19.481188+0000","last_clean":"2024-04-25T08:56:19.481188+0000","last_became_active":"2024-04-25T08:56:18.208223+0000","last_became_peered":"2024-04-25T08:56:18.208223+0000","last_unstale":"2024-04-25T08:56:19.481188+0000","last_undegraded":"2024-04-25T08:56:19.481188+0000","last_fullsized":"2024-04-25T08:56:19.481188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:58.962486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195551+0000","last_change":"2024-04-25T08:56:18.211520+0000","last_active":"2024-04-25T08:56:19.195551+0000","last_peered":"2024-04-25T08:56:19.195551+0000","last_clean":"2024-04-25T08:56:19.195551+0000","last_became_active":"2024-04-25T08:56:18.211171+0000","last_became_peered":"2024-04-25T08:56:18.211171+0000","last_unstale":"2024-04-25T08:56:19.195551+0000","last_undegraded":"2024-04-25T08:56:19.195551+0000","last_fullsized":"2024-04-25T08:56:19.195551+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:56.175100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481207+0000","last_change":"2024-04-25T08:56:18.223242+0000","last_active":"2024-04-25T08:56:19.481207+0000","last_peered":"2024-04-25T08:56:19.481207+0000","last_clean":"2024-04-25T08:56:19.481207+0000","last_became_active":"2024-04-25T08:56:18.222694+0000","last_became_peered":"2024-04-25T08:56:18.222694+0000","last_unstale":"2024-04-25T08:56:19.481207+0000","last_undegraded":"2024-04-25T08:56:19.481207+0000","last_fullsized":"2024-04-25T08:56:19.481207+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:47.866218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196301+0000","last_change":"2024-04-25T08:56:18.217082+0000","last_active":"2024-04-25T08:56:19.196301+0000","last_peered":"2024-04-25T08:56:19.196301+0000","last_clean":"2024-04-25T08:56:19.196301+0000","last_became_active":"2024-04-25T08:56:18.216639+0000","last_became_peered":"2024-04-25T08:56:18.216639+0000","last_unstale":"2024-04-25T08:56:19.196301+0000","last_undegraded":"2024-04-25T08:56:19.196301+0000","last_fullsized":"2024-04-25T08:56:19.196301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:39.841298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197280+0000","last_change":"2024-04-25T08:56:18.215507+0000","last_active":"2024-04-25T08:56:19.197280+0000","last_peered":"2024-04-25T08:56:19.197280+0000","last_clean":"2024-04-25T08:56:19.197280+0000","last_became_active":"2024-04-25T08:56:18.215224+0000","last_became_peered":"2024-04-25T08:56:18.215224+0000","last_unstale":"2024-04-25T08:56:19.197280+0000","last_undegraded":"2024-04-25T08:56:19.197280+0000","last_fullsized":"2024-04-25T08:56:19.197280+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:12.624706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.213831+0000","last_change":"2024-04-25T08:56:18.207047+0000","last_active":"2024-04-25T08:56:18.213831+0000","last_peered":"2024-04-25T08:56:18.213831+0000","last_clean":"2024-04-25T08:56:18.213831+0000","last_became_active":"2024-04-25T08:56:18.206749+0000","last_became_peered":"2024-04-25T08:56:18.206749+0000","last_unstale":"2024-04-25T08:56:18.213831+0000","last_undegraded":"2024-04-25T08:56:18.213831+0000","last_fullsized":"2024-04-25T08:56:18.213831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:33.200201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359355+0000","last_change":"2024-04-25T08:56:18.216568+0000","last_active":"2024-04-25T08:56:19.359355+0000","last_peered":"2024-04-25T08:56:19.359355+0000","last_clean":"2024-04-25T08:56:19.359355+0000","last_became_active":"2024-04-25T08:56:18.215965+0000","last_became_peered":"2024-04-25T08:56:18.215965+0000","last_unstale":"2024-04-25T08:56:19.359355+0000","last_undegraded":"2024-04-25T08:56:19.359355+0000","last_fullsized":"2024-04-25T08:56:19.359355+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197235+0000","last_change":"2024-04-25T08:56:18.219428+0000","last_active":"2024-04-25T08:56:19.197235+0000","last_peered":"2024-04-25T08:56:19.197235+0000","last_clean":"2024-04-25T08:56:19.197235+0000","last_became_active":"2024-04-25T08:56:18.218946+0000","last_became_peered":"2024-04-25T08:56:18.218946+0000","last_unstale":"2024-04-25T08:56:19.197235+0000","last_undegraded":"2024-04-25T08:56:19.197235+0000","last_fullsized":"2024-04-25T08:56:19.197235+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:17.124211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196368+0000","last_change":"2024-04-25T08:56:18.209922+0000","last_active":"2024-04-25T08:56:19.196368+0000","last_peered":"2024-04-25T08:56:19.196368+0000","last_clean":"2024-04-25T08:56:19.196368+0000","last_became_active":"2024-04-25T08:56:18.208216+0000","last_became_peered":"2024-04-25T08:56:18.208216+0000","last_unstale":"2024-04-25T08:56:19.196368+0000","last_undegraded":"2024-04-25T08:56:19.196368+0000","last_fullsized":"2024-04-25T08:56:19.196368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:54.752262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481129+0000","last_change":"2024-04-25T08:56:18.215840+0000","last_active":"2024-04-25T08:56:19.481129+0000","last_peered":"2024-04-25T08:56:19.481129+0000","last_clean":"2024-04-25T08:56:19.481129+0000","last_became_active":"2024-04-25T08:56:18.214137+0000","last_became_peered":"2024-04-25T08:56:18.214137+0000","last_unstale":"2024-04-25T08:56:19.481129+0000","last_undegraded":"2024-04-25T08:56:19.481129+0000","last_fullsized":"2024-04-25T08:56:19.481129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:36.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196664+0000","last_change":"2024-04-25T08:56:18.215113+0000","last_active":"2024-04-25T08:56:19.196664+0000","last_peered":"2024-04-25T08:56:19.196664+0000","last_clean":"2024-04-25T08:56:19.196664+0000","last_became_active":"2024-04-25T08:56:18.214777+0000","last_became_peered":"2024-04-25T08:56:18.214777+0000","last_unstale":"2024-04-25T08:56:19.196664+0000","last_undegraded":"2024-04-25T08:56:19.196664+0000","last_fullsized":"2024-04-25T08:56:19.196664+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:02.932997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359476+0000","last_change":"2024-04-25T08:56:18.223089+0000","last_active":"2024-04-25T08:56:19.359476+0000","last_peered":"2024-04-25T08:56:19.359476+0000","last_clean":"2024-04-25T08:56:19.359476+0000","last_became_active":"2024-04-25T08:56:18.222727+0000","last_became_peered":"2024-04-25T08:56:18.222727+0000","last_unstale":"2024-04-25T08:56:19.359476+0000","last_undegraded":"2024-04-25T08:56:19.359476+0000","last_fullsized":"2024-04-25T08:56:19.359476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:47.361388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359468+0000","last_change":"2024-04-25T08:56:18.217780+0000","last_active":"2024-04-25T08:56:19.359468+0000","last_peered":"2024-04-25T08:56:19.359468+0000","last_clean":"2024-04-25T08:56:19.359468+0000","last_became_active":"2024-04-25T08:56:18.217411+0000","last_became_peered":"2024-04-25T08:56:18.217411+0000","last_unstale":"2024-04-25T08:56:19.359468+0000","last_undegraded":"2024-04-25T08:56:19.359468+0000","last_fullsized":"2024-04-25T08:56:19.359468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:53.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359681+0000","last_change":"2024-04-25T08:56:17.209473+0000","last_active":"2024-04-25T08:56:19.359681+0000","last_peered":"2024-04-25T08:56:19.359681+0000","last_clean":"2024-04-25T08:56:19.359681+0000","last_became_active":"2024-04-25T08:56:17.209211+0000","last_became_peered":"2024-04-25T08:56:17.209211+0000","last_unstale":"2024-04-25T08:56:19.359681+0000","last_undegraded":"2024-04-25T08:56:19.359681+0000","last_fullsized":"2024-04-25T08:56:19.359681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.024118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196283+0000","last_change":"2024-04-25T08:56:17.212441+0000","last_active":"2024-04-25T08:56:19.196283+0000","last_peered":"2024-04-25T08:56:19.196283+0000","last_clean":"2024-04-25T08:56:19.196283+0000","last_became_active":"2024-04-25T08:56:17.212105+0000","last_became_peered":"2024-04-25T08:56:17.212105+0000","last_unstale":"2024-04-25T08:56:19.196283+0000","last_undegraded":"2024-04-25T08:56:19.196283+0000","last_fullsized":"2024-04-25T08:56:19.196283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:43.080241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359476+0000","last_change":"2024-04-25T08:56:18.220153+0000","last_active":"2024-04-25T08:56:19.359476+0000","last_peered":"2024-04-25T08:56:19.359476+0000","last_clean":"2024-04-25T08:56:19.359476+0000","last_became_active":"2024-04-25T08:56:18.219814+0000","last_became_peered":"2024-04-25T08:56:18.219814+0000","last_unstale":"2024-04-25T08:56:19.359476+0000","last_undegraded":"2024-04-25T08:56:19.359476+0000","last_fullsized":"2024-04-25T08:56:19.359476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:29.370750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359572+0000","last_change":"2024-04-25T08:56:17.210018+0000","last_active":"2024-04-25T08:56:19.359572+0000","last_peered":"2024-04-25T08:56:19.359572+0000","last_clean":"2024-04-25T08:56:19.359572+0000","last_became_active":"2024-04-25T08:56:17.209032+0000","last_became_peered":"2024-04-25T08:56:17.209032+0000","last_unstale":"2024-04-25T08:56:19.359572+0000","last_undegraded":"2024-04-25T08:56:19.359572+0000","last_fullsized":"2024-04-25T08:56:19.359572+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:32.077700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359440+0000","last_change":"2024-04-25T08:56:18.223451+0000","last_active":"2024-04-25T08:56:19.359440+0000","last_peered":"2024-04-25T08:56:19.359440+0000","last_clean":"2024-04-25T08:56:19.359440+0000","last_became_active":"2024-04-25T08:56:18.223100+0000","last_became_peered":"2024-04-25T08:56:18.223100+0000","last_unstale":"2024-04-25T08:56:19.359440+0000","last_undegraded":"2024-04-25T08:56:19.359440+0000","last_fullsized":"2024-04-25T08:56:19.359440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.388864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215475+0000","last_change":"2024-04-25T08:56:17.208994+0000","last_active":"2024-04-25T08:56:18.215475+0000","last_peered":"2024-04-25T08:56:18.215475+0000","last_clean":"2024-04-25T08:56:18.215475+0000","last_became_active":"2024-04-25T08:56:17.208669+0000","last_became_peered":"2024-04-25T08:56:17.208669+0000","last_unstale":"2024-04-25T08:56:18.215475+0000","last_undegraded":"2024-04-25T08:56:18.215475+0000","last_fullsized":"2024-04-25T08:56:18.215475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:56.789554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195704+0000","last_change":"2024-04-25T08:56:18.210662+0000","last_active":"2024-04-25T08:56:19.195704+0000","last_peered":"2024-04-25T08:56:19.195704+0000","last_clean":"2024-04-25T08:56:19.195704+0000","last_became_active":"2024-04-25T08:56:18.210316+0000","last_became_peered":"2024-04-25T08:56:18.210316+0000","last_unstale":"2024-04-25T08:56:19.195704+0000","last_undegraded":"2024-04-25T08:56:19.195704+0000","last_fullsized":"2024-04-25T08:56:19.195704+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:51.409173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.212560+0000","last_change":"2024-04-25T08:56:17.217874+0000","last_active":"2024-04-25T08:56:18.212560+0000","last_peered":"2024-04-25T08:56:18.212560+0000","last_clean":"2024-04-25T08:56:18.212560+0000","last_became_active":"2024-04-25T08:56:17.217659+0000","last_became_peered":"2024-04-25T08:56:17.217659+0000","last_unstale":"2024-04-25T08:56:18.212560+0000","last_undegraded":"2024-04-25T08:56:18.212560+0000","last_fullsized":"2024-04-25T08:56:18.212560+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:53.854649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196361+0000","last_change":"2024-04-25T08:56:18.221070+0000","last_active":"2024-04-25T08:56:19.196361+0000","last_peered":"2024-04-25T08:56:19.196361+0000","last_clean":"2024-04-25T08:56:19.196361+0000","last_became_active":"2024-04-25T08:56:18.220788+0000","last_became_peered":"2024-04-25T08:56:18.220788+0000","last_unstale":"2024-04-25T08:56:19.196361+0000","last_undegraded":"2024-04-25T08:56:19.196361+0000","last_fullsized":"2024-04-25T08:56:19.196361+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:41.014505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359314+0000","last_change":"2024-04-25T08:56:17.208139+0000","last_active":"2024-04-25T08:56:19.359314+0000","last_peered":"2024-04-25T08:56:19.359314+0000","last_clean":"2024-04-25T08:56:19.359314+0000","last_became_active":"2024-04-25T08:56:17.207843+0000","last_became_peered":"2024-04-25T08:56:17.207843+0000","last_unstale":"2024-04-25T08:56:19.359314+0000","last_undegraded":"2024-04-25T08:56:19.359314+0000","last_fullsized":"2024-04-25T08:56:19.359314+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:56.789554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196397+0000","last_change":"2024-04-25T08:56:18.210083+0000","last_active":"2024-04-25T08:56:19.196397+0000","last_peered":"2024-04-25T08:56:19.196397+0000","last_clean":"2024-04-25T08:56:19.196397+0000","last_became_active":"2024-04-25T08:56:18.209783+0000","last_became_peered":"2024-04-25T08:56:18.209783+0000","last_unstale":"2024-04-25T08:56:19.196397+0000","last_undegraded":"2024-04-25T08:56:19.196397+0000","last_fullsized":"2024-04-25T08:56:19.196397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:10.794882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204581+0000","last_change":"2024-04-25T08:56:17.211340+0000","last_active":"2024-04-25T08:56:18.204581+0000","last_peered":"2024-04-25T08:56:18.204581+0000","last_clean":"2024-04-25T08:56:18.204581+0000","last_became_active":"2024-04-25T08:56:17.211002+0000","last_became_peered":"2024-04-25T08:56:17.211002+0000","last_unstale":"2024-04-25T08:56:18.204581+0000","last_undegraded":"2024-04-25T08:56:18.204581+0000","last_fullsized":"2024-04-25T08:56:18.204581+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:59.690478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195577+0000","last_change":"2024-04-25T08:56:18.205814+0000","last_active":"2024-04-25T08:56:19.195577+0000","last_peered":"2024-04-25T08:56:19.195577+0000","last_clean":"2024-04-25T08:56:19.195577+0000","last_became_active":"2024-04-25T08:56:18.205528+0000","last_became_peered":"2024-04-25T08:56:18.205528+0000","last_unstale":"2024-04-25T08:56:19.195577+0000","last_undegraded":"2024-04-25T08:56:19.195577+0000","last_fullsized":"2024-04-25T08:56:19.195577+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:07.023502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.194961+0000","last_change":"2024-04-25T08:56:17.207453+0000","last_active":"2024-04-25T08:56:18.194961+0000","last_peered":"2024-04-25T08:56:18.194961+0000","last_clean":"2024-04-25T08:56:18.194961+0000","last_became_active":"2024-04-25T08:56:17.207230+0000","last_became_peered":"2024-04-25T08:56:17.207230+0000","last_unstale":"2024-04-25T08:56:18.194961+0000","last_undegraded":"2024-04-25T08:56:18.194961+0000","last_fullsized":"2024-04-25T08:56:18.194961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:50.902995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.218097+0000","last_change":"2024-04-25T08:56:18.216487+0000","last_active":"2024-04-25T08:56:18.218097+0000","last_peered":"2024-04-25T08:56:18.218097+0000","last_clean":"2024-04-25T08:56:18.218097+0000","last_became_active":"2024-04-25T08:56:18.215687+0000","last_became_peered":"2024-04-25T08:56:18.215687+0000","last_unstale":"2024-04-25T08:56:18.218097+0000","last_undegraded":"2024-04-25T08:56:18.218097+0000","last_fullsized":"2024-04-25T08:56:18.218097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:12.416991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481604+0000","last_change":"2024-04-25T08:56:17.202622+0000","last_active":"2024-04-25T08:56:19.481604+0000","last_peered":"2024-04-25T08:56:19.481604+0000","last_clean":"2024-04-25T08:56:19.481604+0000","last_became_active":"2024-04-25T08:56:17.202334+0000","last_became_peered":"2024-04-25T08:56:17.202334+0000","last_unstale":"2024-04-25T08:56:19.481604+0000","last_undegraded":"2024-04-25T08:56:19.481604+0000","last_fullsized":"2024-04-25T08:56:19.481604+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.248690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481627+0000","last_change":"2024-04-25T08:56:18.223478+0000","last_active":"2024-04-25T08:56:19.481627+0000","last_peered":"2024-04-25T08:56:19.481627+0000","last_clean":"2024-04-25T08:56:19.481627+0000","last_became_active":"2024-04-25T08:56:18.223262+0000","last_became_peered":"2024-04-25T08:56:18.223262+0000","last_unstale":"2024-04-25T08:56:19.481627+0000","last_undegraded":"2024-04-25T08:56:19.481627+0000","last_fullsized":"2024-04-25T08:56:19.481627+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:47.361388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196303+0000","last_change":"2024-04-25T08:56:17.218177+0000","last_active":"2024-04-25T08:56:19.196303+0000","last_peered":"2024-04-25T08:56:19.196303+0000","last_clean":"2024-04-25T08:56:19.196303+0000","last_became_active":"2024-04-25T08:56:17.217859+0000","last_became_peered":"2024-04-25T08:56:17.217859+0000","last_unstale":"2024-04-25T08:56:19.196303+0000","last_undegraded":"2024-04-25T08:56:19.196303+0000","last_fullsized":"2024-04-25T08:56:19.196303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:01.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481558+0000","last_change":"2024-04-25T08:56:17.209000+0000","last_active":"2024-04-25T08:56:19.481558+0000","last_peered":"2024-04-25T08:56:19.481558+0000","last_clean":"2024-04-25T08:56:19.481558+0000","last_became_active":"2024-04-25T08:56:17.208727+0000","last_became_peered":"2024-04-25T08:56:17.208727+0000","last_unstale":"2024-04-25T08:56:19.481558+0000","last_undegraded":"2024-04-25T08:56:19.481558+0000","last_fullsized":"2024-04-25T08:56:19.481558+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:50.271504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481437+0000","last_change":"2024-04-25T08:56:18.220854+0000","last_active":"2024-04-25T08:56:19.481437+0000","last_peered":"2024-04-25T08:56:19.481437+0000","last_clean":"2024-04-25T08:56:19.481437+0000","last_became_active":"2024-04-25T08:56:18.220406+0000","last_became_peered":"2024-04-25T08:56:18.220406+0000","last_unstale":"2024-04-25T08:56:19.481437+0000","last_undegraded":"2024-04-25T08:56:19.481437+0000","last_fullsized":"2024-04-25T08:56:19.481437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:10.524577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.233028+0000","last_change":"2024-04-25T08:56:17.199981+0000","last_active":"2024-04-25T08:56:18.233028+0000","last_peered":"2024-04-25T08:56:18.233028+0000","last_clean":"2024-04-25T08:56:18.233028+0000","last_became_active":"2024-04-25T08:56:17.199667+0000","last_became_peered":"2024-04-25T08:56:17.199667+0000","last_unstale":"2024-04-25T08:56:18.233028+0000","last_undegraded":"2024-04-25T08:56:18.233028+0000","last_fullsized":"2024-04-25T08:56:18.233028+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:19.999889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.225164+0000","last_change":"2024-04-25T08:56:18.221416+0000","last_active":"2024-04-25T08:56:18.225164+0000","last_peered":"2024-04-25T08:56:18.225164+0000","last_clean":"2024-04-25T08:56:18.225164+0000","last_became_active":"2024-04-25T08:56:18.221196+0000","last_became_peered":"2024-04-25T08:56:18.221196+0000","last_unstale":"2024-04-25T08:56:18.225164+0000","last_undegraded":"2024-04-25T08:56:18.225164+0000","last_fullsized":"2024-04-25T08:56:18.225164+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:02.980311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196227+0000","last_change":"2024-04-25T08:56:17.218664+0000","last_active":"2024-04-25T08:56:19.196227+0000","last_peered":"2024-04-25T08:56:19.196227+0000","last_clean":"2024-04-25T08:56:19.196227+0000","last_became_active":"2024-04-25T08:56:17.218365+0000","last_became_peered":"2024-04-25T08:56:17.218365+0000","last_unstale":"2024-04-25T08:56:19.196227+0000","last_undegraded":"2024-04-25T08:56:19.196227+0000","last_fullsized":"2024-04-25T08:56:19.196227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:39.098749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481296+0000","last_change":"2024-04-25T08:56:18.212351+0000","last_active":"2024-04-25T08:56:19.481296+0000","last_peered":"2024-04-25T08:56:19.481296+0000","last_clean":"2024-04-25T08:56:19.481296+0000","last_became_active":"2024-04-25T08:56:18.212075+0000","last_became_peered":"2024-04-25T08:56:18.212075+0000","last_unstale":"2024-04-25T08:56:19.481296+0000","last_undegraded":"2024-04-25T08:56:19.481296+0000","last_fullsized":"2024-04-25T08:56:19.481296+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196473+0000","last_change":"2024-04-25T08:56:17.200568+0000","last_active":"2024-04-25T08:56:19.196473+0000","last_peered":"2024-04-25T08:56:19.196473+0000","last_clean":"2024-04-25T08:56:19.196473+0000","last_became_active":"2024-04-25T08:56:17.200242+0000","last_became_peered":"2024-04-25T08:56:17.200242+0000","last_unstale":"2024-04-25T08:56:19.196473+0000","last_undegraded":"2024-04-25T08:56:19.196473+0000","last_fullsized":"2024-04-25T08:56:19.196473+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:57.237578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215172+0000","last_change":"2024-04-25T08:56:18.213076+0000","last_active":"2024-04-25T08:56:18.215172+0000","last_peered":"2024-04-25T08:56:18.215172+0000","last_clean":"2024-04-25T08:56:18.215172+0000","last_became_active":"2024-04-25T08:56:18.212746+0000","last_became_peered":"2024-04-25T08:56:18.212746+0000","last_unstale":"2024-04-25T08:56:18.215172+0000","last_undegraded":"2024-04-25T08:56:18.215172+0000","last_fullsized":"2024-04-25T08:56:18.215172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:22.026643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204803+0000","last_change":"2024-04-25T08:56:17.209077+0000","last_active":"2024-04-25T08:56:18.204803+0000","last_peered":"2024-04-25T08:56:18.204803+0000","last_clean":"2024-04-25T08:56:18.204803+0000","last_became_active":"2024-04-25T08:56:17.208079+0000","last_became_peered":"2024-04-25T08:56:17.208079+0000","last_unstale":"2024-04-25T08:56:18.204803+0000","last_undegraded":"2024-04-25T08:56:18.204803+0000","last_fullsized":"2024-04-25T08:56:18.204803+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:11.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481202+0000","last_change":"2024-04-25T08:56:18.223135+0000","last_active":"2024-04-25T08:56:19.481202+0000","last_peered":"2024-04-25T08:56:19.481202+0000","last_clean":"2024-04-25T08:56:19.481202+0000","last_became_active":"2024-04-25T08:56:18.222867+0000","last_became_peered":"2024-04-25T08:56:18.222867+0000","last_unstale":"2024-04-25T08:56:19.481202+0000","last_undegraded":"2024-04-25T08:56:19.481202+0000","last_fullsized":"2024-04-25T08:56:19.481202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:18.749861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481015+0000","last_change":"2024-04-25T08:56:17.209066+0000","last_active":"2024-04-25T08:56:19.481015+0000","last_peered":"2024-04-25T08:56:19.481015+0000","last_clean":"2024-04-25T08:56:19.481015+0000","last_became_active":"2024-04-25T08:56:17.208841+0000","last_became_peered":"2024-04-25T08:56:17.208841+0000","last_unstale":"2024-04-25T08:56:19.481015+0000","last_undegraded":"2024-04-25T08:56:19.481015+0000","last_fullsized":"2024-04-25T08:56:19.481015+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:21.082806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481564+0000","last_change":"2024-04-25T08:56:18.215974+0000","last_active":"2024-04-25T08:56:19.481564+0000","last_peered":"2024-04-25T08:56:19.481564+0000","last_clean":"2024-04-25T08:56:19.481564+0000","last_became_active":"2024-04-25T08:56:18.215532+0000","last_became_peered":"2024-04-25T08:56:18.215532+0000","last_unstale":"2024-04-25T08:56:19.481564+0000","last_undegraded":"2024-04-25T08:56:19.481564+0000","last_fullsized":"2024-04-25T08:56:19.481564+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:29.370750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196574+0000","last_change":"2024-04-25T08:56:17.218282+0000","last_active":"2024-04-25T08:56:19.196574+0000","last_peered":"2024-04-25T08:56:19.196574+0000","last_clean":"2024-04-25T08:56:19.196574+0000","last_became_active":"2024-04-25T08:56:17.217970+0000","last_became_peered":"2024-04-25T08:56:17.217970+0000","last_unstale":"2024-04-25T08:56:19.196574+0000","last_undegraded":"2024-04-25T08:56:19.196574+0000","last_fullsized":"2024-04-25T08:56:19.196574+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:57.959960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.225552+0000","last_change":"2024-04-25T08:56:18.222912+0000","last_active":"2024-04-25T08:56:18.225552+0000","last_peered":"2024-04-25T08:56:18.225552+0000","last_clean":"2024-04-25T08:56:18.225552+0000","last_became_active":"2024-04-25T08:56:18.222609+0000","last_became_peered":"2024-04-25T08:56:18.222609+0000","last_unstale":"2024-04-25T08:56:18.225552+0000","last_undegraded":"2024-04-25T08:56:18.225552+0000","last_fullsized":"2024-04-25T08:56:18.225552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:36.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359576+0000","last_change":"2024-04-25T08:56:17.217247+0000","last_active":"2024-04-25T08:56:19.359576+0000","last_peered":"2024-04-25T08:56:19.359576+0000","last_clean":"2024-04-25T08:56:19.359576+0000","last_became_active":"2024-04-25T08:56:17.216896+0000","last_became_peered":"2024-04-25T08:56:17.216896+0000","last_unstale":"2024-04-25T08:56:19.359576+0000","last_undegraded":"2024-04-25T08:56:19.359576+0000","last_fullsized":"2024-04-25T08:56:19.359576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:11.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196124+0000","last_change":"2024-04-25T08:56:18.202536+0000","last_active":"2024-04-25T08:56:19.196124+0000","last_peered":"2024-04-25T08:56:19.196124+0000","last_clean":"2024-04-25T08:56:19.196124+0000","last_became_active":"2024-04-25T08:56:18.202235+0000","last_became_peered":"2024-04-25T08:56:18.202235+0000","last_unstale":"2024-04-25T08:56:19.196124+0000","last_undegraded":"2024-04-25T08:56:19.196124+0000","last_fullsized":"2024-04-25T08:56:19.196124+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:32.018334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215666+0000","last_change":"2024-04-25T08:56:17.205551+0000","last_active":"2024-04-25T08:56:18.215666+0000","last_peered":"2024-04-25T08:56:18.215666+0000","last_clean":"2024-04-25T08:56:18.215666+0000","last_became_active":"2024-04-25T08:56:17.205230+0000","last_became_peered":"2024-04-25T08:56:17.205230+0000","last_unstale":"2024-04-25T08:56:18.215666+0000","last_undegraded":"2024-04-25T08:56:18.215666+0000","last_fullsized":"2024-04-25T08:56:18.215666+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:20.992044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481566+0000","last_change":"2024-04-25T08:56:18.220992+0000","last_active":"2024-04-25T08:56:19.481566+0000","last_peered":"2024-04-25T08:56:19.481566+0000","last_clean":"2024-04-25T08:56:19.481566+0000","last_became_active":"2024-04-25T08:56:18.220716+0000","last_became_peered":"2024-04-25T08:56:18.220716+0000","last_unstale":"2024-04-25T08:56:19.481566+0000","last_undegraded":"2024-04-25T08:56:19.481566+0000","last_fullsized":"2024-04-25T08:56:19.481566+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:53.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359615+0000","last_change":"2024-04-25T08:56:17.207716+0000","last_active":"2024-04-25T08:56:19.359615+0000","last_peered":"2024-04-25T08:56:19.359615+0000","last_clean":"2024-04-25T08:56:19.359615+0000","last_became_active":"2024-04-25T08:56:17.207377+0000","last_became_peered":"2024-04-25T08:56:17.207377+0000","last_unstale":"2024-04-25T08:56:19.359615+0000","last_undegraded":"2024-04-25T08:56:19.359615+0000","last_fullsized":"2024-04-25T08:56:19.359615+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:59.690478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222580+0000","last_change":"2024-04-25T08:56:18.214828+0000","last_active":"2024-04-25T08:56:18.222580+0000","last_peered":"2024-04-25T08:56:18.222580+0000","last_clean":"2024-04-25T08:56:18.222580+0000","last_became_active":"2024-04-25T08:56:18.214546+0000","last_became_peered":"2024-04-25T08:56:18.214546+0000","last_unstale":"2024-04-25T08:56:18.222580+0000","last_undegraded":"2024-04-25T08:56:18.222580+0000","last_fullsized":"2024-04-25T08:56:18.222580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:44.082766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196468+0000","last_change":"2024-04-25T08:56:17.211265+0000","last_active":"2024-04-25T08:56:19.196468+0000","last_peered":"2024-04-25T08:56:19.196468+0000","last_clean":"2024-04-25T08:56:19.196468+0000","last_became_active":"2024-04-25T08:56:17.210943+0000","last_became_peered":"2024-04-25T08:56:17.210943+0000","last_unstale":"2024-04-25T08:56:19.196468+0000","last_undegraded":"2024-04-25T08:56:19.196468+0000","last_fullsized":"2024-04-25T08:56:19.196468+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:35.063530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359715+0000","last_change":"2024-04-25T08:56:18.218361+0000","last_active":"2024-04-25T08:56:19.359715+0000","last_peered":"2024-04-25T08:56:19.359715+0000","last_clean":"2024-04-25T08:56:19.359715+0000","last_became_active":"2024-04-25T08:56:18.218070+0000","last_became_peered":"2024-04-25T08:56:18.218070+0000","last_unstale":"2024-04-25T08:56:19.359715+0000","last_undegraded":"2024-04-25T08:56:19.359715+0000","last_fullsized":"2024-04-25T08:56:19.359715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:07.045007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.190673+0000","last_change":"2024-04-25T08:56:16.190673+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.190673+0000","last_undegraded":"2024-04-25T08:56:16.190673+0000","last_fullsized":"2024-04-25T08:56:16.190673+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359223+0000","last_change":"2024-04-25T08:56:18.218040+0000","last_active":"2024-04-25T08:56:19.359223+0000","last_peered":"2024-04-25T08:56:19.359223+0000","last_clean":"2024-04-25T08:56:19.359223+0000","last_became_active":"2024-04-25T08:56:18.217711+0000","last_became_peered":"2024-04-25T08:56:18.217711+0000","last_unstale":"2024-04-25T08:56:19.359223+0000","last_undegraded":"2024-04-25T08:56:19.359223+0000","last_fullsized":"2024-04-25T08:56:19.359223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:34:03.547004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204576+0000","last_change":"2024-04-25T08:56:17.210094+0000","last_active":"2024-04-25T08:56:18.204576+0000","last_peered":"2024-04-25T08:56:18.204576+0000","last_clean":"2024-04-25T08:56:18.204576+0000","last_became_active":"2024-04-25T08:56:17.209773+0000","last_became_peered":"2024-04-25T08:56:17.209773+0000","last_unstale":"2024-04-25T08:56:18.204576+0000","last_undegraded":"2024-04-25T08:56:18.204576+0000","last_fullsized":"2024-04-25T08:56:18.204576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.024118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222599+0000","last_change":"2024-04-25T08:56:18.215521+0000","last_active":"2024-04-25T08:56:18.222599+0000","last_peered":"2024-04-25T08:56:18.222599+0000","last_clean":"2024-04-25T08:56:18.222599+0000","last_became_active":"2024-04-25T08:56:18.215222+0000","last_became_peered":"2024-04-25T08:56:18.215222+0000","last_unstale":"2024-04-25T08:56:18.222599+0000","last_undegraded":"2024-04-25T08:56:18.222599+0000","last_fullsized":"2024-04-25T08:56:18.222599+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:40.101275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.189457+0000","last_change":"2024-04-25T08:56:16.189457+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.189457+0000","last_undegraded":"2024-04-25T08:56:16.189457+0000","last_fullsized":"2024-04-25T08:56:16.189457+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222791+0000","last_change":"2024-04-25T08:56:18.213570+0000","last_active":"2024-04-25T08:56:18.222791+0000","last_peered":"2024-04-25T08:56:18.222791+0000","last_clean":"2024-04-25T08:56:18.222791+0000","last_became_active":"2024-04-25T08:56:18.212104+0000","last_became_peered":"2024-04-25T08:56:18.212104+0000","last_unstale":"2024-04-25T08:56:18.222791+0000","last_undegraded":"2024-04-25T08:56:18.222791+0000","last_fullsized":"2024-04-25T08:56:18.222791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:26.179109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359605+0000","last_change":"2024-04-25T08:56:17.208227+0000","last_active":"2024-04-25T08:56:19.359605+0000","last_peered":"2024-04-25T08:56:19.359605+0000","last_clean":"2024-04-25T08:56:19.359605+0000","last_became_active":"2024-04-25T08:56:17.207936+0000","last_became_peered":"2024-04-25T08:56:17.207936+0000","last_unstale":"2024-04-25T08:56:19.359605+0000","last_undegraded":"2024-04-25T08:56:19.359605+0000","last_fullsized":"2024-04-25T08:56:19.359605+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:20.992044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196657+0000","last_change":"2024-04-25T08:56:17.199076+0000","last_active":"2024-04-25T08:56:19.196657+0000","last_peered":"2024-04-25T08:56:19.196657+0000","last_clean":"2024-04-25T08:56:19.196657+0000","last_became_active":"2024-04-25T08:56:17.198759+0000","last_became_peered":"2024-04-25T08:56:17.198759+0000","last_unstale":"2024-04-25T08:56:19.196657+0000","last_undegraded":"2024-04-25T08:56:19.196657+0000","last_fullsized":"2024-04-25T08:56:19.196657+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:35.077938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359501+0000","last_change":"2024-04-25T08:56:18.223807+0000","last_active":"2024-04-25T08:56:19.359501+0000","last_peered":"2024-04-25T08:56:19.359501+0000","last_clean":"2024-04-25T08:56:19.359501+0000","last_became_active":"2024-04-25T08:56:18.223515+0000","last_became_peered":"2024-04-25T08:56:18.223515+0000","last_unstale":"2024-04-25T08:56:19.359501+0000","last_undegraded":"2024-04-25T08:56:19.359501+0000","last_fullsized":"2024-04-25T08:56:19.359501+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:57.277364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.205872+0000","last_change":"2024-04-25T08:56:17.208356+0000","last_active":"2024-04-25T08:56:18.205872+0000","last_peered":"2024-04-25T08:56:18.205872+0000","last_clean":"2024-04-25T08:56:18.205872+0000","last_became_active":"2024-04-25T08:56:17.208086+0000","last_became_peered":"2024-04-25T08:56:17.208086+0000","last_unstale":"2024-04-25T08:56:18.205872+0000","last_undegraded":"2024-04-25T08:56:18.205872+0000","last_fullsized":"2024-04-25T08:56:18.205872+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:32.077700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195840+0000","last_change":"2024-04-25T08:56:18.207334+0000","last_active":"2024-04-25T08:56:19.195840+0000","last_peered":"2024-04-25T08:56:19.195840+0000","last_clean":"2024-04-25T08:56:19.195840+0000","last_became_active":"2024-04-25T08:56:18.206799+0000","last_became_peered":"2024-04-25T08:56:18.206799+0000","last_unstale":"2024-04-25T08:56:19.195840+0000","last_undegraded":"2024-04-25T08:56:19.195840+0000","last_fullsized":"2024-04-25T08:56:19.195840+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:11.835152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.189157+0000","last_change":"2024-04-25T08:56:16.189157+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.189157+0000","last_undegraded":"2024-04-25T08:56:16.189157+0000","last_fullsized":"2024-04-25T08:56:16.189157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481425+0000","last_change":"2024-04-25T08:56:18.222650+0000","last_active":"2024-04-25T08:56:19.481425+0000","last_peered":"2024-04-25T08:56:19.481425+0000","last_clean":"2024-04-25T08:56:19.481425+0000","last_became_active":"2024-04-25T08:56:18.222247+0000","last_became_peered":"2024-04-25T08:56:18.222247+0000","last_unstale":"2024-04-25T08:56:19.481425+0000","last_undegraded":"2024-04-25T08:56:19.481425+0000","last_fullsized":"2024-04-25T08:56:19.481425+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.196651+0000","last_change":"2024-04-25T08:56:17.202547+0000","last_active":"2024-04-25T08:56:18.196651+0000","last_peered":"2024-04-25T08:56:18.196651+0000","last_clean":"2024-04-25T08:56:18.196651+0000","last_became_active":"2024-04-25T08:56:17.202228+0000","last_became_peered":"2024-04-25T08:56:17.202228+0000","last_unstale":"2024-04-25T08:56:18.196651+0000","last_undegraded":"2024-04-25T08:56:18.196651+0000","last_fullsized":"2024-04-25T08:56:18.196651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:21.082806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.189131+0000","last_change":"2024-04-25T08:56:16.189131+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.189131+0000","last_undegraded":"2024-04-25T08:56:16.189131+0000","last_fullsized":"2024-04-25T08:56:16.189131+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195622+0000","last_change":"2024-04-25T08:56:18.206772+0000","last_active":"2024-04-25T08:56:19.195622+0000","last_peered":"2024-04-25T08:56:19.195622+0000","last_clean":"2024-04-25T08:56:19.195622+0000","last_became_active":"2024-04-25T08:56:18.206478+0000","last_became_peered":"2024-04-25T08:56:18.206478+0000","last_unstale":"2024-04-25T08:56:19.195622+0000","last_undegraded":"2024-04-25T08:56:19.195622+0000","last_fullsized":"2024-04-25T08:56:19.195622+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:38.623368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195622+0000","last_change":"2024-04-25T08:56:17.212487+0000","last_active":"2024-04-25T08:56:19.195622+0000","last_peered":"2024-04-25T08:56:19.195622+0000","last_clean":"2024-04-25T08:56:19.195622+0000","last_became_active":"2024-04-25T08:56:17.212169+0000","last_became_peered":"2024-04-25T08:56:17.212169+0000","last_unstale":"2024-04-25T08:56:19.195622+0000","last_undegraded":"2024-04-25T08:56:19.195622+0000","last_fullsized":"2024-04-25T08:56:19.195622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:54.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195510+0000","last_change":"2024-04-25T08:56:18.217388+0000","last_active":"2024-04-25T08:56:19.195510+0000","last_peered":"2024-04-25T08:56:19.195510+0000","last_clean":"2024-04-25T08:56:19.195510+0000","last_became_active":"2024-04-25T08:56:18.217118+0000","last_became_peered":"2024-04-25T08:56:18.217118+0000","last_unstale":"2024-04-25T08:56:19.195510+0000","last_undegraded":"2024-04-25T08:56:19.195510+0000","last_fullsized":"2024-04-25T08:56:19.195510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:55.113303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196321+0000","last_change":"2024-04-25T08:56:17.210100+0000","last_active":"2024-04-25T08:56:19.196321+0000","last_peered":"2024-04-25T08:56:19.196321+0000","last_clean":"2024-04-25T08:56:19.196321+0000","last_became_active":"2024-04-25T08:56:17.209722+0000","last_became_peered":"2024-04-25T08:56:17.209722+0000","last_unstale":"2024-04-25T08:56:19.196321+0000","last_undegraded":"2024-04-25T08:56:19.196321+0000","last_fullsized":"2024-04-25T08:56:19.196321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:35.041624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":240,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.480994+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:56:19.480994+0000","last_peered":"2024-04-25T08:56:19.480994+0000","last_clean":"2024-04-25T08:56:19.480994+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:56:19.480994+0000","last_undegraded":"2024-04-25T08:56:19.480994+0000","last_fullsized":"2024-04-25T08:56:19.480994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28308,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343532,"statfs":{"total":96636764160,"available":96607776768,"internally_reserved":0,"allocated":1314816,"data_stored":884994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":712704,"data_stored":294466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":295118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":724992,"data_stored":296078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":300822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":300822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1323008,"data_stored":887028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":688128,"data_stored":281424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:56:21.196 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:56:21.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.344+0000 7f6222e38640 1 Processor -- start 2024-04-25T08:56:21.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.344+0000 7f6222e38640 1 -- start start 2024-04-25T08:56:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f6222e38640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f621c15ec10 0x7f621c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f6222e38640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f621c06e1b0 0x7f621c0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f6222e38640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621c06e6c0 con 0x7f621c0b3580 2024-04-25T08:56:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f6222e38640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621c06f2d0 con 0x7f621c15ec10 2024-04-25T08:56:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f6222e38640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c06e9a0 con 0x7f621c06e1b0 2024-04-25T08:56:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f6220bd4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f621c15ec10 0x7f621c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f62213d5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f621c0b3580 0x7f621c1616d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37530/0 (socket says 172.21.15.55:37530) 2024-04-25T08:56:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f62213d5640 1 -- 172.21.15.55:0/3146083245 learned_addr learned my addr 172.21.15.55:0/3146083245 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f621bfff640 1 --2- 172.21.15.55:0/3146083245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f621c06e1b0 0x7f621c0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f6220bd4640 1 -- 172.21.15.55:0/3146083245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f621c06e1b0 msgr2=0x7f621c0b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f6220bd4640 1 --2- 172.21.15.55:0/3146083245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f621c06e1b0 0x7f621c0b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f6220bd4640 1 -- 172.21.15.55:0/3146083245 >> v1:172.21.15.55:6789/0 conn(0x7f621c0b3580 legacy=0x7f621c1616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f621b7fe640 1 -- 172.21.15.55:0/3146083245 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115543421 0 0) 0x7f621c06e6c0 con 0x7f621c0b3580 2024-04-25T08:56:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f6220bd4640 1 -- 172.21.15.55:0/3146083245 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c06ec80 con 0x7f621c15ec10 2024-04-25T08:56:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.345+0000 7f621bfff640 1 --2- 172.21.15.55:0/3146083245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f621c06e1b0 0x7f621c0b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:21.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.346+0000 7f6220bd4640 1 --2- 172.21.15.55:0/3146083245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f621c15ec10 0x7f621c06dc70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f62100097d0 tx=0x7f621002a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159a23929ec297a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.346+0000 7f621b7fe640 1 -- 172.21.15.55:0/3146083245 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210037070 con 0x7f621c15ec10 2024-04-25T08:56:21.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.346+0000 7f621b7fe640 1 -- 172.21.15.55:0/3146083245 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621002adb0 con 0x7f621c15ec10 2024-04-25T08:56:21.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.346+0000 7f621b7fe640 1 -- 172.21.15.55:0/3146083245 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210032660 con 0x7f621c15ec10 2024-04-25T08:56:21.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.347+0000 7f6222e38640 1 -- 172.21.15.55:0/3146083245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f621c15ec10 msgr2=0x7f621c06dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.347+0000 7f6222e38640 1 --2- 172.21.15.55:0/3146083245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f621c15ec10 0x7f621c06dc70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f62100097d0 tx=0x7f621002a0a0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.347+0000 7f6222e38640 1 -- 172.21.15.55:0/3146083245 shutdown_connections 2024-04-25T08:56:21.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.347+0000 7f6222e38640 1 --2- 172.21.15.55:0/3146083245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f621c06e1b0 0x7f621c0b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.347+0000 7f6222e38640 1 --2- 172.21.15.55:0/3146083245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f621c15ec10 0x7f621c06dc70 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.347+0000 7f6222e38640 1 -- 172.21.15.55:0/3146083245 >> 172.21.15.55:0/3146083245 conn(0x7f621c0b2220 msgr2=0x7f621c0cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.347+0000 7f6222e38640 1 -- 172.21.15.55:0/3146083245 shutdown_connections 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.347+0000 7f6222e38640 1 -- 172.21.15.55:0/3146083245 wait complete. 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.348+0000 7f6222e38640 1 Processor -- start 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.348+0000 7f6222e38640 1 -- start start 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6222e38640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f621c06e1b0 0x7f621c14f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6222e38640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f621c0b3580 0x7f621c14da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6222e38640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f621c15ec10 0x7f621c1503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6222e38640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c15e2e0 con 0x7f621c06e1b0 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6222e38640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c15eff0 con 0x7f621c15ec10 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6222e38640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c15e460 con 0x7f621c0b3580 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6220bd4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f621c06e1b0 0x7f621c14f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6220bd4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f621c06e1b0 0x7f621c14f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39166/0 (socket says 172.21.15.55:39166) 2024-04-25T08:56:21.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6220bd4640 1 -- 172.21.15.55:0/4130377265 learned_addr learned my addr 172.21.15.55:0/4130377265 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f62213d5640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f621c15ec10 0x7f621c1503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f621bfff640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f621c0b3580 0x7f621c14da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6220bd4640 1 -- 172.21.15.55:0/4130377265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f621c0b3580 msgr2=0x7f621c14da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6220bd4640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f621c0b3580 0x7f621c14da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6220bd4640 1 -- 172.21.15.55:0/4130377265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f621c15ec10 msgr2=0x7f621c1503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6220bd4640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f621c15ec10 0x7f621c1503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6220bd4640 1 -- 172.21.15.55:0/4130377265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c150920 con 0x7f621c06e1b0 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.349+0000 7f6220bd4640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f621c06e1b0 0x7f621c14f000 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6210035040 tx=0x7f62100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.350+0000 7f62197fa640 1 -- 172.21.15.55:0/4130377265 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210041070 con 0x7f621c06e1b0 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.350+0000 7f62197fa640 1 -- 172.21.15.55:0/4130377265 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621003c670 con 0x7f621c06e1b0 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.350+0000 7f62197fa640 1 -- 172.21.15.55:0/4130377265 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210037040 con 0x7f621c06e1b0 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.350+0000 7f6222e38640 1 -- 172.21.15.55:0/4130377265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c14f5f0 con 0x7f621c06e1b0 2024-04-25T08:56:21.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.350+0000 7f6222e38640 1 -- 172.21.15.55:0/4130377265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c14fbb0 con 0x7f621c06e1b0 2024-04-25T08:56:21.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.351+0000 7f6222e38640 1 -- 172.21.15.55:0/4130377265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621c0749b0 con 0x7f621c06e1b0 2024-04-25T08:56:21.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.351+0000 7f62197fa640 1 -- 172.21.15.55:0/4130377265 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f621003a070 con 0x7f621c06e1b0 2024-04-25T08:56:21.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.351+0000 7f62197fa640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f620006b4d0 0x7f620006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.352+0000 7f62197fa640 1 -- 172.21.15.55:0/4130377265 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62100aa5b0 con 0x7f621c06e1b0 2024-04-25T08:56:21.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.352+0000 7f621bfff640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f620006b4d0 0x7f620006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.352+0000 7f621bfff640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f620006b4d0 0x7f620006d990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f621c161580 tx=0x7f6208008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.356+0000 7f62197fa640 1 -- 172.21.15.55:0/4130377265 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6210079430 con 0x7f621c06e1b0 2024-04-25T08:56:21.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.535+0000 7f6222e38640 1 -- 172.21.15.55:0/4130377265 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f621c157d80 con 0x7f620006b4d0 2024-04-25T08:56:21.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.541+0000 7f62197fa640 1 -- 172.21.15.55:0/4130377265 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250694 (secure 0 0 0) 0x7f621c157d80 con 0x7f620006b4d0 2024-04-25T08:56:21.533 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.544+0000 7f6222e38640 1 -- 172.21.15.55:0/4130377265 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f620006b4d0 msgr2=0x7f620006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.544+0000 7f6222e38640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f620006b4d0 0x7f620006d990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f621c161580 tx=0x7f6208008040 comp rx=0 tx=0).stop 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.544+0000 7f6222e38640 1 -- 172.21.15.55:0/4130377265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f621c06e1b0 msgr2=0x7f621c14f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.544+0000 7f6222e38640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f621c06e1b0 0x7f621c14f000 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6210035040 tx=0x7f62100046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.545+0000 7f6222e38640 1 -- 172.21.15.55:0/4130377265 shutdown_connections 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.545+0000 7f6222e38640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f620006b4d0 0x7f620006d990 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.545+0000 7f6222e38640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f621c15ec10 0x7f621c1503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.545+0000 7f6222e38640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f621c0b3580 0x7f621c14da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.545+0000 7f6222e38640 1 --2- 172.21.15.55:0/4130377265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f621c06e1b0 0x7f621c14f000 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.545+0000 7f6222e38640 1 -- 172.21.15.55:0/4130377265 >> 172.21.15.55:0/4130377265 conn(0x7f621c0b2220 msgr2=0x7f621c0cfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.545+0000 7f6222e38640 1 -- 172.21.15.55:0/4130377265 shutdown_connections 2024-04-25T08:56:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.545+0000 7f6222e38640 1 -- 172.21.15.55:0/4130377265 wait complete. 2024-04-25T08:56:21.545 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-25T08:56:20.583778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239620,"kb_used_data":6788,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735100,"statfs":{"total":773094113280,"available":772848742400,"internally_reserved":0,"allocated":6950912,"data_stored":3540752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.399277"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197228+0000","last_change":"2024-04-25T08:56:18.216097+0000","last_active":"2024-04-25T08:56:19.197228+0000","last_peered":"2024-04-25T08:56:19.197228+0000","last_clean":"2024-04-25T08:56:19.197228+0000","last_became_active":"2024-04-25T08:56:18.215813+0000","last_became_peered":"2024-04-25T08:56:18.215813+0000","last_unstale":"2024-04-25T08:56:19.197228+0000","last_undegraded":"2024-04-25T08:56:19.197228+0000","last_fullsized":"2024-04-25T08:56:19.197228+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:16.551427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196183+0000","last_change":"2024-04-25T08:56:18.216111+0000","last_active":"2024-04-25T08:56:19.196183+0000","last_peered":"2024-04-25T08:56:19.196183+0000","last_clean":"2024-04-25T08:56:19.196183+0000","last_became_active":"2024-04-25T08:56:18.215825+0000","last_became_peered":"2024-04-25T08:56:18.215825+0000","last_unstale":"2024-04-25T08:56:19.196183+0000","last_undegraded":"2024-04-25T08:56:19.196183+0000","last_fullsized":"2024-04-25T08:56:19.196183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:27.852434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481340+0000","last_change":"2024-04-25T08:56:18.216482+0000","last_active":"2024-04-25T08:56:19.481340+0000","last_peered":"2024-04-25T08:56:19.481340+0000","last_clean":"2024-04-25T08:56:19.481340+0000","last_became_active":"2024-04-25T08:56:18.216109+0000","last_became_peered":"2024-04-25T08:56:18.216109+0000","last_unstale":"2024-04-25T08:56:19.481340+0000","last_undegraded":"2024-04-25T08:56:19.481340+0000","last_fullsized":"2024-04-25T08:56:19.481340+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:34:03.547004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222711+0000","last_change":"2024-04-25T08:56:18.215504+0000","last_active":"2024-04-25T08:56:18.222711+0000","last_peered":"2024-04-25T08:56:18.222711+0000","last_clean":"2024-04-25T08:56:18.222711+0000","last_became_active":"2024-04-25T08:56:18.215231+0000","last_became_peered":"2024-04-25T08:56:18.215231+0000","last_unstale":"2024-04-25T08:56:18.222711+0000","last_undegraded":"2024-04-25T08:56:18.222711+0000","last_fullsized":"2024-04-25T08:56:18.222711+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:55.008870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196987+0000","last_change":"2024-04-25T08:56:18.215438+0000","last_active":"2024-04-25T08:56:19.196987+0000","last_peered":"2024-04-25T08:56:19.196987+0000","last_clean":"2024-04-25T08:56:19.196987+0000","last_became_active":"2024-04-25T08:56:18.215127+0000","last_became_peered":"2024-04-25T08:56:18.215127+0000","last_unstale":"2024-04-25T08:56:19.196987+0000","last_undegraded":"2024-04-25T08:56:19.196987+0000","last_fullsized":"2024-04-25T08:56:19.196987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:18.265835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359240+0000","last_change":"2024-04-25T08:56:18.219404+0000","last_active":"2024-04-25T08:56:19.359240+0000","last_peered":"2024-04-25T08:56:19.359240+0000","last_clean":"2024-04-25T08:56:19.359240+0000","last_became_active":"2024-04-25T08:56:18.219126+0000","last_became_peered":"2024-04-25T08:56:18.219126+0000","last_unstale":"2024-04-25T08:56:19.359240+0000","last_undegraded":"2024-04-25T08:56:19.359240+0000","last_fullsized":"2024-04-25T08:56:19.359240+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:10.524577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.211594+0000","last_change":"2024-04-25T08:56:18.207889+0000","last_active":"2024-04-25T08:56:18.211594+0000","last_peered":"2024-04-25T08:56:18.211594+0000","last_clean":"2024-04-25T08:56:18.211594+0000","last_became_active":"2024-04-25T08:56:18.207533+0000","last_became_peered":"2024-04-25T08:56:18.207533+0000","last_unstale":"2024-04-25T08:56:18.211594+0000","last_undegraded":"2024-04-25T08:56:18.211594+0000","last_fullsized":"2024-04-25T08:56:18.211594+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:05.251215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195447+0000","last_change":"2024-04-25T08:56:18.201722+0000","last_active":"2024-04-25T08:56:19.195447+0000","last_peered":"2024-04-25T08:56:19.195447+0000","last_clean":"2024-04-25T08:56:19.195447+0000","last_became_active":"2024-04-25T08:56:18.201409+0000","last_became_peered":"2024-04-25T08:56:18.201409+0000","last_unstale":"2024-04-25T08:56:19.195447+0000","last_undegraded":"2024-04-25T08:56:19.195447+0000","last_fullsized":"2024-04-25T08:56:19.195447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:02.179797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222016+0000","last_change":"2024-04-25T08:56:18.218239+0000","last_active":"2024-04-25T08:56:18.222016+0000","last_peered":"2024-04-25T08:56:18.222016+0000","last_clean":"2024-04-25T08:56:18.222016+0000","last_became_active":"2024-04-25T08:56:18.217954+0000","last_became_peered":"2024-04-25T08:56:18.217954+0000","last_unstale":"2024-04-25T08:56:18.222016+0000","last_undegraded":"2024-04-25T08:56:18.222016+0000","last_fullsized":"2024-04-25T08:56:18.222016+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:21.994569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.219587+0000","last_change":"2024-04-25T08:56:18.211963+0000","last_active":"2024-04-25T08:56:18.219587+0000","last_peered":"2024-04-25T08:56:18.219587+0000","last_clean":"2024-04-25T08:56:18.219587+0000","last_became_active":"2024-04-25T08:56:18.211651+0000","last_became_peered":"2024-04-25T08:56:18.211651+0000","last_unstale":"2024-04-25T08:56:18.219587+0000","last_undegraded":"2024-04-25T08:56:18.219587+0000","last_fullsized":"2024-04-25T08:56:18.219587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:13.460350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196604+0000","last_change":"2024-04-25T08:56:18.218212+0000","last_active":"2024-04-25T08:56:19.196604+0000","last_peered":"2024-04-25T08:56:19.196604+0000","last_clean":"2024-04-25T08:56:19.196604+0000","last_became_active":"2024-04-25T08:56:18.217523+0000","last_became_peered":"2024-04-25T08:56:18.217523+0000","last_unstale":"2024-04-25T08:56:19.196604+0000","last_undegraded":"2024-04-25T08:56:19.196604+0000","last_fullsized":"2024-04-25T08:56:19.196604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:12.024798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.212508+0000","last_change":"2024-04-25T08:56:18.210940+0000","last_active":"2024-04-25T08:56:18.212508+0000","last_peered":"2024-04-25T08:56:18.212508+0000","last_clean":"2024-04-25T08:56:18.212508+0000","last_became_active":"2024-04-25T08:56:18.210548+0000","last_became_peered":"2024-04-25T08:56:18.210548+0000","last_unstale":"2024-04-25T08:56:18.212508+0000","last_undegraded":"2024-04-25T08:56:18.212508+0000","last_fullsized":"2024-04-25T08:56:18.212508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:51.274029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.216299+0000","last_change":"2024-04-25T08:56:18.215336+0000","last_active":"2024-04-25T08:56:18.216299+0000","last_peered":"2024-04-25T08:56:18.216299+0000","last_clean":"2024-04-25T08:56:18.216299+0000","last_became_active":"2024-04-25T08:56:18.214922+0000","last_became_peered":"2024-04-25T08:56:18.214922+0000","last_unstale":"2024-04-25T08:56:18.216299+0000","last_undegraded":"2024-04-25T08:56:18.216299+0000","last_fullsized":"2024-04-25T08:56:18.216299+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:00.693003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359208+0000","last_change":"2024-04-25T08:56:18.216067+0000","last_active":"2024-04-25T08:56:19.359208+0000","last_peered":"2024-04-25T08:56:19.359208+0000","last_clean":"2024-04-25T08:56:19.359208+0000","last_became_active":"2024-04-25T08:56:18.215750+0000","last_became_peered":"2024-04-25T08:56:18.215750+0000","last_unstale":"2024-04-25T08:56:19.359208+0000","last_undegraded":"2024-04-25T08:56:19.359208+0000","last_fullsized":"2024-04-25T08:56:19.359208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196193+0000","last_change":"2024-04-25T08:56:18.205704+0000","last_active":"2024-04-25T08:56:19.196193+0000","last_peered":"2024-04-25T08:56:19.196193+0000","last_clean":"2024-04-25T08:56:19.196193+0000","last_became_active":"2024-04-25T08:56:18.205432+0000","last_became_peered":"2024-04-25T08:56:18.205432+0000","last_unstale":"2024-04-25T08:56:19.196193+0000","last_undegraded":"2024-04-25T08:56:19.196193+0000","last_fullsized":"2024-04-25T08:56:19.196193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:50.798086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481529+0000","last_change":"2024-04-25T08:56:18.220201+0000","last_active":"2024-04-25T08:56:19.481529+0000","last_peered":"2024-04-25T08:56:19.481529+0000","last_clean":"2024-04-25T08:56:19.481529+0000","last_became_active":"2024-04-25T08:56:18.219890+0000","last_became_peered":"2024-04-25T08:56:18.219890+0000","last_unstale":"2024-04-25T08:56:19.481529+0000","last_undegraded":"2024-04-25T08:56:19.481529+0000","last_fullsized":"2024-04-25T08:56:19.481529+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.388864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196996+0000","last_change":"2024-04-25T08:56:18.216067+0000","last_active":"2024-04-25T08:56:19.196996+0000","last_peered":"2024-04-25T08:56:19.196996+0000","last_clean":"2024-04-25T08:56:19.196996+0000","last_became_active":"2024-04-25T08:56:18.215793+0000","last_became_peered":"2024-04-25T08:56:18.215793+0000","last_unstale":"2024-04-25T08:56:19.196996+0000","last_undegraded":"2024-04-25T08:56:19.196996+0000","last_fullsized":"2024-04-25T08:56:19.196996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:27.576959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196082+0000","last_change":"2024-04-25T08:56:18.221843+0000","last_active":"2024-04-25T08:56:19.196082+0000","last_peered":"2024-04-25T08:56:19.196082+0000","last_clean":"2024-04-25T08:56:19.196082+0000","last_became_active":"2024-04-25T08:56:18.221585+0000","last_became_peered":"2024-04-25T08:56:18.221585+0000","last_unstale":"2024-04-25T08:56:19.196082+0000","last_undegraded":"2024-04-25T08:56:19.196082+0000","last_fullsized":"2024-04-25T08:56:19.196082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:54.520655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481188+0000","last_change":"2024-04-25T08:56:18.208528+0000","last_active":"2024-04-25T08:56:19.481188+0000","last_peered":"2024-04-25T08:56:19.481188+0000","last_clean":"2024-04-25T08:56:19.481188+0000","last_became_active":"2024-04-25T08:56:18.208223+0000","last_became_peered":"2024-04-25T08:56:18.208223+0000","last_unstale":"2024-04-25T08:56:19.481188+0000","last_undegraded":"2024-04-25T08:56:19.481188+0000","last_fullsized":"2024-04-25T08:56:19.481188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:58.962486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195551+0000","last_change":"2024-04-25T08:56:18.211520+0000","last_active":"2024-04-25T08:56:19.195551+0000","last_peered":"2024-04-25T08:56:19.195551+0000","last_clean":"2024-04-25T08:56:19.195551+0000","last_became_active":"2024-04-25T08:56:18.211171+0000","last_became_peered":"2024-04-25T08:56:18.211171+0000","last_unstale":"2024-04-25T08:56:19.195551+0000","last_undegraded":"2024-04-25T08:56:19.195551+0000","last_fullsized":"2024-04-25T08:56:19.195551+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:56.175100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481207+0000","last_change":"2024-04-25T08:56:18.223242+0000","last_active":"2024-04-25T08:56:19.481207+0000","last_peered":"2024-04-25T08:56:19.481207+0000","last_clean":"2024-04-25T08:56:19.481207+0000","last_became_active":"2024-04-25T08:56:18.222694+0000","last_became_peered":"2024-04-25T08:56:18.222694+0000","last_unstale":"2024-04-25T08:56:19.481207+0000","last_undegraded":"2024-04-25T08:56:19.481207+0000","last_fullsized":"2024-04-25T08:56:19.481207+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:47.866218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196301+0000","last_change":"2024-04-25T08:56:18.217082+0000","last_active":"2024-04-25T08:56:19.196301+0000","last_peered":"2024-04-25T08:56:19.196301+0000","last_clean":"2024-04-25T08:56:19.196301+0000","last_became_active":"2024-04-25T08:56:18.216639+0000","last_became_peered":"2024-04-25T08:56:18.216639+0000","last_unstale":"2024-04-25T08:56:19.196301+0000","last_undegraded":"2024-04-25T08:56:19.196301+0000","last_fullsized":"2024-04-25T08:56:19.196301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:39.841298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197280+0000","last_change":"2024-04-25T08:56:18.215507+0000","last_active":"2024-04-25T08:56:19.197280+0000","last_peered":"2024-04-25T08:56:19.197280+0000","last_clean":"2024-04-25T08:56:19.197280+0000","last_became_active":"2024-04-25T08:56:18.215224+0000","last_became_peered":"2024-04-25T08:56:18.215224+0000","last_unstale":"2024-04-25T08:56:19.197280+0000","last_undegraded":"2024-04-25T08:56:19.197280+0000","last_fullsized":"2024-04-25T08:56:19.197280+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:12.624706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.213831+0000","last_change":"2024-04-25T08:56:18.207047+0000","last_active":"2024-04-25T08:56:18.213831+0000","last_peered":"2024-04-25T08:56:18.213831+0000","last_clean":"2024-04-25T08:56:18.213831+0000","last_became_active":"2024-04-25T08:56:18.206749+0000","last_became_peered":"2024-04-25T08:56:18.206749+0000","last_unstale":"2024-04-25T08:56:18.213831+0000","last_undegraded":"2024-04-25T08:56:18.213831+0000","last_fullsized":"2024-04-25T08:56:18.213831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:33.200201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359355+0000","last_change":"2024-04-25T08:56:18.216568+0000","last_active":"2024-04-25T08:56:19.359355+0000","last_peered":"2024-04-25T08:56:19.359355+0000","last_clean":"2024-04-25T08:56:19.359355+0000","last_became_active":"2024-04-25T08:56:18.215965+0000","last_became_peered":"2024-04-25T08:56:18.215965+0000","last_unstale":"2024-04-25T08:56:19.359355+0000","last_undegraded":"2024-04-25T08:56:19.359355+0000","last_fullsized":"2024-04-25T08:56:19.359355+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197235+0000","last_change":"2024-04-25T08:56:18.219428+0000","last_active":"2024-04-25T08:56:19.197235+0000","last_peered":"2024-04-25T08:56:19.197235+0000","last_clean":"2024-04-25T08:56:19.197235+0000","last_became_active":"2024-04-25T08:56:18.218946+0000","last_became_peered":"2024-04-25T08:56:18.218946+0000","last_unstale":"2024-04-25T08:56:19.197235+0000","last_undegraded":"2024-04-25T08:56:19.197235+0000","last_fullsized":"2024-04-25T08:56:19.197235+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:17.124211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196368+0000","last_change":"2024-04-25T08:56:18.209922+0000","last_active":"2024-04-25T08:56:19.196368+0000","last_peered":"2024-04-25T08:56:19.196368+0000","last_clean":"2024-04-25T08:56:19.196368+0000","last_became_active":"2024-04-25T08:56:18.208216+0000","last_became_peered":"2024-04-25T08:56:18.208216+0000","last_unstale":"2024-04-25T08:56:19.196368+0000","last_undegraded":"2024-04-25T08:56:19.196368+0000","last_fullsized":"2024-04-25T08:56:19.196368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:54.752262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481129+0000","last_change":"2024-04-25T08:56:18.215840+0000","last_active":"2024-04-25T08:56:19.481129+0000","last_peered":"2024-04-25T08:56:19.481129+0000","last_clean":"2024-04-25T08:56:19.481129+0000","last_became_active":"2024-04-25T08:56:18.214137+0000","last_became_peered":"2024-04-25T08:56:18.214137+0000","last_unstale":"2024-04-25T08:56:19.481129+0000","last_undegraded":"2024-04-25T08:56:19.481129+0000","last_fullsized":"2024-04-25T08:56:19.481129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:36.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196664+0000","last_change":"2024-04-25T08:56:18.215113+0000","last_active":"2024-04-25T08:56:19.196664+0000","last_peered":"2024-04-25T08:56:19.196664+0000","last_clean":"2024-04-25T08:56:19.196664+0000","last_became_active":"2024-04-25T08:56:18.214777+0000","last_became_peered":"2024-04-25T08:56:18.214777+0000","last_unstale":"2024-04-25T08:56:19.196664+0000","last_undegraded":"2024-04-25T08:56:19.196664+0000","last_fullsized":"2024-04-25T08:56:19.196664+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:02.932997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359476+0000","last_change":"2024-04-25T08:56:18.223089+0000","last_active":"2024-04-25T08:56:19.359476+0000","last_peered":"2024-04-25T08:56:19.359476+0000","last_clean":"2024-04-25T08:56:19.359476+0000","last_became_active":"2024-04-25T08:56:18.222727+0000","last_became_peered":"2024-04-25T08:56:18.222727+0000","last_unstale":"2024-04-25T08:56:19.359476+0000","last_undegraded":"2024-04-25T08:56:19.359476+0000","last_fullsized":"2024-04-25T08:56:19.359476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:47.361388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359468+0000","last_change":"2024-04-25T08:56:18.217780+0000","last_active":"2024-04-25T08:56:19.359468+0000","last_peered":"2024-04-25T08:56:19.359468+0000","last_clean":"2024-04-25T08:56:19.359468+0000","last_became_active":"2024-04-25T08:56:18.217411+0000","last_became_peered":"2024-04-25T08:56:18.217411+0000","last_unstale":"2024-04-25T08:56:19.359468+0000","last_undegraded":"2024-04-25T08:56:19.359468+0000","last_fullsized":"2024-04-25T08:56:19.359468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:53.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359681+0000","last_change":"2024-04-25T08:56:17.209473+0000","last_active":"2024-04-25T08:56:19.359681+0000","last_peered":"2024-04-25T08:56:19.359681+0000","last_clean":"2024-04-25T08:56:19.359681+0000","last_became_active":"2024-04-25T08:56:17.209211+0000","last_became_peered":"2024-04-25T08:56:17.209211+0000","last_unstale":"2024-04-25T08:56:19.359681+0000","last_undegraded":"2024-04-25T08:56:19.359681+0000","last_fullsized":"2024-04-25T08:56:19.359681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.024118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196283+0000","last_change":"2024-04-25T08:56:17.212441+0000","last_active":"2024-04-25T08:56:19.196283+0000","last_peered":"2024-04-25T08:56:19.196283+0000","last_clean":"2024-04-25T08:56:19.196283+0000","last_became_active":"2024-04-25T08:56:17.212105+0000","last_became_peered":"2024-04-25T08:56:17.212105+0000","last_unstale":"2024-04-25T08:56:19.196283+0000","last_undegraded":"2024-04-25T08:56:19.196283+0000","last_fullsized":"2024-04-25T08:56:19.196283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:43.080241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359476+0000","last_change":"2024-04-25T08:56:18.220153+0000","last_active":"2024-04-25T08:56:19.359476+0000","last_peered":"2024-04-25T08:56:19.359476+0000","last_clean":"2024-04-25T08:56:19.359476+0000","last_became_active":"2024-04-25T08:56:18.219814+0000","last_became_peered":"2024-04-25T08:56:18.219814+0000","last_unstale":"2024-04-25T08:56:19.359476+0000","last_undegraded":"2024-04-25T08:56:19.359476+0000","last_fullsized":"2024-04-25T08:56:19.359476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:29.370750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359572+0000","last_change":"2024-04-25T08:56:17.210018+0000","last_active":"2024-04-25T08:56:19.359572+0000","last_peered":"2024-04-25T08:56:19.359572+0000","last_clean":"2024-04-25T08:56:19.359572+0000","last_became_active":"2024-04-25T08:56:17.209032+0000","last_became_peered":"2024-04-25T08:56:17.209032+0000","last_unstale":"2024-04-25T08:56:19.359572+0000","last_undegraded":"2024-04-25T08:56:19.359572+0000","last_fullsized":"2024-04-25T08:56:19.359572+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:32.077700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359440+0000","last_change":"2024-04-25T08:56:18.223451+0000","last_active":"2024-04-25T08:56:19.359440+0000","last_peered":"2024-04-25T08:56:19.359440+0000","last_clean":"2024-04-25T08:56:19.359440+0000","last_became_active":"2024-04-25T08:56:18.223100+0000","last_became_peered":"2024-04-25T08:56:18.223100+0000","last_unstale":"2024-04-25T08:56:19.359440+0000","last_undegraded":"2024-04-25T08:56:19.359440+0000","last_fullsized":"2024-04-25T08:56:19.359440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.388864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215475+0000","last_change":"2024-04-25T08:56:17.208994+0000","last_active":"2024-04-25T08:56:18.215475+0000","last_peered":"2024-04-25T08:56:18.215475+0000","last_clean":"2024-04-25T08:56:18.215475+0000","last_became_active":"2024-04-25T08:56:17.208669+0000","last_became_peered":"2024-04-25T08:56:17.208669+0000","last_unstale":"2024-04-25T08:56:18.215475+0000","last_undegraded":"2024-04-25T08:56:18.215475+0000","last_fullsized":"2024-04-25T08:56:18.215475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:56.789554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195704+0000","last_change":"2024-04-25T08:56:18.210662+0000","last_active":"2024-04-25T08:56:19.195704+0000","last_peered":"2024-04-25T08:56:19.195704+0000","last_clean":"2024-04-25T08:56:19.195704+0000","last_became_active":"2024-04-25T08:56:18.210316+0000","last_became_peered":"2024-04-25T08:56:18.210316+0000","last_unstale":"2024-04-25T08:56:19.195704+0000","last_undegraded":"2024-04-25T08:56:19.195704+0000","last_fullsized":"2024-04-25T08:56:19.195704+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:51.409173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.212560+0000","last_change":"2024-04-25T08:56:17.217874+0000","last_active":"2024-04-25T08:56:18.212560+0000","last_peered":"2024-04-25T08:56:18.212560+0000","last_clean":"2024-04-25T08:56:18.212560+0000","last_became_active":"2024-04-25T08:56:17.217659+0000","last_became_peered":"2024-04-25T08:56:17.217659+0000","last_unstale":"2024-04-25T08:56:18.212560+0000","last_undegraded":"2024-04-25T08:56:18.212560+0000","last_fullsized":"2024-04-25T08:56:18.212560+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:53.854649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196361+0000","last_change":"2024-04-25T08:56:18.221070+0000","last_active":"2024-04-25T08:56:19.196361+0000","last_peered":"2024-04-25T08:56:19.196361+0000","last_clean":"2024-04-25T08:56:19.196361+0000","last_became_active":"2024-04-25T08:56:18.220788+0000","last_became_peered":"2024-04-25T08:56:18.220788+0000","last_unstale":"2024-04-25T08:56:19.196361+0000","last_undegraded":"2024-04-25T08:56:19.196361+0000","last_fullsized":"2024-04-25T08:56:19.196361+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:41.014505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359314+0000","last_change":"2024-04-25T08:56:17.208139+0000","last_active":"2024-04-25T08:56:19.359314+0000","last_peered":"2024-04-25T08:56:19.359314+0000","last_clean":"2024-04-25T08:56:19.359314+0000","last_became_active":"2024-04-25T08:56:17.207843+0000","last_became_peered":"2024-04-25T08:56:17.207843+0000","last_unstale":"2024-04-25T08:56:19.359314+0000","last_undegraded":"2024-04-25T08:56:19.359314+0000","last_fullsized":"2024-04-25T08:56:19.359314+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:56.789554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196397+0000","last_change":"2024-04-25T08:56:18.210083+0000","last_active":"2024-04-25T08:56:19.196397+0000","last_peered":"2024-04-25T08:56:19.196397+0000","last_clean":"2024-04-25T08:56:19.196397+0000","last_became_active":"2024-04-25T08:56:18.209783+0000","last_became_peered":"2024-04-25T08:56:18.209783+0000","last_unstale":"2024-04-25T08:56:19.196397+0000","last_undegraded":"2024-04-25T08:56:19.196397+0000","last_fullsized":"2024-04-25T08:56:19.196397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:10.794882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204581+0000","last_change":"2024-04-25T08:56:17.211340+0000","last_active":"2024-04-25T08:56:18.204581+0000","last_peered":"2024-04-25T08:56:18.204581+0000","last_clean":"2024-04-25T08:56:18.204581+0000","last_became_active":"2024-04-25T08:56:17.211002+0000","last_became_peered":"2024-04-25T08:56:17.211002+0000","last_unstale":"2024-04-25T08:56:18.204581+0000","last_undegraded":"2024-04-25T08:56:18.204581+0000","last_fullsized":"2024-04-25T08:56:18.204581+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:59.690478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195577+0000","last_change":"2024-04-25T08:56:18.205814+0000","last_active":"2024-04-25T08:56:19.195577+0000","last_peered":"2024-04-25T08:56:19.195577+0000","last_clean":"2024-04-25T08:56:19.195577+0000","last_became_active":"2024-04-25T08:56:18.205528+0000","last_became_peered":"2024-04-25T08:56:18.205528+0000","last_unstale":"2024-04-25T08:56:19.195577+0000","last_undegraded":"2024-04-25T08:56:19.195577+0000","last_fullsized":"2024-04-25T08:56:19.195577+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:07.023502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.194961+0000","last_change":"2024-04-25T08:56:17.207453+0000","last_active":"2024-04-25T08:56:18.194961+0000","last_peered":"2024-04-25T08:56:18.194961+0000","last_clean":"2024-04-25T08:56:18.194961+0000","last_became_active":"2024-04-25T08:56:17.207230+0000","last_became_peered":"2024-04-25T08:56:17.207230+0000","last_unstale":"2024-04-25T08:56:18.194961+0000","last_undegraded":"2024-04-25T08:56:18.194961+0000","last_fullsized":"2024-04-25T08:56:18.194961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:50.902995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.218097+0000","last_change":"2024-04-25T08:56:18.216487+0000","last_active":"2024-04-25T08:56:18.218097+0000","last_peered":"2024-04-25T08:56:18.218097+0000","last_clean":"2024-04-25T08:56:18.218097+0000","last_became_active":"2024-04-25T08:56:18.215687+0000","last_became_peered":"2024-04-25T08:56:18.215687+0000","last_unstale":"2024-04-25T08:56:18.218097+0000","last_undegraded":"2024-04-25T08:56:18.218097+0000","last_fullsized":"2024-04-25T08:56:18.218097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:12.416991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481604+0000","last_change":"2024-04-25T08:56:17.202622+0000","last_active":"2024-04-25T08:56:19.481604+0000","last_peered":"2024-04-25T08:56:19.481604+0000","last_clean":"2024-04-25T08:56:19.481604+0000","last_became_active":"2024-04-25T08:56:17.202334+0000","last_became_peered":"2024-04-25T08:56:17.202334+0000","last_unstale":"2024-04-25T08:56:19.481604+0000","last_undegraded":"2024-04-25T08:56:19.481604+0000","last_fullsized":"2024-04-25T08:56:19.481604+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.248690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481627+0000","last_change":"2024-04-25T08:56:18.223478+0000","last_active":"2024-04-25T08:56:19.481627+0000","last_peered":"2024-04-25T08:56:19.481627+0000","last_clean":"2024-04-25T08:56:19.481627+0000","last_became_active":"2024-04-25T08:56:18.223262+0000","last_became_peered":"2024-04-25T08:56:18.223262+0000","last_unstale":"2024-04-25T08:56:19.481627+0000","last_undegraded":"2024-04-25T08:56:19.481627+0000","last_fullsized":"2024-04-25T08:56:19.481627+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:47.361388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196303+0000","last_change":"2024-04-25T08:56:17.218177+0000","last_active":"2024-04-25T08:56:19.196303+0000","last_peered":"2024-04-25T08:56:19.196303+0000","last_clean":"2024-04-25T08:56:19.196303+0000","last_became_active":"2024-04-25T08:56:17.217859+0000","last_became_peered":"2024-04-25T08:56:17.217859+0000","last_unstale":"2024-04-25T08:56:19.196303+0000","last_undegraded":"2024-04-25T08:56:19.196303+0000","last_fullsized":"2024-04-25T08:56:19.196303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:01.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481558+0000","last_change":"2024-04-25T08:56:17.209000+0000","last_active":"2024-04-25T08:56:19.481558+0000","last_peered":"2024-04-25T08:56:19.481558+0000","last_clean":"2024-04-25T08:56:19.481558+0000","last_became_active":"2024-04-25T08:56:17.208727+0000","last_became_peered":"2024-04-25T08:56:17.208727+0000","last_unstale":"2024-04-25T08:56:19.481558+0000","last_undegraded":"2024-04-25T08:56:19.481558+0000","last_fullsized":"2024-04-25T08:56:19.481558+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:50.271504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481437+0000","last_change":"2024-04-25T08:56:18.220854+0000","last_active":"2024-04-25T08:56:19.481437+0000","last_peered":"2024-04-25T08:56:19.481437+0000","last_clean":"2024-04-25T08:56:19.481437+0000","last_became_active":"2024-04-25T08:56:18.220406+0000","last_became_peered":"2024-04-25T08:56:18.220406+0000","last_unstale":"2024-04-25T08:56:19.481437+0000","last_undegraded":"2024-04-25T08:56:19.481437+0000","last_fullsized":"2024-04-25T08:56:19.481437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:10.524577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.233028+0000","last_change":"2024-04-25T08:56:17.199981+0000","last_active":"2024-04-25T08:56:18.233028+0000","last_peered":"2024-04-25T08:56:18.233028+0000","last_clean":"2024-04-25T08:56:18.233028+0000","last_became_active":"2024-04-25T08:56:17.199667+0000","last_became_peered":"2024-04-25T08:56:17.199667+0000","last_unstale":"2024-04-25T08:56:18.233028+0000","last_undegraded":"2024-04-25T08:56:18.233028+0000","last_fullsized":"2024-04-25T08:56:18.233028+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:19.999889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.225164+0000","last_change":"2024-04-25T08:56:18.221416+0000","last_active":"2024-04-25T08:56:18.225164+0000","last_peered":"2024-04-25T08:56:18.225164+0000","last_clean":"2024-04-25T08:56:18.225164+0000","last_became_active":"2024-04-25T08:56:18.221196+0000","last_became_peered":"2024-04-25T08:56:18.221196+0000","last_unstale":"2024-04-25T08:56:18.225164+0000","last_undegraded":"2024-04-25T08:56:18.225164+0000","last_fullsized":"2024-04-25T08:56:18.225164+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:02.980311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196227+0000","last_change":"2024-04-25T08:56:17.218664+0000","last_active":"2024-04-25T08:56:19.196227+0000","last_peered":"2024-04-25T08:56:19.196227+0000","last_clean":"2024-04-25T08:56:19.196227+0000","last_became_active":"2024-04-25T08:56:17.218365+0000","last_became_peered":"2024-04-25T08:56:17.218365+0000","last_unstale":"2024-04-25T08:56:19.196227+0000","last_undegraded":"2024-04-25T08:56:19.196227+0000","last_fullsized":"2024-04-25T08:56:19.196227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:39.098749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481296+0000","last_change":"2024-04-25T08:56:18.212351+0000","last_active":"2024-04-25T08:56:19.481296+0000","last_peered":"2024-04-25T08:56:19.481296+0000","last_clean":"2024-04-25T08:56:19.481296+0000","last_became_active":"2024-04-25T08:56:18.212075+0000","last_became_peered":"2024-04-25T08:56:18.212075+0000","last_unstale":"2024-04-25T08:56:19.481296+0000","last_undegraded":"2024-04-25T08:56:19.481296+0000","last_fullsized":"2024-04-25T08:56:19.481296+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196473+0000","last_change":"2024-04-25T08:56:17.200568+0000","last_active":"2024-04-25T08:56:19.196473+0000","last_peered":"2024-04-25T08:56:19.196473+0000","last_clean":"2024-04-25T08:56:19.196473+0000","last_became_active":"2024-04-25T08:56:17.200242+0000","last_became_peered":"2024-04-25T08:56:17.200242+0000","last_unstale":"2024-04-25T08:56:19.196473+0000","last_undegraded":"2024-04-25T08:56:19.196473+0000","last_fullsized":"2024-04-25T08:56:19.196473+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:57.237578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215172+0000","last_change":"2024-04-25T08:56:18.213076+0000","last_active":"2024-04-25T08:56:18.215172+0000","last_peered":"2024-04-25T08:56:18.215172+0000","last_clean":"2024-04-25T08:56:18.215172+0000","last_became_active":"2024-04-25T08:56:18.212746+0000","last_became_peered":"2024-04-25T08:56:18.212746+0000","last_unstale":"2024-04-25T08:56:18.215172+0000","last_undegraded":"2024-04-25T08:56:18.215172+0000","last_fullsized":"2024-04-25T08:56:18.215172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:22.026643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204803+0000","last_change":"2024-04-25T08:56:17.209077+0000","last_active":"2024-04-25T08:56:18.204803+0000","last_peered":"2024-04-25T08:56:18.204803+0000","last_clean":"2024-04-25T08:56:18.204803+0000","last_became_active":"2024-04-25T08:56:17.208079+0000","last_became_peered":"2024-04-25T08:56:17.208079+0000","last_unstale":"2024-04-25T08:56:18.204803+0000","last_undegraded":"2024-04-25T08:56:18.204803+0000","last_fullsized":"2024-04-25T08:56:18.204803+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:11.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481202+0000","last_change":"2024-04-25T08:56:18.223135+0000","last_active":"2024-04-25T08:56:19.481202+0000","last_peered":"2024-04-25T08:56:19.481202+0000","last_clean":"2024-04-25T08:56:19.481202+0000","last_became_active":"2024-04-25T08:56:18.222867+0000","last_became_peered":"2024-04-25T08:56:18.222867+0000","last_unstale":"2024-04-25T08:56:19.481202+0000","last_undegraded":"2024-04-25T08:56:19.481202+0000","last_fullsized":"2024-04-25T08:56:19.481202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:18.749861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481015+0000","last_change":"2024-04-25T08:56:17.209066+0000","last_active":"2024-04-25T08:56:19.481015+0000","last_peered":"2024-04-25T08:56:19.481015+0000","last_clean":"2024-04-25T08:56:19.481015+0000","last_became_active":"2024-04-25T08:56:17.208841+0000","last_became_peered":"2024-04-25T08:56:17.208841+0000","last_unstale":"2024-04-25T08:56:19.481015+0000","last_undegraded":"2024-04-25T08:56:19.481015+0000","last_fullsized":"2024-04-25T08:56:19.481015+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:21.082806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481564+0000","last_change":"2024-04-25T08:56:18.215974+0000","last_active":"2024-04-25T08:56:19.481564+0000","last_peered":"2024-04-25T08:56:19.481564+0000","last_clean":"2024-04-25T08:56:19.481564+0000","last_became_active":"2024-04-25T08:56:18.215532+0000","last_became_peered":"2024-04-25T08:56:18.215532+0000","last_unstale":"2024-04-25T08:56:19.481564+0000","last_undegraded":"2024-04-25T08:56:19.481564+0000","last_fullsized":"2024-04-25T08:56:19.481564+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:29.370750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196574+0000","last_change":"2024-04-25T08:56:17.218282+0000","last_active":"2024-04-25T08:56:19.196574+0000","last_peered":"2024-04-25T08:56:19.196574+0000","last_clean":"2024-04-25T08:56:19.196574+0000","last_became_active":"2024-04-25T08:56:17.217970+0000","last_became_peered":"2024-04-25T08:56:17.217970+0000","last_unstale":"2024-04-25T08:56:19.196574+0000","last_undegraded":"2024-04-25T08:56:19.196574+0000","last_fullsized":"2024-04-25T08:56:19.196574+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:57.959960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.225552+0000","last_change":"2024-04-25T08:56:18.222912+0000","last_active":"2024-04-25T08:56:18.225552+0000","last_peered":"2024-04-25T08:56:18.225552+0000","last_clean":"2024-04-25T08:56:18.225552+0000","last_became_active":"2024-04-25T08:56:18.222609+0000","last_became_peered":"2024-04-25T08:56:18.222609+0000","last_unstale":"2024-04-25T08:56:18.225552+0000","last_undegraded":"2024-04-25T08:56:18.225552+0000","last_fullsized":"2024-04-25T08:56:18.225552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:36.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359576+0000","last_change":"2024-04-25T08:56:17.217247+0000","last_active":"2024-04-25T08:56:19.359576+0000","last_peered":"2024-04-25T08:56:19.359576+0000","last_clean":"2024-04-25T08:56:19.359576+0000","last_became_active":"2024-04-25T08:56:17.216896+0000","last_became_peered":"2024-04-25T08:56:17.216896+0000","last_unstale":"2024-04-25T08:56:19.359576+0000","last_undegraded":"2024-04-25T08:56:19.359576+0000","last_fullsized":"2024-04-25T08:56:19.359576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:11.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196124+0000","last_change":"2024-04-25T08:56:18.202536+0000","last_active":"2024-04-25T08:56:19.196124+0000","last_peered":"2024-04-25T08:56:19.196124+0000","last_clean":"2024-04-25T08:56:19.196124+0000","last_became_active":"2024-04-25T08:56:18.202235+0000","last_became_peered":"2024-04-25T08:56:18.202235+0000","last_unstale":"2024-04-25T08:56:19.196124+0000","last_undegraded":"2024-04-25T08:56:19.196124+0000","last_fullsized":"2024-04-25T08:56:19.196124+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:32.018334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215666+0000","last_change":"2024-04-25T08:56:17.205551+0000","last_active":"2024-04-25T08:56:18.215666+0000","last_peered":"2024-04-25T08:56:18.215666+0000","last_clean":"2024-04-25T08:56:18.215666+0000","last_became_active":"2024-04-25T08:56:17.205230+0000","last_became_peered":"2024-04-25T08:56:17.205230+0000","last_unstale":"2024-04-25T08:56:18.215666+0000","last_undegraded":"2024-04-25T08:56:18.215666+0000","last_fullsized":"2024-04-25T08:56:18.215666+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:20.992044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481566+0000","last_change":"2024-04-25T08:56:18.220992+0000","last_active":"2024-04-25T08:56:19.481566+0000","last_peered":"2024-04-25T08:56:19.481566+0000","last_clean":"2024-04-25T08:56:19.481566+0000","last_became_active":"2024-04-25T08:56:18.220716+0000","last_became_peered":"2024-04-25T08:56:18.220716+0000","last_unstale":"2024-04-25T08:56:19.481566+0000","last_undegraded":"2024-04-25T08:56:19.481566+0000","last_fullsized":"2024-04-25T08:56:19.481566+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:53.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359615+0000","last_change":"2024-04-25T08:56:17.207716+0000","last_active":"2024-04-25T08:56:19.359615+0000","last_peered":"2024-04-25T08:56:19.359615+0000","last_clean":"2024-04-25T08:56:19.359615+0000","last_became_active":"2024-04-25T08:56:17.207377+0000","last_became_peered":"2024-04-25T08:56:17.207377+0000","last_unstale":"2024-04-25T08:56:19.359615+0000","last_undegraded":"2024-04-25T08:56:19.359615+0000","last_fullsized":"2024-04-25T08:56:19.359615+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:59.690478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222580+0000","last_change":"2024-04-25T08:56:18.214828+0000","last_active":"2024-04-25T08:56:18.222580+0000","last_peered":"2024-04-25T08:56:18.222580+0000","last_clean":"2024-04-25T08:56:18.222580+0000","last_became_active":"2024-04-25T08:56:18.214546+0000","last_became_peered":"2024-04-25T08:56:18.214546+0000","last_unstale":"2024-04-25T08:56:18.222580+0000","last_undegraded":"2024-04-25T08:56:18.222580+0000","last_fullsized":"2024-04-25T08:56:18.222580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:44.082766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196468+0000","last_change":"2024-04-25T08:56:17.211265+0000","last_active":"2024-04-25T08:56:19.196468+0000","last_peered":"2024-04-25T08:56:19.196468+0000","last_clean":"2024-04-25T08:56:19.196468+0000","last_became_active":"2024-04-25T08:56:17.210943+0000","last_became_peered":"2024-04-25T08:56:17.210943+0000","last_unstale":"2024-04-25T08:56:19.196468+0000","last_undegraded":"2024-04-25T08:56:19.196468+0000","last_fullsized":"2024-04-25T08:56:19.196468+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:35.063530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359715+0000","last_change":"2024-04-25T08:56:18.218361+0000","last_active":"2024-04-25T08:56:19.359715+0000","last_peered":"2024-04-25T08:56:19.359715+0000","last_clean":"2024-04-25T08:56:19.359715+0000","last_became_active":"2024-04-25T08:56:18.218070+0000","last_became_peered":"2024-04-25T08:56:18.218070+0000","last_unstale":"2024-04-25T08:56:19.359715+0000","last_undegraded":"2024-04-25T08:56:19.359715+0000","last_fullsized":"2024-04-25T08:56:19.359715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:07.045007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.190673+0000","last_change":"2024-04-25T08:56:16.190673+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.190673+0000","last_undegraded":"2024-04-25T08:56:16.190673+0000","last_fullsized":"2024-04-25T08:56:16.190673+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359223+0000","last_change":"2024-04-25T08:56:18.218040+0000","last_active":"2024-04-25T08:56:19.359223+0000","last_peered":"2024-04-25T08:56:19.359223+0000","last_clean":"2024-04-25T08:56:19.359223+0000","last_became_active":"2024-04-25T08:56:18.217711+0000","last_became_peered":"2024-04-25T08:56:18.217711+0000","last_unstale":"2024-04-25T08:56:19.359223+0000","last_undegraded":"2024-04-25T08:56:19.359223+0000","last_fullsized":"2024-04-25T08:56:19.359223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:34:03.547004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204576+0000","last_change":"2024-04-25T08:56:17.210094+0000","last_active":"2024-04-25T08:56:18.204576+0000","last_peered":"2024-04-25T08:56:18.204576+0000","last_clean":"2024-04-25T08:56:18.204576+0000","last_became_active":"2024-04-25T08:56:17.209773+0000","last_became_peered":"2024-04-25T08:56:17.209773+0000","last_unstale":"2024-04-25T08:56:18.204576+0000","last_undegraded":"2024-04-25T08:56:18.204576+0000","last_fullsized":"2024-04-25T08:56:18.204576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.024118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222599+0000","last_change":"2024-04-25T08:56:18.215521+0000","last_active":"2024-04-25T08:56:18.222599+0000","last_peered":"2024-04-25T08:56:18.222599+0000","last_clean":"2024-04-25T08:56:18.222599+0000","last_became_active":"2024-04-25T08:56:18.215222+0000","last_became_peered":"2024-04-25T08:56:18.215222+0000","last_unstale":"2024-04-25T08:56:18.222599+0000","last_undegraded":"2024-04-25T08:56:18.222599+0000","last_fullsized":"2024-04-25T08:56:18.222599+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:40.101275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.189457+0000","last_change":"2024-04-25T08:56:16.189457+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.189457+0000","last_undegraded":"2024-04-25T08:56:16.189457+0000","last_fullsized":"2024-04-25T08:56:16.189457+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222791+0000","last_change":"2024-04-25T08:56:18.213570+0000","last_active":"2024-04-25T08:56:18.222791+0000","last_peered":"2024-04-25T08:56:18.222791+0000","last_clean":"2024-04-25T08:56:18.222791+0000","last_became_active":"2024-04-25T08:56:18.212104+0000","last_became_peered":"2024-04-25T08:56:18.212104+0000","last_unstale":"2024-04-25T08:56:18.222791+0000","last_undegraded":"2024-04-25T08:56:18.222791+0000","last_fullsized":"2024-04-25T08:56:18.222791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:26.179109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359605+0000","last_change":"2024-04-25T08:56:17.208227+0000","last_active":"2024-04-25T08:56:19.359605+0000","last_peered":"2024-04-25T08:56:19.359605+0000","last_clean":"2024-04-25T08:56:19.359605+0000","last_became_active":"2024-04-25T08:56:17.207936+0000","last_became_peered":"2024-04-25T08:56:17.207936+0000","last_unstale":"2024-04-25T08:56:19.359605+0000","last_undegraded":"2024-04-25T08:56:19.359605+0000","last_fullsized":"2024-04-25T08:56:19.359605+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:20.992044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196657+0000","last_change":"2024-04-25T08:56:17.199076+0000","last_active":"2024-04-25T08:56:19.196657+0000","last_peered":"2024-04-25T08:56:19.196657+0000","last_clean":"2024-04-25T08:56:19.196657+0000","last_became_active":"2024-04-25T08:56:17.198759+0000","last_became_peered":"2024-04-25T08:56:17.198759+0000","last_unstale":"2024-04-25T08:56:19.196657+0000","last_undegraded":"2024-04-25T08:56:19.196657+0000","last_fullsized":"2024-04-25T08:56:19.196657+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:35.077938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359501+0000","last_change":"2024-04-25T08:56:18.223807+0000","last_active":"2024-04-25T08:56:19.359501+0000","last_peered":"2024-04-25T08:56:19.359501+0000","last_clean":"2024-04-25T08:56:19.359501+0000","last_became_active":"2024-04-25T08:56:18.223515+0000","last_became_peered":"2024-04-25T08:56:18.223515+0000","last_unstale":"2024-04-25T08:56:19.359501+0000","last_undegraded":"2024-04-25T08:56:19.359501+0000","last_fullsized":"2024-04-25T08:56:19.359501+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:57.277364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.205872+0000","last_change":"2024-04-25T08:56:17.208356+0000","last_active":"2024-04-25T08:56:18.205872+0000","last_peered":"2024-04-25T08:56:18.205872+0000","last_clean":"2024-04-25T08:56:18.205872+0000","last_became_active":"2024-04-25T08:56:17.208086+0000","last_became_peered":"2024-04-25T08:56:17.208086+0000","last_unstale":"2024-04-25T08:56:18.205872+0000","last_undegraded":"2024-04-25T08:56:18.205872+0000","last_fullsized":"2024-04-25T08:56:18.205872+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:32.077700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195840+0000","last_change":"2024-04-25T08:56:18.207334+0000","last_active":"2024-04-25T08:56:19.195840+0000","last_peered":"2024-04-25T08:56:19.195840+0000","last_clean":"2024-04-25T08:56:19.195840+0000","last_became_active":"2024-04-25T08:56:18.206799+0000","last_became_peered":"2024-04-25T08:56:18.206799+0000","last_unstale":"2024-04-25T08:56:19.195840+0000","last_undegraded":"2024-04-25T08:56:19.195840+0000","last_fullsized":"2024-04-25T08:56:19.195840+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:11.835152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.189157+0000","last_change":"2024-04-25T08:56:16.189157+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.189157+0000","last_undegraded":"2024-04-25T08:56:16.189157+0000","last_fullsized":"2024-04-25T08:56:16.189157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481425+0000","last_change":"2024-04-25T08:56:18.222650+0000","last_active":"2024-04-25T08:56:19.481425+0000","last_peered":"2024-04-25T08:56:19.481425+0000","last_clean":"2024-04-25T08:56:19.481425+0000","last_became_active":"2024-04-25T08:56:18.222247+0000","last_became_peered":"2024-04-25T08:56:18.222247+0000","last_unstale":"2024-04-25T08:56:19.481425+0000","last_undegraded":"2024-04-25T08:56:19.481425+0000","last_fullsized":"2024-04-25T08:56:19.481425+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.196651+0000","last_change":"2024-04-25T08:56:17.202547+0000","last_active":"2024-04-25T08:56:18.196651+0000","last_peered":"2024-04-25T08:56:18.196651+0000","last_clean":"2024-04-25T08:56:18.196651+0000","last_became_active":"2024-04-25T08:56:17.202228+0000","last_became_peered":"2024-04-25T08:56:17.202228+0000","last_unstale":"2024-04-25T08:56:18.196651+0000","last_undegraded":"2024-04-25T08:56:18.196651+0000","last_fullsized":"2024-04-25T08:56:18.196651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:21.082806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.189131+0000","last_change":"2024-04-25T08:56:16.189131+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.189131+0000","last_undegraded":"2024-04-25T08:56:16.189131+0000","last_fullsized":"2024-04-25T08:56:16.189131+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195622+0000","last_change":"2024-04-25T08:56:18.206772+0000","last_active":"2024-04-25T08:56:19.195622+0000","last_peered":"2024-04-25T08:56:19.195622+0000","last_clean":"2024-04-25T08:56:19.195622+0000","last_became_active":"2024-04-25T08:56:18.206478+0000","last_became_peered":"2024-04-25T08:56:18.206478+0000","last_unstale":"2024-04-25T08:56:19.195622+0000","last_undegraded":"2024-04-25T08:56:19.195622+0000","last_fullsized":"2024-04-25T08:56:19.195622+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:38.623368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195622+0000","last_change":"2024-04-25T08:56:17.212487+0000","last_active":"2024-04-25T08:56:19.195622+0000","last_peered":"2024-04-25T08:56:19.195622+0000","last_clean":"2024-04-25T08:56:19.195622+0000","last_became_active":"2024-04-25T08:56:17.212169+0000","last_became_peered":"2024-04-25T08:56:17.212169+0000","last_unstale":"2024-04-25T08:56:19.195622+0000","last_undegraded":"2024-04-25T08:56:19.195622+0000","last_fullsized":"2024-04-25T08:56:19.195622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:54.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195510+0000","last_change":"2024-04-25T08:56:18.217388+0000","last_active":"2024-04-25T08:56:19.195510+0000","last_peered":"2024-04-25T08:56:19.195510+0000","last_clean":"2024-04-25T08:56:19.195510+0000","last_became_active":"2024-04-25T08:56:18.217118+0000","last_became_peered":"2024-04-25T08:56:18.217118+0000","last_unstale":"2024-04-25T08:56:19.195510+0000","last_undegraded":"2024-04-25T08:56:19.195510+0000","last_fullsized":"2024-04-25T08:56:19.195510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:55.113303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196321+0000","last_change":"2024-04-25T08:56:17.210100+0000","last_active":"2024-04-25T08:56:19.196321+0000","last_peered":"2024-04-25T08:56:19.196321+0000","last_clean":"2024-04-25T08:56:19.196321+0000","last_became_active":"2024-04-25T08:56:17.209722+0000","last_became_peered":"2024-04-25T08:56:17.209722+0000","last_unstale":"2024-04-25T08:56:19.196321+0000","last_undegraded":"2024-04-25T08:56:19.196321+0000","last_fullsized":"2024-04-25T08:56:19.196321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:35.041624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":240,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.480994+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:56:19.480994+0000","last_peered":"2024-04-25T08:56:19.480994+0000","last_clean":"2024-04-25T08:56:19.480994+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:56:19.480994+0000","last_undegraded":"2024-04-25T08:56:19.480994+0000","last_fullsized":"2024-04-25T08:56:19.480994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28308,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343532,"statfs":{"total":96636764160,"available":96607776768,"internally_reserved":0,"allocated":1314816,"data_stored":884994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":712704,"data_stored":294466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":295118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":724992,"data_stored":296078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":300822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":300822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1323008,"data_stored":887028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":688128,"data_stored":281424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:56:21.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:56:21.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.697+0000 7f5824ddb640 1 Processor -- start 2024-04-25T08:56:21.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.698+0000 7f5824ddb640 1 -- start start 2024-04-25T08:56:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.698+0000 7f5824ddb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015ba10 0x7f5820099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.698+0000 7f5824ddb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582009a3a0 con 0x7f582006c3c0 2024-04-25T08:56:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.698+0000 7f5824ddb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582006c900 con 0x7f5820099f80 2024-04-25T08:56:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.698+0000 7f5824ddb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58200cbe50 con 0x7f582015ba10 2024-04-25T08:56:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f582006c3c0 0x7f58200cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37544/0 (socket says 172.21.15.55:37544) 2024-04-25T08:56:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581ed9d640 1 -- 172.21.15.55:0/2105892807 learned_addr learned my addr 172.21.15.55:0/2105892807 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581e59c640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015ba10 0x7f5820099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368774479 0 0) 0x7f582009a3a0 con 0x7f582006c3c0 2024-04-25T08:56:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5808003520 con 0x7f582006c3c0 2024-04-25T08:56:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 672866198 0 0) 0x7f5808003520 con 0x7f582006c3c0 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015ba10 msgr2=0x7f5820099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015ba10 0x7f5820099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 >> v1:172.21.15.167:6789/0 conn(0x7f5820099f80 legacy=0x7f582006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582006cbe0 con 0x7f582006c3c0 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f58180019f0 con 0x7f582006c3c0 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 >> v1:172.21.15.55:6789/0 conn(0x7f582006c3c0 legacy=0x7f58200cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 0x7f5808003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015ba10 0x7f5808004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5808004d40 0x7f58080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580800b9c0 con 0x7f58080039e0 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580800bb40 con 0x7f5808004d40 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580800bd40 con 0x7f582015ba10 2024-04-25T08:56:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.699+0000 7f581e59c640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 0x7f5808003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.700+0000 7f581dd9b640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015ba10 0x7f5808004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.700+0000 7f581ed9d640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5808004d40 0x7f58080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.700+0000 7f581e59c640 1 -- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015ba10 msgr2=0x7f5808004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.700+0000 7f581e59c640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015ba10 0x7f5808004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.700+0000 7f581e59c640 1 -- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5808004d40 msgr2=0x7f58080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.700+0000 7f581e59c640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5808004d40 0x7f58080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.700+0000 7f581e59c640 1 -- 172.21.15.55:0/2105892807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5808003520 con 0x7f58080039e0 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.700+0000 7f581ed9d640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5808004d40 0x7f58080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.700+0000 7f581e59c640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 0x7f5808003dc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5810009ac0 tx=0x7f5808005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a02b0f525558645 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.701+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810036070 con 0x7f58080039e0 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.701+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5810031400 con 0x7f58080039e0 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.701+0000 7f581d59a640 1 -- 172.21.15.55:0/2105892807 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810009690 con 0x7f58080039e0 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.701+0000 7f5824ddb640 1 -- 172.21.15.55:0/2105892807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 msgr2=0x7f5808003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.701+0000 7f5824ddb640 1 --2- 172.21.15.55:0/2105892807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 0x7f5808003dc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5810009ac0 tx=0x7f5808005830 comp rx=0 tx=0).stop 2024-04-25T08:56:21.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.701+0000 7f581ed9d640 1 -- 172.21.15.55:0/2105892807 reap_dead start 2024-04-25T08:56:21.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.701+0000 7f5824ddb640 1 -- 172.21.15.55:0/2105892807 shutdown_connections 2024-04-25T08:56:21.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.701+0000 7f5824ddb640 1 -- 172.21.15.55:0/2105892807 >> 172.21.15.55:0/2105892807 conn(0x7f58200b32f0 msgr2=0x7f58200b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.701+0000 7f5824ddb640 1 -- 172.21.15.55:0/2105892807 shutdown_connections 2024-04-25T08:56:21.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.701+0000 7f5824ddb640 1 -- 172.21.15.55:0/2105892807 wait complete. 2024-04-25T08:56:21.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.703+0000 7f5824ddb640 1 Processor -- start 2024-04-25T08:56:21.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.703+0000 7f5824ddb640 1 -- start start 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.703+0000 7f5824ddb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 0x7f58201f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.703+0000 7f5824ddb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58200b68d0 0x7f58200c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.703+0000 7f5824ddb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015f2a0 0x7f5820158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.703+0000 7f5824ddb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58200d1320 con 0x7f58080039e0 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.703+0000 7f5824ddb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58200cfe80 con 0x7f58200b68d0 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.703+0000 7f5824ddb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58200d14a0 con 0x7f582015f2a0 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.703+0000 7f581e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 0x7f58201f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.703+0000 7f581e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 0x7f58201f3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39196/0 (socket says 172.21.15.55:39196) 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.703+0000 7f581e59c640 1 -- 172.21.15.55:0/3451775218 learned_addr learned my addr 172.21.15.55:0/3451775218 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.704+0000 7f581e59c640 1 -- 172.21.15.55:0/3451775218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015f2a0 msgr2=0x7f5820158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.704+0000 7f581e59c640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015f2a0 0x7f5820158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.704+0000 7f581e59c640 1 -- 172.21.15.55:0/3451775218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58200b68d0 msgr2=0x7f58200c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.704+0000 7f581e59c640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58200b68d0 0x7f58200c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.704+0000 7f581e59c640 1 -- 172.21.15.55:0/3451775218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582015fc10 con 0x7f58080039e0 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.704+0000 7f581e59c640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 0x7f58201f3de0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5810034040 tx=0x7f5810004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.704+0000 7f580effd640 1 -- 172.21.15.55:0/3451775218 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810040020 con 0x7f58080039e0 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.704+0000 7f580effd640 1 -- 172.21.15.55:0/3451775218 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5810003b40 con 0x7f58080039e0 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.704+0000 7f5824ddb640 1 -- 172.21.15.55:0/3451775218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582015fef0 con 0x7f58080039e0 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.704+0000 7f580effd640 1 -- 172.21.15.55:0/3451775218 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810036040 con 0x7f58080039e0 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.704+0000 7f5824ddb640 1 -- 172.21.15.55:0/3451775218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58200c70b0 con 0x7f58080039e0 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.705+0000 7f5824ddb640 1 -- 172.21.15.55:0/3451775218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58200749b0 con 0x7f58080039e0 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.705+0000 7f580effd640 1 -- 172.21.15.55:0/3451775218 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5810043020 con 0x7f58080039e0 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.706+0000 7f580effd640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f580006b500 0x7f580006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.706+0000 7f580effd640 1 -- 172.21.15.55:0/3451775218 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58100aa270 con 0x7f58080039e0 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.706+0000 7f581dd9b640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f580006b500 0x7f580006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.706+0000 7f581dd9b640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f580006b500 0x7f580006d9c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f58200b6cf0 tx=0x7f5814009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.710+0000 7f580effd640 1 -- 172.21.15.55:0/3451775218 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f581004a070 con 0x7f58080039e0 2024-04-25T08:56:21.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.887+0000 7f5824ddb640 1 -- 172.21.15.55:0/3451775218 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f582009a570 con 0x7f580006b500 2024-04-25T08:56:21.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.893+0000 7f580effd640 1 -- 172.21.15.55:0/3451775218 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250694 (secure 0 0 0) 0x7f582009a570 con 0x7f580006b500 2024-04-25T08:56:21.885 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:56:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 -- 172.21.15.55:0/3451775218 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f580006b500 msgr2=0x7f580006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f580006b500 0x7f580006d9c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f58200b6cf0 tx=0x7f5814009040 comp rx=0 tx=0).stop 2024-04-25T08:56:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 -- 172.21.15.55:0/3451775218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 msgr2=0x7f58201f3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 0x7f58201f3de0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5810034040 tx=0x7f5810004730 comp rx=0 tx=0).stop 2024-04-25T08:56:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 -- 172.21.15.55:0/3451775218 shutdown_connections 2024-04-25T08:56:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f580006b500 0x7f580006d9c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f582015f2a0 0x7f5820158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58200b68d0 0x7f58200c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 --2- 172.21.15.55:0/3451775218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58080039e0 0x7f58201f3de0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 -- 172.21.15.55:0/3451775218 >> 172.21.15.55:0/3451775218 conn(0x7f58200b32f0 msgr2=0x7f5820150430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 -- 172.21.15.55:0/3451775218 shutdown_connections 2024-04-25T08:56:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:21.896+0000 7f5824ddb640 1 -- 172.21.15.55:0/3451775218 wait complete. 2024-04-25T08:56:21.896 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-25T08:56:20.583778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239620,"kb_used_data":6788,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735100,"statfs":{"total":773094113280,"available":772848742400,"internally_reserved":0,"allocated":6950912,"data_stored":3540752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.399277"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197228+0000","last_change":"2024-04-25T08:56:18.216097+0000","last_active":"2024-04-25T08:56:19.197228+0000","last_peered":"2024-04-25T08:56:19.197228+0000","last_clean":"2024-04-25T08:56:19.197228+0000","last_became_active":"2024-04-25T08:56:18.215813+0000","last_became_peered":"2024-04-25T08:56:18.215813+0000","last_unstale":"2024-04-25T08:56:19.197228+0000","last_undegraded":"2024-04-25T08:56:19.197228+0000","last_fullsized":"2024-04-25T08:56:19.197228+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:16.551427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196183+0000","last_change":"2024-04-25T08:56:18.216111+0000","last_active":"2024-04-25T08:56:19.196183+0000","last_peered":"2024-04-25T08:56:19.196183+0000","last_clean":"2024-04-25T08:56:19.196183+0000","last_became_active":"2024-04-25T08:56:18.215825+0000","last_became_peered":"2024-04-25T08:56:18.215825+0000","last_unstale":"2024-04-25T08:56:19.196183+0000","last_undegraded":"2024-04-25T08:56:19.196183+0000","last_fullsized":"2024-04-25T08:56:19.196183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:27.852434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481340+0000","last_change":"2024-04-25T08:56:18.216482+0000","last_active":"2024-04-25T08:56:19.481340+0000","last_peered":"2024-04-25T08:56:19.481340+0000","last_clean":"2024-04-25T08:56:19.481340+0000","last_became_active":"2024-04-25T08:56:18.216109+0000","last_became_peered":"2024-04-25T08:56:18.216109+0000","last_unstale":"2024-04-25T08:56:19.481340+0000","last_undegraded":"2024-04-25T08:56:19.481340+0000","last_fullsized":"2024-04-25T08:56:19.481340+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:34:03.547004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222711+0000","last_change":"2024-04-25T08:56:18.215504+0000","last_active":"2024-04-25T08:56:18.222711+0000","last_peered":"2024-04-25T08:56:18.222711+0000","last_clean":"2024-04-25T08:56:18.222711+0000","last_became_active":"2024-04-25T08:56:18.215231+0000","last_became_peered":"2024-04-25T08:56:18.215231+0000","last_unstale":"2024-04-25T08:56:18.222711+0000","last_undegraded":"2024-04-25T08:56:18.222711+0000","last_fullsized":"2024-04-25T08:56:18.222711+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:55.008870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196987+0000","last_change":"2024-04-25T08:56:18.215438+0000","last_active":"2024-04-25T08:56:19.196987+0000","last_peered":"2024-04-25T08:56:19.196987+0000","last_clean":"2024-04-25T08:56:19.196987+0000","last_became_active":"2024-04-25T08:56:18.215127+0000","last_became_peered":"2024-04-25T08:56:18.215127+0000","last_unstale":"2024-04-25T08:56:19.196987+0000","last_undegraded":"2024-04-25T08:56:19.196987+0000","last_fullsized":"2024-04-25T08:56:19.196987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:18.265835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359240+0000","last_change":"2024-04-25T08:56:18.219404+0000","last_active":"2024-04-25T08:56:19.359240+0000","last_peered":"2024-04-25T08:56:19.359240+0000","last_clean":"2024-04-25T08:56:19.359240+0000","last_became_active":"2024-04-25T08:56:18.219126+0000","last_became_peered":"2024-04-25T08:56:18.219126+0000","last_unstale":"2024-04-25T08:56:19.359240+0000","last_undegraded":"2024-04-25T08:56:19.359240+0000","last_fullsized":"2024-04-25T08:56:19.359240+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:10.524577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.211594+0000","last_change":"2024-04-25T08:56:18.207889+0000","last_active":"2024-04-25T08:56:18.211594+0000","last_peered":"2024-04-25T08:56:18.211594+0000","last_clean":"2024-04-25T08:56:18.211594+0000","last_became_active":"2024-04-25T08:56:18.207533+0000","last_became_peered":"2024-04-25T08:56:18.207533+0000","last_unstale":"2024-04-25T08:56:18.211594+0000","last_undegraded":"2024-04-25T08:56:18.211594+0000","last_fullsized":"2024-04-25T08:56:18.211594+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:05.251215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195447+0000","last_change":"2024-04-25T08:56:18.201722+0000","last_active":"2024-04-25T08:56:19.195447+0000","last_peered":"2024-04-25T08:56:19.195447+0000","last_clean":"2024-04-25T08:56:19.195447+0000","last_became_active":"2024-04-25T08:56:18.201409+0000","last_became_peered":"2024-04-25T08:56:18.201409+0000","last_unstale":"2024-04-25T08:56:19.195447+0000","last_undegraded":"2024-04-25T08:56:19.195447+0000","last_fullsized":"2024-04-25T08:56:19.195447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:02.179797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222016+0000","last_change":"2024-04-25T08:56:18.218239+0000","last_active":"2024-04-25T08:56:18.222016+0000","last_peered":"2024-04-25T08:56:18.222016+0000","last_clean":"2024-04-25T08:56:18.222016+0000","last_became_active":"2024-04-25T08:56:18.217954+0000","last_became_peered":"2024-04-25T08:56:18.217954+0000","last_unstale":"2024-04-25T08:56:18.222016+0000","last_undegraded":"2024-04-25T08:56:18.222016+0000","last_fullsized":"2024-04-25T08:56:18.222016+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:21.994569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.219587+0000","last_change":"2024-04-25T08:56:18.211963+0000","last_active":"2024-04-25T08:56:18.219587+0000","last_peered":"2024-04-25T08:56:18.219587+0000","last_clean":"2024-04-25T08:56:18.219587+0000","last_became_active":"2024-04-25T08:56:18.211651+0000","last_became_peered":"2024-04-25T08:56:18.211651+0000","last_unstale":"2024-04-25T08:56:18.219587+0000","last_undegraded":"2024-04-25T08:56:18.219587+0000","last_fullsized":"2024-04-25T08:56:18.219587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:13.460350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196604+0000","last_change":"2024-04-25T08:56:18.218212+0000","last_active":"2024-04-25T08:56:19.196604+0000","last_peered":"2024-04-25T08:56:19.196604+0000","last_clean":"2024-04-25T08:56:19.196604+0000","last_became_active":"2024-04-25T08:56:18.217523+0000","last_became_peered":"2024-04-25T08:56:18.217523+0000","last_unstale":"2024-04-25T08:56:19.196604+0000","last_undegraded":"2024-04-25T08:56:19.196604+0000","last_fullsized":"2024-04-25T08:56:19.196604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:12.024798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.212508+0000","last_change":"2024-04-25T08:56:18.210940+0000","last_active":"2024-04-25T08:56:18.212508+0000","last_peered":"2024-04-25T08:56:18.212508+0000","last_clean":"2024-04-25T08:56:18.212508+0000","last_became_active":"2024-04-25T08:56:18.210548+0000","last_became_peered":"2024-04-25T08:56:18.210548+0000","last_unstale":"2024-04-25T08:56:18.212508+0000","last_undegraded":"2024-04-25T08:56:18.212508+0000","last_fullsized":"2024-04-25T08:56:18.212508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:51.274029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.216299+0000","last_change":"2024-04-25T08:56:18.215336+0000","last_active":"2024-04-25T08:56:18.216299+0000","last_peered":"2024-04-25T08:56:18.216299+0000","last_clean":"2024-04-25T08:56:18.216299+0000","last_became_active":"2024-04-25T08:56:18.214922+0000","last_became_peered":"2024-04-25T08:56:18.214922+0000","last_unstale":"2024-04-25T08:56:18.216299+0000","last_undegraded":"2024-04-25T08:56:18.216299+0000","last_fullsized":"2024-04-25T08:56:18.216299+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:00.693003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359208+0000","last_change":"2024-04-25T08:56:18.216067+0000","last_active":"2024-04-25T08:56:19.359208+0000","last_peered":"2024-04-25T08:56:19.359208+0000","last_clean":"2024-04-25T08:56:19.359208+0000","last_became_active":"2024-04-25T08:56:18.215750+0000","last_became_peered":"2024-04-25T08:56:18.215750+0000","last_unstale":"2024-04-25T08:56:19.359208+0000","last_undegraded":"2024-04-25T08:56:19.359208+0000","last_fullsized":"2024-04-25T08:56:19.359208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196193+0000","last_change":"2024-04-25T08:56:18.205704+0000","last_active":"2024-04-25T08:56:19.196193+0000","last_peered":"2024-04-25T08:56:19.196193+0000","last_clean":"2024-04-25T08:56:19.196193+0000","last_became_active":"2024-04-25T08:56:18.205432+0000","last_became_peered":"2024-04-25T08:56:18.205432+0000","last_unstale":"2024-04-25T08:56:19.196193+0000","last_undegraded":"2024-04-25T08:56:19.196193+0000","last_fullsized":"2024-04-25T08:56:19.196193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:50.798086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481529+0000","last_change":"2024-04-25T08:56:18.220201+0000","last_active":"2024-04-25T08:56:19.481529+0000","last_peered":"2024-04-25T08:56:19.481529+0000","last_clean":"2024-04-25T08:56:19.481529+0000","last_became_active":"2024-04-25T08:56:18.219890+0000","last_became_peered":"2024-04-25T08:56:18.219890+0000","last_unstale":"2024-04-25T08:56:19.481529+0000","last_undegraded":"2024-04-25T08:56:19.481529+0000","last_fullsized":"2024-04-25T08:56:19.481529+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.388864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196996+0000","last_change":"2024-04-25T08:56:18.216067+0000","last_active":"2024-04-25T08:56:19.196996+0000","last_peered":"2024-04-25T08:56:19.196996+0000","last_clean":"2024-04-25T08:56:19.196996+0000","last_became_active":"2024-04-25T08:56:18.215793+0000","last_became_peered":"2024-04-25T08:56:18.215793+0000","last_unstale":"2024-04-25T08:56:19.196996+0000","last_undegraded":"2024-04-25T08:56:19.196996+0000","last_fullsized":"2024-04-25T08:56:19.196996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:27.576959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196082+0000","last_change":"2024-04-25T08:56:18.221843+0000","last_active":"2024-04-25T08:56:19.196082+0000","last_peered":"2024-04-25T08:56:19.196082+0000","last_clean":"2024-04-25T08:56:19.196082+0000","last_became_active":"2024-04-25T08:56:18.221585+0000","last_became_peered":"2024-04-25T08:56:18.221585+0000","last_unstale":"2024-04-25T08:56:19.196082+0000","last_undegraded":"2024-04-25T08:56:19.196082+0000","last_fullsized":"2024-04-25T08:56:19.196082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:54.520655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481188+0000","last_change":"2024-04-25T08:56:18.208528+0000","last_active":"2024-04-25T08:56:19.481188+0000","last_peered":"2024-04-25T08:56:19.481188+0000","last_clean":"2024-04-25T08:56:19.481188+0000","last_became_active":"2024-04-25T08:56:18.208223+0000","last_became_peered":"2024-04-25T08:56:18.208223+0000","last_unstale":"2024-04-25T08:56:19.481188+0000","last_undegraded":"2024-04-25T08:56:19.481188+0000","last_fullsized":"2024-04-25T08:56:19.481188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:58.962486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195551+0000","last_change":"2024-04-25T08:56:18.211520+0000","last_active":"2024-04-25T08:56:19.195551+0000","last_peered":"2024-04-25T08:56:19.195551+0000","last_clean":"2024-04-25T08:56:19.195551+0000","last_became_active":"2024-04-25T08:56:18.211171+0000","last_became_peered":"2024-04-25T08:56:18.211171+0000","last_unstale":"2024-04-25T08:56:19.195551+0000","last_undegraded":"2024-04-25T08:56:19.195551+0000","last_fullsized":"2024-04-25T08:56:19.195551+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:56.175100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481207+0000","last_change":"2024-04-25T08:56:18.223242+0000","last_active":"2024-04-25T08:56:19.481207+0000","last_peered":"2024-04-25T08:56:19.481207+0000","last_clean":"2024-04-25T08:56:19.481207+0000","last_became_active":"2024-04-25T08:56:18.222694+0000","last_became_peered":"2024-04-25T08:56:18.222694+0000","last_unstale":"2024-04-25T08:56:19.481207+0000","last_undegraded":"2024-04-25T08:56:19.481207+0000","last_fullsized":"2024-04-25T08:56:19.481207+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:47.866218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196301+0000","last_change":"2024-04-25T08:56:18.217082+0000","last_active":"2024-04-25T08:56:19.196301+0000","last_peered":"2024-04-25T08:56:19.196301+0000","last_clean":"2024-04-25T08:56:19.196301+0000","last_became_active":"2024-04-25T08:56:18.216639+0000","last_became_peered":"2024-04-25T08:56:18.216639+0000","last_unstale":"2024-04-25T08:56:19.196301+0000","last_undegraded":"2024-04-25T08:56:19.196301+0000","last_fullsized":"2024-04-25T08:56:19.196301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:39.841298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197280+0000","last_change":"2024-04-25T08:56:18.215507+0000","last_active":"2024-04-25T08:56:19.197280+0000","last_peered":"2024-04-25T08:56:19.197280+0000","last_clean":"2024-04-25T08:56:19.197280+0000","last_became_active":"2024-04-25T08:56:18.215224+0000","last_became_peered":"2024-04-25T08:56:18.215224+0000","last_unstale":"2024-04-25T08:56:19.197280+0000","last_undegraded":"2024-04-25T08:56:19.197280+0000","last_fullsized":"2024-04-25T08:56:19.197280+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:12.624706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.213831+0000","last_change":"2024-04-25T08:56:18.207047+0000","last_active":"2024-04-25T08:56:18.213831+0000","last_peered":"2024-04-25T08:56:18.213831+0000","last_clean":"2024-04-25T08:56:18.213831+0000","last_became_active":"2024-04-25T08:56:18.206749+0000","last_became_peered":"2024-04-25T08:56:18.206749+0000","last_unstale":"2024-04-25T08:56:18.213831+0000","last_undegraded":"2024-04-25T08:56:18.213831+0000","last_fullsized":"2024-04-25T08:56:18.213831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:33.200201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359355+0000","last_change":"2024-04-25T08:56:18.216568+0000","last_active":"2024-04-25T08:56:19.359355+0000","last_peered":"2024-04-25T08:56:19.359355+0000","last_clean":"2024-04-25T08:56:19.359355+0000","last_became_active":"2024-04-25T08:56:18.215965+0000","last_became_peered":"2024-04-25T08:56:18.215965+0000","last_unstale":"2024-04-25T08:56:19.359355+0000","last_undegraded":"2024-04-25T08:56:19.359355+0000","last_fullsized":"2024-04-25T08:56:19.359355+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197235+0000","last_change":"2024-04-25T08:56:18.219428+0000","last_active":"2024-04-25T08:56:19.197235+0000","last_peered":"2024-04-25T08:56:19.197235+0000","last_clean":"2024-04-25T08:56:19.197235+0000","last_became_active":"2024-04-25T08:56:18.218946+0000","last_became_peered":"2024-04-25T08:56:18.218946+0000","last_unstale":"2024-04-25T08:56:19.197235+0000","last_undegraded":"2024-04-25T08:56:19.197235+0000","last_fullsized":"2024-04-25T08:56:19.197235+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:17.124211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196368+0000","last_change":"2024-04-25T08:56:18.209922+0000","last_active":"2024-04-25T08:56:19.196368+0000","last_peered":"2024-04-25T08:56:19.196368+0000","last_clean":"2024-04-25T08:56:19.196368+0000","last_became_active":"2024-04-25T08:56:18.208216+0000","last_became_peered":"2024-04-25T08:56:18.208216+0000","last_unstale":"2024-04-25T08:56:19.196368+0000","last_undegraded":"2024-04-25T08:56:19.196368+0000","last_fullsized":"2024-04-25T08:56:19.196368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:54.752262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481129+0000","last_change":"2024-04-25T08:56:18.215840+0000","last_active":"2024-04-25T08:56:19.481129+0000","last_peered":"2024-04-25T08:56:19.481129+0000","last_clean":"2024-04-25T08:56:19.481129+0000","last_became_active":"2024-04-25T08:56:18.214137+0000","last_became_peered":"2024-04-25T08:56:18.214137+0000","last_unstale":"2024-04-25T08:56:19.481129+0000","last_undegraded":"2024-04-25T08:56:19.481129+0000","last_fullsized":"2024-04-25T08:56:19.481129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:36.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196664+0000","last_change":"2024-04-25T08:56:18.215113+0000","last_active":"2024-04-25T08:56:19.196664+0000","last_peered":"2024-04-25T08:56:19.196664+0000","last_clean":"2024-04-25T08:56:19.196664+0000","last_became_active":"2024-04-25T08:56:18.214777+0000","last_became_peered":"2024-04-25T08:56:18.214777+0000","last_unstale":"2024-04-25T08:56:19.196664+0000","last_undegraded":"2024-04-25T08:56:19.196664+0000","last_fullsized":"2024-04-25T08:56:19.196664+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:02.932997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359476+0000","last_change":"2024-04-25T08:56:18.223089+0000","last_active":"2024-04-25T08:56:19.359476+0000","last_peered":"2024-04-25T08:56:19.359476+0000","last_clean":"2024-04-25T08:56:19.359476+0000","last_became_active":"2024-04-25T08:56:18.222727+0000","last_became_peered":"2024-04-25T08:56:18.222727+0000","last_unstale":"2024-04-25T08:56:19.359476+0000","last_undegraded":"2024-04-25T08:56:19.359476+0000","last_fullsized":"2024-04-25T08:56:19.359476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:47.361388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359468+0000","last_change":"2024-04-25T08:56:18.217780+0000","last_active":"2024-04-25T08:56:19.359468+0000","last_peered":"2024-04-25T08:56:19.359468+0000","last_clean":"2024-04-25T08:56:19.359468+0000","last_became_active":"2024-04-25T08:56:18.217411+0000","last_became_peered":"2024-04-25T08:56:18.217411+0000","last_unstale":"2024-04-25T08:56:19.359468+0000","last_undegraded":"2024-04-25T08:56:19.359468+0000","last_fullsized":"2024-04-25T08:56:19.359468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:53.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359681+0000","last_change":"2024-04-25T08:56:17.209473+0000","last_active":"2024-04-25T08:56:19.359681+0000","last_peered":"2024-04-25T08:56:19.359681+0000","last_clean":"2024-04-25T08:56:19.359681+0000","last_became_active":"2024-04-25T08:56:17.209211+0000","last_became_peered":"2024-04-25T08:56:17.209211+0000","last_unstale":"2024-04-25T08:56:19.359681+0000","last_undegraded":"2024-04-25T08:56:19.359681+0000","last_fullsized":"2024-04-25T08:56:19.359681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.024118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196283+0000","last_change":"2024-04-25T08:56:17.212441+0000","last_active":"2024-04-25T08:56:19.196283+0000","last_peered":"2024-04-25T08:56:19.196283+0000","last_clean":"2024-04-25T08:56:19.196283+0000","last_became_active":"2024-04-25T08:56:17.212105+0000","last_became_peered":"2024-04-25T08:56:17.212105+0000","last_unstale":"2024-04-25T08:56:19.196283+0000","last_undegraded":"2024-04-25T08:56:19.196283+0000","last_fullsized":"2024-04-25T08:56:19.196283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:43.080241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359476+0000","last_change":"2024-04-25T08:56:18.220153+0000","last_active":"2024-04-25T08:56:19.359476+0000","last_peered":"2024-04-25T08:56:19.359476+0000","last_clean":"2024-04-25T08:56:19.359476+0000","last_became_active":"2024-04-25T08:56:18.219814+0000","last_became_peered":"2024-04-25T08:56:18.219814+0000","last_unstale":"2024-04-25T08:56:19.359476+0000","last_undegraded":"2024-04-25T08:56:19.359476+0000","last_fullsized":"2024-04-25T08:56:19.359476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:29.370750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359572+0000","last_change":"2024-04-25T08:56:17.210018+0000","last_active":"2024-04-25T08:56:19.359572+0000","last_peered":"2024-04-25T08:56:19.359572+0000","last_clean":"2024-04-25T08:56:19.359572+0000","last_became_active":"2024-04-25T08:56:17.209032+0000","last_became_peered":"2024-04-25T08:56:17.209032+0000","last_unstale":"2024-04-25T08:56:19.359572+0000","last_undegraded":"2024-04-25T08:56:19.359572+0000","last_fullsized":"2024-04-25T08:56:19.359572+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:32.077700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359440+0000","last_change":"2024-04-25T08:56:18.223451+0000","last_active":"2024-04-25T08:56:19.359440+0000","last_peered":"2024-04-25T08:56:19.359440+0000","last_clean":"2024-04-25T08:56:19.359440+0000","last_became_active":"2024-04-25T08:56:18.223100+0000","last_became_peered":"2024-04-25T08:56:18.223100+0000","last_unstale":"2024-04-25T08:56:19.359440+0000","last_undegraded":"2024-04-25T08:56:19.359440+0000","last_fullsized":"2024-04-25T08:56:19.359440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.388864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215475+0000","last_change":"2024-04-25T08:56:17.208994+0000","last_active":"2024-04-25T08:56:18.215475+0000","last_peered":"2024-04-25T08:56:18.215475+0000","last_clean":"2024-04-25T08:56:18.215475+0000","last_became_active":"2024-04-25T08:56:17.208669+0000","last_became_peered":"2024-04-25T08:56:17.208669+0000","last_unstale":"2024-04-25T08:56:18.215475+0000","last_undegraded":"2024-04-25T08:56:18.215475+0000","last_fullsized":"2024-04-25T08:56:18.215475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:56.789554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195704+0000","last_change":"2024-04-25T08:56:18.210662+0000","last_active":"2024-04-25T08:56:19.195704+0000","last_peered":"2024-04-25T08:56:19.195704+0000","last_clean":"2024-04-25T08:56:19.195704+0000","last_became_active":"2024-04-25T08:56:18.210316+0000","last_became_peered":"2024-04-25T08:56:18.210316+0000","last_unstale":"2024-04-25T08:56:19.195704+0000","last_undegraded":"2024-04-25T08:56:19.195704+0000","last_fullsized":"2024-04-25T08:56:19.195704+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:51.409173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.212560+0000","last_change":"2024-04-25T08:56:17.217874+0000","last_active":"2024-04-25T08:56:18.212560+0000","last_peered":"2024-04-25T08:56:18.212560+0000","last_clean":"2024-04-25T08:56:18.212560+0000","last_became_active":"2024-04-25T08:56:17.217659+0000","last_became_peered":"2024-04-25T08:56:17.217659+0000","last_unstale":"2024-04-25T08:56:18.212560+0000","last_undegraded":"2024-04-25T08:56:18.212560+0000","last_fullsized":"2024-04-25T08:56:18.212560+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:53.854649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196361+0000","last_change":"2024-04-25T08:56:18.221070+0000","last_active":"2024-04-25T08:56:19.196361+0000","last_peered":"2024-04-25T08:56:19.196361+0000","last_clean":"2024-04-25T08:56:19.196361+0000","last_became_active":"2024-04-25T08:56:18.220788+0000","last_became_peered":"2024-04-25T08:56:18.220788+0000","last_unstale":"2024-04-25T08:56:19.196361+0000","last_undegraded":"2024-04-25T08:56:19.196361+0000","last_fullsized":"2024-04-25T08:56:19.196361+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:41.014505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359314+0000","last_change":"2024-04-25T08:56:17.208139+0000","last_active":"2024-04-25T08:56:19.359314+0000","last_peered":"2024-04-25T08:56:19.359314+0000","last_clean":"2024-04-25T08:56:19.359314+0000","last_became_active":"2024-04-25T08:56:17.207843+0000","last_became_peered":"2024-04-25T08:56:17.207843+0000","last_unstale":"2024-04-25T08:56:19.359314+0000","last_undegraded":"2024-04-25T08:56:19.359314+0000","last_fullsized":"2024-04-25T08:56:19.359314+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:56.789554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196397+0000","last_change":"2024-04-25T08:56:18.210083+0000","last_active":"2024-04-25T08:56:19.196397+0000","last_peered":"2024-04-25T08:56:19.196397+0000","last_clean":"2024-04-25T08:56:19.196397+0000","last_became_active":"2024-04-25T08:56:18.209783+0000","last_became_peered":"2024-04-25T08:56:18.209783+0000","last_unstale":"2024-04-25T08:56:19.196397+0000","last_undegraded":"2024-04-25T08:56:19.196397+0000","last_fullsized":"2024-04-25T08:56:19.196397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:10.794882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204581+0000","last_change":"2024-04-25T08:56:17.211340+0000","last_active":"2024-04-25T08:56:18.204581+0000","last_peered":"2024-04-25T08:56:18.204581+0000","last_clean":"2024-04-25T08:56:18.204581+0000","last_became_active":"2024-04-25T08:56:17.211002+0000","last_became_peered":"2024-04-25T08:56:17.211002+0000","last_unstale":"2024-04-25T08:56:18.204581+0000","last_undegraded":"2024-04-25T08:56:18.204581+0000","last_fullsized":"2024-04-25T08:56:18.204581+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:59.690478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195577+0000","last_change":"2024-04-25T08:56:18.205814+0000","last_active":"2024-04-25T08:56:19.195577+0000","last_peered":"2024-04-25T08:56:19.195577+0000","last_clean":"2024-04-25T08:56:19.195577+0000","last_became_active":"2024-04-25T08:56:18.205528+0000","last_became_peered":"2024-04-25T08:56:18.205528+0000","last_unstale":"2024-04-25T08:56:19.195577+0000","last_undegraded":"2024-04-25T08:56:19.195577+0000","last_fullsized":"2024-04-25T08:56:19.195577+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:07.023502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.194961+0000","last_change":"2024-04-25T08:56:17.207453+0000","last_active":"2024-04-25T08:56:18.194961+0000","last_peered":"2024-04-25T08:56:18.194961+0000","last_clean":"2024-04-25T08:56:18.194961+0000","last_became_active":"2024-04-25T08:56:17.207230+0000","last_became_peered":"2024-04-25T08:56:17.207230+0000","last_unstale":"2024-04-25T08:56:18.194961+0000","last_undegraded":"2024-04-25T08:56:18.194961+0000","last_fullsized":"2024-04-25T08:56:18.194961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:50.902995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.218097+0000","last_change":"2024-04-25T08:56:18.216487+0000","last_active":"2024-04-25T08:56:18.218097+0000","last_peered":"2024-04-25T08:56:18.218097+0000","last_clean":"2024-04-25T08:56:18.218097+0000","last_became_active":"2024-04-25T08:56:18.215687+0000","last_became_peered":"2024-04-25T08:56:18.215687+0000","last_unstale":"2024-04-25T08:56:18.218097+0000","last_undegraded":"2024-04-25T08:56:18.218097+0000","last_fullsized":"2024-04-25T08:56:18.218097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:12.416991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481604+0000","last_change":"2024-04-25T08:56:17.202622+0000","last_active":"2024-04-25T08:56:19.481604+0000","last_peered":"2024-04-25T08:56:19.481604+0000","last_clean":"2024-04-25T08:56:19.481604+0000","last_became_active":"2024-04-25T08:56:17.202334+0000","last_became_peered":"2024-04-25T08:56:17.202334+0000","last_unstale":"2024-04-25T08:56:19.481604+0000","last_undegraded":"2024-04-25T08:56:19.481604+0000","last_fullsized":"2024-04-25T08:56:19.481604+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.248690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481627+0000","last_change":"2024-04-25T08:56:18.223478+0000","last_active":"2024-04-25T08:56:19.481627+0000","last_peered":"2024-04-25T08:56:19.481627+0000","last_clean":"2024-04-25T08:56:19.481627+0000","last_became_active":"2024-04-25T08:56:18.223262+0000","last_became_peered":"2024-04-25T08:56:18.223262+0000","last_unstale":"2024-04-25T08:56:19.481627+0000","last_undegraded":"2024-04-25T08:56:19.481627+0000","last_fullsized":"2024-04-25T08:56:19.481627+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:47.361388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196303+0000","last_change":"2024-04-25T08:56:17.218177+0000","last_active":"2024-04-25T08:56:19.196303+0000","last_peered":"2024-04-25T08:56:19.196303+0000","last_clean":"2024-04-25T08:56:19.196303+0000","last_became_active":"2024-04-25T08:56:17.217859+0000","last_became_peered":"2024-04-25T08:56:17.217859+0000","last_unstale":"2024-04-25T08:56:19.196303+0000","last_undegraded":"2024-04-25T08:56:19.196303+0000","last_fullsized":"2024-04-25T08:56:19.196303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:01.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481558+0000","last_change":"2024-04-25T08:56:17.209000+0000","last_active":"2024-04-25T08:56:19.481558+0000","last_peered":"2024-04-25T08:56:19.481558+0000","last_clean":"2024-04-25T08:56:19.481558+0000","last_became_active":"2024-04-25T08:56:17.208727+0000","last_became_peered":"2024-04-25T08:56:17.208727+0000","last_unstale":"2024-04-25T08:56:19.481558+0000","last_undegraded":"2024-04-25T08:56:19.481558+0000","last_fullsized":"2024-04-25T08:56:19.481558+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:50.271504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481437+0000","last_change":"2024-04-25T08:56:18.220854+0000","last_active":"2024-04-25T08:56:19.481437+0000","last_peered":"2024-04-25T08:56:19.481437+0000","last_clean":"2024-04-25T08:56:19.481437+0000","last_became_active":"2024-04-25T08:56:18.220406+0000","last_became_peered":"2024-04-25T08:56:18.220406+0000","last_unstale":"2024-04-25T08:56:19.481437+0000","last_undegraded":"2024-04-25T08:56:19.481437+0000","last_fullsized":"2024-04-25T08:56:19.481437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:10.524577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.233028+0000","last_change":"2024-04-25T08:56:17.199981+0000","last_active":"2024-04-25T08:56:18.233028+0000","last_peered":"2024-04-25T08:56:18.233028+0000","last_clean":"2024-04-25T08:56:18.233028+0000","last_became_active":"2024-04-25T08:56:17.199667+0000","last_became_peered":"2024-04-25T08:56:17.199667+0000","last_unstale":"2024-04-25T08:56:18.233028+0000","last_undegraded":"2024-04-25T08:56:18.233028+0000","last_fullsized":"2024-04-25T08:56:18.233028+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:19.999889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.225164+0000","last_change":"2024-04-25T08:56:18.221416+0000","last_active":"2024-04-25T08:56:18.225164+0000","last_peered":"2024-04-25T08:56:18.225164+0000","last_clean":"2024-04-25T08:56:18.225164+0000","last_became_active":"2024-04-25T08:56:18.221196+0000","last_became_peered":"2024-04-25T08:56:18.221196+0000","last_unstale":"2024-04-25T08:56:18.225164+0000","last_undegraded":"2024-04-25T08:56:18.225164+0000","last_fullsized":"2024-04-25T08:56:18.225164+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:02.980311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196227+0000","last_change":"2024-04-25T08:56:17.218664+0000","last_active":"2024-04-25T08:56:19.196227+0000","last_peered":"2024-04-25T08:56:19.196227+0000","last_clean":"2024-04-25T08:56:19.196227+0000","last_became_active":"2024-04-25T08:56:17.218365+0000","last_became_peered":"2024-04-25T08:56:17.218365+0000","last_unstale":"2024-04-25T08:56:19.196227+0000","last_undegraded":"2024-04-25T08:56:19.196227+0000","last_fullsized":"2024-04-25T08:56:19.196227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:39.098749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481296+0000","last_change":"2024-04-25T08:56:18.212351+0000","last_active":"2024-04-25T08:56:19.481296+0000","last_peered":"2024-04-25T08:56:19.481296+0000","last_clean":"2024-04-25T08:56:19.481296+0000","last_became_active":"2024-04-25T08:56:18.212075+0000","last_became_peered":"2024-04-25T08:56:18.212075+0000","last_unstale":"2024-04-25T08:56:19.481296+0000","last_undegraded":"2024-04-25T08:56:19.481296+0000","last_fullsized":"2024-04-25T08:56:19.481296+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196473+0000","last_change":"2024-04-25T08:56:17.200568+0000","last_active":"2024-04-25T08:56:19.196473+0000","last_peered":"2024-04-25T08:56:19.196473+0000","last_clean":"2024-04-25T08:56:19.196473+0000","last_became_active":"2024-04-25T08:56:17.200242+0000","last_became_peered":"2024-04-25T08:56:17.200242+0000","last_unstale":"2024-04-25T08:56:19.196473+0000","last_undegraded":"2024-04-25T08:56:19.196473+0000","last_fullsized":"2024-04-25T08:56:19.196473+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:57.237578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215172+0000","last_change":"2024-04-25T08:56:18.213076+0000","last_active":"2024-04-25T08:56:18.215172+0000","last_peered":"2024-04-25T08:56:18.215172+0000","last_clean":"2024-04-25T08:56:18.215172+0000","last_became_active":"2024-04-25T08:56:18.212746+0000","last_became_peered":"2024-04-25T08:56:18.212746+0000","last_unstale":"2024-04-25T08:56:18.215172+0000","last_undegraded":"2024-04-25T08:56:18.215172+0000","last_fullsized":"2024-04-25T08:56:18.215172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:22.026643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204803+0000","last_change":"2024-04-25T08:56:17.209077+0000","last_active":"2024-04-25T08:56:18.204803+0000","last_peered":"2024-04-25T08:56:18.204803+0000","last_clean":"2024-04-25T08:56:18.204803+0000","last_became_active":"2024-04-25T08:56:17.208079+0000","last_became_peered":"2024-04-25T08:56:17.208079+0000","last_unstale":"2024-04-25T08:56:18.204803+0000","last_undegraded":"2024-04-25T08:56:18.204803+0000","last_fullsized":"2024-04-25T08:56:18.204803+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:11.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481202+0000","last_change":"2024-04-25T08:56:18.223135+0000","last_active":"2024-04-25T08:56:19.481202+0000","last_peered":"2024-04-25T08:56:19.481202+0000","last_clean":"2024-04-25T08:56:19.481202+0000","last_became_active":"2024-04-25T08:56:18.222867+0000","last_became_peered":"2024-04-25T08:56:18.222867+0000","last_unstale":"2024-04-25T08:56:19.481202+0000","last_undegraded":"2024-04-25T08:56:19.481202+0000","last_fullsized":"2024-04-25T08:56:19.481202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:18.749861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481015+0000","last_change":"2024-04-25T08:56:17.209066+0000","last_active":"2024-04-25T08:56:19.481015+0000","last_peered":"2024-04-25T08:56:19.481015+0000","last_clean":"2024-04-25T08:56:19.481015+0000","last_became_active":"2024-04-25T08:56:17.208841+0000","last_became_peered":"2024-04-25T08:56:17.208841+0000","last_unstale":"2024-04-25T08:56:19.481015+0000","last_undegraded":"2024-04-25T08:56:19.481015+0000","last_fullsized":"2024-04-25T08:56:19.481015+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:21.082806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481564+0000","last_change":"2024-04-25T08:56:18.215974+0000","last_active":"2024-04-25T08:56:19.481564+0000","last_peered":"2024-04-25T08:56:19.481564+0000","last_clean":"2024-04-25T08:56:19.481564+0000","last_became_active":"2024-04-25T08:56:18.215532+0000","last_became_peered":"2024-04-25T08:56:18.215532+0000","last_unstale":"2024-04-25T08:56:19.481564+0000","last_undegraded":"2024-04-25T08:56:19.481564+0000","last_fullsized":"2024-04-25T08:56:19.481564+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:29.370750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196574+0000","last_change":"2024-04-25T08:56:17.218282+0000","last_active":"2024-04-25T08:56:19.196574+0000","last_peered":"2024-04-25T08:56:19.196574+0000","last_clean":"2024-04-25T08:56:19.196574+0000","last_became_active":"2024-04-25T08:56:17.217970+0000","last_became_peered":"2024-04-25T08:56:17.217970+0000","last_unstale":"2024-04-25T08:56:19.196574+0000","last_undegraded":"2024-04-25T08:56:19.196574+0000","last_fullsized":"2024-04-25T08:56:19.196574+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:57.959960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.225552+0000","last_change":"2024-04-25T08:56:18.222912+0000","last_active":"2024-04-25T08:56:18.225552+0000","last_peered":"2024-04-25T08:56:18.225552+0000","last_clean":"2024-04-25T08:56:18.225552+0000","last_became_active":"2024-04-25T08:56:18.222609+0000","last_became_peered":"2024-04-25T08:56:18.222609+0000","last_unstale":"2024-04-25T08:56:18.225552+0000","last_undegraded":"2024-04-25T08:56:18.225552+0000","last_fullsized":"2024-04-25T08:56:18.225552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:36.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359576+0000","last_change":"2024-04-25T08:56:17.217247+0000","last_active":"2024-04-25T08:56:19.359576+0000","last_peered":"2024-04-25T08:56:19.359576+0000","last_clean":"2024-04-25T08:56:19.359576+0000","last_became_active":"2024-04-25T08:56:17.216896+0000","last_became_peered":"2024-04-25T08:56:17.216896+0000","last_unstale":"2024-04-25T08:56:19.359576+0000","last_undegraded":"2024-04-25T08:56:19.359576+0000","last_fullsized":"2024-04-25T08:56:19.359576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:11.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196124+0000","last_change":"2024-04-25T08:56:18.202536+0000","last_active":"2024-04-25T08:56:19.196124+0000","last_peered":"2024-04-25T08:56:19.196124+0000","last_clean":"2024-04-25T08:56:19.196124+0000","last_became_active":"2024-04-25T08:56:18.202235+0000","last_became_peered":"2024-04-25T08:56:18.202235+0000","last_unstale":"2024-04-25T08:56:19.196124+0000","last_undegraded":"2024-04-25T08:56:19.196124+0000","last_fullsized":"2024-04-25T08:56:19.196124+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:32.018334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215666+0000","last_change":"2024-04-25T08:56:17.205551+0000","last_active":"2024-04-25T08:56:18.215666+0000","last_peered":"2024-04-25T08:56:18.215666+0000","last_clean":"2024-04-25T08:56:18.215666+0000","last_became_active":"2024-04-25T08:56:17.205230+0000","last_became_peered":"2024-04-25T08:56:17.205230+0000","last_unstale":"2024-04-25T08:56:18.215666+0000","last_undegraded":"2024-04-25T08:56:18.215666+0000","last_fullsized":"2024-04-25T08:56:18.215666+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:20.992044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481566+0000","last_change":"2024-04-25T08:56:18.220992+0000","last_active":"2024-04-25T08:56:19.481566+0000","last_peered":"2024-04-25T08:56:19.481566+0000","last_clean":"2024-04-25T08:56:19.481566+0000","last_became_active":"2024-04-25T08:56:18.220716+0000","last_became_peered":"2024-04-25T08:56:18.220716+0000","last_unstale":"2024-04-25T08:56:19.481566+0000","last_undegraded":"2024-04-25T08:56:19.481566+0000","last_fullsized":"2024-04-25T08:56:19.481566+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:53.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359615+0000","last_change":"2024-04-25T08:56:17.207716+0000","last_active":"2024-04-25T08:56:19.359615+0000","last_peered":"2024-04-25T08:56:19.359615+0000","last_clean":"2024-04-25T08:56:19.359615+0000","last_became_active":"2024-04-25T08:56:17.207377+0000","last_became_peered":"2024-04-25T08:56:17.207377+0000","last_unstale":"2024-04-25T08:56:19.359615+0000","last_undegraded":"2024-04-25T08:56:19.359615+0000","last_fullsized":"2024-04-25T08:56:19.359615+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:59.690478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222580+0000","last_change":"2024-04-25T08:56:18.214828+0000","last_active":"2024-04-25T08:56:18.222580+0000","last_peered":"2024-04-25T08:56:18.222580+0000","last_clean":"2024-04-25T08:56:18.222580+0000","last_became_active":"2024-04-25T08:56:18.214546+0000","last_became_peered":"2024-04-25T08:56:18.214546+0000","last_unstale":"2024-04-25T08:56:18.222580+0000","last_undegraded":"2024-04-25T08:56:18.222580+0000","last_fullsized":"2024-04-25T08:56:18.222580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:44.082766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196468+0000","last_change":"2024-04-25T08:56:17.211265+0000","last_active":"2024-04-25T08:56:19.196468+0000","last_peered":"2024-04-25T08:56:19.196468+0000","last_clean":"2024-04-25T08:56:19.196468+0000","last_became_active":"2024-04-25T08:56:17.210943+0000","last_became_peered":"2024-04-25T08:56:17.210943+0000","last_unstale":"2024-04-25T08:56:19.196468+0000","last_undegraded":"2024-04-25T08:56:19.196468+0000","last_fullsized":"2024-04-25T08:56:19.196468+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:35.063530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359715+0000","last_change":"2024-04-25T08:56:18.218361+0000","last_active":"2024-04-25T08:56:19.359715+0000","last_peered":"2024-04-25T08:56:19.359715+0000","last_clean":"2024-04-25T08:56:19.359715+0000","last_became_active":"2024-04-25T08:56:18.218070+0000","last_became_peered":"2024-04-25T08:56:18.218070+0000","last_unstale":"2024-04-25T08:56:19.359715+0000","last_undegraded":"2024-04-25T08:56:19.359715+0000","last_fullsized":"2024-04-25T08:56:19.359715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:07.045007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.190673+0000","last_change":"2024-04-25T08:56:16.190673+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.190673+0000","last_undegraded":"2024-04-25T08:56:16.190673+0000","last_fullsized":"2024-04-25T08:56:16.190673+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359223+0000","last_change":"2024-04-25T08:56:18.218040+0000","last_active":"2024-04-25T08:56:19.359223+0000","last_peered":"2024-04-25T08:56:19.359223+0000","last_clean":"2024-04-25T08:56:19.359223+0000","last_became_active":"2024-04-25T08:56:18.217711+0000","last_became_peered":"2024-04-25T08:56:18.217711+0000","last_unstale":"2024-04-25T08:56:19.359223+0000","last_undegraded":"2024-04-25T08:56:19.359223+0000","last_fullsized":"2024-04-25T08:56:19.359223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:34:03.547004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204576+0000","last_change":"2024-04-25T08:56:17.210094+0000","last_active":"2024-04-25T08:56:18.204576+0000","last_peered":"2024-04-25T08:56:18.204576+0000","last_clean":"2024-04-25T08:56:18.204576+0000","last_became_active":"2024-04-25T08:56:17.209773+0000","last_became_peered":"2024-04-25T08:56:17.209773+0000","last_unstale":"2024-04-25T08:56:18.204576+0000","last_undegraded":"2024-04-25T08:56:18.204576+0000","last_fullsized":"2024-04-25T08:56:18.204576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.024118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222599+0000","last_change":"2024-04-25T08:56:18.215521+0000","last_active":"2024-04-25T08:56:18.222599+0000","last_peered":"2024-04-25T08:56:18.222599+0000","last_clean":"2024-04-25T08:56:18.222599+0000","last_became_active":"2024-04-25T08:56:18.215222+0000","last_became_peered":"2024-04-25T08:56:18.215222+0000","last_unstale":"2024-04-25T08:56:18.222599+0000","last_undegraded":"2024-04-25T08:56:18.222599+0000","last_fullsized":"2024-04-25T08:56:18.222599+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:40.101275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.189457+0000","last_change":"2024-04-25T08:56:16.189457+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.189457+0000","last_undegraded":"2024-04-25T08:56:16.189457+0000","last_fullsized":"2024-04-25T08:56:16.189457+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222791+0000","last_change":"2024-04-25T08:56:18.213570+0000","last_active":"2024-04-25T08:56:18.222791+0000","last_peered":"2024-04-25T08:56:18.222791+0000","last_clean":"2024-04-25T08:56:18.222791+0000","last_became_active":"2024-04-25T08:56:18.212104+0000","last_became_peered":"2024-04-25T08:56:18.212104+0000","last_unstale":"2024-04-25T08:56:18.222791+0000","last_undegraded":"2024-04-25T08:56:18.222791+0000","last_fullsized":"2024-04-25T08:56:18.222791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:26.179109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359605+0000","last_change":"2024-04-25T08:56:17.208227+0000","last_active":"2024-04-25T08:56:19.359605+0000","last_peered":"2024-04-25T08:56:19.359605+0000","last_clean":"2024-04-25T08:56:19.359605+0000","last_became_active":"2024-04-25T08:56:17.207936+0000","last_became_peered":"2024-04-25T08:56:17.207936+0000","last_unstale":"2024-04-25T08:56:19.359605+0000","last_undegraded":"2024-04-25T08:56:19.359605+0000","last_fullsized":"2024-04-25T08:56:19.359605+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:20.992044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196657+0000","last_change":"2024-04-25T08:56:17.199076+0000","last_active":"2024-04-25T08:56:19.196657+0000","last_peered":"2024-04-25T08:56:19.196657+0000","last_clean":"2024-04-25T08:56:19.196657+0000","last_became_active":"2024-04-25T08:56:17.198759+0000","last_became_peered":"2024-04-25T08:56:17.198759+0000","last_unstale":"2024-04-25T08:56:19.196657+0000","last_undegraded":"2024-04-25T08:56:19.196657+0000","last_fullsized":"2024-04-25T08:56:19.196657+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:35.077938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359501+0000","last_change":"2024-04-25T08:56:18.223807+0000","last_active":"2024-04-25T08:56:19.359501+0000","last_peered":"2024-04-25T08:56:19.359501+0000","last_clean":"2024-04-25T08:56:19.359501+0000","last_became_active":"2024-04-25T08:56:18.223515+0000","last_became_peered":"2024-04-25T08:56:18.223515+0000","last_unstale":"2024-04-25T08:56:19.359501+0000","last_undegraded":"2024-04-25T08:56:19.359501+0000","last_fullsized":"2024-04-25T08:56:19.359501+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:57.277364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.205872+0000","last_change":"2024-04-25T08:56:17.208356+0000","last_active":"2024-04-25T08:56:18.205872+0000","last_peered":"2024-04-25T08:56:18.205872+0000","last_clean":"2024-04-25T08:56:18.205872+0000","last_became_active":"2024-04-25T08:56:17.208086+0000","last_became_peered":"2024-04-25T08:56:17.208086+0000","last_unstale":"2024-04-25T08:56:18.205872+0000","last_undegraded":"2024-04-25T08:56:18.205872+0000","last_fullsized":"2024-04-25T08:56:18.205872+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:32.077700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195840+0000","last_change":"2024-04-25T08:56:18.207334+0000","last_active":"2024-04-25T08:56:19.195840+0000","last_peered":"2024-04-25T08:56:19.195840+0000","last_clean":"2024-04-25T08:56:19.195840+0000","last_became_active":"2024-04-25T08:56:18.206799+0000","last_became_peered":"2024-04-25T08:56:18.206799+0000","last_unstale":"2024-04-25T08:56:19.195840+0000","last_undegraded":"2024-04-25T08:56:19.195840+0000","last_fullsized":"2024-04-25T08:56:19.195840+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:11.835152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.189157+0000","last_change":"2024-04-25T08:56:16.189157+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.189157+0000","last_undegraded":"2024-04-25T08:56:16.189157+0000","last_fullsized":"2024-04-25T08:56:16.189157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481425+0000","last_change":"2024-04-25T08:56:18.222650+0000","last_active":"2024-04-25T08:56:19.481425+0000","last_peered":"2024-04-25T08:56:19.481425+0000","last_clean":"2024-04-25T08:56:19.481425+0000","last_became_active":"2024-04-25T08:56:18.222247+0000","last_became_peered":"2024-04-25T08:56:18.222247+0000","last_unstale":"2024-04-25T08:56:19.481425+0000","last_undegraded":"2024-04-25T08:56:19.481425+0000","last_fullsized":"2024-04-25T08:56:19.481425+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.196651+0000","last_change":"2024-04-25T08:56:17.202547+0000","last_active":"2024-04-25T08:56:18.196651+0000","last_peered":"2024-04-25T08:56:18.196651+0000","last_clean":"2024-04-25T08:56:18.196651+0000","last_became_active":"2024-04-25T08:56:17.202228+0000","last_became_peered":"2024-04-25T08:56:17.202228+0000","last_unstale":"2024-04-25T08:56:18.196651+0000","last_undegraded":"2024-04-25T08:56:18.196651+0000","last_fullsized":"2024-04-25T08:56:18.196651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:21.082806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:56:17.182918+0000","last_change":"2024-04-25T08:56:17.182918+0000","last_active":"2024-04-25T08:56:17.182918+0000","last_peered":"2024-04-25T08:56:17.182918+0000","last_clean":"2024-04-25T08:56:17.182918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:17.182918+0000","last_undegraded":"2024-04-25T08:56:17.182918+0000","last_fullsized":"2024-04-25T08:56:17.182918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-04-25T08:56:16.189131+0000","last_change":"2024-04-25T08:56:16.189131+0000","last_active":"2024-04-25T08:56:16.180393+0000","last_peered":"2024-04-25T08:56:16.180393+0000","last_clean":"2024-04-25T08:56:16.180393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:56:16.189131+0000","last_undegraded":"2024-04-25T08:56:16.189131+0000","last_fullsized":"2024-04-25T08:56:16.189131+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195622+0000","last_change":"2024-04-25T08:56:18.206772+0000","last_active":"2024-04-25T08:56:19.195622+0000","last_peered":"2024-04-25T08:56:19.195622+0000","last_clean":"2024-04-25T08:56:19.195622+0000","last_became_active":"2024-04-25T08:56:18.206478+0000","last_became_peered":"2024-04-25T08:56:18.206478+0000","last_unstale":"2024-04-25T08:56:19.195622+0000","last_undegraded":"2024-04-25T08:56:19.195622+0000","last_fullsized":"2024-04-25T08:56:19.195622+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:38.623368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195622+0000","last_change":"2024-04-25T08:56:17.212487+0000","last_active":"2024-04-25T08:56:19.195622+0000","last_peered":"2024-04-25T08:56:19.195622+0000","last_clean":"2024-04-25T08:56:19.195622+0000","last_became_active":"2024-04-25T08:56:17.212169+0000","last_became_peered":"2024-04-25T08:56:17.212169+0000","last_unstale":"2024-04-25T08:56:19.195622+0000","last_undegraded":"2024-04-25T08:56:19.195622+0000","last_fullsized":"2024-04-25T08:56:19.195622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:54.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195510+0000","last_change":"2024-04-25T08:56:18.217388+0000","last_active":"2024-04-25T08:56:19.195510+0000","last_peered":"2024-04-25T08:56:19.195510+0000","last_clean":"2024-04-25T08:56:19.195510+0000","last_became_active":"2024-04-25T08:56:18.217118+0000","last_became_peered":"2024-04-25T08:56:18.217118+0000","last_unstale":"2024-04-25T08:56:19.195510+0000","last_undegraded":"2024-04-25T08:56:19.195510+0000","last_fullsized":"2024-04-25T08:56:19.195510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:55.113303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196321+0000","last_change":"2024-04-25T08:56:17.210100+0000","last_active":"2024-04-25T08:56:19.196321+0000","last_peered":"2024-04-25T08:56:19.196321+0000","last_clean":"2024-04-25T08:56:19.196321+0000","last_became_active":"2024-04-25T08:56:17.209722+0000","last_became_peered":"2024-04-25T08:56:17.209722+0000","last_unstale":"2024-04-25T08:56:19.196321+0000","last_undegraded":"2024-04-25T08:56:19.196321+0000","last_fullsized":"2024-04-25T08:56:19.196321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:35.041624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":240,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.480994+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:56:19.480994+0000","last_peered":"2024-04-25T08:56:19.480994+0000","last_clean":"2024-04-25T08:56:19.480994+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:56:19.480994+0000","last_undegraded":"2024-04-25T08:56:19.480994+0000","last_fullsized":"2024-04-25T08:56:19.480994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28308,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343532,"statfs":{"total":96636764160,"available":96607776768,"internally_reserved":0,"allocated":1314816,"data_stored":884994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":712704,"data_stored":294466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":295118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":724992,"data_stored":296078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":300822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":300822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1323008,"data_stored":887028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":688128,"data_stored":281424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:56:21.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-04-25T08:56:21.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:56:17.182918+0000', 'last_change': '2024-04-25T08:56:17.182918+0000', 'last_active': '2024-04-25T08:56:17.182918+0000', 'last_peered': '2024-04-25T08:56:17.182918+0000', 'last_clean': '2024-04-25T08:56:17.182918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:56:17.182918+0000', 'last_undegraded': '2024-04-25T08:56:17.182918+0000', 'last_fullsized': '2024-04-25T08:56:17.182918+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_clean_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:56:21.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2024-04-25T08:56:21.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:56:17.182918+0000', 'last_change': '2024-04-25T08:56:17.182918+0000', 'last_active': '2024-04-25T08:56:17.182918+0000', 'last_peered': '2024-04-25T08:56:17.182918+0000', 'last_clean': '2024-04-25T08:56:17.182918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:56:17.182918+0000', 'last_undegraded': '2024-04-25T08:56:17.182918+0000', 'last_fullsized': '2024-04-25T08:56:17.182918+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_clean_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:56:21.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-04-25T08:56:21.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:56:17.182918+0000', 'last_change': '2024-04-25T08:56:17.182918+0000', 'last_active': '2024-04-25T08:56:17.182918+0000', 'last_peered': '2024-04-25T08:56:17.182918+0000', 'last_clean': '2024-04-25T08:56:17.182918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:56:17.182918+0000', 'last_undegraded': '2024-04-25T08:56:17.182918+0000', 'last_fullsized': '2024-04-25T08:56:17.182918+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_clean_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:56:21.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-04-25T08:56:21.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:56:17.182918+0000', 'last_change': '2024-04-25T08:56:17.182918+0000', 'last_active': '2024-04-25T08:56:17.182918+0000', 'last_peered': '2024-04-25T08:56:17.182918+0000', 'last_clean': '2024-04-25T08:56:17.182918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:56:17.182918+0000', 'last_undegraded': '2024-04-25T08:56:17.182918+0000', 'last_fullsized': '2024-04-25T08:56:17.182918+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_clean_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:56:21.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-04-25T08:56:21.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:56:16.190673+0000', 'last_change': '2024-04-25T08:56:16.190673+0000', 'last_active': '2024-04-25T08:56:16.180393+0000', 'last_peered': '2024-04-25T08:56:16.180393+0000', 'last_clean': '2024-04-25T08:56:16.180393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:56:16.190673+0000', 'last_undegraded': '2024-04-25T08:56:16.190673+0000', 'last_fullsized': '2024-04-25T08:56:16.190673+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'last_clean_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:56:21.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-04-25T08:56:21.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:56:16.189457+0000', 'last_change': '2024-04-25T08:56:16.189457+0000', 'last_active': '2024-04-25T08:56:16.180393+0000', 'last_peered': '2024-04-25T08:56:16.180393+0000', 'last_clean': '2024-04-25T08:56:16.180393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:56:16.189457+0000', 'last_undegraded': '2024-04-25T08:56:16.189457+0000', 'last_fullsized': '2024-04-25T08:56:16.189457+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'last_clean_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:56:21.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-04-25T08:56:21.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:56:17.182918+0000', 'last_change': '2024-04-25T08:56:17.182918+0000', 'last_active': '2024-04-25T08:56:17.182918+0000', 'last_peered': '2024-04-25T08:56:17.182918+0000', 'last_clean': '2024-04-25T08:56:17.182918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:56:17.182918+0000', 'last_undegraded': '2024-04-25T08:56:17.182918+0000', 'last_fullsized': '2024-04-25T08:56:17.182918+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_clean_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:56:21.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-04-25T08:56:21.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:56:16.189157+0000', 'last_change': '2024-04-25T08:56:16.189157+0000', 'last_active': '2024-04-25T08:56:16.180393+0000', 'last_peered': '2024-04-25T08:56:16.180393+0000', 'last_clean': '2024-04-25T08:56:16.180393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:56:16.189157+0000', 'last_undegraded': '2024-04-25T08:56:16.189157+0000', 'last_fullsized': '2024-04-25T08:56:16.189157+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'last_clean_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:56:21.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-04-25T08:56:21.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:56:17.182918+0000', 'last_change': '2024-04-25T08:56:17.182918+0000', 'last_active': '2024-04-25T08:56:17.182918+0000', 'last_peered': '2024-04-25T08:56:17.182918+0000', 'last_clean': '2024-04-25T08:56:17.182918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:56:17.182918+0000', 'last_undegraded': '2024-04-25T08:56:17.182918+0000', 'last_fullsized': '2024-04-25T08:56:17.182918+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'last_clean_scrub_stamp': '2024-04-25T08:56:17.182918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:56:21.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-04-25T08:56:21.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:56:16.189131+0000', 'last_change': '2024-04-25T08:56:16.189131+0000', 'last_active': '2024-04-25T08:56:16.180393+0000', 'last_peered': '2024-04-25T08:56:16.180393+0000', 'last_clean': '2024-04-25T08:56:16.180393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:56:16.189131+0000', 'last_undegraded': '2024-04-25T08:56:16.189131+0000', 'last_fullsized': '2024-04-25T08:56:16.189131+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'last_clean_scrub_stamp': '2024-04-25T08:56:16.180393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:56:21.903 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.046+0000 7faa2d81f640 1 Processor -- start 2024-04-25T08:56:22.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.046+0000 7faa2d81f640 1 -- start start 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.047+0000 7faa2d81f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa280ce130 0x7faa2806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.047+0000 7faa2d81f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa28161970 con 0x7faa2806b0e0 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.047+0000 7faa2d81f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2806b4f0 con 0x7faa28162360 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.047+0000 7faa2d81f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2806b780 con 0x7faa280ce130 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.047+0000 7faa267fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa280ce130 0x7faa2806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.047+0000 7faa277fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faa2806b0e0 0x7faa2806dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37546/0 (socket says 172.21.15.55:37546) 2024-04-25T08:56:22.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.047+0000 7faa277fe640 1 -- 172.21.15.55:0/1166075939 learned_addr learned my addr 172.21.15.55:0/1166075939 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:22.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.048+0000 7faa267fc640 1 -- 172.21.15.55:0/1166075939 >> v1:172.21.15.167:6789/0 conn(0x7faa28162360 legacy=0x7faa280cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.048+0000 7faa267fc640 1 -- 172.21.15.55:0/1166075939 >> v1:172.21.15.55:6789/0 conn(0x7faa2806b0e0 legacy=0x7faa2806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.048+0000 7faa267fc640 1 -- 172.21.15.55:0/1166075939 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2806ba60 con 0x7faa280ce130 2024-04-25T08:56:22.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.048+0000 7faa25ffb640 1 -- 172.21.15.55:0/1166075939 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024860786 0 0) 0x7faa20001110 con 0x7faa2806b0e0 2024-04-25T08:56:22.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.048+0000 7faa267fc640 1 --2- 172.21.15.55:0/1166075939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa280ce130 0x7faa2806aba0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7faa100097a0 tx=0x7faa1002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74566cc95aa84e53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.048+0000 7faa25ffb640 1 -- 172.21.15.55:0/1166075939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa10037070 con 0x7faa280ce130 2024-04-25T08:56:22.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.049+0000 7faa25ffb640 1 -- 172.21.15.55:0/1166075939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa10032440 con 0x7faa280ce130 2024-04-25T08:56:22.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.049+0000 7faa25ffb640 1 -- 172.21.15.55:0/1166075939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa10032810 con 0x7faa280ce130 2024-04-25T08:56:22.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.049+0000 7faa2d81f640 1 -- 172.21.15.55:0/1166075939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa280ce130 msgr2=0x7faa2806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.049+0000 7faa2d81f640 1 --2- 172.21.15.55:0/1166075939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa280ce130 0x7faa2806aba0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7faa100097a0 tx=0x7faa1002a230 comp rx=0 tx=0).stop 2024-04-25T08:56:22.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.049+0000 7faa2d81f640 1 -- 172.21.15.55:0/1166075939 shutdown_connections 2024-04-25T08:56:22.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.049+0000 7faa2d81f640 1 --2- 172.21.15.55:0/1166075939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa280ce130 0x7faa2806aba0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.049+0000 7faa2d81f640 1 -- 172.21.15.55:0/1166075939 >> 172.21.15.55:0/1166075939 conn(0x7faa280cc8d0 msgr2=0x7faa280ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:22.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.049+0000 7faa2d81f640 1 -- 172.21.15.55:0/1166075939 shutdown_connections 2024-04-25T08:56:22.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.049+0000 7faa2d81f640 1 -- 172.21.15.55:0/1166075939 wait complete. 2024-04-25T08:56:22.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.050+0000 7faa2d81f640 1 Processor -- start 2024-04-25T08:56:22.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.050+0000 7faa2d81f640 1 -- start start 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.051+0000 7faa2d81f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa2806b0e0 0x7faa280b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.051+0000 7faa2d81f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa280ce130 0x7faa280c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.051+0000 7faa2d81f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa281532b0 0x7faa280c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.051+0000 7faa2d81f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2806c300 con 0x7faa2806b0e0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.051+0000 7faa2d81f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2806c020 con 0x7faa280ce130 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.051+0000 7faa2d81f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2806e1c0 con 0x7faa281532b0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.051+0000 7faa26ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa2806b0e0 0x7faa280b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.051+0000 7faa26ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa2806b0e0 0x7faa280b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39210/0 (socket says 172.21.15.55:39210) 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.051+0000 7faa26ffd640 1 -- 172.21.15.55:0/650115577 learned_addr learned my addr 172.21.15.55:0/650115577 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa267fc640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa280ce130 0x7faa280c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa26ffd640 1 -- 172.21.15.55:0/650115577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa281532b0 msgr2=0x7faa280c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa277fe640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa281532b0 0x7faa280c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa26ffd640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa281532b0 0x7faa280c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa26ffd640 1 -- 172.21.15.55:0/650115577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa280ce130 msgr2=0x7faa280c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa26ffd640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa280ce130 0x7faa280c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa26ffd640 1 -- 172.21.15.55:0/650115577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa280b3e60 con 0x7faa2806b0e0 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa267fc640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa280ce130 0x7faa280c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa277fe640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa281532b0 0x7faa280c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa26ffd640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa2806b0e0 0x7faa280b34a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c870 tx=0x7faa1800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa1ffff640 1 -- 172.21.15.55:0/650115577 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18003b70 con 0x7faa2806b0e0 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa1ffff640 1 -- 172.21.15.55:0/650115577 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18003d30 con 0x7faa2806b0e0 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa2d81f640 1 -- 172.21.15.55:0/650115577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa280b3b80 con 0x7faa2806b0e0 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa1ffff640 1 -- 172.21.15.55:0/650115577 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1800aa90 con 0x7faa2806b0e0 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.052+0000 7faa2d81f640 1 -- 172.21.15.55:0/650115577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa280b4470 con 0x7faa2806b0e0 2024-04-25T08:56:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.053+0000 7faa2d81f640 1 -- 172.21.15.55:0/650115577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa280749b0 con 0x7faa2806b0e0 2024-04-25T08:56:22.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.054+0000 7faa1ffff640 1 -- 172.21.15.55:0/650115577 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faa1800ac30 con 0x7faa2806b0e0 2024-04-25T08:56:22.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.054+0000 7faa1ffff640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa0806b4d0 0x7faa0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.054+0000 7faa1ffff640 1 -- 172.21.15.55:0/650115577 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa1808a140 con 0x7faa2806b0e0 2024-04-25T08:56:22.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.054+0000 7faa267fc640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa0806b4d0 0x7faa0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.055+0000 7faa267fc640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa0806b4d0 0x7faa0806d990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faa10034000 tx=0x7faa1002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.058+0000 7faa1ffff640 1 -- 172.21.15.55:0/650115577 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faa18059050 con 0x7faa2806b0e0 2024-04-25T08:56:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.312+0000 7faa2d81f640 1 -- 172.21.15.55:0/650115577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7faa280b17a0 con 0x7faa2806b0e0 2024-04-25T08:56:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.312+0000 7faa1ffff640 1 -- 172.21.15.55:0/650115577 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1594 (secure 0 0 0) 0x7faa18058950 con 0x7faa2806b0e0 2024-04-25T08:56:22.302 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:22.302 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":184,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":61,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035209,"num_in_osds":8,"osd_in_since":1714035200,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":87},{"state_name":"unknown","count":6},{"state_name":"creating+peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":245370880,"bytes_avail":772848742400,"bytes_total":773094113280,"unknown_pgs_ratio":0.061855670064687729,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":3258,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":28,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6060}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-04-25T08:56:06.581214+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:56:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 -- 172.21.15.55:0/650115577 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa0806b4d0 msgr2=0x7faa0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa0806b4d0 0x7faa0806d990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faa10034000 tx=0x7faa1002e000 comp rx=0 tx=0).stop 2024-04-25T08:56:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 -- 172.21.15.55:0/650115577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa2806b0e0 msgr2=0x7faa280b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa2806b0e0 0x7faa280b34a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c870 tx=0x7faa1800cd30 comp rx=0 tx=0).stop 2024-04-25T08:56:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 -- 172.21.15.55:0/650115577 shutdown_connections 2024-04-25T08:56:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa0806b4d0 0x7faa0806d990 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa281532b0 0x7faa280c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa280ce130 0x7faa280c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 --2- 172.21.15.55:0/650115577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa2806b0e0 0x7faa280b34a0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 -- 172.21.15.55:0/650115577 >> 172.21.15.55:0/650115577 conn(0x7faa280cc8d0 msgr2=0x7faa2806e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 -- 172.21.15.55:0/650115577 shutdown_connections 2024-04-25T08:56:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.314+0000 7faa2d81f640 1 -- 172.21.15.55:0/650115577 wait complete. 2024-04-25T08:56:22.315 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:56:22.315 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:56:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.427+0000 7f011d9ce640 1 Processor -- start 2024-04-25T08:56:22.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.427+0000 7f011d9ce640 1 -- start start 2024-04-25T08:56:22.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.427+0000 7f011d9ce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f011815dce0 0x7f01180d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.427+0000 7f011d9ce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f01180d35b0 0x7f01180b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.427+0000 7f011d9ce640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011815e0c0 con 0x7f01180d1f90 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.428+0000 7f011d9ce640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01180b7b10 con 0x7f011815dce0 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.428+0000 7f011d9ce640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01180d2510 con 0x7f01180d35b0 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.428+0000 7f0116ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f011815dce0 0x7f01180d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.428+0000 7f0116ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f011815dce0 0x7f01180d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39222/0 (socket says 172.21.15.55:39222) 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.428+0000 7f0116ffd640 1 -- 172.21.15.55:0/505989941 learned_addr learned my addr 172.21.15.55:0/505989941 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.428+0000 7f010ffff640 1 --2- 172.21.15.55:0/505989941 >> v2:172.21.15.167:3300/0 conn(0x7f01180d35b0 0x7f01180b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.428+0000 7f0116ffd640 1 -- 172.21.15.55:0/505989941 >> v2:172.21.15.167:3300/0 conn(0x7f01180d35b0 msgr2=0x7f01180b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.428+0000 7f0116ffd640 1 --2- 172.21.15.55:0/505989941 >> v2:172.21.15.167:3300/0 conn(0x7f01180d35b0 0x7f01180b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.428+0000 7f0116ffd640 1 -- 172.21.15.55:0/505989941 >> v1:172.21.15.167:6789/0 conn(0x7f01180d1f90 legacy=0x7f011806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.428+0000 7f0116ffd640 1 -- 172.21.15.55:0/505989941 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180d27f0 con 0x7f011815dce0 2024-04-25T08:56:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.429+0000 7f0116ffd640 1 --2- 172.21.15.55:0/505989941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f011815dce0 0x7f01180d1a50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f01180cdfa0 tx=0x7f010802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec13cb685f002c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.429+0000 7f01167fc640 1 -- 172.21.15.55:0/505989941 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108037070 con 0x7f011815dce0 2024-04-25T08:56:22.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.429+0000 7f01167fc640 1 -- 172.21.15.55:0/505989941 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0108032440 con 0x7f011815dce0 2024-04-25T08:56:22.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.429+0000 7f01167fc640 1 -- 172.21.15.55:0/505989941 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108032810 con 0x7f011815dce0 2024-04-25T08:56:22.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.429+0000 7f011d9ce640 1 -- 172.21.15.55:0/505989941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f011815dce0 msgr2=0x7f01180d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.429+0000 7f011d9ce640 1 --2- 172.21.15.55:0/505989941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f011815dce0 0x7f01180d1a50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f01180cdfa0 tx=0x7f010802a270 comp rx=0 tx=0).stop 2024-04-25T08:56:22.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.430+0000 7f011d9ce640 1 -- 172.21.15.55:0/505989941 shutdown_connections 2024-04-25T08:56:22.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.430+0000 7f011d9ce640 1 --2- 172.21.15.55:0/505989941 >> v2:172.21.15.167:3300/0 conn(0x7f01180d35b0 0x7f01180b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.430+0000 7f011d9ce640 1 --2- 172.21.15.55:0/505989941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f011815dce0 0x7f01180d1a50 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.430+0000 7f011d9ce640 1 -- 172.21.15.55:0/505989941 >> 172.21.15.55:0/505989941 conn(0x7f0118072900 msgr2=0x7f01180d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.430+0000 7f011d9ce640 1 -- 172.21.15.55:0/505989941 shutdown_connections 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.430+0000 7f011d9ce640 1 -- 172.21.15.55:0/505989941 wait complete. 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.431+0000 7f011d9ce640 1 Processor -- start 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.431+0000 7f011d9ce640 1 -- start start 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.431+0000 7f011d9ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180d1f90 0x7f01180c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.431+0000 7f011d9ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01180d35b0 0x7f0118152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f011d9ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011815dce0 0x7f01180ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f011d9ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180d3090 con 0x7f01180d1f90 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f011d9ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180d2db0 con 0x7f011815dce0 2024-04-25T08:56:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f011d9ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01180b9820 con 0x7f01180d35b0 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180d1f90 0x7f01180c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180d1f90 0x7f01180c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39228/0 (socket says 172.21.15.55:39228) 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0116ffd640 1 -- 172.21.15.55:0/1757235078 learned_addr learned my addr 172.21.15.55:0/1757235078 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f010ffff640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01180d35b0 0x7f0118152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f01177fe640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011815dce0 0x7f01180ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0116ffd640 1 -- 172.21.15.55:0/1757235078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01180d35b0 msgr2=0x7f0118152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0116ffd640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01180d35b0 0x7f0118152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0116ffd640 1 -- 172.21.15.55:0/1757235078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011815dce0 msgr2=0x7f01180ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0116ffd640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011815dce0 0x7f01180ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0116ffd640 1 -- 172.21.15.55:0/1757235078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180c8c20 con 0x7f01180d1f90 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f01177fe640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011815dce0 0x7f01180ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0116ffd640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180d1f90 0x7f01180c9cc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f010802a2b0 tx=0x7f01080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0114ff9640 1 -- 172.21.15.55:0/1757235078 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108041020 con 0x7f01180d1f90 2024-04-25T08:56:22.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0114ff9640 1 -- 172.21.15.55:0/1757235078 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01080306c0 con 0x7f01180d1f90 2024-04-25T08:56:22.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f0114ff9640 1 -- 172.21.15.55:0/1757235078 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108037040 con 0x7f01180d1f90 2024-04-25T08:56:22.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f011d9ce640 1 -- 172.21.15.55:0/1757235078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01180c8f00 con 0x7f01180d1f90 2024-04-25T08:56:22.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.432+0000 7f011d9ce640 1 -- 172.21.15.55:0/1757235078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01180c94c0 con 0x7f01180d1f90 2024-04-25T08:56:22.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.433+0000 7f011d9ce640 1 -- 172.21.15.55:0/1757235078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01180749b0 con 0x7f01180d1f90 2024-04-25T08:56:22.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.434+0000 7f0114ff9640 1 -- 172.21.15.55:0/1757235078 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0108044020 con 0x7f01180d1f90 2024-04-25T08:56:22.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.434+0000 7f0114ff9640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00f806b4d0 0x7f00f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:22.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.434+0000 7f0114ff9640 1 -- 172.21.15.55:0/1757235078 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01080aa980 con 0x7f01180d1f90 2024-04-25T08:56:22.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.434+0000 7f010ffff640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00f806b4d0 0x7f00f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:22.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.435+0000 7f010ffff640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00f806b4d0 0x7f00f806d990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f01180b2570 tx=0x7f0100008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:22.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.438+0000 7f0114ff9640 1 -- 172.21.15.55:0/1757235078 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f010804b030 con 0x7f01180d1f90 2024-04-25T08:56:22.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.618+0000 7f011d9ce640 1 -- 172.21.15.55:0/1757235078 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0118161370 con 0x7f00f806b4d0 2024-04-25T08:56:22.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.624+0000 7f0114ff9640 1 -- 172.21.15.55:0/1757235078 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251939 (secure 0 0 0) 0x7f0118161370 con 0x7f00f806b4d0 2024-04-25T08:56:22.616 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:22.617 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 -- 172.21.15.55:0/1757235078 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00f806b4d0 msgr2=0x7f00f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00f806b4d0 0x7f00f806d990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f01180b2570 tx=0x7f0100008040 comp rx=0 tx=0).stop 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 -- 172.21.15.55:0/1757235078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180d1f90 msgr2=0x7f01180c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180d1f90 0x7f01180c9cc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f010802a2b0 tx=0x7f01080046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 -- 172.21.15.55:0/1757235078 shutdown_connections 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00f806b4d0 0x7f00f806d990 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011815dce0 0x7f01180ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01180d35b0 0x7f0118152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 --2- 172.21.15.55:0/1757235078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180d1f90 0x7f01180c9cc0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 -- 172.21.15.55:0/1757235078 >> 172.21.15.55:0/1757235078 conn(0x7f0118072900 msgr2=0x7f01180d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 -- 172.21.15.55:0/1757235078 shutdown_connections 2024-04-25T08:56:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:22.627+0000 7f011d9ce640 1 -- 172.21.15.55:0/1757235078 wait complete. 2024-04-25T08:56:22.627 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-04-25T08:56:22.584184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239664,"kb_used_data":6828,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735056,"statfs":{"total":773094113280,"available":772848697344,"internally_reserved":0,"allocated":6991872,"data_stored":3560184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001215"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197228+0000","last_change":"2024-04-25T08:56:18.216097+0000","last_active":"2024-04-25T08:56:19.197228+0000","last_peered":"2024-04-25T08:56:19.197228+0000","last_clean":"2024-04-25T08:56:19.197228+0000","last_became_active":"2024-04-25T08:56:18.215813+0000","last_became_peered":"2024-04-25T08:56:18.215813+0000","last_unstale":"2024-04-25T08:56:19.197228+0000","last_undegraded":"2024-04-25T08:56:19.197228+0000","last_fullsized":"2024-04-25T08:56:19.197228+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:16.551427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196183+0000","last_change":"2024-04-25T08:56:18.216111+0000","last_active":"2024-04-25T08:56:19.196183+0000","last_peered":"2024-04-25T08:56:19.196183+0000","last_clean":"2024-04-25T08:56:19.196183+0000","last_became_active":"2024-04-25T08:56:18.215825+0000","last_became_peered":"2024-04-25T08:56:18.215825+0000","last_unstale":"2024-04-25T08:56:19.196183+0000","last_undegraded":"2024-04-25T08:56:19.196183+0000","last_fullsized":"2024-04-25T08:56:19.196183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:27.852434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481340+0000","last_change":"2024-04-25T08:56:18.216482+0000","last_active":"2024-04-25T08:56:19.481340+0000","last_peered":"2024-04-25T08:56:19.481340+0000","last_clean":"2024-04-25T08:56:19.481340+0000","last_became_active":"2024-04-25T08:56:18.216109+0000","last_became_peered":"2024-04-25T08:56:18.216109+0000","last_unstale":"2024-04-25T08:56:19.481340+0000","last_undegraded":"2024-04-25T08:56:19.481340+0000","last_fullsized":"2024-04-25T08:56:19.481340+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:34:03.547004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222711+0000","last_change":"2024-04-25T08:56:18.215504+0000","last_active":"2024-04-25T08:56:18.222711+0000","last_peered":"2024-04-25T08:56:18.222711+0000","last_clean":"2024-04-25T08:56:18.222711+0000","last_became_active":"2024-04-25T08:56:18.215231+0000","last_became_peered":"2024-04-25T08:56:18.215231+0000","last_unstale":"2024-04-25T08:56:18.222711+0000","last_undegraded":"2024-04-25T08:56:18.222711+0000","last_fullsized":"2024-04-25T08:56:18.222711+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:55.008870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196987+0000","last_change":"2024-04-25T08:56:18.215438+0000","last_active":"2024-04-25T08:56:19.196987+0000","last_peered":"2024-04-25T08:56:19.196987+0000","last_clean":"2024-04-25T08:56:19.196987+0000","last_became_active":"2024-04-25T08:56:18.215127+0000","last_became_peered":"2024-04-25T08:56:18.215127+0000","last_unstale":"2024-04-25T08:56:19.196987+0000","last_undegraded":"2024-04-25T08:56:19.196987+0000","last_fullsized":"2024-04-25T08:56:19.196987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:18.265835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359240+0000","last_change":"2024-04-25T08:56:18.219404+0000","last_active":"2024-04-25T08:56:19.359240+0000","last_peered":"2024-04-25T08:56:19.359240+0000","last_clean":"2024-04-25T08:56:19.359240+0000","last_became_active":"2024-04-25T08:56:18.219126+0000","last_became_peered":"2024-04-25T08:56:18.219126+0000","last_unstale":"2024-04-25T08:56:19.359240+0000","last_undegraded":"2024-04-25T08:56:19.359240+0000","last_fullsized":"2024-04-25T08:56:19.359240+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:10.524577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.211594+0000","last_change":"2024-04-25T08:56:18.207889+0000","last_active":"2024-04-25T08:56:18.211594+0000","last_peered":"2024-04-25T08:56:18.211594+0000","last_clean":"2024-04-25T08:56:18.211594+0000","last_became_active":"2024-04-25T08:56:18.207533+0000","last_became_peered":"2024-04-25T08:56:18.207533+0000","last_unstale":"2024-04-25T08:56:18.211594+0000","last_undegraded":"2024-04-25T08:56:18.211594+0000","last_fullsized":"2024-04-25T08:56:18.211594+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:05.251215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195447+0000","last_change":"2024-04-25T08:56:18.201722+0000","last_active":"2024-04-25T08:56:19.195447+0000","last_peered":"2024-04-25T08:56:19.195447+0000","last_clean":"2024-04-25T08:56:19.195447+0000","last_became_active":"2024-04-25T08:56:18.201409+0000","last_became_peered":"2024-04-25T08:56:18.201409+0000","last_unstale":"2024-04-25T08:56:19.195447+0000","last_undegraded":"2024-04-25T08:56:19.195447+0000","last_fullsized":"2024-04-25T08:56:19.195447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:02.179797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222016+0000","last_change":"2024-04-25T08:56:18.218239+0000","last_active":"2024-04-25T08:56:18.222016+0000","last_peered":"2024-04-25T08:56:18.222016+0000","last_clean":"2024-04-25T08:56:18.222016+0000","last_became_active":"2024-04-25T08:56:18.217954+0000","last_became_peered":"2024-04-25T08:56:18.217954+0000","last_unstale":"2024-04-25T08:56:18.222016+0000","last_undegraded":"2024-04-25T08:56:18.222016+0000","last_fullsized":"2024-04-25T08:56:18.222016+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:21.994569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346393+0000","last_change":"2024-04-25T08:56:18.213749+0000","last_active":"2024-04-25T08:56:20.346393+0000","last_peered":"2024-04-25T08:56:20.346393+0000","last_clean":"2024-04-25T08:56:20.346393+0000","last_became_active":"2024-04-25T08:56:18.213412+0000","last_became_peered":"2024-04-25T08:56:18.213412+0000","last_unstale":"2024-04-25T08:56:20.346393+0000","last_undegraded":"2024-04-25T08:56:20.346393+0000","last_fullsized":"2024-04-25T08:56:20.346393+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:46.818060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346588+0000","last_change":"2024-04-25T08:56:18.214004+0000","last_active":"2024-04-25T08:56:20.346588+0000","last_peered":"2024-04-25T08:56:20.346588+0000","last_clean":"2024-04-25T08:56:20.346588+0000","last_became_active":"2024-04-25T08:56:18.213323+0000","last_became_peered":"2024-04-25T08:56:18.213323+0000","last_unstale":"2024-04-25T08:56:20.346588+0000","last_undegraded":"2024-04-25T08:56:20.346588+0000","last_fullsized":"2024-04-25T08:56:20.346588+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:02.247840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.219587+0000","last_change":"2024-04-25T08:56:18.211963+0000","last_active":"2024-04-25T08:56:18.219587+0000","last_peered":"2024-04-25T08:56:18.219587+0000","last_clean":"2024-04-25T08:56:18.219587+0000","last_became_active":"2024-04-25T08:56:18.211651+0000","last_became_peered":"2024-04-25T08:56:18.211651+0000","last_unstale":"2024-04-25T08:56:18.219587+0000","last_undegraded":"2024-04-25T08:56:18.219587+0000","last_fullsized":"2024-04-25T08:56:18.219587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:13.460350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196604+0000","last_change":"2024-04-25T08:56:18.218212+0000","last_active":"2024-04-25T08:56:19.196604+0000","last_peered":"2024-04-25T08:56:19.196604+0000","last_clean":"2024-04-25T08:56:19.196604+0000","last_became_active":"2024-04-25T08:56:18.217523+0000","last_became_peered":"2024-04-25T08:56:18.217523+0000","last_unstale":"2024-04-25T08:56:19.196604+0000","last_undegraded":"2024-04-25T08:56:19.196604+0000","last_fullsized":"2024-04-25T08:56:19.196604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:12.024798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.212508+0000","last_change":"2024-04-25T08:56:18.210940+0000","last_active":"2024-04-25T08:56:18.212508+0000","last_peered":"2024-04-25T08:56:18.212508+0000","last_clean":"2024-04-25T08:56:18.212508+0000","last_became_active":"2024-04-25T08:56:18.210548+0000","last_became_peered":"2024-04-25T08:56:18.210548+0000","last_unstale":"2024-04-25T08:56:18.212508+0000","last_undegraded":"2024-04-25T08:56:18.212508+0000","last_fullsized":"2024-04-25T08:56:18.212508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:51.274029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.216299+0000","last_change":"2024-04-25T08:56:18.215336+0000","last_active":"2024-04-25T08:56:18.216299+0000","last_peered":"2024-04-25T08:56:18.216299+0000","last_clean":"2024-04-25T08:56:18.216299+0000","last_became_active":"2024-04-25T08:56:18.214922+0000","last_became_peered":"2024-04-25T08:56:18.214922+0000","last_unstale":"2024-04-25T08:56:18.216299+0000","last_undegraded":"2024-04-25T08:56:18.216299+0000","last_fullsized":"2024-04-25T08:56:18.216299+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:00.693003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359208+0000","last_change":"2024-04-25T08:56:18.216067+0000","last_active":"2024-04-25T08:56:19.359208+0000","last_peered":"2024-04-25T08:56:19.359208+0000","last_clean":"2024-04-25T08:56:19.359208+0000","last_became_active":"2024-04-25T08:56:18.215750+0000","last_became_peered":"2024-04-25T08:56:18.215750+0000","last_unstale":"2024-04-25T08:56:19.359208+0000","last_undegraded":"2024-04-25T08:56:19.359208+0000","last_fullsized":"2024-04-25T08:56:19.359208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196193+0000","last_change":"2024-04-25T08:56:18.205704+0000","last_active":"2024-04-25T08:56:19.196193+0000","last_peered":"2024-04-25T08:56:19.196193+0000","last_clean":"2024-04-25T08:56:19.196193+0000","last_became_active":"2024-04-25T08:56:18.205432+0000","last_became_peered":"2024-04-25T08:56:18.205432+0000","last_unstale":"2024-04-25T08:56:19.196193+0000","last_undegraded":"2024-04-25T08:56:19.196193+0000","last_fullsized":"2024-04-25T08:56:19.196193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:50.798086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481529+0000","last_change":"2024-04-25T08:56:18.220201+0000","last_active":"2024-04-25T08:56:19.481529+0000","last_peered":"2024-04-25T08:56:19.481529+0000","last_clean":"2024-04-25T08:56:19.481529+0000","last_became_active":"2024-04-25T08:56:18.219890+0000","last_became_peered":"2024-04-25T08:56:18.219890+0000","last_unstale":"2024-04-25T08:56:19.481529+0000","last_undegraded":"2024-04-25T08:56:19.481529+0000","last_fullsized":"2024-04-25T08:56:19.481529+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.388864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196996+0000","last_change":"2024-04-25T08:56:18.216067+0000","last_active":"2024-04-25T08:56:19.196996+0000","last_peered":"2024-04-25T08:56:19.196996+0000","last_clean":"2024-04-25T08:56:19.196996+0000","last_became_active":"2024-04-25T08:56:18.215793+0000","last_became_peered":"2024-04-25T08:56:18.215793+0000","last_unstale":"2024-04-25T08:56:19.196996+0000","last_undegraded":"2024-04-25T08:56:19.196996+0000","last_fullsized":"2024-04-25T08:56:19.196996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:27.576959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196082+0000","last_change":"2024-04-25T08:56:18.221843+0000","last_active":"2024-04-25T08:56:19.196082+0000","last_peered":"2024-04-25T08:56:19.196082+0000","last_clean":"2024-04-25T08:56:19.196082+0000","last_became_active":"2024-04-25T08:56:18.221585+0000","last_became_peered":"2024-04-25T08:56:18.221585+0000","last_unstale":"2024-04-25T08:56:19.196082+0000","last_undegraded":"2024-04-25T08:56:19.196082+0000","last_fullsized":"2024-04-25T08:56:19.196082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:54.520655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481188+0000","last_change":"2024-04-25T08:56:18.208528+0000","last_active":"2024-04-25T08:56:19.481188+0000","last_peered":"2024-04-25T08:56:19.481188+0000","last_clean":"2024-04-25T08:56:19.481188+0000","last_became_active":"2024-04-25T08:56:18.208223+0000","last_became_peered":"2024-04-25T08:56:18.208223+0000","last_unstale":"2024-04-25T08:56:19.481188+0000","last_undegraded":"2024-04-25T08:56:19.481188+0000","last_fullsized":"2024-04-25T08:56:19.481188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:58.962486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195551+0000","last_change":"2024-04-25T08:56:18.211520+0000","last_active":"2024-04-25T08:56:19.195551+0000","last_peered":"2024-04-25T08:56:19.195551+0000","last_clean":"2024-04-25T08:56:19.195551+0000","last_became_active":"2024-04-25T08:56:18.211171+0000","last_became_peered":"2024-04-25T08:56:18.211171+0000","last_unstale":"2024-04-25T08:56:19.195551+0000","last_undegraded":"2024-04-25T08:56:19.195551+0000","last_fullsized":"2024-04-25T08:56:19.195551+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:56.175100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481207+0000","last_change":"2024-04-25T08:56:18.223242+0000","last_active":"2024-04-25T08:56:19.481207+0000","last_peered":"2024-04-25T08:56:19.481207+0000","last_clean":"2024-04-25T08:56:19.481207+0000","last_became_active":"2024-04-25T08:56:18.222694+0000","last_became_peered":"2024-04-25T08:56:18.222694+0000","last_unstale":"2024-04-25T08:56:19.481207+0000","last_undegraded":"2024-04-25T08:56:19.481207+0000","last_fullsized":"2024-04-25T08:56:19.481207+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:47.866218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196301+0000","last_change":"2024-04-25T08:56:18.217082+0000","last_active":"2024-04-25T08:56:19.196301+0000","last_peered":"2024-04-25T08:56:19.196301+0000","last_clean":"2024-04-25T08:56:19.196301+0000","last_became_active":"2024-04-25T08:56:18.216639+0000","last_became_peered":"2024-04-25T08:56:18.216639+0000","last_unstale":"2024-04-25T08:56:19.196301+0000","last_undegraded":"2024-04-25T08:56:19.196301+0000","last_fullsized":"2024-04-25T08:56:19.196301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:39.841298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197280+0000","last_change":"2024-04-25T08:56:18.215507+0000","last_active":"2024-04-25T08:56:19.197280+0000","last_peered":"2024-04-25T08:56:19.197280+0000","last_clean":"2024-04-25T08:56:19.197280+0000","last_became_active":"2024-04-25T08:56:18.215224+0000","last_became_peered":"2024-04-25T08:56:18.215224+0000","last_unstale":"2024-04-25T08:56:19.197280+0000","last_undegraded":"2024-04-25T08:56:19.197280+0000","last_fullsized":"2024-04-25T08:56:19.197280+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:12.624706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.213831+0000","last_change":"2024-04-25T08:56:18.207047+0000","last_active":"2024-04-25T08:56:18.213831+0000","last_peered":"2024-04-25T08:56:18.213831+0000","last_clean":"2024-04-25T08:56:18.213831+0000","last_became_active":"2024-04-25T08:56:18.206749+0000","last_became_peered":"2024-04-25T08:56:18.206749+0000","last_unstale":"2024-04-25T08:56:18.213831+0000","last_undegraded":"2024-04-25T08:56:18.213831+0000","last_fullsized":"2024-04-25T08:56:18.213831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:33.200201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359355+0000","last_change":"2024-04-25T08:56:18.216568+0000","last_active":"2024-04-25T08:56:19.359355+0000","last_peered":"2024-04-25T08:56:19.359355+0000","last_clean":"2024-04-25T08:56:19.359355+0000","last_became_active":"2024-04-25T08:56:18.215965+0000","last_became_peered":"2024-04-25T08:56:18.215965+0000","last_unstale":"2024-04-25T08:56:19.359355+0000","last_undegraded":"2024-04-25T08:56:19.359355+0000","last_fullsized":"2024-04-25T08:56:19.359355+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197235+0000","last_change":"2024-04-25T08:56:18.219428+0000","last_active":"2024-04-25T08:56:19.197235+0000","last_peered":"2024-04-25T08:56:19.197235+0000","last_clean":"2024-04-25T08:56:19.197235+0000","last_became_active":"2024-04-25T08:56:18.218946+0000","last_became_peered":"2024-04-25T08:56:18.218946+0000","last_unstale":"2024-04-25T08:56:19.197235+0000","last_undegraded":"2024-04-25T08:56:19.197235+0000","last_fullsized":"2024-04-25T08:56:19.197235+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:17.124211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196368+0000","last_change":"2024-04-25T08:56:18.209922+0000","last_active":"2024-04-25T08:56:19.196368+0000","last_peered":"2024-04-25T08:56:19.196368+0000","last_clean":"2024-04-25T08:56:19.196368+0000","last_became_active":"2024-04-25T08:56:18.208216+0000","last_became_peered":"2024-04-25T08:56:18.208216+0000","last_unstale":"2024-04-25T08:56:19.196368+0000","last_undegraded":"2024-04-25T08:56:19.196368+0000","last_fullsized":"2024-04-25T08:56:19.196368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:54.752262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481129+0000","last_change":"2024-04-25T08:56:18.215840+0000","last_active":"2024-04-25T08:56:19.481129+0000","last_peered":"2024-04-25T08:56:19.481129+0000","last_clean":"2024-04-25T08:56:19.481129+0000","last_became_active":"2024-04-25T08:56:18.214137+0000","last_became_peered":"2024-04-25T08:56:18.214137+0000","last_unstale":"2024-04-25T08:56:19.481129+0000","last_undegraded":"2024-04-25T08:56:19.481129+0000","last_fullsized":"2024-04-25T08:56:19.481129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:36.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196664+0000","last_change":"2024-04-25T08:56:18.215113+0000","last_active":"2024-04-25T08:56:19.196664+0000","last_peered":"2024-04-25T08:56:19.196664+0000","last_clean":"2024-04-25T08:56:19.196664+0000","last_became_active":"2024-04-25T08:56:18.214777+0000","last_became_peered":"2024-04-25T08:56:18.214777+0000","last_unstale":"2024-04-25T08:56:19.196664+0000","last_undegraded":"2024-04-25T08:56:19.196664+0000","last_fullsized":"2024-04-25T08:56:19.196664+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:02.932997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359476+0000","last_change":"2024-04-25T08:56:18.223089+0000","last_active":"2024-04-25T08:56:19.359476+0000","last_peered":"2024-04-25T08:56:19.359476+0000","last_clean":"2024-04-25T08:56:19.359476+0000","last_became_active":"2024-04-25T08:56:18.222727+0000","last_became_peered":"2024-04-25T08:56:18.222727+0000","last_unstale":"2024-04-25T08:56:19.359476+0000","last_undegraded":"2024-04-25T08:56:19.359476+0000","last_fullsized":"2024-04-25T08:56:19.359476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:47.361388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359468+0000","last_change":"2024-04-25T08:56:18.217780+0000","last_active":"2024-04-25T08:56:19.359468+0000","last_peered":"2024-04-25T08:56:19.359468+0000","last_clean":"2024-04-25T08:56:19.359468+0000","last_became_active":"2024-04-25T08:56:18.217411+0000","last_became_peered":"2024-04-25T08:56:18.217411+0000","last_unstale":"2024-04-25T08:56:19.359468+0000","last_undegraded":"2024-04-25T08:56:19.359468+0000","last_fullsized":"2024-04-25T08:56:19.359468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:53.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359681+0000","last_change":"2024-04-25T08:56:17.209473+0000","last_active":"2024-04-25T08:56:19.359681+0000","last_peered":"2024-04-25T08:56:19.359681+0000","last_clean":"2024-04-25T08:56:19.359681+0000","last_became_active":"2024-04-25T08:56:17.209211+0000","last_became_peered":"2024-04-25T08:56:17.209211+0000","last_unstale":"2024-04-25T08:56:19.359681+0000","last_undegraded":"2024-04-25T08:56:19.359681+0000","last_fullsized":"2024-04-25T08:56:19.359681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.024118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346500+0000","last_change":"2024-04-25T08:56:18.213007+0000","last_active":"2024-04-25T08:56:20.346500+0000","last_peered":"2024-04-25T08:56:20.346500+0000","last_clean":"2024-04-25T08:56:20.346500+0000","last_became_active":"2024-04-25T08:56:18.212709+0000","last_became_peered":"2024-04-25T08:56:18.212709+0000","last_unstale":"2024-04-25T08:56:20.346500+0000","last_undegraded":"2024-04-25T08:56:20.346500+0000","last_fullsized":"2024-04-25T08:56:20.346500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:53.942817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196283+0000","last_change":"2024-04-25T08:56:17.212441+0000","last_active":"2024-04-25T08:56:19.196283+0000","last_peered":"2024-04-25T08:56:19.196283+0000","last_clean":"2024-04-25T08:56:19.196283+0000","last_became_active":"2024-04-25T08:56:17.212105+0000","last_became_peered":"2024-04-25T08:56:17.212105+0000","last_unstale":"2024-04-25T08:56:19.196283+0000","last_undegraded":"2024-04-25T08:56:19.196283+0000","last_fullsized":"2024-04-25T08:56:19.196283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:43.080241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359476+0000","last_change":"2024-04-25T08:56:18.220153+0000","last_active":"2024-04-25T08:56:19.359476+0000","last_peered":"2024-04-25T08:56:19.359476+0000","last_clean":"2024-04-25T08:56:19.359476+0000","last_became_active":"2024-04-25T08:56:18.219814+0000","last_became_peered":"2024-04-25T08:56:18.219814+0000","last_unstale":"2024-04-25T08:56:19.359476+0000","last_undegraded":"2024-04-25T08:56:19.359476+0000","last_fullsized":"2024-04-25T08:56:19.359476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:29.370750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359572+0000","last_change":"2024-04-25T08:56:17.210018+0000","last_active":"2024-04-25T08:56:19.359572+0000","last_peered":"2024-04-25T08:56:19.359572+0000","last_clean":"2024-04-25T08:56:19.359572+0000","last_became_active":"2024-04-25T08:56:17.209032+0000","last_became_peered":"2024-04-25T08:56:17.209032+0000","last_unstale":"2024-04-25T08:56:19.359572+0000","last_undegraded":"2024-04-25T08:56:19.359572+0000","last_fullsized":"2024-04-25T08:56:19.359572+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:32.077700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359440+0000","last_change":"2024-04-25T08:56:18.223451+0000","last_active":"2024-04-25T08:56:19.359440+0000","last_peered":"2024-04-25T08:56:19.359440+0000","last_clean":"2024-04-25T08:56:19.359440+0000","last_became_active":"2024-04-25T08:56:18.223100+0000","last_became_peered":"2024-04-25T08:56:18.223100+0000","last_unstale":"2024-04-25T08:56:19.359440+0000","last_undegraded":"2024-04-25T08:56:19.359440+0000","last_fullsized":"2024-04-25T08:56:19.359440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.388864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215475+0000","last_change":"2024-04-25T08:56:17.208994+0000","last_active":"2024-04-25T08:56:18.215475+0000","last_peered":"2024-04-25T08:56:18.215475+0000","last_clean":"2024-04-25T08:56:18.215475+0000","last_became_active":"2024-04-25T08:56:17.208669+0000","last_became_peered":"2024-04-25T08:56:17.208669+0000","last_unstale":"2024-04-25T08:56:18.215475+0000","last_undegraded":"2024-04-25T08:56:18.215475+0000","last_fullsized":"2024-04-25T08:56:18.215475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:56.789554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195704+0000","last_change":"2024-04-25T08:56:18.210662+0000","last_active":"2024-04-25T08:56:19.195704+0000","last_peered":"2024-04-25T08:56:19.195704+0000","last_clean":"2024-04-25T08:56:19.195704+0000","last_became_active":"2024-04-25T08:56:18.210316+0000","last_became_peered":"2024-04-25T08:56:18.210316+0000","last_unstale":"2024-04-25T08:56:19.195704+0000","last_undegraded":"2024-04-25T08:56:19.195704+0000","last_fullsized":"2024-04-25T08:56:19.195704+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:51.409173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.212560+0000","last_change":"2024-04-25T08:56:17.217874+0000","last_active":"2024-04-25T08:56:18.212560+0000","last_peered":"2024-04-25T08:56:18.212560+0000","last_clean":"2024-04-25T08:56:18.212560+0000","last_became_active":"2024-04-25T08:56:17.217659+0000","last_became_peered":"2024-04-25T08:56:17.217659+0000","last_unstale":"2024-04-25T08:56:18.212560+0000","last_undegraded":"2024-04-25T08:56:18.212560+0000","last_fullsized":"2024-04-25T08:56:18.212560+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:53.854649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196361+0000","last_change":"2024-04-25T08:56:18.221070+0000","last_active":"2024-04-25T08:56:19.196361+0000","last_peered":"2024-04-25T08:56:19.196361+0000","last_clean":"2024-04-25T08:56:19.196361+0000","last_became_active":"2024-04-25T08:56:18.220788+0000","last_became_peered":"2024-04-25T08:56:18.220788+0000","last_unstale":"2024-04-25T08:56:19.196361+0000","last_undegraded":"2024-04-25T08:56:19.196361+0000","last_fullsized":"2024-04-25T08:56:19.196361+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:41.014505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359314+0000","last_change":"2024-04-25T08:56:17.208139+0000","last_active":"2024-04-25T08:56:19.359314+0000","last_peered":"2024-04-25T08:56:19.359314+0000","last_clean":"2024-04-25T08:56:19.359314+0000","last_became_active":"2024-04-25T08:56:17.207843+0000","last_became_peered":"2024-04-25T08:56:17.207843+0000","last_unstale":"2024-04-25T08:56:19.359314+0000","last_undegraded":"2024-04-25T08:56:19.359314+0000","last_fullsized":"2024-04-25T08:56:19.359314+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:56.789554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196397+0000","last_change":"2024-04-25T08:56:18.210083+0000","last_active":"2024-04-25T08:56:19.196397+0000","last_peered":"2024-04-25T08:56:19.196397+0000","last_clean":"2024-04-25T08:56:19.196397+0000","last_became_active":"2024-04-25T08:56:18.209783+0000","last_became_peered":"2024-04-25T08:56:18.209783+0000","last_unstale":"2024-04-25T08:56:19.196397+0000","last_undegraded":"2024-04-25T08:56:19.196397+0000","last_fullsized":"2024-04-25T08:56:19.196397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:10.794882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204581+0000","last_change":"2024-04-25T08:56:17.211340+0000","last_active":"2024-04-25T08:56:18.204581+0000","last_peered":"2024-04-25T08:56:18.204581+0000","last_clean":"2024-04-25T08:56:18.204581+0000","last_became_active":"2024-04-25T08:56:17.211002+0000","last_became_peered":"2024-04-25T08:56:17.211002+0000","last_unstale":"2024-04-25T08:56:18.204581+0000","last_undegraded":"2024-04-25T08:56:18.204581+0000","last_fullsized":"2024-04-25T08:56:18.204581+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:59.690478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195577+0000","last_change":"2024-04-25T08:56:18.205814+0000","last_active":"2024-04-25T08:56:19.195577+0000","last_peered":"2024-04-25T08:56:19.195577+0000","last_clean":"2024-04-25T08:56:19.195577+0000","last_became_active":"2024-04-25T08:56:18.205528+0000","last_became_peered":"2024-04-25T08:56:18.205528+0000","last_unstale":"2024-04-25T08:56:19.195577+0000","last_undegraded":"2024-04-25T08:56:19.195577+0000","last_fullsized":"2024-04-25T08:56:19.195577+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:07.023502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.194961+0000","last_change":"2024-04-25T08:56:17.207453+0000","last_active":"2024-04-25T08:56:18.194961+0000","last_peered":"2024-04-25T08:56:18.194961+0000","last_clean":"2024-04-25T08:56:18.194961+0000","last_became_active":"2024-04-25T08:56:17.207230+0000","last_became_peered":"2024-04-25T08:56:17.207230+0000","last_unstale":"2024-04-25T08:56:18.194961+0000","last_undegraded":"2024-04-25T08:56:18.194961+0000","last_fullsized":"2024-04-25T08:56:18.194961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:50.902995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.218097+0000","last_change":"2024-04-25T08:56:18.216487+0000","last_active":"2024-04-25T08:56:18.218097+0000","last_peered":"2024-04-25T08:56:18.218097+0000","last_clean":"2024-04-25T08:56:18.218097+0000","last_became_active":"2024-04-25T08:56:18.215687+0000","last_became_peered":"2024-04-25T08:56:18.215687+0000","last_unstale":"2024-04-25T08:56:18.218097+0000","last_undegraded":"2024-04-25T08:56:18.218097+0000","last_fullsized":"2024-04-25T08:56:18.218097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:12.416991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481604+0000","last_change":"2024-04-25T08:56:17.202622+0000","last_active":"2024-04-25T08:56:19.481604+0000","last_peered":"2024-04-25T08:56:19.481604+0000","last_clean":"2024-04-25T08:56:19.481604+0000","last_became_active":"2024-04-25T08:56:17.202334+0000","last_became_peered":"2024-04-25T08:56:17.202334+0000","last_unstale":"2024-04-25T08:56:19.481604+0000","last_undegraded":"2024-04-25T08:56:19.481604+0000","last_fullsized":"2024-04-25T08:56:19.481604+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.248690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481627+0000","last_change":"2024-04-25T08:56:18.223478+0000","last_active":"2024-04-25T08:56:19.481627+0000","last_peered":"2024-04-25T08:56:19.481627+0000","last_clean":"2024-04-25T08:56:19.481627+0000","last_became_active":"2024-04-25T08:56:18.223262+0000","last_became_peered":"2024-04-25T08:56:18.223262+0000","last_unstale":"2024-04-25T08:56:19.481627+0000","last_undegraded":"2024-04-25T08:56:19.481627+0000","last_fullsized":"2024-04-25T08:56:19.481627+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:47.361388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196303+0000","last_change":"2024-04-25T08:56:17.218177+0000","last_active":"2024-04-25T08:56:19.196303+0000","last_peered":"2024-04-25T08:56:19.196303+0000","last_clean":"2024-04-25T08:56:19.196303+0000","last_became_active":"2024-04-25T08:56:17.217859+0000","last_became_peered":"2024-04-25T08:56:17.217859+0000","last_unstale":"2024-04-25T08:56:19.196303+0000","last_undegraded":"2024-04-25T08:56:19.196303+0000","last_fullsized":"2024-04-25T08:56:19.196303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:01.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346274+0000","last_change":"2024-04-25T08:56:18.214038+0000","last_active":"2024-04-25T08:56:20.346274+0000","last_peered":"2024-04-25T08:56:20.346274+0000","last_clean":"2024-04-25T08:56:20.346274+0000","last_became_active":"2024-04-25T08:56:18.213765+0000","last_became_peered":"2024-04-25T08:56:18.213765+0000","last_unstale":"2024-04-25T08:56:20.346274+0000","last_undegraded":"2024-04-25T08:56:20.346274+0000","last_fullsized":"2024-04-25T08:56:20.346274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:58.964006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481558+0000","last_change":"2024-04-25T08:56:17.209000+0000","last_active":"2024-04-25T08:56:19.481558+0000","last_peered":"2024-04-25T08:56:19.481558+0000","last_clean":"2024-04-25T08:56:19.481558+0000","last_became_active":"2024-04-25T08:56:17.208727+0000","last_became_peered":"2024-04-25T08:56:17.208727+0000","last_unstale":"2024-04-25T08:56:19.481558+0000","last_undegraded":"2024-04-25T08:56:19.481558+0000","last_fullsized":"2024-04-25T08:56:19.481558+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:50.271504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481437+0000","last_change":"2024-04-25T08:56:18.220854+0000","last_active":"2024-04-25T08:56:19.481437+0000","last_peered":"2024-04-25T08:56:19.481437+0000","last_clean":"2024-04-25T08:56:19.481437+0000","last_became_active":"2024-04-25T08:56:18.220406+0000","last_became_peered":"2024-04-25T08:56:18.220406+0000","last_unstale":"2024-04-25T08:56:19.481437+0000","last_undegraded":"2024-04-25T08:56:19.481437+0000","last_fullsized":"2024-04-25T08:56:19.481437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:10.524577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.233028+0000","last_change":"2024-04-25T08:56:17.199981+0000","last_active":"2024-04-25T08:56:18.233028+0000","last_peered":"2024-04-25T08:56:18.233028+0000","last_clean":"2024-04-25T08:56:18.233028+0000","last_became_active":"2024-04-25T08:56:17.199667+0000","last_became_peered":"2024-04-25T08:56:17.199667+0000","last_unstale":"2024-04-25T08:56:18.233028+0000","last_undegraded":"2024-04-25T08:56:18.233028+0000","last_fullsized":"2024-04-25T08:56:18.233028+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:19.999889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.225164+0000","last_change":"2024-04-25T08:56:18.221416+0000","last_active":"2024-04-25T08:56:18.225164+0000","last_peered":"2024-04-25T08:56:18.225164+0000","last_clean":"2024-04-25T08:56:18.225164+0000","last_became_active":"2024-04-25T08:56:18.221196+0000","last_became_peered":"2024-04-25T08:56:18.221196+0000","last_unstale":"2024-04-25T08:56:18.225164+0000","last_undegraded":"2024-04-25T08:56:18.225164+0000","last_fullsized":"2024-04-25T08:56:18.225164+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:02.980311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196227+0000","last_change":"2024-04-25T08:56:17.218664+0000","last_active":"2024-04-25T08:56:19.196227+0000","last_peered":"2024-04-25T08:56:19.196227+0000","last_clean":"2024-04-25T08:56:19.196227+0000","last_became_active":"2024-04-25T08:56:17.218365+0000","last_became_peered":"2024-04-25T08:56:17.218365+0000","last_unstale":"2024-04-25T08:56:19.196227+0000","last_undegraded":"2024-04-25T08:56:19.196227+0000","last_fullsized":"2024-04-25T08:56:19.196227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:39.098749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481296+0000","last_change":"2024-04-25T08:56:18.212351+0000","last_active":"2024-04-25T08:56:19.481296+0000","last_peered":"2024-04-25T08:56:19.481296+0000","last_clean":"2024-04-25T08:56:19.481296+0000","last_became_active":"2024-04-25T08:56:18.212075+0000","last_became_peered":"2024-04-25T08:56:18.212075+0000","last_unstale":"2024-04-25T08:56:19.481296+0000","last_undegraded":"2024-04-25T08:56:19.481296+0000","last_fullsized":"2024-04-25T08:56:19.481296+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196473+0000","last_change":"2024-04-25T08:56:17.200568+0000","last_active":"2024-04-25T08:56:19.196473+0000","last_peered":"2024-04-25T08:56:19.196473+0000","last_clean":"2024-04-25T08:56:19.196473+0000","last_became_active":"2024-04-25T08:56:17.200242+0000","last_became_peered":"2024-04-25T08:56:17.200242+0000","last_unstale":"2024-04-25T08:56:19.196473+0000","last_undegraded":"2024-04-25T08:56:19.196473+0000","last_fullsized":"2024-04-25T08:56:19.196473+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:57.237578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215172+0000","last_change":"2024-04-25T08:56:18.213076+0000","last_active":"2024-04-25T08:56:18.215172+0000","last_peered":"2024-04-25T08:56:18.215172+0000","last_clean":"2024-04-25T08:56:18.215172+0000","last_became_active":"2024-04-25T08:56:18.212746+0000","last_became_peered":"2024-04-25T08:56:18.212746+0000","last_unstale":"2024-04-25T08:56:18.215172+0000","last_undegraded":"2024-04-25T08:56:18.215172+0000","last_fullsized":"2024-04-25T08:56:18.215172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:22.026643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204803+0000","last_change":"2024-04-25T08:56:17.209077+0000","last_active":"2024-04-25T08:56:18.204803+0000","last_peered":"2024-04-25T08:56:18.204803+0000","last_clean":"2024-04-25T08:56:18.204803+0000","last_became_active":"2024-04-25T08:56:17.208079+0000","last_became_peered":"2024-04-25T08:56:17.208079+0000","last_unstale":"2024-04-25T08:56:18.204803+0000","last_undegraded":"2024-04-25T08:56:18.204803+0000","last_fullsized":"2024-04-25T08:56:18.204803+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:11.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481202+0000","last_change":"2024-04-25T08:56:18.223135+0000","last_active":"2024-04-25T08:56:19.481202+0000","last_peered":"2024-04-25T08:56:19.481202+0000","last_clean":"2024-04-25T08:56:19.481202+0000","last_became_active":"2024-04-25T08:56:18.222867+0000","last_became_peered":"2024-04-25T08:56:18.222867+0000","last_unstale":"2024-04-25T08:56:19.481202+0000","last_undegraded":"2024-04-25T08:56:19.481202+0000","last_fullsized":"2024-04-25T08:56:19.481202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:18.749861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481015+0000","last_change":"2024-04-25T08:56:17.209066+0000","last_active":"2024-04-25T08:56:19.481015+0000","last_peered":"2024-04-25T08:56:19.481015+0000","last_clean":"2024-04-25T08:56:19.481015+0000","last_became_active":"2024-04-25T08:56:17.208841+0000","last_became_peered":"2024-04-25T08:56:17.208841+0000","last_unstale":"2024-04-25T08:56:19.481015+0000","last_undegraded":"2024-04-25T08:56:19.481015+0000","last_fullsized":"2024-04-25T08:56:19.481015+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:21.082806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481564+0000","last_change":"2024-04-25T08:56:18.215974+0000","last_active":"2024-04-25T08:56:19.481564+0000","last_peered":"2024-04-25T08:56:19.481564+0000","last_clean":"2024-04-25T08:56:19.481564+0000","last_became_active":"2024-04-25T08:56:18.215532+0000","last_became_peered":"2024-04-25T08:56:18.215532+0000","last_unstale":"2024-04-25T08:56:19.481564+0000","last_undegraded":"2024-04-25T08:56:19.481564+0000","last_fullsized":"2024-04-25T08:56:19.481564+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:29.370750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196574+0000","last_change":"2024-04-25T08:56:17.218282+0000","last_active":"2024-04-25T08:56:19.196574+0000","last_peered":"2024-04-25T08:56:19.196574+0000","last_clean":"2024-04-25T08:56:19.196574+0000","last_became_active":"2024-04-25T08:56:17.217970+0000","last_became_peered":"2024-04-25T08:56:17.217970+0000","last_unstale":"2024-04-25T08:56:19.196574+0000","last_undegraded":"2024-04-25T08:56:19.196574+0000","last_fullsized":"2024-04-25T08:56:19.196574+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:57.959960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.225552+0000","last_change":"2024-04-25T08:56:18.222912+0000","last_active":"2024-04-25T08:56:18.225552+0000","last_peered":"2024-04-25T08:56:18.225552+0000","last_clean":"2024-04-25T08:56:18.225552+0000","last_became_active":"2024-04-25T08:56:18.222609+0000","last_became_peered":"2024-04-25T08:56:18.222609+0000","last_unstale":"2024-04-25T08:56:18.225552+0000","last_undegraded":"2024-04-25T08:56:18.225552+0000","last_fullsized":"2024-04-25T08:56:18.225552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:36.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359576+0000","last_change":"2024-04-25T08:56:17.217247+0000","last_active":"2024-04-25T08:56:19.359576+0000","last_peered":"2024-04-25T08:56:19.359576+0000","last_clean":"2024-04-25T08:56:19.359576+0000","last_became_active":"2024-04-25T08:56:17.216896+0000","last_became_peered":"2024-04-25T08:56:17.216896+0000","last_unstale":"2024-04-25T08:56:19.359576+0000","last_undegraded":"2024-04-25T08:56:19.359576+0000","last_fullsized":"2024-04-25T08:56:19.359576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:11.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196124+0000","last_change":"2024-04-25T08:56:18.202536+0000","last_active":"2024-04-25T08:56:19.196124+0000","last_peered":"2024-04-25T08:56:19.196124+0000","last_clean":"2024-04-25T08:56:19.196124+0000","last_became_active":"2024-04-25T08:56:18.202235+0000","last_became_peered":"2024-04-25T08:56:18.202235+0000","last_unstale":"2024-04-25T08:56:19.196124+0000","last_undegraded":"2024-04-25T08:56:19.196124+0000","last_fullsized":"2024-04-25T08:56:19.196124+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:32.018334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215666+0000","last_change":"2024-04-25T08:56:17.205551+0000","last_active":"2024-04-25T08:56:18.215666+0000","last_peered":"2024-04-25T08:56:18.215666+0000","last_clean":"2024-04-25T08:56:18.215666+0000","last_became_active":"2024-04-25T08:56:17.205230+0000","last_became_peered":"2024-04-25T08:56:17.205230+0000","last_unstale":"2024-04-25T08:56:18.215666+0000","last_undegraded":"2024-04-25T08:56:18.215666+0000","last_fullsized":"2024-04-25T08:56:18.215666+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:20.992044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481566+0000","last_change":"2024-04-25T08:56:18.220992+0000","last_active":"2024-04-25T08:56:19.481566+0000","last_peered":"2024-04-25T08:56:19.481566+0000","last_clean":"2024-04-25T08:56:19.481566+0000","last_became_active":"2024-04-25T08:56:18.220716+0000","last_became_peered":"2024-04-25T08:56:18.220716+0000","last_unstale":"2024-04-25T08:56:19.481566+0000","last_undegraded":"2024-04-25T08:56:19.481566+0000","last_fullsized":"2024-04-25T08:56:19.481566+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:53.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359615+0000","last_change":"2024-04-25T08:56:17.207716+0000","last_active":"2024-04-25T08:56:19.359615+0000","last_peered":"2024-04-25T08:56:19.359615+0000","last_clean":"2024-04-25T08:56:19.359615+0000","last_became_active":"2024-04-25T08:56:17.207377+0000","last_became_peered":"2024-04-25T08:56:17.207377+0000","last_unstale":"2024-04-25T08:56:19.359615+0000","last_undegraded":"2024-04-25T08:56:19.359615+0000","last_fullsized":"2024-04-25T08:56:19.359615+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:59.690478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222580+0000","last_change":"2024-04-25T08:56:18.214828+0000","last_active":"2024-04-25T08:56:18.222580+0000","last_peered":"2024-04-25T08:56:18.222580+0000","last_clean":"2024-04-25T08:56:18.222580+0000","last_became_active":"2024-04-25T08:56:18.214546+0000","last_became_peered":"2024-04-25T08:56:18.214546+0000","last_unstale":"2024-04-25T08:56:18.222580+0000","last_undegraded":"2024-04-25T08:56:18.222580+0000","last_fullsized":"2024-04-25T08:56:18.222580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:44.082766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196468+0000","last_change":"2024-04-25T08:56:17.211265+0000","last_active":"2024-04-25T08:56:19.196468+0000","last_peered":"2024-04-25T08:56:19.196468+0000","last_clean":"2024-04-25T08:56:19.196468+0000","last_became_active":"2024-04-25T08:56:17.210943+0000","last_became_peered":"2024-04-25T08:56:17.210943+0000","last_unstale":"2024-04-25T08:56:19.196468+0000","last_undegraded":"2024-04-25T08:56:19.196468+0000","last_fullsized":"2024-04-25T08:56:19.196468+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:35.063530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359715+0000","last_change":"2024-04-25T08:56:18.218361+0000","last_active":"2024-04-25T08:56:19.359715+0000","last_peered":"2024-04-25T08:56:19.359715+0000","last_clean":"2024-04-25T08:56:19.359715+0000","last_became_active":"2024-04-25T08:56:18.218070+0000","last_became_peered":"2024-04-25T08:56:18.218070+0000","last_unstale":"2024-04-25T08:56:19.359715+0000","last_undegraded":"2024-04-25T08:56:19.359715+0000","last_fullsized":"2024-04-25T08:56:19.359715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:07.045007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346209+0000","last_change":"2024-04-25T08:56:17.217221+0000","last_active":"2024-04-25T08:56:20.346209+0000","last_peered":"2024-04-25T08:56:20.346209+0000","last_clean":"2024-04-25T08:56:20.346209+0000","last_became_active":"2024-04-25T08:56:17.216923+0000","last_became_peered":"2024-04-25T08:56:17.216923+0000","last_unstale":"2024-04-25T08:56:20.346209+0000","last_undegraded":"2024-04-25T08:56:20.346209+0000","last_fullsized":"2024-04-25T08:56:20.346209+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:31.733647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359223+0000","last_change":"2024-04-25T08:56:18.218040+0000","last_active":"2024-04-25T08:56:19.359223+0000","last_peered":"2024-04-25T08:56:19.359223+0000","last_clean":"2024-04-25T08:56:19.359223+0000","last_became_active":"2024-04-25T08:56:18.217711+0000","last_became_peered":"2024-04-25T08:56:18.217711+0000","last_unstale":"2024-04-25T08:56:19.359223+0000","last_undegraded":"2024-04-25T08:56:19.359223+0000","last_fullsized":"2024-04-25T08:56:19.359223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:34:03.547004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204576+0000","last_change":"2024-04-25T08:56:17.210094+0000","last_active":"2024-04-25T08:56:18.204576+0000","last_peered":"2024-04-25T08:56:18.204576+0000","last_clean":"2024-04-25T08:56:18.204576+0000","last_became_active":"2024-04-25T08:56:17.209773+0000","last_became_peered":"2024-04-25T08:56:17.209773+0000","last_unstale":"2024-04-25T08:56:18.204576+0000","last_undegraded":"2024-04-25T08:56:18.204576+0000","last_fullsized":"2024-04-25T08:56:18.204576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.024118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222599+0000","last_change":"2024-04-25T08:56:18.215521+0000","last_active":"2024-04-25T08:56:18.222599+0000","last_peered":"2024-04-25T08:56:18.222599+0000","last_clean":"2024-04-25T08:56:18.222599+0000","last_became_active":"2024-04-25T08:56:18.215222+0000","last_became_peered":"2024-04-25T08:56:18.215222+0000","last_unstale":"2024-04-25T08:56:18.222599+0000","last_undegraded":"2024-04-25T08:56:18.222599+0000","last_fullsized":"2024-04-25T08:56:18.222599+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:40.101275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346459+0000","last_change":"2024-04-25T08:56:17.213267+0000","last_active":"2024-04-25T08:56:20.346459+0000","last_peered":"2024-04-25T08:56:20.346459+0000","last_clean":"2024-04-25T08:56:20.346459+0000","last_became_active":"2024-04-25T08:56:17.212962+0000","last_became_peered":"2024-04-25T08:56:17.212962+0000","last_unstale":"2024-04-25T08:56:20.346459+0000","last_undegraded":"2024-04-25T08:56:20.346459+0000","last_fullsized":"2024-04-25T08:56:20.346459+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:52.207757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222791+0000","last_change":"2024-04-25T08:56:18.213570+0000","last_active":"2024-04-25T08:56:18.222791+0000","last_peered":"2024-04-25T08:56:18.222791+0000","last_clean":"2024-04-25T08:56:18.222791+0000","last_became_active":"2024-04-25T08:56:18.212104+0000","last_became_peered":"2024-04-25T08:56:18.212104+0000","last_unstale":"2024-04-25T08:56:18.222791+0000","last_undegraded":"2024-04-25T08:56:18.222791+0000","last_fullsized":"2024-04-25T08:56:18.222791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:26.179109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359605+0000","last_change":"2024-04-25T08:56:17.208227+0000","last_active":"2024-04-25T08:56:19.359605+0000","last_peered":"2024-04-25T08:56:19.359605+0000","last_clean":"2024-04-25T08:56:19.359605+0000","last_became_active":"2024-04-25T08:56:17.207936+0000","last_became_peered":"2024-04-25T08:56:17.207936+0000","last_unstale":"2024-04-25T08:56:19.359605+0000","last_undegraded":"2024-04-25T08:56:19.359605+0000","last_fullsized":"2024-04-25T08:56:19.359605+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:20.992044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346370+0000","last_change":"2024-04-25T08:56:18.213602+0000","last_active":"2024-04-25T08:56:20.346370+0000","last_peered":"2024-04-25T08:56:20.346370+0000","last_clean":"2024-04-25T08:56:20.346370+0000","last_became_active":"2024-04-25T08:56:18.213096+0000","last_became_peered":"2024-04-25T08:56:18.213096+0000","last_unstale":"2024-04-25T08:56:20.346370+0000","last_undegraded":"2024-04-25T08:56:20.346370+0000","last_fullsized":"2024-04-25T08:56:20.346370+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:50.064809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196657+0000","last_change":"2024-04-25T08:56:17.199076+0000","last_active":"2024-04-25T08:56:19.196657+0000","last_peered":"2024-04-25T08:56:19.196657+0000","last_clean":"2024-04-25T08:56:19.196657+0000","last_became_active":"2024-04-25T08:56:17.198759+0000","last_became_peered":"2024-04-25T08:56:17.198759+0000","last_unstale":"2024-04-25T08:56:19.196657+0000","last_undegraded":"2024-04-25T08:56:19.196657+0000","last_fullsized":"2024-04-25T08:56:19.196657+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:35.077938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359501+0000","last_change":"2024-04-25T08:56:18.223807+0000","last_active":"2024-04-25T08:56:19.359501+0000","last_peered":"2024-04-25T08:56:19.359501+0000","last_clean":"2024-04-25T08:56:19.359501+0000","last_became_active":"2024-04-25T08:56:18.223515+0000","last_became_peered":"2024-04-25T08:56:18.223515+0000","last_unstale":"2024-04-25T08:56:19.359501+0000","last_undegraded":"2024-04-25T08:56:19.359501+0000","last_fullsized":"2024-04-25T08:56:19.359501+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:57.277364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.205872+0000","last_change":"2024-04-25T08:56:17.208356+0000","last_active":"2024-04-25T08:56:18.205872+0000","last_peered":"2024-04-25T08:56:18.205872+0000","last_clean":"2024-04-25T08:56:18.205872+0000","last_became_active":"2024-04-25T08:56:17.208086+0000","last_became_peered":"2024-04-25T08:56:17.208086+0000","last_unstale":"2024-04-25T08:56:18.205872+0000","last_undegraded":"2024-04-25T08:56:18.205872+0000","last_fullsized":"2024-04-25T08:56:18.205872+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:32.077700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195840+0000","last_change":"2024-04-25T08:56:18.207334+0000","last_active":"2024-04-25T08:56:19.195840+0000","last_peered":"2024-04-25T08:56:19.195840+0000","last_clean":"2024-04-25T08:56:19.195840+0000","last_became_active":"2024-04-25T08:56:18.206799+0000","last_became_peered":"2024-04-25T08:56:18.206799+0000","last_unstale":"2024-04-25T08:56:19.195840+0000","last_undegraded":"2024-04-25T08:56:19.195840+0000","last_fullsized":"2024-04-25T08:56:19.195840+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:11.835152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346080+0000","last_change":"2024-04-25T08:56:17.209129+0000","last_active":"2024-04-25T08:56:20.346080+0000","last_peered":"2024-04-25T08:56:20.346080+0000","last_clean":"2024-04-25T08:56:20.346080+0000","last_became_active":"2024-04-25T08:56:17.208830+0000","last_became_peered":"2024-04-25T08:56:17.208830+0000","last_unstale":"2024-04-25T08:56:20.346080+0000","last_undegraded":"2024-04-25T08:56:20.346080+0000","last_fullsized":"2024-04-25T08:56:20.346080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:41.038731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481425+0000","last_change":"2024-04-25T08:56:18.222650+0000","last_active":"2024-04-25T08:56:19.481425+0000","last_peered":"2024-04-25T08:56:19.481425+0000","last_clean":"2024-04-25T08:56:19.481425+0000","last_became_active":"2024-04-25T08:56:18.222247+0000","last_became_peered":"2024-04-25T08:56:18.222247+0000","last_unstale":"2024-04-25T08:56:19.481425+0000","last_undegraded":"2024-04-25T08:56:19.481425+0000","last_fullsized":"2024-04-25T08:56:19.481425+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.196651+0000","last_change":"2024-04-25T08:56:17.202547+0000","last_active":"2024-04-25T08:56:18.196651+0000","last_peered":"2024-04-25T08:56:18.196651+0000","last_clean":"2024-04-25T08:56:18.196651+0000","last_became_active":"2024-04-25T08:56:17.202228+0000","last_became_peered":"2024-04-25T08:56:17.202228+0000","last_unstale":"2024-04-25T08:56:18.196651+0000","last_undegraded":"2024-04-25T08:56:18.196651+0000","last_fullsized":"2024-04-25T08:56:18.196651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:21.082806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346123+0000","last_change":"2024-04-25T08:56:18.205118+0000","last_active":"2024-04-25T08:56:20.346123+0000","last_peered":"2024-04-25T08:56:20.346123+0000","last_clean":"2024-04-25T08:56:20.346123+0000","last_became_active":"2024-04-25T08:56:18.204817+0000","last_became_peered":"2024-04-25T08:56:18.204817+0000","last_unstale":"2024-04-25T08:56:20.346123+0000","last_undegraded":"2024-04-25T08:56:20.346123+0000","last_fullsized":"2024-04-25T08:56:20.346123+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:16.070089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346080+0000","last_change":"2024-04-25T08:56:17.200745+0000","last_active":"2024-04-25T08:56:20.346080+0000","last_peered":"2024-04-25T08:56:20.346080+0000","last_clean":"2024-04-25T08:56:20.346080+0000","last_became_active":"2024-04-25T08:56:17.200486+0000","last_became_peered":"2024-04-25T08:56:17.200486+0000","last_unstale":"2024-04-25T08:56:20.346080+0000","last_undegraded":"2024-04-25T08:56:20.346080+0000","last_fullsized":"2024-04-25T08:56:20.346080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:56.826119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195622+0000","last_change":"2024-04-25T08:56:18.206772+0000","last_active":"2024-04-25T08:56:19.195622+0000","last_peered":"2024-04-25T08:56:19.195622+0000","last_clean":"2024-04-25T08:56:19.195622+0000","last_became_active":"2024-04-25T08:56:18.206478+0000","last_became_peered":"2024-04-25T08:56:18.206478+0000","last_unstale":"2024-04-25T08:56:19.195622+0000","last_undegraded":"2024-04-25T08:56:19.195622+0000","last_fullsized":"2024-04-25T08:56:19.195622+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:38.623368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195622+0000","last_change":"2024-04-25T08:56:17.212487+0000","last_active":"2024-04-25T08:56:19.195622+0000","last_peered":"2024-04-25T08:56:19.195622+0000","last_clean":"2024-04-25T08:56:19.195622+0000","last_became_active":"2024-04-25T08:56:17.212169+0000","last_became_peered":"2024-04-25T08:56:17.212169+0000","last_unstale":"2024-04-25T08:56:19.195622+0000","last_undegraded":"2024-04-25T08:56:19.195622+0000","last_fullsized":"2024-04-25T08:56:19.195622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:54.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195510+0000","last_change":"2024-04-25T08:56:18.217388+0000","last_active":"2024-04-25T08:56:19.195510+0000","last_peered":"2024-04-25T08:56:19.195510+0000","last_clean":"2024-04-25T08:56:19.195510+0000","last_became_active":"2024-04-25T08:56:18.217118+0000","last_became_peered":"2024-04-25T08:56:18.217118+0000","last_unstale":"2024-04-25T08:56:19.195510+0000","last_undegraded":"2024-04-25T08:56:19.195510+0000","last_fullsized":"2024-04-25T08:56:19.195510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:55.113303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196321+0000","last_change":"2024-04-25T08:56:17.210100+0000","last_active":"2024-04-25T08:56:19.196321+0000","last_peered":"2024-04-25T08:56:19.196321+0000","last_clean":"2024-04-25T08:56:19.196321+0000","last_became_active":"2024-04-25T08:56:17.209722+0000","last_became_peered":"2024-04-25T08:56:17.209722+0000","last_unstale":"2024-04-25T08:56:19.196321+0000","last_undegraded":"2024-04-25T08:56:19.196321+0000","last_fullsized":"2024-04-25T08:56:19.196321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:35.041624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":240,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.480994+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:56:19.480994+0000","last_peered":"2024-04-25T08:56:19.480994+0000","last_clean":"2024-04-25T08:56:19.480994+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:56:19.480994+0000","last_undegraded":"2024-04-25T08:56:19.480994+0000","last_fullsized":"2024-04-25T08:56:19.480994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28308,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343532,"statfs":{"total":96636764160,"available":96607776768,"internally_reserved":0,"allocated":1314816,"data_stored":884994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":712704,"data_stored":294466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":295118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":724992,"data_stored":296078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":300822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":300822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1323008,"data_stored":887028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":300856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:56:23.843 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-04-25T08:56:23.854+0000 7fb0c97d9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:56:25.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:56:25.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.758+0000 7f0dd6cf5640 1 Processor -- start 2024-04-25T08:56:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.758+0000 7f0dd6cf5640 1 -- start start 2024-04-25T08:56:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd6cf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0dd015a730 0x7f0dd00ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd6cf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0dd00b4020 0x7f0dd00b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd6cf5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0dd006d1b0 0x7f0dd006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd6cf5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd00b49a0 con 0x7f0dd015a730 2024-04-25T08:56:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd6cf5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd00cc020 con 0x7f0dd006d1b0 2024-04-25T08:56:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd6cf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00b32b0 con 0x7f0dd00b4020 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd4a91640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0dd015a730 0x7f0dd00ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd4a91640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0dd015a730 0x7f0dd00ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39244/0 (socket says 172.21.15.55:39244) 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd4a91640 1 -- 172.21.15.55:0/3579111289 learned_addr learned my addr 172.21.15.55:0/3579111289 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd5292640 1 --2- 172.21.15.55:0/3579111289 >> v2:172.21.15.167:3300/0 conn(0x7f0dd006d1b0 0x7f0dd006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dc7fff640 1 --2- 172.21.15.55:0/3579111289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0dd00b4020 0x7f0dd00b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd4a91640 1 -- 172.21.15.55:0/3579111289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0dd00b4020 msgr2=0x7f0dd00b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd4a91640 1 --2- 172.21.15.55:0/3579111289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0dd00b4020 0x7f0dd00b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd4a91640 1 -- 172.21.15.55:0/3579111289 >> v2:172.21.15.167:3300/0 conn(0x7f0dd006d1b0 msgr2=0x7f0dd006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd4a91640 1 --2- 172.21.15.55:0/3579111289 >> v2:172.21.15.167:3300/0 conn(0x7f0dd006d1b0 0x7f0dd006d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd4a91640 1 -- 172.21.15.55:0/3579111289 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00b3590 con 0x7f0dd015a730 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dc7fff640 1 --2- 172.21.15.55:0/3579111289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0dd00b4020 0x7f0dd00b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.759+0000 7f0dd5292640 1 --2- 172.21.15.55:0/3579111289 >> v2:172.21.15.167:3300/0 conn(0x7f0dd006d1b0 0x7f0dd006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.760+0000 7f0dd4a91640 1 --2- 172.21.15.55:0/3579111289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd015a730 0x7f0dd00ae9b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f0dd006ba90 tx=0x7f0dcc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a38751c7840d2e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.760+0000 7f0dc77fe640 1 -- 172.21.15.55:0/3579111289 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc037070 con 0x7f0dd015a730 2024-04-25T08:56:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.760+0000 7f0dc77fe640 1 -- 172.21.15.55:0/3579111289 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc032440 con 0x7f0dd015a730 2024-04-25T08:56:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.760+0000 7f0dc77fe640 1 -- 172.21.15.55:0/3579111289 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc032810 con 0x7f0dd015a730 2024-04-25T08:56:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.761+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/3579111289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd015a730 msgr2=0x7f0dd00ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.761+0000 7f0dd6cf5640 1 --2- 172.21.15.55:0/3579111289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd015a730 0x7f0dd00ae9b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f0dd006ba90 tx=0x7f0dcc02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.761+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/3579111289 shutdown_connections 2024-04-25T08:56:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.761+0000 7f0dd6cf5640 1 --2- 172.21.15.55:0/3579111289 >> v2:172.21.15.167:3300/0 conn(0x7f0dd006d1b0 0x7f0dd006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.761+0000 7f0dd6cf5640 1 --2- 172.21.15.55:0/3579111289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0dd00b4020 0x7f0dd00b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.761+0000 7f0dd6cf5640 1 --2- 172.21.15.55:0/3579111289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd015a730 0x7f0dd00ae9b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.761+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/3579111289 >> 172.21.15.55:0/3579111289 conn(0x7f0dd006aba0 msgr2=0x7f0dd006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.761+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/3579111289 shutdown_connections 2024-04-25T08:56:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.761+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/3579111289 wait complete. 2024-04-25T08:56:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.762+0000 7f0dd6cf5640 1 Processor -- start 2024-04-25T08:56:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.762+0000 7f0dd6cf5640 1 -- start start 2024-04-25T08:56:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dd6cf5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dd006d1b0 0x7f0dd013f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dd6cf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd00b4020 0x7f0dd015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dd6cf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0dd015a730 0x7f0dd015d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dd6cf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00cd620 con 0x7f0dd00b4020 2024-04-25T08:56:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dd6cf5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00b3b50 con 0x7f0dd006d1b0 2024-04-25T08:56:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dd6cf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00aeef0 con 0x7f0dd015a730 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dc7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd00b4020 0x7f0dd015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dc7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd00b4020 0x7f0dd015cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39254/0 (socket says 172.21.15.55:39254) 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dc7fff640 1 -- 172.21.15.55:0/923224095 learned_addr learned my addr 172.21.15.55:0/923224095 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dd4a91640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dd006d1b0 0x7f0dd013f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dd5292640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0dd015a730 0x7f0dd015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dc7fff640 1 -- 172.21.15.55:0/923224095 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0dd015a730 msgr2=0x7f0dd015d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dc7fff640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0dd015a730 0x7f0dd015d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dc7fff640 1 -- 172.21.15.55:0/923224095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dd006d1b0 msgr2=0x7f0dd013f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dc7fff640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dd006d1b0 0x7f0dd013f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.763+0000 7f0dc7fff640 1 -- 172.21.15.55:0/923224095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0159430 con 0x7f0dd00b4020 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.764+0000 7f0dc7fff640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd00b4020 0x7f0dd015cf10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000e730 tx=0x7f0dc000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.764+0000 7f0dc57fa640 1 -- 172.21.15.55:0/923224095 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000f040 con 0x7f0dd00b4020 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.764+0000 7f0dc57fa640 1 -- 172.21.15.55:0/923224095 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc0004230 con 0x7f0dd00b4020 2024-04-25T08:56:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.764+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/923224095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd0159710 con 0x7f0dd00b4020 2024-04-25T08:56:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.764+0000 7f0dc57fa640 1 -- 172.21.15.55:0/923224095 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000ee40 con 0x7f0dd00b4020 2024-04-25T08:56:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.764+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/923224095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd01e4200 con 0x7f0dd00b4020 2024-04-25T08:56:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.765+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/923224095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd00749b0 con 0x7f0dd00b4020 2024-04-25T08:56:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.765+0000 7f0dc57fa640 1 -- 172.21.15.55:0/923224095 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0dc000c6d0 con 0x7f0dd00b4020 2024-04-25T08:56:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.766+0000 7f0dc57fa640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0dbc06b4d0 0x7f0dbc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.766+0000 7f0dc57fa640 1 -- 172.21.15.55:0/923224095 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dc0089dc0 con 0x7f0dd00b4020 2024-04-25T08:56:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.766+0000 7f0dd4a91640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0dbc06b4d0 0x7f0dbc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.766+0000 7f0dd4a91640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0dbc06b4d0 0x7f0dbc06d990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc034000 tx=0x7f0dcc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:25.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.770+0000 7f0dc57fa640 1 -- 172.21.15.55:0/923224095 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0dc0017020 con 0x7f0dd00b4020 2024-04-25T08:56:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.947+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/923224095 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0dd0151ef0 con 0x7f0dbc06b4d0 2024-04-25T08:56:25.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.953+0000 7f0dc57fa640 1 -- 172.21.15.55:0/923224095 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251939 (secure 0 0 0) 0x7f0dd0151ef0 con 0x7f0dbc06b4d0 2024-04-25T08:56:25.945 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:25.946 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:56:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.955+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/923224095 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0dbc06b4d0 msgr2=0x7f0dbc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.955+0000 7f0dd6cf5640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0dbc06b4d0 0x7f0dbc06d990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc034000 tx=0x7f0dcc02e000 comp rx=0 tx=0).stop 2024-04-25T08:56:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.956+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/923224095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd00b4020 msgr2=0x7f0dd015cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.956+0000 7f0dd6cf5640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd00b4020 0x7f0dd015cf10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000e730 tx=0x7f0dc000ebf0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.956+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/923224095 shutdown_connections 2024-04-25T08:56:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.956+0000 7f0dd6cf5640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0dbc06b4d0 0x7f0dbc06d990 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.956+0000 7f0dd6cf5640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0dd015a730 0x7f0dd015d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.956+0000 7f0dd6cf5640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd00b4020 0x7f0dd015cf10 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.956+0000 7f0dd6cf5640 1 --2- 172.21.15.55:0/923224095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dd006d1b0 0x7f0dd013f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.956+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/923224095 >> 172.21.15.55:0/923224095 conn(0x7f0dd006aba0 msgr2=0x7f0dd00af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.956+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/923224095 shutdown_connections 2024-04-25T08:56:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:25.956+0000 7f0dd6cf5640 1 -- 172.21.15.55:0/923224095 wait complete. 2024-04-25T08:56:25.956 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-04-25T08:56:24.584553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239664,"kb_used_data":6828,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735056,"statfs":{"total":773094113280,"available":772848697344,"internally_reserved":0,"allocated":6991872,"data_stored":3560184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.393172"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197228+0000","last_change":"2024-04-25T08:56:18.216097+0000","last_active":"2024-04-25T08:56:19.197228+0000","last_peered":"2024-04-25T08:56:19.197228+0000","last_clean":"2024-04-25T08:56:19.197228+0000","last_became_active":"2024-04-25T08:56:18.215813+0000","last_became_peered":"2024-04-25T08:56:18.215813+0000","last_unstale":"2024-04-25T08:56:19.197228+0000","last_undegraded":"2024-04-25T08:56:19.197228+0000","last_fullsized":"2024-04-25T08:56:19.197228+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:16.551427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196183+0000","last_change":"2024-04-25T08:56:18.216111+0000","last_active":"2024-04-25T08:56:19.196183+0000","last_peered":"2024-04-25T08:56:19.196183+0000","last_clean":"2024-04-25T08:56:19.196183+0000","last_became_active":"2024-04-25T08:56:18.215825+0000","last_became_peered":"2024-04-25T08:56:18.215825+0000","last_unstale":"2024-04-25T08:56:19.196183+0000","last_undegraded":"2024-04-25T08:56:19.196183+0000","last_fullsized":"2024-04-25T08:56:19.196183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:27.852434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481340+0000","last_change":"2024-04-25T08:56:18.216482+0000","last_active":"2024-04-25T08:56:19.481340+0000","last_peered":"2024-04-25T08:56:19.481340+0000","last_clean":"2024-04-25T08:56:19.481340+0000","last_became_active":"2024-04-25T08:56:18.216109+0000","last_became_peered":"2024-04-25T08:56:18.216109+0000","last_unstale":"2024-04-25T08:56:19.481340+0000","last_undegraded":"2024-04-25T08:56:19.481340+0000","last_fullsized":"2024-04-25T08:56:19.481340+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:34:03.547004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222711+0000","last_change":"2024-04-25T08:56:18.215504+0000","last_active":"2024-04-25T08:56:18.222711+0000","last_peered":"2024-04-25T08:56:18.222711+0000","last_clean":"2024-04-25T08:56:18.222711+0000","last_became_active":"2024-04-25T08:56:18.215231+0000","last_became_peered":"2024-04-25T08:56:18.215231+0000","last_unstale":"2024-04-25T08:56:18.222711+0000","last_undegraded":"2024-04-25T08:56:18.222711+0000","last_fullsized":"2024-04-25T08:56:18.222711+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:55.008870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196987+0000","last_change":"2024-04-25T08:56:18.215438+0000","last_active":"2024-04-25T08:56:19.196987+0000","last_peered":"2024-04-25T08:56:19.196987+0000","last_clean":"2024-04-25T08:56:19.196987+0000","last_became_active":"2024-04-25T08:56:18.215127+0000","last_became_peered":"2024-04-25T08:56:18.215127+0000","last_unstale":"2024-04-25T08:56:19.196987+0000","last_undegraded":"2024-04-25T08:56:19.196987+0000","last_fullsized":"2024-04-25T08:56:19.196987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:18.265835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359240+0000","last_change":"2024-04-25T08:56:18.219404+0000","last_active":"2024-04-25T08:56:19.359240+0000","last_peered":"2024-04-25T08:56:19.359240+0000","last_clean":"2024-04-25T08:56:19.359240+0000","last_became_active":"2024-04-25T08:56:18.219126+0000","last_became_peered":"2024-04-25T08:56:18.219126+0000","last_unstale":"2024-04-25T08:56:19.359240+0000","last_undegraded":"2024-04-25T08:56:19.359240+0000","last_fullsized":"2024-04-25T08:56:19.359240+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:10.524577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.211594+0000","last_change":"2024-04-25T08:56:18.207889+0000","last_active":"2024-04-25T08:56:18.211594+0000","last_peered":"2024-04-25T08:56:18.211594+0000","last_clean":"2024-04-25T08:56:18.211594+0000","last_became_active":"2024-04-25T08:56:18.207533+0000","last_became_peered":"2024-04-25T08:56:18.207533+0000","last_unstale":"2024-04-25T08:56:18.211594+0000","last_undegraded":"2024-04-25T08:56:18.211594+0000","last_fullsized":"2024-04-25T08:56:18.211594+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:05.251215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195447+0000","last_change":"2024-04-25T08:56:18.201722+0000","last_active":"2024-04-25T08:56:19.195447+0000","last_peered":"2024-04-25T08:56:19.195447+0000","last_clean":"2024-04-25T08:56:19.195447+0000","last_became_active":"2024-04-25T08:56:18.201409+0000","last_became_peered":"2024-04-25T08:56:18.201409+0000","last_unstale":"2024-04-25T08:56:19.195447+0000","last_undegraded":"2024-04-25T08:56:19.195447+0000","last_fullsized":"2024-04-25T08:56:19.195447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:02.179797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222016+0000","last_change":"2024-04-25T08:56:18.218239+0000","last_active":"2024-04-25T08:56:18.222016+0000","last_peered":"2024-04-25T08:56:18.222016+0000","last_clean":"2024-04-25T08:56:18.222016+0000","last_became_active":"2024-04-25T08:56:18.217954+0000","last_became_peered":"2024-04-25T08:56:18.217954+0000","last_unstale":"2024-04-25T08:56:18.222016+0000","last_undegraded":"2024-04-25T08:56:18.222016+0000","last_fullsized":"2024-04-25T08:56:18.222016+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:21.994569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346393+0000","last_change":"2024-04-25T08:56:18.213749+0000","last_active":"2024-04-25T08:56:20.346393+0000","last_peered":"2024-04-25T08:56:20.346393+0000","last_clean":"2024-04-25T08:56:20.346393+0000","last_became_active":"2024-04-25T08:56:18.213412+0000","last_became_peered":"2024-04-25T08:56:18.213412+0000","last_unstale":"2024-04-25T08:56:20.346393+0000","last_undegraded":"2024-04-25T08:56:20.346393+0000","last_fullsized":"2024-04-25T08:56:20.346393+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:46.818060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346588+0000","last_change":"2024-04-25T08:56:18.214004+0000","last_active":"2024-04-25T08:56:20.346588+0000","last_peered":"2024-04-25T08:56:20.346588+0000","last_clean":"2024-04-25T08:56:20.346588+0000","last_became_active":"2024-04-25T08:56:18.213323+0000","last_became_peered":"2024-04-25T08:56:18.213323+0000","last_unstale":"2024-04-25T08:56:20.346588+0000","last_undegraded":"2024-04-25T08:56:20.346588+0000","last_fullsized":"2024-04-25T08:56:20.346588+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:02.247840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.219587+0000","last_change":"2024-04-25T08:56:18.211963+0000","last_active":"2024-04-25T08:56:18.219587+0000","last_peered":"2024-04-25T08:56:18.219587+0000","last_clean":"2024-04-25T08:56:18.219587+0000","last_became_active":"2024-04-25T08:56:18.211651+0000","last_became_peered":"2024-04-25T08:56:18.211651+0000","last_unstale":"2024-04-25T08:56:18.219587+0000","last_undegraded":"2024-04-25T08:56:18.219587+0000","last_fullsized":"2024-04-25T08:56:18.219587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:13.460350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196604+0000","last_change":"2024-04-25T08:56:18.218212+0000","last_active":"2024-04-25T08:56:19.196604+0000","last_peered":"2024-04-25T08:56:19.196604+0000","last_clean":"2024-04-25T08:56:19.196604+0000","last_became_active":"2024-04-25T08:56:18.217523+0000","last_became_peered":"2024-04-25T08:56:18.217523+0000","last_unstale":"2024-04-25T08:56:19.196604+0000","last_undegraded":"2024-04-25T08:56:19.196604+0000","last_fullsized":"2024-04-25T08:56:19.196604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:12.024798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.212508+0000","last_change":"2024-04-25T08:56:18.210940+0000","last_active":"2024-04-25T08:56:18.212508+0000","last_peered":"2024-04-25T08:56:18.212508+0000","last_clean":"2024-04-25T08:56:18.212508+0000","last_became_active":"2024-04-25T08:56:18.210548+0000","last_became_peered":"2024-04-25T08:56:18.210548+0000","last_unstale":"2024-04-25T08:56:18.212508+0000","last_undegraded":"2024-04-25T08:56:18.212508+0000","last_fullsized":"2024-04-25T08:56:18.212508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:51.274029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.216299+0000","last_change":"2024-04-25T08:56:18.215336+0000","last_active":"2024-04-25T08:56:18.216299+0000","last_peered":"2024-04-25T08:56:18.216299+0000","last_clean":"2024-04-25T08:56:18.216299+0000","last_became_active":"2024-04-25T08:56:18.214922+0000","last_became_peered":"2024-04-25T08:56:18.214922+0000","last_unstale":"2024-04-25T08:56:18.216299+0000","last_undegraded":"2024-04-25T08:56:18.216299+0000","last_fullsized":"2024-04-25T08:56:18.216299+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:00.693003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359208+0000","last_change":"2024-04-25T08:56:18.216067+0000","last_active":"2024-04-25T08:56:19.359208+0000","last_peered":"2024-04-25T08:56:19.359208+0000","last_clean":"2024-04-25T08:56:19.359208+0000","last_became_active":"2024-04-25T08:56:18.215750+0000","last_became_peered":"2024-04-25T08:56:18.215750+0000","last_unstale":"2024-04-25T08:56:19.359208+0000","last_undegraded":"2024-04-25T08:56:19.359208+0000","last_fullsized":"2024-04-25T08:56:19.359208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196193+0000","last_change":"2024-04-25T08:56:18.205704+0000","last_active":"2024-04-25T08:56:19.196193+0000","last_peered":"2024-04-25T08:56:19.196193+0000","last_clean":"2024-04-25T08:56:19.196193+0000","last_became_active":"2024-04-25T08:56:18.205432+0000","last_became_peered":"2024-04-25T08:56:18.205432+0000","last_unstale":"2024-04-25T08:56:19.196193+0000","last_undegraded":"2024-04-25T08:56:19.196193+0000","last_fullsized":"2024-04-25T08:56:19.196193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:50.798086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481529+0000","last_change":"2024-04-25T08:56:18.220201+0000","last_active":"2024-04-25T08:56:19.481529+0000","last_peered":"2024-04-25T08:56:19.481529+0000","last_clean":"2024-04-25T08:56:19.481529+0000","last_became_active":"2024-04-25T08:56:18.219890+0000","last_became_peered":"2024-04-25T08:56:18.219890+0000","last_unstale":"2024-04-25T08:56:19.481529+0000","last_undegraded":"2024-04-25T08:56:19.481529+0000","last_fullsized":"2024-04-25T08:56:19.481529+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.388864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196996+0000","last_change":"2024-04-25T08:56:18.216067+0000","last_active":"2024-04-25T08:56:19.196996+0000","last_peered":"2024-04-25T08:56:19.196996+0000","last_clean":"2024-04-25T08:56:19.196996+0000","last_became_active":"2024-04-25T08:56:18.215793+0000","last_became_peered":"2024-04-25T08:56:18.215793+0000","last_unstale":"2024-04-25T08:56:19.196996+0000","last_undegraded":"2024-04-25T08:56:19.196996+0000","last_fullsized":"2024-04-25T08:56:19.196996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:27.576959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196082+0000","last_change":"2024-04-25T08:56:18.221843+0000","last_active":"2024-04-25T08:56:19.196082+0000","last_peered":"2024-04-25T08:56:19.196082+0000","last_clean":"2024-04-25T08:56:19.196082+0000","last_became_active":"2024-04-25T08:56:18.221585+0000","last_became_peered":"2024-04-25T08:56:18.221585+0000","last_unstale":"2024-04-25T08:56:19.196082+0000","last_undegraded":"2024-04-25T08:56:19.196082+0000","last_fullsized":"2024-04-25T08:56:19.196082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:54.520655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481188+0000","last_change":"2024-04-25T08:56:18.208528+0000","last_active":"2024-04-25T08:56:19.481188+0000","last_peered":"2024-04-25T08:56:19.481188+0000","last_clean":"2024-04-25T08:56:19.481188+0000","last_became_active":"2024-04-25T08:56:18.208223+0000","last_became_peered":"2024-04-25T08:56:18.208223+0000","last_unstale":"2024-04-25T08:56:19.481188+0000","last_undegraded":"2024-04-25T08:56:19.481188+0000","last_fullsized":"2024-04-25T08:56:19.481188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:58.962486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195551+0000","last_change":"2024-04-25T08:56:18.211520+0000","last_active":"2024-04-25T08:56:19.195551+0000","last_peered":"2024-04-25T08:56:19.195551+0000","last_clean":"2024-04-25T08:56:19.195551+0000","last_became_active":"2024-04-25T08:56:18.211171+0000","last_became_peered":"2024-04-25T08:56:18.211171+0000","last_unstale":"2024-04-25T08:56:19.195551+0000","last_undegraded":"2024-04-25T08:56:19.195551+0000","last_fullsized":"2024-04-25T08:56:19.195551+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:56.175100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481207+0000","last_change":"2024-04-25T08:56:18.223242+0000","last_active":"2024-04-25T08:56:19.481207+0000","last_peered":"2024-04-25T08:56:19.481207+0000","last_clean":"2024-04-25T08:56:19.481207+0000","last_became_active":"2024-04-25T08:56:18.222694+0000","last_became_peered":"2024-04-25T08:56:18.222694+0000","last_unstale":"2024-04-25T08:56:19.481207+0000","last_undegraded":"2024-04-25T08:56:19.481207+0000","last_fullsized":"2024-04-25T08:56:19.481207+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:47.866218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196301+0000","last_change":"2024-04-25T08:56:18.217082+0000","last_active":"2024-04-25T08:56:19.196301+0000","last_peered":"2024-04-25T08:56:19.196301+0000","last_clean":"2024-04-25T08:56:19.196301+0000","last_became_active":"2024-04-25T08:56:18.216639+0000","last_became_peered":"2024-04-25T08:56:18.216639+0000","last_unstale":"2024-04-25T08:56:19.196301+0000","last_undegraded":"2024-04-25T08:56:19.196301+0000","last_fullsized":"2024-04-25T08:56:19.196301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:39.841298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197280+0000","last_change":"2024-04-25T08:56:18.215507+0000","last_active":"2024-04-25T08:56:19.197280+0000","last_peered":"2024-04-25T08:56:19.197280+0000","last_clean":"2024-04-25T08:56:19.197280+0000","last_became_active":"2024-04-25T08:56:18.215224+0000","last_became_peered":"2024-04-25T08:56:18.215224+0000","last_unstale":"2024-04-25T08:56:19.197280+0000","last_undegraded":"2024-04-25T08:56:19.197280+0000","last_fullsized":"2024-04-25T08:56:19.197280+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:12.624706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.213831+0000","last_change":"2024-04-25T08:56:18.207047+0000","last_active":"2024-04-25T08:56:18.213831+0000","last_peered":"2024-04-25T08:56:18.213831+0000","last_clean":"2024-04-25T08:56:18.213831+0000","last_became_active":"2024-04-25T08:56:18.206749+0000","last_became_peered":"2024-04-25T08:56:18.206749+0000","last_unstale":"2024-04-25T08:56:18.213831+0000","last_undegraded":"2024-04-25T08:56:18.213831+0000","last_fullsized":"2024-04-25T08:56:18.213831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:33.200201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359355+0000","last_change":"2024-04-25T08:56:18.216568+0000","last_active":"2024-04-25T08:56:19.359355+0000","last_peered":"2024-04-25T08:56:19.359355+0000","last_clean":"2024-04-25T08:56:19.359355+0000","last_became_active":"2024-04-25T08:56:18.215965+0000","last_became_peered":"2024-04-25T08:56:18.215965+0000","last_unstale":"2024-04-25T08:56:19.359355+0000","last_undegraded":"2024-04-25T08:56:19.359355+0000","last_fullsized":"2024-04-25T08:56:19.359355+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.197235+0000","last_change":"2024-04-25T08:56:18.219428+0000","last_active":"2024-04-25T08:56:19.197235+0000","last_peered":"2024-04-25T08:56:19.197235+0000","last_clean":"2024-04-25T08:56:19.197235+0000","last_became_active":"2024-04-25T08:56:18.218946+0000","last_became_peered":"2024-04-25T08:56:18.218946+0000","last_unstale":"2024-04-25T08:56:19.197235+0000","last_undegraded":"2024-04-25T08:56:19.197235+0000","last_fullsized":"2024-04-25T08:56:19.197235+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:17.124211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196368+0000","last_change":"2024-04-25T08:56:18.209922+0000","last_active":"2024-04-25T08:56:19.196368+0000","last_peered":"2024-04-25T08:56:19.196368+0000","last_clean":"2024-04-25T08:56:19.196368+0000","last_became_active":"2024-04-25T08:56:18.208216+0000","last_became_peered":"2024-04-25T08:56:18.208216+0000","last_unstale":"2024-04-25T08:56:19.196368+0000","last_undegraded":"2024-04-25T08:56:19.196368+0000","last_fullsized":"2024-04-25T08:56:19.196368+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:54.752262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481129+0000","last_change":"2024-04-25T08:56:18.215840+0000","last_active":"2024-04-25T08:56:19.481129+0000","last_peered":"2024-04-25T08:56:19.481129+0000","last_clean":"2024-04-25T08:56:19.481129+0000","last_became_active":"2024-04-25T08:56:18.214137+0000","last_became_peered":"2024-04-25T08:56:18.214137+0000","last_unstale":"2024-04-25T08:56:19.481129+0000","last_undegraded":"2024-04-25T08:56:19.481129+0000","last_fullsized":"2024-04-25T08:56:19.481129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:36.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196664+0000","last_change":"2024-04-25T08:56:18.215113+0000","last_active":"2024-04-25T08:56:19.196664+0000","last_peered":"2024-04-25T08:56:19.196664+0000","last_clean":"2024-04-25T08:56:19.196664+0000","last_became_active":"2024-04-25T08:56:18.214777+0000","last_became_peered":"2024-04-25T08:56:18.214777+0000","last_unstale":"2024-04-25T08:56:19.196664+0000","last_undegraded":"2024-04-25T08:56:19.196664+0000","last_fullsized":"2024-04-25T08:56:19.196664+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:02.932997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359476+0000","last_change":"2024-04-25T08:56:18.223089+0000","last_active":"2024-04-25T08:56:19.359476+0000","last_peered":"2024-04-25T08:56:19.359476+0000","last_clean":"2024-04-25T08:56:19.359476+0000","last_became_active":"2024-04-25T08:56:18.222727+0000","last_became_peered":"2024-04-25T08:56:18.222727+0000","last_unstale":"2024-04-25T08:56:19.359476+0000","last_undegraded":"2024-04-25T08:56:19.359476+0000","last_fullsized":"2024-04-25T08:56:19.359476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:47.361388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359468+0000","last_change":"2024-04-25T08:56:18.217780+0000","last_active":"2024-04-25T08:56:19.359468+0000","last_peered":"2024-04-25T08:56:19.359468+0000","last_clean":"2024-04-25T08:56:19.359468+0000","last_became_active":"2024-04-25T08:56:18.217411+0000","last_became_peered":"2024-04-25T08:56:18.217411+0000","last_unstale":"2024-04-25T08:56:19.359468+0000","last_undegraded":"2024-04-25T08:56:19.359468+0000","last_fullsized":"2024-04-25T08:56:19.359468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:53.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359681+0000","last_change":"2024-04-25T08:56:17.209473+0000","last_active":"2024-04-25T08:56:19.359681+0000","last_peered":"2024-04-25T08:56:19.359681+0000","last_clean":"2024-04-25T08:56:19.359681+0000","last_became_active":"2024-04-25T08:56:17.209211+0000","last_became_peered":"2024-04-25T08:56:17.209211+0000","last_unstale":"2024-04-25T08:56:19.359681+0000","last_undegraded":"2024-04-25T08:56:19.359681+0000","last_fullsized":"2024-04-25T08:56:19.359681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.024118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346500+0000","last_change":"2024-04-25T08:56:18.213007+0000","last_active":"2024-04-25T08:56:20.346500+0000","last_peered":"2024-04-25T08:56:20.346500+0000","last_clean":"2024-04-25T08:56:20.346500+0000","last_became_active":"2024-04-25T08:56:18.212709+0000","last_became_peered":"2024-04-25T08:56:18.212709+0000","last_unstale":"2024-04-25T08:56:20.346500+0000","last_undegraded":"2024-04-25T08:56:20.346500+0000","last_fullsized":"2024-04-25T08:56:20.346500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:53.942817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196283+0000","last_change":"2024-04-25T08:56:17.212441+0000","last_active":"2024-04-25T08:56:19.196283+0000","last_peered":"2024-04-25T08:56:19.196283+0000","last_clean":"2024-04-25T08:56:19.196283+0000","last_became_active":"2024-04-25T08:56:17.212105+0000","last_became_peered":"2024-04-25T08:56:17.212105+0000","last_unstale":"2024-04-25T08:56:19.196283+0000","last_undegraded":"2024-04-25T08:56:19.196283+0000","last_fullsized":"2024-04-25T08:56:19.196283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:43.080241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359476+0000","last_change":"2024-04-25T08:56:18.220153+0000","last_active":"2024-04-25T08:56:19.359476+0000","last_peered":"2024-04-25T08:56:19.359476+0000","last_clean":"2024-04-25T08:56:19.359476+0000","last_became_active":"2024-04-25T08:56:18.219814+0000","last_became_peered":"2024-04-25T08:56:18.219814+0000","last_unstale":"2024-04-25T08:56:19.359476+0000","last_undegraded":"2024-04-25T08:56:19.359476+0000","last_fullsized":"2024-04-25T08:56:19.359476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:29.370750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359572+0000","last_change":"2024-04-25T08:56:17.210018+0000","last_active":"2024-04-25T08:56:19.359572+0000","last_peered":"2024-04-25T08:56:19.359572+0000","last_clean":"2024-04-25T08:56:19.359572+0000","last_became_active":"2024-04-25T08:56:17.209032+0000","last_became_peered":"2024-04-25T08:56:17.209032+0000","last_unstale":"2024-04-25T08:56:19.359572+0000","last_undegraded":"2024-04-25T08:56:19.359572+0000","last_fullsized":"2024-04-25T08:56:19.359572+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:32.077700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359440+0000","last_change":"2024-04-25T08:56:18.223451+0000","last_active":"2024-04-25T08:56:19.359440+0000","last_peered":"2024-04-25T08:56:19.359440+0000","last_clean":"2024-04-25T08:56:19.359440+0000","last_became_active":"2024-04-25T08:56:18.223100+0000","last_became_peered":"2024-04-25T08:56:18.223100+0000","last_unstale":"2024-04-25T08:56:19.359440+0000","last_undegraded":"2024-04-25T08:56:19.359440+0000","last_fullsized":"2024-04-25T08:56:19.359440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.388864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215475+0000","last_change":"2024-04-25T08:56:17.208994+0000","last_active":"2024-04-25T08:56:18.215475+0000","last_peered":"2024-04-25T08:56:18.215475+0000","last_clean":"2024-04-25T08:56:18.215475+0000","last_became_active":"2024-04-25T08:56:17.208669+0000","last_became_peered":"2024-04-25T08:56:17.208669+0000","last_unstale":"2024-04-25T08:56:18.215475+0000","last_undegraded":"2024-04-25T08:56:18.215475+0000","last_fullsized":"2024-04-25T08:56:18.215475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:56.789554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195704+0000","last_change":"2024-04-25T08:56:18.210662+0000","last_active":"2024-04-25T08:56:19.195704+0000","last_peered":"2024-04-25T08:56:19.195704+0000","last_clean":"2024-04-25T08:56:19.195704+0000","last_became_active":"2024-04-25T08:56:18.210316+0000","last_became_peered":"2024-04-25T08:56:18.210316+0000","last_unstale":"2024-04-25T08:56:19.195704+0000","last_undegraded":"2024-04-25T08:56:19.195704+0000","last_fullsized":"2024-04-25T08:56:19.195704+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:51.409173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.212560+0000","last_change":"2024-04-25T08:56:17.217874+0000","last_active":"2024-04-25T08:56:18.212560+0000","last_peered":"2024-04-25T08:56:18.212560+0000","last_clean":"2024-04-25T08:56:18.212560+0000","last_became_active":"2024-04-25T08:56:17.217659+0000","last_became_peered":"2024-04-25T08:56:17.217659+0000","last_unstale":"2024-04-25T08:56:18.212560+0000","last_undegraded":"2024-04-25T08:56:18.212560+0000","last_fullsized":"2024-04-25T08:56:18.212560+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:53.854649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196361+0000","last_change":"2024-04-25T08:56:18.221070+0000","last_active":"2024-04-25T08:56:19.196361+0000","last_peered":"2024-04-25T08:56:19.196361+0000","last_clean":"2024-04-25T08:56:19.196361+0000","last_became_active":"2024-04-25T08:56:18.220788+0000","last_became_peered":"2024-04-25T08:56:18.220788+0000","last_unstale":"2024-04-25T08:56:19.196361+0000","last_undegraded":"2024-04-25T08:56:19.196361+0000","last_fullsized":"2024-04-25T08:56:19.196361+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:41.014505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359314+0000","last_change":"2024-04-25T08:56:17.208139+0000","last_active":"2024-04-25T08:56:19.359314+0000","last_peered":"2024-04-25T08:56:19.359314+0000","last_clean":"2024-04-25T08:56:19.359314+0000","last_became_active":"2024-04-25T08:56:17.207843+0000","last_became_peered":"2024-04-25T08:56:17.207843+0000","last_unstale":"2024-04-25T08:56:19.359314+0000","last_undegraded":"2024-04-25T08:56:19.359314+0000","last_fullsized":"2024-04-25T08:56:19.359314+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:56.789554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196397+0000","last_change":"2024-04-25T08:56:18.210083+0000","last_active":"2024-04-25T08:56:19.196397+0000","last_peered":"2024-04-25T08:56:19.196397+0000","last_clean":"2024-04-25T08:56:19.196397+0000","last_became_active":"2024-04-25T08:56:18.209783+0000","last_became_peered":"2024-04-25T08:56:18.209783+0000","last_unstale":"2024-04-25T08:56:19.196397+0000","last_undegraded":"2024-04-25T08:56:19.196397+0000","last_fullsized":"2024-04-25T08:56:19.196397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:10.794882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204581+0000","last_change":"2024-04-25T08:56:17.211340+0000","last_active":"2024-04-25T08:56:18.204581+0000","last_peered":"2024-04-25T08:56:18.204581+0000","last_clean":"2024-04-25T08:56:18.204581+0000","last_became_active":"2024-04-25T08:56:17.211002+0000","last_became_peered":"2024-04-25T08:56:17.211002+0000","last_unstale":"2024-04-25T08:56:18.204581+0000","last_undegraded":"2024-04-25T08:56:18.204581+0000","last_fullsized":"2024-04-25T08:56:18.204581+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:59.690478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195577+0000","last_change":"2024-04-25T08:56:18.205814+0000","last_active":"2024-04-25T08:56:19.195577+0000","last_peered":"2024-04-25T08:56:19.195577+0000","last_clean":"2024-04-25T08:56:19.195577+0000","last_became_active":"2024-04-25T08:56:18.205528+0000","last_became_peered":"2024-04-25T08:56:18.205528+0000","last_unstale":"2024-04-25T08:56:19.195577+0000","last_undegraded":"2024-04-25T08:56:19.195577+0000","last_fullsized":"2024-04-25T08:56:19.195577+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:07.023502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.194961+0000","last_change":"2024-04-25T08:56:17.207453+0000","last_active":"2024-04-25T08:56:18.194961+0000","last_peered":"2024-04-25T08:56:18.194961+0000","last_clean":"2024-04-25T08:56:18.194961+0000","last_became_active":"2024-04-25T08:56:17.207230+0000","last_became_peered":"2024-04-25T08:56:17.207230+0000","last_unstale":"2024-04-25T08:56:18.194961+0000","last_undegraded":"2024-04-25T08:56:18.194961+0000","last_fullsized":"2024-04-25T08:56:18.194961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:50.902995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.218097+0000","last_change":"2024-04-25T08:56:18.216487+0000","last_active":"2024-04-25T08:56:18.218097+0000","last_peered":"2024-04-25T08:56:18.218097+0000","last_clean":"2024-04-25T08:56:18.218097+0000","last_became_active":"2024-04-25T08:56:18.215687+0000","last_became_peered":"2024-04-25T08:56:18.215687+0000","last_unstale":"2024-04-25T08:56:18.218097+0000","last_undegraded":"2024-04-25T08:56:18.218097+0000","last_fullsized":"2024-04-25T08:56:18.218097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:12.416991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481604+0000","last_change":"2024-04-25T08:56:17.202622+0000","last_active":"2024-04-25T08:56:19.481604+0000","last_peered":"2024-04-25T08:56:19.481604+0000","last_clean":"2024-04-25T08:56:19.481604+0000","last_became_active":"2024-04-25T08:56:17.202334+0000","last_became_peered":"2024-04-25T08:56:17.202334+0000","last_unstale":"2024-04-25T08:56:19.481604+0000","last_undegraded":"2024-04-25T08:56:19.481604+0000","last_fullsized":"2024-04-25T08:56:19.481604+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.248690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481627+0000","last_change":"2024-04-25T08:56:18.223478+0000","last_active":"2024-04-25T08:56:19.481627+0000","last_peered":"2024-04-25T08:56:19.481627+0000","last_clean":"2024-04-25T08:56:19.481627+0000","last_became_active":"2024-04-25T08:56:18.223262+0000","last_became_peered":"2024-04-25T08:56:18.223262+0000","last_unstale":"2024-04-25T08:56:19.481627+0000","last_undegraded":"2024-04-25T08:56:19.481627+0000","last_fullsized":"2024-04-25T08:56:19.481627+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:47.361388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196303+0000","last_change":"2024-04-25T08:56:17.218177+0000","last_active":"2024-04-25T08:56:19.196303+0000","last_peered":"2024-04-25T08:56:19.196303+0000","last_clean":"2024-04-25T08:56:19.196303+0000","last_became_active":"2024-04-25T08:56:17.217859+0000","last_became_peered":"2024-04-25T08:56:17.217859+0000","last_unstale":"2024-04-25T08:56:19.196303+0000","last_undegraded":"2024-04-25T08:56:19.196303+0000","last_fullsized":"2024-04-25T08:56:19.196303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:01.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346274+0000","last_change":"2024-04-25T08:56:18.214038+0000","last_active":"2024-04-25T08:56:20.346274+0000","last_peered":"2024-04-25T08:56:20.346274+0000","last_clean":"2024-04-25T08:56:20.346274+0000","last_became_active":"2024-04-25T08:56:18.213765+0000","last_became_peered":"2024-04-25T08:56:18.213765+0000","last_unstale":"2024-04-25T08:56:20.346274+0000","last_undegraded":"2024-04-25T08:56:20.346274+0000","last_fullsized":"2024-04-25T08:56:20.346274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:58.964006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481558+0000","last_change":"2024-04-25T08:56:17.209000+0000","last_active":"2024-04-25T08:56:19.481558+0000","last_peered":"2024-04-25T08:56:19.481558+0000","last_clean":"2024-04-25T08:56:19.481558+0000","last_became_active":"2024-04-25T08:56:17.208727+0000","last_became_peered":"2024-04-25T08:56:17.208727+0000","last_unstale":"2024-04-25T08:56:19.481558+0000","last_undegraded":"2024-04-25T08:56:19.481558+0000","last_fullsized":"2024-04-25T08:56:19.481558+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:50.271504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481437+0000","last_change":"2024-04-25T08:56:18.220854+0000","last_active":"2024-04-25T08:56:19.481437+0000","last_peered":"2024-04-25T08:56:19.481437+0000","last_clean":"2024-04-25T08:56:19.481437+0000","last_became_active":"2024-04-25T08:56:18.220406+0000","last_became_peered":"2024-04-25T08:56:18.220406+0000","last_unstale":"2024-04-25T08:56:19.481437+0000","last_undegraded":"2024-04-25T08:56:19.481437+0000","last_fullsized":"2024-04-25T08:56:19.481437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:10.524577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.233028+0000","last_change":"2024-04-25T08:56:17.199981+0000","last_active":"2024-04-25T08:56:18.233028+0000","last_peered":"2024-04-25T08:56:18.233028+0000","last_clean":"2024-04-25T08:56:18.233028+0000","last_became_active":"2024-04-25T08:56:17.199667+0000","last_became_peered":"2024-04-25T08:56:17.199667+0000","last_unstale":"2024-04-25T08:56:18.233028+0000","last_undegraded":"2024-04-25T08:56:18.233028+0000","last_fullsized":"2024-04-25T08:56:18.233028+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:19.999889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.225164+0000","last_change":"2024-04-25T08:56:18.221416+0000","last_active":"2024-04-25T08:56:18.225164+0000","last_peered":"2024-04-25T08:56:18.225164+0000","last_clean":"2024-04-25T08:56:18.225164+0000","last_became_active":"2024-04-25T08:56:18.221196+0000","last_became_peered":"2024-04-25T08:56:18.221196+0000","last_unstale":"2024-04-25T08:56:18.225164+0000","last_undegraded":"2024-04-25T08:56:18.225164+0000","last_fullsized":"2024-04-25T08:56:18.225164+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:02.980311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196227+0000","last_change":"2024-04-25T08:56:17.218664+0000","last_active":"2024-04-25T08:56:19.196227+0000","last_peered":"2024-04-25T08:56:19.196227+0000","last_clean":"2024-04-25T08:56:19.196227+0000","last_became_active":"2024-04-25T08:56:17.218365+0000","last_became_peered":"2024-04-25T08:56:17.218365+0000","last_unstale":"2024-04-25T08:56:19.196227+0000","last_undegraded":"2024-04-25T08:56:19.196227+0000","last_fullsized":"2024-04-25T08:56:19.196227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:39.098749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481296+0000","last_change":"2024-04-25T08:56:18.212351+0000","last_active":"2024-04-25T08:56:19.481296+0000","last_peered":"2024-04-25T08:56:19.481296+0000","last_clean":"2024-04-25T08:56:19.481296+0000","last_became_active":"2024-04-25T08:56:18.212075+0000","last_became_peered":"2024-04-25T08:56:18.212075+0000","last_unstale":"2024-04-25T08:56:19.481296+0000","last_undegraded":"2024-04-25T08:56:19.481296+0000","last_fullsized":"2024-04-25T08:56:19.481296+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196473+0000","last_change":"2024-04-25T08:56:17.200568+0000","last_active":"2024-04-25T08:56:19.196473+0000","last_peered":"2024-04-25T08:56:19.196473+0000","last_clean":"2024-04-25T08:56:19.196473+0000","last_became_active":"2024-04-25T08:56:17.200242+0000","last_became_peered":"2024-04-25T08:56:17.200242+0000","last_unstale":"2024-04-25T08:56:19.196473+0000","last_undegraded":"2024-04-25T08:56:19.196473+0000","last_fullsized":"2024-04-25T08:56:19.196473+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:57.237578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215172+0000","last_change":"2024-04-25T08:56:18.213076+0000","last_active":"2024-04-25T08:56:18.215172+0000","last_peered":"2024-04-25T08:56:18.215172+0000","last_clean":"2024-04-25T08:56:18.215172+0000","last_became_active":"2024-04-25T08:56:18.212746+0000","last_became_peered":"2024-04-25T08:56:18.212746+0000","last_unstale":"2024-04-25T08:56:18.215172+0000","last_undegraded":"2024-04-25T08:56:18.215172+0000","last_fullsized":"2024-04-25T08:56:18.215172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:22.026643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204803+0000","last_change":"2024-04-25T08:56:17.209077+0000","last_active":"2024-04-25T08:56:18.204803+0000","last_peered":"2024-04-25T08:56:18.204803+0000","last_clean":"2024-04-25T08:56:18.204803+0000","last_became_active":"2024-04-25T08:56:17.208079+0000","last_became_peered":"2024-04-25T08:56:17.208079+0000","last_unstale":"2024-04-25T08:56:18.204803+0000","last_undegraded":"2024-04-25T08:56:18.204803+0000","last_fullsized":"2024-04-25T08:56:18.204803+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:11.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481202+0000","last_change":"2024-04-25T08:56:18.223135+0000","last_active":"2024-04-25T08:56:19.481202+0000","last_peered":"2024-04-25T08:56:19.481202+0000","last_clean":"2024-04-25T08:56:19.481202+0000","last_became_active":"2024-04-25T08:56:18.222867+0000","last_became_peered":"2024-04-25T08:56:18.222867+0000","last_unstale":"2024-04-25T08:56:19.481202+0000","last_undegraded":"2024-04-25T08:56:19.481202+0000","last_fullsized":"2024-04-25T08:56:19.481202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:18.749861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481015+0000","last_change":"2024-04-25T08:56:17.209066+0000","last_active":"2024-04-25T08:56:19.481015+0000","last_peered":"2024-04-25T08:56:19.481015+0000","last_clean":"2024-04-25T08:56:19.481015+0000","last_became_active":"2024-04-25T08:56:17.208841+0000","last_became_peered":"2024-04-25T08:56:17.208841+0000","last_unstale":"2024-04-25T08:56:19.481015+0000","last_undegraded":"2024-04-25T08:56:19.481015+0000","last_fullsized":"2024-04-25T08:56:19.481015+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:21.082806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481564+0000","last_change":"2024-04-25T08:56:18.215974+0000","last_active":"2024-04-25T08:56:19.481564+0000","last_peered":"2024-04-25T08:56:19.481564+0000","last_clean":"2024-04-25T08:56:19.481564+0000","last_became_active":"2024-04-25T08:56:18.215532+0000","last_became_peered":"2024-04-25T08:56:18.215532+0000","last_unstale":"2024-04-25T08:56:19.481564+0000","last_undegraded":"2024-04-25T08:56:19.481564+0000","last_fullsized":"2024-04-25T08:56:19.481564+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:29.370750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196574+0000","last_change":"2024-04-25T08:56:17.218282+0000","last_active":"2024-04-25T08:56:19.196574+0000","last_peered":"2024-04-25T08:56:19.196574+0000","last_clean":"2024-04-25T08:56:19.196574+0000","last_became_active":"2024-04-25T08:56:17.217970+0000","last_became_peered":"2024-04-25T08:56:17.217970+0000","last_unstale":"2024-04-25T08:56:19.196574+0000","last_undegraded":"2024-04-25T08:56:19.196574+0000","last_fullsized":"2024-04-25T08:56:19.196574+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:57.959960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.225552+0000","last_change":"2024-04-25T08:56:18.222912+0000","last_active":"2024-04-25T08:56:18.225552+0000","last_peered":"2024-04-25T08:56:18.225552+0000","last_clean":"2024-04-25T08:56:18.225552+0000","last_became_active":"2024-04-25T08:56:18.222609+0000","last_became_peered":"2024-04-25T08:56:18.222609+0000","last_unstale":"2024-04-25T08:56:18.225552+0000","last_undegraded":"2024-04-25T08:56:18.225552+0000","last_fullsized":"2024-04-25T08:56:18.225552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:36.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359576+0000","last_change":"2024-04-25T08:56:17.217247+0000","last_active":"2024-04-25T08:56:19.359576+0000","last_peered":"2024-04-25T08:56:19.359576+0000","last_clean":"2024-04-25T08:56:19.359576+0000","last_became_active":"2024-04-25T08:56:17.216896+0000","last_became_peered":"2024-04-25T08:56:17.216896+0000","last_unstale":"2024-04-25T08:56:19.359576+0000","last_undegraded":"2024-04-25T08:56:19.359576+0000","last_fullsized":"2024-04-25T08:56:19.359576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:11.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196124+0000","last_change":"2024-04-25T08:56:18.202536+0000","last_active":"2024-04-25T08:56:19.196124+0000","last_peered":"2024-04-25T08:56:19.196124+0000","last_clean":"2024-04-25T08:56:19.196124+0000","last_became_active":"2024-04-25T08:56:18.202235+0000","last_became_peered":"2024-04-25T08:56:18.202235+0000","last_unstale":"2024-04-25T08:56:19.196124+0000","last_undegraded":"2024-04-25T08:56:19.196124+0000","last_fullsized":"2024-04-25T08:56:19.196124+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:32.018334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.215666+0000","last_change":"2024-04-25T08:56:17.205551+0000","last_active":"2024-04-25T08:56:18.215666+0000","last_peered":"2024-04-25T08:56:18.215666+0000","last_clean":"2024-04-25T08:56:18.215666+0000","last_became_active":"2024-04-25T08:56:17.205230+0000","last_became_peered":"2024-04-25T08:56:17.205230+0000","last_unstale":"2024-04-25T08:56:18.215666+0000","last_undegraded":"2024-04-25T08:56:18.215666+0000","last_fullsized":"2024-04-25T08:56:18.215666+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:20.992044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481566+0000","last_change":"2024-04-25T08:56:18.220992+0000","last_active":"2024-04-25T08:56:19.481566+0000","last_peered":"2024-04-25T08:56:19.481566+0000","last_clean":"2024-04-25T08:56:19.481566+0000","last_became_active":"2024-04-25T08:56:18.220716+0000","last_became_peered":"2024-04-25T08:56:18.220716+0000","last_unstale":"2024-04-25T08:56:19.481566+0000","last_undegraded":"2024-04-25T08:56:19.481566+0000","last_fullsized":"2024-04-25T08:56:19.481566+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:53.457868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359615+0000","last_change":"2024-04-25T08:56:17.207716+0000","last_active":"2024-04-25T08:56:19.359615+0000","last_peered":"2024-04-25T08:56:19.359615+0000","last_clean":"2024-04-25T08:56:19.359615+0000","last_became_active":"2024-04-25T08:56:17.207377+0000","last_became_peered":"2024-04-25T08:56:17.207377+0000","last_unstale":"2024-04-25T08:56:19.359615+0000","last_undegraded":"2024-04-25T08:56:19.359615+0000","last_fullsized":"2024-04-25T08:56:19.359615+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:59.690478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222580+0000","last_change":"2024-04-25T08:56:18.214828+0000","last_active":"2024-04-25T08:56:18.222580+0000","last_peered":"2024-04-25T08:56:18.222580+0000","last_clean":"2024-04-25T08:56:18.222580+0000","last_became_active":"2024-04-25T08:56:18.214546+0000","last_became_peered":"2024-04-25T08:56:18.214546+0000","last_unstale":"2024-04-25T08:56:18.222580+0000","last_undegraded":"2024-04-25T08:56:18.222580+0000","last_fullsized":"2024-04-25T08:56:18.222580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:44.082766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196468+0000","last_change":"2024-04-25T08:56:17.211265+0000","last_active":"2024-04-25T08:56:19.196468+0000","last_peered":"2024-04-25T08:56:19.196468+0000","last_clean":"2024-04-25T08:56:19.196468+0000","last_became_active":"2024-04-25T08:56:17.210943+0000","last_became_peered":"2024-04-25T08:56:17.210943+0000","last_unstale":"2024-04-25T08:56:19.196468+0000","last_undegraded":"2024-04-25T08:56:19.196468+0000","last_fullsized":"2024-04-25T08:56:19.196468+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:35.063530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359715+0000","last_change":"2024-04-25T08:56:18.218361+0000","last_active":"2024-04-25T08:56:19.359715+0000","last_peered":"2024-04-25T08:56:19.359715+0000","last_clean":"2024-04-25T08:56:19.359715+0000","last_became_active":"2024-04-25T08:56:18.218070+0000","last_became_peered":"2024-04-25T08:56:18.218070+0000","last_unstale":"2024-04-25T08:56:19.359715+0000","last_undegraded":"2024-04-25T08:56:19.359715+0000","last_fullsized":"2024-04-25T08:56:19.359715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:07.045007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346209+0000","last_change":"2024-04-25T08:56:17.217221+0000","last_active":"2024-04-25T08:56:20.346209+0000","last_peered":"2024-04-25T08:56:20.346209+0000","last_clean":"2024-04-25T08:56:20.346209+0000","last_became_active":"2024-04-25T08:56:17.216923+0000","last_became_peered":"2024-04-25T08:56:17.216923+0000","last_unstale":"2024-04-25T08:56:20.346209+0000","last_undegraded":"2024-04-25T08:56:20.346209+0000","last_fullsized":"2024-04-25T08:56:20.346209+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:31.733647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359223+0000","last_change":"2024-04-25T08:56:18.218040+0000","last_active":"2024-04-25T08:56:19.359223+0000","last_peered":"2024-04-25T08:56:19.359223+0000","last_clean":"2024-04-25T08:56:19.359223+0000","last_became_active":"2024-04-25T08:56:18.217711+0000","last_became_peered":"2024-04-25T08:56:18.217711+0000","last_unstale":"2024-04-25T08:56:19.359223+0000","last_undegraded":"2024-04-25T08:56:19.359223+0000","last_fullsized":"2024-04-25T08:56:19.359223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:34:03.547004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.204576+0000","last_change":"2024-04-25T08:56:17.210094+0000","last_active":"2024-04-25T08:56:18.204576+0000","last_peered":"2024-04-25T08:56:18.204576+0000","last_clean":"2024-04-25T08:56:18.204576+0000","last_became_active":"2024-04-25T08:56:17.209773+0000","last_became_peered":"2024-04-25T08:56:17.209773+0000","last_unstale":"2024-04-25T08:56:18.204576+0000","last_undegraded":"2024-04-25T08:56:18.204576+0000","last_fullsized":"2024-04-25T08:56:18.204576+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.024118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222599+0000","last_change":"2024-04-25T08:56:18.215521+0000","last_active":"2024-04-25T08:56:18.222599+0000","last_peered":"2024-04-25T08:56:18.222599+0000","last_clean":"2024-04-25T08:56:18.222599+0000","last_became_active":"2024-04-25T08:56:18.215222+0000","last_became_peered":"2024-04-25T08:56:18.215222+0000","last_unstale":"2024-04-25T08:56:18.222599+0000","last_undegraded":"2024-04-25T08:56:18.222599+0000","last_fullsized":"2024-04-25T08:56:18.222599+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:40.101275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346459+0000","last_change":"2024-04-25T08:56:17.213267+0000","last_active":"2024-04-25T08:56:20.346459+0000","last_peered":"2024-04-25T08:56:20.346459+0000","last_clean":"2024-04-25T08:56:20.346459+0000","last_became_active":"2024-04-25T08:56:17.212962+0000","last_became_peered":"2024-04-25T08:56:17.212962+0000","last_unstale":"2024-04-25T08:56:20.346459+0000","last_undegraded":"2024-04-25T08:56:20.346459+0000","last_fullsized":"2024-04-25T08:56:20.346459+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:52.207757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.222791+0000","last_change":"2024-04-25T08:56:18.213570+0000","last_active":"2024-04-25T08:56:18.222791+0000","last_peered":"2024-04-25T08:56:18.222791+0000","last_clean":"2024-04-25T08:56:18.222791+0000","last_became_active":"2024-04-25T08:56:18.212104+0000","last_became_peered":"2024-04-25T08:56:18.212104+0000","last_unstale":"2024-04-25T08:56:18.222791+0000","last_undegraded":"2024-04-25T08:56:18.222791+0000","last_fullsized":"2024-04-25T08:56:18.222791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:26.179109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359605+0000","last_change":"2024-04-25T08:56:17.208227+0000","last_active":"2024-04-25T08:56:19.359605+0000","last_peered":"2024-04-25T08:56:19.359605+0000","last_clean":"2024-04-25T08:56:19.359605+0000","last_became_active":"2024-04-25T08:56:17.207936+0000","last_became_peered":"2024-04-25T08:56:17.207936+0000","last_unstale":"2024-04-25T08:56:19.359605+0000","last_undegraded":"2024-04-25T08:56:19.359605+0000","last_fullsized":"2024-04-25T08:56:19.359605+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:20.992044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346370+0000","last_change":"2024-04-25T08:56:18.213602+0000","last_active":"2024-04-25T08:56:20.346370+0000","last_peered":"2024-04-25T08:56:20.346370+0000","last_clean":"2024-04-25T08:56:20.346370+0000","last_became_active":"2024-04-25T08:56:18.213096+0000","last_became_peered":"2024-04-25T08:56:18.213096+0000","last_unstale":"2024-04-25T08:56:20.346370+0000","last_undegraded":"2024-04-25T08:56:20.346370+0000","last_fullsized":"2024-04-25T08:56:20.346370+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:50.064809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196657+0000","last_change":"2024-04-25T08:56:17.199076+0000","last_active":"2024-04-25T08:56:19.196657+0000","last_peered":"2024-04-25T08:56:19.196657+0000","last_clean":"2024-04-25T08:56:19.196657+0000","last_became_active":"2024-04-25T08:56:17.198759+0000","last_became_peered":"2024-04-25T08:56:17.198759+0000","last_unstale":"2024-04-25T08:56:19.196657+0000","last_undegraded":"2024-04-25T08:56:19.196657+0000","last_fullsized":"2024-04-25T08:56:19.196657+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:35.077938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.359501+0000","last_change":"2024-04-25T08:56:18.223807+0000","last_active":"2024-04-25T08:56:19.359501+0000","last_peered":"2024-04-25T08:56:19.359501+0000","last_clean":"2024-04-25T08:56:19.359501+0000","last_became_active":"2024-04-25T08:56:18.223515+0000","last_became_peered":"2024-04-25T08:56:18.223515+0000","last_unstale":"2024-04-25T08:56:19.359501+0000","last_undegraded":"2024-04-25T08:56:19.359501+0000","last_fullsized":"2024-04-25T08:56:19.359501+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:57.277364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.205872+0000","last_change":"2024-04-25T08:56:17.208356+0000","last_active":"2024-04-25T08:56:18.205872+0000","last_peered":"2024-04-25T08:56:18.205872+0000","last_clean":"2024-04-25T08:56:18.205872+0000","last_became_active":"2024-04-25T08:56:17.208086+0000","last_became_peered":"2024-04-25T08:56:17.208086+0000","last_unstale":"2024-04-25T08:56:18.205872+0000","last_undegraded":"2024-04-25T08:56:18.205872+0000","last_fullsized":"2024-04-25T08:56:18.205872+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:32.077700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195840+0000","last_change":"2024-04-25T08:56:18.207334+0000","last_active":"2024-04-25T08:56:19.195840+0000","last_peered":"2024-04-25T08:56:19.195840+0000","last_clean":"2024-04-25T08:56:19.195840+0000","last_became_active":"2024-04-25T08:56:18.206799+0000","last_became_peered":"2024-04-25T08:56:18.206799+0000","last_unstale":"2024-04-25T08:56:19.195840+0000","last_undegraded":"2024-04-25T08:56:19.195840+0000","last_fullsized":"2024-04-25T08:56:19.195840+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:11.835152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346080+0000","last_change":"2024-04-25T08:56:17.209129+0000","last_active":"2024-04-25T08:56:20.346080+0000","last_peered":"2024-04-25T08:56:20.346080+0000","last_clean":"2024-04-25T08:56:20.346080+0000","last_became_active":"2024-04-25T08:56:17.208830+0000","last_became_peered":"2024-04-25T08:56:17.208830+0000","last_unstale":"2024-04-25T08:56:20.346080+0000","last_undegraded":"2024-04-25T08:56:20.346080+0000","last_fullsized":"2024-04-25T08:56:20.346080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:41.038731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.481425+0000","last_change":"2024-04-25T08:56:18.222650+0000","last_active":"2024-04-25T08:56:19.481425+0000","last_peered":"2024-04-25T08:56:19.481425+0000","last_clean":"2024-04-25T08:56:19.481425+0000","last_became_active":"2024-04-25T08:56:18.222247+0000","last_became_peered":"2024-04-25T08:56:18.222247+0000","last_unstale":"2024-04-25T08:56:19.481425+0000","last_undegraded":"2024-04-25T08:56:19.481425+0000","last_fullsized":"2024-04-25T08:56:19.481425+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T08:56:18.196651+0000","last_change":"2024-04-25T08:56:17.202547+0000","last_active":"2024-04-25T08:56:18.196651+0000","last_peered":"2024-04-25T08:56:18.196651+0000","last_clean":"2024-04-25T08:56:18.196651+0000","last_became_active":"2024-04-25T08:56:17.202228+0000","last_became_peered":"2024-04-25T08:56:17.202228+0000","last_unstale":"2024-04-25T08:56:18.196651+0000","last_undegraded":"2024-04-25T08:56:18.196651+0000","last_fullsized":"2024-04-25T08:56:18.196651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:21.082806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346123+0000","last_change":"2024-04-25T08:56:18.205118+0000","last_active":"2024-04-25T08:56:20.346123+0000","last_peered":"2024-04-25T08:56:20.346123+0000","last_clean":"2024-04-25T08:56:20.346123+0000","last_became_active":"2024-04-25T08:56:18.204817+0000","last_became_peered":"2024-04-25T08:56:18.204817+0000","last_unstale":"2024-04-25T08:56:20.346123+0000","last_undegraded":"2024-04-25T08:56:20.346123+0000","last_fullsized":"2024-04-25T08:56:20.346123+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:16.070089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:20.346080+0000","last_change":"2024-04-25T08:56:17.200745+0000","last_active":"2024-04-25T08:56:20.346080+0000","last_peered":"2024-04-25T08:56:20.346080+0000","last_clean":"2024-04-25T08:56:20.346080+0000","last_became_active":"2024-04-25T08:56:17.200486+0000","last_became_peered":"2024-04-25T08:56:17.200486+0000","last_unstale":"2024-04-25T08:56:20.346080+0000","last_undegraded":"2024-04-25T08:56:20.346080+0000","last_fullsized":"2024-04-25T08:56:20.346080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:56.826119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195622+0000","last_change":"2024-04-25T08:56:18.206772+0000","last_active":"2024-04-25T08:56:19.195622+0000","last_peered":"2024-04-25T08:56:19.195622+0000","last_clean":"2024-04-25T08:56:19.195622+0000","last_became_active":"2024-04-25T08:56:18.206478+0000","last_became_peered":"2024-04-25T08:56:18.206478+0000","last_unstale":"2024-04-25T08:56:19.195622+0000","last_undegraded":"2024-04-25T08:56:19.195622+0000","last_fullsized":"2024-04-25T08:56:19.195622+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:38.623368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195622+0000","last_change":"2024-04-25T08:56:17.212487+0000","last_active":"2024-04-25T08:56:19.195622+0000","last_peered":"2024-04-25T08:56:19.195622+0000","last_clean":"2024-04-25T08:56:19.195622+0000","last_became_active":"2024-04-25T08:56:17.212169+0000","last_became_peered":"2024-04-25T08:56:17.212169+0000","last_unstale":"2024-04-25T08:56:19.195622+0000","last_undegraded":"2024-04-25T08:56:19.195622+0000","last_fullsized":"2024-04-25T08:56:19.195622+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:54.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.195510+0000","last_change":"2024-04-25T08:56:18.217388+0000","last_active":"2024-04-25T08:56:19.195510+0000","last_peered":"2024-04-25T08:56:19.195510+0000","last_clean":"2024-04-25T08:56:19.195510+0000","last_became_active":"2024-04-25T08:56:18.217118+0000","last_became_peered":"2024-04-25T08:56:18.217118+0000","last_unstale":"2024-04-25T08:56:19.195510+0000","last_undegraded":"2024-04-25T08:56:19.195510+0000","last_fullsized":"2024-04-25T08:56:19.195510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:17.182918+0000","last_clean_scrub_stamp":"2024-04-25T08:56:17.182918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:55.113303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.196321+0000","last_change":"2024-04-25T08:56:17.210100+0000","last_active":"2024-04-25T08:56:19.196321+0000","last_peered":"2024-04-25T08:56:19.196321+0000","last_clean":"2024-04-25T08:56:19.196321+0000","last_became_active":"2024-04-25T08:56:17.209722+0000","last_became_peered":"2024-04-25T08:56:17.209722+0000","last_unstale":"2024-04-25T08:56:19.196321+0000","last_undegraded":"2024-04-25T08:56:19.196321+0000","last_fullsized":"2024-04-25T08:56:19.196321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:56:16.180393+0000","last_clean_scrub_stamp":"2024-04-25T08:56:16.180393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:35.041624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":240,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:56:19.480994+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:56:19.480994+0000","last_peered":"2024-04-25T08:56:19.480994+0000","last_clean":"2024-04-25T08:56:19.480994+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:56:19.480994+0000","last_undegraded":"2024-04-25T08:56:19.480994+0000","last_fullsized":"2024-04-25T08:56:19.480994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28308,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343532,"statfs":{"total":96636764160,"available":96607776768,"internally_reserved":0,"allocated":1314816,"data_stored":884994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":712704,"data_stored":294466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":295118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":724992,"data_stored":296078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":300822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":300822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1323008,"data_stored":887028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":300856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:56:25.960 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:56:25.960 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:56:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.114+0000 7fb92a7e7640 1 Processor -- start 2024-04-25T08:56:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.115+0000 7fb92a7e7640 1 -- start start 2024-04-25T08:56:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.115+0000 7fb92a7e7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9240b10c0 0x7fb9240cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.115+0000 7fb92a7e7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb9240cff90 0x7fb9240cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.115+0000 7fb92a7e7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92415f540 con 0x7fb9240cc0c0 2024-04-25T08:56:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.115+0000 7fb92a7e7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9240b0c30 con 0x7fb9240b10c0 2024-04-25T08:56:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.115+0000 7fb92a7e7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9240b0060 con 0x7fb9240cff90 2024-04-25T08:56:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.115+0000 7fb9237fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9240b10c0 0x7fb9240cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.116+0000 7fb9237fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9240b10c0 0x7fb9240cfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39258/0 (socket says 172.21.15.55:39258) 2024-04-25T08:56:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.116+0000 7fb9237fe640 1 -- 172.21.15.55:0/394586585 learned_addr learned my addr 172.21.15.55:0/394586585 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.116+0000 7fb928d84640 1 --2- 172.21.15.55:0/394586585 >> v2:172.21.15.167:3300/0 conn(0x7fb9240cff90 0x7fb9240cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.116+0000 7fb9237fe640 1 -- 172.21.15.55:0/394586585 >> v2:172.21.15.167:3300/0 conn(0x7fb9240cff90 msgr2=0x7fb9240cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.116+0000 7fb9237fe640 1 --2- 172.21.15.55:0/394586585 >> v2:172.21.15.167:3300/0 conn(0x7fb9240cff90 0x7fb9240cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.116+0000 7fb9237fe640 1 -- 172.21.15.55:0/394586585 >> v1:172.21.15.167:6789/0 conn(0x7fb9240cc0c0 legacy=0x7fb92415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.116+0000 7fb9237fe640 1 -- 172.21.15.55:0/394586585 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240b1550 con 0x7fb9240b10c0 2024-04-25T08:56:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb9237fe640 1 --2- 172.21.15.55:0/394586585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240b10c0 0x7fb9240cfa50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb92409a420 tx=0x7fb91802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaf21d39cf0bb6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb922ffd640 1 -- 172.21.15.55:0/394586585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918037070 con 0x7fb9240b10c0 2024-04-25T08:56:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb922ffd640 1 -- 172.21.15.55:0/394586585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb918032440 con 0x7fb9240b10c0 2024-04-25T08:56:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb922ffd640 1 -- 172.21.15.55:0/394586585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918032810 con 0x7fb9240b10c0 2024-04-25T08:56:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb92a7e7640 1 -- 172.21.15.55:0/394586585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240b10c0 msgr2=0x7fb9240cfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb92a7e7640 1 --2- 172.21.15.55:0/394586585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240b10c0 0x7fb9240cfa50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb92409a420 tx=0x7fb91802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb92a7e7640 1 -- 172.21.15.55:0/394586585 shutdown_connections 2024-04-25T08:56:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb92a7e7640 1 --2- 172.21.15.55:0/394586585 >> v2:172.21.15.167:3300/0 conn(0x7fb9240cff90 0x7fb9240cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb92a7e7640 1 --2- 172.21.15.55:0/394586585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240b10c0 0x7fb9240cfa50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb92a7e7640 1 -- 172.21.15.55:0/394586585 >> 172.21.15.55:0/394586585 conn(0x7fb924099a40 msgr2=0x7fb9240b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb92a7e7640 1 -- 172.21.15.55:0/394586585 shutdown_connections 2024-04-25T08:56:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.117+0000 7fb92a7e7640 1 -- 172.21.15.55:0/394586585 wait complete. 2024-04-25T08:56:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.118+0000 7fb92a7e7640 1 Processor -- start 2024-04-25T08:56:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.119+0000 7fb92a7e7640 1 -- start start 2024-04-25T08:56:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.119+0000 7fb92a7e7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240b10c0 0x7fb9240c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.119+0000 7fb92a7e7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9240cc0c0 0x7fb9241f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.119+0000 7fb92a7e7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9240cff90 0x7fb9241f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.119+0000 7fb92a7e7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240b08c0 con 0x7fb9240b10c0 2024-04-25T08:56:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.119+0000 7fb92a7e7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240b05e0 con 0x7fb9240cff90 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.119+0000 7fb92a7e7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240cc4a0 con 0x7fb9240cc0c0 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.119+0000 7fb923fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240b10c0 0x7fb9240c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb923fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240b10c0 0x7fb9240c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39274/0 (socket says 172.21.15.55:39274) 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb923fff640 1 -- 172.21.15.55:0/1868082459 learned_addr learned my addr 172.21.15.55:0/1868082459 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb928d84640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9240cff90 0x7fb9241f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb9237fe640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9240cc0c0 0x7fb9241f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb923fff640 1 -- 172.21.15.55:0/1868082459 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9240cc0c0 msgr2=0x7fb9241f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb923fff640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9240cc0c0 0x7fb9241f3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb923fff640 1 -- 172.21.15.55:0/1868082459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9240cff90 msgr2=0x7fb9241f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb923fff640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9240cff90 0x7fb9241f4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb923fff640 1 -- 172.21.15.55:0/1868082459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240c6fc0 con 0x7fb9240b10c0 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb928d84640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9240cff90 0x7fb9241f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb9237fe640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9240cc0c0 0x7fb9241f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:26.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb923fff640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240b10c0 0x7fb9240c6570 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb91400c400 tx=0x7fb91400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:26.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb920ff9640 1 -- 172.21.15.55:0/1868082459 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9140052d0 con 0x7fb9240b10c0 2024-04-25T08:56:26.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb920ff9640 1 -- 172.21.15.55:0/1868082459 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb914005490 con 0x7fb9240b10c0 2024-04-25T08:56:26.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb92a7e7640 1 -- 172.21.15.55:0/1868082459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9240ad810 con 0x7fb9240b10c0 2024-04-25T08:56:26.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb920ff9640 1 -- 172.21.15.55:0/1868082459 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914007260 con 0x7fb9240b10c0 2024-04-25T08:56:26.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.120+0000 7fb92a7e7640 1 -- 172.21.15.55:0/1868082459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9240addd0 con 0x7fb9240b10c0 2024-04-25T08:56:26.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.121+0000 7fb92a7e7640 1 -- 172.21.15.55:0/1868082459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9240749b0 con 0x7fb9240b10c0 2024-04-25T08:56:26.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.122+0000 7fb920ff9640 1 -- 172.21.15.55:0/1868082459 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb914007400 con 0x7fb9240b10c0 2024-04-25T08:56:26.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.122+0000 7fb920ff9640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb91006b500 0x7fb91006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.122+0000 7fb920ff9640 1 -- 172.21.15.55:0/1868082459 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb914089650 con 0x7fb9240b10c0 2024-04-25T08:56:26.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.122+0000 7fb9237fe640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb91006b500 0x7fb91006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.123+0000 7fb9237fe640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb91006b500 0x7fb91006d9c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb918034000 tx=0x7fb91802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:26.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.126+0000 7fb920ff9640 1 -- 172.21.15.55:0/1868082459 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb92415f540 con 0x7fb9240b10c0 2024-04-25T08:56:26.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.380+0000 7fb92a7e7640 1 -- 172.21.15.55:0/1868082459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb92406e8a0 con 0x7fb9240b10c0 2024-04-25T08:56:26.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.382+0000 7fb920ff9640 1 -- 172.21.15.55:0/1868082459 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb914058560 con 0x7fb9240b10c0 2024-04-25T08:56:26.371 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-04-25T08:56:26.372 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw== 2024-04-25T08:56:26.372 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2024-04-25T08:56:26.372 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2024-04-25T08:56:26.372 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:56:26.372 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-25T08:56:26.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 -- 172.21.15.55:0/1868082459 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb91006b500 msgr2=0x7fb91006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb91006b500 0x7fb91006d9c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb918034000 tx=0x7fb91802e000 comp rx=0 tx=0).stop 2024-04-25T08:56:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 -- 172.21.15.55:0/1868082459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240b10c0 msgr2=0x7fb9240c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240b10c0 0x7fb9240c6570 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb91400c400 tx=0x7fb91400c8c0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 -- 172.21.15.55:0/1868082459 shutdown_connections 2024-04-25T08:56:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb91006b500 0x7fb91006d9c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9240cff90 0x7fb9241f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9240cc0c0 0x7fb9241f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 --2- 172.21.15.55:0/1868082459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240b10c0 0x7fb9240c6570 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 -- 172.21.15.55:0/1868082459 >> 172.21.15.55:0/1868082459 conn(0x7fb924099a40 msgr2=0x7fb92406fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 -- 172.21.15.55:0/1868082459 shutdown_connections 2024-04-25T08:56:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.384+0000 7fb92a7e7640 1 -- 172.21.15.55:0/1868082459 wait complete. 2024-04-25T08:56:26.384 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:26.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.495+0000 7f2133ad8640 1 Processor -- start 2024-04-25T08:56:26.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.496+0000 7f2133ad8640 1 -- start start 2024-04-25T08:56:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.496+0000 7f2133ad8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f212c15baf0 0x7f212c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.496+0000 7f2133ad8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c070a10 0x7f212c072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.496+0000 7f2133ad8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212c0ce810 con 0x7f212c0ce380 2024-04-25T08:56:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.496+0000 7f2133ad8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c073210 con 0x7f212c15baf0 2024-04-25T08:56:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.496+0000 7f2133ad8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0cecc0 con 0x7f212c070a10 2024-04-25T08:56:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.497+0000 7f2131073640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c070a10 0x7f212c072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.497+0000 7f2131874640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f212c15baf0 0x7f212c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.497+0000 7f2131073640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c070a10 0x7f212c072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:46868/0 (socket says 172.21.15.55:46868) 2024-04-25T08:56:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.497+0000 7f2131874640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f212c15baf0 0x7f212c0ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:47656/0 (socket says 172.21.15.55:47656) 2024-04-25T08:56:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.497+0000 7f2132075640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f212c0ce380 0x7f212c0cb990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:54456/0 (socket says 172.21.15.55:54456) 2024-04-25T08:56:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.497+0000 7f2131073640 1 -- 172.21.15.55:0/2331849072 learned_addr learned my addr 172.21.15.55:0/2331849072 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:26.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.497+0000 7f2131874640 1 -- 172.21.15.55:0/2331849072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c070a10 msgr2=0x7f212c072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:26.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.497+0000 7f2131874640 1 --2- 172.21.15.55:0/2331849072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c070a10 0x7f212c072b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.497+0000 7f2131874640 1 -- 172.21.15.55:0/2331849072 >> v1:172.21.15.167:6789/0 conn(0x7f212c0ce380 legacy=0x7f212c0cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.497+0000 7f2131874640 1 -- 172.21.15.55:0/2331849072 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c0cefa0 con 0x7f212c15baf0 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.498+0000 7f2131874640 1 --2- 172.21.15.55:0/2331849072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c15baf0 0x7f212c0ccb90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f21240097a0 tx=0x7f212402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be1ce1d53bec586a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.498+0000 7f2130872640 1 -- 172.21.15.55:0/2331849072 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124037070 con 0x7f212c15baf0 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.498+0000 7f2130872640 1 -- 172.21.15.55:0/2331849072 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212402adb0 con 0x7f212c15baf0 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.498+0000 7f2130872640 1 -- 172.21.15.55:0/2331849072 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124032660 con 0x7f212c15baf0 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.499+0000 7f2133ad8640 1 -- 172.21.15.55:0/2331849072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c15baf0 msgr2=0x7f212c0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.499+0000 7f2133ad8640 1 --2- 172.21.15.55:0/2331849072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c15baf0 0x7f212c0ccb90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f21240097a0 tx=0x7f212402a060 comp rx=0 tx=0).stop 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.499+0000 7f2133ad8640 1 -- 172.21.15.55:0/2331849072 shutdown_connections 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.499+0000 7f2133ad8640 1 --2- 172.21.15.55:0/2331849072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c070a10 0x7f212c072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.499+0000 7f2133ad8640 1 --2- 172.21.15.55:0/2331849072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c15baf0 0x7f212c0ccb90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.499+0000 7f2133ad8640 1 -- 172.21.15.55:0/2331849072 >> 172.21.15.55:0/2331849072 conn(0x7f212c0b2370 msgr2=0x7f212c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.499+0000 7f2133ad8640 1 -- 172.21.15.55:0/2331849072 shutdown_connections 2024-04-25T08:56:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.499+0000 7f2133ad8640 1 -- 172.21.15.55:0/2331849072 wait complete. 2024-04-25T08:56:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.500+0000 7f2133ad8640 1 Processor -- start 2024-04-25T08:56:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.500+0000 7f2133ad8640 1 -- start start 2024-04-25T08:56:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2133ad8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c070a10 0x7f212c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2133ad8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c0ce380 0x7f212c0c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2133ad8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f212c15baf0 0x7f212c14d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2133ad8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0cc0a0 con 0x7f212c15baf0 2024-04-25T08:56:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2133ad8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0704f0 con 0x7f212c070a10 2024-04-25T08:56:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2133ad8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0cc220 con 0x7f212c0ce380 2024-04-25T08:56:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2132075640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f212c15baf0 0x7f212c14d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2132075640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f212c15baf0 0x7f212c14d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39278/0 (socket says 172.21.15.55:39278) 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2132075640 1 -- 172.21.15.55:0/2200460797 learned_addr learned my addr 172.21.15.55:0/2200460797 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2131874640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c070a10 0x7f212c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2131073640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c0ce380 0x7f212c0c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2132075640 1 -- 172.21.15.55:0/2200460797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c0ce380 msgr2=0x7f212c0c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2132075640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c0ce380 0x7f212c0c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2132075640 1 -- 172.21.15.55:0/2200460797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c070a10 msgr2=0x7f212c1504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2132075640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c070a10 0x7f212c1504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2132075640 1 -- 172.21.15.55:0/2200460797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c0c60a0 con 0x7f212c15baf0 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2131874640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c070a10 0x7f212c1504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2131073640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c0ce380 0x7f212c0c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2132075640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f212c15baf0 0x7f212c14d590 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c760 tx=0x7f211c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f212a7fc640 1 -- 172.21.15.55:0/2200460797 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c018070 con 0x7f212c15baf0 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f212a7fc640 1 -- 172.21.15.55:0/2200460797 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c004d60 con 0x7f212c15baf0 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f212a7fc640 1 -- 172.21.15.55:0/2200460797 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c00a880 con 0x7f212c15baf0 2024-04-25T08:56:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.501+0000 7f2133ad8640 1 -- 172.21.15.55:0/2200460797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c0c6380 con 0x7f212c15baf0 2024-04-25T08:56:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.502+0000 7f2133ad8640 1 -- 172.21.15.55:0/2200460797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c0c6940 con 0x7f212c15baf0 2024-04-25T08:56:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.502+0000 7f2133ad8640 1 -- 172.21.15.55:0/2200460797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c0749b0 con 0x7f212c15baf0 2024-04-25T08:56:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.503+0000 7f212a7fc640 1 -- 172.21.15.55:0/2200460797 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f211c01b070 con 0x7f212c15baf0 2024-04-25T08:56:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.503+0000 7f212a7fc640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f211806b4d0 0x7f211806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.503+0000 7f212a7fc640 1 -- 172.21.15.55:0/2200460797 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f211c089690 con 0x7f212c15baf0 2024-04-25T08:56:26.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.503+0000 7f2131874640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f211806b4d0 0x7f211806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:26.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.504+0000 7f2131874640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f211806b4d0 0x7f211806d990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2124034000 tx=0x7f212402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.508+0000 7f212a7fc640 1 -- 172.21.15.55:0/2200460797 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f212c0ce810 con 0x7f212c15baf0 2024-04-25T08:56:26.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.725+0000 7f2133ad8640 1 -- 172.21.15.55:0/2200460797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f212c0723e0 con 0x7f212c15baf0 2024-04-25T08:56:26.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.726+0000 7f212a7fc640 1 -- 172.21.15.55:0/2200460797 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f211c0584f0 con 0x7f212c15baf0 2024-04-25T08:56:26.716 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:26.716 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1092467772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1092467772},{"type":"v1","addr":"172.21.15.167:6834","nonce":1092467772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/651597245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":651597245},{"type":"v1","addr":"172.21.15.55:6837","nonce":651597245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3980280949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3980280949},{"type":"v1","addr":"172.21.15.55:6836","nonce":3980280949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:17.562426+0000","modified":"2024-04-25T08:56:19.557433+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/238831666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":238831666},{"type":"v1","addr":"172.21.15.167:6835","nonce":238831666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:56:26.716 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 28 2024-04-25T08:56:26.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 -- 172.21.15.55:0/2200460797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f211806b4d0 msgr2=0x7f211806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f211806b4d0 0x7f211806d990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2124034000 tx=0x7f212402e000 comp rx=0 tx=0).stop 2024-04-25T08:56:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 -- 172.21.15.55:0/2200460797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f212c15baf0 msgr2=0x7f212c14d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f212c15baf0 0x7f212c14d590 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c760 tx=0x7f211c00cb60 comp rx=0 tx=0).stop 2024-04-25T08:56:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 -- 172.21.15.55:0/2200460797 shutdown_connections 2024-04-25T08:56:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f211806b4d0 0x7f211806d990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f212c15baf0 0x7f212c14d590 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f212c0ce380 0x7f212c0c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 --2- 172.21.15.55:0/2200460797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c070a10 0x7f212c1504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 -- 172.21.15.55:0/2200460797 >> 172.21.15.55:0/2200460797 conn(0x7f212c0b2370 msgr2=0x7f212c0b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 -- 172.21.15.55:0/2200460797 shutdown_connections 2024-04-25T08:56:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:26.728+0000 7f2133ad8640 1 -- 172.21.15.55:0/2200460797 wait complete. 2024-04-25T08:56:27.131 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:56:17.562426+0000', 'modified': '2024-04-25T08:56:19.557433+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6060}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6060': {'gid': 6060, 'name': 'b', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6835/238831666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6833', 'nonce': 238831666}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 238831666}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:56:27.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:56:27.132 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T08:56:27.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.251+0000 7f1e3e41c640 1 Processor -- start 2024-04-25T08:56:27.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.251+0000 7f1e3e41c640 1 -- start start 2024-04-25T08:56:27.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.251+0000 7f1e3e41c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e38161090 0x7f1e38161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.251+0000 7f1e3e41c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380b9720 0x7f1e380ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.251+0000 7f1e3e41c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e38161f80 con 0x7f1e380cece0 2024-04-25T08:56:27.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.251+0000 7f1e3e41c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e380cf130 con 0x7f1e38161090 2024-04-25T08:56:27.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.251+0000 7f1e3e41c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e380d21a0 con 0x7f1e380b9720 2024-04-25T08:56:27.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.252+0000 7f1e377fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380b9720 0x7f1e380ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.252+0000 7f1e37fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e38161090 0x7f1e38161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.252+0000 7f1e377fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380b9720 0x7f1e380ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:46884/0 (socket says 172.21.15.55:46884) 2024-04-25T08:56:27.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.252+0000 7f1e377fe640 1 -- 172.21.15.55:0/2662228604 learned_addr learned my addr 172.21.15.55:0/2662228604 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:27.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.252+0000 7f1e3c9b9640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1e380cece0 0x7f1e3806c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:54468/0 (socket says 172.21.15.55:54468) 2024-04-25T08:56:27.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.252+0000 7f1e377fe640 1 -- 172.21.15.55:0/2662228604 >> v2:172.21.15.167:3300/0 conn(0x7f1e38161090 msgr2=0x7f1e38161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:27.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.252+0000 7f1e377fe640 1 --2- 172.21.15.55:0/2662228604 >> v2:172.21.15.167:3300/0 conn(0x7f1e38161090 0x7f1e38161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.252+0000 7f1e377fe640 1 -- 172.21.15.55:0/2662228604 >> v1:172.21.15.167:6789/0 conn(0x7f1e380cece0 legacy=0x7f1e3806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.252+0000 7f1e377fe640 1 -- 172.21.15.55:0/2662228604 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38162260 con 0x7f1e380b9720 2024-04-25T08:56:27.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.252+0000 7f1e37fff640 1 --2- 172.21.15.55:0/2662228604 >> v2:172.21.15.167:3300/0 conn(0x7f1e38161090 0x7f1e38161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.253+0000 7f1e377fe640 1 --2- 172.21.15.55:0/2662228604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380b9720 0x7f1e380ce7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009870 tx=0x7f1e2c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf1e954be57119c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.253+0000 7f1e36ffd640 1 -- 172.21.15.55:0/2662228604 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c037070 con 0x7f1e380b9720 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.253+0000 7f1e36ffd640 1 -- 172.21.15.55:0/2662228604 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c032440 con 0x7f1e380b9720 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.253+0000 7f1e36ffd640 1 -- 172.21.15.55:0/2662228604 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c032810 con 0x7f1e380b9720 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.254+0000 7f1e3e41c640 1 -- 172.21.15.55:0/2662228604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380b9720 msgr2=0x7f1e380ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.254+0000 7f1e3e41c640 1 --2- 172.21.15.55:0/2662228604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380b9720 0x7f1e380ce7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009870 tx=0x7f1e2c02a270 comp rx=0 tx=0).stop 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.254+0000 7f1e3e41c640 1 -- 172.21.15.55:0/2662228604 shutdown_connections 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.254+0000 7f1e3e41c640 1 --2- 172.21.15.55:0/2662228604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380b9720 0x7f1e380ce7a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.254+0000 7f1e3e41c640 1 --2- 172.21.15.55:0/2662228604 >> v2:172.21.15.167:3300/0 conn(0x7f1e38161090 0x7f1e38161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.254+0000 7f1e3e41c640 1 -- 172.21.15.55:0/2662228604 >> 172.21.15.55:0/2662228604 conn(0x7f1e380b55e0 msgr2=0x7f1e380b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.254+0000 7f1e3e41c640 1 -- 172.21.15.55:0/2662228604 shutdown_connections 2024-04-25T08:56:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.254+0000 7f1e3e41c640 1 -- 172.21.15.55:0/2662228604 wait complete. 2024-04-25T08:56:27.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.255+0000 7f1e3e41c640 1 Processor -- start 2024-04-25T08:56:27.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.255+0000 7f1e3e41c640 1 -- start start 2024-04-25T08:56:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e3e41c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e380b9720 0x7f1e3815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e3e41c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380cece0 0x7f1e380b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e3e41c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e38161090 0x7f1e380b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e3e41c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e38161470 con 0x7f1e380b9720 2024-04-25T08:56:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e3e41c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e380d1e30 con 0x7f1e38161090 2024-04-25T08:56:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e3e41c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e38161c70 con 0x7f1e380cece0 2024-04-25T08:56:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e380b9720 0x7f1e3815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e380b9720 0x7f1e3815aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39294/0 (socket says 172.21.15.55:39294) 2024-04-25T08:56:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e37fff640 1 -- 172.21.15.55:0/1702989471 learned_addr learned my addr 172.21.15.55:0/1702989471 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e3c9b9640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e38161090 0x7f1e380b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e377fe640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380cece0 0x7f1e380b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e37fff640 1 -- 172.21.15.55:0/1702989471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380cece0 msgr2=0x7f1e380b7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e37fff640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380cece0 0x7f1e380b7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e37fff640 1 -- 172.21.15.55:0/1702989471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e38161090 msgr2=0x7f1e380b8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e37fff640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e38161090 0x7f1e380b8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.256+0000 7f1e37fff640 1 -- 172.21.15.55:0/1702989471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3815db50 con 0x7f1e380b9720 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.257+0000 7f1e37fff640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e380b9720 0x7f1e3815aa50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800e960 tx=0x7f1e2800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.257+0000 7f1e34ff9640 1 -- 172.21.15.55:0/1702989471 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28017070 con 0x7f1e380b9720 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.257+0000 7f1e34ff9640 1 -- 172.21.15.55:0/1702989471 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2800ca00 con 0x7f1e380b9720 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.257+0000 7f1e3e41c640 1 -- 172.21.15.55:0/1702989471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3815de30 con 0x7f1e380b9720 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.257+0000 7f1e34ff9640 1 -- 172.21.15.55:0/1702989471 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2800cdd0 con 0x7f1e380b9720 2024-04-25T08:56:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.257+0000 7f1e3e41c640 1 -- 172.21.15.55:0/1702989471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3815e3f0 con 0x7f1e380b9720 2024-04-25T08:56:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.258+0000 7f1e34ff9640 1 -- 172.21.15.55:0/1702989471 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e2801a070 con 0x7f1e380b9720 2024-04-25T08:56:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.259+0000 7f1e34ff9640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e2406b4d0 0x7f1e2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.259+0000 7f1e34ff9640 1 -- 172.21.15.55:0/1702989471 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e2808a500 con 0x7f1e380b9720 2024-04-25T08:56:27.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.259+0000 7f1e377fe640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e2406b4d0 0x7f1e2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.259+0000 7f1e377fe640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e2406b4d0 0x7f1e2406d990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c034000 tx=0x7f1e2c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:27.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.260+0000 7f1e411f7740 1 Processor -- start 2024-04-25T08:56:27.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.260+0000 7f1e411f7740 1 -- start start 2024-04-25T08:56:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.260+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a670230 0x55782a670610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.260+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a68dad0 0x55782a68e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.260+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a645f10 0x55782a68c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.260+0000 7f1e411f7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782a5a8a10 con 0x55782a68dad0 2024-04-25T08:56:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.260+0000 7f1e411f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782a551b30 con 0x55782a645f10 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.260+0000 7f1e411f7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55782a5a4c50 con 0x55782a670230 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.260+0000 7f1e377fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a68dad0 0x55782a68e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e377fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a68dad0 0x55782a68e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39296/0 (socket says 172.21.15.55:39296) 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e377fe640 1 -- 172.21.15.55:0/4234437037 learned_addr learned my addr 172.21.15.55:0/4234437037 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e3c9b9640 1 --2- 172.21.15.55:0/4234437037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a645f10 0x55782a68c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e37fff640 1 --2- 172.21.15.55:0/4234437037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a670230 0x55782a670610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e377fe640 1 -- 172.21.15.55:0/4234437037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a670230 msgr2=0x55782a670610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e377fe640 1 --2- 172.21.15.55:0/4234437037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a670230 0x55782a670610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e377fe640 1 -- 172.21.15.55:0/4234437037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a645f10 msgr2=0x55782a68c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e377fe640 1 --2- 172.21.15.55:0/4234437037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a645f10 0x55782a68c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e377fe640 1 -- 172.21.15.55:0/4234437037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55782a566e10 con 0x55782a68dad0 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e3c9b9640 1 --2- 172.21.15.55:0/4234437037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a645f10 0x55782a68c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e37fff640 1 --2- 172.21.15.55:0/4234437037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a670230 0x55782a670610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e377fe640 1 --2- 172.21.15.55:0/4234437037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a68dad0 0x55782a68e020 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c035040 tx=0x7f1e2c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84755be157f30573 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e1dffb640 1 -- 172.21.15.55:0/4234437037 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c04e070 con 0x55782a68dad0 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e1dffb640 1 -- 172.21.15.55:0/4234437037 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c032d90 con 0x55782a68dad0 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.261+0000 7f1e1dffb640 1 -- 172.21.15.55:0/4234437037 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c037040 con 0x55782a68dad0 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.262+0000 7f1e411f7740 1 -- 172.21.15.55:0/4234437037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a68dad0 msgr2=0x55782a68e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.262+0000 7f1e411f7740 1 --2- 172.21.15.55:0/4234437037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a68dad0 0x55782a68e020 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c035040 tx=0x7f1e2c02c000 comp rx=0 tx=0).stop 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.262+0000 7f1e411f7740 1 -- 172.21.15.55:0/4234437037 shutdown_connections 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.262+0000 7f1e411f7740 1 --2- 172.21.15.55:0/4234437037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a645f10 0x55782a68c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.262+0000 7f1e411f7740 1 --2- 172.21.15.55:0/4234437037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a68dad0 0x55782a68e020 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.262+0000 7f1e411f7740 1 --2- 172.21.15.55:0/4234437037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a670230 0x55782a670610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.262+0000 7f1e411f7740 1 -- 172.21.15.55:0/4234437037 >> 172.21.15.55:0/4234437037 conn(0x55782a642840 msgr2=0x55782a68b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.262+0000 7f1e411f7740 1 -- 172.21.15.55:0/4234437037 shutdown_connections 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.262+0000 7f1e411f7740 1 -- 172.21.15.55:0/4234437037 wait complete. 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.262+0000 7f1e411f7740 1 -- start start 2024-04-25T08:56:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.263+0000 7f1e411f7740 1 Processor -- start 2024-04-25T08:56:27.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.263+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a69c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.263+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a68dad0 0x55782a68e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.263+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a671f40 0x55782a6890e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.263+0000 7f1e411f7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782a646cb0 con 0x55782a670230 2024-04-25T08:56:27.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.263+0000 7f1e411f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782a5650c0 con 0x55782a671f40 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.263+0000 7f1e411f7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55782a640770 con 0x55782a68dad0 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.263+0000 7f1e411f7740 10 client.0 _ll_register_callbacks cb 0x55782a558ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.263+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a69c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.263+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a69c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39312/0 (socket says 172.21.15.55:39312) 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.263+0000 7f1e37fff640 1 -- 172.21.15.55:0/789693269 learned_addr learned my addr 172.21.15.55:0/789693269 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e3c9b9640 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a671f40 0x55782a6890e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e377fe640 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a68dad0 0x55782a68e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e37fff640 1 -- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a68dad0 msgr2=0x55782a68e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e37fff640 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a68dad0 0x55782a68e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e37fff640 1 -- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a671f40 msgr2=0x55782a6890e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e37fff640 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a671f40 0x55782a6890e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e37fff640 1 -- 172.21.15.55:0/789693269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55782a2bd2d0 con 0x55782a670230 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e37fff640 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a69c220 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1e280889d0 tx=0x7f1e28059430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e143daf4d6b6635 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:56:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e16ffd640 1 -- 172.21.15.55:0/789693269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28070020 con 0x55782a670230 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e16ffd640 1 -- 172.21.15.55:0/789693269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e2808a0b0 con 0x55782a670230 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e411f7740 1 -- 172.21.15.55:0/789693269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1e2c032d90 con 0x55782a670230 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e16ffd640 1 -- 172.21.15.55:0/789693269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e28021040 con 0x55782a670230 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e411f7740 10 client.6210 fetch_fsmap learned FSMap version 28 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e411f7740 1 -- 172.21.15.55:0/789693269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55782a3876b0 con 0x55782a670230 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e16ffd640 1 -- 172.21.15.55:0/789693269 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c032d90 con 0x55782a670230 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e16ffd640 1 -- 172.21.15.55:0/789693269 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1e28058040 con 0x55782a670230 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e411f7740 10 client.6210 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e411f7740 10 client.6210 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e411f7740 20 client.6210 populate_metadata read hostname 'smithi055' 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.264+0000 7f1e411f7740 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55782a683d10 0x55782a69f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.265+0000 7f1e411f7740 4 client.6210 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.265+0000 7f1e411f7740 1 -- 172.21.15.55:0/789693269 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55782a607920 con 0x55782a683d10 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.265+0000 7f1e377fe640 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55782a683d10 0x55782a69f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.265+0000 7f1e377fe640 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55782a683d10 0x55782a69f0e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8b0087b973d048b server_cookie=9fddd0abb7e8c53f in_seq=0 out_seq=0 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.265+0000 7f1e16ffd640 10 client.6210 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e16ffd640 1 -- 172.21.15.55:0/789693269 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55782a607920 con 0x55782a683d10 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e16ffd640 10 client.6210 handle_command_reply: tid=0 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 1 client.6210 shutdown 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 1 -- 172.21.15.55:0/789693269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 msgr2=0x55782a69c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a69c220 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1e280889d0 tx=0x7f1e28059430 comp rx=0 tx=0).stop 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 1 -- 172.21.15.55:0/789693269 shutdown_connections 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55782a683d10 0x55782a69f0e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a671f40 0x55782a6890e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a68dad0 0x55782a68e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 1 --2- 172.21.15.55:0/789693269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a69c220 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e16ffd640 0 client.6210 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 1 -- 172.21.15.55:0/789693269 >> 172.21.15.55:0/789693269 conn(0x55782a645f10 msgr2=0x55782a63feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 1 -- 172.21.15.55:0/789693269 shutdown_connections 2024-04-25T08:56:27.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 1 -- 172.21.15.55:0/789693269 wait complete. 2024-04-25T08:56:27.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.266+0000 7f1e411f7740 20 client.6210 trim_cache size 0 max 16384 2024-04-25T08:56:27.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.282+0000 7f1e411f7740 1 Processor -- start 2024-04-25T08:56:27.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.282+0000 7f1e411f7740 1 -- start start 2024-04-25T08:56:27.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a688c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a671f40 0x55782a6462f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a68dad0 0x55782a646830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e411f7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3815f7f0 con 0x55782a670230 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e411f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3815ebf0 con 0x55782a68dad0 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e411f7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3815f1f0 con 0x55782a671f40 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a688c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a688c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39328/0 (socket says 172.21.15.55:39328) 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e37fff640 1 -- 172.21.15.55:0/3535478576 learned_addr learned my addr 172.21.15.55:0/3535478576 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e377fe640 1 --2- 172.21.15.55:0/3535478576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a671f40 0x55782a6462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e3c9b9640 1 --2- 172.21.15.55:0/3535478576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a68dad0 0x55782a646830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e37fff640 1 -- 172.21.15.55:0/3535478576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a671f40 msgr2=0x55782a6462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e37fff640 1 --2- 172.21.15.55:0/3535478576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a671f40 0x55782a6462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e37fff640 1 -- 172.21.15.55:0/3535478576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a68dad0 msgr2=0x55782a646830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e37fff640 1 --2- 172.21.15.55:0/3535478576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a68dad0 0x55782a646830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e37fff640 1 -- 172.21.15.55:0/3535478576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55782a670980 con 0x55782a670230 2024-04-25T08:56:27.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.283+0000 7f1e37fff640 1 --2- 172.21.15.55:0/3535478576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a688c60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1e28060e60 tx=0x7f1e2801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a133f6ec3073405 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e1d7fa640 1 -- 172.21.15.55:0/3535478576 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28070030 con 0x55782a670230 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e1d7fa640 1 -- 172.21.15.55:0/3535478576 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28088e50 con 0x55782a670230 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e1d7fa640 1 -- 172.21.15.55:0/3535478576 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280589c0 con 0x55782a670230 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e411f7740 1 -- 172.21.15.55:0/3535478576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 msgr2=0x55782a688c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e411f7740 1 --2- 172.21.15.55:0/3535478576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a688c60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1e28060e60 tx=0x7f1e2801e000 comp rx=0 tx=0).stop 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e411f7740 1 -- 172.21.15.55:0/3535478576 shutdown_connections 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e411f7740 1 --2- 172.21.15.55:0/3535478576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a68dad0 0x55782a646830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e411f7740 1 --2- 172.21.15.55:0/3535478576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a671f40 0x55782a6462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e411f7740 1 --2- 172.21.15.55:0/3535478576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a688c60 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e411f7740 1 -- 172.21.15.55:0/3535478576 >> 172.21.15.55:0/3535478576 conn(0x55782a645f10 msgr2=0x55782a68e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e411f7740 1 -- 172.21.15.55:0/3535478576 shutdown_connections 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.284+0000 7f1e411f7740 1 -- 172.21.15.55:0/3535478576 wait complete. 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.285+0000 7f1e411f7740 1 -- start start 2024-04-25T08:56:27.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.285+0000 7f1e411f7740 1 Processor -- start 2024-04-25T08:56:27.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a644380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a671f40 0x55782a6448c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e411f7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a68dad0 0x55782a68c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e411f7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782a6821c0 con 0x55782a670230 2024-04-25T08:56:27.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e411f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782a672da0 con 0x55782a671f40 2024-04-25T08:56:27.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e411f7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55782a684160 con 0x55782a68dad0 2024-04-25T08:56:27.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e411f7740 10 client.0 _ll_register_callbacks cb 0x55782a640c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:56:27.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a644380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a644380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39338/0 (socket says 172.21.15.55:39338) 2024-04-25T08:56:27.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e37fff640 1 -- 172.21.15.55:0/2620915158 learned_addr learned my addr 172.21.15.55:0/2620915158 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e377fe640 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a671f40 0x55782a6448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e3c9b9640 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a68dad0 0x55782a68c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e37fff640 1 -- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a68dad0 msgr2=0x55782a68c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e37fff640 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a68dad0 0x55782a68c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e37fff640 1 -- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a671f40 msgr2=0x55782a6448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e37fff640 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a671f40 0x55782a6448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e37fff640 1 -- 172.21.15.55:0/2620915158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55782a682e80 con 0x55782a670230 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e377fe640 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a671f40 0x55782a6448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e37fff640 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a644380 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1e28055570 tx=0x7f1e28088900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dea8a452a8eef86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e16ffd640 1 -- 172.21.15.55:0/2620915158 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280589c0 con 0x55782a670230 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e16ffd640 1 -- 172.21.15.55:0/2620915158 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e2808a0b0 con 0x55782a670230 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.286+0000 7f1e411f7740 1 -- 172.21.15.55:0/2620915158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1e28088e50 con 0x55782a670230 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e16ffd640 1 -- 172.21.15.55:0/2620915158 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e28066050 con 0x55782a670230 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e411f7740 10 client.6216 fetch_fsmap learned FSMap version 28 2024-04-25T08:56:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e411f7740 1 -- 172.21.15.55:0/2620915158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55782a682e80 con 0x55782a670230 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e16ffd640 1 -- 172.21.15.55:0/2620915158 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28088e50 con 0x55782a670230 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e16ffd640 1 -- 172.21.15.55:0/2620915158 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1e28069020 con 0x55782a670230 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e411f7740 10 client.6216 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e411f7740 10 client.6216 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e411f7740 20 client.6216 populate_metadata read hostname 'smithi055' 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e411f7740 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55782a6f6240 0x55782a68c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e411f7740 4 client.6216 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e411f7740 1 -- 172.21.15.55:0/2620915158 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55782a5b5f50 con 0x55782a6f6240 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e377fe640 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55782a6f6240 0x55782a68c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e377fe640 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55782a6f6240 0x55782a68c770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e6d0bf758a6e5f8 server_cookie=17c12496b38e746 in_seq=0 out_seq=0 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.287+0000 7f1e16ffd640 10 client.6216 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e16ffd640 1 -- 172.21.15.55:0/2620915158 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55782a5b5f50 con 0x55782a6f6240 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e16ffd640 10 client.6216 handle_command_reply: tid=0 2024-04-25T08:56:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 1 client.6216 shutdown 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 1 -- 172.21.15.55:0/2620915158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 msgr2=0x55782a644380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a644380 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1e28055570 tx=0x7f1e28088900 comp rx=0 tx=0).stop 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 1 -- 172.21.15.55:0/2620915158 shutdown_connections 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55782a6f6240 0x55782a68c770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55782a68dad0 0x55782a68c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55782a671f40 0x55782a6448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 1 --2- 172.21.15.55:0/2620915158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55782a670230 0x55782a644380 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e16ffd640 0 client.6216 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 1 -- 172.21.15.55:0/2620915158 >> 172.21.15.55:0/2620915158 conn(0x55782a645f10 msgr2=0x55782a68eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 1 -- 172.21.15.55:0/2620915158 shutdown_connections 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 1 -- 172.21.15.55:0/2620915158 wait complete. 2024-04-25T08:56:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e411f7740 20 client.6216 trim_cache size 0 max 16384 2024-04-25T08:56:27.285 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:56:27.285 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T08:56:27.285 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T08:56:27.285 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6060, 2024-04-25T08:56:27.285 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T08:56:27.285 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T08:56:27.285 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T08:56:27.285 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 9.0972351259999993, 2024-04-25T08:56:27.285 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 28, 2024-04-25T08:56:27.285 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 61, 2024-04-25T08:56:27.286 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 61, 2024-04-25T08:56:27.286 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 14.432185296 2024-04-25T08:56:27.286 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:56:27.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e3e41c640 1 -- 172.21.15.55:0/1702989471 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e2406b4d0 msgr2=0x7f1e2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e3e41c640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e2406b4d0 0x7f1e2406d990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c034000 tx=0x7f1e2c02e000 comp rx=0 tx=0).stop 2024-04-25T08:56:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e3e41c640 1 -- 172.21.15.55:0/1702989471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e380b9720 msgr2=0x7f1e3815aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.288+0000 7f1e3e41c640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e380b9720 0x7f1e3815aa50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800e960 tx=0x7f1e2800ee20 comp rx=0 tx=0).stop 2024-04-25T08:56:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.289+0000 7f1e3e41c640 1 -- 172.21.15.55:0/1702989471 shutdown_connections 2024-04-25T08:56:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.289+0000 7f1e3e41c640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e2406b4d0 0x7f1e2406d990 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.289+0000 7f1e3e41c640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e38161090 0x7f1e380b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.289+0000 7f1e3e41c640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e380cece0 0x7f1e380b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.289+0000 7f1e3e41c640 1 --2- 172.21.15.55:0/1702989471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e380b9720 0x7f1e3815aa50 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.289+0000 7f1e3e41c640 1 -- 172.21.15.55:0/1702989471 >> 172.21.15.55:0/1702989471 conn(0x7f1e380b55e0 msgr2=0x7f1e380b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.289+0000 7f1e3e41c640 1 -- 172.21.15.55:0/1702989471 shutdown_connections 2024-04-25T08:56:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.289+0000 7f1e3e41c640 1 -- 172.21.15.55:0/1702989471 wait complete. 2024-04-25T08:56:27.289 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:56:27.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.401+0000 7f8d9844a640 1 Processor -- start 2024-04-25T08:56:27.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.401+0000 7f8d9844a640 1 -- start start 2024-04-25T08:56:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.402+0000 7f8d9844a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8d900cc0a0 0x7f8d900ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.402+0000 7f8d9844a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8d90070a10 0x7f8d90072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.402+0000 7f8d9844a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d90073210 con 0x7f8d9015baf0 2024-04-25T08:56:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.402+0000 7f8d9844a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d900cecc0 con 0x7f8d900cc0a0 2024-04-25T08:56:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.402+0000 7f8d9844a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d900cefa0 con 0x7f8d90070a10 2024-04-25T08:56:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.402+0000 7f8d961e6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8d9015baf0 0x7f8d900cb990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37558/0 (socket says 172.21.15.55:37558) 2024-04-25T08:56:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.402+0000 7f8d961e6640 1 -- 172.21.15.55:0/3023757273 learned_addr learned my addr 172.21.15.55:0/3023757273 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.402+0000 7f8d959e5640 1 --2- 172.21.15.55:0/3023757273 >> v2:172.21.15.55:3300/0 conn(0x7f8d900cc0a0 0x7f8d900ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.403+0000 7f8d969e7640 1 --2- 172.21.15.55:0/3023757273 >> v2:172.21.15.167:3300/0 conn(0x7f8d90070a10 0x7f8d90072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.403+0000 7f8d959e5640 1 -- 172.21.15.55:0/3023757273 >> v2:172.21.15.167:3300/0 conn(0x7f8d90070a10 msgr2=0x7f8d90072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.403+0000 7f8d959e5640 1 --2- 172.21.15.55:0/3023757273 >> v2:172.21.15.167:3300/0 conn(0x7f8d90070a10 0x7f8d90072b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.403+0000 7f8d959e5640 1 -- 172.21.15.55:0/3023757273 >> v1:172.21.15.55:6789/0 conn(0x7f8d9015baf0 legacy=0x7f8d900cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.403+0000 7f8d959e5640 1 -- 172.21.15.55:0/3023757273 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d900cf280 con 0x7f8d900cc0a0 2024-04-25T08:56:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.403+0000 7f8d951e4640 1 -- 172.21.15.55:0/3023757273 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707658174 0 0) 0x7f8d90073210 con 0x7f8d9015baf0 2024-04-25T08:56:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.403+0000 7f8d959e5640 1 --2- 172.21.15.55:0/3023757273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d900cc0a0 0x7f8d900ccb90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8d9006b880 tx=0x7f8d8002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa11d3e048a8112 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.404+0000 7f8d951e4640 1 -- 172.21.15.55:0/3023757273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80037070 con 0x7f8d900cc0a0 2024-04-25T08:56:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.404+0000 7f8d951e4640 1 -- 172.21.15.55:0/3023757273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d80032440 con 0x7f8d900cc0a0 2024-04-25T08:56:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.404+0000 7f8d951e4640 1 -- 172.21.15.55:0/3023757273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8002ae60 con 0x7f8d900cc0a0 2024-04-25T08:56:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.404+0000 7f8d9844a640 1 -- 172.21.15.55:0/3023757273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d900cc0a0 msgr2=0x7f8d900ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.404+0000 7f8d9844a640 1 --2- 172.21.15.55:0/3023757273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d900cc0a0 0x7f8d900ccb90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8d9006b880 tx=0x7f8d8002a110 comp rx=0 tx=0).stop 2024-04-25T08:56:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.404+0000 7f8d9844a640 1 -- 172.21.15.55:0/3023757273 shutdown_connections 2024-04-25T08:56:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.404+0000 7f8d9844a640 1 --2- 172.21.15.55:0/3023757273 >> v2:172.21.15.167:3300/0 conn(0x7f8d90070a10 0x7f8d90072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.404+0000 7f8d9844a640 1 --2- 172.21.15.55:0/3023757273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d900cc0a0 0x7f8d900ccb90 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.404+0000 7f8d9844a640 1 -- 172.21.15.55:0/3023757273 >> 172.21.15.55:0/3023757273 conn(0x7f8d900b2370 msgr2=0x7f8d900b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.404+0000 7f8d9844a640 1 -- 172.21.15.55:0/3023757273 shutdown_connections 2024-04-25T08:56:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.404+0000 7f8d9844a640 1 -- 172.21.15.55:0/3023757273 wait complete. 2024-04-25T08:56:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.405+0000 7f8d9844a640 1 Processor -- start 2024-04-25T08:56:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.406+0000 7f8d9844a640 1 -- start start 2024-04-25T08:56:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.406+0000 7f8d9844a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d90070a10 0x7f8d900b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.406+0000 7f8d9844a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d900cc0a0 0x7f8d900c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.406+0000 7f8d9844a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9015baf0 0x7f8d90156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.406+0000 7f8d9844a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d900ce500 con 0x7f8d90070a10 2024-04-25T08:56:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.406+0000 7f8d9844a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d900ce380 con 0x7f8d900cc0a0 2024-04-25T08:56:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.406+0000 7f8d9844a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d900ce680 con 0x7f8d9015baf0 2024-04-25T08:56:27.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.406+0000 7f8d961e6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d90070a10 0x7f8d900b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.406+0000 7f8d961e6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d90070a10 0x7f8d900b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39360/0 (socket says 172.21.15.55:39360) 2024-04-25T08:56:27.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.406+0000 7f8d961e6640 1 -- 172.21.15.55:0/4281071799 learned_addr learned my addr 172.21.15.55:0/4281071799 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:27.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d969e7640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9015baf0 0x7f8d90156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d959e5640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d900cc0a0 0x7f8d900c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d961e6640 1 -- 172.21.15.55:0/4281071799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9015baf0 msgr2=0x7f8d90156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d961e6640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9015baf0 0x7f8d90156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d961e6640 1 -- 172.21.15.55:0/4281071799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d900cc0a0 msgr2=0x7f8d900c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d961e6640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d900cc0a0 0x7f8d900c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d961e6640 1 -- 172.21.15.55:0/4281071799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d90157990 con 0x7f8d90070a10 2024-04-25T08:56:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d959e5640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d900cc0a0 0x7f8d900c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d961e6640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d90070a10 0x7f8d900b4bd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8d88010b10 tx=0x7f8d8800e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d86ffd640 1 -- 172.21.15.55:0/4281071799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8801b070 con 0x7f8d90070a10 2024-04-25T08:56:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d86ffd640 1 -- 172.21.15.55:0/4281071799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8800ec70 con 0x7f8d90070a10 2024-04-25T08:56:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d9844a640 1 -- 172.21.15.55:0/4281071799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d900b40f0 con 0x7f8d90070a10 2024-04-25T08:56:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d86ffd640 1 -- 172.21.15.55:0/4281071799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800ee60 con 0x7f8d90070a10 2024-04-25T08:56:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.407+0000 7f8d9844a640 1 -- 172.21.15.55:0/4281071799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d900b46b0 con 0x7f8d90070a10 2024-04-25T08:56:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.408+0000 7f8d9844a640 1 -- 172.21.15.55:0/4281071799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d90068520 con 0x7f8d90070a10 2024-04-25T08:56:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.408+0000 7f8d86ffd640 1 -- 172.21.15.55:0/4281071799 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8d8801e070 con 0x7f8d90070a10 2024-04-25T08:56:27.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.409+0000 7f8d86ffd640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d7406b4d0 0x7f8d7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:27.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.409+0000 7f8d86ffd640 1 -- 172.21.15.55:0/4281071799 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d8808df40 con 0x7f8d90070a10 2024-04-25T08:56:27.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.409+0000 7f8d959e5640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d7406b4d0 0x7f8d7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:27.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.409+0000 7f8d959e5640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d7406b4d0 0x7f8d7406d990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8d80034000 tx=0x7f8d8002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:27.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.413+0000 7f8d86ffd640 1 -- 172.21.15.55:0/4281071799 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d90068520 con 0x7f8d90070a10 2024-04-25T08:56:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.631+0000 7f8d9844a640 1 -- 172.21.15.55:0/4281071799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d900749b0 con 0x7f8d90070a10 2024-04-25T08:56:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.631+0000 7f8d86ffd640 1 -- 172.21.15.55:0/4281071799 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8d8805cdc0 con 0x7f8d90070a10 2024-04-25T08:56:27.620 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:56:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 -- 172.21.15.55:0/4281071799 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d7406b4d0 msgr2=0x7f8d7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d7406b4d0 0x7f8d7406d990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8d80034000 tx=0x7f8d8002e000 comp rx=0 tx=0).stop 2024-04-25T08:56:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 -- 172.21.15.55:0/4281071799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d90070a10 msgr2=0x7f8d900b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d90070a10 0x7f8d900b4bd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8d88010b10 tx=0x7f8d8800e060 comp rx=0 tx=0).stop 2024-04-25T08:56:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 -- 172.21.15.55:0/4281071799 shutdown_connections 2024-04-25T08:56:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d7406b4d0 0x7f8d7406d990 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9015baf0 0x7f8d90156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d900cc0a0 0x7f8d900c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 --2- 172.21.15.55:0/4281071799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d90070a10 0x7f8d900b4bd0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 -- 172.21.15.55:0/4281071799 >> 172.21.15.55:0/4281071799 conn(0x7f8d900b2370 msgr2=0x7f8d900b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 -- 172.21.15.55:0/4281071799 shutdown_connections 2024-04-25T08:56:27.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:27.633+0000 7f8d9844a640 1 -- 172.21.15.55:0/4281071799 wait complete. 2024-04-25T08:56:27.634 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:56:27.634 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:56:27.634 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T08:56:27.634 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:56:27.634 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:56:27.634 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:56:27.634 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:56:27.634 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:56:27.634 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:56:27.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:27.635 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T08:56:27.651 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:56:27.651 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:56:27.651 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:56:27.651 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:56:27.651 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:56:27.651 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:56:27.651 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42570sec preferred_lft 42570sec 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:56:27.652 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T08:56:27.653 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:56:27.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:27.654 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:56:27.715 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:56:27.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:27.716 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T08:56:27.772 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T08:56:27.773 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:56:27.773 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:56:27.773 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:56:27.773 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:56:27.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:27.773 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:56:27.773 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:56:27.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:56:27.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:56:27.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:56:27.774 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:56:27.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:27.859 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:56:27.874 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:56:27.875 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:56:27.875 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:56:27.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:27.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T08:56:27.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:56:27.939 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:56:27.995 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:56:27.995 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:56:27.995 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:56:28.050 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:56:28.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:28.050 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:56:28.132 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:56:28.133 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:56:28.133 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:56:28.141 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:56:28.141 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:56:28.141 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:56:28.141 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:56:28.141 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:56:28.147 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:56:28.147 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:56:28.147 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:56:28.147 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:56:28.147 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:56:28.147 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:56:28.147 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:56:28.147 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:56:28.147 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:56:28.148 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:56:28.148 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:56:28.148 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:56:28.148 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:56:28.149 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:56:28.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:28.149 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:56:28.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:28.215 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:56:28.278 INFO:teuthology.orchestra.run.smithi055.stdout:client6228 2024-04-25T08:56:28.279 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:56:28.279 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:56:28.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:28.334 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-04-25T08:56:28.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:28.395 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-04-25T08:56:28.452 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T08:56:28.453 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T08:56:28.453 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T08:56:28.453 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:56:28.453 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-04-25T08:56:28.453 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T08:56:28.559 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-25T08:56:28.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:56:28.568 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:28.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.720+0000 7fc1e5fce640 1 Processor -- start 2024-04-25T08:56:28.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.720+0000 7fc1e5fce640 1 -- start start 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1e5fce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc1e00d35b0 0x7fc1e00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1e5fce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1e00b5990 0x7fc1e00b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1e5fce640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e015e0c0 con 0x7fc1e015dce0 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1e5fce640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e00d2510 con 0x7fc1e00b5990 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1e5fce640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e00d27f0 con 0x7fc1e00d35b0 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1dffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1e00b5990 0x7fc1e00b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1df7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc1e015dce0 0x7fc1e00d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52618/0 (socket says 172.21.15.55:52618) 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1df7fe640 1 -- 172.21.15.55:0/1812431832 learned_addr learned my addr 172.21.15.55:0/1812431832 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1deffd640 1 --2- 172.21.15.55:0/1812431832 >> v2:172.21.15.167:3300/0 conn(0x7fc1e00d35b0 0x7fc1e00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1dffff640 1 -- 172.21.15.55:0/1812431832 >> v2:172.21.15.167:3300/0 conn(0x7fc1e00d35b0 msgr2=0x7fc1e00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1dffff640 1 --2- 172.21.15.55:0/1812431832 >> v2:172.21.15.167:3300/0 conn(0x7fc1e00d35b0 0x7fc1e00b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1dffff640 1 -- 172.21.15.55:0/1812431832 >> v1:172.21.15.55:6789/0 conn(0x7fc1e015dce0 legacy=0x7fc1e00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1dffff640 1 -- 172.21.15.55:0/1812431832 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00d2ad0 con 0x7fc1e00b5990 2024-04-25T08:56:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1de7fc640 1 -- 172.21.15.55:0/1812431832 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104942716 0 0) 0x7fc1e015e0c0 con 0x7fc1e015dce0 2024-04-25T08:56:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.721+0000 7fc1deffd640 1 --2- 172.21.15.55:0/1812431832 >> v2:172.21.15.167:3300/0 conn(0x7fc1e00d35b0 0x7fc1e00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.722+0000 7fc1dffff640 1 --2- 172.21.15.55:0/1812431832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e00b5990 0x7fc1e00b6b00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00cdfa0 tx=0x7fc1d802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670b81672c8cceb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.722+0000 7fc1de7fc640 1 -- 172.21.15.55:0/1812431832 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8007740 con 0x7fc1e00b5990 2024-04-25T08:56:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.722+0000 7fc1de7fc640 1 -- 172.21.15.55:0/1812431832 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d80078e0 con 0x7fc1e00b5990 2024-04-25T08:56:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.722+0000 7fc1de7fc640 1 -- 172.21.15.55:0/1812431832 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8007cb0 con 0x7fc1e00b5990 2024-04-25T08:56:28.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.723+0000 7fc1e5fce640 1 -- 172.21.15.55:0/1812431832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e00b5990 msgr2=0x7fc1e00b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:28.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.723+0000 7fc1e5fce640 1 --2- 172.21.15.55:0/1812431832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e00b5990 0x7fc1e00b6b00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00cdfa0 tx=0x7fc1d802a680 comp rx=0 tx=0).stop 2024-04-25T08:56:28.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.723+0000 7fc1e5fce640 1 -- 172.21.15.55:0/1812431832 shutdown_connections 2024-04-25T08:56:28.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.723+0000 7fc1e5fce640 1 --2- 172.21.15.55:0/1812431832 >> v2:172.21.15.167:3300/0 conn(0x7fc1e00d35b0 0x7fc1e00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:28.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.723+0000 7fc1e5fce640 1 --2- 172.21.15.55:0/1812431832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e00b5990 0x7fc1e00b6b00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:28.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.723+0000 7fc1e5fce640 1 -- 172.21.15.55:0/1812431832 >> 172.21.15.55:0/1812431832 conn(0x7fc1e0072900 msgr2=0x7fc1e00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:28.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.723+0000 7fc1e5fce640 1 -- 172.21.15.55:0/1812431832 shutdown_connections 2024-04-25T08:56:28.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.723+0000 7fc1e5fce640 1 -- 172.21.15.55:0/1812431832 wait complete. 2024-04-25T08:56:28.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.724+0000 7fc1e5fce640 1 Processor -- start 2024-04-25T08:56:28.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.724+0000 7fc1e5fce640 1 -- start start 2024-04-25T08:56:28.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1e5fce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1e00b5990 0x7fc1e015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:28.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1e5fce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1e00d35b0 0x7fc1e00ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:28.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1e5fce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e015dce0 0x7fc1e00b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:28.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1e5fce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00d2160 con 0x7fc1e015dce0 2024-04-25T08:56:28.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1e5fce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00d3090 con 0x7fc1e00b5990 2024-04-25T08:56:28.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1e5fce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00aa550 con 0x7fc1e00d35b0 2024-04-25T08:56:28.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e015dce0 0x7fc1e00b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:28.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e015dce0 0x7fc1e00b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41686/0 (socket says 172.21.15.55:41686) 2024-04-25T08:56:28.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1dffff640 1 -- 172.21.15.55:0/3905931550 learned_addr learned my addr 172.21.15.55:0/3905931550 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:28.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1dffff640 1 -- 172.21.15.55:0/3905931550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1e00d35b0 msgr2=0x7fc1e00ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:28.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1dffff640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1e00d35b0 0x7fc1e00ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:28.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1dffff640 1 -- 172.21.15.55:0/3905931550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1e00b5990 msgr2=0x7fc1e015b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:28.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1df7fe640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1e00b5990 0x7fc1e015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:28.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1dffff640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1e00b5990 0x7fc1e015b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:28.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1dffff640 1 -- 172.21.15.55:0/3905931550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00aa830 con 0x7fc1e015dce0 2024-04-25T08:56:28.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.725+0000 7fc1dffff640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e015dce0 0x7fc1e00b35e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009e50 tx=0x7fc1d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:28.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.726+0000 7fc1c7fff640 1 -- 172.21.15.55:0/3905931550 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8040070 con 0x7fc1e015dce0 2024-04-25T08:56:28.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.726+0000 7fc1e5fce640 1 -- 172.21.15.55:0/3905931550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e00aab10 con 0x7fc1e015dce0 2024-04-25T08:56:28.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.726+0000 7fc1c7fff640 1 -- 172.21.15.55:0/3905931550 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d8031bf0 con 0x7fc1e015dce0 2024-04-25T08:56:28.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.726+0000 7fc1c7fff640 1 -- 172.21.15.55:0/3905931550 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8045460 con 0x7fc1e015dce0 2024-04-25T08:56:28.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.726+0000 7fc1e5fce640 1 -- 172.21.15.55:0/3905931550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e015b840 con 0x7fc1e015dce0 2024-04-25T08:56:28.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.727+0000 7fc1e5fce640 1 -- 172.21.15.55:0/3905931550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e00cf8d0 con 0x7fc1e015dce0 2024-04-25T08:56:28.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.727+0000 7fc1c7fff640 1 -- 172.21.15.55:0/3905931550 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc1d8039040 con 0x7fc1e015dce0 2024-04-25T08:56:28.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.727+0000 7fc1c7fff640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1cc06b4d0 0x7fc1cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:28.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.728+0000 7fc1df7fe640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1cc06b4d0 0x7fc1cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:28.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.728+0000 7fc1c7fff640 1 -- 172.21.15.55:0/3905931550 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1d80abbf0 con 0x7fc1e015dce0 2024-04-25T08:56:28.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.728+0000 7fc1df7fe640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1cc06b4d0 0x7fc1cc06d990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0000f60 tx=0x7fc1d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:28.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.732+0000 7fc1c7fff640 1 -- 172.21.15.55:0/3905931550 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc1e00cf8d0 con 0x7fc1e015dce0 2024-04-25T08:56:28.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.952+0000 7fc1e5fce640 1 -- 172.21.15.55:0/3905931550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1e00749b0 con 0x7fc1e015dce0 2024-04-25T08:56:28.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.953+0000 7fc1c7fff640 1 -- 172.21.15.55:0/3905931550 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fc1d807aa60 con 0x7fc1e015dce0 2024-04-25T08:56:28.943 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:28.943 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1092467772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1092467772},{"type":"v1","addr":"172.21.15.167:6834","nonce":1092467772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/651597245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":651597245},{"type":"v1","addr":"172.21.15.55:6837","nonce":651597245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3980280949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3980280949},{"type":"v1","addr":"172.21.15.55:6836","nonce":3980280949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:17.562426+0000","modified":"2024-04-25T08:56:19.557433+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6835/238831666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":238831666},{"type":"v1","addr":"172.21.15.167:6835","nonce":238831666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:56:28.943 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 28 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 -- 172.21.15.55:0/3905931550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1cc06b4d0 msgr2=0x7fc1cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1cc06b4d0 0x7fc1cc06d990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0000f60 tx=0x7fc1d0009040 comp rx=0 tx=0).stop 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 -- 172.21.15.55:0/3905931550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e015dce0 msgr2=0x7fc1e00b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e015dce0 0x7fc1e00b35e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009e50 tx=0x7fc1d8004a40 comp rx=0 tx=0).stop 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 -- 172.21.15.55:0/3905931550 shutdown_connections 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1cc06b4d0 0x7fc1cc06d990 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e015dce0 0x7fc1e00b35e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1e00d35b0 0x7fc1e00ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 --2- 172.21.15.55:0/3905931550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1e00b5990 0x7fc1e015b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 -- 172.21.15.55:0/3905931550 >> 172.21.15.55:0/3905931550 conn(0x7fc1e0072900 msgr2=0x7fc1e00b82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 -- 172.21.15.55:0/3905931550 shutdown_connections 2024-04-25T08:56:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:28.955+0000 7fc1e5fce640 1 -- 172.21.15.55:0/3905931550 wait complete. 2024-04-25T08:56:28.956 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-25T08:56:29.094 INFO:teuthology.orchestra.run.smithi167.stdout:{"message":"","return_code":0} 2024-04-25T08:56:29.094 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T08:56:29.094 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T08:56:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.148+0000 7fce40f8ef40 1 Processor -- start 2024-04-25T08:56:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.148+0000 7fce40f8ef40 1 -- start start 2024-04-25T08:56:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce40f8ef40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 0x55d2d6567350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce40f8ef40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d2d6637b60 0x55d2d6565a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce40f8ef40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2d663a5e0 0x55d2d663c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce40f8ef40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2d650bdf0 con 0x55d2d6594880 2024-04-25T08:56:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce40f8ef40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2d650fd50 con 0x55d2d663a5e0 2024-04-25T08:56:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce40f8ef40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2d663b860 con 0x55d2d6637b60 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3ea8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 0x55d2d6567350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3ea8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 0x55d2d6567350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41714/0 (socket says 172.21.15.55:41714) 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3ea8f640 1 -- 172.21.15.55:0/876887396 learned_addr learned my addr 172.21.15.55:0/876887396 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3f290640 1 --2- 172.21.15.55:0/876887396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2d663a5e0 0x55d2d663c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3e28e640 1 --2- 172.21.15.55:0/876887396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d2d6637b60 0x55d2d6565a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3ea8f640 1 -- 172.21.15.55:0/876887396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d2d6637b60 msgr2=0x55d2d6565a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3ea8f640 1 --2- 172.21.15.55:0/876887396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d2d6637b60 0x55d2d6565a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3ea8f640 1 -- 172.21.15.55:0/876887396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2d663a5e0 msgr2=0x55d2d663c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3ea8f640 1 --2- 172.21.15.55:0/876887396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2d663a5e0 0x55d2d663c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3ea8f640 1 -- 172.21.15.55:0/876887396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2d658ea40 con 0x55d2d6594880 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3f290640 1 --2- 172.21.15.55:0/876887396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2d663a5e0 0x55d2d663c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.149+0000 7fce3ea8f640 1 --2- 172.21.15.55:0/876887396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 0x55d2d6567350 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fce3800b310 tx=0x7fce3800b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560a96dcca4411bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce3d28c640 1 -- 172.21.15.55:0/876887396 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce38008070 con 0x55d2d6594880 2024-04-25T08:56:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce3d28c640 1 -- 172.21.15.55:0/876887396 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3800d500 con 0x55d2d6594880 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce3d28c640 1 -- 172.21.15.55:0/876887396 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3800d8b0 con 0x55d2d6594880 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce40f8ef40 1 -- 172.21.15.55:0/876887396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 msgr2=0x55d2d6567350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce40f8ef40 1 --2- 172.21.15.55:0/876887396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 0x55d2d6567350 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fce3800b310 tx=0x7fce3800b7d0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce40f8ef40 1 -- 172.21.15.55:0/876887396 shutdown_connections 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce40f8ef40 1 --2- 172.21.15.55:0/876887396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2d663a5e0 0x55d2d663c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce40f8ef40 1 --2- 172.21.15.55:0/876887396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d2d6637b60 0x55d2d6565a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce40f8ef40 1 --2- 172.21.15.55:0/876887396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 0x55d2d6567350 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce40f8ef40 1 -- 172.21.15.55:0/876887396 >> 172.21.15.55:0/876887396 conn(0x55d2d658f3d0 msgr2=0x55d2d65626c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce40f8ef40 1 -- 172.21.15.55:0/876887396 shutdown_connections 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.150+0000 7fce40f8ef40 1 -- 172.21.15.55:0/876887396 wait complete. 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.151+0000 7fce40f8ef40 1 Processor -- start 2024-04-25T08:56:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.151+0000 7fce40f8ef40 1 -- start start 2024-04-25T08:56:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.151+0000 7fce40f8ef40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 0x55d2d65626c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.151+0000 7fce40f8ef40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d2d6637b60 0x55d2d662af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.151+0000 7fce40f8ef40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2d663a5e0 0x55d2d663c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce40f8ef40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2d658ece0 con 0x55d2d6594880 2024-04-25T08:56:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce40f8ef40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2d6565f60 con 0x55d2d663a5e0 2024-04-25T08:56:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce40f8ef40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2d662ed20 con 0x55d2d6637b60 2024-04-25T08:56:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce3ea8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 0x55d2d65626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce3ea8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 0x55d2d65626c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41722/0 (socket says 172.21.15.55:41722) 2024-04-25T08:56:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce3ea8f640 1 -- 172.21.15.55:0/153942693 learned_addr learned my addr 172.21.15.55:0/153942693 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce3f290640 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2d663a5e0 0x55d2d663c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce3e28e640 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d2d6637b60 0x55d2d662af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce3ea8f640 1 -- 172.21.15.55:0/153942693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d2d6637b60 msgr2=0x55d2d662af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce3ea8f640 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d2d6637b60 0x55d2d662af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce3ea8f640 1 -- 172.21.15.55:0/153942693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2d663a5e0 msgr2=0x55d2d663c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce3ea8f640 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2d663a5e0 0x55d2d663c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce3ea8f640 1 -- 172.21.15.55:0/153942693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2d662f650 con 0x55d2d6594880 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce3ea8f640 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 0x55d2d65626c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fce38000c00 tx=0x7fce38000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce37fff640 1 -- 172.21.15.55:0/153942693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce38021030 con 0x55d2d6594880 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce37fff640 1 -- 172.21.15.55:0/153942693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3801c440 con 0x55d2d6594880 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce40f8ef40 1 -- 172.21.15.55:0/153942693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2d6632740 con 0x55d2d6594880 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce37fff640 1 -- 172.21.15.55:0/153942693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3801c650 con 0x55d2d6594880 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.152+0000 7fce40f8ef40 1 -- 172.21.15.55:0/153942693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2d662bc20 con 0x55d2d6594880 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.154+0000 7fce37fff640 1 -- 172.21.15.55:0/153942693 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce38024070 con 0x55d2d6594880 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.154+0000 7fce37fff640 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fce20069eb0 0x7fce2006c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.154+0000 7fce37fff640 1 -- 172.21.15.55:0/153942693 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce38089e90 con 0x55d2d6594880 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.154+0000 7fce3e28e640 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fce20069eb0 0x7fce2006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.154+0000 7fce40f8ef40 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55d2d6632280 0x55d2d66395d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.154+0000 7fce40f8ef40 1 -- 172.21.15.55:0/153942693 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61) v9 -- 0x55d2d6639b10 con 0x55d2d6632280 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.154+0000 7fce3e28e640 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fce20069eb0 0x7fce2006c370 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fce28057000 tx=0x7fce28052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce3f290640 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55d2d6632280 0x55d2d66395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce3f290640 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55d2d6632280 0x55d2d66395d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce3f290640 1 -- 172.21.15.55:0/153942693 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7fce3000d7e0 con 0x55d2d6632280 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce40f8ef40 1 -- 172.21.15.55:0/153942693 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55d2d6632280 msgr2=0x55d2d66395d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce40f8ef40 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55d2d6632280 0x55d2d66395d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce40f8ef40 1 -- 172.21.15.55:0/153942693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fce20069eb0 msgr2=0x7fce2006c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce40f8ef40 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fce20069eb0 0x7fce2006c370 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fce28057000 tx=0x7fce28052000 comp rx=0 tx=0).stop 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce40f8ef40 1 -- 172.21.15.55:0/153942693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 msgr2=0x55d2d65626c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce40f8ef40 1 --2- 172.21.15.55:0/153942693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d2d6594880 0x55d2d65626c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fce38000c00 tx=0x7fce38000ed0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce3f290640 1 -- 172.21.15.55:0/153942693 reap_dead start 2024-04-25T08:56:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce40f8ef40 1 -- 172.21.15.55:0/153942693 shutdown_connections 2024-04-25T08:56:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce40f8ef40 1 -- 172.21.15.55:0/153942693 >> 172.21.15.55:0/153942693 conn(0x55d2d658f3d0 msgr2=0x55d2d6636a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce40f8ef40 1 -- 172.21.15.55:0/153942693 shutdown_connections 2024-04-25T08:56:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.155+0000 7fce40f8ef40 1 -- 172.21.15.55:0/153942693 wait complete. 2024-04-25T08:56:29.150 INFO:teuthology.orchestra.run.smithi055.stdout:Xfiledir_test 2024-04-25T08:56:29.150 DEBUG:teuthology.orchestra.run.smithi055:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T08:56:29.236 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: "ancestors": [ 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1099511627776, 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "file", 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 2 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1, 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "dir_test", 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 4 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-25T08:56:29.237 INFO:teuthology.orchestra.run.smithi055.stdout: "pool": 9, 2024-04-25T08:56:29.238 INFO:teuthology.orchestra.run.smithi055.stdout: "old_pools": [] 2024-04-25T08:56:29.238 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:56:29.238 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:56:29.239 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-04-25T08:56:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.334+0000 7fe653828f40 1 Processor -- start 2024-04-25T08:56:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.334+0000 7fe653828f40 1 -- start start 2024-04-25T08:56:29.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe653828f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a20c2f6570 0x55a20c3924f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe653828f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 0x55a20c30ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe653828f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a20c39d6b0 0x55a20c2c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe653828f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a20c2f7530 con 0x55a20c39cd90 2024-04-25T08:56:29.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe653828f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a20c26fdf0 con 0x55a20c2f6570 2024-04-25T08:56:29.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe653828f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a20c2f77d0 con 0x55a20c39d6b0 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe650b28640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 0x55a20c30ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe650b28640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 0x55a20c30ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41734/0 (socket says 172.21.15.55:41734) 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe650b28640 1 -- 172.21.15.55:0/689014149 learned_addr learned my addr 172.21.15.55:0/689014149 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe651329640 1 --2- 172.21.15.55:0/689014149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a20c2f6570 0x55a20c3924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe651b2a640 1 --2- 172.21.15.55:0/689014149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a20c39d6b0 0x55a20c2c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe651329640 1 -- 172.21.15.55:0/689014149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a20c39d6b0 msgr2=0x55a20c2c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe651329640 1 --2- 172.21.15.55:0/689014149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a20c39d6b0 0x55a20c2c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe651329640 1 -- 172.21.15.55:0/689014149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 msgr2=0x55a20c30ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe651329640 1 --2- 172.21.15.55:0/689014149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 0x55a20c30ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe651329640 1 -- 172.21.15.55:0/689014149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a20c1f5c50 con 0x55a20c2f6570 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.335+0000 7fe651329640 1 --2- 172.21.15.55:0/689014149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a20c2f6570 0x55a20c3924f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe64c053000 tx=0x7fe64c04e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e0df142f27db8e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe64b7fe640 1 -- 172.21.15.55:0/689014149 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c059040 con 0x55a20c2f6570 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe64b7fe640 1 -- 172.21.15.55:0/689014149 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c00a250 con 0x55a20c2f6570 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe64b7fe640 1 -- 172.21.15.55:0/689014149 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c054a30 con 0x55a20c2f6570 2024-04-25T08:56:29.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe653828f40 1 -- 172.21.15.55:0/689014149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a20c2f6570 msgr2=0x55a20c3924f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe653828f40 1 --2- 172.21.15.55:0/689014149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a20c2f6570 0x55a20c3924f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe64c053000 tx=0x7fe64c04e000 comp rx=0 tx=0).stop 2024-04-25T08:56:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe653828f40 1 -- 172.21.15.55:0/689014149 shutdown_connections 2024-04-25T08:56:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe653828f40 1 --2- 172.21.15.55:0/689014149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a20c39d6b0 0x55a20c2c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe653828f40 1 --2- 172.21.15.55:0/689014149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 0x55a20c30ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe653828f40 1 --2- 172.21.15.55:0/689014149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a20c2f6570 0x55a20c3924f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe653828f40 1 -- 172.21.15.55:0/689014149 >> 172.21.15.55:0/689014149 conn(0x55a20c2f33d0 msgr2=0x55a20c3a0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe653828f40 1 -- 172.21.15.55:0/689014149 shutdown_connections 2024-04-25T08:56:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.336+0000 7fe653828f40 1 -- 172.21.15.55:0/689014149 wait complete. 2024-04-25T08:56:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.337+0000 7fe653828f40 1 Processor -- start 2024-04-25T08:56:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.337+0000 7fe653828f40 1 -- start start 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.337+0000 7fe653828f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a20c2f6570 0x55a20c39f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.337+0000 7fe653828f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 0x55a20c3935c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.337+0000 7fe653828f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a20c39d6b0 0x55a20c393b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.337+0000 7fe653828f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a20c392a30 con 0x55a20c39cd90 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.337+0000 7fe653828f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a20c2cb2d0 con 0x55a20c2f6570 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.337+0000 7fe653828f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a20c39c370 con 0x55a20c39d6b0 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe650b28640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 0x55a20c3935c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe650b28640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 0x55a20c3935c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41742/0 (socket says 172.21.15.55:41742) 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe650b28640 1 -- 172.21.15.55:0/1065212911 learned_addr learned my addr 172.21.15.55:0/1065212911 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe651329640 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a20c2f6570 0x55a20c39f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe651b2a640 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a20c39d6b0 0x55a20c393b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe650b28640 1 -- 172.21.15.55:0/1065212911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a20c39d6b0 msgr2=0x55a20c393b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe650b28640 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a20c39d6b0 0x55a20c393b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe650b28640 1 -- 172.21.15.55:0/1065212911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a20c2f6570 msgr2=0x55a20c39f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe650b28640 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a20c2f6570 0x55a20c39f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe650b28640 1 -- 172.21.15.55:0/1065212911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a20c39fc60 con 0x55a20c39cd90 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe650b28640 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 0x55a20c3935c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0086e0 tx=0x7fe63c0087d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe64a7fc640 1 -- 172.21.15.55:0/1065212911 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c019020 con 0x55a20c39cd90 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe64a7fc640 1 -- 172.21.15.55:0/1065212911 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c015880 con 0x55a20c39cd90 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe653828f40 1 -- 172.21.15.55:0/1065212911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a20c39ff10 con 0x55a20c39cd90 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe64a7fc640 1 -- 172.21.15.55:0/1065212911 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0054c0 con 0x55a20c39cd90 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.338+0000 7fe653828f40 1 -- 172.21.15.55:0/1065212911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a20c399b00 con 0x55a20c39cd90 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.340+0000 7fe64a7fc640 1 -- 172.21.15.55:0/1065212911 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe63c01c020 con 0x55a20c39cd90 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.340+0000 7fe64a7fc640 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe634069eb0 0x7fe63406c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.340+0000 7fe64a7fc640 1 -- 172.21.15.55:0/1065212911 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe63c089200 con 0x55a20c39cd90 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.340+0000 7fe651329640 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe634069eb0 0x7fe63406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.340+0000 7fe653828f40 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55a20c39b310 0x55a20c442b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.340+0000 7fe653828f40 1 -- 172.21.15.55:0/1065212911 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61) v9 -- 0x55a20c4430c0 con 0x55a20c39b310 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.341+0000 7fe651b2a640 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55a20c39b310 0x55a20c442b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.341+0000 7fe651329640 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe634069eb0 0x7fe63406c370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe64c061000 tx=0x7fe64c051000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.341+0000 7fe651b2a640 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55a20c39b310 0x55a20c442b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe651b2a640 1 -- 172.21.15.55:0/1065212911 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v61'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe644003530 con 0x55a20c39b310 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe653828f40 1 -- 172.21.15.55:0/1065212911 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55a20c39b310 msgr2=0x55a20c442b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe653828f40 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55a20c39b310 0x55a20c442b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe653828f40 1 -- 172.21.15.55:0/1065212911 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe634069eb0 msgr2=0x7fe63406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe653828f40 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe634069eb0 0x7fe63406c370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe64c061000 tx=0x7fe64c051000 comp rx=0 tx=0).stop 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe653828f40 1 -- 172.21.15.55:0/1065212911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 msgr2=0x55a20c3935c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe653828f40 1 --2- 172.21.15.55:0/1065212911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a20c39cd90 0x55a20c3935c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0086e0 tx=0x7fe63c0087d0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe651b2a640 1 -- 172.21.15.55:0/1065212911 reap_dead start 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe653828f40 1 -- 172.21.15.55:0/1065212911 shutdown_connections 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe653828f40 1 -- 172.21.15.55:0/1065212911 >> 172.21.15.55:0/1065212911 conn(0x55a20c2f33d0 msgr2=0x55a20c2c9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe653828f40 1 -- 172.21.15.55:0/1065212911 shutdown_connections 2024-04-25T08:56:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.342+0000 7fe653828f40 1 -- 172.21.15.55:0/1065212911 wait complete. 2024-04-25T08:56:29.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:29.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-04-25T08:56:29.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.453+0000 7f033675c640 1 Processor -- start 2024-04-25T08:56:29.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.454+0000 7f033675c640 1 -- start start 2024-04-25T08:56:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.454+0000 7f033675c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f033015dbe0 0x7f033015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.454+0000 7f033675c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f03300b5c80 0x7f0330161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.454+0000 7f033675c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03300b9980 con 0x7f03300d3580 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.454+0000 7f033675c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033015f210 con 0x7f03300b5c80 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.454+0000 7f033675c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03300ce140 con 0x7f033015dbe0 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.455+0000 7f032ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f033015dbe0 0x7f033015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.455+0000 7f0334cf9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f03300b5c80 0x7f0330161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.455+0000 7f032f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f03300d3580 0x7f03300b5570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58362/0 (socket says 172.21.15.55:58362) 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.455+0000 7f032f7fe640 1 -- 172.21.15.55:0/3448714566 learned_addr learned my addr 172.21.15.55:0/3448714566 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.455+0000 7f0334cf9640 1 -- 172.21.15.55:0/3448714566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f033015dbe0 msgr2=0x7f033015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.455+0000 7f0334cf9640 1 --2- 172.21.15.55:0/3448714566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f033015dbe0 0x7f033015ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.455+0000 7f0334cf9640 1 -- 172.21.15.55:0/3448714566 >> v1:172.21.15.167:6789/0 conn(0x7f03300d3580 legacy=0x7f03300b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.455+0000 7f0334cf9640 1 -- 172.21.15.55:0/3448714566 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03300ce420 con 0x7f03300b5c80 2024-04-25T08:56:29.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f0334cf9640 1 --2- 172.21.15.55:0/3448714566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03300b5c80 0x7f0330161800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f032802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a13a83558c2169c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f032effd640 1 -- 172.21.15.55:0/3448714566 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328007740 con 0x7f03300b5c80 2024-04-25T08:56:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f032effd640 1 -- 172.21.15.55:0/3448714566 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03280078e0 con 0x7f03300b5c80 2024-04-25T08:56:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f032effd640 1 -- 172.21.15.55:0/3448714566 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328007cb0 con 0x7f03300b5c80 2024-04-25T08:56:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f033675c640 1 -- 172.21.15.55:0/3448714566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03300b5c80 msgr2=0x7f0330161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f033675c640 1 --2- 172.21.15.55:0/3448714566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03300b5c80 0x7f0330161800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f032802a660 comp rx=0 tx=0).stop 2024-04-25T08:56:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f033675c640 1 -- 172.21.15.55:0/3448714566 shutdown_connections 2024-04-25T08:56:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f033675c640 1 --2- 172.21.15.55:0/3448714566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03300b5c80 0x7f0330161800 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f033675c640 1 --2- 172.21.15.55:0/3448714566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f033015dbe0 0x7f033015ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f033675c640 1 -- 172.21.15.55:0/3448714566 >> 172.21.15.55:0/3448714566 conn(0x7f0330072900 msgr2=0x7f03300d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f033675c640 1 -- 172.21.15.55:0/3448714566 shutdown_connections 2024-04-25T08:56:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.456+0000 7f033675c640 1 -- 172.21.15.55:0/3448714566 wait complete. 2024-04-25T08:56:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.458+0000 7f033675c640 1 Processor -- start 2024-04-25T08:56:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.458+0000 7f033675c640 1 -- start start 2024-04-25T08:56:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.458+0000 7f033675c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03300b5c80 0x7f03301500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f033675c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03300d3580 0x7f03300cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f033675c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033015dbe0 0x7f033015fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f033675c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033015dfc0 con 0x7f033015dbe0 2024-04-25T08:56:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f033675c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03300d3060 con 0x7f03300d3580 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f033675c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033015e140 con 0x7f03300b5c80 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f0334cf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033015dbe0 0x7f033015fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f032ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03300b5c80 0x7f03301500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f0334cf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033015dbe0 0x7f033015fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41746/0 (socket says 172.21.15.55:41746) 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f032f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03300d3580 0x7f03300cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f0334cf9640 1 -- 172.21.15.55:0/3150475234 learned_addr learned my addr 172.21.15.55:0/3150475234 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f032ffff640 1 -- 172.21.15.55:0/3150475234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03300d3580 msgr2=0x7f03300cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f032ffff640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03300d3580 0x7f03300cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f032ffff640 1 -- 172.21.15.55:0/3150475234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033015dbe0 msgr2=0x7f033015fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f032ffff640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033015dbe0 0x7f033015fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f032ffff640 1 -- 172.21.15.55:0/3150475234 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03300c90a0 con 0x7f03300b5c80 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f0334cf9640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033015dbe0 0x7f033015fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f032ffff640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03300b5c80 0x7f03301500e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f032000e870 tx=0x7f032000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f032cff9640 1 -- 172.21.15.55:0/3150475234 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320017070 con 0x7f03300b5c80 2024-04-25T08:56:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f032cff9640 1 -- 172.21.15.55:0/3150475234 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032000ee60 con 0x7f03300b5c80 2024-04-25T08:56:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.459+0000 7f033675c640 1 -- 172.21.15.55:0/3150475234 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03300c9380 con 0x7f03300b5c80 2024-04-25T08:56:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.460+0000 7f032cff9640 1 -- 172.21.15.55:0/3150475234 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032000cb60 con 0x7f03300b5c80 2024-04-25T08:56:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.460+0000 7f033675c640 1 -- 172.21.15.55:0/3150475234 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03300c9940 con 0x7f03300b5c80 2024-04-25T08:56:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.461+0000 7f032cff9640 1 -- 172.21.15.55:0/3150475234 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f032001a070 con 0x7f03300b5c80 2024-04-25T08:56:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.462+0000 7f032cff9640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f031c06b4d0 0x7f031c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.462+0000 7f032f7fe640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f031c06b4d0 0x7f031c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.462+0000 7f032cff9640 1 -- 172.21.15.55:0/3150475234 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f032008a390 con 0x7f03300b5c80 2024-04-25T08:56:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.462+0000 7f032f7fe640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f031c06b4d0 0x7f031c06d990 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f03300c8770 tx=0x7f0324009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.462+0000 7f0339463740 1 Processor -- start 2024-04-25T08:56:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f0339463740 1 -- start start 2024-04-25T08:56:29.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f0339463740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaedd080 0x5609aaedf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f0339463740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd460 0x5609aaedfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f0339463740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaeafce0 0x5609aaeb34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f0339463740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609aae18af0 con 0x5609aaeafce0 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f0339463740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609aadc1de0 con 0x5609aaedd080 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f0339463740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609aae14b90 con 0x5609aaedd460 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f0334cf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaeafce0 0x5609aaeb34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f0334cf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaeafce0 0x5609aaeb34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41750/0 (socket says 172.21.15.55:41750) 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f0334cf9640 1 -- 172.21.15.55:0/2449656417 learned_addr learned my addr 172.21.15.55:0/2449656417 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f032f7fe640 1 --2- 172.21.15.55:0/2449656417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd460 0x5609aaedfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.463+0000 7f032ffff640 1 --2- 172.21.15.55:0/2449656417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaedd080 0x5609aaedf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.464+0000 7f0334cf9640 1 -- 172.21.15.55:0/2449656417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd460 msgr2=0x5609aaedfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.464+0000 7f0334cf9640 1 --2- 172.21.15.55:0/2449656417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd460 0x5609aaedfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.464+0000 7f0334cf9640 1 -- 172.21.15.55:0/2449656417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaedd080 msgr2=0x5609aaedf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.464+0000 7f0334cf9640 1 --2- 172.21.15.55:0/2449656417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaedd080 0x5609aaedf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.464+0000 7f0334cf9640 1 -- 172.21.15.55:0/2449656417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609aabf97b0 con 0x5609aaeafce0 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.464+0000 7f032f7fe640 1 --2- 172.21.15.55:0/2449656417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd460 0x5609aaedfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.464+0000 7f0334cf9640 1 --2- 172.21.15.55:0/2449656417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaeafce0 0x5609aaeb34f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0328007ef0 tx=0x7f032802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b950989bcfad84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.464+0000 7f0315ffb640 1 -- 172.21.15.55:0/2449656417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328007880 con 0x5609aaeafce0 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.464+0000 7f0315ffb640 1 -- 172.21.15.55:0/2449656417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328045430 con 0x5609aaeafce0 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.464+0000 7f0315ffb640 1 -- 172.21.15.55:0/2449656417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03280457e0 con 0x5609aaeafce0 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.465+0000 7f0339463740 1 -- 172.21.15.55:0/2449656417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaeafce0 msgr2=0x5609aaeb34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.465+0000 7f0339463740 1 --2- 172.21.15.55:0/2449656417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaeafce0 0x5609aaeb34f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0328007ef0 tx=0x7f032802e000 comp rx=0 tx=0).stop 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.465+0000 7f0339463740 1 -- 172.21.15.55:0/2449656417 shutdown_connections 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.465+0000 7f0339463740 1 --2- 172.21.15.55:0/2449656417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaeafce0 0x5609aaeb34f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.465+0000 7f0339463740 1 --2- 172.21.15.55:0/2449656417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd460 0x5609aaedfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.465+0000 7f0339463740 1 --2- 172.21.15.55:0/2449656417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaedd080 0x5609aaedf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.465+0000 7f0339463740 1 -- 172.21.15.55:0/2449656417 >> 172.21.15.55:0/2449656417 conn(0x5609aaeb1f50 msgr2=0x5609aaefa890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.465+0000 7f0339463740 1 -- 172.21.15.55:0/2449656417 shutdown_connections 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.465+0000 7f0339463740 1 -- 172.21.15.55:0/2449656417 wait complete. 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.465+0000 7f0339463740 1 -- start start 2024-04-25T08:56:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.465+0000 7f0339463740 1 Processor -- start 2024-04-25T08:56:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f0339463740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd080 0x5609aaed93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f0339463740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaedd460 0x5609aaefdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f0339463740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaed7460 0x5609aaefe150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f0339463740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609aaeb5100 con 0x5609aaed7460 2024-04-25T08:56:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f0339463740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609aadb73e0 con 0x5609aaedd460 2024-04-25T08:56:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f0339463740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609aaeb53e0 con 0x5609aaedd080 2024-04-25T08:56:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f0339463740 10 client.0 _ll_register_callbacks cb 0x5609aadd4d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f0334cf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaed7460 0x5609aaefe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f0334cf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaed7460 0x5609aaefe150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41754/0 (socket says 172.21.15.55:41754) 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f0334cf9640 1 -- 172.21.15.55:0/3700554620 learned_addr learned my addr 172.21.15.55:0/3700554620 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f032f7fe640 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaedd460 0x5609aaefdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.466+0000 7f032ffff640 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd080 0x5609aaed93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0334cf9640 1 -- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd080 msgr2=0x5609aaed93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0334cf9640 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd080 0x5609aaed93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0334cf9640 1 -- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaedd460 msgr2=0x5609aaefdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0334cf9640 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaedd460 0x5609aaefdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0334cf9640 1 -- 172.21.15.55:0/3700554620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609aac59f40 con 0x5609aaed7460 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0334cf9640 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaed7460 0x5609aaefe150 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f0328004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc0f4f563232cd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f030effd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f030effd640 1 -- 172.21.15.55:0/3700554620 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328004240 con 0x5609aaed7460 2024-04-25T08:56:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f030effd640 1 -- 172.21.15.55:0/3700554620 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03280043e0 con 0x5609aaed7460 2024-04-25T08:56:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0339463740 1 -- 172.21.15.55:0/3700554620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0328045430 con 0x5609aaed7460 2024-04-25T08:56:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f030effd640 1 -- 172.21.15.55:0/3700554620 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0328059050 con 0x5609aaed7460 2024-04-25T08:56:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0339463740 10 client.6264 fetch_fsmap learned FSMap version 28 2024-04-25T08:56:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0339463740 1 -- 172.21.15.55:0/3700554620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x5609aaaed0a0 con 0x5609aaed7460 2024-04-25T08:56:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f030effd640 1 -- 172.21.15.55:0/3700554620 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328045430 con 0x5609aaed7460 2024-04-25T08:56:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f030effd640 1 -- 172.21.15.55:0/3700554620 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f032805c020 con 0x5609aaed7460 2024-04-25T08:56:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0339463740 10 client.6264 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T08:56:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0339463740 10 client.6264 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:56:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0339463740 20 client.6264 populate_metadata read hostname 'smithi055' 2024-04-25T08:56:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0339463740 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5609aaed98e0 0x5609aaed8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0339463740 4 client.6264 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:56:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.467+0000 7f0339463740 1 -- 172.21.15.55:0/3700554620 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609aae26030 con 0x5609aaed98e0 2024-04-25T08:56:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.468+0000 7f032ffff640 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5609aaed98e0 0x5609aaed8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.468+0000 7f032ffff640 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5609aaed98e0 0x5609aaed8650 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49bbc92868393170 server_cookie=8b1cc6c0f0089107 in_seq=0 out_seq=0 2024-04-25T08:56:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.468+0000 7f030effd640 10 client.6264 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f030effd640 1 -- 172.21.15.55:0/3700554620 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7f0320087a90 con 0x5609aaed98e0 2024-04-25T08:56:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f030effd640 10 client.6264 handle_command_reply: tid=0 2024-04-25T08:56:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 1 client.6264 shutdown 2024-04-25T08:56:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 1 -- 172.21.15.55:0/3700554620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaed7460 msgr2=0x5609aaefe150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaed7460 0x5609aaefe150 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f0328004ab0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 1 -- 172.21.15.55:0/3700554620 shutdown_connections 2024-04-25T08:56:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5609aaed98e0 0x5609aaed8650 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaed7460 0x5609aaefe150 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaedd460 0x5609aaefdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f030effd640 0 client.6264 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 1 --2- 172.21.15.55:0/3700554620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd080 0x5609aaed93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 1 -- 172.21.15.55:0/3700554620 >> 172.21.15.55:0/3700554620 conn(0x5609aaeafce0 msgr2=0x5609aaedc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 1 -- 172.21.15.55:0/3700554620 shutdown_connections 2024-04-25T08:56:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 1 -- 172.21.15.55:0/3700554620 wait complete. 2024-04-25T08:56:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.469+0000 7f0339463740 20 client.6264 trim_cache size 0 max 16384 2024-04-25T08:56:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.484+0000 7f0339463740 1 Processor -- start 2024-04-25T08:56:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.484+0000 7f0339463740 1 -- start start 2024-04-25T08:56:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f0339463740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaed7460 0x5609aaee3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f0339463740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd080 0x5609aaeaecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f0339463740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd460 0x5609aaeb34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f0339463740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03301fff50 con 0x5609aaedd080 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f0339463740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03301e7bd0 con 0x5609aaed7460 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f0339463740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03301e6fd0 con 0x5609aaedd460 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f032f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd080 0x5609aaeaecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f032f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd080 0x5609aaeaecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41758/0 (socket says 172.21.15.55:41758) 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f032f7fe640 1 -- 172.21.15.55:0/3031789116 learned_addr learned my addr 172.21.15.55:0/3031789116 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f032ffff640 1 --2- 172.21.15.55:0/3031789116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaed7460 0x5609aaee3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f0334cf9640 1 --2- 172.21.15.55:0/3031789116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd460 0x5609aaeb34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f032f7fe640 1 -- 172.21.15.55:0/3031789116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd460 msgr2=0x5609aaeb34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f032f7fe640 1 --2- 172.21.15.55:0/3031789116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd460 0x5609aaeb34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f032f7fe640 1 -- 172.21.15.55:0/3031789116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaed7460 msgr2=0x5609aaee3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f032f7fe640 1 --2- 172.21.15.55:0/3031789116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaed7460 0x5609aaee3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.485+0000 7f032f7fe640 1 -- 172.21.15.55:0/3031789116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609aaeb5a90 con 0x5609aaedd080 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f032f7fe640 1 --2- 172.21.15.55:0/3031789116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd080 0x5609aaeaecf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0324000f60 tx=0x7f0324012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fe029e94c63561 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f03157fa640 1 -- 172.21.15.55:0/3031789116 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324014c20 con 0x5609aaedd080 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f03157fa640 1 -- 172.21.15.55:0/3031789116 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0324028070 con 0x5609aaedd080 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f03157fa640 1 -- 172.21.15.55:0/3031789116 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324023480 con 0x5609aaedd080 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f0339463740 1 -- 172.21.15.55:0/3031789116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd080 msgr2=0x5609aaeaecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f0339463740 1 --2- 172.21.15.55:0/3031789116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd080 0x5609aaeaecf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0324000f60 tx=0x7f0324012000 comp rx=0 tx=0).stop 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f0339463740 1 -- 172.21.15.55:0/3031789116 shutdown_connections 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f0339463740 1 --2- 172.21.15.55:0/3031789116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd460 0x5609aaeb34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f0339463740 1 --2- 172.21.15.55:0/3031789116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd080 0x5609aaeaecf0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f0339463740 1 --2- 172.21.15.55:0/3031789116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaed7460 0x5609aaee3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f0339463740 1 -- 172.21.15.55:0/3031789116 >> 172.21.15.55:0/3031789116 conn(0x5609aaeafce0 msgr2=0x5609aaf1d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f0339463740 1 -- 172.21.15.55:0/3031789116 shutdown_connections 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.486+0000 7f0339463740 1 -- 172.21.15.55:0/3031789116 wait complete. 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.487+0000 7f0339463740 1 -- start start 2024-04-25T08:56:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.487+0000 7f0339463740 1 Processor -- start 2024-04-25T08:56:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0339463740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaed7460 0x5609aaef6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0339463740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd080 0x5609aaed5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0339463740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd460 0x5609aaf14b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0339463740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609aaedabe0 con 0x5609aaedd460 2024-04-25T08:56:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0339463740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03301e75d0 con 0x5609aaed7460 2024-04-25T08:56:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0339463740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609aaeb00c0 con 0x5609aaedd080 2024-04-25T08:56:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0339463740 10 client.0 _ll_register_callbacks cb 0x7f0324007d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:56:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0334cf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd460 0x5609aaf14b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0334cf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd460 0x5609aaf14b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41766/0 (socket says 172.21.15.55:41766) 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0334cf9640 1 -- 172.21.15.55:0/2671685397 learned_addr learned my addr 172.21.15.55:0/2671685397 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f032ffff640 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaed7460 0x5609aaef6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f032f7fe640 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd080 0x5609aaed5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0334cf9640 1 -- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd080 msgr2=0x5609aaed5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0334cf9640 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd080 0x5609aaed5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0334cf9640 1 -- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaed7460 msgr2=0x5609aaef6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0334cf9640 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaed7460 0x5609aaef6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0334cf9640 1 -- 172.21.15.55:0/2671685397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609aaf150b0 con 0x5609aaedd460 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f0334cf9640 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd460 0x5609aaf14b70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f032802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd04218060927fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.488+0000 7f030effd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f030effd640 1 -- 172.21.15.55:0/2671685397 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328045630 con 0x5609aaedd460 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f030effd640 1 -- 172.21.15.55:0/2671685397 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03280457d0 con 0x5609aaedd460 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f0339463740 1 -- 172.21.15.55:0/2671685397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0324028070 con 0x5609aaedd460 2024-04-25T08:56:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f030effd640 1 -- 172.21.15.55:0/2671685397 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0328067050 con 0x5609aaedd460 2024-04-25T08:56:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f0339463740 10 client.6270 fetch_fsmap learned FSMap version 28 2024-04-25T08:56:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f0339463740 1 -- 172.21.15.55:0/2671685397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x5609aaeb0ed0 con 0x5609aaedd460 2024-04-25T08:56:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f030effd640 1 -- 172.21.15.55:0/2671685397 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0324028070 con 0x5609aaedd460 2024-04-25T08:56:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f030effd640 1 -- 172.21.15.55:0/2671685397 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f032806a020 con 0x5609aaedd460 2024-04-25T08:56:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f0339463740 10 client.6270 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T08:56:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f0339463740 10 client.6270 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:56:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f0339463740 20 client.6270 populate_metadata read hostname 'smithi055' 2024-04-25T08:56:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f0339463740 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5609aaf0d1c0 0x5609aaf0d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f0339463740 4 client.6270 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-04-25T08:56:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f0339463740 1 -- 172.21.15.55:0/2671685397 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x5609aae20380 con 0x5609aaf0d1c0 2024-04-25T08:56:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.489+0000 7f032ffff640 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5609aaf0d1c0 0x5609aaf0d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.490+0000 7f030effd640 10 client.6270 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.490+0000 7f032ffff640 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5609aaf0d1c0 0x5609aaf0d5d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b12761045c0a1bb5 server_cookie=dfb2001b3f859065 in_seq=0 out_seq=0 2024-04-25T08:56:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.490+0000 7f030effd640 1 -- 172.21.15.55:0/2671685397 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5609aae20380 con 0x5609aaf0d1c0 2024-04-25T08:56:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.490+0000 7f030effd640 10 client.6270 handle_command_reply: tid=0 2024-04-25T08:56:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.490+0000 7f0339463740 1 client.6270 shutdown 2024-04-25T08:56:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f0339463740 1 -- 172.21.15.55:0/2671685397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd460 msgr2=0x5609aaf14b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f0339463740 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd460 0x5609aaf14b70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f032802f000 comp rx=0 tx=0).stop 2024-04-25T08:56:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f0339463740 1 -- 172.21.15.55:0/2671685397 shutdown_connections 2024-04-25T08:56:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f0339463740 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5609aaf0d1c0 0x5609aaf0d5d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f0339463740 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5609aaedd460 0x5609aaf14b70 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f0339463740 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609aaedd080 0x5609aaed5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f030effd640 0 client.6270 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f0339463740 1 --2- 172.21.15.55:0/2671685397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609aaed7460 0x5609aaef6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f0339463740 1 -- 172.21.15.55:0/2671685397 >> 172.21.15.55:0/2671685397 conn(0x5609aaeafce0 msgr2=0x5609aaef7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f0339463740 1 -- 172.21.15.55:0/2671685397 shutdown_connections 2024-04-25T08:56:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f0339463740 1 -- 172.21.15.55:0/2671685397 wait complete. 2024-04-25T08:56:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f0339463740 20 client.6270 trim_cache size 0 max 16384 2024-04-25T08:56:29.487 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:56:29.487 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-25T08:56:29.487 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "092b04fc-55d8-4b1e-b360-f5bddc929d40", 2024-04-25T08:56:29.487 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-25T08:56:29.487 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f033675c640 1 -- 172.21.15.55:0/3150475234 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f031c06b4d0 msgr2=0x7f031c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f033675c640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f031c06b4d0 0x7f031c06d990 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f03300c8770 tx=0x7f0324009040 comp rx=0 tx=0).stop 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f033675c640 1 -- 172.21.15.55:0/3150475234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03300b5c80 msgr2=0x7f03301500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f033675c640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03300b5c80 0x7f03301500e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f032000e870 tx=0x7f032000ed30 comp rx=0 tx=0).stop 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f033675c640 1 -- 172.21.15.55:0/3150475234 shutdown_connections 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f033675c640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f031c06b4d0 0x7f031c06d990 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f033675c640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033015dbe0 0x7f033015fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f033675c640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03300d3580 0x7f03300cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f033675c640 1 --2- 172.21.15.55:0/3150475234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03300b5c80 0x7f03301500e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.491+0000 7f033675c640 1 -- 172.21.15.55:0/3150475234 >> 172.21.15.55:0/3150475234 conn(0x7f0330072900 msgr2=0x7f03300b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.492+0000 7f033675c640 1 -- 172.21.15.55:0/3150475234 shutdown_connections 2024-04-25T08:56:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.492+0000 7f033675c640 1 -- 172.21.15.55:0/3150475234 wait complete. 2024-04-25T08:56:29.489 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-04-25T08:56:29.491+0000 7fb0c57d1640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6228=0-4194304@1} caps={6228=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6228 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x561e1b8e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T08:56:29.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:29.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T08:56:29.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.606+0000 7effde807640 1 Processor -- start 2024-04-25T08:56:29.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.606+0000 7effde807640 1 -- start start 2024-04-25T08:56:29.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.606+0000 7effde807640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7effd815bbe0 0x7effd80cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.606+0000 7effde807640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effd80d0610 0x7effd80cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.606+0000 7effde807640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd80cc830 con 0x7effd80cf510 2024-04-25T08:56:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.606+0000 7effde807640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd80ccb10 con 0x7effd815bbe0 2024-04-25T08:56:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.606+0000 7effde807640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd80ccdf0 con 0x7effd80d0610 2024-04-25T08:56:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.607+0000 7effdcda4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effd80d0610 0x7effd80cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.607+0000 7effd7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7effd815bbe0 0x7effd80cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.607+0000 7effd77fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7effd80cf510 0x7effd80cff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:58368/0 (socket says 172.21.15.55:58368) 2024-04-25T08:56:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.607+0000 7effd77fe640 1 -- 172.21.15.55:0/1201573016 learned_addr learned my addr 172.21.15.55:0/1201573016 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.607+0000 7effd7fff640 1 -- 172.21.15.55:0/1201573016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effd80d0610 msgr2=0x7effd80cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.607+0000 7effd7fff640 1 --2- 172.21.15.55:0/1201573016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effd80d0610 0x7effd80cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.607+0000 7effd7fff640 1 -- 172.21.15.55:0/1201573016 >> v1:172.21.15.167:6789/0 conn(0x7effd80cf510 legacy=0x7effd80cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.607+0000 7effd7fff640 1 -- 172.21.15.55:0/1201573016 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd80cd0d0 con 0x7effd815bbe0 2024-04-25T08:56:29.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.608+0000 7effd7fff640 1 --2- 172.21.15.55:0/1201573016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effd815bbe0 0x7effd80cd8d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7effc80097a0 tx=0x7effc802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8192b522871b53ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.608+0000 7effd6ffd640 1 -- 172.21.15.55:0/1201573016 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8037070 con 0x7effd815bbe0 2024-04-25T08:56:29.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.608+0000 7effd6ffd640 1 -- 172.21.15.55:0/1201573016 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc802ad10 con 0x7effd815bbe0 2024-04-25T08:56:29.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.608+0000 7effd6ffd640 1 -- 172.21.15.55:0/1201573016 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8032660 con 0x7effd815bbe0 2024-04-25T08:56:29.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.608+0000 7effde807640 1 -- 172.21.15.55:0/1201573016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effd815bbe0 msgr2=0x7effd80cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.608+0000 7effde807640 1 --2- 172.21.15.55:0/1201573016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effd815bbe0 0x7effd80cd8d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7effc80097a0 tx=0x7effc802a080 comp rx=0 tx=0).stop 2024-04-25T08:56:29.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.609+0000 7effde807640 1 -- 172.21.15.55:0/1201573016 shutdown_connections 2024-04-25T08:56:29.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.609+0000 7effde807640 1 --2- 172.21.15.55:0/1201573016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effd80d0610 0x7effd80cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.609+0000 7effde807640 1 --2- 172.21.15.55:0/1201573016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effd815bbe0 0x7effd80cd8d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.609+0000 7effde807640 1 -- 172.21.15.55:0/1201573016 >> 172.21.15.55:0/1201573016 conn(0x7effd80b3430 msgr2=0x7effd80b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.609+0000 7effde807640 1 -- 172.21.15.55:0/1201573016 shutdown_connections 2024-04-25T08:56:29.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.609+0000 7effde807640 1 -- 172.21.15.55:0/1201573016 wait complete. 2024-04-25T08:56:29.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.610+0000 7effde807640 1 Processor -- start 2024-04-25T08:56:29.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.610+0000 7effde807640 1 -- start start 2024-04-25T08:56:29.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effde807640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd80cf510 0x7effd809ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effde807640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effd80d0610 0x7effd80cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effde807640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effd815bbe0 0x7effd80cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effde807640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd80cde10 con 0x7effd80cf510 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effde807640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd815bfc0 con 0x7effd80d0610 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effde807640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd80cc450 con 0x7effd815bbe0 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd80cf510 0x7effd809ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd80cf510 0x7effd809ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41772/0 (socket says 172.21.15.55:41772) 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd7fff640 1 -- 172.21.15.55:0/1253871188 learned_addr learned my addr 172.21.15.55:0/1253871188 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effdcda4640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effd815bbe0 0x7effd80cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd77fe640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effd80d0610 0x7effd80cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd7fff640 1 -- 172.21.15.55:0/1253871188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effd815bbe0 msgr2=0x7effd80cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd7fff640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effd815bbe0 0x7effd80cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd7fff640 1 -- 172.21.15.55:0/1253871188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effd80d0610 msgr2=0x7effd80cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd7fff640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effd80d0610 0x7effd80cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd7fff640 1 -- 172.21.15.55:0/1253871188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd815d880 con 0x7effd80cf510 2024-04-25T08:56:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effdcda4640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effd815bbe0 0x7effd80cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd77fe640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effd80d0610 0x7effd80cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd7fff640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd80cf510 0x7effd809ec00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7effc8035040 tx=0x7effc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd4ff9640 1 -- 172.21.15.55:0/1253871188 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8041030 con 0x7effd80cf510 2024-04-25T08:56:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd4ff9640 1 -- 172.21.15.55:0/1253871188 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc802ab10 con 0x7effd80cf510 2024-04-25T08:56:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effd4ff9640 1 -- 172.21.15.55:0/1253871188 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8037040 con 0x7effd80cf510 2024-04-25T08:56:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effde807640 1 -- 172.21.15.55:0/1253871188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd80c8bb0 con 0x7effd80cf510 2024-04-25T08:56:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.611+0000 7effde807640 1 -- 172.21.15.55:0/1253871188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd809f140 con 0x7effd80cf510 2024-04-25T08:56:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.613+0000 7effd4ff9640 1 -- 172.21.15.55:0/1253871188 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effc8044070 con 0x7effd80cf510 2024-04-25T08:56:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.613+0000 7effd4ff9640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effb806b4d0 0x7effb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.613+0000 7effd4ff9640 1 -- 172.21.15.55:0/1253871188 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effc80aa310 con 0x7effd80cf510 2024-04-25T08:56:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.614+0000 7effd77fe640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effb806b4d0 0x7effb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.614+0000 7effd77fe640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effb806b4d0 0x7effb806d990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7effd809f650 tx=0x7effc0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.614+0000 7effe15e1740 1 Processor -- start 2024-04-25T08:56:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.614+0000 7effe15e1740 1 -- start start 2024-04-25T08:56:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.615+0000 7effe15e1740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31b10 0x5597b7e34320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.615+0000 7effe15e1740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e34860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.615+0000 7effe15e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e04770 0x5597b7e07f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.615+0000 7effe15e1740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b7d6dda0 con 0x5597b7e31ef0 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.615+0000 7effe15e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b7d16b80 con 0x5597b7e04770 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.615+0000 7effe15e1740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597b7d69e40 con 0x5597b7e31b10 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.615+0000 7effd77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e34860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.615+0000 7effd77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e34860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41778/0 (socket says 172.21.15.55:41778) 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.615+0000 7effd77fe640 1 -- 172.21.15.55:0/3424507009 learned_addr learned my addr 172.21.15.55:0/3424507009 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.615+0000 7effd7fff640 1 --2- 172.21.15.55:0/3424507009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31b10 0x5597b7e34320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.615+0000 7effdcda4640 1 --2- 172.21.15.55:0/3424507009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e04770 0x5597b7e07f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effd77fe640 1 -- 172.21.15.55:0/3424507009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31b10 msgr2=0x5597b7e34320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effd77fe640 1 --2- 172.21.15.55:0/3424507009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31b10 0x5597b7e34320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effd77fe640 1 -- 172.21.15.55:0/3424507009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e04770 msgr2=0x5597b7e07f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effd77fe640 1 --2- 172.21.15.55:0/3424507009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e04770 0x5597b7e07f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effd77fe640 1 -- 172.21.15.55:0/3424507009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597b7d20f10 con 0x5597b7e31ef0 2024-04-25T08:56:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effd77fe640 1 --2- 172.21.15.55:0/3424507009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e34860 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7effc00074c0 tx=0x7effc0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29673a7c4ac5099c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effcdffb640 1 -- 172.21.15.55:0/3424507009 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000dcc0 con 0x5597b7e31ef0 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effcdffb640 1 -- 172.21.15.55:0/3424507009 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc000de60 con 0x5597b7e31ef0 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effcdffb640 1 -- 172.21.15.55:0/3424507009 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0020690 con 0x5597b7e31ef0 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effe15e1740 1 -- 172.21.15.55:0/3424507009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 msgr2=0x5597b7e34860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effe15e1740 1 --2- 172.21.15.55:0/3424507009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e34860 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7effc00074c0 tx=0x7effc0010000 comp rx=0 tx=0).stop 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effe15e1740 1 -- 172.21.15.55:0/3424507009 shutdown_connections 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effe15e1740 1 --2- 172.21.15.55:0/3424507009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e04770 0x5597b7e07f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effe15e1740 1 --2- 172.21.15.55:0/3424507009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e34860 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.616+0000 7effe15e1740 1 --2- 172.21.15.55:0/3424507009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31b10 0x5597b7e34320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.617+0000 7effe15e1740 1 -- 172.21.15.55:0/3424507009 >> 172.21.15.55:0/3424507009 conn(0x5597b7e069e0 msgr2=0x5597b7e4f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.617+0000 7effe15e1740 1 -- 172.21.15.55:0/3424507009 shutdown_connections 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.617+0000 7effe15e1740 1 -- 172.21.15.55:0/3424507009 wait complete. 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.617+0000 7effe15e1740 1 -- start start 2024-04-25T08:56:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.617+0000 7effe15e1740 1 Processor -- start 2024-04-25T08:56:29.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effe15e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e31b10 0x5597b7e53aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effe15e1740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31ef0 0x5597b7e351f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effe15e1740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e21c50 0x5597b7e37860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effe15e1740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b7e09b90 con 0x5597b7e21c50 2024-04-25T08:56:29.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effe15e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b7d0c4b0 con 0x5597b7e31b10 2024-04-25T08:56:29.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effe15e1740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597b7e09e70 con 0x5597b7e31ef0 2024-04-25T08:56:29.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effe15e1740 10 client.0 _ll_register_callbacks cb 0x5597b7d4c180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:56:29.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effdcda4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e21c50 0x5597b7e37860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effdcda4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e21c50 0x5597b7e37860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41784/0 (socket says 172.21.15.55:41784) 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effdcda4640 1 -- 172.21.15.55:0/727011970 learned_addr learned my addr 172.21.15.55:0/727011970 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effd7fff640 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e31b10 0x5597b7e53aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.618+0000 7effd77fe640 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31ef0 0x5597b7e351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effdcda4640 1 -- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31ef0 msgr2=0x5597b7e351f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effdcda4640 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31ef0 0x5597b7e351f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effdcda4640 1 -- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e31b10 msgr2=0x5597b7e53aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effdcda4640 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e31b10 0x5597b7e53aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effdcda4640 1 -- 172.21.15.55:0/727011970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597b7b4c7d0 con 0x5597b7e21c50 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effd7fff640 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e31b10 0x5597b7e53aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effdcda4640 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e21c50 0x5597b7e37860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7effd0007d70 tx=0x7effd0012610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79289160c85b271 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effb6ffd640 1 -- 172.21.15.55:0/727011970 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd001c020 con 0x5597b7e21c50 2024-04-25T08:56:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effb6ffd640 1 -- 172.21.15.55:0/727011970 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effd0018670 con 0x5597b7e21c50 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effe15e1740 1 -- 172.21.15.55:0/727011970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7effc000de60 con 0x5597b7e21c50 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effb6ffd640 1 -- 172.21.15.55:0/727011970 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7effd0026050 con 0x5597b7e21c50 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effe15e1740 10 client.6279 fetch_fsmap learned FSMap version 28 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effe15e1740 1 -- 172.21.15.55:0/727011970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x5597b7a823f0 con 0x5597b7e21c50 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effb6ffd640 1 -- 172.21.15.55:0/727011970 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc000de60 con 0x5597b7e21c50 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effb6ffd640 1 -- 172.21.15.55:0/727011970 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7effd0029020 con 0x5597b7e21c50 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effe15e1740 10 client.6279 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effe15e1740 10 client.6279 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effe15e1740 20 client.6279 populate_metadata read hostname 'smithi055' 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effe15e1740 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5597b7e30080 0x5597b7e304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effe15e1740 4 client.6279 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.619+0000 7effe15e1740 1 -- 172.21.15.55:0/727011970 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597b7d7b2e0 con 0x5597b7e30080 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.620+0000 7effd7fff640 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5597b7e30080 0x5597b7e304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.620+0000 7effb6ffd640 10 client.6279 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.620+0000 7effd7fff640 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5597b7e30080 0x5597b7e304b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e56f7dc55f99e76c server_cookie=e639f02db2aa73f1 in_seq=0 out_seq=0 2024-04-25T08:56:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effb6ffd640 1 -- 172.21.15.55:0/727011970 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5597b7d7b2e0 con 0x5597b7e30080 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effb6ffd640 10 client.6279 handle_command_reply: tid=0 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 1 client.6279 shutdown 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 1 -- 172.21.15.55:0/727011970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e21c50 msgr2=0x5597b7e37860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e21c50 0x5597b7e37860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7effd0007d70 tx=0x7effd0012610 comp rx=0 tx=0).stop 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 1 -- 172.21.15.55:0/727011970 shutdown_connections 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5597b7e30080 0x5597b7e304b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e21c50 0x5597b7e37860 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31ef0 0x5597b7e351f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effb6ffd640 0 client.6279 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 1 --2- 172.21.15.55:0/727011970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e31b10 0x5597b7e53aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 1 -- 172.21.15.55:0/727011970 >> 172.21.15.55:0/727011970 conn(0x5597b7e04770 msgr2=0x5597b7e05400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 1 -- 172.21.15.55:0/727011970 shutdown_connections 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 1 -- 172.21.15.55:0/727011970 wait complete. 2024-04-25T08:56:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.621+0000 7effe15e1740 20 client.6279 trim_cache size 0 max 16384 2024-04-25T08:56:29.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.636+0000 7effe15e1740 1 Processor -- start 2024-04-25T08:56:29.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.636+0000 7effe15e1740 1 -- start start 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effe15e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 0x5597b7e37250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effe15e1740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31b10 0x5597b7e37790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effe15e1740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e61020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effe15e1740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd81ffed0 con 0x5597b7e31ef0 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effe15e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd81ff090 con 0x5597b7e21c50 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effe15e1740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd81fe4f0 con 0x5597b7e31b10 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effdcda4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e61020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effdcda4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e61020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41798/0 (socket says 172.21.15.55:41798) 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effdcda4640 1 -- 172.21.15.55:0/162973640 learned_addr learned my addr 172.21.15.55:0/162973640 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effd7fff640 1 --2- 172.21.15.55:0/162973640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 0x5597b7e37250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effd77fe640 1 --2- 172.21.15.55:0/162973640 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31b10 0x5597b7e37790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effdcda4640 1 -- 172.21.15.55:0/162973640 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31b10 msgr2=0x5597b7e37790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effdcda4640 1 --2- 172.21.15.55:0/162973640 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31b10 0x5597b7e37790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effdcda4640 1 -- 172.21.15.55:0/162973640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 msgr2=0x5597b7e37250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effdcda4640 1 --2- 172.21.15.55:0/162973640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 0x5597b7e37250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effdcda4640 1 -- 172.21.15.55:0/162973640 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597b7a420f0 con 0x5597b7e31ef0 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effd7fff640 1 --2- 172.21.15.55:0/162973640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 0x5597b7e37250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.637+0000 7effd77fe640 1 --2- 172.21.15.55:0/162973640 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31b10 0x5597b7e37790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.638+0000 7effdcda4640 1 --2- 172.21.15.55:0/162973640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e61020 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7effd0009310 tx=0x7effd0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e0f4652616ab43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.638+0000 7effcd7fa640 1 -- 172.21.15.55:0/162973640 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd001c070 con 0x5597b7e31ef0 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.638+0000 7effcd7fa640 1 -- 172.21.15.55:0/162973640 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd0018690 con 0x5597b7e31ef0 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.638+0000 7effcd7fa640 1 -- 172.21.15.55:0/162973640 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0018bf0 con 0x5597b7e31ef0 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.638+0000 7effe15e1740 1 -- 172.21.15.55:0/162973640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 msgr2=0x5597b7e61020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.638+0000 7effe15e1740 1 --2- 172.21.15.55:0/162973640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e61020 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7effd0009310 tx=0x7effd0018000 comp rx=0 tx=0).stop 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.638+0000 7effe15e1740 1 -- 172.21.15.55:0/162973640 shutdown_connections 2024-04-25T08:56:29.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.638+0000 7effe15e1740 1 --2- 172.21.15.55:0/162973640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31ef0 0x5597b7e61020 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.638+0000 7effe15e1740 1 --2- 172.21.15.55:0/162973640 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31b10 0x5597b7e37790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.638+0000 7effe15e1740 1 --2- 172.21.15.55:0/162973640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 0x5597b7e37250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.639+0000 7effe15e1740 1 -- 172.21.15.55:0/162973640 >> 172.21.15.55:0/162973640 conn(0x5597b7e04770 msgr2=0x5597b7e342e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.639+0000 7effe15e1740 1 -- 172.21.15.55:0/162973640 shutdown_connections 2024-04-25T08:56:29.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.639+0000 7effe15e1740 1 -- 172.21.15.55:0/162973640 wait complete. 2024-04-25T08:56:29.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.639+0000 7effe15e1740 1 -- start start 2024-04-25T08:56:29.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.639+0000 7effe15e1740 1 Processor -- start 2024-04-25T08:56:29.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effe15e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 0x5597b7e20430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effe15e1740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31b10 0x5597b7eb9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effe15e1740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31ef0 0x5597b7e36df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effe15e1740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd81feac0 con 0x5597b7e31b10 2024-04-25T08:56:29.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effe15e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597b7e31760 con 0x5597b7e21c50 2024-04-25T08:56:29.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effe15e1740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597b7e61d90 con 0x5597b7e31ef0 2024-04-25T08:56:29.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effe15e1740 10 client.0 _ll_register_callbacks cb 0x7effc0007e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:56:29.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effd77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31b10 0x5597b7eb9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effd77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31b10 0x5597b7eb9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41810/0 (socket says 172.21.15.55:41810) 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effd77fe640 1 -- 172.21.15.55:0/393038574 learned_addr learned my addr 172.21.15.55:0/393038574 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effdcda4640 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31ef0 0x5597b7e36df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effd7fff640 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 0x5597b7e20430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effd77fe640 1 -- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31ef0 msgr2=0x5597b7e36df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effd77fe640 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31ef0 0x5597b7e36df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effd77fe640 1 -- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 msgr2=0x5597b7e20430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effd77fe640 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 0x5597b7e20430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.640+0000 7effd77fe640 1 -- 172.21.15.55:0/393038574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597b7e53a50 con 0x5597b7e31b10 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effdcda4640 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31ef0 0x5597b7e36df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effd7fff640 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 0x5597b7e20430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effd77fe640 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31b10 0x5597b7eb9300 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7effc0000f60 tx=0x7effc0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5472f00bba10e4b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:56:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effb6ffd640 1 -- 172.21.15.55:0/393038574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0031060 con 0x5597b7e31b10 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effb6ffd640 1 -- 172.21.15.55:0/393038574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effc0020660 con 0x5597b7e31b10 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effe15e1740 1 -- 172.21.15.55:0/393038574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7effd0018690 con 0x5597b7e31b10 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effb6ffd640 1 -- 172.21.15.55:0/393038574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7effc0037050 con 0x5597b7e31b10 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effe15e1740 10 client.6285 fetch_fsmap learned FSMap version 28 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effe15e1740 1 -- 172.21.15.55:0/393038574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x5597b7e45d50 con 0x5597b7e31b10 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effb6ffd640 1 -- 172.21.15.55:0/393038574 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd0018690 con 0x5597b7e31b10 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effb6ffd640 1 -- 172.21.15.55:0/393038574 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7effc003a020 con 0x5597b7e31b10 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effe15e1740 10 client.6285 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effe15e1740 10 client.6285 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effe15e1740 20 client.6285 populate_metadata read hostname 'smithi055' 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effe15e1740 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5597b7e37330 0x5597b7e61020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effe15e1740 4 client.6285 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.641+0000 7effe15e1740 1 -- 172.21.15.55:0/393038574 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5597b7d75630 con 0x5597b7e37330 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effd7fff640 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5597b7e37330 0x5597b7e61020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effb6ffd640 10 client.6285 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effd7fff640 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5597b7e37330 0x5597b7e61020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b3464176c5ebbea server_cookie=148ba2bfe4a5a23a in_seq=0 out_seq=0 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effb6ffd640 1 -- 172.21.15.55:0/393038574 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x5597b7d75630 con 0x5597b7e37330 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effb6ffd640 10 client.6285 handle_command_reply: tid=0 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 1 client.6285 shutdown 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 1 -- 172.21.15.55:0/393038574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31b10 msgr2=0x5597b7eb9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31b10 0x5597b7eb9300 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7effc0000f60 tx=0x7effc0012000 comp rx=0 tx=0).stop 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 1 -- 172.21.15.55:0/393038574 shutdown_connections 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x5597b7e37330 0x5597b7e61020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597b7e31ef0 0x5597b7e36df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597b7e31b10 0x5597b7eb9300 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 1 --2- 172.21.15.55:0/393038574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597b7e21c50 0x5597b7e20430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 1 -- 172.21.15.55:0/393038574 >> 172.21.15.55:0/393038574 conn(0x5597b7e04770 msgr2=0x5597b7e35c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effb6ffd640 0 client.6285 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 1 -- 172.21.15.55:0/393038574 shutdown_connections 2024-04-25T08:56:29.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 1 -- 172.21.15.55:0/393038574 wait complete. 2024-04-25T08:56:29.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.642+0000 7effe15e1740 20 client.6285 trim_cache size 0 max 16384 2024-04-25T08:56:29.639 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:56:29.639 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:56:29.639 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-25T08:56:29.639 INFO:teuthology.orchestra.run.smithi055.stdout: "092b04fc-55d8-4b1e-b360-f5bddc929d40": { 2024-04-25T08:56:29.639 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-04-25T08:56:29.639 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "092b04fc-55d8-4b1e-b360-f5bddc929d40", 2024-04-25T08:56:29.639 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive" 2024-04-25T08:56:29.639 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:29.639 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:56:29.640 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:56:29.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 -- 172.21.15.55:0/1253871188 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effb806b4d0 msgr2=0x7effb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effb806b4d0 0x7effb806d990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7effd809f650 tx=0x7effc0009040 comp rx=0 tx=0).stop 2024-04-25T08:56:29.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 -- 172.21.15.55:0/1253871188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd80cf510 msgr2=0x7effd809ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:29.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd80cf510 0x7effd809ec00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7effc8035040 tx=0x7effc80046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 -- 172.21.15.55:0/1253871188 shutdown_connections 2024-04-25T08:56:29.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effb806b4d0 0x7effb806d990 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effd815bbe0 0x7effd80cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effd80d0610 0x7effd80cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 --2- 172.21.15.55:0/1253871188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd80cf510 0x7effd809ec00 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:29.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 -- 172.21.15.55:0/1253871188 >> 172.21.15.55:0/1253871188 conn(0x7effd80b3430 msgr2=0x7effd80c6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:29.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 -- 172.21.15.55:0/1253871188 shutdown_connections 2024-04-25T08:56:29.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:29.643+0000 7effde807640 1 -- 172.21.15.55:0/1253871188 wait complete. 2024-04-25T08:56:29.643 INFO:tasks.cephfs.filesystem:scrub status for tag:092b04fc-55d8-4b1e-b360-f5bddc929d40 - {'path': '/', 'tag': '092b04fc-55d8-4b1e-b360-f5bddc929d40', 'options': 'recursive'} 2024-04-25T08:56:34.249 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T08:56:34.259+0000 7f7581a89640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T08:56:39.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:56:39.639 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:56:59.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:56:59.644 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T08:56:59.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.770+0000 7f6d7af1b640 1 Processor -- start 2024-04-25T08:56:59.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.770+0000 7f6d7af1b640 1 -- start start 2024-04-25T08:56:59.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.771+0000 7f6d7af1b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d7415dca0 0x7f6d740ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.771+0000 7f6d7af1b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d740d4090 con 0x7f6d740d3b90 2024-04-25T08:56:59.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.771+0000 7f6d7af1b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d740d4370 con 0x7f6d740d1130 2024-04-25T08:56:59.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.771+0000 7f6d7af1b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740b6b20 con 0x7f6d7415dca0 2024-04-25T08:56:59.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.771+0000 7f6d6bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6d740d3b90 0x7f6d740d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39508/0 (socket says 172.21.15.55:39508) 2024-04-25T08:56:59.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.771+0000 7f6d6bfff640 1 -- 172.21.15.55:0/4005145500 learned_addr learned my addr 172.21.15.55:0/4005145500 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:59.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.771+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/4005145500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d7415dca0 0x7f6d740ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.771+0000 7f6d6b7fe640 1 -- 172.21.15.55:0/4005145500 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301308104 0 0) 0x7f6d740d4090 con 0x7f6d740d3b90 2024-04-25T08:56:59.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.771+0000 7f6d6b7fe640 1 -- 172.21.15.55:0/4005145500 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d5c003520 con 0x7f6d740d3b90 2024-04-25T08:56:59.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.771+0000 7f6d6b7fe640 1 -- 172.21.15.55:0/4005145500 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12059744 0 0) 0x7f6d740d4370 con 0x7f6d740d1130 2024-04-25T08:56:59.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.772+0000 7f6d6b7fe640 1 -- 172.21.15.55:0/4005145500 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d740d4090 con 0x7f6d740d1130 2024-04-25T08:56:59.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.772+0000 7f6d78cb7640 1 -- 172.21.15.55:0/4005145500 >> v1:172.21.15.167:6789/0 conn(0x7f6d740d1130 legacy=0x7f6d740b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.772+0000 7f6d78cb7640 1 -- 172.21.15.55:0/4005145500 >> v1:172.21.15.55:6789/0 conn(0x7f6d740d3b90 legacy=0x7f6d740d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.772+0000 7f6d78cb7640 1 -- 172.21.15.55:0/4005145500 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d740d4650 con 0x7f6d7415dca0 2024-04-25T08:56:59.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.772+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/4005145500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d7415dca0 0x7f6d740ce940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6d700097d0 tx=0x7f6d7002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b42c7e8ed9a518e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:59.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.773+0000 7f6d6b7fe640 1 -- 172.21.15.55:0/4005145500 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70037070 con 0x7f6d7415dca0 2024-04-25T08:56:59.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.773+0000 7f6d6b7fe640 1 -- 172.21.15.55:0/4005145500 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d70032440 con 0x7f6d7415dca0 2024-04-25T08:56:59.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.773+0000 7f6d6b7fe640 1 -- 172.21.15.55:0/4005145500 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70032810 con 0x7f6d7415dca0 2024-04-25T08:56:59.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.773+0000 7f6d7af1b640 1 -- 172.21.15.55:0/4005145500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d7415dca0 msgr2=0x7f6d740ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.773+0000 7f6d7af1b640 1 --2- 172.21.15.55:0/4005145500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d7415dca0 0x7f6d740ce940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6d700097d0 tx=0x7f6d7002a210 comp rx=0 tx=0).stop 2024-04-25T08:56:59.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.773+0000 7f6d7af1b640 1 -- 172.21.15.55:0/4005145500 shutdown_connections 2024-04-25T08:56:59.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.773+0000 7f6d7af1b640 1 --2- 172.21.15.55:0/4005145500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d7415dca0 0x7f6d740ce940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.773+0000 7f6d7af1b640 1 -- 172.21.15.55:0/4005145500 >> 172.21.15.55:0/4005145500 conn(0x7f6d740726c0 msgr2=0x7f6d74072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:59.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.773+0000 7f6d7af1b640 1 -- 172.21.15.55:0/4005145500 shutdown_connections 2024-04-25T08:56:59.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.773+0000 7f6d7af1b640 1 -- 172.21.15.55:0/4005145500 wait complete. 2024-04-25T08:56:59.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.774+0000 7f6d7af1b640 1 Processor -- start 2024-04-25T08:56:59.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.774+0000 7f6d7af1b640 1 -- start start 2024-04-25T08:56:59.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.775+0000 7f6d7af1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d740d1130 0x7f6d740c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.775+0000 7f6d7af1b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d740d3b90 0x7f6d740cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.775+0000 7f6d7af1b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d7415dca0 0x7f6d740ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.775+0000 7f6d7af1b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7415e200 con 0x7f6d740d1130 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.775+0000 7f6d7af1b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7415e080 con 0x7f6d7415dca0 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.775+0000 7f6d7af1b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740cee80 con 0x7f6d740d3b90 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.775+0000 7f6d78cb7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d740d1130 0x7f6d740c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.775+0000 7f6d78cb7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d740d1130 0x7f6d740c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59002/0 (socket says 172.21.15.55:59002) 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d78cb7640 1 -- 172.21.15.55:0/3551570550 learned_addr learned my addr 172.21.15.55:0/3551570550 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d794b8640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d7415dca0 0x7f6d740ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d740d3b90 0x7f6d740cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d78cb7640 1 -- 172.21.15.55:0/3551570550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d740d3b90 msgr2=0x7f6d740cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d740d3b90 0x7f6d740cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d78cb7640 1 -- 172.21.15.55:0/3551570550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d7415dca0 msgr2=0x7f6d740ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d7415dca0 0x7f6d740ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d78cb7640 1 -- 172.21.15.55:0/3551570550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d74158dc0 con 0x7f6d740d1130 2024-04-25T08:56:59.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d740d3b90 0x7f6d740cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:59.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d740d1130 0x7f6d740c9ff0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6d700098f0 tx=0x7f6d700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:59.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d697fa640 1 -- 172.21.15.55:0/3551570550 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70037050 con 0x7f6d740d1130 2024-04-25T08:56:59.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d697fa640 1 -- 172.21.15.55:0/3551570550 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d70043070 con 0x7f6d740d1130 2024-04-25T08:56:59.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d7af1b640 1 -- 172.21.15.55:0/3551570550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d7415e7a0 con 0x7f6d740d1130 2024-04-25T08:56:59.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d697fa640 1 -- 172.21.15.55:0/3551570550 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7003cb30 con 0x7f6d740d1130 2024-04-25T08:56:59.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.776+0000 7f6d7af1b640 1 -- 172.21.15.55:0/3551570550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7415ed60 con 0x7f6d740d1130 2024-04-25T08:56:59.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.778+0000 7f6d697fa640 1 -- 172.21.15.55:0/3551570550 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6d7003ccd0 con 0x7f6d740d1130 2024-04-25T08:56:59.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.778+0000 7f6d697fa640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d6006b4d0 0x7f6d6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.778+0000 7f6d697fa640 1 -- 172.21.15.55:0/3551570550 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d700aaed0 con 0x7f6d740d1130 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.778+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d6006b4d0 0x7f6d6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.779+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d6006b4d0 0x7f6d6006d990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6d74159070 tx=0x7f6d64009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.779+0000 7f6d7dc1e740 1 Processor -- start 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.779+0000 7f6d7dc1e740 1 -- start start 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.780+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cb10 0x55ca5463f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.780+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5463f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.780+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5460f770 0x55ca54612f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.780+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca54578da0 con 0x55ca5463cef0 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.780+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca54521b80 con 0x55ca5463cb10 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.780+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca54574e40 con 0x55ca5460f770 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.780+0000 7f6d6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5463f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.780+0000 7f6d6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5463f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59014/0 (socket says 172.21.15.55:59014) 2024-04-25T08:56:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.780+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3459484691 learned_addr learned my addr 172.21.15.55:0/3459484691 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/3459484691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cb10 0x55ca5463f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d794b8640 1 --2- 172.21.15.55:0/3459484691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5460f770 0x55ca54612f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3459484691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5460f770 msgr2=0x55ca54612f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3459484691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5460f770 0x55ca54612f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3459484691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cb10 msgr2=0x55ca5463f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3459484691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cb10 0x55ca5463f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3459484691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca5452bf10 con 0x55ca5463cef0 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/3459484691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cb10 0x55ca5463f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3459484691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5463f860 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6d74161520 tx=0x7f6d64010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829482e13de94986 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/3459484691 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64023070 con 0x55ca5463cef0 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/3459484691 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6400dbb0 con 0x55ca5463cef0 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/3459484691 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64007710 con 0x55ca5463cef0 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/3459484691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 msgr2=0x55ca5463f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.781+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/3459484691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5463f860 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6d74161520 tx=0x7f6d64010000 comp rx=0 tx=0).stop 2024-04-25T08:56:59.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.782+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/3459484691 shutdown_connections 2024-04-25T08:56:59.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.782+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/3459484691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5460f770 0x55ca54612f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.782+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/3459484691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5463f860 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.782+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/3459484691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cb10 0x55ca5463f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.782+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/3459484691 >> 172.21.15.55:0/3459484691 conn(0x55ca546119e0 msgr2=0x55ca5465a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:59.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.782+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/3459484691 shutdown_connections 2024-04-25T08:56:59.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.782+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/3459484691 wait complete. 2024-04-25T08:56:59.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.782+0000 7f6d7dc1e740 1 -- start start 2024-04-25T08:56:59.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.782+0000 7f6d7dc1e740 1 Processor -- start 2024-04-25T08:56:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.783+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cb10 0x55ca54633fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.783+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5463cef0 0x55ca54636390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.783+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5465b810 0x55ca5465bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.783+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca54614b90 con 0x55ca5465b810 2024-04-25T08:56:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.783+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca545174b0 con 0x55ca5463cb10 2024-04-25T08:56:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.783+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca54614e70 con 0x55ca5463cef0 2024-04-25T08:56:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.783+0000 7f6d7dc1e740 10 client.0 _ll_register_callbacks cb 0x55ca54557180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:56:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.783+0000 7f6d794b8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5465b810 0x55ca5465bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.783+0000 7f6d794b8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5465b810 0x55ca5465bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59018/0 (socket says 172.21.15.55:59018) 2024-04-25T08:56:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.783+0000 7f6d794b8640 1 -- 172.21.15.55:0/510585999 learned_addr learned my addr 172.21.15.55:0/510585999 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5463cef0 0x55ca54636390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cb10 0x55ca54633fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d794b8640 1 -- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5463cef0 msgr2=0x55ca54636390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d794b8640 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5463cef0 0x55ca54636390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d794b8640 1 -- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cb10 msgr2=0x55ca54633fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d794b8640 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cb10 0x55ca54633fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d794b8640 1 -- 172.21.15.55:0/510585999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca543577d0 con 0x55ca5465b810 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d794b8640 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5465b810 0x55ca5465bc90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00f480 tx=0x7f6d6c00f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3775534b118a30dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d537fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d537fe640 1 -- 172.21.15.55:0/510585999 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c017020 con 0x55ca5465b810 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d537fe640 1 -- 172.21.15.55:0/510585999 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d6c003b80 con 0x55ca5465b810 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/510585999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d6400dbb0 con 0x55ca5465b810 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d537fe640 1 -- 172.21.15.55:0/510585999 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d6c021050 con 0x55ca5465b810 2024-04-25T08:56:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d7dc1e740 10 client.6297 fetch_fsmap learned FSMap version 29 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/510585999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x55ca5428d3f0 con 0x55ca5465b810 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d537fe640 1 -- 172.21.15.55:0/510585999 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6400dbb0 con 0x55ca5465b810 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.784+0000 7f6d537fe640 1 -- 172.21.15.55:0/510585999 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6d6c024020 con 0x55ca5465b810 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.785+0000 7f6d7dc1e740 10 client.6297 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.785+0000 7f6d7dc1e740 10 client.6297 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.785+0000 7f6d7dc1e740 20 client.6297 populate_metadata read hostname 'smithi055' 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.785+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55ca54655fa0 0x55ca546778c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.785+0000 7f6d7dc1e740 4 client.6297 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.785+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/510585999 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca545862e0 con 0x55ca54655fa0 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.785+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55ca54655fa0 0x55ca546778c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.785+0000 7f6d537fe640 10 client.6297 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.785+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55ca54655fa0 0x55ca546778c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26593b86bf41b303 server_cookie=52d8009b7ac11b06 in_seq=0 out_seq=0 2024-04-25T08:56:59.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d537fe640 1 -- 172.21.15.55:0/510585999 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ca545862e0 con 0x55ca54655fa0 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d537fe640 10 client.6297 handle_command_reply: tid=0 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 1 client.6297 shutdown 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/510585999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5465b810 msgr2=0x55ca5465bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5465b810 0x55ca5465bc90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00f480 tx=0x7f6d6c00f940 comp rx=0 tx=0).stop 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/510585999 shutdown_connections 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55ca54655fa0 0x55ca546778c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5465b810 0x55ca5465bc90 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5463cef0 0x55ca54636390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/510585999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cb10 0x55ca54633fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d537fe640 0 client.6297 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/510585999 >> 172.21.15.55:0/510585999 conn(0x55ca5460f770 msgr2=0x55ca5463bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/510585999 shutdown_connections 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/510585999 wait complete. 2024-04-25T08:56:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.786+0000 7f6d7dc1e740 20 client.6297 trim_cache size 0 max 16384 2024-04-25T08:56:59.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.802+0000 7f6d7dc1e740 1 Processor -- start 2024-04-25T08:56:59.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.802+0000 7f6d7dc1e740 1 -- start start 2024-04-25T08:56:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.802+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5463cb10 0x55ca54679d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.802+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5460ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.802+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5465b810 0x55ca5460fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.802+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d741ffdc0 con 0x55ca5463cef0 2024-04-25T08:56:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.802+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d74158a30 con 0x55ca5465b810 2024-04-25T08:56:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.802+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d74157e30 con 0x55ca5463cb10 2024-04-25T08:56:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5460ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5460ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59030/0 (socket says 172.21.15.55:59030) 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d6bfff640 1 -- 172.21.15.55:0/178301535 learned_addr learned my addr 172.21.15.55:0/178301535 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/178301535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5463cb10 0x55ca54679d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d794b8640 1 --2- 172.21.15.55:0/178301535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5465b810 0x55ca5460fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d6bfff640 1 -- 172.21.15.55:0/178301535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5463cb10 msgr2=0x55ca54679d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/178301535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5463cb10 0x55ca54679d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d6bfff640 1 -- 172.21.15.55:0/178301535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5465b810 msgr2=0x55ca5460fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/178301535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5465b810 0x55ca5460fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d6bfff640 1 -- 172.21.15.55:0/178301535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca5424d0f0 con 0x55ca5463cef0 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d794b8640 1 --2- 172.21.15.55:0/178301535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5465b810 0x55ca5460fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/178301535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5460ab80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6d64006b40 tx=0x7f6d64007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a65515b59f419b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d59ffb640 1 -- 172.21.15.55:0/178301535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64023070 con 0x55ca5463cef0 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d59ffb640 1 -- 172.21.15.55:0/178301535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6402e070 con 0x55ca5463cef0 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.803+0000 7f6d59ffb640 1 -- 172.21.15.55:0/178301535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400de30 con 0x55ca5463cef0 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.804+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/178301535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 msgr2=0x55ca5460ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.804+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/178301535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5460ab80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6d64006b40 tx=0x7f6d64007000 comp rx=0 tx=0).stop 2024-04-25T08:56:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.804+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/178301535 shutdown_connections 2024-04-25T08:56:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.804+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/178301535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5465b810 0x55ca5460fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.804+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/178301535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cef0 0x55ca5460ab80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.804+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/178301535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5463cb10 0x55ca54679d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.804+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/178301535 >> 172.21.15.55:0/178301535 conn(0x55ca5460f770 msgr2=0x55ca546331d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.804+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/178301535 shutdown_connections 2024-04-25T08:56:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.804+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/178301535 wait complete. 2024-04-25T08:56:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.804+0000 7f6d7dc1e740 1 -- start start 2024-04-25T08:56:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.805+0000 7f6d7dc1e740 1 Processor -- start 2024-04-25T08:56:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.805+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cb10 0x55ca546c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.805+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cef0 0x55ca54673580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.805+0000 7f6d7dc1e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5465b810 0x55ca5460e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.805+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d74158430 con 0x55ca5463cb10 2024-04-25T08:56:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.805+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca54673d40 con 0x55ca5463cef0 2024-04-25T08:56:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.805+0000 7f6d7dc1e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca5460ae60 con 0x55ca5465b810 2024-04-25T08:56:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.805+0000 7f6d7dc1e740 10 client.0 _ll_register_callbacks cb 0x7f6d64001430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.805+0000 7f6d78cb7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cb10 0x55ca546c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.805+0000 7f6d78cb7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cb10 0x55ca546c4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59044/0 (socket says 172.21.15.55:59044) 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.805+0000 7f6d78cb7640 1 -- 172.21.15.55:0/623486129 learned_addr learned my addr 172.21.15.55:0/623486129 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cef0 0x55ca54673580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d794b8640 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5465b810 0x55ca5460e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d78cb7640 1 -- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5465b810 msgr2=0x55ca5460e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5465b810 0x55ca5460e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d78cb7640 1 -- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cef0 msgr2=0x55ca54673580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cef0 0x55ca54673580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d78cb7640 1 -- 172.21.15.55:0/623486129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca5460ab80 con 0x55ca5463cb10 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d794b8640 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5465b810 0x55ca5460e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d78cb7640 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cb10 0x55ca546c4290 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009720 tx=0x7f6d70009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedee68c5c6beecd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d537fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d537fe640 1 -- 172.21.15.55:0/623486129 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d700795d0 con 0x55ca5463cb10 2024-04-25T08:56:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d537fe640 1 -- 172.21.15.55:0/623486129 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d70075c40 con 0x55ca5463cb10 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/623486129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d6402e070 con 0x55ca5463cb10 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d537fe640 1 -- 172.21.15.55:0/623486129 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d7007d720 con 0x55ca5463cb10 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d7dc1e740 10 client.6303 fetch_fsmap learned FSMap version 29 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/623486129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x55ca5465bbf0 con 0x55ca5463cb10 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.806+0000 7f6d537fe640 1 -- 172.21.15.55:0/623486129 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6402e070 con 0x55ca5463cb10 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d537fe640 1 -- 172.21.15.55:0/623486129 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6d700980b0 con 0x55ca5463cb10 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d7dc1e740 10 client.6303 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d7dc1e740 10 client.6303 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d7dc1e740 20 client.6303 populate_metadata read hostname 'smithi055' 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55ca5460ef20 0x55ca5460fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d7dc1e740 4 client.6303 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/623486129 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ca54580630 con 0x55ca5460ef20 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55ca5460ef20 0x55ca5460fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d537fe640 10 client.6303 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55ca5460ef20 0x55ca5460fc50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb080c692eb06009 server_cookie=58b1b8a514dd3045 in_seq=0 out_seq=0 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d537fe640 1 -- 172.21.15.55:0/623486129 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ca54580630 con 0x55ca5460ef20 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d537fe640 10 client.6303 handle_command_reply: tid=0 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.807+0000 7f6d7dc1e740 1 client.6303 shutdown 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/623486129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cb10 msgr2=0x55ca546c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cb10 0x55ca546c4290 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009720 tx=0x7f6d70009190 comp rx=0 tx=0).stop 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/623486129 shutdown_connections 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55ca5460ef20 0x55ca5460fc50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ca5465b810 0x55ca5460e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca5463cef0 0x55ca54673580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d537fe640 0 client.6303 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7dc1e740 1 --2- 172.21.15.55:0/623486129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ca5463cb10 0x55ca546c4290 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/623486129 >> 172.21.15.55:0/623486129 conn(0x55ca5460f770 msgr2=0x55ca5465a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/623486129 shutdown_connections 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7dc1e740 1 -- 172.21.15.55:0/623486129 wait complete. 2024-04-25T08:56:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7dc1e740 20 client.6303 trim_cache size 0 max 16384 2024-04-25T08:56:59.805 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:56:59.805 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-25T08:56:59.805 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-25T08:56:59.805 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:56:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7af1b640 1 -- 172.21.15.55:0/3551570550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d6006b4d0 msgr2=0x7f6d6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7af1b640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d6006b4d0 0x7f6d6006d990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6d74159070 tx=0x7f6d64009040 comp rx=0 tx=0).stop 2024-04-25T08:56:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7af1b640 1 -- 172.21.15.55:0/3551570550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d740d1130 msgr2=0x7f6d740c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7af1b640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d740d1130 0x7f6d740c9ff0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6d700098f0 tx=0x7f6d700046c0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7af1b640 1 -- 172.21.15.55:0/3551570550 shutdown_connections 2024-04-25T08:56:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7af1b640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d6006b4d0 0x7f6d6006d990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7af1b640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d7415dca0 0x7f6d740ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7af1b640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d740d3b90 0x7f6d740cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7af1b640 1 --2- 172.21.15.55:0/3551570550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d740d1130 0x7f6d740c9ff0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.808+0000 7f6d7af1b640 1 -- 172.21.15.55:0/3551570550 >> 172.21.15.55:0/3551570550 conn(0x7f6d740726c0 msgr2=0x7f6d740d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.809+0000 7f6d7af1b640 1 -- 172.21.15.55:0/3551570550 shutdown_connections 2024-04-25T08:56:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.809+0000 7f6d7af1b640 1 -- 172.21.15.55:0/3551570550 wait complete. 2024-04-25T08:56:59.809 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:56:59.809 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:56:59.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.920+0000 7f8d35190640 1 Processor -- start 2024-04-25T08:56:59.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.920+0000 7f8d35190640 1 -- start start 2024-04-25T08:56:59.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.921+0000 7f8d35190640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3015dce0 0x7f8d300d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.921+0000 7f8d35190640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8d300d35b0 0x7f8d300b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.921+0000 7f8d35190640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3015e0c0 con 0x7f8d300d1f90 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.921+0000 7f8d35190640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d300b7b10 con 0x7f8d300d35b0 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.921+0000 7f8d35190640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d300d2510 con 0x7f8d3015dce0 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.921+0000 7f8d2f59e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8d300d1f90 0x7f8d3006bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39510/0 (socket says 172.21.15.55:39510) 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.921+0000 7f8d2f59e640 1 -- 172.21.15.55:0/1560045176 learned_addr learned my addr 172.21.15.55:0/1560045176 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.921+0000 7f8d2e59c640 1 --2- 172.21.15.55:0/1560045176 >> v2:172.21.15.167:3300/0 conn(0x7f8d300d35b0 0x7f8d300b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.921+0000 7f8d2ed9d640 1 --2- 172.21.15.55:0/1560045176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3015dce0 0x7f8d300d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.922+0000 7f8d2dd9b640 1 -- 172.21.15.55:0/1560045176 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723900118 0 0) 0x7f8d3015e0c0 con 0x7f8d300d1f90 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.922+0000 7f8d2dd9b640 1 -- 172.21.15.55:0/1560045176 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d18003520 con 0x7f8d300d1f90 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.922+0000 7f8d2e59c640 1 -- 172.21.15.55:0/1560045176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3015dce0 msgr2=0x7f8d300d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.922+0000 7f8d2e59c640 1 --2- 172.21.15.55:0/1560045176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3015dce0 0x7f8d300d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.922+0000 7f8d2e59c640 1 -- 172.21.15.55:0/1560045176 >> v1:172.21.15.55:6789/0 conn(0x7f8d300d1f90 legacy=0x7f8d3006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.922+0000 7f8d2e59c640 1 -- 172.21.15.55:0/1560045176 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d300d27f0 con 0x7f8d300d35b0 2024-04-25T08:56:59.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.922+0000 7f8d2e59c640 1 --2- 172.21.15.55:0/1560045176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d300d35b0 0x7f8d300b5450 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8d240097a0 tx=0x7f8d2402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69981e0f5d5f676 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:59.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.923+0000 7f8d2dd9b640 1 -- 172.21.15.55:0/1560045176 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24037070 con 0x7f8d300d35b0 2024-04-25T08:56:59.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.923+0000 7f8d2dd9b640 1 -- 172.21.15.55:0/1560045176 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2402ae50 con 0x7f8d300d35b0 2024-04-25T08:56:59.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.923+0000 7f8d2dd9b640 1 -- 172.21.15.55:0/1560045176 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24032660 con 0x7f8d300d35b0 2024-04-25T08:56:59.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.923+0000 7f8d35190640 1 -- 172.21.15.55:0/1560045176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d300d35b0 msgr2=0x7f8d300b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.923+0000 7f8d35190640 1 --2- 172.21.15.55:0/1560045176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d300d35b0 0x7f8d300b5450 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8d240097a0 tx=0x7f8d2402a100 comp rx=0 tx=0).stop 2024-04-25T08:56:59.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.923+0000 7f8d35190640 1 -- 172.21.15.55:0/1560045176 shutdown_connections 2024-04-25T08:56:59.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.923+0000 7f8d35190640 1 --2- 172.21.15.55:0/1560045176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d300d35b0 0x7f8d300b5450 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.923+0000 7f8d35190640 1 --2- 172.21.15.55:0/1560045176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d3015dce0 0x7f8d300d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.923+0000 7f8d35190640 1 -- 172.21.15.55:0/1560045176 >> 172.21.15.55:0/1560045176 conn(0x7f8d30072900 msgr2=0x7f8d300d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:56:59.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.923+0000 7f8d35190640 1 -- 172.21.15.55:0/1560045176 shutdown_connections 2024-04-25T08:56:59.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.923+0000 7f8d35190640 1 -- 172.21.15.55:0/1560045176 wait complete. 2024-04-25T08:56:59.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.925+0000 7f8d35190640 1 Processor -- start 2024-04-25T08:56:59.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.925+0000 7f8d35190640 1 -- start start 2024-04-25T08:56:59.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.925+0000 7f8d35190640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d300d1f90 0x7f8d300c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.925+0000 7f8d35190640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d300d35b0 0x7f8d30152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.925+0000 7f8d35190640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3015dce0 0x7f8d300cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.925+0000 7f8d35190640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d300d3090 con 0x7f8d300d1f90 2024-04-25T08:56:59.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.925+0000 7f8d35190640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d300d2db0 con 0x7f8d3015dce0 2024-04-25T08:56:59.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.925+0000 7f8d35190640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d300b9820 con 0x7f8d300d35b0 2024-04-25T08:56:59.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d300d1f90 0x7f8d300c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d300d1f90 0x7f8d300c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59060/0 (socket says 172.21.15.55:59060) 2024-04-25T08:56:59.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2ed9d640 1 -- 172.21.15.55:0/583713566 learned_addr learned my addr 172.21.15.55:0/583713566 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:56:59.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2e59c640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d300d35b0 0x7f8d30152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2f59e640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3015dce0 0x7f8d300cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2ed9d640 1 -- 172.21.15.55:0/583713566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d300d35b0 msgr2=0x7f8d30152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2ed9d640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d300d35b0 0x7f8d30152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2ed9d640 1 -- 172.21.15.55:0/583713566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3015dce0 msgr2=0x7f8d300cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2ed9d640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3015dce0 0x7f8d300cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2ed9d640 1 -- 172.21.15.55:0/583713566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3015e870 con 0x7f8d300d1f90 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2f59e640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3015dce0 0x7f8d300cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d2ed9d640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d300d1f90 0x7f8d300c7f10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e9b0 tx=0x7f8d2800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d177fe640 1 -- 172.21.15.55:0/583713566 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d28017070 con 0x7f8d300d1f90 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d177fe640 1 -- 172.21.15.55:0/583713566 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2800c9a0 con 0x7f8d300d1f90 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d177fe640 1 -- 172.21.15.55:0/583713566 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2800cd90 con 0x7f8d300d1f90 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d35190640 1 -- 172.21.15.55:0/583713566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3015eb50 con 0x7f8d300d1f90 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.926+0000 7f8d35190640 1 -- 172.21.15.55:0/583713566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3015f110 con 0x7f8d300d1f90 2024-04-25T08:56:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.927+0000 7f8d35190640 1 -- 172.21.15.55:0/583713566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d300749b0 con 0x7f8d300d1f90 2024-04-25T08:56:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.928+0000 7f8d177fe640 1 -- 172.21.15.55:0/583713566 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8d2801a070 con 0x7f8d300d1f90 2024-04-25T08:56:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.928+0000 7f8d177fe640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d1c06b500 0x7f8d1c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:56:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.928+0000 7f8d177fe640 1 -- 172.21.15.55:0/583713566 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d2808a640 con 0x7f8d300d1f90 2024-04-25T08:56:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.928+0000 7f8d2e59c640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d1c06b500 0x7f8d1c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:56:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.929+0000 7f8d2e59c640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d1c06b500 0x7f8d1c06d9c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8d24034000 tx=0x7f8d2402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:56:59.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:56:59.933+0000 7f8d177fe640 1 -- 172.21.15.55:0/583713566 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d28059440 con 0x7f8d300d1f90 2024-04-25T08:57:00.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.150+0000 7f8d35190640 1 -- 172.21.15.55:0/583713566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d300b92f0 con 0x7f8d300d1f90 2024-04-25T08:57:00.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.150+0000 7f8d177fe640 1 -- 172.21.15.55:0/583713566 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f8d28058d40 con 0x7f8d300d1f90 2024-04-25T08:57:00.140 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:00.140 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1092467772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1092467772},{"type":"v1","addr":"172.21.15.167:6834","nonce":1092467772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/651597245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":651597245},{"type":"v1","addr":"172.21.15.55:6837","nonce":651597245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3980280949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3980280949},{"type":"v1","addr":"172.21.15.55:6836","nonce":3980280949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:17.562426+0000","modified":"2024-04-25T08:56:34.236553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6835/238831666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":238831666},{"type":"v1","addr":"172.21.15.167:6835","nonce":238831666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:57:00.140 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 29 2024-04-25T08:57:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 -- 172.21.15.55:0/583713566 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d1c06b500 msgr2=0x7f8d1c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d1c06b500 0x7f8d1c06d9c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8d24034000 tx=0x7f8d2402e000 comp rx=0 tx=0).stop 2024-04-25T08:57:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 -- 172.21.15.55:0/583713566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d300d1f90 msgr2=0x7f8d300c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d300d1f90 0x7f8d300c7f10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e9b0 tx=0x7f8d2800ee70 comp rx=0 tx=0).stop 2024-04-25T08:57:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 -- 172.21.15.55:0/583713566 shutdown_connections 2024-04-25T08:57:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d1c06b500 0x7f8d1c06d9c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3015dce0 0x7f8d300cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d300d35b0 0x7f8d30152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 --2- 172.21.15.55:0/583713566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d300d1f90 0x7f8d300c7f10 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 -- 172.21.15.55:0/583713566 >> 172.21.15.55:0/583713566 conn(0x7f8d30072900 msgr2=0x7f8d300b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 -- 172.21.15.55:0/583713566 shutdown_connections 2024-04-25T08:57:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.152+0000 7f8d35190640 1 -- 172.21.15.55:0/583713566 wait complete. 2024-04-25T08:57:00.153 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b damage ls --format=json-pretty 2024-04-25T08:57:00.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.266+0000 7fc6fe709640 1 Processor -- start 2024-04-25T08:57:00.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.266+0000 7fc6fe709640 1 -- start start 2024-04-25T08:57:00.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.267+0000 7fc6fe709640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161120 0x7fc6f81617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.267+0000 7fc6fe709640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6f8161ce0 0x7fc6f80b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.267+0000 7fc6fe709640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f8161500 con 0x7fc6f80b5a90 2024-04-25T08:57:00.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.267+0000 7fc6fe709640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f8162740 con 0x7fc6f8161ce0 2024-04-25T08:57:00.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.267+0000 7fc6fe709640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8162180 con 0x7fc6f8161120 2024-04-25T08:57:00.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.267+0000 7fc6f77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6f8161ce0 0x7fc6f80b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.267+0000 7fc6f77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6f8161ce0 0x7fc6f80b5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59062/0 (socket says 172.21.15.55:59062) 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.267+0000 7fc6f77fe640 1 -- 172.21.15.55:0/3553021969 learned_addr learned my addr 172.21.15.55:0/3553021969 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.268+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/3553021969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161120 0x7fc6f81617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.268+0000 7fc6f77fe640 1 -- 172.21.15.55:0/3553021969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161120 msgr2=0x7fc6f81617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.268+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/3553021969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161120 0x7fc6f81617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.268+0000 7fc6f77fe640 1 -- 172.21.15.55:0/3553021969 >> v1:172.21.15.167:6789/0 conn(0x7fc6f80b5a90 legacy=0x7fc6f806c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.268+0000 7fc6f77fe640 1 -- 172.21.15.55:0/3553021969 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f8162460 con 0x7fc6f8161ce0 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.268+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/3553021969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161120 0x7fc6f81617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.268+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/3553021969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6f8161ce0 0x7fc6f80b5550 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80d4b60 tx=0x7fc6ec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3354fd5f547510e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.269+0000 7fc6f6ffd640 1 -- 172.21.15.55:0/3553021969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec037070 con 0x7fc6f8161ce0 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.269+0000 7fc6f6ffd640 1 -- 172.21.15.55:0/3553021969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec02ae50 con 0x7fc6f8161ce0 2024-04-25T08:57:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.269+0000 7fc6f6ffd640 1 -- 172.21.15.55:0/3553021969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec032660 con 0x7fc6f8161ce0 2024-04-25T08:57:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.269+0000 7fc6fe709640 1 -- 172.21.15.55:0/3553021969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6f8161ce0 msgr2=0x7fc6f80b5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.269+0000 7fc6fe709640 1 --2- 172.21.15.55:0/3553021969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6f8161ce0 0x7fc6f80b5550 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80d4b60 tx=0x7fc6ec02a140 comp rx=0 tx=0).stop 2024-04-25T08:57:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.269+0000 7fc6fe709640 1 -- 172.21.15.55:0/3553021969 shutdown_connections 2024-04-25T08:57:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.269+0000 7fc6fe709640 1 --2- 172.21.15.55:0/3553021969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6f8161ce0 0x7fc6f80b5550 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.269+0000 7fc6fe709640 1 --2- 172.21.15.55:0/3553021969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161120 0x7fc6f81617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.269+0000 7fc6fe709640 1 -- 172.21.15.55:0/3553021969 >> 172.21.15.55:0/3553021969 conn(0x7fc6f80d0550 msgr2=0x7fc6f80d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.269+0000 7fc6fe709640 1 -- 172.21.15.55:0/3553021969 shutdown_connections 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.269+0000 7fc6fe709640 1 -- 172.21.15.55:0/3553021969 wait complete. 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.270+0000 7fc6fe709640 1 Processor -- start 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6fe709640 1 -- start start 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6fe709640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6f80b5a90 0x7fc6f81f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6fe709640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f8161120 0x7fc6f80c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6fe709640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161ce0 0x7fc6f8158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6fe709640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80b95f0 con 0x7fc6f80b5a90 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6fe709640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80d2040 con 0x7fc6f8161120 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6fe709640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80b9770 con 0x7fc6f8161ce0 2024-04-25T08:57:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6f80b5a90 0x7fc6f81f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6f80b5a90 0x7fc6f81f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59078/0 (socket says 172.21.15.55:59078) 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6f7fff640 1 -- 172.21.15.55:0/2830805490 learned_addr learned my addr 172.21.15.55:0/2830805490 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f8161120 0x7fc6f80c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.271+0000 7fc6fcca6640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161ce0 0x7fc6f8158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6f7fff640 1 -- 172.21.15.55:0/2830805490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161ce0 msgr2=0x7fc6f8158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161ce0 0x7fc6f8158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6f7fff640 1 -- 172.21.15.55:0/2830805490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f8161120 msgr2=0x7fc6f80c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f8161120 0x7fc6f80c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6f7fff640 1 -- 172.21.15.55:0/2830805490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f81572e0 con 0x7fc6f80b5a90 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6fcca6640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161ce0 0x7fc6f8158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6f80b5a90 0x7fc6f81f7be0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c7f0 tx=0x7fc6e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6f4ff9640 1 -- 172.21.15.55:0/2830805490 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8015070 con 0x7fc6f80b5a90 2024-04-25T08:57:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6f4ff9640 1 -- 172.21.15.55:0/2830805490 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e8007a30 con 0x7fc6f80b5a90 2024-04-25T08:57:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6f4ff9640 1 -- 172.21.15.55:0/2830805490 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8007e00 con 0x7fc6f80b5a90 2024-04-25T08:57:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6fe709640 1 -- 172.21.15.55:0/2830805490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f81575c0 con 0x7fc6f80b5a90 2024-04-25T08:57:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.272+0000 7fc6fe709640 1 -- 172.21.15.55:0/2830805490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f8157b80 con 0x7fc6f80b5a90 2024-04-25T08:57:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.274+0000 7fc6f4ff9640 1 -- 172.21.15.55:0/2830805490 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc6e8018070 con 0x7fc6f80b5a90 2024-04-25T08:57:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.274+0000 7fc6f4ff9640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6e406b4d0 0x7fc6e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.274+0000 7fc6f4ff9640 1 -- 172.21.15.55:0/2830805490 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6e808a100 con 0x7fc6f80b5a90 2024-04-25T08:57:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.274+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6e406b4d0 0x7fc6e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.275+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6e406b4d0 0x7fc6e406d990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec034000 tx=0x7fc6ec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.275+0000 7fc701411740 1 Processor -- start 2024-04-25T08:57:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.275+0000 7fc701411740 1 -- start start 2024-04-25T08:57:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc701411740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f4a590 0x563c58f4c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc701411740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f4a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc701411740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f75050 0x563c58f754d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc701411740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c58eadc60 con 0x563c58f86c60 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc701411740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c58e4cd80 con 0x563c58f4a590 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc701411740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c58ea9d00 con 0x563c58f75050 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6f77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f4a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6f77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f4a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59090/0 (socket says 172.21.15.55:59090) 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6f77fe640 1 -- 172.21.15.55:0/1526473385 learned_addr learned my addr 172.21.15.55:0/1526473385 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/1526473385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f4a590 0x563c58f4c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6fcca6640 1 --2- 172.21.15.55:0/1526473385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f75050 0x563c58f754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6f77fe640 1 -- 172.21.15.55:0/1526473385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f75050 msgr2=0x563c58f754d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/1526473385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f75050 0x563c58f754d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6f77fe640 1 -- 172.21.15.55:0/1526473385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f4a590 msgr2=0x563c58f4c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/1526473385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f4a590 0x563c58f4c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6f77fe640 1 -- 172.21.15.55:0/1526473385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c58c8e7c0 con 0x563c58f86c60 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/1526473385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f4a590 0x563c58f4c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.276+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/1526473385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f4a970 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec03e040 tx=0x7fc6ec02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654f2fb24e4d8f9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc6ddffb640 1 -- 172.21.15.55:0/1526473385 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec037040 con 0x563c58f86c60 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc6ddffb640 1 -- 172.21.15.55:0/1526473385 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec04e070 con 0x563c58f86c60 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc6ddffb640 1 -- 172.21.15.55:0/1526473385 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec049480 con 0x563c58f86c60 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc701411740 1 -- 172.21.15.55:0/1526473385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 msgr2=0x563c58f4a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc701411740 1 --2- 172.21.15.55:0/1526473385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f4a970 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec03e040 tx=0x7fc6ec02c000 comp rx=0 tx=0).stop 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc701411740 1 -- 172.21.15.55:0/1526473385 shutdown_connections 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc701411740 1 --2- 172.21.15.55:0/1526473385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f75050 0x563c58f754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc701411740 1 --2- 172.21.15.55:0/1526473385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f4a970 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc701411740 1 --2- 172.21.15.55:0/1526473385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f4a590 0x563c58f4c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc701411740 1 -- 172.21.15.55:0/1526473385 >> 172.21.15.55:0/1526473385 conn(0x563c58f126e0 msgr2=0x563c58f90050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc701411740 1 -- 172.21.15.55:0/1526473385 shutdown_connections 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.277+0000 7fc701411740 1 -- 172.21.15.55:0/1526473385 wait complete. 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.278+0000 7fc701411740 1 -- start start 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.278+0000 7fc701411740 1 Processor -- start 2024-04-25T08:57:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc701411740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f4a590 0x563c58f870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc701411740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f67640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc701411740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f76f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc701411740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c58e4a840 con 0x563c58f86c60 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc701411740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c58f72ba0 con 0x563c58f75050 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc701411740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c58f884b0 con 0x563c58f4a590 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc701411740 10 client.0 _ll_register_callbacks cb 0x563c58e64980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6fcca6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f76f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6fcca6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f76f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59096/0 (socket says 172.21.15.55:59096) 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6fcca6640 1 -- 172.21.15.55:0/3352196567 learned_addr learned my addr 172.21.15.55:0/3352196567 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f67640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f4a590 0x563c58f870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6fcca6640 1 -- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f4a590 msgr2=0x563c58f870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6fcca6640 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f4a590 0x563c58f870a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6fcca6640 1 -- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 msgr2=0x563c58f67640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6fcca6640 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f67640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6fcca6640 1 -- 172.21.15.55:0/3352196567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c58ceef50 con 0x563c58f86c60 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6fcca6640 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f76f10 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00104e0 tx=0x7fc6f00109a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a456de7474f4a0f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.279+0000 7fc6d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3352196567 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0019020 con 0x563c58f86c60 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3352196567 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6f0015870 con 0x563c58f86c60 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc701411740 1 -- 172.21.15.55:0/3352196567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc6ec04e070 con 0x563c58f86c60 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3352196567 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6f0023050 con 0x563c58f86c60 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc701411740 10 client.6321 fetch_fsmap learned FSMap version 29 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc701411740 1 -- 172.21.15.55:0/3352196567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x563c58b820b0 con 0x563c58f86c60 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3352196567 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec04e070 con 0x563c58f86c60 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3352196567 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc6f0026020 con 0x563c58f86c60 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc701411740 10 client.6321 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc701411740 10 client.6321 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc701411740 20 client.6321 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc701411740 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x563c58fab920 0x563c58fadd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc701411740 4 client.6321 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc701411740 1 -- 172.21.15.55:0/3352196567 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c58e6de60 con 0x563c58fab920 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.280+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x563c58fab920 0x563c58fadd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x563c58fab920 0x563c58fadd10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89697dc8b3de4df3 server_cookie=b91b49e278b50e09 in_seq=0 out_seq=0 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc6d6ffd640 10 client.6321 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3352196567 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563c58e6de60 con 0x563c58fab920 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc6d6ffd640 10 client.6321 handle_command_reply: tid=0 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc701411740 1 client.6321 shutdown 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc701411740 1 -- 172.21.15.55:0/3352196567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 msgr2=0x563c58f76f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc701411740 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f76f10 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00104e0 tx=0x7fc6f00109a0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc701411740 1 -- 172.21.15.55:0/3352196567 shutdown_connections 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc701411740 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x563c58fab920 0x563c58fadd10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc701411740 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f86c60 0x563c58f76f10 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc701411740 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f67640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc701411740 1 --2- 172.21.15.55:0/3352196567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f4a590 0x563c58f870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc6d6ffd640 0 client.6321 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.281+0000 7fc701411740 1 -- 172.21.15.55:0/3352196567 >> 172.21.15.55:0/3352196567 conn(0x563c58f126e0 msgr2=0x563c58f933b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.282+0000 7fc701411740 1 -- 172.21.15.55:0/3352196567 shutdown_connections 2024-04-25T08:57:00.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.282+0000 7fc701411740 1 -- 172.21.15.55:0/3352196567 wait complete. 2024-04-25T08:57:00.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.282+0000 7fc701411740 20 client.6321 trim_cache size 0 max 16384 2024-04-25T08:57:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.293+0000 7fc701411740 1 Processor -- start 2024-04-25T08:57:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.294+0000 7fc701411740 1 -- start start 2024-04-25T08:57:00.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.294+0000 7fc701411740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f9f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.294+0000 7fc701411740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f9fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.294+0000 7fc701411740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f86c60 0x563c58f66ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.294+0000 7fc701411740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80cd990 con 0x563c58f4a590 2024-04-25T08:57:00.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.294+0000 7fc701411740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f815c600 con 0x563c58f75050 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.294+0000 7fc701411740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80cd390 con 0x563c58f86c60 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.294+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f9f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.294+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f9f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59112/0 (socket says 172.21.15.55:59112) 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.294+0000 7fc6f7fff640 1 -- 172.21.15.55:0/2247766853 learned_addr learned my addr 172.21.15.55:0/2247766853 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/2247766853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f9fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6fcca6640 1 --2- 172.21.15.55:0/2247766853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f86c60 0x563c58f66ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6f7fff640 1 -- 172.21.15.55:0/2247766853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f86c60 msgr2=0x563c58f66ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/2247766853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f86c60 0x563c58f66ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6f7fff640 1 -- 172.21.15.55:0/2247766853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 msgr2=0x563c58f9fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/2247766853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f9fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6f7fff640 1 -- 172.21.15.55:0/2247766853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c58f40130 con 0x563c58f4a590 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6fcca6640 1 --2- 172.21.15.55:0/2247766853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f86c60 0x563c58f66ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/2247766853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f9fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/2247766853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f9f780 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8088650 tx=0x7fc6e8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d22d127bd43621 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6dd7fa640 1 -- 172.21.15.55:0/2247766853 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e801f040 con 0x563c58f4a590 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6dd7fa640 1 -- 172.21.15.55:0/2247766853 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e8056c30 con 0x563c58f4a590 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc6dd7fa640 1 -- 172.21.15.55:0/2247766853 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8070170 con 0x563c58f4a590 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc701411740 1 -- 172.21.15.55:0/2247766853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 msgr2=0x563c58f9f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc701411740 1 --2- 172.21.15.55:0/2247766853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f9f780 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8088650 tx=0x7fc6e8000bc0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc701411740 1 -- 172.21.15.55:0/2247766853 shutdown_connections 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc701411740 1 --2- 172.21.15.55:0/2247766853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f86c60 0x563c58f66ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc701411740 1 --2- 172.21.15.55:0/2247766853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f9fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc701411740 1 --2- 172.21.15.55:0/2247766853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f9f780 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.295+0000 7fc701411740 1 -- 172.21.15.55:0/2247766853 >> 172.21.15.55:0/2247766853 conn(0x563c58f126e0 msgr2=0x563c58f78310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.296+0000 7fc701411740 1 -- 172.21.15.55:0/2247766853 shutdown_connections 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.296+0000 7fc701411740 1 -- 172.21.15.55:0/2247766853 wait complete. 2024-04-25T08:57:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.296+0000 7fc701411740 1 -- start start 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.296+0000 7fc701411740 1 Processor -- start 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc701411740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f72500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc701411740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f67490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc701411740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f86c60 0x563c58faece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc701411740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c58fa9800 con 0x563c58f4a590 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc701411740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c58f67e20 con 0x563c58f75050 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc701411740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c58fa9ca0 con 0x563c58f86c60 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc701411740 10 client.0 _ll_register_callbacks cb 0x7fc6ec0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f72500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f72500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59114/0 (socket says 172.21.15.55:59114) 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc6f7fff640 1 -- 172.21.15.55:0/3964901334 learned_addr learned my addr 172.21.15.55:0/3964901334 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f67490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc6fcca6640 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f86c60 0x563c58faece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc6f7fff640 1 -- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f86c60 msgr2=0x563c58faece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f86c60 0x563c58faece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc6f7fff640 1 -- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 msgr2=0x563c58f67490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f67490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc6f7fff640 1 -- 172.21.15.55:0/3964901334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c58faf220 con 0x563c58f4a590 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.297+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f67490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc6f7fff640 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f72500 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8058630 tx=0x7fc6e801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6e3db11f732fe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc6d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3964901334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e801f070 con 0x563c58f4a590 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3964901334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6e8070370 con 0x563c58f4a590 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc701411740 1 -- 172.21.15.55:0/3964901334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc6e8056c30 con 0x563c58f4a590 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3964901334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6e800ce40 con 0x563c58f4a590 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc701411740 10 client.6327 fetch_fsmap learned FSMap version 29 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc701411740 1 -- 172.21.15.55:0/3964901334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x563c58f90d20 con 0x563c58f4a590 2024-04-25T08:57:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3964901334 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e8056c30 con 0x563c58f4a590 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3964901334 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc6e80771f0 con 0x563c58f4a590 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc701411740 10 client.6327 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc701411740 10 client.6327 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc701411740 20 client.6327 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc701411740 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x563c58f93410 0x563c58f937f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc701411740 4 client.6327 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc701411740 1 -- 172.21.15.55:0/3964901334 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x563c58ebb1a0 con 0x563c58f93410 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.298+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x563c58f93410 0x563c58f937f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc6f77fe640 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x563c58f93410 0x563c58f937f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46e6b9508f871218 server_cookie=c73f2c9bec1a15f6 in_seq=0 out_seq=0 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc6d6ffd640 10 client.6327 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc6d6ffd640 1 -- 172.21.15.55:0/3964901334 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+141 (crc 0 0 0) 0x563c58ebb1a0 con 0x563c58f93410 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc6d6ffd640 10 client.6327 handle_command_reply: tid=0 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 1 client.6327 shutdown 2024-04-25T08:57:00.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 1 -- 172.21.15.55:0/3964901334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 msgr2=0x563c58f72500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f72500 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8058630 tx=0x7fc6e801c040 comp rx=0 tx=0).stop 2024-04-25T08:57:00.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 1 -- 172.21.15.55:0/3964901334 shutdown_connections 2024-04-25T08:57:00.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x563c58f93410 0x563c58f937f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563c58f86c60 0x563c58faece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc6d6ffd640 0 client.6327 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c58f75050 0x563c58f67490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 1 --2- 172.21.15.55:0/3964901334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c58f4a590 0x563c58f72500 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 1 -- 172.21.15.55:0/3964901334 >> 172.21.15.55:0/3964901334 conn(0x563c58f126e0 msgr2=0x563c58f8a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 1 -- 172.21.15.55:0/3964901334 shutdown_connections 2024-04-25T08:57:00.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 1 -- 172.21.15.55:0/3964901334 wait complete. 2024-04-25T08:57:00.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.299+0000 7fc701411740 20 client.6327 trim_cache size 0 max 16384 2024-04-25T08:57:00.296 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:00.296 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T08:57:00.296 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:00.296 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "backtrace", 2024-04-25T08:57:00.296 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2900478428, 2024-04-25T08:57:00.296 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-25T08:57:00.296 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir_test/file" 2024-04-25T08:57:00.296 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:00.296 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T08:57:00.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 -- 172.21.15.55:0/2830805490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6e406b4d0 msgr2=0x7fc6e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6e406b4d0 0x7fc6e406d990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec034000 tx=0x7fc6ec02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:00.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 -- 172.21.15.55:0/2830805490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6f80b5a90 msgr2=0x7fc6f81f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6f80b5a90 0x7fc6f81f7be0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c7f0 tx=0x7fc6e800cbf0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 -- 172.21.15.55:0/2830805490 shutdown_connections 2024-04-25T08:57:00.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6e406b4d0 0x7fc6e406d990 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6f8161ce0 0x7fc6f8158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f8161120 0x7fc6f80c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 --2- 172.21.15.55:0/2830805490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6f80b5a90 0x7fc6f81f7be0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 -- 172.21.15.55:0/2830805490 >> 172.21.15.55:0/2830805490 conn(0x7fc6f80d0550 msgr2=0x7fc6f815fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 -- 172.21.15.55:0/2830805490 shutdown_connections 2024-04-25T08:57:00.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.300+0000 7fc6fe709640 1 -- 172.21.15.55:0/2830805490 wait complete. 2024-04-25T08:57:00.300 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T08:57:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.411+0000 7ffb1421f640 1 Processor -- start 2024-04-25T08:57:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.411+0000 7ffb1421f640 1 -- start start 2024-04-25T08:57:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb1421f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb0c15ba10 0x7ffb0c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb1421f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffb0c099f80 0x7ffb0c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb1421f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c06c680 con 0x7ffb0c06c1f0 2024-04-25T08:57:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb1421f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c0cbe50 con 0x7ffb0c15ba10 2024-04-25T08:57:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb1421f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c09a3d0 con 0x7ffb0c099f80 2024-04-25T08:57:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb11fbb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb0c15ba10 0x7ffb0c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb11fbb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb0c15ba10 0x7ffb0c099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59128/0 (socket says 172.21.15.55:59128) 2024-04-25T08:57:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb11fbb640 1 -- 172.21.15.55:0/3934601750 learned_addr learned my addr 172.21.15.55:0/3934601750 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb117ba640 1 --2- 172.21.15.55:0/3934601750 >> v2:172.21.15.167:3300/0 conn(0x7ffb0c099f80 0x7ffb0c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb11fbb640 1 -- 172.21.15.55:0/3934601750 >> v2:172.21.15.167:3300/0 conn(0x7ffb0c099f80 msgr2=0x7ffb0c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb11fbb640 1 --2- 172.21.15.55:0/3934601750 >> v2:172.21.15.167:3300/0 conn(0x7ffb0c099f80 0x7ffb0c06bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb11fbb640 1 -- 172.21.15.55:0/3934601750 >> v1:172.21.15.167:6789/0 conn(0x7ffb0c06c1f0 legacy=0x7ffb0c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb11fbb640 1 -- 172.21.15.55:0/3934601750 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c06c900 con 0x7ffb0c15ba10 2024-04-25T08:57:00.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.412+0000 7ffb117ba640 1 --2- 172.21.15.55:0/3934601750 >> v2:172.21.15.167:3300/0 conn(0x7ffb0c099f80 0x7ffb0c06bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.413+0000 7ffb11fbb640 1 --2- 172.21.15.55:0/3934601750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c15ba10 0x7ffb0c099a40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c09a9c0 tx=0x7ffb0802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a320c77aed95f36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.413+0000 7ffb10fb9640 1 -- 172.21.15.55:0/3934601750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08037070 con 0x7ffb0c15ba10 2024-04-25T08:57:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.413+0000 7ffb10fb9640 1 -- 172.21.15.55:0/3934601750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb08032440 con 0x7ffb0c15ba10 2024-04-25T08:57:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.413+0000 7ffb10fb9640 1 -- 172.21.15.55:0/3934601750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08032810 con 0x7ffb0c15ba10 2024-04-25T08:57:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.414+0000 7ffb1421f640 1 -- 172.21.15.55:0/3934601750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c15ba10 msgr2=0x7ffb0c099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.414+0000 7ffb1421f640 1 --2- 172.21.15.55:0/3934601750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c15ba10 0x7ffb0c099a40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c09a9c0 tx=0x7ffb0802a230 comp rx=0 tx=0).stop 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.414+0000 7ffb1421f640 1 -- 172.21.15.55:0/3934601750 shutdown_connections 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.414+0000 7ffb1421f640 1 --2- 172.21.15.55:0/3934601750 >> v2:172.21.15.167:3300/0 conn(0x7ffb0c099f80 0x7ffb0c06bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.414+0000 7ffb1421f640 1 --2- 172.21.15.55:0/3934601750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c15ba10 0x7ffb0c099a40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.414+0000 7ffb1421f640 1 -- 172.21.15.55:0/3934601750 >> 172.21.15.55:0/3934601750 conn(0x7ffb0c0b32f0 msgr2=0x7ffb0c0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.414+0000 7ffb1421f640 1 -- 172.21.15.55:0/3934601750 shutdown_connections 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.414+0000 7ffb1421f640 1 -- 172.21.15.55:0/3934601750 wait complete. 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.415+0000 7ffb1421f640 1 Processor -- start 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.415+0000 7ffb1421f640 1 -- start start 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb1421f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c06c1f0 0x7ffb0c158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb1421f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c099f80 0x7ffb0c0ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb1421f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c15ba10 0x7ffb0c0ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb1421f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c06cec0 con 0x7ffb0c15ba10 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb1421f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0cfe80 con 0x7ffb0c06c1f0 2024-04-25T08:57:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb1421f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0cd930 con 0x7ffb0c099f80 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb127bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c15ba10 0x7ffb0c0ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb127bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c15ba10 0x7ffb0c0ae9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59142/0 (socket says 172.21.15.55:59142) 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb127bc640 1 -- 172.21.15.55:0/3664107543 learned_addr learned my addr 172.21.15.55:0/3664107543 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb11fbb640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c06c1f0 0x7ffb0c158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb117ba640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c099f80 0x7ffb0c0ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb127bc640 1 -- 172.21.15.55:0/3664107543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c099f80 msgr2=0x7ffb0c0ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb127bc640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c099f80 0x7ffb0c0ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb127bc640 1 -- 172.21.15.55:0/3664107543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c06c1f0 msgr2=0x7ffb0c158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb127bc640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c06c1f0 0x7ffb0c158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb127bc640 1 -- 172.21.15.55:0/3664107543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c0af7a0 con 0x7ffb0c15ba10 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb117ba640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c099f80 0x7ffb0c0ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb127bc640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c15ba10 0x7ffb0c0ae9f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400c780 tx=0x7ffb0400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb027fc640 1 -- 172.21.15.55:0/3664107543 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04004b60 con 0x7ffb0c15ba10 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb027fc640 1 -- 172.21.15.55:0/3664107543 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb04004d00 con 0x7ffb0c15ba10 2024-04-25T08:57:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb027fc640 1 -- 172.21.15.55:0/3664107543 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400aa90 con 0x7ffb0c15ba10 2024-04-25T08:57:00.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb1421f640 1 -- 172.21.15.55:0/3664107543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c0afa80 con 0x7ffb0c15ba10 2024-04-25T08:57:00.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.416+0000 7ffb1421f640 1 -- 172.21.15.55:0/3664107543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c15d070 con 0x7ffb0c15ba10 2024-04-25T08:57:00.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.417+0000 7ffb1421f640 1 -- 172.21.15.55:0/3664107543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c15d330 con 0x7ffb0c15ba10 2024-04-25T08:57:00.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.418+0000 7ffb027fc640 1 -- 172.21.15.55:0/3664107543 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb0400ac30 con 0x7ffb0c15ba10 2024-04-25T08:57:00.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.418+0000 7ffb027fc640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 0x7ffaf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.419+0000 7ffb027fc640 1 -- 172.21.15.55:0/3664107543 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb0408a3d0 con 0x7ffb0c15ba10 2024-04-25T08:57:00.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.419+0000 7ffb11fbb640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 0x7ffaf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.419+0000 7ffb11fbb640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 0x7ffaf006d990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffb08034000 tx=0x7ffb0802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.423+0000 7ffb027fc640 1 -- 172.21.15.55:0/3664107543 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb04020070 con 0x7ffb0c15ba10 2024-04-25T08:57:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.642+0000 7ffb1421f640 1 -- 172.21.15.55:0/3664107543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffb0c09a570 con 0x7ffb0c15ba10 2024-04-25T08:57:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.642+0000 7ffb027fc640 1 -- 172.21.15.55:0/3664107543 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7ffb040592e0 con 0x7ffb0c15ba10 2024-04-25T08:57:00.632 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:00.632 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T08:57:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 -- 172.21.15.55:0/3664107543 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 msgr2=0x7ffaf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 0x7ffaf006d990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffb08034000 tx=0x7ffb0802e000 comp rx=0 tx=0).stop 2024-04-25T08:57:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 -- 172.21.15.55:0/3664107543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c15ba10 msgr2=0x7ffb0c0ae9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c15ba10 0x7ffb0c0ae9f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400c780 tx=0x7ffb0400cc40 comp rx=0 tx=0).stop 2024-04-25T08:57:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 -- 172.21.15.55:0/3664107543 shutdown_connections 2024-04-25T08:57:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ffaf006b4d0 0x7ffaf006d990 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0c15ba10 0x7ffb0c0ae9f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb0c099f80 0x7ffb0c0ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 --2- 172.21.15.55:0/3664107543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c06c1f0 0x7ffb0c158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 -- 172.21.15.55:0/3664107543 >> 172.21.15.55:0/3664107543 conn(0x7ffb0c0b32f0 msgr2=0x7ffb0c0cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 -- 172.21.15.55:0/3664107543 shutdown_connections 2024-04-25T08:57:00.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.644+0000 7ffb1421f640 1 -- 172.21.15.55:0/3664107543 wait complete. 2024-04-25T08:57:00.647 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T08:57:00.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.647 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-04-25T08:57:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.763+0000 7f1c75c1b640 1 Processor -- start 2024-04-25T08:57:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.763+0000 7f1c75c1b640 1 -- start start 2024-04-25T08:57:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c75c1b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7015ae20 0x7f1c700b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c75c1b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7006da40 con 0x7f1c700b4730 2024-04-25T08:57:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c75c1b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7006dd20 con 0x7f1c700aedc0 2024-04-25T08:57:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c75c1b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7015b280 con 0x7f1c7015ae20 2024-04-25T08:57:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1c700b4730 0x7f1c7015c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39516/0 (socket says 172.21.15.55:39516) 2024-04-25T08:57:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6ffff640 1 -- 172.21.15.55:0/4098155297 learned_addr learned my addr 172.21.15.55:0/4098155297 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6effd640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7015ae20 0x7f1c700b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419469251 0 0) 0x7f1c7006da40 con 0x7f1c700b4730 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c58003520 con 0x7f1c700b4730 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764151125 0 0) 0x7f1c7006dd20 con 0x7f1c700aedc0 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c7006da40 con 0x7f1c700aedc0 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1396145032 0 0) 0x7f1c58003520 con 0x7f1c700b4730 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7015ae20 msgr2=0x7f1c700b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6e7fc640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7015ae20 0x7f1c700b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 >> v1:172.21.15.167:6789/0 conn(0x7f1c700aedc0 legacy=0x7f1c7006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7006e000 con 0x7f1c700b4730 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f1c680019f0 con 0x7f1c700b4730 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.764+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 >> v1:172.21.15.55:6789/0 conn(0x7f1c700b4730 legacy=0x7f1c7015c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6e7fc640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c58003b70 0x7f1c58003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6e7fc640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7015ae20 0x7f1c58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6e7fc640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c58004d40 0x7f1c580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5800bb50 con 0x7f1c58003b70 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5800bcd0 con 0x7f1c58004d40 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5800bea0 con 0x7f1c7015ae20 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c58003b70 0x7f1c58003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c58004d40 0x7f1c580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6effd640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7015ae20 0x7f1c58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6f7fe640 1 -- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7015ae20 msgr2=0x7f1c58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7015ae20 0x7f1c58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6f7fe640 1 -- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c58004d40 msgr2=0x7f1c580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c58004d40 0x7f1c580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6f7fe640 1 -- 172.21.15.55:0/4098155297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58003520 con 0x7f1c58003b70 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c58004d40 0x7f1c580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.765+0000 7f1c6effd640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7015ae20 0x7f1c58004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.766+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c58003b70 0x7f1c58003f70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1c60001900 tx=0x7f1c58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2c572a696d58fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.766+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600014f0 con 0x7f1c58003b70 2024-04-25T08:57:00.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.766+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c600052d0 con 0x7f1c58003b70 2024-04-25T08:57:00.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.766+0000 7f1c6e7fc640 1 -- 172.21.15.55:0/4098155297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6002ac80 con 0x7f1c58003b70 2024-04-25T08:57:00.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.766+0000 7f1c75c1b640 1 -- 172.21.15.55:0/4098155297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c58003b70 msgr2=0x7f1c58003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.766+0000 7f1c75c1b640 1 --2- 172.21.15.55:0/4098155297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c58003b70 0x7f1c58003f70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1c60001900 tx=0x7f1c58005830 comp rx=0 tx=0).stop 2024-04-25T08:57:00.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.766+0000 7f1c6ffff640 1 -- 172.21.15.55:0/4098155297 reap_dead start 2024-04-25T08:57:00.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.766+0000 7f1c75c1b640 1 -- 172.21.15.55:0/4098155297 shutdown_connections 2024-04-25T08:57:00.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.766+0000 7f1c75c1b640 1 -- 172.21.15.55:0/4098155297 >> 172.21.15.55:0/4098155297 conn(0x7f1c7006aba0 msgr2=0x7f1c7006af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.766+0000 7f1c75c1b640 1 -- 172.21.15.55:0/4098155297 shutdown_connections 2024-04-25T08:57:00.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.766+0000 7f1c75c1b640 1 -- 172.21.15.55:0/4098155297 wait complete. 2024-04-25T08:57:00.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.768+0000 7f1c75c1b640 1 Processor -- start 2024-04-25T08:57:00.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.768+0000 7f1c75c1b640 1 -- start start 2024-04-25T08:57:00.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c75c1b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c58003b70 0x7f1c700a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c75c1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c700aa5e0 0x7f1c700ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c75c1b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c700abc20 0x7f1c700ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c75c1b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700af1a0 con 0x7f1c700aa5e0 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c75c1b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7015c050 con 0x7f1c58003b70 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c75c1b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700b41f0 con 0x7f1c700abc20 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c700aa5e0 0x7f1c700ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c700aa5e0 0x7f1c700ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59164/0 (socket says 172.21.15.55:59164) 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6effd640 1 -- 172.21.15.55:0/1229532742 learned_addr learned my addr 172.21.15.55:0/1229532742 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c58003b70 0x7f1c700a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c700abc20 0x7f1c700ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6effd640 1 -- 172.21.15.55:0/1229532742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c700abc20 msgr2=0x7f1c700ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6effd640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c700abc20 0x7f1c700ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6effd640 1 -- 172.21.15.55:0/1229532742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c58003b70 msgr2=0x7f1c700a9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6effd640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c58003b70 0x7f1c700a9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6effd640 1 -- 172.21.15.55:0/1229532742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c700aab80 con 0x7f1c700aa5e0 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c58003b70 0x7f1c700a9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c700abc20 0x7f1c700ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c6effd640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c700aa5e0 0x7f1c700ad270 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1c64011730 tx=0x7f1c64011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c57fff640 1 -- 172.21.15.55:0/1229532742 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400f9c0 con 0x7f1c700aa5e0 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c57fff640 1 -- 172.21.15.55:0/1229532742 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6400fb60 con 0x7f1c700aa5e0 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c75c1b640 1 -- 172.21.15.55:0/1229532742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c700aae60 con 0x7f1c700aa5e0 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c57fff640 1 -- 172.21.15.55:0/1229532742 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64015460 con 0x7f1c700aa5e0 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.769+0000 7f1c75c1b640 1 -- 172.21.15.55:0/1229532742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c700ab420 con 0x7f1c700aa5e0 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.771+0000 7f1c57fff640 1 -- 172.21.15.55:0/1229532742 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c64015600 con 0x7f1c700aa5e0 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.772+0000 7f1c57fff640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1c5c06b500 0x7f1c5c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.772+0000 7f1c57fff640 1 -- 172.21.15.55:0/1229532742 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c6408ac60 con 0x7f1c700aa5e0 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.772+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1c5c06b500 0x7f1c5c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.772+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1c5c06b500 0x7f1c5c06d9c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1c60032000 tx=0x7f1c60009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.773+0000 7f1c789f1740 1 Processor -- start 2024-04-25T08:57:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.773+0000 7f1c789f1740 1 -- start start 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.773+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e374f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.773+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e07370 0x55e910e0d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.773+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e53070 0x55e910e534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.773+0000 7f1c789f1740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e910d6fbc0 con 0x55e910e07370 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.773+0000 7f1c789f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e910d18e70 con 0x55e910e37110 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.773+0000 7f1c789f1740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e910d6bc60 con 0x55e910e53070 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c6effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e07370 0x55e910e0d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c6effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e07370 0x55e910e0d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59176/0 (socket says 172.21.15.55:59176) 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c6effd640 1 -- 172.21.15.55:0/2535945819 learned_addr learned my addr 172.21.15.55:0/2535945819 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/2535945819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c6effd640 1 -- 172.21.15.55:0/2535945819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e53070 msgr2=0x55e910e534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c6effd640 1 --2- 172.21.15.55:0/2535945819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e53070 0x55e910e534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c6effd640 1 -- 172.21.15.55:0/2535945819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 msgr2=0x55e910e374f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c6effd640 1 --2- 172.21.15.55:0/2535945819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e374f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c6effd640 1 -- 172.21.15.55:0/2535945819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e910d39ad0 con 0x55e910e07370 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/2535945819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c6effd640 1 --2- 172.21.15.55:0/2535945819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e07370 0x55e910e0d3a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1c64089060 tx=0x7f1c64058fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7101d8729c8af3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c557fa640 1 -- 172.21.15.55:0/2535945819 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64088070 con 0x55e910e07370 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c557fa640 1 -- 172.21.15.55:0/2535945819 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6401bdc0 con 0x55e910e07370 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.774+0000 7f1c557fa640 1 -- 172.21.15.55:0/2535945819 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6405d170 con 0x55e910e07370 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.775+0000 7f1c789f1740 1 -- 172.21.15.55:0/2535945819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e07370 msgr2=0x55e910e0d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.775+0000 7f1c789f1740 1 --2- 172.21.15.55:0/2535945819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e07370 0x55e910e0d3a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1c64089060 tx=0x7f1c64058fb0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.775+0000 7f1c789f1740 1 -- 172.21.15.55:0/2535945819 shutdown_connections 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.775+0000 7f1c789f1740 1 --2- 172.21.15.55:0/2535945819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e53070 0x55e910e534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.775+0000 7f1c789f1740 1 --2- 172.21.15.55:0/2535945819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e07370 0x55e910e0d3a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.775+0000 7f1c789f1740 1 --2- 172.21.15.55:0/2535945819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.775+0000 7f1c789f1740 1 -- 172.21.15.55:0/2535945819 >> 172.21.15.55:0/2535945819 conn(0x55e910e095e0 msgr2=0x55e910e51f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.775+0000 7f1c789f1740 1 -- 172.21.15.55:0/2535945819 shutdown_connections 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.775+0000 7f1c789f1740 1 -- 172.21.15.55:0/2535945819 wait complete. 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.776+0000 7f1c789f1740 1 -- start start 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.776+0000 7f1c789f1740 1 Processor -- start 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.776+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e32bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.776+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e53070 0x55e910e52390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.776+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e35f70 0x55e910e363f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.776+0000 7f1c789f1740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e910e0d8e0 con 0x55e910e35f70 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.776+0000 7f1c789f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e910d0e4e0 con 0x55e910e37110 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.776+0000 7f1c789f1740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e910e0cf10 con 0x55e910e53070 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.776+0000 7f1c789f1740 10 client.0 _ll_register_callbacks cb 0x55e910d2bde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e35f70 0x55e910e363f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e35f70 0x55e910e363f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59188/0 (socket says 172.21.15.55:59188) 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6ffff640 1 -- 172.21.15.55:0/741751943 learned_addr learned my addr 172.21.15.55:0/741751943 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e32bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6effd640 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e53070 0x55e910e52390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6ffff640 1 -- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e53070 msgr2=0x55e910e52390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e53070 0x55e910e52390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6ffff640 1 -- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 msgr2=0x55e910e32bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e32bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6ffff640 1 -- 172.21.15.55:0/741751943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e910b50940 con 0x55e910e35f70 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6effd640 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e53070 0x55e910e52390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e35f70 0x55e910e363f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1c68001350 tx=0x7f1c68007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15b66a069f3438b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/741751943 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68010040 con 0x55e910e35f70 2024-04-25T08:57:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/741751943 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c6800f8a0 con 0x55e910e35f70 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c789f1740 1 -- 172.21.15.55:0/741751943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c6401bdc0 con 0x55e910e35f70 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/741751943 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c68021050 con 0x55e910e35f70 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c789f1740 10 client.6345 fetch_fsmap learned FSMap version 29 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c789f1740 1 -- 172.21.15.55:0/741751943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x55e910bb10d0 con 0x55e910e35f70 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.777+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/741751943 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6401bdc0 con 0x55e910e35f70 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.778+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/741751943 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1c68024020 con 0x55e910e35f70 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.778+0000 7f1c789f1740 10 client.6345 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.778+0000 7f1c789f1740 10 client.6345 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.778+0000 7f1c789f1740 20 client.6345 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.778+0000 7f1c789f1740 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55e910e6a070 0x55e910e6a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.778+0000 7f1c789f1740 4 client.6345 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.778+0000 7f1c789f1740 1 -- 172.21.15.55:0/741751943 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e910d7d100 con 0x55e910e6a070 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.778+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55e910e6a070 0x55e910e6a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.778+0000 7f1c4e7fc640 10 client.6345 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.778+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55e910e6a070 0x55e910e6a450 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ccbdbe44474f3bf server_cookie=b42d4b4dc2a3748e in_seq=0 out_seq=0 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/741751943 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e910d7d100 con 0x55e910e6a070 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c4e7fc640 10 client.6345 handle_command_reply: tid=0 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c789f1740 1 client.6345 shutdown 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c789f1740 1 -- 172.21.15.55:0/741751943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e35f70 msgr2=0x55e910e363f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c789f1740 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e35f70 0x55e910e363f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1c68001350 tx=0x7f1c68007850 comp rx=0 tx=0).stop 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c789f1740 1 -- 172.21.15.55:0/741751943 shutdown_connections 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c789f1740 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55e910e6a070 0x55e910e6a450 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c789f1740 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e35f70 0x55e910e363f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c789f1740 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e53070 0x55e910e52390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c4e7fc640 0 client.6345 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c789f1740 1 --2- 172.21.15.55:0/741751943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e32bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c789f1740 1 -- 172.21.15.55:0/741751943 >> 172.21.15.55:0/741751943 conn(0x55e910e07370 msgr2=0x55e910e33750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c789f1740 1 -- 172.21.15.55:0/741751943 shutdown_connections 2024-04-25T08:57:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.779+0000 7f1c789f1740 1 -- 172.21.15.55:0/741751943 wait complete. 2024-04-25T08:57:00.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.780+0000 7f1c789f1740 20 client.6345 trim_cache size 0 max 16384 2024-04-25T08:57:00.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.795+0000 7f1c789f1740 1 Processor -- start 2024-04-25T08:57:00.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.795+0000 7f1c789f1740 1 -- start start 2024-04-25T08:57:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.795+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e35f70 0x55e910e31220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.795+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e37110 0x55e910e0ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.795+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910e0b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c789f1740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c701fc0f0 con 0x55e910e53070 2024-04-25T08:57:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c789f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700cf610 con 0x55e910e35f70 2024-04-25T08:57:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c789f1740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700cea10 con 0x55e910e37110 2024-04-25T08:57:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910e0b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910e0b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59190/0 (socket says 172.21.15.55:59190) 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6ffff640 1 -- 172.21.15.55:0/3366499265 learned_addr learned my addr 172.21.15.55:0/3366499265 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/3366499265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e35f70 0x55e910e31220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6ffff640 1 -- 172.21.15.55:0/3366499265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e37110 msgr2=0x55e910e0ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6effd640 1 --2- 172.21.15.55:0/3366499265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e37110 0x55e910e0ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/3366499265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e37110 0x55e910e0ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6ffff640 1 -- 172.21.15.55:0/3366499265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e35f70 msgr2=0x55e910e31220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/3366499265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e35f70 0x55e910e31220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6ffff640 1 -- 172.21.15.55:0/3366499265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e910a44230 con 0x55e910e53070 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/3366499265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e35f70 0x55e910e31220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/3366499265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910e0b0c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1c68001580 tx=0x7f1c68013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980a3034299f342d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c54ff9640 1 -- 172.21.15.55:0/3366499265 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800f8a0 con 0x55e910e53070 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c54ff9640 1 -- 172.21.15.55:0/3366499265 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68019070 con 0x55e910e53070 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.796+0000 7f1c54ff9640 1 -- 172.21.15.55:0/3366499265 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68014650 con 0x55e910e53070 2024-04-25T08:57:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.797+0000 7f1c789f1740 1 -- 172.21.15.55:0/3366499265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 msgr2=0x55e910e0b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.797+0000 7f1c789f1740 1 --2- 172.21.15.55:0/3366499265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910e0b0c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1c68001580 tx=0x7f1c68013000 comp rx=0 tx=0).stop 2024-04-25T08:57:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.797+0000 7f1c789f1740 1 -- 172.21.15.55:0/3366499265 shutdown_connections 2024-04-25T08:57:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.797+0000 7f1c789f1740 1 --2- 172.21.15.55:0/3366499265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910e0b0c0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.797+0000 7f1c789f1740 1 --2- 172.21.15.55:0/3366499265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e37110 0x55e910e0ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.797+0000 7f1c789f1740 1 --2- 172.21.15.55:0/3366499265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e35f70 0x55e910e31220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.797+0000 7f1c789f1740 1 -- 172.21.15.55:0/3366499265 >> 172.21.15.55:0/3366499265 conn(0x55e910e07370 msgr2=0x55e910e3ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.797+0000 7f1c789f1740 1 -- 172.21.15.55:0/3366499265 shutdown_connections 2024-04-25T08:57:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.797+0000 7f1c789f1740 1 -- 172.21.15.55:0/3366499265 wait complete. 2024-04-25T08:57:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.798+0000 7f1c789f1740 1 -- start start 2024-04-25T08:57:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.798+0000 7f1c789f1740 1 Processor -- start 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.798+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e35f70 0x55e910eaa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.798+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e3a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.798+0000 7f1c789f1740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910eb8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.798+0000 7f1c789f1740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700cf010 con 0x55e910e53070 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.798+0000 7f1c789f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e910e56290 con 0x55e910e37110 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.798+0000 7f1c789f1740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e910eb8c90 con 0x55e910e35f70 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.798+0000 7f1c789f1740 10 client.0 _ll_register_callbacks cb 0x55e910e07170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.798+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910eb8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.798+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910eb8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59200/0 (socket says 172.21.15.55:59200) 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c6ffff640 1 -- 172.21.15.55:0/3195475014 learned_addr learned my addr 172.21.15.55:0/3195475014 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c6effd640 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e3a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e35f70 0x55e910eaa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c6ffff640 1 -- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e35f70 msgr2=0x55e910eaa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e35f70 0x55e910eaa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c6ffff640 1 -- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 msgr2=0x55e910e3a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e3a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c6ffff640 1 -- 172.21.15.55:0/3195475014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e910e3a930 con 0x55e910e53070 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c6ffff640 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910eb8080 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1c68001350 tx=0x7f1c68001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79fba9f10aebca0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/3195475014 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68034030 con 0x55e910e53070 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/3195475014 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c6800fd80 con 0x55e910e53070 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c789f1740 1 -- 172.21.15.55:0/3195475014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c68019070 con 0x55e910e53070 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/3195475014 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c6802e450 con 0x55e910e53070 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c789f1740 10 client.6351 fetch_fsmap learned FSMap version 29 2024-04-25T08:57:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c789f1740 1 -- 172.21.15.55:0/3195475014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x55e910eb8a90 con 0x55e910e53070 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/3195475014 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68019070 con 0x55e910e53070 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/3195475014 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1c68024070 con 0x55e910e53070 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.799+0000 7f1c789f1740 10 client.6351 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.800+0000 7f1c789f1740 10 client.6351 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.800+0000 7f1c789f1740 20 client.6351 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.800+0000 7f1c789f1740 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55e910eb85c0 0x55e910e0a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.800+0000 7f1c789f1740 4 client.6351 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.800+0000 7f1c789f1740 1 -- 172.21.15.55:0/3195475014 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) v1 -- 0x55e910d77450 con 0x55e910eb85c0 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.800+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55e910eb85c0 0x55e910e0a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.800+0000 7f1c6f7fe640 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55e910eb85c0 0x55e910e0a9f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbf80b178365790 server_cookie=48c2750e0a1d5147 in_seq=0 out_seq=0 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.800+0000 7f1c4e7fc640 10 client.6351 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c4e7fc640 1 -- 172.21.15.55:0/3195475014 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e910d77450 con 0x55e910eb85c0 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c4e7fc640 10 client.6351 handle_command_reply: tid=0 2024-04-25T08:57:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 1 client.6351 shutdown 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 1 -- 172.21.15.55:0/3195475014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 msgr2=0x55e910eb8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910eb8080 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1c68001350 tx=0x7f1c68001e60 comp rx=0 tx=0).stop 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 1 -- 172.21.15.55:0/3195475014 shutdown_connections 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x55e910eb85c0 0x55e910e0a9f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e910e53070 0x55e910eb8080 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e910e37110 0x55e910e3a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c4e7fc640 0 client.6351 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 1 --2- 172.21.15.55:0/3195475014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e910e35f70 0x55e910eaa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 1 -- 172.21.15.55:0/3195475014 >> 172.21.15.55:0/3195475014 conn(0x55e910e07370 msgr2=0x55e910e3ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 1 -- 172.21.15.55:0/3195475014 shutdown_connections 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 1 -- 172.21.15.55:0/3195475014 wait complete. 2024-04-25T08:57:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.801+0000 7f1c789f1740 20 client.6351 trim_cache size 0 max 16384 2024-04-25T08:57:00.797 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:57:00.797 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-25T08:57:00.797 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "193a142e-5a1a-46d9-ae93-3e4b695724a3", 2024-04-25T08:57:00.797 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-25T08:57:00.797 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:57:00.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 -- 172.21.15.55:0/1229532742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1c5c06b500 msgr2=0x7f1c5c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1c5c06b500 0x7f1c5c06d9c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1c60032000 tx=0x7f1c60009030 comp rx=0 tx=0).stop 2024-04-25T08:57:00.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 -- 172.21.15.55:0/1229532742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c700aa5e0 msgr2=0x7f1c700ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c700aa5e0 0x7f1c700ad270 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1c64011730 tx=0x7f1c64011bf0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 -- 172.21.15.55:0/1229532742 shutdown_connections 2024-04-25T08:57:00.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1c5c06b500 0x7f1c5c06d9c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c700abc20 0x7f1c700ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c700aa5e0 0x7f1c700ad270 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 --2- 172.21.15.55:0/1229532742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c58003b70 0x7f1c700a9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 -- 172.21.15.55:0/1229532742 >> 172.21.15.55:0/1229532742 conn(0x7f1c7006aba0 msgr2=0x7f1c7015a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 -- 172.21.15.55:0/1229532742 shutdown_connections 2024-04-25T08:57:00.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.802+0000 7f1c75c1b640 1 -- 172.21.15.55:0/1229532742 wait complete. 2024-04-25T08:57:00.799 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-04-25T08:57:00.801+0000 7fb0c57d1640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6228=0-4194304@1} caps={6228=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6228 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x561e1b8e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T08:57:00.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:00.802 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.916+0000 7fc69df63640 1 Processor -- start 2024-04-25T08:57:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.916+0000 7fc69df63640 1 -- start start 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc69df63640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc69815dca0 0x7fc6980ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc69df63640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6980d3b90 0x7fc6980d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc69df63640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6980cee80 0x7fc6980d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc69df63640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6980b6b20 con 0x7fc6980cee80 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc69df63640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6980d4090 con 0x7fc69815dca0 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc69df63640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980d4370 con 0x7fc6980d3b90 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc697fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6980cee80 0x7fc6980d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc697fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6980cee80 0x7fc6980d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59208/0 (socket says 172.21.15.55:59208) 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc697fff640 1 -- 172.21.15.55:0/4220058977 learned_addr learned my addr 172.21.15.55:0/4220058977 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc6977fe640 1 --2- 172.21.15.55:0/4220058977 >> v2:172.21.15.167:3300/0 conn(0x7fc69815dca0 0x7fc6980ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc696ffd640 1 --2- 172.21.15.55:0/4220058977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6980d3b90 0x7fc6980d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc697fff640 1 -- 172.21.15.55:0/4220058977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6980d3b90 msgr2=0x7fc6980d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc697fff640 1 --2- 172.21.15.55:0/4220058977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6980d3b90 0x7fc6980d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc697fff640 1 -- 172.21.15.55:0/4220058977 >> v2:172.21.15.167:3300/0 conn(0x7fc69815dca0 msgr2=0x7fc6980ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc697fff640 1 --2- 172.21.15.55:0/4220058977 >> v2:172.21.15.167:3300/0 conn(0x7fc69815dca0 0x7fc6980ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc697fff640 1 -- 172.21.15.55:0/4220058977 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6980d4650 con 0x7fc6980cee80 2024-04-25T08:57:00.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.917+0000 7fc6977fe640 1 --2- 172.21.15.55:0/4220058977 >> v2:172.21.15.167:3300/0 conn(0x7fc69815dca0 0x7fc6980ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:00.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.918+0000 7fc697fff640 1 --2- 172.21.15.55:0/4220058977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6980cee80 0x7fc6980d0f60 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc6980b6340 tx=0x7fc69002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2963a241f2d55ad5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.918+0000 7fc6967fc640 1 -- 172.21.15.55:0/4220058977 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690036070 con 0x7fc6980cee80 2024-04-25T08:57:00.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.918+0000 7fc6967fc640 1 -- 172.21.15.55:0/4220058977 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc690031600 con 0x7fc6980cee80 2024-04-25T08:57:00.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.918+0000 7fc6967fc640 1 -- 172.21.15.55:0/4220058977 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900319d0 con 0x7fc6980cee80 2024-04-25T08:57:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.919+0000 7fc69df63640 1 -- 172.21.15.55:0/4220058977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6980cee80 msgr2=0x7fc6980d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.919+0000 7fc69df63640 1 --2- 172.21.15.55:0/4220058977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6980cee80 0x7fc6980d0f60 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc6980b6340 tx=0x7fc69002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.919+0000 7fc69df63640 1 -- 172.21.15.55:0/4220058977 shutdown_connections 2024-04-25T08:57:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.919+0000 7fc69df63640 1 --2- 172.21.15.55:0/4220058977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6980cee80 0x7fc6980d0f60 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.919+0000 7fc69df63640 1 --2- 172.21.15.55:0/4220058977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6980d3b90 0x7fc6980d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.919+0000 7fc69df63640 1 --2- 172.21.15.55:0/4220058977 >> v2:172.21.15.167:3300/0 conn(0x7fc69815dca0 0x7fc6980ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.919+0000 7fc69df63640 1 -- 172.21.15.55:0/4220058977 >> 172.21.15.55:0/4220058977 conn(0x7fc6980726c0 msgr2=0x7fc698072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.919+0000 7fc69df63640 1 -- 172.21.15.55:0/4220058977 shutdown_connections 2024-04-25T08:57:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.919+0000 7fc69df63640 1 -- 172.21.15.55:0/4220058977 wait complete. 2024-04-25T08:57:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.920+0000 7fc69df63640 1 Processor -- start 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.920+0000 7fc69df63640 1 -- start start 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc69df63640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6980cee80 0x7fc698160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc69df63640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6980d3b90 0x7fc6980ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc69df63640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc69815dca0 0x7fc6981f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc69df63640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69815e200 con 0x7fc6980cee80 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc69df63640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69815e080 con 0x7fc6980d3b90 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc69df63640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980b2500 con 0x7fc69815dca0 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc6977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6980cee80 0x7fc698160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc6977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6980cee80 0x7fc698160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59220/0 (socket says 172.21.15.55:59220) 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc6977fe640 1 -- 172.21.15.55:0/4242796394 learned_addr learned my addr 172.21.15.55:0/4242796394 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc696ffd640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6980d3b90 0x7fc6980ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc6977fe640 1 -- 172.21.15.55:0/4242796394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc69815dca0 msgr2=0x7fc6981f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc697fff640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc69815dca0 0x7fc6981f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc6977fe640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc69815dca0 0x7fc6981f2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc6977fe640 1 -- 172.21.15.55:0/4242796394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6980d3b90 msgr2=0x7fc6980ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc6977fe640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6980d3b90 0x7fc6980ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc6977fe640 1 -- 172.21.15.55:0/4242796394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69815e420 con 0x7fc6980cee80 2024-04-25T08:57:00.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc696ffd640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6980d3b90 0x7fc6980ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:00.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.921+0000 7fc6977fe640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6980cee80 0x7fc698160ac0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc68800d800 tx=0x7fc68800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.922+0000 7fc67ffff640 1 -- 172.21.15.55:0/4242796394 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688004030 con 0x7fc6980cee80 2024-04-25T08:57:00.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.922+0000 7fc67ffff640 1 -- 172.21.15.55:0/4242796394 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6880041d0 con 0x7fc6980cee80 2024-04-25T08:57:00.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.922+0000 7fc69df63640 1 -- 172.21.15.55:0/4242796394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69815e6c0 con 0x7fc6980cee80 2024-04-25T08:57:00.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.922+0000 7fc67ffff640 1 -- 172.21.15.55:0/4242796394 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688009640 con 0x7fc6980cee80 2024-04-25T08:57:00.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.922+0000 7fc69df63640 1 -- 172.21.15.55:0/4242796394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc698161000 con 0x7fc6980cee80 2024-04-25T08:57:00.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.924+0000 7fc67ffff640 1 -- 172.21.15.55:0/4242796394 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc6880097e0 con 0x7fc6980cee80 2024-04-25T08:57:00.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.924+0000 7fc67ffff640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc68406b4d0 0x7fc68406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.924+0000 7fc67ffff640 1 -- 172.21.15.55:0/4242796394 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc68808a3c0 con 0x7fc6980cee80 2024-04-25T08:57:00.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.924+0000 7fc696ffd640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc68406b4d0 0x7fc68406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.925+0000 7fc696ffd640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc68406b4d0 0x7fc68406d990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc6980ce690 tx=0x7fc68c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.925+0000 7fc6a0c6e740 1 Processor -- start 2024-04-25T08:57:00.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.925+0000 7fc6a0c6e740 1 -- start start 2024-04-25T08:57:00.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f5753b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 0x555f5753b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5750b770 0x555f5750ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f57474da0 con 0x555f57538b10 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5741db80 con 0x555f5750b770 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f57470e40 con 0x555f57538ef0 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f5753b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f5753b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59234/0 (socket says 172.21.15.55:59234) 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6977fe640 1 -- 172.21.15.55:0/1693713517 learned_addr learned my addr 172.21.15.55:0/1693713517 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc697fff640 1 --2- 172.21.15.55:0/1693713517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5750b770 0x555f5750ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc696ffd640 1 --2- 172.21.15.55:0/1693713517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 0x555f5753b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6977fe640 1 -- 172.21.15.55:0/1693713517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 msgr2=0x555f5753b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6977fe640 1 --2- 172.21.15.55:0/1693713517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 0x555f5753b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6977fe640 1 -- 172.21.15.55:0/1693713517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5750b770 msgr2=0x555f5750ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6977fe640 1 --2- 172.21.15.55:0/1693713517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5750b770 0x555f5750ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6977fe640 1 -- 172.21.15.55:0/1693713517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f57427f10 con 0x555f57538b10 2024-04-25T08:57:00.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc697fff640 1 --2- 172.21.15.55:0/1693713517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5750b770 0x555f5750ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc6977fe640 1 --2- 172.21.15.55:0/1693713517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f5753b320 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc6880889a0 tx=0x7fc688059410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be131edaba53cc77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.926+0000 7fc67d7fa640 1 -- 172.21.15.55:0/1693713517 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688070020 con 0x555f57538b10 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.927+0000 7fc67d7fa640 1 -- 172.21.15.55:0/1693713517 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6880612e0 con 0x555f57538b10 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.927+0000 7fc67d7fa640 1 -- 172.21.15.55:0/1693713517 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688056ed0 con 0x555f57538b10 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.927+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/1693713517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 msgr2=0x555f5753b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.927+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/1693713517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f5753b320 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc6880889a0 tx=0x7fc688059410 comp rx=0 tx=0).stop 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.927+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/1693713517 shutdown_connections 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.927+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/1693713517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5750b770 0x555f5750ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.927+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/1693713517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 0x555f5753b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.927+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/1693713517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f5753b320 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.927+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/1693713517 >> 172.21.15.55:0/1693713517 conn(0x555f5750d9e0 msgr2=0x555f57556320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.927+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/1693713517 shutdown_connections 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.927+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/1693713517 wait complete. 2024-04-25T08:57:00.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.928+0000 7fc6a0c6e740 1 -- start start 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.928+0000 7fc6a0c6e740 1 Processor -- start 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f57538b10 0x555f5752e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 0x555f5755c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5755ce30 0x555f575379a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f57510b90 con 0x555f5755ce30 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f574134b0 con 0x555f57538b10 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f57510e70 con 0x555f57538ef0 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6a0c6e740 10 client.0 _ll_register_callbacks cb 0x555f57453180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc697fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5755ce30 0x555f575379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc697fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5755ce30 0x555f575379a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59248/0 (socket says 172.21.15.55:59248) 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc697fff640 1 -- 172.21.15.55:0/445940535 learned_addr learned my addr 172.21.15.55:0/445940535 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6977fe640 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f57538b10 0x555f5752e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc697fff640 1 -- 172.21.15.55:0/445940535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 msgr2=0x555f5755c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc697fff640 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 0x555f5755c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc697fff640 1 -- 172.21.15.55:0/445940535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f57538b10 msgr2=0x555f5752e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc697fff640 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f57538b10 0x555f5752e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc697fff640 1 -- 172.21.15.55:0/445940535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f572537d0 con 0x555f5755ce30 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc697fff640 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5755ce30 0x555f575379a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc690009f40 tx=0x7fc690004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a5d539fc0fbf7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6767fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6767fc640 1 -- 172.21.15.55:0/445940535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690042070 con 0x555f5755ce30 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6767fc640 1 -- 172.21.15.55:0/445940535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc69003c450 con 0x555f5755ce30 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.929+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/445940535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc6880612e0 con 0x555f5755ce30 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6767fc640 1 -- 172.21.15.55:0/445940535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc69004d050 con 0x555f5755ce30 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6a0c6e740 10 client.6363 fetch_fsmap learned FSMap version 29 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/445940535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x555f571893f0 con 0x555f5755ce30 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6767fc640 1 -- 172.21.15.55:0/445940535 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6880612e0 con 0x555f5755ce30 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6767fc640 1 -- 172.21.15.55:0/445940535 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc690050020 con 0x555f5755ce30 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6a0c6e740 10 client.6363 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T08:57:00.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6a0c6e740 10 client.6363 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6a0c6e740 20 client.6363 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x555f5752f210 0x555f5752f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6a0c6e740 4 client.6363 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/445940535 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f574822e0 con 0x555f5752f210 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6977fe640 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x555f5752f210 0x555f5752f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6767fc640 10 client.6363 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.930+0000 7fc6977fe640 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x555f5752f210 0x555f5752f640 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7fb162baaefb6a1 server_cookie=f8e63a98c28d0cac in_seq=0 out_seq=0 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6767fc640 1 -- 172.21.15.55:0/445940535 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555f574822e0 con 0x555f5752f210 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6767fc640 10 client.6363 handle_command_reply: tid=0 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 1 client.6363 shutdown 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/445940535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5755ce30 msgr2=0x555f575379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5755ce30 0x555f575379a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc690009f40 tx=0x7fc690004ab0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/445940535 shutdown_connections 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x555f5752f210 0x555f5752f640 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5755ce30 0x555f575379a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 0x555f5755c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6767fc640 0 client.6363 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/445940535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f57538b10 0x555f5752e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/445940535 >> 172.21.15.55:0/445940535 conn(0x555f5750b770 msgr2=0x555f5750c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/445940535 shutdown_connections 2024-04-25T08:57:00.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/445940535 wait complete. 2024-04-25T08:57:00.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.931+0000 7fc6a0c6e740 20 client.6363 trim_cache size 0 max 16384 2024-04-25T08:57:00.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.947+0000 7fc6a0c6e740 1 Processor -- start 2024-04-25T08:57:00.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.947+0000 7fc6a0c6e740 1 -- start start 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.947+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f5752f210 0x555f57553210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.947+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f57538b10 0x555f5755e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.947+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538ef0 0x555f5753ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.947+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6981ffe50 con 0x555f57538ef0 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.947+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6981ff040 con 0x555f57538b10 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.947+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6981f78b0 con 0x555f5752f210 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc697fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538ef0 0x555f5753ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc697fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538ef0 0x555f5753ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59256/0 (socket says 172.21.15.55:59256) 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc697fff640 1 -- 172.21.15.55:0/2399361678 learned_addr learned my addr 172.21.15.55:0/2399361678 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc696ffd640 1 --2- 172.21.15.55:0/2399361678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f57538b10 0x555f5755e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc697fff640 1 -- 172.21.15.55:0/2399361678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f5752f210 msgr2=0x555f57553210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc697fff640 1 --2- 172.21.15.55:0/2399361678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f5752f210 0x555f57553210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc697fff640 1 -- 172.21.15.55:0/2399361678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f57538b10 msgr2=0x555f5755e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc697fff640 1 --2- 172.21.15.55:0/2399361678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f57538b10 0x555f5755e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc697fff640 1 -- 172.21.15.55:0/2399361678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f571490f0 con 0x555f57538ef0 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc696ffd640 1 --2- 172.21.15.55:0/2399361678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f57538b10 0x555f5755e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc697fff640 1 --2- 172.21.15.55:0/2399361678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538ef0 0x555f5753ed40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc69002a6e0 tx=0x7fc69003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c101feebd019b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc67cff9640 1 -- 172.21.15.55:0/2399361678 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690042040 con 0x555f57538ef0 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc67cff9640 1 -- 172.21.15.55:0/2399361678 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69003c450 con 0x555f57538ef0 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.948+0000 7fc67cff9640 1 -- 172.21.15.55:0/2399361678 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690036040 con 0x555f57538ef0 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.949+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/2399361678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538ef0 msgr2=0x555f5753ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.949+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/2399361678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538ef0 0x555f5753ed40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc69002a6e0 tx=0x7fc69003c000 comp rx=0 tx=0).stop 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.949+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/2399361678 shutdown_connections 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.949+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/2399361678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538ef0 0x555f5753ed40 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.949+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/2399361678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f57538b10 0x555f5755e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.949+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/2399361678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f5752f210 0x555f57553210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.949+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/2399361678 >> 172.21.15.55:0/2399361678 conn(0x555f5750b770 msgr2=0x555f57510e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.949+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/2399361678 shutdown_connections 2024-04-25T08:57:00.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.949+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/2399361678 wait complete. 2024-04-25T08:57:00.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.949+0000 7fc6a0c6e740 1 -- start start 2024-04-25T08:57:00.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.949+0000 7fc6a0c6e740 1 Processor -- start 2024-04-25T08:57:00.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5752f210 0x555f575baab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f57557450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc6a0c6e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 0x555f57557990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69815fcf0 con 0x555f57538b10 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5755a950 con 0x555f5752f210 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc6a0c6e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5754bcb0 con 0x555f57538ef0 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc6a0c6e740 10 client.0 _ll_register_callbacks cb 0x7fc688054ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f57557450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f57557450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59272/0 (socket says 172.21.15.55:59272) 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc696ffd640 1 -- 172.21.15.55:0/3597362066 learned_addr learned my addr 172.21.15.55:0/3597362066 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc697fff640 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 0x555f57557990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.950+0000 7fc6977fe640 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5752f210 0x555f575baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc696ffd640 1 -- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 msgr2=0x555f57557990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc696ffd640 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 0x555f57557990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc696ffd640 1 -- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5752f210 msgr2=0x555f575baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc696ffd640 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5752f210 0x555f575baab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc696ffd640 1 -- 172.21.15.55:0/3597362066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f5753c930 con 0x555f57538b10 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6977fe640 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5752f210 0x555f575baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc696ffd640 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f57557450 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc68c006fd0 tx=0x7fc68c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dcba45dd2060ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6767fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6767fc640 1 -- 172.21.15.55:0/3597362066 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c00f040 con 0x555f57538b10 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6767fc640 1 -- 172.21.15.55:0/3597362066 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc68c003c20 con 0x555f57538b10 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/3597362066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc69003c450 con 0x555f57538b10 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6767fc640 1 -- 172.21.15.55:0/3597362066 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc68c003e20 con 0x555f57538b10 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6a0c6e740 10 client.6369 fetch_fsmap learned FSMap version 29 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/3597362066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x555f57556d60 con 0x555f57538b10 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6767fc640 1 -- 172.21.15.55:0/3597362066 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69003c450 con 0x555f57538b10 2024-04-25T08:57:00.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6767fc640 1 -- 172.21.15.55:0/3597362066 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc68c030080 con 0x555f57538b10 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6a0c6e740 10 client.6369 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6a0c6e740 10 client.6369 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6a0c6e740 20 client.6369 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x555f5755ce30 0x555f575366c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6a0c6e740 4 client.6369 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.951+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/3597362066 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555f5747c630 con 0x555f5755ce30 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6977fe640 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x555f5755ce30 0x555f575366c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6977fe640 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x555f5755ce30 0x555f575366c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b926e0a46a44101 server_cookie=3de9839463d5c93b in_seq=0 out_seq=0 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6767fc640 10 client.6369 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6767fc640 1 -- 172.21.15.55:0/3597362066 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x555f5747c630 con 0x555f5755ce30 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6767fc640 10 client.6369 handle_command_reply: tid=0 2024-04-25T08:57:00.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6a0c6e740 1 client.6369 shutdown 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/3597362066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 msgr2=0x555f57557450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f57557450 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc68c006fd0 tx=0x7fc68c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/3597362066 shutdown_connections 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x555f5755ce30 0x555f575366c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555f57538ef0 0x555f57557990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f57538b10 0x555f57557450 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6767fc640 0 client.6369 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6a0c6e740 1 --2- 172.21.15.55:0/3597362066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f5752f210 0x555f575baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.952+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/3597362066 >> 172.21.15.55:0/3597362066 conn(0x555f5750b770 msgr2=0x555f575537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/3597362066 shutdown_connections 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc6a0c6e740 1 -- 172.21.15.55:0/3597362066 wait complete. 2024-04-25T08:57:00.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc6a0c6e740 20 client.6369 trim_cache size 0 max 16384 2024-04-25T08:57:00.949 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:57:00.949 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:57:00.949 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-25T08:57:00.949 INFO:teuthology.orchestra.run.smithi055.stdout: "193a142e-5a1a-46d9-ae93-3e4b695724a3": { 2024-04-25T08:57:00.949 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-04-25T08:57:00.949 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "193a142e-5a1a-46d9-ae93-3e4b695724a3", 2024-04-25T08:57:00.949 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair,force" 2024-04-25T08:57:00.949 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:00.949 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:00.950 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:57:00.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 -- 172.21.15.55:0/4242796394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc68406b4d0 msgr2=0x7fc68406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc68406b4d0 0x7fc68406d990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc6980ce690 tx=0x7fc68c008040 comp rx=0 tx=0).stop 2024-04-25T08:57:00.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 -- 172.21.15.55:0/4242796394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6980cee80 msgr2=0x7fc698160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:00.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6980cee80 0x7fc698160ac0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc68800d800 tx=0x7fc68800dcc0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 -- 172.21.15.55:0/4242796394 shutdown_connections 2024-04-25T08:57:00.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc68406b4d0 0x7fc68406d990 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc69815dca0 0x7fc6981f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6980d3b90 0x7fc6980ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 --2- 172.21.15.55:0/4242796394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6980cee80 0x7fc698160ac0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:00.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 -- 172.21.15.55:0/4242796394 >> 172.21.15.55:0/4242796394 conn(0x7fc6980726c0 msgr2=0x7fc6980d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:00.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 -- 172.21.15.55:0/4242796394 shutdown_connections 2024-04-25T08:57:00.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:00.953+0000 7fc69df63640 1 -- 172.21.15.55:0/4242796394 wait complete. 2024-04-25T08:57:00.953 INFO:tasks.cephfs.filesystem:scrub status for tag:193a142e-5a1a-46d9-ae93-3e4b695724a3 - {'path': '/', 'tag': '193a142e-5a1a-46d9-ae93-3e4b695724a3', 'options': 'recursive,repair,force'} 2024-04-25T08:57:09.722 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:57:09.725 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:57:30.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:30.954 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T08:57:31.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.082+0000 7f127d45a640 1 Processor -- start 2024-04-25T08:57:31.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.082+0000 7f127d45a640 1 -- start start 2024-04-25T08:57:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f127d45a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f127815ba70 0x7f12780d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f127d45a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12780b7030 0x7f12780b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f127d45a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12780cfcf0 con 0x7f12780ce230 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f127d45a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12780cffd0 con 0x7f127815ba70 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f127d45a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12780d02b0 con 0x7f12780b7030 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f1276ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f127815ba70 0x7f12780d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f12777fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f12780ce230 0x7f12780ce6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56606/0 (socket says 172.21.15.55:56606) 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f12777fe640 1 -- 172.21.15.55:0/1661184704 learned_addr learned my addr 172.21.15.55:0/1661184704 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f1276ffd640 1 -- 172.21.15.55:0/1661184704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12780b7030 msgr2=0x7f12780b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f126ffff640 1 --2- 172.21.15.55:0/1661184704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12780b7030 0x7f12780b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f1276ffd640 1 --2- 172.21.15.55:0/1661184704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12780b7030 0x7f12780b7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f1276ffd640 1 -- 172.21.15.55:0/1661184704 >> v1:172.21.15.55:6789/0 conn(0x7f12780ce230 legacy=0x7f12780ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f1276ffd640 1 -- 172.21.15.55:0/1661184704 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12780d0590 con 0x7f127815ba70 2024-04-25T08:57:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.083+0000 7f12767fc640 1 -- 172.21.15.55:0/1661184704 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022074347 0 0) 0x7f12780cfcf0 con 0x7f12780ce230 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.084+0000 7f1276ffd640 1 --2- 172.21.15.55:0/1661184704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f127815ba70 0x7f12780d0d90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f12680097a0 tx=0x7f126802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5500e1268579266b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.084+0000 7f12767fc640 1 -- 172.21.15.55:0/1661184704 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268037070 con 0x7f127815ba70 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.084+0000 7f12767fc640 1 -- 172.21.15.55:0/1661184704 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268032440 con 0x7f127815ba70 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.084+0000 7f12767fc640 1 -- 172.21.15.55:0/1661184704 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268032810 con 0x7f127815ba70 2024-04-25T08:57:31.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.085+0000 7f127d45a640 1 -- 172.21.15.55:0/1661184704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f127815ba70 msgr2=0x7f12780d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.085+0000 7f127d45a640 1 --2- 172.21.15.55:0/1661184704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f127815ba70 0x7f12780d0d90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f12680097a0 tx=0x7f126802a180 comp rx=0 tx=0).stop 2024-04-25T08:57:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.085+0000 7f127d45a640 1 -- 172.21.15.55:0/1661184704 shutdown_connections 2024-04-25T08:57:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.085+0000 7f127d45a640 1 --2- 172.21.15.55:0/1661184704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12780b7030 0x7f12780b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.085+0000 7f127d45a640 1 --2- 172.21.15.55:0/1661184704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f127815ba70 0x7f12780d0d90 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.085+0000 7f127d45a640 1 -- 172.21.15.55:0/1661184704 >> 172.21.15.55:0/1661184704 conn(0x7f127806f4a0 msgr2=0x7f127806f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.085+0000 7f127d45a640 1 -- 172.21.15.55:0/1661184704 shutdown_connections 2024-04-25T08:57:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.085+0000 7f127d45a640 1 -- 172.21.15.55:0/1661184704 wait complete. 2024-04-25T08:57:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.086+0000 7f127d45a640 1 Processor -- start 2024-04-25T08:57:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.086+0000 7f127d45a640 1 -- start start 2024-04-25T08:57:31.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f127d45a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12780b7030 0x7f12780c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f127d45a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12780ce230 0x7f12781eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f127d45a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f127815ba70 0x7f12781f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f127d45a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127815be50 con 0x7f12780ce230 2024-04-25T08:57:31.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f127d45a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12780cf980 con 0x7f12780b7030 2024-04-25T08:57:31.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f127d45a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12781f2720 con 0x7f127815ba70 2024-04-25T08:57:31.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f126ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12780ce230 0x7f12781eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f126ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12780ce230 0x7f12781eed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58918/0 (socket says 172.21.15.55:58918) 2024-04-25T08:57:31.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f126ffff640 1 -- 172.21.15.55:0/1435617986 learned_addr learned my addr 172.21.15.55:0/1435617986 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f12777fe640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f127815ba70 0x7f12781f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f1276ffd640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12780b7030 0x7f12780c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f126ffff640 1 -- 172.21.15.55:0/1435617986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f127815ba70 msgr2=0x7f12781f1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f126ffff640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f127815ba70 0x7f12781f1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f126ffff640 1 -- 172.21.15.55:0/1435617986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12780b7030 msgr2=0x7f12780c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f126ffff640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12780b7030 0x7f12780c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.087+0000 7f126ffff640 1 -- 172.21.15.55:0/1435617986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12780c8120 con 0x7f12780ce230 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.088+0000 7f126ffff640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12780ce230 0x7f12781eed90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f126000c7f0 tx=0x7f126000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.088+0000 7f126f7fe640 1 -- 172.21.15.55:0/1435617986 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260015070 con 0x7f12780ce230 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.088+0000 7f126f7fe640 1 -- 172.21.15.55:0/1435617986 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260004240 con 0x7f12780ce230 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.088+0000 7f126f7fe640 1 -- 172.21.15.55:0/1435617986 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260007620 con 0x7f12780ce230 2024-04-25T08:57:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.088+0000 7f127d45a640 1 -- 172.21.15.55:0/1435617986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12781f1e80 con 0x7f12780ce230 2024-04-25T08:57:31.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.088+0000 7f127d45a640 1 -- 172.21.15.55:0/1435617986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12781f2440 con 0x7f12780ce230 2024-04-25T08:57:31.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.089+0000 7f126f7fe640 1 -- 172.21.15.55:0/1435617986 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f12600079d0 con 0x7f12780ce230 2024-04-25T08:57:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.090+0000 7f126f7fe640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125806b4d0 0x7f125806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.090+0000 7f126f7fe640 1 -- 172.21.15.55:0/1435617986 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f126008a620 con 0x7f12780ce230 2024-04-25T08:57:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.090+0000 7f1276ffd640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125806b4d0 0x7f125806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.090+0000 7f1276ffd640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125806b4d0 0x7f125806d990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1268034000 tx=0x7f126802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.091+0000 7f1280231740 1 Processor -- start 2024-04-25T08:57:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.091+0000 7f1280231740 1 -- start start 2024-04-25T08:57:31.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f1280231740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fad510 0x559892fad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f1280231740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892f7d770 0x559892f837a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f1280231740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fc9470 0x559892fc98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f1280231740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559892ee6da0 con 0x559892f7d770 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f1280231740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559892e8fb80 con 0x559892fad510 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f1280231740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559892ee2e40 con 0x559892fc9470 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f126ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892f7d770 0x559892f837a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f126ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892f7d770 0x559892f837a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58924/0 (socket says 172.21.15.55:58924) 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f126ffff640 1 -- 172.21.15.55:0/1288040379 learned_addr learned my addr 172.21.15.55:0/1288040379 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f1276ffd640 1 --2- 172.21.15.55:0/1288040379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fad510 0x559892fad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f12777fe640 1 --2- 172.21.15.55:0/1288040379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fc9470 0x559892fc98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f126ffff640 1 -- 172.21.15.55:0/1288040379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fc9470 msgr2=0x559892fc98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f126ffff640 1 --2- 172.21.15.55:0/1288040379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fc9470 0x559892fc98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f126ffff640 1 -- 172.21.15.55:0/1288040379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fad510 msgr2=0x559892fad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f126ffff640 1 --2- 172.21.15.55:0/1288040379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fad510 0x559892fad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f126ffff640 1 -- 172.21.15.55:0/1288040379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559892e99f10 con 0x559892f7d770 2024-04-25T08:57:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f12777fe640 1 --2- 172.21.15.55:0/1288040379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fc9470 0x559892fc98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f126ffff640 1 --2- 172.21.15.55:0/1288040379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892f7d770 0x559892f837a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1260088ab0 tx=0x7f1260058ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff0a1c53e59f7ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.092+0000 7f126cff9640 1 -- 172.21.15.55:0/1288040379 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126001e040 con 0x559892f7d770 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.093+0000 7f126cff9640 1 -- 172.21.15.55:0/1288040379 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260056e30 con 0x559892f7d770 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.093+0000 7f126cff9640 1 -- 172.21.15.55:0/1288040379 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126005f0c0 con 0x559892f7d770 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.093+0000 7f1280231740 1 -- 172.21.15.55:0/1288040379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892f7d770 msgr2=0x559892f837a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.093+0000 7f1280231740 1 --2- 172.21.15.55:0/1288040379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892f7d770 0x559892f837a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1260088ab0 tx=0x7f1260058ed0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.093+0000 7f1280231740 1 -- 172.21.15.55:0/1288040379 shutdown_connections 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.093+0000 7f1280231740 1 --2- 172.21.15.55:0/1288040379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fc9470 0x559892fc98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.093+0000 7f1280231740 1 --2- 172.21.15.55:0/1288040379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892f7d770 0x559892f837a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.093+0000 7f1280231740 1 --2- 172.21.15.55:0/1288040379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fad510 0x559892fad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.093+0000 7f1280231740 1 -- 172.21.15.55:0/1288040379 >> 172.21.15.55:0/1288040379 conn(0x559892f7f9e0 msgr2=0x559892fc8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.093+0000 7f1280231740 1 -- 172.21.15.55:0/1288040379 shutdown_connections 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.093+0000 7f1280231740 1 -- 172.21.15.55:0/1288040379 wait complete. 2024-04-25T08:57:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.094+0000 7f1280231740 1 -- start start 2024-04-25T08:57:31.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.094+0000 7f1280231740 1 Processor -- start 2024-04-25T08:57:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1280231740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fcbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1280231740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fc9470 0x559892faf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1280231740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fa8c80 0x559892fa90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1280231740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559892f83ce0 con 0x559892fad510 2024-04-25T08:57:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1280231740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559892e854b0 con 0x559892fa8c80 2024-04-25T08:57:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1280231740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559892f83310 con 0x559892fc9470 2024-04-25T08:57:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1280231740 10 client.0 _ll_register_callbacks cb 0x559892ec5180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1276ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fcbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1276ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fcbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58926/0 (socket says 172.21.15.55:58926) 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1276ffd640 1 -- 172.21.15.55:0/2573866527 learned_addr learned my addr 172.21.15.55:0/2573866527 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f126ffff640 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fc9470 0x559892faf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1276ffd640 1 -- 172.21.15.55:0/2573866527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fc9470 msgr2=0x559892faf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1276ffd640 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fc9470 0x559892faf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1276ffd640 1 -- 172.21.15.55:0/2573866527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fa8c80 msgr2=0x559892fa90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1276ffd640 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fa8c80 0x559892fa90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1276ffd640 1 -- 172.21.15.55:0/2573866527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559892cc57d0 con 0x559892fad510 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1276ffd640 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fcbc30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f126802a770 tx=0x7f1268004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffc233664e8cc5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.095+0000 7f1255ffb640 1 -- 172.21.15.55:0/2573866527 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126804d060 con 0x559892fad510 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1255ffb640 1 -- 172.21.15.55:0/2573866527 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f126803eb30 con 0x559892fad510 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1280231740 1 -- 172.21.15.55:0/2573866527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1260056e30 con 0x559892fad510 2024-04-25T08:57:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1255ffb640 1 -- 172.21.15.55:0/2573866527 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1268053050 con 0x559892fad510 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1280231740 10 client.6384 fetch_fsmap learned FSMap version 30 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1280231740 1 -- 172.21.15.55:0/2573866527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x559892bfb3f0 con 0x559892fad510 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1255ffb640 1 -- 172.21.15.55:0/2573866527 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260056e30 con 0x559892fad510 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1255ffb640 1 -- 172.21.15.55:0/2573866527 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1268056020 con 0x559892fad510 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1280231740 10 client.6384 fetch_fsmap finished waiting for FSMap version 30 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1280231740 10 client.6384 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1280231740 20 client.6384 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1280231740 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559892fb7e10 0x559892fb8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1280231740 4 client.6384 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f1280231740 1 -- 172.21.15.55:0/2573866527 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559892ef42e0 con 0x559892fb7e10 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.096+0000 7f126ffff640 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559892fb7e10 0x559892fb8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1255ffb640 10 client.6384 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f126ffff640 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559892fb7e10 0x559892fb8280 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3431b86487bb7363 server_cookie=6dff75db85291d06 in_seq=0 out_seq=0 2024-04-25T08:57:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1255ffb640 1 -- 172.21.15.55:0/2573866527 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559892ef42e0 con 0x559892fb7e10 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1255ffb640 10 client.6384 handle_command_reply: tid=0 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1280231740 1 client.6384 shutdown 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1280231740 1 -- 172.21.15.55:0/2573866527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 msgr2=0x559892fcbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1280231740 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fcbc30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f126802a770 tx=0x7f1268004730 comp rx=0 tx=0).stop 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1280231740 1 -- 172.21.15.55:0/2573866527 shutdown_connections 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1280231740 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559892fb7e10 0x559892fb8280 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1280231740 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fa8c80 0x559892fa90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1280231740 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fc9470 0x559892faf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1280231740 1 --2- 172.21.15.55:0/2573866527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fcbc30 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1280231740 1 -- 172.21.15.55:0/2573866527 >> 172.21.15.55:0/2573866527 conn(0x559892f7d770 msgr2=0x559892f7ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.097+0000 7f1255ffb640 0 client.6384 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.098+0000 7f1280231740 1 -- 172.21.15.55:0/2573866527 shutdown_connections 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.098+0000 7f1280231740 1 -- 172.21.15.55:0/2573866527 wait complete. 2024-04-25T08:57:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.098+0000 7f1280231740 20 client.6384 trim_cache size 0 max 16384 2024-04-25T08:57:31.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.113+0000 7f1280231740 1 Processor -- start 2024-04-25T08:57:31.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.113+0000 7f1280231740 1 -- start start 2024-04-25T08:57:31.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f1280231740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fa8c80 0x559892fb0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f1280231740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fb1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f1280231740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fc9470 0x559892f823c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f1280231740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127806da10 con 0x559892fad510 2024-04-25T08:57:31.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f1280231740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127806cbd0 con 0x559892fc9470 2024-04-25T08:57:31.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f1280231740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127806bfd0 con 0x559892fa8c80 2024-04-25T08:57:31.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f126ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fb1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f126ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fb1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58940/0 (socket says 172.21.15.55:58940) 2024-04-25T08:57:31.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f126ffff640 1 -- 172.21.15.55:0/2430111687 learned_addr learned my addr 172.21.15.55:0/2430111687 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f1276ffd640 1 --2- 172.21.15.55:0/2430111687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fa8c80 0x559892fb0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f12777fe640 1 --2- 172.21.15.55:0/2430111687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fc9470 0x559892f823c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f126ffff640 1 -- 172.21.15.55:0/2430111687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fa8c80 msgr2=0x559892fb0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f126ffff640 1 --2- 172.21.15.55:0/2430111687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fa8c80 0x559892fb0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f126ffff640 1 -- 172.21.15.55:0/2430111687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fc9470 msgr2=0x559892f823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f126ffff640 1 --2- 172.21.15.55:0/2430111687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fc9470 0x559892f823c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f126ffff640 1 -- 172.21.15.55:0/2430111687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559892fb97a0 con 0x559892fad510 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f1276ffd640 1 --2- 172.21.15.55:0/2430111687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fa8c80 0x559892fb0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f12777fe640 1 --2- 172.21.15.55:0/2430111687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fc9470 0x559892f823c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f126ffff640 1 --2- 172.21.15.55:0/2430111687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fb1100 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f126005d0a0 tx=0x7f126008a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ad2a2660a34e4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f1257fff640 1 -- 172.21.15.55:0/2430111687 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126001e040 con 0x559892fad510 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f1257fff640 1 -- 172.21.15.55:0/2430111687 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260074070 con 0x559892fad510 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.114+0000 7f1257fff640 1 -- 172.21.15.55:0/2430111687 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260056e30 con 0x559892fad510 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.115+0000 7f1280231740 1 -- 172.21.15.55:0/2430111687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 msgr2=0x559892fb1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.115+0000 7f1280231740 1 --2- 172.21.15.55:0/2430111687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fb1100 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f126005d0a0 tx=0x7f126008a000 comp rx=0 tx=0).stop 2024-04-25T08:57:31.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.115+0000 7f1280231740 1 -- 172.21.15.55:0/2430111687 shutdown_connections 2024-04-25T08:57:31.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.115+0000 7f1280231740 1 --2- 172.21.15.55:0/2430111687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fc9470 0x559892f823c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.115+0000 7f1280231740 1 --2- 172.21.15.55:0/2430111687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892fb1100 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.115+0000 7f1280231740 1 --2- 172.21.15.55:0/2430111687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fa8c80 0x559892fb0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.115+0000 7f1280231740 1 -- 172.21.15.55:0/2430111687 >> 172.21.15.55:0/2430111687 conn(0x559892f7d770 msgr2=0x559892fbe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.115+0000 7f1280231740 1 -- 172.21.15.55:0/2430111687 shutdown_connections 2024-04-25T08:57:31.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.115+0000 7f1280231740 1 -- 172.21.15.55:0/2430111687 wait complete. 2024-04-25T08:57:31.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.115+0000 7f1280231740 1 -- start start 2024-04-25T08:57:31.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.115+0000 7f1280231740 1 Processor -- start 2024-04-25T08:57:31.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f1280231740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fa8c80 0x559893036430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f1280231740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892f823c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f1280231740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fc9470 0x559892f82900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f1280231740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127806c5d0 con 0x559892fad510 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f1280231740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559892fb8ec0 con 0x559892fc9470 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f1280231740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559893036ea0 con 0x559892fa8c80 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f1280231740 10 client.0 _ll_register_callbacks cb 0x7f1260058b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f126ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892f823c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f126ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892f823c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58946/0 (socket says 172.21.15.55:58946) 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f126ffff640 1 -- 172.21.15.55:0/2010717904 learned_addr learned my addr 172.21.15.55:0/2010717904 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f12777fe640 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fc9470 0x559892f82900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.116+0000 7f1276ffd640 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fa8c80 0x559893036430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f126ffff640 1 -- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fa8c80 msgr2=0x559893036430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f126ffff640 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fa8c80 0x559893036430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f126ffff640 1 -- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fc9470 msgr2=0x559892f82900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f126ffff640 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fc9470 0x559892f82900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f126ffff640 1 -- 172.21.15.55:0/2010717904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559892bbb0f0 con 0x559892fad510 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f126ffff640 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892f823c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1260058d20 tx=0x7f126005f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd5274ff2bf23a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1255ffb640 1 -- 172.21.15.55:0/2010717904 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126001e070 con 0x559892fad510 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1255ffb640 1 -- 172.21.15.55:0/2010717904 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f126005de00 con 0x559892fad510 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1280231740 1 -- 172.21.15.55:0/2010717904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1260074070 con 0x559892fad510 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1255ffb640 1 -- 172.21.15.55:0/2010717904 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1260066050 con 0x559892fad510 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1280231740 10 client.6390 fetch_fsmap learned FSMap version 30 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1280231740 1 -- 172.21.15.55:0/2010717904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x559892fdea10 con 0x559892fad510 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1255ffb640 1 -- 172.21.15.55:0/2010717904 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260074070 con 0x559892fad510 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1255ffb640 1 -- 172.21.15.55:0/2010717904 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1260069020 con 0x559892fad510 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1280231740 10 client.6390 fetch_fsmap finished waiting for FSMap version 30 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1280231740 10 client.6390 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1280231740 20 client.6390 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1280231740 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559892fdef20 0x55989303a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1280231740 4 client.6390 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.117+0000 7f1280231740 1 -- 172.21.15.55:0/2010717904 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559892fb7270 con 0x559892fdef20 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1276ffd640 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559892fdef20 0x55989303a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1276ffd640 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559892fdef20 0x55989303a180 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad6abd08bf98bd07 server_cookie=b58b8153dd8425b1 in_seq=0 out_seq=0 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1255ffb640 10 client.6390 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1255ffb640 1 -- 172.21.15.55:0/2010717904 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559892fb7270 con 0x559892fdef20 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1255ffb640 10 client.6390 handle_command_reply: tid=0 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1280231740 1 client.6390 shutdown 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1280231740 1 -- 172.21.15.55:0/2010717904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 msgr2=0x559892f823c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1280231740 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892f823c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1260058d20 tx=0x7f126005f050 comp rx=0 tx=0).stop 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1280231740 1 -- 172.21.15.55:0/2010717904 shutdown_connections 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1280231740 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559892fdef20 0x55989303a180 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1280231740 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559892fc9470 0x559892f82900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1280231740 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559892fad510 0x559892f823c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1255ffb640 0 client.6390 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1280231740 1 --2- 172.21.15.55:0/2010717904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559892fa8c80 0x559893036430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1280231740 1 -- 172.21.15.55:0/2010717904 >> 172.21.15.55:0/2010717904 conn(0x559892f7d770 msgr2=0x559892f83500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1280231740 1 -- 172.21.15.55:0/2010717904 shutdown_connections 2024-04-25T08:57:31.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.118+0000 7f1280231740 1 -- 172.21.15.55:0/2010717904 wait complete. 2024-04-25T08:57:31.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f1280231740 20 client.6390 trim_cache size 0 max 16384 2024-04-25T08:57:31.114 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:57:31.114 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-25T08:57:31.114 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-25T08:57:31.114 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:57:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 -- 172.21.15.55:0/1435617986 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125806b4d0 msgr2=0x7f125806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125806b4d0 0x7f125806d990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1268034000 tx=0x7f126802e000 comp rx=0 tx=0).stop 2024-04-25T08:57:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 -- 172.21.15.55:0/1435617986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12780ce230 msgr2=0x7f12781eed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12780ce230 0x7f12781eed90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f126000c7f0 tx=0x7f126000ccb0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 -- 172.21.15.55:0/1435617986 shutdown_connections 2024-04-25T08:57:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125806b4d0 0x7f125806d990 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f127815ba70 0x7f12781f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12780ce230 0x7f12781eed90 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 --2- 172.21.15.55:0/1435617986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12780b7030 0x7f12780c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 -- 172.21.15.55:0/1435617986 >> 172.21.15.55:0/1435617986 conn(0x7f127806f4a0 msgr2=0x7f127806f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 -- 172.21.15.55:0/1435617986 shutdown_connections 2024-04-25T08:57:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.119+0000 7f127d45a640 1 -- 172.21.15.55:0/1435617986 wait complete. 2024-04-25T08:57:31.119 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:57:31.119 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:31.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.230+0000 7f6fa044d640 1 Processor -- start 2024-04-25T08:57:31.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.230+0000 7f6fa044d640 1 -- start start 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.231+0000 7f6fa044d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6f98071190 0x7f6f980ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.231+0000 7f6fa044d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f98071570 0x7f6f9815daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.231+0000 7f6fa044d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9806d550 con 0x7f6f9815e030 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.231+0000 7f6fa044d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f980aeee0 con 0x7f6f98071190 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.231+0000 7f6fa044d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9806d830 con 0x7f6f98071570 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.232+0000 7f6f9e1e9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6f98071190 0x7f6f980ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.232+0000 7f6f9e9ea640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6f9815e030 0x7f6f980b2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:57374/0 (socket says 172.21.15.55:57374) 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.232+0000 7f6f9e9ea640 1 -- 172.21.15.55:0/152879636 learned_addr learned my addr 172.21.15.55:0/152879636 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.232+0000 7f6f9d9e8640 1 --2- 172.21.15.55:0/152879636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f98071570 0x7f6f9815daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.232+0000 7f6f9d1e7640 1 -- 172.21.15.55:0/152879636 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544896669 0 0) 0x7f6f9806d550 con 0x7f6f9815e030 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.232+0000 7f6f9d1e7640 1 -- 172.21.15.55:0/152879636 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f84003520 con 0x7f6f9815e030 2024-04-25T08:57:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.232+0000 7f6f9e1e9640 1 -- 172.21.15.55:0/152879636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f98071570 msgr2=0x7f6f9815daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.232+0000 7f6f9e1e9640 1 --2- 172.21.15.55:0/152879636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f98071570 0x7f6f9815daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.232+0000 7f6f9e1e9640 1 -- 172.21.15.55:0/152879636 >> v1:172.21.15.167:6789/0 conn(0x7f6f9815e030 legacy=0x7f6f980b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.232+0000 7f6f9e1e9640 1 -- 172.21.15.55:0/152879636 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9806db10 con 0x7f6f98071190 2024-04-25T08:57:31.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.233+0000 7f6f9e1e9640 1 --2- 172.21.15.55:0/152879636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f98071190 0x7f6f980ae9a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6f940097a0 tx=0x7f6f9402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb73b3d2c47a75ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.233+0000 7f6f9d1e7640 1 -- 172.21.15.55:0/152879636 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94037070 con 0x7f6f98071190 2024-04-25T08:57:31.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.233+0000 7f6f9d1e7640 1 -- 172.21.15.55:0/152879636 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94032440 con 0x7f6f98071190 2024-04-25T08:57:31.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.233+0000 7f6f9d1e7640 1 -- 172.21.15.55:0/152879636 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f940327f0 con 0x7f6f98071190 2024-04-25T08:57:31.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.234+0000 7f6fa044d640 1 -- 172.21.15.55:0/152879636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f98071190 msgr2=0x7f6f980ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.234+0000 7f6fa044d640 1 --2- 172.21.15.55:0/152879636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f98071190 0x7f6f980ae9a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6f940097a0 tx=0x7f6f9402a180 comp rx=0 tx=0).stop 2024-04-25T08:57:31.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.234+0000 7f6fa044d640 1 -- 172.21.15.55:0/152879636 shutdown_connections 2024-04-25T08:57:31.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.234+0000 7f6fa044d640 1 --2- 172.21.15.55:0/152879636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f98071570 0x7f6f9815daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.234+0000 7f6fa044d640 1 --2- 172.21.15.55:0/152879636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f98071190 0x7f6f980ae9a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.234+0000 7f6fa044d640 1 -- 172.21.15.55:0/152879636 >> 172.21.15.55:0/152879636 conn(0x7f6f9806aba0 msgr2=0x7f6f9806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.234+0000 7f6fa044d640 1 -- 172.21.15.55:0/152879636 shutdown_connections 2024-04-25T08:57:31.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.234+0000 7f6fa044d640 1 -- 172.21.15.55:0/152879636 wait complete. 2024-04-25T08:57:31.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.235+0000 7f6fa044d640 1 Processor -- start 2024-04-25T08:57:31.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.235+0000 7f6fa044d640 1 -- start start 2024-04-25T08:57:31.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6fa044d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f98071190 0x7f6f9814f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6fa044d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f98071570 0x7f6f981583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6fa044d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f9815e030 0x7f6f980aa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6fa044d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9806e8b0 con 0x7f6f98071570 2024-04-25T08:57:31.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6fa044d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9806e0d0 con 0x7f6f98071190 2024-04-25T08:57:31.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6fa044d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980719d0 con 0x7f6f9815e030 2024-04-25T08:57:31.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6f9d9e8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f98071570 0x7f6f981583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6f9d9e8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f98071570 0x7f6f981583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58960/0 (socket says 172.21.15.55:58960) 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6f9d9e8640 1 -- 172.21.15.55:0/1801336756 learned_addr learned my addr 172.21.15.55:0/1801336756 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6f9e9ea640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f9815e030 0x7f6f980aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6f9e1e9640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f98071190 0x7f6f9814f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6f9d9e8640 1 -- 172.21.15.55:0/1801336756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f9815e030 msgr2=0x7f6f980aa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6f9d9e8640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f9815e030 0x7f6f980aa820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6f9d9e8640 1 -- 172.21.15.55:0/1801336756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f98071190 msgr2=0x7f6f9814f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6f9d9e8640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f98071190 0x7f6f9814f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6f9d9e8640 1 -- 172.21.15.55:0/1801336756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f981588e0 con 0x7f6f98071570 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.236+0000 7f6f9d9e8640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f98071570 0x7f6f981583a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800e9b0 tx=0x7f6f8800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.237+0000 7f6f8effd640 1 -- 172.21.15.55:0/1801336756 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88017070 con 0x7f6f98071570 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.237+0000 7f6f8effd640 1 -- 172.21.15.55:0/1801336756 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8800c9a0 con 0x7f6f98071570 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.237+0000 7f6fa044d640 1 -- 172.21.15.55:0/1801336756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f98153120 con 0x7f6f98071570 2024-04-25T08:57:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.237+0000 7f6f8effd640 1 -- 172.21.15.55:0/1801336756 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800cd90 con 0x7f6f98071570 2024-04-25T08:57:31.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.237+0000 7f6fa044d640 1 -- 172.21.15.55:0/1801336756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f98153a20 con 0x7f6f98071570 2024-04-25T08:57:31.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.238+0000 7f6fa044d640 1 -- 172.21.15.55:0/1801336756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f98157990 con 0x7f6f98071570 2024-04-25T08:57:31.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.238+0000 7f6f8effd640 1 -- 172.21.15.55:0/1801336756 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6f8801a070 con 0x7f6f98071570 2024-04-25T08:57:31.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.239+0000 7f6f8effd640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f7c06b500 0x7f6f7c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.239+0000 7f6f8effd640 1 -- 172.21.15.55:0/1801336756 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f8808a450 con 0x7f6f98071570 2024-04-25T08:57:31.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.239+0000 7f6f9e1e9640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f7c06b500 0x7f6f7c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.239+0000 7f6f9e1e9640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f7c06b500 0x7f6f7c06d9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6f94034000 tx=0x7f6f9402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.243+0000 7f6f8effd640 1 -- 172.21.15.55:0/1801336756 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6f88058d10 con 0x7f6f98071570 2024-04-25T08:57:31.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.464+0000 7f6fa044d640 1 -- 172.21.15.55:0/1801336756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f980749b0 con 0x7f6f98071570 2024-04-25T08:57:31.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.465+0000 7f6f8effd640 1 -- 172.21.15.55:0/1801336756 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f6f8805cdb0 con 0x7f6f98071570 2024-04-25T08:57:31.455 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:31.455 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1092467772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1092467772},{"type":"v1","addr":"172.21.15.167:6834","nonce":1092467772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/651597245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":651597245},{"type":"v1","addr":"172.21.15.55:6837","nonce":651597245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3980280949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3980280949},{"type":"v1","addr":"172.21.15.55:6836","nonce":3980280949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:17.562426+0000","modified":"2024-04-25T08:57:06.241661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":15,"addr":"172.21.15.167:6835/238831666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":238831666},{"type":"v1","addr":"172.21.15.167:6835","nonce":238831666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:57:31.455 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 30 2024-04-25T08:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 -- 172.21.15.55:0/1801336756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f7c06b500 msgr2=0x7f6f7c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f7c06b500 0x7f6f7c06d9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6f94034000 tx=0x7f6f9402e000 comp rx=0 tx=0).stop 2024-04-25T08:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 -- 172.21.15.55:0/1801336756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f98071570 msgr2=0x7f6f981583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f98071570 0x7f6f981583a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800e9b0 tx=0x7f6f8800ee70 comp rx=0 tx=0).stop 2024-04-25T08:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 -- 172.21.15.55:0/1801336756 shutdown_connections 2024-04-25T08:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6f7c06b500 0x7f6f7c06d9c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f9815e030 0x7f6f980aa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f98071570 0x7f6f981583a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 --2- 172.21.15.55:0/1801336756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f98071190 0x7f6f9814f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 -- 172.21.15.55:0/1801336756 >> 172.21.15.55:0/1801336756 conn(0x7f6f9806aba0 msgr2=0x7f6f9815cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 -- 172.21.15.55:0/1801336756 shutdown_connections 2024-04-25T08:57:31.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.467+0000 7f6fa044d640 1 -- 172.21.15.55:0/1801336756 wait complete. 2024-04-25T08:57:31.467 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b damage ls --format=json-pretty 2024-04-25T08:57:31.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.581+0000 7f567a522640 1 Processor -- start 2024-04-25T08:57:31.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.581+0000 7f567a522640 1 -- start start 2024-04-25T08:57:31.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.582+0000 7f567a522640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f567406aba0 0x7f567406b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.582+0000 7f567a522640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56740cae90 0x7f56740cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.582+0000 7f567a522640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56740b1f00 con 0x7f567415deb0 2024-04-25T08:57:31.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.582+0000 7f567a522640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567406b540 con 0x7f56740cae90 2024-04-25T08:57:31.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.582+0000 7f567a522640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56740b21d0 con 0x7f567406aba0 2024-04-25T08:57:31.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.582+0000 7f5678abf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56740cae90 0x7f56740cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.582+0000 7f5678abf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56740cae90 0x7f56740cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58970/0 (socket says 172.21.15.55:58970) 2024-04-25T08:57:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.582+0000 7f5678abf640 1 -- 172.21.15.55:0/2726833705 learned_addr learned my addr 172.21.15.55:0/2726833705 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.583+0000 7f56737fe640 1 --2- 172.21.15.55:0/2726833705 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f567406aba0 0x7f567406b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.583+0000 7f5678abf640 1 -- 172.21.15.55:0/2726833705 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f567406aba0 msgr2=0x7f567406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.583+0000 7f5678abf640 1 --2- 172.21.15.55:0/2726833705 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f567406aba0 0x7f567406b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.583+0000 7f5678abf640 1 -- 172.21.15.55:0/2726833705 >> v1:172.21.15.167:6789/0 conn(0x7f567415deb0 legacy=0x7f56740b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.583+0000 7f5678abf640 1 -- 172.21.15.55:0/2726833705 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56740cd150 con 0x7f56740cae90 2024-04-25T08:57:31.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.583+0000 7f5678abf640 1 --2- 172.21.15.55:0/2726833705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56740cae90 0x7f56740cb2e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f566c009e80 tx=0x7f566c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a500a0ff0493bd27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.583+0000 7f5672ffd640 1 -- 172.21.15.55:0/2726833705 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c036070 con 0x7f56740cae90 2024-04-25T08:57:31.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.584+0000 7f5672ffd640 1 -- 172.21.15.55:0/2726833705 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c031600 con 0x7f56740cae90 2024-04-25T08:57:31.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.584+0000 7f5672ffd640 1 -- 172.21.15.55:0/2726833705 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0319d0 con 0x7f56740cae90 2024-04-25T08:57:31.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.584+0000 7f567a522640 1 -- 172.21.15.55:0/2726833705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56740cae90 msgr2=0x7f56740cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.584+0000 7f567a522640 1 --2- 172.21.15.55:0/2726833705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56740cae90 0x7f56740cb2e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f566c009e80 tx=0x7f566c02a6c0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.584+0000 7f567a522640 1 -- 172.21.15.55:0/2726833705 shutdown_connections 2024-04-25T08:57:31.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.584+0000 7f567a522640 1 --2- 172.21.15.55:0/2726833705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56740cae90 0x7f56740cb2e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.584+0000 7f567a522640 1 --2- 172.21.15.55:0/2726833705 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f567406aba0 0x7f567406b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.584+0000 7f567a522640 1 -- 172.21.15.55:0/2726833705 >> 172.21.15.55:0/2726833705 conn(0x7f56740b2390 msgr2=0x7f56740b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.584+0000 7f567a522640 1 -- 172.21.15.55:0/2726833705 shutdown_connections 2024-04-25T08:57:31.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.584+0000 7f567a522640 1 -- 172.21.15.55:0/2726833705 wait complete. 2024-04-25T08:57:31.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.585+0000 7f567a522640 1 Processor -- start 2024-04-25T08:57:31.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.586+0000 7f567a522640 1 -- start start 2024-04-25T08:57:31.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.586+0000 7f567a522640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f567406aba0 0x7f567406f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.586+0000 7f567a522640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56740cae90 0x7f56740c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.586+0000 7f567a522640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f567415deb0 0x7f56740c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.586+0000 7f567a522640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56740cd9f0 con 0x7f567415deb0 2024-04-25T08:57:31.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.586+0000 7f567a522640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56740cd710 con 0x7f56740cae90 2024-04-25T08:57:31.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.586+0000 7f567a522640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567415e290 con 0x7f567406aba0 2024-04-25T08:57:31.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.586+0000 7f5678abf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f567415deb0 0x7f56740c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.586+0000 7f5678abf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f567415deb0 0x7f56740c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58972/0 (socket says 172.21.15.55:58972) 2024-04-25T08:57:31.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.586+0000 7f5678abf640 1 -- 172.21.15.55:0/2087322370 learned_addr learned my addr 172.21.15.55:0/2087322370 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f5673fff640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f567406aba0 0x7f567406f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f56737fe640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56740cae90 0x7f56740c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f5678abf640 1 -- 172.21.15.55:0/2087322370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f567406aba0 msgr2=0x7f567406f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f5678abf640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f567406aba0 0x7f567406f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f5678abf640 1 -- 172.21.15.55:0/2087322370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56740cae90 msgr2=0x7f56740c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f5678abf640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56740cae90 0x7f56740c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f5678abf640 1 -- 172.21.15.55:0/2087322370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56740c68b0 con 0x7f567415deb0 2024-04-25T08:57:31.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f56737fe640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56740cae90 0x7f56740c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:31.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f5678abf640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f567415deb0 0x7f56740c56a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f566c009fa0 tx=0x7f566c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f5670ff9640 1 -- 172.21.15.55:0/2087322370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c03f020 con 0x7f567415deb0 2024-04-25T08:57:31.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f5670ff9640 1 -- 172.21.15.55:0/2087322370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c037040 con 0x7f567415deb0 2024-04-25T08:57:31.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f567a522640 1 -- 172.21.15.55:0/2087322370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56740c6b90 con 0x7f567415deb0 2024-04-25T08:57:31.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f5670ff9640 1 -- 172.21.15.55:0/2087322370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c036070 con 0x7f567415deb0 2024-04-25T08:57:31.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.587+0000 7f567a522640 1 -- 172.21.15.55:0/2087322370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56740c7150 con 0x7f567415deb0 2024-04-25T08:57:31.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.588+0000 7f5670ff9640 1 -- 172.21.15.55:0/2087322370 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f566c042020 con 0x7f567415deb0 2024-04-25T08:57:31.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.589+0000 7f5670ff9640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f566006b4d0 0x7f566006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.589+0000 7f5670ff9640 1 -- 172.21.15.55:0/2087322370 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f566c0aa5e0 con 0x7f567415deb0 2024-04-25T08:57:31.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.589+0000 7f5673fff640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f566006b4d0 0x7f566006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.589+0000 7f5673fff640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f566006b4d0 0x7f566006d990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5664007fd0 tx=0x7f5664009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.590+0000 7f567d221740 1 Processor -- start 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.590+0000 7f567d221740 1 -- start start 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f567d221740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7755590 0x559af77576f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f567d221740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7791c60 0x559af7755970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f567d221740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7780050 0x559af77804d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f567d221740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af76b8c60 con 0x559af7791c60 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f567d221740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af7657d80 con 0x559af7780050 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f567d221740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559af76b4d00 con 0x559af7755590 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f56737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7791c60 0x559af7755970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f56737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7791c60 0x559af7755970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58984/0 (socket says 172.21.15.55:58984) 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f56737fe640 1 -- 172.21.15.55:0/4102678364 learned_addr learned my addr 172.21.15.55:0/4102678364 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f5678abf640 1 --2- 172.21.15.55:0/4102678364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7780050 0x559af77804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f5673fff640 1 --2- 172.21.15.55:0/4102678364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7755590 0x559af77576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f56737fe640 1 -- 172.21.15.55:0/4102678364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7755590 msgr2=0x559af77576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f56737fe640 1 --2- 172.21.15.55:0/4102678364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7755590 0x559af77576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f56737fe640 1 -- 172.21.15.55:0/4102678364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7780050 msgr2=0x559af77804d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f56737fe640 1 --2- 172.21.15.55:0/4102678364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7780050 0x559af77804d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f56737fe640 1 -- 172.21.15.55:0/4102678364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559af74997c0 con 0x559af7791c60 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f56737fe640 1 --2- 172.21.15.55:0/4102678364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7791c60 0x559af7755970 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f56680099f0 tx=0x7f5668009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0ce6bb41cf606 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f5659ffb640 1 -- 172.21.15.55:0/4102678364 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800c070 con 0x559af7791c60 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f5659ffb640 1 -- 172.21.15.55:0/4102678364 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5668018070 con 0x559af7791c60 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.591+0000 7f5659ffb640 1 -- 172.21.15.55:0/4102678364 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800f040 con 0x559af7791c60 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.592+0000 7f567d221740 1 -- 172.21.15.55:0/4102678364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7791c60 msgr2=0x559af7755970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.592+0000 7f567d221740 1 --2- 172.21.15.55:0/4102678364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7791c60 0x559af7755970 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f56680099f0 tx=0x7f5668009eb0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.592+0000 7f567d221740 1 -- 172.21.15.55:0/4102678364 shutdown_connections 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.592+0000 7f567d221740 1 --2- 172.21.15.55:0/4102678364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7780050 0x559af77804d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.592+0000 7f567d221740 1 --2- 172.21.15.55:0/4102678364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7791c60 0x559af7755970 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.592+0000 7f567d221740 1 --2- 172.21.15.55:0/4102678364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7755590 0x559af77576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.592+0000 7f567d221740 1 -- 172.21.15.55:0/4102678364 >> 172.21.15.55:0/4102678364 conn(0x559af771d6e0 msgr2=0x559af779b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.592+0000 7f567d221740 1 -- 172.21.15.55:0/4102678364 shutdown_connections 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.592+0000 7f567d221740 1 -- 172.21.15.55:0/4102678364 wait complete. 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.593+0000 7f567d221740 1 -- start start 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.593+0000 7f567d221740 1 Processor -- start 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f567d221740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7755590 0x559af7794610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f567d221740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77804d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f567d221740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7791c60 0x559af77adb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f567d221740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af7655840 con 0x559af7780050 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f567d221740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af777dba0 con 0x559af7791c60 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f567d221740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559af77ab250 con 0x559af7755590 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f567d221740 10 client.0 _ll_register_callbacks cb 0x559af766f980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:31.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f56737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f56737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77804d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58996/0 (socket says 172.21.15.55:58996) 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f56737fe640 1 -- 172.21.15.55:0/1773812580 learned_addr learned my addr 172.21.15.55:0/1773812580 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f5678abf640 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7791c60 0x559af77adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f5673fff640 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7755590 0x559af7794610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f56737fe640 1 -- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7755590 msgr2=0x559af7794610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f56737fe640 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7755590 0x559af7794610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f56737fe640 1 -- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7791c60 msgr2=0x559af77adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f56737fe640 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7791c60 0x559af77adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f56737fe640 1 -- 172.21.15.55:0/1773812580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559af74f9f50 con 0x559af7780050 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f56737fe640 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77804d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5668015040 tx=0x7f5668004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adea82094656f12f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f5652ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f5652ffd640 1 -- 172.21.15.55:0/1773812580 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56680044e0 con 0x559af7780050 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f5652ffd640 1 -- 172.21.15.55:0/1773812580 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5668003610 con 0x559af7780050 2024-04-25T08:57:31.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.594+0000 7f567d221740 1 -- 172.21.15.55:0/1773812580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5668018070 con 0x559af7780050 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f5652ffd640 1 -- 172.21.15.55:0/1773812580 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5668030050 con 0x559af7780050 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f567d221740 10 client.6405 fetch_fsmap learned FSMap version 30 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f567d221740 1 -- 172.21.15.55:0/1773812580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x559af738d0b0 con 0x559af7780050 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f5652ffd640 1 -- 172.21.15.55:0/1773812580 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5668018070 con 0x559af7780050 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f5652ffd640 1 -- 172.21.15.55:0/1773812580 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5668033020 con 0x559af7780050 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f567d221740 10 client.6405 fetch_fsmap finished waiting for FSMap version 30 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f567d221740 10 client.6405 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f567d221740 20 client.6405 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f567d221740 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559af77ae320 0x559af77ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f567d221740 4 client.6405 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f567d221740 1 -- 172.21.15.55:0/1773812580 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559af7678e60 con 0x559af77ae320 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.595+0000 7f5673fff640 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559af77ae320 0x559af77ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f5652ffd640 10 client.6405 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f5673fff640 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559af77ae320 0x559af77ae770 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f9571fa9a87cc33 server_cookie=2cde3713ae6b9775 in_seq=0 out_seq=0 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f5652ffd640 1 -- 172.21.15.55:0/1773812580 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559af7678e60 con 0x559af77ae320 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f5652ffd640 10 client.6405 handle_command_reply: tid=0 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f567d221740 1 client.6405 shutdown 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f567d221740 1 -- 172.21.15.55:0/1773812580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 msgr2=0x559af77804d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f567d221740 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77804d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5668015040 tx=0x7f5668004730 comp rx=0 tx=0).stop 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f567d221740 1 -- 172.21.15.55:0/1773812580 shutdown_connections 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f567d221740 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559af77ae320 0x559af77ae770 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f567d221740 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7791c60 0x559af77adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f567d221740 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77804d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f567d221740 1 --2- 172.21.15.55:0/1773812580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7755590 0x559af7794610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f5652ffd640 0 client.6405 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.596+0000 7f567d221740 1 -- 172.21.15.55:0/1773812580 >> 172.21.15.55:0/1773812580 conn(0x559af771d6e0 msgr2=0x559af777dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.597+0000 7f567d221740 1 -- 172.21.15.55:0/1773812580 shutdown_connections 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.597+0000 7f567d221740 1 -- 172.21.15.55:0/1773812580 wait complete. 2024-04-25T08:57:31.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.597+0000 7f567d221740 20 client.6405 trim_cache size 0 max 16384 2024-04-25T08:57:31.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.608+0000 7f567d221740 1 Processor -- start 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.608+0000 7f567d221740 1 -- start start 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f567d221740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7755590 0x559af77839c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f567d221740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77bde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f567d221740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7791c60 0x559af777e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f567d221740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56741ff190 con 0x559af7780050 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f567d221740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56740ca0a0 con 0x559af7755590 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f567d221740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56740ca6a0 con 0x559af7791c60 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f56737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77bde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f56737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77bde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59012/0 (socket says 172.21.15.55:59012) 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f56737fe640 1 -- 172.21.15.55:0/3630156445 learned_addr learned my addr 172.21.15.55:0/3630156445 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f5678abf640 1 --2- 172.21.15.55:0/3630156445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7791c60 0x559af777e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f5673fff640 1 --2- 172.21.15.55:0/3630156445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7755590 0x559af77839c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f56737fe640 1 -- 172.21.15.55:0/3630156445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7791c60 msgr2=0x559af777e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f56737fe640 1 --2- 172.21.15.55:0/3630156445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7791c60 0x559af777e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f56737fe640 1 -- 172.21.15.55:0/3630156445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7755590 msgr2=0x559af77839c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f56737fe640 1 --2- 172.21.15.55:0/3630156445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7755590 0x559af77839c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.609+0000 7f56737fe640 1 -- 172.21.15.55:0/3630156445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559af77551a0 con 0x559af7780050 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f56737fe640 1 --2- 172.21.15.55:0/3630156445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77bde10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5668006e60 tx=0x7f566801f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7774311d7cba0dcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f56597fa640 1 -- 172.21.15.55:0/3630156445 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668039070 con 0x559af7780050 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f56597fa640 1 -- 172.21.15.55:0/3630156445 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5668018070 con 0x559af7780050 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f56597fa640 1 -- 172.21.15.55:0/3630156445 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668004340 con 0x559af7780050 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f567d221740 1 -- 172.21.15.55:0/3630156445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 msgr2=0x559af77bde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f567d221740 1 --2- 172.21.15.55:0/3630156445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77bde10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5668006e60 tx=0x7f566801f070 comp rx=0 tx=0).stop 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f567d221740 1 -- 172.21.15.55:0/3630156445 shutdown_connections 2024-04-25T08:57:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f567d221740 1 --2- 172.21.15.55:0/3630156445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7791c60 0x559af777e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f567d221740 1 --2- 172.21.15.55:0/3630156445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af77bde10 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f567d221740 1 --2- 172.21.15.55:0/3630156445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7755590 0x559af77839c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f567d221740 1 -- 172.21.15.55:0/3630156445 >> 172.21.15.55:0/3630156445 conn(0x559af771d6e0 msgr2=0x559af7756470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f567d221740 1 -- 172.21.15.55:0/3630156445 shutdown_connections 2024-04-25T08:57:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.610+0000 7f567d221740 1 -- 172.21.15.55:0/3630156445 wait complete. 2024-04-25T08:57:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.611+0000 7f567d221740 1 -- start start 2024-04-25T08:57:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.611+0000 7f567d221740 1 Processor -- start 2024-04-25T08:57:31.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f567d221740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7755590 0x559af777bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f567d221740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af777c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f567d221740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7791c60 0x559af77b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f567d221740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af77ae1a0 con 0x559af7780050 2024-04-25T08:57:31.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f567d221740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af77ab3f0 con 0x559af7755590 2024-04-25T08:57:31.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f567d221740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559af7782c80 con 0x559af7791c60 2024-04-25T08:57:31.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f567d221740 10 client.0 _ll_register_callbacks cb 0x7f56680091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:31.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f56737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af777c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f56737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af777c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59016/0 (socket says 172.21.15.55:59016) 2024-04-25T08:57:31.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f56737fe640 1 -- 172.21.15.55:0/4146668254 learned_addr learned my addr 172.21.15.55:0/4146668254 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f5673fff640 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7755590 0x559af777bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f5678abf640 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7791c60 0x559af77b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f56737fe640 1 -- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7791c60 msgr2=0x559af77b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f56737fe640 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7791c60 0x559af77b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f56737fe640 1 -- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7755590 msgr2=0x559af777bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f56737fe640 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7755590 0x559af777bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f56737fe640 1 -- 172.21.15.55:0/4146668254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559af779baa0 con 0x559af7780050 2024-04-25T08:57:31.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f5678abf640 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7791c60 0x559af77b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:31.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f56737fe640 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af777c480 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5668003b20 tx=0x7f5668008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85837159db01e4dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.612+0000 7f5652ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:31.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f5652ffd640 1 -- 172.21.15.55:0/4146668254 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668039040 con 0x559af7780050 2024-04-25T08:57:31.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f5652ffd640 1 -- 172.21.15.55:0/4146668254 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5668003b50 con 0x559af7780050 2024-04-25T08:57:31.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f567d221740 1 -- 172.21.15.55:0/4146668254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5668018070 con 0x559af7780050 2024-04-25T08:57:31.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f5652ffd640 1 -- 172.21.15.55:0/4146668254 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f566804a050 con 0x559af7780050 2024-04-25T08:57:31.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f567d221740 10 client.6411 fetch_fsmap learned FSMap version 30 2024-04-25T08:57:31.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f567d221740 1 -- 172.21.15.55:0/4146668254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x559af77966c0 con 0x559af7780050 2024-04-25T08:57:31.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f5652ffd640 1 -- 172.21.15.55:0/4146668254 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5668018070 con 0x559af7780050 2024-04-25T08:57:31.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f5652ffd640 1 -- 172.21.15.55:0/4146668254 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f566804d020 con 0x559af7780050 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f567d221740 10 client.6411 fetch_fsmap finished waiting for FSMap version 30 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f567d221740 10 client.6411 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f567d221740 20 client.6411 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f567d221740 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559af77b4eb0 0x559af779e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f567d221740 4 client.6411 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f567d221740 1 -- 172.21.15.55:0/4146668254 --> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x559af76c61a0 con 0x559af77b4eb0 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.613+0000 7f5673fff640 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559af77b4eb0 0x559af779e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f5673fff640 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559af77b4eb0 0x559af779e110 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9026a7be730557f9 server_cookie=c6ed01f3488545c7 in_seq=0 out_seq=0 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f5652ffd640 10 client.6411 ms_handle_connect on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f5652ffd640 1 -- 172.21.15.55:0/4146668254 <== mds.0 v2:172.21.15.167:6833/238831666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559af76c61a0 con 0x559af77b4eb0 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f5652ffd640 10 client.6411 handle_command_reply: tid=0 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 1 client.6411 shutdown 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 1 -- 172.21.15.55:0/4146668254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 msgr2=0x559af777c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af777c480 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5668003b20 tx=0x7f5668008040 comp rx=0 tx=0).stop 2024-04-25T08:57:31.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 1 -- 172.21.15.55:0/4146668254 shutdown_connections 2024-04-25T08:57:31.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:6833/238831666,v1:172.21.15.167:6835/238831666] conn(0x559af77b4eb0 0x559af779e110 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559af7791c60 0x559af77b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559af7780050 0x559af777c480 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 1 --2- 172.21.15.55:0/4146668254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559af7755590 0x559af777bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f5652ffd640 0 client.6411 ms_handle_reset on v2:172.21.15.167:6833/238831666 2024-04-25T08:57:31.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 1 -- 172.21.15.55:0/4146668254 >> 172.21.15.55:0/4146668254 conn(0x559af771d6e0 msgr2=0x559af777d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 1 -- 172.21.15.55:0/4146668254 shutdown_connections 2024-04-25T08:57:31.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 1 -- 172.21.15.55:0/4146668254 wait complete. 2024-04-25T08:57:31.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.614+0000 7f567d221740 20 client.6411 trim_cache size 0 max 16384 2024-04-25T08:57:31.612 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:31.613 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-04-25T08:57:31.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 -- 172.21.15.55:0/2087322370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f566006b4d0 msgr2=0x7f566006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f566006b4d0 0x7f566006d990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5664007fd0 tx=0x7f5664009040 comp rx=0 tx=0).stop 2024-04-25T08:57:31.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 -- 172.21.15.55:0/2087322370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f567415deb0 msgr2=0x7f56740c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f567415deb0 0x7f56740c56a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f566c009fa0 tx=0x7f566c004a40 comp rx=0 tx=0).stop 2024-04-25T08:57:31.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 -- 172.21.15.55:0/2087322370 shutdown_connections 2024-04-25T08:57:31.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f566006b4d0 0x7f566006d990 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f567415deb0 0x7f56740c56a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56740cae90 0x7f56740c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 --2- 172.21.15.55:0/2087322370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f567406aba0 0x7f567406f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 -- 172.21.15.55:0/2087322370 >> 172.21.15.55:0/2087322370 conn(0x7f56740b2390 msgr2=0x7f5674160310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 -- 172.21.15.55:0/2087322370 shutdown_connections 2024-04-25T08:57:31.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.615+0000 7f567a522640 1 -- 172.21.15.55:0/2087322370 wait complete. 2024-04-25T08:57:31.615 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T08:57:31.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.726+0000 7f896e6fc640 1 Processor -- start 2024-04-25T08:57:31.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.726+0000 7f896e6fc640 1 -- start start 2024-04-25T08:57:31.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f896e6fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f896815dce0 0x7f89680d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f896e6fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89680b5b60 0x7f89680b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f896e6fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896815e0c0 con 0x7f89680d35b0 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f896e6fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89680d2510 con 0x7f89680b5b60 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f896e6fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89680d27f0 con 0x7f896815dce0 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f896cc99640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89680b5b60 0x7f89680b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f89677fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f89680d35b0 0x7f89680b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56616/0 (socket says 172.21.15.55:56616) 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f89677fe640 1 -- 172.21.15.55:0/3207171697 learned_addr learned my addr 172.21.15.55:0/3207171697 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f896cc99640 1 -- 172.21.15.55:0/3207171697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f896815dce0 msgr2=0x7f89680d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f8967fff640 1 --2- 172.21.15.55:0/3207171697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f896815dce0 0x7f89680d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f8966ffd640 1 -- 172.21.15.55:0/3207171697 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158720883 0 0) 0x7f896815e0c0 con 0x7f89680d35b0 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f896cc99640 1 --2- 172.21.15.55:0/3207171697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f896815dce0 0x7f89680d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f896cc99640 1 -- 172.21.15.55:0/3207171697 >> v1:172.21.15.55:6789/0 conn(0x7f89680d35b0 legacy=0x7f89680b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f896cc99640 1 -- 172.21.15.55:0/3207171697 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89680d2ad0 con 0x7f89680b5b60 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.727+0000 7f8967fff640 1 --2- 172.21.15.55:0/3207171697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f896815dce0 0x7f89680d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:31.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.728+0000 7f896cc99640 1 --2- 172.21.15.55:0/3207171697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89680b5b60 0x7f89680b6b00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8960009d90 tx=0x7f896002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72368e776eae1271 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.728+0000 7f8966ffd640 1 -- 172.21.15.55:0/3207171697 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960007740 con 0x7f89680b5b60 2024-04-25T08:57:31.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.728+0000 7f8966ffd640 1 -- 172.21.15.55:0/3207171697 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89600078e0 con 0x7f89680b5b60 2024-04-25T08:57:31.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.728+0000 7f8966ffd640 1 -- 172.21.15.55:0/3207171697 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960007cb0 con 0x7f89680b5b60 2024-04-25T08:57:31.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.729+0000 7f896e6fc640 1 -- 172.21.15.55:0/3207171697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89680b5b60 msgr2=0x7f89680b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.729+0000 7f896e6fc640 1 --2- 172.21.15.55:0/3207171697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89680b5b60 0x7f89680b6b00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8960009d90 tx=0x7f896002a660 comp rx=0 tx=0).stop 2024-04-25T08:57:31.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.729+0000 7f896e6fc640 1 -- 172.21.15.55:0/3207171697 shutdown_connections 2024-04-25T08:57:31.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.729+0000 7f896e6fc640 1 --2- 172.21.15.55:0/3207171697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89680b5b60 0x7f89680b6b00 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.729+0000 7f896e6fc640 1 --2- 172.21.15.55:0/3207171697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f896815dce0 0x7f89680d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.729+0000 7f896e6fc640 1 -- 172.21.15.55:0/3207171697 >> 172.21.15.55:0/3207171697 conn(0x7f8968072900 msgr2=0x7f89680d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.729+0000 7f896e6fc640 1 -- 172.21.15.55:0/3207171697 shutdown_connections 2024-04-25T08:57:31.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.729+0000 7f896e6fc640 1 -- 172.21.15.55:0/3207171697 wait complete. 2024-04-25T08:57:31.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.730+0000 7f896e6fc640 1 Processor -- start 2024-04-25T08:57:31.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.730+0000 7f896e6fc640 1 -- start start 2024-04-25T08:57:31.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f896e6fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89680b5b60 0x7f8968155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f896e6fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89680d35b0 0x7f8968160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f896e6fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f896815dce0 0x7f8968160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f896e6fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89680b9820 con 0x7f89680b5b60 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f896e6fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89680d3090 con 0x7f89680d35b0 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f896e6fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89680b99a0 con 0x7f896815dce0 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f8967fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89680b5b60 0x7f8968155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f8967fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89680b5b60 0x7f8968155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59028/0 (socket says 172.21.15.55:59028) 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f8967fff640 1 -- 172.21.15.55:0/4011503686 learned_addr learned my addr 172.21.15.55:0/4011503686 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f896cc99640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f896815dce0 0x7f8968160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f8967fff640 1 -- 172.21.15.55:0/4011503686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f896815dce0 msgr2=0x7f8968160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f89677fe640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89680d35b0 0x7f8968160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f8967fff640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f896815dce0 0x7f8968160050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f8967fff640 1 -- 172.21.15.55:0/4011503686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89680d35b0 msgr2=0x7f8968160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f8967fff640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89680d35b0 0x7f8968160a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.731+0000 7f8967fff640 1 -- 172.21.15.55:0/4011503686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896815f010 con 0x7f89680b5b60 2024-04-25T08:57:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.732+0000 7f8967fff640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89680b5b60 0x7f8968155210 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f895800c7f0 tx=0x7f895800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.732+0000 7f8964ff9640 1 -- 172.21.15.55:0/4011503686 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958015070 con 0x7f89680b5b60 2024-04-25T08:57:31.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.732+0000 7f8964ff9640 1 -- 172.21.15.55:0/4011503686 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8958007820 con 0x7f89680b5b60 2024-04-25T08:57:31.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.732+0000 7f896e6fc640 1 -- 172.21.15.55:0/4011503686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896815f290 con 0x7f89680b5b60 2024-04-25T08:57:31.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.732+0000 7f8964ff9640 1 -- 172.21.15.55:0/4011503686 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958007bd0 con 0x7f89680b5b60 2024-04-25T08:57:31.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.732+0000 7f896e6fc640 1 -- 172.21.15.55:0/4011503686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896815f850 con 0x7f89680b5b60 2024-04-25T08:57:31.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.733+0000 7f896e6fc640 1 -- 172.21.15.55:0/4011503686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89680749b0 con 0x7f89680b5b60 2024-04-25T08:57:31.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.733+0000 7f8964ff9640 1 -- 172.21.15.55:0/4011503686 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8958018070 con 0x7f89680b5b60 2024-04-25T08:57:31.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.734+0000 7f8964ff9640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f895406b4d0 0x7f895406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:31.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.734+0000 7f89677fe640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f895406b4d0 0x7f895406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:31.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.734+0000 7f8964ff9640 1 -- 172.21.15.55:0/4011503686 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f895808a1c0 con 0x7f89680b5b60 2024-04-25T08:57:31.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.734+0000 7f89677fe640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f895406b4d0 0x7f895406d990 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f89680ca520 tx=0x7f895c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:31.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.738+0000 7f8964ff9640 1 -- 172.21.15.55:0/4011503686 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f896815f010 con 0x7f89680b5b60 2024-04-25T08:57:31.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.958+0000 7f896e6fc640 1 -- 172.21.15.55:0/4011503686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f89680b2700 con 0x7f89680b5b60 2024-04-25T08:57:31.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.959+0000 7f8964ff9640 1 -- 172.21.15.55:0/4011503686 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8958058fa0 con 0x7f89680b5b60 2024-04-25T08:57:31.948 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:31.949 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T08:57:31.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 -- 172.21.15.55:0/4011503686 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f895406b4d0 msgr2=0x7f895406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f895406b4d0 0x7f895406d990 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f89680ca520 tx=0x7f895c009040 comp rx=0 tx=0).stop 2024-04-25T08:57:31.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 -- 172.21.15.55:0/4011503686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89680b5b60 msgr2=0x7f8968155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:31.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89680b5b60 0x7f8968155210 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f895800c7f0 tx=0x7f895800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 -- 172.21.15.55:0/4011503686 shutdown_connections 2024-04-25T08:57:31.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f895406b4d0 0x7f895406d990 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f896815dce0 0x7f8968160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89680d35b0 0x7f8968160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 --2- 172.21.15.55:0/4011503686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89680b5b60 0x7f8968155210 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 -- 172.21.15.55:0/4011503686 >> 172.21.15.55:0/4011503686 conn(0x7f8968072900 msgr2=0x7f89680ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 -- 172.21.15.55:0/4011503686 shutdown_connections 2024-04-25T08:57:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:31.961+0000 7f896e6fc640 1 -- 172.21.15.55:0/4011503686 wait complete. 2024-04-25T08:57:31.961 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T08:57:31.961 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:57:31.961 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:57:32.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:57:32.044 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:57:32.045 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:57:32.045 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:32.061 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:57:32.061 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:32.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.268+0000 7fcd44be0640 1 Processor -- start 2024-04-25T08:57:32.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.268+0000 7fcd44be0640 1 -- start start 2024-04-25T08:57:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd44be0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd4015dce0 0x7fcd400d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd44be0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcd400b5b60 0x7fcd400b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd44be0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4015e0c0 con 0x7fcd400d35b0 2024-04-25T08:57:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd44be0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd400d2510 con 0x7fcd400b5b60 2024-04-25T08:57:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd44be0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400d27f0 con 0x7fcd4015dce0 2024-04-25T08:57:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd37fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcd400d35b0 0x7fcd400b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56624/0 (socket says 172.21.15.55:56624) 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd37fff640 1 -- 172.21.15.55:0/3985953413 learned_addr learned my addr 172.21.15.55:0/3985953413 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3e59c640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd4015dce0 0x7fcd400d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3ed9d640 1 --2- 172.21.15.55:0/3985953413 >> v2:172.21.15.167:3300/0 conn(0x7fcd400b5b60 0x7fcd400b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173102224 0 0) 0x7fcd4015e0c0 con 0x7fcd400d35b0 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd2c003520 con 0x7fcd400d35b0 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274730832 0 0) 0x7fcd2c003520 con 0x7fcd400d35b0 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd4015dce0 msgr2=0x7fcd400d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3dd9b640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd4015dce0 0x7fcd400d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 >> v2:172.21.15.167:3300/0 conn(0x7fcd400b5b60 msgr2=0x7fcd400b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3dd9b640 1 --2- 172.21.15.55:0/3985953413 >> v2:172.21.15.167:3300/0 conn(0x7fcd400b5b60 0x7fcd400b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd400d2ad0 con 0x7fcd400d35b0 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fcd28001670 con 0x7fcd400d35b0 2024-04-25T08:57:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.269+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 >> v1:172.21.15.55:6789/0 conn(0x7fcd400d35b0 legacy=0x7fcd400b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3dd9b640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd4015dce0 0x7fcd2c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3dd9b640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd2c003f30 0x7fcd2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3dd9b640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd2c004d40 0x7fcd2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400d2510 con 0x7fcd2c004d40 2024-04-25T08:57:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400d27f0 con 0x7fcd2c003f30 2024-04-25T08:57:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c00b9c0 con 0x7fcd4015dce0 2024-04-25T08:57:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3ed9d640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd2c004d40 0x7fcd2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd37fff640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd2c003f30 0x7fcd2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3e59c640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd4015dce0 0x7fcd2c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3ed9d640 1 -- 172.21.15.55:0/3985953413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd4015dce0 msgr2=0x7fcd2c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3ed9d640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd4015dce0 0x7fcd2c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3ed9d640 1 -- 172.21.15.55:0/3985953413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd2c003f30 msgr2=0x7fcd2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3ed9d640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd2c003f30 0x7fcd2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.270+0000 7fcd3ed9d640 1 -- 172.21.15.55:0/3985953413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c003520 con 0x7fcd2c004d40 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.271+0000 7fcd3ed9d640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd2c004d40 0x7fcd2c0051c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009fc0 tx=0x7fcd2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88201289c2c40f6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.271+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38009c10 con 0x7fcd2c004d40 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.271+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd38036070 con 0x7fcd2c004d40 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.271+0000 7fcd3dd9b640 1 -- 172.21.15.55:0/3985953413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3802d070 con 0x7fcd2c004d40 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.271+0000 7fcd44be0640 1 -- 172.21.15.55:0/3985953413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd2c004d40 msgr2=0x7fcd2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.271+0000 7fcd44be0640 1 --2- 172.21.15.55:0/3985953413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd2c004d40 0x7fcd2c0051c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009fc0 tx=0x7fcd2c005830 comp rx=0 tx=0).stop 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.271+0000 7fcd3ed9d640 1 -- 172.21.15.55:0/3985953413 reap_dead start 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.271+0000 7fcd44be0640 1 -- 172.21.15.55:0/3985953413 shutdown_connections 2024-04-25T08:57:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.271+0000 7fcd44be0640 1 -- 172.21.15.55:0/3985953413 >> 172.21.15.55:0/3985953413 conn(0x7fcd40072900 msgr2=0x7fcd400d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:32.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.271+0000 7fcd44be0640 1 -- 172.21.15.55:0/3985953413 shutdown_connections 2024-04-25T08:57:32.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.271+0000 7fcd44be0640 1 -- 172.21.15.55:0/3985953413 wait complete. 2024-04-25T08:57:32.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.273+0000 7fcd44be0640 1 Processor -- start 2024-04-25T08:57:32.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.273+0000 7fcd44be0640 1 -- start start 2024-04-25T08:57:32.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd44be0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd40153080 0x7fcd40160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd44be0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd40153460 0x7fcd401f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd44be0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd401f7530 0x7fcd400cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd44be0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400b9820 con 0x7fcd40153080 2024-04-25T08:57:32.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd44be0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400d3090 con 0x7fcd401f7530 2024-04-25T08:57:32.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd44be0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400b99a0 con 0x7fcd40153460 2024-04-25T08:57:32.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd3e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd40153080 0x7fcd40160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd3e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd40153080 0x7fcd40160bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59054/0 (socket says 172.21.15.55:59054) 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd3e59c640 1 -- 172.21.15.55:0/1181497210 learned_addr learned my addr 172.21.15.55:0/1181497210 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd3ed9d640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd401f7530 0x7fcd400cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd37fff640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd40153460 0x7fcd401f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd3e59c640 1 -- 172.21.15.55:0/1181497210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd40153460 msgr2=0x7fcd401f6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd3e59c640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd40153460 0x7fcd401f6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd3e59c640 1 -- 172.21.15.55:0/1181497210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd401f7530 msgr2=0x7fcd400cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd3e59c640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd401f7530 0x7fcd400cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd3e59c640 1 -- 172.21.15.55:0/1181497210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd400cbdf0 con 0x7fcd40153080 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd3e59c640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd40153080 0x7fcd40160bd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fcd300119a0 tx=0x7fcd30011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd36ffd640 1 -- 172.21.15.55:0/1181497210 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000faf0 con 0x7fcd40153080 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd36ffd640 1 -- 172.21.15.55:0/1181497210 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3000fc90 con 0x7fcd40153080 2024-04-25T08:57:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd44be0640 1 -- 172.21.15.55:0/1181497210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4015f070 con 0x7fcd40153080 2024-04-25T08:57:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd36ffd640 1 -- 172.21.15.55:0/1181497210 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30014440 con 0x7fcd40153080 2024-04-25T08:57:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.274+0000 7fcd44be0640 1 -- 172.21.15.55:0/1181497210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd40161110 con 0x7fcd40153080 2024-04-25T08:57:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.275+0000 7fcd44be0640 1 -- 172.21.15.55:0/1181497210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd400749b0 con 0x7fcd40153080 2024-04-25T08:57:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.276+0000 7fcd36ffd640 1 -- 172.21.15.55:0/1181497210 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd30012040 con 0x7fcd40153080 2024-04-25T08:57:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.276+0000 7fcd36ffd640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd2006b500 0x7fcd2006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.276+0000 7fcd36ffd640 1 -- 172.21.15.55:0/1181497210 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd3008a730 con 0x7fcd40153080 2024-04-25T08:57:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.277+0000 7fcd37fff640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd2006b500 0x7fcd2006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.277+0000 7fcd37fff640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd2006b500 0x7fcd2006d9c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcd28004840 tx=0x7fcd28007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.281+0000 7fcd36ffd640 1 -- 172.21.15.55:0/1181497210 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd30019030 con 0x7fcd40153080 2024-04-25T08:57:32.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.462+0000 7fcd44be0640 1 -- 172.21.15.55:0/1181497210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd401f7910 con 0x7fcd40153080 2024-04-25T08:57:32.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.463+0000 7fcd36ffd640 1 -- 172.21.15.55:0/1181497210 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16665 (secure 0 0 0) 0x7fcd30058f60 con 0x7fcd40153080 2024-04-25T08:57:32.453 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:32.453 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":61,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:56:19.191031+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:15.846477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:16.537036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:32.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 -- 172.21.15.55:0/1181497210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd2006b500 msgr2=0x7fcd2006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd2006b500 0x7fcd2006d9c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcd28004840 tx=0x7fcd28007970 comp rx=0 tx=0).stop 2024-04-25T08:57:32.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 -- 172.21.15.55:0/1181497210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd40153080 msgr2=0x7fcd40160bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd40153080 0x7fcd40160bd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fcd300119a0 tx=0x7fcd30011e60 comp rx=0 tx=0).stop 2024-04-25T08:57:32.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 -- 172.21.15.55:0/1181497210 shutdown_connections 2024-04-25T08:57:32.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd2006b500 0x7fcd2006d9c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd401f7530 0x7fcd400cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd40153460 0x7fcd401f6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 --2- 172.21.15.55:0/1181497210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd40153080 0x7fcd40160bd0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 -- 172.21.15.55:0/1181497210 >> 172.21.15.55:0/1181497210 conn(0x7fcd40072900 msgr2=0x7fcd400b6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:32.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 -- 172.21.15.55:0/1181497210 shutdown_connections 2024-04-25T08:57:32.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.465+0000 7fcd44be0640 1 -- 172.21.15.55:0/1181497210 wait complete. 2024-04-25T08:57:32.465 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:15.846477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:16.537036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:32.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:32.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.580+0000 7f57813b7640 1 Processor -- start 2024-04-25T08:57:32.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.580+0000 7f57813b7640 1 -- start start 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.581+0000 7f57813b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f577c15dc80 0x7f577c161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.581+0000 7f57813b7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f577c0b97c0 0x7f577c0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.581+0000 7f57813b7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f577c0b5a30 0x7f577c06bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.581+0000 7f57813b7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c0b5ea0 con 0x7f577c0b97c0 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.581+0000 7f57813b7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c1627a0 con 0x7f577c0b5a30 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.581+0000 7f57813b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c1621e0 con 0x7f577c15dc80 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.581+0000 7f577a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f577c0b97c0 0x7f577c0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.581+0000 7f577a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f577c0b97c0 0x7f577c0b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59070/0 (socket says 172.21.15.55:59070) 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.581+0000 7f577a7fc640 1 -- 172.21.15.55:0/3501109932 learned_addr learned my addr 172.21.15.55:0/3501109932 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.581+0000 7f577affd640 1 --2- 172.21.15.55:0/3501109932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f577c15dc80 0x7f577c161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.581+0000 7f577b7fe640 1 --2- 172.21.15.55:0/3501109932 >> v2:172.21.15.167:3300/0 conn(0x7f577c0b5a30 0x7f577c06bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.582+0000 7f577a7fc640 1 -- 172.21.15.55:0/3501109932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f577c15dc80 msgr2=0x7f577c161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.582+0000 7f577a7fc640 1 --2- 172.21.15.55:0/3501109932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f577c15dc80 0x7f577c161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.582+0000 7f577a7fc640 1 -- 172.21.15.55:0/3501109932 >> v2:172.21.15.167:3300/0 conn(0x7f577c0b5a30 msgr2=0x7f577c06bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.582+0000 7f577a7fc640 1 --2- 172.21.15.55:0/3501109932 >> v2:172.21.15.167:3300/0 conn(0x7f577c0b5a30 0x7f577c06bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.582+0000 7f577a7fc640 1 -- 172.21.15.55:0/3501109932 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c1624c0 con 0x7f577c0b97c0 2024-04-25T08:57:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.582+0000 7f577a7fc640 1 --2- 172.21.15.55:0/3501109932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f577c0b97c0 0x7f577c0b54f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f577c0d16d0 tx=0x7f576402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb943580303b584f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.582+0000 7f5779ffb640 1 -- 172.21.15.55:0/3501109932 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764037070 con 0x7f577c0b97c0 2024-04-25T08:57:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.582+0000 7f5779ffb640 1 -- 172.21.15.55:0/3501109932 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764032440 con 0x7f577c0b97c0 2024-04-25T08:57:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.582+0000 7f5779ffb640 1 -- 172.21.15.55:0/3501109932 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764032810 con 0x7f577c0b97c0 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.583+0000 7f57813b7640 1 -- 172.21.15.55:0/3501109932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f577c0b97c0 msgr2=0x7f577c0b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.583+0000 7f57813b7640 1 --2- 172.21.15.55:0/3501109932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f577c0b97c0 0x7f577c0b54f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f577c0d16d0 tx=0x7f576402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.583+0000 7f57813b7640 1 -- 172.21.15.55:0/3501109932 shutdown_connections 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.583+0000 7f57813b7640 1 --2- 172.21.15.55:0/3501109932 >> v2:172.21.15.167:3300/0 conn(0x7f577c0b5a30 0x7f577c06bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.583+0000 7f57813b7640 1 --2- 172.21.15.55:0/3501109932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f577c0b97c0 0x7f577c0b54f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.583+0000 7f57813b7640 1 --2- 172.21.15.55:0/3501109932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f577c15dc80 0x7f577c161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.583+0000 7f57813b7640 1 -- 172.21.15.55:0/3501109932 >> 172.21.15.55:0/3501109932 conn(0x7f577c0d04f0 msgr2=0x7f577c0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.583+0000 7f57813b7640 1 -- 172.21.15.55:0/3501109932 shutdown_connections 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.583+0000 7f57813b7640 1 -- 172.21.15.55:0/3501109932 wait complete. 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.584+0000 7f57813b7640 1 Processor -- start 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.584+0000 7f57813b7640 1 -- start start 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.585+0000 7f57813b7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f577c0b5a30 0x7f577c1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.585+0000 7f57813b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f577c0b97c0 0x7f577c0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.585+0000 7f57813b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f577c15dc80 0x7f577c0d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.585+0000 7f57813b7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c161db0 con 0x7f577c0b5a30 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.585+0000 7f57813b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c15e060 con 0x7f577c0b97c0 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.585+0000 7f57813b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c161f30 con 0x7f577c15dc80 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.585+0000 7f577affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f577c0b5a30 0x7f577c1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.585+0000 7f577affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f577c0b5a30 0x7f577c1572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59072/0 (socket says 172.21.15.55:59072) 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.585+0000 7f577affd640 1 -- 172.21.15.55:0/256421832 learned_addr learned my addr 172.21.15.55:0/256421832 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.585+0000 7f577b7fe640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f577c15dc80 0x7f577c0d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.585+0000 7f577a7fc640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f577c0b97c0 0x7f577c0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f577affd640 1 -- 172.21.15.55:0/256421832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f577c15dc80 msgr2=0x7f577c0d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f577affd640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f577c15dc80 0x7f577c0d2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f577affd640 1 -- 172.21.15.55:0/256421832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f577c0b97c0 msgr2=0x7f577c0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f577affd640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f577c0b97c0 0x7f577c0cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f577affd640 1 -- 172.21.15.55:0/256421832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c0b5040 con 0x7f577c0b5a30 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f577b7fe640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f577c15dc80 0x7f577c0d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f577a7fc640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f577c0b97c0 0x7f577c0cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f577affd640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f577c0b5a30 0x7f577c1572d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f577400d5f0 tx=0x7f577400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f57737fe640 1 -- 172.21.15.55:0/256421832 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57740125f0 con 0x7f577c0b5a30 2024-04-25T08:57:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f57737fe640 1 -- 172.21.15.55:0/256421832 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5774019070 con 0x7f577c0b5a30 2024-04-25T08:57:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f57813b7640 1 -- 172.21.15.55:0/256421832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c0c8c00 con 0x7f577c0b5a30 2024-04-25T08:57:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f57737fe640 1 -- 172.21.15.55:0/256421832 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57740129d0 con 0x7f577c0b5a30 2024-04-25T08:57:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.586+0000 7f57813b7640 1 -- 172.21.15.55:0/256421832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c0c8ec0 con 0x7f577c0b5a30 2024-04-25T08:57:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.587+0000 7f57813b7640 1 -- 172.21.15.55:0/256421832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c0750b0 con 0x7f577c0b5a30 2024-04-25T08:57:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.587+0000 7f57737fe640 1 -- 172.21.15.55:0/256421832 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5774012b70 con 0x7f577c0b5a30 2024-04-25T08:57:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.588+0000 7f57737fe640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f575c06b4d0 0x7f575c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.588+0000 7f57737fe640 1 -- 172.21.15.55:0/256421832 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f577408a560 con 0x7f577c0b5a30 2024-04-25T08:57:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.588+0000 7f577a7fc640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f575c06b4d0 0x7f575c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.588+0000 7f577a7fc640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f575c06b4d0 0x7f575c06d990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5764034000 tx=0x7f576402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.592+0000 7f57737fe640 1 -- 172.21.15.55:0/256421832 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f577c0b5040 con 0x7f577c0b5a30 2024-04-25T08:57:32.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.775+0000 7f57813b7640 1 -- 172.21.15.55:0/256421832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f577c0c8860 con 0x7f577c0b5a30 2024-04-25T08:57:32.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.776+0000 7f57737fe640 1 -- 172.21.15.55:0/256421832 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5774059470 con 0x7f577c0b5a30 2024-04-25T08:57:32.765 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:57:32.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 -- 172.21.15.55:0/256421832 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f575c06b4d0 msgr2=0x7f575c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f575c06b4d0 0x7f575c06d990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5764034000 tx=0x7f576402e000 comp rx=0 tx=0).stop 2024-04-25T08:57:32.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 -- 172.21.15.55:0/256421832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f577c0b5a30 msgr2=0x7f577c1572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f577c0b5a30 0x7f577c1572d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f577400d5f0 tx=0x7f577400dab0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 -- 172.21.15.55:0/256421832 shutdown_connections 2024-04-25T08:57:32.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f575c06b4d0 0x7f575c06d990 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f577c15dc80 0x7f577c0d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f577c0b97c0 0x7f577c0cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 --2- 172.21.15.55:0/256421832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f577c0b5a30 0x7f577c1572d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 -- 172.21.15.55:0/256421832 >> 172.21.15.55:0/256421832 conn(0x7f577c0d04f0 msgr2=0x7f577c0d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:32.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 -- 172.21.15.55:0/256421832 shutdown_connections 2024-04-25T08:57:32.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.778+0000 7f57813b7640 1 -- 172.21.15.55:0/256421832 wait complete. 2024-04-25T08:57:32.778 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:32.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.892+0000 7f24639c1640 1 Processor -- start 2024-04-25T08:57:32.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.893+0000 7f24639c1640 1 -- start start 2024-04-25T08:57:32.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.893+0000 7f24639c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f245c0d3b90 0x7f245c0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.893+0000 7f24639c1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f245c0d0f60 0x7f245c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.893+0000 7f24639c1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245c0d4090 con 0x7f245c15dca0 2024-04-25T08:57:32.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.893+0000 7f24639c1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c0b6b20 con 0x7f245c0d0f60 2024-04-25T08:57:32.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.893+0000 7f24639c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0d4370 con 0x7f245c0d3b90 2024-04-25T08:57:32.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.894+0000 7f2461f5e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f245c0d0f60 0x7f245c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.894+0000 7f246175d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f245c15dca0 0x7f245c0ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56638/0 (socket says 172.21.15.55:56638) 2024-04-25T08:57:32.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.894+0000 7f246175d640 1 -- 172.21.15.55:0/2166326999 learned_addr learned my addr 172.21.15.55:0/2166326999 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:32.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.894+0000 7f2461f5e640 1 -- 172.21.15.55:0/2166326999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f245c0d3b90 msgr2=0x7f245c0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:32.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.894+0000 7f2461f5e640 1 --2- 172.21.15.55:0/2166326999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f245c0d3b90 0x7f245c0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.894+0000 7f2461f5e640 1 -- 172.21.15.55:0/2166326999 >> v1:172.21.15.55:6789/0 conn(0x7f245c15dca0 legacy=0x7f245c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.894+0000 7f2461f5e640 1 -- 172.21.15.55:0/2166326999 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0d4650 con 0x7f245c0d0f60 2024-04-25T08:57:32.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.894+0000 7f245bfff640 1 -- 172.21.15.55:0/2166326999 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236654275 0 0) 0x7f245c0d4090 con 0x7f245c15dca0 2024-04-25T08:57:32.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f2461f5e640 1 --2- 172.21.15.55:0/2166326999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f245c0d0f60 0x7f245c0b2500 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f244c009d90 tx=0x7f244c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4743205472f3e59f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f245bfff640 1 -- 172.21.15.55:0/2166326999 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c007740 con 0x7f245c0d0f60 2024-04-25T08:57:32.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f245bfff640 1 -- 172.21.15.55:0/2166326999 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c0078e0 con 0x7f245c0d0f60 2024-04-25T08:57:32.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f245bfff640 1 -- 172.21.15.55:0/2166326999 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c007cb0 con 0x7f245c0d0f60 2024-04-25T08:57:32.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f24639c1640 1 -- 172.21.15.55:0/2166326999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f245c0d0f60 msgr2=0x7f245c0b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f24639c1640 1 --2- 172.21.15.55:0/2166326999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f245c0d0f60 0x7f245c0b2500 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f244c009d90 tx=0x7f244c02a660 comp rx=0 tx=0).stop 2024-04-25T08:57:32.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f24639c1640 1 -- 172.21.15.55:0/2166326999 shutdown_connections 2024-04-25T08:57:32.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f24639c1640 1 --2- 172.21.15.55:0/2166326999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f245c0d3b90 0x7f245c0d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f24639c1640 1 --2- 172.21.15.55:0/2166326999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f245c0d0f60 0x7f245c0b2500 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f24639c1640 1 -- 172.21.15.55:0/2166326999 >> 172.21.15.55:0/2166326999 conn(0x7f245c0726c0 msgr2=0x7f245c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:32.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f24639c1640 1 -- 172.21.15.55:0/2166326999 shutdown_connections 2024-04-25T08:57:32.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.895+0000 7f24639c1640 1 -- 172.21.15.55:0/2166326999 wait complete. 2024-04-25T08:57:32.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.897+0000 7f24639c1640 1 Processor -- start 2024-04-25T08:57:32.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.897+0000 7f24639c1640 1 -- start start 2024-04-25T08:57:32.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.897+0000 7f24639c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f245c0d0f60 0x7f245c1f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.897+0000 7f24639c1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f245c0d3b90 0x7f245c149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.897+0000 7f24639c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f245c15dca0 0x7f245c155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.897+0000 7f24639c1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c15e080 con 0x7f245c0d0f60 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.897+0000 7f24639c1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0cf050 con 0x7f245c0d3b90 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.897+0000 7f24639c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c15e200 con 0x7f245c15dca0 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.897+0000 7f246175d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f245c0d0f60 0x7f245c1f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.897+0000 7f246175d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f245c0d0f60 0x7f245c1f41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59082/0 (socket says 172.21.15.55:59082) 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.897+0000 7f246175d640 1 -- 172.21.15.55:0/1080487513 learned_addr learned my addr 172.21.15.55:0/1080487513 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f2461f5e640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f245c15dca0 0x7f245c155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f2460f5c640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f245c0d3b90 0x7f245c149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f246175d640 1 -- 172.21.15.55:0/1080487513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f245c15dca0 msgr2=0x7f245c155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f246175d640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f245c15dca0 0x7f245c155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f246175d640 1 -- 172.21.15.55:0/1080487513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f245c0d3b90 msgr2=0x7f245c149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f246175d640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f245c0d3b90 0x7f245c149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f246175d640 1 -- 172.21.15.55:0/1080487513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0cd880 con 0x7f245c0d0f60 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f2461f5e640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f245c15dca0 0x7f245c155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f2460f5c640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f245c0d3b90 0x7f245c149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f246175d640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f245c0d0f60 0x7f245c1f41f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f245400c430 tx=0x7f245400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f2459ffb640 1 -- 172.21.15.55:0/1080487513 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24540074e0 con 0x7f245c0d0f60 2024-04-25T08:57:32.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f2459ffb640 1 -- 172.21.15.55:0/1080487513 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24540047e0 con 0x7f245c0d0f60 2024-04-25T08:57:32.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f24639c1640 1 -- 172.21.15.55:0/1080487513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c1f4730 con 0x7f245c0d0f60 2024-04-25T08:57:32.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f2459ffb640 1 -- 172.21.15.55:0/1080487513 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454004bd0 con 0x7f245c0d0f60 2024-04-25T08:57:32.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.898+0000 7f24639c1640 1 -- 172.21.15.55:0/1080487513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c1543a0 con 0x7f245c0d0f60 2024-04-25T08:57:32.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.899+0000 7f24639c1640 1 -- 172.21.15.55:0/1080487513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245c0750b0 con 0x7f245c0d0f60 2024-04-25T08:57:32.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.900+0000 7f2459ffb640 1 -- 172.21.15.55:0/1080487513 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2454011070 con 0x7f245c0d0f60 2024-04-25T08:57:32.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.900+0000 7f2459ffb640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f244806b500 0x7f244806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:32.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.900+0000 7f2459ffb640 1 -- 172.21.15.55:0/1080487513 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2454089de0 con 0x7f245c0d0f60 2024-04-25T08:57:32.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.900+0000 7f2460f5c640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f244806b500 0x7f244806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:32.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.901+0000 7f2460f5c640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f244806b500 0x7f244806d9c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2450006fd0 tx=0x7f2450008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:32.904+0000 7f2459ffb640 1 -- 172.21.15.55:0/1080487513 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f245c1f4730 con 0x7f245c0d0f60 2024-04-25T08:57:33.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.083+0000 7f24639c1640 1 -- 172.21.15.55:0/1080487513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f245c0b4fa0 con 0x7f245c0d0f60 2024-04-25T08:57:33.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.084+0000 7f2459ffb640 1 -- 172.21.15.55:0/1080487513 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f245c0cd880 con 0x7f245c0d0f60 2024-04-25T08:57:33.074 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:57:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 -- 172.21.15.55:0/1080487513 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f244806b500 msgr2=0x7f244806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f244806b500 0x7f244806d9c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2450006fd0 tx=0x7f2450008040 comp rx=0 tx=0).stop 2024-04-25T08:57:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 -- 172.21.15.55:0/1080487513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f245c0d0f60 msgr2=0x7f245c1f41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f245c0d0f60 0x7f245c1f41f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f245400c430 tx=0x7f245400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 -- 172.21.15.55:0/1080487513 shutdown_connections 2024-04-25T08:57:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f244806b500 0x7f244806d9c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f245c15dca0 0x7f245c155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f245c0d3b90 0x7f245c149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 --2- 172.21.15.55:0/1080487513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f245c0d0f60 0x7f245c1f41f0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 -- 172.21.15.55:0/1080487513 >> 172.21.15.55:0/1080487513 conn(0x7f245c0726c0 msgr2=0x7f245c0b8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:33.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 -- 172.21.15.55:0/1080487513 shutdown_connections 2024-04-25T08:57:33.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.086+0000 7f24639c1640 1 -- 172.21.15.55:0/1080487513 wait complete. 2024-04-25T08:57:33.086 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:33.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.201+0000 7f28873d5640 1 Processor -- start 2024-04-25T08:57:33.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.201+0000 7f28873d5640 1 -- start start 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f28873d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f288015dca0 0x7f28800ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f28873d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28800d3b90 0x7f28800d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f28873d5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28800d4090 con 0x7f28800cee80 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f28873d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28800b6b20 con 0x7f288015dca0 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f28873d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28800d4370 con 0x7f28800d3b90 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f2885171640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f288015dca0 0x7f28800ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f2885171640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f288015dca0 0x7f28800ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59098/0 (socket says 172.21.15.55:59098) 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f2885171640 1 -- 172.21.15.55:0/3303114413 learned_addr learned my addr 172.21.15.55:0/3303114413 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f2884970640 1 --2- 172.21.15.55:0/3303114413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28800d3b90 0x7f28800d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f2885171640 1 -- 172.21.15.55:0/3303114413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28800d3b90 msgr2=0x7f28800d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f2885171640 1 --2- 172.21.15.55:0/3303114413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28800d3b90 0x7f28800d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f2885171640 1 -- 172.21.15.55:0/3303114413 >> v1:172.21.15.167:6789/0 conn(0x7f28800cee80 legacy=0x7f28800b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.202+0000 7f2885171640 1 -- 172.21.15.55:0/3303114413 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28800d4650 con 0x7f288015dca0 2024-04-25T08:57:33.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.203+0000 7f2885171640 1 --2- 172.21.15.55:0/3303114413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f288015dca0 0x7f28800ce940 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f287c009870 tx=0x7f287c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acd606957b53ebc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.203+0000 7f2877fff640 1 -- 172.21.15.55:0/3303114413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c037070 con 0x7f288015dca0 2024-04-25T08:57:33.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.203+0000 7f2877fff640 1 -- 172.21.15.55:0/3303114413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c032440 con 0x7f288015dca0 2024-04-25T08:57:33.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.203+0000 7f2877fff640 1 -- 172.21.15.55:0/3303114413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c032810 con 0x7f288015dca0 2024-04-25T08:57:33.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.204+0000 7f28873d5640 1 -- 172.21.15.55:0/3303114413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f288015dca0 msgr2=0x7f28800ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.204+0000 7f28873d5640 1 --2- 172.21.15.55:0/3303114413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f288015dca0 0x7f28800ce940 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f287c009870 tx=0x7f287c02a270 comp rx=0 tx=0).stop 2024-04-25T08:57:33.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.204+0000 7f28873d5640 1 -- 172.21.15.55:0/3303114413 shutdown_connections 2024-04-25T08:57:33.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.204+0000 7f28873d5640 1 --2- 172.21.15.55:0/3303114413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28800d3b90 0x7f28800d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.204+0000 7f28873d5640 1 --2- 172.21.15.55:0/3303114413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f288015dca0 0x7f28800ce940 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.204+0000 7f28873d5640 1 -- 172.21.15.55:0/3303114413 >> 172.21.15.55:0/3303114413 conn(0x7f28800726c0 msgr2=0x7f2880072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:33.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.204+0000 7f28873d5640 1 -- 172.21.15.55:0/3303114413 shutdown_connections 2024-04-25T08:57:33.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.204+0000 7f28873d5640 1 -- 172.21.15.55:0/3303114413 wait complete. 2024-04-25T08:57:33.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.205+0000 7f28873d5640 1 Processor -- start 2024-04-25T08:57:33.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.205+0000 7f28873d5640 1 -- start start 2024-04-25T08:57:33.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f28873d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28800cee80 0x7f28800aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f28873d5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28800d3b90 0x7f288014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f28873d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f288015dca0 0x7f28801600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f28873d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288015e200 con 0x7f288015dca0 2024-04-25T08:57:33.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f28873d5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288015e080 con 0x7f28800d3b90 2024-04-25T08:57:33.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f28873d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28800d0f60 con 0x7f28800cee80 2024-04-25T08:57:33.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2885972640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f288015dca0 0x7f28801600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2885972640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f288015dca0 0x7f28801600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59108/0 (socket says 172.21.15.55:59108) 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2885972640 1 -- 172.21.15.55:0/2608460736 learned_addr learned my addr 172.21.15.55:0/2608460736 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2884970640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28800d3b90 0x7f288014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2885171640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28800cee80 0x7f28800aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2885972640 1 -- 172.21.15.55:0/2608460736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28800cee80 msgr2=0x7f28800aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2885972640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28800cee80 0x7f28800aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2885972640 1 -- 172.21.15.55:0/2608460736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28800d3b90 msgr2=0x7f288014bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2885972640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28800d3b90 0x7f288014bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2885972640 1 -- 172.21.15.55:0/2608460736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288015f2f0 con 0x7f288015dca0 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2885972640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f288015dca0 0x7f28801600b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f287800c7a0 tx=0x7f287800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2875ffb640 1 -- 172.21.15.55:0/2608460736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878003b70 con 0x7f288015dca0 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2875ffb640 1 -- 172.21.15.55:0/2608460736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2878003d30 con 0x7f288015dca0 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f28873d5640 1 -- 172.21.15.55:0/2608460736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288015f5d0 con 0x7f288015dca0 2024-04-25T08:57:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.206+0000 7f2875ffb640 1 -- 172.21.15.55:0/2608460736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800aa30 con 0x7f288015dca0 2024-04-25T08:57:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.207+0000 7f28873d5640 1 -- 172.21.15.55:0/2608460736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288015fb90 con 0x7f288015dca0 2024-04-25T08:57:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.207+0000 7f28873d5640 1 -- 172.21.15.55:0/2608460736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288015fd90 con 0x7f288015dca0 2024-04-25T08:57:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.208+0000 7f2875ffb640 1 -- 172.21.15.55:0/2608460736 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f287800abd0 con 0x7f288015dca0 2024-04-25T08:57:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.208+0000 7f2875ffb640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f286406b4d0 0x7f286406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.208+0000 7f2885171640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f286406b4d0 0x7f286406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.208+0000 7f2875ffb640 1 -- 172.21.15.55:0/2608460736 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f287808a120 con 0x7f288015dca0 2024-04-25T08:57:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.209+0000 7f2885171640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f286406b4d0 0x7f286406d990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f287c034000 tx=0x7f287c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.213+0000 7f2875ffb640 1 -- 172.21.15.55:0/2608460736 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f288015fd90 con 0x7f288015dca0 2024-04-25T08:57:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.392+0000 7f28873d5640 1 -- 172.21.15.55:0/2608460736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28800b47e0 con 0x7f288015dca0 2024-04-25T08:57:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.393+0000 7f2875ffb640 1 -- 172.21.15.55:0/2608460736 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28800b47e0 con 0x7f288015dca0 2024-04-25T08:57:33.382 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:57:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 -- 172.21.15.55:0/2608460736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f286406b4d0 msgr2=0x7f286406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f286406b4d0 0x7f286406d990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f287c034000 tx=0x7f287c02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 -- 172.21.15.55:0/2608460736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f288015dca0 msgr2=0x7f28801600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f288015dca0 0x7f28801600b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f287800c7a0 tx=0x7f287800cc60 comp rx=0 tx=0).stop 2024-04-25T08:57:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 -- 172.21.15.55:0/2608460736 shutdown_connections 2024-04-25T08:57:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f286406b4d0 0x7f286406d990 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f288015dca0 0x7f28801600b0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28800d3b90 0x7f288014bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 --2- 172.21.15.55:0/2608460736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28800cee80 0x7f28800aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 -- 172.21.15.55:0/2608460736 >> 172.21.15.55:0/2608460736 conn(0x7f28800726c0 msgr2=0x7f28800d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 -- 172.21.15.55:0/2608460736 shutdown_connections 2024-04-25T08:57:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.395+0000 7f28873d5640 1 -- 172.21.15.55:0/2608460736 wait complete. 2024-04-25T08:57:33.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:57:33.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.508+0000 7f283f0fc640 1 Processor -- start 2024-04-25T08:57:33.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.508+0000 7f283f0fc640 1 -- start start 2024-04-25T08:57:33.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283f0fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f28380d24b0 0x7f28380d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283f0fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28380d0990 0x7f28380b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283f0fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28380d2a20 con 0x7f283815dec0 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283f0fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28380d2d00 con 0x7f28380d0990 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283f0fc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28380d2fe0 con 0x7f28380d24b0 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283d699640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28380d0990 0x7f28380b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283d699640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28380d0990 0x7f28380b6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59110/0 (socket says 172.21.15.55:59110) 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283d699640 1 -- 172.21.15.55:0/1701668417 learned_addr learned my addr 172.21.15.55:0/1701668417 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f2837fff640 1 --2- 172.21.15.55:0/1701668417 >> v2:172.21.15.167:3300/0 conn(0x7f28380d24b0 0x7f28380d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283d699640 1 -- 172.21.15.55:0/1701668417 >> v2:172.21.15.167:3300/0 conn(0x7f28380d24b0 msgr2=0x7f28380d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283d699640 1 --2- 172.21.15.55:0/1701668417 >> v2:172.21.15.167:3300/0 conn(0x7f28380d24b0 0x7f28380d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283d699640 1 -- 172.21.15.55:0/1701668417 >> v1:172.21.15.167:6789/0 conn(0x7f283815dec0 legacy=0x7f28380d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f283d699640 1 -- 172.21.15.55:0/1701668417 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380d32c0 con 0x7f28380d0990 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.509+0000 7f2837fff640 1 --2- 172.21.15.55:0/1701668417 >> v2:172.21.15.167:3300/0 conn(0x7f28380d24b0 0x7f28380d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.510+0000 7f283d699640 1 --2- 172.21.15.55:0/1701668417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d0990 0x7f28380b6e90 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2828009870 tx=0x7f282802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8021267980479a98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.510+0000 7f28377fe640 1 -- 172.21.15.55:0/1701668417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828037070 con 0x7f28380d0990 2024-04-25T08:57:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.510+0000 7f28377fe640 1 -- 172.21.15.55:0/1701668417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2828032440 con 0x7f28380d0990 2024-04-25T08:57:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.510+0000 7f28377fe640 1 -- 172.21.15.55:0/1701668417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828032810 con 0x7f28380d0990 2024-04-25T08:57:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.510+0000 7f283f0fc640 1 -- 172.21.15.55:0/1701668417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d0990 msgr2=0x7f28380b6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.510+0000 7f283f0fc640 1 --2- 172.21.15.55:0/1701668417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d0990 0x7f28380b6e90 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2828009870 tx=0x7f282802a270 comp rx=0 tx=0).stop 2024-04-25T08:57:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.511+0000 7f283f0fc640 1 -- 172.21.15.55:0/1701668417 shutdown_connections 2024-04-25T08:57:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.511+0000 7f283f0fc640 1 --2- 172.21.15.55:0/1701668417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d0990 0x7f28380b6e90 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.511+0000 7f283f0fc640 1 --2- 172.21.15.55:0/1701668417 >> v2:172.21.15.167:3300/0 conn(0x7f28380d24b0 0x7f28380d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.511+0000 7f283f0fc640 1 -- 172.21.15.55:0/1701668417 >> 172.21.15.55:0/1701668417 conn(0x7f2838072900 msgr2=0x7f28380b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:33.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.511+0000 7f283f0fc640 1 -- 172.21.15.55:0/1701668417 shutdown_connections 2024-04-25T08:57:33.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.511+0000 7f283f0fc640 1 -- 172.21.15.55:0/1701668417 wait complete. 2024-04-25T08:57:33.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.512+0000 7f283f0fc640 1 Processor -- start 2024-04-25T08:57:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.512+0000 7f283f0fc640 1 -- start start 2024-04-25T08:57:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283f0fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d0990 0x7f2838146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283f0fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28380d24b0 0x7f283815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283f0fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f283815dec0 0x7f283815b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283f0fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28380b73d0 con 0x7f28380d0990 2024-04-25T08:57:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283f0fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28380d0e20 con 0x7f283815dec0 2024-04-25T08:57:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283f0fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28380b7550 con 0x7f28380d24b0 2024-04-25T08:57:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283ce98640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d0990 0x7f2838146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283ce98640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d0990 0x7f2838146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59116/0 (socket says 172.21.15.55:59116) 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283ce98640 1 -- 172.21.15.55:0/1542689014 learned_addr learned my addr 172.21.15.55:0/1542689014 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283ce98640 1 -- 172.21.15.55:0/1542689014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28380d24b0 msgr2=0x7f283815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283ce98640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28380d24b0 0x7f283815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283ce98640 1 -- 172.21.15.55:0/1542689014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f283815dec0 msgr2=0x7f283815b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283ce98640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f283815dec0 0x7f283815b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283ce98640 1 -- 172.21.15.55:0/1542689014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28381472d0 con 0x7f28380d0990 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283ce98640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d0990 0x7f2838146d90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f283000ba80 tx=0x7f283000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f28357fa640 1 -- 172.21.15.55:0/1542689014 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283000cc00 con 0x7f28380d0990 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f28357fa640 1 -- 172.21.15.55:0/1542689014 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283000cda0 con 0x7f28380d0990 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283f0fc640 1 -- 172.21.15.55:0/1542689014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2838155e10 con 0x7f28380d0990 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f28357fa640 1 -- 172.21.15.55:0/1542689014 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830003bb0 con 0x7f28380d0990 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.513+0000 7f283f0fc640 1 -- 172.21.15.55:0/1542689014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28381563d0 con 0x7f28380d0990 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.514+0000 7f283f0fc640 1 -- 172.21.15.55:0/1542689014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28380750b0 con 0x7f28380d0990 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.515+0000 7f28357fa640 1 -- 172.21.15.55:0/1542689014 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2830014440 con 0x7f28380d0990 2024-04-25T08:57:33.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.515+0000 7f28357fa640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f281806b4d0 0x7f281806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.515+0000 7f28357fa640 1 -- 172.21.15.55:0/1542689014 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f283008a1c0 con 0x7f28380d0990 2024-04-25T08:57:33.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.515+0000 7f2837fff640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f281806b4d0 0x7f281806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.516+0000 7f2837fff640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f281806b4d0 0x7f281806d990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2820006fd0 tx=0x7f2820008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:33.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.520+0000 7f28357fa640 1 -- 172.21.15.55:0/1542689014 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f28381472d0 con 0x7f28380d0990 2024-04-25T08:57:33.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.715+0000 7f283f0fc640 1 -- 172.21.15.55:0/1542689014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f283815c830 con 0x7f28380d0990 2024-04-25T08:57:33.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.715+0000 7f28357fa640 1 -- 172.21.15.55:0/1542689014 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2830059030 con 0x7f28380d0990 2024-04-25T08:57:33.705 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T08:57:33.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.717+0000 7f283f0fc640 1 -- 172.21.15.55:0/1542689014 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f281806b4d0 msgr2=0x7f281806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.717+0000 7f283f0fc640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f281806b4d0 0x7f281806d990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2820006fd0 tx=0x7f2820008040 comp rx=0 tx=0).stop 2024-04-25T08:57:33.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.717+0000 7f283f0fc640 1 -- 172.21.15.55:0/1542689014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d0990 msgr2=0x7f2838146d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.717+0000 7f283f0fc640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d0990 0x7f2838146d90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f283000ba80 tx=0x7f283000bf40 comp rx=0 tx=0).stop 2024-04-25T08:57:33.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.717+0000 7f283f0fc640 1 -- 172.21.15.55:0/1542689014 shutdown_connections 2024-04-25T08:57:33.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.717+0000 7f283f0fc640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f281806b4d0 0x7f281806d990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.717+0000 7f283f0fc640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f283815dec0 0x7f283815b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.717+0000 7f283f0fc640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28380d24b0 0x7f283815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.717+0000 7f283f0fc640 1 --2- 172.21.15.55:0/1542689014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d0990 0x7f2838146d90 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.717+0000 7f283f0fc640 1 -- 172.21.15.55:0/1542689014 >> 172.21.15.55:0/1542689014 conn(0x7f2838072900 msgr2=0x7f28380ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:33.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.718+0000 7f283f0fc640 1 -- 172.21.15.55:0/1542689014 shutdown_connections 2024-04-25T08:57:33.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:33.718+0000 7f283f0fc640 1 -- 172.21.15.55:0/1542689014 wait complete. 2024-04-25T08:57:33.718 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:57:33.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:33.718 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:57:33.778 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:57:33.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:33.779 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:57:33.798 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:57:33.798 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:33.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:57:33.815 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:57:33.815 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:33.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:57:33.854 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:57:33.854 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:33.871 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:57:33.871 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:33.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.005+0000 7fcfdf716640 1 Processor -- start 2024-04-25T08:57:33.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.005+0000 7fcfdf716640 1 -- start start 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.006+0000 7fcfdf716640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcfd80d0050 0x7fcfd8168960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.006+0000 7fcfdf716640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd80cd930 con 0x7fcfd815df40 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.006+0000 7fcfdf716640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd80cdc10 con 0x7fcfd80cd320 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.006+0000 7fcfdf716640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd80cc5b0 con 0x7fcfd80d0050 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.006+0000 7fcfdd4b2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcfd815df40 0x7fcfd80b19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56640/0 (socket says 172.21.15.55:56640) 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.006+0000 7fcfdd4b2640 1 -- 172.21.15.55:0/2859488004 learned_addr learned my addr 172.21.15.55:0/2859488004 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfddcb3640 1 --2- 172.21.15.55:0/2859488004 >> v2:172.21.15.167:3300/0 conn(0x7fcfd80d0050 0x7fcfd8168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881638612 0 0) 0x7fcfd80cd930 con 0x7fcfd815df40 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc0003520 con 0x7fcfd815df40 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 949155367 0 0) 0x7fcfc0003520 con 0x7fcfd815df40 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 >> v2:172.21.15.167:3300/0 conn(0x7fcfd80d0050 msgr2=0x7fcfd8168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 --2- 172.21.15.55:0/2859488004 >> v2:172.21.15.167:3300/0 conn(0x7fcfd80d0050 0x7fcfd8168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 >> v1:172.21.15.167:6789/0 conn(0x7fcfd80cd320 legacy=0x7fcfd80cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80cdef0 con 0x7fcfd815df40 2024-04-25T08:57:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fcfd0001670 con 0x7fcfd815df40 2024-04-25T08:57:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 >> v1:172.21.15.55:6789/0 conn(0x7fcfd815df40 legacy=0x7fcfd80b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 --2- 172.21.15.55:0/2859488004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 0x7fcfc0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 --2- 172.21.15.55:0/2859488004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc0004800 0x7fcfc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 --2- 172.21.15.55:0/2859488004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc00051c0 0x7fcfc000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80cc5b0 con 0x7fcfc00039b0 2024-04-25T08:57:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc000c160 con 0x7fcfc0004800 2024-04-25T08:57:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc000c360 con 0x7fcfc00051c0 2024-04-25T08:57:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfdd4b2640 1 --2- 172.21.15.55:0/2859488004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 0x7fcfc0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfdccb1640 1 --2- 172.21.15.55:0/2859488004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc0004800 0x7fcfc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfddcb3640 1 --2- 172.21.15.55:0/2859488004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc00051c0 0x7fcfc000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfdd4b2640 1 -- 172.21.15.55:0/2859488004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc00051c0 msgr2=0x7fcfc000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfdd4b2640 1 --2- 172.21.15.55:0/2859488004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfc00051c0 0x7fcfc000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfdd4b2640 1 -- 172.21.15.55:0/2859488004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc0004800 msgr2=0x7fcfc0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfdd4b2640 1 --2- 172.21.15.55:0/2859488004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc0004800 0x7fcfc0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfddcb3640 1 -- 172.21.15.55:0/2859488004 reap_dead start 2024-04-25T08:57:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.007+0000 7fcfdd4b2640 1 -- 172.21.15.55:0/2859488004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0003520 con 0x7fcfc00039b0 2024-04-25T08:57:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.008+0000 7fcfdd4b2640 1 --2- 172.21.15.55:0/2859488004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 0x7fcfc0003dd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000c240 tx=0x7fcfc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e5bdd84c9175f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.008+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0007cf0 con 0x7fcfc00039b0 2024-04-25T08:57:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.008+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd0005af0 con 0x7fcfc00039b0 2024-04-25T08:57:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.008+0000 7fcfd7fff640 1 -- 172.21.15.55:0/2859488004 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0007070 con 0x7fcfc00039b0 2024-04-25T08:57:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.009+0000 7fcfdf716640 1 -- 172.21.15.55:0/2859488004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 msgr2=0x7fcfc0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.009+0000 7fcfdf716640 1 --2- 172.21.15.55:0/2859488004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 0x7fcfc0003dd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000c240 tx=0x7fcfc0005830 comp rx=0 tx=0).stop 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.009+0000 7fcfdf716640 1 -- 172.21.15.55:0/2859488004 shutdown_connections 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.009+0000 7fcfdf716640 1 --2- 172.21.15.55:0/2859488004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 0x7fcfc0003dd0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.009+0000 7fcfdf716640 1 -- 172.21.15.55:0/2859488004 >> 172.21.15.55:0/2859488004 conn(0x7fcfd80d06b0 msgr2=0x7fcfd80d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.009+0000 7fcfdf716640 1 -- 172.21.15.55:0/2859488004 shutdown_connections 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.009+0000 7fcfdf716640 1 -- 172.21.15.55:0/2859488004 wait complete. 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.010+0000 7fcfdf716640 1 Processor -- start 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.010+0000 7fcfdf716640 1 -- start start 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdf716640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 0x7fcfd80b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdf716640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfd8160d70 0x7fcfd81489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdf716640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfd80b49a0 0x7fcfd80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdf716640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80c4200 con 0x7fcfc00039b0 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdf716640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80cb080 con 0x7fcfd80b49a0 2024-04-25T08:57:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdf716640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80c4380 con 0x7fcfd8160d70 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdd4b2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 0x7fcfd80b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdd4b2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 0x7fcfd80b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59134/0 (socket says 172.21.15.55:59134) 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdd4b2640 1 -- 172.21.15.55:0/662362339 learned_addr learned my addr 172.21.15.55:0/662362339 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfddcb3640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfd80b49a0 0x7fcfd80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdccb1640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfd8160d70 0x7fcfd81489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdd4b2640 1 -- 172.21.15.55:0/662362339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfd8160d70 msgr2=0x7fcfd81489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdd4b2640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfd8160d70 0x7fcfd81489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdd4b2640 1 -- 172.21.15.55:0/662362339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfd80b49a0 msgr2=0x7fcfd80b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdd4b2640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfd80b49a0 0x7fcfd80b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdd4b2640 1 -- 172.21.15.55:0/662362339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80b3900 con 0x7fcfc00039b0 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdccb1640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfd8160d70 0x7fcfd81489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.011+0000 7fcfdd4b2640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 0x7fcfd80b32b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcfd002ad80 tx=0x7fcfd80cdde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.012+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/662362339 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0041020 con 0x7fcfc00039b0 2024-04-25T08:57:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.012+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/662362339 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd0038040 con 0x7fcfc00039b0 2024-04-25T08:57:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.012+0000 7fcfdf716640 1 -- 172.21.15.55:0/662362339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd80b3be0 con 0x7fcfc00039b0 2024-04-25T08:57:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.012+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/662362339 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0007070 con 0x7fcfc00039b0 2024-04-25T08:57:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.012+0000 7fcfdf716640 1 -- 172.21.15.55:0/662362339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd80b41a0 con 0x7fcfc00039b0 2024-04-25T08:57:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.013+0000 7fcfdf716640 1 -- 172.21.15.55:0/662362339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd80749b0 con 0x7fcfc00039b0 2024-04-25T08:57:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.013+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/662362339 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcfd0044020 con 0x7fcfc00039b0 2024-04-25T08:57:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.014+0000 7fcfd5ffb640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcfc406b4d0 0x7fcfc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.014+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/662362339 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfd00aa470 con 0x7fcfc00039b0 2024-04-25T08:57:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.014+0000 7fcfdccb1640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcfc406b4d0 0x7fcfc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.014+0000 7fcfdccb1640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcfc406b4d0 0x7fcfc406d990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc000c00 tx=0x7fcfcc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.018+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/662362339 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfd0079380 con 0x7fcfc00039b0 2024-04-25T08:57:34.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.235+0000 7fcfdf716640 1 -- 172.21.15.55:0/662362339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfd806f010 con 0x7fcfc00039b0 2024-04-25T08:57:34.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.235+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/662362339 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4939 (secure 0 0 0) 0x7fcfd0078c80 con 0x7fcfc00039b0 2024-04-25T08:57:34.225 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:34.225 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1092467772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1092467772},{"type":"v1","addr":"172.21.15.167:6834","nonce":1092467772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/651597245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":651597245},{"type":"v1","addr":"172.21.15.55:6837","nonce":651597245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3980280949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3980280949},{"type":"v1","addr":"172.21.15.55:6836","nonce":3980280949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:17.562426+0000","modified":"2024-04-25T08:57:06.241661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":15,"addr":"172.21.15.167:6835/238831666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":238831666},{"type":"v1","addr":"172.21.15.167:6835","nonce":238831666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:57:34.225 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 30 2024-04-25T08:57:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 -- 172.21.15.55:0/662362339 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcfc406b4d0 msgr2=0x7fcfc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcfc406b4d0 0x7fcfc406d990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc000c00 tx=0x7fcfcc009040 comp rx=0 tx=0).stop 2024-04-25T08:57:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 -- 172.21.15.55:0/662362339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 msgr2=0x7fcfd80b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 0x7fcfd80b32b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcfd002ad80 tx=0x7fcfd80cdde0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 -- 172.21.15.55:0/662362339 shutdown_connections 2024-04-25T08:57:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcfc406b4d0 0x7fcfc406d990 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfd80b49a0 0x7fcfd80b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfd8160d70 0x7fcfd81489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 --2- 172.21.15.55:0/662362339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfc00039b0 0x7fcfd80b32b0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 -- 172.21.15.55:0/662362339 >> 172.21.15.55:0/662362339 conn(0x7fcfd80d06b0 msgr2=0x7fcfd80b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 -- 172.21.15.55:0/662362339 shutdown_connections 2024-04-25T08:57:34.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.237+0000 7fcfdf716640 1 -- 172.21.15.55:0/662362339 wait complete. 2024-04-25T08:57:34.238 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:34.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.350+0000 7ff04d5ce640 1 Processor -- start 2024-04-25T08:57:34.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.350+0000 7ff04d5ce640 1 -- start start 2024-04-25T08:57:34.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.351+0000 7ff04d5ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 0x7ff04806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.351+0000 7ff04d5ce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff04806c1f0 0x7ff0480cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.351+0000 7ff04d5ce640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04806c680 con 0x7ff04815ba10 2024-04-25T08:57:34.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.351+0000 7ff04d5ce640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0480cbe50 con 0x7ff04806c1f0 2024-04-25T08:57:34.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.351+0000 7ff04d5ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480cfe80 con 0x7ff04809a150 2024-04-25T08:57:34.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.351+0000 7ff0467fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 0x7ff04806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.351+0000 7ff0477fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff04806c1f0 0x7ff0480cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.351+0000 7ff0477fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff04806c1f0 0x7ff0480cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:49958/0 (socket says 172.21.15.55:49958) 2024-04-25T08:57:34.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.351+0000 7ff0467fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 0x7ff04806bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:40716/0 (socket says 172.21.15.55:40716) 2024-04-25T08:57:34.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.351+0000 7ff0477fe640 1 -- 172.21.15.55:0/1367938483 learned_addr learned my addr 172.21.15.55:0/1367938483 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:34.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.351+0000 7ff046ffd640 1 --1- 172.21.15.55:0/1367938483 >> v1:172.21.15.167:6789/0 conn(0x7ff04815ba10 0x7ff048099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:57414/0 (socket says 172.21.15.55:57414) 2024-04-25T08:57:34.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.352+0000 7ff0467fc640 1 -- 172.21.15.55:0/1367938483 >> v2:172.21.15.167:3300/0 conn(0x7ff04806c1f0 msgr2=0x7ff0480cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:34.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.352+0000 7ff0467fc640 1 --2- 172.21.15.55:0/1367938483 >> v2:172.21.15.167:3300/0 conn(0x7ff04806c1f0 0x7ff0480cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.352+0000 7ff0467fc640 1 -- 172.21.15.55:0/1367938483 >> v1:172.21.15.167:6789/0 conn(0x7ff04815ba10 legacy=0x7ff048099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.352+0000 7ff0467fc640 1 -- 172.21.15.55:0/1367938483 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04806c900 con 0x7ff04809a150 2024-04-25T08:57:34.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.352+0000 7ff0467fc640 1 --2- 172.21.15.55:0/1367938483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 0x7ff04806bcb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff0300097a0 tx=0x7ff03002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbdf2c1e22197c48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.353+0000 7ff045ffb640 1 -- 172.21.15.55:0/1367938483 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030037070 con 0x7ff04809a150 2024-04-25T08:57:34.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.353+0000 7ff045ffb640 1 -- 172.21.15.55:0/1367938483 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff030032440 con 0x7ff04809a150 2024-04-25T08:57:34.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.353+0000 7ff045ffb640 1 -- 172.21.15.55:0/1367938483 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030032810 con 0x7ff04809a150 2024-04-25T08:57:34.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.353+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1367938483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 msgr2=0x7ff04806bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.353+0000 7ff04d5ce640 1 --2- 172.21.15.55:0/1367938483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 0x7ff04806bcb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff0300097a0 tx=0x7ff03002a180 comp rx=0 tx=0).stop 2024-04-25T08:57:34.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.353+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1367938483 shutdown_connections 2024-04-25T08:57:34.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.353+0000 7ff04d5ce640 1 --2- 172.21.15.55:0/1367938483 >> v2:172.21.15.167:3300/0 conn(0x7ff04806c1f0 0x7ff0480cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.353+0000 7ff04d5ce640 1 --2- 172.21.15.55:0/1367938483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 0x7ff04806bcb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.353+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1367938483 >> 172.21.15.55:0/1367938483 conn(0x7ff0480b32f0 msgr2=0x7ff0480b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:34.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.353+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1367938483 shutdown_connections 2024-04-25T08:57:34.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.353+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1367938483 wait complete. 2024-04-25T08:57:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.354+0000 7ff04d5ce640 1 Processor -- start 2024-04-25T08:57:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff04d5ce640 1 -- start start 2024-04-25T08:57:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff04d5ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff04806c1f0 0x7ff0480b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff04d5ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 0x7ff0480cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff04d5ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff04815ba10 0x7ff048159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff04d5ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480cd760 con 0x7ff04806c1f0 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff04d5ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04806cec0 con 0x7ff04815ba10 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff04d5ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480cd8e0 con 0x7ff04809a150 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff046ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff04806c1f0 0x7ff0480b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff046ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff04806c1f0 0x7ff0480b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59140/0 (socket says 172.21.15.55:59140) 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff046ffd640 1 -- 172.21.15.55:0/1409969152 learned_addr learned my addr 172.21.15.55:0/1409969152 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff0477fe640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff04815ba10 0x7ff048159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.355+0000 7ff0467fc640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 0x7ff0480cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.356+0000 7ff046ffd640 1 -- 172.21.15.55:0/1409969152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 msgr2=0x7ff0480cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.356+0000 7ff046ffd640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 0x7ff0480cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.356+0000 7ff046ffd640 1 -- 172.21.15.55:0/1409969152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff04815ba10 msgr2=0x7ff048159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.356+0000 7ff046ffd640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff04815ba10 0x7ff048159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.356+0000 7ff046ffd640 1 -- 172.21.15.55:0/1409969152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480c9f40 con 0x7ff04806c1f0 2024-04-25T08:57:34.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.356+0000 7ff046ffd640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff04806c1f0 0x7ff0480b4e10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c730 tx=0x7ff03800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.356+0000 7ff03f7fe640 1 -- 172.21.15.55:0/1409969152 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038017070 con 0x7ff04806c1f0 2024-04-25T08:57:34.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.356+0000 7ff03f7fe640 1 -- 172.21.15.55:0/1409969152 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03800ce40 con 0x7ff04806c1f0 2024-04-25T08:57:34.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.356+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1409969152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0480ca220 con 0x7ff04806c1f0 2024-04-25T08:57:34.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.356+0000 7ff03f7fe640 1 -- 172.21.15.55:0/1409969152 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03800a860 con 0x7ff04806c1f0 2024-04-25T08:57:34.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.356+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1409969152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0480ca7e0 con 0x7ff04806c1f0 2024-04-25T08:57:34.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.357+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1409969152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0480749b0 con 0x7ff04806c1f0 2024-04-25T08:57:34.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.358+0000 7ff03f7fe640 1 -- 172.21.15.55:0/1409969152 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff03801a070 con 0x7ff04806c1f0 2024-04-25T08:57:34.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.358+0000 7ff03f7fe640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff02806b4d0 0x7ff02806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.358+0000 7ff0467fc640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff02806b4d0 0x7ff02806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.358+0000 7ff03f7fe640 1 -- 172.21.15.55:0/1409969152 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0380896e0 con 0x7ff04806c1f0 2024-04-25T08:57:34.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.359+0000 7ff0467fc640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff02806b4d0 0x7ff02806d990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff030034000 tx=0x7ff03002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.362+0000 7ff03f7fe640 1 -- 172.21.15.55:0/1409969152 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff04806c680 con 0x7ff04806c1f0 2024-04-25T08:57:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.543+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1409969152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0480b4120 con 0x7ff04806c1f0 2024-04-25T08:57:34.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.544+0000 7ff03f7fe640 1 -- 172.21.15.55:0/1409969152 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16665 (secure 0 0 0) 0x7ff038057fa0 con 0x7ff04806c1f0 2024-04-25T08:57:34.534 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:34.534 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":61,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:56:19.191031+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:15.846477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:16.537036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.546+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1409969152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff02806b4d0 msgr2=0x7ff02806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.546+0000 7ff04d5ce640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff02806b4d0 0x7ff02806d990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff030034000 tx=0x7ff03002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.546+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1409969152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff04806c1f0 msgr2=0x7ff0480b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.546+0000 7ff04d5ce640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff04806c1f0 0x7ff0480b4e10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c730 tx=0x7ff03800cbf0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.546+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1409969152 shutdown_connections 2024-04-25T08:57:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.546+0000 7ff04d5ce640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff02806b4d0 0x7ff02806d990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.546+0000 7ff04d5ce640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff04815ba10 0x7ff048159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.546+0000 7ff04d5ce640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff04809a150 0x7ff0480cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.546+0000 7ff04d5ce640 1 --2- 172.21.15.55:0/1409969152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff04806c1f0 0x7ff0480b4e10 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.546+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1409969152 >> 172.21.15.55:0/1409969152 conn(0x7ff0480b32f0 msgr2=0x7ff048070020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.547+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1409969152 shutdown_connections 2024-04-25T08:57:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.547+0000 7ff04d5ce640 1 -- 172.21.15.55:0/1409969152 wait complete. 2024-04-25T08:57:34.547 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:56:15.846477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:56:16.537036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:34.547 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:34.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.663+0000 7f8fda058640 1 Processor -- start 2024-04-25T08:57:34.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.663+0000 7f8fda058640 1 -- start start 2024-04-25T08:57:34.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fda058640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd40d3b90 0x7f8fd40d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fda058640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd40d4090 con 0x7f8fd40d0f60 2024-04-25T08:57:34.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fda058640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd40d4370 con 0x7f8fd415dca0 2024-04-25T08:57:34.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fda058640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40b6b20 con 0x7f8fd40d3b90 2024-04-25T08:57:34.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fd3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8fd40d0f60 0x7f8fd40b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56644/0 (socket says 172.21.15.55:56644) 2024-04-25T08:57:34.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fd3fff640 1 -- 172.21.15.55:0/3043722030 learned_addr learned my addr 172.21.15.55:0/3043722030 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fd2ffd640 1 --2- 172.21.15.55:0/3043722030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd40d3b90 0x7f8fd40d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fd27fc640 1 -- 172.21.15.55:0/3043722030 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752182105 0 0) 0x7f8fd40d4090 con 0x7f8fd40d0f60 2024-04-25T08:57:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fd27fc640 1 -- 172.21.15.55:0/3043722030 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc0003520 con 0x7f8fd40d0f60 2024-04-25T08:57:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fd27fc640 1 -- 172.21.15.55:0/3043722030 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921266394 0 0) 0x7f8fd40d4370 con 0x7f8fd415dca0 2024-04-25T08:57:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fd27fc640 1 -- 172.21.15.55:0/3043722030 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd40d4090 con 0x7f8fd415dca0 2024-04-25T08:57:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fd27fc640 1 -- 172.21.15.55:0/3043722030 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1543996943 0 0) 0x7f8fc0003520 con 0x7f8fd40d0f60 2024-04-25T08:57:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fd2ffd640 1 -- 172.21.15.55:0/3043722030 >> v1:172.21.15.167:6789/0 conn(0x7f8fd415dca0 legacy=0x7f8fd40ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fd2ffd640 1 -- 172.21.15.55:0/3043722030 >> v1:172.21.15.55:6789/0 conn(0x7f8fd40d0f60 legacy=0x7f8fd40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.664+0000 7f8fd2ffd640 1 -- 172.21.15.55:0/3043722030 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd40d4650 con 0x7f8fd40d3b90 2024-04-25T08:57:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.665+0000 7f8fd2ffd640 1 --2- 172.21.15.55:0/3043722030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd40d3b90 0x7f8fd40d0a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0097d0 tx=0x7f8fbc02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef4f5e40ca304966 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.665+0000 7f8fd27fc640 1 -- 172.21.15.55:0/3043722030 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc037070 con 0x7f8fd40d3b90 2024-04-25T08:57:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.665+0000 7f8fd27fc640 1 -- 172.21.15.55:0/3043722030 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc02ac30 con 0x7f8fd40d3b90 2024-04-25T08:57:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.665+0000 7f8fd27fc640 1 -- 172.21.15.55:0/3043722030 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0019f0 con 0x7f8fd40d3b90 2024-04-25T08:57:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.666+0000 7f8fda058640 1 -- 172.21.15.55:0/3043722030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd40d3b90 msgr2=0x7f8fd40d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.666+0000 7f8fda058640 1 --2- 172.21.15.55:0/3043722030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd40d3b90 0x7f8fd40d0a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0097d0 tx=0x7f8fbc02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.666+0000 7f8fda058640 1 -- 172.21.15.55:0/3043722030 shutdown_connections 2024-04-25T08:57:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.666+0000 7f8fda058640 1 --2- 172.21.15.55:0/3043722030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd40d3b90 0x7f8fd40d0a20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.666+0000 7f8fda058640 1 -- 172.21.15.55:0/3043722030 >> 172.21.15.55:0/3043722030 conn(0x7f8fd40726c0 msgr2=0x7f8fd4072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.666+0000 7f8fda058640 1 -- 172.21.15.55:0/3043722030 shutdown_connections 2024-04-25T08:57:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.666+0000 7f8fda058640 1 -- 172.21.15.55:0/3043722030 wait complete. 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.667+0000 7f8fda058640 1 Processor -- start 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.667+0000 7f8fda058640 1 -- start start 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.668+0000 7f8fda058640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fd40d0f60 0x7f8fd4160d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.668+0000 7f8fda058640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd40d3b90 0x7f8fd4158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.668+0000 7f8fda058640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fd415dca0 0x7f8fd41f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.668+0000 7f8fda058640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd415e080 con 0x7f8fd40d0f60 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.668+0000 7f8fda058640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40cf050 con 0x7f8fd415dca0 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.668+0000 7f8fda058640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd415e200 con 0x7f8fd40d3b90 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.668+0000 7f8fd37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fd40d0f60 0x7f8fd4160d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.668+0000 7f8fd37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fd40d0f60 0x7f8fd4160d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59158/0 (socket says 172.21.15.55:59158) 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.668+0000 7f8fd37fe640 1 -- 172.21.15.55:0/1372370793 learned_addr learned my addr 172.21.15.55:0/1372370793 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.668+0000 7f8fd2ffd640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd40d3b90 0x7f8fd4158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.668+0000 7f8fd3fff640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fd415dca0 0x7f8fd41f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.669+0000 7f8fd37fe640 1 -- 172.21.15.55:0/1372370793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd40d3b90 msgr2=0x7f8fd4158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.669+0000 7f8fd37fe640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd40d3b90 0x7f8fd4158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.669+0000 7f8fd37fe640 1 -- 172.21.15.55:0/1372370793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fd415dca0 msgr2=0x7f8fd41f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.669+0000 7f8fd37fe640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fd415dca0 0x7f8fd41f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.669+0000 7f8fd37fe640 1 -- 172.21.15.55:0/1372370793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd41599d0 con 0x7f8fd40d0f60 2024-04-25T08:57:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.669+0000 7f8fd37fe640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fd40d0f60 0x7f8fd4160d60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c430 tx=0x7f8fc400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.669+0000 7f8fcbfff640 1 -- 172.21.15.55:0/1372370793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4017070 con 0x7f8fd40d0f60 2024-04-25T08:57:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.669+0000 7f8fcbfff640 1 -- 172.21.15.55:0/1372370793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc40052f0 con 0x7f8fd40d0f60 2024-04-25T08:57:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.669+0000 7f8fcbfff640 1 -- 172.21.15.55:0/1372370793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4003830 con 0x7f8fd40d0f60 2024-04-25T08:57:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.669+0000 7f8fda058640 1 -- 172.21.15.55:0/1372370793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd4159cb0 con 0x7f8fd40d0f60 2024-04-25T08:57:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.669+0000 7f8fda058640 1 -- 172.21.15.55:0/1372370793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd415a270 con 0x7f8fd40d0f60 2024-04-25T08:57:34.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.670+0000 7f8fda058640 1 -- 172.21.15.55:0/1372370793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd40750b0 con 0x7f8fd40d0f60 2024-04-25T08:57:34.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.671+0000 7f8fcbfff640 1 -- 172.21.15.55:0/1372370793 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8fc401a070 con 0x7f8fd40d0f60 2024-04-25T08:57:34.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.671+0000 7f8fcbfff640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fb406b4d0 0x7f8fb406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.671+0000 7f8fd2ffd640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fb406b4d0 0x7f8fb406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.671+0000 7f8fcbfff640 1 -- 172.21.15.55:0/1372370793 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fc4089480 con 0x7f8fd40d0f60 2024-04-25T08:57:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.672+0000 7f8fd2ffd640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fb406b4d0 0x7f8fb406d990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc034000 tx=0x7f8fbc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.675+0000 7f8fcbfff640 1 -- 172.21.15.55:0/1372370793 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8fc4057d40 con 0x7f8fd40d0f60 2024-04-25T08:57:34.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.859+0000 7f8fda058640 1 -- 172.21.15.55:0/1372370793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fd40cdb90 con 0x7f8fd40d0f60 2024-04-25T08:57:34.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.860+0000 7f8fcbfff640 1 -- 172.21.15.55:0/1372370793 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fc405bde0 con 0x7f8fd40d0f60 2024-04-25T08:57:34.849 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:57:34.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 -- 172.21.15.55:0/1372370793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fb406b4d0 msgr2=0x7f8fb406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fb406b4d0 0x7f8fb406d990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc034000 tx=0x7f8fbc02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 -- 172.21.15.55:0/1372370793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fd40d0f60 msgr2=0x7f8fd4160d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fd40d0f60 0x7f8fd4160d60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c430 tx=0x7f8fc400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 -- 172.21.15.55:0/1372370793 shutdown_connections 2024-04-25T08:57:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fb406b4d0 0x7f8fb406d990 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fd415dca0 0x7f8fd41f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd40d3b90 0x7f8fd4158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 --2- 172.21.15.55:0/1372370793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fd40d0f60 0x7f8fd4160d60 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 -- 172.21.15.55:0/1372370793 >> 172.21.15.55:0/1372370793 conn(0x7f8fd40726c0 msgr2=0x7f8fd40b8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 -- 172.21.15.55:0/1372370793 shutdown_connections 2024-04-25T08:57:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.862+0000 7f8fda058640 1 -- 172.21.15.55:0/1372370793 wait complete. 2024-04-25T08:57:34.863 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:57:34.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.976+0000 7f26e3e5d640 1 Processor -- start 2024-04-25T08:57:34.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.977+0000 7f26e3e5d640 1 -- start start 2024-04-25T08:57:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.977+0000 7f26e3e5d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26dc15b7b0 0x7f26dc0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.977+0000 7f26e3e5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26dc0cf760 0x7f26dc0cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.977+0000 7f26e3e5d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc15f000 con 0x7f26dc15e110 2024-04-25T08:57:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.977+0000 7f26e3e5d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc0d0100 con 0x7f26dc15b7b0 2024-04-25T08:57:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.977+0000 7f26e3e5d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0ced00 con 0x7f26dc0cf760 2024-04-25T08:57:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e23fa640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f26dc15e110 0x7f26dc0cc080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56652/0 (socket says 172.21.15.55:56652) 2024-04-25T08:57:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e23fa640 1 -- 172.21.15.55:0/2985093677 learned_addr learned my addr 172.21.15.55:0/2985093677 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e1bf9640 1 --2- 172.21.15.55:0/2985093677 >> v2:172.21.15.167:3300/0 conn(0x7f26dc15b7b0 0x7f26dc0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e13f8640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26dc0cf760 0x7f26dc0cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025072341 0 0) 0x7f26dc15f000 con 0x7f26dc15e110 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26c8003520 con 0x7f26dc15e110 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3398663236 0 0) 0x7f26c8003520 con 0x7f26dc15e110 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26dc0cf760 msgr2=0x7f26dc0cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26dc0cf760 0x7f26dc0cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 >> v2:172.21.15.167:3300/0 conn(0x7f26dc15b7b0 msgr2=0x7f26dc0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 --2- 172.21.15.55:0/2985093677 >> v2:172.21.15.167:3300/0 conn(0x7f26dc15b7b0 0x7f26dc0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc15ed20 con 0x7f26dc15e110 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f26d40019f0 con 0x7f26dc15e110 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 >> v1:172.21.15.55:6789/0 conn(0x7f26dc15e110 legacy=0x7f26dc0cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26dc0cf760 0x7f26c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26c8003f30 0x7f26c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c8004d40 0x7f26c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0ced00 con 0x7f26c8003f30 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c800b9c0 con 0x7f26c8004d40 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c800bb40 con 0x7f26dc0cf760 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e1bf9640 1 --2- 172.21.15.55:0/2985093677 >> v2:172.21.15.167:3300/0 conn(0x7f26dc15b7b0 0x7f26dc0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e13f8640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26c8003f30 0x7f26c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e23fa640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c8004d40 0x7f26c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.978+0000 7f26e1bf9640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26dc0cf760 0x7f26c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.979+0000 7f26e13f8640 1 -- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26dc0cf760 msgr2=0x7f26c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.979+0000 7f26e13f8640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26dc0cf760 0x7f26c80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.979+0000 7f26e13f8640 1 -- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c8004d40 msgr2=0x7f26c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.979+0000 7f26e13f8640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c8004d40 0x7f26c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.979+0000 7f26e13f8640 1 -- 172.21.15.55:0/2985093677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c8003520 con 0x7f26c8003f30 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.979+0000 7f26e23fa640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c8004d40 0x7f26c80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.979+0000 7f26e13f8640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26c8003f30 0x7f26c8004800 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009aa0 tx=0x7f26c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7261a006051d114e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.979+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc036070 con 0x7f26c8003f30 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.979+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc031400 con 0x7f26c8003f30 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.979+0000 7f26e0bf7640 1 -- 172.21.15.55:0/2985093677 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc009670 con 0x7f26c8003f30 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.980+0000 7f26e3e5d640 1 -- 172.21.15.55:0/2985093677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26c8003f30 msgr2=0x7f26c8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.980+0000 7f26e3e5d640 1 --2- 172.21.15.55:0/2985093677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26c8003f30 0x7f26c8004800 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009aa0 tx=0x7f26c8005830 comp rx=0 tx=0).stop 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.980+0000 7f26e23fa640 1 -- 172.21.15.55:0/2985093677 reap_dead start 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.980+0000 7f26e3e5d640 1 -- 172.21.15.55:0/2985093677 shutdown_connections 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.980+0000 7f26e3e5d640 1 -- 172.21.15.55:0/2985093677 >> 172.21.15.55:0/2985093677 conn(0x7f26dc06f4a0 msgr2=0x7f26dc06f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.980+0000 7f26e3e5d640 1 -- 172.21.15.55:0/2985093677 shutdown_connections 2024-04-25T08:57:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.980+0000 7f26e3e5d640 1 -- 172.21.15.55:0/2985093677 wait complete. 2024-04-25T08:57:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.981+0000 7f26e3e5d640 1 Processor -- start 2024-04-25T08:57:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.981+0000 7f26e3e5d640 1 -- start start 2024-04-25T08:57:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e3e5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26c8003f30 0x7f26dc1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e3e5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26dc152e00 0x7f26dc0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e3e5d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26dc0b68c0 0x7f26dc0b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e3e5d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0cdfc0 con 0x7f26dc152e00 2024-04-25T08:57:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e3e5d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0ce330 con 0x7f26dc0b68c0 2024-04-25T08:57:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e3e5d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc1619f0 con 0x7f26c8003f30 2024-04-25T08:57:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e13f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26dc152e00 0x7f26dc0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e13f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26dc152e00 0x7f26dc0b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59174/0 (socket says 172.21.15.55:59174) 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e13f8640 1 -- 172.21.15.55:0/28920031 learned_addr learned my addr 172.21.15.55:0/28920031 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e1bf9640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26c8003f30 0x7f26dc1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e23fa640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26dc0b68c0 0x7f26dc0b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e13f8640 1 -- 172.21.15.55:0/28920031 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26c8003f30 msgr2=0x7f26dc1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.982+0000 7f26e13f8640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26c8003f30 0x7f26dc1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.983+0000 7f26e13f8640 1 -- 172.21.15.55:0/28920031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26dc0b68c0 msgr2=0x7f26dc0b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.983+0000 7f26e13f8640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26dc0b68c0 0x7f26dc0b6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.983+0000 7f26e13f8640 1 -- 172.21.15.55:0/28920031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc0b48e0 con 0x7f26dc152e00 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.983+0000 7f26e13f8640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26dc152e00 0x7f26dc0b1d40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009b90 tx=0x7f26cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.983+0000 7f26d27fc640 1 -- 172.21.15.55:0/28920031 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc041070 con 0x7f26dc152e00 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.983+0000 7f26d27fc640 1 -- 172.21.15.55:0/28920031 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc03d460 con 0x7f26dc152e00 2024-04-25T08:57:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.983+0000 7f26e3e5d640 1 -- 172.21.15.55:0/28920031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc0b4b80 con 0x7f26dc152e00 2024-04-25T08:57:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.983+0000 7f26d27fc640 1 -- 172.21.15.55:0/28920031 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc036040 con 0x7f26dc152e00 2024-04-25T08:57:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.983+0000 7f26e3e5d640 1 -- 172.21.15.55:0/28920031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc0b5140 con 0x7f26dc152e00 2024-04-25T08:57:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.984+0000 7f26e3e5d640 1 -- 172.21.15.55:0/28920031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc0750b0 con 0x7f26dc152e00 2024-04-25T08:57:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.984+0000 7f26d27fc640 1 -- 172.21.15.55:0/28920031 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f26cc044070 con 0x7f26dc152e00 2024-04-25T08:57:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.985+0000 7f26d27fc640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f26c006b500 0x7f26c006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.985+0000 7f26d27fc640 1 -- 172.21.15.55:0/28920031 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26cc0aa860 con 0x7f26dc152e00 2024-04-25T08:57:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.985+0000 7f26e1bf9640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f26c006b500 0x7f26c006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.985+0000 7f26e1bf9640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f26c006b500 0x7f26c006d9c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f26dc1f6ee0 tx=0x7f26d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:34.989+0000 7f26d27fc640 1 -- 172.21.15.55:0/28920031 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f26cc079120 con 0x7f26dc152e00 2024-04-25T08:57:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.168+0000 7f26e3e5d640 1 -- 172.21.15.55:0/28920031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26dc0cda20 con 0x7f26dc152e00 2024-04-25T08:57:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.168+0000 7f26d27fc640 1 -- 172.21.15.55:0/28920031 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f26cc0aa0a0 con 0x7f26dc152e00 2024-04-25T08:57:35.158 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:57:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 -- 172.21.15.55:0/28920031 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f26c006b500 msgr2=0x7f26c006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f26c006b500 0x7f26c006d9c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f26dc1f6ee0 tx=0x7f26d8008040 comp rx=0 tx=0).stop 2024-04-25T08:57:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 -- 172.21.15.55:0/28920031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26dc152e00 msgr2=0x7f26dc0b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26dc152e00 0x7f26dc0b1d40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009b90 tx=0x7f26cc004730 comp rx=0 tx=0).stop 2024-04-25T08:57:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 -- 172.21.15.55:0/28920031 shutdown_connections 2024-04-25T08:57:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f26c006b500 0x7f26c006d9c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26dc0b68c0 0x7f26dc0b6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26dc152e00 0x7f26dc0b1d40 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 --2- 172.21.15.55:0/28920031 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26c8003f30 0x7f26dc1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 -- 172.21.15.55:0/28920031 >> 172.21.15.55:0/28920031 conn(0x7f26dc06f4a0 msgr2=0x7f26dc15cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 -- 172.21.15.55:0/28920031 shutdown_connections 2024-04-25T08:57:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.170+0000 7f26e3e5d640 1 -- 172.21.15.55:0/28920031 wait complete. 2024-04-25T08:57:35.171 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:57:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.285+0000 7fe047f34640 1 Processor -- start 2024-04-25T08:57:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.285+0000 7fe047f34640 1 -- start start 2024-04-25T08:57:35.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.286+0000 7fe047f34640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400ce9d0 0x7fe0400cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.286+0000 7fe047f34640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe0400cc300 0x7fe0400cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.286+0000 7fe047f34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04006dcb0 con 0x7fe040144e70 2024-04-25T08:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.286+0000 7fe047f34640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04015bfe0 con 0x7fe0400cc300 2024-04-25T08:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.286+0000 7fe047f34640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04006df90 con 0x7fe0400ce9d0 2024-04-25T08:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.286+0000 7fe045cd0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe040144e70 0x7fe04006d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56654/0 (socket says 172.21.15.55:56654) 2024-04-25T08:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.286+0000 7fe045cd0640 1 -- 172.21.15.55:0/874830183 learned_addr learned my addr 172.21.15.55:0/874830183 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.286+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202905678 0 0) 0x7fe04006dcb0 con 0x7fe040144e70 2024-04-25T08:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.286+0000 7fe0464d1640 1 --2- 172.21.15.55:0/874830183 >> v2:172.21.15.167:3300/0 conn(0x7fe0400cc300 0x7fe0400cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.286+0000 7fe0454cf640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400ce9d0 0x7fe0400cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.286+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe02c003520 con 0x7fe040144e70 2024-04-25T08:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3399447535 0 0) 0x7fe02c003520 con 0x7fe040144e70 2024-04-25T08:57:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400ce9d0 msgr2=0x7fe0400cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400ce9d0 0x7fe0400cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 >> v2:172.21.15.167:3300/0 conn(0x7fe0400cc300 msgr2=0x7fe0400cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 --2- 172.21.15.55:0/874830183 >> v2:172.21.15.167:3300/0 conn(0x7fe0400cc300 0x7fe0400cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04006e270 con 0x7fe040144e70 2024-04-25T08:57:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fe038001690 con 0x7fe040144e70 2024-04-25T08:57:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 >> v1:172.21.15.55:6789/0 conn(0x7fe040144e70 legacy=0x7fe04006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 0x7fe02c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe02c004800 0x7fe02c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400ce9d0 0x7fe02c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04015bfe0 con 0x7fe02c0039b0 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04006df90 con 0x7fe02c004800 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c00b9f0 con 0x7fe0400ce9d0 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe045cd0640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 0x7fe02c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe0454cf640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe02c004800 0x7fe02c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe0464d1640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400ce9d0 0x7fe02c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe045cd0640 1 -- 172.21.15.55:0/874830183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400ce9d0 msgr2=0x7fe02c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe045cd0640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400ce9d0 0x7fe02c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe045cd0640 1 -- 172.21.15.55:0/874830183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe02c004800 msgr2=0x7fe02c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe045cd0640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe02c004800 0x7fe02c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.287+0000 7fe045cd0640 1 -- 172.21.15.55:0/874830183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c003520 con 0x7fe02c0039b0 2024-04-25T08:57:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.288+0000 7fe045cd0640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 0x7fe02c003dd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c210 tx=0x7fe02c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42174a9f85ec7aff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.288+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038007d60 con 0x7fe02c0039b0 2024-04-25T08:57:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.288+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe038005af0 con 0x7fe02c0039b0 2024-04-25T08:57:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.288+0000 7fe044cce640 1 -- 172.21.15.55:0/874830183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038007070 con 0x7fe02c0039b0 2024-04-25T08:57:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.289+0000 7fe047f34640 1 -- 172.21.15.55:0/874830183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 msgr2=0x7fe02c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.289+0000 7fe047f34640 1 --2- 172.21.15.55:0/874830183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 0x7fe02c003dd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c210 tx=0x7fe02c005830 comp rx=0 tx=0).stop 2024-04-25T08:57:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.289+0000 7fe0464d1640 1 -- 172.21.15.55:0/874830183 reap_dead start 2024-04-25T08:57:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.289+0000 7fe047f34640 1 -- 172.21.15.55:0/874830183 shutdown_connections 2024-04-25T08:57:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.289+0000 7fe047f34640 1 -- 172.21.15.55:0/874830183 >> 172.21.15.55:0/874830183 conn(0x7fe04006aba0 msgr2=0x7fe04006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.289+0000 7fe047f34640 1 -- 172.21.15.55:0/874830183 shutdown_connections 2024-04-25T08:57:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.289+0000 7fe047f34640 1 -- 172.21.15.55:0/874830183 wait complete. 2024-04-25T08:57:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.290+0000 7fe047f34640 1 Processor -- start 2024-04-25T08:57:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.290+0000 7fe047f34640 1 -- start start 2024-04-25T08:57:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe047f34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 0x7fe0400cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe047f34640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04015a8e0 0x7fe0400b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe047f34640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400adbd0 0x7fe0401f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe047f34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0401454b0 con 0x7fe02c0039b0 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe047f34640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04006d970 con 0x7fe04015a8e0 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe047f34640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe040145630 con 0x7fe0400adbd0 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe045cd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 0x7fe0400cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe045cd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 0x7fe0400cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59182/0 (socket says 172.21.15.55:59182) 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe045cd0640 1 -- 172.21.15.55:0/3775325532 learned_addr learned my addr 172.21.15.55:0/3775325532 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe0454cf640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04015a8e0 0x7fe0400b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe0464d1640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400adbd0 0x7fe0401f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe045cd0640 1 -- 172.21.15.55:0/3775325532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400adbd0 msgr2=0x7fe0401f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe045cd0640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400adbd0 0x7fe0401f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe045cd0640 1 -- 172.21.15.55:0/3775325532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04015a8e0 msgr2=0x7fe0400b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe045cd0640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04015a8e0 0x7fe0400b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe045cd0640 1 -- 172.21.15.55:0/3775325532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0400acb30 con 0x7fe02c0039b0 2024-04-25T08:57:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe045cd0640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 0x7fe0400cb020 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe03802ae00 tx=0x7fe04006de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.291+0000 7fe0367fc640 1 -- 172.21.15.55:0/3775325532 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038038040 con 0x7fe02c0039b0 2024-04-25T08:57:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.292+0000 7fe0367fc640 1 -- 172.21.15.55:0/3775325532 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe038042070 con 0x7fe02c0039b0 2024-04-25T08:57:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.292+0000 7fe047f34640 1 -- 172.21.15.55:0/3775325532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0400ace10 con 0x7fe02c0039b0 2024-04-25T08:57:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.292+0000 7fe0367fc640 1 -- 172.21.15.55:0/3775325532 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0380047e0 con 0x7fe02c0039b0 2024-04-25T08:57:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.292+0000 7fe047f34640 1 -- 172.21.15.55:0/3775325532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0400ad3d0 con 0x7fe02c0039b0 2024-04-25T08:57:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.293+0000 7fe047f34640 1 -- 172.21.15.55:0/3775325532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0400ad810 con 0x7fe02c0039b0 2024-04-25T08:57:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.293+0000 7fe0367fc640 1 -- 172.21.15.55:0/3775325532 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe038004980 con 0x7fe02c0039b0 2024-04-25T08:57:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.294+0000 7fe0367fc640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe02406b4d0 0x7fe02406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.294+0000 7fe0367fc640 1 -- 172.21.15.55:0/3775325532 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0380a9f80 con 0x7fe02c0039b0 2024-04-25T08:57:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.294+0000 7fe0454cf640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe02406b4d0 0x7fe02406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.294+0000 7fe0454cf640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe02406b4d0 0x7fe02406d990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe04015acc0 tx=0x7fe030008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.298+0000 7fe0367fc640 1 -- 172.21.15.55:0/3775325532 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe038005040 con 0x7fe02c0039b0 2024-04-25T08:57:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.479+0000 7fe047f34640 1 -- 172.21.15.55:0/3775325532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0400750b0 con 0x7fe02c0039b0 2024-04-25T08:57:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.479+0000 7fe0367fc640 1 -- 172.21.15.55:0/3775325532 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe038078f30 con 0x7fe02c0039b0 2024-04-25T08:57:35.469 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:57:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 -- 172.21.15.55:0/3775325532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe02406b4d0 msgr2=0x7fe02406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe02406b4d0 0x7fe02406d990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe04015acc0 tx=0x7fe030008040 comp rx=0 tx=0).stop 2024-04-25T08:57:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 -- 172.21.15.55:0/3775325532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 msgr2=0x7fe0400cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 0x7fe0400cb020 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe03802ae00 tx=0x7fe04006de80 comp rx=0 tx=0).stop 2024-04-25T08:57:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 -- 172.21.15.55:0/3775325532 shutdown_connections 2024-04-25T08:57:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe02406b4d0 0x7fe02406d990 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0400adbd0 0x7fe0401f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04015a8e0 0x7fe0400b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 --2- 172.21.15.55:0/3775325532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe02c0039b0 0x7fe0400cb020 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 -- 172.21.15.55:0/3775325532 >> 172.21.15.55:0/3775325532 conn(0x7fe04006aba0 msgr2=0x7fe0400cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:35.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 -- 172.21.15.55:0/3775325532 shutdown_connections 2024-04-25T08:57:35.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.481+0000 7fe047f34640 1 -- 172.21.15.55:0/3775325532 wait complete. 2024-04-25T08:57:35.481 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.593+0000 7fe6028c4640 1 Processor -- start 2024-04-25T08:57:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.593+0000 7fe6028c4640 1 -- start start 2024-04-25T08:57:35.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe6028c4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5fc15dce0 0x7fe5fc0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe6028c4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5fc0d35b0 0x7fe5fc0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe6028c4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe5fc0d1f90 0x7fe5fc0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe6028c4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc15e0c0 con 0x7fe5fc15dce0 2024-04-25T08:57:35.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe6028c4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc0d2510 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe6028c4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0d27f0 con 0x7fe5fc0d35b0 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe5fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5fc15dce0 0x7fe5fc0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe5fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5fc15dce0 0x7fe5fc0d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59194/0 (socket says 172.21.15.55:59194) 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe5fbfff640 1 -- 172.21.15.55:0/3634509633 learned_addr learned my addr 172.21.15.55:0/3634509633 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe600e61640 1 --2- 172.21.15.55:0/3634509633 >> v2:172.21.15.167:3300/0 conn(0x7fe5fc0d1f90 0x7fe5fc0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe5fb7fe640 1 --2- 172.21.15.55:0/3634509633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5fc0d35b0 0x7fe5fc0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe5fbfff640 1 -- 172.21.15.55:0/3634509633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5fc0d35b0 msgr2=0x7fe5fc0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe5fbfff640 1 --2- 172.21.15.55:0/3634509633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5fc0d35b0 0x7fe5fc0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe5fbfff640 1 -- 172.21.15.55:0/3634509633 >> v2:172.21.15.167:3300/0 conn(0x7fe5fc0d1f90 msgr2=0x7fe5fc0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe5fbfff640 1 --2- 172.21.15.55:0/3634509633 >> v2:172.21.15.167:3300/0 conn(0x7fe5fc0d1f90 0x7fe5fc0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe5fbfff640 1 -- 172.21.15.55:0/3634509633 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0d2ad0 con 0x7fe5fc15dce0 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe600e61640 1 --2- 172.21.15.55:0/3634509633 >> v2:172.21.15.167:3300/0 conn(0x7fe5fc0d1f90 0x7fe5fc0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.594+0000 7fe5fb7fe640 1 --2- 172.21.15.55:0/3634509633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5fc0d35b0 0x7fe5fc0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.595+0000 7fe5fbfff640 1 --2- 172.21.15.55:0/3634509633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5fc15dce0 0x7fe5fc0d1a50 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc161710 tx=0x7fe5e402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eaf6dcc03e67847 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.595+0000 7fe5faffd640 1 -- 172.21.15.55:0/3634509633 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4037070 con 0x7fe5fc15dce0 2024-04-25T08:57:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.595+0000 7fe5faffd640 1 -- 172.21.15.55:0/3634509633 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e4032440 con 0x7fe5fc15dce0 2024-04-25T08:57:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.595+0000 7fe5faffd640 1 -- 172.21.15.55:0/3634509633 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4032810 con 0x7fe5fc15dce0 2024-04-25T08:57:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.596+0000 7fe6028c4640 1 -- 172.21.15.55:0/3634509633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5fc15dce0 msgr2=0x7fe5fc0d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.596+0000 7fe6028c4640 1 --2- 172.21.15.55:0/3634509633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5fc15dce0 0x7fe5fc0d1a50 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc161710 tx=0x7fe5e402a140 comp rx=0 tx=0).stop 2024-04-25T08:57:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.596+0000 7fe6028c4640 1 -- 172.21.15.55:0/3634509633 shutdown_connections 2024-04-25T08:57:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.596+0000 7fe6028c4640 1 --2- 172.21.15.55:0/3634509633 >> v2:172.21.15.167:3300/0 conn(0x7fe5fc0d1f90 0x7fe5fc0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.596+0000 7fe6028c4640 1 --2- 172.21.15.55:0/3634509633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5fc0d35b0 0x7fe5fc0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.596+0000 7fe6028c4640 1 --2- 172.21.15.55:0/3634509633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5fc15dce0 0x7fe5fc0d1a50 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.596+0000 7fe6028c4640 1 -- 172.21.15.55:0/3634509633 >> 172.21.15.55:0/3634509633 conn(0x7fe5fc072900 msgr2=0x7fe5fc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.596+0000 7fe6028c4640 1 -- 172.21.15.55:0/3634509633 shutdown_connections 2024-04-25T08:57:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.596+0000 7fe6028c4640 1 -- 172.21.15.55:0/3634509633 wait complete. 2024-04-25T08:57:35.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.597+0000 7fe6028c4640 1 Processor -- start 2024-04-25T08:57:35.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.597+0000 7fe6028c4640 1 -- start start 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe6028c4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5fc0d1f90 0x7fe5fc15b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe6028c4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5fc0d35b0 0x7fe5fc0cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe6028c4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5fc15dce0 0x7fe5fc0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe6028c4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b9820 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe6028c4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0d3090 con 0x7fe5fc0d35b0 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe6028c4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b99a0 con 0x7fe5fc15dce0 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe5fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5fc0d1f90 0x7fe5fc15b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe5fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5fc0d1f90 0x7fe5fc15b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59196/0 (socket says 172.21.15.55:59196) 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe5fbfff640 1 -- 172.21.15.55:0/1568275187 learned_addr learned my addr 172.21.15.55:0/1568275187 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe600e61640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5fc15dce0 0x7fe5fc0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe5fb7fe640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5fc0d35b0 0x7fe5fc0cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe5fbfff640 1 -- 172.21.15.55:0/1568275187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5fc15dce0 msgr2=0x7fe5fc0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe5fbfff640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5fc15dce0 0x7fe5fc0cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe5fbfff640 1 -- 172.21.15.55:0/1568275187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5fc0d35b0 msgr2=0x7fe5fc0cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe5fbfff640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5fc0d35b0 0x7fe5fc0cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe5fbfff640 1 -- 172.21.15.55:0/1568275187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc15bb20 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.598+0000 7fe5fbfff640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5fc0d1f90 0x7fe5fc15b5e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe5e402a180 tx=0x7fe5e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.599+0000 7fe5f8ff9640 1 -- 172.21.15.55:0/1568275187 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4037040 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.599+0000 7fe5f8ff9640 1 -- 172.21.15.55:0/1568275187 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e4042070 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.599+0000 7fe6028c4640 1 -- 172.21.15.55:0/1568275187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc15bdc0 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.599+0000 7fe5f8ff9640 1 -- 172.21.15.55:0/1568275187 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4030bb0 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.599+0000 7fe6028c4640 1 -- 172.21.15.55:0/1568275187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc15c380 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.600+0000 7fe6028c4640 1 -- 172.21.15.55:0/1568275187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc0749b0 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.600+0000 7fe5f8ff9640 1 -- 172.21.15.55:0/1568275187 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe5e4047460 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.601+0000 7fe5f8ff9640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe5dc06b4d0 0x7fe5dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.601+0000 7fe5fb7fe640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe5dc06b4d0 0x7fe5dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.601+0000 7fe5f8ff9640 1 -- 172.21.15.55:0/1568275187 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5e40aaf20 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.601+0000 7fe5fb7fe640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe5dc06b4d0 0x7fe5dc06d990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc1f6cd0 tx=0x7fe5ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.605+0000 7fe5f8ff9640 1 -- 172.21.15.55:0/1568275187 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe5e4045360 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.823+0000 7fe6028c4640 1 -- 172.21.15.55:0/1568275187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5fc0b7a60 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.823+0000 7fe5f8ff9640 1 -- 172.21.15.55:0/1568275187 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4939 (secure 0 0 0) 0x7fe5e4079d10 con 0x7fe5fc0d1f90 2024-04-25T08:57:35.813 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:35.813 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1092467772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1092467772},{"type":"v1","addr":"172.21.15.167:6834","nonce":1092467772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/651597245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":651597245},{"type":"v1","addr":"172.21.15.55:6837","nonce":651597245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3980280949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3980280949},{"type":"v1","addr":"172.21.15.55:6836","nonce":3980280949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:17.562426+0000","modified":"2024-04-25T08:57:06.241661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":15,"addr":"172.21.15.167:6835/238831666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":238831666},{"type":"v1","addr":"172.21.15.167:6835","nonce":238831666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:57:35.813 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 30 2024-04-25T08:57:35.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.825+0000 7fe6028c4640 1 -- 172.21.15.55:0/1568275187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe5dc06b4d0 msgr2=0x7fe5dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.825+0000 7fe6028c4640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe5dc06b4d0 0x7fe5dc06d990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc1f6cd0 tx=0x7fe5ec008040 comp rx=0 tx=0).stop 2024-04-25T08:57:35.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.825+0000 7fe6028c4640 1 -- 172.21.15.55:0/1568275187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5fc0d1f90 msgr2=0x7fe5fc15b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.825+0000 7fe6028c4640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5fc0d1f90 0x7fe5fc15b5e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe5e402a180 tx=0x7fe5e40046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.825+0000 7fe6028c4640 1 -- 172.21.15.55:0/1568275187 shutdown_connections 2024-04-25T08:57:35.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.825+0000 7fe6028c4640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe5dc06b4d0 0x7fe5dc06d990 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.825+0000 7fe6028c4640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5fc15dce0 0x7fe5fc0cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.825+0000 7fe6028c4640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5fc0d35b0 0x7fe5fc0cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.825+0000 7fe6028c4640 1 --2- 172.21.15.55:0/1568275187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5fc0d1f90 0x7fe5fc15b5e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.825+0000 7fe6028c4640 1 -- 172.21.15.55:0/1568275187 >> 172.21.15.55:0/1568275187 conn(0x7fe5fc072900 msgr2=0x7fe5fc0b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:35.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.826+0000 7fe6028c4640 1 -- 172.21.15.55:0/1568275187 shutdown_connections 2024-04-25T08:57:35.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.826+0000 7fe6028c4640 1 -- 172.21.15.55:0/1568275187 wait complete. 2024-04-25T08:57:35.826 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:35.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.937+0000 7fc07a2fc640 1 Processor -- start 2024-04-25T08:57:35.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.937+0000 7fc07a2fc640 1 -- start start 2024-04-25T08:57:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc07a2fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc07415dce0 0x7fc0740d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc07a2fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07415e0c0 con 0x7fc0740b5b60 2024-04-25T08:57:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc07a2fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0740d2510 con 0x7fc0740d35b0 2024-04-25T08:57:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc07a2fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740d27f0 con 0x7fc07415dce0 2024-04-25T08:57:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc078899640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc0740b5b60 0x7fc0740b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56658/0 (socket says 172.21.15.55:56658) 2024-04-25T08:57:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc078899640 1 -- 172.21.15.55:0/4086606742 learned_addr learned my addr 172.21.15.55:0/4086606742 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216752161 0 0) 0x7fc07415e0c0 con 0x7fc0740b5b60 2024-04-25T08:57:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc073fff640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc07415dce0 0x7fc0740d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc05c003520 con 0x7fc0740b5b60 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1132935053 0 0) 0x7fc05c003520 con 0x7fc0740b5b60 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc07415dce0 msgr2=0x7fc0740d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc07415dce0 0x7fc0740d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 >> v1:172.21.15.167:6789/0 conn(0x7fc0740d35b0 legacy=0x7fc0740b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0740d2ad0 con 0x7fc0740b5b60 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc06c0019f0 con 0x7fc0740b5b60 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 >> v1:172.21.15.55:6789/0 conn(0x7fc0740b5b60 legacy=0x7fc0740b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc07415dce0 0x7fc05c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc05c003f60 0x7fc05c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc05c004d40 0x7fc05c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740d27f0 con 0x7fc05c003f60 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c00baa0 con 0x7fc05c004d40 2024-04-25T08:57:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c00bca0 con 0x7fc07415dce0 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.938+0000 7fc0737fe640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc05c003f60 0x7fc05c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.939+0000 7fc073fff640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc07415dce0 0x7fc05c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.939+0000 7fc078899640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc05c004d40 0x7fc05c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.939+0000 7fc0737fe640 1 -- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc07415dce0 msgr2=0x7fc05c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.939+0000 7fc0737fe640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc07415dce0 0x7fc05c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.939+0000 7fc0737fe640 1 -- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc05c004d40 msgr2=0x7fc05c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.939+0000 7fc0737fe640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc05c004d40 0x7fc05c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.939+0000 7fc0737fe640 1 -- 172.21.15.55:0/4086606742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c003520 con 0x7fc05c003f60 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.939+0000 7fc078899640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc05c004d40 0x7fc05c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.939+0000 7fc0737fe640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc05c003f60 0x7fc05c004800 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc068001750 tx=0x7fc05c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e652ceb0f3b8108e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.940+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc068001370 con 0x7fc05c003f60 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.940+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0680052d0 con 0x7fc05c003f60 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.940+0000 7fc072ffd640 1 -- 172.21.15.55:0/4086606742 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06802abe0 con 0x7fc05c003f60 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.940+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4086606742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc05c003f60 msgr2=0x7fc05c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.940+0000 7fc07a2fc640 1 --2- 172.21.15.55:0/4086606742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc05c003f60 0x7fc05c004800 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc068001750 tx=0x7fc05c005830 comp rx=0 tx=0).stop 2024-04-25T08:57:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.940+0000 7fc078899640 1 -- 172.21.15.55:0/4086606742 reap_dead start 2024-04-25T08:57:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.940+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4086606742 shutdown_connections 2024-04-25T08:57:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.940+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4086606742 >> 172.21.15.55:0/4086606742 conn(0x7fc074072900 msgr2=0x7fc0740d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.940+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4086606742 shutdown_connections 2024-04-25T08:57:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.940+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4086606742 wait complete. 2024-04-25T08:57:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.941+0000 7fc07a2fc640 1 Processor -- start 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.942+0000 7fc07a2fc640 1 -- start start 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.942+0000 7fc07a2fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc05c003f60 0x7fc0740cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.942+0000 7fc07a2fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07415a1c0 0x7fc0740b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.942+0000 7fc07a2fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc074152de0 0x7fc0740b8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.942+0000 7fc07a2fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740b9820 con 0x7fc07415a1c0 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.942+0000 7fc07a2fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740d3090 con 0x7fc074152de0 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.942+0000 7fc07a2fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740b99a0 con 0x7fc05c003f60 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.942+0000 7fc0737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07415a1c0 0x7fc0740b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.942+0000 7fc0737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07415a1c0 0x7fc0740b7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59214/0 (socket says 172.21.15.55:59214) 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.942+0000 7fc0737fe640 1 -- 172.21.15.55:0/4093192226 learned_addr learned my addr 172.21.15.55:0/4093192226 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc073fff640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc05c003f60 0x7fc0740cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc078899640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc074152de0 0x7fc0740b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc0737fe640 1 -- 172.21.15.55:0/4093192226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc05c003f60 msgr2=0x7fc0740cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc0737fe640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc05c003f60 0x7fc0740cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc0737fe640 1 -- 172.21.15.55:0/4093192226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc074152de0 msgr2=0x7fc0740b8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc0737fe640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc074152de0 0x7fc0740b8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc0737fe640 1 -- 172.21.15.55:0/4093192226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07415ecc0 con 0x7fc07415a1c0 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc078899640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc074152de0 0x7fc0740b8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc0737fe640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07415a1c0 0x7fc0740b7c20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc06802a590 tx=0x7fc068001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc070ff9640 1 -- 172.21.15.55:0/4093192226 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc068037040 con 0x7fc07415a1c0 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc070ff9640 1 -- 172.21.15.55:0/4093192226 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc068005480 con 0x7fc07415a1c0 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc070ff9640 1 -- 172.21.15.55:0/4093192226 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc068007a30 con 0x7fc07415a1c0 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4093192226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07415e350 con 0x7fc07415a1c0 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.943+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4093192226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07415e630 con 0x7fc07415a1c0 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.944+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4093192226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0740749b0 con 0x7fc07415a1c0 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.944+0000 7fc070ff9640 1 -- 172.21.15.55:0/4093192226 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc068044020 con 0x7fc07415a1c0 2024-04-25T08:57:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.945+0000 7fc070ff9640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc06006b500 0x7fc06006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.945+0000 7fc070ff9640 1 -- 172.21.15.55:0/4093192226 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0680a9b60 con 0x7fc07415a1c0 2024-04-25T08:57:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.945+0000 7fc073fff640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc06006b500 0x7fc06006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.945+0000 7fc073fff640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc06006b500 0x7fc06006d9c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc064009b00 tx=0x7fc064008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:35.949+0000 7fc070ff9640 1 -- 172.21.15.55:0/4093192226 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc06804b020 con 0x7fc07415a1c0 2024-04-25T08:57:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.129+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4093192226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0740b4230 con 0x7fc07415a1c0 2024-04-25T08:57:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.130+0000 7fc070ff9640 1 -- 172.21.15.55:0/4093192226 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16665 (secure 0 0 0) 0x7fc068078a70 con 0x7fc07415a1c0 2024-04-25T08:57:36.120 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:36.120 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":61,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:56:19.191031+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:15.846477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:16.537036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4093192226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc06006b500 msgr2=0x7fc06006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc06006b500 0x7fc06006d9c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc064009b00 tx=0x7fc064008040 comp rx=0 tx=0).stop 2024-04-25T08:57:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4093192226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07415a1c0 msgr2=0x7fc0740b7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07415a1c0 0x7fc0740b7c20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc06802a590 tx=0x7fc068001120 comp rx=0 tx=0).stop 2024-04-25T08:57:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4093192226 shutdown_connections 2024-04-25T08:57:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc06006b500 0x7fc06006d9c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc074152de0 0x7fc0740b8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07415a1c0 0x7fc0740b7c20 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 --2- 172.21.15.55:0/4093192226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc05c003f60 0x7fc0740cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4093192226 >> 172.21.15.55:0/4093192226 conn(0x7fc074072900 msgr2=0x7fc0740d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4093192226 shutdown_connections 2024-04-25T08:57:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.132+0000 7fc07a2fc640 1 -- 172.21.15.55:0/4093192226 wait complete. 2024-04-25T08:57:36.133 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:57:36.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.245+0000 7f037a0b3640 1 Processor -- start 2024-04-25T08:57:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.245+0000 7f037a0b3640 1 -- start start 2024-04-25T08:57:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.246+0000 7f037a0b3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f037409a150 0x7f037406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.246+0000 7f037a0b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f037406c1f0 0x7f03740cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.246+0000 7f037a0b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037406c680 con 0x7f037415ba10 2024-04-25T08:57:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.246+0000 7f037a0b3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03740cbe50 con 0x7f037409a150 2024-04-25T08:57:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.246+0000 7f037a0b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03740cfe80 con 0x7f037406c1f0 2024-04-25T08:57:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.246+0000 7f03737fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f037415ba10 0x7f0374099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56664/0 (socket says 172.21.15.55:56664) 2024-04-25T08:57:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.246+0000 7f03737fe640 1 -- 172.21.15.55:0/347203394 learned_addr learned my addr 172.21.15.55:0/347203394 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.246+0000 7f0372ffd640 1 --2- 172.21.15.55:0/347203394 >> v2:172.21.15.167:3300/0 conn(0x7f037409a150 0x7f037406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.246+0000 7f0373fff640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f037406c1f0 0x7f03740cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.246+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009546958 0 0) 0x7f0364001110 con 0x7f037415ba10 2024-04-25T08:57:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.246+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f035c003520 con 0x7f037415ba10 2024-04-25T08:57:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1262338205 0 0) 0x7f035c003520 con 0x7f037415ba10 2024-04-25T08:57:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f037406c1f0 msgr2=0x7f03740cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f037406c1f0 0x7f03740cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 >> v2:172.21.15.167:3300/0 conn(0x7f037409a150 msgr2=0x7f037406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 --2- 172.21.15.55:0/347203394 >> v2:172.21.15.167:3300/0 conn(0x7f037409a150 0x7f037406bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037406c900 con 0x7f037415ba10 2024-04-25T08:57:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f0364001840 con 0x7f037415ba10 2024-04-25T08:57:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 >> v1:172.21.15.55:6789/0 conn(0x7f037415ba10 legacy=0x7f0374099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f035c0039b0 0x7f035c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 0x7f035c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f037406c1f0 0x7f035c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03740cfe80 con 0x7f035c004800 2024-04-25T08:57:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c00b9c0 con 0x7f035c0039b0 2024-04-25T08:57:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c00bb40 con 0x7f037406c1f0 2024-04-25T08:57:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f0372ffd640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 0x7f035c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03737fe640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f035c0039b0 0x7f035c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f0373fff640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f037406c1f0 0x7f035c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f0372ffd640 1 -- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f037406c1f0 msgr2=0x7f035c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f0372ffd640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f037406c1f0 0x7f035c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f0372ffd640 1 -- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f035c0039b0 msgr2=0x7f035c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f0372ffd640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f035c0039b0 0x7f035c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f0372ffd640 1 -- 172.21.15.55:0/347203394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c003520 con 0x7f035c004800 2024-04-25T08:57:36.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f03737fe640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f035c0039b0 0x7f035c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:36.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.247+0000 7f0373fff640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f037406c1f0 0x7f035c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:36.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.248+0000 7f0372ffd640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 0x7f035c004c80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0368009ac0 tx=0x7f035c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0b46e6148df6cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.248+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368036070 con 0x7f035c004800 2024-04-25T08:57:36.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.248+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0368031400 con 0x7f035c004800 2024-04-25T08:57:36.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.248+0000 7f03727fc640 1 -- 172.21.15.55:0/347203394 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368009690 con 0x7f035c004800 2024-04-25T08:57:36.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.248+0000 7f037a0b3640 1 -- 172.21.15.55:0/347203394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 msgr2=0x7f035c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.248+0000 7f037a0b3640 1 --2- 172.21.15.55:0/347203394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 0x7f035c004c80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0368009ac0 tx=0x7f035c005830 comp rx=0 tx=0).stop 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.248+0000 7f0373fff640 1 -- 172.21.15.55:0/347203394 reap_dead start 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.248+0000 7f037a0b3640 1 -- 172.21.15.55:0/347203394 shutdown_connections 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.249+0000 7f037a0b3640 1 -- 172.21.15.55:0/347203394 >> 172.21.15.55:0/347203394 conn(0x7f03740b32f0 msgr2=0x7f03740b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.249+0000 7f037a0b3640 1 -- 172.21.15.55:0/347203394 shutdown_connections 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.249+0000 7f037a0b3640 1 -- 172.21.15.55:0/347203394 wait complete. 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.250+0000 7f037a0b3640 1 Processor -- start 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.250+0000 7f037a0b3640 1 -- start start 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f037a0b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 0x7f0374151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f037a0b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f037415a1a0 0x7f03740c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f037a0b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03740c6f30 0x7f03740c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f037a0b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03740cd220 con 0x7f035c004800 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f037a0b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037406cec0 con 0x7f037415a1a0 2024-04-25T08:57:36.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f037a0b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03740cd3a0 con 0x7f03740c6f30 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f03737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 0x7f0374151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f03737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 0x7f0374151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59240/0 (socket says 172.21.15.55:59240) 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f03737fe640 1 -- 172.21.15.55:0/3891464911 learned_addr learned my addr 172.21.15.55:0/3891464911 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f0372ffd640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f037415a1a0 0x7f03740c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f0373fff640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03740c6f30 0x7f03740c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f03737fe640 1 -- 172.21.15.55:0/3891464911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03740c6f30 msgr2=0x7f03740c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f03737fe640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03740c6f30 0x7f03740c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f03737fe640 1 -- 172.21.15.55:0/3891464911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f037415a1a0 msgr2=0x7f03740c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f03737fe640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f037415a1a0 0x7f03740c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f03737fe640 1 -- 172.21.15.55:0/3891464911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03740c7c00 con 0x7f035c004800 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f03737fe640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 0x7f0374151ae0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f036400e800 tx=0x7f036400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f035bfff640 1 -- 172.21.15.55:0/3891464911 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036400c870 con 0x7f035c004800 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f035bfff640 1 -- 172.21.15.55:0/3891464911 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0364018070 con 0x7f035c004800 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f035bfff640 1 -- 172.21.15.55:0/3891464911 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036400cc10 con 0x7f035c004800 2024-04-25T08:57:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.251+0000 7f037a0b3640 1 -- 172.21.15.55:0/3891464911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03740c7ee0 con 0x7f035c004800 2024-04-25T08:57:36.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.252+0000 7f037a0b3640 1 -- 172.21.15.55:0/3891464911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03740b4940 con 0x7f035c004800 2024-04-25T08:57:36.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.253+0000 7f037a0b3640 1 -- 172.21.15.55:0/3891464911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03740749b0 con 0x7f035c004800 2024-04-25T08:57:36.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.253+0000 7f035bfff640 1 -- 172.21.15.55:0/3891464911 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f036401d460 con 0x7f035c004800 2024-04-25T08:57:36.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.253+0000 7f035bfff640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f036006b4d0 0x7f036006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.254+0000 7f035bfff640 1 -- 172.21.15.55:0/3891464911 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f036408a090 con 0x7f035c004800 2024-04-25T08:57:36.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.254+0000 7f0372ffd640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f036006b4d0 0x7f036006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.254+0000 7f0372ffd640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f036006b4d0 0x7f036006d990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0368033000 tx=0x7f0368008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.258+0000 7f035bfff640 1 -- 172.21.15.55:0/3891464911 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f037406c680 con 0x7f035c004800 2024-04-25T08:57:36.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.475+0000 7f037a0b3640 1 -- 172.21.15.55:0/3891464911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03740b4b10 con 0x7f035c004800 2024-04-25T08:57:36.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.476+0000 7f035bfff640 1 -- 172.21.15.55:0/3891464911 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f0364058830 con 0x7f035c004800 2024-04-25T08:57:36.465 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:36.465 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1092467772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1092467772},{"type":"v1","addr":"172.21.15.167:6834","nonce":1092467772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/651597245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":651597245},{"type":"v1","addr":"172.21.15.55:6837","nonce":651597245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3980280949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3980280949},{"type":"v1","addr":"172.21.15.55:6836","nonce":3980280949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:17.562426+0000","modified":"2024-04-25T08:57:06.241661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":15,"addr":"172.21.15.167:6835/238831666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":238831666},{"type":"v1","addr":"172.21.15.167:6835","nonce":238831666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:57:36.466 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 30 2024-04-25T08:57:36.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 -- 172.21.15.55:0/3891464911 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f036006b4d0 msgr2=0x7f036006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f036006b4d0 0x7f036006d990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0368033000 tx=0x7f0368008030 comp rx=0 tx=0).stop 2024-04-25T08:57:36.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 -- 172.21.15.55:0/3891464911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 msgr2=0x7f0374151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 0x7f0374151ae0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f036400e800 tx=0x7f036400ecc0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 -- 172.21.15.55:0/3891464911 shutdown_connections 2024-04-25T08:57:36.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f036006b4d0 0x7f036006d990 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03740c6f30 0x7f03740c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f037415a1a0 0x7f03740c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 --2- 172.21.15.55:0/3891464911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f035c004800 0x7f0374151ae0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 -- 172.21.15.55:0/3891464911 >> 172.21.15.55:0/3891464911 conn(0x7f03740b32f0 msgr2=0x7f03740b2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 -- 172.21.15.55:0/3891464911 shutdown_connections 2024-04-25T08:57:36.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.478+0000 7f037a0b3640 1 -- 172.21.15.55:0/3891464911 wait complete. 2024-04-25T08:57:36.478 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:36.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.590+0000 7fdbf4cac640 1 Processor -- start 2024-04-25T08:57:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.590+0000 7fdbf4cac640 1 -- start start 2024-04-25T08:57:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.591+0000 7fdbf4cac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbf015dce0 0x7fdbf00d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.591+0000 7fdbf4cac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf015e0c0 con 0x7fdbf00b5b60 2024-04-25T08:57:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.591+0000 7fdbf4cac640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf00d2510 con 0x7fdbf00d35b0 2024-04-25T08:57:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.591+0000 7fdbf4cac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf00d27f0 con 0x7fdbf015dce0 2024-04-25T08:57:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.591+0000 7fdbee59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbf015dce0 0x7fdbf00d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.591+0000 7fdbeed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdbf00b5b60 0x7fdbf00b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56676/0 (socket says 172.21.15.55:56676) 2024-04-25T08:57:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.591+0000 7fdbeed9d640 1 -- 172.21.15.55:0/1595115732 learned_addr learned my addr 172.21.15.55:0/1595115732 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.591+0000 7fdbee59c640 1 -- 172.21.15.55:0/1595115732 >> v1:172.21.15.167:6789/0 conn(0x7fdbf00d35b0 legacy=0x7fdbf00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.591+0000 7fdbee59c640 1 -- 172.21.15.55:0/1595115732 >> v1:172.21.15.55:6789/0 conn(0x7fdbf00b5b60 legacy=0x7fdbf00b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.591+0000 7fdbee59c640 1 -- 172.21.15.55:0/1595115732 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf00d2ad0 con 0x7fdbf015dce0 2024-04-25T08:57:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.591+0000 7fdbed59a640 1 -- 172.21.15.55:0/1595115732 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176298393 0 0) 0x7fdbf015e0c0 con 0x7fdbf00b5b60 2024-04-25T08:57:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.592+0000 7fdbee59c640 1 --2- 172.21.15.55:0/1595115732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf015dce0 0x7fdbf00d1a50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80097a0 tx=0x7fdbe802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ce30e5a4a1979f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.592+0000 7fdbed59a640 1 -- 172.21.15.55:0/1595115732 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8037070 con 0x7fdbf015dce0 2024-04-25T08:57:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.592+0000 7fdbed59a640 1 -- 172.21.15.55:0/1595115732 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe8032440 con 0x7fdbf015dce0 2024-04-25T08:57:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.592+0000 7fdbed59a640 1 -- 172.21.15.55:0/1595115732 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8032810 con 0x7fdbf015dce0 2024-04-25T08:57:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.593+0000 7fdbf4cac640 1 -- 172.21.15.55:0/1595115732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf015dce0 msgr2=0x7fdbf00d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.593+0000 7fdbf4cac640 1 --2- 172.21.15.55:0/1595115732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf015dce0 0x7fdbf00d1a50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80097a0 tx=0x7fdbe802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.593+0000 7fdbf4cac640 1 -- 172.21.15.55:0/1595115732 shutdown_connections 2024-04-25T08:57:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.593+0000 7fdbf4cac640 1 --2- 172.21.15.55:0/1595115732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf015dce0 0x7fdbf00d1a50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.593+0000 7fdbf4cac640 1 -- 172.21.15.55:0/1595115732 >> 172.21.15.55:0/1595115732 conn(0x7fdbf0072900 msgr2=0x7fdbf00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.593+0000 7fdbf4cac640 1 -- 172.21.15.55:0/1595115732 shutdown_connections 2024-04-25T08:57:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.593+0000 7fdbf4cac640 1 -- 172.21.15.55:0/1595115732 wait complete. 2024-04-25T08:57:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.594+0000 7fdbf4cac640 1 Processor -- start 2024-04-25T08:57:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.594+0000 7fdbf4cac640 1 -- start start 2024-04-25T08:57:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbf4cac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf00b5b60 0x7fdbf014bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbf4cac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbf00d35b0 0x7fdbf0160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbf4cac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbf015dce0 0x7fdbf00b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbf4cac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf00b9820 con 0x7fdbf00b5b60 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbf4cac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf00d3090 con 0x7fdbf015dce0 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbf4cac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf00b99a0 con 0x7fdbf00d35b0 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbee59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf00b5b60 0x7fdbf014bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbee59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf00b5b60 0x7fdbf014bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59258/0 (socket says 172.21.15.55:59258) 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbee59c640 1 -- 172.21.15.55:0/750352922 learned_addr learned my addr 172.21.15.55:0/750352922 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbeed9d640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbf015dce0 0x7fdbf00b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbedd9b640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbf00d35b0 0x7fdbf0160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbee59c640 1 -- 172.21.15.55:0/750352922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbf00d35b0 msgr2=0x7fdbf0160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbee59c640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbf00d35b0 0x7fdbf0160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbee59c640 1 -- 172.21.15.55:0/750352922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbf015dce0 msgr2=0x7fdbf00b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbee59c640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbf015dce0 0x7fdbf00b7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbee59c640 1 -- 172.21.15.55:0/750352922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf014c330 con 0x7fdbf00b5b60 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.595+0000 7fdbeed9d640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbf015dce0 0x7fdbf00b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.596+0000 7fdbee59c640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf00b5b60 0x7fdbf014bdf0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80097a0 tx=0x7fdbe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.596+0000 7fdbe6ffd640 1 -- 172.21.15.55:0/750352922 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8041070 con 0x7fdbf00b5b60 2024-04-25T08:57:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.596+0000 7fdbe6ffd640 1 -- 172.21.15.55:0/750352922 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe803c870 con 0x7fdbf00b5b60 2024-04-25T08:57:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.596+0000 7fdbf4cac640 1 -- 172.21.15.55:0/750352922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf014e960 con 0x7fdbf00b5b60 2024-04-25T08:57:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.596+0000 7fdbe6ffd640 1 -- 172.21.15.55:0/750352922 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8037040 con 0x7fdbf00b5b60 2024-04-25T08:57:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.596+0000 7fdbf4cac640 1 -- 172.21.15.55:0/750352922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf014f200 con 0x7fdbf00b5b60 2024-04-25T08:57:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.597+0000 7fdbf4cac640 1 -- 172.21.15.55:0/750352922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf014ed50 con 0x7fdbf00b5b60 2024-04-25T08:57:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.597+0000 7fdbe6ffd640 1 -- 172.21.15.55:0/750352922 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdbe8044070 con 0x7fdbf00b5b60 2024-04-25T08:57:36.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.598+0000 7fdbe6ffd640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbd006b4d0 0x7fdbd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.598+0000 7fdbe6ffd640 1 -- 172.21.15.55:0/750352922 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbe80ab0b0 con 0x7fdbf00b5b60 2024-04-25T08:57:36.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.598+0000 7fdbedd9b640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbd006b4d0 0x7fdbd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.598+0000 7fdbedd9b640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbd006b4d0 0x7fdbd006d990 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdbf015f350 tx=0x7fdbd8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.602+0000 7fdbe6ffd640 1 -- 172.21.15.55:0/750352922 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdbf014c330 con 0x7fdbf00b5b60 2024-04-25T08:57:36.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.822+0000 7fdbf4cac640 1 -- 172.21.15.55:0/750352922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbf00749b0 con 0x7fdbf00b5b60 2024-04-25T08:57:36.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.823+0000 7fdbe6ffd640 1 -- 172.21.15.55:0/750352922 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4939 (secure 0 0 0) 0x7fdbe807a050 con 0x7fdbf00b5b60 2024-04-25T08:57:36.812 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:36.813 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1092467772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1092467772},{"type":"v1","addr":"172.21.15.167:6834","nonce":1092467772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/651597245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":651597245},{"type":"v1","addr":"172.21.15.55:6837","nonce":651597245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3980280949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3980280949},{"type":"v1","addr":"172.21.15.55:6836","nonce":3980280949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:56:17.562426+0000","modified":"2024-04-25T08:57:06.241661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":15,"addr":"172.21.15.167:6835/238831666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":238831666},{"type":"v1","addr":"172.21.15.167:6835","nonce":238831666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:57:36.813 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 30 2024-04-25T08:57:36.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 -- 172.21.15.55:0/750352922 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbd006b4d0 msgr2=0x7fdbd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbd006b4d0 0x7fdbd006d990 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdbf015f350 tx=0x7fdbd8009040 comp rx=0 tx=0).stop 2024-04-25T08:57:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 -- 172.21.15.55:0/750352922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf00b5b60 msgr2=0x7fdbf014bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf00b5b60 0x7fdbf014bdf0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80097a0 tx=0x7fdbe80046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 -- 172.21.15.55:0/750352922 shutdown_connections 2024-04-25T08:57:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdbd006b4d0 0x7fdbd006d990 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbf015dce0 0x7fdbf00b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdbf00d35b0 0x7fdbf0160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 --2- 172.21.15.55:0/750352922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf00b5b60 0x7fdbf014bdf0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 -- 172.21.15.55:0/750352922 >> 172.21.15.55:0/750352922 conn(0x7fdbf0072900 msgr2=0x7fdbf00b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 -- 172.21.15.55:0/750352922 shutdown_connections 2024-04-25T08:57:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.825+0000 7fdbf4cac640 1 -- 172.21.15.55:0/750352922 wait complete. 2024-04-25T08:57:36.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:36.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.937+0000 7f158a57e640 1 Processor -- start 2024-04-25T08:57:36.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.937+0000 7f158a57e640 1 -- start start 2024-04-25T08:57:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.938+0000 7f158a57e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f158406e2e0 0x7f15840cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.938+0000 7f158a57e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15840cdb10 con 0x7f15840cfc40 2024-04-25T08:57:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.938+0000 7f158a57e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15840cddf0 con 0x7f158415a870 2024-04-25T08:57:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.938+0000 7f158a57e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15840ce720 con 0x7f158406e2e0 2024-04-25T08:57:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.938+0000 7f15837fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f158406e2e0 0x7f15840cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.938+0000 7f1588b1b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f15840cfc40 0x7f158415bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56680/0 (socket says 172.21.15.55:56680) 2024-04-25T08:57:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.938+0000 7f1588b1b640 1 -- 172.21.15.55:0/279419932 learned_addr learned my addr 172.21.15.55:0/279419932 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.938+0000 7f15837fe640 1 -- 172.21.15.55:0/279419932 >> v1:172.21.15.167:6789/0 conn(0x7f158415a870 legacy=0x7f15840cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.938+0000 7f15837fe640 1 -- 172.21.15.55:0/279419932 >> v1:172.21.15.55:6789/0 conn(0x7f15840cfc40 legacy=0x7f158415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.938+0000 7f15837fe640 1 -- 172.21.15.55:0/279419932 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840ce0d0 con 0x7f158406e2e0 2024-04-25T08:57:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.938+0000 7f1582ffd640 1 -- 172.21.15.55:0/279419932 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379485764 0 0) 0x7f15840cdb10 con 0x7f15840cfc40 2024-04-25T08:57:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.939+0000 7f15837fe640 1 --2- 172.21.15.55:0/279419932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f158406e2e0 0x7f15840cebb0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f15780097d0 tx=0x7f157802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f287d1bb9f392a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.939+0000 7f1582ffd640 1 -- 172.21.15.55:0/279419932 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578037070 con 0x7f158406e2e0 2024-04-25T08:57:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.939+0000 7f1582ffd640 1 -- 172.21.15.55:0/279419932 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1578032440 con 0x7f158406e2e0 2024-04-25T08:57:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.939+0000 7f1582ffd640 1 -- 172.21.15.55:0/279419932 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578032810 con 0x7f158406e2e0 2024-04-25T08:57:36.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.939+0000 7f158a57e640 1 -- 172.21.15.55:0/279419932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f158406e2e0 msgr2=0x7f15840cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.939+0000 7f158a57e640 1 --2- 172.21.15.55:0/279419932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f158406e2e0 0x7f15840cebb0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f15780097d0 tx=0x7f157802a270 comp rx=0 tx=0).stop 2024-04-25T08:57:36.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.939+0000 7f158a57e640 1 -- 172.21.15.55:0/279419932 shutdown_connections 2024-04-25T08:57:36.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.940+0000 7f158a57e640 1 --2- 172.21.15.55:0/279419932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f158406e2e0 0x7f15840cebb0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.940+0000 7f158a57e640 1 -- 172.21.15.55:0/279419932 >> 172.21.15.55:0/279419932 conn(0x7f158406aba0 msgr2=0x7f158406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.940+0000 7f158a57e640 1 -- 172.21.15.55:0/279419932 shutdown_connections 2024-04-25T08:57:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.940+0000 7f158a57e640 1 -- 172.21.15.55:0/279419932 wait complete. 2024-04-25T08:57:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.941+0000 7f158a57e640 1 Processor -- start 2024-04-25T08:57:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.941+0000 7f158a57e640 1 -- start start 2024-04-25T08:57:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f158a57e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f158406e2e0 0x7f1584159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f158a57e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15840cfc40 0x7f1584154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f158a57e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158415a870 0x7f15841e7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f158a57e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840cd700 con 0x7f15840cfc40 2024-04-25T08:57:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f158a57e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840cd580 con 0x7f158415a870 2024-04-25T08:57:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f158a57e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15840cd880 con 0x7f158406e2e0 2024-04-25T08:57:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f15837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15840cfc40 0x7f1584154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f15837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15840cfc40 0x7f1584154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59276/0 (socket says 172.21.15.55:59276) 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f15837fe640 1 -- 172.21.15.55:0/3033308720 learned_addr learned my addr 172.21.15.55:0/3033308720 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f1588b1b640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158415a870 0x7f15841e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f15837fe640 1 -- 172.21.15.55:0/3033308720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f158406e2e0 msgr2=0x7f1584159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f1583fff640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f158406e2e0 0x7f1584159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f15837fe640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f158406e2e0 0x7f1584159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f15837fe640 1 -- 172.21.15.55:0/3033308720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158415a870 msgr2=0x7f15841e7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f15837fe640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158415a870 0x7f15841e7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f15837fe640 1 -- 172.21.15.55:0/3033308720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1584148b10 con 0x7f15840cfc40 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f1588b1b640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158415a870 0x7f15841e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f1583fff640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f158406e2e0 0x7f1584159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f15837fe640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15840cfc40 0x7f1584154c70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f15780098f0 tx=0x7f15780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f1580ff9640 1 -- 172.21.15.55:0/3033308720 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578041070 con 0x7f15840cfc40 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f1580ff9640 1 -- 172.21.15.55:0/3033308720 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157803c930 con 0x7f15840cfc40 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f158a57e640 1 -- 172.21.15.55:0/3033308720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1584155650 con 0x7f15840cfc40 2024-04-25T08:57:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f1580ff9640 1 -- 172.21.15.55:0/3033308720 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578037040 con 0x7f15840cfc40 2024-04-25T08:57:36.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.942+0000 7f158a57e640 1 -- 172.21.15.55:0/3033308720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1584155c10 con 0x7f15840cfc40 2024-04-25T08:57:36.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.943+0000 7f158a57e640 1 -- 172.21.15.55:0/3033308720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15841563e0 con 0x7f15840cfc40 2024-04-25T08:57:36.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.944+0000 7f1580ff9640 1 -- 172.21.15.55:0/3033308720 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1578044070 con 0x7f15840cfc40 2024-04-25T08:57:36.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.944+0000 7f1580ff9640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f157006b4d0 0x7f157006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:36.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.945+0000 7f1583fff640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f157006b4d0 0x7f157006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:36.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.945+0000 7f1580ff9640 1 -- 172.21.15.55:0/3033308720 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15780aaf70 con 0x7f15840cfc40 2024-04-25T08:57:36.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.945+0000 7f1583fff640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f157006b4d0 0x7f157006d990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1574000f60 tx=0x7f1574009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:36.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:36.949+0000 7f1580ff9640 1 -- 172.21.15.55:0/3033308720 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1578079f10 con 0x7f15840cfc40 2024-04-25T08:57:37.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.128+0000 7f158a57e640 1 -- 172.21.15.55:0/3033308720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15841576f0 con 0x7f15840cfc40 2024-04-25T08:57:37.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.129+0000 7f1580ff9640 1 -- 172.21.15.55:0/3033308720 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16665 (secure 0 0 0) 0x7f1578079810 con 0x7f15840cfc40 2024-04-25T08:57:37.119 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:37.119 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":61,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:56:19.191031+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:56:15.846477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T08:56:16.537036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:37.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 -- 172.21.15.55:0/3033308720 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f157006b4d0 msgr2=0x7f157006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f157006b4d0 0x7f157006d990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1574000f60 tx=0x7f1574009040 comp rx=0 tx=0).stop 2024-04-25T08:57:37.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 -- 172.21.15.55:0/3033308720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15840cfc40 msgr2=0x7f1584154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15840cfc40 0x7f1584154c70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f15780098f0 tx=0x7f15780046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 -- 172.21.15.55:0/3033308720 shutdown_connections 2024-04-25T08:57:37.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f157006b4d0 0x7f157006d990 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158415a870 0x7f15841e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15840cfc40 0x7f1584154c70 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 --2- 172.21.15.55:0/3033308720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f158406e2e0 0x7f1584159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 -- 172.21.15.55:0/3033308720 >> 172.21.15.55:0/3033308720 conn(0x7f158406aba0 msgr2=0x7f15840cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:37.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 -- 172.21.15.55:0/3033308720 shutdown_connections 2024-04-25T08:57:37.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.131+0000 7f158a57e640 1 -- 172.21.15.55:0/3033308720 wait complete. 2024-04-25T08:57:37.132 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:57:37.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.245+0000 7f9899b63640 1 Processor -- start 2024-04-25T08:57:37.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.245+0000 7f9899b63640 1 -- start start 2024-04-25T08:57:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.246+0000 7f9899b63640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98940d1110 0x7f9894168880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.246+0000 7f9899b63640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989415f2d0 con 0x7f98940cece0 2024-04-25T08:57:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.246+0000 7f9899b63640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989415e9d0 con 0x7f989415b910 2024-04-25T08:57:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.246+0000 7f9899b63640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989415ecb0 con 0x7f98940d1110 2024-04-25T08:57:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.246+0000 7f9892ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f98940cece0 0x7f98940d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56690/0 (socket says 172.21.15.55:56690) 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.246+0000 7f9892ffd640 1 -- 172.21.15.55:0/3729028604 learned_addr learned my addr 172.21.15.55:0/3729028604 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f9893fff640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98940d1110 0x7f9894168880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563524631 0 0) 0x7f989415f2d0 con 0x7f98940cece0 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f987c003520 con 0x7f98940cece0 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99132640 0 0) 0x7f989415e9d0 con 0x7f989415b910 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f989415f2d0 con 0x7f989415b910 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1174418130 0 0) 0x7f987c003520 con 0x7f98940cece0 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98940d1110 msgr2=0x7f9894168880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98940d1110 0x7f9894168880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 >> v1:172.21.15.167:6789/0 conn(0x7f989415b910 legacy=0x7f989415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989415ef90 con 0x7f98940cece0 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f98880015f0 con 0x7f98940cece0 2024-04-25T08:57:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 >> v1:172.21.15.55:6789/0 conn(0x7f98940cece0 legacy=0x7f98940d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98940d1110 0x7f987c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f987c004120 0x7f987c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c004d40 0x7f987c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989415ecb0 con 0x7f987c004d40 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c00bb00 con 0x7f987c004120 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c00bd00 con 0x7f98940d1110 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f9893fff640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c004d40 0x7f987c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f98937fe640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98940d1110 0x7f987c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f9892ffd640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f987c004120 0x7f987c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f9893fff640 1 -- 172.21.15.55:0/3729028604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98940d1110 msgr2=0x7f987c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f9893fff640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98940d1110 0x7f987c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f9893fff640 1 -- 172.21.15.55:0/3729028604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f987c004120 msgr2=0x7f987c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f9893fff640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f987c004120 0x7f987c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.247+0000 7f9893fff640 1 -- 172.21.15.55:0/3729028604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c003520 con 0x7f987c004d40 2024-04-25T08:57:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.248+0000 7f9893fff640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c004d40 0x7f987c0051c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f988c009fc0 tx=0x7f987c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f2b5918314a3de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.248+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c009c10 con 0x7f987c004d40 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.248+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c036070 con 0x7f987c004d40 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.248+0000 7f98927fc640 1 -- 172.21.15.55:0/3729028604 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c031880 con 0x7f987c004d40 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.249+0000 7f9899b63640 1 -- 172.21.15.55:0/3729028604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c004d40 msgr2=0x7f987c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.249+0000 7f9899b63640 1 --2- 172.21.15.55:0/3729028604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c004d40 0x7f987c0051c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f988c009fc0 tx=0x7f987c005830 comp rx=0 tx=0).stop 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.249+0000 7f9893fff640 1 -- 172.21.15.55:0/3729028604 reap_dead start 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.249+0000 7f9899b63640 1 -- 172.21.15.55:0/3729028604 shutdown_connections 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.249+0000 7f9899b63640 1 -- 172.21.15.55:0/3729028604 >> 172.21.15.55:0/3729028604 conn(0x7f98940726c0 msgr2=0x7f9894072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.249+0000 7f9899b63640 1 -- 172.21.15.55:0/3729028604 shutdown_connections 2024-04-25T08:57:37.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.249+0000 7f9899b63640 1 -- 172.21.15.55:0/3729028604 wait complete. 2024-04-25T08:57:37.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.250+0000 7f9899b63640 1 Processor -- start 2024-04-25T08:57:37.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.250+0000 7f9899b63640 1 -- start start 2024-04-25T08:57:37.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.251+0000 7f9899b63640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f987c004d40 0x7f98941523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.251+0000 7f9899b63640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98940c75a0 0x7f98940c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.251+0000 7f9899b63640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9894161690 0x7f9894161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.251+0000 7f9899b63640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9894160c20 con 0x7f9894161690 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.251+0000 7f9899b63640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9894160aa0 con 0x7f98940c75a0 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.251+0000 7f9899b63640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9894160da0 con 0x7f987c004d40 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.251+0000 7f9893fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9894161690 0x7f9894161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.251+0000 7f9893fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9894161690 0x7f9894161b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59298/0 (socket says 172.21.15.55:59298) 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.251+0000 7f9893fff640 1 -- 172.21.15.55:0/2719322122 learned_addr learned my addr 172.21.15.55:0/2719322122 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.251+0000 7f98937fe640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f987c004d40 0x7f98941523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.251+0000 7f9892ffd640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98940c75a0 0x7f98940c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.252+0000 7f9893fff640 1 -- 172.21.15.55:0/2719322122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f987c004d40 msgr2=0x7f98941523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.252+0000 7f9893fff640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f987c004d40 0x7f98941523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.252+0000 7f9893fff640 1 -- 172.21.15.55:0/2719322122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98940c75a0 msgr2=0x7f98940c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.252+0000 7f9893fff640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98940c75a0 0x7f98940c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.252+0000 7f9893fff640 1 -- 172.21.15.55:0/2719322122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98940d2040 con 0x7f9894161690 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.252+0000 7f9893fff640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9894161690 0x7f9894161b20 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f988c033040 tx=0x7f988c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.252+0000 7f987bfff640 1 -- 172.21.15.55:0/2719322122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c009c10 con 0x7f9894161690 2024-04-25T08:57:37.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.252+0000 7f987bfff640 1 -- 172.21.15.55:0/2719322122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c031d30 con 0x7f9894161690 2024-04-25T08:57:37.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.252+0000 7f9899b63640 1 -- 172.21.15.55:0/2719322122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98940c7a30 con 0x7f9894161690 2024-04-25T08:57:37.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.252+0000 7f987bfff640 1 -- 172.21.15.55:0/2719322122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c003bd0 con 0x7f9894161690 2024-04-25T08:57:37.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.252+0000 7f9899b63640 1 -- 172.21.15.55:0/2719322122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98940c7ff0 con 0x7f9894161690 2024-04-25T08:57:37.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.253+0000 7f9899b63640 1 -- 172.21.15.55:0/2719322122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98940750b0 con 0x7f9894161690 2024-04-25T08:57:37.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.254+0000 7f987bfff640 1 -- 172.21.15.55:0/2719322122 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f988c005d10 con 0x7f9894161690 2024-04-25T08:57:37.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.254+0000 7f987bfff640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f988006b4d0 0x7f988006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.254+0000 7f987bfff640 1 -- 172.21.15.55:0/2719322122 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f988c0ab610 con 0x7f9894161690 2024-04-25T08:57:37.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.254+0000 7f98937fe640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f988006b4d0 0x7f988006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.255+0000 7f98937fe640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f988006b4d0 0x7f988006d990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9884000c00 tx=0x7f9884009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.258+0000 7f987bfff640 1 -- 172.21.15.55:0/2719322122 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f988c04a060 con 0x7f9894161690 2024-04-25T08:57:37.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.477+0000 7f9899b63640 1 -- 172.21.15.55:0/2719322122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f98941623d0 con 0x7f9894161690 2024-04-25T08:57:37.467 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T08:57:37.478+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:57:37.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.480+0000 7f987bfff640 1 -- 172.21.15.55:0/2719322122 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7f98940d2040 con 0x7f9894161690 2024-04-25T08:57:37.469 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:57:37.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.482+0000 7f9899b63640 1 -- 172.21.15.55:0/2719322122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f988006b4d0 msgr2=0x7f988006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.482+0000 7f9899b63640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f988006b4d0 0x7f988006d990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9884000c00 tx=0x7f9884009040 comp rx=0 tx=0).stop 2024-04-25T08:57:37.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.482+0000 7f9899b63640 1 -- 172.21.15.55:0/2719322122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9894161690 msgr2=0x7f9894161b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.482+0000 7f9899b63640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9894161690 0x7f9894161b20 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f988c033040 tx=0x7f988c009750 comp rx=0 tx=0).stop 2024-04-25T08:57:37.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.483+0000 7f9899b63640 1 -- 172.21.15.55:0/2719322122 shutdown_connections 2024-04-25T08:57:37.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.483+0000 7f9899b63640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f988006b4d0 0x7f988006d990 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.483+0000 7f9899b63640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9894161690 0x7f9894161b20 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.483+0000 7f9899b63640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98940c75a0 0x7f98940c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.483+0000 7f9899b63640 1 --2- 172.21.15.55:0/2719322122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f987c004d40 0x7f98941523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.483+0000 7f9899b63640 1 -- 172.21.15.55:0/2719322122 >> 172.21.15.55:0/2719322122 conn(0x7f98940726c0 msgr2=0x7f989406c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.483+0000 7f9899b63640 1 -- 172.21.15.55:0/2719322122 shutdown_connections 2024-04-25T08:57:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.483+0000 7f9899b63640 1 -- 172.21.15.55:0/2719322122 wait complete. 2024-04-25T08:57:37.476 INFO:tasks.ceph.mds.b.smithi167.stderr: -8728> 2024-04-25T08:56:12.854+0000 7fb0cf7e5640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-25T08:57:37.477 INFO:tasks.ceph.mds.b.smithi167.stderr: -7482> 2024-04-25T08:56:23.854+0000 7fb0c97d9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:57:37.481 INFO:tasks.ceph.mds.b.smithi167.stderr: -4853> 2024-04-25T08:56:29.491+0000 7fb0c57d1640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6228=0-4194304@1} caps={6228=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6228 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x561e1b8e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T08:57:37.481 INFO:tasks.ceph.mds.b.smithi167.stderr: -3071> 2024-04-25T08:57:00.801+0000 7fb0c57d1640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6228=0-4194304@1} caps={6228=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6228 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x561e1b8e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T08:57:37.483 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:57:37.509 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T08:57:37.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.597+0000 7fba9eb7e640 1 Processor -- start 2024-04-25T08:57:37.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.597+0000 7fba9eb7e640 1 -- start start 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.597+0000 7fba9eb7e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba98161120 0x7fba981617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.597+0000 7fba9eb7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba98161ce0 0x7fba980b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.597+0000 7fba9eb7e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba980b5a90 0x7fba9806c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.597+0000 7fba9eb7e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba980b5f00 con 0x7fba98161ce0 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.597+0000 7fba9eb7e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba98162740 con 0x7fba98161120 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.597+0000 7fba9eb7e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba98161500 con 0x7fba980b5a90 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba97fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba98161ce0 0x7fba980b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba97fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba98161ce0 0x7fba980b5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59314/0 (socket says 172.21.15.55:59314) 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba97fff640 1 -- 172.21.15.55:0/1674343871 learned_addr learned my addr 172.21.15.55:0/1674343871 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba9d11b640 1 --2- 172.21.15.55:0/1674343871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba980b5a90 0x7fba9806c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba9c91a640 1 --2- 172.21.15.55:0/1674343871 >> v2:172.21.15.167:3300/0 conn(0x7fba98161120 0x7fba981617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba97fff640 1 -- 172.21.15.55:0/1674343871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba980b5a90 msgr2=0x7fba9806c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba97fff640 1 --2- 172.21.15.55:0/1674343871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba980b5a90 0x7fba9806c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba97fff640 1 -- 172.21.15.55:0/1674343871 >> v2:172.21.15.167:3300/0 conn(0x7fba98161120 msgr2=0x7fba981617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba97fff640 1 --2- 172.21.15.55:0/1674343871 >> v2:172.21.15.167:3300/0 conn(0x7fba98161120 0x7fba981617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba97fff640 1 -- 172.21.15.55:0/1674343871 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba98162180 con 0x7fba98161ce0 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba9d11b640 1 --2- 172.21.15.55:0/1674343871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba980b5a90 0x7fba9806c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.598+0000 7fba9c91a640 1 --2- 172.21.15.55:0/1674343871 >> v2:172.21.15.167:3300/0 conn(0x7fba98161120 0x7fba981617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba97fff640 1 --2- 172.21.15.55:0/1674343871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98161ce0 0x7fba980b5550 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fba9806dac0 tx=0x7fba8402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35402fb73cfd444 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba977fe640 1 -- 172.21.15.55:0/1674343871 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84037070 con 0x7fba98161ce0 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba977fe640 1 -- 172.21.15.55:0/1674343871 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba84032440 con 0x7fba98161ce0 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba977fe640 1 -- 172.21.15.55:0/1674343871 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84032810 con 0x7fba98161ce0 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1674343871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98161ce0 msgr2=0x7fba980b5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba9eb7e640 1 --2- 172.21.15.55:0/1674343871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98161ce0 0x7fba980b5550 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fba9806dac0 tx=0x7fba8402a140 comp rx=0 tx=0).stop 2024-04-25T08:57:37.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1674343871 shutdown_connections 2024-04-25T08:57:37.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba9eb7e640 1 --2- 172.21.15.55:0/1674343871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba980b5a90 0x7fba9806c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba9eb7e640 1 --2- 172.21.15.55:0/1674343871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98161ce0 0x7fba980b5550 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba9eb7e640 1 --2- 172.21.15.55:0/1674343871 >> v2:172.21.15.167:3300/0 conn(0x7fba98161120 0x7fba981617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1674343871 >> 172.21.15.55:0/1674343871 conn(0x7fba980d0550 msgr2=0x7fba980d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:37.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1674343871 shutdown_connections 2024-04-25T08:57:37.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.599+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1674343871 wait complete. 2024-04-25T08:57:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.600+0000 7fba9eb7e640 1 Processor -- start 2024-04-25T08:57:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.600+0000 7fba9eb7e640 1 -- start start 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.601+0000 7fba9eb7e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba980b5a90 0x7fba980c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.601+0000 7fba9eb7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba98161120 0x7fba980b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.601+0000 7fba9eb7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98161ce0 0x7fba980b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.601+0000 7fba9eb7e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980d2040 con 0x7fba98161ce0 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.601+0000 7fba9eb7e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980d1d60 con 0x7fba98161120 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.601+0000 7fba9eb7e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba980b95f0 con 0x7fba980b5a90 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.601+0000 7fba9d11b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98161ce0 0x7fba980b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.601+0000 7fba9d11b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98161ce0 0x7fba980b7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59316/0 (socket says 172.21.15.55:59316) 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.601+0000 7fba9d11b640 1 -- 172.21.15.55:0/1290688153 learned_addr learned my addr 172.21.15.55:0/1290688153 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba9c91a640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba980b5a90 0x7fba980c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba97fff640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba98161120 0x7fba980b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba9d11b640 1 -- 172.21.15.55:0/1290688153 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba980b5a90 msgr2=0x7fba980c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba9d11b640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba980b5a90 0x7fba980c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba9d11b640 1 -- 172.21.15.55:0/1290688153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba98161120 msgr2=0x7fba980b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba9d11b640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba98161120 0x7fba980b7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba9d11b640 1 -- 172.21.15.55:0/1290688153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba98156eb0 con 0x7fba98161ce0 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba97fff640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba98161120 0x7fba980b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba9d11b640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98161ce0 0x7fba980b7cc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fba9000cd10 tx=0x7fba9000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba957fa640 1 -- 172.21.15.55:0/1290688153 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000f680 con 0x7fba98161ce0 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba957fa640 1 -- 172.21.15.55:0/1290688153 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9000f840 con 0x7fba98161ce0 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1290688153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba980cb7a0 con 0x7fba98161ce0 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba957fa640 1 -- 172.21.15.55:0/1290688153 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000fc30 con 0x7fba98161ce0 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.602+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1290688153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba980cba40 con 0x7fba98161ce0 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.603+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1290688153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba980750b0 con 0x7fba98161ce0 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.604+0000 7fba957fa640 1 -- 172.21.15.55:0/1290688153 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fba900213f0 con 0x7fba98161ce0 2024-04-25T08:57:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.604+0000 7fba957fa640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba7c06b4d0 0x7fba7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:37.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.604+0000 7fba957fa640 1 -- 172.21.15.55:0/1290688153 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fba9008af10 con 0x7fba98161ce0 2024-04-25T08:57:37.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.604+0000 7fba9c91a640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba7c06b4d0 0x7fba7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:37.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.605+0000 7fba9c91a640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba7c06b4d0 0x7fba7c06d990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00a990 tx=0x7fba8c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:37.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.608+0000 7fba957fa640 1 -- 172.21.15.55:0/1290688153 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba90014030 con 0x7fba98161ce0 2024-04-25T08:57:37.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:37.828+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1290688153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fba980d0050 con 0x7fba98161ce0 2024-04-25T08:57:38.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.483+0000 7fba957fa640 1 -- 172.21.15.55:0/1290688153 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7fba90059770 con 0x7fba98161ce0 2024-04-25T08:57:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.485+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1290688153 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba7c06b4d0 msgr2=0x7fba7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.485+0000 7fba9eb7e640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba7c06b4d0 0x7fba7c06d990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00a990 tx=0x7fba8c008040 comp rx=0 tx=0).stop 2024-04-25T08:57:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.485+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1290688153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98161ce0 msgr2=0x7fba980b7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.485+0000 7fba9eb7e640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98161ce0 0x7fba980b7cc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fba9000cd10 tx=0x7fba9000a650 comp rx=0 tx=0).stop 2024-04-25T08:57:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.485+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1290688153 shutdown_connections 2024-04-25T08:57:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.485+0000 7fba9eb7e640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba7c06b4d0 0x7fba7c06d990 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.485+0000 7fba9eb7e640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98161ce0 0x7fba980b7cc0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.485+0000 7fba9eb7e640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba98161120 0x7fba980b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.485+0000 7fba9eb7e640 1 --2- 172.21.15.55:0/1290688153 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba980b5a90 0x7fba980c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.485+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1290688153 >> 172.21.15.55:0/1290688153 conn(0x7fba980d0550 msgr2=0x7fba9806c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.486+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1290688153 shutdown_connections 2024-04-25T08:57:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.486+0000 7fba9eb7e640 1 -- 172.21.15.55:0/1290688153 wait complete. 2024-04-25T08:57:38.488 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:57:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.611+0000 7f3f73932640 1 Processor -- start 2024-04-25T08:57:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.612+0000 7f3f73932640 1 -- start start 2024-04-25T08:57:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.612+0000 7f3f73932640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f6c0b3f80 0x7f3f6c162350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.612+0000 7f3f73932640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6c0cfed0 con 0x7f3f6c161400 2024-04-25T08:57:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.612+0000 7f3f73932640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6c0cf850 con 0x7f3f6c0b35e0 2024-04-25T08:57:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.612+0000 7f3f73932640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6c162890 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.613+0000 7f3f70ecd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f6c0b3f80 0x7f3f6c162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.613+0000 7f3f71ecf640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3f6c161400 0x7f3f6c0cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56696/0 (socket says 172.21.15.55:56696) 2024-04-25T08:57:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.613+0000 7f3f71ecf640 1 -- 172.21.15.55:0/4132371158 learned_addr learned my addr 172.21.15.55:0/4132371158 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.613+0000 7f3f70ecd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f6c0b3f80 0x7f3f6c162350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59326/0 (socket says 172.21.15.55:59326) 2024-04-25T08:57:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.613+0000 7f3f70ecd640 1 -- 172.21.15.55:0/4132371158 >> v1:172.21.15.167:6789/0 conn(0x7f3f6c0b35e0 legacy=0x7f3f6c160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.613+0000 7f3f70ecd640 1 -- 172.21.15.55:0/4132371158 >> v1:172.21.15.55:6789/0 conn(0x7f3f6c161400 legacy=0x7f3f6c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.613+0000 7f3f70ecd640 1 -- 172.21.15.55:0/4132371158 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c0cfb30 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.613+0000 7f3f63fff640 1 -- 172.21.15.55:0/4132371158 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164472520 0 0) 0x7f3f6c0cfed0 con 0x7f3f6c161400 2024-04-25T08:57:38.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.614+0000 7f3f70ecd640 1 --2- 172.21.15.55:0/4132371158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0b3f80 0x7f3f6c162350 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0097a0 tx=0x7f3f5c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e5711b3f36db35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.614+0000 7f3f63fff640 1 -- 172.21.15.55:0/4132371158 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c037070 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.614+0000 7f3f63fff640 1 -- 172.21.15.55:0/4132371158 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c02ae50 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.614+0000 7f3f63fff640 1 -- 172.21.15.55:0/4132371158 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c032660 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.614+0000 7f3f73932640 1 -- 172.21.15.55:0/4132371158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0b3f80 msgr2=0x7f3f6c162350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.614+0000 7f3f73932640 1 --2- 172.21.15.55:0/4132371158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0b3f80 0x7f3f6c162350 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0097a0 tx=0x7f3f5c02a140 comp rx=0 tx=0).stop 2024-04-25T08:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.614+0000 7f3f73932640 1 -- 172.21.15.55:0/4132371158 shutdown_connections 2024-04-25T08:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.614+0000 7f3f73932640 1 --2- 172.21.15.55:0/4132371158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0b3f80 0x7f3f6c162350 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.614+0000 7f3f73932640 1 -- 172.21.15.55:0/4132371158 >> 172.21.15.55:0/4132371158 conn(0x7f3f6c06f4c0 msgr2=0x7f3f6c06f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.615+0000 7f3f73932640 1 -- 172.21.15.55:0/4132371158 shutdown_connections 2024-04-25T08:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.615+0000 7f3f73932640 1 -- 172.21.15.55:0/4132371158 wait complete. 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.616+0000 7f3f73932640 1 Processor -- start 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.616+0000 7f3f73932640 1 -- start start 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.616+0000 7f3f73932640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f6c0b35e0 0x7f3f6c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.616+0000 7f3f73932640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0b3f80 0x7f3f6c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.616+0000 7f3f73932640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6c161400 0x7f3f6c0c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.616+0000 7f3f73932640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c0d05d0 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.616+0000 7f3f73932640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c0d0450 con 0x7f3f6c161400 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.616+0000 7f3f73932640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c0b39c0 con 0x7f3f6c0b35e0 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f70ecd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0b3f80 0x7f3f6c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f70ecd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0b3f80 0x7f3f6c15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59340/0 (socket says 172.21.15.55:59340) 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f70ecd640 1 -- 172.21.15.55:0/2058135477 learned_addr learned my addr 172.21.15.55:0/2058135477 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f71ecf640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6c161400 0x7f3f6c0c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f70ecd640 1 -- 172.21.15.55:0/2058135477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f6c0b35e0 msgr2=0x7f3f6c0cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f716ce640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f6c0b35e0 0x7f3f6c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f70ecd640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f6c0b35e0 0x7f3f6c0cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f70ecd640 1 -- 172.21.15.55:0/2058135477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6c161400 msgr2=0x7f3f6c0c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f70ecd640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6c161400 0x7f3f6c0c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f70ecd640 1 -- 172.21.15.55:0/2058135477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c159ff0 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f70ecd640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0b3f80 0x7f3f6c15b370 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0097a0 tx=0x7f3f5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f61ffb640 1 -- 172.21.15.55:0/2058135477 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c037040 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f61ffb640 1 -- 172.21.15.55:0/2058135477 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c004030 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f61ffb640 1 -- 172.21.15.55:0/2058135477 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c006e10 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.617+0000 7f3f73932640 1 -- 172.21.15.55:0/2058135477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6c15a2d0 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.618+0000 7f3f73932640 1 -- 172.21.15.55:0/2058135477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6c15a890 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.618+0000 7f3f73932640 1 -- 172.21.15.55:0/2058135477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6c162080 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.619+0000 7f3f61ffb640 1 -- 172.21.15.55:0/2058135477 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3f5c03d650 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.619+0000 7f3f61ffb640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3f5006b4d0 0x7f3f5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:38.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.619+0000 7f3f61ffb640 1 -- 172.21.15.55:0/2058135477 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3f5c0aaad0 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.619+0000 7f3f716ce640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3f5006b4d0 0x7f3f5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:38.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.620+0000 7f3f716ce640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3f5006b4d0 0x7f3f5006d990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3f68003d90 tx=0x7f3f68009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:38.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.624+0000 7f3f61ffb640 1 -- 172.21.15.55:0/2058135477 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3f6c162080 con 0x7f3f6c0b3f80 2024-04-25T08:57:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:38.805+0000 7f3f73932640 1 -- 172.21.15.55:0/2058135477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3f6c0b7870 con 0x7f3f6c0b3f80 2024-04-25T08:57:39.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.783+0000 7f3f61ffb640 1 -- 172.21.15.55:0/2058135477 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3f5c042020 con 0x7f3f6c0b3f80 2024-04-25T08:57:39.773 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:57:39.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.787+0000 7f3f73932640 1 -- 172.21.15.55:0/2058135477 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3f5006b4d0 msgr2=0x7f3f5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:39.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.787+0000 7f3f73932640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3f5006b4d0 0x7f3f5006d990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3f68003d90 tx=0x7f3f68009040 comp rx=0 tx=0).stop 2024-04-25T08:57:39.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.787+0000 7f3f73932640 1 -- 172.21.15.55:0/2058135477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0b3f80 msgr2=0x7f3f6c15b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:39.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.787+0000 7f3f73932640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0b3f80 0x7f3f6c15b370 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0097a0 tx=0x7f3f5c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.787+0000 7f3f73932640 1 -- 172.21.15.55:0/2058135477 shutdown_connections 2024-04-25T08:57:39.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.787+0000 7f3f73932640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3f5006b4d0 0x7f3f5006d990 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.787+0000 7f3f73932640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6c161400 0x7f3f6c0c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.787+0000 7f3f73932640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0b3f80 0x7f3f6c15b370 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.788+0000 7f3f73932640 1 --2- 172.21.15.55:0/2058135477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f6c0b35e0 0x7f3f6c0cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.788+0000 7f3f73932640 1 -- 172.21.15.55:0/2058135477 >> 172.21.15.55:0/2058135477 conn(0x7f3f6c06f4c0 msgr2=0x7f3f6c0d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:39.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.788+0000 7f3f73932640 1 -- 172.21.15.55:0/2058135477 shutdown_connections 2024-04-25T08:57:39.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.788+0000 7f3f73932640 1 -- 172.21.15.55:0/2058135477 wait complete. 2024-04-25T08:57:39.791 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:57:39.845 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:57:39.847 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:57:39.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.914+0000 7fe943de0640 1 Processor -- start 2024-04-25T08:57:39.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.914+0000 7fe943de0640 1 -- start start 2024-04-25T08:57:39.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe943de0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93c161090 0x7fe93c161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:39.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe943de0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe93c0b9720 0x7fe93c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:39.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe943de0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe93c0cece0 0x7fe93c06c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:39.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe943de0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93c0cf130 con 0x7fe93c0cece0 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe943de0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93c0d21a0 con 0x7fe93c0b9720 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe943de0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c161f80 con 0x7fe93c161090 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe94237d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe93c0cece0 0x7fe93c06c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe94237d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe93c0cece0 0x7fe93c06c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48016/0 (socket says 172.21.15.55:48016) 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe94237d640 1 -- 172.21.15.55:0/812909651 learned_addr learned my addr 172.21.15.55:0/812909651 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe94137b640 1 --2- 172.21.15.55:0/812909651 >> v2:172.21.15.167:3300/0 conn(0x7fe93c0b9720 0x7fe93c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe941b7c640 1 --2- 172.21.15.55:0/812909651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93c161090 0x7fe93c161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe94237d640 1 -- 172.21.15.55:0/812909651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93c161090 msgr2=0x7fe93c161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.915+0000 7fe94237d640 1 --2- 172.21.15.55:0/812909651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93c161090 0x7fe93c161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.916+0000 7fe94237d640 1 -- 172.21.15.55:0/812909651 >> v2:172.21.15.167:3300/0 conn(0x7fe93c0b9720 msgr2=0x7fe93c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.916+0000 7fe94237d640 1 --2- 172.21.15.55:0/812909651 >> v2:172.21.15.167:3300/0 conn(0x7fe93c0b9720 0x7fe93c0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.916+0000 7fe94237d640 1 -- 172.21.15.55:0/812909651 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c162260 con 0x7fe93c0cece0 2024-04-25T08:57:39.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.916+0000 7fe94137b640 1 --2- 172.21.15.55:0/812909651 >> v2:172.21.15.167:3300/0 conn(0x7fe93c0b9720 0x7fe93c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:39.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.916+0000 7fe94237d640 1 --2- 172.21.15.55:0/812909651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93c0cece0 0x7fe93c06c0b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0b66c0 tx=0x7fe93402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf17e30fd6449b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:39.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.916+0000 7fe940b7a640 1 -- 172.21.15.55:0/812909651 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934036070 con 0x7fe93c0cece0 2024-04-25T08:57:39.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.916+0000 7fe940b7a640 1 -- 172.21.15.55:0/812909651 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934031600 con 0x7fe93c0cece0 2024-04-25T08:57:39.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.916+0000 7fe940b7a640 1 -- 172.21.15.55:0/812909651 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9340319d0 con 0x7fe93c0cece0 2024-04-25T08:57:39.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.917+0000 7fe943de0640 1 -- 172.21.15.55:0/812909651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93c0cece0 msgr2=0x7fe93c06c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:39.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.917+0000 7fe943de0640 1 --2- 172.21.15.55:0/812909651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93c0cece0 0x7fe93c06c0b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0b66c0 tx=0x7fe93402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.917+0000 7fe943de0640 1 -- 172.21.15.55:0/812909651 shutdown_connections 2024-04-25T08:57:39.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.917+0000 7fe943de0640 1 --2- 172.21.15.55:0/812909651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93c0cece0 0x7fe93c06c0b0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.917+0000 7fe943de0640 1 --2- 172.21.15.55:0/812909651 >> v2:172.21.15.167:3300/0 conn(0x7fe93c0b9720 0x7fe93c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.917+0000 7fe943de0640 1 --2- 172.21.15.55:0/812909651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93c161090 0x7fe93c161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.917+0000 7fe943de0640 1 -- 172.21.15.55:0/812909651 >> 172.21.15.55:0/812909651 conn(0x7fe93c0b55e0 msgr2=0x7fe93c0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.917+0000 7fe943de0640 1 -- 172.21.15.55:0/812909651 shutdown_connections 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.917+0000 7fe943de0640 1 -- 172.21.15.55:0/812909651 wait complete. 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.918+0000 7fe943de0640 1 Processor -- start 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.918+0000 7fe943de0640 1 -- start start 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe943de0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe93c0b9720 0x7fe93c0aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe943de0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93c0cece0 0x7fe93c150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe943de0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93c161090 0x7fe93c1f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe943de0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c161470 con 0x7fe93c0cece0 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe943de0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c0d1e30 con 0x7fe93c0b9720 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe943de0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c161c70 con 0x7fe93c161090 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe94137b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93c0cece0 0x7fe93c150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe94137b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93c0cece0 0x7fe93c150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48030/0 (socket says 172.21.15.55:48030) 2024-04-25T08:57:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe94137b640 1 -- 172.21.15.55:0/2535818503 learned_addr learned my addr 172.21.15.55:0/2535818503 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe941b7c640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe93c0b9720 0x7fe93c0aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe94237d640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93c161090 0x7fe93c1f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.919+0000 7fe94137b640 1 -- 172.21.15.55:0/2535818503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93c161090 msgr2=0x7fe93c1f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe94137b640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93c161090 0x7fe93c1f6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe94137b640 1 -- 172.21.15.55:0/2535818503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe93c0b9720 msgr2=0x7fe93c0aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe94137b640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe93c0b9720 0x7fe93c0aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe94137b640 1 -- 172.21.15.55:0/2535818503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c0ccd20 con 0x7fe93c0cece0 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe94237d640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93c161090 0x7fe93c1f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe941b7c640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe93c0b9720 0x7fe93c0aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe94137b640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93c0cece0 0x7fe93c150b00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00c7c0 tx=0x7fe92c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe9327fc640 1 -- 172.21.15.55:0/2535818503 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c015070 con 0x7fe93c0cece0 2024-04-25T08:57:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe9327fc640 1 -- 172.21.15.55:0/2535818503 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c007a30 con 0x7fe93c0cece0 2024-04-25T08:57:39.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe943de0640 1 -- 172.21.15.55:0/2535818503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c0aaa20 con 0x7fe93c0cece0 2024-04-25T08:57:39.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe9327fc640 1 -- 172.21.15.55:0/2535818503 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c007e00 con 0x7fe93c0cece0 2024-04-25T08:57:39.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.920+0000 7fe943de0640 1 -- 172.21.15.55:0/2535818503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c1f74d0 con 0x7fe93c0cece0 2024-04-25T08:57:39.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.921+0000 7fe943de0640 1 -- 172.21.15.55:0/2535818503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93c0750b0 con 0x7fe93c0cece0 2024-04-25T08:57:39.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.921+0000 7fe9327fc640 1 -- 172.21.15.55:0/2535818503 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe92c018070 con 0x7fe93c0cece0 2024-04-25T08:57:39.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.922+0000 7fe9327fc640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe92006b4d0 0x7fe92006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:39.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.922+0000 7fe9327fc640 1 -- 172.21.15.55:0/2535818503 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fe92c089f80 con 0x7fe93c0cece0 2024-04-25T08:57:39.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.922+0000 7fe941b7c640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe92006b4d0 0x7fe92006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:39.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.922+0000 7fe941b7c640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe92006b4d0 0x7fe92006d990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe938006fd0 tx=0x7fe938008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:39.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:39.926+0000 7fe9327fc640 1 -- 172.21.15.55:0/2535818503 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe92c058ff0 con 0x7fe93c0cece0 2024-04-25T08:57:40.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.107+0000 7fe943de0640 1 -- 172.21.15.55:0/2535818503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe93c0d1700 con 0x7fe93c0cece0 2024-04-25T08:57:40.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.790+0000 7fe9327fc640 1 -- 172.21.15.55:0/2535818503 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe92c0588f0 con 0x7fe93c0cece0 2024-04-25T08:57:40.780 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 -- 172.21.15.55:0/2535818503 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe92006b4d0 msgr2=0x7fe92006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe92006b4d0 0x7fe92006d990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe938006fd0 tx=0x7fe938008040 comp rx=0 tx=0).stop 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 -- 172.21.15.55:0/2535818503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93c0cece0 msgr2=0x7fe93c150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93c0cece0 0x7fe93c150b00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00c7c0 tx=0x7fe92c00cc80 comp rx=0 tx=0).stop 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 -- 172.21.15.55:0/2535818503 shutdown_connections 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe92006b4d0 0x7fe92006d990 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93c161090 0x7fe93c1f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93c0cece0 0x7fe93c150b00 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 --2- 172.21.15.55:0/2535818503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe93c0b9720 0x7fe93c0aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 -- 172.21.15.55:0/2535818503 >> 172.21.15.55:0/2535818503 conn(0x7fe93c0b55e0 msgr2=0x7fe93c0d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 -- 172.21.15.55:0/2535818503 shutdown_connections 2024-04-25T08:57:40.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.793+0000 7fe943de0640 1 -- 172.21.15.55:0/2535818503 wait complete. 2024-04-25T08:57:40.798 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:57:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.957+0000 7f578a970640 1 Processor -- start 2024-04-25T08:57:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.957+0000 7f578a970640 1 -- start start 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f578a970640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f57840d3b90 0x7f57840d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f578a970640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57840d0f60 0x7f57840b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f578a970640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57840d4090 con 0x7f578415dca0 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f578a970640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57840b6b20 con 0x7f57840d0f60 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f578a970640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57840d1390 con 0x7f57840d3b90 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f5788f0d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57840d0f60 0x7f57840b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f5788f0d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57840d0f60 0x7f57840b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48038/0 (socket says 172.21.15.55:48038) 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f5788f0d640 1 -- 172.21.15.55:0/3935198219 learned_addr learned my addr 172.21.15.55:0/3935198219 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f57837fe640 1 --2- 172.21.15.55:0/3935198219 >> v2:172.21.15.167:3300/0 conn(0x7f57840d3b90 0x7f57840d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f5788f0d640 1 -- 172.21.15.55:0/3935198219 >> v2:172.21.15.167:3300/0 conn(0x7f57840d3b90 msgr2=0x7f57840d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f5788f0d640 1 --2- 172.21.15.55:0/3935198219 >> v2:172.21.15.167:3300/0 conn(0x7f57840d3b90 0x7f57840d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f5788f0d640 1 -- 172.21.15.55:0/3935198219 >> v1:172.21.15.167:6789/0 conn(0x7f578415dca0 legacy=0x7f57840ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:40.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.958+0000 7f5788f0d640 1 -- 172.21.15.55:0/3935198219 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57840d4370 con 0x7f57840d0f60 2024-04-25T08:57:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.959+0000 7f5788f0d640 1 --2- 172.21.15.55:0/3935198219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840d0f60 0x7f57840b2500 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f57840b6560 tx=0x7f577c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdae517d2819e899 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.959+0000 7f5782ffd640 1 -- 172.21.15.55:0/3935198219 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c036070 con 0x7f57840d0f60 2024-04-25T08:57:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.959+0000 7f5782ffd640 1 -- 172.21.15.55:0/3935198219 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c031600 con 0x7f57840d0f60 2024-04-25T08:57:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.959+0000 7f5782ffd640 1 -- 172.21.15.55:0/3935198219 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0319d0 con 0x7f57840d0f60 2024-04-25T08:57:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.960+0000 7f578a970640 1 -- 172.21.15.55:0/3935198219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840d0f60 msgr2=0x7f57840b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.960+0000 7f578a970640 1 --2- 172.21.15.55:0/3935198219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840d0f60 0x7f57840b2500 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f57840b6560 tx=0x7f577c02a710 comp rx=0 tx=0).stop 2024-04-25T08:57:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.960+0000 7f578a970640 1 -- 172.21.15.55:0/3935198219 shutdown_connections 2024-04-25T08:57:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.960+0000 7f578a970640 1 --2- 172.21.15.55:0/3935198219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840d0f60 0x7f57840b2500 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.960+0000 7f578a970640 1 --2- 172.21.15.55:0/3935198219 >> v2:172.21.15.167:3300/0 conn(0x7f57840d3b90 0x7f57840d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.960+0000 7f578a970640 1 -- 172.21.15.55:0/3935198219 >> 172.21.15.55:0/3935198219 conn(0x7f57840726c0 msgr2=0x7f5784072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.960+0000 7f578a970640 1 -- 172.21.15.55:0/3935198219 shutdown_connections 2024-04-25T08:57:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.960+0000 7f578a970640 1 -- 172.21.15.55:0/3935198219 wait complete. 2024-04-25T08:57:40.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.961+0000 7f578a970640 1 Processor -- start 2024-04-25T08:57:40.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.961+0000 7f578a970640 1 -- start start 2024-04-25T08:57:40.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.962+0000 7f578a970640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57840d0f60 0x7f57841f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.962+0000 7f578a970640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840d3b90 0x7f57840b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.962+0000 7f578a970640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578415dca0 0x7f57840cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.962+0000 7f578a970640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57840cf050 con 0x7f57840d3b90 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.962+0000 7f578a970640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57840b6d50 con 0x7f578415dca0 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.962+0000 7f578a970640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578415e080 con 0x7f57840d0f60 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.962+0000 7f57837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840d3b90 0x7f57840b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.962+0000 7f57837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840d3b90 0x7f57840b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48048/0 (socket says 172.21.15.55:48048) 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.962+0000 7f57837fe640 1 -- 172.21.15.55:0/1888880823 learned_addr learned my addr 172.21.15.55:0/1888880823 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.962+0000 7f5783fff640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57840d0f60 0x7f57841f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.962+0000 7f5788f0d640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578415dca0 0x7f57840cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.963+0000 7f57837fe640 1 -- 172.21.15.55:0/1888880823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57840d0f60 msgr2=0x7f57841f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.963+0000 7f57837fe640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57840d0f60 0x7f57841f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.963+0000 7f57837fe640 1 -- 172.21.15.55:0/1888880823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578415dca0 msgr2=0x7f57840cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.963+0000 7f57837fe640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578415dca0 0x7f57840cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.963+0000 7f57837fe640 1 -- 172.21.15.55:0/1888880823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57840c9920 con 0x7f57840d3b90 2024-04-25T08:57:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.963+0000 7f57837fe640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840d3b90 0x7f57840b3f70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f577400d7d0 tx=0x7f577400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.963+0000 7f5780ff9640 1 -- 172.21.15.55:0/1888880823 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577400b6c0 con 0x7f57840d3b90 2024-04-25T08:57:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.963+0000 7f5780ff9640 1 -- 172.21.15.55:0/1888880823 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5774019070 con 0x7f57840d3b90 2024-04-25T08:57:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.963+0000 7f578a970640 1 -- 172.21.15.55:0/1888880823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57840c9c00 con 0x7f57840d3b90 2024-04-25T08:57:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.963+0000 7f5780ff9640 1 -- 172.21.15.55:0/1888880823 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577400bac0 con 0x7f57840d3b90 2024-04-25T08:57:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.963+0000 7f578a970640 1 -- 172.21.15.55:0/1888880823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57840ca1c0 con 0x7f57840d3b90 2024-04-25T08:57:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.964+0000 7f578a970640 1 -- 172.21.15.55:0/1888880823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57840750b0 con 0x7f57840d3b90 2024-04-25T08:57:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.965+0000 7f5780ff9640 1 -- 172.21.15.55:0/1888880823 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f577400bc60 con 0x7f57840d3b90 2024-04-25T08:57:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.965+0000 7f5780ff9640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576406b500 0x7f576406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.965+0000 7f5783fff640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576406b500 0x7f576406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.965+0000 7f5780ff9640 1 -- 172.21.15.55:0/1888880823 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f577408a240 con 0x7f57840d3b90 2024-04-25T08:57:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.966+0000 7f5783fff640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576406b500 0x7f576406d9c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f576c006fd0 tx=0x7f576c009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:40.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:40.969+0000 7f5780ff9640 1 -- 172.21.15.55:0/1888880823 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5774058d70 con 0x7f57840d3b90 2024-04-25T08:57:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.152+0000 7f578a970640 1 -- 172.21.15.55:0/1888880823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f57840b4a00 con 0x7f57840d3b90 2024-04-25T08:57:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.155+0000 7f5780ff9640 1 -- 172.21.15.55:0/1888880823 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f577405ce10 con 0x7f57840d3b90 2024-04-25T08:57:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 -- 172.21.15.55:0/1888880823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576406b500 msgr2=0x7f576406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576406b500 0x7f576406d9c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f576c006fd0 tx=0x7f576c009060 comp rx=0 tx=0).stop 2024-04-25T08:57:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 -- 172.21.15.55:0/1888880823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840d3b90 msgr2=0x7f57840b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840d3b90 0x7f57840b3f70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f577400d7d0 tx=0x7f577400dc90 comp rx=0 tx=0).stop 2024-04-25T08:57:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 -- 172.21.15.55:0/1888880823 shutdown_connections 2024-04-25T08:57:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576406b500 0x7f576406d9c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578415dca0 0x7f57840cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840d3b90 0x7f57840b3f70 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 --2- 172.21.15.55:0/1888880823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57840d0f60 0x7f57841f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 -- 172.21.15.55:0/1888880823 >> 172.21.15.55:0/1888880823 conn(0x7f57840726c0 msgr2=0x7f57840d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 -- 172.21.15.55:0/1888880823 shutdown_connections 2024-04-25T08:57:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.157+0000 7f578a970640 1 -- 172.21.15.55:0/1888880823 wait complete. 2024-04-25T08:57:41.157 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T08:57:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.269+0000 7f8496fe2640 1 Processor -- start 2024-04-25T08:57:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.269+0000 7f8496fe2640 1 -- start start 2024-04-25T08:57:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.270+0000 7f8496fe2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f84900d35b0 0x7f84900b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.270+0000 7f8496fe2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84900b5990 0x7f84900b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.270+0000 7f8496fe2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849015e0c0 con 0x7f849015dce0 2024-04-25T08:57:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.270+0000 7f8496fe2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84900d2510 con 0x7f84900b5990 2024-04-25T08:57:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.270+0000 7f8496fe2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84900d27f0 con 0x7f84900d35b0 2024-04-25T08:57:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.270+0000 7f8494d7e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f849015dce0 0x7f84900d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42010/0 (socket says 172.21.15.55:42010) 2024-04-25T08:57:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.270+0000 7f8494d7e640 1 -- 172.21.15.55:0/4097537019 learned_addr learned my addr 172.21.15.55:0/4097537019 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.270+0000 7f849557f640 1 --2- 172.21.15.55:0/4097537019 >> v2:172.21.15.55:3300/0 conn(0x7f84900b5990 0x7f84900b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.270+0000 7f8487fff640 1 --2- 172.21.15.55:0/4097537019 >> v2:172.21.15.167:3300/0 conn(0x7f84900d35b0 0x7f84900b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.271+0000 7f849557f640 1 -- 172.21.15.55:0/4097537019 >> v2:172.21.15.167:3300/0 conn(0x7f84900d35b0 msgr2=0x7f84900b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.271+0000 7f849557f640 1 --2- 172.21.15.55:0/4097537019 >> v2:172.21.15.167:3300/0 conn(0x7f84900d35b0 0x7f84900b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.271+0000 7f849557f640 1 -- 172.21.15.55:0/4097537019 >> v1:172.21.15.55:6789/0 conn(0x7f849015dce0 legacy=0x7f84900d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.271+0000 7f84877fe640 1 -- 172.21.15.55:0/4097537019 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905504257 0 0) 0x7f849015e0c0 con 0x7f849015dce0 2024-04-25T08:57:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.271+0000 7f849557f640 1 -- 172.21.15.55:0/4097537019 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900d2ad0 con 0x7f84900b5990 2024-04-25T08:57:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.271+0000 7f8487fff640 1 --2- 172.21.15.55:0/4097537019 >> v2:172.21.15.167:3300/0 conn(0x7f84900d35b0 0x7f84900b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.271+0000 7f849557f640 1 --2- 172.21.15.55:0/4097537019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84900b5990 0x7f84900b6b00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f84900cdfa0 tx=0x7f848802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25baf72b14871d6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.271+0000 7f84877fe640 1 -- 172.21.15.55:0/4097537019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488007740 con 0x7f84900b5990 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.271+0000 7f84877fe640 1 -- 172.21.15.55:0/4097537019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84880078e0 con 0x7f84900b5990 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.271+0000 7f84877fe640 1 -- 172.21.15.55:0/4097537019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488007cb0 con 0x7f84900b5990 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.272+0000 7f8496fe2640 1 -- 172.21.15.55:0/4097537019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84900b5990 msgr2=0x7f84900b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.272+0000 7f8496fe2640 1 --2- 172.21.15.55:0/4097537019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84900b5990 0x7f84900b6b00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f84900cdfa0 tx=0x7f848802a680 comp rx=0 tx=0).stop 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.272+0000 7f8496fe2640 1 -- 172.21.15.55:0/4097537019 shutdown_connections 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.272+0000 7f8496fe2640 1 --2- 172.21.15.55:0/4097537019 >> v2:172.21.15.167:3300/0 conn(0x7f84900d35b0 0x7f84900b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.272+0000 7f8496fe2640 1 --2- 172.21.15.55:0/4097537019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84900b5990 0x7f84900b6b00 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.272+0000 7f8496fe2640 1 -- 172.21.15.55:0/4097537019 >> 172.21.15.55:0/4097537019 conn(0x7f8490072900 msgr2=0x7f84900d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.272+0000 7f8496fe2640 1 -- 172.21.15.55:0/4097537019 shutdown_connections 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.272+0000 7f8496fe2640 1 -- 172.21.15.55:0/4097537019 wait complete. 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.273+0000 7f8496fe2640 1 Processor -- start 2024-04-25T08:57:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.273+0000 7f8496fe2640 1 -- start start 2024-04-25T08:57:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f8496fe2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84900b5990 0x7f849015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f8496fe2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84900d35b0 0x7f84900ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f8496fe2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849015dce0 0x7f84900b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f8496fe2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900d2160 con 0x7f849015dce0 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f8496fe2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900d3090 con 0x7f84900b5990 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f8496fe2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84900aa550 con 0x7f84900d35b0 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f849557f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849015dce0 0x7f84900b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f849557f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849015dce0 0x7f84900b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48052/0 (socket says 172.21.15.55:48052) 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f849557f640 1 -- 172.21.15.55:0/864852681 learned_addr learned my addr 172.21.15.55:0/864852681 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f8494d7e640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84900b5990 0x7f849015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f8487fff640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84900d35b0 0x7f84900ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f849557f640 1 -- 172.21.15.55:0/864852681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84900d35b0 msgr2=0x7f84900ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f849557f640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84900d35b0 0x7f84900ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f849557f640 1 -- 172.21.15.55:0/864852681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84900b5990 msgr2=0x7f849015b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f849557f640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84900b5990 0x7f849015b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f849557f640 1 -- 172.21.15.55:0/864852681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900aa830 con 0x7f849015dce0 2024-04-25T08:57:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.274+0000 7f8487fff640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84900d35b0 0x7f84900ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.275+0000 7f849557f640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849015dce0 0x7f84900b35e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8488009e50 tx=0x7f8488004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.275+0000 7f84857fa640 1 -- 172.21.15.55:0/864852681 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488040070 con 0x7f849015dce0 2024-04-25T08:57:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.275+0000 7f84857fa640 1 -- 172.21.15.55:0/864852681 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488031bf0 con 0x7f849015dce0 2024-04-25T08:57:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.275+0000 7f8496fe2640 1 -- 172.21.15.55:0/864852681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84900aab10 con 0x7f849015dce0 2024-04-25T08:57:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.275+0000 7f84857fa640 1 -- 172.21.15.55:0/864852681 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488045460 con 0x7f849015dce0 2024-04-25T08:57:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.275+0000 7f8496fe2640 1 -- 172.21.15.55:0/864852681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849015b840 con 0x7f849015dce0 2024-04-25T08:57:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.276+0000 7f8496fe2640 1 -- 172.21.15.55:0/864852681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84900cf8d0 con 0x7f849015dce0 2024-04-25T08:57:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.276+0000 7f84857fa640 1 -- 172.21.15.55:0/864852681 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8488039040 con 0x7f849015dce0 2024-04-25T08:57:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.277+0000 7f84857fa640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f847c06b4d0 0x7f847c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.277+0000 7f84857fa640 1 -- 172.21.15.55:0/864852681 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f84880ab7a0 con 0x7f849015dce0 2024-04-25T08:57:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.277+0000 7f8494d7e640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f847c06b4d0 0x7f847c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.277+0000 7f8494d7e640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f847c06b4d0 0x7f847c06d990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f848c007fd0 tx=0x7f848c007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.281+0000 7f84857fa640 1 -- 172.21.15.55:0/864852681 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f84900cf8d0 con 0x7f849015dce0 2024-04-25T08:57:41.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.537+0000 7f8496fe2640 1 -- 172.21.15.55:0/864852681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f84900749b0 con 0x7f849015dce0 2024-04-25T08:57:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.796+0000 7f84857fa640 1 -- 172.21.15.55:0/864852681 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v210) v1 ==== 169+0+0 (secure 0 0 0) 0x7f848807a9b0 con 0x7f849015dce0 2024-04-25T08:57:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.797+0000 7f8496fe2640 1 -- 172.21.15.55:0/864852681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f847c06b4d0 msgr2=0x7f847c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.797+0000 7f8496fe2640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f847c06b4d0 0x7f847c06d990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f848c007fd0 tx=0x7f848c007de0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.797+0000 7f8496fe2640 1 -- 172.21.15.55:0/864852681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849015dce0 msgr2=0x7f84900b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.797+0000 7f8496fe2640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849015dce0 0x7f84900b35e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8488009e50 tx=0x7f8488004a40 comp rx=0 tx=0).stop 2024-04-25T08:57:41.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.798+0000 7f8496fe2640 1 -- 172.21.15.55:0/864852681 shutdown_connections 2024-04-25T08:57:41.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.798+0000 7f8496fe2640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f847c06b4d0 0x7f847c06d990 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.798+0000 7f8496fe2640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849015dce0 0x7f84900b35e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.798+0000 7f8496fe2640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84900d35b0 0x7f84900ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.798+0000 7f8496fe2640 1 --2- 172.21.15.55:0/864852681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84900b5990 0x7f849015b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.798+0000 7f8496fe2640 1 -- 172.21.15.55:0/864852681 >> 172.21.15.55:0/864852681 conn(0x7f8490072900 msgr2=0x7f84900b82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:41.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.798+0000 7f8496fe2640 1 -- 172.21.15.55:0/864852681 shutdown_connections 2024-04-25T08:57:41.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.798+0000 7f8496fe2640 1 -- 172.21.15.55:0/864852681 wait complete. 2024-04-25T08:57:41.799 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T08:57:41.799 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T08:57:41.799 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T08:57:41.800 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:41.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.915+0000 7fa2696d2640 1 Processor -- start 2024-04-25T08:57:41.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.915+0000 7fa2696d2640 1 -- start start 2024-04-25T08:57:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.915+0000 7fa2696d2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26415bb90 0x7fa264160070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.915+0000 7fa2696d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa26406aba0 0x7fa2640cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.915+0000 7fa2696d2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26406b310 con 0x7fa2640cc780 2024-04-25T08:57:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.915+0000 7fa2696d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2640b0010 con 0x7fa26406aba0 2024-04-25T08:57:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.915+0000 7fa2696d2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26406b5f0 con 0x7fa26415bb90 2024-04-25T08:57:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.916+0000 7fa2627fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa26406aba0 0x7fa2640cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.916+0000 7fa2627fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa26406aba0 0x7fa2640cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48054/0 (socket says 172.21.15.55:48054) 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.916+0000 7fa2627fc640 1 -- 172.21.15.55:0/3971160806 learned_addr learned my addr 172.21.15.55:0/3971160806 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.916+0000 7fa262ffd640 1 --2- 172.21.15.55:0/3971160806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26415bb90 0x7fa264160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.916+0000 7fa2627fc640 1 -- 172.21.15.55:0/3971160806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26415bb90 msgr2=0x7fa264160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.916+0000 7fa2627fc640 1 --2- 172.21.15.55:0/3971160806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26415bb90 0x7fa264160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.916+0000 7fa2627fc640 1 -- 172.21.15.55:0/3971160806 >> v1:172.21.15.167:6789/0 conn(0x7fa2640cc780 legacy=0x7fa2640cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.916+0000 7fa2627fc640 1 -- 172.21.15.55:0/3971160806 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2640b0260 con 0x7fa26406aba0 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.916+0000 7fa261ffb640 1 -- 172.21.15.55:0/3971160806 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447811738 0 0) 0x7fa26406b310 con 0x7fa2640cc780 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.917+0000 7fa2627fc640 1 --2- 172.21.15.55:0/3971160806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa26406aba0 0x7fa2640cc240 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa258009870 tx=0x7fa25802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334c7f86f95fa9f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.917+0000 7fa261ffb640 1 -- 172.21.15.55:0/3971160806 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258037070 con 0x7fa26406aba0 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.917+0000 7fa261ffb640 1 -- 172.21.15.55:0/3971160806 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258032440 con 0x7fa26406aba0 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.917+0000 7fa261ffb640 1 -- 172.21.15.55:0/3971160806 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258032810 con 0x7fa26406aba0 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.917+0000 7fa2696d2640 1 -- 172.21.15.55:0/3971160806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa26406aba0 msgr2=0x7fa2640cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.917+0000 7fa2696d2640 1 --2- 172.21.15.55:0/3971160806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa26406aba0 0x7fa2640cc240 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa258009870 tx=0x7fa25802a1c0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.918+0000 7fa2696d2640 1 -- 172.21.15.55:0/3971160806 shutdown_connections 2024-04-25T08:57:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.918+0000 7fa2696d2640 1 --2- 172.21.15.55:0/3971160806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa26406aba0 0x7fa2640cc240 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.918+0000 7fa2696d2640 1 --2- 172.21.15.55:0/3971160806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26415bb90 0x7fa264160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.918+0000 7fa2696d2640 1 -- 172.21.15.55:0/3971160806 >> 172.21.15.55:0/3971160806 conn(0x7fa2640d06b0 msgr2=0x7fa2640d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.918+0000 7fa2696d2640 1 -- 172.21.15.55:0/3971160806 shutdown_connections 2024-04-25T08:57:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.918+0000 7fa2696d2640 1 -- 172.21.15.55:0/3971160806 wait complete. 2024-04-25T08:57:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.919+0000 7fa2696d2640 1 Processor -- start 2024-04-25T08:57:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.919+0000 7fa2696d2640 1 -- start start 2024-04-25T08:57:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2696d2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26406aba0 0x7fa2641e5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2696d2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2640cc780 0x7fa2640c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2696d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa26415bb90 0x7fa264159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2696d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26406b000 con 0x7fa26415bb90 2024-04-25T08:57:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2696d2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2640ccc10 con 0x7fa2640cc780 2024-04-25T08:57:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2696d2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2640b1a70 con 0x7fa26406aba0 2024-04-25T08:57:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2637fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa26415bb90 0x7fa264159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2637fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa26415bb90 0x7fa264159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48066/0 (socket says 172.21.15.55:48066) 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2637fe640 1 -- 172.21.15.55:0/4282639232 learned_addr learned my addr 172.21.15.55:0/4282639232 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa262ffd640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26406aba0 0x7fa2641e5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2627fc640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2640cc780 0x7fa2640c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2637fe640 1 -- 172.21.15.55:0/4282639232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26406aba0 msgr2=0x7fa2641e5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2637fe640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26406aba0 0x7fa2641e5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2637fe640 1 -- 172.21.15.55:0/4282639232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2640cc780 msgr2=0x7fa2640c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2637fe640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2640cc780 0x7fa2640c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2637fe640 1 -- 172.21.15.55:0/4282639232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2640c8e60 con 0x7fa26415bb90 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.920+0000 7fa2637fe640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa26415bb90 0x7fa264159ab0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00c760 tx=0x7fa25c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.921+0000 7fa24b7fe640 1 -- 172.21.15.55:0/4282639232 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c003da0 con 0x7fa26415bb90 2024-04-25T08:57:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.921+0000 7fa24b7fe640 1 -- 172.21.15.55:0/4282639232 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c005070 con 0x7fa26415bb90 2024-04-25T08:57:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.921+0000 7fa2696d2640 1 -- 172.21.15.55:0/4282639232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2640c9140 con 0x7fa26415bb90 2024-04-25T08:57:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.921+0000 7fa24b7fe640 1 -- 172.21.15.55:0/4282639232 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c005460 con 0x7fa26415bb90 2024-04-25T08:57:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.921+0000 7fa2696d2640 1 -- 172.21.15.55:0/4282639232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2640c9700 con 0x7fa26415bb90 2024-04-25T08:57:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.922+0000 7fa2696d2640 1 -- 172.21.15.55:0/4282639232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2640749b0 con 0x7fa26415bb90 2024-04-25T08:57:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.922+0000 7fa24b7fe640 1 -- 172.21.15.55:0/4282639232 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa25c005600 con 0x7fa26415bb90 2024-04-25T08:57:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.923+0000 7fa24b7fe640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa25006b4d0 0x7fa25006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.923+0000 7fa262ffd640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa25006b4d0 0x7fa25006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:41.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.923+0000 7fa24b7fe640 1 -- 172.21.15.55:0/4282639232 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa25c089d30 con 0x7fa26415bb90 2024-04-25T08:57:41.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.923+0000 7fa262ffd640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa25006b4d0 0x7fa25006d990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa2640d1530 tx=0x7fa254009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:41.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:41.927+0000 7fa24b7fe640 1 -- 172.21.15.55:0/4282639232 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa25c058850 con 0x7fa26415bb90 2024-04-25T08:57:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.107+0000 7fa2696d2640 1 -- 172.21.15.55:0/4282639232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2640d0ed0 con 0x7fa26415bb90 2024-04-25T08:57:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.108+0000 7fa24b7fe640 1 -- 172.21.15.55:0/4282639232 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+13020 (secure 0 0 0) 0x7fa25c05c8f0 con 0x7fa26415bb90 2024-04-25T08:57:42.097 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:42.098 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":64,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:57:40.784384+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6835/238831666":"2024-04-26T08:57:37.478758+0000","172.21.15.167:6833/238831666":"2024-04-26T08:57:37.478758+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:42.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 -- 172.21.15.55:0/4282639232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa25006b4d0 msgr2=0x7fa25006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa25006b4d0 0x7fa25006d990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa2640d1530 tx=0x7fa254009190 comp rx=0 tx=0).stop 2024-04-25T08:57:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 -- 172.21.15.55:0/4282639232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa26415bb90 msgr2=0x7fa264159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa26415bb90 0x7fa264159ab0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00c760 tx=0x7fa25c00cc20 comp rx=0 tx=0).stop 2024-04-25T08:57:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 -- 172.21.15.55:0/4282639232 shutdown_connections 2024-04-25T08:57:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa25006b4d0 0x7fa25006d990 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa26415bb90 0x7fa264159ab0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2640cc780 0x7fa2640c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 --2- 172.21.15.55:0/4282639232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26406aba0 0x7fa2641e5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 -- 172.21.15.55:0/4282639232 >> 172.21.15.55:0/4282639232 conn(0x7fa2640d06b0 msgr2=0x7fa2640b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 -- 172.21.15.55:0/4282639232 shutdown_connections 2024-04-25T08:57:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.110+0000 7fa2696d2640 1 -- 172.21.15.55:0/4282639232 wait complete. 2024-04-25T08:57:42.111 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:42.111 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:42.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.225+0000 7f42effee640 1 Processor -- start 2024-04-25T08:57:42.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.225+0000 7f42effee640 1 -- start start 2024-04-25T08:57:42.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.226+0000 7f42effee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42e815dca0 0x7f42e80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.226+0000 7f42effee640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f42e80d3b90 0x7f42e80d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.226+0000 7f42effee640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e80d4090 con 0x7f42e80cee80 2024-04-25T08:57:42.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.226+0000 7f42effee640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e80b6b20 con 0x7f42e815dca0 2024-04-25T08:57:42.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.226+0000 7f42effee640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e80d4370 con 0x7f42e80d3b90 2024-04-25T08:57:42.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.226+0000 7f42edd8a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42e815dca0 0x7f42e80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.226+0000 7f42edd8a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42e815dca0 0x7f42e80ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48074/0 (socket says 172.21.15.55:48074) 2024-04-25T08:57:42.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.226+0000 7f42edd8a640 1 -- 172.21.15.55:0/3333883989 learned_addr learned my addr 172.21.15.55:0/3333883989 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:42.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.227+0000 7f42ed589640 1 --2- 172.21.15.55:0/3333883989 >> v2:172.21.15.167:3300/0 conn(0x7f42e80d3b90 0x7f42e80d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.227+0000 7f42edd8a640 1 -- 172.21.15.55:0/3333883989 >> v2:172.21.15.167:3300/0 conn(0x7f42e80d3b90 msgr2=0x7f42e80d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.227+0000 7f42edd8a640 1 --2- 172.21.15.55:0/3333883989 >> v2:172.21.15.167:3300/0 conn(0x7f42e80d3b90 0x7f42e80d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.227+0000 7f42edd8a640 1 -- 172.21.15.55:0/3333883989 >> v1:172.21.15.167:6789/0 conn(0x7f42e80cee80 legacy=0x7f42e80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.227+0000 7f42edd8a640 1 -- 172.21.15.55:0/3333883989 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e80d4650 con 0x7f42e815dca0 2024-04-25T08:57:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.227+0000 7f42edd8a640 1 --2- 172.21.15.55:0/3333883989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42e815dca0 0x7f42e80ce940 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f42e80b6560 tx=0x7f42e002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18e784d1ac0e02a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.228+0000 7f42ecd88640 1 -- 172.21.15.55:0/3333883989 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0037070 con 0x7f42e815dca0 2024-04-25T08:57:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.228+0000 7f42ecd88640 1 -- 172.21.15.55:0/3333883989 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e0032440 con 0x7f42e815dca0 2024-04-25T08:57:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.228+0000 7f42ecd88640 1 -- 172.21.15.55:0/3333883989 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0032810 con 0x7f42e815dca0 2024-04-25T08:57:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.228+0000 7f42effee640 1 -- 172.21.15.55:0/3333883989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42e815dca0 msgr2=0x7f42e80ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.228+0000 7f42effee640 1 --2- 172.21.15.55:0/3333883989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42e815dca0 0x7f42e80ce940 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f42e80b6560 tx=0x7f42e002a230 comp rx=0 tx=0).stop 2024-04-25T08:57:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.228+0000 7f42effee640 1 -- 172.21.15.55:0/3333883989 shutdown_connections 2024-04-25T08:57:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.228+0000 7f42effee640 1 --2- 172.21.15.55:0/3333883989 >> v2:172.21.15.167:3300/0 conn(0x7f42e80d3b90 0x7f42e80d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.228+0000 7f42effee640 1 --2- 172.21.15.55:0/3333883989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42e815dca0 0x7f42e80ce940 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.228+0000 7f42effee640 1 -- 172.21.15.55:0/3333883989 >> 172.21.15.55:0/3333883989 conn(0x7f42e80726c0 msgr2=0x7f42e8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.228+0000 7f42effee640 1 -- 172.21.15.55:0/3333883989 shutdown_connections 2024-04-25T08:57:42.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.228+0000 7f42effee640 1 -- 172.21.15.55:0/3333883989 wait complete. 2024-04-25T08:57:42.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.229+0000 7f42effee640 1 Processor -- start 2024-04-25T08:57:42.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.229+0000 7f42effee640 1 -- start start 2024-04-25T08:57:42.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42effee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42e80cee80 0x7f42e815b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42effee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42e80d3b90 0x7f42e81f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42effee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42e815dca0 0x7f42e815fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42effee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e815e200 con 0x7f42e80cee80 2024-04-25T08:57:42.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42effee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e815e080 con 0x7f42e80d3b90 2024-04-25T08:57:42.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42effee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e80d0f60 con 0x7f42e815dca0 2024-04-25T08:57:42.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42edd8a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42e80cee80 0x7f42e815b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42edd8a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42e80cee80 0x7f42e815b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48082/0 (socket says 172.21.15.55:48082) 2024-04-25T08:57:42.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42edd8a640 1 -- 172.21.15.55:0/194847851 learned_addr learned my addr 172.21.15.55:0/194847851 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:42.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42edd8a640 1 -- 172.21.15.55:0/194847851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42e815dca0 msgr2=0x7f42e815fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42edd8a640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42e815dca0 0x7f42e815fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.230+0000 7f42edd8a640 1 -- 172.21.15.55:0/194847851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42e80d3b90 msgr2=0x7f42e81f3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.231+0000 7f42edd8a640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42e80d3b90 0x7f42e81f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.231+0000 7f42edd8a640 1 -- 172.21.15.55:0/194847851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e815bc00 con 0x7f42e80cee80 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.231+0000 7f42edd8a640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42e80cee80 0x7f42e815b6c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f42e0000c00 tx=0x7f42e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.231+0000 7f42e67fc640 1 -- 172.21.15.55:0/194847851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0041020 con 0x7f42e80cee80 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.231+0000 7f42e67fc640 1 -- 172.21.15.55:0/194847851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e00306c0 con 0x7f42e80cee80 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.231+0000 7f42e67fc640 1 -- 172.21.15.55:0/194847851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0037040 con 0x7f42e80cee80 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.231+0000 7f42effee640 1 -- 172.21.15.55:0/194847851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e80cc000 con 0x7f42e80cee80 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.231+0000 7f42effee640 1 -- 172.21.15.55:0/194847851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e80cc5c0 con 0x7f42e80cee80 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.232+0000 7f42effee640 1 -- 172.21.15.55:0/194847851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e80750b0 con 0x7f42e80cee80 2024-04-25T08:57:42.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.233+0000 7f42e67fc640 1 -- 172.21.15.55:0/194847851 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f42e0044020 con 0x7f42e80cee80 2024-04-25T08:57:42.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.233+0000 7f42e67fc640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f42d406b4d0 0x7f42d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.233+0000 7f42e67fc640 1 -- 172.21.15.55:0/194847851 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f42e00aa730 con 0x7f42e80cee80 2024-04-25T08:57:42.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.233+0000 7f42ed589640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f42d406b4d0 0x7f42d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.234+0000 7f42ed589640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f42d406b4d0 0x7f42d406d990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f42e80b90a0 tx=0x7f42dc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.237+0000 7f42e67fc640 1 -- 172.21.15.55:0/194847851 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f42e004b030 con 0x7f42e80cee80 2024-04-25T08:57:42.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.422+0000 7f42effee640 1 -- 172.21.15.55:0/194847851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42e80b4ec0 con 0x7f42e80cee80 2024-04-25T08:57:42.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.422+0000 7f42e67fc640 1 -- 172.21.15.55:0/194847851 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42e00798b0 con 0x7f42e80cee80 2024-04-25T08:57:42.412 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:57:42.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 -- 172.21.15.55:0/194847851 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f42d406b4d0 msgr2=0x7f42d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f42d406b4d0 0x7f42d406d990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f42e80b90a0 tx=0x7f42dc008040 comp rx=0 tx=0).stop 2024-04-25T08:57:42.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 -- 172.21.15.55:0/194847851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42e80cee80 msgr2=0x7f42e815b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42e80cee80 0x7f42e815b6c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f42e0000c00 tx=0x7f42e00046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 -- 172.21.15.55:0/194847851 shutdown_connections 2024-04-25T08:57:42.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f42d406b4d0 0x7f42d406d990 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42e815dca0 0x7f42e815fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42e80d3b90 0x7f42e81f3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 --2- 172.21.15.55:0/194847851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42e80cee80 0x7f42e815b6c0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 -- 172.21.15.55:0/194847851 >> 172.21.15.55:0/194847851 conn(0x7f42e80726c0 msgr2=0x7f42e815d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 -- 172.21.15.55:0/194847851 shutdown_connections 2024-04-25T08:57:42.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.425+0000 7f42effee640 1 -- 172.21.15.55:0/194847851 wait complete. 2024-04-25T08:57:42.425 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T08:57:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.537+0000 7f1db1c1f640 1 Processor -- start 2024-04-25T08:57:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.537+0000 7f1db1c1f640 1 -- start start 2024-04-25T08:57:42.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1db1c1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1dac15ba10 0x7f1dac099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1db1c1f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1dac06c3c0 0x7f1dac0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1db1c1f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dac06c900 con 0x7f1dac099f80 2024-04-25T08:57:42.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1db1c1f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dac0cbe50 con 0x7f1dac15ba10 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1db1c1f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dac09a3d0 con 0x7f1dac06c3c0 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1dab7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1dac15ba10 0x7f1dac099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1daaffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1dac099f80 0x7f1dac06bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42022/0 (socket says 172.21.15.55:42022) 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1dab7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1dac15ba10 0x7f1dac099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48094/0 (socket says 172.21.15.55:48094) 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1daaffd640 1 -- 172.21.15.55:0/2541292099 learned_addr learned my addr 172.21.15.55:0/2541292099 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1dabfff640 1 --2- 172.21.15.55:0/2541292099 >> v2:172.21.15.167:3300/0 conn(0x7f1dac06c3c0 0x7f1dac0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1dab7fe640 1 -- 172.21.15.55:0/2541292099 >> v2:172.21.15.167:3300/0 conn(0x7f1dac06c3c0 msgr2=0x7f1dac0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1dab7fe640 1 --2- 172.21.15.55:0/2541292099 >> v2:172.21.15.167:3300/0 conn(0x7f1dac06c3c0 0x7f1dac0cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1dab7fe640 1 -- 172.21.15.55:0/2541292099 >> v1:172.21.15.55:6789/0 conn(0x7f1dac099f80 legacy=0x7f1dac06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1daa7fc640 1 -- 172.21.15.55:0/2541292099 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039325471 0 0) 0x7f1dac06c900 con 0x7f1dac099f80 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.538+0000 7f1dab7fe640 1 -- 172.21.15.55:0/2541292099 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac06cbe0 con 0x7f1dac15ba10 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.539+0000 7f1dab7fe640 1 --2- 172.21.15.55:0/2541292099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dac15ba10 0x7f1dac099a40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0b7850 tx=0x7f1d9c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eafdab23bbfa4c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.539+0000 7f1daa7fc640 1 -- 172.21.15.55:0/2541292099 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c037070 con 0x7f1dac15ba10 2024-04-25T08:57:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.539+0000 7f1daa7fc640 1 -- 172.21.15.55:0/2541292099 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c032440 con 0x7f1dac15ba10 2024-04-25T08:57:42.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.539+0000 7f1daa7fc640 1 -- 172.21.15.55:0/2541292099 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c032810 con 0x7f1dac15ba10 2024-04-25T08:57:42.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.539+0000 7f1db1c1f640 1 -- 172.21.15.55:0/2541292099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dac15ba10 msgr2=0x7f1dac099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.539+0000 7f1db1c1f640 1 --2- 172.21.15.55:0/2541292099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dac15ba10 0x7f1dac099a40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0b7850 tx=0x7f1d9c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.539+0000 7f1db1c1f640 1 -- 172.21.15.55:0/2541292099 shutdown_connections 2024-04-25T08:57:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.539+0000 7f1db1c1f640 1 --2- 172.21.15.55:0/2541292099 >> v2:172.21.15.167:3300/0 conn(0x7f1dac06c3c0 0x7f1dac0cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.539+0000 7f1db1c1f640 1 --2- 172.21.15.55:0/2541292099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dac15ba10 0x7f1dac099a40 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.539+0000 7f1db1c1f640 1 -- 172.21.15.55:0/2541292099 >> 172.21.15.55:0/2541292099 conn(0x7f1dac0b32f0 msgr2=0x7f1dac0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.540+0000 7f1db1c1f640 1 -- 172.21.15.55:0/2541292099 shutdown_connections 2024-04-25T08:57:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.540+0000 7f1db1c1f640 1 -- 172.21.15.55:0/2541292099 wait complete. 2024-04-25T08:57:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.541+0000 7f1db1c1f640 1 Processor -- start 2024-04-25T08:57:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.541+0000 7f1db1c1f640 1 -- start start 2024-04-25T08:57:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1db1c1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac06c3c0 0x7f1dac159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1db1c1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dac099f80 0x7f1dac0ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1db1c1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dac15ba10 0x7f1dac0b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1db1c1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac0cd760 con 0x7f1dac099f80 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1db1c1f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac0cfe80 con 0x7f1dac06c3c0 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1db1c1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac0cd8e0 con 0x7f1dac15ba10 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1daaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dac099f80 0x7f1dac0ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1daaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dac099f80 0x7f1dac0ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48102/0 (socket says 172.21.15.55:48102) 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1daaffd640 1 -- 172.21.15.55:0/3603719728 learned_addr learned my addr 172.21.15.55:0/3603719728 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1dab7fe640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac06c3c0 0x7f1dac159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1dabfff640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dac15ba10 0x7f1dac0b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1daaffd640 1 -- 172.21.15.55:0/3603719728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dac15ba10 msgr2=0x7f1dac0b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1daaffd640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dac15ba10 0x7f1dac0b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1daaffd640 1 -- 172.21.15.55:0/3603719728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac06c3c0 msgr2=0x7f1dac159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1daaffd640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac06c3c0 0x7f1dac159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1daaffd640 1 -- 172.21.15.55:0/3603719728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac0b5100 con 0x7f1dac099f80 2024-04-25T08:57:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1dabfff640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dac15ba10 0x7f1dac0b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1daaffd640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dac099f80 0x7f1dac0ae8f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1da000c4d0 tx=0x7f1da000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1d93fff640 1 -- 172.21.15.55:0/3603719728 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0018070 con 0x7f1dac099f80 2024-04-25T08:57:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1d93fff640 1 -- 172.21.15.55:0/3603719728 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da0007500 con 0x7f1dac099f80 2024-04-25T08:57:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1db1c1f640 1 -- 172.21.15.55:0/3603719728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac15c810 con 0x7f1dac099f80 2024-04-25T08:57:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1d93fff640 1 -- 172.21.15.55:0/3603719728 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0004a20 con 0x7f1dac099f80 2024-04-25T08:57:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.542+0000 7f1db1c1f640 1 -- 172.21.15.55:0/3603719728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dac15cdd0 con 0x7f1dac099f80 2024-04-25T08:57:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.543+0000 7f1db1c1f640 1 -- 172.21.15.55:0/3603719728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dac0749b0 con 0x7f1dac099f80 2024-04-25T08:57:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.544+0000 7f1d93fff640 1 -- 172.21.15.55:0/3603719728 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1da001b070 con 0x7f1dac099f80 2024-04-25T08:57:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.544+0000 7f1d93fff640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d9806b500 0x7f1d9806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.544+0000 7f1d93fff640 1 -- 172.21.15.55:0/3603719728 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1da0089150 con 0x7f1dac099f80 2024-04-25T08:57:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.544+0000 7f1dab7fe640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d9806b500 0x7f1d9806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.545+0000 7f1dab7fe640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d9806b500 0x7f1d9806d9c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c034000 tx=0x7f1d9c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.549+0000 7f1d93fff640 1 -- 172.21.15.55:0/3603719728 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1da0058360 con 0x7f1dac099f80 2024-04-25T08:57:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:42.799+0000 7f1db1c1f640 1 -- 172.21.15.55:0/3603719728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7f1dac09a570 con 0x7f1dac099f80 2024-04-25T08:57:43.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.805+0000 7f1d93fff640 1 -- 172.21.15.55:0/3603719728 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v212) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1da0057c60 con 0x7f1dac099f80 2024-04-25T08:57:43.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 -- 172.21.15.55:0/3603719728 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d9806b500 msgr2=0x7f1d9806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:43.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d9806b500 0x7f1d9806d9c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c034000 tx=0x7f1d9c02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:43.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 -- 172.21.15.55:0/3603719728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dac099f80 msgr2=0x7f1dac0ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:43.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dac099f80 0x7f1dac0ae8f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1da000c4d0 tx=0x7f1da000c990 comp rx=0 tx=0).stop 2024-04-25T08:57:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 -- 172.21.15.55:0/3603719728 shutdown_connections 2024-04-25T08:57:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d9806b500 0x7f1d9806d9c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dac15ba10 0x7f1dac0b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dac099f80 0x7f1dac0ae8f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 --2- 172.21.15.55:0/3603719728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac06c3c0 0x7f1dac159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 -- 172.21.15.55:0/3603719728 >> 172.21.15.55:0/3603719728 conn(0x7f1dac0b32f0 msgr2=0x7f1dac15acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 -- 172.21.15.55:0/3603719728 shutdown_connections 2024-04-25T08:57:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.808+0000 7f1db1c1f640 1 -- 172.21.15.55:0/3603719728 wait complete. 2024-04-25T08:57:43.811 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:57:43.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.932+0000 7fd451d16640 1 Processor -- start 2024-04-25T08:57:43.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.932+0000 7fd451d16640 1 -- start start 2024-04-25T08:57:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.932+0000 7fd451d16640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0cf510 0x7fd44c0cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.932+0000 7fd451d16640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c0cc830 con 0x7fd44c0cff00 2024-04-25T08:57:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.932+0000 7fd451d16640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c0ccb10 con 0x7fd44c15bbe0 2024-04-25T08:57:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.932+0000 7fd451d16640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0ccdf0 con 0x7fd44c0cf510 2024-04-25T08:57:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd44c0cff00 0x7fd44c0c5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42034/0 (socket says 172.21.15.55:42034) 2024-04-25T08:57:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44bfff640 1 -- 172.21.15.55:0/3122447087 learned_addr learned my addr 172.21.15.55:0/3122447087 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870769136 0 0) 0x7fd44c0cc830 con 0x7fd44c0cff00 2024-04-25T08:57:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44affd640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0cf510 0x7fd44c0cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd434003520 con 0x7fd44c0cff00 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3157039470 0 0) 0x7fd434003520 con 0x7fd44c0cff00 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0cf510 msgr2=0x7fd44c0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0cf510 0x7fd44c0cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 >> v1:172.21.15.167:6789/0 conn(0x7fd44c15bbe0 legacy=0x7fd44c0cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c0cd0d0 con 0x7fd44c0cff00 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fd4440019f0 con 0x7fd44c0cff00 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 >> v1:172.21.15.55:6789/0 conn(0x7fd44c0cff00 legacy=0x7fd44c0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4340039e0 0x7fd434003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd434004800 0x7fd434004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0cf510 0x7fd4340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0ccdf0 con 0x7fd434004800 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43400ba70 con 0x7fd4340039e0 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.933+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43400bc70 con 0x7fd44c0cf510 2024-04-25T08:57:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.934+0000 7fd44affd640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd434004800 0x7fd434004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.934+0000 7fd44b7fe640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4340039e0 0x7fd434003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.934+0000 7fd44bfff640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0cf510 0x7fd4340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.934+0000 7fd44affd640 1 -- 172.21.15.55:0/3122447087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0cf510 msgr2=0x7fd4340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:43.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.934+0000 7fd44affd640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0cf510 0x7fd4340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.934+0000 7fd44affd640 1 -- 172.21.15.55:0/3122447087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4340039e0 msgr2=0x7fd434003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:43.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.934+0000 7fd44affd640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4340039e0 0x7fd434003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.934+0000 7fd44affd640 1 -- 172.21.15.55:0/3122447087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434003520 con 0x7fd434004800 2024-04-25T08:57:43.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.935+0000 7fd44affd640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd434004800 0x7fd434004c80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0cfeb0 tx=0x7fd434005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e1cf0dc23dcf52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:43.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.935+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440036070 con 0x7fd434004800 2024-04-25T08:57:43.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.935+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440031400 con 0x7fd434004800 2024-04-25T08:57:43.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.935+0000 7fd44a7fc640 1 -- 172.21.15.55:0/3122447087 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440009690 con 0x7fd434004800 2024-04-25T08:57:43.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.935+0000 7fd451d16640 1 -- 172.21.15.55:0/3122447087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd434004800 msgr2=0x7fd434004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:43.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.935+0000 7fd451d16640 1 --2- 172.21.15.55:0/3122447087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd434004800 0x7fd434004c80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0cfeb0 tx=0x7fd434005830 comp rx=0 tx=0).stop 2024-04-25T08:57:43.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.935+0000 7fd44bfff640 1 -- 172.21.15.55:0/3122447087 reap_dead start 2024-04-25T08:57:43.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.935+0000 7fd451d16640 1 -- 172.21.15.55:0/3122447087 shutdown_connections 2024-04-25T08:57:43.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.935+0000 7fd451d16640 1 -- 172.21.15.55:0/3122447087 >> 172.21.15.55:0/3122447087 conn(0x7fd44c0b3430 msgr2=0x7fd44c0b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.935+0000 7fd451d16640 1 -- 172.21.15.55:0/3122447087 shutdown_connections 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.935+0000 7fd451d16640 1 -- 172.21.15.55:0/3122447087 wait complete. 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.937+0000 7fd451d16640 1 Processor -- start 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.937+0000 7fd451d16640 1 -- start start 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.937+0000 7fd451d16640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd434004800 0x7fd44c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd451d16640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd44c06f7b0 0x7fd44c06fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd451d16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd44c0ca530 0x7fd44c0ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd451d16640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0cc450 con 0x7fd44c06f7b0 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd451d16640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c15bfc0 con 0x7fd44c0ca530 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd451d16640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0cc5d0 con 0x7fd434004800 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd44c06f7b0 0x7fd44c06fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd44c06f7b0 0x7fd44c06fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48118/0 (socket says 172.21.15.55:48118) 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44affd640 1 -- 172.21.15.55:0/102915749 learned_addr learned my addr 172.21.15.55:0/102915749 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:43.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44b7fe640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd434004800 0x7fd44c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44bfff640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd44c0ca530 0x7fd44c0ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44affd640 1 -- 172.21.15.55:0/102915749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd434004800 msgr2=0x7fd44c155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44affd640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd434004800 0x7fd44c155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44affd640 1 -- 172.21.15.55:0/102915749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd44c0ca530 msgr2=0x7fd44c0ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44affd640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd44c0ca530 0x7fd44c0ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44affd640 1 -- 172.21.15.55:0/102915749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c06bcb0 con 0x7fd44c06f7b0 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44b7fe640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd434004800 0x7fd44c155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44bfff640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd44c0ca530 0x7fd44c0ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd44affd640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd44c06f7b0 0x7fd44c06fc30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd440009b50 tx=0x7fd440004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd433fff640 1 -- 172.21.15.55:0/102915749 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440041020 con 0x7fd44c06f7b0 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd433fff640 1 -- 172.21.15.55:0/102915749 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44003c470 con 0x7fd44c06f7b0 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd451d16640 1 -- 172.21.15.55:0/102915749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c06bf90 con 0x7fd44c06f7b0 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd433fff640 1 -- 172.21.15.55:0/102915749 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440036040 con 0x7fd44c06f7b0 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.938+0000 7fd451d16640 1 -- 172.21.15.55:0/102915749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c06c550 con 0x7fd44c06f7b0 2024-04-25T08:57:43.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.939+0000 7fd451d16640 1 -- 172.21.15.55:0/102915749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c0750b0 con 0x7fd44c06f7b0 2024-04-25T08:57:43.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.940+0000 7fd433fff640 1 -- 172.21.15.55:0/102915749 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd440044020 con 0x7fd44c06f7b0 2024-04-25T08:57:43.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.940+0000 7fd433fff640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd43806b4d0 0x7fd43806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:43.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.940+0000 7fd433fff640 1 -- 172.21.15.55:0/102915749 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd4400a9f10 con 0x7fd44c06f7b0 2024-04-25T08:57:43.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.941+0000 7fd44b7fe640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd43806b4d0 0x7fd43806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:43.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.941+0000 7fd44b7fe640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd43806b4d0 0x7fd43806d990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0036b0 tx=0x7fd43c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:43.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:43.945+0000 7fd433fff640 1 -- 172.21.15.55:0/102915749 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd440079090 con 0x7fd44c06f7b0 2024-04-25T08:57:44.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.125+0000 7fd451d16640 1 -- 172.21.15.55:0/102915749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd44c0b42d0 con 0x7fd44c06f7b0 2024-04-25T08:57:44.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.128+0000 7fd433fff640 1 -- 172.21.15.55:0/102915749 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd440078990 con 0x7fd44c06f7b0 2024-04-25T08:57:44.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 -- 172.21.15.55:0/102915749 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd43806b4d0 msgr2=0x7fd43806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd43806b4d0 0x7fd43806d990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0036b0 tx=0x7fd43c009040 comp rx=0 tx=0).stop 2024-04-25T08:57:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 -- 172.21.15.55:0/102915749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd44c06f7b0 msgr2=0x7fd44c06fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd44c06f7b0 0x7fd44c06fc30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd440009b50 tx=0x7fd440004730 comp rx=0 tx=0).stop 2024-04-25T08:57:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 -- 172.21.15.55:0/102915749 shutdown_connections 2024-04-25T08:57:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd43806b4d0 0x7fd43806d990 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd44c0ca530 0x7fd44c0ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd44c06f7b0 0x7fd44c06fc30 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 --2- 172.21.15.55:0/102915749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd434004800 0x7fd44c155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 -- 172.21.15.55:0/102915749 >> 172.21.15.55:0/102915749 conn(0x7fd44c0b3430 msgr2=0x7fd44c0b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 -- 172.21.15.55:0/102915749 shutdown_connections 2024-04-25T08:57:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.131+0000 7fd451d16640 1 -- 172.21.15.55:0/102915749 wait complete. 2024-04-25T08:57:44.132 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:57:44.132 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:57:44.177 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:57:44.216 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:57:44.216 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:57:44.216 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:44.232 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:57:44.232 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:57:44.232 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:44.274 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:57:44.274 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:57:44.274 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:44.289 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:57:44.290 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:57:44.290 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:57:44.331 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:57:44.331 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:57:44.332 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:44.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.444+0000 7fcb4d409640 1 Processor -- start 2024-04-25T08:57:44.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.444+0000 7fcb4d409640 1 -- start start 2024-04-25T08:57:44.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb4d409640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb4815bf00 0x7fcb480cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb4d409640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb4806e8f0 0x7fcb481654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb4d409640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb480ce6c0 con 0x7fcb480cc310 2024-04-25T08:57:44.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb4d409640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb481455e0 con 0x7fcb4815bf00 2024-04-25T08:57:44.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb4d409640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4806d450 con 0x7fcb4806e8f0 2024-04-25T08:57:44.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb46ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb4815bf00 0x7fcb480cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:44.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb46ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb4815bf00 0x7fcb480cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48122/0 (socket says 172.21.15.55:48122) 2024-04-25T08:57:44.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb46ffd640 1 -- 172.21.15.55:0/3716690579 learned_addr learned my addr 172.21.15.55:0/3716690579 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:44.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb477fe640 1 --2- 172.21.15.55:0/3716690579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb4806e8f0 0x7fcb481654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:44.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb46ffd640 1 -- 172.21.15.55:0/3716690579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb4806e8f0 msgr2=0x7fcb481654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:44.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb46ffd640 1 --2- 172.21.15.55:0/3716690579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb4806e8f0 0x7fcb481654b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb46ffd640 1 -- 172.21.15.55:0/3716690579 >> v1:172.21.15.167:6789/0 conn(0x7fcb480cc310 legacy=0x7fcb4815c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:44.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.445+0000 7fcb46ffd640 1 -- 172.21.15.55:0/3716690579 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480cc7b0 con 0x7fcb4815bf00 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.446+0000 7fcb46ffd640 1 --2- 172.21.15.55:0/3716690579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb4815bf00 0x7fcb480cbdd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009870 tx=0x7fcb3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91f2c3056a2108a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.446+0000 7fcb467fc640 1 -- 172.21.15.55:0/3716690579 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38037070 con 0x7fcb4815bf00 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.446+0000 7fcb467fc640 1 -- 172.21.15.55:0/3716690579 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb38032440 con 0x7fcb4815bf00 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.446+0000 7fcb467fc640 1 -- 172.21.15.55:0/3716690579 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38032810 con 0x7fcb4815bf00 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.447+0000 7fcb4d409640 1 -- 172.21.15.55:0/3716690579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb4815bf00 msgr2=0x7fcb480cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.447+0000 7fcb4d409640 1 --2- 172.21.15.55:0/3716690579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb4815bf00 0x7fcb480cbdd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009870 tx=0x7fcb3802a270 comp rx=0 tx=0).stop 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.447+0000 7fcb4d409640 1 -- 172.21.15.55:0/3716690579 shutdown_connections 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.447+0000 7fcb4d409640 1 --2- 172.21.15.55:0/3716690579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb4806e8f0 0x7fcb481654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.447+0000 7fcb4d409640 1 --2- 172.21.15.55:0/3716690579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb4815bf00 0x7fcb480cbdd0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.447+0000 7fcb4d409640 1 -- 172.21.15.55:0/3716690579 >> 172.21.15.55:0/3716690579 conn(0x7fcb4806aba0 msgr2=0x7fcb4806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.447+0000 7fcb4d409640 1 -- 172.21.15.55:0/3716690579 shutdown_connections 2024-04-25T08:57:44.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.447+0000 7fcb4d409640 1 -- 172.21.15.55:0/3716690579 wait complete. 2024-04-25T08:57:44.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.448+0000 7fcb4d409640 1 Processor -- start 2024-04-25T08:57:44.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.448+0000 7fcb4d409640 1 -- start start 2024-04-25T08:57:44.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb4d409640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb4806e8f0 0x7fcb4813eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb4d409640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb480cc310 0x7fcb4813ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb4d409640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb4815bf00 0x7fcb48140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb4d409640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480cd050 con 0x7fcb480cc310 2024-04-25T08:57:44.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb4d409640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480ccd70 con 0x7fcb4815bf00 2024-04-25T08:57:44.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb4d409640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4806ee60 con 0x7fcb4806e8f0 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb3ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb480cc310 0x7fcb4813ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb3ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb480cc310 0x7fcb4813ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48126/0 (socket says 172.21.15.55:48126) 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb3ffff640 1 -- 172.21.15.55:0/1495633969 learned_addr learned my addr 172.21.15.55:0/1495633969 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb477fe640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb4815bf00 0x7fcb48140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb46ffd640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb4806e8f0 0x7fcb4813eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb3ffff640 1 -- 172.21.15.55:0/1495633969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb4806e8f0 msgr2=0x7fcb4813eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb3ffff640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb4806e8f0 0x7fcb4813eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb3ffff640 1 -- 172.21.15.55:0/1495633969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb4815bf00 msgr2=0x7fcb48140500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb3ffff640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb4815bf00 0x7fcb48140500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb3ffff640 1 -- 172.21.15.55:0/1495633969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb48156bf0 con 0x7fcb480cc310 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb46ffd640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb4806e8f0 0x7fcb4813eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb477fe640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb4815bf00 0x7fcb48140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb3ffff640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb480cc310 0x7fcb4813ae50 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000c440 tx=0x7fcb30001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.449+0000 7fcb3f7fe640 1 -- 172.21.15.55:0/1495633969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300052d0 con 0x7fcb480cc310 2024-04-25T08:57:44.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.450+0000 7fcb3f7fe640 1 -- 172.21.15.55:0/1495633969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb30005470 con 0x7fcb480cc310 2024-04-25T08:57:44.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.450+0000 7fcb3f7fe640 1 -- 172.21.15.55:0/1495633969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30007260 con 0x7fcb480cc310 2024-04-25T08:57:44.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.450+0000 7fcb4d409640 1 -- 172.21.15.55:0/1495633969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb481598f0 con 0x7fcb480cc310 2024-04-25T08:57:44.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.450+0000 7fcb4d409640 1 -- 172.21.15.55:0/1495633969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb48156e90 con 0x7fcb480cc310 2024-04-25T08:57:44.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.451+0000 7fcb4d409640 1 -- 172.21.15.55:0/1495633969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4806bb30 con 0x7fcb480cc310 2024-04-25T08:57:44.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.451+0000 7fcb3f7fe640 1 -- 172.21.15.55:0/1495633969 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb30007400 con 0x7fcb480cc310 2024-04-25T08:57:44.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.451+0000 7fcb3f7fe640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb2806b4d0 0x7fcb2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.451+0000 7fcb3f7fe640 1 -- 172.21.15.55:0/1495633969 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcb300893b0 con 0x7fcb480cc310 2024-04-25T08:57:44.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.451+0000 7fcb46ffd640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb2806b4d0 0x7fcb2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:44.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.452+0000 7fcb46ffd640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb2806b4d0 0x7fcb2806d990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb38034000 tx=0x7fcb3802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:44.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.456+0000 7fcb3f7fe640 1 -- 172.21.15.55:0/1495633969 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcb480ce6c0 con 0x7fcb480cc310 2024-04-25T08:57:44.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.675+0000 7fcb4d409640 1 -- 172.21.15.55:0/1495633969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb480749b0 con 0x7fcb480cc310 2024-04-25T08:57:44.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.675+0000 7fcb3f7fe640 1 -- 172.21.15.55:0/1495633969 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fcb300585c0 con 0x7fcb480cc310 2024-04-25T08:57:44.665 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:44.665 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1092467772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1092467772},{"type":"v1","addr":"172.21.15.167:6834","nonce":1092467772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/651597245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":651597245},{"type":"v1","addr":"172.21.15.55:6837","nonce":651597245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3980280949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3980280949},{"type":"v1","addr":"172.21.15.55:6836","nonce":3980280949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6073,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2926083655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2926083655},{"type":"v1","addr":"172.21.15.167:6835","nonce":2926083655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[]} 2024-04-25T08:57:44.665 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 -- 172.21.15.55:0/1495633969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb2806b4d0 msgr2=0x7fcb2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb2806b4d0 0x7fcb2806d990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb38034000 tx=0x7fcb3802e000 comp rx=0 tx=0).stop 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 -- 172.21.15.55:0/1495633969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb480cc310 msgr2=0x7fcb4813ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb480cc310 0x7fcb4813ae50 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000c440 tx=0x7fcb30001e70 comp rx=0 tx=0).stop 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 -- 172.21.15.55:0/1495633969 shutdown_connections 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcb2806b4d0 0x7fcb2806d990 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb4815bf00 0x7fcb48140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb480cc310 0x7fcb4813ae50 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 --2- 172.21.15.55:0/1495633969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb4806e8f0 0x7fcb4813eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 -- 172.21.15.55:0/1495633969 >> 172.21.15.55:0/1495633969 conn(0x7fcb4806aba0 msgr2=0x7fcb48143b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 -- 172.21.15.55:0/1495633969 shutdown_connections 2024-04-25T08:57:44.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.677+0000 7fcb4d409640 1 -- 172.21.15.55:0/1495633969 wait complete. 2024-04-25T08:57:44.677 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:57:44.678 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:57:44.678 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:57:44.678 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:57:44.678 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:57:44.678 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:57:44.678 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:57:44.678 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:57:44.679 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:57:44.679 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:57:44.679 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:57:44.679 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:57:44.679 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:57:44.679 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:57:44.679 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:57:44.680 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:57:44.688 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:57:44.688 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:57:44.689 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:57:44.689 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:57:44.696 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:57:44.696 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:57:44.697 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:57:44.697 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:57:44.730 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:57:44.731 DEBUG:teuthology.parallel:result is None 2024-04-25T08:57:44.731 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:57:44.731 DEBUG:teuthology.parallel:result is None 2024-04-25T08:57:44.739 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:57:44.739 DEBUG:teuthology.parallel:result is None 2024-04-25T08:57:44.740 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:57:44.740 DEBUG:teuthology.parallel:result is None 2024-04-25T08:57:44.740 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:57:44.807 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-25T08:57:44.807 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T08:57:44.818 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T08:57:44.818 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T08:57:44.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.856+0000 7f40fc66f640 1 Processor -- start 2024-04-25T08:57:44.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.856+0000 7f40fc66f640 1 -- start start 2024-04-25T08:57:44.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fc66f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40f40b5c80 0x7f40f415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fc66f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40f40d3580 0x7f40f4161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fc66f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f40b9980 con 0x7f40f415dbe0 2024-04-25T08:57:44.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fc66f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f415f210 con 0x7f40f40d3580 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fc66f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40ce140 con 0x7f40f40b5c80 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fa40b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f40f415dbe0 0x7f40f40b5570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42048/0 (socket says 172.21.15.55:42048) 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fa40b640 1 -- 172.21.15.55:0/2657137565 learned_addr learned my addr 172.21.15.55:0/2657137565 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fac0c640 1 --2- 172.21.15.55:0/2657137565 >> v2:172.21.15.55:3300/0 conn(0x7f40f40d3580 0x7f40f4161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40f9c0a640 1 --2- 172.21.15.55:0/2657137565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40f40b5c80 0x7f40f415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40f9409640 1 -- 172.21.15.55:0/2657137565 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101271524 0 0) 0x7f40f40b9980 con 0x7f40f415dbe0 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40f9409640 1 -- 172.21.15.55:0/2657137565 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40e0003520 con 0x7f40f415dbe0 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fac0c640 1 -- 172.21.15.55:0/2657137565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40f40b5c80 msgr2=0x7f40f415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fac0c640 1 --2- 172.21.15.55:0/2657137565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40f40b5c80 0x7f40f415ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fac0c640 1 -- 172.21.15.55:0/2657137565 >> v1:172.21.15.55:6789/0 conn(0x7f40f415dbe0 legacy=0x7f40f40b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.858+0000 7f40fac0c640 1 -- 172.21.15.55:0/2657137565 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40ce420 con 0x7f40f40d3580 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.859+0000 7f40fac0c640 1 --2- 172.21.15.55:0/2657137565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f40d3580 0x7f40f4161800 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009d90 tx=0x7f40ec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac03aabd99984e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.859+0000 7f40f9409640 1 -- 172.21.15.55:0/2657137565 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec007740 con 0x7f40f40d3580 2024-04-25T08:57:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.859+0000 7f40f9409640 1 -- 172.21.15.55:0/2657137565 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ec0078e0 con 0x7f40f40d3580 2024-04-25T08:57:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.859+0000 7f40f9409640 1 -- 172.21.15.55:0/2657137565 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec007cb0 con 0x7f40f40d3580 2024-04-25T08:57:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.860+0000 7f40fc66f640 1 -- 172.21.15.55:0/2657137565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f40d3580 msgr2=0x7f40f4161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.860+0000 7f40fc66f640 1 --2- 172.21.15.55:0/2657137565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f40d3580 0x7f40f4161800 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009d90 tx=0x7f40ec02a660 comp rx=0 tx=0).stop 2024-04-25T08:57:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.860+0000 7f40fc66f640 1 -- 172.21.15.55:0/2657137565 shutdown_connections 2024-04-25T08:57:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.860+0000 7f40fc66f640 1 --2- 172.21.15.55:0/2657137565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40f40b5c80 0x7f40f415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.860+0000 7f40fc66f640 1 --2- 172.21.15.55:0/2657137565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f40d3580 0x7f40f4161800 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.860+0000 7f40fc66f640 1 -- 172.21.15.55:0/2657137565 >> 172.21.15.55:0/2657137565 conn(0x7f40f4072900 msgr2=0x7f40f40d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.860+0000 7f40fc66f640 1 -- 172.21.15.55:0/2657137565 shutdown_connections 2024-04-25T08:57:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.860+0000 7f40fc66f640 1 -- 172.21.15.55:0/2657137565 wait complete. 2024-04-25T08:57:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.861+0000 7f40fc66f640 1 Processor -- start 2024-04-25T08:57:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.861+0000 7f40fc66f640 1 -- start start 2024-04-25T08:57:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fc66f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f40b5c80 0x7f40f41f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fc66f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40f40d3580 0x7f40f4157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fc66f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f415dbe0 0x7f40f415a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fc66f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f415dfc0 con 0x7f40f40b5c80 2024-04-25T08:57:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fc66f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40d3060 con 0x7f40f415dbe0 2024-04-25T08:57:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fc66f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f415e140 con 0x7f40f40d3580 2024-04-25T08:57:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fa40b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f40b5c80 0x7f40f41f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fa40b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f40b5c80 0x7f40f41f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48166/0 (socket says 172.21.15.55:48166) 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fa40b640 1 -- 172.21.15.55:0/147550636 learned_addr learned my addr 172.21.15.55:0/147550636 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fa40b640 1 -- 172.21.15.55:0/147550636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40f40d3580 msgr2=0x7f40f4157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fa40b640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40f40d3580 0x7f40f4157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fa40b640 1 -- 172.21.15.55:0/147550636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f415dbe0 msgr2=0x7f40f415a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fa40b640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f415dbe0 0x7f40f415a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fa40b640 1 -- 172.21.15.55:0/147550636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40cda00 con 0x7f40f40b5c80 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fa40b640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f40b5c80 0x7f40f41f35e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c410 tx=0x7f40f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40eaffd640 1 -- 172.21.15.55:0/147550636 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0017070 con 0x7f40f40b5c80 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40eaffd640 1 -- 172.21.15.55:0/147550636 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f0005ce0 con 0x7f40f40b5c80 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fc66f640 1 -- 172.21.15.55:0/147550636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f41f6e70 con 0x7f40f40b5c80 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40eaffd640 1 -- 172.21.15.55:0/147550636 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00072f0 con 0x7f40f40b5c80 2024-04-25T08:57:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.862+0000 7f40fc66f640 1 -- 172.21.15.55:0/147550636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f40cd720 con 0x7f40f40b5c80 2024-04-25T08:57:44.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.864+0000 7f40fc66f640 1 -- 172.21.15.55:0/147550636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f40750b0 con 0x7f40f40b5c80 2024-04-25T08:57:44.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.864+0000 7f40eaffd640 1 -- 172.21.15.55:0/147550636 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f40f001a070 con 0x7f40f40b5c80 2024-04-25T08:57:44.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.864+0000 7f40eaffd640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f40d806b4d0 0x7f40d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:44.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.865+0000 7f40eaffd640 1 -- 172.21.15.55:0/147550636 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f40f0089290 con 0x7f40f40b5c80 2024-04-25T08:57:44.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.865+0000 7f40f9c0a640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f40d806b4d0 0x7f40d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:44.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.865+0000 7f40f9c0a640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f40d806b4d0 0x7f40d806d990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f40e4006a90 tx=0x7f40e4006a20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:44.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:44.869+0000 7f40eaffd640 1 -- 172.21.15.55:0/147550636 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f40f0058560 con 0x7f40f40b5c80 2024-04-25T08:57:45.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:45.061+0000 7f40fc66f640 1 -- 172.21.15.55:0/147550636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f40f40d1790 con 0x7f40f40b5c80 2024-04-25T08:57:46.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.164+0000 7f40eaffd640 1 -- 172.21.15.55:0/147550636 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) v1 ==== 97+0+0 (secure 0 0 0) 0x7f40f0057e60 con 0x7f40f40b5c80 2024-04-25T08:57:46.154 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 -- 172.21.15.55:0/147550636 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f40d806b4d0 msgr2=0x7f40d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f40d806b4d0 0x7f40d806d990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f40e4006a90 tx=0x7f40e4006a20 comp rx=0 tx=0).stop 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 -- 172.21.15.55:0/147550636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f40b5c80 msgr2=0x7f40f41f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f40b5c80 0x7f40f41f35e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c410 tx=0x7f40f000c8d0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 -- 172.21.15.55:0/147550636 shutdown_connections 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f40d806b4d0 0x7f40d806d990 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f415dbe0 0x7f40f415a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40f40d3580 0x7f40f4157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 --2- 172.21.15.55:0/147550636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f40b5c80 0x7f40f41f35e0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 -- 172.21.15.55:0/147550636 >> 172.21.15.55:0/147550636 conn(0x7f40f4072900 msgr2=0x7f40f4160cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 -- 172.21.15.55:0/147550636 shutdown_connections 2024-04-25T08:57:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.167+0000 7f40fc66f640 1 -- 172.21.15.55:0/147550636 wait complete. 2024-04-25T08:57:46.169 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:57:46.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.283+0000 7f315e8bd640 1 Processor -- start 2024-04-25T08:57:46.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.283+0000 7f315e8bd640 1 -- start start 2024-04-25T08:57:46.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.284+0000 7f315e8bd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31580b5b60 0x7f31581687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.284+0000 7f315e8bd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315815e0c0 con 0x7f315815dce0 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.284+0000 7f315e8bd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31580d2510 con 0x7f31580d35b0 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.284+0000 7f315e8bd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580b7b10 con 0x7f31580b5b60 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.284+0000 7f3157fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f315815dce0 0x7f31580d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42062/0 (socket says 172.21.15.55:42062) 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.284+0000 7f3157fff640 1 -- 172.21.15.55:0/3963273607 learned_addr learned my addr 172.21.15.55:0/3963273607 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f315ce5a640 1 --2- 172.21.15.55:0/3963273607 >> v2:172.21.15.167:3300/0 conn(0x7f31580b5b60 0x7f31581687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438858596 0 0) 0x7f315815e0c0 con 0x7f315815dce0 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3140003520 con 0x7f315815dce0 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913233813 0 0) 0x7f31580d2510 con 0x7f31580d35b0 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f315815e0c0 con 0x7f31580d35b0 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 975573958 0 0) 0x7f3140003520 con 0x7f315815dce0 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 >> v2:172.21.15.167:3300/0 conn(0x7f31580b5b60 msgr2=0x7f31581687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 --2- 172.21.15.55:0/3963273607 >> v2:172.21.15.167:3300/0 conn(0x7f31580b5b60 0x7f31581687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 >> v1:172.21.15.167:6789/0 conn(0x7f31580d35b0 legacy=0x7f31580b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31580d27f0 con 0x7f315815dce0 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f3148001670 con 0x7f315815dce0 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 >> v1:172.21.15.55:6789/0 conn(0x7f315815dce0 legacy=0x7f31580d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 --2- 172.21.15.55:0/3963273607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3140003b40 0x7f3140003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 --2- 172.21.15.55:0/3963273607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3140004800 0x7f3140004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 --2- 172.21.15.55:0/3963273607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 0x7f314000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b7b10 con 0x7f31400051c0 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314000c040 con 0x7f3140003b40 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314000c240 con 0x7f3140004800 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f315ce5a640 1 --2- 172.21.15.55:0/3963273607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 0x7f314000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f3157fff640 1 --2- 172.21.15.55:0/3963273607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3140003b40 0x7f3140003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f31577fe640 1 --2- 172.21.15.55:0/3963273607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3140004800 0x7f3140004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f315ce5a640 1 -- 172.21.15.55:0/3963273607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3140004800 msgr2=0x7f3140004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f315ce5a640 1 --2- 172.21.15.55:0/3963273607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3140004800 0x7f3140004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.285+0000 7f315ce5a640 1 -- 172.21.15.55:0/3963273607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3140003b40 msgr2=0x7f3140003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.286+0000 7f315ce5a640 1 --2- 172.21.15.55:0/3963273607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3140003b40 0x7f3140003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.286+0000 7f315ce5a640 1 -- 172.21.15.55:0/3963273607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3140003520 con 0x7f31400051c0 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.286+0000 7f315ce5a640 1 -- 172.21.15.55:0/3963273607 reap_dead start 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.286+0000 7f315ce5a640 1 --2- 172.21.15.55:0/3963273607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 0x7f314000b9c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3150009fc0 tx=0x7f3140005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46940bfb28ee368c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.286+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150035020 con 0x7f31400051c0 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.286+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3150003bd0 con 0x7f31400051c0 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.286+0000 7f3156ffd640 1 -- 172.21.15.55:0/3963273607 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150009c10 con 0x7f31400051c0 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.287+0000 7f315e8bd640 1 -- 172.21.15.55:0/3963273607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 msgr2=0x7f314000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.287+0000 7f315e8bd640 1 --2- 172.21.15.55:0/3963273607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 0x7f314000b9c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3150009fc0 tx=0x7f3140005830 comp rx=0 tx=0).stop 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.287+0000 7f315e8bd640 1 -- 172.21.15.55:0/3963273607 shutdown_connections 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.287+0000 7f315e8bd640 1 --2- 172.21.15.55:0/3963273607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 0x7f314000b9c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.287+0000 7f315e8bd640 1 -- 172.21.15.55:0/3963273607 >> 172.21.15.55:0/3963273607 conn(0x7f3158072900 msgr2=0x7f31580d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.287+0000 7f315e8bd640 1 -- 172.21.15.55:0/3963273607 shutdown_connections 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.287+0000 7f315e8bd640 1 -- 172.21.15.55:0/3963273607 wait complete. 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.288+0000 7f315e8bd640 1 Processor -- start 2024-04-25T08:57:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.288+0000 7f315e8bd640 1 -- start start 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f315e8bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 0x7f315815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f315e8bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f315815e2b0 0x7f3158153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f315e8bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31580cc030 0x7f31580cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f315e8bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580d3090 con 0x7f31400051c0 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f315e8bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580d2db0 con 0x7f315815e2b0 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f315e8bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b9820 con 0x7f31580cc030 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f3157fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 0x7f315815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f3157fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 0x7f315815a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48192/0 (socket says 172.21.15.55:48192) 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f3157fff640 1 -- 172.21.15.55:0/1593186365 learned_addr learned my addr 172.21.15.55:0/1593186365 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f31577fe640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f315815e2b0 0x7f3158153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f315ce5a640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31580cc030 0x7f31580cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f3157fff640 1 -- 172.21.15.55:0/1593186365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31580cc030 msgr2=0x7f31580cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f3157fff640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31580cc030 0x7f31580cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f3157fff640 1 -- 172.21.15.55:0/1593186365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f315815e2b0 msgr2=0x7f3158153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f3157fff640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f315815e2b0 0x7f3158153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.289+0000 7f3157fff640 1 -- 172.21.15.55:0/1593186365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315815f2c0 con 0x7f31400051c0 2024-04-25T08:57:46.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.290+0000 7f3157fff640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 0x7f315815a680 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3148007340 tx=0x7f3148007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:46.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.290+0000 7f3154ff9640 1 -- 172.21.15.55:0/1593186365 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800f860 con 0x7f31400051c0 2024-04-25T08:57:46.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.290+0000 7f3154ff9640 1 -- 172.21.15.55:0/1593186365 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3148018070 con 0x7f31400051c0 2024-04-25T08:57:46.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.290+0000 7f315e8bd640 1 -- 172.21.15.55:0/1593186365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315815f860 con 0x7f31400051c0 2024-04-25T08:57:46.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.290+0000 7f3154ff9640 1 -- 172.21.15.55:0/1593186365 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800fc60 con 0x7f31400051c0 2024-04-25T08:57:46.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.290+0000 7f315e8bd640 1 -- 172.21.15.55:0/1593186365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315815ed00 con 0x7f31400051c0 2024-04-25T08:57:46.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.291+0000 7f315e8bd640 1 -- 172.21.15.55:0/1593186365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31580749b0 con 0x7f31400051c0 2024-04-25T08:57:46.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.291+0000 7f3154ff9640 1 -- 172.21.15.55:0/1593186365 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f314801d460 con 0x7f31400051c0 2024-04-25T08:57:46.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.292+0000 7f3154ff9640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f314406b4d0 0x7f314406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.292+0000 7f3154ff9640 1 -- 172.21.15.55:0/1593186365 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3148089e60 con 0x7f31400051c0 2024-04-25T08:57:46.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.292+0000 7f31577fe640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f314406b4d0 0x7f314406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.292+0000 7f31577fe640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f314406b4d0 0x7f314406d990 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f314c000c00 tx=0x7f314c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:46.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.296+0000 7f3154ff9640 1 -- 172.21.15.55:0/1593186365 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f31480590c0 con 0x7f31400051c0 2024-04-25T08:57:46.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.546+0000 7f315e8bd640 1 -- 172.21.15.55:0/1593186365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f315815fa30 con 0x7f31400051c0 2024-04-25T08:57:46.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.546+0000 7f3154ff9640 1 -- 172.21.15.55:0/1593186365 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f31480589c0 con 0x7f31400051c0 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm4IxeGBAAwuzfw8fkgBWLS/OHkVRPdA==", 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.536 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmz17MIxAAOjfHLP2pVtyOH1KkaFBdpw==", 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcJlOHxAAWRBqx21VaZdp7n+bG6QdjA==", 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:57:46.537 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmbKyTKhAARg7pgR8TeZKNHV38FuAv+g==", 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.538 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDgGSpmMDqwHRAAte7ZpF14thK4VEsC4getWg==", 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDjGSpm7bEhHRAALQKewGfpKljGFsW75+h/Dg==", 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:57:46.539 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDmGSpmjg2RHBAA+DxXqJHuPIGUsVvwUirEwg==", 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDpGSpmxft1HBAAsIYtKh97QF4WhdL9kI2QeA==", 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.540 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDvGSpm4QDFIRAAlMSvRI/gNR4p8BgQdRUcBA==", 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-25T08:57:46.541 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyGSpmARfiHxAABn3CWZTkyRxXpTUxKGi71A==", 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1GSpmLHBmHRAA4xXuyYK95pq8g+DAXREvKQ==", 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:46.542 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4GSpmMbpPGxAAP7YWBUzcafaowcZG1ZWhDA==", 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.543 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw==", 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcP0TNxAA02w2xuYx7fMlMbZpgy53hQ==", 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:57:46.544 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmpD8INBAA29l06IV/RnM5qxOD6VL3MA==", 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDaGSpm8xftABAADCQqbD2gknLM2w+MV/H29A==", 2024-04-25T08:57:46.545 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDYGSpmHI4oORAAQoQL0ylKsbBRG+EldcMd4g==", 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:57:46.546 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmk2Q/FRAAwGHbq7UsFI+OdwcBOqLnlA==", 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm6NfaERAAtb5ZheEavSDdOCOxeM0a2Q==", 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:57:46.547 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:57:46.548 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T08:57:46.548 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:57:46.548 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.548 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:46.548 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-25T08:57:46.548 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:57:46.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 -- 172.21.15.55:0/1593186365 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f314406b4d0 msgr2=0x7f314406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f314406b4d0 0x7f314406d990 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f314c000c00 tx=0x7f314c009040 comp rx=0 tx=0).stop 2024-04-25T08:57:46.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 -- 172.21.15.55:0/1593186365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 msgr2=0x7f315815a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 0x7f315815a680 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3148007340 tx=0x7f3148007800 comp rx=0 tx=0).stop 2024-04-25T08:57:46.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 -- 172.21.15.55:0/1593186365 shutdown_connections 2024-04-25T08:57:46.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f314406b4d0 0x7f314406d990 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31580cc030 0x7f31580cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f315815e2b0 0x7f3158153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 --2- 172.21.15.55:0/1593186365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31400051c0 0x7f315815a680 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 -- 172.21.15.55:0/1593186365 >> 172.21.15.55:0/1593186365 conn(0x7f3158072900 msgr2=0x7f31580d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:46.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 -- 172.21.15.55:0/1593186365 shutdown_connections 2024-04-25T08:57:46.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.548+0000 7f315e8bd640 1 -- 172.21.15.55:0/1593186365 wait complete. 2024-04-25T08:57:46.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:46.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.664+0000 7fc39ad6a640 1 Processor -- start 2024-04-25T08:57:46.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.664+0000 7fc39ad6a640 1 -- start start 2024-04-25T08:57:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc39ad6a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc39415dce0 0x7fc3940d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc39ad6a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc3940d35b0 0x7fc3940b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc39ad6a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39415e0c0 con 0x7fc3940d1f90 2024-04-25T08:57:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc39ad6a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940b7b10 con 0x7fc3940d35b0 2024-04-25T08:57:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc39ad6a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940d2510 con 0x7fc39415dce0 2024-04-25T08:57:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc399307640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc3940d1f90 0x7fc39406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42072/0 (socket says 172.21.15.55:42072) 2024-04-25T08:57:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc399307640 1 -- 172.21.15.55:0/822390858 learned_addr learned my addr 172.21.15.55:0/822390858 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc398b06640 1 --2- 172.21.15.55:0/822390858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc39415dce0 0x7fc3940d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc38bfff640 1 --2- 172.21.15.55:0/822390858 >> v2:172.21.15.167:3300/0 conn(0x7fc3940d35b0 0x7fc3940b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc38b7fe640 1 -- 172.21.15.55:0/822390858 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263447009 0 0) 0x7fc39415e0c0 con 0x7fc3940d1f90 2024-04-25T08:57:46.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc38b7fe640 1 -- 172.21.15.55:0/822390858 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc37c003520 con 0x7fc3940d1f90 2024-04-25T08:57:46.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc398b06640 1 -- 172.21.15.55:0/822390858 >> v2:172.21.15.167:3300/0 conn(0x7fc3940d35b0 msgr2=0x7fc3940b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:46.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc398b06640 1 --2- 172.21.15.55:0/822390858 >> v2:172.21.15.167:3300/0 conn(0x7fc3940d35b0 0x7fc3940b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc398b06640 1 -- 172.21.15.55:0/822390858 >> v1:172.21.15.55:6789/0 conn(0x7fc3940d1f90 legacy=0x7fc39406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc398b06640 1 -- 172.21.15.55:0/822390858 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3940d27f0 con 0x7fc39415dce0 2024-04-25T08:57:46.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.665+0000 7fc38bfff640 1 --2- 172.21.15.55:0/822390858 >> v2:172.21.15.167:3300/0 conn(0x7fc3940d35b0 0x7fc3940b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:46.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.666+0000 7fc398b06640 1 --2- 172.21.15.55:0/822390858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc39415dce0 0x7fc3940d1a50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc3900097a0 tx=0x7fc39002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b5ad682e4086f2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:46.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.666+0000 7fc38b7fe640 1 -- 172.21.15.55:0/822390858 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390037070 con 0x7fc39415dce0 2024-04-25T08:57:46.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.666+0000 7fc38b7fe640 1 -- 172.21.15.55:0/822390858 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39002ae50 con 0x7fc39415dce0 2024-04-25T08:57:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.666+0000 7fc38b7fe640 1 -- 172.21.15.55:0/822390858 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390032640 con 0x7fc39415dce0 2024-04-25T08:57:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.667+0000 7fc39ad6a640 1 -- 172.21.15.55:0/822390858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc39415dce0 msgr2=0x7fc3940d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.667+0000 7fc39ad6a640 1 --2- 172.21.15.55:0/822390858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc39415dce0 0x7fc3940d1a50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc3900097a0 tx=0x7fc39002a100 comp rx=0 tx=0).stop 2024-04-25T08:57:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.667+0000 7fc39ad6a640 1 -- 172.21.15.55:0/822390858 shutdown_connections 2024-04-25T08:57:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.667+0000 7fc39ad6a640 1 --2- 172.21.15.55:0/822390858 >> v2:172.21.15.167:3300/0 conn(0x7fc3940d35b0 0x7fc3940b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.667+0000 7fc39ad6a640 1 --2- 172.21.15.55:0/822390858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc39415dce0 0x7fc3940d1a50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.667+0000 7fc39ad6a640 1 -- 172.21.15.55:0/822390858 >> 172.21.15.55:0/822390858 conn(0x7fc394072900 msgr2=0x7fc3940d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.667+0000 7fc39ad6a640 1 -- 172.21.15.55:0/822390858 shutdown_connections 2024-04-25T08:57:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.667+0000 7fc39ad6a640 1 -- 172.21.15.55:0/822390858 wait complete. 2024-04-25T08:57:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.668+0000 7fc39ad6a640 1 Processor -- start 2024-04-25T08:57:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.668+0000 7fc39ad6a640 1 -- start start 2024-04-25T08:57:46.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc39ad6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3940d1f90 0x7fc394152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc39ad6a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3940d35b0 0x7fc3940c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc39ad6a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc39415dce0 0x7fc3941f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc39ad6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940d3090 con 0x7fc3940d1f90 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc39ad6a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940d2db0 con 0x7fc3940d35b0 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc39ad6a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940b9820 con 0x7fc39415dce0 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc398b06640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3940d1f90 0x7fc394152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc398b06640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3940d1f90 0x7fc394152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48196/0 (socket says 172.21.15.55:48196) 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc398b06640 1 -- 172.21.15.55:0/4070039839 learned_addr learned my addr 172.21.15.55:0/4070039839 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc38bfff640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3940d35b0 0x7fc3940c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc399307640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc39415dce0 0x7fc3941f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc398b06640 1 -- 172.21.15.55:0/4070039839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc39415dce0 msgr2=0x7fc3941f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc398b06640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc39415dce0 0x7fc3941f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc398b06640 1 -- 172.21.15.55:0/4070039839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3940d35b0 msgr2=0x7fc3940c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc398b06640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3940d35b0 0x7fc3940c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.669+0000 7fc398b06640 1 -- 172.21.15.55:0/4070039839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3940c7500 con 0x7fc3940d1f90 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.670+0000 7fc398b06640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3940d1f90 0x7fc394152a10 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc39002a140 tx=0x7fc3900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:46.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.670+0000 7fc3897fa640 1 -- 172.21.15.55:0/4070039839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390041070 con 0x7fc3940d1f90 2024-04-25T08:57:46.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.670+0000 7fc3897fa640 1 -- 172.21.15.55:0/4070039839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39003c460 con 0x7fc3940d1f90 2024-04-25T08:57:46.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.670+0000 7fc39ad6a640 1 -- 172.21.15.55:0/4070039839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3940c77a0 con 0x7fc3940d1f90 2024-04-25T08:57:46.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.670+0000 7fc3897fa640 1 -- 172.21.15.55:0/4070039839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390037040 con 0x7fc3940d1f90 2024-04-25T08:57:46.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.670+0000 7fc39ad6a640 1 -- 172.21.15.55:0/4070039839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3940c7d60 con 0x7fc3940d1f90 2024-04-25T08:57:46.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.671+0000 7fc39ad6a640 1 -- 172.21.15.55:0/4070039839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3940b30e0 con 0x7fc3940d1f90 2024-04-25T08:57:46.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.671+0000 7fc3897fa640 1 -- 172.21.15.55:0/4070039839 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc390044070 con 0x7fc3940d1f90 2024-04-25T08:57:46.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.672+0000 7fc3897fa640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc38006b500 0x7fc38006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.672+0000 7fc38bfff640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc38006b500 0x7fc38006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.672+0000 7fc3897fa640 1 -- 172.21.15.55:0/4070039839 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc3900aa520 con 0x7fc3940d1f90 2024-04-25T08:57:46.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.672+0000 7fc38bfff640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc38006b500 0x7fc38006d9c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc394161320 tx=0x7fc384008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:46.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.676+0000 7fc3897fa640 1 -- 172.21.15.55:0/4070039839 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3940b30e0 con 0x7fc3940d1f90 2024-04-25T08:57:46.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.857+0000 7fc39ad6a640 1 -- 172.21.15.55:0/4070039839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3940b35b0 con 0x7fc3940d1f90 2024-04-25T08:57:46.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.857+0000 7fc3897fa640 1 -- 172.21.15.55:0/4070039839 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+12891 (secure 0 0 0) 0x7fc390079810 con 0x7fc3940d1f90 2024-04-25T08:57:46.848 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:46.848 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":69,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:57:46.162389+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:46.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 -- 172.21.15.55:0/4070039839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc38006b500 msgr2=0x7fc38006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc38006b500 0x7fc38006d9c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc394161320 tx=0x7fc384008040 comp rx=0 tx=0).stop 2024-04-25T08:57:46.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 -- 172.21.15.55:0/4070039839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3940d1f90 msgr2=0x7fc394152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3940d1f90 0x7fc394152a10 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc39002a140 tx=0x7fc3900046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 -- 172.21.15.55:0/4070039839 shutdown_connections 2024-04-25T08:57:46.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc38006b500 0x7fc38006d9c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc39415dce0 0x7fc3941f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3940d35b0 0x7fc3940c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 --2- 172.21.15.55:0/4070039839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3940d1f90 0x7fc394152a10 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 -- 172.21.15.55:0/4070039839 >> 172.21.15.55:0/4070039839 conn(0x7fc394072900 msgr2=0x7fc39415cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:46.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 -- 172.21.15.55:0/4070039839 shutdown_connections 2024-04-25T08:57:46.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.859+0000 7fc39ad6a640 1 -- 172.21.15.55:0/4070039839 wait complete. 2024-04-25T08:57:46.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:57:46.861 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:57:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.974+0000 7f8ef85a9640 1 Processor -- start 2024-04-25T08:57:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.974+0000 7f8ef85a9640 1 -- start start 2024-04-25T08:57:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.975+0000 7f8ef85a9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ef015dca0 0x7f8ef00ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.975+0000 7f8ef85a9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef00d4090 con 0x7f8ef00d3b90 2024-04-25T08:57:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.975+0000 7f8ef85a9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef00d4370 con 0x7f8ef00d1130 2024-04-25T08:57:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.975+0000 7f8ef85a9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00b6b20 con 0x7f8ef015dca0 2024-04-25T08:57:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.975+0000 7f8ef5b44640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8ef00d3b90 0x7f8ef00d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42084/0 (socket says 172.21.15.55:42084) 2024-04-25T08:57:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.975+0000 7f8ef5b44640 1 -- 172.21.15.55:0/2654460487 learned_addr learned my addr 172.21.15.55:0/2654460487 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.975+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61575226 0 0) 0x7f8ef00d4090 con 0x7f8ef00d3b90 2024-04-25T08:57:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.975+0000 7f8ef6345640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ef015dca0 0x7f8ef00ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.975+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ed8003520 con 0x7f8ef00d3b90 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2785237023 0 0) 0x7f8ed8003520 con 0x7f8ef00d3b90 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ef015dca0 msgr2=0x7f8ef00ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ef015dca0 0x7f8ef00ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 >> v1:172.21.15.167:6789/0 conn(0x7f8ef00d1130 legacy=0x7f8ef00b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00d4650 con 0x7f8ef00d3b90 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f8ee4001670 con 0x7f8ef00d3b90 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 >> v1:172.21.15.55:6789/0 conn(0x7f8ef00d3b90 legacy=0x7f8ef00d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed80039e0 0x7f8ed8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ef015dca0 0x7f8ed8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed8004d40 0x7f8ed80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed800ba70 con 0x7f8ed8004d40 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed800bc20 con 0x7f8ed80039e0 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed800be20 con 0x7f8ef015dca0 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef6b46640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed8004d40 0x7f8ed80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef6345640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed80039e0 0x7f8ed8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef5b44640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ef015dca0 0x7f8ed8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef6b46640 1 -- 172.21.15.55:0/2654460487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ef015dca0 msgr2=0x7f8ed8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef6b46640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ef015dca0 0x7f8ed8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef6b46640 1 -- 172.21.15.55:0/2654460487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed80039e0 msgr2=0x7f8ed8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef6b46640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed80039e0 0x7f8ed8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.976+0000 7f8ef6b46640 1 -- 172.21.15.55:0/2654460487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8003520 con 0x7f8ed8004d40 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.977+0000 7f8ef6b46640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed8004d40 0x7f8ed80051c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00b6580 tx=0x7f8ed8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110b7bb2cd9eade1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.977+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0001a70 con 0x7f8ed8004d40 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.977+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee002add0 con 0x7f8ed8004d40 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.977+0000 7f8ef5343640 1 -- 172.21.15.55:0/2654460487 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0003bb0 con 0x7f8ed8004d40 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.978+0000 7f8ef85a9640 1 -- 172.21.15.55:0/2654460487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed8004d40 msgr2=0x7f8ed80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.978+0000 7f8ef85a9640 1 --2- 172.21.15.55:0/2654460487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ed8004d40 0x7f8ed80051c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00b6580 tx=0x7f8ed8005830 comp rx=0 tx=0).stop 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.978+0000 7f8ef6b46640 1 -- 172.21.15.55:0/2654460487 reap_dead start 2024-04-25T08:57:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.978+0000 7f8ef85a9640 1 -- 172.21.15.55:0/2654460487 shutdown_connections 2024-04-25T08:57:46.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.978+0000 7f8ef85a9640 1 -- 172.21.15.55:0/2654460487 >> 172.21.15.55:0/2654460487 conn(0x7f8ef00726c0 msgr2=0x7f8ef0072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:46.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.978+0000 7f8ef85a9640 1 -- 172.21.15.55:0/2654460487 shutdown_connections 2024-04-25T08:57:46.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.978+0000 7f8ef85a9640 1 -- 172.21.15.55:0/2654460487 wait complete. 2024-04-25T08:57:46.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.979+0000 7f8ef85a9640 1 Processor -- start 2024-04-25T08:57:46.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.979+0000 7f8ef85a9640 1 -- start start 2024-04-25T08:57:46.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef85a9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ed8004d40 0x7f8ef00cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef85a9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ef00ace50 0x7f8ef01f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef85a9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ef01f6e20 0x7f8ef00cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef85a9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef015e200 con 0x7f8ef01f6e20 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef85a9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef015e080 con 0x7f8ef00ace50 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef85a9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00b8280 con 0x7f8ed8004d40 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef6b46640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ef01f6e20 0x7f8ef00cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef6b46640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ef01f6e20 0x7f8ef00cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48214/0 (socket says 172.21.15.55:48214) 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef6b46640 1 -- 172.21.15.55:0/524807547 learned_addr learned my addr 172.21.15.55:0/524807547 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef5b44640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ef00ace50 0x7f8ef01f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef6345640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ed8004d40 0x7f8ef00cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef6b46640 1 -- 172.21.15.55:0/524807547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ed8004d40 msgr2=0x7f8ef00cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef6b46640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ed8004d40 0x7f8ef00cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef6b46640 1 -- 172.21.15.55:0/524807547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ef00ace50 msgr2=0x7f8ef01f68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef6b46640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ef00ace50 0x7f8ef01f68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef6b46640 1 -- 172.21.15.55:0/524807547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00ccb90 con 0x7f8ef01f6e20 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef6b46640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ef01f6e20 0x7f8ef00cebe0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0001ee0 tx=0x7f8ee00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8eeeffd640 1 -- 172.21.15.55:0/524807547 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0037040 con 0x7f8ef01f6e20 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8eeeffd640 1 -- 172.21.15.55:0/524807547 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee002abd0 con 0x7f8ef01f6e20 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8eeeffd640 1 -- 172.21.15.55:0/524807547 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0001a70 con 0x7f8ef01f6e20 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.980+0000 7f8ef85a9640 1 -- 172.21.15.55:0/524807547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef00cbbb0 con 0x7f8ef01f6e20 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.981+0000 7f8ef85a9640 1 -- 172.21.15.55:0/524807547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef01f7680 con 0x7f8ef01f6e20 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.981+0000 7f8ef85a9640 1 -- 172.21.15.55:0/524807547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef00750b0 con 0x7f8ef01f6e20 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.982+0000 7f8eeeffd640 1 -- 172.21.15.55:0/524807547 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ee0042030 con 0x7f8ef01f6e20 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.982+0000 7f8eeeffd640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8edc06b4d0 0x7f8edc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.982+0000 7f8eeeffd640 1 -- 172.21.15.55:0/524807547 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8ee00a90f0 con 0x7f8ef01f6e20 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.983+0000 7f8ef6345640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8edc06b4d0 0x7f8edc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.983+0000 7f8ef6345640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8edc06b4d0 0x7f8edc06d990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009bc0 tx=0x7f8ee8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:46.987+0000 7f8eeeffd640 1 -- 172.21.15.55:0/524807547 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ee0049020 con 0x7f8ef01f6e20 2024-04-25T08:57:47.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.167+0000 7f8ef85a9640 1 -- 172.21.15.55:0/524807547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ef006b1d0 con 0x7f8ef01f6e20 2024-04-25T08:57:47.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.167+0000 7f8eeeffd640 1 -- 172.21.15.55:0/524807547 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ee002ada0 con 0x7f8ef01f6e20 2024-04-25T08:57:47.158 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:57:47.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 -- 172.21.15.55:0/524807547 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8edc06b4d0 msgr2=0x7f8edc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:47.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8edc06b4d0 0x7f8edc06d990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009bc0 tx=0x7f8ee8009190 comp rx=0 tx=0).stop 2024-04-25T08:57:47.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 -- 172.21.15.55:0/524807547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ef01f6e20 msgr2=0x7f8ef00cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:47.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ef01f6e20 0x7f8ef00cebe0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0001ee0 tx=0x7f8ee00014a0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 -- 172.21.15.55:0/524807547 shutdown_connections 2024-04-25T08:57:47.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8edc06b4d0 0x7f8edc06d990 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ef01f6e20 0x7f8ef00cebe0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ef00ace50 0x7f8ef01f68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 --2- 172.21.15.55:0/524807547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ed8004d40 0x7f8ef00cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 -- 172.21.15.55:0/524807547 >> 172.21.15.55:0/524807547 conn(0x7f8ef00726c0 msgr2=0x7f8ef00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:47.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 -- 172.21.15.55:0/524807547 shutdown_connections 2024-04-25T08:57:47.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.169+0000 7f8ef85a9640 1 -- 172.21.15.55:0/524807547 wait complete. 2024-04-25T08:57:47.170 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:57:47.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.281+0000 7f5077c1f640 1 Processor -- start 2024-04-25T08:57:47.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.281+0000 7f5077c1f640 1 -- start start 2024-04-25T08:57:47.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f5077c1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f507015ba10 0x7f5070099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f5077c1f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f507006c3c0 0x7f50700cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f5077c1f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507006c900 con 0x7f5070099f80 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f5077c1f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700cbe50 con 0x7f507015ba10 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f5077c1f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507009a3d0 con 0x7f507006c3c0 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f50759bb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f507015ba10 0x7f5070099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f50759bb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f507015ba10 0x7f5070099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48220/0 (socket says 172.21.15.55:48220) 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f50759bb640 1 -- 172.21.15.55:0/3266177176 learned_addr learned my addr 172.21.15.55:0/3266177176 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f50761bc640 1 --2- 172.21.15.55:0/3266177176 >> v2:172.21.15.167:3300/0 conn(0x7f507006c3c0 0x7f50700cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f50759bb640 1 -- 172.21.15.55:0/3266177176 >> v2:172.21.15.167:3300/0 conn(0x7f507006c3c0 msgr2=0x7f50700cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f50759bb640 1 --2- 172.21.15.55:0/3266177176 >> v2:172.21.15.167:3300/0 conn(0x7f507006c3c0 0x7f50700cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f50759bb640 1 -- 172.21.15.55:0/3266177176 >> v1:172.21.15.167:6789/0 conn(0x7f5070099f80 legacy=0x7f507006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.282+0000 7f50759bb640 1 -- 172.21.15.55:0/3266177176 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507006cbe0 con 0x7f507015ba10 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.283+0000 7f50759bb640 1 --2- 172.21.15.55:0/3266177176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f507015ba10 0x7f5070099a40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f50700b7850 tx=0x7f506c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ca2903b36efc57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.283+0000 7f50749b9640 1 -- 172.21.15.55:0/3266177176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c037070 con 0x7f507015ba10 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.283+0000 7f50749b9640 1 -- 172.21.15.55:0/3266177176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c032440 con 0x7f507015ba10 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.283+0000 7f50749b9640 1 -- 172.21.15.55:0/3266177176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c032810 con 0x7f507015ba10 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.283+0000 7f5077c1f640 1 -- 172.21.15.55:0/3266177176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f507015ba10 msgr2=0x7f5070099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.283+0000 7f5077c1f640 1 --2- 172.21.15.55:0/3266177176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f507015ba10 0x7f5070099a40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f50700b7850 tx=0x7f506c02a230 comp rx=0 tx=0).stop 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.284+0000 7f5077c1f640 1 -- 172.21.15.55:0/3266177176 shutdown_connections 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.284+0000 7f5077c1f640 1 --2- 172.21.15.55:0/3266177176 >> v2:172.21.15.167:3300/0 conn(0x7f507006c3c0 0x7f50700cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.284+0000 7f5077c1f640 1 --2- 172.21.15.55:0/3266177176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f507015ba10 0x7f5070099a40 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.284+0000 7f5077c1f640 1 -- 172.21.15.55:0/3266177176 >> 172.21.15.55:0/3266177176 conn(0x7f50700b32f0 msgr2=0x7f50700b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.284+0000 7f5077c1f640 1 -- 172.21.15.55:0/3266177176 shutdown_connections 2024-04-25T08:57:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.284+0000 7f5077c1f640 1 -- 172.21.15.55:0/3266177176 wait complete. 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.285+0000 7f5077c1f640 1 Processor -- start 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.285+0000 7f5077c1f640 1 -- start start 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f5077c1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f507006c3c0 0x7f50701f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f5077c1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070099f80 0x7f507015c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f5077c1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f507015ba10 0x7f50700cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f5077c1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700cd760 con 0x7f5070099f80 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f5077c1f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700cfe80 con 0x7f507006c3c0 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f5077c1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50700cd8e0 con 0x7f507015ba10 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50751ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070099f80 0x7f507015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50751ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070099f80 0x7f507015c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48224/0 (socket says 172.21.15.55:48224) 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50751ba640 1 -- 172.21.15.55:0/2947853322 learned_addr learned my addr 172.21.15.55:0/2947853322 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50759bb640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f507006c3c0 0x7f50701f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50761bc640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f507015ba10 0x7f50700cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50751ba640 1 -- 172.21.15.55:0/2947853322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f507015ba10 msgr2=0x7f50700cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50751ba640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f507015ba10 0x7f50700cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50751ba640 1 -- 172.21.15.55:0/2947853322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f507006c3c0 msgr2=0x7f50701f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50751ba640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f507006c3c0 0x7f50701f39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50751ba640 1 -- 172.21.15.55:0/2947853322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700af6a0 con 0x7f5070099f80 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50759bb640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f507006c3c0 0x7f50701f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50761bc640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f507015ba10 0x7f50700cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50751ba640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070099f80 0x7f507015c140 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f506000c430 tx=0x7f506000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50667fc640 1 -- 172.21.15.55:0/2947853322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060011790 con 0x7f5070099f80 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f50667fc640 1 -- 172.21.15.55:0/2947853322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5060017070 con 0x7f5070099f80 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.286+0000 7f5077c1f640 1 -- 172.21.15.55:0/2947853322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50700af940 con 0x7f5070099f80 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.287+0000 7f50667fc640 1 -- 172.21.15.55:0/2947853322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060011bb0 con 0x7f5070099f80 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.287+0000 7f5077c1f640 1 -- 172.21.15.55:0/2947853322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50700aff00 con 0x7f5070099f80 2024-04-25T08:57:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.287+0000 7f5077c1f640 1 -- 172.21.15.55:0/2947853322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50700749b0 con 0x7f5070099f80 2024-04-25T08:57:47.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.288+0000 7f50667fc640 1 -- 172.21.15.55:0/2947853322 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f506001c460 con 0x7f5070099f80 2024-04-25T08:57:47.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.288+0000 7f50667fc640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f505406b4d0 0x7f505406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.288+0000 7f50667fc640 1 -- 172.21.15.55:0/2947853322 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5060089e30 con 0x7f5070099f80 2024-04-25T08:57:47.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.288+0000 7f50759bb640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f505406b4d0 0x7f505406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.289+0000 7f50759bb640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f505406b4d0 0x7f505406d990 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f506c034000 tx=0x7f506c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.294+0000 7f50667fc640 1 -- 172.21.15.55:0/2947853322 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5060058f60 con 0x7f5070099f80 2024-04-25T08:57:47.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.474+0000 7f5077c1f640 1 -- 172.21.15.55:0/2947853322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f50700b4120 con 0x7f5070099f80 2024-04-25T08:57:47.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.474+0000 7f50667fc640 1 -- 172.21.15.55:0/2947853322 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5060058860 con 0x7f5070099f80 2024-04-25T08:57:47.465 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:47.465 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T08:57:47.465 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:57:47.465 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-25T08:57:47.465 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-25T08:57:47.465 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:57:47.465 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T08:57:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.476+0000 7f5077c1f640 1 -- 172.21.15.55:0/2947853322 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f505406b4d0 msgr2=0x7f505406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.476+0000 7f5077c1f640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f505406b4d0 0x7f505406d990 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f506c034000 tx=0x7f506c02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.476+0000 7f5077c1f640 1 -- 172.21.15.55:0/2947853322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070099f80 msgr2=0x7f507015c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.476+0000 7f5077c1f640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070099f80 0x7f507015c140 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f506000c430 tx=0x7f506000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.476+0000 7f5077c1f640 1 -- 172.21.15.55:0/2947853322 shutdown_connections 2024-04-25T08:57:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.476+0000 7f5077c1f640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f505406b4d0 0x7f505406d990 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.477+0000 7f5077c1f640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f507015ba10 0x7f50700cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.477+0000 7f5077c1f640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070099f80 0x7f507015c140 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.477+0000 7f5077c1f640 1 --2- 172.21.15.55:0/2947853322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f507006c3c0 0x7f50701f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.477+0000 7f5077c1f640 1 -- 172.21.15.55:0/2947853322 >> 172.21.15.55:0/2947853322 conn(0x7f50700b32f0 msgr2=0x7f50700ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:47.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.477+0000 7f5077c1f640 1 -- 172.21.15.55:0/2947853322 shutdown_connections 2024-04-25T08:57:47.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.477+0000 7f5077c1f640 1 -- 172.21.15.55:0/2947853322 wait complete. 2024-04-25T08:57:47.478 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:57:47.478 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:57:47.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.592+0000 7fb5eeebd640 1 Processor -- start 2024-04-25T08:57:47.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.592+0000 7fb5eeebd640 1 -- start start 2024-04-25T08:57:47.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.593+0000 7fb5eeebd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e81610b0 0x7fb5e80b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.593+0000 7fb5eeebd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb5e80cef40 0x7fb5e80d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.593+0000 7fb5eeebd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e8162040 con 0x7fb5e81618d0 2024-04-25T08:57:47.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.593+0000 7fb5eeebd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e80d1ea0 con 0x7fb5e80cef40 2024-04-25T08:57:47.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.593+0000 7fb5eeebd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e8162320 con 0x7fb5e81610b0 2024-04-25T08:57:47.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.593+0000 7fb5e7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb5e81618d0 0x7fb5e80ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42088/0 (socket says 172.21.15.55:42088) 2024-04-25T08:57:47.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.593+0000 7fb5e7fff640 1 -- 172.21.15.55:0/1962970854 learned_addr learned my addr 172.21.15.55:0/1962970854 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:47.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.593+0000 7fb5ed45a640 1 --2- 172.21.15.55:0/1962970854 >> v2:172.21.15.167:3300/0 conn(0x7fb5e80cef40 0x7fb5e80d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.593+0000 7fb5ecc59640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e81610b0 0x7fb5e80b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.593+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341522847 0 0) 0x7fb5e8162040 con 0x7fb5e81618d0 2024-04-25T08:57:47.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.593+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5d4003520 con 0x7fb5e81618d0 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2931931797 0 0) 0x7fb5d4003520 con 0x7fb5e81618d0 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e81610b0 msgr2=0x7fb5e80b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e81610b0 0x7fb5e80b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 >> v2:172.21.15.167:3300/0 conn(0x7fb5e80cef40 msgr2=0x7fb5e80d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 --2- 172.21.15.55:0/1962970854 >> v2:172.21.15.167:3300/0 conn(0x7fb5e80cef40 0x7fb5e80d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e8162600 con 0x7fb5e81618d0 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fb5d8001a10 con 0x7fb5e81618d0 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 >> v1:172.21.15.55:6789/0 conn(0x7fb5e81618d0 legacy=0x7fb5e80ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d40039b0 0x7fb5d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4004800 0x7fb5d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e81610b0 0x7fb5d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80d1ea0 con 0x7fb5d4004800 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e8162320 con 0x7fb5d40039b0 2024-04-25T08:57:47.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d400b9c0 con 0x7fb5e81610b0 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e7fff640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4004800 0x7fb5d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5ed45a640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e81610b0 0x7fb5d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5ecc59640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d40039b0 0x7fb5d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e7fff640 1 -- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e81610b0 msgr2=0x7fb5d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e7fff640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e81610b0 0x7fb5d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e7fff640 1 -- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d40039b0 msgr2=0x7fb5d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e7fff640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d40039b0 0x7fb5d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5e7fff640 1 -- 172.21.15.55:0/1962970854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d4003520 con 0x7fb5d4004800 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.594+0000 7fb5ecc59640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d40039b0 0x7fb5d4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.595+0000 7fb5e7fff640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4004800 0x7fb5d4004c80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800a8a0 tx=0x7fb5d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852cc21966453a5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.595+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800a4c0 con 0x7fb5d4004800 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.595+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d802f070 con 0x7fb5d4004800 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.595+0000 7fb5e77fe640 1 -- 172.21.15.55:0/1962970854 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d802bca0 con 0x7fb5d4004800 2024-04-25T08:57:47.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.595+0000 7fb5eeebd640 1 -- 172.21.15.55:0/1962970854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4004800 msgr2=0x7fb5d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:47.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.595+0000 7fb5eeebd640 1 --2- 172.21.15.55:0/1962970854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4004800 0x7fb5d4004c80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800a8a0 tx=0x7fb5d4005830 comp rx=0 tx=0).stop 2024-04-25T08:57:47.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.595+0000 7fb5ed45a640 1 -- 172.21.15.55:0/1962970854 reap_dead start 2024-04-25T08:57:47.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.596+0000 7fb5eeebd640 1 -- 172.21.15.55:0/1962970854 shutdown_connections 2024-04-25T08:57:47.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.596+0000 7fb5eeebd640 1 -- 172.21.15.55:0/1962970854 >> 172.21.15.55:0/1962970854 conn(0x7fb5e80b5570 msgr2=0x7fb5e80b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:47.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.596+0000 7fb5eeebd640 1 -- 172.21.15.55:0/1962970854 shutdown_connections 2024-04-25T08:57:47.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.596+0000 7fb5eeebd640 1 -- 172.21.15.55:0/1962970854 wait complete. 2024-04-25T08:57:47.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.597+0000 7fb5eeebd640 1 Processor -- start 2024-04-25T08:57:47.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.597+0000 7fb5eeebd640 1 -- start start 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5eeebd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d4004800 0x7fb5e80cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5eeebd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e81f48d0 0x7fb5e81531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5eeebd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e8147880 0x7fb5e8147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5eeebd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e8161d10 con 0x7fb5e81f48d0 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5eeebd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80b6c00 con 0x7fb5d4004800 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5eeebd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e8161490 con 0x7fb5e8147880 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5e7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e81f48d0 0x7fb5e81531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5e7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e81f48d0 0x7fb5e81531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48242/0 (socket says 172.21.15.55:48242) 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5e7fff640 1 -- 172.21.15.55:0/610896793 learned_addr learned my addr 172.21.15.55:0/610896793 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5ecc59640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d4004800 0x7fb5e80cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5e7fff640 1 -- 172.21.15.55:0/610896793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e8147880 msgr2=0x7fb5e8147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5e7fff640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e8147880 0x7fb5e8147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5e7fff640 1 -- 172.21.15.55:0/610896793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d4004800 msgr2=0x7fb5e80cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5e7fff640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d4004800 0x7fb5e80cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5e7fff640 1 -- 172.21.15.55:0/610896793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e81554f0 con 0x7fb5e81f48d0 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5e7fff640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e81f48d0 0x7fb5e81531a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800a9c0 tx=0x7fb5e81627d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.598+0000 7fb5e57fa640 1 -- 172.21.15.55:0/610896793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8044070 con 0x7fb5e81f48d0 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.599+0000 7fb5e57fa640 1 -- 172.21.15.55:0/610896793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d802ce30 con 0x7fb5e81f48d0 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.599+0000 7fb5eeebd640 1 -- 172.21.15.55:0/610896793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e80cd3d0 con 0x7fb5e81f48d0 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.599+0000 7fb5e57fa640 1 -- 172.21.15.55:0/610896793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8002010 con 0x7fb5e81f48d0 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.599+0000 7fb5eeebd640 1 -- 172.21.15.55:0/610896793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e80cc0d0 con 0x7fb5e81f48d0 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.600+0000 7fb5eeebd640 1 -- 172.21.15.55:0/610896793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e80750b0 con 0x7fb5e81f48d0 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.600+0000 7fb5e57fa640 1 -- 172.21.15.55:0/610896793 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb5d8047070 con 0x7fb5e81f48d0 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.600+0000 7fb5e57fa640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb5c806b500 0x7fb5c806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.601+0000 7fb5e57fa640 1 -- 172.21.15.55:0/610896793 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb5d80a9e00 con 0x7fb5e81f48d0 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.601+0000 7fb5ecc59640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb5c806b500 0x7fb5c806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.601+0000 7fb5ecc59640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb5c806b500 0x7fb5c806d9c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb5e815cd60 tx=0x7fb5e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:47.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.605+0000 7fb5e57fa640 1 -- 172.21.15.55:0/610896793 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb5d8079060 con 0x7fb5e81f48d0 2024-04-25T08:57:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:47.787+0000 7fb5eeebd640 1 -- 172.21.15.55:0/610896793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb5e80b6d80 con 0x7fb5e81f48d0 2024-04-25T08:57:48.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.168+0000 7fb5e57fa640 1 -- 172.21.15.55:0/610896793 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb5d8078960 con 0x7fb5e81f48d0 2024-04-25T08:57:48.158 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-25T08:57:48.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.170+0000 7fb5eeebd640 1 -- 172.21.15.55:0/610896793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb5c806b500 msgr2=0x7fb5c806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:48.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.170+0000 7fb5eeebd640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb5c806b500 0x7fb5c806d9c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb5e815cd60 tx=0x7fb5e0008040 comp rx=0 tx=0).stop 2024-04-25T08:57:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.170+0000 7fb5eeebd640 1 -- 172.21.15.55:0/610896793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e81f48d0 msgr2=0x7fb5e81531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.170+0000 7fb5eeebd640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e81f48d0 0x7fb5e81531a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800a9c0 tx=0x7fb5e81627d0 comp rx=0 tx=0).stop 2024-04-25T08:57:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.171+0000 7fb5eeebd640 1 -- 172.21.15.55:0/610896793 shutdown_connections 2024-04-25T08:57:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.171+0000 7fb5eeebd640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb5c806b500 0x7fb5c806d9c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.171+0000 7fb5eeebd640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e8147880 0x7fb5e8147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.171+0000 7fb5eeebd640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e81f48d0 0x7fb5e81531a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:48.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.171+0000 7fb5eeebd640 1 --2- 172.21.15.55:0/610896793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d4004800 0x7fb5e80cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:48.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.171+0000 7fb5eeebd640 1 -- 172.21.15.55:0/610896793 >> 172.21.15.55:0/610896793 conn(0x7fb5e80b5570 msgr2=0x7fb5e80ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:48.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.171+0000 7fb5eeebd640 1 -- 172.21.15.55:0/610896793 shutdown_connections 2024-04-25T08:57:48.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.171+0000 7fb5eeebd640 1 -- 172.21.15.55:0/610896793 wait complete. 2024-04-25T08:57:48.176 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:57:48.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.298+0000 7f394af22640 1 Processor -- start 2024-04-25T08:57:48.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.298+0000 7f394af22640 1 -- start start 2024-04-25T08:57:48.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.299+0000 7f394af22640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3944071a80 0x7f39440b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:48.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.299+0000 7f394af22640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3944070d40 0x7f39440711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:48.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.299+0000 7f394af22640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39440b66a0 con 0x7f394415ba50 2024-04-25T08:57:48.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.299+0000 7f394af22640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39440b4ef0 con 0x7f3944071a80 2024-04-25T08:57:48.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.299+0000 7f394af22640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39440b51d0 con 0x7f3944070d40 2024-04-25T08:57:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.299+0000 7f3943fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3944071a80 0x7f39440b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.299+0000 7f3943fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3944071a80 0x7f39440b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48254/0 (socket says 172.21.15.55:48254) 2024-04-25T08:57:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.299+0000 7f3943fff640 1 -- 172.21.15.55:0/562872873 learned_addr learned my addr 172.21.15.55:0/562872873 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.300+0000 7f39494bf640 1 --2- 172.21.15.55:0/562872873 >> v2:172.21.15.167:3300/0 conn(0x7f3944070d40 0x7f39440711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.300+0000 7f3943fff640 1 -- 172.21.15.55:0/562872873 >> v2:172.21.15.167:3300/0 conn(0x7f3944070d40 msgr2=0x7f39440711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.300+0000 7f3943fff640 1 --2- 172.21.15.55:0/562872873 >> v2:172.21.15.167:3300/0 conn(0x7f3944070d40 0x7f39440711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.300+0000 7f3943fff640 1 -- 172.21.15.55:0/562872873 >> v1:172.21.15.167:6789/0 conn(0x7f394415ba50 legacy=0x7f39440b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.300+0000 7f3943fff640 1 -- 172.21.15.55:0/562872873 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39440b54b0 con 0x7f3944071a80 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.300+0000 7f3943fff640 1 --2- 172.21.15.55:0/562872873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3944071a80 0x7f39440b47c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f394406f350 tx=0x7f393402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cc6f84a02a6761 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.301+0000 7f39437fe640 1 -- 172.21.15.55:0/562872873 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934037070 con 0x7f3944071a80 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.301+0000 7f39437fe640 1 -- 172.21.15.55:0/562872873 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3934032440 con 0x7f3944071a80 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.301+0000 7f39437fe640 1 -- 172.21.15.55:0/562872873 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934032810 con 0x7f3944071a80 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.301+0000 7f394af22640 1 -- 172.21.15.55:0/562872873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3944071a80 msgr2=0x7f39440b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.301+0000 7f394af22640 1 --2- 172.21.15.55:0/562872873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3944071a80 0x7f39440b47c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f394406f350 tx=0x7f393402a230 comp rx=0 tx=0).stop 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.301+0000 7f394af22640 1 -- 172.21.15.55:0/562872873 shutdown_connections 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.301+0000 7f394af22640 1 --2- 172.21.15.55:0/562872873 >> v2:172.21.15.167:3300/0 conn(0x7f3944070d40 0x7f39440711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.301+0000 7f394af22640 1 --2- 172.21.15.55:0/562872873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3944071a80 0x7f39440b47c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.301+0000 7f394af22640 1 -- 172.21.15.55:0/562872873 >> 172.21.15.55:0/562872873 conn(0x7f39440b34c0 msgr2=0x7f39440b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.301+0000 7f394af22640 1 -- 172.21.15.55:0/562872873 shutdown_connections 2024-04-25T08:57:48.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.301+0000 7f394af22640 1 -- 172.21.15.55:0/562872873 wait complete. 2024-04-25T08:57:48.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.302+0000 7f394af22640 1 Processor -- start 2024-04-25T08:57:48.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.302+0000 7f394af22640 1 -- start start 2024-04-25T08:57:48.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.303+0000 7f394af22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3944070d40 0x7f394415cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:48.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.303+0000 7f394af22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3944071a80 0x7f394415e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:48.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.303+0000 7f394af22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394415ba50 0x7f3944150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:48.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.303+0000 7f394af22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394415be30 con 0x7f394415ba50 2024-04-25T08:57:48.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.303+0000 7f394af22640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39440b5a70 con 0x7f3944071a80 2024-04-25T08:57:48.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.303+0000 7f394af22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394415bfb0 con 0x7f3944070d40 2024-04-25T08:57:48.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.303+0000 7f39494bf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394415ba50 0x7f3944150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:48.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f39494bf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394415ba50 0x7f3944150670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48260/0 (socket says 172.21.15.55:48260) 2024-04-25T08:57:48.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f39494bf640 1 -- 172.21.15.55:0/3870632468 learned_addr learned my addr 172.21.15.55:0/3870632468 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:48.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f3943fff640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3944071a80 0x7f394415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:48.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f3948cbe640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3944070d40 0x7f394415cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f39494bf640 1 -- 172.21.15.55:0/3870632468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3944070d40 msgr2=0x7f394415cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f39494bf640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3944070d40 0x7f394415cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f39494bf640 1 -- 172.21.15.55:0/3870632468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3944071a80 msgr2=0x7f394415e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f39494bf640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3944071a80 0x7f394415e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f39494bf640 1 -- 172.21.15.55:0/3870632468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3944150ee0 con 0x7f394415ba50 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f3943fff640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3944071a80 0x7f394415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f3948cbe640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3944070d40 0x7f394415cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f39494bf640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394415ba50 0x7f3944150670 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f392c00c7f0 tx=0x7f392c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f39417fa640 1 -- 172.21.15.55:0/3870632468 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c015070 con 0x7f394415ba50 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f39417fa640 1 -- 172.21.15.55:0/3870632468 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c004220 con 0x7f394415ba50 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f39417fa640 1 -- 172.21.15.55:0/3870632468 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c007620 con 0x7f394415ba50 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f394af22640 1 -- 172.21.15.55:0/3870632468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394415d440 con 0x7f394415ba50 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.304+0000 7f394af22640 1 -- 172.21.15.55:0/3870632468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394415da00 con 0x7f394415ba50 2024-04-25T08:57:48.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.305+0000 7f394af22640 1 -- 172.21.15.55:0/3870632468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39440749b0 con 0x7f394415ba50 2024-04-25T08:57:48.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.306+0000 7f39417fa640 1 -- 172.21.15.55:0/3870632468 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f392c0079d0 con 0x7f394415ba50 2024-04-25T08:57:48.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.306+0000 7f39417fa640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f392406b4d0 0x7f392406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:48.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.306+0000 7f39417fa640 1 -- 172.21.15.55:0/3870632468 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f392c08a000 con 0x7f394415ba50 2024-04-25T08:57:48.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.306+0000 7f3948cbe640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f392406b4d0 0x7f392406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:48.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.307+0000 7f3948cbe640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f392406b4d0 0x7f392406d990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f393c007e90 tx=0x7f393c0073a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:48.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.311+0000 7f39417fa640 1 -- 172.21.15.55:0/3870632468 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f392c0590f0 con 0x7f394415ba50 2024-04-25T08:57:48.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:48.491+0000 7f394af22640 1 -- 172.21.15.55:0/3870632468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f394415e910 con 0x7f394415ba50 2024-04-25T08:57:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.180+0000 7f39417fa640 1 -- 172.21.15.55:0/3870632468 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) v1 ==== 170+0+0 (secure 0 0 0) 0x7f392c0589f0 con 0x7f394415ba50 2024-04-25T08:57:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 -- 172.21.15.55:0/3870632468 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f392406b4d0 msgr2=0x7f392406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f392406b4d0 0x7f392406d990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f393c007e90 tx=0x7f393c0073a0 comp rx=0 tx=0).stop 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 -- 172.21.15.55:0/3870632468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394415ba50 msgr2=0x7f3944150670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394415ba50 0x7f3944150670 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f392c00c7f0 tx=0x7f392c00ccb0 comp rx=0 tx=0).stop 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 -- 172.21.15.55:0/3870632468 shutdown_connections 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f392406b4d0 0x7f392406d990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394415ba50 0x7f3944150670 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3944071a80 0x7f394415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 --2- 172.21.15.55:0/3870632468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3944070d40 0x7f394415cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 -- 172.21.15.55:0/3870632468 >> 172.21.15.55:0/3870632468 conn(0x7f39440b34c0 msgr2=0x7f3944155f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 -- 172.21.15.55:0/3870632468 shutdown_connections 2024-04-25T08:57:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.183+0000 7f394af22640 1 -- 172.21.15.55:0/3870632468 wait complete. 2024-04-25T08:57:49.197 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:57:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.317+0000 7f954ab8b640 1 Processor -- start 2024-04-25T08:57:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.317+0000 7f954ab8b640 1 -- start start 2024-04-25T08:57:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f954ab8b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95440d3b90 0x7f95440d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f954ab8b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95440d0f60 0x7f95440b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f954ab8b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95440d4090 con 0x7f954415dca0 2024-04-25T08:57:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f954ab8b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95440b6b20 con 0x7f95440d0f60 2024-04-25T08:57:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f954ab8b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95440d4370 con 0x7f95440d3b90 2024-04-25T08:57:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f9549128640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95440d0f60 0x7f95440b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f9549128640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95440d0f60 0x7f95440b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46512/0 (socket says 172.21.15.55:46512) 2024-04-25T08:57:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f9549128640 1 -- 172.21.15.55:0/63881614 learned_addr learned my addr 172.21.15.55:0/63881614 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f9543fff640 1 --2- 172.21.15.55:0/63881614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95440d3b90 0x7f95440d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f9549128640 1 -- 172.21.15.55:0/63881614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95440d3b90 msgr2=0x7f95440d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f9549128640 1 --2- 172.21.15.55:0/63881614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95440d3b90 0x7f95440d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:49.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f9549128640 1 -- 172.21.15.55:0/63881614 >> v1:172.21.15.167:6789/0 conn(0x7f954415dca0 legacy=0x7f95440ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:49.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.318+0000 7f9549128640 1 -- 172.21.15.55:0/63881614 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440d4650 con 0x7f95440d0f60 2024-04-25T08:57:49.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.319+0000 7f9549128640 1 --2- 172.21.15.55:0/63881614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95440d0f60 0x7f95440b2500 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f953c009e50 tx=0x7f953c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7554ffca69b65f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:49.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.319+0000 7f95437fe640 1 -- 172.21.15.55:0/63881614 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c036070 con 0x7f95440d0f60 2024-04-25T08:57:49.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.319+0000 7f95437fe640 1 -- 172.21.15.55:0/63881614 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c031600 con 0x7f95440d0f60 2024-04-25T08:57:49.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.319+0000 7f95437fe640 1 -- 172.21.15.55:0/63881614 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c0319d0 con 0x7f95440d0f60 2024-04-25T08:57:49.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.320+0000 7f954ab8b640 1 -- 172.21.15.55:0/63881614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95440d0f60 msgr2=0x7f95440b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:49.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.320+0000 7f954ab8b640 1 --2- 172.21.15.55:0/63881614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95440d0f60 0x7f95440b2500 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f953c009e50 tx=0x7f953c02a710 comp rx=0 tx=0).stop 2024-04-25T08:57:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.320+0000 7f954ab8b640 1 -- 172.21.15.55:0/63881614 shutdown_connections 2024-04-25T08:57:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.320+0000 7f954ab8b640 1 --2- 172.21.15.55:0/63881614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95440d0f60 0x7f95440b2500 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.320+0000 7f954ab8b640 1 --2- 172.21.15.55:0/63881614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95440d3b90 0x7f95440d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.320+0000 7f954ab8b640 1 -- 172.21.15.55:0/63881614 >> 172.21.15.55:0/63881614 conn(0x7f95440726c0 msgr2=0x7f9544072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.320+0000 7f954ab8b640 1 -- 172.21.15.55:0/63881614 shutdown_connections 2024-04-25T08:57:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.320+0000 7f954ab8b640 1 -- 172.21.15.55:0/63881614 wait complete. 2024-04-25T08:57:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.321+0000 7f954ab8b640 1 Processor -- start 2024-04-25T08:57:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.321+0000 7f954ab8b640 1 -- start start 2024-04-25T08:57:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f954ab8b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95440d0f60 0x7f95441f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f954ab8b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95440d3b90 0x7f9544159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f954ab8b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f954415dca0 0x7f95440cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f954ab8b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954415e080 con 0x7f95440d0f60 2024-04-25T08:57:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f954ab8b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95440cf050 con 0x7f954415dca0 2024-04-25T08:57:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f954ab8b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954415e200 con 0x7f95440d3b90 2024-04-25T08:57:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f9548927640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95440d0f60 0x7f95441f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f9548927640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95440d0f60 0x7f95441f42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46514/0 (socket says 172.21.15.55:46514) 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f9548927640 1 -- 172.21.15.55:0/2185275283 learned_addr learned my addr 172.21.15.55:0/2185275283 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f9543fff640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95440d3b90 0x7f9544159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f9549128640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f954415dca0 0x7f95440cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f9548927640 1 -- 172.21.15.55:0/2185275283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95440d3b90 msgr2=0x7f9544159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f9548927640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95440d3b90 0x7f9544159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f9548927640 1 -- 172.21.15.55:0/2185275283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f954415dca0 msgr2=0x7f95440cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f9548927640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f954415dca0 0x7f95440cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f9548927640 1 -- 172.21.15.55:0/2185275283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440cd270 con 0x7f95440d0f60 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.322+0000 7f9548927640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95440d0f60 0x7f95441f42b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f953800c3f0 tx=0x7f953800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.323+0000 7f95417fa640 1 -- 172.21.15.55:0/2185275283 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95380052d0 con 0x7f95440d0f60 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.323+0000 7f95417fa640 1 -- 172.21.15.55:0/2185275283 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9538005490 con 0x7f95440d0f60 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.323+0000 7f954ab8b640 1 -- 172.21.15.55:0/2185275283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954415a440 con 0x7f95440d0f60 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.323+0000 7f95417fa640 1 -- 172.21.15.55:0/2185275283 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538007260 con 0x7f95440d0f60 2024-04-25T08:57:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.323+0000 7f954ab8b640 1 -- 172.21.15.55:0/2185275283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95441f75e0 con 0x7f95440d0f60 2024-04-25T08:57:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.324+0000 7f954ab8b640 1 -- 172.21.15.55:0/2185275283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95440750b0 con 0x7f95440d0f60 2024-04-25T08:57:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.324+0000 7f95417fa640 1 -- 172.21.15.55:0/2185275283 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9538007400 con 0x7f95440d0f60 2024-04-25T08:57:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.325+0000 7f95417fa640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f952806b4d0 0x7f952806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.325+0000 7f95417fa640 1 -- 172.21.15.55:0/2185275283 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f95380895f0 con 0x7f95440d0f60 2024-04-25T08:57:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.325+0000 7f9543fff640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f952806b4d0 0x7f952806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:49.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.325+0000 7f9543fff640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f952806b4d0 0x7f952806d990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9544157230 tx=0x7f9530008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:49.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.329+0000 7f95417fa640 1 -- 172.21.15.55:0/2185275283 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f95380584d0 con 0x7f95440d0f60 2024-04-25T08:57:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:49.552+0000 7f954ab8b640 1 -- 172.21.15.55:0/2185275283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f95440b4970 con 0x7f95440d0f60 2024-04-25T08:57:50.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.181+0000 7f95417fa640 1 -- 172.21.15.55:0/2185275283 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v34) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9538057dd0 con 0x7f95440d0f60 2024-04-25T08:57:50.171 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 10 and data pool 11 2024-04-25T08:57:50.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.185+0000 7f954ab8b640 1 -- 172.21.15.55:0/2185275283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f952806b4d0 msgr2=0x7f952806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.185+0000 7f954ab8b640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f952806b4d0 0x7f952806d990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9544157230 tx=0x7f9530008040 comp rx=0 tx=0).stop 2024-04-25T08:57:50.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.185+0000 7f954ab8b640 1 -- 172.21.15.55:0/2185275283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95440d0f60 msgr2=0x7f95441f42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.185+0000 7f954ab8b640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95440d0f60 0x7f95441f42b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f953800c3f0 tx=0x7f953800c8b0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.185+0000 7f954ab8b640 1 -- 172.21.15.55:0/2185275283 shutdown_connections 2024-04-25T08:57:50.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.185+0000 7f954ab8b640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f952806b4d0 0x7f952806d990 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.185+0000 7f954ab8b640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f954415dca0 0x7f95440cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.185+0000 7f954ab8b640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95440d3b90 0x7f9544159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.185+0000 7f954ab8b640 1 --2- 172.21.15.55:0/2185275283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95440d0f60 0x7f95441f42b0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.185+0000 7f954ab8b640 1 -- 172.21.15.55:0/2185275283 >> 172.21.15.55:0/2185275283 conn(0x7f95440726c0 msgr2=0x7f95440d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:50.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.186+0000 7f954ab8b640 1 -- 172.21.15.55:0/2185275283 shutdown_connections 2024-04-25T08:57:50.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.186+0000 7f954ab8b640 1 -- 172.21.15.55:0/2185275283 wait complete. 2024-04-25T08:57:50.192 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:50.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.309+0000 7f53f9e4d640 1 Processor -- start 2024-04-25T08:57:50.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.309+0000 7f53f9e4d640 1 -- start start 2024-04-25T08:57:50.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.310+0000 7f53f9e4d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b1b30 0x7f53f41687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.310+0000 7f53f9e4d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f406c1f0 con 0x7f53f406cdd0 2024-04-25T08:57:50.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.310+0000 7f53f9e4d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f40cfb40 con 0x7f53f415dc30 2024-04-25T08:57:50.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.310+0000 7f53f9e4d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40b2060 con 0x7f53f40b1b30 2024-04-25T08:57:50.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.310+0000 7f53f2ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f53f406cdd0 0x7f53f40b1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50316/0 (socket says 172.21.15.55:50316) 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.310+0000 7f53f2ffd640 1 -- 172.21.15.55:0/2059700901 learned_addr learned my addr 172.21.15.55:0/2059700901 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.310+0000 7f53f3fff640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b1b30 0x7f53f41687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.310+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645174634 0 0) 0x7f53e8001110 con 0x7f53f406cdd0 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.310+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53dc003520 con 0x7f53f406cdd0 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3322626409 0 0) 0x7f53dc003520 con 0x7f53f406cdd0 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b1b30 msgr2=0x7f53f41687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b1b30 0x7f53f41687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 >> v1:172.21.15.167:6789/0 conn(0x7f53f415dc30 legacy=0x7f53f406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f40b2340 con 0x7f53f406cdd0 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f53e8001840 con 0x7f53f406cdd0 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 >> v1:172.21.15.55:6789/0 conn(0x7f53f406cdd0 legacy=0x7f53f40b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc0039e0 0x7f53dc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b1b30 0x7f53dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53dc004d40 0x7f53dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40b2060 con 0x7f53dc0039e0 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc00b9c0 con 0x7f53dc004d40 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc00bbc0 con 0x7f53f40b1b30 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f37fe640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc0039e0 0x7f53dc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f2ffd640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b1b30 0x7f53dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f3fff640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53dc004d40 0x7f53dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f37fe640 1 -- 172.21.15.55:0/2059700901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b1b30 msgr2=0x7f53dc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f37fe640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b1b30 0x7f53dc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f37fe640 1 -- 172.21.15.55:0/2059700901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53dc004d40 msgr2=0x7f53dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f37fe640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53dc004d40 0x7f53dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.311+0000 7f53f37fe640 1 -- 172.21.15.55:0/2059700901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc003520 con 0x7f53dc0039e0 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.312+0000 7f53f37fe640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc0039e0 0x7f53dc003dc0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f53e4001860 tx=0x7f53dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b22b32759b5bfe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.312+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4037070 con 0x7f53dc0039e0 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.312+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e402ab60 con 0x7f53dc0039e0 2024-04-25T08:57:50.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.312+0000 7f53f27fc640 1 -- 172.21.15.55:0/2059700901 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4001430 con 0x7f53dc0039e0 2024-04-25T08:57:50.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.313+0000 7f53f9e4d640 1 -- 172.21.15.55:0/2059700901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc0039e0 msgr2=0x7f53dc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.313+0000 7f53f9e4d640 1 --2- 172.21.15.55:0/2059700901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc0039e0 0x7f53dc003dc0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f53e4001860 tx=0x7f53dc005830 comp rx=0 tx=0).stop 2024-04-25T08:57:50.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.313+0000 7f53f3fff640 1 -- 172.21.15.55:0/2059700901 reap_dead start 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.313+0000 7f53f9e4d640 1 -- 172.21.15.55:0/2059700901 shutdown_connections 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.313+0000 7f53f9e4d640 1 -- 172.21.15.55:0/2059700901 >> 172.21.15.55:0/2059700901 conn(0x7f53f40d1900 msgr2=0x7f53f40d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.313+0000 7f53f9e4d640 1 -- 172.21.15.55:0/2059700901 shutdown_connections 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.313+0000 7f53f9e4d640 1 -- 172.21.15.55:0/2059700901 wait complete. 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.314+0000 7f53f9e4d640 1 Processor -- start 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.314+0000 7f53f9e4d640 1 -- start start 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f9e4d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53dc0039e0 0x7f53f40c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f9e4d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40b68c0 0x7f53f41f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f9e4d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b6d40 0x7f53f41f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f9e4d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f415e010 con 0x7f53f40b68c0 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f9e4d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40cfde0 con 0x7f53dc0039e0 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f9e4d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40d1310 con 0x7f53f40b6d40 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40b68c0 0x7f53f41f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40b68c0 0x7f53f41f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46532/0 (socket says 172.21.15.55:46532) 2024-04-25T08:57:50.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f2ffd640 1 -- 172.21.15.55:0/1366375089 learned_addr learned my addr 172.21.15.55:0/1366375089 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f37fe640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53dc0039e0 0x7f53f40c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f3fff640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b6d40 0x7f53f41f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f2ffd640 1 -- 172.21.15.55:0/1366375089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b6d40 msgr2=0x7f53f41f7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f2ffd640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b6d40 0x7f53f41f7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f2ffd640 1 -- 172.21.15.55:0/1366375089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53dc0039e0 msgr2=0x7f53f40c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f2ffd640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53dc0039e0 0x7f53f40c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f2ffd640 1 -- 172.21.15.55:0/1366375089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f40c8b50 con 0x7f53f40b68c0 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f3fff640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b6d40 0x7f53f41f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53f2ffd640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40b68c0 0x7f53f41f6ee0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f53e8001050 tx=0x7f53e8007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53dbfff640 1 -- 172.21.15.55:0/1366375089 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800f910 con 0x7f53f40b68c0 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53dbfff640 1 -- 172.21.15.55:0/1366375089 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e8018070 con 0x7f53f40b68c0 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.315+0000 7f53dbfff640 1 -- 172.21.15.55:0/1366375089 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800fd10 con 0x7f53f40b68c0 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.316+0000 7f53f9e4d640 1 -- 172.21.15.55:0/1366375089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f40c8e10 con 0x7f53f40b68c0 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.316+0000 7f53f9e4d640 1 -- 172.21.15.55:0/1366375089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f40c93d0 con 0x7f53f40b68c0 2024-04-25T08:57:50.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.317+0000 7f53f9e4d640 1 -- 172.21.15.55:0/1366375089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f4067850 con 0x7f53f40b68c0 2024-04-25T08:57:50.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.317+0000 7f53dbfff640 1 -- 172.21.15.55:0/1366375089 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f53e801d460 con 0x7f53f40b68c0 2024-04-25T08:57:50.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.317+0000 7f53dbfff640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f53e006b500 0x7f53e006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.317+0000 7f53dbfff640 1 -- 172.21.15.55:0/1366375089 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53e808a150 con 0x7f53f40b68c0 2024-04-25T08:57:50.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.318+0000 7f53f37fe640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f53e006b500 0x7f53e006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.318+0000 7f53f37fe640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f53e006b500 0x7f53e006d9c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53e4034000 tx=0x7f53e4009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:50.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.322+0000 7f53dbfff640 1 -- 172.21.15.55:0/1366375089 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f53f406c1f0 con 0x7f53f40b68c0 2024-04-25T08:57:50.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.502+0000 7f53f9e4d640 1 -- 172.21.15.55:0/1366375089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53f40cbd10 con 0x7f53f40b68c0 2024-04-25T08:57:50.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.503+0000 7f53dbfff640 1 -- 172.21.15.55:0/1366375089 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f53e8059060 con 0x7f53f40b68c0 2024-04-25T08:57:50.493 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:50.493 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":72,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:57:49.554161+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:47.819814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:48.522459+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:50.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 -- 172.21.15.55:0/1366375089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f53e006b500 msgr2=0x7f53e006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f53e006b500 0x7f53e006d9c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53e4034000 tx=0x7f53e4009030 comp rx=0 tx=0).stop 2024-04-25T08:57:50.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 -- 172.21.15.55:0/1366375089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40b68c0 msgr2=0x7f53f41f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40b68c0 0x7f53f41f6ee0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f53e8001050 tx=0x7f53e8007720 comp rx=0 tx=0).stop 2024-04-25T08:57:50.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 -- 172.21.15.55:0/1366375089 shutdown_connections 2024-04-25T08:57:50.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f53e006b500 0x7f53e006d9c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f40b6d40 0x7f53f41f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40b68c0 0x7f53f41f6ee0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 --2- 172.21.15.55:0/1366375089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53dc0039e0 0x7f53f40c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 -- 172.21.15.55:0/1366375089 >> 172.21.15.55:0/1366375089 conn(0x7f53f40d1900 msgr2=0x7f53f40ae480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:50.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 -- 172.21.15.55:0/1366375089 shutdown_connections 2024-04-25T08:57:50.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.505+0000 7f53f9e4d640 1 -- 172.21.15.55:0/1366375089 wait complete. 2024-04-25T08:57:50.506 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.618+0000 7ff4fad09640 1 Processor -- start 2024-04-25T08:57:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.618+0000 7ff4fad09640 1 -- start start 2024-04-25T08:57:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.619+0000 7ff4fad09640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f415dce0 0x7ff4f40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.619+0000 7ff4fad09640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4f40d35b0 0x7ff4f40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.619+0000 7ff4fad09640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f415e0c0 con 0x7ff4f40d1f90 2024-04-25T08:57:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.619+0000 7ff4fad09640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f40b7b10 con 0x7ff4f40d35b0 2024-04-25T08:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.619+0000 7ff4fad09640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40d2510 con 0x7ff4f415dce0 2024-04-25T08:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.619+0000 7ff4f3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4f40d35b0 0x7ff4f40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.619+0000 7ff4f92a6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff4f40d1f90 0x7ff4f406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50320/0 (socket says 172.21.15.55:50320) 2024-04-25T08:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.619+0000 7ff4f92a6640 1 -- 172.21.15.55:0/1467727423 learned_addr learned my addr 172.21.15.55:0/1467727423 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.620+0000 7ff4f8aa5640 1 --2- 172.21.15.55:0/1467727423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f415dce0 0x7ff4f40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.620+0000 7ff4f3fff640 1 -- 172.21.15.55:0/1467727423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f415dce0 msgr2=0x7ff4f40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.620+0000 7ff4f3fff640 1 --2- 172.21.15.55:0/1467727423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f415dce0 0x7ff4f40d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.620+0000 7ff4f3fff640 1 -- 172.21.15.55:0/1467727423 >> v1:172.21.15.55:6789/0 conn(0x7ff4f40d1f90 legacy=0x7ff4f406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.620+0000 7ff4f3fff640 1 -- 172.21.15.55:0/1467727423 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40d27f0 con 0x7ff4f40d35b0 2024-04-25T08:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.620+0000 7ff4f37fe640 1 -- 172.21.15.55:0/1467727423 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759901140 0 0) 0x7ff4f415e0c0 con 0x7ff4f40d1f90 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.620+0000 7ff4f3fff640 1 --2- 172.21.15.55:0/1467727423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f40d35b0 0x7ff4f40b5450 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00097a0 tx=0x7ff4e002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e6eb656136ba0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.621+0000 7ff4f37fe640 1 -- 172.21.15.55:0/1467727423 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0037070 con 0x7ff4f40d35b0 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.621+0000 7ff4f37fe640 1 -- 172.21.15.55:0/1467727423 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e002ae50 con 0x7ff4f40d35b0 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.621+0000 7ff4f37fe640 1 -- 172.21.15.55:0/1467727423 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0032660 con 0x7ff4f40d35b0 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.621+0000 7ff4fad09640 1 -- 172.21.15.55:0/1467727423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f40d35b0 msgr2=0x7ff4f40b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.621+0000 7ff4fad09640 1 --2- 172.21.15.55:0/1467727423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f40d35b0 0x7ff4f40b5450 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00097a0 tx=0x7ff4e002a100 comp rx=0 tx=0).stop 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.621+0000 7ff4fad09640 1 -- 172.21.15.55:0/1467727423 shutdown_connections 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.621+0000 7ff4fad09640 1 --2- 172.21.15.55:0/1467727423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f40d35b0 0x7ff4f40b5450 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.621+0000 7ff4fad09640 1 --2- 172.21.15.55:0/1467727423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f415dce0 0x7ff4f40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.621+0000 7ff4fad09640 1 -- 172.21.15.55:0/1467727423 >> 172.21.15.55:0/1467727423 conn(0x7ff4f4072900 msgr2=0x7ff4f40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.621+0000 7ff4fad09640 1 -- 172.21.15.55:0/1467727423 shutdown_connections 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.621+0000 7ff4fad09640 1 -- 172.21.15.55:0/1467727423 wait complete. 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.622+0000 7ff4fad09640 1 Processor -- start 2024-04-25T08:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.622+0000 7ff4fad09640 1 -- start start 2024-04-25T08:57:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.623+0000 7ff4fad09640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f40d1f90 0x7ff4f41f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.623+0000 7ff4fad09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f40d35b0 0x7ff4f4156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.623+0000 7ff4fad09640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f415dce0 0x7ff4f40ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.623+0000 7ff4fad09640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40d3090 con 0x7ff4f40d35b0 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.623+0000 7ff4fad09640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40d2db0 con 0x7ff4f40d1f90 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.623+0000 7ff4fad09640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40b9820 con 0x7ff4f415dce0 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.623+0000 7ff4f3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f40d35b0 0x7ff4f4156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.623+0000 7ff4f3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f40d35b0 0x7ff4f4156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46542/0 (socket says 172.21.15.55:46542) 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.623+0000 7ff4f3fff640 1 -- 172.21.15.55:0/1132865570 learned_addr learned my addr 172.21.15.55:0/1132865570 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4f92a6640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f415dce0 0x7ff4f40ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4f3fff640 1 -- 172.21.15.55:0/1132865570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f415dce0 msgr2=0x7ff4f40ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4f3fff640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f415dce0 0x7ff4f40ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4f3fff640 1 -- 172.21.15.55:0/1132865570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f40d1f90 msgr2=0x7ff4f41f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4f3fff640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f40d1f90 0x7ff4f41f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4f3fff640 1 -- 172.21.15.55:0/1132865570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f41f4720 con 0x7ff4f40d35b0 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4f3fff640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f40d35b0 0x7ff4f4156020 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0035040 tx=0x7ff4e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4f17fa640 1 -- 172.21.15.55:0/1132865570 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0041070 con 0x7ff4f40d35b0 2024-04-25T08:57:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4f17fa640 1 -- 172.21.15.55:0/1132865570 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e003c670 con 0x7ff4f40d35b0 2024-04-25T08:57:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4fad09640 1 -- 172.21.15.55:0/1132865570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f415e2b0 con 0x7ff4f40d35b0 2024-04-25T08:57:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4f17fa640 1 -- 172.21.15.55:0/1132865570 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0037040 con 0x7ff4f40d35b0 2024-04-25T08:57:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.624+0000 7ff4fad09640 1 -- 172.21.15.55:0/1132865570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f415e550 con 0x7ff4f40d35b0 2024-04-25T08:57:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.625+0000 7ff4fad09640 1 -- 172.21.15.55:0/1132865570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f40749b0 con 0x7ff4f40d35b0 2024-04-25T08:57:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.625+0000 7ff4f17fa640 1 -- 172.21.15.55:0/1132865570 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff4e003a070 con 0x7ff4f40d35b0 2024-04-25T08:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.626+0000 7ff4f17fa640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4d806b4d0 0x7ff4d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.626+0000 7ff4f17fa640 1 -- 172.21.15.55:0/1132865570 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4e00aa4e0 con 0x7ff4f40d35b0 2024-04-25T08:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.626+0000 7ff4f8aa5640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4d806b4d0 0x7ff4d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.626+0000 7ff4f8aa5640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4d806b4d0 0x7ff4d806d990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40b3f80 tx=0x7ff4e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.630+0000 7ff4f17fa640 1 -- 172.21.15.55:0/1132865570 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff4f41f4720 con 0x7ff4f40d35b0 2024-04-25T08:57:50.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.816+0000 7ff4fad09640 1 -- 172.21.15.55:0/1132865570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4f40c72a0 con 0x7ff4f40d35b0 2024-04-25T08:57:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.817+0000 7ff4f17fa640 1 -- 172.21.15.55:0/1132865570 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16681 (secure 0 0 0) 0x7ff4e0079360 con 0x7ff4f40d35b0 2024-04-25T08:57:50.807 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:50.807 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":72,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:57:49.554161+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:47.819814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:48.522459+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:50.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 -- 172.21.15.55:0/1132865570 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4d806b4d0 msgr2=0x7ff4d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4d806b4d0 0x7ff4d806d990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40b3f80 tx=0x7ff4e8008040 comp rx=0 tx=0).stop 2024-04-25T08:57:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 -- 172.21.15.55:0/1132865570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f40d35b0 msgr2=0x7ff4f4156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f40d35b0 0x7ff4f4156020 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0035040 tx=0x7ff4e00046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 -- 172.21.15.55:0/1132865570 shutdown_connections 2024-04-25T08:57:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff4d806b4d0 0x7ff4d806d990 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4f415dce0 0x7ff4f40ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f40d35b0 0x7ff4f4156020 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 --2- 172.21.15.55:0/1132865570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f40d1f90 0x7ff4f41f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 -- 172.21.15.55:0/1132865570 >> 172.21.15.55:0/1132865570 conn(0x7ff4f4072900 msgr2=0x7ff4f40ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 -- 172.21.15.55:0/1132865570 shutdown_connections 2024-04-25T08:57:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.819+0000 7ff4fad09640 1 -- 172.21.15.55:0/1132865570 wait complete. 2024-04-25T08:57:50.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:57:50.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.935+0000 7fe9034b3640 1 Processor -- start 2024-04-25T08:57:50.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.936+0000 7fe9034b3640 1 -- start start 2024-04-25T08:57:50.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.936+0000 7fe9034b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc0d0490 0x7fe8fc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.936+0000 7fe9034b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc06c150 con 0x7fe8fc0ce1a0 2024-04-25T08:57:50.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.936+0000 7fe9034b3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc06c430 con 0x7fe8fc0b2740 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.936+0000 7fe9034b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0d2000 con 0x7fe8fc0d0490 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.936+0000 7fe901a50640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe8fc0ce1a0 0x7fe8fc0ce630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50322/0 (socket says 172.21.15.55:50322) 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe901a50640 1 -- 172.21.15.55:0/309297324 learned_addr learned my addr 172.21.15.55:0/309297324 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105514474 0 0) 0x7fe8fc06c150 con 0x7fe8fc0ce1a0 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8e8003520 con 0x7fe8fc0ce1a0 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe90124f640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc0d0490 0x7fe8fc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2629520649 0 0) 0x7fe8e8003520 con 0x7fe8fc0ce1a0 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc0d0490 msgr2=0x7fe8fc15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc0d0490 0x7fe8fc15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 >> v1:172.21.15.167:6789/0 conn(0x7fe8fc0b2740 legacy=0x7fe8fc0d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc06c710 con 0x7fe8fc0ce1a0 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fe8f40019f0 con 0x7fe8fc0ce1a0 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 >> v1:172.21.15.55:6789/0 conn(0x7fe8fc0ce1a0 legacy=0x7fe8fc0ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc0d0490 0x7fe8e80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 0x7fe8e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e8004d40 0x7fe8e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e800bbd0 con 0x7fe8e8004010 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e800bd80 con 0x7fe8e8004d40 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e800bf80 con 0x7fe8fc0d0490 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe900a4e640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 0x7fe8e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe90124f640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc0d0490 0x7fe8e80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe901a50640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e8004d40 0x7fe8e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe900a4e640 1 -- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc0d0490 msgr2=0x7fe8e80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe900a4e640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc0d0490 0x7fe8e80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe900a4e640 1 -- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e8004d40 msgr2=0x7fe8e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.937+0000 7fe900a4e640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e8004d40 0x7fe8e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.938+0000 7fe900a4e640 1 -- 172.21.15.55:0/309297324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e8003520 con 0x7fe8e8004010 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.938+0000 7fe901a50640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e8004d40 0x7fe8e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:50.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.938+0000 7fe900a4e640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 0x7fe8e8004800 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec001750 tx=0x7fe8e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bcc5ff0de477ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:50.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.938+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec001370 con 0x7fe8e8004010 2024-04-25T08:57:50.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.938+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ec0052d0 con 0x7fe8e8004010 2024-04-25T08:57:50.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.938+0000 7fe8f3fff640 1 -- 172.21.15.55:0/309297324 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec02abe0 con 0x7fe8e8004010 2024-04-25T08:57:50.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.939+0000 7fe9034b3640 1 -- 172.21.15.55:0/309297324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 msgr2=0x7fe8e8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.939+0000 7fe9034b3640 1 --2- 172.21.15.55:0/309297324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 0x7fe8e8004800 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec001750 tx=0x7fe8e8005830 comp rx=0 tx=0).stop 2024-04-25T08:57:50.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.939+0000 7fe901a50640 1 -- 172.21.15.55:0/309297324 reap_dead start 2024-04-25T08:57:50.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.939+0000 7fe9034b3640 1 -- 172.21.15.55:0/309297324 shutdown_connections 2024-04-25T08:57:50.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.939+0000 7fe9034b3640 1 -- 172.21.15.55:0/309297324 >> 172.21.15.55:0/309297324 conn(0x7fe8fc0b5660 msgr2=0x7fe8fc0b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:50.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.939+0000 7fe9034b3640 1 -- 172.21.15.55:0/309297324 shutdown_connections 2024-04-25T08:57:50.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.939+0000 7fe9034b3640 1 -- 172.21.15.55:0/309297324 wait complete. 2024-04-25T08:57:50.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.940+0000 7fe9034b3640 1 Processor -- start 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.940+0000 7fe9034b3640 1 -- start start 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe9034b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 0x7fe8fc15b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe9034b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8fc0b77f0 0x7fe8fc15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe9034b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc14bf00 0x7fe8fc15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe9034b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc15e020 con 0x7fe8e8004010 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe9034b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc15ec90 con 0x7fe8fc0b77f0 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe9034b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc15ee10 con 0x7fe8fc14bf00 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe90124f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 0x7fe8fc15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe90124f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 0x7fe8fc15b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46562/0 (socket says 172.21.15.55:46562) 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe90124f640 1 -- 172.21.15.55:0/3530185965 learned_addr learned my addr 172.21.15.55:0/3530185965 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe901a50640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc14bf00 0x7fe8fc15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe900a4e640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8fc0b77f0 0x7fe8fc15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe90124f640 1 -- 172.21.15.55:0/3530185965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc14bf00 msgr2=0x7fe8fc15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe90124f640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc14bf00 0x7fe8fc15fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe90124f640 1 -- 172.21.15.55:0/3530185965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8fc0b77f0 msgr2=0x7fe8fc15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe90124f640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8fc0b77f0 0x7fe8fc15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.941+0000 7fe90124f640 1 -- 172.21.15.55:0/3530185965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc0b7f60 con 0x7fe8e8004010 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.942+0000 7fe90124f640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 0x7fe8fc15b190 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800b7f0 tx=0x7fe8f800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.942+0000 7fe8f1ffb640 1 -- 172.21.15.55:0/3530185965 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8018070 con 0x7fe8e8004010 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.942+0000 7fe8f1ffb640 1 -- 172.21.15.55:0/3530185965 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f8010830 con 0x7fe8e8004010 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.942+0000 7fe9034b3640 1 -- 172.21.15.55:0/3530185965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8fc159200 con 0x7fe8e8004010 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.942+0000 7fe8f1ffb640 1 -- 172.21.15.55:0/3530185965 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8010c00 con 0x7fe8e8004010 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.942+0000 7fe9034b3640 1 -- 172.21.15.55:0/3530185965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8fc0b7c80 con 0x7fe8e8004010 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.943+0000 7fe9034b3640 1 -- 172.21.15.55:0/3530185965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8fc0750b0 con 0x7fe8e8004010 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.944+0000 7fe8f1ffb640 1 -- 172.21.15.55:0/3530185965 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe8f801b070 con 0x7fe8e8004010 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.944+0000 7fe8f1ffb640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe8e006b4d0 0x7fe8e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.944+0000 7fe8f1ffb640 1 -- 172.21.15.55:0/3530185965 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8f808a8e0 con 0x7fe8e8004010 2024-04-25T08:57:50.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.944+0000 7fe900a4e640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe8e006b4d0 0x7fe8e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:50.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.944+0000 7fe900a4e640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe8e006b4d0 0x7fe8e006d990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec032000 tx=0x7fe8ec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:50.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:50.948+0000 7fe8f1ffb640 1 -- 172.21.15.55:0/3530185965 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe8f80596d0 con 0x7fe8e8004010 2024-04-25T08:57:51.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.165+0000 7fe9034b3640 1 -- 172.21.15.55:0/3530185965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe8fc0d18d0 con 0x7fe8e8004010 2024-04-25T08:57:51.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.192+0000 7fe8f1ffb640 1 -- 172.21.15.55:0/3530185965 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe8f8058fd0 con 0x7fe8e8004010 2024-04-25T08:57:51.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 -- 172.21.15.55:0/3530185965 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe8e006b4d0 msgr2=0x7fe8e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:51.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe8e006b4d0 0x7fe8e006d990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec032000 tx=0x7fe8ec02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:51.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 -- 172.21.15.55:0/3530185965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 msgr2=0x7fe8fc15b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:51.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 0x7fe8fc15b190 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800b7f0 tx=0x7fe8f800bcb0 comp rx=0 tx=0).stop 2024-04-25T08:57:51.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 -- 172.21.15.55:0/3530185965 shutdown_connections 2024-04-25T08:57:51.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe8e006b4d0 0x7fe8e006d990 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:51.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8fc14bf00 0x7fe8fc15fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:51.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8fc0b77f0 0x7fe8fc15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:51.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 --2- 172.21.15.55:0/3530185965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8004010 0x7fe8fc15b190 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:51.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 -- 172.21.15.55:0/3530185965 >> 172.21.15.55:0/3530185965 conn(0x7fe8fc0b5660 msgr2=0x7fe8fc1e75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:51.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 -- 172.21.15.55:0/3530185965 shutdown_connections 2024-04-25T08:57:51.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.195+0000 7fe9034b3640 1 -- 172.21.15.55:0/3530185965 wait complete. 2024-04-25T08:57:51.195 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:57:51.195 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:57:51.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.310+0000 7f3cc3b0a640 1 Processor -- start 2024-04-25T08:57:51.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.310+0000 7f3cc3b0a640 1 -- start start 2024-04-25T08:57:51.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc3b0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cbc15dc80 0x7f3cbc161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:51.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc3b0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3cbc0b97c0 0x7f3cbc0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:51.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc3b0a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cbc1627a0 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc3b0a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc0b5ea0 con 0x7f3cbc0b97c0 2024-04-25T08:57:51.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc3b0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc1621e0 con 0x7f3cbc15dc80 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc10a5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3cbc0b97c0 0x7f3cbc0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc10a5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3cbc0b97c0 0x7f3cbc0b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46572/0 (socket says 172.21.15.55:46572) 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc10a5640 1 -- 172.21.15.55:0/3198563400 learned_addr learned my addr 172.21.15.55:0/3198563400 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc18a6640 1 --2- 172.21.15.55:0/3198563400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cbc15dc80 0x7f3cbc161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc10a5640 1 -- 172.21.15.55:0/3198563400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cbc15dc80 msgr2=0x7f3cbc161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc10a5640 1 --2- 172.21.15.55:0/3198563400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cbc15dc80 0x7f3cbc161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc10a5640 1 -- 172.21.15.55:0/3198563400 >> v1:172.21.15.167:6789/0 conn(0x7f3cbc0b5a30 legacy=0x7f3cbc06bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.311+0000 7f3cc10a5640 1 -- 172.21.15.55:0/3198563400 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc1624c0 con 0x7f3cbc0b97c0 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.312+0000 7f3cc10a5640 1 --2- 172.21.15.55:0/3198563400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cbc0b97c0 0x7f3cbc0b54f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009870 tx=0x7f3cac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9143b90525436afe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.312+0000 7f3cc08a4640 1 -- 172.21.15.55:0/3198563400 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac037070 con 0x7f3cbc0b97c0 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.312+0000 7f3cc08a4640 1 -- 172.21.15.55:0/3198563400 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac032440 con 0x7f3cbc0b97c0 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.312+0000 7f3cc08a4640 1 -- 172.21.15.55:0/3198563400 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac032810 con 0x7f3cbc0b97c0 2024-04-25T08:57:51.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.313+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/3198563400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cbc0b97c0 msgr2=0x7f3cbc0b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:51.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.313+0000 7f3cc3b0a640 1 --2- 172.21.15.55:0/3198563400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cbc0b97c0 0x7f3cbc0b54f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009870 tx=0x7f3cac02a270 comp rx=0 tx=0).stop 2024-04-25T08:57:51.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.313+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/3198563400 shutdown_connections 2024-04-25T08:57:51.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.313+0000 7f3cc3b0a640 1 --2- 172.21.15.55:0/3198563400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cbc0b97c0 0x7f3cbc0b54f0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:51.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.313+0000 7f3cc3b0a640 1 --2- 172.21.15.55:0/3198563400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cbc15dc80 0x7f3cbc161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.313+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/3198563400 >> 172.21.15.55:0/3198563400 conn(0x7f3cbc0d04f0 msgr2=0x7f3cbc0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.313+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/3198563400 shutdown_connections 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.313+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/3198563400 wait complete. 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.314+0000 7f3cc3b0a640 1 Processor -- start 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.314+0000 7f3cc3b0a640 1 -- start start 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc3b0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cbc0b5a30 0x7f3cbc14cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc3b0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cbc0b97c0 0x7f3cbc0aa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc3b0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cbc15dc80 0x7f3cbc14e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc3b0a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc161db0 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc3b0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc15e060 con 0x7f3cbc0b97c0 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc3b0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc161f30 con 0x7f3cbc15dc80 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc18a6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cbc0b5a30 0x7f3cbc14cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:51.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc18a6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cbc0b5a30 0x7f3cbc14cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46578/0 (socket says 172.21.15.55:46578) 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc18a6640 1 -- 172.21.15.55:0/2663181907 learned_addr learned my addr 172.21.15.55:0/2663181907 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc10a5640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cbc0b97c0 0x7f3cbc0aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc20a7640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cbc15dc80 0x7f3cbc14e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc18a6640 1 -- 172.21.15.55:0/2663181907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cbc15dc80 msgr2=0x7f3cbc14e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc18a6640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cbc15dc80 0x7f3cbc14e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc18a6640 1 -- 172.21.15.55:0/2663181907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cbc0b97c0 msgr2=0x7f3cbc0aa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc18a6640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cbc0b97c0 0x7f3cbc0aa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc18a6640 1 -- 172.21.15.55:0/2663181907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc14d300 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc20a7640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cbc15dc80 0x7f3cbc14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc18a6640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cbc0b5a30 0x7f3cbc14cc90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800d600 tx=0x7f3cb800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cb27fc640 1 -- 172.21.15.55:0/2663181907 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80125f0 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cb27fc640 1 -- 172.21.15.55:0/2663181907 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8019070 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cb27fc640 1 -- 172.21.15.55:0/2663181907 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80129f0 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.315+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/2663181907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc14d5e0 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.316+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/2663181907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc14dba0 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.317+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/2663181907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc0750b0 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.317+0000 7f3cb27fc640 1 -- 172.21.15.55:0/2663181907 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3cb8012b90 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.317+0000 7f3cb27fc640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ca006b4d0 0x7f3ca006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:51.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.317+0000 7f3cb27fc640 1 -- 172.21.15.55:0/2663181907 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cb808a5e0 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.317+0000 7f3cc10a5640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ca006b4d0 0x7f3ca006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:51.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.318+0000 7f3cc10a5640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ca006b4d0 0x7f3ca006d990 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3cac034000 tx=0x7f3cac02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:51.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.322+0000 7f3cb27fc640 1 -- 172.21.15.55:0/2663181907 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3cb8059450 con 0x7f3cbc0b5a30 2024-04-25T08:57:51.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:51.541+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/2663181907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3cbc0b2d50 con 0x7f3cbc0b5a30 2024-04-25T08:57:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.194+0000 7f3cb27fc640 1 -- 172.21.15.55:0/2663181907 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3cb8058d50 con 0x7f3cbc0b5a30 2024-04-25T08:57:52.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/2663181907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ca006b4d0 msgr2=0x7f3ca006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ca006b4d0 0x7f3ca006d990 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3cac034000 tx=0x7f3cac02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/2663181907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cbc0b5a30 msgr2=0x7f3cbc14cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cbc0b5a30 0x7f3cbc14cc90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800d600 tx=0x7f3cb800dac0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/2663181907 shutdown_connections 2024-04-25T08:57:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3ca006b4d0 0x7f3ca006d990 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cbc15dc80 0x7f3cbc14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cbc0b97c0 0x7f3cbc0aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 --2- 172.21.15.55:0/2663181907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cbc0b5a30 0x7f3cbc14cc90 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/2663181907 >> 172.21.15.55:0/2663181907 conn(0x7f3cbc0d04f0 msgr2=0x7f3cbc0b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/2663181907 shutdown_connections 2024-04-25T08:57:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.197+0000 7f3cc3b0a640 1 -- 172.21.15.55:0/2663181907 wait complete. 2024-04-25T08:57:52.200 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:57:52.200 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:52.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.320+0000 7fdd3976a640 1 Processor -- start 2024-04-25T08:57:52.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.320+0000 7fdd3976a640 1 -- start start 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd3976a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd3415dce0 0x7fdd340d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd3976a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd340d35b0 0x7fdd340b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd3976a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3415e0c0 con 0x7fdd340d1f90 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd3976a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd340b7b10 con 0x7fdd3415dce0 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd3976a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd340d2510 con 0x7fdd340d35b0 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd32ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd3415dce0 0x7fdd340d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd32ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd3415dce0 0x7fdd340d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46594/0 (socket says 172.21.15.55:46594) 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd32ffd640 1 -- 172.21.15.55:0/2439087779 learned_addr learned my addr 172.21.15.55:0/2439087779 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd32ffd640 1 -- 172.21.15.55:0/2439087779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd340d35b0 msgr2=0x7fdd340b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd327fc640 1 --2- 172.21.15.55:0/2439087779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd340d35b0 0x7fdd340b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd32ffd640 1 --2- 172.21.15.55:0/2439087779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd340d35b0 0x7fdd340b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd32ffd640 1 -- 172.21.15.55:0/2439087779 >> v1:172.21.15.167:6789/0 conn(0x7fdd340d1f90 legacy=0x7fdd3406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd32ffd640 1 -- 172.21.15.55:0/2439087779 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd340d27f0 con 0x7fdd3415dce0 2024-04-25T08:57:52.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.321+0000 7fdd327fc640 1 --2- 172.21.15.55:0/2439087779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd340d35b0 0x7fdd340b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.322+0000 7fdd32ffd640 1 --2- 172.21.15.55:0/2439087779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd3415dce0 0x7fdd340d1a50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009870 tx=0x7fdd2402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280d54b0663178e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.322+0000 7fdd31ffb640 1 -- 172.21.15.55:0/2439087779 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24037070 con 0x7fdd3415dce0 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.322+0000 7fdd31ffb640 1 -- 172.21.15.55:0/2439087779 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd24032440 con 0x7fdd3415dce0 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.322+0000 7fdd31ffb640 1 -- 172.21.15.55:0/2439087779 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24032810 con 0x7fdd3415dce0 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.323+0000 7fdd3976a640 1 -- 172.21.15.55:0/2439087779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd3415dce0 msgr2=0x7fdd340d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.323+0000 7fdd3976a640 1 --2- 172.21.15.55:0/2439087779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd3415dce0 0x7fdd340d1a50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009870 tx=0x7fdd2402a180 comp rx=0 tx=0).stop 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.323+0000 7fdd3976a640 1 -- 172.21.15.55:0/2439087779 shutdown_connections 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.323+0000 7fdd3976a640 1 --2- 172.21.15.55:0/2439087779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd340d35b0 0x7fdd340b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.323+0000 7fdd3976a640 1 --2- 172.21.15.55:0/2439087779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd3415dce0 0x7fdd340d1a50 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.323+0000 7fdd3976a640 1 -- 172.21.15.55:0/2439087779 >> 172.21.15.55:0/2439087779 conn(0x7fdd34072900 msgr2=0x7fdd340d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.323+0000 7fdd3976a640 1 -- 172.21.15.55:0/2439087779 shutdown_connections 2024-04-25T08:57:52.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.323+0000 7fdd3976a640 1 -- 172.21.15.55:0/2439087779 wait complete. 2024-04-25T08:57:52.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.324+0000 7fdd3976a640 1 Processor -- start 2024-04-25T08:57:52.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.324+0000 7fdd3976a640 1 -- start start 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd3976a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd340d1f90 0x7fdd3415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd3976a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd340d35b0 0x7fdd340c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd3976a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd3415dce0 0x7fdd3415e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd3976a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd340d3090 con 0x7fdd340d35b0 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd3976a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd340d2db0 con 0x7fdd3415dce0 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd3976a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd340b9820 con 0x7fdd340d1f90 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd327fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd340d35b0 0x7fdd340c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd327fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd340d35b0 0x7fdd340c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46596/0 (socket says 172.21.15.55:46596) 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd327fc640 1 -- 172.21.15.55:0/2931040757 learned_addr learned my addr 172.21.15.55:0/2931040757 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd32ffd640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd340d1f90 0x7fdd3415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd337fe640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd3415dce0 0x7fdd3415e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd327fc640 1 -- 172.21.15.55:0/2931040757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd340d1f90 msgr2=0x7fdd3415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd327fc640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd340d1f90 0x7fdd3415bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd327fc640 1 -- 172.21.15.55:0/2931040757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd3415dce0 msgr2=0x7fdd3415e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd327fc640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd3415dce0 0x7fdd3415e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.325+0000 7fdd327fc640 1 -- 172.21.15.55:0/2931040757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3415fb30 con 0x7fdd340d35b0 2024-04-25T08:57:52.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.326+0000 7fdd327fc640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd340d35b0 0x7fdd340c9bc0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800c820 tx=0x7fdd2800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:52.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.326+0000 7fdd1b7fe640 1 -- 172.21.15.55:0/2931040757 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd28015070 con 0x7fdd340d35b0 2024-04-25T08:57:52.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.326+0000 7fdd1b7fe640 1 -- 172.21.15.55:0/2931040757 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd28007a30 con 0x7fdd340d35b0 2024-04-25T08:57:52.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.326+0000 7fdd1b7fe640 1 -- 172.21.15.55:0/2931040757 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd28007e00 con 0x7fdd340d35b0 2024-04-25T08:57:52.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.326+0000 7fdd3976a640 1 -- 172.21.15.55:0/2931040757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3415fda0 con 0x7fdd340d35b0 2024-04-25T08:57:52.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.326+0000 7fdd3976a640 1 -- 172.21.15.55:0/2931040757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd34160360 con 0x7fdd340d35b0 2024-04-25T08:57:52.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.327+0000 7fdd3976a640 1 -- 172.21.15.55:0/2931040757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd340749b0 con 0x7fdd340d35b0 2024-04-25T08:57:52.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.327+0000 7fdd1b7fe640 1 -- 172.21.15.55:0/2931040757 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd28018070 con 0x7fdd340d35b0 2024-04-25T08:57:52.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.328+0000 7fdd1b7fe640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd2006b4d0 0x7fdd2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.328+0000 7fdd1b7fe640 1 -- 172.21.15.55:0/2931040757 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd2808a140 con 0x7fdd340d35b0 2024-04-25T08:57:52.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.328+0000 7fdd32ffd640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd2006b4d0 0x7fdd2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.328+0000 7fdd32ffd640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd2006b4d0 0x7fdd2006d990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdd24034000 tx=0x7fdd2402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:52.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.332+0000 7fdd1b7fe640 1 -- 172.21.15.55:0/2931040757 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdd28058fc0 con 0x7fdd340d35b0 2024-04-25T08:57:52.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.550+0000 7fdd3976a640 1 -- 172.21.15.55:0/2931040757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd3406b080 con 0x7fdd340d35b0 2024-04-25T08:57:52.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.550+0000 7fdd1b7fe640 1 -- 172.21.15.55:0/2931040757 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4937 (secure 0 0 0) 0x7fdd280588c0 con 0x7fdd340d35b0 2024-04-25T08:57:52.540 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:52.540 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:57:51.543169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6609":{"gid":6609,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/173615501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":173615501},{"type":"v1","addr":"172.21.15.55:6837","nonce":173615501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:57:52.540 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 36 2024-04-25T08:57:52.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 -- 172.21.15.55:0/2931040757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd2006b4d0 msgr2=0x7fdd2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd2006b4d0 0x7fdd2006d990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdd24034000 tx=0x7fdd2402e000 comp rx=0 tx=0).stop 2024-04-25T08:57:52.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 -- 172.21.15.55:0/2931040757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd340d35b0 msgr2=0x7fdd340c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd340d35b0 0x7fdd340c9bc0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800c820 tx=0x7fdd2800cc20 comp rx=0 tx=0).stop 2024-04-25T08:57:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 -- 172.21.15.55:0/2931040757 shutdown_connections 2024-04-25T08:57:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdd2006b4d0 0x7fdd2006d990 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd3415dce0 0x7fdd3415e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd340d35b0 0x7fdd340c9bc0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 --2- 172.21.15.55:0/2931040757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd340d1f90 0x7fdd3415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 -- 172.21.15.55:0/2931040757 >> 172.21.15.55:0/2931040757 conn(0x7fdd34072900 msgr2=0x7fdd340b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 -- 172.21.15.55:0/2931040757 shutdown_connections 2024-04-25T08:57:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.553+0000 7fdd3976a640 1 -- 172.21.15.55:0/2931040757 wait complete. 2024-04-25T08:57:52.553 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:57:52.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.665+0000 7f877cc37640 1 Processor -- start 2024-04-25T08:57:52.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.665+0000 7f877cc37640 1 -- start start 2024-04-25T08:57:52.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f877cc37640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f877815dce0 0x7f87780d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f877cc37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87780d35b0 0x7f87780b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f877cc37640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87780d1f90 0x7f87780b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f877cc37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877815e0c0 con 0x7f87780d35b0 2024-04-25T08:57:52.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f877cc37640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87780d2510 con 0x7f877815dce0 2024-04-25T08:57:52.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f877cc37640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87780d27f0 con 0x7f87780d1f90 2024-04-25T08:57:52.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f8775d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87780d35b0 0x7f87780b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f8775d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87780d35b0 0x7f87780b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46598/0 (socket says 172.21.15.55:46598) 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f8775d9b640 1 -- 172.21.15.55:0/1650733270 learned_addr learned my addr 172.21.15.55:0/1650733270 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f8776d9d640 1 --2- 172.21.15.55:0/1650733270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87780d1f90 0x7f87780b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f877659c640 1 --2- 172.21.15.55:0/1650733270 >> v2:172.21.15.167:3300/0 conn(0x7f877815dce0 0x7f87780d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f8775d9b640 1 -- 172.21.15.55:0/1650733270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87780d1f90 msgr2=0x7f87780b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f8775d9b640 1 --2- 172.21.15.55:0/1650733270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87780d1f90 0x7f87780b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f8775d9b640 1 -- 172.21.15.55:0/1650733270 >> v2:172.21.15.167:3300/0 conn(0x7f877815dce0 msgr2=0x7f87780d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f8775d9b640 1 --2- 172.21.15.55:0/1650733270 >> v2:172.21.15.167:3300/0 conn(0x7f877815dce0 0x7f87780d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.666+0000 7f8775d9b640 1 -- 172.21.15.55:0/1650733270 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780d2ad0 con 0x7f87780d35b0 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.667+0000 7f8775d9b640 1 --2- 172.21.15.55:0/1650733270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87780d35b0 0x7f87780b5450 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f87780ce220 tx=0x7f876c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f251be3fe3ef16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.667+0000 7f877559a640 1 -- 172.21.15.55:0/1650733270 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c037070 con 0x7f87780d35b0 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.667+0000 7f877559a640 1 -- 172.21.15.55:0/1650733270 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c032440 con 0x7f87780d35b0 2024-04-25T08:57:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.667+0000 7f877559a640 1 -- 172.21.15.55:0/1650733270 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c032810 con 0x7f87780d35b0 2024-04-25T08:57:52.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.668+0000 7f877cc37640 1 -- 172.21.15.55:0/1650733270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87780d35b0 msgr2=0x7f87780b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.668+0000 7f877cc37640 1 --2- 172.21.15.55:0/1650733270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87780d35b0 0x7f87780b5450 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f87780ce220 tx=0x7f876c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.668+0000 7f877cc37640 1 -- 172.21.15.55:0/1650733270 shutdown_connections 2024-04-25T08:57:52.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.668+0000 7f877cc37640 1 --2- 172.21.15.55:0/1650733270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87780d1f90 0x7f87780b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.668+0000 7f877cc37640 1 --2- 172.21.15.55:0/1650733270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87780d35b0 0x7f87780b5450 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.668+0000 7f877cc37640 1 --2- 172.21.15.55:0/1650733270 >> v2:172.21.15.167:3300/0 conn(0x7f877815dce0 0x7f87780d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.668+0000 7f877cc37640 1 -- 172.21.15.55:0/1650733270 >> 172.21.15.55:0/1650733270 conn(0x7f8778072900 msgr2=0x7f87780d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:52.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.668+0000 7f877cc37640 1 -- 172.21.15.55:0/1650733270 shutdown_connections 2024-04-25T08:57:52.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.668+0000 7f877cc37640 1 -- 172.21.15.55:0/1650733270 wait complete. 2024-04-25T08:57:52.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.669+0000 7f877cc37640 1 Processor -- start 2024-04-25T08:57:52.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.669+0000 7f877cc37640 1 -- start start 2024-04-25T08:57:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877cc37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87780d1f90 0x7f87781f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877cc37640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87780d35b0 0x7f877815fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877cc37640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f877815dce0 0x7f8778160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877cc37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87780b9820 con 0x7f87780d1f90 2024-04-25T08:57:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877cc37640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87780d3090 con 0x7f877815dce0 2024-04-25T08:57:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877cc37640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87780b99a0 con 0x7f87780d35b0 2024-04-25T08:57:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87780d1f90 0x7f87781f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87780d1f90 0x7f87781f3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46606/0 (socket says 172.21.15.55:46606) 2024-04-25T08:57:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877659c640 1 -- 172.21.15.55:0/5005673 learned_addr learned my addr 172.21.15.55:0/5005673 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f8775d9b640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87780d35b0 0x7f877815fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f8776d9d640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f877815dce0 0x7f8778160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877659c640 1 -- 172.21.15.55:0/5005673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87780d35b0 msgr2=0x7f877815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877659c640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87780d35b0 0x7f877815fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877659c640 1 -- 172.21.15.55:0/5005673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f877815dce0 msgr2=0x7f8778160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877659c640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f877815dce0 0x7f8778160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877659c640 1 -- 172.21.15.55:0/5005673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87781f37e0 con 0x7f87780d1f90 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877659c640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87780d1f90 0x7f87781f3e70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f876800d800 tx=0x7f876800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f8766ffd640 1 -- 172.21.15.55:0/5005673 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800b6c0 con 0x7f87780d1f90 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f8766ffd640 1 -- 172.21.15.55:0/5005673 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768019070 con 0x7f87780d1f90 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f8766ffd640 1 -- 172.21.15.55:0/5005673 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800ba80 con 0x7f87780d1f90 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.670+0000 7f877cc37640 1 -- 172.21.15.55:0/5005673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87781f43b0 con 0x7f87780d1f90 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.671+0000 7f877cc37640 1 -- 172.21.15.55:0/5005673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877815f100 con 0x7f87780d1f90 2024-04-25T08:57:52.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.672+0000 7f877cc37640 1 -- 172.21.15.55:0/5005673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87780749b0 con 0x7f87780d1f90 2024-04-25T08:57:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.672+0000 7f8766ffd640 1 -- 172.21.15.55:0/5005673 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f876800bc20 con 0x7f87780d1f90 2024-04-25T08:57:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.672+0000 7f8766ffd640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f875806b4d0 0x7f875806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.673+0000 7f8766ffd640 1 -- 172.21.15.55:0/5005673 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f876808a780 con 0x7f87780d1f90 2024-04-25T08:57:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.673+0000 7f8775d9b640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f875806b4d0 0x7f875806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.673+0000 7f8775d9b640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f875806b4d0 0x7f875806d990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f876c034000 tx=0x7f876c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:52.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.677+0000 7f8766ffd640 1 -- 172.21.15.55:0/5005673 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8768059560 con 0x7f87780d1f90 2024-04-25T08:57:52.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.857+0000 7f877cc37640 1 -- 172.21.15.55:0/5005673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f877806b080 con 0x7f87780d1f90 2024-04-25T08:57:52.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.859+0000 7f8766ffd640 1 -- 172.21.15.55:0/5005673 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16668 (secure 0 0 0) 0x7f8768058e60 con 0x7f87780d1f90 2024-04-25T08:57:52.848 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:52.848 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":73,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:57:50.826466+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:47.819814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:48.522459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:57:52.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.860+0000 7f877cc37640 1 -- 172.21.15.55:0/5005673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f875806b4d0 msgr2=0x7f875806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.860+0000 7f877cc37640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f875806b4d0 0x7f875806d990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f876c034000 tx=0x7f876c02e000 comp rx=0 tx=0).stop 2024-04-25T08:57:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.861+0000 7f877cc37640 1 -- 172.21.15.55:0/5005673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87780d1f90 msgr2=0x7f87781f3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.861+0000 7f877cc37640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87780d1f90 0x7f87781f3e70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f876800d800 tx=0x7f876800dcc0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.861+0000 7f877cc37640 1 -- 172.21.15.55:0/5005673 shutdown_connections 2024-04-25T08:57:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.861+0000 7f877cc37640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f875806b4d0 0x7f875806d990 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.861+0000 7f877cc37640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f877815dce0 0x7f8778160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.861+0000 7f877cc37640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87780d35b0 0x7f877815fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.861+0000 7f877cc37640 1 --2- 172.21.15.55:0/5005673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87780d1f90 0x7f87781f3e70 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.861+0000 7f877cc37640 1 -- 172.21.15.55:0/5005673 >> 172.21.15.55:0/5005673 conn(0x7f8778072900 msgr2=0x7f87780b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.861+0000 7f877cc37640 1 -- 172.21.15.55:0/5005673 shutdown_connections 2024-04-25T08:57:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.861+0000 7f877cc37640 1 -- 172.21.15.55:0/5005673 wait complete. 2024-04-25T08:57:52.861 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:57:52.861 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:57:52.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.973+0000 7f82016fc640 1 Processor -- start 2024-04-25T08:57:52.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.973+0000 7f82016fc640 1 -- start start 2024-04-25T08:57:52.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f82016fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81fc15dce0 0x7f81fc0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f82016fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81fc0d35b0 0x7f81fc0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f82016fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81fc15e0c0 con 0x7f81fc0d1f90 2024-04-25T08:57:52.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f82016fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc0b7b10 con 0x7f81fc0d35b0 2024-04-25T08:57:52.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f82016fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0d2510 con 0x7f81fc15dce0 2024-04-25T08:57:52.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f81fa7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81fc0d35b0 0x7f81fc0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f81fa7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81fc0d35b0 0x7f81fc0b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46616/0 (socket says 172.21.15.55:46616) 2024-04-25T08:57:52.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f81fa7fc640 1 -- 172.21.15.55:0/2856577665 learned_addr learned my addr 172.21.15.55:0/2856577665 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f81faffd640 1 --2- 172.21.15.55:0/2856577665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81fc15dce0 0x7f81fc0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f81fa7fc640 1 -- 172.21.15.55:0/2856577665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81fc15dce0 msgr2=0x7f81fc0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f81fa7fc640 1 --2- 172.21.15.55:0/2856577665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81fc15dce0 0x7f81fc0d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f81fa7fc640 1 -- 172.21.15.55:0/2856577665 >> v1:172.21.15.167:6789/0 conn(0x7f81fc0d1f90 legacy=0x7f81fc06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.974+0000 7f81fa7fc640 1 -- 172.21.15.55:0/2856577665 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc0d27f0 con 0x7f81fc0d35b0 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.975+0000 7f81fa7fc640 1 --2- 172.21.15.55:0/2856577665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81fc0d35b0 0x7f81fc0b5450 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009870 tx=0x7f81f002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55be1d889212c181 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.975+0000 7f81f9ffb640 1 -- 172.21.15.55:0/2856577665 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0037070 con 0x7f81fc0d35b0 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.975+0000 7f81f9ffb640 1 -- 172.21.15.55:0/2856577665 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f0032440 con 0x7f81fc0d35b0 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.975+0000 7f81f9ffb640 1 -- 172.21.15.55:0/2856577665 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0032810 con 0x7f81fc0d35b0 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.976+0000 7f82016fc640 1 -- 172.21.15.55:0/2856577665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81fc0d35b0 msgr2=0x7f81fc0b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.976+0000 7f82016fc640 1 --2- 172.21.15.55:0/2856577665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81fc0d35b0 0x7f81fc0b5450 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009870 tx=0x7f81f002a1c0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.976+0000 7f82016fc640 1 -- 172.21.15.55:0/2856577665 shutdown_connections 2024-04-25T08:57:52.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.976+0000 7f82016fc640 1 --2- 172.21.15.55:0/2856577665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81fc0d35b0 0x7f81fc0b5450 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.976+0000 7f82016fc640 1 --2- 172.21.15.55:0/2856577665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81fc15dce0 0x7f81fc0d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.976+0000 7f82016fc640 1 -- 172.21.15.55:0/2856577665 >> 172.21.15.55:0/2856577665 conn(0x7f81fc072900 msgr2=0x7f81fc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:52.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.976+0000 7f82016fc640 1 -- 172.21.15.55:0/2856577665 shutdown_connections 2024-04-25T08:57:52.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.976+0000 7f82016fc640 1 -- 172.21.15.55:0/2856577665 wait complete. 2024-04-25T08:57:52.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.977+0000 7f82016fc640 1 Processor -- start 2024-04-25T08:57:52.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.977+0000 7f82016fc640 1 -- start start 2024-04-25T08:57:52.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f82016fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81fc0d1f90 0x7f81fc15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f82016fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81fc0d35b0 0x7f81fc0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f82016fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81fc15dce0 0x7f81fc0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f82016fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0d3090 con 0x7f81fc0d35b0 2024-04-25T08:57:52.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f82016fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0d2db0 con 0x7f81fc15dce0 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f82016fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0b9820 con 0x7f81fc0d1f90 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81fa7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81fc0d35b0 0x7f81fc0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81fa7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81fc0d35b0 0x7f81fc0b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46620/0 (socket says 172.21.15.55:46620) 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81fa7fc640 1 -- 172.21.15.55:0/1343899878 learned_addr learned my addr 172.21.15.55:0/1343899878 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81faffd640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81fc0d1f90 0x7f81fc15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81fb7fe640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81fc15dce0 0x7f81fc0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81fa7fc640 1 -- 172.21.15.55:0/1343899878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81fc0d1f90 msgr2=0x7f81fc15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81fa7fc640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81fc0d1f90 0x7f81fc15ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81fa7fc640 1 -- 172.21.15.55:0/1343899878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81fc15dce0 msgr2=0x7f81fc0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81fa7fc640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81fc15dce0 0x7f81fc0cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81fa7fc640 1 -- 172.21.15.55:0/1343899878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc15ef60 con 0x7f81fc0d35b0 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81fb7fe640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81fc15dce0 0x7f81fc0cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81fa7fc640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81fc0d35b0 0x7f81fc0b1d10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f81f0000c00 tx=0x7f81f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:52.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81e37fe640 1 -- 172.21.15.55:0/1343899878 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0041020 con 0x7f81fc0d35b0 2024-04-25T08:57:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.978+0000 7f81e37fe640 1 -- 172.21.15.55:0/1343899878 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f00306c0 con 0x7f81fc0d35b0 2024-04-25T08:57:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.979+0000 7f82016fc640 1 -- 172.21.15.55:0/1343899878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc0ccd50 con 0x7f81fc0d35b0 2024-04-25T08:57:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.979+0000 7f81e37fe640 1 -- 172.21.15.55:0/1343899878 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0037040 con 0x7f81fc0d35b0 2024-04-25T08:57:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.979+0000 7f82016fc640 1 -- 172.21.15.55:0/1343899878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc0cd310 con 0x7f81fc0d35b0 2024-04-25T08:57:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.979+0000 7f82016fc640 1 -- 172.21.15.55:0/1343899878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc0749b0 con 0x7f81fc0d35b0 2024-04-25T08:57:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.980+0000 7f81e37fe640 1 -- 172.21.15.55:0/1343899878 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f81f0044020 con 0x7f81fc0d35b0 2024-04-25T08:57:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.980+0000 7f81e37fe640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81e806b4d0 0x7f81e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.980+0000 7f81e37fe640 1 -- 172.21.15.55:0/1343899878 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81f00aaa20 con 0x7f81fc0d35b0 2024-04-25T08:57:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.981+0000 7f81faffd640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81e806b4d0 0x7f81e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.981+0000 7f81faffd640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81e806b4d0 0x7f81e806d990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f81ec006fd0 tx=0x7f81ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:52.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:52.985+0000 7f81e37fe640 1 -- 172.21.15.55:0/1343899878 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81f004b030 con 0x7f81fc0d35b0 2024-04-25T08:57:53.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.164+0000 7f82016fc640 1 -- 172.21.15.55:0/1343899878 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81fc15d270 con 0x7f81e806b4d0 2024-04-25T08:57:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.170+0000 7f81e37fe640 1 -- 172.21.15.55:0/1343899878 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247193 (secure 0 0 0) 0x7f81fc15d270 con 0x7f81e806b4d0 2024-04-25T08:57:53.163 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:57:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.173+0000 7f82016fc640 1 -- 172.21.15.55:0/1343899878 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81e806b4d0 msgr2=0x7f81e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.173+0000 7f82016fc640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81e806b4d0 0x7f81e806d990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f81ec006fd0 tx=0x7f81ec008040 comp rx=0 tx=0).stop 2024-04-25T08:57:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.173+0000 7f82016fc640 1 -- 172.21.15.55:0/1343899878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81fc0d35b0 msgr2=0x7f81fc0b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.173+0000 7f82016fc640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81fc0d35b0 0x7f81fc0b1d10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f81f0000c00 tx=0x7f81f00046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.173+0000 7f82016fc640 1 -- 172.21.15.55:0/1343899878 shutdown_connections 2024-04-25T08:57:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.173+0000 7f82016fc640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81e806b4d0 0x7f81e806d990 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.173+0000 7f82016fc640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81fc15dce0 0x7f81fc0cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.173+0000 7f82016fc640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81fc0d35b0 0x7f81fc0b1d10 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.173+0000 7f82016fc640 1 --2- 172.21.15.55:0/1343899878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81fc0d1f90 0x7f81fc15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.173+0000 7f82016fc640 1 -- 172.21.15.55:0/1343899878 >> 172.21.15.55:0/1343899878 conn(0x7f81fc072900 msgr2=0x7f81fc0b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.173+0000 7f82016fc640 1 -- 172.21.15.55:0/1343899878 shutdown_connections 2024-04-25T08:57:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.174+0000 7f82016fc640 1 -- 172.21.15.55:0/1343899878 wait complete. 2024-04-25T08:57:53.174 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-25T08:57:52.605884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592014,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240656,"kb_used_data":7832,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734064,"statfs":{"total":773094113280,"available":772847681536,"internally_reserved":0,"allocated":8019968,"data_stored":4014312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1646,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.434485"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189913+0000","last_change":"2024-04-25T08:57:49.189913+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189913+0000","last_undegraded":"2024-04-25T08:57:49.189913+0000","last_fullsized":"2024-04-25T08:57:49.189913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185400+0000","last_change":"2024-04-25T08:57:49.185400+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185400+0000","last_undegraded":"2024-04-25T08:57:49.185400+0000","last_fullsized":"2024-04-25T08:57:49.185400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.196576+0000","last_change":"2024-04-25T08:57:49.196576+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.196576+0000","last_undegraded":"2024-04-25T08:57:49.196576+0000","last_fullsized":"2024-04-25T08:57:49.196576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845941+0000","last_change":"2024-04-25T08:57:49.843433+0000","last_active":"2024-04-25T08:57:50.845941+0000","last_peered":"2024-04-25T08:57:50.845941+0000","last_clean":"2024-04-25T08:57:50.845941+0000","last_became_active":"2024-04-25T08:57:49.842997+0000","last_became_peered":"2024-04-25T08:57:49.842997+0000","last_unstale":"2024-04-25T08:57:50.845941+0000","last_undegraded":"2024-04-25T08:57:50.845941+0000","last_fullsized":"2024-04-25T08:57:50.845941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:00.690627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188384+0000","last_change":"2024-04-25T08:57:49.188384+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188384+0000","last_undegraded":"2024-04-25T08:57:49.188384+0000","last_fullsized":"2024-04-25T08:57:49.188384+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.186043+0000","last_change":"2024-04-25T08:57:49.186043+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.186043+0000","last_undegraded":"2024-04-25T08:57:49.186043+0000","last_fullsized":"2024-04-25T08:57:49.186043+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192147+0000","last_change":"2024-04-25T08:57:49.192147+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192147+0000","last_undegraded":"2024-04-25T08:57:49.192147+0000","last_fullsized":"2024-04-25T08:57:49.192147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185936+0000","last_change":"2024-04-25T08:57:49.185936+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185936+0000","last_undegraded":"2024-04-25T08:57:49.185936+0000","last_fullsized":"2024-04-25T08:57:49.185936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189680+0000","last_change":"2024-04-25T08:57:49.189680+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189680+0000","last_undegraded":"2024-04-25T08:57:49.189680+0000","last_fullsized":"2024-04-25T08:57:49.189680+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193533+0000","last_change":"2024-04-25T08:57:49.193533+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193533+0000","last_undegraded":"2024-04-25T08:57:49.193533+0000","last_fullsized":"2024-04-25T08:57:49.193533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189581+0000","last_change":"2024-04-25T08:57:49.189581+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189581+0000","last_undegraded":"2024-04-25T08:57:49.189581+0000","last_fullsized":"2024-04-25T08:57:49.189581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846107+0000","last_change":"2024-04-25T08:57:49.845838+0000","last_active":"2024-04-25T08:57:50.846107+0000","last_peered":"2024-04-25T08:57:50.846107+0000","last_clean":"2024-04-25T08:57:50.846107+0000","last_became_active":"2024-04-25T08:57:49.845562+0000","last_became_peered":"2024-04-25T08:57:49.845562+0000","last_unstale":"2024-04-25T08:57:50.846107+0000","last_undegraded":"2024-04-25T08:57:50.846107+0000","last_fullsized":"2024-04-25T08:57:50.846107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:23.131325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194521+0000","last_change":"2024-04-25T08:57:49.194521+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194521+0000","last_undegraded":"2024-04-25T08:57:49.194521+0000","last_fullsized":"2024-04-25T08:57:49.194521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189507+0000","last_change":"2024-04-25T08:57:49.189507+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189507+0000","last_undegraded":"2024-04-25T08:57:49.189507+0000","last_fullsized":"2024-04-25T08:57:49.189507+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.197918+0000","last_change":"2024-04-25T08:57:49.197918+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.197918+0000","last_undegraded":"2024-04-25T08:57:49.197918+0000","last_fullsized":"2024-04-25T08:57:49.197918+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.190819+0000","last_change":"2024-04-25T08:57:49.190819+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.190819+0000","last_undegraded":"2024-04-25T08:57:49.190819+0000","last_fullsized":"2024-04-25T08:57:49.190819+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189238+0000","last_change":"2024-04-25T08:57:49.189238+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189238+0000","last_undegraded":"2024-04-25T08:57:49.189238+0000","last_fullsized":"2024-04-25T08:57:49.189238+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846126+0000","last_change":"2024-04-25T08:57:49.844027+0000","last_active":"2024-04-25T08:57:50.846126+0000","last_peered":"2024-04-25T08:57:50.846126+0000","last_clean":"2024-04-25T08:57:50.846126+0000","last_became_active":"2024-04-25T08:57:49.843756+0000","last_became_peered":"2024-04-25T08:57:49.843756+0000","last_unstale":"2024-04-25T08:57:50.846126+0000","last_undegraded":"2024-04-25T08:57:50.846126+0000","last_fullsized":"2024-04-25T08:57:50.846126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:37.684246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185045+0000","last_change":"2024-04-25T08:57:49.185045+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185045+0000","last_undegraded":"2024-04-25T08:57:49.185045+0000","last_fullsized":"2024-04-25T08:57:49.185045+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195057+0000","last_change":"2024-04-25T08:57:49.195057+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195057+0000","last_undegraded":"2024-04-25T08:57:49.195057+0000","last_fullsized":"2024-04-25T08:57:49.195057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194165+0000","last_change":"2024-04-25T08:57:49.194165+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194165+0000","last_undegraded":"2024-04-25T08:57:49.194165+0000","last_fullsized":"2024-04-25T08:57:49.194165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.190485+0000","last_change":"2024-04-25T08:57:49.190485+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.190485+0000","last_undegraded":"2024-04-25T08:57:49.190485+0000","last_fullsized":"2024-04-25T08:57:49.190485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188149+0000","last_change":"2024-04-25T08:57:49.188149+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188149+0000","last_undegraded":"2024-04-25T08:57:49.188149+0000","last_fullsized":"2024-04-25T08:57:49.188149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187722+0000","last_change":"2024-04-25T08:57:49.187722+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187722+0000","last_undegraded":"2024-04-25T08:57:49.187722+0000","last_fullsized":"2024-04-25T08:57:49.187722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193974+0000","last_change":"2024-04-25T08:57:49.193974+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193974+0000","last_undegraded":"2024-04-25T08:57:49.193974+0000","last_fullsized":"2024-04-25T08:57:49.193974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194325+0000","last_change":"2024-04-25T08:57:49.194325+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194325+0000","last_undegraded":"2024-04-25T08:57:49.194325+0000","last_fullsized":"2024-04-25T08:57:49.194325+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.196022+0000","last_change":"2024-04-25T08:57:49.196022+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.196022+0000","last_undegraded":"2024-04-25T08:57:49.196022+0000","last_fullsized":"2024-04-25T08:57:49.196022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191584+0000","last_change":"2024-04-25T08:57:49.191584+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191584+0000","last_undegraded":"2024-04-25T08:57:49.191584+0000","last_fullsized":"2024-04-25T08:57:49.191584+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195517+0000","last_change":"2024-04-25T08:57:49.195517+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195517+0000","last_undegraded":"2024-04-25T08:57:49.195517+0000","last_fullsized":"2024-04-25T08:57:49.195517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192841+0000","last_change":"2024-04-25T08:57:49.192841+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192841+0000","last_undegraded":"2024-04-25T08:57:49.192841+0000","last_fullsized":"2024-04-25T08:57:49.192841+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191293+0000","last_change":"2024-04-25T08:57:49.191293+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191293+0000","last_undegraded":"2024-04-25T08:57:49.191293+0000","last_fullsized":"2024-04-25T08:57:49.191293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.184663+0000","last_change":"2024-04-25T08:57:49.184663+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.184663+0000","last_undegraded":"2024-04-25T08:57:49.184663+0000","last_fullsized":"2024-04-25T08:57:49.184663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187865+0000","last_change":"2024-04-25T08:57:49.187865+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187865+0000","last_undegraded":"2024-04-25T08:57:49.187865+0000","last_fullsized":"2024-04-25T08:57:49.187865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205876+0000","last_change":"2024-04-25T08:57:49.204071+0000","last_active":"2024-04-25T08:57:49.205876+0000","last_peered":"2024-04-25T08:57:49.205876+0000","last_clean":"2024-04-25T08:57:49.205876+0000","last_became_active":"2024-04-25T08:57:49.203657+0000","last_became_peered":"2024-04-25T08:57:49.203657+0000","last_unstale":"2024-04-25T08:57:49.205876+0000","last_undegraded":"2024-04-25T08:57:49.205876+0000","last_fullsized":"2024-04-25T08:57:49.205876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:08.452486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188708+0000","last_change":"2024-04-25T08:57:49.188708+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188708+0000","last_undegraded":"2024-04-25T08:57:49.188708+0000","last_fullsized":"2024-04-25T08:57:49.188708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208494+0000","last_change":"2024-04-25T08:57:49.204785+0000","last_active":"2024-04-25T08:57:49.208494+0000","last_peered":"2024-04-25T08:57:49.208494+0000","last_clean":"2024-04-25T08:57:49.208494+0000","last_became_active":"2024-04-25T08:57:49.204484+0000","last_became_peered":"2024-04-25T08:57:49.204484+0000","last_unstale":"2024-04-25T08:57:49.208494+0000","last_undegraded":"2024-04-25T08:57:49.208494+0000","last_fullsized":"2024-04-25T08:57:49.208494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:10.848641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185935+0000","last_change":"2024-04-25T08:57:49.185935+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185935+0000","last_undegraded":"2024-04-25T08:57:49.185935+0000","last_fullsized":"2024-04-25T08:57:49.185935+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.203012+0000","last_change":"2024-04-25T08:57:49.200263+0000","last_active":"2024-04-25T08:57:49.203012+0000","last_peered":"2024-04-25T08:57:49.203012+0000","last_clean":"2024-04-25T08:57:49.203012+0000","last_became_active":"2024-04-25T08:57:49.199990+0000","last_became_peered":"2024-04-25T08:57:49.199990+0000","last_unstale":"2024-04-25T08:57:49.203012+0000","last_undegraded":"2024-04-25T08:57:49.203012+0000","last_fullsized":"2024-04-25T08:57:49.203012+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:25.735805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189051+0000","last_change":"2024-04-25T08:57:49.189051+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189051+0000","last_undegraded":"2024-04-25T08:57:49.189051+0000","last_fullsized":"2024-04-25T08:57:49.189051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.197550+0000","last_change":"2024-04-25T08:57:49.193842+0000","last_active":"2024-04-25T08:57:49.197550+0000","last_peered":"2024-04-25T08:57:49.197550+0000","last_clean":"2024-04-25T08:57:49.197550+0000","last_became_active":"2024-04-25T08:57:49.193515+0000","last_became_peered":"2024-04-25T08:57:49.193515+0000","last_unstale":"2024-04-25T08:57:49.197550+0000","last_undegraded":"2024-04-25T08:57:49.197550+0000","last_fullsized":"2024-04-25T08:57:49.197550+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:34.530548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191916+0000","last_change":"2024-04-25T08:57:49.191916+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191916+0000","last_undegraded":"2024-04-25T08:57:49.191916+0000","last_fullsized":"2024-04-25T08:57:49.191916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.202646+0000","last_change":"2024-04-25T08:57:49.200083+0000","last_active":"2024-04-25T08:57:49.202646+0000","last_peered":"2024-04-25T08:57:49.202646+0000","last_clean":"2024-04-25T08:57:49.202646+0000","last_became_active":"2024-04-25T08:57:49.199768+0000","last_became_peered":"2024-04-25T08:57:49.199768+0000","last_unstale":"2024-04-25T08:57:49.202646+0000","last_undegraded":"2024-04-25T08:57:49.202646+0000","last_fullsized":"2024-04-25T08:57:49.202646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:20.826126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193688+0000","last_change":"2024-04-25T08:57:49.193688+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193688+0000","last_undegraded":"2024-04-25T08:57:49.193688+0000","last_fullsized":"2024-04-25T08:57:49.193688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205811+0000","last_change":"2024-04-25T08:57:49.204607+0000","last_active":"2024-04-25T08:57:49.205811+0000","last_peered":"2024-04-25T08:57:49.205811+0000","last_clean":"2024-04-25T08:57:49.205811+0000","last_became_active":"2024-04-25T08:57:49.204298+0000","last_became_peered":"2024-04-25T08:57:49.204298+0000","last_unstale":"2024-04-25T08:57:49.205811+0000","last_undegraded":"2024-04-25T08:57:49.205811+0000","last_fullsized":"2024-04-25T08:57:49.205811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:28.260907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187961+0000","last_change":"2024-04-25T08:57:49.187961+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187961+0000","last_undegraded":"2024-04-25T08:57:49.187961+0000","last_fullsized":"2024-04-25T08:57:49.187961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845764+0000","last_change":"2024-04-25T08:57:49.201987+0000","last_active":"2024-04-25T08:57:50.845764+0000","last_peered":"2024-04-25T08:57:50.845764+0000","last_clean":"2024-04-25T08:57:50.845764+0000","last_became_active":"2024-04-25T08:57:49.201668+0000","last_became_peered":"2024-04-25T08:57:49.201668+0000","last_unstale":"2024-04-25T08:57:50.845764+0000","last_undegraded":"2024-04-25T08:57:50.845764+0000","last_fullsized":"2024-04-25T08:57:50.845764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:02.728261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195966+0000","last_change":"2024-04-25T08:57:49.195966+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195966+0000","last_undegraded":"2024-04-25T08:57:49.195966+0000","last_fullsized":"2024-04-25T08:57:49.195966+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199827+0000","last_change":"2024-04-25T08:57:49.192553+0000","last_active":"2024-04-25T08:57:49.199827+0000","last_peered":"2024-04-25T08:57:49.199827+0000","last_clean":"2024-04-25T08:57:49.199827+0000","last_became_active":"2024-04-25T08:57:49.192250+0000","last_became_peered":"2024-04-25T08:57:49.192250+0000","last_unstale":"2024-04-25T08:57:49.199827+0000","last_undegraded":"2024-04-25T08:57:49.199827+0000","last_fullsized":"2024-04-25T08:57:49.199827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:22.257572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193848+0000","last_change":"2024-04-25T08:57:49.193848+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193848+0000","last_undegraded":"2024-04-25T08:57:49.193848+0000","last_fullsized":"2024-04-25T08:57:49.193848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205248+0000","last_change":"2024-04-25T08:57:49.202591+0000","last_active":"2024-04-25T08:57:49.205248+0000","last_peered":"2024-04-25T08:57:49.205248+0000","last_clean":"2024-04-25T08:57:49.205248+0000","last_became_active":"2024-04-25T08:57:49.202288+0000","last_became_peered":"2024-04-25T08:57:49.202288+0000","last_unstale":"2024-04-25T08:57:49.205248+0000","last_undegraded":"2024-04-25T08:57:49.205248+0000","last_fullsized":"2024-04-25T08:57:49.205248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:34.916404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189069+0000","last_change":"2024-04-25T08:57:49.189069+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189069+0000","last_undegraded":"2024-04-25T08:57:49.189069+0000","last_fullsized":"2024-04-25T08:57:49.189069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.200886+0000","last_change":"2024-04-25T08:57:49.199212+0000","last_active":"2024-04-25T08:57:49.200886+0000","last_peered":"2024-04-25T08:57:49.200886+0000","last_clean":"2024-04-25T08:57:49.200886+0000","last_became_active":"2024-04-25T08:57:49.198860+0000","last_became_peered":"2024-04-25T08:57:49.198860+0000","last_unstale":"2024-04-25T08:57:49.200886+0000","last_undegraded":"2024-04-25T08:57:49.200886+0000","last_fullsized":"2024-04-25T08:57:49.200886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:29.372407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185388+0000","last_change":"2024-04-25T08:57:49.185388+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185388+0000","last_undegraded":"2024-04-25T08:57:49.185388+0000","last_fullsized":"2024-04-25T08:57:49.185388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199149+0000","last_change":"2024-04-25T08:57:49.193690+0000","last_active":"2024-04-25T08:57:49.199149+0000","last_peered":"2024-04-25T08:57:49.199149+0000","last_clean":"2024-04-25T08:57:49.199149+0000","last_became_active":"2024-04-25T08:57:49.193363+0000","last_became_peered":"2024-04-25T08:57:49.193363+0000","last_unstale":"2024-04-25T08:57:49.199149+0000","last_undegraded":"2024-04-25T08:57:49.199149+0000","last_fullsized":"2024-04-25T08:57:49.199149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.044245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188883+0000","last_change":"2024-04-25T08:57:49.188883+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188883+0000","last_undegraded":"2024-04-25T08:57:49.188883+0000","last_fullsized":"2024-04-25T08:57:49.188883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846243+0000","last_change":"2024-04-25T08:57:49.198251+0000","last_active":"2024-04-25T08:57:50.846243+0000","last_peered":"2024-04-25T08:57:50.846243+0000","last_clean":"2024-04-25T08:57:50.846243+0000","last_became_active":"2024-04-25T08:57:49.197958+0000","last_became_peered":"2024-04-25T08:57:49.197958+0000","last_unstale":"2024-04-25T08:57:50.846243+0000","last_undegraded":"2024-04-25T08:57:50.846243+0000","last_fullsized":"2024-04-25T08:57:50.846243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.206185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187970+0000","last_change":"2024-04-25T08:57:49.187970+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187970+0000","last_undegraded":"2024-04-25T08:57:49.187970+0000","last_fullsized":"2024-04-25T08:57:49.187970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845968+0000","last_change":"2024-04-25T08:57:49.198379+0000","last_active":"2024-04-25T08:57:50.845968+0000","last_peered":"2024-04-25T08:57:50.845968+0000","last_clean":"2024-04-25T08:57:50.845968+0000","last_became_active":"2024-04-25T08:57:49.198053+0000","last_became_peered":"2024-04-25T08:57:49.198053+0000","last_unstale":"2024-04-25T08:57:50.845968+0000","last_undegraded":"2024-04-25T08:57:50.845968+0000","last_fullsized":"2024-04-25T08:57:50.845968+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:24.585656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192674+0000","last_change":"2024-04-25T08:57:49.192674+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192674+0000","last_undegraded":"2024-04-25T08:57:49.192674+0000","last_fullsized":"2024-04-25T08:57:49.192674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201819+0000","last_change":"2024-04-25T08:57:49.200592+0000","last_active":"2024-04-25T08:57:49.201819+0000","last_peered":"2024-04-25T08:57:49.201819+0000","last_clean":"2024-04-25T08:57:49.201819+0000","last_became_active":"2024-04-25T08:57:49.200309+0000","last_became_peered":"2024-04-25T08:57:49.200309+0000","last_unstale":"2024-04-25T08:57:49.201819+0000","last_undegraded":"2024-04-25T08:57:49.201819+0000","last_fullsized":"2024-04-25T08:57:49.201819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:00.354293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193883+0000","last_change":"2024-04-25T08:57:49.193883+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193883+0000","last_undegraded":"2024-04-25T08:57:49.193883+0000","last_fullsized":"2024-04-25T08:57:49.193883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.204416+0000","last_change":"2024-04-25T08:57:49.202467+0000","last_active":"2024-04-25T08:57:49.204416+0000","last_peered":"2024-04-25T08:57:49.204416+0000","last_clean":"2024-04-25T08:57:49.204416+0000","last_became_active":"2024-04-25T08:57:49.202182+0000","last_became_peered":"2024-04-25T08:57:49.202182+0000","last_unstale":"2024-04-25T08:57:49.204416+0000","last_undegraded":"2024-04-25T08:57:49.204416+0000","last_fullsized":"2024-04-25T08:57:49.204416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.464226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187658+0000","last_change":"2024-04-25T08:57:49.187658+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187658+0000","last_undegraded":"2024-04-25T08:57:49.187658+0000","last_fullsized":"2024-04-25T08:57:49.187658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201172+0000","last_change":"2024-04-25T08:57:49.199693+0000","last_active":"2024-04-25T08:57:49.201172+0000","last_peered":"2024-04-25T08:57:49.201172+0000","last_clean":"2024-04-25T08:57:49.201172+0000","last_became_active":"2024-04-25T08:57:49.199348+0000","last_became_peered":"2024-04-25T08:57:49.199348+0000","last_unstale":"2024-04-25T08:57:49.201172+0000","last_undegraded":"2024-04-25T08:57:49.201172+0000","last_fullsized":"2024-04-25T08:57:49.201172+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:11.998048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191499+0000","last_change":"2024-04-25T08:57:49.191499+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191499+0000","last_undegraded":"2024-04-25T08:57:49.191499+0000","last_fullsized":"2024-04-25T08:57:49.191499+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199063+0000","last_change":"2024-04-25T08:57:49.196147+0000","last_active":"2024-04-25T08:57:49.199063+0000","last_peered":"2024-04-25T08:57:49.199063+0000","last_clean":"2024-04-25T08:57:49.199063+0000","last_became_active":"2024-04-25T08:57:49.195241+0000","last_became_peered":"2024-04-25T08:57:49.195241+0000","last_unstale":"2024-04-25T08:57:49.199063+0000","last_undegraded":"2024-04-25T08:57:49.199063+0000","last_fullsized":"2024-04-25T08:57:49.199063+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:10.850720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188158+0000","last_change":"2024-04-25T08:57:49.188158+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188158+0000","last_undegraded":"2024-04-25T08:57:49.188158+0000","last_fullsized":"2024-04-25T08:57:49.188158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.203814+0000","last_change":"2024-04-25T08:57:49.201604+0000","last_active":"2024-04-25T08:57:49.203814+0000","last_peered":"2024-04-25T08:57:49.203814+0000","last_clean":"2024-04-25T08:57:49.203814+0000","last_became_active":"2024-04-25T08:57:49.201278+0000","last_became_peered":"2024-04-25T08:57:49.201278+0000","last_unstale":"2024-04-25T08:57:49.203814+0000","last_undegraded":"2024-04-25T08:57:49.203814+0000","last_fullsized":"2024-04-25T08:57:49.203814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:59.607582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846217+0000","last_change":"2024-04-25T08:57:49.846548+0000","last_active":"2024-04-25T08:57:50.846217+0000","last_peered":"2024-04-25T08:57:50.846217+0000","last_clean":"2024-04-25T08:57:50.846217+0000","last_became_active":"2024-04-25T08:57:49.846273+0000","last_became_peered":"2024-04-25T08:57:49.846273+0000","last_unstale":"2024-04-25T08:57:50.846217+0000","last_undegraded":"2024-04-25T08:57:50.846217+0000","last_fullsized":"2024-04-25T08:57:50.846217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:15.697708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.200892+0000","last_change":"2024-04-25T08:57:49.199525+0000","last_active":"2024-04-25T08:57:49.200892+0000","last_peered":"2024-04-25T08:57:49.200892+0000","last_clean":"2024-04-25T08:57:49.200892+0000","last_became_active":"2024-04-25T08:57:49.199026+0000","last_became_peered":"2024-04-25T08:57:49.199026+0000","last_unstale":"2024-04-25T08:57:49.200892+0000","last_undegraded":"2024-04-25T08:57:49.200892+0000","last_fullsized":"2024-04-25T08:57:49.200892+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:24.441411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188393+0000","last_change":"2024-04-25T08:57:49.188393+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188393+0000","last_undegraded":"2024-04-25T08:57:49.188393+0000","last_fullsized":"2024-04-25T08:57:49.188393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205118+0000","last_change":"2024-04-25T08:57:49.203809+0000","last_active":"2024-04-25T08:57:49.205118+0000","last_peered":"2024-04-25T08:57:49.205118+0000","last_clean":"2024-04-25T08:57:49.205118+0000","last_became_active":"2024-04-25T08:57:49.203459+0000","last_became_peered":"2024-04-25T08:57:49.203459+0000","last_unstale":"2024-04-25T08:57:49.205118+0000","last_undegraded":"2024-04-25T08:57:49.205118+0000","last_fullsized":"2024-04-25T08:57:49.205118+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193606+0000","last_change":"2024-04-25T08:57:49.193606+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193606+0000","last_undegraded":"2024-04-25T08:57:49.193606+0000","last_fullsized":"2024-04-25T08:57:49.193606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205792+0000","last_change":"2024-04-25T08:57:49.203616+0000","last_active":"2024-04-25T08:57:49.205792+0000","last_peered":"2024-04-25T08:57:49.205792+0000","last_clean":"2024-04-25T08:57:49.205792+0000","last_became_active":"2024-04-25T08:57:49.203330+0000","last_became_peered":"2024-04-25T08:57:49.203330+0000","last_unstale":"2024-04-25T08:57:49.205792+0000","last_undegraded":"2024-04-25T08:57:49.205792+0000","last_fullsized":"2024-04-25T08:57:49.205792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:18.344931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192288+0000","last_change":"2024-04-25T08:57:49.192288+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192288+0000","last_undegraded":"2024-04-25T08:57:49.192288+0000","last_fullsized":"2024-04-25T08:57:49.192288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201520+0000","last_change":"2024-04-25T08:57:49.200461+0000","last_active":"2024-04-25T08:57:49.201520+0000","last_peered":"2024-04-25T08:57:49.201520+0000","last_clean":"2024-04-25T08:57:49.201520+0000","last_became_active":"2024-04-25T08:57:49.200166+0000","last_became_peered":"2024-04-25T08:57:49.200166+0000","last_unstale":"2024-04-25T08:57:49.201520+0000","last_undegraded":"2024-04-25T08:57:49.201520+0000","last_fullsized":"2024-04-25T08:57:49.201520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:45.768247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192305+0000","last_change":"2024-04-25T08:57:49.192305+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192305+0000","last_undegraded":"2024-04-25T08:57:49.192305+0000","last_fullsized":"2024-04-25T08:57:49.192305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208396+0000","last_change":"2024-04-25T08:57:49.204125+0000","last_active":"2024-04-25T08:57:49.208396+0000","last_peered":"2024-04-25T08:57:49.208396+0000","last_clean":"2024-04-25T08:57:49.208396+0000","last_became_active":"2024-04-25T08:57:49.203829+0000","last_became_peered":"2024-04-25T08:57:49.203829+0000","last_unstale":"2024-04-25T08:57:49.208396+0000","last_undegraded":"2024-04-25T08:57:49.208396+0000","last_fullsized":"2024-04-25T08:57:49.208396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:20.640318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.198297+0000","last_change":"2024-04-25T08:57:49.198297+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.198297+0000","last_undegraded":"2024-04-25T08:57:49.198297+0000","last_fullsized":"2024-04-25T08:57:49.198297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199039+0000","last_change":"2024-04-25T08:57:49.195696+0000","last_active":"2024-04-25T08:57:49.199039+0000","last_peered":"2024-04-25T08:57:49.199039+0000","last_clean":"2024-04-25T08:57:49.199039+0000","last_became_active":"2024-04-25T08:57:49.195396+0000","last_became_peered":"2024-04-25T08:57:49.195396+0000","last_unstale":"2024-04-25T08:57:49.199039+0000","last_undegraded":"2024-04-25T08:57:49.199039+0000","last_fullsized":"2024-04-25T08:57:49.199039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:41.508120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192584+0000","last_change":"2024-04-25T08:57:49.192584+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192584+0000","last_undegraded":"2024-04-25T08:57:49.192584+0000","last_fullsized":"2024-04-25T08:57:49.192584+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.206257+0000","last_change":"2024-04-25T08:57:49.204999+0000","last_active":"2024-04-25T08:57:49.206257+0000","last_peered":"2024-04-25T08:57:49.206257+0000","last_clean":"2024-04-25T08:57:49.206257+0000","last_became_active":"2024-04-25T08:57:49.204637+0000","last_became_peered":"2024-04-25T08:57:49.204637+0000","last_unstale":"2024-04-25T08:57:49.206257+0000","last_undegraded":"2024-04-25T08:57:49.206257+0000","last_fullsized":"2024-04-25T08:57:49.206257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188164+0000","last_change":"2024-04-25T08:57:49.188164+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188164+0000","last_undegraded":"2024-04-25T08:57:49.188164+0000","last_fullsized":"2024-04-25T08:57:49.188164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208398+0000","last_change":"2024-04-25T08:57:49.204319+0000","last_active":"2024-04-25T08:57:49.208398+0000","last_peered":"2024-04-25T08:57:49.208398+0000","last_clean":"2024-04-25T08:57:49.208398+0000","last_became_active":"2024-04-25T08:57:49.203999+0000","last_became_peered":"2024-04-25T08:57:49.203999+0000","last_unstale":"2024-04-25T08:57:49.208398+0000","last_undegraded":"2024-04-25T08:57:49.208398+0000","last_fullsized":"2024-04-25T08:57:49.208398+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:31.676546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188647+0000","last_change":"2024-04-25T08:57:49.188647+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188647+0000","last_undegraded":"2024-04-25T08:57:49.188647+0000","last_fullsized":"2024-04-25T08:57:49.188647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.206105+0000","last_change":"2024-04-25T08:57:49.201643+0000","last_active":"2024-04-25T08:57:49.206105+0000","last_peered":"2024-04-25T08:57:49.206105+0000","last_clean":"2024-04-25T08:57:49.206105+0000","last_became_active":"2024-04-25T08:57:49.201323+0000","last_became_peered":"2024-04-25T08:57:49.201323+0000","last_unstale":"2024-04-25T08:57:49.206105+0000","last_undegraded":"2024-04-25T08:57:49.206105+0000","last_fullsized":"2024-04-25T08:57:49.206105+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:18.790627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189009+0000","last_change":"2024-04-25T08:57:49.189009+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189009+0000","last_undegraded":"2024-04-25T08:57:49.189009+0000","last_fullsized":"2024-04-25T08:57:49.189009+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.202325+0000","last_change":"2024-04-25T08:57:49.196631+0000","last_active":"2024-04-25T08:57:49.202325+0000","last_peered":"2024-04-25T08:57:49.202325+0000","last_clean":"2024-04-25T08:57:49.202325+0000","last_became_active":"2024-04-25T08:57:49.196337+0000","last_became_peered":"2024-04-25T08:57:49.196337+0000","last_unstale":"2024-04-25T08:57:49.202325+0000","last_undegraded":"2024-04-25T08:57:49.202325+0000","last_fullsized":"2024-04-25T08:57:49.202325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:53.010186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185324+0000","last_change":"2024-04-25T08:57:49.185324+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185324+0000","last_undegraded":"2024-04-25T08:57:49.185324+0000","last_fullsized":"2024-04-25T08:57:49.185324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845844+0000","last_change":"2024-04-25T08:57:49.199669+0000","last_active":"2024-04-25T08:57:50.845844+0000","last_peered":"2024-04-25T08:57:50.845844+0000","last_clean":"2024-04-25T08:57:50.845844+0000","last_became_active":"2024-04-25T08:57:49.199360+0000","last_became_peered":"2024-04-25T08:57:49.199360+0000","last_unstale":"2024-04-25T08:57:50.845844+0000","last_undegraded":"2024-04-25T08:57:50.845844+0000","last_fullsized":"2024-04-25T08:57:50.845844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:29.222215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845767+0000","last_change":"2024-04-25T08:57:49.843470+0000","last_active":"2024-04-25T08:57:50.845767+0000","last_peered":"2024-04-25T08:57:50.845767+0000","last_clean":"2024-04-25T08:57:50.845767+0000","last_became_active":"2024-04-25T08:57:49.842975+0000","last_became_peered":"2024-04-25T08:57:49.842975+0000","last_unstale":"2024-04-25T08:57:50.845767+0000","last_undegraded":"2024-04-25T08:57:50.845767+0000","last_fullsized":"2024-04-25T08:57:50.845767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:39.580799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201009+0000","last_change":"2024-04-25T08:57:49.198371+0000","last_active":"2024-04-25T08:57:49.201009+0000","last_peered":"2024-04-25T08:57:49.201009+0000","last_clean":"2024-04-25T08:57:49.201009+0000","last_became_active":"2024-04-25T08:57:49.198048+0000","last_became_peered":"2024-04-25T08:57:49.198048+0000","last_unstale":"2024-04-25T08:57:49.201009+0000","last_undegraded":"2024-04-25T08:57:49.201009+0000","last_fullsized":"2024-04-25T08:57:49.201009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:21.781630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.184515+0000","last_change":"2024-04-25T08:57:49.184515+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.184515+0000","last_undegraded":"2024-04-25T08:57:49.184515+0000","last_fullsized":"2024-04-25T08:57:49.184515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.194761+0000","last_change":"2024-04-25T08:57:49.192336+0000","last_active":"2024-04-25T08:57:49.194761+0000","last_peered":"2024-04-25T08:57:49.194761+0000","last_clean":"2024-04-25T08:57:49.194761+0000","last_became_active":"2024-04-25T08:57:49.192062+0000","last_became_peered":"2024-04-25T08:57:49.192062+0000","last_unstale":"2024-04-25T08:57:49.194761+0000","last_undegraded":"2024-04-25T08:57:49.194761+0000","last_fullsized":"2024-04-25T08:57:49.194761+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:18.849761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192705+0000","last_change":"2024-04-25T08:57:49.192705+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192705+0000","last_undegraded":"2024-04-25T08:57:49.192705+0000","last_fullsized":"2024-04-25T08:57:49.192705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.197397+0000","last_change":"2024-04-25T08:57:49.193013+0000","last_active":"2024-04-25T08:57:49.197397+0000","last_peered":"2024-04-25T08:57:49.197397+0000","last_clean":"2024-04-25T08:57:49.197397+0000","last_became_active":"2024-04-25T08:57:49.192748+0000","last_became_peered":"2024-04-25T08:57:49.192748+0000","last_unstale":"2024-04-25T08:57:49.197397+0000","last_undegraded":"2024-04-25T08:57:49.197397+0000","last_fullsized":"2024-04-25T08:57:49.197397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:17.238736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":259,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.190730+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:57:49.190730+0000","last_peered":"2024-04-25T08:57:49.190730+0000","last_clean":"2024-04-25T08:57:49.190730+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:57:49.190730+0000","last_undegraded":"2024-04-25T08:57:49.190730+0000","last_fullsized":"2024-04-25T08:57:49.190730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1646,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28424,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343416,"statfs":{"total":96636764160,"available":96607657984,"internally_reserved":0,"allocated":1437696,"data_stored":940299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":856064,"data_stored":356206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1449984,"data_stored":946574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":901120,"data_stored":371509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:57:53.178 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:57:53.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.326+0000 7f5b45f4f640 1 Processor -- start 2024-04-25T08:57:53.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.327+0000 7f5b45f4f640 1 -- start start 2024-04-25T08:57:53.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.327+0000 7f5b45f4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b400d35b0 0x7f5b400b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.327+0000 7f5b45f4f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4015e0c0 con 0x7f5b400b5990 2024-04-25T08:57:53.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.327+0000 7f5b45f4f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b400d2510 con 0x7f5b4015dce0 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.327+0000 7f5b45f4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400b5de0 con 0x7f5b400d35b0 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.327+0000 7f5b3ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5b400b5990 0x7f5b400b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50324/0 (socket says 172.21.15.55:50324) 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.327+0000 7f5b3ffff640 1 -- 172.21.15.55:0/2721552960 learned_addr learned my addr 172.21.15.55:0/2721552960 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3effd640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b400d35b0 0x7f5b400b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992183031 0 0) 0x7f5b4015e0c0 con 0x7f5b400b5990 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b28003520 con 0x7f5b400b5990 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123033620 0 0) 0x7f5b400d2510 con 0x7f5b4015dce0 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b4015e0c0 con 0x7f5b4015dce0 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3294555456 0 0) 0x7f5b28003520 con 0x7f5b400b5990 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b400d35b0 msgr2=0x7f5b400b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b400d35b0 0x7f5b400b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 >> v1:172.21.15.167:6789/0 conn(0x7f5b4015dce0 legacy=0x7f5b400d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b400d27f0 con 0x7f5b400b5990 2024-04-25T08:57:53.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f5b38001970 con 0x7f5b400b5990 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 >> v1:172.21.15.55:6789/0 conn(0x7f5b400b5990 legacy=0x7f5b400b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b28003b70 0x7f5b28003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b28004800 0x7f5b28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b400d35b0 0x7f5b280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400b5de0 con 0x7f5b28003b70 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2800ba70 con 0x7f5b28004800 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2800bc70 con 0x7f5b400d35b0 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3f7fe640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b28003b70 0x7f5b28003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3effd640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b28004800 0x7f5b28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3ffff640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b400d35b0 0x7f5b280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3f7fe640 1 -- 172.21.15.55:0/2721552960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b400d35b0 msgr2=0x7f5b280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3f7fe640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b400d35b0 0x7f5b280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3f7fe640 1 -- 172.21.15.55:0/2721552960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b28004800 msgr2=0x7f5b28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:53.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.328+0000 7f5b3f7fe640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b28004800 0x7f5b28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.329+0000 7f5b3f7fe640 1 -- 172.21.15.55:0/2721552960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28003520 con 0x7f5b28003b70 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.329+0000 7f5b3f7fe640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b28003b70 0x7f5b28003f70 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5b300018d0 tx=0x7f5b28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494540829e08befa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.329+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b300014f0 con 0x7f5b28003b70 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.329+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b300052d0 con 0x7f5b28003b70 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.329+0000 7f5b3e7fc640 1 -- 172.21.15.55:0/2721552960 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3002aca0 con 0x7f5b28003b70 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.330+0000 7f5b45f4f640 1 -- 172.21.15.55:0/2721552960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b28003b70 msgr2=0x7f5b28003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.330+0000 7f5b45f4f640 1 --2- 172.21.15.55:0/2721552960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b28003b70 0x7f5b28003f70 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5b300018d0 tx=0x7f5b28005830 comp rx=0 tx=0).stop 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.330+0000 7f5b3ffff640 1 -- 172.21.15.55:0/2721552960 reap_dead start 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.330+0000 7f5b45f4f640 1 -- 172.21.15.55:0/2721552960 shutdown_connections 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.330+0000 7f5b45f4f640 1 -- 172.21.15.55:0/2721552960 >> 172.21.15.55:0/2721552960 conn(0x7f5b40072900 msgr2=0x7f5b400d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.330+0000 7f5b45f4f640 1 -- 172.21.15.55:0/2721552960 shutdown_connections 2024-04-25T08:57:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.330+0000 7f5b45f4f640 1 -- 172.21.15.55:0/2721552960 wait complete. 2024-04-25T08:57:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.331+0000 7f5b45f4f640 1 Processor -- start 2024-04-25T08:57:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.331+0000 7f5b45f4f640 1 -- start start 2024-04-25T08:57:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.332+0000 7f5b45f4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b28003b70 0x7f5b40161110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.332+0000 7f5b45f4f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b4014dfa0 0x7f5b400d0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.332+0000 7f5b45f4f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400d06b0 0x7f5b4015f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.332+0000 7f5b45f4f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400d3090 con 0x7f5b400d06b0 2024-04-25T08:57:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.332+0000 7f5b45f4f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400d2db0 con 0x7f5b4014dfa0 2024-04-25T08:57:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.332+0000 7f5b45f4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400d2160 con 0x7f5b28003b70 2024-04-25T08:57:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.332+0000 7f5b3ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400d06b0 0x7f5b4015f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.332+0000 7f5b3ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400d06b0 0x7f5b4015f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46632/0 (socket says 172.21.15.55:46632) 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.332+0000 7f5b3ffff640 1 -- 172.21.15.55:0/3651657939 learned_addr learned my addr 172.21.15.55:0/3651657939 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.332+0000 7f5b3f7fe640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b28003b70 0x7f5b40161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.332+0000 7f5b3effd640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b4014dfa0 0x7f5b400d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b3ffff640 1 -- 172.21.15.55:0/3651657939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b28003b70 msgr2=0x7f5b40161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b3ffff640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b28003b70 0x7f5b40161110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b3ffff640 1 -- 172.21.15.55:0/3651657939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b4014dfa0 msgr2=0x7f5b400d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b3ffff640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b4014dfa0 0x7f5b400d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b3ffff640 1 -- 172.21.15.55:0/3651657939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40160070 con 0x7f5b400d06b0 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b3effd640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b4014dfa0 0x7f5b400d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b3ffff640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400d06b0 0x7f5b4015f420 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5b38007740 tx=0x7f5b38007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b27fff640 1 -- 172.21.15.55:0/3651657939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3800ab20 con 0x7f5b400d06b0 2024-04-25T08:57:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b27fff640 1 -- 172.21.15.55:0/3651657939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b38018070 con 0x7f5b400d06b0 2024-04-25T08:57:53.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b27fff640 1 -- 172.21.15.55:0/3651657939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b380133f0 con 0x7f5b400d06b0 2024-04-25T08:57:53.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b45f4f640 1 -- 172.21.15.55:0/3651657939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b40160350 con 0x7f5b400d06b0 2024-04-25T08:57:53.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.333+0000 7f5b45f4f640 1 -- 172.21.15.55:0/3651657939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b40160910 con 0x7f5b400d06b0 2024-04-25T08:57:53.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.334+0000 7f5b45f4f640 1 -- 172.21.15.55:0/3651657939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b400749b0 con 0x7f5b400d06b0 2024-04-25T08:57:53.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.334+0000 7f5b27fff640 1 -- 172.21.15.55:0/3651657939 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b38013590 con 0x7f5b400d06b0 2024-04-25T08:57:53.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.335+0000 7f5b27fff640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b2c06b500 0x7f5b2c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.335+0000 7f5b27fff640 1 -- 172.21.15.55:0/3651657939 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b3808a770 con 0x7f5b400d06b0 2024-04-25T08:57:53.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.335+0000 7f5b3f7fe640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b2c06b500 0x7f5b2c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.335+0000 7f5b3f7fe640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b2c06b500 0x7f5b2c06d9c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5b30032000 tx=0x7f5b30009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:53.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.339+0000 7f5b27fff640 1 -- 172.21.15.55:0/3651657939 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b380595f0 con 0x7f5b400d06b0 2024-04-25T08:57:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.518+0000 7f5b45f4f640 1 -- 172.21.15.55:0/3651657939 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b400ce980 con 0x7f5b2c06b500 2024-04-25T08:57:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.524+0000 7f5b27fff640 1 -- 172.21.15.55:0/3651657939 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247193 (secure 0 0 0) 0x7f5b400ce980 con 0x7f5b2c06b500 2024-04-25T08:57:53.516 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:53.517 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 -- 172.21.15.55:0/3651657939 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b2c06b500 msgr2=0x7f5b2c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b2c06b500 0x7f5b2c06d9c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5b30032000 tx=0x7f5b30009030 comp rx=0 tx=0).stop 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 -- 172.21.15.55:0/3651657939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400d06b0 msgr2=0x7f5b4015f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400d06b0 0x7f5b4015f420 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5b38007740 tx=0x7f5b38007c00 comp rx=0 tx=0).stop 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 -- 172.21.15.55:0/3651657939 shutdown_connections 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b2c06b500 0x7f5b2c06d9c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400d06b0 0x7f5b4015f420 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b4014dfa0 0x7f5b400d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 --2- 172.21.15.55:0/3651657939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b28003b70 0x7f5b40161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 -- 172.21.15.55:0/3651657939 >> 172.21.15.55:0/3651657939 conn(0x7f5b40072900 msgr2=0x7f5b400ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 -- 172.21.15.55:0/3651657939 shutdown_connections 2024-04-25T08:57:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.527+0000 7f5b45f4f640 1 -- 172.21.15.55:0/3651657939 wait complete. 2024-04-25T08:57:53.527 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-25T08:57:52.605884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592014,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240656,"kb_used_data":7832,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734064,"statfs":{"total":773094113280,"available":772847681536,"internally_reserved":0,"allocated":8019968,"data_stored":4014312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1646,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.434485"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189913+0000","last_change":"2024-04-25T08:57:49.189913+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189913+0000","last_undegraded":"2024-04-25T08:57:49.189913+0000","last_fullsized":"2024-04-25T08:57:49.189913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185400+0000","last_change":"2024-04-25T08:57:49.185400+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185400+0000","last_undegraded":"2024-04-25T08:57:49.185400+0000","last_fullsized":"2024-04-25T08:57:49.185400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.196576+0000","last_change":"2024-04-25T08:57:49.196576+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.196576+0000","last_undegraded":"2024-04-25T08:57:49.196576+0000","last_fullsized":"2024-04-25T08:57:49.196576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845941+0000","last_change":"2024-04-25T08:57:49.843433+0000","last_active":"2024-04-25T08:57:50.845941+0000","last_peered":"2024-04-25T08:57:50.845941+0000","last_clean":"2024-04-25T08:57:50.845941+0000","last_became_active":"2024-04-25T08:57:49.842997+0000","last_became_peered":"2024-04-25T08:57:49.842997+0000","last_unstale":"2024-04-25T08:57:50.845941+0000","last_undegraded":"2024-04-25T08:57:50.845941+0000","last_fullsized":"2024-04-25T08:57:50.845941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:00.690627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188384+0000","last_change":"2024-04-25T08:57:49.188384+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188384+0000","last_undegraded":"2024-04-25T08:57:49.188384+0000","last_fullsized":"2024-04-25T08:57:49.188384+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.186043+0000","last_change":"2024-04-25T08:57:49.186043+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.186043+0000","last_undegraded":"2024-04-25T08:57:49.186043+0000","last_fullsized":"2024-04-25T08:57:49.186043+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192147+0000","last_change":"2024-04-25T08:57:49.192147+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192147+0000","last_undegraded":"2024-04-25T08:57:49.192147+0000","last_fullsized":"2024-04-25T08:57:49.192147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185936+0000","last_change":"2024-04-25T08:57:49.185936+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185936+0000","last_undegraded":"2024-04-25T08:57:49.185936+0000","last_fullsized":"2024-04-25T08:57:49.185936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189680+0000","last_change":"2024-04-25T08:57:49.189680+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189680+0000","last_undegraded":"2024-04-25T08:57:49.189680+0000","last_fullsized":"2024-04-25T08:57:49.189680+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193533+0000","last_change":"2024-04-25T08:57:49.193533+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193533+0000","last_undegraded":"2024-04-25T08:57:49.193533+0000","last_fullsized":"2024-04-25T08:57:49.193533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189581+0000","last_change":"2024-04-25T08:57:49.189581+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189581+0000","last_undegraded":"2024-04-25T08:57:49.189581+0000","last_fullsized":"2024-04-25T08:57:49.189581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846107+0000","last_change":"2024-04-25T08:57:49.845838+0000","last_active":"2024-04-25T08:57:50.846107+0000","last_peered":"2024-04-25T08:57:50.846107+0000","last_clean":"2024-04-25T08:57:50.846107+0000","last_became_active":"2024-04-25T08:57:49.845562+0000","last_became_peered":"2024-04-25T08:57:49.845562+0000","last_unstale":"2024-04-25T08:57:50.846107+0000","last_undegraded":"2024-04-25T08:57:50.846107+0000","last_fullsized":"2024-04-25T08:57:50.846107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:23.131325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194521+0000","last_change":"2024-04-25T08:57:49.194521+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194521+0000","last_undegraded":"2024-04-25T08:57:49.194521+0000","last_fullsized":"2024-04-25T08:57:49.194521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189507+0000","last_change":"2024-04-25T08:57:49.189507+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189507+0000","last_undegraded":"2024-04-25T08:57:49.189507+0000","last_fullsized":"2024-04-25T08:57:49.189507+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.197918+0000","last_change":"2024-04-25T08:57:49.197918+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.197918+0000","last_undegraded":"2024-04-25T08:57:49.197918+0000","last_fullsized":"2024-04-25T08:57:49.197918+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.190819+0000","last_change":"2024-04-25T08:57:49.190819+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.190819+0000","last_undegraded":"2024-04-25T08:57:49.190819+0000","last_fullsized":"2024-04-25T08:57:49.190819+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189238+0000","last_change":"2024-04-25T08:57:49.189238+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189238+0000","last_undegraded":"2024-04-25T08:57:49.189238+0000","last_fullsized":"2024-04-25T08:57:49.189238+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846126+0000","last_change":"2024-04-25T08:57:49.844027+0000","last_active":"2024-04-25T08:57:50.846126+0000","last_peered":"2024-04-25T08:57:50.846126+0000","last_clean":"2024-04-25T08:57:50.846126+0000","last_became_active":"2024-04-25T08:57:49.843756+0000","last_became_peered":"2024-04-25T08:57:49.843756+0000","last_unstale":"2024-04-25T08:57:50.846126+0000","last_undegraded":"2024-04-25T08:57:50.846126+0000","last_fullsized":"2024-04-25T08:57:50.846126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:37.684246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185045+0000","last_change":"2024-04-25T08:57:49.185045+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185045+0000","last_undegraded":"2024-04-25T08:57:49.185045+0000","last_fullsized":"2024-04-25T08:57:49.185045+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195057+0000","last_change":"2024-04-25T08:57:49.195057+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195057+0000","last_undegraded":"2024-04-25T08:57:49.195057+0000","last_fullsized":"2024-04-25T08:57:49.195057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194165+0000","last_change":"2024-04-25T08:57:49.194165+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194165+0000","last_undegraded":"2024-04-25T08:57:49.194165+0000","last_fullsized":"2024-04-25T08:57:49.194165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.190485+0000","last_change":"2024-04-25T08:57:49.190485+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.190485+0000","last_undegraded":"2024-04-25T08:57:49.190485+0000","last_fullsized":"2024-04-25T08:57:49.190485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188149+0000","last_change":"2024-04-25T08:57:49.188149+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188149+0000","last_undegraded":"2024-04-25T08:57:49.188149+0000","last_fullsized":"2024-04-25T08:57:49.188149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187722+0000","last_change":"2024-04-25T08:57:49.187722+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187722+0000","last_undegraded":"2024-04-25T08:57:49.187722+0000","last_fullsized":"2024-04-25T08:57:49.187722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193974+0000","last_change":"2024-04-25T08:57:49.193974+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193974+0000","last_undegraded":"2024-04-25T08:57:49.193974+0000","last_fullsized":"2024-04-25T08:57:49.193974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194325+0000","last_change":"2024-04-25T08:57:49.194325+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194325+0000","last_undegraded":"2024-04-25T08:57:49.194325+0000","last_fullsized":"2024-04-25T08:57:49.194325+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.196022+0000","last_change":"2024-04-25T08:57:49.196022+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.196022+0000","last_undegraded":"2024-04-25T08:57:49.196022+0000","last_fullsized":"2024-04-25T08:57:49.196022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191584+0000","last_change":"2024-04-25T08:57:49.191584+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191584+0000","last_undegraded":"2024-04-25T08:57:49.191584+0000","last_fullsized":"2024-04-25T08:57:49.191584+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195517+0000","last_change":"2024-04-25T08:57:49.195517+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195517+0000","last_undegraded":"2024-04-25T08:57:49.195517+0000","last_fullsized":"2024-04-25T08:57:49.195517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192841+0000","last_change":"2024-04-25T08:57:49.192841+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192841+0000","last_undegraded":"2024-04-25T08:57:49.192841+0000","last_fullsized":"2024-04-25T08:57:49.192841+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191293+0000","last_change":"2024-04-25T08:57:49.191293+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191293+0000","last_undegraded":"2024-04-25T08:57:49.191293+0000","last_fullsized":"2024-04-25T08:57:49.191293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.184663+0000","last_change":"2024-04-25T08:57:49.184663+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.184663+0000","last_undegraded":"2024-04-25T08:57:49.184663+0000","last_fullsized":"2024-04-25T08:57:49.184663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187865+0000","last_change":"2024-04-25T08:57:49.187865+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187865+0000","last_undegraded":"2024-04-25T08:57:49.187865+0000","last_fullsized":"2024-04-25T08:57:49.187865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205876+0000","last_change":"2024-04-25T08:57:49.204071+0000","last_active":"2024-04-25T08:57:49.205876+0000","last_peered":"2024-04-25T08:57:49.205876+0000","last_clean":"2024-04-25T08:57:49.205876+0000","last_became_active":"2024-04-25T08:57:49.203657+0000","last_became_peered":"2024-04-25T08:57:49.203657+0000","last_unstale":"2024-04-25T08:57:49.205876+0000","last_undegraded":"2024-04-25T08:57:49.205876+0000","last_fullsized":"2024-04-25T08:57:49.205876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:08.452486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188708+0000","last_change":"2024-04-25T08:57:49.188708+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188708+0000","last_undegraded":"2024-04-25T08:57:49.188708+0000","last_fullsized":"2024-04-25T08:57:49.188708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208494+0000","last_change":"2024-04-25T08:57:49.204785+0000","last_active":"2024-04-25T08:57:49.208494+0000","last_peered":"2024-04-25T08:57:49.208494+0000","last_clean":"2024-04-25T08:57:49.208494+0000","last_became_active":"2024-04-25T08:57:49.204484+0000","last_became_peered":"2024-04-25T08:57:49.204484+0000","last_unstale":"2024-04-25T08:57:49.208494+0000","last_undegraded":"2024-04-25T08:57:49.208494+0000","last_fullsized":"2024-04-25T08:57:49.208494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:10.848641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185935+0000","last_change":"2024-04-25T08:57:49.185935+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185935+0000","last_undegraded":"2024-04-25T08:57:49.185935+0000","last_fullsized":"2024-04-25T08:57:49.185935+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.203012+0000","last_change":"2024-04-25T08:57:49.200263+0000","last_active":"2024-04-25T08:57:49.203012+0000","last_peered":"2024-04-25T08:57:49.203012+0000","last_clean":"2024-04-25T08:57:49.203012+0000","last_became_active":"2024-04-25T08:57:49.199990+0000","last_became_peered":"2024-04-25T08:57:49.199990+0000","last_unstale":"2024-04-25T08:57:49.203012+0000","last_undegraded":"2024-04-25T08:57:49.203012+0000","last_fullsized":"2024-04-25T08:57:49.203012+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:25.735805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189051+0000","last_change":"2024-04-25T08:57:49.189051+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189051+0000","last_undegraded":"2024-04-25T08:57:49.189051+0000","last_fullsized":"2024-04-25T08:57:49.189051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.197550+0000","last_change":"2024-04-25T08:57:49.193842+0000","last_active":"2024-04-25T08:57:49.197550+0000","last_peered":"2024-04-25T08:57:49.197550+0000","last_clean":"2024-04-25T08:57:49.197550+0000","last_became_active":"2024-04-25T08:57:49.193515+0000","last_became_peered":"2024-04-25T08:57:49.193515+0000","last_unstale":"2024-04-25T08:57:49.197550+0000","last_undegraded":"2024-04-25T08:57:49.197550+0000","last_fullsized":"2024-04-25T08:57:49.197550+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:34.530548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191916+0000","last_change":"2024-04-25T08:57:49.191916+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191916+0000","last_undegraded":"2024-04-25T08:57:49.191916+0000","last_fullsized":"2024-04-25T08:57:49.191916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.202646+0000","last_change":"2024-04-25T08:57:49.200083+0000","last_active":"2024-04-25T08:57:49.202646+0000","last_peered":"2024-04-25T08:57:49.202646+0000","last_clean":"2024-04-25T08:57:49.202646+0000","last_became_active":"2024-04-25T08:57:49.199768+0000","last_became_peered":"2024-04-25T08:57:49.199768+0000","last_unstale":"2024-04-25T08:57:49.202646+0000","last_undegraded":"2024-04-25T08:57:49.202646+0000","last_fullsized":"2024-04-25T08:57:49.202646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:20.826126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193688+0000","last_change":"2024-04-25T08:57:49.193688+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193688+0000","last_undegraded":"2024-04-25T08:57:49.193688+0000","last_fullsized":"2024-04-25T08:57:49.193688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205811+0000","last_change":"2024-04-25T08:57:49.204607+0000","last_active":"2024-04-25T08:57:49.205811+0000","last_peered":"2024-04-25T08:57:49.205811+0000","last_clean":"2024-04-25T08:57:49.205811+0000","last_became_active":"2024-04-25T08:57:49.204298+0000","last_became_peered":"2024-04-25T08:57:49.204298+0000","last_unstale":"2024-04-25T08:57:49.205811+0000","last_undegraded":"2024-04-25T08:57:49.205811+0000","last_fullsized":"2024-04-25T08:57:49.205811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:28.260907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187961+0000","last_change":"2024-04-25T08:57:49.187961+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187961+0000","last_undegraded":"2024-04-25T08:57:49.187961+0000","last_fullsized":"2024-04-25T08:57:49.187961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845764+0000","last_change":"2024-04-25T08:57:49.201987+0000","last_active":"2024-04-25T08:57:50.845764+0000","last_peered":"2024-04-25T08:57:50.845764+0000","last_clean":"2024-04-25T08:57:50.845764+0000","last_became_active":"2024-04-25T08:57:49.201668+0000","last_became_peered":"2024-04-25T08:57:49.201668+0000","last_unstale":"2024-04-25T08:57:50.845764+0000","last_undegraded":"2024-04-25T08:57:50.845764+0000","last_fullsized":"2024-04-25T08:57:50.845764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:02.728261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195966+0000","last_change":"2024-04-25T08:57:49.195966+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195966+0000","last_undegraded":"2024-04-25T08:57:49.195966+0000","last_fullsized":"2024-04-25T08:57:49.195966+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199827+0000","last_change":"2024-04-25T08:57:49.192553+0000","last_active":"2024-04-25T08:57:49.199827+0000","last_peered":"2024-04-25T08:57:49.199827+0000","last_clean":"2024-04-25T08:57:49.199827+0000","last_became_active":"2024-04-25T08:57:49.192250+0000","last_became_peered":"2024-04-25T08:57:49.192250+0000","last_unstale":"2024-04-25T08:57:49.199827+0000","last_undegraded":"2024-04-25T08:57:49.199827+0000","last_fullsized":"2024-04-25T08:57:49.199827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:22.257572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193848+0000","last_change":"2024-04-25T08:57:49.193848+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193848+0000","last_undegraded":"2024-04-25T08:57:49.193848+0000","last_fullsized":"2024-04-25T08:57:49.193848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205248+0000","last_change":"2024-04-25T08:57:49.202591+0000","last_active":"2024-04-25T08:57:49.205248+0000","last_peered":"2024-04-25T08:57:49.205248+0000","last_clean":"2024-04-25T08:57:49.205248+0000","last_became_active":"2024-04-25T08:57:49.202288+0000","last_became_peered":"2024-04-25T08:57:49.202288+0000","last_unstale":"2024-04-25T08:57:49.205248+0000","last_undegraded":"2024-04-25T08:57:49.205248+0000","last_fullsized":"2024-04-25T08:57:49.205248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:34.916404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189069+0000","last_change":"2024-04-25T08:57:49.189069+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189069+0000","last_undegraded":"2024-04-25T08:57:49.189069+0000","last_fullsized":"2024-04-25T08:57:49.189069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.200886+0000","last_change":"2024-04-25T08:57:49.199212+0000","last_active":"2024-04-25T08:57:49.200886+0000","last_peered":"2024-04-25T08:57:49.200886+0000","last_clean":"2024-04-25T08:57:49.200886+0000","last_became_active":"2024-04-25T08:57:49.198860+0000","last_became_peered":"2024-04-25T08:57:49.198860+0000","last_unstale":"2024-04-25T08:57:49.200886+0000","last_undegraded":"2024-04-25T08:57:49.200886+0000","last_fullsized":"2024-04-25T08:57:49.200886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:29.372407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185388+0000","last_change":"2024-04-25T08:57:49.185388+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185388+0000","last_undegraded":"2024-04-25T08:57:49.185388+0000","last_fullsized":"2024-04-25T08:57:49.185388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199149+0000","last_change":"2024-04-25T08:57:49.193690+0000","last_active":"2024-04-25T08:57:49.199149+0000","last_peered":"2024-04-25T08:57:49.199149+0000","last_clean":"2024-04-25T08:57:49.199149+0000","last_became_active":"2024-04-25T08:57:49.193363+0000","last_became_peered":"2024-04-25T08:57:49.193363+0000","last_unstale":"2024-04-25T08:57:49.199149+0000","last_undegraded":"2024-04-25T08:57:49.199149+0000","last_fullsized":"2024-04-25T08:57:49.199149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.044245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188883+0000","last_change":"2024-04-25T08:57:49.188883+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188883+0000","last_undegraded":"2024-04-25T08:57:49.188883+0000","last_fullsized":"2024-04-25T08:57:49.188883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846243+0000","last_change":"2024-04-25T08:57:49.198251+0000","last_active":"2024-04-25T08:57:50.846243+0000","last_peered":"2024-04-25T08:57:50.846243+0000","last_clean":"2024-04-25T08:57:50.846243+0000","last_became_active":"2024-04-25T08:57:49.197958+0000","last_became_peered":"2024-04-25T08:57:49.197958+0000","last_unstale":"2024-04-25T08:57:50.846243+0000","last_undegraded":"2024-04-25T08:57:50.846243+0000","last_fullsized":"2024-04-25T08:57:50.846243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.206185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187970+0000","last_change":"2024-04-25T08:57:49.187970+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187970+0000","last_undegraded":"2024-04-25T08:57:49.187970+0000","last_fullsized":"2024-04-25T08:57:49.187970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845968+0000","last_change":"2024-04-25T08:57:49.198379+0000","last_active":"2024-04-25T08:57:50.845968+0000","last_peered":"2024-04-25T08:57:50.845968+0000","last_clean":"2024-04-25T08:57:50.845968+0000","last_became_active":"2024-04-25T08:57:49.198053+0000","last_became_peered":"2024-04-25T08:57:49.198053+0000","last_unstale":"2024-04-25T08:57:50.845968+0000","last_undegraded":"2024-04-25T08:57:50.845968+0000","last_fullsized":"2024-04-25T08:57:50.845968+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:24.585656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192674+0000","last_change":"2024-04-25T08:57:49.192674+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192674+0000","last_undegraded":"2024-04-25T08:57:49.192674+0000","last_fullsized":"2024-04-25T08:57:49.192674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201819+0000","last_change":"2024-04-25T08:57:49.200592+0000","last_active":"2024-04-25T08:57:49.201819+0000","last_peered":"2024-04-25T08:57:49.201819+0000","last_clean":"2024-04-25T08:57:49.201819+0000","last_became_active":"2024-04-25T08:57:49.200309+0000","last_became_peered":"2024-04-25T08:57:49.200309+0000","last_unstale":"2024-04-25T08:57:49.201819+0000","last_undegraded":"2024-04-25T08:57:49.201819+0000","last_fullsized":"2024-04-25T08:57:49.201819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:00.354293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193883+0000","last_change":"2024-04-25T08:57:49.193883+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193883+0000","last_undegraded":"2024-04-25T08:57:49.193883+0000","last_fullsized":"2024-04-25T08:57:49.193883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.204416+0000","last_change":"2024-04-25T08:57:49.202467+0000","last_active":"2024-04-25T08:57:49.204416+0000","last_peered":"2024-04-25T08:57:49.204416+0000","last_clean":"2024-04-25T08:57:49.204416+0000","last_became_active":"2024-04-25T08:57:49.202182+0000","last_became_peered":"2024-04-25T08:57:49.202182+0000","last_unstale":"2024-04-25T08:57:49.204416+0000","last_undegraded":"2024-04-25T08:57:49.204416+0000","last_fullsized":"2024-04-25T08:57:49.204416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.464226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187658+0000","last_change":"2024-04-25T08:57:49.187658+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187658+0000","last_undegraded":"2024-04-25T08:57:49.187658+0000","last_fullsized":"2024-04-25T08:57:49.187658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201172+0000","last_change":"2024-04-25T08:57:49.199693+0000","last_active":"2024-04-25T08:57:49.201172+0000","last_peered":"2024-04-25T08:57:49.201172+0000","last_clean":"2024-04-25T08:57:49.201172+0000","last_became_active":"2024-04-25T08:57:49.199348+0000","last_became_peered":"2024-04-25T08:57:49.199348+0000","last_unstale":"2024-04-25T08:57:49.201172+0000","last_undegraded":"2024-04-25T08:57:49.201172+0000","last_fullsized":"2024-04-25T08:57:49.201172+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:11.998048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191499+0000","last_change":"2024-04-25T08:57:49.191499+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191499+0000","last_undegraded":"2024-04-25T08:57:49.191499+0000","last_fullsized":"2024-04-25T08:57:49.191499+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199063+0000","last_change":"2024-04-25T08:57:49.196147+0000","last_active":"2024-04-25T08:57:49.199063+0000","last_peered":"2024-04-25T08:57:49.199063+0000","last_clean":"2024-04-25T08:57:49.199063+0000","last_became_active":"2024-04-25T08:57:49.195241+0000","last_became_peered":"2024-04-25T08:57:49.195241+0000","last_unstale":"2024-04-25T08:57:49.199063+0000","last_undegraded":"2024-04-25T08:57:49.199063+0000","last_fullsized":"2024-04-25T08:57:49.199063+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:10.850720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188158+0000","last_change":"2024-04-25T08:57:49.188158+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188158+0000","last_undegraded":"2024-04-25T08:57:49.188158+0000","last_fullsized":"2024-04-25T08:57:49.188158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.203814+0000","last_change":"2024-04-25T08:57:49.201604+0000","last_active":"2024-04-25T08:57:49.203814+0000","last_peered":"2024-04-25T08:57:49.203814+0000","last_clean":"2024-04-25T08:57:49.203814+0000","last_became_active":"2024-04-25T08:57:49.201278+0000","last_became_peered":"2024-04-25T08:57:49.201278+0000","last_unstale":"2024-04-25T08:57:49.203814+0000","last_undegraded":"2024-04-25T08:57:49.203814+0000","last_fullsized":"2024-04-25T08:57:49.203814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:59.607582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846217+0000","last_change":"2024-04-25T08:57:49.846548+0000","last_active":"2024-04-25T08:57:50.846217+0000","last_peered":"2024-04-25T08:57:50.846217+0000","last_clean":"2024-04-25T08:57:50.846217+0000","last_became_active":"2024-04-25T08:57:49.846273+0000","last_became_peered":"2024-04-25T08:57:49.846273+0000","last_unstale":"2024-04-25T08:57:50.846217+0000","last_undegraded":"2024-04-25T08:57:50.846217+0000","last_fullsized":"2024-04-25T08:57:50.846217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:15.697708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.200892+0000","last_change":"2024-04-25T08:57:49.199525+0000","last_active":"2024-04-25T08:57:49.200892+0000","last_peered":"2024-04-25T08:57:49.200892+0000","last_clean":"2024-04-25T08:57:49.200892+0000","last_became_active":"2024-04-25T08:57:49.199026+0000","last_became_peered":"2024-04-25T08:57:49.199026+0000","last_unstale":"2024-04-25T08:57:49.200892+0000","last_undegraded":"2024-04-25T08:57:49.200892+0000","last_fullsized":"2024-04-25T08:57:49.200892+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:24.441411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188393+0000","last_change":"2024-04-25T08:57:49.188393+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188393+0000","last_undegraded":"2024-04-25T08:57:49.188393+0000","last_fullsized":"2024-04-25T08:57:49.188393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205118+0000","last_change":"2024-04-25T08:57:49.203809+0000","last_active":"2024-04-25T08:57:49.205118+0000","last_peered":"2024-04-25T08:57:49.205118+0000","last_clean":"2024-04-25T08:57:49.205118+0000","last_became_active":"2024-04-25T08:57:49.203459+0000","last_became_peered":"2024-04-25T08:57:49.203459+0000","last_unstale":"2024-04-25T08:57:49.205118+0000","last_undegraded":"2024-04-25T08:57:49.205118+0000","last_fullsized":"2024-04-25T08:57:49.205118+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193606+0000","last_change":"2024-04-25T08:57:49.193606+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193606+0000","last_undegraded":"2024-04-25T08:57:49.193606+0000","last_fullsized":"2024-04-25T08:57:49.193606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205792+0000","last_change":"2024-04-25T08:57:49.203616+0000","last_active":"2024-04-25T08:57:49.205792+0000","last_peered":"2024-04-25T08:57:49.205792+0000","last_clean":"2024-04-25T08:57:49.205792+0000","last_became_active":"2024-04-25T08:57:49.203330+0000","last_became_peered":"2024-04-25T08:57:49.203330+0000","last_unstale":"2024-04-25T08:57:49.205792+0000","last_undegraded":"2024-04-25T08:57:49.205792+0000","last_fullsized":"2024-04-25T08:57:49.205792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:18.344931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192288+0000","last_change":"2024-04-25T08:57:49.192288+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192288+0000","last_undegraded":"2024-04-25T08:57:49.192288+0000","last_fullsized":"2024-04-25T08:57:49.192288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201520+0000","last_change":"2024-04-25T08:57:49.200461+0000","last_active":"2024-04-25T08:57:49.201520+0000","last_peered":"2024-04-25T08:57:49.201520+0000","last_clean":"2024-04-25T08:57:49.201520+0000","last_became_active":"2024-04-25T08:57:49.200166+0000","last_became_peered":"2024-04-25T08:57:49.200166+0000","last_unstale":"2024-04-25T08:57:49.201520+0000","last_undegraded":"2024-04-25T08:57:49.201520+0000","last_fullsized":"2024-04-25T08:57:49.201520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:45.768247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192305+0000","last_change":"2024-04-25T08:57:49.192305+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192305+0000","last_undegraded":"2024-04-25T08:57:49.192305+0000","last_fullsized":"2024-04-25T08:57:49.192305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208396+0000","last_change":"2024-04-25T08:57:49.204125+0000","last_active":"2024-04-25T08:57:49.208396+0000","last_peered":"2024-04-25T08:57:49.208396+0000","last_clean":"2024-04-25T08:57:49.208396+0000","last_became_active":"2024-04-25T08:57:49.203829+0000","last_became_peered":"2024-04-25T08:57:49.203829+0000","last_unstale":"2024-04-25T08:57:49.208396+0000","last_undegraded":"2024-04-25T08:57:49.208396+0000","last_fullsized":"2024-04-25T08:57:49.208396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:20.640318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.198297+0000","last_change":"2024-04-25T08:57:49.198297+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.198297+0000","last_undegraded":"2024-04-25T08:57:49.198297+0000","last_fullsized":"2024-04-25T08:57:49.198297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199039+0000","last_change":"2024-04-25T08:57:49.195696+0000","last_active":"2024-04-25T08:57:49.199039+0000","last_peered":"2024-04-25T08:57:49.199039+0000","last_clean":"2024-04-25T08:57:49.199039+0000","last_became_active":"2024-04-25T08:57:49.195396+0000","last_became_peered":"2024-04-25T08:57:49.195396+0000","last_unstale":"2024-04-25T08:57:49.199039+0000","last_undegraded":"2024-04-25T08:57:49.199039+0000","last_fullsized":"2024-04-25T08:57:49.199039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:41.508120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192584+0000","last_change":"2024-04-25T08:57:49.192584+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192584+0000","last_undegraded":"2024-04-25T08:57:49.192584+0000","last_fullsized":"2024-04-25T08:57:49.192584+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.206257+0000","last_change":"2024-04-25T08:57:49.204999+0000","last_active":"2024-04-25T08:57:49.206257+0000","last_peered":"2024-04-25T08:57:49.206257+0000","last_clean":"2024-04-25T08:57:49.206257+0000","last_became_active":"2024-04-25T08:57:49.204637+0000","last_became_peered":"2024-04-25T08:57:49.204637+0000","last_unstale":"2024-04-25T08:57:49.206257+0000","last_undegraded":"2024-04-25T08:57:49.206257+0000","last_fullsized":"2024-04-25T08:57:49.206257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188164+0000","last_change":"2024-04-25T08:57:49.188164+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188164+0000","last_undegraded":"2024-04-25T08:57:49.188164+0000","last_fullsized":"2024-04-25T08:57:49.188164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208398+0000","last_change":"2024-04-25T08:57:49.204319+0000","last_active":"2024-04-25T08:57:49.208398+0000","last_peered":"2024-04-25T08:57:49.208398+0000","last_clean":"2024-04-25T08:57:49.208398+0000","last_became_active":"2024-04-25T08:57:49.203999+0000","last_became_peered":"2024-04-25T08:57:49.203999+0000","last_unstale":"2024-04-25T08:57:49.208398+0000","last_undegraded":"2024-04-25T08:57:49.208398+0000","last_fullsized":"2024-04-25T08:57:49.208398+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:31.676546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188647+0000","last_change":"2024-04-25T08:57:49.188647+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188647+0000","last_undegraded":"2024-04-25T08:57:49.188647+0000","last_fullsized":"2024-04-25T08:57:49.188647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.206105+0000","last_change":"2024-04-25T08:57:49.201643+0000","last_active":"2024-04-25T08:57:49.206105+0000","last_peered":"2024-04-25T08:57:49.206105+0000","last_clean":"2024-04-25T08:57:49.206105+0000","last_became_active":"2024-04-25T08:57:49.201323+0000","last_became_peered":"2024-04-25T08:57:49.201323+0000","last_unstale":"2024-04-25T08:57:49.206105+0000","last_undegraded":"2024-04-25T08:57:49.206105+0000","last_fullsized":"2024-04-25T08:57:49.206105+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:18.790627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189009+0000","last_change":"2024-04-25T08:57:49.189009+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189009+0000","last_undegraded":"2024-04-25T08:57:49.189009+0000","last_fullsized":"2024-04-25T08:57:49.189009+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.202325+0000","last_change":"2024-04-25T08:57:49.196631+0000","last_active":"2024-04-25T08:57:49.202325+0000","last_peered":"2024-04-25T08:57:49.202325+0000","last_clean":"2024-04-25T08:57:49.202325+0000","last_became_active":"2024-04-25T08:57:49.196337+0000","last_became_peered":"2024-04-25T08:57:49.196337+0000","last_unstale":"2024-04-25T08:57:49.202325+0000","last_undegraded":"2024-04-25T08:57:49.202325+0000","last_fullsized":"2024-04-25T08:57:49.202325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:53.010186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185324+0000","last_change":"2024-04-25T08:57:49.185324+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185324+0000","last_undegraded":"2024-04-25T08:57:49.185324+0000","last_fullsized":"2024-04-25T08:57:49.185324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845844+0000","last_change":"2024-04-25T08:57:49.199669+0000","last_active":"2024-04-25T08:57:50.845844+0000","last_peered":"2024-04-25T08:57:50.845844+0000","last_clean":"2024-04-25T08:57:50.845844+0000","last_became_active":"2024-04-25T08:57:49.199360+0000","last_became_peered":"2024-04-25T08:57:49.199360+0000","last_unstale":"2024-04-25T08:57:50.845844+0000","last_undegraded":"2024-04-25T08:57:50.845844+0000","last_fullsized":"2024-04-25T08:57:50.845844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:29.222215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845767+0000","last_change":"2024-04-25T08:57:49.843470+0000","last_active":"2024-04-25T08:57:50.845767+0000","last_peered":"2024-04-25T08:57:50.845767+0000","last_clean":"2024-04-25T08:57:50.845767+0000","last_became_active":"2024-04-25T08:57:49.842975+0000","last_became_peered":"2024-04-25T08:57:49.842975+0000","last_unstale":"2024-04-25T08:57:50.845767+0000","last_undegraded":"2024-04-25T08:57:50.845767+0000","last_fullsized":"2024-04-25T08:57:50.845767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:39.580799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201009+0000","last_change":"2024-04-25T08:57:49.198371+0000","last_active":"2024-04-25T08:57:49.201009+0000","last_peered":"2024-04-25T08:57:49.201009+0000","last_clean":"2024-04-25T08:57:49.201009+0000","last_became_active":"2024-04-25T08:57:49.198048+0000","last_became_peered":"2024-04-25T08:57:49.198048+0000","last_unstale":"2024-04-25T08:57:49.201009+0000","last_undegraded":"2024-04-25T08:57:49.201009+0000","last_fullsized":"2024-04-25T08:57:49.201009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:21.781630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.184515+0000","last_change":"2024-04-25T08:57:49.184515+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.184515+0000","last_undegraded":"2024-04-25T08:57:49.184515+0000","last_fullsized":"2024-04-25T08:57:49.184515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.194761+0000","last_change":"2024-04-25T08:57:49.192336+0000","last_active":"2024-04-25T08:57:49.194761+0000","last_peered":"2024-04-25T08:57:49.194761+0000","last_clean":"2024-04-25T08:57:49.194761+0000","last_became_active":"2024-04-25T08:57:49.192062+0000","last_became_peered":"2024-04-25T08:57:49.192062+0000","last_unstale":"2024-04-25T08:57:49.194761+0000","last_undegraded":"2024-04-25T08:57:49.194761+0000","last_fullsized":"2024-04-25T08:57:49.194761+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:18.849761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192705+0000","last_change":"2024-04-25T08:57:49.192705+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192705+0000","last_undegraded":"2024-04-25T08:57:49.192705+0000","last_fullsized":"2024-04-25T08:57:49.192705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.197397+0000","last_change":"2024-04-25T08:57:49.193013+0000","last_active":"2024-04-25T08:57:49.197397+0000","last_peered":"2024-04-25T08:57:49.197397+0000","last_clean":"2024-04-25T08:57:49.197397+0000","last_became_active":"2024-04-25T08:57:49.192748+0000","last_became_peered":"2024-04-25T08:57:49.192748+0000","last_unstale":"2024-04-25T08:57:49.197397+0000","last_undegraded":"2024-04-25T08:57:49.197397+0000","last_fullsized":"2024-04-25T08:57:49.197397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:17.238736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":259,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.190730+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:57:49.190730+0000","last_peered":"2024-04-25T08:57:49.190730+0000","last_clean":"2024-04-25T08:57:49.190730+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:57:49.190730+0000","last_undegraded":"2024-04-25T08:57:49.190730+0000","last_fullsized":"2024-04-25T08:57:49.190730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1646,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28424,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343416,"statfs":{"total":96636764160,"available":96607657984,"internally_reserved":0,"allocated":1437696,"data_stored":940299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":856064,"data_stored":356206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1449984,"data_stored":946574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":901120,"data_stored":371509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:57:53.531 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:57:53.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.680+0000 7f4bfccf5640 1 Processor -- start 2024-04-25T08:57:53.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.680+0000 7f4bfccf5640 1 -- start start 2024-04-25T08:57:53.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.681+0000 7f4bfccf5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4bf815f120 0x7f4bf80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.681+0000 7f4bfccf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4bf80cfdb0 0x7f4bf80ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.681+0000 7f4bfccf5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf80d0430 con 0x7f4bf80ce830 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.681+0000 7f4bfccf5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf80d09f0 con 0x7f4bf80cfdb0 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.681+0000 7f4bfccf5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf80cec70 con 0x7f4bf815f120 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.681+0000 7f4bf6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4bf80cfdb0 0x7f4bf80ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.681+0000 7f4bf5d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4bf80ce830 0x7f4bf80cf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50326/0 (socket says 172.21.15.55:50326) 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.681+0000 7f4bf5d9b640 1 -- 172.21.15.55:0/2780749429 learned_addr learned my addr 172.21.15.55:0/2780749429 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.682+0000 7f4bf6d9d640 1 -- 172.21.15.55:0/2780749429 >> v2:172.21.15.167:3300/0 conn(0x7f4bf815f120 msgr2=0x7f4bf80ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.682+0000 7f4bf659c640 1 --2- 172.21.15.55:0/2780749429 >> v2:172.21.15.167:3300/0 conn(0x7f4bf815f120 0x7f4bf80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.682+0000 7f4bf6d9d640 1 --2- 172.21.15.55:0/2780749429 >> v2:172.21.15.167:3300/0 conn(0x7f4bf815f120 0x7f4bf80ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.682+0000 7f4bf6d9d640 1 -- 172.21.15.55:0/2780749429 >> v1:172.21.15.55:6789/0 conn(0x7f4bf80ce830 legacy=0x7f4bf80cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.682+0000 7f4bf559a640 1 -- 172.21.15.55:0/2780749429 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282825688 0 0) 0x7f4bf80d0430 con 0x7f4bf80ce830 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.682+0000 7f4bf6d9d640 1 -- 172.21.15.55:0/2780749429 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80d0710 con 0x7f4bf80cfdb0 2024-04-25T08:57:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.682+0000 7f4bf6d9d640 1 --2- 172.21.15.55:0/2780749429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf80cfdb0 0x7f4bf80ccfd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4bf809b000 tx=0x7f4be802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be07ac92dba620f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.683+0000 7f4bf559a640 1 -- 172.21.15.55:0/2780749429 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8007740 con 0x7f4bf80cfdb0 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.683+0000 7f4bf559a640 1 -- 172.21.15.55:0/2780749429 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be80078e0 con 0x7f4bf80cfdb0 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.683+0000 7f4bf559a640 1 -- 172.21.15.55:0/2780749429 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8007cb0 con 0x7f4bf80cfdb0 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.683+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2780749429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf80cfdb0 msgr2=0x7f4bf80ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.683+0000 7f4bfccf5640 1 --2- 172.21.15.55:0/2780749429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf80cfdb0 0x7f4bf80ccfd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4bf809b000 tx=0x7f4be802a710 comp rx=0 tx=0).stop 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.683+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2780749429 shutdown_connections 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.683+0000 7f4bfccf5640 1 --2- 172.21.15.55:0/2780749429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf80cfdb0 0x7f4bf80ccfd0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.683+0000 7f4bfccf5640 1 --2- 172.21.15.55:0/2780749429 >> v2:172.21.15.167:3300/0 conn(0x7f4bf815f120 0x7f4bf80ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.683+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2780749429 >> 172.21.15.55:0/2780749429 conn(0x7f4bf80d1900 msgr2=0x7f4bf80d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.683+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2780749429 shutdown_connections 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.683+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2780749429 wait complete. 2024-04-25T08:57:53.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.685+0000 7f4bfccf5640 1 Processor -- start 2024-04-25T08:57:53.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.685+0000 7f4bfccf5640 1 -- start start 2024-04-25T08:57:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.685+0000 7f4bfccf5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bf80ce830 0x7f4bf8156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.685+0000 7f4bfccf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bf80cfdb0 0x7f4bf80ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.685+0000 7f4bfccf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf815f120 0x7f4bf80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.685+0000 7f4bfccf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80cc480 con 0x7f4bf815f120 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.685+0000 7f4bfccf5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80ccab0 con 0x7f4bf80ce830 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.685+0000 7f4bfccf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80c5450 con 0x7f4bf80cfdb0 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.685+0000 7f4bf6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf815f120 0x7f4bf80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.685+0000 7f4bf6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf815f120 0x7f4bf80caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46642/0 (socket says 172.21.15.55:46642) 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.685+0000 7f4bf6d9d640 1 -- 172.21.15.55:0/2992923783 learned_addr learned my addr 172.21.15.55:0/2992923783 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4bf5d9b640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bf80cfdb0 0x7f4bf80ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4bf659c640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bf80ce830 0x7f4bf8156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4bf6d9d640 1 -- 172.21.15.55:0/2992923783 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bf80cfdb0 msgr2=0x7f4bf80ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4bf6d9d640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bf80cfdb0 0x7f4bf80ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4bf6d9d640 1 -- 172.21.15.55:0/2992923783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bf80ce830 msgr2=0x7f4bf8156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4bf6d9d640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bf80ce830 0x7f4bf8156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4bf6d9d640 1 -- 172.21.15.55:0/2992923783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80c9e70 con 0x7f4bf815f120 2024-04-25T08:57:53.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4bf6d9d640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf815f120 0x7f4bf80caf10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4be802ad00 tx=0x7f4be8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:53.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4beeffd640 1 -- 172.21.15.55:0/2992923783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8040070 con 0x7f4bf815f120 2024-04-25T08:57:53.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4beeffd640 1 -- 172.21.15.55:0/2992923783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be8031c90 con 0x7f4bf815f120 2024-04-25T08:57:53.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2992923783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf80ca150 con 0x7f4bf815f120 2024-04-25T08:57:53.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4beeffd640 1 -- 172.21.15.55:0/2992923783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8045680 con 0x7f4bf815f120 2024-04-25T08:57:53.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.686+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2992923783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf80ca710 con 0x7f4bf815f120 2024-04-25T08:57:53.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.687+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2992923783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf8067850 con 0x7f4bf815f120 2024-04-25T08:57:53.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.688+0000 7f4beeffd640 1 -- 172.21.15.55:0/2992923783 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4be8039040 con 0x7f4bf815f120 2024-04-25T08:57:53.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.688+0000 7f4beeffd640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4bd806b4d0 0x7f4bd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:53.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.688+0000 7f4beeffd640 1 -- 172.21.15.55:0/2992923783 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4be80abbf0 con 0x7f4bf815f120 2024-04-25T08:57:53.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.688+0000 7f4bf659c640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4bd806b4d0 0x7f4bd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:53.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.689+0000 7f4bf659c640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4bd806b4d0 0x7f4bd806d990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000b7c0 tx=0x7f4bf0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:53.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.692+0000 7f4beeffd640 1 -- 172.21.15.55:0/2992923783 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4be8043360 con 0x7f4bf815f120 2024-04-25T08:57:53.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.867+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2992923783 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4bf8071210 con 0x7f4bd806b4d0 2024-04-25T08:57:53.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.873+0000 7f4beeffd640 1 -- 172.21.15.55:0/2992923783 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247193 (secure 0 0 0) 0x7f4bf8071210 con 0x7f4bd806b4d0 2024-04-25T08:57:53.865 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:53.866 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:57:53.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2992923783 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4bd806b4d0 msgr2=0x7f4bd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4bd806b4d0 0x7f4bd806d990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000b7c0 tx=0x7f4bf0008040 comp rx=0 tx=0).stop 2024-04-25T08:57:53.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2992923783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf815f120 msgr2=0x7f4bf80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:53.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf815f120 0x7f4bf80caf10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4be802ad00 tx=0x7f4be8004a40 comp rx=0 tx=0).stop 2024-04-25T08:57:53.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2992923783 shutdown_connections 2024-04-25T08:57:53.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4bd806b4d0 0x7f4bd806d990 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf815f120 0x7f4bf80caf10 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bf80cfdb0 0x7f4bf80ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 --2- 172.21.15.55:0/2992923783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bf80ce830 0x7f4bf8156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:53.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2992923783 >> 172.21.15.55:0/2992923783 conn(0x7f4bf80d1900 msgr2=0x7f4bf80b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:53.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2992923783 shutdown_connections 2024-04-25T08:57:53.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:53.876+0000 7f4bfccf5640 1 -- 172.21.15.55:0/2992923783 wait complete. 2024-04-25T08:57:53.876 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-25T08:57:52.605884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592014,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240656,"kb_used_data":7832,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734064,"statfs":{"total":773094113280,"available":772847681536,"internally_reserved":0,"allocated":8019968,"data_stored":4014312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1646,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.434485"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189913+0000","last_change":"2024-04-25T08:57:49.189913+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189913+0000","last_undegraded":"2024-04-25T08:57:49.189913+0000","last_fullsized":"2024-04-25T08:57:49.189913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185400+0000","last_change":"2024-04-25T08:57:49.185400+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185400+0000","last_undegraded":"2024-04-25T08:57:49.185400+0000","last_fullsized":"2024-04-25T08:57:49.185400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.196576+0000","last_change":"2024-04-25T08:57:49.196576+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.196576+0000","last_undegraded":"2024-04-25T08:57:49.196576+0000","last_fullsized":"2024-04-25T08:57:49.196576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845941+0000","last_change":"2024-04-25T08:57:49.843433+0000","last_active":"2024-04-25T08:57:50.845941+0000","last_peered":"2024-04-25T08:57:50.845941+0000","last_clean":"2024-04-25T08:57:50.845941+0000","last_became_active":"2024-04-25T08:57:49.842997+0000","last_became_peered":"2024-04-25T08:57:49.842997+0000","last_unstale":"2024-04-25T08:57:50.845941+0000","last_undegraded":"2024-04-25T08:57:50.845941+0000","last_fullsized":"2024-04-25T08:57:50.845941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:00.690627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188384+0000","last_change":"2024-04-25T08:57:49.188384+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188384+0000","last_undegraded":"2024-04-25T08:57:49.188384+0000","last_fullsized":"2024-04-25T08:57:49.188384+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.186043+0000","last_change":"2024-04-25T08:57:49.186043+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.186043+0000","last_undegraded":"2024-04-25T08:57:49.186043+0000","last_fullsized":"2024-04-25T08:57:49.186043+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192147+0000","last_change":"2024-04-25T08:57:49.192147+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192147+0000","last_undegraded":"2024-04-25T08:57:49.192147+0000","last_fullsized":"2024-04-25T08:57:49.192147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185936+0000","last_change":"2024-04-25T08:57:49.185936+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185936+0000","last_undegraded":"2024-04-25T08:57:49.185936+0000","last_fullsized":"2024-04-25T08:57:49.185936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189680+0000","last_change":"2024-04-25T08:57:49.189680+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189680+0000","last_undegraded":"2024-04-25T08:57:49.189680+0000","last_fullsized":"2024-04-25T08:57:49.189680+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193533+0000","last_change":"2024-04-25T08:57:49.193533+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193533+0000","last_undegraded":"2024-04-25T08:57:49.193533+0000","last_fullsized":"2024-04-25T08:57:49.193533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189581+0000","last_change":"2024-04-25T08:57:49.189581+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189581+0000","last_undegraded":"2024-04-25T08:57:49.189581+0000","last_fullsized":"2024-04-25T08:57:49.189581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846107+0000","last_change":"2024-04-25T08:57:49.845838+0000","last_active":"2024-04-25T08:57:50.846107+0000","last_peered":"2024-04-25T08:57:50.846107+0000","last_clean":"2024-04-25T08:57:50.846107+0000","last_became_active":"2024-04-25T08:57:49.845562+0000","last_became_peered":"2024-04-25T08:57:49.845562+0000","last_unstale":"2024-04-25T08:57:50.846107+0000","last_undegraded":"2024-04-25T08:57:50.846107+0000","last_fullsized":"2024-04-25T08:57:50.846107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:23.131325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194521+0000","last_change":"2024-04-25T08:57:49.194521+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194521+0000","last_undegraded":"2024-04-25T08:57:49.194521+0000","last_fullsized":"2024-04-25T08:57:49.194521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189507+0000","last_change":"2024-04-25T08:57:49.189507+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189507+0000","last_undegraded":"2024-04-25T08:57:49.189507+0000","last_fullsized":"2024-04-25T08:57:49.189507+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.197918+0000","last_change":"2024-04-25T08:57:49.197918+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.197918+0000","last_undegraded":"2024-04-25T08:57:49.197918+0000","last_fullsized":"2024-04-25T08:57:49.197918+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.190819+0000","last_change":"2024-04-25T08:57:49.190819+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.190819+0000","last_undegraded":"2024-04-25T08:57:49.190819+0000","last_fullsized":"2024-04-25T08:57:49.190819+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189238+0000","last_change":"2024-04-25T08:57:49.189238+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189238+0000","last_undegraded":"2024-04-25T08:57:49.189238+0000","last_fullsized":"2024-04-25T08:57:49.189238+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846126+0000","last_change":"2024-04-25T08:57:49.844027+0000","last_active":"2024-04-25T08:57:50.846126+0000","last_peered":"2024-04-25T08:57:50.846126+0000","last_clean":"2024-04-25T08:57:50.846126+0000","last_became_active":"2024-04-25T08:57:49.843756+0000","last_became_peered":"2024-04-25T08:57:49.843756+0000","last_unstale":"2024-04-25T08:57:50.846126+0000","last_undegraded":"2024-04-25T08:57:50.846126+0000","last_fullsized":"2024-04-25T08:57:50.846126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:37.684246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185045+0000","last_change":"2024-04-25T08:57:49.185045+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185045+0000","last_undegraded":"2024-04-25T08:57:49.185045+0000","last_fullsized":"2024-04-25T08:57:49.185045+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195057+0000","last_change":"2024-04-25T08:57:49.195057+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195057+0000","last_undegraded":"2024-04-25T08:57:49.195057+0000","last_fullsized":"2024-04-25T08:57:49.195057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194165+0000","last_change":"2024-04-25T08:57:49.194165+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194165+0000","last_undegraded":"2024-04-25T08:57:49.194165+0000","last_fullsized":"2024-04-25T08:57:49.194165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.190485+0000","last_change":"2024-04-25T08:57:49.190485+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.190485+0000","last_undegraded":"2024-04-25T08:57:49.190485+0000","last_fullsized":"2024-04-25T08:57:49.190485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188149+0000","last_change":"2024-04-25T08:57:49.188149+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188149+0000","last_undegraded":"2024-04-25T08:57:49.188149+0000","last_fullsized":"2024-04-25T08:57:49.188149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187722+0000","last_change":"2024-04-25T08:57:49.187722+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187722+0000","last_undegraded":"2024-04-25T08:57:49.187722+0000","last_fullsized":"2024-04-25T08:57:49.187722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193974+0000","last_change":"2024-04-25T08:57:49.193974+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193974+0000","last_undegraded":"2024-04-25T08:57:49.193974+0000","last_fullsized":"2024-04-25T08:57:49.193974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194325+0000","last_change":"2024-04-25T08:57:49.194325+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194325+0000","last_undegraded":"2024-04-25T08:57:49.194325+0000","last_fullsized":"2024-04-25T08:57:49.194325+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.196022+0000","last_change":"2024-04-25T08:57:49.196022+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.196022+0000","last_undegraded":"2024-04-25T08:57:49.196022+0000","last_fullsized":"2024-04-25T08:57:49.196022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191584+0000","last_change":"2024-04-25T08:57:49.191584+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191584+0000","last_undegraded":"2024-04-25T08:57:49.191584+0000","last_fullsized":"2024-04-25T08:57:49.191584+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195517+0000","last_change":"2024-04-25T08:57:49.195517+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195517+0000","last_undegraded":"2024-04-25T08:57:49.195517+0000","last_fullsized":"2024-04-25T08:57:49.195517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192841+0000","last_change":"2024-04-25T08:57:49.192841+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192841+0000","last_undegraded":"2024-04-25T08:57:49.192841+0000","last_fullsized":"2024-04-25T08:57:49.192841+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191293+0000","last_change":"2024-04-25T08:57:49.191293+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191293+0000","last_undegraded":"2024-04-25T08:57:49.191293+0000","last_fullsized":"2024-04-25T08:57:49.191293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.184663+0000","last_change":"2024-04-25T08:57:49.184663+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.184663+0000","last_undegraded":"2024-04-25T08:57:49.184663+0000","last_fullsized":"2024-04-25T08:57:49.184663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187865+0000","last_change":"2024-04-25T08:57:49.187865+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187865+0000","last_undegraded":"2024-04-25T08:57:49.187865+0000","last_fullsized":"2024-04-25T08:57:49.187865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205876+0000","last_change":"2024-04-25T08:57:49.204071+0000","last_active":"2024-04-25T08:57:49.205876+0000","last_peered":"2024-04-25T08:57:49.205876+0000","last_clean":"2024-04-25T08:57:49.205876+0000","last_became_active":"2024-04-25T08:57:49.203657+0000","last_became_peered":"2024-04-25T08:57:49.203657+0000","last_unstale":"2024-04-25T08:57:49.205876+0000","last_undegraded":"2024-04-25T08:57:49.205876+0000","last_fullsized":"2024-04-25T08:57:49.205876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:08.452486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188708+0000","last_change":"2024-04-25T08:57:49.188708+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188708+0000","last_undegraded":"2024-04-25T08:57:49.188708+0000","last_fullsized":"2024-04-25T08:57:49.188708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208494+0000","last_change":"2024-04-25T08:57:49.204785+0000","last_active":"2024-04-25T08:57:49.208494+0000","last_peered":"2024-04-25T08:57:49.208494+0000","last_clean":"2024-04-25T08:57:49.208494+0000","last_became_active":"2024-04-25T08:57:49.204484+0000","last_became_peered":"2024-04-25T08:57:49.204484+0000","last_unstale":"2024-04-25T08:57:49.208494+0000","last_undegraded":"2024-04-25T08:57:49.208494+0000","last_fullsized":"2024-04-25T08:57:49.208494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:10.848641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185935+0000","last_change":"2024-04-25T08:57:49.185935+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185935+0000","last_undegraded":"2024-04-25T08:57:49.185935+0000","last_fullsized":"2024-04-25T08:57:49.185935+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.203012+0000","last_change":"2024-04-25T08:57:49.200263+0000","last_active":"2024-04-25T08:57:49.203012+0000","last_peered":"2024-04-25T08:57:49.203012+0000","last_clean":"2024-04-25T08:57:49.203012+0000","last_became_active":"2024-04-25T08:57:49.199990+0000","last_became_peered":"2024-04-25T08:57:49.199990+0000","last_unstale":"2024-04-25T08:57:49.203012+0000","last_undegraded":"2024-04-25T08:57:49.203012+0000","last_fullsized":"2024-04-25T08:57:49.203012+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:25.735805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189051+0000","last_change":"2024-04-25T08:57:49.189051+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189051+0000","last_undegraded":"2024-04-25T08:57:49.189051+0000","last_fullsized":"2024-04-25T08:57:49.189051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.197550+0000","last_change":"2024-04-25T08:57:49.193842+0000","last_active":"2024-04-25T08:57:49.197550+0000","last_peered":"2024-04-25T08:57:49.197550+0000","last_clean":"2024-04-25T08:57:49.197550+0000","last_became_active":"2024-04-25T08:57:49.193515+0000","last_became_peered":"2024-04-25T08:57:49.193515+0000","last_unstale":"2024-04-25T08:57:49.197550+0000","last_undegraded":"2024-04-25T08:57:49.197550+0000","last_fullsized":"2024-04-25T08:57:49.197550+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:34.530548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191916+0000","last_change":"2024-04-25T08:57:49.191916+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191916+0000","last_undegraded":"2024-04-25T08:57:49.191916+0000","last_fullsized":"2024-04-25T08:57:49.191916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.202646+0000","last_change":"2024-04-25T08:57:49.200083+0000","last_active":"2024-04-25T08:57:49.202646+0000","last_peered":"2024-04-25T08:57:49.202646+0000","last_clean":"2024-04-25T08:57:49.202646+0000","last_became_active":"2024-04-25T08:57:49.199768+0000","last_became_peered":"2024-04-25T08:57:49.199768+0000","last_unstale":"2024-04-25T08:57:49.202646+0000","last_undegraded":"2024-04-25T08:57:49.202646+0000","last_fullsized":"2024-04-25T08:57:49.202646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:20.826126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193688+0000","last_change":"2024-04-25T08:57:49.193688+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193688+0000","last_undegraded":"2024-04-25T08:57:49.193688+0000","last_fullsized":"2024-04-25T08:57:49.193688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205811+0000","last_change":"2024-04-25T08:57:49.204607+0000","last_active":"2024-04-25T08:57:49.205811+0000","last_peered":"2024-04-25T08:57:49.205811+0000","last_clean":"2024-04-25T08:57:49.205811+0000","last_became_active":"2024-04-25T08:57:49.204298+0000","last_became_peered":"2024-04-25T08:57:49.204298+0000","last_unstale":"2024-04-25T08:57:49.205811+0000","last_undegraded":"2024-04-25T08:57:49.205811+0000","last_fullsized":"2024-04-25T08:57:49.205811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:28.260907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187961+0000","last_change":"2024-04-25T08:57:49.187961+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187961+0000","last_undegraded":"2024-04-25T08:57:49.187961+0000","last_fullsized":"2024-04-25T08:57:49.187961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845764+0000","last_change":"2024-04-25T08:57:49.201987+0000","last_active":"2024-04-25T08:57:50.845764+0000","last_peered":"2024-04-25T08:57:50.845764+0000","last_clean":"2024-04-25T08:57:50.845764+0000","last_became_active":"2024-04-25T08:57:49.201668+0000","last_became_peered":"2024-04-25T08:57:49.201668+0000","last_unstale":"2024-04-25T08:57:50.845764+0000","last_undegraded":"2024-04-25T08:57:50.845764+0000","last_fullsized":"2024-04-25T08:57:50.845764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:02.728261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195966+0000","last_change":"2024-04-25T08:57:49.195966+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195966+0000","last_undegraded":"2024-04-25T08:57:49.195966+0000","last_fullsized":"2024-04-25T08:57:49.195966+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199827+0000","last_change":"2024-04-25T08:57:49.192553+0000","last_active":"2024-04-25T08:57:49.199827+0000","last_peered":"2024-04-25T08:57:49.199827+0000","last_clean":"2024-04-25T08:57:49.199827+0000","last_became_active":"2024-04-25T08:57:49.192250+0000","last_became_peered":"2024-04-25T08:57:49.192250+0000","last_unstale":"2024-04-25T08:57:49.199827+0000","last_undegraded":"2024-04-25T08:57:49.199827+0000","last_fullsized":"2024-04-25T08:57:49.199827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:22.257572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193848+0000","last_change":"2024-04-25T08:57:49.193848+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193848+0000","last_undegraded":"2024-04-25T08:57:49.193848+0000","last_fullsized":"2024-04-25T08:57:49.193848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205248+0000","last_change":"2024-04-25T08:57:49.202591+0000","last_active":"2024-04-25T08:57:49.205248+0000","last_peered":"2024-04-25T08:57:49.205248+0000","last_clean":"2024-04-25T08:57:49.205248+0000","last_became_active":"2024-04-25T08:57:49.202288+0000","last_became_peered":"2024-04-25T08:57:49.202288+0000","last_unstale":"2024-04-25T08:57:49.205248+0000","last_undegraded":"2024-04-25T08:57:49.205248+0000","last_fullsized":"2024-04-25T08:57:49.205248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:34.916404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189069+0000","last_change":"2024-04-25T08:57:49.189069+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189069+0000","last_undegraded":"2024-04-25T08:57:49.189069+0000","last_fullsized":"2024-04-25T08:57:49.189069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.200886+0000","last_change":"2024-04-25T08:57:49.199212+0000","last_active":"2024-04-25T08:57:49.200886+0000","last_peered":"2024-04-25T08:57:49.200886+0000","last_clean":"2024-04-25T08:57:49.200886+0000","last_became_active":"2024-04-25T08:57:49.198860+0000","last_became_peered":"2024-04-25T08:57:49.198860+0000","last_unstale":"2024-04-25T08:57:49.200886+0000","last_undegraded":"2024-04-25T08:57:49.200886+0000","last_fullsized":"2024-04-25T08:57:49.200886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:29.372407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185388+0000","last_change":"2024-04-25T08:57:49.185388+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185388+0000","last_undegraded":"2024-04-25T08:57:49.185388+0000","last_fullsized":"2024-04-25T08:57:49.185388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199149+0000","last_change":"2024-04-25T08:57:49.193690+0000","last_active":"2024-04-25T08:57:49.199149+0000","last_peered":"2024-04-25T08:57:49.199149+0000","last_clean":"2024-04-25T08:57:49.199149+0000","last_became_active":"2024-04-25T08:57:49.193363+0000","last_became_peered":"2024-04-25T08:57:49.193363+0000","last_unstale":"2024-04-25T08:57:49.199149+0000","last_undegraded":"2024-04-25T08:57:49.199149+0000","last_fullsized":"2024-04-25T08:57:49.199149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.044245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188883+0000","last_change":"2024-04-25T08:57:49.188883+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188883+0000","last_undegraded":"2024-04-25T08:57:49.188883+0000","last_fullsized":"2024-04-25T08:57:49.188883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846243+0000","last_change":"2024-04-25T08:57:49.198251+0000","last_active":"2024-04-25T08:57:50.846243+0000","last_peered":"2024-04-25T08:57:50.846243+0000","last_clean":"2024-04-25T08:57:50.846243+0000","last_became_active":"2024-04-25T08:57:49.197958+0000","last_became_peered":"2024-04-25T08:57:49.197958+0000","last_unstale":"2024-04-25T08:57:50.846243+0000","last_undegraded":"2024-04-25T08:57:50.846243+0000","last_fullsized":"2024-04-25T08:57:50.846243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.206185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187970+0000","last_change":"2024-04-25T08:57:49.187970+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187970+0000","last_undegraded":"2024-04-25T08:57:49.187970+0000","last_fullsized":"2024-04-25T08:57:49.187970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845968+0000","last_change":"2024-04-25T08:57:49.198379+0000","last_active":"2024-04-25T08:57:50.845968+0000","last_peered":"2024-04-25T08:57:50.845968+0000","last_clean":"2024-04-25T08:57:50.845968+0000","last_became_active":"2024-04-25T08:57:49.198053+0000","last_became_peered":"2024-04-25T08:57:49.198053+0000","last_unstale":"2024-04-25T08:57:50.845968+0000","last_undegraded":"2024-04-25T08:57:50.845968+0000","last_fullsized":"2024-04-25T08:57:50.845968+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:24.585656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192674+0000","last_change":"2024-04-25T08:57:49.192674+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192674+0000","last_undegraded":"2024-04-25T08:57:49.192674+0000","last_fullsized":"2024-04-25T08:57:49.192674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201819+0000","last_change":"2024-04-25T08:57:49.200592+0000","last_active":"2024-04-25T08:57:49.201819+0000","last_peered":"2024-04-25T08:57:49.201819+0000","last_clean":"2024-04-25T08:57:49.201819+0000","last_became_active":"2024-04-25T08:57:49.200309+0000","last_became_peered":"2024-04-25T08:57:49.200309+0000","last_unstale":"2024-04-25T08:57:49.201819+0000","last_undegraded":"2024-04-25T08:57:49.201819+0000","last_fullsized":"2024-04-25T08:57:49.201819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:00.354293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193883+0000","last_change":"2024-04-25T08:57:49.193883+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193883+0000","last_undegraded":"2024-04-25T08:57:49.193883+0000","last_fullsized":"2024-04-25T08:57:49.193883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.204416+0000","last_change":"2024-04-25T08:57:49.202467+0000","last_active":"2024-04-25T08:57:49.204416+0000","last_peered":"2024-04-25T08:57:49.204416+0000","last_clean":"2024-04-25T08:57:49.204416+0000","last_became_active":"2024-04-25T08:57:49.202182+0000","last_became_peered":"2024-04-25T08:57:49.202182+0000","last_unstale":"2024-04-25T08:57:49.204416+0000","last_undegraded":"2024-04-25T08:57:49.204416+0000","last_fullsized":"2024-04-25T08:57:49.204416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.464226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187658+0000","last_change":"2024-04-25T08:57:49.187658+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187658+0000","last_undegraded":"2024-04-25T08:57:49.187658+0000","last_fullsized":"2024-04-25T08:57:49.187658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201172+0000","last_change":"2024-04-25T08:57:49.199693+0000","last_active":"2024-04-25T08:57:49.201172+0000","last_peered":"2024-04-25T08:57:49.201172+0000","last_clean":"2024-04-25T08:57:49.201172+0000","last_became_active":"2024-04-25T08:57:49.199348+0000","last_became_peered":"2024-04-25T08:57:49.199348+0000","last_unstale":"2024-04-25T08:57:49.201172+0000","last_undegraded":"2024-04-25T08:57:49.201172+0000","last_fullsized":"2024-04-25T08:57:49.201172+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:11.998048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191499+0000","last_change":"2024-04-25T08:57:49.191499+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191499+0000","last_undegraded":"2024-04-25T08:57:49.191499+0000","last_fullsized":"2024-04-25T08:57:49.191499+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199063+0000","last_change":"2024-04-25T08:57:49.196147+0000","last_active":"2024-04-25T08:57:49.199063+0000","last_peered":"2024-04-25T08:57:49.199063+0000","last_clean":"2024-04-25T08:57:49.199063+0000","last_became_active":"2024-04-25T08:57:49.195241+0000","last_became_peered":"2024-04-25T08:57:49.195241+0000","last_unstale":"2024-04-25T08:57:49.199063+0000","last_undegraded":"2024-04-25T08:57:49.199063+0000","last_fullsized":"2024-04-25T08:57:49.199063+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:10.850720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188158+0000","last_change":"2024-04-25T08:57:49.188158+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188158+0000","last_undegraded":"2024-04-25T08:57:49.188158+0000","last_fullsized":"2024-04-25T08:57:49.188158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.203814+0000","last_change":"2024-04-25T08:57:49.201604+0000","last_active":"2024-04-25T08:57:49.203814+0000","last_peered":"2024-04-25T08:57:49.203814+0000","last_clean":"2024-04-25T08:57:49.203814+0000","last_became_active":"2024-04-25T08:57:49.201278+0000","last_became_peered":"2024-04-25T08:57:49.201278+0000","last_unstale":"2024-04-25T08:57:49.203814+0000","last_undegraded":"2024-04-25T08:57:49.203814+0000","last_fullsized":"2024-04-25T08:57:49.203814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:59.607582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846217+0000","last_change":"2024-04-25T08:57:49.846548+0000","last_active":"2024-04-25T08:57:50.846217+0000","last_peered":"2024-04-25T08:57:50.846217+0000","last_clean":"2024-04-25T08:57:50.846217+0000","last_became_active":"2024-04-25T08:57:49.846273+0000","last_became_peered":"2024-04-25T08:57:49.846273+0000","last_unstale":"2024-04-25T08:57:50.846217+0000","last_undegraded":"2024-04-25T08:57:50.846217+0000","last_fullsized":"2024-04-25T08:57:50.846217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:15.697708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.200892+0000","last_change":"2024-04-25T08:57:49.199525+0000","last_active":"2024-04-25T08:57:49.200892+0000","last_peered":"2024-04-25T08:57:49.200892+0000","last_clean":"2024-04-25T08:57:49.200892+0000","last_became_active":"2024-04-25T08:57:49.199026+0000","last_became_peered":"2024-04-25T08:57:49.199026+0000","last_unstale":"2024-04-25T08:57:49.200892+0000","last_undegraded":"2024-04-25T08:57:49.200892+0000","last_fullsized":"2024-04-25T08:57:49.200892+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:24.441411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188393+0000","last_change":"2024-04-25T08:57:49.188393+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188393+0000","last_undegraded":"2024-04-25T08:57:49.188393+0000","last_fullsized":"2024-04-25T08:57:49.188393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205118+0000","last_change":"2024-04-25T08:57:49.203809+0000","last_active":"2024-04-25T08:57:49.205118+0000","last_peered":"2024-04-25T08:57:49.205118+0000","last_clean":"2024-04-25T08:57:49.205118+0000","last_became_active":"2024-04-25T08:57:49.203459+0000","last_became_peered":"2024-04-25T08:57:49.203459+0000","last_unstale":"2024-04-25T08:57:49.205118+0000","last_undegraded":"2024-04-25T08:57:49.205118+0000","last_fullsized":"2024-04-25T08:57:49.205118+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193606+0000","last_change":"2024-04-25T08:57:49.193606+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193606+0000","last_undegraded":"2024-04-25T08:57:49.193606+0000","last_fullsized":"2024-04-25T08:57:49.193606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205792+0000","last_change":"2024-04-25T08:57:49.203616+0000","last_active":"2024-04-25T08:57:49.205792+0000","last_peered":"2024-04-25T08:57:49.205792+0000","last_clean":"2024-04-25T08:57:49.205792+0000","last_became_active":"2024-04-25T08:57:49.203330+0000","last_became_peered":"2024-04-25T08:57:49.203330+0000","last_unstale":"2024-04-25T08:57:49.205792+0000","last_undegraded":"2024-04-25T08:57:49.205792+0000","last_fullsized":"2024-04-25T08:57:49.205792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:18.344931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192288+0000","last_change":"2024-04-25T08:57:49.192288+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192288+0000","last_undegraded":"2024-04-25T08:57:49.192288+0000","last_fullsized":"2024-04-25T08:57:49.192288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201520+0000","last_change":"2024-04-25T08:57:49.200461+0000","last_active":"2024-04-25T08:57:49.201520+0000","last_peered":"2024-04-25T08:57:49.201520+0000","last_clean":"2024-04-25T08:57:49.201520+0000","last_became_active":"2024-04-25T08:57:49.200166+0000","last_became_peered":"2024-04-25T08:57:49.200166+0000","last_unstale":"2024-04-25T08:57:49.201520+0000","last_undegraded":"2024-04-25T08:57:49.201520+0000","last_fullsized":"2024-04-25T08:57:49.201520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:45.768247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192305+0000","last_change":"2024-04-25T08:57:49.192305+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192305+0000","last_undegraded":"2024-04-25T08:57:49.192305+0000","last_fullsized":"2024-04-25T08:57:49.192305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208396+0000","last_change":"2024-04-25T08:57:49.204125+0000","last_active":"2024-04-25T08:57:49.208396+0000","last_peered":"2024-04-25T08:57:49.208396+0000","last_clean":"2024-04-25T08:57:49.208396+0000","last_became_active":"2024-04-25T08:57:49.203829+0000","last_became_peered":"2024-04-25T08:57:49.203829+0000","last_unstale":"2024-04-25T08:57:49.208396+0000","last_undegraded":"2024-04-25T08:57:49.208396+0000","last_fullsized":"2024-04-25T08:57:49.208396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:20.640318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.198297+0000","last_change":"2024-04-25T08:57:49.198297+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.198297+0000","last_undegraded":"2024-04-25T08:57:49.198297+0000","last_fullsized":"2024-04-25T08:57:49.198297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199039+0000","last_change":"2024-04-25T08:57:49.195696+0000","last_active":"2024-04-25T08:57:49.199039+0000","last_peered":"2024-04-25T08:57:49.199039+0000","last_clean":"2024-04-25T08:57:49.199039+0000","last_became_active":"2024-04-25T08:57:49.195396+0000","last_became_peered":"2024-04-25T08:57:49.195396+0000","last_unstale":"2024-04-25T08:57:49.199039+0000","last_undegraded":"2024-04-25T08:57:49.199039+0000","last_fullsized":"2024-04-25T08:57:49.199039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:41.508120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192584+0000","last_change":"2024-04-25T08:57:49.192584+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192584+0000","last_undegraded":"2024-04-25T08:57:49.192584+0000","last_fullsized":"2024-04-25T08:57:49.192584+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.206257+0000","last_change":"2024-04-25T08:57:49.204999+0000","last_active":"2024-04-25T08:57:49.206257+0000","last_peered":"2024-04-25T08:57:49.206257+0000","last_clean":"2024-04-25T08:57:49.206257+0000","last_became_active":"2024-04-25T08:57:49.204637+0000","last_became_peered":"2024-04-25T08:57:49.204637+0000","last_unstale":"2024-04-25T08:57:49.206257+0000","last_undegraded":"2024-04-25T08:57:49.206257+0000","last_fullsized":"2024-04-25T08:57:49.206257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188164+0000","last_change":"2024-04-25T08:57:49.188164+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188164+0000","last_undegraded":"2024-04-25T08:57:49.188164+0000","last_fullsized":"2024-04-25T08:57:49.188164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208398+0000","last_change":"2024-04-25T08:57:49.204319+0000","last_active":"2024-04-25T08:57:49.208398+0000","last_peered":"2024-04-25T08:57:49.208398+0000","last_clean":"2024-04-25T08:57:49.208398+0000","last_became_active":"2024-04-25T08:57:49.203999+0000","last_became_peered":"2024-04-25T08:57:49.203999+0000","last_unstale":"2024-04-25T08:57:49.208398+0000","last_undegraded":"2024-04-25T08:57:49.208398+0000","last_fullsized":"2024-04-25T08:57:49.208398+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:31.676546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188647+0000","last_change":"2024-04-25T08:57:49.188647+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188647+0000","last_undegraded":"2024-04-25T08:57:49.188647+0000","last_fullsized":"2024-04-25T08:57:49.188647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.206105+0000","last_change":"2024-04-25T08:57:49.201643+0000","last_active":"2024-04-25T08:57:49.206105+0000","last_peered":"2024-04-25T08:57:49.206105+0000","last_clean":"2024-04-25T08:57:49.206105+0000","last_became_active":"2024-04-25T08:57:49.201323+0000","last_became_peered":"2024-04-25T08:57:49.201323+0000","last_unstale":"2024-04-25T08:57:49.206105+0000","last_undegraded":"2024-04-25T08:57:49.206105+0000","last_fullsized":"2024-04-25T08:57:49.206105+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:18.790627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189009+0000","last_change":"2024-04-25T08:57:49.189009+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189009+0000","last_undegraded":"2024-04-25T08:57:49.189009+0000","last_fullsized":"2024-04-25T08:57:49.189009+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.202325+0000","last_change":"2024-04-25T08:57:49.196631+0000","last_active":"2024-04-25T08:57:49.202325+0000","last_peered":"2024-04-25T08:57:49.202325+0000","last_clean":"2024-04-25T08:57:49.202325+0000","last_became_active":"2024-04-25T08:57:49.196337+0000","last_became_peered":"2024-04-25T08:57:49.196337+0000","last_unstale":"2024-04-25T08:57:49.202325+0000","last_undegraded":"2024-04-25T08:57:49.202325+0000","last_fullsized":"2024-04-25T08:57:49.202325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:53.010186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185324+0000","last_change":"2024-04-25T08:57:49.185324+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185324+0000","last_undegraded":"2024-04-25T08:57:49.185324+0000","last_fullsized":"2024-04-25T08:57:49.185324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845844+0000","last_change":"2024-04-25T08:57:49.199669+0000","last_active":"2024-04-25T08:57:50.845844+0000","last_peered":"2024-04-25T08:57:50.845844+0000","last_clean":"2024-04-25T08:57:50.845844+0000","last_became_active":"2024-04-25T08:57:49.199360+0000","last_became_peered":"2024-04-25T08:57:49.199360+0000","last_unstale":"2024-04-25T08:57:50.845844+0000","last_undegraded":"2024-04-25T08:57:50.845844+0000","last_fullsized":"2024-04-25T08:57:50.845844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:29.222215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845767+0000","last_change":"2024-04-25T08:57:49.843470+0000","last_active":"2024-04-25T08:57:50.845767+0000","last_peered":"2024-04-25T08:57:50.845767+0000","last_clean":"2024-04-25T08:57:50.845767+0000","last_became_active":"2024-04-25T08:57:49.842975+0000","last_became_peered":"2024-04-25T08:57:49.842975+0000","last_unstale":"2024-04-25T08:57:50.845767+0000","last_undegraded":"2024-04-25T08:57:50.845767+0000","last_fullsized":"2024-04-25T08:57:50.845767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:39.580799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201009+0000","last_change":"2024-04-25T08:57:49.198371+0000","last_active":"2024-04-25T08:57:49.201009+0000","last_peered":"2024-04-25T08:57:49.201009+0000","last_clean":"2024-04-25T08:57:49.201009+0000","last_became_active":"2024-04-25T08:57:49.198048+0000","last_became_peered":"2024-04-25T08:57:49.198048+0000","last_unstale":"2024-04-25T08:57:49.201009+0000","last_undegraded":"2024-04-25T08:57:49.201009+0000","last_fullsized":"2024-04-25T08:57:49.201009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:21.781630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.184515+0000","last_change":"2024-04-25T08:57:49.184515+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.184515+0000","last_undegraded":"2024-04-25T08:57:49.184515+0000","last_fullsized":"2024-04-25T08:57:49.184515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.194761+0000","last_change":"2024-04-25T08:57:49.192336+0000","last_active":"2024-04-25T08:57:49.194761+0000","last_peered":"2024-04-25T08:57:49.194761+0000","last_clean":"2024-04-25T08:57:49.194761+0000","last_became_active":"2024-04-25T08:57:49.192062+0000","last_became_peered":"2024-04-25T08:57:49.192062+0000","last_unstale":"2024-04-25T08:57:49.194761+0000","last_undegraded":"2024-04-25T08:57:49.194761+0000","last_fullsized":"2024-04-25T08:57:49.194761+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:18.849761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192705+0000","last_change":"2024-04-25T08:57:49.192705+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192705+0000","last_undegraded":"2024-04-25T08:57:49.192705+0000","last_fullsized":"2024-04-25T08:57:49.192705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.197397+0000","last_change":"2024-04-25T08:57:49.193013+0000","last_active":"2024-04-25T08:57:49.197397+0000","last_peered":"2024-04-25T08:57:49.197397+0000","last_clean":"2024-04-25T08:57:49.197397+0000","last_became_active":"2024-04-25T08:57:49.192748+0000","last_became_peered":"2024-04-25T08:57:49.192748+0000","last_unstale":"2024-04-25T08:57:49.197397+0000","last_undegraded":"2024-04-25T08:57:49.197397+0000","last_fullsized":"2024-04-25T08:57:49.197397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:17.238736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":259,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.190730+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:57:49.190730+0000","last_peered":"2024-04-25T08:57:49.190730+0000","last_clean":"2024-04-25T08:57:49.190730+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:57:49.190730+0000","last_undegraded":"2024-04-25T08:57:49.190730+0000","last_fullsized":"2024-04-25T08:57:49.190730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1646,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28424,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343416,"statfs":{"total":96636764160,"available":96607657984,"internally_reserved":0,"allocated":1437696,"data_stored":940299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":856064,"data_stored":356206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1449984,"data_stored":946574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":901120,"data_stored":371509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:57:53.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2024-04-25T08:57:53.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.189913+0000', 'last_change': '2024-04-25T08:57:49.189913+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.189913+0000', 'last_undegraded': '2024-04-25T08:57:49.189913+0000', 'last_fullsized': '2024-04-25T08:57:49.189913+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:57:53.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2024-04-25T08:57:53.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.185400+0000', 'last_change': '2024-04-25T08:57:49.185400+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.185400+0000', 'last_undegraded': '2024-04-25T08:57:49.185400+0000', 'last_fullsized': '2024-04-25T08:57:49.185400+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:53.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2024-04-25T08:57:53.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.196576+0000', 'last_change': '2024-04-25T08:57:49.196576+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.196576+0000', 'last_undegraded': '2024-04-25T08:57:49.196576+0000', 'last_fullsized': '2024-04-25T08:57:49.196576+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:53.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2024-04-25T08:57:53.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.188384+0000', 'last_change': '2024-04-25T08:57:49.188384+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.188384+0000', 'last_undegraded': '2024-04-25T08:57:49.188384+0000', 'last_fullsized': '2024-04-25T08:57:49.188384+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:57:53.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2024-04-25T08:57:53.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.186043+0000', 'last_change': '2024-04-25T08:57:49.186043+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.186043+0000', 'last_undegraded': '2024-04-25T08:57:49.186043+0000', 'last_fullsized': '2024-04-25T08:57:49.186043+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:53.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2024-04-25T08:57:53.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.192147+0000', 'last_change': '2024-04-25T08:57:49.192147+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.192147+0000', 'last_undegraded': '2024-04-25T08:57:49.192147+0000', 'last_fullsized': '2024-04-25T08:57:49.192147+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:57:53.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2024-04-25T08:57:53.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.185936+0000', 'last_change': '2024-04-25T08:57:49.185936+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.185936+0000', 'last_undegraded': '2024-04-25T08:57:49.185936+0000', 'last_fullsized': '2024-04-25T08:57:49.185936+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:53.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2024-04-25T08:57:53.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.189680+0000', 'last_change': '2024-04-25T08:57:49.189680+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.189680+0000', 'last_undegraded': '2024-04-25T08:57:49.189680+0000', 'last_fullsized': '2024-04-25T08:57:49.189680+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:57:53.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2024-04-25T08:57:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.193533+0000', 'last_change': '2024-04-25T08:57:49.193533+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.193533+0000', 'last_undegraded': '2024-04-25T08:57:49.193533+0000', 'last_fullsized': '2024-04-25T08:57:49.193533+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2024-04-25T08:57:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.189581+0000', 'last_change': '2024-04-25T08:57:49.189581+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.189581+0000', 'last_undegraded': '2024-04-25T08:57:49.189581+0000', 'last_fullsized': '2024-04-25T08:57:49.189581+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:57:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2024-04-25T08:57:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.194521+0000', 'last_change': '2024-04-25T08:57:49.194521+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.194521+0000', 'last_undegraded': '2024-04-25T08:57:49.194521+0000', 'last_fullsized': '2024-04-25T08:57:49.194521+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:57:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2024-04-25T08:57:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.189507+0000', 'last_change': '2024-04-25T08:57:49.189507+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.189507+0000', 'last_undegraded': '2024-04-25T08:57:49.189507+0000', 'last_fullsized': '2024-04-25T08:57:49.189507+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:57:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2024-04-25T08:57:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.197918+0000', 'last_change': '2024-04-25T08:57:49.197918+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.197918+0000', 'last_undegraded': '2024-04-25T08:57:49.197918+0000', 'last_fullsized': '2024-04-25T08:57:49.197918+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:57:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2024-04-25T08:57:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.190819+0000', 'last_change': '2024-04-25T08:57:49.190819+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.190819+0000', 'last_undegraded': '2024-04-25T08:57:49.190819+0000', 'last_fullsized': '2024-04-25T08:57:49.190819+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.189238+0000', 'last_change': '2024-04-25T08:57:49.189238+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.189238+0000', 'last_undegraded': '2024-04-25T08:57:49.189238+0000', 'last_fullsized': '2024-04-25T08:57:49.189238+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.185045+0000', 'last_change': '2024-04-25T08:57:49.185045+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.185045+0000', 'last_undegraded': '2024-04-25T08:57:49.185045+0000', 'last_fullsized': '2024-04-25T08:57:49.185045+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.195057+0000', 'last_change': '2024-04-25T08:57:49.195057+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.195057+0000', 'last_undegraded': '2024-04-25T08:57:49.195057+0000', 'last_fullsized': '2024-04-25T08:57:49.195057+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.194165+0000', 'last_change': '2024-04-25T08:57:49.194165+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.194165+0000', 'last_undegraded': '2024-04-25T08:57:49.194165+0000', 'last_fullsized': '2024-04-25T08:57:49.194165+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.190485+0000', 'last_change': '2024-04-25T08:57:49.190485+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.190485+0000', 'last_undegraded': '2024-04-25T08:57:49.190485+0000', 'last_fullsized': '2024-04-25T08:57:49.190485+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2024-04-25T08:57:53.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.188149+0000', 'last_change': '2024-04-25T08:57:49.188149+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.188149+0000', 'last_undegraded': '2024-04-25T08:57:49.188149+0000', 'last_fullsized': '2024-04-25T08:57:49.188149+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.187722+0000', 'last_change': '2024-04-25T08:57:49.187722+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.187722+0000', 'last_undegraded': '2024-04-25T08:57:49.187722+0000', 'last_fullsized': '2024-04-25T08:57:49.187722+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.193974+0000', 'last_change': '2024-04-25T08:57:49.193974+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.193974+0000', 'last_undegraded': '2024-04-25T08:57:49.193974+0000', 'last_fullsized': '2024-04-25T08:57:49.193974+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.194325+0000', 'last_change': '2024-04-25T08:57:49.194325+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.194325+0000', 'last_undegraded': '2024-04-25T08:57:49.194325+0000', 'last_fullsized': '2024-04-25T08:57:49.194325+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.196022+0000', 'last_change': '2024-04-25T08:57:49.196022+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.196022+0000', 'last_undegraded': '2024-04-25T08:57:49.196022+0000', 'last_fullsized': '2024-04-25T08:57:49.196022+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.191584+0000', 'last_change': '2024-04-25T08:57:49.191584+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.191584+0000', 'last_undegraded': '2024-04-25T08:57:49.191584+0000', 'last_fullsized': '2024-04-25T08:57:49.191584+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2024-04-25T08:57:53.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.195517+0000', 'last_change': '2024-04-25T08:57:49.195517+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.195517+0000', 'last_undegraded': '2024-04-25T08:57:49.195517+0000', 'last_fullsized': '2024-04-25T08:57:49.195517+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:53.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2024-04-25T08:57:53.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.192841+0000', 'last_change': '2024-04-25T08:57:49.192841+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.192841+0000', 'last_undegraded': '2024-04-25T08:57:49.192841+0000', 'last_fullsized': '2024-04-25T08:57:49.192841+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:57:53.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2024-04-25T08:57:53.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.191293+0000', 'last_change': '2024-04-25T08:57:49.191293+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.191293+0000', 'last_undegraded': '2024-04-25T08:57:49.191293+0000', 'last_fullsized': '2024-04-25T08:57:49.191293+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:57:53.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2024-04-25T08:57:53.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.184663+0000', 'last_change': '2024-04-25T08:57:49.184663+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.184663+0000', 'last_undegraded': '2024-04-25T08:57:49.184663+0000', 'last_fullsized': '2024-04-25T08:57:49.184663+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:53.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2024-04-25T08:57:53.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.187865+0000', 'last_change': '2024-04-25T08:57:49.187865+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.187865+0000', 'last_undegraded': '2024-04-25T08:57:49.187865+0000', 'last_fullsized': '2024-04-25T08:57:49.187865+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:57:53.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2024-04-25T08:57:53.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.188708+0000', 'last_change': '2024-04-25T08:57:49.188708+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.188708+0000', 'last_undegraded': '2024-04-25T08:57:49.188708+0000', 'last_fullsized': '2024-04-25T08:57:49.188708+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:57:53.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2024-04-25T08:57:53.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.185935+0000', 'last_change': '2024-04-25T08:57:49.185935+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.185935+0000', 'last_undegraded': '2024-04-25T08:57:49.185935+0000', 'last_fullsized': '2024-04-25T08:57:49.185935+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:53.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2024-04-25T08:57:53.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.189051+0000', 'last_change': '2024-04-25T08:57:49.189051+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.189051+0000', 'last_undegraded': '2024-04-25T08:57:49.189051+0000', 'last_fullsized': '2024-04-25T08:57:49.189051+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:57:53.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2024-04-25T08:57:53.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.191916+0000', 'last_change': '2024-04-25T08:57:49.191916+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.191916+0000', 'last_undegraded': '2024-04-25T08:57:49.191916+0000', 'last_fullsized': '2024-04-25T08:57:49.191916+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:57:53.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2024-04-25T08:57:53.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.193688+0000', 'last_change': '2024-04-25T08:57:49.193688+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.193688+0000', 'last_undegraded': '2024-04-25T08:57:49.193688+0000', 'last_fullsized': '2024-04-25T08:57:49.193688+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:53.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2024-04-25T08:57:53.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.187961+0000', 'last_change': '2024-04-25T08:57:49.187961+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.187961+0000', 'last_undegraded': '2024-04-25T08:57:49.187961+0000', 'last_fullsized': '2024-04-25T08:57:49.187961+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:57:53.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2024-04-25T08:57:53.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.195966+0000', 'last_change': '2024-04-25T08:57:49.195966+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.195966+0000', 'last_undegraded': '2024-04-25T08:57:49.195966+0000', 'last_fullsized': '2024-04-25T08:57:49.195966+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:57:53.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2024-04-25T08:57:53.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.193848+0000', 'last_change': '2024-04-25T08:57:49.193848+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.193848+0000', 'last_undegraded': '2024-04-25T08:57:49.193848+0000', 'last_fullsized': '2024-04-25T08:57:49.193848+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:57:53.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2024-04-25T08:57:53.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.189069+0000', 'last_change': '2024-04-25T08:57:49.189069+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.189069+0000', 'last_undegraded': '2024-04-25T08:57:49.189069+0000', 'last_fullsized': '2024-04-25T08:57:49.189069+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:57:53.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2024-04-25T08:57:53.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.185388+0000', 'last_change': '2024-04-25T08:57:49.185388+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.185388+0000', 'last_undegraded': '2024-04-25T08:57:49.185388+0000', 'last_fullsized': '2024-04-25T08:57:49.185388+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:53.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2024-04-25T08:57:53.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.188883+0000', 'last_change': '2024-04-25T08:57:49.188883+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.188883+0000', 'last_undegraded': '2024-04-25T08:57:49.188883+0000', 'last_fullsized': '2024-04-25T08:57:49.188883+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:57:53.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2024-04-25T08:57:53.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.187970+0000', 'last_change': '2024-04-25T08:57:49.187970+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.187970+0000', 'last_undegraded': '2024-04-25T08:57:49.187970+0000', 'last_fullsized': '2024-04-25T08:57:49.187970+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:57:53.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2024-04-25T08:57:53.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.192674+0000', 'last_change': '2024-04-25T08:57:49.192674+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.192674+0000', 'last_undegraded': '2024-04-25T08:57:49.192674+0000', 'last_fullsized': '2024-04-25T08:57:49.192674+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:57:53.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2024-04-25T08:57:53.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.193883+0000', 'last_change': '2024-04-25T08:57:49.193883+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.193883+0000', 'last_undegraded': '2024-04-25T08:57:49.193883+0000', 'last_fullsized': '2024-04-25T08:57:49.193883+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:57:53.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2024-04-25T08:57:53.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.187658+0000', 'last_change': '2024-04-25T08:57:49.187658+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.187658+0000', 'last_undegraded': '2024-04-25T08:57:49.187658+0000', 'last_fullsized': '2024-04-25T08:57:49.187658+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:57:53.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2024-04-25T08:57:53.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.191499+0000', 'last_change': '2024-04-25T08:57:49.191499+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.191499+0000', 'last_undegraded': '2024-04-25T08:57:49.191499+0000', 'last_fullsized': '2024-04-25T08:57:49.191499+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:57:53.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2024-04-25T08:57:53.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.188158+0000', 'last_change': '2024-04-25T08:57:49.188158+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.188158+0000', 'last_undegraded': '2024-04-25T08:57:49.188158+0000', 'last_fullsized': '2024-04-25T08:57:49.188158+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:57:53.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2024-04-25T08:57:53.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.188393+0000', 'last_change': '2024-04-25T08:57:49.188393+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.188393+0000', 'last_undegraded': '2024-04-25T08:57:49.188393+0000', 'last_fullsized': '2024-04-25T08:57:49.188393+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:57:53.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2024-04-25T08:57:53.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.193606+0000', 'last_change': '2024-04-25T08:57:49.193606+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.193606+0000', 'last_undegraded': '2024-04-25T08:57:49.193606+0000', 'last_fullsized': '2024-04-25T08:57:49.193606+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:53.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2024-04-25T08:57:53.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.192288+0000', 'last_change': '2024-04-25T08:57:49.192288+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.192288+0000', 'last_undegraded': '2024-04-25T08:57:49.192288+0000', 'last_fullsized': '2024-04-25T08:57:49.192288+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:53.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2024-04-25T08:57:53.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.192305+0000', 'last_change': '2024-04-25T08:57:49.192305+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.192305+0000', 'last_undegraded': '2024-04-25T08:57:49.192305+0000', 'last_fullsized': '2024-04-25T08:57:49.192305+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:53.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2024-04-25T08:57:53.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.198297+0000', 'last_change': '2024-04-25T08:57:49.198297+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.198297+0000', 'last_undegraded': '2024-04-25T08:57:49.198297+0000', 'last_fullsized': '2024-04-25T08:57:49.198297+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:57:53.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2024-04-25T08:57:53.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.192584+0000', 'last_change': '2024-04-25T08:57:49.192584+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.192584+0000', 'last_undegraded': '2024-04-25T08:57:49.192584+0000', 'last_fullsized': '2024-04-25T08:57:49.192584+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:57:53.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2024-04-25T08:57:53.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.188164+0000', 'last_change': '2024-04-25T08:57:49.188164+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.188164+0000', 'last_undegraded': '2024-04-25T08:57:49.188164+0000', 'last_fullsized': '2024-04-25T08:57:49.188164+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:57:53.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2024-04-25T08:57:53.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.188647+0000', 'last_change': '2024-04-25T08:57:49.188647+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.188647+0000', 'last_undegraded': '2024-04-25T08:57:49.188647+0000', 'last_fullsized': '2024-04-25T08:57:49.188647+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:57:53.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2024-04-25T08:57:53.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.189009+0000', 'last_change': '2024-04-25T08:57:49.189009+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.189009+0000', 'last_undegraded': '2024-04-25T08:57:49.189009+0000', 'last_fullsized': '2024-04-25T08:57:49.189009+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:57:53.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2024-04-25T08:57:53.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.185324+0000', 'last_change': '2024-04-25T08:57:49.185324+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.185324+0000', 'last_undegraded': '2024-04-25T08:57:49.185324+0000', 'last_fullsized': '2024-04-25T08:57:49.185324+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:53.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2024-04-25T08:57:53.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.184515+0000', 'last_change': '2024-04-25T08:57:49.184515+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.184515+0000', 'last_undegraded': '2024-04-25T08:57:49.184515+0000', 'last_fullsized': '2024-04-25T08:57:49.184515+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:57:53.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2024-04-25T08:57:53.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:57:49.192705+0000', 'last_change': '2024-04-25T08:57:49.192705+0000', 'last_active': '2024-04-25T08:57:49.169839+0000', 'last_peered': '2024-04-25T08:57:49.169839+0000', 'last_clean': '2024-04-25T08:57:49.169839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:57:49.192705+0000', 'last_undegraded': '2024-04-25T08:57:49.192705+0000', 'last_fullsized': '2024-04-25T08:57:49.192705+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'last_clean_scrub_stamp': '2024-04-25T08:57:49.169839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:57:53.891 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:57:54.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.027+0000 7f57f7529640 1 Processor -- start 2024-04-25T08:57:54.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.027+0000 7f57f7529640 1 -- start start 2024-04-25T08:57:54.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.028+0000 7f57f7529640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00ce130 0x7f57f006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.028+0000 7f57f7529640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f0161970 con 0x7f57f006b0e0 2024-04-25T08:57:54.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.028+0000 7f57f7529640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f006b780 con 0x7f57f0162360 2024-04-25T08:57:54.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.028+0000 7f57f7529640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f006b530 con 0x7f57f00ce130 2024-04-25T08:57:54.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.028+0000 7f57f5ac6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f57f006b0e0 0x7f57f006dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50340/0 (socket says 172.21.15.55:50340) 2024-04-25T08:57:54.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.028+0000 7f57f5ac6640 1 -- 172.21.15.55:0/3158505999 learned_addr learned my addr 172.21.15.55:0/3158505999 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:54.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.028+0000 7f57f4ac4640 1 --2- 172.21.15.55:0/3158505999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00ce130 0x7f57f006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.028+0000 7f57e7fff640 1 -- 172.21.15.55:0/3158505999 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210523876 0 0) 0x7f57e8001490 con 0x7f57f006b0e0 2024-04-25T08:57:54.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.028+0000 7f57e7fff640 1 -- 172.21.15.55:0/3158505999 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57dc003520 con 0x7f57f006b0e0 2024-04-25T08:57:54.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.029+0000 7f57e7fff640 1 -- 172.21.15.55:0/3158505999 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645532819 0 0) 0x7f57f006b780 con 0x7f57f0162360 2024-04-25T08:57:54.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.029+0000 7f57e7fff640 1 -- 172.21.15.55:0/3158505999 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e8001490 con 0x7f57f0162360 2024-04-25T08:57:54.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.029+0000 7f57f4ac4640 1 -- 172.21.15.55:0/3158505999 >> v1:172.21.15.167:6789/0 conn(0x7f57f0162360 legacy=0x7f57f00cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.029+0000 7f57f4ac4640 1 -- 172.21.15.55:0/3158505999 >> v1:172.21.15.55:6789/0 conn(0x7f57f006b0e0 legacy=0x7f57f006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.029+0000 7f57f4ac4640 1 -- 172.21.15.55:0/3158505999 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f006ba60 con 0x7f57f00ce130 2024-04-25T08:57:54.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.029+0000 7f57f4ac4640 1 --2- 172.21.15.55:0/3158505999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00ce130 0x7f57f006aba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f57e00097d0 tx=0x7f57e002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1543f7afed650057 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:54.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.030+0000 7f57e7fff640 1 -- 172.21.15.55:0/3158505999 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0037070 con 0x7f57f00ce130 2024-04-25T08:57:54.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.030+0000 7f57e7fff640 1 -- 172.21.15.55:0/3158505999 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e0032440 con 0x7f57f00ce130 2024-04-25T08:57:54.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.030+0000 7f57e7fff640 1 -- 172.21.15.55:0/3158505999 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0032810 con 0x7f57f00ce130 2024-04-25T08:57:54.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.030+0000 7f57f7529640 1 -- 172.21.15.55:0/3158505999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00ce130 msgr2=0x7f57f006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.030+0000 7f57f7529640 1 --2- 172.21.15.55:0/3158505999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00ce130 0x7f57f006aba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f57e00097d0 tx=0x7f57e002a210 comp rx=0 tx=0).stop 2024-04-25T08:57:54.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.030+0000 7f57f7529640 1 -- 172.21.15.55:0/3158505999 shutdown_connections 2024-04-25T08:57:54.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.030+0000 7f57f7529640 1 --2- 172.21.15.55:0/3158505999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00ce130 0x7f57f006aba0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.030+0000 7f57f7529640 1 -- 172.21.15.55:0/3158505999 >> 172.21.15.55:0/3158505999 conn(0x7f57f00cc8d0 msgr2=0x7f57f00ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:54.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.030+0000 7f57f7529640 1 -- 172.21.15.55:0/3158505999 shutdown_connections 2024-04-25T08:57:54.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.030+0000 7f57f7529640 1 -- 172.21.15.55:0/3158505999 wait complete. 2024-04-25T08:57:54.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.031+0000 7f57f7529640 1 Processor -- start 2024-04-25T08:57:54.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.031+0000 7f57f7529640 1 -- start start 2024-04-25T08:57:54.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.032+0000 7f57f7529640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f006b0e0 0x7f57f00b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.032+0000 7f57f7529640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57f00ce130 0x7f57f0160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.032+0000 7f57f7529640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00b4220 0x7f57f014c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.032+0000 7f57f7529640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f006c300 con 0x7f57f006b0e0 2024-04-25T08:57:54.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.032+0000 7f57f7529640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f006c020 con 0x7f57f00ce130 2024-04-25T08:57:54.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.032+0000 7f57f7529640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f006e1c0 con 0x7f57f00b4220 2024-04-25T08:57:54.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.032+0000 7f57f52c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f006b0e0 0x7f57f00b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.032+0000 7f57f52c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f006b0e0 0x7f57f00b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46650/0 (socket says 172.21.15.55:46650) 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.032+0000 7f57f52c5640 1 -- 172.21.15.55:0/3736842839 learned_addr learned my addr 172.21.15.55:0/3736842839 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.032+0000 7f57f4ac4640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57f00ce130 0x7f57f0160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.032+0000 7f57f5ac6640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00b4220 0x7f57f014c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57f52c5640 1 -- 172.21.15.55:0/3736842839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00b4220 msgr2=0x7f57f014c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57f52c5640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00b4220 0x7f57f014c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57f52c5640 1 -- 172.21.15.55:0/3736842839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57f00ce130 msgr2=0x7f57f0160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57f52c5640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57f00ce130 0x7f57f0160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57f52c5640 1 -- 172.21.15.55:0/3736842839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f00b47e0 con 0x7f57f006b0e0 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57f5ac6640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00b4220 0x7f57f014c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57f52c5640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f006b0e0 0x7f57f00b34a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00c500 tx=0x7f57ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57e5ffb640 1 -- 172.21.15.55:0/3736842839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0052d0 con 0x7f57f006b0e0 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57e5ffb640 1 -- 172.21.15.55:0/3736842839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec005490 con 0x7f57f006b0e0 2024-04-25T08:57:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57f7529640 1 -- 172.21.15.55:0/3736842839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f00b4ac0 con 0x7f57f006b0e0 2024-04-25T08:57:54.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57e5ffb640 1 -- 172.21.15.55:0/3736842839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec012870 con 0x7f57f006b0e0 2024-04-25T08:57:54.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.033+0000 7f57f7529640 1 -- 172.21.15.55:0/3736842839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f00b5080 con 0x7f57f006b0e0 2024-04-25T08:57:54.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.034+0000 7f57f7529640 1 -- 172.21.15.55:0/3736842839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f00749b0 con 0x7f57f006b0e0 2024-04-25T08:57:54.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.035+0000 7f57e5ffb640 1 -- 172.21.15.55:0/3736842839 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f57ec012a10 con 0x7f57f006b0e0 2024-04-25T08:57:54.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.035+0000 7f57e5ffb640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57d406b4d0 0x7f57d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.035+0000 7f57e5ffb640 1 -- 172.21.15.55:0/3736842839 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57ec089e50 con 0x7f57f006b0e0 2024-04-25T08:57:54.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.035+0000 7f57f4ac4640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57d406b4d0 0x7f57d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.036+0000 7f57f4ac4640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57d406b4d0 0x7f57d406d990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f57e0034000 tx=0x7f57e002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:54.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.039+0000 7f57e5ffb640 1 -- 172.21.15.55:0/3736842839 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f57ec058ce0 con 0x7f57f006b0e0 2024-04-25T08:57:54.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.295+0000 7f57f7529640 1 -- 172.21.15.55:0/3736842839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f57f006f4b0 con 0x7f57f006b0e0 2024-04-25T08:57:54.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.295+0000 7f57e5ffb640 1 -- 172.21.15.55:0/3736842839 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1260 (secure 0 0 0) 0x7f57ec0585e0 con 0x7f57f006b0e0 2024-04-25T08:57:54.285 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:54.285 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":276,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":73,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035209,"num_in_osds":8,"osd_in_since":1714035200,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":59},{"state_name":"active+clean","count":38}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":592014,"bytes_used":246431744,"bytes_avail":772847681536,"bytes_total":773094113280,"inactive_pgs_ratio":0.60824739933013916,"write_bytes_sec":2309,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":36,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6609}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-04-25T08:57:14.597800+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:57:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.297+0000 7f57f7529640 1 -- 172.21.15.55:0/3736842839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57d406b4d0 msgr2=0x7f57d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.297+0000 7f57f7529640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57d406b4d0 0x7f57d406d990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f57e0034000 tx=0x7f57e002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.297+0000 7f57f7529640 1 -- 172.21.15.55:0/3736842839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f006b0e0 msgr2=0x7f57f00b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.297+0000 7f57f7529640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f006b0e0 0x7f57f00b34a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00c500 tx=0x7f57ec00c9c0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.297+0000 7f57f7529640 1 -- 172.21.15.55:0/3736842839 shutdown_connections 2024-04-25T08:57:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.297+0000 7f57f7529640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f57d406b4d0 0x7f57d406d990 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.297+0000 7f57f7529640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00b4220 0x7f57f014c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.297+0000 7f57f7529640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57f00ce130 0x7f57f0160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.297+0000 7f57f7529640 1 --2- 172.21.15.55:0/3736842839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f006b0e0 0x7f57f00b34a0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.297+0000 7f57f7529640 1 -- 172.21.15.55:0/3736842839 >> 172.21.15.55:0/3736842839 conn(0x7f57f00cc8d0 msgr2=0x7f57f00afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.297+0000 7f57f7529640 1 -- 172.21.15.55:0/3736842839 shutdown_connections 2024-04-25T08:57:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.298+0000 7f57f7529640 1 -- 172.21.15.55:0/3736842839 wait complete. 2024-04-25T08:57:54.297 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:57:54.298 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:57:54.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.409+0000 7f30e57ce640 1 Processor -- start 2024-04-25T08:57:54.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.409+0000 7f30e57ce640 1 -- start start 2024-04-25T08:57:54.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30e57ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00d35b0 0x7f30e00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30e57ce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f30e00b5990 0x7f30e00b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30e57ce640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e015e0c0 con 0x7f30e015dce0 2024-04-25T08:57:54.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30e57ce640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e00b5de0 con 0x7f30e00b5990 2024-04-25T08:57:54.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30e57ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00d2510 con 0x7f30e00d35b0 2024-04-25T08:57:54.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30deffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f30e015dce0 0x7f30e00d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50342/0 (socket says 172.21.15.55:50342) 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30deffd640 1 -- 172.21.15.55:0/2570902234 learned_addr learned my addr 172.21.15.55:0/2570902234 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30de7fc640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00d35b0 0x7f30e00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30df7fe640 1 --2- 172.21.15.55:0/2570902234 >> v2:172.21.15.167:3300/0 conn(0x7f30e00b5990 0x7f30e00b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995399493 0 0) 0x7f30e015e0c0 con 0x7f30e015dce0 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30c8003520 con 0x7f30e015dce0 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3013826478 0 0) 0x7f30c8003520 con 0x7f30e015dce0 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00d35b0 msgr2=0x7f30e00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.410+0000 7f30ddffb640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00d35b0 0x7f30e00b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 >> v2:172.21.15.167:3300/0 conn(0x7f30e00b5990 msgr2=0x7f30e00b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30ddffb640 1 --2- 172.21.15.55:0/2570902234 >> v2:172.21.15.167:3300/0 conn(0x7f30e00b5990 0x7f30e00b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e00d27f0 con 0x7f30e015dce0 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f30d8001670 con 0x7f30e015dce0 2024-04-25T08:57:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 >> v1:172.21.15.55:6789/0 conn(0x7f30e015dce0 legacy=0x7f30e00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30ddffb640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30c80039b0 0x7f30c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30ddffb640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00d35b0 0x7f30c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30ddffb640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 0x7f30c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00b5de0 con 0x7f30c8004d40 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00d2510 con 0x7f30c80039b0 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c800b9c0 con 0x7f30e00d35b0 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30df7fe640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 0x7f30c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30deffd640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30c80039b0 0x7f30c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30de7fc640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00d35b0 0x7f30c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30df7fe640 1 -- 172.21.15.55:0/2570902234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00d35b0 msgr2=0x7f30c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30df7fe640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00d35b0 0x7f30c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30df7fe640 1 -- 172.21.15.55:0/2570902234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30c80039b0 msgr2=0x7f30c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30df7fe640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30c80039b0 0x7f30c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.411+0000 7f30df7fe640 1 -- 172.21.15.55:0/2570902234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c8003520 con 0x7f30c8004d40 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.412+0000 7f30df7fe640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 0x7f30c80051c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009fc0 tx=0x7f30c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e561f0956eb5e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.412+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d0009c10 con 0x7f30c8004d40 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.412+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d0036070 con 0x7f30c8004d40 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.412+0000 7f30ddffb640 1 -- 172.21.15.55:0/2570902234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d002d070 con 0x7f30c8004d40 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.412+0000 7f30e57ce640 1 -- 172.21.15.55:0/2570902234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 msgr2=0x7f30c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.412+0000 7f30e57ce640 1 --2- 172.21.15.55:0/2570902234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 0x7f30c80051c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009fc0 tx=0x7f30c8005830 comp rx=0 tx=0).stop 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.412+0000 7f30df7fe640 1 -- 172.21.15.55:0/2570902234 reap_dead start 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.412+0000 7f30e57ce640 1 -- 172.21.15.55:0/2570902234 shutdown_connections 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.413+0000 7f30e57ce640 1 -- 172.21.15.55:0/2570902234 >> 172.21.15.55:0/2570902234 conn(0x7f30e0072900 msgr2=0x7f30e00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.413+0000 7f30e57ce640 1 -- 172.21.15.55:0/2570902234 shutdown_connections 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.413+0000 7f30e57ce640 1 -- 172.21.15.55:0/2570902234 wait complete. 2024-04-25T08:57:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.414+0000 7f30e57ce640 1 Processor -- start 2024-04-25T08:57:54.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.414+0000 7f30e57ce640 1 -- start start 2024-04-25T08:57:54.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30e57ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 0x7f30e00cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30e57ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00c7500 0x7f30e00c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30e57ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30e00c9710 0x7f30e00c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30e57ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00d3090 con 0x7f30c8004d40 2024-04-25T08:57:54.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30e57ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00d2db0 con 0x7f30e00c9710 2024-04-25T08:57:54.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30e57ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00d2160 con 0x7f30e00c7500 2024-04-25T08:57:54.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30deffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 0x7f30e00cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30deffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 0x7f30e00cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46668/0 (socket says 172.21.15.55:46668) 2024-04-25T08:57:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30deffd640 1 -- 172.21.15.55:0/2786247273 learned_addr learned my addr 172.21.15.55:0/2786247273 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30de7fc640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00c7500 0x7f30e00c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30df7fe640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30e00c9710 0x7f30e00c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30deffd640 1 -- 172.21.15.55:0/2786247273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00c7500 msgr2=0x7f30e00c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30deffd640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00c7500 0x7f30e00c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30deffd640 1 -- 172.21.15.55:0/2786247273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30e00c9710 msgr2=0x7f30e00c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30deffd640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30e00c9710 0x7f30e00c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30deffd640 1 -- 172.21.15.55:0/2786247273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e015e500 con 0x7f30c8004d40 2024-04-25T08:57:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30df7fe640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30e00c9710 0x7f30e00c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30deffd640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 0x7f30e00cc850 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f30d80072c0 tx=0x7f30d80076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:54.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30c77fe640 1 -- 172.21.15.55:0/2786247273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d801a070 con 0x7f30c8004d40 2024-04-25T08:57:54.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30c77fe640 1 -- 172.21.15.55:0/2786247273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d800f960 con 0x7f30c8004d40 2024-04-25T08:57:54.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30e57ce640 1 -- 172.21.15.55:0/2786247273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e015e7e0 con 0x7f30c8004d40 2024-04-25T08:57:54.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.415+0000 7f30c77fe640 1 -- 172.21.15.55:0/2786247273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800fd50 con 0x7f30c8004d40 2024-04-25T08:57:54.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.416+0000 7f30e57ce640 1 -- 172.21.15.55:0/2786247273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e015eda0 con 0x7f30c8004d40 2024-04-25T08:57:54.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.417+0000 7f30e57ce640 1 -- 172.21.15.55:0/2786247273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e00749b0 con 0x7f30c8004d40 2024-04-25T08:57:54.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.417+0000 7f30c77fe640 1 -- 172.21.15.55:0/2786247273 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f30d801d070 con 0x7f30c8004d40 2024-04-25T08:57:54.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.418+0000 7f30c77fe640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f30cc06b4d0 0x7f30cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:54.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.418+0000 7f30de7fc640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f30cc06b4d0 0x7f30cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:54.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.418+0000 7f30c77fe640 1 -- 172.21.15.55:0/2786247273 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30d8089bf0 con 0x7f30c8004d40 2024-04-25T08:57:54.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.418+0000 7f30de7fc640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f30cc06b4d0 0x7f30cc06d990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f30e01f6d70 tx=0x7f30d4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:54.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.422+0000 7f30c77fe640 1 -- 172.21.15.55:0/2786247273 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30d8058a70 con 0x7f30c8004d40 2024-04-25T08:57:54.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.599+0000 7f30e57ce640 1 -- 172.21.15.55:0/2786247273 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30e015e2b0 con 0x7f30cc06b4d0 2024-04-25T08:57:54.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.605+0000 7f30c77fe640 1 -- 172.21.15.55:0/2786247273 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247193 (secure 0 0 0) 0x7f30e015e2b0 con 0x7f30cc06b4d0 2024-04-25T08:57:54.597 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:54.598 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:57:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 -- 172.21.15.55:0/2786247273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f30cc06b4d0 msgr2=0x7f30cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f30cc06b4d0 0x7f30cc06d990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f30e01f6d70 tx=0x7f30d4009190 comp rx=0 tx=0).stop 2024-04-25T08:57:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 -- 172.21.15.55:0/2786247273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 msgr2=0x7f30e00cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 0x7f30e00cc850 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f30d80072c0 tx=0x7f30d80076c0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 -- 172.21.15.55:0/2786247273 shutdown_connections 2024-04-25T08:57:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f30cc06b4d0 0x7f30cc06d990 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30e00c9710 0x7f30e00c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30e00c7500 0x7f30e00c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 --2- 172.21.15.55:0/2786247273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c8004d40 0x7f30e00cc850 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 -- 172.21.15.55:0/2786247273 >> 172.21.15.55:0/2786247273 conn(0x7f30e0072900 msgr2=0x7f30e00b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 -- 172.21.15.55:0/2786247273 shutdown_connections 2024-04-25T08:57:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:54.608+0000 7f30e57ce640 1 -- 172.21.15.55:0/2786247273 wait complete. 2024-04-25T08:57:54.609 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-25T08:57:52.605884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592014,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240656,"kb_used_data":7832,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734064,"statfs":{"total":773094113280,"available":772847681536,"internally_reserved":0,"allocated":8019968,"data_stored":4014312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1646,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.434485"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189913+0000","last_change":"2024-04-25T08:57:49.189913+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189913+0000","last_undegraded":"2024-04-25T08:57:49.189913+0000","last_fullsized":"2024-04-25T08:57:49.189913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185400+0000","last_change":"2024-04-25T08:57:49.185400+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185400+0000","last_undegraded":"2024-04-25T08:57:49.185400+0000","last_fullsized":"2024-04-25T08:57:49.185400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.196576+0000","last_change":"2024-04-25T08:57:49.196576+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.196576+0000","last_undegraded":"2024-04-25T08:57:49.196576+0000","last_fullsized":"2024-04-25T08:57:49.196576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845941+0000","last_change":"2024-04-25T08:57:49.843433+0000","last_active":"2024-04-25T08:57:50.845941+0000","last_peered":"2024-04-25T08:57:50.845941+0000","last_clean":"2024-04-25T08:57:50.845941+0000","last_became_active":"2024-04-25T08:57:49.842997+0000","last_became_peered":"2024-04-25T08:57:49.842997+0000","last_unstale":"2024-04-25T08:57:50.845941+0000","last_undegraded":"2024-04-25T08:57:50.845941+0000","last_fullsized":"2024-04-25T08:57:50.845941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:00.690627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188384+0000","last_change":"2024-04-25T08:57:49.188384+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188384+0000","last_undegraded":"2024-04-25T08:57:49.188384+0000","last_fullsized":"2024-04-25T08:57:49.188384+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.186043+0000","last_change":"2024-04-25T08:57:49.186043+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.186043+0000","last_undegraded":"2024-04-25T08:57:49.186043+0000","last_fullsized":"2024-04-25T08:57:49.186043+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192147+0000","last_change":"2024-04-25T08:57:49.192147+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192147+0000","last_undegraded":"2024-04-25T08:57:49.192147+0000","last_fullsized":"2024-04-25T08:57:49.192147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185936+0000","last_change":"2024-04-25T08:57:49.185936+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185936+0000","last_undegraded":"2024-04-25T08:57:49.185936+0000","last_fullsized":"2024-04-25T08:57:49.185936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189680+0000","last_change":"2024-04-25T08:57:49.189680+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189680+0000","last_undegraded":"2024-04-25T08:57:49.189680+0000","last_fullsized":"2024-04-25T08:57:49.189680+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193533+0000","last_change":"2024-04-25T08:57:49.193533+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193533+0000","last_undegraded":"2024-04-25T08:57:49.193533+0000","last_fullsized":"2024-04-25T08:57:49.193533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189581+0000","last_change":"2024-04-25T08:57:49.189581+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189581+0000","last_undegraded":"2024-04-25T08:57:49.189581+0000","last_fullsized":"2024-04-25T08:57:49.189581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846107+0000","last_change":"2024-04-25T08:57:49.845838+0000","last_active":"2024-04-25T08:57:50.846107+0000","last_peered":"2024-04-25T08:57:50.846107+0000","last_clean":"2024-04-25T08:57:50.846107+0000","last_became_active":"2024-04-25T08:57:49.845562+0000","last_became_peered":"2024-04-25T08:57:49.845562+0000","last_unstale":"2024-04-25T08:57:50.846107+0000","last_undegraded":"2024-04-25T08:57:50.846107+0000","last_fullsized":"2024-04-25T08:57:50.846107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:23.131325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194521+0000","last_change":"2024-04-25T08:57:49.194521+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194521+0000","last_undegraded":"2024-04-25T08:57:49.194521+0000","last_fullsized":"2024-04-25T08:57:49.194521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189507+0000","last_change":"2024-04-25T08:57:49.189507+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189507+0000","last_undegraded":"2024-04-25T08:57:49.189507+0000","last_fullsized":"2024-04-25T08:57:49.189507+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.197918+0000","last_change":"2024-04-25T08:57:49.197918+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.197918+0000","last_undegraded":"2024-04-25T08:57:49.197918+0000","last_fullsized":"2024-04-25T08:57:49.197918+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.190819+0000","last_change":"2024-04-25T08:57:49.190819+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.190819+0000","last_undegraded":"2024-04-25T08:57:49.190819+0000","last_fullsized":"2024-04-25T08:57:49.190819+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189238+0000","last_change":"2024-04-25T08:57:49.189238+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189238+0000","last_undegraded":"2024-04-25T08:57:49.189238+0000","last_fullsized":"2024-04-25T08:57:49.189238+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846126+0000","last_change":"2024-04-25T08:57:49.844027+0000","last_active":"2024-04-25T08:57:50.846126+0000","last_peered":"2024-04-25T08:57:50.846126+0000","last_clean":"2024-04-25T08:57:50.846126+0000","last_became_active":"2024-04-25T08:57:49.843756+0000","last_became_peered":"2024-04-25T08:57:49.843756+0000","last_unstale":"2024-04-25T08:57:50.846126+0000","last_undegraded":"2024-04-25T08:57:50.846126+0000","last_fullsized":"2024-04-25T08:57:50.846126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:37.684246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185045+0000","last_change":"2024-04-25T08:57:49.185045+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185045+0000","last_undegraded":"2024-04-25T08:57:49.185045+0000","last_fullsized":"2024-04-25T08:57:49.185045+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195057+0000","last_change":"2024-04-25T08:57:49.195057+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195057+0000","last_undegraded":"2024-04-25T08:57:49.195057+0000","last_fullsized":"2024-04-25T08:57:49.195057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194165+0000","last_change":"2024-04-25T08:57:49.194165+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194165+0000","last_undegraded":"2024-04-25T08:57:49.194165+0000","last_fullsized":"2024-04-25T08:57:49.194165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.190485+0000","last_change":"2024-04-25T08:57:49.190485+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.190485+0000","last_undegraded":"2024-04-25T08:57:49.190485+0000","last_fullsized":"2024-04-25T08:57:49.190485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188149+0000","last_change":"2024-04-25T08:57:49.188149+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188149+0000","last_undegraded":"2024-04-25T08:57:49.188149+0000","last_fullsized":"2024-04-25T08:57:49.188149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187722+0000","last_change":"2024-04-25T08:57:49.187722+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187722+0000","last_undegraded":"2024-04-25T08:57:49.187722+0000","last_fullsized":"2024-04-25T08:57:49.187722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193974+0000","last_change":"2024-04-25T08:57:49.193974+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193974+0000","last_undegraded":"2024-04-25T08:57:49.193974+0000","last_fullsized":"2024-04-25T08:57:49.193974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.194325+0000","last_change":"2024-04-25T08:57:49.194325+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.194325+0000","last_undegraded":"2024-04-25T08:57:49.194325+0000","last_fullsized":"2024-04-25T08:57:49.194325+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.196022+0000","last_change":"2024-04-25T08:57:49.196022+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.196022+0000","last_undegraded":"2024-04-25T08:57:49.196022+0000","last_fullsized":"2024-04-25T08:57:49.196022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191584+0000","last_change":"2024-04-25T08:57:49.191584+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191584+0000","last_undegraded":"2024-04-25T08:57:49.191584+0000","last_fullsized":"2024-04-25T08:57:49.191584+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195517+0000","last_change":"2024-04-25T08:57:49.195517+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195517+0000","last_undegraded":"2024-04-25T08:57:49.195517+0000","last_fullsized":"2024-04-25T08:57:49.195517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192841+0000","last_change":"2024-04-25T08:57:49.192841+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192841+0000","last_undegraded":"2024-04-25T08:57:49.192841+0000","last_fullsized":"2024-04-25T08:57:49.192841+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191293+0000","last_change":"2024-04-25T08:57:49.191293+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191293+0000","last_undegraded":"2024-04-25T08:57:49.191293+0000","last_fullsized":"2024-04-25T08:57:49.191293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.184663+0000","last_change":"2024-04-25T08:57:49.184663+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.184663+0000","last_undegraded":"2024-04-25T08:57:49.184663+0000","last_fullsized":"2024-04-25T08:57:49.184663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187865+0000","last_change":"2024-04-25T08:57:49.187865+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187865+0000","last_undegraded":"2024-04-25T08:57:49.187865+0000","last_fullsized":"2024-04-25T08:57:49.187865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205876+0000","last_change":"2024-04-25T08:57:49.204071+0000","last_active":"2024-04-25T08:57:49.205876+0000","last_peered":"2024-04-25T08:57:49.205876+0000","last_clean":"2024-04-25T08:57:49.205876+0000","last_became_active":"2024-04-25T08:57:49.203657+0000","last_became_peered":"2024-04-25T08:57:49.203657+0000","last_unstale":"2024-04-25T08:57:49.205876+0000","last_undegraded":"2024-04-25T08:57:49.205876+0000","last_fullsized":"2024-04-25T08:57:49.205876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:08.452486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188708+0000","last_change":"2024-04-25T08:57:49.188708+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188708+0000","last_undegraded":"2024-04-25T08:57:49.188708+0000","last_fullsized":"2024-04-25T08:57:49.188708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208494+0000","last_change":"2024-04-25T08:57:49.204785+0000","last_active":"2024-04-25T08:57:49.208494+0000","last_peered":"2024-04-25T08:57:49.208494+0000","last_clean":"2024-04-25T08:57:49.208494+0000","last_became_active":"2024-04-25T08:57:49.204484+0000","last_became_peered":"2024-04-25T08:57:49.204484+0000","last_unstale":"2024-04-25T08:57:49.208494+0000","last_undegraded":"2024-04-25T08:57:49.208494+0000","last_fullsized":"2024-04-25T08:57:49.208494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:10.848641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185935+0000","last_change":"2024-04-25T08:57:49.185935+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185935+0000","last_undegraded":"2024-04-25T08:57:49.185935+0000","last_fullsized":"2024-04-25T08:57:49.185935+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.203012+0000","last_change":"2024-04-25T08:57:49.200263+0000","last_active":"2024-04-25T08:57:49.203012+0000","last_peered":"2024-04-25T08:57:49.203012+0000","last_clean":"2024-04-25T08:57:49.203012+0000","last_became_active":"2024-04-25T08:57:49.199990+0000","last_became_peered":"2024-04-25T08:57:49.199990+0000","last_unstale":"2024-04-25T08:57:49.203012+0000","last_undegraded":"2024-04-25T08:57:49.203012+0000","last_fullsized":"2024-04-25T08:57:49.203012+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:25.735805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189051+0000","last_change":"2024-04-25T08:57:49.189051+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189051+0000","last_undegraded":"2024-04-25T08:57:49.189051+0000","last_fullsized":"2024-04-25T08:57:49.189051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.197550+0000","last_change":"2024-04-25T08:57:49.193842+0000","last_active":"2024-04-25T08:57:49.197550+0000","last_peered":"2024-04-25T08:57:49.197550+0000","last_clean":"2024-04-25T08:57:49.197550+0000","last_became_active":"2024-04-25T08:57:49.193515+0000","last_became_peered":"2024-04-25T08:57:49.193515+0000","last_unstale":"2024-04-25T08:57:49.197550+0000","last_undegraded":"2024-04-25T08:57:49.197550+0000","last_fullsized":"2024-04-25T08:57:49.197550+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:34.530548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191916+0000","last_change":"2024-04-25T08:57:49.191916+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191916+0000","last_undegraded":"2024-04-25T08:57:49.191916+0000","last_fullsized":"2024-04-25T08:57:49.191916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.202646+0000","last_change":"2024-04-25T08:57:49.200083+0000","last_active":"2024-04-25T08:57:49.202646+0000","last_peered":"2024-04-25T08:57:49.202646+0000","last_clean":"2024-04-25T08:57:49.202646+0000","last_became_active":"2024-04-25T08:57:49.199768+0000","last_became_peered":"2024-04-25T08:57:49.199768+0000","last_unstale":"2024-04-25T08:57:49.202646+0000","last_undegraded":"2024-04-25T08:57:49.202646+0000","last_fullsized":"2024-04-25T08:57:49.202646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:20.826126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193688+0000","last_change":"2024-04-25T08:57:49.193688+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193688+0000","last_undegraded":"2024-04-25T08:57:49.193688+0000","last_fullsized":"2024-04-25T08:57:49.193688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205811+0000","last_change":"2024-04-25T08:57:49.204607+0000","last_active":"2024-04-25T08:57:49.205811+0000","last_peered":"2024-04-25T08:57:49.205811+0000","last_clean":"2024-04-25T08:57:49.205811+0000","last_became_active":"2024-04-25T08:57:49.204298+0000","last_became_peered":"2024-04-25T08:57:49.204298+0000","last_unstale":"2024-04-25T08:57:49.205811+0000","last_undegraded":"2024-04-25T08:57:49.205811+0000","last_fullsized":"2024-04-25T08:57:49.205811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:28.260907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187961+0000","last_change":"2024-04-25T08:57:49.187961+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187961+0000","last_undegraded":"2024-04-25T08:57:49.187961+0000","last_fullsized":"2024-04-25T08:57:49.187961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845764+0000","last_change":"2024-04-25T08:57:49.201987+0000","last_active":"2024-04-25T08:57:50.845764+0000","last_peered":"2024-04-25T08:57:50.845764+0000","last_clean":"2024-04-25T08:57:50.845764+0000","last_became_active":"2024-04-25T08:57:49.201668+0000","last_became_peered":"2024-04-25T08:57:49.201668+0000","last_unstale":"2024-04-25T08:57:50.845764+0000","last_undegraded":"2024-04-25T08:57:50.845764+0000","last_fullsized":"2024-04-25T08:57:50.845764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:02.728261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.195966+0000","last_change":"2024-04-25T08:57:49.195966+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.195966+0000","last_undegraded":"2024-04-25T08:57:49.195966+0000","last_fullsized":"2024-04-25T08:57:49.195966+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199827+0000","last_change":"2024-04-25T08:57:49.192553+0000","last_active":"2024-04-25T08:57:49.199827+0000","last_peered":"2024-04-25T08:57:49.199827+0000","last_clean":"2024-04-25T08:57:49.199827+0000","last_became_active":"2024-04-25T08:57:49.192250+0000","last_became_peered":"2024-04-25T08:57:49.192250+0000","last_unstale":"2024-04-25T08:57:49.199827+0000","last_undegraded":"2024-04-25T08:57:49.199827+0000","last_fullsized":"2024-04-25T08:57:49.199827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:22.257572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193848+0000","last_change":"2024-04-25T08:57:49.193848+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193848+0000","last_undegraded":"2024-04-25T08:57:49.193848+0000","last_fullsized":"2024-04-25T08:57:49.193848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205248+0000","last_change":"2024-04-25T08:57:49.202591+0000","last_active":"2024-04-25T08:57:49.205248+0000","last_peered":"2024-04-25T08:57:49.205248+0000","last_clean":"2024-04-25T08:57:49.205248+0000","last_became_active":"2024-04-25T08:57:49.202288+0000","last_became_peered":"2024-04-25T08:57:49.202288+0000","last_unstale":"2024-04-25T08:57:49.205248+0000","last_undegraded":"2024-04-25T08:57:49.205248+0000","last_fullsized":"2024-04-25T08:57:49.205248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:34.916404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189069+0000","last_change":"2024-04-25T08:57:49.189069+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189069+0000","last_undegraded":"2024-04-25T08:57:49.189069+0000","last_fullsized":"2024-04-25T08:57:49.189069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.200886+0000","last_change":"2024-04-25T08:57:49.199212+0000","last_active":"2024-04-25T08:57:49.200886+0000","last_peered":"2024-04-25T08:57:49.200886+0000","last_clean":"2024-04-25T08:57:49.200886+0000","last_became_active":"2024-04-25T08:57:49.198860+0000","last_became_peered":"2024-04-25T08:57:49.198860+0000","last_unstale":"2024-04-25T08:57:49.200886+0000","last_undegraded":"2024-04-25T08:57:49.200886+0000","last_fullsized":"2024-04-25T08:57:49.200886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:29.372407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185388+0000","last_change":"2024-04-25T08:57:49.185388+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185388+0000","last_undegraded":"2024-04-25T08:57:49.185388+0000","last_fullsized":"2024-04-25T08:57:49.185388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199149+0000","last_change":"2024-04-25T08:57:49.193690+0000","last_active":"2024-04-25T08:57:49.199149+0000","last_peered":"2024-04-25T08:57:49.199149+0000","last_clean":"2024-04-25T08:57:49.199149+0000","last_became_active":"2024-04-25T08:57:49.193363+0000","last_became_peered":"2024-04-25T08:57:49.193363+0000","last_unstale":"2024-04-25T08:57:49.199149+0000","last_undegraded":"2024-04-25T08:57:49.199149+0000","last_fullsized":"2024-04-25T08:57:49.199149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.044245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188883+0000","last_change":"2024-04-25T08:57:49.188883+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188883+0000","last_undegraded":"2024-04-25T08:57:49.188883+0000","last_fullsized":"2024-04-25T08:57:49.188883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846243+0000","last_change":"2024-04-25T08:57:49.198251+0000","last_active":"2024-04-25T08:57:50.846243+0000","last_peered":"2024-04-25T08:57:50.846243+0000","last_clean":"2024-04-25T08:57:50.846243+0000","last_became_active":"2024-04-25T08:57:49.197958+0000","last_became_peered":"2024-04-25T08:57:49.197958+0000","last_unstale":"2024-04-25T08:57:50.846243+0000","last_undegraded":"2024-04-25T08:57:50.846243+0000","last_fullsized":"2024-04-25T08:57:50.846243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.206185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187970+0000","last_change":"2024-04-25T08:57:49.187970+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187970+0000","last_undegraded":"2024-04-25T08:57:49.187970+0000","last_fullsized":"2024-04-25T08:57:49.187970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845968+0000","last_change":"2024-04-25T08:57:49.198379+0000","last_active":"2024-04-25T08:57:50.845968+0000","last_peered":"2024-04-25T08:57:50.845968+0000","last_clean":"2024-04-25T08:57:50.845968+0000","last_became_active":"2024-04-25T08:57:49.198053+0000","last_became_peered":"2024-04-25T08:57:49.198053+0000","last_unstale":"2024-04-25T08:57:50.845968+0000","last_undegraded":"2024-04-25T08:57:50.845968+0000","last_fullsized":"2024-04-25T08:57:50.845968+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:24.585656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192674+0000","last_change":"2024-04-25T08:57:49.192674+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192674+0000","last_undegraded":"2024-04-25T08:57:49.192674+0000","last_fullsized":"2024-04-25T08:57:49.192674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201819+0000","last_change":"2024-04-25T08:57:49.200592+0000","last_active":"2024-04-25T08:57:49.201819+0000","last_peered":"2024-04-25T08:57:49.201819+0000","last_clean":"2024-04-25T08:57:49.201819+0000","last_became_active":"2024-04-25T08:57:49.200309+0000","last_became_peered":"2024-04-25T08:57:49.200309+0000","last_unstale":"2024-04-25T08:57:49.201819+0000","last_undegraded":"2024-04-25T08:57:49.201819+0000","last_fullsized":"2024-04-25T08:57:49.201819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:00.354293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193883+0000","last_change":"2024-04-25T08:57:49.193883+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193883+0000","last_undegraded":"2024-04-25T08:57:49.193883+0000","last_fullsized":"2024-04-25T08:57:49.193883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.204416+0000","last_change":"2024-04-25T08:57:49.202467+0000","last_active":"2024-04-25T08:57:49.204416+0000","last_peered":"2024-04-25T08:57:49.204416+0000","last_clean":"2024-04-25T08:57:49.204416+0000","last_became_active":"2024-04-25T08:57:49.202182+0000","last_became_peered":"2024-04-25T08:57:49.202182+0000","last_unstale":"2024-04-25T08:57:49.204416+0000","last_undegraded":"2024-04-25T08:57:49.204416+0000","last_fullsized":"2024-04-25T08:57:49.204416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.464226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.187658+0000","last_change":"2024-04-25T08:57:49.187658+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.187658+0000","last_undegraded":"2024-04-25T08:57:49.187658+0000","last_fullsized":"2024-04-25T08:57:49.187658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201172+0000","last_change":"2024-04-25T08:57:49.199693+0000","last_active":"2024-04-25T08:57:49.201172+0000","last_peered":"2024-04-25T08:57:49.201172+0000","last_clean":"2024-04-25T08:57:49.201172+0000","last_became_active":"2024-04-25T08:57:49.199348+0000","last_became_peered":"2024-04-25T08:57:49.199348+0000","last_unstale":"2024-04-25T08:57:49.201172+0000","last_undegraded":"2024-04-25T08:57:49.201172+0000","last_fullsized":"2024-04-25T08:57:49.201172+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:11.998048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.191499+0000","last_change":"2024-04-25T08:57:49.191499+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.191499+0000","last_undegraded":"2024-04-25T08:57:49.191499+0000","last_fullsized":"2024-04-25T08:57:49.191499+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199063+0000","last_change":"2024-04-25T08:57:49.196147+0000","last_active":"2024-04-25T08:57:49.199063+0000","last_peered":"2024-04-25T08:57:49.199063+0000","last_clean":"2024-04-25T08:57:49.199063+0000","last_became_active":"2024-04-25T08:57:49.195241+0000","last_became_peered":"2024-04-25T08:57:49.195241+0000","last_unstale":"2024-04-25T08:57:49.199063+0000","last_undegraded":"2024-04-25T08:57:49.199063+0000","last_fullsized":"2024-04-25T08:57:49.199063+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:10.850720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188158+0000","last_change":"2024-04-25T08:57:49.188158+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188158+0000","last_undegraded":"2024-04-25T08:57:49.188158+0000","last_fullsized":"2024-04-25T08:57:49.188158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.203814+0000","last_change":"2024-04-25T08:57:49.201604+0000","last_active":"2024-04-25T08:57:49.203814+0000","last_peered":"2024-04-25T08:57:49.203814+0000","last_clean":"2024-04-25T08:57:49.203814+0000","last_became_active":"2024-04-25T08:57:49.201278+0000","last_became_peered":"2024-04-25T08:57:49.201278+0000","last_unstale":"2024-04-25T08:57:49.203814+0000","last_undegraded":"2024-04-25T08:57:49.203814+0000","last_fullsized":"2024-04-25T08:57:49.203814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:59.607582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846217+0000","last_change":"2024-04-25T08:57:49.846548+0000","last_active":"2024-04-25T08:57:50.846217+0000","last_peered":"2024-04-25T08:57:50.846217+0000","last_clean":"2024-04-25T08:57:50.846217+0000","last_became_active":"2024-04-25T08:57:49.846273+0000","last_became_peered":"2024-04-25T08:57:49.846273+0000","last_unstale":"2024-04-25T08:57:50.846217+0000","last_undegraded":"2024-04-25T08:57:50.846217+0000","last_fullsized":"2024-04-25T08:57:50.846217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:15.697708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.200892+0000","last_change":"2024-04-25T08:57:49.199525+0000","last_active":"2024-04-25T08:57:49.200892+0000","last_peered":"2024-04-25T08:57:49.200892+0000","last_clean":"2024-04-25T08:57:49.200892+0000","last_became_active":"2024-04-25T08:57:49.199026+0000","last_became_peered":"2024-04-25T08:57:49.199026+0000","last_unstale":"2024-04-25T08:57:49.200892+0000","last_undegraded":"2024-04-25T08:57:49.200892+0000","last_fullsized":"2024-04-25T08:57:49.200892+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:24.441411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188393+0000","last_change":"2024-04-25T08:57:49.188393+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188393+0000","last_undegraded":"2024-04-25T08:57:49.188393+0000","last_fullsized":"2024-04-25T08:57:49.188393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205118+0000","last_change":"2024-04-25T08:57:49.203809+0000","last_active":"2024-04-25T08:57:49.205118+0000","last_peered":"2024-04-25T08:57:49.205118+0000","last_clean":"2024-04-25T08:57:49.205118+0000","last_became_active":"2024-04-25T08:57:49.203459+0000","last_became_peered":"2024-04-25T08:57:49.203459+0000","last_unstale":"2024-04-25T08:57:49.205118+0000","last_undegraded":"2024-04-25T08:57:49.205118+0000","last_fullsized":"2024-04-25T08:57:49.205118+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.193606+0000","last_change":"2024-04-25T08:57:49.193606+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.193606+0000","last_undegraded":"2024-04-25T08:57:49.193606+0000","last_fullsized":"2024-04-25T08:57:49.193606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.205792+0000","last_change":"2024-04-25T08:57:49.203616+0000","last_active":"2024-04-25T08:57:49.205792+0000","last_peered":"2024-04-25T08:57:49.205792+0000","last_clean":"2024-04-25T08:57:49.205792+0000","last_became_active":"2024-04-25T08:57:49.203330+0000","last_became_peered":"2024-04-25T08:57:49.203330+0000","last_unstale":"2024-04-25T08:57:49.205792+0000","last_undegraded":"2024-04-25T08:57:49.205792+0000","last_fullsized":"2024-04-25T08:57:49.205792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:18.344931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192288+0000","last_change":"2024-04-25T08:57:49.192288+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192288+0000","last_undegraded":"2024-04-25T08:57:49.192288+0000","last_fullsized":"2024-04-25T08:57:49.192288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201520+0000","last_change":"2024-04-25T08:57:49.200461+0000","last_active":"2024-04-25T08:57:49.201520+0000","last_peered":"2024-04-25T08:57:49.201520+0000","last_clean":"2024-04-25T08:57:49.201520+0000","last_became_active":"2024-04-25T08:57:49.200166+0000","last_became_peered":"2024-04-25T08:57:49.200166+0000","last_unstale":"2024-04-25T08:57:49.201520+0000","last_undegraded":"2024-04-25T08:57:49.201520+0000","last_fullsized":"2024-04-25T08:57:49.201520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:45.768247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192305+0000","last_change":"2024-04-25T08:57:49.192305+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192305+0000","last_undegraded":"2024-04-25T08:57:49.192305+0000","last_fullsized":"2024-04-25T08:57:49.192305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208396+0000","last_change":"2024-04-25T08:57:49.204125+0000","last_active":"2024-04-25T08:57:49.208396+0000","last_peered":"2024-04-25T08:57:49.208396+0000","last_clean":"2024-04-25T08:57:49.208396+0000","last_became_active":"2024-04-25T08:57:49.203829+0000","last_became_peered":"2024-04-25T08:57:49.203829+0000","last_unstale":"2024-04-25T08:57:49.208396+0000","last_undegraded":"2024-04-25T08:57:49.208396+0000","last_fullsized":"2024-04-25T08:57:49.208396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:20.640318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.198297+0000","last_change":"2024-04-25T08:57:49.198297+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.198297+0000","last_undegraded":"2024-04-25T08:57:49.198297+0000","last_fullsized":"2024-04-25T08:57:49.198297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.199039+0000","last_change":"2024-04-25T08:57:49.195696+0000","last_active":"2024-04-25T08:57:49.199039+0000","last_peered":"2024-04-25T08:57:49.199039+0000","last_clean":"2024-04-25T08:57:49.199039+0000","last_became_active":"2024-04-25T08:57:49.195396+0000","last_became_peered":"2024-04-25T08:57:49.195396+0000","last_unstale":"2024-04-25T08:57:49.199039+0000","last_undegraded":"2024-04-25T08:57:49.199039+0000","last_fullsized":"2024-04-25T08:57:49.199039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:41.508120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192584+0000","last_change":"2024-04-25T08:57:49.192584+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192584+0000","last_undegraded":"2024-04-25T08:57:49.192584+0000","last_fullsized":"2024-04-25T08:57:49.192584+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.206257+0000","last_change":"2024-04-25T08:57:49.204999+0000","last_active":"2024-04-25T08:57:49.206257+0000","last_peered":"2024-04-25T08:57:49.206257+0000","last_clean":"2024-04-25T08:57:49.206257+0000","last_became_active":"2024-04-25T08:57:49.204637+0000","last_became_peered":"2024-04-25T08:57:49.204637+0000","last_unstale":"2024-04-25T08:57:49.206257+0000","last_undegraded":"2024-04-25T08:57:49.206257+0000","last_fullsized":"2024-04-25T08:57:49.206257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:42.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188164+0000","last_change":"2024-04-25T08:57:49.188164+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188164+0000","last_undegraded":"2024-04-25T08:57:49.188164+0000","last_fullsized":"2024-04-25T08:57:49.188164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.208398+0000","last_change":"2024-04-25T08:57:49.204319+0000","last_active":"2024-04-25T08:57:49.208398+0000","last_peered":"2024-04-25T08:57:49.208398+0000","last_clean":"2024-04-25T08:57:49.208398+0000","last_became_active":"2024-04-25T08:57:49.203999+0000","last_became_peered":"2024-04-25T08:57:49.203999+0000","last_unstale":"2024-04-25T08:57:49.208398+0000","last_undegraded":"2024-04-25T08:57:49.208398+0000","last_fullsized":"2024-04-25T08:57:49.208398+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:31.676546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.188647+0000","last_change":"2024-04-25T08:57:49.188647+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.188647+0000","last_undegraded":"2024-04-25T08:57:49.188647+0000","last_fullsized":"2024-04-25T08:57:49.188647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.206105+0000","last_change":"2024-04-25T08:57:49.201643+0000","last_active":"2024-04-25T08:57:49.206105+0000","last_peered":"2024-04-25T08:57:49.206105+0000","last_clean":"2024-04-25T08:57:49.206105+0000","last_became_active":"2024-04-25T08:57:49.201323+0000","last_became_peered":"2024-04-25T08:57:49.201323+0000","last_unstale":"2024-04-25T08:57:49.206105+0000","last_undegraded":"2024-04-25T08:57:49.206105+0000","last_fullsized":"2024-04-25T08:57:49.206105+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:18.790627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.189009+0000","last_change":"2024-04-25T08:57:49.189009+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.189009+0000","last_undegraded":"2024-04-25T08:57:49.189009+0000","last_fullsized":"2024-04-25T08:57:49.189009+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.202325+0000","last_change":"2024-04-25T08:57:49.196631+0000","last_active":"2024-04-25T08:57:49.202325+0000","last_peered":"2024-04-25T08:57:49.202325+0000","last_clean":"2024-04-25T08:57:49.202325+0000","last_became_active":"2024-04-25T08:57:49.196337+0000","last_became_peered":"2024-04-25T08:57:49.196337+0000","last_unstale":"2024-04-25T08:57:49.202325+0000","last_undegraded":"2024-04-25T08:57:49.202325+0000","last_fullsized":"2024-04-25T08:57:49.202325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:53.010186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.185324+0000","last_change":"2024-04-25T08:57:49.185324+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.185324+0000","last_undegraded":"2024-04-25T08:57:49.185324+0000","last_fullsized":"2024-04-25T08:57:49.185324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845844+0000","last_change":"2024-04-25T08:57:49.199669+0000","last_active":"2024-04-25T08:57:50.845844+0000","last_peered":"2024-04-25T08:57:50.845844+0000","last_clean":"2024-04-25T08:57:50.845844+0000","last_became_active":"2024-04-25T08:57:49.199360+0000","last_became_peered":"2024-04-25T08:57:49.199360+0000","last_unstale":"2024-04-25T08:57:50.845844+0000","last_undegraded":"2024-04-25T08:57:50.845844+0000","last_fullsized":"2024-04-25T08:57:50.845844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:29.222215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845767+0000","last_change":"2024-04-25T08:57:49.843470+0000","last_active":"2024-04-25T08:57:50.845767+0000","last_peered":"2024-04-25T08:57:50.845767+0000","last_clean":"2024-04-25T08:57:50.845767+0000","last_became_active":"2024-04-25T08:57:49.842975+0000","last_became_peered":"2024-04-25T08:57:49.842975+0000","last_unstale":"2024-04-25T08:57:50.845767+0000","last_undegraded":"2024-04-25T08:57:50.845767+0000","last_fullsized":"2024-04-25T08:57:50.845767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:39.580799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.201009+0000","last_change":"2024-04-25T08:57:49.198371+0000","last_active":"2024-04-25T08:57:49.201009+0000","last_peered":"2024-04-25T08:57:49.201009+0000","last_clean":"2024-04-25T08:57:49.201009+0000","last_became_active":"2024-04-25T08:57:49.198048+0000","last_became_peered":"2024-04-25T08:57:49.198048+0000","last_unstale":"2024-04-25T08:57:49.201009+0000","last_undegraded":"2024-04-25T08:57:49.201009+0000","last_fullsized":"2024-04-25T08:57:49.201009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:21.781630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.184515+0000","last_change":"2024-04-25T08:57:49.184515+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.184515+0000","last_undegraded":"2024-04-25T08:57:49.184515+0000","last_fullsized":"2024-04-25T08:57:49.184515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.194761+0000","last_change":"2024-04-25T08:57:49.192336+0000","last_active":"2024-04-25T08:57:49.194761+0000","last_peered":"2024-04-25T08:57:49.194761+0000","last_clean":"2024-04-25T08:57:49.194761+0000","last_became_active":"2024-04-25T08:57:49.192062+0000","last_became_peered":"2024-04-25T08:57:49.192062+0000","last_unstale":"2024-04-25T08:57:49.194761+0000","last_undegraded":"2024-04-25T08:57:49.194761+0000","last_fullsized":"2024-04-25T08:57:49.194761+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:18.849761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-04-25T08:57:49.192705+0000","last_change":"2024-04-25T08:57:49.192705+0000","last_active":"2024-04-25T08:57:49.169839+0000","last_peered":"2024-04-25T08:57:49.169839+0000","last_clean":"2024-04-25T08:57:49.169839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:57:49.192705+0000","last_undegraded":"2024-04-25T08:57:49.192705+0000","last_fullsized":"2024-04-25T08:57:49.192705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.197397+0000","last_change":"2024-04-25T08:57:49.193013+0000","last_active":"2024-04-25T08:57:49.197397+0000","last_peered":"2024-04-25T08:57:49.197397+0000","last_clean":"2024-04-25T08:57:49.197397+0000","last_became_active":"2024-04-25T08:57:49.192748+0000","last_became_peered":"2024-04-25T08:57:49.192748+0000","last_unstale":"2024-04-25T08:57:49.197397+0000","last_undegraded":"2024-04-25T08:57:49.197397+0000","last_fullsized":"2024-04-25T08:57:49.197397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:17.238736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":259,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-25T08:57:49.190730+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:57:49.190730+0000","last_peered":"2024-04-25T08:57:49.190730+0000","last_clean":"2024-04-25T08:57:49.190730+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:57:49.190730+0000","last_undegraded":"2024-04-25T08:57:49.190730+0000","last_fullsized":"2024-04-25T08:57:49.190730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1646,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28424,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343416,"statfs":{"total":96636764160,"available":96607657984,"internally_reserved":0,"allocated":1437696,"data_stored":940299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":843776,"data_stored":349931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":856064,"data_stored":356206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1449984,"data_stored":946574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":901120,"data_stored":371509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:57:55.810 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T08:57:55.821+0000 7ff3eb63b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:57:57.615 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:57:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.739+0000 7f633026b640 1 Processor -- start 2024-04-25T08:57:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.739+0000 7f633026b640 1 -- start start 2024-04-25T08:57:57.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.740+0000 7f633026b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6328160070 0x7f632806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:57.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.740+0000 7f633026b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6328160500 con 0x7f63280cc950 2024-04-25T08:57:57.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.740+0000 7f633026b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632806b310 con 0x7f632815bb90 2024-04-25T08:57:57.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.740+0000 7f633026b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632806b0e0 con 0x7f6328160070 2024-04-25T08:57:57.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.740+0000 7f632d806640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f63280cc950 0x7f63280b0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50348/0 (socket says 172.21.15.55:50348) 2024-04-25T08:57:57.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.740+0000 7f632d806640 1 -- 172.21.15.55:0/3818823610 learned_addr learned my addr 172.21.15.55:0/3818823610 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:57.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.740+0000 7f632e808640 1 --2- 172.21.15.55:0/3818823610 >> v2:172.21.15.167:3300/0 conn(0x7f6328160070 0x7f632806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.740+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679351796 0 0) 0x7f6328160500 con 0x7f63280cc950 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.740+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6314003520 con 0x7f63280cc950 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75801786 0 0) 0x7f632806b310 con 0x7f632815bb90 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6328160500 con 0x7f632815bb90 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3047985053 0 0) 0x7f6314003520 con 0x7f63280cc950 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 >> v2:172.21.15.167:3300/0 conn(0x7f6328160070 msgr2=0x7f632806aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 --2- 172.21.15.55:0/3818823610 >> v2:172.21.15.167:3300/0 conn(0x7f6328160070 0x7f632806aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 >> v1:172.21.15.167:6789/0 conn(0x7f632815bb90 legacy=0x7f63280cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632806b5f0 con 0x7f63280cc950 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f6318001670 con 0x7f63280cc950 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632e808640 1 --2- 172.21.15.55:0/3818823610 >> v2:172.21.15.167:3300/0 conn(0x7f6328160070 0x7f632806aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 >> v1:172.21.15.55:6789/0 conn(0x7f63280cc950 legacy=0x7f63280b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6314003b40 0x7f6314003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:57.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 0x7f6314004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6314005230 0x7f631400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631400c160 con 0x7f6314004800 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631400c310 con 0x7f6314003b40 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631400c510 con 0x7f6314005230 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d806640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 0x7f6314004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632e007640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6314003b40 0x7f6314003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632e808640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6314005230 0x7f631400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d806640 1 -- 172.21.15.55:0/3818823610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6314005230 msgr2=0x7f631400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d806640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6314005230 0x7f631400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d806640 1 -- 172.21.15.55:0/3818823610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6314003b40 msgr2=0x7f6314003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d806640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6314003b40 0x7f6314003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632d806640 1 -- 172.21.15.55:0/3818823610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6314003520 con 0x7f6314004800 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632e808640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6314005230 0x7f631400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.741+0000 7f632e808640 1 -- 172.21.15.55:0/3818823610 reap_dead start 2024-04-25T08:57:57.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.742+0000 7f632d806640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 0x7f6314004c80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f631800c160 tx=0x7f6314005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787ef096c9d0947e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:57.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.742+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318007ca0 con 0x7f6314004800 2024-04-25T08:57:57.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.742+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318005ad0 con 0x7f6314004800 2024-04-25T08:57:57.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.742+0000 7f632d005640 1 -- 172.21.15.55:0/3818823610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318007070 con 0x7f6314004800 2024-04-25T08:57:57.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.743+0000 7f633026b640 1 -- 172.21.15.55:0/3818823610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 msgr2=0x7f6314004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:57.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.743+0000 7f633026b640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 0x7f6314004c80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f631800c160 tx=0x7f6314005830 comp rx=0 tx=0).stop 2024-04-25T08:57:57.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.743+0000 7f633026b640 1 -- 172.21.15.55:0/3818823610 shutdown_connections 2024-04-25T08:57:57.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.743+0000 7f633026b640 1 --2- 172.21.15.55:0/3818823610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 0x7f6314004c80 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:57.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.743+0000 7f633026b640 1 -- 172.21.15.55:0/3818823610 >> 172.21.15.55:0/3818823610 conn(0x7f63280d06b0 msgr2=0x7f63280d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:57.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.743+0000 7f633026b640 1 -- 172.21.15.55:0/3818823610 shutdown_connections 2024-04-25T08:57:57.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.743+0000 7f633026b640 1 -- 172.21.15.55:0/3818823610 wait complete. 2024-04-25T08:57:57.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.744+0000 7f633026b640 1 Processor -- start 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.744+0000 7f633026b640 1 -- start start 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f633026b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 0x7f63280c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f633026b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63280c9c60 0x7f6328151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f633026b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63281519c0 0x7f63281f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f633026b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280b0540 con 0x7f6314004800 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f633026b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280b0010 con 0x7f63281519c0 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f633026b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632806aba0 con 0x7f63280c9c60 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f632e007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 0x7f63280c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f632e007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 0x7f63280c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46686/0 (socket says 172.21.15.55:46686) 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f632e007640 1 -- 172.21.15.55:0/467353913 learned_addr learned my addr 172.21.15.55:0/467353913 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f632e808640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63281519c0 0x7f63281f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f632d806640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63280c9c60 0x7f6328151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f632e007640 1 -- 172.21.15.55:0/467353913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63280c9c60 msgr2=0x7f6328151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f632e007640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63280c9c60 0x7f6328151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f632e007640 1 -- 172.21.15.55:0/467353913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63281519c0 msgr2=0x7f63281f3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f632e007640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63281519c0 0x7f63281f3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f632e007640 1 -- 172.21.15.55:0/467353913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63280c7b00 con 0x7f6314004800 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f632e007640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 0x7f63280c9720 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f632400f7a0 tx=0x7f632400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f631effd640 1 -- 172.21.15.55:0/467353913 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632401a070 con 0x7f6314004800 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.745+0000 7f631effd640 1 -- 172.21.15.55:0/467353913 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6324005110 con 0x7f6314004800 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.746+0000 7f633026b640 1 -- 172.21.15.55:0/467353913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63280c7de0 con 0x7f6314004800 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.746+0000 7f631effd640 1 -- 172.21.15.55:0/467353913 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324007050 con 0x7f6314004800 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.746+0000 7f633026b640 1 -- 172.21.15.55:0/467353913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63280c83a0 con 0x7f6314004800 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.747+0000 7f633026b640 1 -- 172.21.15.55:0/467353913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63280749b0 con 0x7f6314004800 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.747+0000 7f631effd640 1 -- 172.21.15.55:0/467353913 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f632401d070 con 0x7f6314004800 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.748+0000 7f631effd640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f630c06b500 0x7f630c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.748+0000 7f631effd640 1 -- 172.21.15.55:0/467353913 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6324089920 con 0x7f6314004800 2024-04-25T08:57:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.748+0000 7f632d806640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f630c06b500 0x7f630c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:57.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.748+0000 7f632d806640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f630c06b500 0x7f630c06d9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6318032000 tx=0x7f6318009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:57.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.752+0000 7f631effd640 1 -- 172.21.15.55:0/467353913 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6324058850 con 0x7f6314004800 2024-04-25T08:57:57.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.932+0000 7f633026b640 1 -- 172.21.15.55:0/467353913 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63280724d0 con 0x7f630c06b500 2024-04-25T08:57:57.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.938+0000 7f631effd640 1 -- 172.21.15.55:0/467353913 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252068 (secure 0 0 0) 0x7f63280724d0 con 0x7f630c06b500 2024-04-25T08:57:57.931 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:57:57.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 -- 172.21.15.55:0/467353913 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f630c06b500 msgr2=0x7f630c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:57.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f630c06b500 0x7f630c06d9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6318032000 tx=0x7f6318009030 comp rx=0 tx=0).stop 2024-04-25T08:57:57.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 -- 172.21.15.55:0/467353913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 msgr2=0x7f63280c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:57.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 0x7f63280c9720 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f632400f7a0 tx=0x7f632400fc60 comp rx=0 tx=0).stop 2024-04-25T08:57:57.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 -- 172.21.15.55:0/467353913 shutdown_connections 2024-04-25T08:57:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f630c06b500 0x7f630c06d9c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63281519c0 0x7f63281f3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63280c9c60 0x7f6328151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 --2- 172.21.15.55:0/467353913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6314004800 0x7f63280c9720 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 -- 172.21.15.55:0/467353913 >> 172.21.15.55:0/467353913 conn(0x7f63280d06b0 msgr2=0x7f63280ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 -- 172.21.15.55:0/467353913 shutdown_connections 2024-04-25T08:57:57.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:57.941+0000 7f633026b640 1 -- 172.21.15.55:0/467353913 wait complete. 2024-04-25T08:57:57.943 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-04-25T08:57:56.606629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245092,"kb_used_data":8104,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729628,"statfs":{"total":773094113280,"available":772843139072,"internally_reserved":0,"allocated":8298496,"data_stored":4139804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.420549"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373252+0000","last_change":"2024-04-25T08:57:49.853791+0000","last_active":"2024-04-25T08:57:51.373252+0000","last_peered":"2024-04-25T08:57:51.373252+0000","last_clean":"2024-04-25T08:57:51.373252+0000","last_became_active":"2024-04-25T08:57:49.853236+0000","last_became_peered":"2024-04-25T08:57:49.853236+0000","last_unstale":"2024-04-25T08:57:51.373252+0000","last_undegraded":"2024-04-25T08:57:51.373252+0000","last_fullsized":"2024-04-25T08:57:51.373252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:55.388493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846194+0000","last_change":"2024-04-25T08:57:49.846255+0000","last_active":"2024-04-25T08:57:50.846194+0000","last_peered":"2024-04-25T08:57:50.846194+0000","last_clean":"2024-04-25T08:57:50.846194+0000","last_became_active":"2024-04-25T08:57:49.845507+0000","last_became_peered":"2024-04-25T08:57:49.845507+0000","last_unstale":"2024-04-25T08:57:50.846194+0000","last_undegraded":"2024-04-25T08:57:50.846194+0000","last_fullsized":"2024-04-25T08:57:50.846194+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:19.794005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373153+0000","last_change":"2024-04-25T08:57:49.848238+0000","last_active":"2024-04-25T08:57:51.373153+0000","last_peered":"2024-04-25T08:57:51.373153+0000","last_clean":"2024-04-25T08:57:51.373153+0000","last_became_active":"2024-04-25T08:57:49.847989+0000","last_became_peered":"2024-04-25T08:57:49.847989+0000","last_unstale":"2024-04-25T08:57:51.373153+0000","last_undegraded":"2024-04-25T08:57:51.373153+0000","last_fullsized":"2024-04-25T08:57:51.373153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:41.805793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845941+0000","last_change":"2024-04-25T08:57:49.843433+0000","last_active":"2024-04-25T08:57:50.845941+0000","last_peered":"2024-04-25T08:57:50.845941+0000","last_clean":"2024-04-25T08:57:50.845941+0000","last_became_active":"2024-04-25T08:57:49.842997+0000","last_became_peered":"2024-04-25T08:57:49.842997+0000","last_unstale":"2024-04-25T08:57:50.845941+0000","last_undegraded":"2024-04-25T08:57:50.845941+0000","last_fullsized":"2024-04-25T08:57:50.845941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:00.690627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372526+0000","last_change":"2024-04-25T08:57:49.841661+0000","last_active":"2024-04-25T08:57:51.372526+0000","last_peered":"2024-04-25T08:57:51.372526+0000","last_clean":"2024-04-25T08:57:51.372526+0000","last_became_active":"2024-04-25T08:57:49.841404+0000","last_became_peered":"2024-04-25T08:57:49.841404+0000","last_unstale":"2024-04-25T08:57:51.372526+0000","last_undegraded":"2024-04-25T08:57:51.372526+0000","last_fullsized":"2024-04-25T08:57:51.372526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:18.242114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845990+0000","last_change":"2024-04-25T08:57:49.844724+0000","last_active":"2024-04-25T08:57:50.845990+0000","last_peered":"2024-04-25T08:57:50.845990+0000","last_clean":"2024-04-25T08:57:50.845990+0000","last_became_active":"2024-04-25T08:57:49.844446+0000","last_became_peered":"2024-04-25T08:57:49.844446+0000","last_unstale":"2024-04-25T08:57:50.845990+0000","last_undegraded":"2024-04-25T08:57:50.845990+0000","last_fullsized":"2024-04-25T08:57:50.845990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:41.673530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845049+0000","last_change":"2024-04-25T08:57:49.855264+0000","last_active":"2024-04-25T08:57:50.845049+0000","last_peered":"2024-04-25T08:57:50.845049+0000","last_clean":"2024-04-25T08:57:50.845049+0000","last_became_active":"2024-04-25T08:57:49.854988+0000","last_became_peered":"2024-04-25T08:57:49.854988+0000","last_unstale":"2024-04-25T08:57:50.845049+0000","last_undegraded":"2024-04-25T08:57:50.845049+0000","last_fullsized":"2024-04-25T08:57:50.845049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:10.876619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845448+0000","last_change":"2024-04-25T08:57:49.842093+0000","last_active":"2024-04-25T08:57:50.845448+0000","last_peered":"2024-04-25T08:57:50.845448+0000","last_clean":"2024-04-25T08:57:50.845448+0000","last_became_active":"2024-04-25T08:57:49.841827+0000","last_became_peered":"2024-04-25T08:57:49.841827+0000","last_unstale":"2024-04-25T08:57:50.845448+0000","last_undegraded":"2024-04-25T08:57:50.845448+0000","last_fullsized":"2024-04-25T08:57:50.845448+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:17.699350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373927+0000","last_change":"2024-04-25T08:57:49.844052+0000","last_active":"2024-04-25T08:57:51.373927+0000","last_peered":"2024-04-25T08:57:51.373927+0000","last_clean":"2024-04-25T08:57:51.373927+0000","last_became_active":"2024-04-25T08:57:49.843350+0000","last_became_peered":"2024-04-25T08:57:49.843350+0000","last_unstale":"2024-04-25T08:57:51.373927+0000","last_undegraded":"2024-04-25T08:57:51.373927+0000","last_fullsized":"2024-04-25T08:57:51.373927+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:19.348309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.868220+0000","last_change":"2024-04-25T08:57:49.854214+0000","last_active":"2024-04-25T08:57:50.868220+0000","last_peered":"2024-04-25T08:57:50.868220+0000","last_clean":"2024-04-25T08:57:50.868220+0000","last_became_active":"2024-04-25T08:57:49.853894+0000","last_became_peered":"2024-04-25T08:57:49.853894+0000","last_unstale":"2024-04-25T08:57:50.868220+0000","last_undegraded":"2024-04-25T08:57:50.868220+0000","last_fullsized":"2024-04-25T08:57:50.868220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:29.971528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373059+0000","last_change":"2024-04-25T08:57:49.842976+0000","last_active":"2024-04-25T08:57:51.373059+0000","last_peered":"2024-04-25T08:57:51.373059+0000","last_clean":"2024-04-25T08:57:51.373059+0000","last_became_active":"2024-04-25T08:57:49.842663+0000","last_became_peered":"2024-04-25T08:57:49.842663+0000","last_unstale":"2024-04-25T08:57:51.373059+0000","last_undegraded":"2024-04-25T08:57:51.373059+0000","last_fullsized":"2024-04-25T08:57:51.373059+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:21.829504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846107+0000","last_change":"2024-04-25T08:57:49.845838+0000","last_active":"2024-04-25T08:57:50.846107+0000","last_peered":"2024-04-25T08:57:50.846107+0000","last_clean":"2024-04-25T08:57:50.846107+0000","last_became_active":"2024-04-25T08:57:49.845562+0000","last_became_peered":"2024-04-25T08:57:49.845562+0000","last_unstale":"2024-04-25T08:57:50.846107+0000","last_undegraded":"2024-04-25T08:57:50.846107+0000","last_fullsized":"2024-04-25T08:57:50.846107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:23.131325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372697+0000","last_change":"2024-04-25T08:57:49.843555+0000","last_active":"2024-04-25T08:57:51.372697+0000","last_peered":"2024-04-25T08:57:51.372697+0000","last_clean":"2024-04-25T08:57:51.372697+0000","last_became_active":"2024-04-25T08:57:49.843291+0000","last_became_peered":"2024-04-25T08:57:49.843291+0000","last_unstale":"2024-04-25T08:57:51.372697+0000","last_undegraded":"2024-04-25T08:57:51.372697+0000","last_fullsized":"2024-04-25T08:57:51.372697+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:29.378106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372915+0000","last_change":"2024-04-25T08:57:49.845963+0000","last_active":"2024-04-25T08:57:51.372915+0000","last_peered":"2024-04-25T08:57:51.372915+0000","last_clean":"2024-04-25T08:57:51.372915+0000","last_became_active":"2024-04-25T08:57:49.845689+0000","last_became_peered":"2024-04-25T08:57:49.845689+0000","last_unstale":"2024-04-25T08:57:51.372915+0000","last_undegraded":"2024-04-25T08:57:51.372915+0000","last_fullsized":"2024-04-25T08:57:51.372915+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:42.511498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372982+0000","last_change":"2024-04-25T08:57:49.853192+0000","last_active":"2024-04-25T08:57:51.372982+0000","last_peered":"2024-04-25T08:57:51.372982+0000","last_clean":"2024-04-25T08:57:51.372982+0000","last_became_active":"2024-04-25T08:57:49.852880+0000","last_became_peered":"2024-04-25T08:57:49.852880+0000","last_unstale":"2024-04-25T08:57:51.372982+0000","last_undegraded":"2024-04-25T08:57:51.372982+0000","last_fullsized":"2024-04-25T08:57:51.372982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:44.806943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.867728+0000","last_change":"2024-04-25T08:57:49.851083+0000","last_active":"2024-04-25T08:57:50.867728+0000","last_peered":"2024-04-25T08:57:50.867728+0000","last_clean":"2024-04-25T08:57:50.867728+0000","last_became_active":"2024-04-25T08:57:49.850798+0000","last_became_peered":"2024-04-25T08:57:49.850798+0000","last_unstale":"2024-04-25T08:57:50.867728+0000","last_undegraded":"2024-04-25T08:57:50.867728+0000","last_fullsized":"2024-04-25T08:57:50.867728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:16.753090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373926+0000","last_change":"2024-04-25T08:57:49.843818+0000","last_active":"2024-04-25T08:57:51.373926+0000","last_peered":"2024-04-25T08:57:51.373926+0000","last_clean":"2024-04-25T08:57:51.373926+0000","last_became_active":"2024-04-25T08:57:49.843073+0000","last_became_peered":"2024-04-25T08:57:49.843073+0000","last_unstale":"2024-04-25T08:57:51.373926+0000","last_undegraded":"2024-04-25T08:57:51.373926+0000","last_fullsized":"2024-04-25T08:57:51.373926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:01.357671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846126+0000","last_change":"2024-04-25T08:57:49.844027+0000","last_active":"2024-04-25T08:57:50.846126+0000","last_peered":"2024-04-25T08:57:50.846126+0000","last_clean":"2024-04-25T08:57:50.846126+0000","last_became_active":"2024-04-25T08:57:49.843756+0000","last_became_peered":"2024-04-25T08:57:49.843756+0000","last_unstale":"2024-04-25T08:57:50.846126+0000","last_undegraded":"2024-04-25T08:57:50.846126+0000","last_fullsized":"2024-04-25T08:57:50.846126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:37.684246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845931+0000","last_change":"2024-04-25T08:57:49.848273+0000","last_active":"2024-04-25T08:57:50.845931+0000","last_peered":"2024-04-25T08:57:50.845931+0000","last_clean":"2024-04-25T08:57:50.845931+0000","last_became_active":"2024-04-25T08:57:49.847857+0000","last_became_peered":"2024-04-25T08:57:49.847857+0000","last_unstale":"2024-04-25T08:57:50.845931+0000","last_undegraded":"2024-04-25T08:57:50.845931+0000","last_fullsized":"2024-04-25T08:57:50.845931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:09.455864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372755+0000","last_change":"2024-04-25T08:57:49.849519+0000","last_active":"2024-04-25T08:57:51.372755+0000","last_peered":"2024-04-25T08:57:51.372755+0000","last_clean":"2024-04-25T08:57:51.372755+0000","last_became_active":"2024-04-25T08:57:49.849266+0000","last_became_peered":"2024-04-25T08:57:49.849266+0000","last_unstale":"2024-04-25T08:57:51.372755+0000","last_undegraded":"2024-04-25T08:57:51.372755+0000","last_fullsized":"2024-04-25T08:57:51.372755+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:48.214336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.867892+0000","last_change":"2024-04-25T08:57:49.848327+0000","last_active":"2024-04-25T08:57:50.867892+0000","last_peered":"2024-04-25T08:57:50.867892+0000","last_clean":"2024-04-25T08:57:50.867892+0000","last_became_active":"2024-04-25T08:57:49.848078+0000","last_became_peered":"2024-04-25T08:57:49.848078+0000","last_unstale":"2024-04-25T08:57:50.867892+0000","last_undegraded":"2024-04-25T08:57:50.867892+0000","last_fullsized":"2024-04-25T08:57:50.867892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:49.436169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.867867+0000","last_change":"2024-04-25T08:57:49.853244+0000","last_active":"2024-04-25T08:57:50.867867+0000","last_peered":"2024-04-25T08:57:50.867867+0000","last_clean":"2024-04-25T08:57:50.867867+0000","last_became_active":"2024-04-25T08:57:49.852956+0000","last_became_peered":"2024-04-25T08:57:49.852956+0000","last_unstale":"2024-04-25T08:57:50.867867+0000","last_undegraded":"2024-04-25T08:57:50.867867+0000","last_fullsized":"2024-04-25T08:57:50.867867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:44.885309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372902+0000","last_change":"2024-04-25T08:57:49.847760+0000","last_active":"2024-04-25T08:57:51.372902+0000","last_peered":"2024-04-25T08:57:51.372902+0000","last_clean":"2024-04-25T08:57:51.372902+0000","last_became_active":"2024-04-25T08:57:49.845973+0000","last_became_peered":"2024-04-25T08:57:49.845973+0000","last_unstale":"2024-04-25T08:57:51.372902+0000","last_undegraded":"2024-04-25T08:57:51.372902+0000","last_fullsized":"2024-04-25T08:57:51.372902+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:44.806943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372786+0000","last_change":"2024-04-25T08:57:49.855384+0000","last_active":"2024-04-25T08:57:51.372786+0000","last_peered":"2024-04-25T08:57:51.372786+0000","last_clean":"2024-04-25T08:57:51.372786+0000","last_became_active":"2024-04-25T08:57:49.855072+0000","last_became_peered":"2024-04-25T08:57:49.855072+0000","last_unstale":"2024-04-25T08:57:51.372786+0000","last_undegraded":"2024-04-25T08:57:51.372786+0000","last_fullsized":"2024-04-25T08:57:51.372786+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:48.214336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.868213+0000","last_change":"2024-04-25T08:57:49.847419+0000","last_active":"2024-04-25T08:57:50.868213+0000","last_peered":"2024-04-25T08:57:50.868213+0000","last_clean":"2024-04-25T08:57:50.868213+0000","last_became_active":"2024-04-25T08:57:49.847077+0000","last_became_peered":"2024-04-25T08:57:49.847077+0000","last_unstale":"2024-04-25T08:57:50.868213+0000","last_undegraded":"2024-04-25T08:57:50.868213+0000","last_fullsized":"2024-04-25T08:57:50.868213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:10.876619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846243+0000","last_change":"2024-04-25T08:57:49.857551+0000","last_active":"2024-04-25T08:57:50.846243+0000","last_peered":"2024-04-25T08:57:50.846243+0000","last_clean":"2024-04-25T08:57:50.846243+0000","last_became_active":"2024-04-25T08:57:49.857254+0000","last_became_peered":"2024-04-25T08:57:49.857254+0000","last_unstale":"2024-04-25T08:57:50.846243+0000","last_undegraded":"2024-04-25T08:57:50.846243+0000","last_fullsized":"2024-04-25T08:57:50.846243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:21.829504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373300+0000","last_change":"2024-04-25T08:57:49.843017+0000","last_active":"2024-04-25T08:57:51.373300+0000","last_peered":"2024-04-25T08:57:51.373300+0000","last_clean":"2024-04-25T08:57:51.373300+0000","last_became_active":"2024-04-25T08:57:49.842758+0000","last_became_peered":"2024-04-25T08:57:49.842758+0000","last_unstale":"2024-04-25T08:57:51.373300+0000","last_undegraded":"2024-04-25T08:57:51.373300+0000","last_fullsized":"2024-04-25T08:57:51.373300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:09.718796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.868125+0000","last_change":"2024-04-25T08:57:49.854489+0000","last_active":"2024-04-25T08:57:50.868125+0000","last_peered":"2024-04-25T08:57:50.868125+0000","last_clean":"2024-04-25T08:57:50.868125+0000","last_became_active":"2024-04-25T08:57:49.853741+0000","last_became_peered":"2024-04-25T08:57:49.853741+0000","last_unstale":"2024-04-25T08:57:50.868125+0000","last_undegraded":"2024-04-25T08:57:50.868125+0000","last_fullsized":"2024-04-25T08:57:50.868125+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:34.725893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373495+0000","last_change":"2024-04-25T08:57:49.849840+0000","last_active":"2024-04-25T08:57:51.373495+0000","last_peered":"2024-04-25T08:57:51.373495+0000","last_clean":"2024-04-25T08:57:51.373495+0000","last_became_active":"2024-04-25T08:57:49.849622+0000","last_became_peered":"2024-04-25T08:57:49.849622+0000","last_unstale":"2024-04-25T08:57:51.373495+0000","last_undegraded":"2024-04-25T08:57:51.373495+0000","last_fullsized":"2024-04-25T08:57:51.373495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:14.279629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845395+0000","last_change":"2024-04-25T08:57:49.857469+0000","last_active":"2024-04-25T08:57:50.845395+0000","last_peered":"2024-04-25T08:57:50.845395+0000","last_clean":"2024-04-25T08:57:50.845395+0000","last_became_active":"2024-04-25T08:57:49.857192+0000","last_became_peered":"2024-04-25T08:57:49.857192+0000","last_unstale":"2024-04-25T08:57:50.845395+0000","last_undegraded":"2024-04-25T08:57:50.845395+0000","last_fullsized":"2024-04-25T08:57:50.845395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:29.378106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845187+0000","last_change":"2024-04-25T08:57:49.855515+0000","last_active":"2024-04-25T08:57:50.845187+0000","last_peered":"2024-04-25T08:57:50.845187+0000","last_clean":"2024-04-25T08:57:50.845187+0000","last_became_active":"2024-04-25T08:57:49.855232+0000","last_became_peered":"2024-04-25T08:57:49.855232+0000","last_unstale":"2024-04-25T08:57:50.845187+0000","last_undegraded":"2024-04-25T08:57:50.845187+0000","last_fullsized":"2024-04-25T08:57:50.845187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:29.971528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845620+0000","last_change":"2024-04-25T08:57:49.843428+0000","last_active":"2024-04-25T08:57:50.845620+0000","last_peered":"2024-04-25T08:57:50.845620+0000","last_clean":"2024-04-25T08:57:50.845620+0000","last_became_active":"2024-04-25T08:57:49.843175+0000","last_became_peered":"2024-04-25T08:57:49.843175+0000","last_unstale":"2024-04-25T08:57:50.845620+0000","last_undegraded":"2024-04-25T08:57:50.845620+0000","last_fullsized":"2024-04-25T08:57:50.845620+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:50.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373223+0000","last_change":"2024-04-25T08:57:49.851010+0000","last_active":"2024-04-25T08:57:51.373223+0000","last_peered":"2024-04-25T08:57:51.373223+0000","last_clean":"2024-04-25T08:57:51.373223+0000","last_became_active":"2024-04-25T08:57:49.850739+0000","last_became_peered":"2024-04-25T08:57:49.850739+0000","last_unstale":"2024-04-25T08:57:51.373223+0000","last_undegraded":"2024-04-25T08:57:51.373223+0000","last_fullsized":"2024-04-25T08:57:51.373223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:33.270604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373433+0000","last_change":"2024-04-25T08:57:49.204071+0000","last_active":"2024-04-25T08:57:51.373433+0000","last_peered":"2024-04-25T08:57:51.373433+0000","last_clean":"2024-04-25T08:57:51.373433+0000","last_became_active":"2024-04-25T08:57:49.203657+0000","last_became_peered":"2024-04-25T08:57:49.203657+0000","last_unstale":"2024-04-25T08:57:51.373433+0000","last_undegraded":"2024-04-25T08:57:51.373433+0000","last_fullsized":"2024-04-25T08:57:51.373433+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:20.640318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.374021+0000","last_change":"2024-04-25T08:57:49.843597+0000","last_active":"2024-04-25T08:57:51.374021+0000","last_peered":"2024-04-25T08:57:51.374021+0000","last_clean":"2024-04-25T08:57:51.374021+0000","last_became_active":"2024-04-25T08:57:49.842779+0000","last_became_peered":"2024-04-25T08:57:49.842779+0000","last_unstale":"2024-04-25T08:57:51.374021+0000","last_undegraded":"2024-04-25T08:57:51.374021+0000","last_fullsized":"2024-04-25T08:57:51.374021+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:29.264285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373792+0000","last_change":"2024-04-25T08:57:49.204785+0000","last_active":"2024-04-25T08:57:51.373792+0000","last_peered":"2024-04-25T08:57:51.373792+0000","last_clean":"2024-04-25T08:57:51.373792+0000","last_became_active":"2024-04-25T08:57:49.204484+0000","last_became_peered":"2024-04-25T08:57:49.204484+0000","last_unstale":"2024-04-25T08:57:51.373792+0000","last_undegraded":"2024-04-25T08:57:51.373792+0000","last_fullsized":"2024-04-25T08:57:51.373792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:15.749712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845618+0000","last_change":"2024-04-25T08:57:49.845906+0000","last_active":"2024-04-25T08:57:50.845618+0000","last_peered":"2024-04-25T08:57:50.845618+0000","last_clean":"2024-04-25T08:57:50.845618+0000","last_became_active":"2024-04-25T08:57:49.845628+0000","last_became_peered":"2024-04-25T08:57:49.845628+0000","last_unstale":"2024-04-25T08:57:50.845618+0000","last_undegraded":"2024-04-25T08:57:50.845618+0000","last_fullsized":"2024-04-25T08:57:50.845618+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:43.519035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.868168+0000","last_change":"2024-04-25T08:57:49.200263+0000","last_active":"2024-04-25T08:57:50.868168+0000","last_peered":"2024-04-25T08:57:50.868168+0000","last_clean":"2024-04-25T08:57:50.868168+0000","last_became_active":"2024-04-25T08:57:49.199990+0000","last_became_peered":"2024-04-25T08:57:49.199990+0000","last_unstale":"2024-04-25T08:57:50.868168+0000","last_undegraded":"2024-04-25T08:57:50.868168+0000","last_fullsized":"2024-04-25T08:57:50.868168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:18.490718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373186+0000","last_change":"2024-04-25T08:57:49.848796+0000","last_active":"2024-04-25T08:57:51.373186+0000","last_peered":"2024-04-25T08:57:51.373186+0000","last_clean":"2024-04-25T08:57:51.373186+0000","last_became_active":"2024-04-25T08:57:49.848508+0000","last_became_peered":"2024-04-25T08:57:49.848508+0000","last_unstale":"2024-04-25T08:57:51.373186+0000","last_undegraded":"2024-04-25T08:57:51.373186+0000","last_fullsized":"2024-04-25T08:57:51.373186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:17.616966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845758+0000","last_change":"2024-04-25T08:57:49.193842+0000","last_active":"2024-04-25T08:57:50.845758+0000","last_peered":"2024-04-25T08:57:50.845758+0000","last_clean":"2024-04-25T08:57:50.845758+0000","last_became_active":"2024-04-25T08:57:49.193515+0000","last_became_peered":"2024-04-25T08:57:49.193515+0000","last_unstale":"2024-04-25T08:57:50.845758+0000","last_undegraded":"2024-04-25T08:57:50.845758+0000","last_fullsized":"2024-04-25T08:57:50.845758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:38.007045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845537+0000","last_change":"2024-04-25T08:57:49.846693+0000","last_active":"2024-04-25T08:57:50.845537+0000","last_peered":"2024-04-25T08:57:50.845537+0000","last_clean":"2024-04-25T08:57:50.845537+0000","last_became_active":"2024-04-25T08:57:49.846352+0000","last_became_peered":"2024-04-25T08:57:49.846352+0000","last_unstale":"2024-04-25T08:57:50.845537+0000","last_undegraded":"2024-04-25T08:57:50.845537+0000","last_fullsized":"2024-04-25T08:57:50.845537+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:48.214336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373591+0000","last_change":"2024-04-25T08:57:49.200083+0000","last_active":"2024-04-25T08:57:51.373591+0000","last_peered":"2024-04-25T08:57:51.373591+0000","last_clean":"2024-04-25T08:57:51.373591+0000","last_became_active":"2024-04-25T08:57:49.199768+0000","last_became_peered":"2024-04-25T08:57:49.199768+0000","last_unstale":"2024-04-25T08:57:51.373591+0000","last_undegraded":"2024-04-25T08:57:51.373591+0000","last_fullsized":"2024-04-25T08:57:51.373591+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:07.635152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.867975+0000","last_change":"2024-04-25T08:57:49.847664+0000","last_active":"2024-04-25T08:57:50.867975+0000","last_peered":"2024-04-25T08:57:50.867975+0000","last_clean":"2024-04-25T08:57:50.867975+0000","last_became_active":"2024-04-25T08:57:49.847095+0000","last_became_peered":"2024-04-25T08:57:49.847095+0000","last_unstale":"2024-04-25T08:57:50.867975+0000","last_undegraded":"2024-04-25T08:57:50.867975+0000","last_fullsized":"2024-04-25T08:57:50.867975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:55.745273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846000+0000","last_change":"2024-04-25T08:57:49.204607+0000","last_active":"2024-04-25T08:57:50.846000+0000","last_peered":"2024-04-25T08:57:50.846000+0000","last_clean":"2024-04-25T08:57:50.846000+0000","last_became_active":"2024-04-25T08:57:49.204298+0000","last_became_peered":"2024-04-25T08:57:49.204298+0000","last_unstale":"2024-04-25T08:57:50.846000+0000","last_undegraded":"2024-04-25T08:57:50.846000+0000","last_fullsized":"2024-04-25T08:57:50.846000+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:26.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372477+0000","last_change":"2024-04-25T08:57:49.842014+0000","last_active":"2024-04-25T08:57:51.372477+0000","last_peered":"2024-04-25T08:57:51.372477+0000","last_clean":"2024-04-25T08:57:51.372477+0000","last_became_active":"2024-04-25T08:57:49.841740+0000","last_became_peered":"2024-04-25T08:57:49.841740+0000","last_unstale":"2024-04-25T08:57:51.372477+0000","last_undegraded":"2024-04-25T08:57:51.372477+0000","last_fullsized":"2024-04-25T08:57:51.372477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:19.853139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845764+0000","last_change":"2024-04-25T08:57:49.201987+0000","last_active":"2024-04-25T08:57:50.845764+0000","last_peered":"2024-04-25T08:57:50.845764+0000","last_clean":"2024-04-25T08:57:50.845764+0000","last_became_active":"2024-04-25T08:57:49.201668+0000","last_became_peered":"2024-04-25T08:57:49.201668+0000","last_unstale":"2024-04-25T08:57:50.845764+0000","last_undegraded":"2024-04-25T08:57:50.845764+0000","last_fullsized":"2024-04-25T08:57:50.845764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:02.728261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373139+0000","last_change":"2024-04-25T08:57:49.844685+0000","last_active":"2024-04-25T08:57:51.373139+0000","last_peered":"2024-04-25T08:57:51.373139+0000","last_clean":"2024-04-25T08:57:51.373139+0000","last_became_active":"2024-04-25T08:57:49.844422+0000","last_became_peered":"2024-04-25T08:57:49.844422+0000","last_unstale":"2024-04-25T08:57:51.373139+0000","last_undegraded":"2024-04-25T08:57:51.373139+0000","last_fullsized":"2024-04-25T08:57:51.373139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:40.047623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372574+0000","last_change":"2024-04-25T08:57:49.192553+0000","last_active":"2024-04-25T08:57:51.372574+0000","last_peered":"2024-04-25T08:57:51.372574+0000","last_clean":"2024-04-25T08:57:51.372574+0000","last_became_active":"2024-04-25T08:57:49.192250+0000","last_became_peered":"2024-04-25T08:57:49.192250+0000","last_unstale":"2024-04-25T08:57:51.372574+0000","last_undegraded":"2024-04-25T08:57:51.372574+0000","last_fullsized":"2024-04-25T08:57:51.372574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:43.400534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846243+0000","last_change":"2024-04-25T08:57:49.847459+0000","last_active":"2024-04-25T08:57:50.846243+0000","last_peered":"2024-04-25T08:57:50.846243+0000","last_clean":"2024-04-25T08:57:50.846243+0000","last_became_active":"2024-04-25T08:57:49.847144+0000","last_became_peered":"2024-04-25T08:57:49.847144+0000","last_unstale":"2024-04-25T08:57:50.846243+0000","last_undegraded":"2024-04-25T08:57:50.846243+0000","last_fullsized":"2024-04-25T08:57:50.846243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:08.638530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.868200+0000","last_change":"2024-04-25T08:57:49.202591+0000","last_active":"2024-04-25T08:57:50.868200+0000","last_peered":"2024-04-25T08:57:50.868200+0000","last_clean":"2024-04-25T08:57:50.868200+0000","last_became_active":"2024-04-25T08:57:49.202288+0000","last_became_peered":"2024-04-25T08:57:49.202288+0000","last_unstale":"2024-04-25T08:57:50.868200+0000","last_undegraded":"2024-04-25T08:57:50.868200+0000","last_fullsized":"2024-04-25T08:57:50.868200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:49.173998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373310+0000","last_change":"2024-04-25T08:57:49.850826+0000","last_active":"2024-04-25T08:57:51.373310+0000","last_peered":"2024-04-25T08:57:51.373310+0000","last_clean":"2024-04-25T08:57:51.373310+0000","last_became_active":"2024-04-25T08:57:49.850546+0000","last_became_peered":"2024-04-25T08:57:49.850546+0000","last_unstale":"2024-04-25T08:57:51.373310+0000","last_undegraded":"2024-04-25T08:57:51.373310+0000","last_fullsized":"2024-04-25T08:57:51.373310+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:03.594841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846174+0000","last_change":"2024-04-25T08:57:49.199212+0000","last_active":"2024-04-25T08:57:50.846174+0000","last_peered":"2024-04-25T08:57:50.846174+0000","last_clean":"2024-04-25T08:57:50.846174+0000","last_became_active":"2024-04-25T08:57:49.198860+0000","last_became_peered":"2024-04-25T08:57:49.198860+0000","last_unstale":"2024-04-25T08:57:50.846174+0000","last_undegraded":"2024-04-25T08:57:50.846174+0000","last_fullsized":"2024-04-25T08:57:50.846174+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:22.392716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845658+0000","last_change":"2024-04-25T08:57:49.845973+0000","last_active":"2024-04-25T08:57:50.845658+0000","last_peered":"2024-04-25T08:57:50.845658+0000","last_clean":"2024-04-25T08:57:50.845658+0000","last_became_active":"2024-04-25T08:57:49.845690+0000","last_became_peered":"2024-04-25T08:57:49.845690+0000","last_unstale":"2024-04-25T08:57:50.845658+0000","last_undegraded":"2024-04-25T08:57:50.845658+0000","last_fullsized":"2024-04-25T08:57:50.845658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:46.771625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373393+0000","last_change":"2024-04-25T08:57:49.193690+0000","last_active":"2024-04-25T08:57:51.373393+0000","last_peered":"2024-04-25T08:57:51.373393+0000","last_clean":"2024-04-25T08:57:51.373393+0000","last_became_active":"2024-04-25T08:57:49.193363+0000","last_became_peered":"2024-04-25T08:57:49.193363+0000","last_unstale":"2024-04-25T08:57:51.373393+0000","last_undegraded":"2024-04-25T08:57:51.373393+0000","last_fullsized":"2024-04-25T08:57:51.373393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:16.613588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373591+0000","last_change":"2024-04-25T08:57:49.846402+0000","last_active":"2024-04-25T08:57:51.373591+0000","last_peered":"2024-04-25T08:57:51.373591+0000","last_clean":"2024-04-25T08:57:51.373591+0000","last_became_active":"2024-04-25T08:57:49.845967+0000","last_became_peered":"2024-04-25T08:57:49.845967+0000","last_unstale":"2024-04-25T08:57:51.373591+0000","last_undegraded":"2024-04-25T08:57:51.373591+0000","last_fullsized":"2024-04-25T08:57:51.373591+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:30.375785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846243+0000","last_change":"2024-04-25T08:57:49.198251+0000","last_active":"2024-04-25T08:57:50.846243+0000","last_peered":"2024-04-25T08:57:50.846243+0000","last_clean":"2024-04-25T08:57:50.846243+0000","last_became_active":"2024-04-25T08:57:49.197958+0000","last_became_peered":"2024-04-25T08:57:49.197958+0000","last_unstale":"2024-04-25T08:57:50.846243+0000","last_undegraded":"2024-04-25T08:57:50.846243+0000","last_fullsized":"2024-04-25T08:57:50.846243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.206185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372895+0000","last_change":"2024-04-25T08:57:49.853574+0000","last_active":"2024-04-25T08:57:51.372895+0000","last_peered":"2024-04-25T08:57:51.372895+0000","last_clean":"2024-04-25T08:57:51.372895+0000","last_became_active":"2024-04-25T08:57:49.853223+0000","last_became_peered":"2024-04-25T08:57:49.853223+0000","last_unstale":"2024-04-25T08:57:51.372895+0000","last_undegraded":"2024-04-25T08:57:51.372895+0000","last_fullsized":"2024-04-25T08:57:51.372895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:40.047623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845968+0000","last_change":"2024-04-25T08:57:49.198379+0000","last_active":"2024-04-25T08:57:50.845968+0000","last_peered":"2024-04-25T08:57:50.845968+0000","last_clean":"2024-04-25T08:57:50.845968+0000","last_became_active":"2024-04-25T08:57:49.198053+0000","last_became_peered":"2024-04-25T08:57:49.198053+0000","last_unstale":"2024-04-25T08:57:50.845968+0000","last_undegraded":"2024-04-25T08:57:50.845968+0000","last_fullsized":"2024-04-25T08:57:50.845968+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:24.585656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845638+0000","last_change":"2024-04-25T08:57:49.844682+0000","last_active":"2024-04-25T08:57:50.845638+0000","last_peered":"2024-04-25T08:57:50.845638+0000","last_clean":"2024-04-25T08:57:50.845638+0000","last_became_active":"2024-04-25T08:57:49.844268+0000","last_became_peered":"2024-04-25T08:57:49.844268+0000","last_unstale":"2024-04-25T08:57:50.845638+0000","last_undegraded":"2024-04-25T08:57:50.845638+0000","last_fullsized":"2024-04-25T08:57:50.845638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:44.806943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846098+0000","last_change":"2024-04-25T08:57:49.200592+0000","last_active":"2024-04-25T08:57:50.846098+0000","last_peered":"2024-04-25T08:57:50.846098+0000","last_clean":"2024-04-25T08:57:50.846098+0000","last_became_active":"2024-04-25T08:57:49.200309+0000","last_became_peered":"2024-04-25T08:57:49.200309+0000","last_unstale":"2024-04-25T08:57:50.846098+0000","last_undegraded":"2024-04-25T08:57:50.846098+0000","last_fullsized":"2024-04-25T08:57:50.846098+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:33.163340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373266+0000","last_change":"2024-04-25T08:57:49.844150+0000","last_active":"2024-04-25T08:57:51.373266+0000","last_peered":"2024-04-25T08:57:51.373266+0000","last_clean":"2024-04-25T08:57:51.373266+0000","last_became_active":"2024-04-25T08:57:49.843879+0000","last_became_peered":"2024-04-25T08:57:49.843879+0000","last_unstale":"2024-04-25T08:57:51.373266+0000","last_undegraded":"2024-04-25T08:57:51.373266+0000","last_fullsized":"2024-04-25T08:57:51.373266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:21.829504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845018+0000","last_change":"2024-04-25T08:57:49.202467+0000","last_active":"2024-04-25T08:57:50.845018+0000","last_peered":"2024-04-25T08:57:50.845018+0000","last_clean":"2024-04-25T08:57:50.845018+0000","last_became_active":"2024-04-25T08:57:49.202182+0000","last_became_peered":"2024-04-25T08:57:49.202182+0000","last_unstale":"2024-04-25T08:57:50.845018+0000","last_undegraded":"2024-04-25T08:57:50.845018+0000","last_fullsized":"2024-04-25T08:57:50.845018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:08.452486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372679+0000","last_change":"2024-04-25T08:57:49.842863+0000","last_active":"2024-04-25T08:57:51.372679+0000","last_peered":"2024-04-25T08:57:51.372679+0000","last_clean":"2024-04-25T08:57:51.372679+0000","last_became_active":"2024-04-25T08:57:49.842590+0000","last_became_peered":"2024-04-25T08:57:49.842590+0000","last_unstale":"2024-04-25T08:57:51.372679+0000","last_undegraded":"2024-04-25T08:57:51.372679+0000","last_fullsized":"2024-04-25T08:57:51.372679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:35.533926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.867787+0000","last_change":"2024-04-25T08:57:49.199693+0000","last_active":"2024-04-25T08:57:50.867787+0000","last_peered":"2024-04-25T08:57:50.867787+0000","last_clean":"2024-04-25T08:57:50.867787+0000","last_became_active":"2024-04-25T08:57:49.199348+0000","last_became_peered":"2024-04-25T08:57:49.199348+0000","last_unstale":"2024-04-25T08:57:50.867787+0000","last_undegraded":"2024-04-25T08:57:50.867787+0000","last_fullsized":"2024-04-25T08:57:50.867787+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:11.533198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.868283+0000","last_change":"2024-04-25T08:57:49.854970+0000","last_active":"2024-04-25T08:57:50.868283+0000","last_peered":"2024-04-25T08:57:50.868283+0000","last_clean":"2024-04-25T08:57:50.868283+0000","last_became_active":"2024-04-25T08:57:49.854686+0000","last_became_peered":"2024-04-25T08:57:49.854686+0000","last_unstale":"2024-04-25T08:57:50.868283+0000","last_undegraded":"2024-04-25T08:57:50.868283+0000","last_fullsized":"2024-04-25T08:57:50.868283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:29.378106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846065+0000","last_change":"2024-04-25T08:57:49.196147+0000","last_active":"2024-04-25T08:57:50.846065+0000","last_peered":"2024-04-25T08:57:50.846065+0000","last_clean":"2024-04-25T08:57:50.846065+0000","last_became_active":"2024-04-25T08:57:49.195241+0000","last_became_peered":"2024-04-25T08:57:49.195241+0000","last_unstale":"2024-04-25T08:57:50.846065+0000","last_undegraded":"2024-04-25T08:57:50.846065+0000","last_fullsized":"2024-04-25T08:57:50.846065+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:42.818695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373395+0000","last_change":"2024-04-25T08:57:49.853518+0000","last_active":"2024-04-25T08:57:51.373395+0000","last_peered":"2024-04-25T08:57:51.373395+0000","last_clean":"2024-04-25T08:57:51.373395+0000","last_became_active":"2024-04-25T08:57:49.852792+0000","last_became_peered":"2024-04-25T08:57:49.852792+0000","last_unstale":"2024-04-25T08:57:51.373395+0000","last_undegraded":"2024-04-25T08:57:51.373395+0000","last_fullsized":"2024-04-25T08:57:51.373395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:23.917983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.868322+0000","last_change":"2024-04-25T08:57:49.201604+0000","last_active":"2024-04-25T08:57:50.868322+0000","last_peered":"2024-04-25T08:57:50.868322+0000","last_clean":"2024-04-25T08:57:50.868322+0000","last_became_active":"2024-04-25T08:57:49.201278+0000","last_became_peered":"2024-04-25T08:57:49.201278+0000","last_unstale":"2024-04-25T08:57:50.868322+0000","last_undegraded":"2024-04-25T08:57:50.868322+0000","last_fullsized":"2024-04-25T08:57:50.868322+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:16.695972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846217+0000","last_change":"2024-04-25T08:57:49.846548+0000","last_active":"2024-04-25T08:57:50.846217+0000","last_peered":"2024-04-25T08:57:50.846217+0000","last_clean":"2024-04-25T08:57:50.846217+0000","last_became_active":"2024-04-25T08:57:49.846273+0000","last_became_peered":"2024-04-25T08:57:49.846273+0000","last_unstale":"2024-04-25T08:57:50.846217+0000","last_undegraded":"2024-04-25T08:57:50.846217+0000","last_fullsized":"2024-04-25T08:57:50.846217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:15.697708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845807+0000","last_change":"2024-04-25T08:57:49.199525+0000","last_active":"2024-04-25T08:57:50.845807+0000","last_peered":"2024-04-25T08:57:50.845807+0000","last_clean":"2024-04-25T08:57:50.845807+0000","last_became_active":"2024-04-25T08:57:49.199026+0000","last_became_peered":"2024-04-25T08:57:49.199026+0000","last_unstale":"2024-04-25T08:57:50.845807+0000","last_undegraded":"2024-04-25T08:57:50.845807+0000","last_fullsized":"2024-04-25T08:57:50.845807+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:09.606911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373730+0000","last_change":"2024-04-25T08:57:49.843895+0000","last_active":"2024-04-25T08:57:51.373730+0000","last_peered":"2024-04-25T08:57:51.373730+0000","last_clean":"2024-04-25T08:57:51.373730+0000","last_became_active":"2024-04-25T08:57:49.843014+0000","last_became_peered":"2024-04-25T08:57:49.843014+0000","last_unstale":"2024-04-25T08:57:51.373730+0000","last_undegraded":"2024-04-25T08:57:51.373730+0000","last_fullsized":"2024-04-25T08:57:51.373730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:25.444789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373167+0000","last_change":"2024-04-25T08:57:49.203809+0000","last_active":"2024-04-25T08:57:51.373167+0000","last_peered":"2024-04-25T08:57:51.373167+0000","last_clean":"2024-04-25T08:57:51.373167+0000","last_became_active":"2024-04-25T08:57:49.203459+0000","last_became_peered":"2024-04-25T08:57:49.203459+0000","last_unstale":"2024-04-25T08:57:51.373167+0000","last_undegraded":"2024-04-25T08:57:51.373167+0000","last_fullsized":"2024-04-25T08:57:51.373167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:18.790627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373581+0000","last_change":"2024-04-25T08:57:49.853435+0000","last_active":"2024-04-25T08:57:51.373581+0000","last_peered":"2024-04-25T08:57:51.373581+0000","last_clean":"2024-04-25T08:57:51.373581+0000","last_became_active":"2024-04-25T08:57:49.852970+0000","last_became_peered":"2024-04-25T08:57:49.852970+0000","last_unstale":"2024-04-25T08:57:51.373581+0000","last_undegraded":"2024-04-25T08:57:51.373581+0000","last_fullsized":"2024-04-25T08:57:51.373581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:32.400976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846131+0000","last_change":"2024-04-25T08:57:49.203616+0000","last_active":"2024-04-25T08:57:50.846131+0000","last_peered":"2024-04-25T08:57:50.846131+0000","last_clean":"2024-04-25T08:57:50.846131+0000","last_became_active":"2024-04-25T08:57:49.203330+0000","last_became_peered":"2024-04-25T08:57:49.203330+0000","last_unstale":"2024-04-25T08:57:50.846131+0000","last_undegraded":"2024-04-25T08:57:50.846131+0000","last_fullsized":"2024-04-25T08:57:50.846131+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:27.158643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372560+0000","last_change":"2024-04-25T08:57:49.850934+0000","last_active":"2024-04-25T08:57:51.372560+0000","last_peered":"2024-04-25T08:57:51.372560+0000","last_clean":"2024-04-25T08:57:51.372560+0000","last_became_active":"2024-04-25T08:57:49.850633+0000","last_became_peered":"2024-04-25T08:57:49.850633+0000","last_unstale":"2024-04-25T08:57:51.372560+0000","last_undegraded":"2024-04-25T08:57:51.372560+0000","last_fullsized":"2024-04-25T08:57:51.372560+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:17.215106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845170+0000","last_change":"2024-04-25T08:57:49.200461+0000","last_active":"2024-04-25T08:57:50.845170+0000","last_peered":"2024-04-25T08:57:50.845170+0000","last_clean":"2024-04-25T08:57:50.845170+0000","last_became_active":"2024-04-25T08:57:49.200166+0000","last_became_peered":"2024-04-25T08:57:49.200166+0000","last_unstale":"2024-04-25T08:57:50.845170+0000","last_undegraded":"2024-04-25T08:57:50.845170+0000","last_fullsized":"2024-04-25T08:57:50.845170+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:40.670152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372622+0000","last_change":"2024-04-25T08:57:49.850747+0000","last_active":"2024-04-25T08:57:51.372622+0000","last_peered":"2024-04-25T08:57:51.372622+0000","last_clean":"2024-04-25T08:57:51.372622+0000","last_became_active":"2024-04-25T08:57:49.850404+0000","last_became_peered":"2024-04-25T08:57:49.850404+0000","last_unstale":"2024-04-25T08:57:51.372622+0000","last_undegraded":"2024-04-25T08:57:51.372622+0000","last_fullsized":"2024-04-25T08:57:51.372622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:58.951573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373109+0000","last_change":"2024-04-25T08:57:49.204125+0000","last_active":"2024-04-25T08:57:51.373109+0000","last_peered":"2024-04-25T08:57:51.373109+0000","last_clean":"2024-04-25T08:57:51.373109+0000","last_became_active":"2024-04-25T08:57:49.203829+0000","last_became_peered":"2024-04-25T08:57:49.203829+0000","last_unstale":"2024-04-25T08:57:51.373109+0000","last_undegraded":"2024-04-25T08:57:51.373109+0000","last_fullsized":"2024-04-25T08:57:51.373109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:10.502406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373777+0000","last_change":"2024-04-25T08:57:49.854004+0000","last_active":"2024-04-25T08:57:51.373777+0000","last_peered":"2024-04-25T08:57:51.373777+0000","last_clean":"2024-04-25T08:57:51.373777+0000","last_became_active":"2024-04-25T08:57:49.853711+0000","last_became_peered":"2024-04-25T08:57:49.853711+0000","last_unstale":"2024-04-25T08:57:51.373777+0000","last_undegraded":"2024-04-25T08:57:51.373777+0000","last_fullsized":"2024-04-25T08:57:51.373777+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:08.638530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846200+0000","last_change":"2024-04-25T08:57:49.195696+0000","last_active":"2024-04-25T08:57:50.846200+0000","last_peered":"2024-04-25T08:57:50.846200+0000","last_clean":"2024-04-25T08:57:50.846200+0000","last_became_active":"2024-04-25T08:57:49.195396+0000","last_became_peered":"2024-04-25T08:57:49.195396+0000","last_unstale":"2024-04-25T08:57:50.846200+0000","last_undegraded":"2024-04-25T08:57:50.846200+0000","last_fullsized":"2024-04-25T08:57:50.846200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:25.504198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845891+0000","last_change":"2024-04-25T08:57:49.845375+0000","last_active":"2024-04-25T08:57:50.845891+0000","last_peered":"2024-04-25T08:57:50.845891+0000","last_clean":"2024-04-25T08:57:50.845891+0000","last_became_active":"2024-04-25T08:57:49.845114+0000","last_became_peered":"2024-04-25T08:57:49.845114+0000","last_unstale":"2024-04-25T08:57:50.845891+0000","last_undegraded":"2024-04-25T08:57:50.845891+0000","last_fullsized":"2024-04-25T08:57:50.845891+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:40.047623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.846450+0000","last_change":"2024-04-25T08:57:49.204999+0000","last_active":"2024-04-25T08:57:50.846450+0000","last_peered":"2024-04-25T08:57:50.846450+0000","last_clean":"2024-04-25T08:57:50.846450+0000","last_became_active":"2024-04-25T08:57:49.204637+0000","last_became_peered":"2024-04-25T08:57:49.204637+0000","last_unstale":"2024-04-25T08:57:50.846450+0000","last_undegraded":"2024-04-25T08:57:50.846450+0000","last_fullsized":"2024-04-25T08:57:50.846450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:18.790627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373121+0000","last_change":"2024-04-25T08:57:49.851604+0000","last_active":"2024-04-25T08:57:51.373121+0000","last_peered":"2024-04-25T08:57:51.373121+0000","last_clean":"2024-04-25T08:57:51.373121+0000","last_became_active":"2024-04-25T08:57:49.850637+0000","last_became_peered":"2024-04-25T08:57:49.850637+0000","last_unstale":"2024-04-25T08:57:51.373121+0000","last_undegraded":"2024-04-25T08:57:51.373121+0000","last_fullsized":"2024-04-25T08:57:51.373121+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:08.638530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373774+0000","last_change":"2024-04-25T08:57:49.204319+0000","last_active":"2024-04-25T08:57:51.373774+0000","last_peered":"2024-04-25T08:57:51.373774+0000","last_clean":"2024-04-25T08:57:51.373774+0000","last_became_active":"2024-04-25T08:57:49.203999+0000","last_became_peered":"2024-04-25T08:57:49.203999+0000","last_unstale":"2024-04-25T08:57:51.373774+0000","last_undegraded":"2024-04-25T08:57:51.373774+0000","last_fullsized":"2024-04-25T08:57:51.373774+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:04.063768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373307+0000","last_change":"2024-04-25T08:57:49.848021+0000","last_active":"2024-04-25T08:57:51.373307+0000","last_peered":"2024-04-25T08:57:51.373307+0000","last_clean":"2024-04-25T08:57:51.373307+0000","last_became_active":"2024-04-25T08:57:49.846270+0000","last_became_peered":"2024-04-25T08:57:49.846270+0000","last_unstale":"2024-04-25T08:57:51.373307+0000","last_undegraded":"2024-04-25T08:57:51.373307+0000","last_fullsized":"2024-04-25T08:57:51.373307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:40.983703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372805+0000","last_change":"2024-04-25T08:57:49.201643+0000","last_active":"2024-04-25T08:57:51.372805+0000","last_peered":"2024-04-25T08:57:51.372805+0000","last_clean":"2024-04-25T08:57:51.372805+0000","last_became_active":"2024-04-25T08:57:49.201323+0000","last_became_peered":"2024-04-25T08:57:49.201323+0000","last_unstale":"2024-04-25T08:57:51.372805+0000","last_undegraded":"2024-04-25T08:57:51.372805+0000","last_fullsized":"2024-04-25T08:57:51.372805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:58.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373068+0000","last_change":"2024-04-25T08:57:49.841293+0000","last_active":"2024-04-25T08:57:51.373068+0000","last_peered":"2024-04-25T08:57:51.373068+0000","last_clean":"2024-04-25T08:57:51.373068+0000","last_became_active":"2024-04-25T08:57:49.840966+0000","last_became_peered":"2024-04-25T08:57:49.840966+0000","last_unstale":"2024-04-25T08:57:51.373068+0000","last_undegraded":"2024-04-25T08:57:51.373068+0000","last_fullsized":"2024-04-25T08:57:51.373068+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:11.854099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372618+0000","last_change":"2024-04-25T08:57:49.196631+0000","last_active":"2024-04-25T08:57:51.372618+0000","last_peered":"2024-04-25T08:57:51.372618+0000","last_clean":"2024-04-25T08:57:51.372618+0000","last_became_active":"2024-04-25T08:57:49.196337+0000","last_became_peered":"2024-04-25T08:57:49.196337+0000","last_unstale":"2024-04-25T08:57:51.372618+0000","last_undegraded":"2024-04-25T08:57:51.372618+0000","last_fullsized":"2024-04-25T08:57:51.372618+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:52.978112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845291+0000","last_change":"2024-04-25T08:57:49.845521+0000","last_active":"2024-04-25T08:57:50.845291+0000","last_peered":"2024-04-25T08:57:50.845291+0000","last_clean":"2024-04-25T08:57:50.845291+0000","last_became_active":"2024-04-25T08:57:49.845205+0000","last_became_peered":"2024-04-25T08:57:49.845205+0000","last_unstale":"2024-04-25T08:57:50.845291+0000","last_undegraded":"2024-04-25T08:57:50.845291+0000","last_fullsized":"2024-04-25T08:57:50.845291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:00.467604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845844+0000","last_change":"2024-04-25T08:57:49.199669+0000","last_active":"2024-04-25T08:57:50.845844+0000","last_peered":"2024-04-25T08:57:50.845844+0000","last_clean":"2024-04-25T08:57:50.845844+0000","last_became_active":"2024-04-25T08:57:49.199360+0000","last_became_peered":"2024-04-25T08:57:49.199360+0000","last_unstale":"2024-04-25T08:57:50.845844+0000","last_undegraded":"2024-04-25T08:57:50.845844+0000","last_fullsized":"2024-04-25T08:57:50.845844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:29.222215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845767+0000","last_change":"2024-04-25T08:57:49.843470+0000","last_active":"2024-04-25T08:57:50.845767+0000","last_peered":"2024-04-25T08:57:50.845767+0000","last_clean":"2024-04-25T08:57:50.845767+0000","last_became_active":"2024-04-25T08:57:49.842975+0000","last_became_peered":"2024-04-25T08:57:49.842975+0000","last_unstale":"2024-04-25T08:57:50.845767+0000","last_undegraded":"2024-04-25T08:57:50.845767+0000","last_fullsized":"2024-04-25T08:57:50.845767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:39.580799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.867715+0000","last_change":"2024-04-25T08:57:49.198371+0000","last_active":"2024-04-25T08:57:50.867715+0000","last_peered":"2024-04-25T08:57:50.867715+0000","last_clean":"2024-04-25T08:57:50.867715+0000","last_became_active":"2024-04-25T08:57:49.198048+0000","last_became_peered":"2024-04-25T08:57:49.198048+0000","last_unstale":"2024-04-25T08:57:50.867715+0000","last_undegraded":"2024-04-25T08:57:50.867715+0000","last_fullsized":"2024-04-25T08:57:50.867715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:13.100120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845469+0000","last_change":"2024-04-25T08:57:49.848443+0000","last_active":"2024-04-25T08:57:50.845469+0000","last_peered":"2024-04-25T08:57:50.845469+0000","last_clean":"2024-04-25T08:57:50.845469+0000","last_became_active":"2024-04-25T08:57:49.847960+0000","last_became_peered":"2024-04-25T08:57:49.847960+0000","last_unstale":"2024-04-25T08:57:50.845469+0000","last_undegraded":"2024-04-25T08:57:50.845469+0000","last_fullsized":"2024-04-25T08:57:50.845469+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:14.103498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845733+0000","last_change":"2024-04-25T08:57:49.192336+0000","last_active":"2024-04-25T08:57:50.845733+0000","last_peered":"2024-04-25T08:57:50.845733+0000","last_clean":"2024-04-25T08:57:50.845733+0000","last_became_active":"2024-04-25T08:57:49.192062+0000","last_became_peered":"2024-04-25T08:57:49.192062+0000","last_unstale":"2024-04-25T08:57:50.845733+0000","last_undegraded":"2024-04-25T08:57:50.845733+0000","last_fullsized":"2024-04-25T08:57:50.845733+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:38.028550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.373364+0000","last_change":"2024-04-25T08:57:49.850866+0000","last_active":"2024-04-25T08:57:51.373364+0000","last_peered":"2024-04-25T08:57:51.373364+0000","last_clean":"2024-04-25T08:57:51.373364+0000","last_became_active":"2024-04-25T08:57:49.850581+0000","last_became_peered":"2024-04-25T08:57:49.850581+0000","last_unstale":"2024-04-25T08:57:51.373364+0000","last_undegraded":"2024-04-25T08:57:51.373364+0000","last_fullsized":"2024-04-25T08:57:51.373364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:49.169839+0000","last_clean_scrub_stamp":"2024-04-25T08:57:49.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:29.575738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:50.845347+0000","last_change":"2024-04-25T08:57:49.193013+0000","last_active":"2024-04-25T08:57:50.845347+0000","last_peered":"2024-04-25T08:57:50.845347+0000","last_clean":"2024-04-25T08:57:50.845347+0000","last_became_active":"2024-04-25T08:57:49.192748+0000","last_became_peered":"2024-04-25T08:57:49.192748+0000","last_unstale":"2024-04-25T08:57:50.845347+0000","last_undegraded":"2024-04-25T08:57:50.845347+0000","last_fullsized":"2024-04-25T08:57:50.845347+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:57:48.166461+0000","last_clean_scrub_stamp":"2024-04-25T08:57:48.166461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:53.067553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":263,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T08:57:51.372790+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:57:51.372790+0000","last_peered":"2024-04-25T08:57:51.372790+0000","last_clean":"2024-04-25T08:57:51.372790+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:57:51.372790+0000","last_undegraded":"2024-04-25T08:57:51.372790+0000","last_fullsized":"2024-04-25T08:57:51.372790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1482752,"data_stored":960265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":369373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":369371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":369351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":888832,"data_stored":369393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509498,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":892928,"data_stored":370893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":959649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":901120,"data_stored":371509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:57:57.947 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:57:57.948 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:57:58.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.102+0000 7f59363f9640 1 Processor -- start 2024-04-25T08:57:58.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.102+0000 7f59363f9640 1 -- start start 2024-04-25T08:57:58.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f59363f9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f59300d03e0 0x7f59300d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f59363f9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300d1a30 0x7f59300b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f59363f9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300d2410 con 0x7f593015dd90 2024-04-25T08:57:58.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f59363f9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300d26f0 con 0x7f59300d03e0 2024-04-25T08:57:58.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f59363f9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59300d29d0 con 0x7f59300d1a30 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f592f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f593015dd90 0x7f59300d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50362/0 (socket says 172.21.15.55:50362) 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f592f7fe640 1 -- 172.21.15.55:0/243228115 learned_addr learned my addr 172.21.15.55:0/243228115 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f592ffff640 1 --2- 172.21.15.55:0/243228115 >> v2:172.21.15.167:3300/0 conn(0x7f59300d03e0 0x7f59300d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f5934996640 1 --2- 172.21.15.55:0/243228115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300d1a30 0x7f59300b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f592effd640 1 -- 172.21.15.55:0/243228115 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827738355 0 0) 0x7f59300d2410 con 0x7f593015dd90 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f592effd640 1 -- 172.21.15.55:0/243228115 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5918003520 con 0x7f593015dd90 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f592ffff640 1 -- 172.21.15.55:0/243228115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300d1a30 msgr2=0x7f59300b69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.103+0000 7f592ffff640 1 --2- 172.21.15.55:0/243228115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300d1a30 0x7f59300b69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.104+0000 7f592ffff640 1 -- 172.21.15.55:0/243228115 >> v1:172.21.15.55:6789/0 conn(0x7f593015dd90 legacy=0x7f59300d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.104+0000 7f592ffff640 1 -- 172.21.15.55:0/243228115 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300d2cb0 con 0x7f59300d03e0 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.104+0000 7f5934996640 1 --2- 172.21.15.55:0/243228115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300d1a30 0x7f59300b69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:57:58.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.104+0000 7f592ffff640 1 --2- 172.21.15.55:0/243228115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59300d03e0 0x7f59300d34b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f59200097a0 tx=0x7f592002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5549ef797d150d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:58.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.104+0000 7f592effd640 1 -- 172.21.15.55:0/243228115 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920037070 con 0x7f59300d03e0 2024-04-25T08:57:58.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.105+0000 7f592effd640 1 -- 172.21.15.55:0/243228115 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920032440 con 0x7f59300d03e0 2024-04-25T08:57:58.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.105+0000 7f592effd640 1 -- 172.21.15.55:0/243228115 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920032810 con 0x7f59300d03e0 2024-04-25T08:57:58.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.105+0000 7f59363f9640 1 -- 172.21.15.55:0/243228115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59300d03e0 msgr2=0x7f59300d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.105+0000 7f59363f9640 1 --2- 172.21.15.55:0/243228115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59300d03e0 0x7f59300d34b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f59200097a0 tx=0x7f592002a210 comp rx=0 tx=0).stop 2024-04-25T08:57:58.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.105+0000 7f59363f9640 1 -- 172.21.15.55:0/243228115 shutdown_connections 2024-04-25T08:57:58.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.105+0000 7f59363f9640 1 --2- 172.21.15.55:0/243228115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300d1a30 0x7f59300b69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.105+0000 7f59363f9640 1 --2- 172.21.15.55:0/243228115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59300d03e0 0x7f59300d34b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.105+0000 7f59363f9640 1 -- 172.21.15.55:0/243228115 >> 172.21.15.55:0/243228115 conn(0x7f5930072900 msgr2=0x7f593006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:58.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.105+0000 7f59363f9640 1 -- 172.21.15.55:0/243228115 shutdown_connections 2024-04-25T08:57:58.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.105+0000 7f59363f9640 1 -- 172.21.15.55:0/243228115 wait complete. 2024-04-25T08:57:58.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.106+0000 7f59363f9640 1 Processor -- start 2024-04-25T08:57:58.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.106+0000 7f59363f9640 1 -- start start 2024-04-25T08:57:58.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.107+0000 7f59363f9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300d03e0 0x7f59300b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.107+0000 7f59363f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59300d1a30 0x7f59300b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.107+0000 7f59363f9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f593015dd90 0x7f59300b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.107+0000 7f59363f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59300b99a0 con 0x7f59300d1a30 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.107+0000 7f59363f9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59300b9820 con 0x7f593015dd90 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.107+0000 7f59363f9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59300d1ee0 con 0x7f59300d03e0 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.107+0000 7f592f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59300d1a30 0x7f59300b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.107+0000 7f592f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59300d1a30 0x7f59300b2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46692/0 (socket says 172.21.15.55:46692) 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.107+0000 7f592f7fe640 1 -- 172.21.15.55:0/3056811955 learned_addr learned my addr 172.21.15.55:0/3056811955 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.107+0000 7f5934996640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f593015dd90 0x7f59300b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.107+0000 7f592ffff640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300d03e0 0x7f59300b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.108+0000 7f592f7fe640 1 -- 172.21.15.55:0/3056811955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300d03e0 msgr2=0x7f59300b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.108+0000 7f592f7fe640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300d03e0 0x7f59300b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.108+0000 7f592f7fe640 1 -- 172.21.15.55:0/3056811955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f593015dd90 msgr2=0x7f59300b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.108+0000 7f592f7fe640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f593015dd90 0x7f59300b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.108+0000 7f592f7fe640 1 -- 172.21.15.55:0/3056811955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300b31d0 con 0x7f59300d1a30 2024-04-25T08:57:58.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.108+0000 7f592f7fe640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59300d1a30 0x7f59300b2c90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f592400c400 tx=0x7f592400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:58.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.108+0000 7f592cff9640 1 -- 172.21.15.55:0/3056811955 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924017070 con 0x7f59300d1a30 2024-04-25T08:57:58.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.108+0000 7f592cff9640 1 -- 172.21.15.55:0/3056811955 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924005ce0 con 0x7f59300d1a30 2024-04-25T08:57:58.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.108+0000 7f59363f9640 1 -- 172.21.15.55:0/3056811955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59300b3470 con 0x7f59300d1a30 2024-04-25T08:57:58.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.108+0000 7f592cff9640 1 -- 172.21.15.55:0/3056811955 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240072d0 con 0x7f59300d1a30 2024-04-25T08:57:58.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.108+0000 7f59363f9640 1 -- 172.21.15.55:0/3056811955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59300b3a30 con 0x7f59300d1a30 2024-04-25T08:57:58.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.109+0000 7f59363f9640 1 -- 172.21.15.55:0/3056811955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59300749b0 con 0x7f59300d1a30 2024-04-25T08:57:58.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.109+0000 7f592cff9640 1 -- 172.21.15.55:0/3056811955 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f592401a070 con 0x7f59300d1a30 2024-04-25T08:57:58.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.110+0000 7f592cff9640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f591c06b4d0 0x7f591c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.110+0000 7f592cff9640 1 -- 172.21.15.55:0/3056811955 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5924089360 con 0x7f59300d1a30 2024-04-25T08:57:58.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.110+0000 7f592ffff640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f591c06b4d0 0x7f591c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:58.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.110+0000 7f592ffff640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f591c06b4d0 0x7f591c06d990 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5920034000 tx=0x7f592002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:58.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.114+0000 7f592cff9640 1 -- 172.21.15.55:0/3056811955 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5924057c20 con 0x7f59300d1a30 2024-04-25T08:57:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.363+0000 7f59363f9640 1 -- 172.21.15.55:0/3056811955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f593006b1d0 con 0x7f59300d1a30 2024-04-25T08:57:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.366+0000 7f592cff9640 1 -- 172.21.15.55:0/3056811955 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f592405bcc0 con 0x7f59300d1a30 2024-04-25T08:57:58.355 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-04-25T08:57:58.355 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw== 2024-04-25T08:57:58.355 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2024-04-25T08:57:58.355 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2024-04-25T08:57:58.355 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:57:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-25T08:57:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.367+0000 7f59363f9640 1 -- 172.21.15.55:0/3056811955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f591c06b4d0 msgr2=0x7f591c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.367+0000 7f59363f9640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f591c06b4d0 0x7f591c06d990 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5920034000 tx=0x7f592002e000 comp rx=0 tx=0).stop 2024-04-25T08:57:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.367+0000 7f59363f9640 1 -- 172.21.15.55:0/3056811955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59300d1a30 msgr2=0x7f59300b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.367+0000 7f59363f9640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59300d1a30 0x7f59300b2c90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f592400c400 tx=0x7f592400c800 comp rx=0 tx=0).stop 2024-04-25T08:57:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.368+0000 7f59363f9640 1 -- 172.21.15.55:0/3056811955 shutdown_connections 2024-04-25T08:57:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.368+0000 7f59363f9640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f591c06b4d0 0x7f591c06d990 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.368+0000 7f59363f9640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f593015dd90 0x7f59300b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.368+0000 7f59363f9640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59300d1a30 0x7f59300b2c90 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.368+0000 7f59363f9640 1 --2- 172.21.15.55:0/3056811955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59300d03e0 0x7f59300b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.368+0000 7f59363f9640 1 -- 172.21.15.55:0/3056811955 >> 172.21.15.55:0/3056811955 conn(0x7f5930072900 msgr2=0x7f59300cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.368+0000 7f59363f9640 1 -- 172.21.15.55:0/3056811955 shutdown_connections 2024-04-25T08:57:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.368+0000 7f59363f9640 1 -- 172.21.15.55:0/3056811955 wait complete. 2024-04-25T08:57:58.368 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:57:58.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.480+0000 7f803db89640 1 Processor -- start 2024-04-25T08:57:58.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.480+0000 7f803db89640 1 -- start start 2024-04-25T08:57:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f803db89640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f803815dce0 0x7f80380d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f803db89640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80380d35b0 0x7f80380b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f803db89640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803815e0c0 con 0x7f80380d1f90 2024-04-25T08:57:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f803db89640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80380b7b10 con 0x7f803815dce0 2024-04-25T08:57:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f803db89640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80380d2510 con 0x7f80380d35b0 2024-04-25T08:57:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f80377fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f803815dce0 0x7f80380d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f8037fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f80380d1f90 0x7f803806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50366/0 (socket says 172.21.15.55:50366) 2024-04-25T08:57:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f8037fff640 1 -- 172.21.15.55:0/4122839723 learned_addr learned my addr 172.21.15.55:0/4122839723 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f80377fe640 1 -- 172.21.15.55:0/4122839723 >> v2:172.21.15.167:3300/0 conn(0x7f80380d35b0 msgr2=0x7f80380b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f80377fe640 1 --2- 172.21.15.55:0/4122839723 >> v2:172.21.15.167:3300/0 conn(0x7f80380d35b0 0x7f80380b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f80377fe640 1 -- 172.21.15.55:0/4122839723 >> v1:172.21.15.55:6789/0 conn(0x7f80380d1f90 legacy=0x7f803806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f80377fe640 1 -- 172.21.15.55:0/4122839723 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80380d27f0 con 0x7f803815dce0 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.481+0000 7f80367fc640 1 -- 172.21.15.55:0/4122839723 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994290789 0 0) 0x7f803815e0c0 con 0x7f80380d1f90 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.482+0000 7f80377fe640 1 --2- 172.21.15.55:0/4122839723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f803815dce0 0x7f80380d1a50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f80380cdfa0 tx=0x7f802802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0c1dde22cb475b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.482+0000 7f80367fc640 1 -- 172.21.15.55:0/4122839723 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028037070 con 0x7f803815dce0 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.482+0000 7f80367fc640 1 -- 172.21.15.55:0/4122839723 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8028032440 con 0x7f803815dce0 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.482+0000 7f80367fc640 1 -- 172.21.15.55:0/4122839723 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028032810 con 0x7f803815dce0 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.483+0000 7f803db89640 1 -- 172.21.15.55:0/4122839723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f803815dce0 msgr2=0x7f80380d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.483+0000 7f803db89640 1 --2- 172.21.15.55:0/4122839723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f803815dce0 0x7f80380d1a50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f80380cdfa0 tx=0x7f802802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.483+0000 7f803db89640 1 -- 172.21.15.55:0/4122839723 shutdown_connections 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.483+0000 7f803db89640 1 --2- 172.21.15.55:0/4122839723 >> v2:172.21.15.167:3300/0 conn(0x7f80380d35b0 0x7f80380b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.483+0000 7f803db89640 1 --2- 172.21.15.55:0/4122839723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f803815dce0 0x7f80380d1a50 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.483+0000 7f803db89640 1 -- 172.21.15.55:0/4122839723 >> 172.21.15.55:0/4122839723 conn(0x7f8038072900 msgr2=0x7f80380d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.483+0000 7f803db89640 1 -- 172.21.15.55:0/4122839723 shutdown_connections 2024-04-25T08:57:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.483+0000 7f803db89640 1 -- 172.21.15.55:0/4122839723 wait complete. 2024-04-25T08:57:58.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.484+0000 7f803db89640 1 Processor -- start 2024-04-25T08:57:58.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.484+0000 7f803db89640 1 -- start start 2024-04-25T08:57:58.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f803db89640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80380d1f90 0x7f803815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f803db89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80380d35b0 0x7f803815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f803db89640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803815dce0 0x7f803814dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f803db89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380d3090 con 0x7f80380d35b0 2024-04-25T08:57:58.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f803db89640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380d2db0 con 0x7f803815dce0 2024-04-25T08:57:58.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f803db89640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80380b9820 con 0x7f80380d1f90 2024-04-25T08:57:58.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f8036ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80380d35b0 0x7f803815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:58.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f8036ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80380d35b0 0x7f803815a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46706/0 (socket says 172.21.15.55:46706) 2024-04-25T08:57:58.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f8036ffd640 1 -- 172.21.15.55:0/405085601 learned_addr learned my addr 172.21.15.55:0/405085601 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:58.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f8037fff640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803815dce0 0x7f803814dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:58.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f80377fe640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80380d1f90 0x7f803815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:58.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f8036ffd640 1 -- 172.21.15.55:0/405085601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80380d1f90 msgr2=0x7f803815e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f8036ffd640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80380d1f90 0x7f803815e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f8036ffd640 1 -- 172.21.15.55:0/405085601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803815dce0 msgr2=0x7f803814dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f8036ffd640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803815dce0 0x7f803814dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f8036ffd640 1 -- 172.21.15.55:0/405085601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80381557b0 con 0x7f80380d35b0 2024-04-25T08:57:58.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f80377fe640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80380d1f90 0x7f803815e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:58.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f8036ffd640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80380d35b0 0x7f803815a420 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f802c00b450 tx=0x7f802c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:58.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f801ffff640 1 -- 172.21.15.55:0/405085601 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c015020 con 0x7f80380d35b0 2024-04-25T08:57:58.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f801ffff640 1 -- 172.21.15.55:0/405085601 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c011890 con 0x7f80380d35b0 2024-04-25T08:57:58.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f803db89640 1 -- 172.21.15.55:0/405085601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8038155a90 con 0x7f80380d35b0 2024-04-25T08:57:58.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.485+0000 7f801ffff640 1 -- 172.21.15.55:0/405085601 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c011c80 con 0x7f80380d35b0 2024-04-25T08:57:58.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.486+0000 7f803db89640 1 -- 172.21.15.55:0/405085601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8038156050 con 0x7f80380d35b0 2024-04-25T08:57:58.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.487+0000 7f803db89640 1 -- 172.21.15.55:0/405085601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80380749b0 con 0x7f80380d35b0 2024-04-25T08:57:58.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.487+0000 7f801ffff640 1 -- 172.21.15.55:0/405085601 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f802c018020 con 0x7f80380d35b0 2024-04-25T08:57:58.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.487+0000 7f801ffff640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f802406b500 0x7f802406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:58.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.487+0000 7f801ffff640 1 -- 172.21.15.55:0/405085601 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f802c08a340 con 0x7f80380d35b0 2024-04-25T08:57:58.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.487+0000 7f80377fe640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f802406b500 0x7f802406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:58.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.488+0000 7f80377fe640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f802406b500 0x7f802406d9c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8028034000 tx=0x7f802802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:58.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.491+0000 7f801ffff640 1 -- 172.21.15.55:0/405085601 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f802c01f020 con 0x7f80380d35b0 2024-04-25T08:57:58.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.709+0000 7f803db89640 1 -- 172.21.15.55:0/405085601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80380b9330 con 0x7f80380d35b0 2024-04-25T08:57:58.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.709+0000 7f801ffff640 1 -- 172.21.15.55:0/405085601 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4937 (secure 0 0 0) 0x7f802c00d040 con 0x7f80380d35b0 2024-04-25T08:57:58.699 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:57:58.699 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:57:51.543169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6609":{"gid":6609,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/173615501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":173615501},{"type":"v1","addr":"172.21.15.55:6837","nonce":173615501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:57:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 36 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 -- 172.21.15.55:0/405085601 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f802406b500 msgr2=0x7f802406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f802406b500 0x7f802406d9c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8028034000 tx=0x7f802802e000 comp rx=0 tx=0).stop 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 -- 172.21.15.55:0/405085601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80380d35b0 msgr2=0x7f803815a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80380d35b0 0x7f803815a420 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f802c00b450 tx=0x7f802c00b910 comp rx=0 tx=0).stop 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 -- 172.21.15.55:0/405085601 shutdown_connections 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f802406b500 0x7f802406d9c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803815dce0 0x7f803814dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80380d35b0 0x7f803815a420 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 --2- 172.21.15.55:0/405085601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80380d1f90 0x7f803815e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 -- 172.21.15.55:0/405085601 >> 172.21.15.55:0/405085601 conn(0x7f8038072900 msgr2=0x7f80380ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 -- 172.21.15.55:0/405085601 shutdown_connections 2024-04-25T08:57:58.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:58.711+0000 7f803db89640 1 -- 172.21.15.55:0/405085601 wait complete. 2024-04-25T08:57:59.114 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:57:49.554460+0000', 'modified': '2024-04-25T08:57:51.543169+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6609}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6609': {'gid': 6609, 'name': 'c', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/173615501', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 173615501}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 173615501}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:57:59.114 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:57:59.114 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T08:57:59.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.230+0000 7f5ec3a83640 1 Processor -- start 2024-04-25T08:57:59.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.230+0000 7f5ec3a83640 1 -- start start 2024-04-25T08:57:59.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.231+0000 7f5ec3a83640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5ebc0b0740 0x7f5ebc0b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.231+0000 7f5ec3a83640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc15f660 con 0x7f5ebc15ef60 2024-04-25T08:57:59.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.231+0000 7f5ec3a83640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc15f940 con 0x7f5ebc0cfd60 2024-04-25T08:57:59.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.231+0000 7f5ec3a83640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ebc15fc20 con 0x7f5ebc0b0740 2024-04-25T08:57:59.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.231+0000 7f5ec101e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5ebc0b0740 0x7f5ebc0b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.231+0000 7f5ec181f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5ebc15ef60 0x7f5ebc0ce4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46550/0 (socket says 172.21.15.55:46550) 2024-04-25T08:57:59.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.231+0000 7f5ec101e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5ebc0b0740 0x7f5ebc0b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49830/0 (socket says 172.21.15.55:49830) 2024-04-25T08:57:59.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.231+0000 7f5ec181f640 1 -- 172.21.15.55:0/3063253217 learned_addr learned my addr 172.21.15.55:0/3063253217 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:57:59.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.231+0000 7f5ec101e640 1 -- 172.21.15.55:0/3063253217 >> v1:172.21.15.167:6789/0 conn(0x7f5ebc0cfd60 legacy=0x7f5ebc0d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.231+0000 7f5ec101e640 1 -- 172.21.15.55:0/3063253217 >> v1:172.21.15.55:6789/0 conn(0x7f5ebc15ef60 legacy=0x7f5ebc0ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.231+0000 7f5ec101e640 1 -- 172.21.15.55:0/3063253217 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc15ff00 con 0x7f5ebc0b0740 2024-04-25T08:57:59.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.232+0000 7f5ec101e640 1 --2- 172.21.15.55:0/3063253217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ebc0b0740 0x7f5ebc0b0bd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0097a0 tx=0x7f5eac02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8799b736dcbd1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:59.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.232+0000 7f5ec081d640 1 -- 172.21.15.55:0/3063253217 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac037070 con 0x7f5ebc0b0740 2024-04-25T08:57:59.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.232+0000 7f5ec081d640 1 -- 172.21.15.55:0/3063253217 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac032640 con 0x7f5ebc0b0740 2024-04-25T08:57:59.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.232+0000 7f5ec081d640 1 -- 172.21.15.55:0/3063253217 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac032a10 con 0x7f5ebc0b0740 2024-04-25T08:57:59.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.233+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3063253217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ebc0b0740 msgr2=0x7f5ebc0b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.233+0000 7f5ec3a83640 1 --2- 172.21.15.55:0/3063253217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ebc0b0740 0x7f5ebc0b0bd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0097a0 tx=0x7f5eac02a2c0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.233+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3063253217 shutdown_connections 2024-04-25T08:57:59.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.233+0000 7f5ec3a83640 1 --2- 172.21.15.55:0/3063253217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ebc0b0740 0x7f5ebc0b0bd0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.233+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3063253217 >> 172.21.15.55:0/3063253217 conn(0x7f5ebc06f4c0 msgr2=0x7f5ebc06f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:59.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.233+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3063253217 shutdown_connections 2024-04-25T08:57:59.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.233+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3063253217 wait complete. 2024-04-25T08:57:59.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.234+0000 7f5ec3a83640 1 Processor -- start 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.234+0000 7f5ec3a83640 1 -- start start 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec3a83640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ebc0b0740 0x7f5ebc0b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec3a83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ebc0cfd60 0x7f5ebc0afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec3a83640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ebc15ef60 0x7f5ebc14fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec3a83640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc15f340 con 0x7f5ebc0cfd60 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec3a83640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc1604c0 con 0x7f5ebc0b0740 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec3a83640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0cebd0 con 0x7f5ebc15ef60 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec101e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ebc0cfd60 0x7f5ebc0afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec101e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ebc0cfd60 0x7f5ebc0afd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49838/0 (socket says 172.21.15.55:49838) 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec101e640 1 -- 172.21.15.55:0/3044664797 learned_addr learned my addr 172.21.15.55:0/3044664797 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec181f640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ebc0b0740 0x7f5ebc0b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec2020640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ebc15ef60 0x7f5ebc14fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec101e640 1 -- 172.21.15.55:0/3044664797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ebc15ef60 msgr2=0x7f5ebc14fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec101e640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ebc15ef60 0x7f5ebc14fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec101e640 1 -- 172.21.15.55:0/3044664797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ebc0b0740 msgr2=0x7f5ebc0b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec101e640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ebc0b0740 0x7f5ebc0b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec101e640 1 -- 172.21.15.55:0/3044664797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc0b2520 con 0x7f5ebc0cfd60 2024-04-25T08:57:59.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.235+0000 7f5ec181f640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ebc0b0740 0x7f5ebc0b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:59.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.236+0000 7f5ec101e640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ebc0cfd60 0x7f5ebc0afd10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f5eac035040 tx=0x7f5eac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:59.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.236+0000 7f5eb27fc640 1 -- 172.21.15.55:0/3044664797 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac041030 con 0x7f5ebc0cfd60 2024-04-25T08:57:59.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.236+0000 7f5eb27fc640 1 -- 172.21.15.55:0/3044664797 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac030750 con 0x7f5ebc0cfd60 2024-04-25T08:57:59.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.236+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3044664797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc0b1910 con 0x7f5ebc0cfd60 2024-04-25T08:57:59.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.236+0000 7f5eb27fc640 1 -- 172.21.15.55:0/3044664797 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac037040 con 0x7f5ebc0cfd60 2024-04-25T08:57:59.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.236+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3044664797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc0b21b0 con 0x7f5ebc0cfd60 2024-04-25T08:57:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.237+0000 7f5eb27fc640 1 -- 172.21.15.55:0/3044664797 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5eac044070 con 0x7f5ebc0cfd60 2024-04-25T08:57:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.238+0000 7f5eb27fc640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ea006b500 0x7f5ea006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.238+0000 7f5eb27fc640 1 -- 172.21.15.55:0/3044664797 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5eac0aab00 con 0x7f5ebc0cfd60 2024-04-25T08:57:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.238+0000 7f5ec181f640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ea006b500 0x7f5ea006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.238+0000 7f5ec181f640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ea006b500 0x7f5ea006d9c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8005880 tx=0x7f5eb8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.239+0000 7f5ec6781740 1 Processor -- start 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.239+0000 7f5ec6781740 1 -- start start 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.239+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf89f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.239+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf8bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.239+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf874f10 0x556bbf8bb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.239+0000 7f5ec6781740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bbf7d7a10 con 0x556bbf89f230 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.239+0000 7f5ec6781740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bbf780b30 con 0x556bbf8bcad0 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.239+0000 7f5ec6781740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bbf7d3c50 con 0x556bbf874f10 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.239+0000 7f5ec181f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf89f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5ec181f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf89f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49852/0 (socket says 172.21.15.55:49852) 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5ec181f640 1 -- 172.21.15.55:0/645826408 learned_addr learned my addr 172.21.15.55:0/645826408 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5ec2020640 1 --2- 172.21.15.55:0/645826408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf874f10 0x556bbf8bb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5ec101e640 1 --2- 172.21.15.55:0/645826408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf8bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5ec181f640 1 -- 172.21.15.55:0/645826408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf874f10 msgr2=0x556bbf8bb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5ec181f640 1 --2- 172.21.15.55:0/645826408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf874f10 0x556bbf8bb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5ec181f640 1 -- 172.21.15.55:0/645826408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 msgr2=0x556bbf8bd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5ec181f640 1 --2- 172.21.15.55:0/645826408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf8bd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5ec181f640 1 -- 172.21.15.55:0/645826408 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bbf795e10 con 0x556bbf89f230 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5ec101e640 1 --2- 172.21.15.55:0/645826408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf8bd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5ec181f640 1 --2- 172.21.15.55:0/645826408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf89f610 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8007fd0 tx=0x7f5eb8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c55a4b1e44377a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5e9f7fe640 1 -- 172.21.15.55:0/645826408 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8007710 con 0x556bbf89f230 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5e9f7fe640 1 -- 172.21.15.55:0/645826408 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb800e7b0 con 0x556bbf89f230 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.240+0000 7f5e9f7fe640 1 -- 172.21.15.55:0/645826408 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800eb60 con 0x556bbf89f230 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.241+0000 7f5ec6781740 1 -- 172.21.15.55:0/645826408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 msgr2=0x556bbf89f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.241+0000 7f5ec6781740 1 --2- 172.21.15.55:0/645826408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf89f610 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8007fd0 tx=0x7f5eb8011000 comp rx=0 tx=0).stop 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.241+0000 7f5ec6781740 1 -- 172.21.15.55:0/645826408 shutdown_connections 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.241+0000 7f5ec6781740 1 --2- 172.21.15.55:0/645826408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf874f10 0x556bbf8bb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.241+0000 7f5ec6781740 1 --2- 172.21.15.55:0/645826408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf8bd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.241+0000 7f5ec6781740 1 --2- 172.21.15.55:0/645826408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf89f610 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.241+0000 7f5ec6781740 1 -- 172.21.15.55:0/645826408 >> 172.21.15.55:0/645826408 conn(0x556bbf871840 msgr2=0x556bbf8ba040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:59.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.241+0000 7f5ec6781740 1 -- 172.21.15.55:0/645826408 shutdown_connections 2024-04-25T08:57:59.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.241+0000 7f5ec6781740 1 -- 172.21.15.55:0/645826408 wait complete. 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.241+0000 7f5ec6781740 1 -- start start 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.241+0000 7f5ec6781740 1 Processor -- start 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.242+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf89f230 0x556bbf88e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.242+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf8bcad0 0x556bbf8ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.242+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 0x556bbf8a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.242+0000 7f5ec6781740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bbf875cb0 con 0x556bbf8bcad0 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.242+0000 7f5ec6781740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bbf7940c0 con 0x556bbf89f230 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.242+0000 7f5ec6781740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bbf86f770 con 0x556bbf8a1110 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.242+0000 7f5ec6781740 10 client.0 _ll_register_callbacks cb 0x556bbf787ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.242+0000 7f5ec101e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf8bcad0 0x556bbf8ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.242+0000 7f5ec101e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf8bcad0 0x556bbf8ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49866/0 (socket says 172.21.15.55:49866) 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec101e640 1 -- 172.21.15.55:0/1717709660 learned_addr learned my addr 172.21.15.55:0/1717709660 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec181f640 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf89f230 0x556bbf88e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec2020640 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 0x556bbf8a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec101e640 1 -- 172.21.15.55:0/1717709660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 msgr2=0x556bbf8a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec101e640 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 0x556bbf8a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec101e640 1 -- 172.21.15.55:0/1717709660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf89f230 msgr2=0x556bbf88e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec101e640 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf89f230 0x556bbf88e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec101e640 1 -- 172.21.15.55:0/1717709660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bbf4ec2d0 con 0x556bbf8bcad0 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec101e640 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf8bcad0 0x556bbf8ca1f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0790a0 tx=0x7f5eac078dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f017da5b9bcb2a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5e9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5e9cff9640 1 -- 172.21.15.55:0/1717709660 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac081ab0 con 0x556bbf8bcad0 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5e9cff9640 1 -- 172.21.15.55:0/1717709660 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5eac032500 con 0x556bbf8bcad0 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec6781740 1 -- 172.21.15.55:0/1717709660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5eb800e7b0 con 0x556bbf8bcad0 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5e9cff9640 1 -- 172.21.15.55:0/1717709660 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eac07d0d0 con 0x556bbf8bcad0 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec6781740 10 client.6786 fetch_fsmap learned FSMap version 36 2024-04-25T08:57:59.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5ec6781740 1 -- 172.21.15.55:0/1717709660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x556bbf5b66b0 con 0x556bbf8bcad0 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5e9cff9640 1 -- 172.21.15.55:0/1717709660 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb800e7b0 con 0x556bbf8bcad0 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.243+0000 7f5e9cff9640 1 -- 172.21.15.55:0/1717709660 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5eac04e060 con 0x556bbf8bcad0 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.244+0000 7f5ec6781740 10 client.6786 fetch_fsmap finished waiting for FSMap version 36 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.244+0000 7f5ec6781740 10 client.6786 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.244+0000 7f5ec6781740 20 client.6786 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.244+0000 7f5ec6781740 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.55:6835/173615501,v1:172.21.15.55:6837/173615501] conn(0x556bbf8d3f80 0x556bbf8d8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.244+0000 7f5ec6781740 4 client.6786 mds_command: new command op to 6609 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.244+0000 7f5ec6781740 1 -- 172.21.15.55:0/1717709660 --> [v2:172.21.15.55:6835/173615501,v1:172.21.15.55:6837/173615501] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556bbf836920 con 0x556bbf8d3f80 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.244+0000 7f5ec181f640 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.55:6835/173615501,v1:172.21.15.55:6837/173615501] conn(0x556bbf8d3f80 0x556bbf8d8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.244+0000 7f5e9cff9640 10 client.6786 ms_handle_connect on v2:172.21.15.55:6835/173615501 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.244+0000 7f5ec181f640 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.55:6835/173615501,v1:172.21.15.55:6837/173615501] conn(0x556bbf8d3f80 0x556bbf8d8110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25119be2b9dca04b server_cookie=2d54cb1efe7445c2 in_seq=0 out_seq=0 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5e9cff9640 1 -- 172.21.15.55:0/1717709660 <== mds.0 v2:172.21.15.55:6835/173615501 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556bbf836920 con 0x556bbf8d3f80 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5e9cff9640 10 client.6786 handle_command_reply: tid=0 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 1 client.6786 shutdown 2024-04-25T08:57:59.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 1 -- 172.21.15.55:0/1717709660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf8bcad0 msgr2=0x556bbf8ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf8bcad0 0x556bbf8ca1f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0790a0 tx=0x7f5eac078dc0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 1 -- 172.21.15.55:0/1717709660 shutdown_connections 2024-04-25T08:57:59.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.55:6835/173615501,v1:172.21.15.55:6837/173615501] conn(0x556bbf8d3f80 0x556bbf8d8110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 0x556bbf8a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf8bcad0 0x556bbf8ca1f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 1 --2- 172.21.15.55:0/1717709660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf89f230 0x556bbf88e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5e9cff9640 0 client.6786 ms_handle_reset on v2:172.21.15.55:6835/173615501 2024-04-25T08:57:59.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 1 -- 172.21.15.55:0/1717709660 >> 172.21.15.55:0/1717709660 conn(0x556bbf874f10 msgr2=0x556bbf8bd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:59.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 1 -- 172.21.15.55:0/1717709660 shutdown_connections 2024-04-25T08:57:59.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 1 -- 172.21.15.55:0/1717709660 wait complete. 2024-04-25T08:57:59.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.245+0000 7f5ec6781740 20 client.6786 trim_cache size 0 max 16384 2024-04-25T08:57:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.261+0000 7f5ec6781740 1 Processor -- start 2024-04-25T08:57:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.261+0000 7f5ec6781740 1 -- start start 2024-04-25T08:57:59.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 0x556bbf8dc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf8dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec6781740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc1fd0a0 con 0x556bbf89f230 2024-04-25T08:57:59.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec6781740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0aaf10 con 0x556bbf8bcad0 2024-04-25T08:57:59.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec6781740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc1f5910 con 0x556bbf8a1110 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec181f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec181f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49878/0 (socket says 172.21.15.55:49878) 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec181f640 1 -- 172.21.15.55:0/1177227015 learned_addr learned my addr 172.21.15.55:0/1177227015 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec181f640 1 -- 172.21.15.55:0/1177227015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 msgr2=0x556bbf8dc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec181f640 1 --2- 172.21.15.55:0/1177227015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 0x556bbf8dc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec181f640 1 -- 172.21.15.55:0/1177227015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 msgr2=0x556bbf8dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec181f640 1 --2- 172.21.15.55:0/1177227015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf8dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec181f640 1 -- 172.21.15.55:0/1177227015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bbf874710 con 0x556bbf89f230 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5ec181f640 1 --2- 172.21.15.55:0/1177227015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8c8fd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80074a0 tx=0x7f5eb8007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f45b04c335e48f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5e9effd640 1 -- 172.21.15.55:0/1177227015 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800ec60 con 0x556bbf89f230 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5e9effd640 1 -- 172.21.15.55:0/1177227015 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb800ee00 con 0x556bbf89f230 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.262+0000 7f5e9effd640 1 -- 172.21.15.55:0/1177227015 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb802c270 con 0x556bbf89f230 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.263+0000 7f5ec6781740 1 -- 172.21.15.55:0/1177227015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 msgr2=0x556bbf8c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.263+0000 7f5ec6781740 1 --2- 172.21.15.55:0/1177227015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8c8fd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80074a0 tx=0x7f5eb8007000 comp rx=0 tx=0).stop 2024-04-25T08:57:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.263+0000 7f5ec6781740 1 -- 172.21.15.55:0/1177227015 shutdown_connections 2024-04-25T08:57:59.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.263+0000 7f5ec6781740 1 --2- 172.21.15.55:0/1177227015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf8dc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.263+0000 7f5ec6781740 1 --2- 172.21.15.55:0/1177227015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 0x556bbf8dc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.263+0000 7f5ec6781740 1 --2- 172.21.15.55:0/1177227015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8c8fd0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.263+0000 7f5ec6781740 1 -- 172.21.15.55:0/1177227015 >> 172.21.15.55:0/1177227015 conn(0x556bbf874f10 msgr2=0x556bbf86ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:59.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.263+0000 7f5ec6781740 1 -- 172.21.15.55:0/1177227015 shutdown_connections 2024-04-25T08:57:59.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.263+0000 7f5ec6781740 1 -- 172.21.15.55:0/1177227015 wait complete. 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.263+0000 7f5ec6781740 1 -- start start 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.264+0000 7f5ec6781740 1 Processor -- start 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.264+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.264+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 0x556bbf88d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.264+0000 7f5ec6781740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf88d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.264+0000 7f5ec6781740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bbf8d3e00 con 0x556bbf89f230 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.264+0000 7f5ec6781740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bbf5b66b0 con 0x556bbf8bcad0 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.264+0000 7f5ec6781740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bbf8d43d0 con 0x556bbf8a1110 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.264+0000 7f5ec6781740 10 client.0 _ll_register_callbacks cb 0x556bbf86fc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec181f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec181f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49894/0 (socket says 172.21.15.55:49894) 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec181f640 1 -- 172.21.15.55:0/2550664273 learned_addr learned my addr 172.21.15.55:0/2550664273 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec2020640 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf88d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec101e640 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 0x556bbf88d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec181f640 1 -- 172.21.15.55:0/2550664273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 msgr2=0x556bbf88d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec181f640 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 0x556bbf88d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec181f640 1 -- 172.21.15.55:0/2550664273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 msgr2=0x556bbf88d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec181f640 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf88d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec181f640 1 -- 172.21.15.55:0/2550664273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bbf8b0730 con 0x556bbf89f230 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec181f640 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8b01f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8017040 tx=0x7f5eb8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0426742ee2c35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5e9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5e9cff9640 1 -- 172.21.15.55:0/2550664273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb802c230 con 0x556bbf89f230 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5e9cff9640 1 -- 172.21.15.55:0/2550664273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5eb802c3d0 con 0x556bbf89f230 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec6781740 1 -- 172.21.15.55:0/2550664273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5eb800ee00 con 0x556bbf89f230 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5e9cff9640 1 -- 172.21.15.55:0/2550664273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eb803d050 con 0x556bbf89f230 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec6781740 10 client.6792 fetch_fsmap learned FSMap version 36 2024-04-25T08:57:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.265+0000 7f5ec6781740 1 -- 172.21.15.55:0/2550664273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x556bbf8dc590 con 0x556bbf89f230 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5e9cff9640 1 -- 172.21.15.55:0/2550664273 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb800ee00 con 0x556bbf89f230 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5e9cff9640 1 -- 172.21.15.55:0/2550664273 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5eb8040020 con 0x556bbf89f230 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 10 client.6792 fetch_fsmap finished waiting for FSMap version 36 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 10 client.6792 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 20 client.6792 populate_metadata read hostname 'smithi055' 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.55:6835/173615501,v1:172.21.15.55:6837/173615501] conn(0x556bbf928b00 0x556bbf928ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 4 client.6792 mds_command: new command op to 6609 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 1 -- 172.21.15.55:0/2550664273 --> [v2:172.21.15.55:6835/173615501,v1:172.21.15.55:6837/173615501] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556bbf7e4f50 con 0x556bbf928b00 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec101e640 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.55:6835/173615501,v1:172.21.15.55:6837/173615501] conn(0x556bbf928b00 0x556bbf928ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5e9cff9640 10 client.6792 ms_handle_connect on v2:172.21.15.55:6835/173615501 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec101e640 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.55:6835/173615501,v1:172.21.15.55:6837/173615501] conn(0x556bbf928b00 0x556bbf928ee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7be07d5daf4961e server_cookie=9b89ad9769a31f61 in_seq=0 out_seq=0 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5e9cff9640 1 -- 172.21.15.55:0/2550664273 <== mds.0 v2:172.21.15.55:6835/173615501 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x556bbf7e4f50 con 0x556bbf928b00 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5e9cff9640 10 client.6792 handle_command_reply: tid=0 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 1 client.6792 shutdown 2024-04-25T08:57:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 1 -- 172.21.15.55:0/2550664273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 msgr2=0x556bbf8b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8b01f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8017040 tx=0x7f5eb8013000 comp rx=0 tx=0).stop 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 1 -- 172.21.15.55:0/2550664273 shutdown_connections 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.55:6835/173615501,v1:172.21.15.55:6837/173615501] conn(0x556bbf928b00 0x556bbf928ee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bbf8bcad0 0x556bbf88d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5e9cff9640 0 client.6792 ms_handle_reset on v2:172.21.15.55:6835/173615501 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bbf8a1110 0x556bbf88d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 1 --2- 172.21.15.55:0/2550664273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556bbf89f230 0x556bbf8b01f0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.266+0000 7f5ec6781740 1 -- 172.21.15.55:0/2550664273 >> 172.21.15.55:0/2550664273 conn(0x556bbf874f10 msgr2=0x556bbf8b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec6781740 1 -- 172.21.15.55:0/2550664273 shutdown_connections 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec6781740 1 -- 172.21.15.55:0/2550664273 wait complete. 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec6781740 20 client.6792 trim_cache size 0 max 16384 2024-04-25T08:57:59.261 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6609, 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 9.0844182310000008, 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 36, 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 73, 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 73, 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 14.447024690999999 2024-04-25T08:57:59.262 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:57:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3044664797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ea006b500 msgr2=0x7f5ea006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ea006b500 0x7f5ea006d9c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8005880 tx=0x7f5eb8009040 comp rx=0 tx=0).stop 2024-04-25T08:57:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3044664797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ebc0cfd60 msgr2=0x7f5ebc0afd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ebc0cfd60 0x7f5ebc0afd10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f5eac035040 tx=0x7f5eac0046c0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3044664797 shutdown_connections 2024-04-25T08:57:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ea006b500 0x7f5ea006d9c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ebc15ef60 0x7f5ebc14fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ebc0cfd60 0x7f5ebc0afd10 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 --2- 172.21.15.55:0/3044664797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ebc0b0740 0x7f5ebc0b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3044664797 >> 172.21.15.55:0/3044664797 conn(0x7f5ebc06f4c0 msgr2=0x7f5ebc0c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3044664797 shutdown_connections 2024-04-25T08:57:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.267+0000 7f5ec3a83640 1 -- 172.21.15.55:0/3044664797 wait complete. 2024-04-25T08:57:59.267 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:57:59.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.379+0000 7f43951ee640 1 Processor -- start 2024-04-25T08:57:59.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.379+0000 7f43951ee640 1 -- start start 2024-04-25T08:57:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f43951ee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f439015ba10 0x7f4390099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f43951ee640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f439006c3c0 0x7f43900cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f43951ee640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439006c900 con 0x7f4390099f80 2024-04-25T08:57:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f43951ee640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43900cbe50 con 0x7f439015ba10 2024-04-25T08:57:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f43951ee640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439009a3d0 con 0x7f439006c3c0 2024-04-25T08:57:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f438ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f439015ba10 0x7f4390099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f438ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f439015ba10 0x7f4390099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49906/0 (socket says 172.21.15.55:49906) 2024-04-25T08:57:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f438ed9d640 1 -- 172.21.15.55:0/1505888524 learned_addr learned my addr 172.21.15.55:0/1505888524 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f438f59e640 1 --2- 172.21.15.55:0/1505888524 >> v2:172.21.15.167:3300/0 conn(0x7f439006c3c0 0x7f43900cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f438ed9d640 1 -- 172.21.15.55:0/1505888524 >> v2:172.21.15.167:3300/0 conn(0x7f439006c3c0 msgr2=0x7f43900cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:59.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f438ed9d640 1 --2- 172.21.15.55:0/1505888524 >> v2:172.21.15.167:3300/0 conn(0x7f439006c3c0 0x7f43900cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f438ed9d640 1 -- 172.21.15.55:0/1505888524 >> v1:172.21.15.167:6789/0 conn(0x7f4390099f80 legacy=0x7f439006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:57:59.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f438ed9d640 1 -- 172.21.15.55:0/1505888524 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439006cbe0 con 0x7f439015ba10 2024-04-25T08:57:59.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.380+0000 7f438f59e640 1 --2- 172.21.15.55:0/1505888524 >> v2:172.21.15.167:3300/0 conn(0x7f439006c3c0 0x7f43900cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:57:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.381+0000 7f438ed9d640 1 --2- 172.21.15.55:0/1505888524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f439015ba10 0x7f4390099a40 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f43900b7850 tx=0x7f438802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e733f6586c34f70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.381+0000 7f438dd9b640 1 -- 172.21.15.55:0/1505888524 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388037070 con 0x7f439015ba10 2024-04-25T08:57:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.381+0000 7f438dd9b640 1 -- 172.21.15.55:0/1505888524 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388032440 con 0x7f439015ba10 2024-04-25T08:57:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.381+0000 7f438dd9b640 1 -- 172.21.15.55:0/1505888524 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388032810 con 0x7f439015ba10 2024-04-25T08:57:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.382+0000 7f43951ee640 1 -- 172.21.15.55:0/1505888524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f439015ba10 msgr2=0x7f4390099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.382+0000 7f43951ee640 1 --2- 172.21.15.55:0/1505888524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f439015ba10 0x7f4390099a40 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f43900b7850 tx=0x7f438802a230 comp rx=0 tx=0).stop 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.382+0000 7f43951ee640 1 -- 172.21.15.55:0/1505888524 shutdown_connections 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.382+0000 7f43951ee640 1 --2- 172.21.15.55:0/1505888524 >> v2:172.21.15.167:3300/0 conn(0x7f439006c3c0 0x7f43900cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.382+0000 7f43951ee640 1 --2- 172.21.15.55:0/1505888524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f439015ba10 0x7f4390099a40 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.382+0000 7f43951ee640 1 -- 172.21.15.55:0/1505888524 >> 172.21.15.55:0/1505888524 conn(0x7f43900b32f0 msgr2=0x7f43900b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.382+0000 7f43951ee640 1 -- 172.21.15.55:0/1505888524 shutdown_connections 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.382+0000 7f43951ee640 1 -- 172.21.15.55:0/1505888524 wait complete. 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.383+0000 7f43951ee640 1 Processor -- start 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.383+0000 7f43951ee640 1 -- start start 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.384+0000 7f43951ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f439006c3c0 0x7f43900b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.384+0000 7f43951ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4390099f80 0x7f43901f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.384+0000 7f43951ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f439015ba10 0x7f439015e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.384+0000 7f43951ee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43900cd760 con 0x7f439015ba10 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.384+0000 7f43951ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43900cfe80 con 0x7f439006c3c0 2024-04-25T08:57:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.384+0000 7f43951ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43900cd8e0 con 0x7f4390099f80 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.384+0000 7f438f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f439015ba10 0x7f439015e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.384+0000 7f438f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f439015ba10 0x7f439015e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49916/0 (socket says 172.21.15.55:49916) 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.384+0000 7f438f59e640 1 -- 172.21.15.55:0/1216281333 learned_addr learned my addr 172.21.15.55:0/1216281333 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.384+0000 7f438ed9d640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f439006c3c0 0x7f43900b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.384+0000 7f438e59c640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4390099f80 0x7f43901f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.385+0000 7f438f59e640 1 -- 172.21.15.55:0/1216281333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4390099f80 msgr2=0x7f43901f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.385+0000 7f438f59e640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4390099f80 0x7f43901f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.385+0000 7f438f59e640 1 -- 172.21.15.55:0/1216281333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f439006c3c0 msgr2=0x7f43900b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.385+0000 7f438f59e640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f439006c3c0 0x7f43900b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.385+0000 7f438f59e640 1 -- 172.21.15.55:0/1216281333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43901f8260 con 0x7f439015ba10 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.385+0000 7f438f59e640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f439015ba10 0x7f439015e0e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f438000ce80 tx=0x7f438000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.385+0000 7f43877fe640 1 -- 172.21.15.55:0/1216281333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438001a070 con 0x7f439015ba10 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.385+0000 7f43877fe640 1 -- 172.21.15.55:0/1216281333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438000d880 con 0x7f439015ba10 2024-04-25T08:57:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.385+0000 7f43951ee640 1 -- 172.21.15.55:0/1216281333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43901f8540 con 0x7f439015ba10 2024-04-25T08:57:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.385+0000 7f43877fe640 1 -- 172.21.15.55:0/1216281333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438000dc70 con 0x7f439015ba10 2024-04-25T08:57:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.385+0000 7f43951ee640 1 -- 172.21.15.55:0/1216281333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439015e620 con 0x7f439015ba10 2024-04-25T08:57:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.386+0000 7f43951ee640 1 -- 172.21.15.55:0/1216281333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43900749b0 con 0x7f439015ba10 2024-04-25T08:57:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.387+0000 7f43877fe640 1 -- 172.21.15.55:0/1216281333 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f438001d070 con 0x7f439015ba10 2024-04-25T08:57:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.387+0000 7f43877fe640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f437006b4d0 0x7f437006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:57:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.387+0000 7f43877fe640 1 -- 172.21.15.55:0/1216281333 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f438008a8e0 con 0x7f439015ba10 2024-04-25T08:57:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.387+0000 7f438ed9d640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f437006b4d0 0x7f437006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:57:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.387+0000 7f438ed9d640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f437006b4d0 0x7f437006d990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4388034000 tx=0x7f438802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:57:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.391+0000 7f43877fe640 1 -- 172.21.15.55:0/1216281333 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4380059120 con 0x7f439015ba10 2024-04-25T08:57:59.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.613+0000 7f43951ee640 1 -- 172.21.15.55:0/1216281333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f43900cdf20 con 0x7f439015ba10 2024-04-25T08:57:59.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.613+0000 7f43877fe640 1 -- 172.21.15.55:0/1216281333 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f438005d1c0 con 0x7f439015ba10 2024-04-25T08:57:59.602 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:57:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 -- 172.21.15.55:0/1216281333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f437006b4d0 msgr2=0x7f437006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f437006b4d0 0x7f437006d990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4388034000 tx=0x7f438802e000 comp rx=0 tx=0).stop 2024-04-25T08:57:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 -- 172.21.15.55:0/1216281333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f439015ba10 msgr2=0x7f439015e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:57:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f439015ba10 0x7f439015e0e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f438000ce80 tx=0x7f438000a710 comp rx=0 tx=0).stop 2024-04-25T08:57:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 -- 172.21.15.55:0/1216281333 shutdown_connections 2024-04-25T08:57:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f437006b4d0 0x7f437006d990 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f439015ba10 0x7f439015e0e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4390099f80 0x7f43901f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 --2- 172.21.15.55:0/1216281333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f439006c3c0 0x7f43900b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:57:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 -- 172.21.15.55:0/1216281333 >> 172.21.15.55:0/1216281333 conn(0x7f43900b32f0 msgr2=0x7f43900d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:57:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 -- 172.21.15.55:0/1216281333 shutdown_connections 2024-04-25T08:57:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:57:59.615+0000 7f43951ee640 1 -- 172.21.15.55:0/1216281333 wait complete. 2024-04-25T08:57:59.615 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:57:59.615 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:57:59.615 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T08:57:59.615 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:57:59.615 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:57:59.615 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:57:59.615 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:57:59.616 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:57:59.616 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:57:59.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:59.616 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T08:57:59.631 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:57:59.631 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T08:57:59.632 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42478sec preferred_lft 42478sec 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T08:57:59.633 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:59.634 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:57:59.634 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:57:59.634 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T08:57:59.634 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:57:59.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:59.634 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:57:59.695 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:57:59.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:59.697 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T08:57:59.753 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T08:57:59.754 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:57:59.754 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:57:59.754 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:57:59.754 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:57:59.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:59.754 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:57:59.754 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:57:59.754 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:57:59.754 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:57:59.754 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:57:59.755 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:57:59.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:59.840 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:57:59.855 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:57:59.856 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:57:59.856 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:57:59.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:57:59.856 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T08:57:59.922 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:57:59.923 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:57:59.978 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:57:59.978 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:57:59.978 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:58:00.033 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:58:00.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:00.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:58:00.115 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:58:00.115 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:58:00.116 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:58:00.124 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:58:00.124 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:58:00.124 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:58:00.124 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:58:00.124 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:58:00.130 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:58:00.131 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:58:00.131 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:58:00.131 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:58:00.131 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:58:00.131 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:58:00.131 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:58:00.131 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:58:00.132 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:58:00.132 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:58:00.132 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:58:00.132 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:58:00.132 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:58:00.133 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:58:00.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:00.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:58:00.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:00.199 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:58:00.260 INFO:teuthology.orchestra.run.smithi055.stdout:client6244 2024-04-25T08:58:00.260 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:58:00.260 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:58:00.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:00.316 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-04-25T08:58:00.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:00.377 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-04-25T08:58:00.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:00.434 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-04-25T08:58:00.490 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T08:58:00.490 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T08:58:00.490 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T08:58:00.490 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:58:00.490 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-04-25T08:58:00.490 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T08:58:00.597 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-25T08:58:00.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:58:00.606 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:58:00.606 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:58:00.662 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:58:00.662 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:58:00.717 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:58:00.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.869+0000 7f22508e1640 1 Processor -- start 2024-04-25T08:58:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.869+0000 7f22508e1640 1 -- start start 2024-04-25T08:58:00.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f22508e1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f224c15dce0 0x7f224c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:00.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f22508e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f224c0d35b0 0x7f224c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:00.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f22508e1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 0x7f224c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:00.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f22508e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c15e0c0 con 0x7f224c0d35b0 2024-04-25T08:58:00.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f22508e1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c0d2510 con 0x7f224c15dce0 2024-04-25T08:58:00.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f22508e1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0d27f0 con 0x7f224c0d1f90 2024-04-25T08:58:00.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f2243fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f224c0d35b0 0x7f224c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:00.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f2243fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f224c0d35b0 0x7f224c0b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49932/0 (socket says 172.21.15.55:49932) 2024-04-25T08:58:00.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f2243fff640 1 -- 172.21.15.55:0/840842723 learned_addr learned my addr 172.21.15.55:0/840842723 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:00.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f2243fff640 1 -- 172.21.15.55:0/840842723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 msgr2=0x7f224c0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:00.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f224a59c640 1 --2- 172.21.15.55:0/840842723 >> v2:172.21.15.167:3300/0 conn(0x7f224c15dce0 0x7f224c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:00.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f224ad9d640 1 --2- 172.21.15.55:0/840842723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 0x7f224c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:00.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f2243fff640 1 --2- 172.21.15.55:0/840842723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 0x7f224c0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:00.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f2243fff640 1 -- 172.21.15.55:0/840842723 >> v2:172.21.15.167:3300/0 conn(0x7f224c15dce0 msgr2=0x7f224c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:00.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f2243fff640 1 --2- 172.21.15.55:0/840842723 >> v2:172.21.15.167:3300/0 conn(0x7f224c15dce0 0x7f224c0d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:00.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f2243fff640 1 -- 172.21.15.55:0/840842723 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c0d2ad0 con 0x7f224c0d35b0 2024-04-25T08:58:00.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f224a59c640 1 --2- 172.21.15.55:0/840842723 >> v2:172.21.15.167:3300/0 conn(0x7f224c15dce0 0x7f224c0d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:00.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.870+0000 7f224ad9d640 1 --2- 172.21.15.55:0/840842723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 0x7f224c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:00.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.871+0000 7f2243fff640 1 --2- 172.21.15.55:0/840842723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224c0d35b0 0x7f224c0b5450 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f224c0ce220 tx=0x7f223402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d99846fdd3161c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:00.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.871+0000 7f2249d9b640 1 -- 172.21.15.55:0/840842723 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234037070 con 0x7f224c0d35b0 2024-04-25T08:58:00.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.871+0000 7f2249d9b640 1 -- 172.21.15.55:0/840842723 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2234032440 con 0x7f224c0d35b0 2024-04-25T08:58:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.871+0000 7f2249d9b640 1 -- 172.21.15.55:0/840842723 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234032810 con 0x7f224c0d35b0 2024-04-25T08:58:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.872+0000 7f22508e1640 1 -- 172.21.15.55:0/840842723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224c0d35b0 msgr2=0x7f224c0b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.872+0000 7f22508e1640 1 --2- 172.21.15.55:0/840842723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224c0d35b0 0x7f224c0b5450 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f224c0ce220 tx=0x7f223402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:58:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.872+0000 7f22508e1640 1 -- 172.21.15.55:0/840842723 shutdown_connections 2024-04-25T08:58:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.872+0000 7f22508e1640 1 --2- 172.21.15.55:0/840842723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 0x7f224c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.872+0000 7f22508e1640 1 --2- 172.21.15.55:0/840842723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224c0d35b0 0x7f224c0b5450 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.872+0000 7f22508e1640 1 --2- 172.21.15.55:0/840842723 >> v2:172.21.15.167:3300/0 conn(0x7f224c15dce0 0x7f224c0d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.872+0000 7f22508e1640 1 -- 172.21.15.55:0/840842723 >> 172.21.15.55:0/840842723 conn(0x7f224c072900 msgr2=0x7f224c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.872+0000 7f22508e1640 1 -- 172.21.15.55:0/840842723 shutdown_connections 2024-04-25T08:58:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.872+0000 7f22508e1640 1 -- 172.21.15.55:0/840842723 wait complete. 2024-04-25T08:58:00.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.873+0000 7f22508e1640 1 Processor -- start 2024-04-25T08:58:00.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.873+0000 7f22508e1640 1 -- start start 2024-04-25T08:58:00.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f22508e1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 0x7f224c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:00.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f22508e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224c0d35b0 0x7f224c0cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:00.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f22508e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f224c15dce0 0x7f224c0cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f22508e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0b9820 con 0x7f224c0d35b0 2024-04-25T08:58:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f22508e1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0d3090 con 0x7f224c15dce0 2024-04-25T08:58:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f22508e1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0b99a0 con 0x7f224c0d1f90 2024-04-25T08:58:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f2243fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224c0d35b0 0x7f224c0cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f2243fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224c0d35b0 0x7f224c0cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49948/0 (socket says 172.21.15.55:49948) 2024-04-25T08:58:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f2243fff640 1 -- 172.21.15.55:0/3209648875 learned_addr learned my addr 172.21.15.55:0/3209648875 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f224ad9d640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f224c15dce0 0x7f224c0cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f224a59c640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 0x7f224c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f2243fff640 1 -- 172.21.15.55:0/3209648875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 msgr2=0x7f224c153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f2243fff640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 0x7f224c153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f2243fff640 1 -- 172.21.15.55:0/3209648875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f224c15dce0 msgr2=0x7f224c0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f2243fff640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f224c15dce0 0x7f224c0cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f2243fff640 1 -- 172.21.15.55:0/3209648875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c0cc770 con 0x7f224c0d35b0 2024-04-25T08:58:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f224ad9d640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f224c15dce0 0x7f224c0cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f224a59c640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 0x7f224c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f2243fff640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224c0d35b0 0x7f224c0cbaf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f223402a220 tx=0x7f22340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:00.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.874+0000 7f2242ffd640 1 -- 172.21.15.55:0/3209648875 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234037040 con 0x7f224c0d35b0 2024-04-25T08:58:00.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.875+0000 7f2242ffd640 1 -- 172.21.15.55:0/3209648875 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2234042070 con 0x7f224c0d35b0 2024-04-25T08:58:00.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.875+0000 7f22508e1640 1 -- 172.21.15.55:0/3209648875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c0cca50 con 0x7f224c0d35b0 2024-04-25T08:58:00.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.875+0000 7f2242ffd640 1 -- 172.21.15.55:0/3209648875 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234030bb0 con 0x7f224c0d35b0 2024-04-25T08:58:00.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.875+0000 7f22508e1640 1 -- 172.21.15.55:0/3209648875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c0cd010 con 0x7f224c0d35b0 2024-04-25T08:58:00.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.876+0000 7f22508e1640 1 -- 172.21.15.55:0/3209648875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c0b9610 con 0x7f224c0d35b0 2024-04-25T08:58:00.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.876+0000 7f2242ffd640 1 -- 172.21.15.55:0/3209648875 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2234047460 con 0x7f224c0d35b0 2024-04-25T08:58:00.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.876+0000 7f2242ffd640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222c06b500 0x7f222c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:00.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.876+0000 7f2242ffd640 1 -- 172.21.15.55:0/3209648875 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22340aae50 con 0x7f224c0d35b0 2024-04-25T08:58:00.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.876+0000 7f224a59c640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222c06b500 0x7f222c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:00.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.877+0000 7f224a59c640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222c06b500 0x7f222c06d9c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f223c006fd0 tx=0x7f223c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:00.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:00.881+0000 7f2242ffd640 1 -- 172.21.15.55:0/3209648875 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f224c0b9610 con 0x7f224c0d35b0 2024-04-25T08:58:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.064+0000 7f22508e1640 1 -- 172.21.15.55:0/3209648875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f224c0749b0 con 0x7f224c0d35b0 2024-04-25T08:58:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.065+0000 7f2242ffd640 1 -- 172.21.15.55:0/3209648875 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16668 (secure 0 0 0) 0x7f2234045360 con 0x7f224c0d35b0 2024-04-25T08:58:01.055 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:58:01.055 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":73,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:57:50.826466+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:47.819814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:48.522459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 -- 172.21.15.55:0/3209648875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222c06b500 msgr2=0x7f222c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222c06b500 0x7f222c06d9c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f223c006fd0 tx=0x7f223c008040 comp rx=0 tx=0).stop 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 -- 172.21.15.55:0/3209648875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224c0d35b0 msgr2=0x7f224c0cbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224c0d35b0 0x7f224c0cbaf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f223402a220 tx=0x7f22340046c0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 -- 172.21.15.55:0/3209648875 shutdown_connections 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f222c06b500 0x7f222c06d9c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f224c15dce0 0x7f224c0cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224c0d35b0 0x7f224c0cbaf0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 --2- 172.21.15.55:0/3209648875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f224c0d1f90 0x7f224c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 -- 172.21.15.55:0/3209648875 >> 172.21.15.55:0/3209648875 conn(0x7f224c072900 msgr2=0x7f224c0b73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 -- 172.21.15.55:0/3209648875 shutdown_connections 2024-04-25T08:58:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.067+0000 7f22508e1640 1 -- 172.21.15.55:0/3209648875 wait complete. 2024-04-25T08:58:01.068 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:57:47.819814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:57:48.522459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:58:01.068 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:58:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.183+0000 7f7645bd5640 1 Processor -- start 2024-04-25T08:58:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.183+0000 7f7645bd5640 1 -- start start 2024-04-25T08:58:01.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f7645bd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f76400d3b90 0x7f76400d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f7645bd5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76400d0f60 0x7f76400b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f7645bd5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76400d4090 con 0x7f764015dca0 2024-04-25T08:58:01.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f7645bd5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76400b6b20 con 0x7f76400d3b90 2024-04-25T08:58:01.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f7645bd5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76400d1390 con 0x7f76400d0f60 2024-04-25T08:58:01.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f763effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f76400d3b90 0x7f76400d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f763f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f764015dca0 0x7f76400ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46554/0 (socket says 172.21.15.55:46554) 2024-04-25T08:58:01.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f763f7fe640 1 -- 172.21.15.55:0/2381371518 learned_addr learned my addr 172.21.15.55:0/2381371518 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:01.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f763ffff640 1 --2- 172.21.15.55:0/2381371518 >> v2:172.21.15.167:3300/0 conn(0x7f76400d0f60 0x7f76400b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f763effd640 1 -- 172.21.15.55:0/2381371518 >> v2:172.21.15.167:3300/0 conn(0x7f76400d0f60 msgr2=0x7f76400b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:01.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f763effd640 1 --2- 172.21.15.55:0/2381371518 >> v2:172.21.15.167:3300/0 conn(0x7f76400d0f60 0x7f76400b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.184+0000 7f763effd640 1 -- 172.21.15.55:0/2381371518 >> v1:172.21.15.55:6789/0 conn(0x7f764015dca0 legacy=0x7f76400ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.185+0000 7f763effd640 1 -- 172.21.15.55:0/2381371518 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76400d4370 con 0x7f76400d3b90 2024-04-25T08:58:01.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.185+0000 7f763e7fc640 1 -- 172.21.15.55:0/2381371518 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304756719 0 0) 0x7f76400d4090 con 0x7f764015dca0 2024-04-25T08:58:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.185+0000 7f763effd640 1 --2- 172.21.15.55:0/2381371518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76400d3b90 0x7f76400d0a20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f76400b9640 tx=0x7f763402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5274b36e0d8e82f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.185+0000 7f763e7fc640 1 -- 172.21.15.55:0/2381371518 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634037070 con 0x7f76400d3b90 2024-04-25T08:58:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.185+0000 7f763e7fc640 1 -- 172.21.15.55:0/2381371518 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7634032440 con 0x7f76400d3b90 2024-04-25T08:58:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.185+0000 7f763e7fc640 1 -- 172.21.15.55:0/2381371518 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634032810 con 0x7f76400d3b90 2024-04-25T08:58:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.186+0000 7f7645bd5640 1 -- 172.21.15.55:0/2381371518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76400d3b90 msgr2=0x7f76400d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.186+0000 7f7645bd5640 1 --2- 172.21.15.55:0/2381371518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76400d3b90 0x7f76400d0a20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f76400b9640 tx=0x7f763402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.186+0000 7f7645bd5640 1 -- 172.21.15.55:0/2381371518 shutdown_connections 2024-04-25T08:58:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.186+0000 7f7645bd5640 1 --2- 172.21.15.55:0/2381371518 >> v2:172.21.15.167:3300/0 conn(0x7f76400d0f60 0x7f76400b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.186+0000 7f7645bd5640 1 --2- 172.21.15.55:0/2381371518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76400d3b90 0x7f76400d0a20 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.186+0000 7f7645bd5640 1 -- 172.21.15.55:0/2381371518 >> 172.21.15.55:0/2381371518 conn(0x7f76400726c0 msgr2=0x7f7640072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.186+0000 7f7645bd5640 1 -- 172.21.15.55:0/2381371518 shutdown_connections 2024-04-25T08:58:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.186+0000 7f7645bd5640 1 -- 172.21.15.55:0/2381371518 wait complete. 2024-04-25T08:58:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.187+0000 7f7645bd5640 1 Processor -- start 2024-04-25T08:58:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.187+0000 7f7645bd5640 1 -- start start 2024-04-25T08:58:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.188+0000 7f7645bd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76400d0f60 0x7f7640153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.188+0000 7f7645bd5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76400d3b90 0x7f7640155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.188+0000 7f7645bd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015dca0 0x7f7640160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.188+0000 7f7645bd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76400cf050 con 0x7f76400d0f60 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.188+0000 7f7645bd5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76400b6d50 con 0x7f76400d3b90 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.188+0000 7f7645bd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764015e080 con 0x7f764015dca0 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.188+0000 7f763f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76400d0f60 0x7f7640153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.188+0000 7f763f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76400d0f60 0x7f7640153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49964/0 (socket says 172.21.15.55:49964) 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.188+0000 7f763f7fe640 1 -- 172.21.15.55:0/3651324335 learned_addr learned my addr 172.21.15.55:0/3651324335 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f763effd640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76400d3b90 0x7f7640155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f763ffff640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015dca0 0x7f7640160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f763f7fe640 1 -- 172.21.15.55:0/3651324335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015dca0 msgr2=0x7f7640160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f763f7fe640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015dca0 0x7f7640160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f763f7fe640 1 -- 172.21.15.55:0/3651324335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76400d3b90 msgr2=0x7f7640155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f763f7fe640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76400d3b90 0x7f7640155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f763f7fe640 1 -- 172.21.15.55:0/3651324335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7640153210 con 0x7f76400d0f60 2024-04-25T08:58:01.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f763f7fe640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76400d0f60 0x7f7640153a90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f763000c430 tx=0x7f763000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:01.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f7627fff640 1 -- 172.21.15.55:0/3651324335 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300074e0 con 0x7f76400d0f60 2024-04-25T08:58:01.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f7627fff640 1 -- 172.21.15.55:0/3651324335 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76300047e0 con 0x7f76400d0f60 2024-04-25T08:58:01.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f7645bd5640 1 -- 172.21.15.55:0/3651324335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764015fa50 con 0x7f76400d0f60 2024-04-25T08:58:01.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f7627fff640 1 -- 172.21.15.55:0/3651324335 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630004bd0 con 0x7f76400d0f60 2024-04-25T08:58:01.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.189+0000 7f7645bd5640 1 -- 172.21.15.55:0/3651324335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7640160010 con 0x7f76400d0f60 2024-04-25T08:58:01.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.190+0000 7f7645bd5640 1 -- 172.21.15.55:0/3651324335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76400750b0 con 0x7f76400d0f60 2024-04-25T08:58:01.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.191+0000 7f7627fff640 1 -- 172.21.15.55:0/3651324335 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7630011070 con 0x7f76400d0f60 2024-04-25T08:58:01.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.191+0000 7f7627fff640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f762c06b4d0 0x7f762c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.191+0000 7f7627fff640 1 -- 172.21.15.55:0/3651324335 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7630089cf0 con 0x7f76400d0f60 2024-04-25T08:58:01.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.191+0000 7f763effd640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f762c06b4d0 0x7f762c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.192+0000 7f763effd640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f762c06b4d0 0x7f762c06d990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7634034000 tx=0x7f763402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.195+0000 7f7627fff640 1 -- 172.21.15.55:0/3651324335 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f763008e070 con 0x7f76400d0f60 2024-04-25T08:58:01.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.374+0000 7f7645bd5640 1 -- 172.21.15.55:0/3651324335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76400d2f20 con 0x7f76400d0f60 2024-04-25T08:58:01.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.375+0000 7f7627fff640 1 -- 172.21.15.55:0/3651324335 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7630058520 con 0x7f76400d0f60 2024-04-25T08:58:01.364 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 -- 172.21.15.55:0/3651324335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f762c06b4d0 msgr2=0x7f762c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f762c06b4d0 0x7f762c06d990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7634034000 tx=0x7f763402e000 comp rx=0 tx=0).stop 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 -- 172.21.15.55:0/3651324335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76400d0f60 msgr2=0x7f7640153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76400d0f60 0x7f7640153a90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f763000c430 tx=0x7f763000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 -- 172.21.15.55:0/3651324335 shutdown_connections 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f762c06b4d0 0x7f762c06d990 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015dca0 0x7f7640160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76400d3b90 0x7f7640155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 --2- 172.21.15.55:0/3651324335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76400d0f60 0x7f7640153a90 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 -- 172.21.15.55:0/3651324335 >> 172.21.15.55:0/3651324335 conn(0x7f76400726c0 msgr2=0x7f764015d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 -- 172.21.15.55:0/3651324335 shutdown_connections 2024-04-25T08:58:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.377+0000 7f7645bd5640 1 -- 172.21.15.55:0/3651324335 wait complete. 2024-04-25T08:58:01.377 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:58:01.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.492+0000 7f6433970640 1 Processor -- start 2024-04-25T08:58:01.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.492+0000 7f6433970640 1 -- start start 2024-04-25T08:58:01.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6433970640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f642c0d3b90 0x7f642c0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6433970640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c0d4090 con 0x7f642c15dca0 2024-04-25T08:58:01.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6433970640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c0d4370 con 0x7f642c0d0f60 2024-04-25T08:58:01.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6433970640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642c0b6b20 con 0x7f642c0d3b90 2024-04-25T08:58:01.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f643170c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f642c15dca0 0x7f642c0ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46560/0 (socket says 172.21.15.55:46560) 2024-04-25T08:58:01.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f643170c640 1 -- 172.21.15.55:0/3319680149 learned_addr learned my addr 172.21.15.55:0/3319680149 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6430f0b640 1 --2- 172.21.15.55:0/3319680149 >> v2:172.21.15.167:3300/0 conn(0x7f642c0d3b90 0x7f642c0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181468106 0 0) 0x7f642c0d4090 con 0x7f642c15dca0 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6418003520 con 0x7f642c15dca0 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1227781207 0 0) 0x7f6418003520 con 0x7f642c15dca0 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 >> v2:172.21.15.167:3300/0 conn(0x7f642c0d3b90 msgr2=0x7f642c0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6423fff640 1 --2- 172.21.15.55:0/3319680149 >> v2:172.21.15.167:3300/0 conn(0x7f642c0d3b90 0x7f642c0d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 >> v1:172.21.15.167:6789/0 conn(0x7f642c0d0f60 legacy=0x7f642c0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c0d4650 con 0x7f642c15dca0 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f6428001670 con 0x7f642c15dca0 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 >> v1:172.21.15.55:6789/0 conn(0x7f642c15dca0 legacy=0x7f642c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6423fff640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64180039b0 0x7f6418003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.493+0000 7f6423fff640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6418004800 0x7f6418004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6423fff640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 0x7f641800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641800c030 con 0x7f64180051c0 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641800c1e0 con 0x7f6418004800 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641800c3e0 con 0x7f64180039b0 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f643170c640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64180039b0 0x7f6418003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6430f0b640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6418004800 0x7f6418004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6431f0d640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 0x7f641800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6431f0d640 1 -- 172.21.15.55:0/3319680149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64180039b0 msgr2=0x7f6418003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6431f0d640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64180039b0 0x7f6418003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6431f0d640 1 -- 172.21.15.55:0/3319680149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6418004800 msgr2=0x7f6418004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6431f0d640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6418004800 0x7f6418004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6431f0d640 1 -- 172.21.15.55:0/3319680149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6418003520 con 0x7f64180051c0 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.494+0000 7f6430f0b640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6418004800 0x7f6418004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.495+0000 7f6431f0d640 1 -- 172.21.15.55:0/3319680149 reap_dead start 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.495+0000 7f6431f0d640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 0x7f641800b9c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6424001e50 tx=0x7f6418005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea638972b04b30b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.495+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c009690 con 0x7f64180051c0 2024-04-25T08:58:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.495+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6424003970 con 0x7f64180051c0 2024-04-25T08:58:01.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.495+0000 7f6423fff640 1 -- 172.21.15.55:0/3319680149 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424001a70 con 0x7f64180051c0 2024-04-25T08:58:01.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.495+0000 7f6433970640 1 -- 172.21.15.55:0/3319680149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 msgr2=0x7f641800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.495+0000 7f6433970640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 0x7f641800b9c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6424001e50 tx=0x7f6418005830 comp rx=0 tx=0).stop 2024-04-25T08:58:01.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.495+0000 7f6433970640 1 -- 172.21.15.55:0/3319680149 shutdown_connections 2024-04-25T08:58:01.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.495+0000 7f6433970640 1 --2- 172.21.15.55:0/3319680149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 0x7f641800b9c0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.495+0000 7f6433970640 1 -- 172.21.15.55:0/3319680149 >> 172.21.15.55:0/3319680149 conn(0x7f642c0726c0 msgr2=0x7f642c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:01.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.496+0000 7f6433970640 1 -- 172.21.15.55:0/3319680149 shutdown_connections 2024-04-25T08:58:01.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.496+0000 7f6433970640 1 -- 172.21.15.55:0/3319680149 wait complete. 2024-04-25T08:58:01.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.497+0000 7f6433970640 1 Processor -- start 2024-04-25T08:58:01.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.497+0000 7f6433970640 1 -- start start 2024-04-25T08:58:01.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.497+0000 7f6433970640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 0x7f642c1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.497+0000 7f6433970640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f642c0cb9c0 0x7f642c158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.497+0000 7f6433970640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f642c159460 0x7f642c0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.497+0000 7f6433970640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c15e080 con 0x7f64180051c0 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.497+0000 7f6433970640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c0d1390 con 0x7f642c0cb9c0 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.497+0000 7f6433970640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c15e200 con 0x7f642c159460 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f643170c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 0x7f642c1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f643170c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 0x7f642c1560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49980/0 (socket says 172.21.15.55:49980) 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f643170c640 1 -- 172.21.15.55:0/2797709366 learned_addr learned my addr 172.21.15.55:0/2797709366 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f643170c640 1 -- 172.21.15.55:0/2797709366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f642c159460 msgr2=0x7f642c0b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f6431f0d640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f642c159460 0x7f642c0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f6430f0b640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f642c0cb9c0 0x7f642c158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f643170c640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f642c159460 0x7f642c0b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f643170c640 1 -- 172.21.15.55:0/2797709366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f642c0cb9c0 msgr2=0x7f642c158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f643170c640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f642c0cb9c0 0x7f642c158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f643170c640 1 -- 172.21.15.55:0/2797709366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c0cbe50 con 0x7f64180051c0 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f643170c640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 0x7f642c1560e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6428007370 tx=0x7f6428007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f6421ffb640 1 -- 172.21.15.55:0/2797709366 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642801a070 con 0x7f64180051c0 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f6421ffb640 1 -- 172.21.15.55:0/2797709366 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642800f9c0 con 0x7f64180051c0 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f6433970640 1 -- 172.21.15.55:0/2797709366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642c0cc130 con 0x7f64180051c0 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f6421ffb640 1 -- 172.21.15.55:0/2797709366 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642800fd90 con 0x7f64180051c0 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.498+0000 7f6433970640 1 -- 172.21.15.55:0/2797709366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642c158770 con 0x7f64180051c0 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.500+0000 7f6433970640 1 -- 172.21.15.55:0/2797709366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642c0750b0 con 0x7f64180051c0 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.500+0000 7f6421ffb640 1 -- 172.21.15.55:0/2797709366 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f642801d070 con 0x7f64180051c0 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.500+0000 7f6421ffb640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f641006b4d0 0x7f641006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.500+0000 7f6430f0b640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f641006b4d0 0x7f641006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.500+0000 7f6421ffb640 1 -- 172.21.15.55:0/2797709366 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6428089b90 con 0x7f64180051c0 2024-04-25T08:58:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.501+0000 7f6430f0b640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f641006b4d0 0x7f641006d990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f642c156620 tx=0x7f641c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.504+0000 7f6421ffb640 1 -- 172.21.15.55:0/2797709366 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6428058ad0 con 0x7f64180051c0 2024-04-25T08:58:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.685+0000 7f6433970640 1 -- 172.21.15.55:0/2797709366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f642c0d2710 con 0x7f64180051c0 2024-04-25T08:58:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.685+0000 7f6421ffb640 1 -- 172.21.15.55:0/2797709366 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64280583d0 con 0x7f64180051c0 2024-04-25T08:58:01.675 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:58:01.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 -- 172.21.15.55:0/2797709366 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f641006b4d0 msgr2=0x7f641006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f641006b4d0 0x7f641006d990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f642c156620 tx=0x7f641c008040 comp rx=0 tx=0).stop 2024-04-25T08:58:01.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 -- 172.21.15.55:0/2797709366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 msgr2=0x7f642c1560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 0x7f642c1560e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6428007370 tx=0x7f6428007830 comp rx=0 tx=0).stop 2024-04-25T08:58:01.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 -- 172.21.15.55:0/2797709366 shutdown_connections 2024-04-25T08:58:01.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f641006b4d0 0x7f641006d990 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f642c159460 0x7f642c0b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f642c0cb9c0 0x7f642c158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 --2- 172.21.15.55:0/2797709366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64180051c0 0x7f642c1560e0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 -- 172.21.15.55:0/2797709366 >> 172.21.15.55:0/2797709366 conn(0x7f642c0726c0 msgr2=0x7f642c0ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:01.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 -- 172.21.15.55:0/2797709366 shutdown_connections 2024-04-25T08:58:01.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.688+0000 7f6433970640 1 -- 172.21.15.55:0/2797709366 wait complete. 2024-04-25T08:58:01.688 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:58:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.802+0000 7ff87cf96640 1 Processor -- start 2024-04-25T08:58:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.802+0000 7ff87cf96640 1 -- start start 2024-04-25T08:58:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.803+0000 7ff87cf96640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff87815dc80 0x7ff878161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.803+0000 7ff87cf96640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff8780b97c0 0x7ff8780b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.803+0000 7ff87cf96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8780b5a30 0x7ff87806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.803+0000 7ff87cf96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8780b5ea0 con 0x7ff8780b5a30 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.803+0000 7ff87cf96640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8781627a0 con 0x7ff8780b97c0 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.803+0000 7ff87cf96640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8781621e0 con 0x7ff87815dc80 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.803+0000 7ff876d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8780b5a30 0x7ff87806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.803+0000 7ff876d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8780b5a30 0x7ff87806bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49990/0 (socket says 172.21.15.55:49990) 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.803+0000 7ff876d9d640 1 -- 172.21.15.55:0/25146662 learned_addr learned my addr 172.21.15.55:0/25146662 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.804+0000 7ff875d9b640 1 --2- 172.21.15.55:0/25146662 >> v2:172.21.15.167:3300/0 conn(0x7ff8780b97c0 0x7ff8780b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.804+0000 7ff87659c640 1 --2- 172.21.15.55:0/25146662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff87815dc80 0x7ff878161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.804+0000 7ff876d9d640 1 -- 172.21.15.55:0/25146662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff87815dc80 msgr2=0x7ff878161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.804+0000 7ff876d9d640 1 --2- 172.21.15.55:0/25146662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff87815dc80 0x7ff878161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.804+0000 7ff876d9d640 1 -- 172.21.15.55:0/25146662 >> v2:172.21.15.167:3300/0 conn(0x7ff8780b97c0 msgr2=0x7ff8780b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.804+0000 7ff876d9d640 1 --2- 172.21.15.55:0/25146662 >> v2:172.21.15.167:3300/0 conn(0x7ff8780b97c0 0x7ff8780b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.804+0000 7ff876d9d640 1 -- 172.21.15.55:0/25146662 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8781624c0 con 0x7ff8780b5a30 2024-04-25T08:58:01.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.804+0000 7ff876d9d640 1 --2- 172.21.15.55:0/25146662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8780b5a30 0x7ff87806bff0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff87806d9c0 tx=0x7ff86802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4da8a055c0a572 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:01.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87559a640 1 -- 172.21.15.55:0/25146662 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868036070 con 0x7ff8780b5a30 2024-04-25T08:58:01.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87559a640 1 -- 172.21.15.55:0/25146662 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868031600 con 0x7ff8780b5a30 2024-04-25T08:58:01.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87559a640 1 -- 172.21.15.55:0/25146662 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8680319d0 con 0x7ff8780b5a30 2024-04-25T08:58:01.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87cf96640 1 -- 172.21.15.55:0/25146662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8780b5a30 msgr2=0x7ff87806bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87cf96640 1 --2- 172.21.15.55:0/25146662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8780b5a30 0x7ff87806bff0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff87806d9c0 tx=0x7ff86802a6a0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87cf96640 1 -- 172.21.15.55:0/25146662 shutdown_connections 2024-04-25T08:58:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87cf96640 1 --2- 172.21.15.55:0/25146662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8780b5a30 0x7ff87806bff0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87cf96640 1 --2- 172.21.15.55:0/25146662 >> v2:172.21.15.167:3300/0 conn(0x7ff8780b97c0 0x7ff8780b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87cf96640 1 --2- 172.21.15.55:0/25146662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff87815dc80 0x7ff878161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87cf96640 1 -- 172.21.15.55:0/25146662 >> 172.21.15.55:0/25146662 conn(0x7ff8780d04f0 msgr2=0x7ff8780d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87cf96640 1 -- 172.21.15.55:0/25146662 shutdown_connections 2024-04-25T08:58:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.805+0000 7ff87cf96640 1 -- 172.21.15.55:0/25146662 wait complete. 2024-04-25T08:58:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.807+0000 7ff87cf96640 1 Processor -- start 2024-04-25T08:58:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.807+0000 7ff87cf96640 1 -- start start 2024-04-25T08:58:01.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.807+0000 7ff87cf96640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8780b5a30 0x7ff87814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.807+0000 7ff87cf96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8780b97c0 0x7ff8780b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.807+0000 7ff87cf96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815dc80 0x7ff8780b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.807+0000 7ff87cf96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff878161db0 con 0x7ff87815dc80 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.807+0000 7ff87cf96640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87815e060 con 0x7ff8780b97c0 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.807+0000 7ff87cf96640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff878161f30 con 0x7ff8780b5a30 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.807+0000 7ff876d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815dc80 0x7ff8780b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.807+0000 7ff876d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815dc80 0x7ff8780b7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50000/0 (socket says 172.21.15.55:50000) 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.807+0000 7ff876d9d640 1 -- 172.21.15.55:0/234092193 learned_addr learned my addr 172.21.15.55:0/234092193 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff87659c640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8780b5a30 0x7ff87814fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff875d9b640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8780b97c0 0x7ff8780b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff876d9d640 1 -- 172.21.15.55:0/234092193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8780b5a30 msgr2=0x7ff87814fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff876d9d640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8780b5a30 0x7ff87814fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff876d9d640 1 -- 172.21.15.55:0/234092193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8780b97c0 msgr2=0x7ff8780b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff876d9d640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8780b97c0 0x7ff8780b76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff876d9d640 1 -- 172.21.15.55:0/234092193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8781502e0 con 0x7ff87815dc80 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff87659c640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8780b5a30 0x7ff87814fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff875d9b640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8780b97c0 0x7ff8780b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff876d9d640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815dc80 0x7ff8780b7c10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff868009f40 tx=0x7ff868004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff86effd640 1 -- 172.21.15.55:0/234092193 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868036050 con 0x7ff87815dc80 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff86effd640 1 -- 172.21.15.55:0/234092193 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868042070 con 0x7ff87815dc80 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff87cf96640 1 -- 172.21.15.55:0/234092193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87815eef0 con 0x7ff87815dc80 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff86effd640 1 -- 172.21.15.55:0/234092193 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868009510 con 0x7ff87815dc80 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.808+0000 7ff87cf96640 1 -- 172.21.15.55:0/234092193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87815f4b0 con 0x7ff87815dc80 2024-04-25T08:58:01.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.809+0000 7ff87cf96640 1 -- 172.21.15.55:0/234092193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8780750b0 con 0x7ff87815dc80 2024-04-25T08:58:01.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.810+0000 7ff86effd640 1 -- 172.21.15.55:0/234092193 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff868007bd0 con 0x7ff87815dc80 2024-04-25T08:58:01.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.810+0000 7ff86effd640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff85806b4d0 0x7ff85806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:01.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.810+0000 7ff86effd640 1 -- 172.21.15.55:0/234092193 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8680ab080 con 0x7ff87815dc80 2024-04-25T08:58:01.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.810+0000 7ff87659c640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff85806b4d0 0x7ff85806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:01.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.810+0000 7ff87659c640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff85806b4d0 0x7ff85806d990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff870006fd0 tx=0x7ff870008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:01.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.814+0000 7ff86effd640 1 -- 172.21.15.55:0/234092193 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff868079f10 con 0x7ff87815dc80 2024-04-25T08:58:01.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.996+0000 7ff87cf96640 1 -- 172.21.15.55:0/234092193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8780d1780 con 0x7ff87815dc80 2024-04-25T08:58:01.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.997+0000 7ff86effd640 1 -- 172.21.15.55:0/234092193 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff868079810 con 0x7ff87815dc80 2024-04-25T08:58:01.986 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 -- 172.21.15.55:0/234092193 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff85806b4d0 msgr2=0x7ff85806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff85806b4d0 0x7ff85806d990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff870006fd0 tx=0x7ff870008040 comp rx=0 tx=0).stop 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 -- 172.21.15.55:0/234092193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815dc80 msgr2=0x7ff8780b7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815dc80 0x7ff8780b7c10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff868009f40 tx=0x7ff868004a40 comp rx=0 tx=0).stop 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 -- 172.21.15.55:0/234092193 shutdown_connections 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff85806b4d0 0x7ff85806d990 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815dc80 0x7ff8780b7c10 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8780b97c0 0x7ff8780b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 --2- 172.21.15.55:0/234092193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8780b5a30 0x7ff87814fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 -- 172.21.15.55:0/234092193 >> 172.21.15.55:0/234092193 conn(0x7ff8780d04f0 msgr2=0x7ff8780c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 -- 172.21.15.55:0/234092193 shutdown_connections 2024-04-25T08:58:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:01.999+0000 7ff87cf96640 1 -- 172.21.15.55:0/234092193 wait complete. 2024-04-25T08:58:01.999 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:58:02.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.111+0000 7fa440ce1640 1 Processor -- start 2024-04-25T08:58:02.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.111+0000 7fa440ce1640 1 -- start start 2024-04-25T08:58:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.112+0000 7fa440ce1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa43c145550 0x7fa43c06ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.112+0000 7fa440ce1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa43c0cacc0 0x7fa43c0cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.112+0000 7fa440ce1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c0cdc60 con 0x7fa43c06bfb0 2024-04-25T08:58:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.112+0000 7fa440ce1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c06c540 con 0x7fa43c0cacc0 2024-04-25T08:58:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.112+0000 7fa440ce1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0cdf40 con 0x7fa43c145550 2024-04-25T08:58:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.112+0000 7fa43ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa43c0cacc0 0x7fa43c0cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.112+0000 7fa43ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa43c0cacc0 0x7fa43c0cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50002/0 (socket says 172.21.15.55:50002) 2024-04-25T08:58:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.112+0000 7fa43ad9d640 1 -- 172.21.15.55:0/445444200 learned_addr learned my addr 172.21.15.55:0/445444200 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.112+0000 7fa43a59c640 1 --2- 172.21.15.55:0/445444200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa43c145550 0x7fa43c06ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.113+0000 7fa43ad9d640 1 -- 172.21.15.55:0/445444200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa43c145550 msgr2=0x7fa43c06ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.113+0000 7fa43ad9d640 1 --2- 172.21.15.55:0/445444200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa43c145550 0x7fa43c06ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.113+0000 7fa43ad9d640 1 -- 172.21.15.55:0/445444200 >> v1:172.21.15.167:6789/0 conn(0x7fa43c06bfb0 legacy=0x7fa43c0ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.113+0000 7fa43ad9d640 1 -- 172.21.15.55:0/445444200 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c0ce220 con 0x7fa43c0cacc0 2024-04-25T08:58:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.113+0000 7fa43ad9d640 1 --2- 172.21.15.55:0/445444200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43c0cacc0 0x7fa43c0cea20 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009e50 tx=0x7fa42c02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb1fc8a5daf9a5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.113+0000 7fa43959a640 1 -- 172.21.15.55:0/445444200 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c036070 con 0x7fa43c0cacc0 2024-04-25T08:58:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.113+0000 7fa43959a640 1 -- 172.21.15.55:0/445444200 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c031600 con 0x7fa43c0cacc0 2024-04-25T08:58:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.114+0000 7fa43959a640 1 -- 172.21.15.55:0/445444200 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0319d0 con 0x7fa43c0cacc0 2024-04-25T08:58:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.114+0000 7fa440ce1640 1 -- 172.21.15.55:0/445444200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43c0cacc0 msgr2=0x7fa43c0cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.114+0000 7fa440ce1640 1 --2- 172.21.15.55:0/445444200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43c0cacc0 0x7fa43c0cea20 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009e50 tx=0x7fa42c02a630 comp rx=0 tx=0).stop 2024-04-25T08:58:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.114+0000 7fa440ce1640 1 -- 172.21.15.55:0/445444200 shutdown_connections 2024-04-25T08:58:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.114+0000 7fa440ce1640 1 --2- 172.21.15.55:0/445444200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43c0cacc0 0x7fa43c0cea20 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.114+0000 7fa440ce1640 1 --2- 172.21.15.55:0/445444200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa43c145550 0x7fa43c06ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.114+0000 7fa440ce1640 1 -- 172.21.15.55:0/445444200 >> 172.21.15.55:0/445444200 conn(0x7fa43c0cc9e0 msgr2=0x7fa43c0ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:02.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.114+0000 7fa440ce1640 1 -- 172.21.15.55:0/445444200 shutdown_connections 2024-04-25T08:58:02.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.114+0000 7fa440ce1640 1 -- 172.21.15.55:0/445444200 wait complete. 2024-04-25T08:58:02.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.115+0000 7fa440ce1640 1 Processor -- start 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.115+0000 7fa440ce1640 1 -- start start 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.116+0000 7fa440ce1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa43c06bfb0 0x7fa43c06e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.116+0000 7fa440ce1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa43c0cacc0 0x7fa43c1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.116+0000 7fa440ce1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43c145550 0x7fa43c15d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.116+0000 7fa440ce1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0acdf0 con 0x7fa43c145550 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.116+0000 7fa440ce1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c06adc0 con 0x7fa43c0cacc0 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.116+0000 7fa440ce1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0acf70 con 0x7fa43c06bfb0 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.116+0000 7fa43ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43c145550 0x7fa43c15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.116+0000 7fa43ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43c145550 0x7fa43c15d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50016/0 (socket says 172.21.15.55:50016) 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.116+0000 7fa43ad9d640 1 -- 172.21.15.55:0/4282281809 learned_addr learned my addr 172.21.15.55:0/4282281809 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa43a59c640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa43c06bfb0 0x7fa43c06e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.116+0000 7fa439d9b640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa43c0cacc0 0x7fa43c1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa43ad9d640 1 -- 172.21.15.55:0/4282281809 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa43c06bfb0 msgr2=0x7fa43c06e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa43ad9d640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa43c06bfb0 0x7fa43c06e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa43ad9d640 1 -- 172.21.15.55:0/4282281809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa43c0cacc0 msgr2=0x7fa43c1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:02.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa43ad9d640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa43c0cacc0 0x7fa43c1584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa43ad9d640 1 -- 172.21.15.55:0/4282281809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c15d9d0 con 0x7fa43c145550 2024-04-25T08:58:02.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa43ad9d640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43c145550 0x7fa43c15d180 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009f70 tx=0x7fa42c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:02.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa42affd640 1 -- 172.21.15.55:0/4282281809 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c03f020 con 0x7fa43c145550 2024-04-25T08:58:02.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa42affd640 1 -- 172.21.15.55:0/4282281809 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c037040 con 0x7fa43c145550 2024-04-25T08:58:02.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa42affd640 1 -- 172.21.15.55:0/4282281809 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c036070 con 0x7fa43c145550 2024-04-25T08:58:02.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa440ce1640 1 -- 172.21.15.55:0/4282281809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c15dcb0 con 0x7fa43c145550 2024-04-25T08:58:02.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.117+0000 7fa440ce1640 1 -- 172.21.15.55:0/4282281809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c15e270 con 0x7fa43c145550 2024-04-25T08:58:02.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.118+0000 7fa440ce1640 1 -- 172.21.15.55:0/4282281809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c0750b0 con 0x7fa43c145550 2024-04-25T08:58:02.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.118+0000 7fa42affd640 1 -- 172.21.15.55:0/4282281809 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa42c042020 con 0x7fa43c145550 2024-04-25T08:58:02.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.119+0000 7fa42affd640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa41c06b4d0 0x7fa41c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.119+0000 7fa42affd640 1 -- 172.21.15.55:0/4282281809 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa42c0aa630 con 0x7fa43c145550 2024-04-25T08:58:02.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.119+0000 7fa43a59c640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa41c06b4d0 0x7fa41c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.119+0000 7fa43a59c640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa41c06b4d0 0x7fa41c06d990 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa434006fd0 tx=0x7fa434008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:02.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.123+0000 7fa42affd640 1 -- 172.21.15.55:0/4282281809 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa42c049030 con 0x7fa43c145550 2024-04-25T08:58:02.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.316+0000 7fa440ce1640 1 -- 172.21.15.55:0/4282281809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa43c066e60 con 0x7fa43c145550 2024-04-25T08:58:02.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.316+0000 7fa42affd640 1 -- 172.21.15.55:0/4282281809 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa42c078ef0 con 0x7fa43c145550 2024-04-25T08:58:02.305 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T08:58:02.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 -- 172.21.15.55:0/4282281809 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa41c06b4d0 msgr2=0x7fa41c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:02.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa41c06b4d0 0x7fa41c06d990 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa434006fd0 tx=0x7fa434008040 comp rx=0 tx=0).stop 2024-04-25T08:58:02.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 -- 172.21.15.55:0/4282281809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43c145550 msgr2=0x7fa43c15d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:02.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43c145550 0x7fa43c15d180 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009f70 tx=0x7fa42c004a40 comp rx=0 tx=0).stop 2024-04-25T08:58:02.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 -- 172.21.15.55:0/4282281809 shutdown_connections 2024-04-25T08:58:02.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa41c06b4d0 0x7fa41c06d990 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43c145550 0x7fa43c15d180 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa43c0cacc0 0x7fa43c1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 --2- 172.21.15.55:0/4282281809 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa43c06bfb0 0x7fa43c06e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 -- 172.21.15.55:0/4282281809 >> 172.21.15.55:0/4282281809 conn(0x7fa43c0cc9e0 msgr2=0x7fa43c0aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 -- 172.21.15.55:0/4282281809 shutdown_connections 2024-04-25T08:58:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.318+0000 7fa440ce1640 1 -- 172.21.15.55:0/4282281809 wait complete. 2024-04-25T08:58:02.318 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:58:02.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:02.318 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:58:02.364 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:58:02.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:02.364 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:58:02.389 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:58:02.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.541+0000 7f66364ee640 1 Processor -- start 2024-04-25T08:58:02.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.541+0000 7f66364ee640 1 -- start start 2024-04-25T08:58:02.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f66364ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f663015df40 0x7f66300cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f66364ee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66300b19c0 0x7f66300cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f66364ee640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66300cd930 con 0x7f66300cfe80 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f66364ee640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66300cc5b0 con 0x7f66300b19c0 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f66364ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66300cdc10 con 0x7f663015df40 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f662f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66300b19c0 0x7f66300cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f662f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66300b19c0 0x7f66300cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50032/0 (socket says 172.21.15.55:50032) 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f662f7fe640 1 -- 172.21.15.55:0/4232748380 learned_addr learned my addr 172.21.15.55:0/4232748380 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f662ffff640 1 --2- 172.21.15.55:0/4232748380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f663015df40 0x7f66300cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f662f7fe640 1 -- 172.21.15.55:0/4232748380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f663015df40 msgr2=0x7f66300cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f662f7fe640 1 --2- 172.21.15.55:0/4232748380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f663015df40 0x7f66300cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f662f7fe640 1 -- 172.21.15.55:0/4232748380 >> v1:172.21.15.167:6789/0 conn(0x7f66300cfe80 legacy=0x7f663006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.542+0000 7f662f7fe640 1 -- 172.21.15.55:0/4232748380 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66300cdef0 con 0x7f66300b19c0 2024-04-25T08:58:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.543+0000 7f662f7fe640 1 --2- 172.21.15.55:0/4232748380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66300b19c0 0x7f66300cf940 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f6620009870 tx=0x7f662002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef25c3bb7442e66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:02.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.543+0000 7f662effd640 1 -- 172.21.15.55:0/4232748380 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620037070 con 0x7f66300b19c0 2024-04-25T08:58:02.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.543+0000 7f662effd640 1 -- 172.21.15.55:0/4232748380 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6620032440 con 0x7f66300b19c0 2024-04-25T08:58:02.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.543+0000 7f662effd640 1 -- 172.21.15.55:0/4232748380 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620032810 con 0x7f66300b19c0 2024-04-25T08:58:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.544+0000 7f66364ee640 1 -- 172.21.15.55:0/4232748380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66300b19c0 msgr2=0x7f66300cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.544+0000 7f66364ee640 1 --2- 172.21.15.55:0/4232748380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66300b19c0 0x7f66300cf940 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f6620009870 tx=0x7f662002a1c0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.544+0000 7f66364ee640 1 -- 172.21.15.55:0/4232748380 shutdown_connections 2024-04-25T08:58:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.544+0000 7f66364ee640 1 --2- 172.21.15.55:0/4232748380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66300b19c0 0x7f66300cf940 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.544+0000 7f66364ee640 1 --2- 172.21.15.55:0/4232748380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f663015df40 0x7f66300cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.544+0000 7f66364ee640 1 -- 172.21.15.55:0/4232748380 >> 172.21.15.55:0/4232748380 conn(0x7f66300d06b0 msgr2=0x7f66300d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.544+0000 7f66364ee640 1 -- 172.21.15.55:0/4232748380 shutdown_connections 2024-04-25T08:58:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.544+0000 7f66364ee640 1 -- 172.21.15.55:0/4232748380 wait complete. 2024-04-25T08:58:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.545+0000 7f66364ee640 1 Processor -- start 2024-04-25T08:58:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.545+0000 7f66364ee640 1 -- start start 2024-04-25T08:58:02.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f66364ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66300b19c0 0x7f66300ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f66364ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66300cfe80 0x7f66300b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f66364ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f663015df40 0x7f66300c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f66364ee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66300d0310 con 0x7f66300cfe80 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f66364ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66300cb080 con 0x7f66300b19c0 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f66364ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66300b1e20 con 0x7f663015df40 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f662f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66300cfe80 0x7f66300b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f662f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66300cfe80 0x7f66300b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50038/0 (socket says 172.21.15.55:50038) 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f662f7fe640 1 -- 172.21.15.55:0/2423964422 learned_addr learned my addr 172.21.15.55:0/2423964422 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f662ffff640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66300b19c0 0x7f66300ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f6634a8b640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f663015df40 0x7f66300c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f662f7fe640 1 -- 172.21.15.55:0/2423964422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f663015df40 msgr2=0x7f66300c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f662f7fe640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f663015df40 0x7f66300c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f662f7fe640 1 -- 172.21.15.55:0/2423964422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66300b19c0 msgr2=0x7f66300ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f662f7fe640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66300b19c0 0x7f66300ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.546+0000 7f662f7fe640 1 -- 172.21.15.55:0/2423964422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66300b39b0 con 0x7f66300cfe80 2024-04-25T08:58:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.547+0000 7f662f7fe640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66300cfe80 0x7f66300b32b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6620000c00 tx=0x7f66200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:02.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.547+0000 7f662cff9640 1 -- 172.21.15.55:0/2423964422 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620037040 con 0x7f66300cfe80 2024-04-25T08:58:02.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.547+0000 7f662cff9640 1 -- 172.21.15.55:0/2423964422 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6620042070 con 0x7f66300cfe80 2024-04-25T08:58:02.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.547+0000 7f66364ee640 1 -- 172.21.15.55:0/2423964422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66300b3c90 con 0x7f66300cfe80 2024-04-25T08:58:02.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.547+0000 7f662cff9640 1 -- 172.21.15.55:0/2423964422 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620030880 con 0x7f66300cfe80 2024-04-25T08:58:02.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.547+0000 7f66364ee640 1 -- 172.21.15.55:0/2423964422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66300b4250 con 0x7f66300cfe80 2024-04-25T08:58:02.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.548+0000 7f66364ee640 1 -- 172.21.15.55:0/2423964422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66300749b0 con 0x7f66300cfe80 2024-04-25T08:58:02.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.548+0000 7f662cff9640 1 -- 172.21.15.55:0/2423964422 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f662002ad10 con 0x7f66300cfe80 2024-04-25T08:58:02.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.549+0000 7f662cff9640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f661c06b500 0x7f661c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:02.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.549+0000 7f662cff9640 1 -- 172.21.15.55:0/2423964422 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66200aa570 con 0x7f66300cfe80 2024-04-25T08:58:02.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.549+0000 7f662ffff640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f661c06b500 0x7f661c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:02.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.549+0000 7f662ffff640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f661c06b500 0x7f661c06d9c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6624009b40 tx=0x7f6624009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:02.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.553+0000 7f662cff9640 1 -- 172.21.15.55:0/2423964422 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6620078d90 con 0x7f66300cfe80 2024-04-25T08:58:02.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.778+0000 7f66364ee640 1 -- 172.21.15.55:0/2423964422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f663006d280 con 0x7f66300cfe80 2024-04-25T08:58:02.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.778+0000 7f662cff9640 1 -- 172.21.15.55:0/2423964422 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4937 (secure 0 0 0) 0x7f66200a8e20 con 0x7f66300cfe80 2024-04-25T08:58:02.768 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:58:02.768 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:57:51.543169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6609":{"gid":6609,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/173615501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":173615501},{"type":"v1","addr":"172.21.15.55:6837","nonce":173615501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:58:02.768 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 36 2024-04-25T08:58:02.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.780+0000 7f66364ee640 1 -- 172.21.15.55:0/2423964422 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f661c06b500 msgr2=0x7f661c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:02.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.780+0000 7f66364ee640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f661c06b500 0x7f661c06d9c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6624009b40 tx=0x7f6624009190 comp rx=0 tx=0).stop 2024-04-25T08:58:02.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.780+0000 7f66364ee640 1 -- 172.21.15.55:0/2423964422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66300cfe80 msgr2=0x7f66300b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:02.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.780+0000 7f66364ee640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66300cfe80 0x7f66300b32b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6620000c00 tx=0x7f66200046c0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.780+0000 7f66364ee640 1 -- 172.21.15.55:0/2423964422 shutdown_connections 2024-04-25T08:58:02.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.780+0000 7f66364ee640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f661c06b500 0x7f661c06d9c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.780+0000 7f66364ee640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f663015df40 0x7f66300c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.780+0000 7f66364ee640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66300cfe80 0x7f66300b32b0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.780+0000 7f66364ee640 1 --2- 172.21.15.55:0/2423964422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66300b19c0 0x7f66300ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:02.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.780+0000 7f66364ee640 1 -- 172.21.15.55:0/2423964422 >> 172.21.15.55:0/2423964422 conn(0x7f66300d06b0 msgr2=0x7f663015bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:02.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.781+0000 7f66364ee640 1 -- 172.21.15.55:0/2423964422 shutdown_connections 2024-04-25T08:58:02.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:02.781+0000 7f66364ee640 1 -- 172.21.15.55:0/2423964422 wait complete. 2024-04-25T08:58:02.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T08:58:02.919 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-25T08:58:02.919 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T08:58:02.920 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:58:03.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.032+0000 7fd903d22640 1 Processor -- start 2024-04-25T08:58:03.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.032+0000 7fd903d22640 1 -- start start 2024-04-25T08:58:03.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.033+0000 7fd903d22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc071590 0x7fd8fc0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.033+0000 7fd903d22640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd8fc0cd940 0x7fd8fc0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.033+0000 7fd903d22640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8fc06c220 con 0x7fd8fc15dc50 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.033+0000 7fd903d22640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0cfe00 con 0x7fd8fc0cd940 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.033+0000 7fd903d22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0cec10 con 0x7fd8fc071590 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.033+0000 7fd901abe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd8fc15dc50 0x7fd8fc070e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46570/0 (socket says 172.21.15.55:46570) 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.033+0000 7fd901abe640 1 -- 172.21.15.55:0/3708887240 learned_addr learned my addr 172.21.15.55:0/3708887240 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.033+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746967976 0 0) 0x7fd8fc06c220 con 0x7fd8fc15dc50 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.033+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8e8003520 con 0x7fd8fc15dc50 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.033+0000 7fd9022bf640 1 --2- 172.21.15.55:0/3708887240 >> v2:172.21.15.167:3300/0 conn(0x7fd8fc0cd940 0x7fd8fc0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.033+0000 7fd9012bd640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc071590 0x7fd8fc0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1693729778 0 0) 0x7fd8e8003520 con 0x7fd8fc15dc50 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc071590 msgr2=0x7fd8fc0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc071590 0x7fd8fc0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 >> v2:172.21.15.167:3300/0 conn(0x7fd8fc0cd940 msgr2=0x7fd8fc0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 --2- 172.21.15.55:0/3708887240 >> v2:172.21.15.167:3300/0 conn(0x7fd8fc0cd940 0x7fd8fc0ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc0d0050 con 0x7fd8fc15dc50 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fd8f8001670 con 0x7fd8fc15dc50 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 >> v1:172.21.15.55:6789/0 conn(0x7fd8fc15dc50 legacy=0x7fd8fc070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc071590 0x7fd8e80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e8003f30 0x7fd8e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8e8004d40 0x7fd8e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0cfe00 con 0x7fd8e8003f30 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0cec10 con 0x7fd8e8004d40 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e800b9c0 con 0x7fd8fc071590 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd9012bd640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e8003f30 0x7fd8e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd901abe640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc071590 0x7fd8e80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd9022bf640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8e8004d40 0x7fd8e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd9012bd640 1 -- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc071590 msgr2=0x7fd8e80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd9012bd640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc071590 0x7fd8e80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd9012bd640 1 -- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8e8004d40 msgr2=0x7fd8e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd9012bd640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8e8004d40 0x7fd8e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd9012bd640 1 -- 172.21.15.55:0/3708887240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e8003520 con 0x7fd8e8003f30 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd901abe640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc071590 0x7fd8e80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.034+0000 7fd9022bf640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8e8004d40 0x7fd8e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.035+0000 7fd9012bd640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e8003f30 0x7fd8e8004800 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009ac0 tx=0x7fd8e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b6ba52662bd76a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.035+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec036070 con 0x7fd8e8003f30 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.035+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec031400 con 0x7fd8e8003f30 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.035+0000 7fd900abc640 1 -- 172.21.15.55:0/3708887240 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec009690 con 0x7fd8e8003f30 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.035+0000 7fd903d22640 1 -- 172.21.15.55:0/3708887240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e8003f30 msgr2=0x7fd8e8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.035+0000 7fd903d22640 1 --2- 172.21.15.55:0/3708887240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e8003f30 0x7fd8e8004800 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009ac0 tx=0x7fd8e8005830 comp rx=0 tx=0).stop 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.035+0000 7fd9022bf640 1 -- 172.21.15.55:0/3708887240 reap_dead start 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.036+0000 7fd903d22640 1 -- 172.21.15.55:0/3708887240 shutdown_connections 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.036+0000 7fd903d22640 1 -- 172.21.15.55:0/3708887240 >> 172.21.15.55:0/3708887240 conn(0x7fd8fc06f430 msgr2=0x7fd8fc06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.036+0000 7fd903d22640 1 -- 172.21.15.55:0/3708887240 shutdown_connections 2024-04-25T08:58:03.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.036+0000 7fd903d22640 1 -- 172.21.15.55:0/3708887240 wait complete. 2024-04-25T08:58:03.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.037+0000 7fd903d22640 1 Processor -- start 2024-04-25T08:58:03.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.037+0000 7fd903d22640 1 -- start start 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.037+0000 7fd903d22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8e8003f30 0x7fd8fc0b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.037+0000 7fd903d22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8fc160f20 0x7fd8fc0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.037+0000 7fd903d22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc0b64c0 0x7fd8fc0b6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.037+0000 7fd903d22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0ce8a0 con 0x7fd8fc160f20 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.037+0000 7fd903d22640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0cc0c0 con 0x7fd8e8003f30 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.037+0000 7fd903d22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc15e030 con 0x7fd8fc0b64c0 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd9012bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8fc160f20 0x7fd8fc0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd9012bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8fc160f20 0x7fd8fc0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50054/0 (socket says 172.21.15.55:50054) 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd9012bd640 1 -- 172.21.15.55:0/1976554593 learned_addr learned my addr 172.21.15.55:0/1976554593 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd901abe640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8e8003f30 0x7fd8fc0b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd9022bf640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc0b64c0 0x7fd8fc0b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd9012bd640 1 -- 172.21.15.55:0/1976554593 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc0b64c0 msgr2=0x7fd8fc0b6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd9012bd640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc0b64c0 0x7fd8fc0b6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd9012bd640 1 -- 172.21.15.55:0/1976554593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8e8003f30 msgr2=0x7fd8fc0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd9012bd640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8e8003f30 0x7fd8fc0b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd9012bd640 1 -- 172.21.15.55:0/1976554593 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc0b6e80 con 0x7fd8fc160f20 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd901abe640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8e8003f30 0x7fd8fc0b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd9012bd640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8fc160f20 0x7fd8fc0b5f80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0099e0 tx=0x7fd8ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd8f27fc640 1 -- 172.21.15.55:0/1976554593 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec040020 con 0x7fd8fc160f20 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd8f27fc640 1 -- 172.21.15.55:0/1976554593 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec003c40 con 0x7fd8fc160f20 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd903d22640 1 -- 172.21.15.55:0/1976554593 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc0c9800 con 0x7fd8fc160f20 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd8f27fc640 1 -- 172.21.15.55:0/1976554593 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec036040 con 0x7fd8fc160f20 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.038+0000 7fd903d22640 1 -- 172.21.15.55:0/1976554593 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc0c9dc0 con 0x7fd8fc160f20 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.039+0000 7fd903d22640 1 -- 172.21.15.55:0/1976554593 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8fc0750b0 con 0x7fd8fc160f20 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.040+0000 7fd8f27fc640 1 -- 172.21.15.55:0/1976554593 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd8ec043020 con 0x7fd8fc160f20 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.040+0000 7fd8f27fc640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8e006b4d0 0x7fd8e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.040+0000 7fd8f27fc640 1 -- 172.21.15.55:0/1976554593 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8ec0aa1c0 con 0x7fd8fc160f20 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.040+0000 7fd901abe640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8e006b4d0 0x7fd8e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.041+0000 7fd901abe640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8e006b4d0 0x7fd8e006d990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8005b90 tx=0x7fd8f8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:03.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.044+0000 7fd8f27fc640 1 -- 172.21.15.55:0/1976554593 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd8ec04a070 con 0x7fd8fc160f20 2024-04-25T08:58:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.266+0000 7fd903d22640 1 -- 172.21.15.55:0/1976554593 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd8fc0008d0 con 0x7fd8fc160f20 2024-04-25T08:58:03.259 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T08:58:03.267+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:58:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.268+0000 7fd8f27fc640 1 -- 172.21.15.55:0/1976554593 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd8ec0044e0 con 0x7fd8fc160f20 2024-04-25T08:58:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:58:03.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 -- 172.21.15.55:0/1976554593 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8e006b4d0 msgr2=0x7fd8e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8e006b4d0 0x7fd8e006d990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8005b90 tx=0x7fd8f8009040 comp rx=0 tx=0).stop 2024-04-25T08:58:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 -- 172.21.15.55:0/1976554593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8fc160f20 msgr2=0x7fd8fc0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8fc160f20 0x7fd8fc0b5f80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0099e0 tx=0x7fd8ec004730 comp rx=0 tx=0).stop 2024-04-25T08:58:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 -- 172.21.15.55:0/1976554593 shutdown_connections 2024-04-25T08:58:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8e006b4d0 0x7fd8e006d990 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8fc0b64c0 0x7fd8fc0b6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8fc160f20 0x7fd8fc0b5f80 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 --2- 172.21.15.55:0/1976554593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8e8003f30 0x7fd8fc0b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 -- 172.21.15.55:0/1976554593 >> 172.21.15.55:0/1976554593 conn(0x7fd8fc06f430 msgr2=0x7fd8fc06cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 -- 172.21.15.55:0/1976554593 shutdown_connections 2024-04-25T08:58:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.271+0000 7fd903d22640 1 -- 172.21.15.55:0/1976554593 wait complete. 2024-04-25T08:58:03.262 INFO:tasks.ceph.mds.c.smithi055.stderr: -4415> 2024-04-25T08:57:55.821+0000 7ff3eb63b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:58:03.272 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T08:58:03.291 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T08:58:03.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.327+0000 7fb7af439f40 1 Processor -- start 2024-04-25T08:58:03.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.327+0000 7fb7af439f40 1 -- start start 2024-04-25T08:58:03.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7af439f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c29f4bb880 0x55c29f5529d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7af439f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c29f55eb60 0x55c29f55b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7af439f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f5615e0 0x55c29f563020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7af439f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29f562860 con 0x55c29f5615e0 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7af439f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29f432df0 con 0x55c29f4bb880 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7af439f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c29f5629e0 con 0x55c29f55eb60 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7ad73b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f5615e0 0x55c29f563020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7ad73b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f5615e0 0x55c29f563020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50108/0 (socket says 172.21.15.55:50108) 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7ad73b640 1 -- 172.21.15.55:0/519367202 learned_addr learned my addr 172.21.15.55:0/519367202 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7ad73b640 1 -- 172.21.15.55:0/519367202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c29f55eb60 msgr2=0x55c29f55b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7ad73b640 1 --2- 172.21.15.55:0/519367202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c29f55eb60 0x55c29f55b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7ad73b640 1 -- 172.21.15.55:0/519367202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c29f4bb880 msgr2=0x55c29f5529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7acf3a640 1 --2- 172.21.15.55:0/519367202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c29f4bb880 0x55c29f5529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7ad73b640 1 --2- 172.21.15.55:0/519367202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c29f4bb880 0x55c29f5529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7ad73b640 1 -- 172.21.15.55:0/519367202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c29f3b8c50 con 0x55c29f5615e0 2024-04-25T08:58:03.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.328+0000 7fb7acf3a640 1 --2- 172.21.15.55:0/519367202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c29f4bb880 0x55c29f5529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7ad73b640 1 --2- 172.21.15.55:0/519367202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f5615e0 0x55c29f563020 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4001620 tx=0x7fb7a4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82ffbd92bc29807 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7ab737640 1 -- 172.21.15.55:0/519367202 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4004520 con 0x55c29f5615e0 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7ab737640 1 -- 172.21.15.55:0/519367202 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a40046c0 con 0x55c29f5615e0 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7ab737640 1 -- 172.21.15.55:0/519367202 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4004a70 con 0x55c29f5615e0 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7af439f40 1 -- 172.21.15.55:0/519367202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f5615e0 msgr2=0x55c29f563020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7af439f40 1 --2- 172.21.15.55:0/519367202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f5615e0 0x55c29f563020 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4001620 tx=0x7fb7a4001ae0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7af439f40 1 -- 172.21.15.55:0/519367202 shutdown_connections 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7af439f40 1 --2- 172.21.15.55:0/519367202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f5615e0 0x55c29f563020 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7af439f40 1 --2- 172.21.15.55:0/519367202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c29f55eb60 0x55c29f55b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7af439f40 1 --2- 172.21.15.55:0/519367202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c29f4bb880 0x55c29f5529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7af439f40 1 -- 172.21.15.55:0/519367202 >> 172.21.15.55:0/519367202 conn(0x55c29f4b63d0 msgr2=0x55c29f4b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7af439f40 1 -- 172.21.15.55:0/519367202 shutdown_connections 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.329+0000 7fb7af439f40 1 -- 172.21.15.55:0/519367202 wait complete. 2024-04-25T08:58:03.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.330+0000 7fb7af439f40 1 Processor -- start 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.330+0000 7fb7af439f40 1 -- start start 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7af439f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c29f4bb880 0x55c29f550c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7af439f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f55eb60 0x55c29f563090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7af439f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c29f5615e0 0x55c29f551800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7af439f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29f48e530 con 0x55c29f55eb60 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7af439f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29f55e030 con 0x55c29f5615e0 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7af439f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c29f563ae0 con 0x55c29f4bb880 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7ac739640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f55eb60 0x55c29f563090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7ac739640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f55eb60 0x55c29f563090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50110/0 (socket says 172.21.15.55:50110) 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7ac739640 1 -- 172.21.15.55:0/963553771 learned_addr learned my addr 172.21.15.55:0/963553771 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7acf3a640 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c29f4bb880 0x55c29f550c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7ad73b640 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c29f5615e0 0x55c29f551800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7ac739640 1 -- 172.21.15.55:0/963553771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c29f4bb880 msgr2=0x55c29f550c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7ac739640 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c29f4bb880 0x55c29f550c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7ac739640 1 -- 172.21.15.55:0/963553771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c29f5615e0 msgr2=0x55c29f551800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7ac739640 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c29f5615e0 0x55c29f551800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7ac739640 1 -- 172.21.15.55:0/963553771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c29f556610 con 0x55c29f55eb60 2024-04-25T08:58:03.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7ac739640 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f55eb60 0x55c29f563090 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb79c009d80 tx=0x7fb79c006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:03.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.331+0000 7fb7aa735640 1 -- 172.21.15.55:0/963553771 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c017070 con 0x55c29f55eb60 2024-04-25T08:58:03.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.332+0000 7fb7aa735640 1 -- 172.21.15.55:0/963553771 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c012410 con 0x55c29f55eb60 2024-04-25T08:58:03.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.332+0000 7fb7af439f40 1 -- 172.21.15.55:0/963553771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c29f5568f0 con 0x55c29f55eb60 2024-04-25T08:58:03.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.332+0000 7fb7aa735640 1 -- 172.21.15.55:0/963553771 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c006e60 con 0x55c29f55eb60 2024-04-25T08:58:03.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.332+0000 7fb7af439f40 1 -- 172.21.15.55:0/963553771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c29f556eb0 con 0x55c29f55eb60 2024-04-25T08:58:03.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.333+0000 7fb7aa735640 1 -- 172.21.15.55:0/963553771 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb79c01a070 con 0x55c29f55eb60 2024-04-25T08:58:03.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.333+0000 7fb7aa735640 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb78c069eb0 0x7fb78c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.333+0000 7fb7aa735640 1 -- 172.21.15.55:0/963553771 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb79c087f40 con 0x55c29f55eb60 2024-04-25T08:58:03.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.333+0000 7fb7acf3a640 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb78c069eb0 0x7fb78c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.334+0000 7fb7af439f40 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55c29f55a280 0x55c29f55a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.334+0000 7fb7af439f40 1 -- 172.21.15.55:0/963553771 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v9 -- 0x55c29f55abd0 con 0x55c29f55a280 2024-04-25T08:58:03.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.334+0000 7fb7acf3a640 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb78c069eb0 0x7fb78c06c370 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb794057000 tx=0x7fb794052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:03.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.334+0000 7fb7ad73b640 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55c29f55a280 0x55c29f55a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.334+0000 7fb7ad73b640 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55c29f55a280 0x55c29f55a690 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:03.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7ad73b640 1 -- 172.21.15.55:0/963553771 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v74'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb7a401b040 con 0x55c29f55a280 2024-04-25T08:58:03.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7af439f40 1 -- 172.21.15.55:0/963553771 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55c29f55a280 msgr2=0x55c29f55a690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7af439f40 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55c29f55a280 0x55c29f55a690 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7af439f40 1 -- 172.21.15.55:0/963553771 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb78c069eb0 msgr2=0x7fb78c06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7af439f40 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb78c069eb0 0x7fb78c06c370 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb794057000 tx=0x7fb794052000 comp rx=0 tx=0).stop 2024-04-25T08:58:03.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7af439f40 1 -- 172.21.15.55:0/963553771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f55eb60 msgr2=0x55c29f563090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7af439f40 1 --2- 172.21.15.55:0/963553771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c29f55eb60 0x55c29f563090 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb79c009d80 tx=0x7fb79c006750 comp rx=0 tx=0).stop 2024-04-25T08:58:03.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7ad73b640 1 -- 172.21.15.55:0/963553771 reap_dead start 2024-04-25T08:58:03.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7af439f40 1 -- 172.21.15.55:0/963553771 shutdown_connections 2024-04-25T08:58:03.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7af439f40 1 -- 172.21.15.55:0/963553771 >> 172.21.15.55:0/963553771 conn(0x55c29f4b63d0 msgr2=0x55c29f55ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:03.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7af439f40 1 -- 172.21.15.55:0/963553771 shutdown_connections 2024-04-25T08:58:03.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.336+0000 7fb7af439f40 1 -- 172.21.15.55:0/963553771 wait complete. 2024-04-25T08:58:03.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T08:58:03.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.484+0000 7f8169215640 1 Processor -- start 2024-04-25T08:58:03.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.484+0000 7f8169215640 1 -- start start 2024-04-25T08:58:03.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.485+0000 7f8169215640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f81640b6ce0 0x7f81640cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.485+0000 7f8169215640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 0x7f81640b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.485+0000 7f8169215640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81640cfaa0 con 0x7f81640ce1f0 2024-04-25T08:58:03.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.485+0000 7f8169215640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81640d06b0 con 0x7f81640b6ce0 2024-04-25T08:58:03.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.485+0000 7f8169215640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81640cfd80 con 0x7f81640cc270 2024-04-25T08:58:03.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.485+0000 7f816259c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 0x7f81640b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.485+0000 7f8162d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f81640b6ce0 0x7f81640cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.485+0000 7f816359e640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f81640ce1f0 0x7f81640ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:39024/0 (socket says 172.21.15.55:39024) 2024-04-25T08:58:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.485+0000 7f8162d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f81640b6ce0 0x7f81640cf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:59604/0 (socket says 172.21.15.55:59604) 2024-04-25T08:58:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.485+0000 7f816359e640 1 -- 172.21.15.55:0/2623594247 learned_addr learned my addr 172.21.15.55:0/2623594247 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.485+0000 7f816259c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 0x7f81640b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:53104/0 (socket says 172.21.15.55:53104) 2024-04-25T08:58:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.486+0000 7f8161d9b640 1 -- 172.21.15.55:0/2623594247 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809932835 0 0) 0x7f81640cfaa0 con 0x7f81640ce1f0 2024-04-25T08:58:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.486+0000 7f816259c640 1 -- 172.21.15.55:0/2623594247 >> v2:172.21.15.167:3300/0 conn(0x7f81640b6ce0 msgr2=0x7f81640cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.486+0000 7f816259c640 1 --2- 172.21.15.55:0/2623594247 >> v2:172.21.15.167:3300/0 conn(0x7f81640b6ce0 0x7f81640cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.486+0000 7f816259c640 1 -- 172.21.15.55:0/2623594247 >> v1:172.21.15.167:6789/0 conn(0x7f81640ce1f0 legacy=0x7f81640ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.486+0000 7f816259c640 1 -- 172.21.15.55:0/2623594247 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81640d0060 con 0x7f81640cc270 2024-04-25T08:58:03.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f816259c640 1 --2- 172.21.15.55:0/2623594247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 0x7f81640b4cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f814c0097d0 tx=0x7f814c02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7062287137133f2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:03.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f8161d9b640 1 -- 172.21.15.55:0/2623594247 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c037070 con 0x7f81640cc270 2024-04-25T08:58:03.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f8161d9b640 1 -- 172.21.15.55:0/2623594247 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c02ae40 con 0x7f81640cc270 2024-04-25T08:58:03.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f8161d9b640 1 -- 172.21.15.55:0/2623594247 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c032660 con 0x7f81640cc270 2024-04-25T08:58:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f8169215640 1 -- 172.21.15.55:0/2623594247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 msgr2=0x7f81640b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f8169215640 1 --2- 172.21.15.55:0/2623594247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 0x7f81640b4cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f814c0097d0 tx=0x7f814c02a130 comp rx=0 tx=0).stop 2024-04-25T08:58:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f8169215640 1 -- 172.21.15.55:0/2623594247 shutdown_connections 2024-04-25T08:58:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f8169215640 1 --2- 172.21.15.55:0/2623594247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 0x7f81640b4cb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f8169215640 1 --2- 172.21.15.55:0/2623594247 >> v2:172.21.15.167:3300/0 conn(0x7f81640b6ce0 0x7f81640cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f8169215640 1 -- 172.21.15.55:0/2623594247 >> 172.21.15.55:0/2623594247 conn(0x7f81640b3440 msgr2=0x7f81640b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f8169215640 1 -- 172.21.15.55:0/2623594247 shutdown_connections 2024-04-25T08:58:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.487+0000 7f8169215640 1 -- 172.21.15.55:0/2623594247 wait complete. 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.489+0000 7f8169215640 1 Processor -- start 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.489+0000 7f8169215640 1 -- start start 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.489+0000 7f8169215640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81640b6ce0 0x7f81640c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.489+0000 7f8169215640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 0x7f8164152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.489+0000 7f8169215640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81640ce1f0 0x7f8164153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.489+0000 7f8169215640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81640cef10 con 0x7f81640b6ce0 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.489+0000 7f8169215640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81640b51f0 con 0x7f81640ce1f0 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.489+0000 7f8169215640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81640b70c0 con 0x7f81640cc270 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f8162d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81640b6ce0 0x7f81640c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f8162d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81640b6ce0 0x7f81640c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50112/0 (socket says 172.21.15.55:50112) 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f8162d9d640 1 -- 172.21.15.55:0/3891333 learned_addr learned my addr 172.21.15.55:0/3891333 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f816359e640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81640ce1f0 0x7f8164153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f816259c640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 0x7f8164152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f8162d9d640 1 -- 172.21.15.55:0/3891333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 msgr2=0x7f8164152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f8162d9d640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 0x7f8164152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f8162d9d640 1 -- 172.21.15.55:0/3891333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81640ce1f0 msgr2=0x7f8164153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f8162d9d640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81640ce1f0 0x7f8164153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f8162d9d640 1 -- 172.21.15.55:0/3891333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81640c9ab0 con 0x7f81640b6ce0 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f8162d9d640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81640b6ce0 0x7f81640c4f70 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f815c00e9b0 tx=0x7f815c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f815b7fe640 1 -- 172.21.15.55:0/3891333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c017070 con 0x7f81640b6ce0 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f815b7fe640 1 -- 172.21.15.55:0/3891333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c00c9a0 con 0x7f81640b6ce0 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f815b7fe640 1 -- 172.21.15.55:0/3891333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00cd90 con 0x7f81640b6ce0 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f8169215640 1 -- 172.21.15.55:0/3891333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81640c9d90 con 0x7f81640b6ce0 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.490+0000 7f8169215640 1 -- 172.21.15.55:0/3891333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81640ca350 con 0x7f81640b6ce0 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.491+0000 7f8169215640 1 -- 172.21.15.55:0/3891333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81640750b0 con 0x7f81640b6ce0 2024-04-25T08:58:03.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.492+0000 7f815b7fe640 1 -- 172.21.15.55:0/3891333 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f815c01a070 con 0x7f81640b6ce0 2024-04-25T08:58:03.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.492+0000 7f815b7fe640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f814406b4d0 0x7f814406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:03.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.492+0000 7f815b7fe640 1 -- 172.21.15.55:0/3891333 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f815c08a500 con 0x7f81640b6ce0 2024-04-25T08:58:03.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.492+0000 7f816259c640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f814406b4d0 0x7f814406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:03.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.493+0000 7f816259c640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f814406b4d0 0x7f814406d990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f814c034000 tx=0x7f814c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:03.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.497+0000 7f815b7fe640 1 -- 172.21.15.55:0/3891333 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f815c058d60 con 0x7f81640b6ce0 2024-04-25T08:58:03.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:03.714+0000 7f8169215640 1 -- 172.21.15.55:0/3891333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f81640b1610 con 0x7f81640b6ce0 2024-04-25T08:58:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.270+0000 7f815b7fe640 1 -- 172.21.15.55:0/3891333 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v38) v1 ==== 162+0+0 (secure 0 0 0) 0x7f815c05ce00 con 0x7f81640b6ce0 2024-04-25T08:58:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T08:58:04.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 -- 172.21.15.55:0/3891333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f814406b4d0 msgr2=0x7f814406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f814406b4d0 0x7f814406d990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f814c034000 tx=0x7f814c02e000 comp rx=0 tx=0).stop 2024-04-25T08:58:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 -- 172.21.15.55:0/3891333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81640b6ce0 msgr2=0x7f81640c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81640b6ce0 0x7f81640c4f70 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f815c00e9b0 tx=0x7f815c00ee70 comp rx=0 tx=0).stop 2024-04-25T08:58:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 -- 172.21.15.55:0/3891333 shutdown_connections 2024-04-25T08:58:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f814406b4d0 0x7f814406d990 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81640ce1f0 0x7f8164153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81640cc270 0x7f8164152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 --2- 172.21.15.55:0/3891333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81640b6ce0 0x7f81640c4f70 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 -- 172.21.15.55:0/3891333 >> 172.21.15.55:0/3891333 conn(0x7f81640b3440 msgr2=0x7f81640b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 -- 172.21.15.55:0/3891333 shutdown_connections 2024-04-25T08:58:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.273+0000 7f8169215640 1 -- 172.21.15.55:0/3891333 wait complete. 2024-04-25T08:58:04.278 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:58:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.393+0000 7fc2845c1640 1 Processor -- start 2024-04-25T08:58:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.393+0000 7fc2845c1640 1 -- start start 2024-04-25T08:58:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.394+0000 7fc2845c1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc27c0cd060 0x7fc27c06e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.394+0000 7fc2845c1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc27c06d690 0x7fc27c06edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.394+0000 7fc2845c1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c0719f0 con 0x7fc27c1476d0 2024-04-25T08:58:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.394+0000 7fc2845c1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c071cd0 con 0x7fc27c06d690 2024-04-25T08:58:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.394+0000 7fc2845c1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c071fb0 con 0x7fc27c0cd060 2024-04-25T08:58:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.394+0000 7fc282b5e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc27c06d690 0x7fc27c06edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.394+0000 7fc28235d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc27c1476d0 0x7fc27c0ca110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46604/0 (socket says 172.21.15.55:46604) 2024-04-25T08:58:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.394+0000 7fc282b5e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc27c06d690 0x7fc27c06edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50126/0 (socket says 172.21.15.55:50126) 2024-04-25T08:58:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.394+0000 7fc28235d640 1 -- 172.21.15.55:0/1048468574 learned_addr learned my addr 172.21.15.55:0/1048468574 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.395+0000 7fc282b5e640 1 -- 172.21.15.55:0/1048468574 >> v2:172.21.15.167:3300/0 conn(0x7fc27c0cd060 msgr2=0x7fc27c06e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.395+0000 7fc281b5c640 1 --2- 172.21.15.55:0/1048468574 >> v2:172.21.15.167:3300/0 conn(0x7fc27c0cd060 0x7fc27c06e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.395+0000 7fc28135b640 1 -- 172.21.15.55:0/1048468574 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987254377 0 0) 0x7fc27c0719f0 con 0x7fc27c1476d0 2024-04-25T08:58:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.395+0000 7fc282b5e640 1 --2- 172.21.15.55:0/1048468574 >> v2:172.21.15.167:3300/0 conn(0x7fc27c0cd060 0x7fc27c06e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.395+0000 7fc282b5e640 1 -- 172.21.15.55:0/1048468574 >> v1:172.21.15.55:6789/0 conn(0x7fc27c1476d0 legacy=0x7fc27c0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.395+0000 7fc282b5e640 1 -- 172.21.15.55:0/1048468574 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c072290 con 0x7fc27c06d690 2024-04-25T08:58:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.395+0000 7fc281b5c640 1 --2- 172.21.15.55:0/1048468574 >> v2:172.21.15.167:3300/0 conn(0x7fc27c0cd060 0x7fc27c06e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:04.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.395+0000 7fc282b5e640 1 --2- 172.21.15.55:0/1048468574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c06d690 0x7fc27c06edf0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc27c06ca50 tx=0x7fc26c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5c160351e59a09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:04.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.395+0000 7fc28135b640 1 -- 172.21.15.55:0/1048468574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c007740 con 0x7fc27c06d690 2024-04-25T08:58:04.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.395+0000 7fc28135b640 1 -- 172.21.15.55:0/1048468574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c0078e0 con 0x7fc27c06d690 2024-04-25T08:58:04.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.395+0000 7fc28135b640 1 -- 172.21.15.55:0/1048468574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c007cb0 con 0x7fc27c06d690 2024-04-25T08:58:04.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.396+0000 7fc2845c1640 1 -- 172.21.15.55:0/1048468574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c06d690 msgr2=0x7fc27c06edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:04.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.396+0000 7fc2845c1640 1 --2- 172.21.15.55:0/1048468574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c06d690 0x7fc27c06edf0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc27c06ca50 tx=0x7fc26c02a710 comp rx=0 tx=0).stop 2024-04-25T08:58:04.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.396+0000 7fc2845c1640 1 -- 172.21.15.55:0/1048468574 shutdown_connections 2024-04-25T08:58:04.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.396+0000 7fc2845c1640 1 --2- 172.21.15.55:0/1048468574 >> v2:172.21.15.167:3300/0 conn(0x7fc27c0cd060 0x7fc27c06e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.396+0000 7fc2845c1640 1 --2- 172.21.15.55:0/1048468574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c06d690 0x7fc27c06edf0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.396+0000 7fc2845c1640 1 -- 172.21.15.55:0/1048468574 >> 172.21.15.55:0/1048468574 conn(0x7fc27c0cc540 msgr2=0x7fc27c0cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.396+0000 7fc2845c1640 1 -- 172.21.15.55:0/1048468574 shutdown_connections 2024-04-25T08:58:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.396+0000 7fc2845c1640 1 -- 172.21.15.55:0/1048468574 wait complete. 2024-04-25T08:58:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.397+0000 7fc2845c1640 1 Processor -- start 2024-04-25T08:58:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.397+0000 7fc2845c1640 1 -- start start 2024-04-25T08:58:04.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.398+0000 7fc2845c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c06d690 0x7fc27c140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:04.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.398+0000 7fc2845c1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc27c0cd060 0x7fc27c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:04.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.398+0000 7fc2845c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc27c1476d0 0x7fc27c1f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:04.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.398+0000 7fc2845c1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0c93e0 con 0x7fc27c06d690 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.398+0000 7fc2845c1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0c9260 con 0x7fc27c0cd060 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.398+0000 7fc2845c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0c9560 con 0x7fc27c1476d0 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.398+0000 7fc28235d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c06d690 0x7fc27c140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.398+0000 7fc28235d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c06d690 0x7fc27c140e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50142/0 (socket says 172.21.15.55:50142) 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.398+0000 7fc28235d640 1 -- 172.21.15.55:0/2911524270 learned_addr learned my addr 172.21.15.55:0/2911524270 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.398+0000 7fc281b5c640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc27c0cd060 0x7fc27c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.398+0000 7fc282b5e640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc27c1476d0 0x7fc27c1f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc28235d640 1 -- 172.21.15.55:0/2911524270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc27c1476d0 msgr2=0x7fc27c1f07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc28235d640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc27c1476d0 0x7fc27c1f07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc28235d640 1 -- 172.21.15.55:0/2911524270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc27c0cd060 msgr2=0x7fc27c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc28235d640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc27c0cd060 0x7fc27c0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc28235d640 1 -- 172.21.15.55:0/2911524270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c1f4480 con 0x7fc27c06d690 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc281b5c640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc27c0cd060 0x7fc27c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc28235d640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c06d690 0x7fc27c140e80 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc27400c430 tx=0x7fc27400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:04.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc27affd640 1 -- 172.21.15.55:0/2911524270 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2740074e0 con 0x7fc27c06d690 2024-04-25T08:58:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc27affd640 1 -- 172.21.15.55:0/2911524270 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2740047e0 con 0x7fc27c06d690 2024-04-25T08:58:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc2845c1640 1 -- 172.21.15.55:0/2911524270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c1403a0 con 0x7fc27c06d690 2024-04-25T08:58:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc27affd640 1 -- 172.21.15.55:0/2911524270 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274004bd0 con 0x7fc27c06d690 2024-04-25T08:58:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.399+0000 7fc2845c1640 1 -- 172.21.15.55:0/2911524270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c140960 con 0x7fc27c06d690 2024-04-25T08:58:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.400+0000 7fc2845c1640 1 -- 172.21.15.55:0/2911524270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c140b60 con 0x7fc27c06d690 2024-04-25T08:58:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.400+0000 7fc27affd640 1 -- 172.21.15.55:0/2911524270 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc274011070 con 0x7fc27c06d690 2024-04-25T08:58:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.401+0000 7fc27affd640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26806b4d0 0x7fc26806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.401+0000 7fc27affd640 1 -- 172.21.15.55:0/2911524270 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc274089e00 con 0x7fc27c06d690 2024-04-25T08:58:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.401+0000 7fc281b5c640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26806b4d0 0x7fc26806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.401+0000 7fc281b5c640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26806b4d0 0x7fc26806d990 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0b5120 tx=0x7fc270008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:04.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.405+0000 7fc27affd640 1 -- 172.21.15.55:0/2911524270 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc27c140b60 con 0x7fc27c06d690 2024-04-25T08:58:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.628+0000 7fc2845c1640 1 -- 172.21.15.55:0/2911524270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc27c0749b0 con 0x7fc27c06d690 2024-04-25T08:58:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.628+0000 7fc27affd640 1 -- 172.21.15.55:0/2911524270 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fc27400e280 con 0x7fc27c06d690 2024-04-25T08:58:04.617 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:58:04.618 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:58:04.273938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6852},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6852":{"gid":6852,"name":"c","rank":0,"incarnation":39,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6837/2486130786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2486130786},{"type":"v1","addr":"172.21.15.55:6837","nonce":2486130786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:58:04.618 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 39 2024-04-25T08:58:04.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 -- 172.21.15.55:0/2911524270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26806b4d0 msgr2=0x7fc26806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26806b4d0 0x7fc26806d990 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0b5120 tx=0x7fc270008040 comp rx=0 tx=0).stop 2024-04-25T08:58:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 -- 172.21.15.55:0/2911524270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c06d690 msgr2=0x7fc27c140e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c06d690 0x7fc27c140e80 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc27400c430 tx=0x7fc27400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 -- 172.21.15.55:0/2911524270 shutdown_connections 2024-04-25T08:58:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc26806b4d0 0x7fc26806d990 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc27c1476d0 0x7fc27c1f07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc27c0cd060 0x7fc27c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 --2- 172.21.15.55:0/2911524270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c06d690 0x7fc27c140e80 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 -- 172.21.15.55:0/2911524270 >> 172.21.15.55:0/2911524270 conn(0x7fc27c0cc540 msgr2=0x7fc27c145cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 -- 172.21.15.55:0/2911524270 shutdown_connections 2024-04-25T08:58:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:04.630+0000 7fc2845c1640 1 -- 172.21.15.55:0/2911524270 wait complete. 2024-04-25T08:58:05.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:57:49.554460+0000', 'modified': '2024-04-25T08:58:04.273938+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6852}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6852': {'gid': 6852, 'name': 'c', 'rank': 0, 'incarnation': 39, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6837/2486130786', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 2486130786}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 2486130786}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:58:05.033 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6852:up:replay 2024-04-25T08:58:06.034 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:58:06.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.158+0000 7f2adc63a640 1 Processor -- start 2024-04-25T08:58:06.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.158+0000 7f2adc63a640 1 -- start start 2024-04-25T08:58:06.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.159+0000 7f2adc63a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad415dce0 0x7f2ad40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.159+0000 7f2adc63a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ad40d35b0 0x7f2ad40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2adc63a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad415e0c0 con 0x7f2ad40d1f90 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2adc63a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad40b7b10 con 0x7f2ad40d35b0 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2adc63a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40d2510 con 0x7f2ad415dce0 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2ad9bd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ad40d35b0 0x7f2ad40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2adabd7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2ad40d1f90 0x7f2ad406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46608/0 (socket says 172.21.15.55:46608) 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2ad9bd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ad40d35b0 0x7f2ad40b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50156/0 (socket says 172.21.15.55:50156) 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2adabd7640 1 -- 172.21.15.55:0/784358830 learned_addr learned my addr 172.21.15.55:0/784358830 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2ada3d6640 1 --2- 172.21.15.55:0/784358830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad415dce0 0x7f2ad40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2ad9bd5640 1 -- 172.21.15.55:0/784358830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad415dce0 msgr2=0x7f2ad40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2ad9bd5640 1 --2- 172.21.15.55:0/784358830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad415dce0 0x7f2ad40d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2ad9bd5640 1 -- 172.21.15.55:0/784358830 >> v1:172.21.15.55:6789/0 conn(0x7f2ad40d1f90 legacy=0x7f2ad406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2ad9bd5640 1 -- 172.21.15.55:0/784358830 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40d27f0 con 0x7f2ad40d35b0 2024-04-25T08:58:06.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2ad93d4640 1 -- 172.21.15.55:0/784358830 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153359043 0 0) 0x7f2ad415e0c0 con 0x7f2ad40d1f90 2024-04-25T08:58:06.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.160+0000 7f2ada3d6640 1 --2- 172.21.15.55:0/784358830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad415dce0 0x7f2ad40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.161+0000 7f2ad9bd5640 1 --2- 172.21.15.55:0/784358830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40d35b0 0x7f2ad40b5450 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40097a0 tx=0x7f2ac402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0f5b5ce231b167 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.161+0000 7f2ad93d4640 1 -- 172.21.15.55:0/784358830 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4037070 con 0x7f2ad40d35b0 2024-04-25T08:58:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.161+0000 7f2ad93d4640 1 -- 172.21.15.55:0/784358830 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac402ae50 con 0x7f2ad40d35b0 2024-04-25T08:58:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.161+0000 7f2ad93d4640 1 -- 172.21.15.55:0/784358830 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4032660 con 0x7f2ad40d35b0 2024-04-25T08:58:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.161+0000 7f2adc63a640 1 -- 172.21.15.55:0/784358830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40d35b0 msgr2=0x7f2ad40b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.161+0000 7f2adc63a640 1 --2- 172.21.15.55:0/784358830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40d35b0 0x7f2ad40b5450 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40097a0 tx=0x7f2ac402a100 comp rx=0 tx=0).stop 2024-04-25T08:58:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.162+0000 7f2adc63a640 1 -- 172.21.15.55:0/784358830 shutdown_connections 2024-04-25T08:58:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.162+0000 7f2adc63a640 1 --2- 172.21.15.55:0/784358830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40d35b0 0x7f2ad40b5450 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.162+0000 7f2adc63a640 1 --2- 172.21.15.55:0/784358830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad415dce0 0x7f2ad40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:06.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.162+0000 7f2adc63a640 1 -- 172.21.15.55:0/784358830 >> 172.21.15.55:0/784358830 conn(0x7f2ad4072900 msgr2=0x7f2ad40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:06.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.162+0000 7f2adc63a640 1 -- 172.21.15.55:0/784358830 shutdown_connections 2024-04-25T08:58:06.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.162+0000 7f2adc63a640 1 -- 172.21.15.55:0/784358830 wait complete. 2024-04-25T08:58:06.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.163+0000 7f2adc63a640 1 Processor -- start 2024-04-25T08:58:06.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.163+0000 7f2adc63a640 1 -- start start 2024-04-25T08:58:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2adc63a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40d1f90 0x7f2ad40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2adc63a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad40d35b0 0x7f2ad414d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2adc63a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad415dce0 0x7f2ad414deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2adc63a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40d3090 con 0x7f2ad40d1f90 2024-04-25T08:58:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2adc63a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40d2db0 con 0x7f2ad40d35b0 2024-04-25T08:58:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2adc63a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40b9820 con 0x7f2ad415dce0 2024-04-25T08:58:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2ada3d6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40d1f90 0x7f2ad40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2ada3d6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40d1f90 0x7f2ad40b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50168/0 (socket says 172.21.15.55:50168) 2024-04-25T08:58:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2ada3d6640 1 -- 172.21.15.55:0/2899393824 learned_addr learned my addr 172.21.15.55:0/2899393824 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2ada3d6640 1 -- 172.21.15.55:0/2899393824 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad415dce0 msgr2=0x7f2ad414deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2ada3d6640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad415dce0 0x7f2ad414deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2ada3d6640 1 -- 172.21.15.55:0/2899393824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad40d35b0 msgr2=0x7f2ad414d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2ad9bd5640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad40d35b0 0x7f2ad414d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2ada3d6640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad40d35b0 0x7f2ad414d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2ada3d6640 1 -- 172.21.15.55:0/2899393824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad41f4610 con 0x7f2ad40d1f90 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2ad9bd5640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad40d35b0 0x7f2ad414d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2ada3d6640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40d1f90 0x7f2ad40b46a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c7f0 tx=0x7f2ad000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2acaffd640 1 -- 172.21.15.55:0/2899393824 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0015070 con 0x7f2ad40d1f90 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2acaffd640 1 -- 172.21.15.55:0/2899393824 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad0007a30 con 0x7f2ad40d1f90 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.164+0000 7f2adc63a640 1 -- 172.21.15.55:0/2899393824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad415e3e0 con 0x7f2ad40d1f90 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.165+0000 7f2acaffd640 1 -- 172.21.15.55:0/2899393824 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0007e00 con 0x7f2ad40d1f90 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.165+0000 7f2adc63a640 1 -- 172.21.15.55:0/2899393824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad415e9a0 con 0x7f2ad40d1f90 2024-04-25T08:58:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.165+0000 7f2adc63a640 1 -- 172.21.15.55:0/2899393824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad40d1a50 con 0x7f2ad40d1f90 2024-04-25T08:58:06.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.166+0000 7f2acaffd640 1 -- 172.21.15.55:0/2899393824 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2ad0018070 con 0x7f2ad40d1f90 2024-04-25T08:58:06.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.166+0000 7f2acaffd640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ab806b4d0 0x7f2ab806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:06.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.166+0000 7f2acaffd640 1 -- 172.21.15.55:0/2899393824 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2ad008a220 con 0x7f2ad40d1f90 2024-04-25T08:58:06.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.167+0000 7f2ad9bd5640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ab806b4d0 0x7f2ab806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:06.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.167+0000 7f2ad9bd5640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ab806b4d0 0x7f2ab806d990 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4034000 tx=0x7f2ac402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.171+0000 7f2acaffd640 1 -- 172.21.15.55:0/2899393824 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2ad40d1a50 con 0x7f2ad40d1f90 2024-04-25T08:58:06.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.396+0000 7f2adc63a640 1 -- 172.21.15.55:0/2899393824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ad40749b0 con 0x7f2ad40d1f90 2024-04-25T08:58:06.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.396+0000 7f2acaffd640 1 -- 172.21.15.55:0/2899393824 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f2ad0059030 con 0x7f2ad40d1f90 2024-04-25T08:58:06.386 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:58:06.386 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:58:05.285181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6852},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6852":{"gid":6852,"name":"c","rank":0,"incarnation":39,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.55:6837/2486130786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2486130786},{"type":"v1","addr":"172.21.15.55:6837","nonce":2486130786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:58:06.386 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 41 2024-04-25T08:58:06.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.398+0000 7f2adc63a640 1 -- 172.21.15.55:0/2899393824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ab806b4d0 msgr2=0x7f2ab806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:06.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.398+0000 7f2adc63a640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ab806b4d0 0x7f2ab806d990 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4034000 tx=0x7f2ac402e000 comp rx=0 tx=0).stop 2024-04-25T08:58:06.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.398+0000 7f2adc63a640 1 -- 172.21.15.55:0/2899393824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40d1f90 msgr2=0x7f2ad40b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:06.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.398+0000 7f2adc63a640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40d1f90 0x7f2ad40b46a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c7f0 tx=0x7f2ad000cbf0 comp rx=0 tx=0).stop 2024-04-25T08:58:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.398+0000 7f2adc63a640 1 -- 172.21.15.55:0/2899393824 shutdown_connections 2024-04-25T08:58:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.398+0000 7f2adc63a640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ab806b4d0 0x7f2ab806d990 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.398+0000 7f2adc63a640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad415dce0 0x7f2ad414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.398+0000 7f2adc63a640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad40d35b0 0x7f2ad414d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.398+0000 7f2adc63a640 1 --2- 172.21.15.55:0/2899393824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40d1f90 0x7f2ad40b46a0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.398+0000 7f2adc63a640 1 -- 172.21.15.55:0/2899393824 >> 172.21.15.55:0/2899393824 conn(0x7f2ad4072900 msgr2=0x7f2ad40d3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.399+0000 7f2adc63a640 1 -- 172.21.15.55:0/2899393824 shutdown_connections 2024-04-25T08:58:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:06.399+0000 7f2adc63a640 1 -- 172.21.15.55:0/2899393824 wait complete. 2024-04-25T08:58:06.802 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:57:49.554460+0000', 'modified': '2024-04-25T08:58:05.285181+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6852}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6852': {'gid': 6852, 'name': 'c', 'rank': 0, 'incarnation': 39, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.55:6837/2486130786', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 2486130786}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 2486130786}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:58:06.802 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6852:up:rejoin 2024-04-25T08:58:07.803 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:58:07.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.927+0000 7f976fb5c640 1 Processor -- start 2024-04-25T08:58:07.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.927+0000 7f976fb5c640 1 -- start start 2024-04-25T08:58:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.928+0000 7f976fb5c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f976815bf00 0x7f97680cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.928+0000 7f976fb5c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97680cc310 0x7f976815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.928+0000 7f976fb5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680ce6c0 con 0x7f976815c820 2024-04-25T08:58:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.928+0000 7f976fb5c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97681455e0 con 0x7f976815bf00 2024-04-25T08:58:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.928+0000 7f976fb5c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976806d450 con 0x7f97680cc310 2024-04-25T08:58:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.928+0000 7f976e0f9640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f976815c820 0x7f976806d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46610/0 (socket says 172.21.15.55:46610) 2024-04-25T08:58:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.928+0000 7f976e0f9640 1 -- 172.21.15.55:0/2713203629 learned_addr learned my addr 172.21.15.55:0/2713203629 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.928+0000 7f976d8f8640 1 --2- 172.21.15.55:0/2713203629 >> v2:172.21.15.167:3300/0 conn(0x7f976815bf00 0x7f97680cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.928+0000 7f976d0f7640 1 --2- 172.21.15.55:0/2713203629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97680cc310 0x7f976815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.928+0000 7f976c8f6640 1 -- 172.21.15.55:0/2713203629 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201544909 0 0) 0x7f9760001490 con 0x7f976815c820 2024-04-25T08:58:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.928+0000 7f976c8f6640 1 -- 172.21.15.55:0/2713203629 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9754003520 con 0x7f976815c820 2024-04-25T08:58:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.929+0000 7f976d0f7640 1 -- 172.21.15.55:0/2713203629 >> v2:172.21.15.167:3300/0 conn(0x7f976815bf00 msgr2=0x7f97680cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.929+0000 7f976d0f7640 1 --2- 172.21.15.55:0/2713203629 >> v2:172.21.15.167:3300/0 conn(0x7f976815bf00 0x7f97680cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.929+0000 7f976d0f7640 1 -- 172.21.15.55:0/2713203629 >> v1:172.21.15.55:6789/0 conn(0x7f976815c820 legacy=0x7f976806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.929+0000 7f976d0f7640 1 -- 172.21.15.55:0/2713203629 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680cc7b0 con 0x7f97680cc310 2024-04-25T08:58:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.929+0000 7f976d8f8640 1 --2- 172.21.15.55:0/2713203629 >> v2:172.21.15.167:3300/0 conn(0x7f976815bf00 0x7f97680cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:58:07.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.929+0000 7f976d0f7640 1 --2- 172.21.15.55:0/2713203629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97680cc310 0x7f976815c2e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f97580097a0 tx=0x7f975802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d375b2dc5ab521b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:07.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.930+0000 7f976c8f6640 1 -- 172.21.15.55:0/2713203629 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758037070 con 0x7f97680cc310 2024-04-25T08:58:07.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.930+0000 7f976c8f6640 1 -- 172.21.15.55:0/2713203629 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758032440 con 0x7f97680cc310 2024-04-25T08:58:07.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.930+0000 7f976c8f6640 1 -- 172.21.15.55:0/2713203629 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97580327f0 con 0x7f97680cc310 2024-04-25T08:58:07.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.930+0000 7f976fb5c640 1 -- 172.21.15.55:0/2713203629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97680cc310 msgr2=0x7f976815c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:07.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.930+0000 7f976fb5c640 1 --2- 172.21.15.55:0/2713203629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97680cc310 0x7f976815c2e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f97580097a0 tx=0x7f975802a180 comp rx=0 tx=0).stop 2024-04-25T08:58:07.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.930+0000 7f976fb5c640 1 -- 172.21.15.55:0/2713203629 shutdown_connections 2024-04-25T08:58:07.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.930+0000 7f976fb5c640 1 --2- 172.21.15.55:0/2713203629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97680cc310 0x7f976815c2e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:07.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.930+0000 7f976fb5c640 1 --2- 172.21.15.55:0/2713203629 >> v2:172.21.15.167:3300/0 conn(0x7f976815bf00 0x7f97680cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:07.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.930+0000 7f976fb5c640 1 -- 172.21.15.55:0/2713203629 >> 172.21.15.55:0/2713203629 conn(0x7f976806aba0 msgr2=0x7f976806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:07.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.930+0000 7f976fb5c640 1 -- 172.21.15.55:0/2713203629 shutdown_connections 2024-04-25T08:58:07.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.930+0000 7f976fb5c640 1 -- 172.21.15.55:0/2713203629 wait complete. 2024-04-25T08:58:07.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.931+0000 7f976fb5c640 1 Processor -- start 2024-04-25T08:58:07.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.931+0000 7f976fb5c640 1 -- start start 2024-04-25T08:58:07.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.932+0000 7f976fb5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cc310 0x7f97680c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:07.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.932+0000 7f976fb5c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976815bf00 0x7f97681f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:07.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.932+0000 7f976fb5c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f976815c820 0x7f97681f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:07.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.932+0000 7f976fb5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680cd050 con 0x7f97680cc310 2024-04-25T08:58:07.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.932+0000 7f976fb5c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680ccd70 con 0x7f976815c820 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.932+0000 7f976fb5c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976815cca0 con 0x7f976815bf00 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.932+0000 7f976d8f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cc310 0x7f97680c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.932+0000 7f976d8f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cc310 0x7f97680c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50180/0 (socket says 172.21.15.55:50180) 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.932+0000 7f976d8f8640 1 -- 172.21.15.55:0/2108917304 learned_addr learned my addr 172.21.15.55:0/2108917304 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.932+0000 7f976e0f9640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f976815c820 0x7f97681f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f976d0f7640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976815bf00 0x7f97681f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f976d8f8640 1 -- 172.21.15.55:0/2108917304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976815bf00 msgr2=0x7f97681f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f976d8f8640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976815bf00 0x7f97681f6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f976d8f8640 1 -- 172.21.15.55:0/2108917304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f976815c820 msgr2=0x7f97681f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f976d8f8640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f976815c820 0x7f97681f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f976d8f8640 1 -- 172.21.15.55:0/2108917304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680b2c50 con 0x7f97680cc310 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f976e0f9640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f976815c820 0x7f97681f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:07.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f976d8f8640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cc310 0x7f97680c9c60 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f976400ebe0 tx=0x7f976400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:07.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f975e7fc640 1 -- 172.21.15.55:0/2108917304 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764017070 con 0x7f97680cc310 2024-04-25T08:58:07.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f975e7fc640 1 -- 172.21.15.55:0/2108917304 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976400cc30 con 0x7f97680cc310 2024-04-25T08:58:07.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f976fb5c640 1 -- 172.21.15.55:0/2108917304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97680b2f30 con 0x7f97680cc310 2024-04-25T08:58:07.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f975e7fc640 1 -- 172.21.15.55:0/2108917304 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764013470 con 0x7f97680cc310 2024-04-25T08:58:07.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.933+0000 7f976fb5c640 1 -- 172.21.15.55:0/2108917304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97681f7dc0 con 0x7f97680cc310 2024-04-25T08:58:07.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.934+0000 7f976fb5c640 1 -- 172.21.15.55:0/2108917304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976806bb30 con 0x7f97680cc310 2024-04-25T08:58:07.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.935+0000 7f975e7fc640 1 -- 172.21.15.55:0/2108917304 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f976401a070 con 0x7f97680cc310 2024-04-25T08:58:07.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.935+0000 7f975e7fc640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974c06b500 0x7f974c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:07.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.935+0000 7f975e7fc640 1 -- 172.21.15.55:0/2108917304 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f976408a540 con 0x7f97680cc310 2024-04-25T08:58:07.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.935+0000 7f976d0f7640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974c06b500 0x7f974c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:07.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.936+0000 7f976d0f7640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974c06b500 0x7f974c06d9c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9758034000 tx=0x7f975802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:07.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:07.940+0000 7f975e7fc640 1 -- 172.21.15.55:0/2108917304 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9764059370 con 0x7f97680cc310 2024-04-25T08:58:08.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.157+0000 7f976fb5c640 1 -- 172.21.15.55:0/2108917304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97680749b0 con 0x7f97680cc310 2024-04-25T08:58:08.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.158+0000 7f975e7fc640 1 -- 172.21.15.55:0/2108917304 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f9764058c70 con 0x7f97680cc310 2024-04-25T08:58:08.147 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:58:08.147 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:58:06.293802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6852},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6852":{"gid":6852,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/2486130786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2486130786},{"type":"v1","addr":"172.21.15.55:6837","nonce":2486130786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:58:08.148 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 42 2024-04-25T08:58:08.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 -- 172.21.15.55:0/2108917304 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974c06b500 msgr2=0x7f974c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974c06b500 0x7f974c06d9c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9758034000 tx=0x7f975802e000 comp rx=0 tx=0).stop 2024-04-25T08:58:08.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 -- 172.21.15.55:0/2108917304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cc310 msgr2=0x7f97680c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cc310 0x7f97680c9c60 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f976400ebe0 tx=0x7f976400c520 comp rx=0 tx=0).stop 2024-04-25T08:58:08.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 -- 172.21.15.55:0/2108917304 shutdown_connections 2024-04-25T08:58:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f974c06b500 0x7f974c06d9c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f976815c820 0x7f97681f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976815bf00 0x7f97681f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 --2- 172.21.15.55:0/2108917304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cc310 0x7f97680c9c60 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 -- 172.21.15.55:0/2108917304 >> 172.21.15.55:0/2108917304 conn(0x7f976806aba0 msgr2=0x7f9768142bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 -- 172.21.15.55:0/2108917304 shutdown_connections 2024-04-25T08:58:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.160+0000 7f976fb5c640 1 -- 172.21.15.55:0/2108917304 wait complete. 2024-04-25T08:58:08.565 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:57:49.554460+0000', 'modified': '2024-04-25T08:58:06.293802+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6852}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6852': {'gid': 6852, 'name': 'c', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6837/2486130786', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 2486130786}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 2486130786}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:58:08.565 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:58:08.565 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T08:58:08.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.688+0000 7fa7b75ce640 1 Processor -- start 2024-04-25T08:58:08.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.688+0000 7fa7b75ce640 1 -- start start 2024-04-25T08:58:08.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.689+0000 7fa7b75ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b01610c0 0x7fa7b00acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.689+0000 7fa7b75ce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa7b00ce240 0x7fa7b006bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.689+0000 7fa7b75ce640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b006c580 con 0x7fa7b006bac0 2024-04-25T08:58:08.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.689+0000 7fa7b75ce640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b01614a0 con 0x7fa7b00ce240 2024-04-25T08:58:08.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.689+0000 7fa7b75ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b006dde0 con 0x7fa7b01610c0 2024-04-25T08:58:08.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.689+0000 7fa7b5b6b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa7b00ce240 0x7fa7b006bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.689+0000 7fa7b536a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b01610c0 0x7fa7b00acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.689+0000 7fa7b4b69640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa7b006bac0 0x7fa7b00cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:54620/0 (socket says 172.21.15.55:54620) 2024-04-25T08:58:08.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.689+0000 7fa7b4b69640 1 -- 172.21.15.55:0/2602448764 learned_addr learned my addr 172.21.15.55:0/2602448764 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:08.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.690+0000 7fa7b536a640 1 -- 172.21.15.55:0/2602448764 >> v2:172.21.15.167:3300/0 conn(0x7fa7b00ce240 msgr2=0x7fa7b006bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.690+0000 7fa7affff640 1 -- 172.21.15.55:0/2602448764 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156642398 0 0) 0x7fa7b006c580 con 0x7fa7b006bac0 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.690+0000 7fa7b536a640 1 --2- 172.21.15.55:0/2602448764 >> v2:172.21.15.167:3300/0 conn(0x7fa7b00ce240 0x7fa7b006bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.690+0000 7fa7b536a640 1 -- 172.21.15.55:0/2602448764 >> v1:172.21.15.167:6789/0 conn(0x7fa7b006bac0 legacy=0x7fa7b00cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.690+0000 7fa7b536a640 1 -- 172.21.15.55:0/2602448764 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b006e0c0 con 0x7fa7b01610c0 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.690+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/2602448764 >> v2:172.21.15.167:3300/0 conn(0x7fa7b00ce240 0x7fa7b006bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7b536a640 1 --2- 172.21.15.55:0/2602448764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b01610c0 0x7fa7b00acdf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80097a0 tx=0x7fa7a802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20f4fde464bdb502 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7affff640 1 -- 172.21.15.55:0/2602448764 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8037070 con 0x7fa7b01610c0 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7affff640 1 -- 172.21.15.55:0/2602448764 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a802ae50 con 0x7fa7b01610c0 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7affff640 1 -- 172.21.15.55:0/2602448764 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8032660 con 0x7fa7b01610c0 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7b75ce640 1 -- 172.21.15.55:0/2602448764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b01610c0 msgr2=0x7fa7b00acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7b75ce640 1 --2- 172.21.15.55:0/2602448764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b01610c0 0x7fa7b00acdf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80097a0 tx=0x7fa7a802a100 comp rx=0 tx=0).stop 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7b75ce640 1 -- 172.21.15.55:0/2602448764 shutdown_connections 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7b75ce640 1 --2- 172.21.15.55:0/2602448764 >> v2:172.21.15.167:3300/0 conn(0x7fa7b00ce240 0x7fa7b006bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7b75ce640 1 --2- 172.21.15.55:0/2602448764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b01610c0 0x7fa7b00acdf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7b75ce640 1 -- 172.21.15.55:0/2602448764 >> 172.21.15.55:0/2602448764 conn(0x7fa7b00cc9e0 msgr2=0x7fa7b00ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:08.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7b75ce640 1 -- 172.21.15.55:0/2602448764 shutdown_connections 2024-04-25T08:58:08.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.691+0000 7fa7b75ce640 1 -- 172.21.15.55:0/2602448764 wait complete. 2024-04-25T08:58:08.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.693+0000 7fa7b75ce640 1 Processor -- start 2024-04-25T08:58:08.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.693+0000 7fa7b75ce640 1 -- start start 2024-04-25T08:58:08.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.693+0000 7fa7b75ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7b006bac0 0x7fa7b01e9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.693+0000 7fa7b75ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b00ce240 0x7fa7b00ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.693+0000 7fa7b75ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b01610c0 0x7fa7b0157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.693+0000 7fa7b75ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b006add0 con 0x7fa7b006bac0 2024-04-25T08:58:08.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.693+0000 7fa7b75ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b006e680 con 0x7fa7b00ce240 2024-04-25T08:58:08.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.693+0000 7fa7b75ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b006eba0 con 0x7fa7b01610c0 2024-04-25T08:58:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.693+0000 7fa7b536a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7b006bac0 0x7fa7b01e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.693+0000 7fa7b536a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7b006bac0 0x7fa7b01e9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49326/0 (socket says 172.21.15.55:49326) 2024-04-25T08:58:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.693+0000 7fa7b536a640 1 -- 172.21.15.55:0/1942812644 learned_addr learned my addr 172.21.15.55:0/1942812644 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b01610c0 0x7fa7b0157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b00ce240 0x7fa7b00ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7b536a640 1 -- 172.21.15.55:0/1942812644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b01610c0 msgr2=0x7fa7b0157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7b536a640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b01610c0 0x7fa7b0157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7b536a640 1 -- 172.21.15.55:0/1942812644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b00ce240 msgr2=0x7fa7b00ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7b536a640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b00ce240 0x7fa7b00ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7b536a640 1 -- 172.21.15.55:0/1942812644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b015f0b0 con 0x7fa7b006bac0 2024-04-25T08:58:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b00ce240 0x7fa7b00ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7b536a640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7b006bac0 0x7fa7b01e9870 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8035040 tx=0x7fa7a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7adffb640 1 -- 172.21.15.55:0/1942812644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8041070 con 0x7fa7b006bac0 2024-04-25T08:58:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7adffb640 1 -- 172.21.15.55:0/1942812644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a803c460 con 0x7fa7b006bac0 2024-04-25T08:58:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7b75ce640 1 -- 172.21.15.55:0/1942812644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b01e9f00 con 0x7fa7b006bac0 2024-04-25T08:58:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7adffb640 1 -- 172.21.15.55:0/1942812644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8037040 con 0x7fa7b006bac0 2024-04-25T08:58:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.694+0000 7fa7b75ce640 1 -- 172.21.15.55:0/1942812644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b01f7470 con 0x7fa7b006bac0 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.696+0000 7fa7adffb640 1 -- 172.21.15.55:0/1942812644 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa7a803a070 con 0x7fa7b006bac0 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.696+0000 7fa7adffb640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa79c06b4d0 0x7fa79c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.696+0000 7fa7adffb640 1 -- 172.21.15.55:0/1942812644 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa7a80aa3b0 con 0x7fa7b006bac0 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.696+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa79c06b4d0 0x7fa79c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.697+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa79c06b4d0 0x7fa79c06d990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00b5a00 tx=0x7fa7a4007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.697+0000 7fa7ba3ac740 1 Processor -- start 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.697+0000 7fa7ba3ac740 1 -- start start 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 0x55665f9b3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f9d0ad0 0x55665f9d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f988f10 0x55665f9cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665f8eba10 con 0x55665f988f10 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665f894b30 con 0x55665f9b3230 2024-04-25T08:58:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55665f8e7c50 con 0x55665f9d0ad0 2024-04-25T08:58:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7b5b6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f988f10 0x55665f9cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7b5b6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f988f10 0x55665f9cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49332/0 (socket says 172.21.15.55:49332) 2024-04-25T08:58:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/259110058 learned_addr learned my addr 172.21.15.55:0/259110058 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7b536a640 1 --2- 172.21.15.55:0/259110058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 0x55665f9b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/259110058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f9d0ad0 msgr2=0x55665f9d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/259110058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f9d0ad0 0x55665f9d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/259110058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f9d0ad0 0x55665f9d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/259110058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 msgr2=0x55665f9b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/259110058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 0x55665f9b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/259110058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55665f8a9e10 con 0x55665f988f10 2024-04-25T08:58:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.698+0000 7fa7b536a640 1 --2- 172.21.15.55:0/259110058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 0x55665f9b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/259110058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f988f10 0x55665f9cf190 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00049d0 tx=0x7fa7a0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d8b91e2b612cf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa796ffd640 1 -- 172.21.15.55:0/259110058 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0019020 con 0x55665f988f10 2024-04-25T08:58:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa796ffd640 1 -- 172.21.15.55:0/259110058 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a0015600 con 0x55665f988f10 2024-04-25T08:58:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa796ffd640 1 -- 172.21.15.55:0/259110058 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a00159f0 con 0x55665f988f10 2024-04-25T08:58:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/259110058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f988f10 msgr2=0x55665f9cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/259110058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f988f10 0x55665f9cf190 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00049d0 tx=0x7fa7a0009750 comp rx=0 tx=0).stop 2024-04-25T08:58:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/259110058 shutdown_connections 2024-04-25T08:58:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/259110058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f988f10 0x55665f9cf190 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/259110058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f9d0ad0 0x55665f9d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/259110058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 0x55665f9b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/259110058 >> 172.21.15.55:0/259110058 conn(0x55665f985840 msgr2=0x55665f9ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/259110058 shutdown_connections 2024-04-25T08:58:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.699+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/259110058 wait complete. 2024-04-25T08:58:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.700+0000 7fa7ba3ac740 1 -- start start 2024-04-25T08:58:08.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.700+0000 7fa7ba3ac740 1 Processor -- start 2024-04-25T08:58:08.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f9b3230 0x55665f99fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9d0ad0 0x55665f9b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f99eac0 0x55665f9a1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665f989cb0 con 0x55665f99eac0 2024-04-25T08:58:08.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665f8a80c0 con 0x55665f9d0ad0 2024-04-25T08:58:08.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55665f983770 con 0x55665f9b3230 2024-04-25T08:58:08.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7ba3ac740 10 client.0 _ll_register_callbacks cb 0x55665f89bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:08.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7b5b6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f99eac0 0x55665f9a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7b5b6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f99eac0 0x55665f9a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49342/0 (socket says 172.21.15.55:49342) 2024-04-25T08:58:08.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/2273360223 learned_addr learned my addr 172.21.15.55:0/2273360223 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:08.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9d0ad0 0x55665f9b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7b536a640 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f9b3230 0x55665f99fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/2273360223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f9b3230 msgr2=0x55665f99fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f9b3230 0x55665f99fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/2273360223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9d0ad0 msgr2=0x55665f9b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9d0ad0 0x55665f9b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/2273360223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55665f6002d0 con 0x55665f99eac0 2024-04-25T08:58:08.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.701+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9d0ad0 0x55665f9b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:08.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f99eac0 0x55665f9a1460 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0000f80 tx=0x7fa7a0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abbbad20ade363f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:08.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa78ffff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:08.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa78ffff640 1 -- 172.21.15.55:0/2273360223 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0025070 con 0x55665f99eac0 2024-04-25T08:58:08.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa78ffff640 1 -- 172.21.15.55:0/2273360223 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa7a001e860 con 0x55665f99eac0 2024-04-25T08:58:08.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2273360223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7a0015600 con 0x55665f99eac0 2024-04-25T08:58:08.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa78ffff640 1 -- 172.21.15.55:0/2273360223 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7a0019040 con 0x55665f99eac0 2024-04-25T08:58:08.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa7ba3ac740 10 client.6900 fetch_fsmap learned FSMap version 42 2024-04-25T08:58:08.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2273360223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55665f6ca6b0 con 0x55665f99eac0 2024-04-25T08:58:08.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa78ffff640 1 -- 172.21.15.55:0/2273360223 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a0015600 con 0x55665f99eac0 2024-04-25T08:58:08.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa78ffff640 1 -- 172.21.15.55:0/2273360223 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 42) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa7a001ea60 con 0x55665f99eac0 2024-04-25T08:58:08.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa7ba3ac740 10 client.6900 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T08:58:08.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa7ba3ac740 10 client.6900 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:58:08.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa7ba3ac740 20 client.6900 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:08.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55665f9b4430 0x55665f9d3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa7ba3ac740 4 client.6900 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:08.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2273360223 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55665f94a920 con 0x55665f9b4430 2024-04-25T08:58:08.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.702+0000 7fa7b536a640 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55665f9b4430 0x55665f9d3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa78ffff640 10 client.6900 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:08.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa7b536a640 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55665f9b4430 0x55665f9d3dc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a630b83d785f71f0 server_cookie=7cdf0157b62833c5 in_seq=0 out_seq=0 2024-04-25T08:58:08.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa78ffff640 1 -- 172.21.15.55:0/2273360223 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55665f94a920 con 0x55665f9b4430 2024-04-25T08:58:08.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa78ffff640 10 client.6900 handle_command_reply: tid=0 2024-04-25T08:58:08.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa7ba3ac740 1 client.6900 shutdown 2024-04-25T08:58:08.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2273360223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f99eac0 msgr2=0x55665f9a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f99eac0 0x55665f9a1460 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0000f80 tx=0x7fa7a0004ab0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2273360223 shutdown_connections 2024-04-25T08:58:08.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55665f9b4430 0x55665f9d3dc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f99eac0 0x55665f9a1460 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9d0ad0 0x55665f9b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2273360223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f9b3230 0x55665f99fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa78ffff640 0 client.6900 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:08.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.703+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2273360223 >> 172.21.15.55:0/2273360223 conn(0x55665f988f10 msgr2=0x55665f9d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:08.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.704+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2273360223 shutdown_connections 2024-04-25T08:58:08.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.704+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2273360223 wait complete. 2024-04-25T08:58:08.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.704+0000 7fa7ba3ac740 20 client.6900 trim_cache size 0 max 16384 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.720+0000 7fa7ba3ac740 1 Processor -- start 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.720+0000 7fa7ba3ac740 1 -- start start 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.720+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f99eac0 0x55665f9c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.720+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 0x55665f99f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.720+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9d0ad0 0x55665f9892f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.720+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b01ff080 con 0x55665f9d0ad0 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.720+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b01fe480 con 0x55665f9b3230 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.720+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b01fea80 con 0x55665f99eac0 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.720+0000 7fa7b5b6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9d0ad0 0x55665f9892f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.720+0000 7fa7b5b6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9d0ad0 0x55665f9892f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49358/0 (socket says 172.21.15.55:49358) 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.720+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/3217943307 learned_addr learned my addr 172.21.15.55:0/3217943307 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7b536a640 1 --2- 172.21.15.55:0/3217943307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f99eac0 0x55665f9c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/3217943307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 0x55665f99f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/3217943307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f99eac0 msgr2=0x55665f9c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/3217943307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f99eac0 0x55665f9c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/3217943307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 msgr2=0x55665f99f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/3217943307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 0x55665f99f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7b5b6b640 1 -- 172.21.15.55:0/3217943307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55665f9ce940 con 0x55665f9d0ad0 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7b536a640 1 --2- 172.21.15.55:0/3217943307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f99eac0 0x55665f9c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/3217943307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 0x55665f99f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/3217943307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9d0ad0 0x55665f9892f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009790 tx=0x7fa7a001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8730251cb6eaa60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7967fc640 1 -- 172.21.15.55:0/3217943307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0025070 con 0x55665f9d0ad0 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7967fc640 1 -- 172.21.15.55:0/3217943307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a0009ca0 con 0x55665f9d0ad0 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7967fc640 1 -- 172.21.15.55:0/3217943307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0003b90 con 0x55665f9d0ad0 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/3217943307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9d0ad0 msgr2=0x55665f9892f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/3217943307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9d0ad0 0x55665f9892f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009790 tx=0x7fa7a001e000 comp rx=0 tx=0).stop 2024-04-25T08:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/3217943307 shutdown_connections 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/3217943307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9d0ad0 0x55665f9892f0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/3217943307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9b3230 0x55665f99f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/3217943307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f99eac0 0x55665f9c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.721+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/3217943307 >> 172.21.15.55:0/3217943307 conn(0x55665f988f10 msgr2=0x55665f98a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.722+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/3217943307 shutdown_connections 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.722+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/3217943307 wait complete. 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.722+0000 7fa7ba3ac740 1 -- start start 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.722+0000 7fa7ba3ac740 1 Processor -- start 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f99eac0 0x55665fa38570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9b3230 0x55665f9d3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7ba3ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9d0ad0 0x55665f9d42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665f9b4810 con 0x55665f9b3230 2024-04-25T08:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665f9a0f40 con 0x55665f9d0ad0 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7ba3ac740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55665f9a1ac0 con 0x55665f99eac0 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7ba3ac740 10 client.0 _ll_register_callbacks cb 0x55665f983c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7b4b69640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9b3230 0x55665f9d3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7b4b69640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9b3230 0x55665f9d3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49372/0 (socket says 172.21.15.55:49372) 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7b4b69640 1 -- 172.21.15.55:0/2340755643 learned_addr learned my addr 172.21.15.55:0/2340755643 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7b536a640 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f99eac0 0x55665fa38570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7b5b6b640 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9d0ad0 0x55665f9d42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7b4b69640 1 -- 172.21.15.55:0/2340755643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f99eac0 msgr2=0x55665fa38570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f99eac0 0x55665fa38570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7b4b69640 1 -- 172.21.15.55:0/2340755643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9d0ad0 msgr2=0x55665f9d42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9d0ad0 0x55665f9d42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.723+0000 7fa7b4b69640 1 -- 172.21.15.55:0/2340755643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55665f9cee80 con 0x55665f9b3230 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa7b4b69640 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9b3230 0x55665f9d3d90 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4000f60 tx=0x7fa7a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8218dec6556dc85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa78ffff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa78ffff640 1 -- 172.21.15.55:0/2340755643 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4014e10 con 0x55665f9b3230 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa78ffff640 1 -- 172.21.15.55:0/2340755643 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa7a4010040 con 0x55665f9b3230 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2340755643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7a0009ca0 con 0x55665f9b3230 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa78ffff640 1 -- 172.21.15.55:0/2340755643 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7a402f050 con 0x55665f9b3230 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa7ba3ac740 10 client.6906 fetch_fsmap learned FSMap version 42 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2340755643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55665fa38ab0 con 0x55665f9b3230 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa78ffff640 1 -- 172.21.15.55:0/2340755643 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a0009ca0 con 0x55665f9b3230 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa78ffff640 1 -- 172.21.15.55:0/2340755643 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 42) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa7a4032020 con 0x55665f9b3230 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa7ba3ac740 10 client.6906 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa7ba3ac740 10 client.6906 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa7ba3ac740 20 client.6906 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55665f9c3d70 0x55665f9c4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa7ba3ac740 4 client.6906 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2340755643 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55665f8f8f50 con 0x55665f9c3d70 2024-04-25T08:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.724+0000 7fa7b536a640 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55665f9c3d70 0x55665f9c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa78ffff640 10 client.6906 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7b536a640 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55665f9c3d70 0x55665f9c4150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df3aba65945f88f4 server_cookie=f3fce426efddb4ae in_seq=0 out_seq=0 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa78ffff640 1 -- 172.21.15.55:0/2340755643 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55665f8f8f50 con 0x55665f9c3d70 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa78ffff640 10 client.6906 handle_command_reply: tid=0 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 1 client.6906 shutdown 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2340755643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9b3230 msgr2=0x55665f9d3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9b3230 0x55665f9d3d90 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4000f60 tx=0x7fa7a4000ed0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2340755643 shutdown_connections 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55665f9c3d70 0x55665f9c4150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55665f9d0ad0 0x55665f9d42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55665f9b3230 0x55665f9d3d90 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa78ffff640 0 client.6906 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 1 --2- 172.21.15.55:0/2340755643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55665f99eac0 0x55665fa38570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2340755643 >> 172.21.15.55:0/2340755643 conn(0x55665f988f10 msgr2=0x55665f9892f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2340755643 shutdown_connections 2024-04-25T08:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 1 -- 172.21.15.55:0/2340755643 wait complete. 2024-04-25T08:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.725+0000 7fa7ba3ac740 20 client.6906 trim_cache size 0 max 16384 2024-04-25T08:58:08.726 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:58:08.726 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T08:58:08.726 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T08:58:08.726 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6852, 2024-04-25T08:58:08.726 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T08:58:08.727 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T08:58:08.727 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T08:58:08.727 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.4469110980000002, 2024-04-25T08:58:08.727 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 42, 2024-04-25T08:58:08.727 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 74, 2024-04-25T08:58:08.727 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 74, 2024-04-25T08:58:08.727 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 5.4205551999999999 2024-04-25T08:58:08.727 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 -- 172.21.15.55:0/1942812644 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa79c06b4d0 msgr2=0x7fa79c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa79c06b4d0 0x7fa79c06d990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00b5a00 tx=0x7fa7a4007c10 comp rx=0 tx=0).stop 2024-04-25T08:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 -- 172.21.15.55:0/1942812644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7b006bac0 msgr2=0x7fa7b01e9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7b006bac0 0x7fa7b01e9870 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8035040 tx=0x7fa7a80046c0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 -- 172.21.15.55:0/1942812644 shutdown_connections 2024-04-25T08:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa79c06b4d0 0x7fa79c06d990 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b01610c0 0x7fa7b0157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b00ce240 0x7fa7b00ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 --2- 172.21.15.55:0/1942812644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7b006bac0 0x7fa7b01e9870 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 -- 172.21.15.55:0/1942812644 >> 172.21.15.55:0/1942812644 conn(0x7fa7b00cc9e0 msgr2=0x7fa7b006ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:08.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 -- 172.21.15.55:0/1942812644 shutdown_connections 2024-04-25T08:58:08.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.726+0000 7fa7b75ce640 1 -- 172.21.15.55:0/1942812644 wait complete. 2024-04-25T08:58:08.729 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:58:08.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.841+0000 7f3cd129e640 1 Processor -- start 2024-04-25T08:58:08.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.841+0000 7f3cd129e640 1 -- start start 2024-04-25T08:58:08.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.842+0000 7f3cd129e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3ccc144450 0x7f3ccc0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.842+0000 7f3cd129e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc0c75c0 con 0x7f3ccc0ccdc0 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.842+0000 7f3cd129e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc0cd2c0 con 0x7f3ccc15eaa0 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.842+0000 7f3cd129e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ccc0cdb60 con 0x7f3ccc144450 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.842+0000 7f3cca7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3ccc0ccdc0 0x7f3ccc0722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59560/0 (socket says 172.21.15.55:59560) 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.842+0000 7f3cca7fc640 1 -- 172.21.15.55:0/2054606538 learned_addr learned my addr 172.21.15.55:0/2054606538 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3ccaffd640 1 --2- 172.21.15.55:0/2054606538 >> v2:172.21.15.167:3300/0 conn(0x7f3ccc144450 0x7f3ccc0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463918773 0 0) 0x7f3ccc0c75c0 con 0x7f3ccc0ccdc0 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb8005730 con 0x7f3ccc0ccdc0 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 758481700 0 0) 0x7f3cb8005730 con 0x7f3ccc0ccdc0 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 >> v2:172.21.15.167:3300/0 conn(0x7f3ccc144450 msgr2=0x7f3ccc0c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 --2- 172.21.15.55:0/2054606538 >> v2:172.21.15.167:3300/0 conn(0x7f3ccc144450 0x7f3ccc0c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 >> v1:172.21.15.167:6789/0 conn(0x7f3ccc15eaa0 legacy=0x7f3ccc0af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0cd5a0 con 0x7f3ccc0ccdc0 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f3cb4001670 con 0x7f3ccc0ccdc0 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 >> v1:172.21.15.55:6789/0 conn(0x7f3ccc0ccdc0 legacy=0x7f3ccc0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 --2- 172.21.15.55:0/2054606538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cb8005c10 0x7f3cb8006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 --2- 172.21.15.55:0/2054606538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cb8006a10 0x7f3cb8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 --2- 172.21.15.55:0/2054606538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cb8007420 0x7f3cb800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb800e340 con 0x7f3cb8007420 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb800e4f0 con 0x7f3cb8005c10 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb800e6f0 con 0x7f3cb8006a10 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3ccb7fe640 1 --2- 172.21.15.55:0/2054606538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cb8007420 0x7f3cb800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3ccaffd640 1 --2- 172.21.15.55:0/2054606538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cb8005c10 0x7f3cb8006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.843+0000 7f3cca7fc640 1 --2- 172.21.15.55:0/2054606538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cb8006a10 0x7f3cb8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.844+0000 7f3ccb7fe640 1 -- 172.21.15.55:0/2054606538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cb8006a10 msgr2=0x7f3cb8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.844+0000 7f3ccb7fe640 1 --2- 172.21.15.55:0/2054606538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cb8006a10 0x7f3cb8006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.844+0000 7f3ccb7fe640 1 -- 172.21.15.55:0/2054606538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cb8005c10 msgr2=0x7f3cb8006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.844+0000 7f3ccb7fe640 1 --2- 172.21.15.55:0/2054606538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cb8005c10 0x7f3cb8006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.844+0000 7f3ccb7fe640 1 -- 172.21.15.55:0/2054606538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb8005730 con 0x7f3cb8007420 2024-04-25T08:58:08.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.844+0000 7f3ccb7fe640 1 -- 172.21.15.55:0/2054606538 reap_dead start 2024-04-25T08:58:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.844+0000 7f3ccb7fe640 1 --2- 172.21.15.55:0/2054606538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cb8007420 0x7f3cb800dbd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc001e20 tx=0x7f3cb8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31c79f678a7bd61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.844+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc001a70 con 0x7f3cb8007420 2024-04-25T08:58:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.844+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc02ae10 con 0x7f3cb8007420 2024-04-25T08:58:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.844+0000 7f3cc9ffb640 1 -- 172.21.15.55:0/2054606538 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc003b90 con 0x7f3cb8007420 2024-04-25T08:58:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.845+0000 7f3cd129e640 1 -- 172.21.15.55:0/2054606538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cb8007420 msgr2=0x7f3cb800dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.845+0000 7f3cd129e640 1 --2- 172.21.15.55:0/2054606538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cb8007420 0x7f3cb800dbd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc001e20 tx=0x7f3cb8007a40 comp rx=0 tx=0).stop 2024-04-25T08:58:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.845+0000 7f3cd129e640 1 -- 172.21.15.55:0/2054606538 shutdown_connections 2024-04-25T08:58:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.845+0000 7f3cd129e640 1 --2- 172.21.15.55:0/2054606538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cb8007420 0x7f3cb800dbd0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.845+0000 7f3cd129e640 1 -- 172.21.15.55:0/2054606538 >> 172.21.15.55:0/2054606538 conn(0x7f3ccc0b2370 msgr2=0x7f3ccc0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.845+0000 7f3cd129e640 1 -- 172.21.15.55:0/2054606538 shutdown_connections 2024-04-25T08:58:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.845+0000 7f3cd129e640 1 -- 172.21.15.55:0/2054606538 wait complete. 2024-04-25T08:58:08.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.846+0000 7f3cd129e640 1 Processor -- start 2024-04-25T08:58:08.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.846+0000 7f3cd129e640 1 -- start start 2024-04-25T08:58:08.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cd129e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cb8007420 0x7f3ccc1521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cd129e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ccc1434f0 0x7f3ccc15d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cd129e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ccc143970 0x7f3ccc15d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cd129e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0c7080 con 0x7f3ccc1434f0 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cd129e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc15e580 con 0x7f3cb8007420 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cd129e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0c7200 con 0x7f3ccc143970 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cca7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ccc1434f0 0x7f3ccc15d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cca7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ccc1434f0 0x7f3ccc15d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49394/0 (socket says 172.21.15.55:49394) 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cca7fc640 1 -- 172.21.15.55:0/1327791591 learned_addr learned my addr 172.21.15.55:0/1327791591 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3ccaffd640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cb8007420 0x7f3ccc1521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3ccb7fe640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ccc143970 0x7f3ccc15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cca7fc640 1 -- 172.21.15.55:0/1327791591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ccc143970 msgr2=0x7f3ccc15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cca7fc640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ccc143970 0x7f3ccc15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cca7fc640 1 -- 172.21.15.55:0/1327791591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cb8007420 msgr2=0x7f3ccc1521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cca7fc640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cb8007420 0x7f3ccc1521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:08.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3cca7fc640 1 -- 172.21.15.55:0/1327791591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0b36b0 con 0x7f3ccc1434f0 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3ccaffd640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cb8007420 0x7f3ccc1521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.847+0000 7f3ccb7fe640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ccc143970 0x7f3ccc15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.848+0000 7f3cca7fc640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ccc1434f0 0x7f3ccc15d130 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40072c0 tx=0x7f3cb40076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.848+0000 7f3cc37fe640 1 -- 172.21.15.55:0/1327791591 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb400f9c0 con 0x7f3ccc1434f0 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.848+0000 7f3cc37fe640 1 -- 172.21.15.55:0/1327791591 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb4018070 con 0x7f3ccc1434f0 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.848+0000 7f3cc37fe640 1 -- 172.21.15.55:0/1327791591 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb400fdc0 con 0x7f3ccc1434f0 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.848+0000 7f3cd129e640 1 -- 172.21.15.55:0/1327791591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc0b3990 con 0x7f3ccc1434f0 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.848+0000 7f3cd129e640 1 -- 172.21.15.55:0/1327791591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc0b3f50 con 0x7f3ccc1434f0 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.849+0000 7f3cd129e640 1 -- 172.21.15.55:0/1327791591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc0749b0 con 0x7f3ccc1434f0 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.849+0000 7f3cc37fe640 1 -- 172.21.15.55:0/1327791591 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3cb401d460 con 0x7f3ccc1434f0 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.850+0000 7f3cc37fe640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cac06b500 0x7f3cac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:08.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.850+0000 7f3cc37fe640 1 -- 172.21.15.55:0/1327791591 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3cb408a2d0 con 0x7f3ccc1434f0 2024-04-25T08:58:08.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.850+0000 7f3ccaffd640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cac06b500 0x7f3cac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:08.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.850+0000 7f3ccaffd640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cac06b500 0x7f3cac06d9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009b40 tx=0x7f3cc4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:08.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:08.854+0000 7f3cc37fe640 1 -- 172.21.15.55:0/1327791591 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3cb4059070 con 0x7f3ccc1434f0 2024-04-25T08:58:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.073+0000 7f3cd129e640 1 -- 172.21.15.55:0/1327791591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3ccc06fb80 con 0x7f3ccc1434f0 2024-04-25T08:58:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.073+0000 7f3cc37fe640 1 -- 172.21.15.55:0/1327791591 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3cb4058970 con 0x7f3ccc1434f0 2024-04-25T08:58:09.063 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:58:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 -- 172.21.15.55:0/1327791591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cac06b500 msgr2=0x7f3cac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cac06b500 0x7f3cac06d9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009b40 tx=0x7f3cc4008040 comp rx=0 tx=0).stop 2024-04-25T08:58:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 -- 172.21.15.55:0/1327791591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ccc1434f0 msgr2=0x7f3ccc15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ccc1434f0 0x7f3ccc15d130 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40072c0 tx=0x7f3cb40076c0 comp rx=0 tx=0).stop 2024-04-25T08:58:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 -- 172.21.15.55:0/1327791591 shutdown_connections 2024-04-25T08:58:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3cac06b500 0x7f3cac06d9c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ccc143970 0x7f3ccc15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ccc1434f0 0x7f3ccc15d130 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 --2- 172.21.15.55:0/1327791591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cb8007420 0x7f3ccc1521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 -- 172.21.15.55:0/1327791591 >> 172.21.15.55:0/1327791591 conn(0x7f3ccc0b2370 msgr2=0x7f3ccc15b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 -- 172.21.15.55:0/1327791591 shutdown_connections 2024-04-25T08:58:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09.075+0000 7f3cd129e640 1 -- 172.21.15.55:0/1327791591 wait complete. 2024-04-25T08:58:09.075 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:58:09.075 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:58:09.075 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T08:58:09.075 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:58:09.075 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:58:09.075 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:58:09.076 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:58:09.076 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:58:09.076 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:58:09.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:09.076 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T08:58:09.091 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:58:09.092 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42468sec preferred_lft 42468sec 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:58:09.093 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:58:09.094 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T08:58:09.094 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:58:09.094 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:58:09.094 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:58:09.094 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T08:58:09.094 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:58:09.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:09.094 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:58:09.155 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:58:09.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:09.157 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T08:58:09.213 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T08:58:09.213 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:58:09.213 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:58:09.213 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:58:09.213 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:58:09.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:09.213 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:58:09.214 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:58:09.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:58:09.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:58:09.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:58:09.214 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:58:09.268 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T08:58:09.279+0000 7f048ce25640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:58:09.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:09.300 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:58:09.355 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:58:09.356 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:58:09.356 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:58:09.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:09.356 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T08:58:09.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:58:09.421 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:58:09.476 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:58:09.476 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:58:09.476 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:58:09.531 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:58:09.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:09.531 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:58:09.613 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:58:09.613 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:58:09.613 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:58:09.622 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:58:09.622 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:58:09.622 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:58:09.622 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:58:09.622 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:58:09.626 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:58:09.627 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:58:09.627 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:58:09.627 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:58:09.627 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:58:09.627 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:58:09.627 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:58:09.627 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:58:09.627 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:58:09.627 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:58:09.628 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:58:09.628 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:58:09.628 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:58:09.629 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:58:09.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:09.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:58:09.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:09.694 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:58:09.750 INFO:teuthology.orchestra.run.smithi055.stdout:client6915 2024-04-25T08:58:09.751 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:58:09.751 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:58:09.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:09.806 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-04-25T08:58:09.865 INFO:teuthology.orchestra.run.smithi055.stdout:file_undamaged 2024-04-25T08:58:09.865 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T08:58:09.865 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T08:58:09.865 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T08:58:09.865 DEBUG:teuthology.orchestra.run.smithi055:> import json 2024-04-25T08:58:09.865 DEBUG:teuthology.orchestra.run.smithi055:> import sys 2024-04-25T08:58:09.866 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:58:09.866 DEBUG:teuthology.orchestra.run.smithi055:> try: 2024-04-25T08:58:09.866 DEBUG:teuthology.orchestra.run.smithi055:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-04-25T08:58:09.866 DEBUG:teuthology.orchestra.run.smithi055:> except OSError as e: 2024-04-25T08:58:09.866 DEBUG:teuthology.orchestra.run.smithi055:> sys.exit(e.errno) 2024-04-25T08:58:09.866 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:58:09.866 DEBUG:teuthology.orchestra.run.smithi055:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T08:58:09.866 DEBUG:teuthology.orchestra.run.smithi055:> print(json.dumps( 2024-04-25T08:58:09.866 DEBUG:teuthology.orchestra.run.smithi055:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T08:58:09.866 DEBUG:teuthology.orchestra.run.smithi055:> indent=2)) 2024-04-25T08:58:09.866 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T08:58:09.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:09 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-04-25T08:58:09.982 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-25T08:58:09.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:09.983 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T08:58:09.983 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:58:10.027 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:58:10.039 INFO:teuthology.orchestra.run.smithi055.stdout:2 2024-04-25T08:58:10.040 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:58:10.040 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:58:10.137 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:58:10.137 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:58:10.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:58:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.345+0000 7f52484f5640 1 Processor -- start 2024-04-25T08:58:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.345+0000 7f52484f5640 1 -- start start 2024-04-25T08:58:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.346+0000 7f52484f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f524015ba10 0x7f5240099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.346+0000 7f52484f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5240099f80 0x7f524006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.346+0000 7f52484f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524009a3a0 con 0x7f524006c1f0 2024-04-25T08:58:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.346+0000 7f52484f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52400cbe50 con 0x7f524015ba10 2024-04-25T08:58:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.346+0000 7f52484f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52400cfe80 con 0x7f5240099f80 2024-04-25T08:58:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.346+0000 7f5246291640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f524015ba10 0x7f5240099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.346+0000 7f5246a92640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f524006c1f0 0x7f52400cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59576/0 (socket says 172.21.15.55:59576) 2024-04-25T08:58:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.346+0000 7f5246291640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f524015ba10 0x7f5240099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49406/0 (socket says 172.21.15.55:49406) 2024-04-25T08:58:10.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.346+0000 7f5246a92640 1 -- 172.21.15.55:0/3034206105 learned_addr learned my addr 172.21.15.55:0/3034206105 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:10.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.346+0000 7f5245a90640 1 --2- 172.21.15.55:0/3034206105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5240099f80 0x7f524006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.347+0000 7f5246291640 1 -- 172.21.15.55:0/3034206105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5240099f80 msgr2=0x7f524006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:10.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.347+0000 7f5246291640 1 --2- 172.21.15.55:0/3034206105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5240099f80 0x7f524006bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.347+0000 7f5246291640 1 -- 172.21.15.55:0/3034206105 >> v1:172.21.15.55:6789/0 conn(0x7f524006c1f0 legacy=0x7f52400cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.347+0000 7f5246291640 1 -- 172.21.15.55:0/3034206105 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524006c680 con 0x7f524015ba10 2024-04-25T08:58:10.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.347+0000 7f524528f640 1 -- 172.21.15.55:0/3034206105 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800454145 0 0) 0x7f524009a3a0 con 0x7f524006c1f0 2024-04-25T08:58:10.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.347+0000 7f5245a90640 1 --2- 172.21.15.55:0/3034206105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5240099f80 0x7f524006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:10.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.347+0000 7f5246291640 1 --2- 172.21.15.55:0/3034206105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f524015ba10 0x7f5240099a40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5230009d90 tx=0x7f523002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fb4bf37e833db0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:10.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.348+0000 7f524528f640 1 -- 172.21.15.55:0/3034206105 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230007740 con 0x7f524015ba10 2024-04-25T08:58:10.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.348+0000 7f524528f640 1 -- 172.21.15.55:0/3034206105 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52300078e0 con 0x7f524015ba10 2024-04-25T08:58:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.348+0000 7f524528f640 1 -- 172.21.15.55:0/3034206105 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230007cb0 con 0x7f524015ba10 2024-04-25T08:58:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.348+0000 7f52484f5640 1 -- 172.21.15.55:0/3034206105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f524015ba10 msgr2=0x7f5240099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.348+0000 7f52484f5640 1 --2- 172.21.15.55:0/3034206105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f524015ba10 0x7f5240099a40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5230009d90 tx=0x7f523002a660 comp rx=0 tx=0).stop 2024-04-25T08:58:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.348+0000 7f52484f5640 1 -- 172.21.15.55:0/3034206105 shutdown_connections 2024-04-25T08:58:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.348+0000 7f52484f5640 1 --2- 172.21.15.55:0/3034206105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5240099f80 0x7f524006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.348+0000 7f52484f5640 1 --2- 172.21.15.55:0/3034206105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f524015ba10 0x7f5240099a40 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.348+0000 7f52484f5640 1 -- 172.21.15.55:0/3034206105 >> 172.21.15.55:0/3034206105 conn(0x7f52400b32f0 msgr2=0x7f52400b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.348+0000 7f52484f5640 1 -- 172.21.15.55:0/3034206105 shutdown_connections 2024-04-25T08:58:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.348+0000 7f52484f5640 1 -- 172.21.15.55:0/3034206105 wait complete. 2024-04-25T08:58:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.349+0000 7f52484f5640 1 Processor -- start 2024-04-25T08:58:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.349+0000 7f52484f5640 1 -- start start 2024-04-25T08:58:10.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f52484f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f524006c1f0 0x7f5240159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f52484f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5240099f80 0x7f52400af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f52484f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f524015ba10 0x7f52400afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f52484f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524006cec0 con 0x7f5240099f80 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f52484f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524006cbe0 con 0x7f524015ba10 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f52484f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52400cd930 con 0x7f524006c1f0 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f5245a90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5240099f80 0x7f52400af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f5245a90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5240099f80 0x7f52400af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49422/0 (socket says 172.21.15.55:49422) 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f5245a90640 1 -- 172.21.15.55:0/516645890 learned_addr learned my addr 172.21.15.55:0/516645890 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f5246291640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f524006c1f0 0x7f5240159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f5246a92640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f524015ba10 0x7f52400afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f5245a90640 1 -- 172.21.15.55:0/516645890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f524006c1f0 msgr2=0x7f5240159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.350+0000 7f5245a90640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f524006c1f0 0x7f5240159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.351+0000 7f5245a90640 1 -- 172.21.15.55:0/516645890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f524015ba10 msgr2=0x7f52400afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.351+0000 7f5245a90640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f524015ba10 0x7f52400afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.351+0000 7f5245a90640 1 -- 172.21.15.55:0/516645890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52400ca250 con 0x7f5240099f80 2024-04-25T08:58:10.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.351+0000 7f5245a90640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5240099f80 0x7f52400af500 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f523400e760 tx=0x7f523400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:10.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.351+0000 7f523effd640 1 -- 172.21.15.55:0/516645890 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523400f040 con 0x7f5240099f80 2024-04-25T08:58:10.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.351+0000 7f523effd640 1 -- 172.21.15.55:0/516645890 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5234004230 con 0x7f5240099f80 2024-04-25T08:58:10.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.351+0000 7f52484f5640 1 -- 172.21.15.55:0/516645890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52400ca530 con 0x7f5240099f80 2024-04-25T08:58:10.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.351+0000 7f523effd640 1 -- 172.21.15.55:0/516645890 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523400ee70 con 0x7f5240099f80 2024-04-25T08:58:10.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.351+0000 7f52484f5640 1 -- 172.21.15.55:0/516645890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52400caaf0 con 0x7f5240099f80 2024-04-25T08:58:10.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.352+0000 7f52484f5640 1 -- 172.21.15.55:0/516645890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52400749b0 con 0x7f5240099f80 2024-04-25T08:58:10.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.352+0000 7f523effd640 1 -- 172.21.15.55:0/516645890 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f523400c6d0 con 0x7f5240099f80 2024-04-25T08:58:10.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.353+0000 7f523effd640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f522c06b500 0x7f522c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.353+0000 7f523effd640 1 -- 172.21.15.55:0/516645890 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5234089ff0 con 0x7f5240099f80 2024-04-25T08:58:10.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.353+0000 7f5246291640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f522c06b500 0x7f522c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.353+0000 7f5246291640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f522c06b500 0x7f522c06d9c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5230034000 tx=0x7f523002f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:10.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.357+0000 7f523effd640 1 -- 172.21.15.55:0/516645890 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5234017020 con 0x7f5240099f80 2024-04-25T08:58:10.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.537+0000 7f52484f5640 1 -- 172.21.15.55:0/516645890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f524009a570 con 0x7f5240099f80 2024-04-25T08:58:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.538+0000 7f523effd640 1 -- 172.21.15.55:0/516645890 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16795 (secure 0 0 0) 0x7f5234081e20 con 0x7f5240099f80 2024-04-25T08:58:10.528 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:58:10.528 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":74,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:58:03.267884+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:47.819814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:48.522459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/173615501":"2024-04-26T08:58:03.267866+0000","172.21.15.55:6835/173615501":"2024-04-26T08:58:03.267866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:58:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.540+0000 7f52484f5640 1 -- 172.21.15.55:0/516645890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f522c06b500 msgr2=0x7f522c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.540+0000 7f52484f5640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f522c06b500 0x7f522c06d9c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5230034000 tx=0x7f523002f000 comp rx=0 tx=0).stop 2024-04-25T08:58:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.540+0000 7f52484f5640 1 -- 172.21.15.55:0/516645890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5240099f80 msgr2=0x7f52400af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.540+0000 7f52484f5640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5240099f80 0x7f52400af500 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f523400e760 tx=0x7f523400ec20 comp rx=0 tx=0).stop 2024-04-25T08:58:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.540+0000 7f52484f5640 1 -- 172.21.15.55:0/516645890 shutdown_connections 2024-04-25T08:58:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.540+0000 7f52484f5640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f522c06b500 0x7f522c06d9c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.540+0000 7f52484f5640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f524015ba10 0x7f52400afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.540+0000 7f52484f5640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5240099f80 0x7f52400af500 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.540+0000 7f52484f5640 1 --2- 172.21.15.55:0/516645890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f524006c1f0 0x7f5240159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.540+0000 7f52484f5640 1 -- 172.21.15.55:0/516645890 >> 172.21.15.55:0/516645890 conn(0x7f52400b32f0 msgr2=0x7f524015acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.541+0000 7f52484f5640 1 -- 172.21.15.55:0/516645890 shutdown_connections 2024-04-25T08:58:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.541+0000 7f52484f5640 1 -- 172.21.15.55:0/516645890 wait complete. 2024-04-25T08:58:10.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:57:47.819814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:57:48.522459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:58:10.541 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:58:10.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.656+0000 7f03f4d09640 1 Processor -- start 2024-04-25T08:58:10.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.656+0000 7f03f4d09640 1 -- start start 2024-04-25T08:58:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03f4d09640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03f015bbe0 0x7f03f00cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03f4d09640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f03f00cf510 0x7f03f00cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03f4d09640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03f00cff00 0x7f03f00d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03f4d09640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00cc830 con 0x7f03f015bbe0 2024-04-25T08:58:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03f4d09640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00ccb10 con 0x7f03f00cf510 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03f4d09640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00ccdf0 con 0x7f03f00cff00 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03ee59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03f015bbe0 0x7f03f00cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03ee59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03f015bbe0 0x7f03f00cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49432/0 (socket says 172.21.15.55:49432) 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03ee59c640 1 -- 172.21.15.55:0/3602937257 learned_addr learned my addr 172.21.15.55:0/3602937257 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03eed9d640 1 --2- 172.21.15.55:0/3602937257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03f00cff00 0x7f03f00d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03ee59c640 1 -- 172.21.15.55:0/3602937257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03f00cff00 msgr2=0x7f03f00d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03ee59c640 1 --2- 172.21.15.55:0/3602937257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03f00cff00 0x7f03f00d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03ee59c640 1 -- 172.21.15.55:0/3602937257 >> v2:172.21.15.167:3300/0 conn(0x7f03f00cf510 msgr2=0x7f03f00cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03e7fff640 1 --2- 172.21.15.55:0/3602937257 >> v2:172.21.15.167:3300/0 conn(0x7f03f00cf510 0x7f03f00cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03ee59c640 1 --2- 172.21.15.55:0/3602937257 >> v2:172.21.15.167:3300/0 conn(0x7f03f00cf510 0x7f03f00cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03ee59c640 1 -- 172.21.15.55:0/3602937257 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00cd0d0 con 0x7f03f015bbe0 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03eed9d640 1 --2- 172.21.15.55:0/3602937257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03f00cff00 0x7f03f00d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.657+0000 7f03e7fff640 1 --2- 172.21.15.55:0/3602937257 >> v2:172.21.15.167:3300/0 conn(0x7f03f00cf510 0x7f03f00cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.658+0000 7f03ee59c640 1 --2- 172.21.15.55:0/3602937257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03f015bbe0 0x7f03f00cd8d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f03f00b42a0 tx=0x7f03e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a4515df7255645 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.658+0000 7f03edd9b640 1 -- 172.21.15.55:0/3602937257 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0037070 con 0x7f03f015bbe0 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.658+0000 7f03edd9b640 1 -- 172.21.15.55:0/3602937257 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e0032440 con 0x7f03f015bbe0 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.658+0000 7f03edd9b640 1 -- 172.21.15.55:0/3602937257 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0032810 con 0x7f03f015bbe0 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.659+0000 7f03f4d09640 1 -- 172.21.15.55:0/3602937257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03f015bbe0 msgr2=0x7f03f00cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.659+0000 7f03f4d09640 1 --2- 172.21.15.55:0/3602937257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03f015bbe0 0x7f03f00cd8d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f03f00b42a0 tx=0x7f03e002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.659+0000 7f03f4d09640 1 -- 172.21.15.55:0/3602937257 shutdown_connections 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.659+0000 7f03f4d09640 1 --2- 172.21.15.55:0/3602937257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03f00cff00 0x7f03f00d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.659+0000 7f03f4d09640 1 --2- 172.21.15.55:0/3602937257 >> v2:172.21.15.167:3300/0 conn(0x7f03f00cf510 0x7f03f00cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.659+0000 7f03f4d09640 1 --2- 172.21.15.55:0/3602937257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03f015bbe0 0x7f03f00cd8d0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.659+0000 7f03f4d09640 1 -- 172.21.15.55:0/3602937257 >> 172.21.15.55:0/3602937257 conn(0x7f03f00b3430 msgr2=0x7f03f00b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.659+0000 7f03f4d09640 1 -- 172.21.15.55:0/3602937257 shutdown_connections 2024-04-25T08:58:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.659+0000 7f03f4d09640 1 -- 172.21.15.55:0/3602937257 wait complete. 2024-04-25T08:58:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.660+0000 7f03f4d09640 1 Processor -- start 2024-04-25T08:58:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.660+0000 7f03f4d09640 1 -- start start 2024-04-25T08:58:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03f4d09640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f00cf510 0x7f03f00c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03f4d09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03f00cff00 0x7f03f00c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03f4d09640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03f015bbe0 0x7f03f015d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03f4d09640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00cde10 con 0x7f03f00cff00 2024-04-25T08:58:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03f4d09640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f015bfc0 con 0x7f03f00cf510 2024-04-25T08:58:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03f4d09640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00cc450 con 0x7f03f015bbe0 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03e7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03f00cff00 0x7f03f00c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03e7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03f00cff00 0x7f03f00c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49438/0 (socket says 172.21.15.55:49438) 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03e7fff640 1 -- 172.21.15.55:0/1825790183 learned_addr learned my addr 172.21.15.55:0/1825790183 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03eed9d640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03f015bbe0 0x7f03f015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03ee59c640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f00cf510 0x7f03f00c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03e7fff640 1 -- 172.21.15.55:0/1825790183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03f015bbe0 msgr2=0x7f03f015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03e7fff640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03f015bbe0 0x7f03f015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03e7fff640 1 -- 172.21.15.55:0/1825790183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f00cf510 msgr2=0x7f03f00c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03e7fff640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f00cf510 0x7f03f00c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03e7fff640 1 -- 172.21.15.55:0/1825790183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f01f43d0 con 0x7f03f00cff00 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.661+0000 7f03e7fff640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03f00cff00 0x7f03f00c59b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f03d800c7f0 tx=0x7f03d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.662+0000 7f03e6ffd640 1 -- 172.21.15.55:0/1825790183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8015070 con 0x7f03f00cff00 2024-04-25T08:58:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.662+0000 7f03e6ffd640 1 -- 172.21.15.55:0/1825790183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d8007820 con 0x7f03f00cff00 2024-04-25T08:58:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.662+0000 7f03f4d09640 1 -- 172.21.15.55:0/1825790183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f01f46b0 con 0x7f03f00cff00 2024-04-25T08:58:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.662+0000 7f03e6ffd640 1 -- 172.21.15.55:0/1825790183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8007c10 con 0x7f03f00cff00 2024-04-25T08:58:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.662+0000 7f03f4d09640 1 -- 172.21.15.55:0/1825790183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f01f4080 con 0x7f03f00cff00 2024-04-25T08:58:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.663+0000 7f03f4d09640 1 -- 172.21.15.55:0/1825790183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f00750b0 con 0x7f03f00cff00 2024-04-25T08:58:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.663+0000 7f03e6ffd640 1 -- 172.21.15.55:0/1825790183 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f03d8018070 con 0x7f03f00cff00 2024-04-25T08:58:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.663+0000 7f03e6ffd640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03d006b4d0 0x7f03d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.664+0000 7f03e6ffd640 1 -- 172.21.15.55:0/1825790183 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f03d8089f50 con 0x7f03f00cff00 2024-04-25T08:58:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.664+0000 7f03ee59c640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03d006b4d0 0x7f03d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.664+0000 7f03ee59c640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03d006b4d0 0x7f03d006d990 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f03e0034000 tx=0x7f03e002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:10.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.668+0000 7f03e6ffd640 1 -- 172.21.15.55:0/1825790183 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f03d8058720 con 0x7f03f00cff00 2024-04-25T08:58:10.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.848+0000 7f03f4d09640 1 -- 172.21.15.55:0/1825790183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03f00d0740 con 0x7f03f00cff00 2024-04-25T08:58:10.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.849+0000 7f03e6ffd640 1 -- 172.21.15.55:0/1825790183 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03d805c7c0 con 0x7f03f00cff00 2024-04-25T08:58:10.838 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:58:10.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.850+0000 7f03f4d09640 1 -- 172.21.15.55:0/1825790183 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03d006b4d0 msgr2=0x7f03d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.850+0000 7f03f4d09640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03d006b4d0 0x7f03d006d990 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f03e0034000 tx=0x7f03e002e000 comp rx=0 tx=0).stop 2024-04-25T08:58:10.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.850+0000 7f03f4d09640 1 -- 172.21.15.55:0/1825790183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03f00cff00 msgr2=0x7f03f00c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.850+0000 7f03f4d09640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03f00cff00 0x7f03f00c59b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f03d800c7f0 tx=0x7f03d800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.850+0000 7f03f4d09640 1 -- 172.21.15.55:0/1825790183 shutdown_connections 2024-04-25T08:58:10.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.850+0000 7f03f4d09640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03d006b4d0 0x7f03d006d990 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.850+0000 7f03f4d09640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03f015bbe0 0x7f03f015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.850+0000 7f03f4d09640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03f00cff00 0x7f03f00c59b0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.850+0000 7f03f4d09640 1 --2- 172.21.15.55:0/1825790183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f00cf510 0x7f03f00c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.850+0000 7f03f4d09640 1 -- 172.21.15.55:0/1825790183 >> 172.21.15.55:0/1825790183 conn(0x7f03f00b3430 msgr2=0x7f03f00c6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:10.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.851+0000 7f03f4d09640 1 -- 172.21.15.55:0/1825790183 shutdown_connections 2024-04-25T08:58:10.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.851+0000 7f03f4d09640 1 -- 172.21.15.55:0/1825790183 wait complete. 2024-04-25T08:58:10.851 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:58:10.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.966+0000 7fb82d316640 1 Processor -- start 2024-04-25T08:58:10.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.966+0000 7fb82d316640 1 -- start start 2024-04-25T08:58:10.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.967+0000 7fb82d316640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8280cfe70 0x7fb8280ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.967+0000 7fb82d316640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82815f000 con 0x7fb82815b7b0 2024-04-25T08:58:10.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.967+0000 7fb82d316640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82815ed20 con 0x7fb82815e110 2024-04-25T08:58:10.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.967+0000 7fb82d316640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8280ced00 con 0x7fb8280cfe70 2024-04-25T08:58:10.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.967+0000 7fb81ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8280cfe70 0x7fb8280ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.967+0000 7fb826ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb82815b7b0 0x7fb8280cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59578/0 (socket says 172.21.15.55:59578) 2024-04-25T08:58:10.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.967+0000 7fb826ffd640 1 -- 172.21.15.55:0/3771265857 learned_addr learned my addr 172.21.15.55:0/3771265857 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:10.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.967+0000 7fb81ffff640 1 -- 172.21.15.55:0/3771265857 >> v1:172.21.15.167:6789/0 conn(0x7fb82815e110 legacy=0x7fb82815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:10.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.967+0000 7fb81ffff640 1 -- 172.21.15.55:0/3771265857 >> v1:172.21.15.55:6789/0 conn(0x7fb82815b7b0 legacy=0x7fb8280cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.967+0000 7fb81ffff640 1 -- 172.21.15.55:0/3771265857 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280cdce0 con 0x7fb8280cfe70 2024-04-25T08:58:10.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.968+0000 7fb81ffff640 1 --2- 172.21.15.55:0/3771265857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8280cfe70 0x7fb8280ce7c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb8100097a0 tx=0x7fb81002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a56928cea11f48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:10.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.968+0000 7fb8267fc640 1 -- 172.21.15.55:0/3771265857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810037070 con 0x7fb8280cfe70 2024-04-25T08:58:10.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.968+0000 7fb8267fc640 1 -- 172.21.15.55:0/3771265857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb810032440 con 0x7fb8280cfe70 2024-04-25T08:58:10.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.968+0000 7fb8267fc640 1 -- 172.21.15.55:0/3771265857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810032810 con 0x7fb8280cfe70 2024-04-25T08:58:10.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.968+0000 7fb82d316640 1 -- 172.21.15.55:0/3771265857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8280cfe70 msgr2=0x7fb8280ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.968+0000 7fb82d316640 1 --2- 172.21.15.55:0/3771265857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8280cfe70 0x7fb8280ce7c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb8100097a0 tx=0x7fb81002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.969+0000 7fb82d316640 1 -- 172.21.15.55:0/3771265857 shutdown_connections 2024-04-25T08:58:10.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.969+0000 7fb82d316640 1 --2- 172.21.15.55:0/3771265857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8280cfe70 0x7fb8280ce7c0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.969+0000 7fb82d316640 1 -- 172.21.15.55:0/3771265857 >> 172.21.15.55:0/3771265857 conn(0x7fb82806f4a0 msgr2=0x7fb82806f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:10.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.969+0000 7fb82d316640 1 -- 172.21.15.55:0/3771265857 shutdown_connections 2024-04-25T08:58:10.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.969+0000 7fb82d316640 1 -- 172.21.15.55:0/3771265857 wait complete. 2024-04-25T08:58:10.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.970+0000 7fb82d316640 1 Processor -- start 2024-04-25T08:58:10.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.970+0000 7fb82d316640 1 -- start start 2024-04-25T08:58:10.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.970+0000 7fb82d316640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8280cfe70 0x7fb82814bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.970+0000 7fb82d316640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82815b7b0 0x7fb8280b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.970+0000 7fb82d316640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb82815e110 0x7fb8280b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.970+0000 7fb82d316640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8281619f0 con 0x7fb8280cfe70 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.970+0000 7fb82d316640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8280ce330 con 0x7fb82815e110 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.970+0000 7fb82d316640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8280cc080 con 0x7fb82815b7b0 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb826ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8280cfe70 0x7fb82814bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb826ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8280cfe70 0x7fb82814bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49462/0 (socket says 172.21.15.55:49462) 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb826ffd640 1 -- 172.21.15.55:0/1395766793 learned_addr learned my addr 172.21.15.55:0/1395766793 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb8277fe640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb82815e110 0x7fb8280b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb81ffff640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82815b7b0 0x7fb8280b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb826ffd640 1 -- 172.21.15.55:0/1395766793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82815b7b0 msgr2=0x7fb8280b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb826ffd640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82815b7b0 0x7fb8280b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb826ffd640 1 -- 172.21.15.55:0/1395766793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb82815e110 msgr2=0x7fb8280b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb826ffd640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb82815e110 0x7fb8280b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb826ffd640 1 -- 172.21.15.55:0/1395766793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280cbb30 con 0x7fb8280cfe70 2024-04-25T08:58:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb81ffff640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82815b7b0 0x7fb8280b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb8277fe640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb82815e110 0x7fb8280b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb826ffd640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8280cfe70 0x7fb82814bea0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb81800c430 tx=0x7fb81800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb81f7fe640 1 -- 172.21.15.55:0/1395766793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818017070 con 0x7fb8280cfe70 2024-04-25T08:58:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb81f7fe640 1 -- 172.21.15.55:0/1395766793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb818005ce0 con 0x7fb8280cfe70 2024-04-25T08:58:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb82d316640 1 -- 172.21.15.55:0/1395766793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8280cad70 con 0x7fb8280cfe70 2024-04-25T08:58:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb81f7fe640 1 -- 172.21.15.55:0/1395766793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8180072f0 con 0x7fb8280cfe70 2024-04-25T08:58:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.971+0000 7fb82d316640 1 -- 172.21.15.55:0/1395766793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8280cb330 con 0x7fb8280cfe70 2024-04-25T08:58:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.972+0000 7fb82d316640 1 -- 172.21.15.55:0/1395766793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8280750b0 con 0x7fb8280cfe70 2024-04-25T08:58:10.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.973+0000 7fb81f7fe640 1 -- 172.21.15.55:0/1395766793 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb81801a070 con 0x7fb8280cfe70 2024-04-25T08:58:10.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.973+0000 7fb81f7fe640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb80806b4d0 0x7fb80806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:10.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.973+0000 7fb81f7fe640 1 -- 172.21.15.55:0/1395766793 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb818089680 con 0x7fb8280cfe70 2024-04-25T08:58:10.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.973+0000 7fb81ffff640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb80806b4d0 0x7fb80806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:10.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.974+0000 7fb81ffff640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb80806b4d0 0x7fb80806d990 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb810034000 tx=0x7fb81002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:10.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:10.977+0000 7fb81f7fe640 1 -- 172.21.15.55:0/1395766793 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8280cbb30 con 0x7fb8280cfe70 2024-04-25T08:58:11.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.156+0000 7fb82d316640 1 -- 172.21.15.55:0/1395766793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8280b7870 con 0x7fb8280cfe70 2024-04-25T08:58:11.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.157+0000 7fb81f7fe640 1 -- 172.21.15.55:0/1395766793 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8180584a0 con 0x7fb8280cfe70 2024-04-25T08:58:11.168 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:58:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.158+0000 7fb82d316640 1 -- 172.21.15.55:0/1395766793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb80806b4d0 msgr2=0x7fb80806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.158+0000 7fb82d316640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb80806b4d0 0x7fb80806d990 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb810034000 tx=0x7fb81002e000 comp rx=0 tx=0).stop 2024-04-25T08:58:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.158+0000 7fb82d316640 1 -- 172.21.15.55:0/1395766793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8280cfe70 msgr2=0x7fb82814bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.158+0000 7fb82d316640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8280cfe70 0x7fb82814bea0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb81800c430 tx=0x7fb81800c8f0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.159+0000 7fb82d316640 1 -- 172.21.15.55:0/1395766793 shutdown_connections 2024-04-25T08:58:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.159+0000 7fb82d316640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb80806b4d0 0x7fb80806d990 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.159+0000 7fb82d316640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb82815e110 0x7fb8280b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.159+0000 7fb82d316640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82815b7b0 0x7fb8280b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.159+0000 7fb82d316640 1 --2- 172.21.15.55:0/1395766793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8280cfe70 0x7fb82814bea0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.159+0000 7fb82d316640 1 -- 172.21.15.55:0/1395766793 >> 172.21.15.55:0/1395766793 conn(0x7fb82806f4a0 msgr2=0x7fb82806bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:11.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.159+0000 7fb82d316640 1 -- 172.21.15.55:0/1395766793 shutdown_connections 2024-04-25T08:58:11.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.159+0000 7fb82d316640 1 -- 172.21.15.55:0/1395766793 wait complete. 2024-04-25T08:58:11.171 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:58:11.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.286+0000 7fd9a8e2a640 1 Processor -- start 2024-04-25T08:58:11.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.286+0000 7fd9a8e2a640 1 -- start start 2024-04-25T08:58:11.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.286+0000 7fd9a8e2a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd9a40d0610 0x7fd9a40cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.286+0000 7fd9a8e2a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a40cc830 con 0x7fd9a40cf510 2024-04-25T08:58:11.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.286+0000 7fd9a8e2a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a40ccb10 con 0x7fd9a415bbe0 2024-04-25T08:58:11.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.286+0000 7fd9a8e2a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a40ccdf0 con 0x7fd9a40d0610 2024-04-25T08:58:11.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd99bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd9a40cf510 0x7fd9a40cff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59584/0 (socket says 172.21.15.55:59584) 2024-04-25T08:58:11.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd99bfff640 1 -- 172.21.15.55:0/1181698486 learned_addr learned my addr 172.21.15.55:0/1181698486 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:11.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a2d9d640 1 --2- 172.21.15.55:0/1181698486 >> v2:172.21.15.167:3300/0 conn(0x7fd9a40d0610 0x7fd9a40cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605437669 0 0) 0x7fd9a40cc830 con 0x7fd9a40cf510 2024-04-25T08:58:11.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd990003520 con 0x7fd9a40cf510 2024-04-25T08:58:11.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3999016008 0 0) 0x7fd990003520 con 0x7fd9a40cf510 2024-04-25T08:58:11.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 >> v2:172.21.15.167:3300/0 conn(0x7fd9a40d0610 msgr2=0x7fd9a40cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:11.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 --2- 172.21.15.55:0/1181698486 >> v2:172.21.15.167:3300/0 conn(0x7fd9a40d0610 0x7fd9a40cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 >> v1:172.21.15.167:6789/0 conn(0x7fd9a415bbe0 legacy=0x7fd9a40cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a40cd0d0 con 0x7fd9a40cf510 2024-04-25T08:58:11.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fd98c001670 con 0x7fd9a40cf510 2024-04-25T08:58:11.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 >> v1:172.21.15.55:6789/0 conn(0x7fd9a40cf510 legacy=0x7fd9a40cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9900039b0 0x7fd990003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd990004800 0x7fd990004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900051c0 0x7fd99000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40ccdf0 con 0x7fd9900051c0 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99000c060 con 0x7fd9900039b0 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99000c260 con 0x7fd990004800 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a2d9d640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900051c0 0x7fd99000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd99bfff640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd990004800 0x7fd990004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.287+0000 7fd9a259c640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9900039b0 0x7fd990003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.288+0000 7fd9a2d9d640 1 -- 172.21.15.55:0/1181698486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd990004800 msgr2=0x7fd990004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.288+0000 7fd9a2d9d640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd990004800 0x7fd990004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.288+0000 7fd9a2d9d640 1 -- 172.21.15.55:0/1181698486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9900039b0 msgr2=0x7fd990003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.288+0000 7fd9a2d9d640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9900039b0 0x7fd990003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.288+0000 7fd9a2d9d640 1 -- 172.21.15.55:0/1181698486 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd990003520 con 0x7fd9900051c0 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.288+0000 7fd9a259c640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9900039b0 0x7fd990003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.288+0000 7fd99bfff640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd990004800 0x7fd990004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.288+0000 7fd9a2d9d640 1 -- 172.21.15.55:0/1181698486 reap_dead start 2024-04-25T08:58:11.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.288+0000 7fd9a2d9d640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900051c0 0x7fd99000b9c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4072640 tx=0x7fd990005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbf6a43d8b6d7f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:11.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.288+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c037070 con 0x7fd9900051c0 2024-04-25T08:58:11.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.288+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c02e050 con 0x7fd9900051c0 2024-04-25T08:58:11.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.289+0000 7fd9a1d9b640 1 -- 172.21.15.55:0/1181698486 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c009c10 con 0x7fd9900051c0 2024-04-25T08:58:11.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.289+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/1181698486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900051c0 msgr2=0x7fd99000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.289+0000 7fd9a8e2a640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900051c0 0x7fd99000b9c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4072640 tx=0x7fd990005830 comp rx=0 tx=0).stop 2024-04-25T08:58:11.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.289+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/1181698486 shutdown_connections 2024-04-25T08:58:11.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.289+0000 7fd9a8e2a640 1 --2- 172.21.15.55:0/1181698486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900051c0 0x7fd99000b9c0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.289+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/1181698486 >> 172.21.15.55:0/1181698486 conn(0x7fd9a40b3430 msgr2=0x7fd9a40b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:11.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.289+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/1181698486 shutdown_connections 2024-04-25T08:58:11.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.289+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/1181698486 wait complete. 2024-04-25T08:58:11.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.290+0000 7fd9a8e2a640 1 Processor -- start 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.290+0000 7fd9a8e2a640 1 -- start start 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.291+0000 7fd9a8e2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9900051c0 0x7fd9a41550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.291+0000 7fd9a8e2a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9a4149000 0x7fd9a4155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.291+0000 7fd9a8e2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a40b6e50 0x7fd9a4149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.291+0000 7fd9a8e2a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40cc450 con 0x7fd9a40b6e50 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.291+0000 7fd9a8e2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a415bfc0 con 0x7fd9900051c0 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.291+0000 7fd9a8e2a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40cc5d0 con 0x7fd9a4149000 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.291+0000 7fd9a2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a40b6e50 0x7fd9a4149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.291+0000 7fd9a2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a40b6e50 0x7fd9a4149570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49486/0 (socket says 172.21.15.55:49486) 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.291+0000 7fd9a2d9d640 1 -- 172.21.15.55:0/3640757328 learned_addr learned my addr 172.21.15.55:0/3640757328 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.291+0000 7fd9a259c640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9900051c0 0x7fd9a41550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd99bfff640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9a4149000 0x7fd9a4155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd9a2d9d640 1 -- 172.21.15.55:0/3640757328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9a4149000 msgr2=0x7fd9a4155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd9a2d9d640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9a4149000 0x7fd9a4155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd9a2d9d640 1 -- 172.21.15.55:0/3640757328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9900051c0 msgr2=0x7fd9a41550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd9a2d9d640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9900051c0 0x7fd9a41550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd9a2d9d640 1 -- 172.21.15.55:0/3640757328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a4155d90 con 0x7fd9a40b6e50 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd9a2d9d640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a40b6e50 0x7fd9a4149570 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00e200 tx=0x7fd99c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd99affd640 1 -- 172.21.15.55:0/3640757328 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c037070 con 0x7fd9a40b6e50 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd99affd640 1 -- 172.21.15.55:0/3640757328 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c044070 con 0x7fd9a40b6e50 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd99affd640 1 -- 172.21.15.55:0/3640757328 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c009c10 con 0x7fd9a40b6e50 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/3640757328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a40b6090 con 0x7fd9a40b6e50 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.292+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/3640757328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a40b6650 con 0x7fd9a40b6e50 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.293+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/3640757328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a40750b0 con 0x7fd9a40b6e50 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.293+0000 7fd99affd640 1 -- 172.21.15.55:0/3640757328 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd99c03eaf0 con 0x7fd9a40b6e50 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.294+0000 7fd99affd640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd98406b500 0x7fd98406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.294+0000 7fd99affd640 1 -- 172.21.15.55:0/3640757328 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd99c0aaea0 con 0x7fd9a40b6e50 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.294+0000 7fd9a259c640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd98406b500 0x7fd98406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.294+0000 7fd9a259c640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd98406b500 0x7fd98406d9c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd994000c00 tx=0x7fd994009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:11.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.298+0000 7fd99affd640 1 -- 172.21.15.55:0/3640757328 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd99c079660 con 0x7fd9a40b6e50 2024-04-25T08:58:11.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.479+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/3640757328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9a40c6ad0 con 0x7fd9a40b6e50 2024-04-25T08:58:11.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.479+0000 7fd99affd640 1 -- 172.21.15.55:0/3640757328 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd99c07d700 con 0x7fd9a40b6e50 2024-04-25T08:58:11.469 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/3640757328 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd98406b500 msgr2=0x7fd98406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd98406b500 0x7fd98406d9c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd994000c00 tx=0x7fd994009040 comp rx=0 tx=0).stop 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/3640757328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a40b6e50 msgr2=0x7fd9a4149570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a40b6e50 0x7fd9a4149570 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00e200 tx=0x7fd99c009750 comp rx=0 tx=0).stop 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/3640757328 shutdown_connections 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd98406b500 0x7fd98406d9c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a40b6e50 0x7fd9a4149570 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9a4149000 0x7fd9a4155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 --2- 172.21.15.55:0/3640757328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9900051c0 0x7fd9a41550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/3640757328 >> 172.21.15.55:0/3640757328 conn(0x7fd9a40b3430 msgr2=0x7fd9a40c4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/3640757328 shutdown_connections 2024-04-25T08:58:11.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.481+0000 7fd9a8e2a640 1 -- 172.21.15.55:0/3640757328 wait complete. 2024-04-25T08:58:11.481 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:58:11.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.593+0000 7f98eee1b640 1 Processor -- start 2024-04-25T08:58:11.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.593+0000 7f98eee1b640 1 -- start start 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.594+0000 7f98eee1b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f98e80b35e0 0x7f98e8162350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.594+0000 7f98eee1b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f98e8161400 0x7f98e80cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.594+0000 7f98eee1b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e80cfed0 con 0x7f98e80b3f80 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.594+0000 7f98eee1b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e8162890 con 0x7f98e80b35e0 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.594+0000 7f98eee1b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e80cf850 con 0x7f98e8161400 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.594+0000 7f98ecbb7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f98e80b35e0 0x7f98e8162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.594+0000 7f98e7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f98e80b3f80 0x7f98e8160cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59598/0 (socket says 172.21.15.55:59598) 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.594+0000 7f98e7fff640 1 -- 172.21.15.55:0/4258780137 learned_addr learned my addr 172.21.15.55:0/4258780137 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.595+0000 7f98ecbb7640 1 -- 172.21.15.55:0/4258780137 >> v2:172.21.15.167:3300/0 conn(0x7f98e8161400 msgr2=0x7f98e80cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.595+0000 7f98ed3b8640 1 --2- 172.21.15.55:0/4258780137 >> v2:172.21.15.167:3300/0 conn(0x7f98e8161400 0x7f98e80cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.595+0000 7f98ecbb7640 1 --2- 172.21.15.55:0/4258780137 >> v2:172.21.15.167:3300/0 conn(0x7f98e8161400 0x7f98e80cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.595+0000 7f98e77fe640 1 -- 172.21.15.55:0/4258780137 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598705432 0 0) 0x7f98e80cfed0 con 0x7f98e80b3f80 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.595+0000 7f98ecbb7640 1 -- 172.21.15.55:0/4258780137 >> v1:172.21.15.55:6789/0 conn(0x7f98e80b3f80 legacy=0x7f98e8160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.595+0000 7f98ecbb7640 1 -- 172.21.15.55:0/4258780137 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80cfb30 con 0x7f98e80b35e0 2024-04-25T08:58:11.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.595+0000 7f98ecbb7640 1 --2- 172.21.15.55:0/4258780137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e80b35e0 0x7f98e8162350 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f98e80732a0 tx=0x7f98d802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3821b7b77aff01d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:11.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.596+0000 7f98e77fe640 1 -- 172.21.15.55:0/4258780137 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8037070 con 0x7f98e80b35e0 2024-04-25T08:58:11.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.596+0000 7f98e77fe640 1 -- 172.21.15.55:0/4258780137 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d8032440 con 0x7f98e80b35e0 2024-04-25T08:58:11.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.596+0000 7f98e77fe640 1 -- 172.21.15.55:0/4258780137 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d802ae60 con 0x7f98e80b35e0 2024-04-25T08:58:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.596+0000 7f98eee1b640 1 -- 172.21.15.55:0/4258780137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e80b35e0 msgr2=0x7f98e8162350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.596+0000 7f98eee1b640 1 --2- 172.21.15.55:0/4258780137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e80b35e0 0x7f98e8162350 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f98e80732a0 tx=0x7f98d802a110 comp rx=0 tx=0).stop 2024-04-25T08:58:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.596+0000 7f98eee1b640 1 -- 172.21.15.55:0/4258780137 shutdown_connections 2024-04-25T08:58:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.596+0000 7f98eee1b640 1 --2- 172.21.15.55:0/4258780137 >> v2:172.21.15.167:3300/0 conn(0x7f98e8161400 0x7f98e80cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.596+0000 7f98eee1b640 1 --2- 172.21.15.55:0/4258780137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e80b35e0 0x7f98e8162350 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.596+0000 7f98eee1b640 1 -- 172.21.15.55:0/4258780137 >> 172.21.15.55:0/4258780137 conn(0x7f98e806f4c0 msgr2=0x7f98e806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.596+0000 7f98eee1b640 1 -- 172.21.15.55:0/4258780137 shutdown_connections 2024-04-25T08:58:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.596+0000 7f98eee1b640 1 -- 172.21.15.55:0/4258780137 wait complete. 2024-04-25T08:58:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.597+0000 7f98eee1b640 1 Processor -- start 2024-04-25T08:58:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.597+0000 7f98eee1b640 1 -- start start 2024-04-25T08:58:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.598+0000 7f98eee1b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98e80b35e0 0x7f98e8159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.598+0000 7f98eee1b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e80b3f80 0x7f98e81488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.598+0000 7f98eee1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e8161400 0x7f98e80b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.598+0000 7f98eee1b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80d05d0 con 0x7f98e8161400 2024-04-25T08:58:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.598+0000 7f98eee1b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80d0450 con 0x7f98e80b35e0 2024-04-25T08:58:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.598+0000 7f98eee1b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80b39c0 con 0x7f98e80b3f80 2024-04-25T08:58:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.598+0000 7f98ed3b8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e8161400 0x7f98e80b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.598+0000 7f98ed3b8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e8161400 0x7f98e80b6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49504/0 (socket says 172.21.15.55:49504) 2024-04-25T08:58:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.598+0000 7f98ed3b8640 1 -- 172.21.15.55:0/2885790681 learned_addr learned my addr 172.21.15.55:0/2885790681 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98e7fff640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e80b3f80 0x7f98e81488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98ed3b8640 1 -- 172.21.15.55:0/2885790681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e80b3f80 msgr2=0x7f98e81488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98ecbb7640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98e80b35e0 0x7f98e8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98ed3b8640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e80b3f80 0x7f98e81488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98ed3b8640 1 -- 172.21.15.55:0/2885790681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98e80b35e0 msgr2=0x7f98e8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98ed3b8640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98e80b35e0 0x7f98e8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98ed3b8640 1 -- 172.21.15.55:0/2885790681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e8159f90 con 0x7f98e8161400 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98e7fff640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e80b3f80 0x7f98e81488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98ecbb7640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98e80b35e0 0x7f98e8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98ed3b8640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e8161400 0x7f98e80b6f90 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f98e000cc60 tx=0x7f98e000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98e57fa640 1 -- 172.21.15.55:0/2885790681 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0003990 con 0x7f98e8161400 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98e57fa640 1 -- 172.21.15.55:0/2885790681 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0003b30 con 0x7f98e8161400 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98e57fa640 1 -- 172.21.15.55:0/2885790681 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0004020 con 0x7f98e8161400 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98eee1b640 1 -- 172.21.15.55:0/2885790681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e815a270 con 0x7f98e8161400 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.599+0000 7f98eee1b640 1 -- 172.21.15.55:0/2885790681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e815a830 con 0x7f98e8161400 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.600+0000 7f98eee1b640 1 -- 172.21.15.55:0/2885790681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e80750b0 con 0x7f98e8161400 2024-04-25T08:58:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.601+0000 7f98e57fa640 1 -- 172.21.15.55:0/2885790681 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f98e00041c0 con 0x7f98e8161400 2024-04-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.601+0000 7f98e57fa640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98d406b4d0 0x7f98d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.601+0000 7f98ecbb7640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98d406b4d0 0x7f98d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.601+0000 7f98e57fa640 1 -- 172.21.15.55:0/2885790681 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f98e008a700 con 0x7f98e8161400 2024-04-25T08:58:11.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.602+0000 7f98ecbb7640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98d406b4d0 0x7f98d406d990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f98d8034000 tx=0x7f98d802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:11.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.606+0000 7f98e57fa640 1 -- 172.21.15.55:0/2885790681 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98e0014030 con 0x7f98e8161400 2024-04-25T08:58:11.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.801+0000 7f98eee1b640 1 -- 172.21.15.55:0/2885790681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f98e80c4b60 con 0x7f98e8161400 2024-04-25T08:58:11.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.802+0000 7f98e57fa640 1 -- 172.21.15.55:0/2885790681 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v74) v1 ==== 80+0+120 (secure 0 0 0) 0x7f98e0059520 con 0x7f98e8161400 2024-04-25T08:58:11.791 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/173615501 2024-04-26T08:58:03.267866+0000 2024-04-25T08:58:11.791 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/173615501 2024-04-26T08:58:03.267866+0000 2024-04-25T08:58:11.791 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-04-25T08:58:11.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 -- 172.21.15.55:0/2885790681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98d406b4d0 msgr2=0x7f98d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98d406b4d0 0x7f98d406d990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f98d8034000 tx=0x7f98d802e000 comp rx=0 tx=0).stop 2024-04-25T08:58:11.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 -- 172.21.15.55:0/2885790681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e8161400 msgr2=0x7f98e80b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:11.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e8161400 0x7f98e80b6f90 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f98e000cc60 tx=0x7f98e000a5c0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 -- 172.21.15.55:0/2885790681 shutdown_connections 2024-04-25T08:58:11.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98d406b4d0 0x7f98d406d990 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e8161400 0x7f98e80b6f90 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e80b3f80 0x7f98e81488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 --2- 172.21.15.55:0/2885790681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98e80b35e0 0x7f98e8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:11.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 -- 172.21.15.55:0/2885790681 >> 172.21.15.55:0/2885790681 conn(0x7f98e806f4c0 msgr2=0x7f98e8160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:11.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 -- 172.21.15.55:0/2885790681 shutdown_connections 2024-04-25T08:58:11.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:11.804+0000 7f98eee1b640 1 -- 172.21.15.55:0/2885790681 wait complete. 2024-04-25T08:58:11.804 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:58:11.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:11.804 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:58:11.831 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:58:11.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:11.831 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:58:11.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:11.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-04-25T08:58:12.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.042+0000 7ff7a4cb3640 1 Processor -- start 2024-04-25T08:58:12.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.042+0000 7ff7a4cb3640 1 -- start start 2024-04-25T08:58:12.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.043+0000 7ff7a4cb3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff7a01610b0 0x7ff7a00b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.043+0000 7ff7a4cb3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7a01618d0 0x7ff7a00ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.043+0000 7ff7a4cb3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a0162040 con 0x7ff7a00ced70 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.043+0000 7ff7a4cb3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a00d1ea0 con 0x7ff7a01610b0 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.043+0000 7ff7a4cb3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0162320 con 0x7ff7a01618d0 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.043+0000 7ff79ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff7a00ced70 0x7ff7a006c250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59606/0 (socket says 172.21.15.55:59606) 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.043+0000 7ff79ed9d640 1 -- 172.21.15.55:0/3047393939 learned_addr learned my addr 172.21.15.55:0/3047393939 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.043+0000 7ff79dd9b640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7a01618d0 0x7ff7a00ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.043+0000 7ff79e59c640 1 --2- 172.21.15.55:0/3047393939 >> v2:172.21.15.167:3300/0 conn(0x7ff7a01610b0 0x7ff7a00b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.043+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831459430 0 0) 0x7ff7a0162040 con 0x7ff7a00ced70 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.043+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff78c003520 con 0x7ff7a00ced70 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1350209539 0 0) 0x7ff78c003520 con 0x7ff7a00ced70 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7a01618d0 msgr2=0x7ff7a00ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7a01618d0 0x7ff7a00ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 >> v2:172.21.15.167:3300/0 conn(0x7ff7a01610b0 msgr2=0x7ff7a00b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 --2- 172.21.15.55:0/3047393939 >> v2:172.21.15.167:3300/0 conn(0x7ff7a01610b0 0x7ff7a00b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0162600 con 0x7ff7a00ced70 2024-04-25T08:58:12.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7ff798001670 con 0x7ff7a00ced70 2024-04-25T08:58:12.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 >> v1:172.21.15.55:6789/0 conn(0x7ff7a00ced70 legacy=0x7ff7a006c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7a01618d0 0x7ff78c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff78c003f30 0x7ff78c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff78c004d40 0x7ff78c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00d1ea0 con 0x7ff78c004d40 2024-04-25T08:58:12.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0162320 con 0x7ff78c003f30 2024-04-25T08:58:12.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c00ba10 con 0x7ff7a01618d0 2024-04-25T08:58:12.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff78c004d40 0x7ff78c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79e59c640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7a01618d0 0x7ff78c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79dd9b640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff78c003f30 0x7ff78c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79ed9d640 1 -- 172.21.15.55:0/3047393939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7a01618d0 msgr2=0x7ff78c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7a01618d0 0x7ff78c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79ed9d640 1 -- 172.21.15.55:0/3047393939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff78c003f30 msgr2=0x7ff78c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff78c003f30 0x7ff78c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.044+0000 7ff79ed9d640 1 -- 172.21.15.55:0/3047393939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c003520 con 0x7ff78c004d40 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.045+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff78c004d40 0x7ff78c0051c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c210 tx=0x7ff78c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33154432a60e94b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.045+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798007d50 con 0x7ff78c004d40 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.045+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff798005ad0 con 0x7ff78c004d40 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.045+0000 7ff79d59a640 1 -- 172.21.15.55:0/3047393939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798007070 con 0x7ff78c004d40 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.046+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/3047393939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff78c004d40 msgr2=0x7ff78c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.046+0000 7ff7a4cb3640 1 --2- 172.21.15.55:0/3047393939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff78c004d40 0x7ff78c0051c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c210 tx=0x7ff78c005830 comp rx=0 tx=0).stop 2024-04-25T08:58:12.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.046+0000 7ff79ed9d640 1 -- 172.21.15.55:0/3047393939 reap_dead start 2024-04-25T08:58:12.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.046+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/3047393939 shutdown_connections 2024-04-25T08:58:12.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.046+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/3047393939 >> 172.21.15.55:0/3047393939 conn(0x7ff7a00b5570 msgr2=0x7ff7a00b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.046+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/3047393939 shutdown_connections 2024-04-25T08:58:12.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.046+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/3047393939 wait complete. 2024-04-25T08:58:12.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.047+0000 7ff7a4cb3640 1 Processor -- start 2024-04-25T08:58:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.047+0000 7ff7a4cb3640 1 -- start start 2024-04-25T08:58:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff7a4cb3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff78c004d40 0x7ff7a015d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff7a4cb3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7a015ba40 0x7ff7a015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff7a4cb3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7a015f060 0x7ff7a015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff7a4cb3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0161d10 con 0x7ff7a015f060 2024-04-25T08:58:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff7a4cb3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00b6c00 con 0x7ff7a015ba40 2024-04-25T08:58:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff7a4cb3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00d3620 con 0x7ff78c004d40 2024-04-25T08:58:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff79ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7a015f060 0x7ff7a015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff79ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7a015f060 0x7ff7a015f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49524/0 (socket says 172.21.15.55:49524) 2024-04-25T08:58:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff79ed9d640 1 -- 172.21.15.55:0/2281129457 learned_addr learned my addr 172.21.15.55:0/2281129457 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff79e59c640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff78c004d40 0x7ff7a015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff79dd9b640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7a015ba40 0x7ff7a015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff79ed9d640 1 -- 172.21.15.55:0/2281129457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff78c004d40 msgr2=0x7ff7a015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff78c004d40 0x7ff7a015d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff79ed9d640 1 -- 172.21.15.55:0/2281129457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7a015ba40 msgr2=0x7ff7a015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7a015ba40 0x7ff7a015bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff79ed9d640 1 -- 172.21.15.55:0/2281129457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a015fd90 con 0x7ff7a015f060 2024-04-25T08:58:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.048+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7a015f060 0x7ff7a015f4e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c300 tx=0x7ff7a00b6b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.049+0000 7ff796ffd640 1 -- 172.21.15.55:0/2281129457 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798044070 con 0x7ff7a015f060 2024-04-25T08:58:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.049+0000 7ff796ffd640 1 -- 172.21.15.55:0/2281129457 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff798039040 con 0x7ff7a015f060 2024-04-25T08:58:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.049+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/2281129457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a0160070 con 0x7ff7a015f060 2024-04-25T08:58:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.049+0000 7ff796ffd640 1 -- 172.21.15.55:0/2281129457 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798001cb0 con 0x7ff7a015f060 2024-04-25T08:58:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.049+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/2281129457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a0160630 con 0x7ff7a015f060 2024-04-25T08:58:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.050+0000 7ff796ffd640 1 -- 172.21.15.55:0/2281129457 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff798047070 con 0x7ff7a015f060 2024-04-25T08:58:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.050+0000 7ff796ffd640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff78006b4d0 0x7ff78006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.051+0000 7ff796ffd640 1 -- 172.21.15.55:0/2281129457 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff7980aa2e0 con 0x7ff7a015f060 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.051+0000 7ff79e59c640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff78006b4d0 0x7ff78006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.051+0000 7ff79e59c640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff78006b4d0 0x7ff78006d990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff790007520 tx=0x7ff79000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.052+0000 7ff7a79b5740 1 Processor -- start 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.052+0000 7ff7a79b5740 1 -- start start 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64852e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852eaa0 0x55f6484fe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f6484fe740 0x55f648526500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6484670a0 con 0x55f64852e080 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64840fd40 con 0x55f64852eaa0 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f648463140 con 0x55f6484fe740 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff79e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64852e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff79e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64852e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49536/0 (socket says 172.21.15.55:49536) 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff79e59c640 1 -- 172.21.15.55:0/2130366441 learned_addr learned my addr 172.21.15.55:0/2130366441 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff79e59c640 1 -- 172.21.15.55:0/2130366441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f6484fe740 msgr2=0x55f648526500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff79dd9b640 1 --2- 172.21.15.55:0/2130366441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852eaa0 0x55f6484fe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/2130366441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f6484fe740 0x55f648526500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff79e59c640 1 --2- 172.21.15.55:0/2130366441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f6484fe740 0x55f648526500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff79e59c640 1 -- 172.21.15.55:0/2130366441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852eaa0 msgr2=0x55f6484fe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff79e59c640 1 --2- 172.21.15.55:0/2130366441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852eaa0 0x55f6484fe200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff79e59c640 1 -- 172.21.15.55:0/2130366441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f648247a20 con 0x55f64852e080 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff79e59c640 1 --2- 172.21.15.55:0/2130366441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64852e460 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff7900157c0 tx=0x7ff790016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c045b4b13fbcdc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff77ffff640 1 -- 172.21.15.55:0/2130366441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7900169b0 con 0x55f64852e080 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff77ffff640 1 -- 172.21.15.55:0/2130366441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff790028070 con 0x55f64852e080 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.053+0000 7ff77ffff640 1 -- 172.21.15.55:0/2130366441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790016d50 con 0x55f64852e080 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.054+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2130366441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 msgr2=0x55f64852e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.054+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2130366441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64852e460 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff7900157c0 tx=0x7ff790016000 comp rx=0 tx=0).stop 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.054+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2130366441 shutdown_connections 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.054+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2130366441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f6484fe740 0x55f648526500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.054+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2130366441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852eaa0 0x55f6484fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.054+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2130366441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64852e460 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.054+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2130366441 >> 172.21.15.55:0/2130366441 conn(0x55f648500470 msgr2=0x55f648548e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.054+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2130366441 shutdown_connections 2024-04-25T08:58:12.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.054+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2130366441 wait complete. 2024-04-25T08:58:12.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.055+0000 7ff7a79b5740 1 -- start start 2024-04-25T08:58:12.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.055+0000 7ff7a79b5740 1 Processor -- start 2024-04-25T08:58:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852e080 0x55f648521ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852eaa0 0x55f64852c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f648522330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64852a7d0 con 0x55f64852c600 2024-04-25T08:58:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6484053d0 con 0x55f64852e080 2024-04-25T08:58:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f64852aa70 con 0x55f64852eaa0 2024-04-25T08:58:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff7a79b5740 10 client.0 _ll_register_callbacks cb 0x55f64817ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff79ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f648522330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff79ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f648522330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49546/0 (socket says 172.21.15.55:49546) 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff79ed9d640 1 -- 172.21.15.55:0/3771097228 learned_addr learned my addr 172.21.15.55:0/3771097228 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff79dd9b640 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852eaa0 0x55f64852c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff79e59c640 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852e080 0x55f648521ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff79ed9d640 1 -- 172.21.15.55:0/3771097228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852eaa0 msgr2=0x55f64852c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852eaa0 0x55f64852c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff79ed9d640 1 -- 172.21.15.55:0/3771097228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852e080 msgr2=0x55f648521ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852e080 0x55f648521ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff79ed9d640 1 -- 172.21.15.55:0/3771097228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f64813b310 con 0x55f64852c600 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f648522330 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff798080d90 tx=0x7ff798078c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d88e99c9946fde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.056+0000 7ff77d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff77d7fa640 1 -- 172.21.15.55:0/3771097228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7980812c0 con 0x55f64852c600 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff77d7fa640 1 -- 172.21.15.55:0/3771097228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff7980752d0 con 0x55f64852c600 2024-04-25T08:58:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff7a79b5740 1 -- 172.21.15.55:0/3771097228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff790028070 con 0x55f64852c600 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff77d7fa640 1 -- 172.21.15.55:0/3771097228 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff798007680 con 0x55f64852c600 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff7a79b5740 10 client.6966 fetch_fsmap learned FSMap version 42 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff7a79b5740 1 -- 172.21.15.55:0/3771097228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55f6482a81b0 con 0x55f64852c600 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff77d7fa640 1 -- 172.21.15.55:0/3771097228 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff790028070 con 0x55f64852c600 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff77d7fa640 1 -- 172.21.15.55:0/3771097228 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 42) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff798031070 con 0x55f64852c600 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff7a79b5740 10 client.6966 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff7a79b5740 10 client.6966 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff7a79b5740 20 client.6966 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55f64854fd10 0x55f648522d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff7a79b5740 4 client.6966 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff7a79b5740 1 -- 172.21.15.55:0/3771097228 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6484745e0 con 0x55f64854fd10 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.057+0000 7ff79e59c640 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55f64854fd10 0x55f648522d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff77d7fa640 10 client.6966 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff79e59c640 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55f64854fd10 0x55f648522d40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20235915e0ce64fa server_cookie=bed697dd79c10f78 in_seq=0 out_seq=0 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff77d7fa640 1 -- 172.21.15.55:0/3771097228 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f6484745e0 con 0x55f64854fd10 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff77d7fa640 10 client.6966 handle_command_reply: tid=0 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff7a79b5740 1 client.6966 shutdown 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff7a79b5740 1 -- 172.21.15.55:0/3771097228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 msgr2=0x55f648522330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f648522330 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff798080d90 tx=0x7ff798078c60 comp rx=0 tx=0).stop 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff7a79b5740 1 -- 172.21.15.55:0/3771097228 shutdown_connections 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55f64854fd10 0x55f648522d40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f648522330 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852eaa0 0x55f64852c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/3771097228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852e080 0x55f648521ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff7a79b5740 1 -- 172.21.15.55:0/3771097228 >> 172.21.15.55:0/3771097228 conn(0x55f6484fe740 msgr2=0x55f648501c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.058+0000 7ff77d7fa640 0 client.6966 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.059+0000 7ff7a79b5740 1 -- 172.21.15.55:0/3771097228 shutdown_connections 2024-04-25T08:58:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.059+0000 7ff7a79b5740 1 -- 172.21.15.55:0/3771097228 wait complete. 2024-04-25T08:58:12.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.059+0000 7ff7a79b5740 20 client.6966 trim_cache size 0 max 16384 2024-04-25T08:58:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.074+0000 7ff7a79b5740 1 Processor -- start 2024-04-25T08:58:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.074+0000 7ff7a79b5740 1 -- start start 2024-04-25T08:58:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852c600 0x55f648503f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64855ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852eaa0 0x55f64855b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64852fac0 con 0x55f64852e080 2024-04-25T08:58:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0200570 con 0x55f64852c600 2024-04-25T08:58:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a01ff750 con 0x55f64852eaa0 2024-04-25T08:58:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff79dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64855ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff79dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64855ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49548/0 (socket says 172.21.15.55:49548) 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff79dd9b640 1 -- 172.21.15.55:0/2081588954 learned_addr learned my addr 172.21.15.55:0/2081588954 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff79dd9b640 1 -- 172.21.15.55:0/2081588954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852eaa0 msgr2=0x55f64855b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff79dd9b640 1 --2- 172.21.15.55:0/2081588954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852eaa0 0x55f64855b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff79dd9b640 1 -- 172.21.15.55:0/2081588954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852c600 msgr2=0x55f648503f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff79dd9b640 1 --2- 172.21.15.55:0/2081588954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852c600 0x55f648503f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff79dd9b640 1 -- 172.21.15.55:0/2081588954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6485214c0 con 0x55f64852e080 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff79dd9b640 1 --2- 172.21.15.55:0/2081588954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64855ad10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff788009bc0 tx=0x7ff788009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa27c946ab835642 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff77f7fe640 1 -- 172.21.15.55:0/2081588954 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788013440 con 0x55f64852e080 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff77f7fe640 1 -- 172.21.15.55:0/2081588954 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7880135e0 con 0x55f64852e080 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.075+0000 7ff77f7fe640 1 -- 172.21.15.55:0/2081588954 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788013790 con 0x55f64852e080 2024-04-25T08:58:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.076+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2081588954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 msgr2=0x55f64855ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.076+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2081588954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64855ad10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff788009bc0 tx=0x7ff788009190 comp rx=0 tx=0).stop 2024-04-25T08:58:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.076+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2081588954 shutdown_connections 2024-04-25T08:58:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.076+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2081588954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852eaa0 0x55f64855b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.076+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2081588954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852e080 0x55f64855ad10 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.076+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2081588954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852c600 0x55f648503f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.076+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2081588954 >> 172.21.15.55:0/2081588954 conn(0x55f6484fe740 msgr2=0x55f64852ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.076+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2081588954 shutdown_connections 2024-04-25T08:58:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.076+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2081588954 wait complete. 2024-04-25T08:58:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.077+0000 7ff7a79b5740 1 -- start start 2024-04-25T08:58:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.077+0000 7ff7a79b5740 1 Processor -- start 2024-04-25T08:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.077+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f64859bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.077+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852e080 0x55f648561f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff7a79b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852eaa0 0x55f6485624d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a01ff150 con 0x55f64852c600 2024-04-25T08:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a01feba0 con 0x55f64852eaa0 2024-04-25T08:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff7a79b5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f64854e050 con 0x55f64852e080 2024-04-25T08:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff7a79b5740 10 client.0 _ll_register_callbacks cb 0x7ff790009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f64859bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f64859bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49564/0 (socket says 172.21.15.55:49564) 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79e59c640 1 -- 172.21.15.55:0/2692222019 learned_addr learned my addr 172.21.15.55:0/2692222019 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852eaa0 0x55f6485624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79dd9b640 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852e080 0x55f648561f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79e59c640 1 -- 172.21.15.55:0/2692222019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852e080 msgr2=0x55f648561f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79e59c640 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852e080 0x55f648561f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79e59c640 1 -- 172.21.15.55:0/2692222019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852eaa0 msgr2=0x55f6485624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79e59c640 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852eaa0 0x55f6485624d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79e59c640 1 -- 172.21.15.55:0/2692222019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f648114490 con 0x55f64852c600 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79ed9d640 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852eaa0 0x55f6485624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff79e59c640 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f64859bda0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff790025040 tx=0x7ff790009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90b36a15a358c3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff77d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff77d7fa640 1 -- 172.21.15.55:0/2692222019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79003f060 con 0x55f64852c600 2024-04-25T08:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff77d7fa640 1 -- 172.21.15.55:0/2692222019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff790039070 con 0x55f64852c600 2024-04-25T08:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2692222019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7880135e0 con 0x55f64852c600 2024-04-25T08:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff77d7fa640 1 -- 172.21.15.55:0/2692222019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff790045050 con 0x55f64852c600 2024-04-25T08:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff7a79b5740 10 client.6972 fetch_fsmap learned FSMap version 42 2024-04-25T08:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.078+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2692222019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55f6485030f0 con 0x55f64852c600 2024-04-25T08:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.079+0000 7ff77d7fa640 1 -- 172.21.15.55:0/2692222019 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7880135e0 con 0x55f64852c600 2024-04-25T08:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.079+0000 7ff77d7fa640 1 -- 172.21.15.55:0/2692222019 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 42) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff790048020 con 0x55f64852c600 2024-04-25T08:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.079+0000 7ff7a79b5740 10 client.6972 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.079+0000 7ff7a79b5740 10 client.6972 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.079+0000 7ff7a79b5740 20 client.6972 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.079+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55f648503610 0x55f64854c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.079+0000 7ff7a79b5740 4 client.6972 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.079+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2692222019 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) v1 -- 0x55f64854f8c0 con 0x55f648503610 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.079+0000 7ff79dd9b640 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55f648503610 0x55f64854c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.079+0000 7ff77d7fa640 10 client.6972 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.079+0000 7ff79dd9b640 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55f648503610 0x55f64854c6a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d11823a5cb4fa79 server_cookie=e4578a89cd36249a in_seq=0 out_seq=0 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff77d7fa640 1 -- 172.21.15.55:0/2692222019 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f64854f8c0 con 0x55f648503610 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff77d7fa640 10 client.6972 handle_command_reply: tid=0 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 1 client.6972 shutdown 2024-04-25T08:58:12.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2692222019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 msgr2=0x55f64859bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f64859bda0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff790025040 tx=0x7ff790009750 comp rx=0 tx=0).stop 2024-04-25T08:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2692222019 shutdown_connections 2024-04-25T08:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55f648503610 0x55f64854c6a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64852eaa0 0x55f6485624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f64852e080 0x55f648561f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 1 --2- 172.21.15.55:0/2692222019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f64852c600 0x55f64859bda0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff77d7fa640 0 client.6972 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2692222019 >> 172.21.15.55:0/2692222019 conn(0x55f6484fe740 msgr2=0x55f648521b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2692222019 shutdown_connections 2024-04-25T08:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 1 -- 172.21.15.55:0/2692222019 wait complete. 2024-04-25T08:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.080+0000 7ff7a79b5740 20 client.6972 trim_cache size 0 max 16384 2024-04-25T08:58:12.078 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:58:12.078 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-25T08:58:12.078 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "d092e0cb-e9c4-46e1-96a6-650d910fea0c", 2024-04-25T08:58:12.078 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-25T08:58:12.078 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/2281129457 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff78006b4d0 msgr2=0x7ff78006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff78006b4d0 0x7ff78006d990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff790007520 tx=0x7ff79000b040 comp rx=0 tx=0).stop 2024-04-25T08:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/2281129457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7a015f060 msgr2=0x7ff7a015f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7a015f060 0x7ff7a015f4e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c300 tx=0x7ff7a00b6b50 comp rx=0 tx=0).stop 2024-04-25T08:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/2281129457 shutdown_connections 2024-04-25T08:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff78006b4d0 0x7ff78006d990 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7a015f060 0x7ff7a015f4e0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7a015ba40 0x7ff7a015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 --2- 172.21.15.55:0/2281129457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff78c004d40 0x7ff7a015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/2281129457 >> 172.21.15.55:0/2281129457 conn(0x7ff7a00b5570 msgr2=0x7ff7a00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/2281129457 shutdown_connections 2024-04-25T08:58:12.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.081+0000 7ff7a4cb3640 1 -- 172.21.15.55:0/2281129457 wait complete. 2024-04-25T08:58:12.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:12.081 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T08:58:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.195+0000 7fb321add640 1 Processor -- start 2024-04-25T08:58:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.196+0000 7fb321add640 1 -- start start 2024-04-25T08:58:12.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.196+0000 7fb321add640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb31c15bbe0 0x7fb31c0cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.196+0000 7fb321add640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c0cc830 con 0x7fb31c0d0610 2024-04-25T08:58:12.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.196+0000 7fb321add640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c0ccb10 con 0x7fb31c0cf510 2024-04-25T08:58:12.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.196+0000 7fb321add640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0ccdf0 con 0x7fb31c15bbe0 2024-04-25T08:58:12.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.197+0000 7fb31bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb31c0d0610 0x7fb31c0c5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59618/0 (socket says 172.21.15.55:59618) 2024-04-25T08:58:12.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.197+0000 7fb31bfff640 1 -- 172.21.15.55:0/2665233978 learned_addr learned my addr 172.21.15.55:0/2665233978 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:12.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.197+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/2665233978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb31c15bbe0 0x7fb31c0cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.197+0000 7fb31a7fc640 1 -- 172.21.15.55:0/2665233978 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073182219 0 0) 0x7fb31c0cc830 con 0x7fb31c0d0610 2024-04-25T08:58:12.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.197+0000 7fb31a7fc640 1 -- 172.21.15.55:0/2665233978 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb304003520 con 0x7fb31c0d0610 2024-04-25T08:58:12.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.197+0000 7fb31a7fc640 1 -- 172.21.15.55:0/2665233978 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048355450 0 0) 0x7fb31c0ccb10 con 0x7fb31c0cf510 2024-04-25T08:58:12.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.197+0000 7fb31a7fc640 1 -- 172.21.15.55:0/2665233978 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb31c0cc830 con 0x7fb31c0cf510 2024-04-25T08:58:12.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.197+0000 7fb31b7fe640 1 -- 172.21.15.55:0/2665233978 >> v1:172.21.15.167:6789/0 conn(0x7fb31c0cf510 legacy=0x7fb31c0cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.197+0000 7fb31a7fc640 1 -- 172.21.15.55:0/2665233978 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 423230027 0 0) 0x7fb304003520 con 0x7fb31c0d0610 2024-04-25T08:58:12.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.197+0000 7fb31b7fe640 1 -- 172.21.15.55:0/2665233978 >> v1:172.21.15.55:6789/0 conn(0x7fb31c0d0610 legacy=0x7fb31c0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.197+0000 7fb31b7fe640 1 -- 172.21.15.55:0/2665233978 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c0cd0d0 con 0x7fb31c15bbe0 2024-04-25T08:58:12.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.198+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/2665233978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb31c15bbe0 0x7fb31c0cd8d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0097d0 tx=0x7fb30c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fc76d251c80d420 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.198+0000 7fb31a7fc640 1 -- 172.21.15.55:0/2665233978 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c037070 con 0x7fb31c15bbe0 2024-04-25T08:58:12.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.198+0000 7fb31a7fc640 1 -- 172.21.15.55:0/2665233978 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c02ac30 con 0x7fb31c15bbe0 2024-04-25T08:58:12.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.198+0000 7fb31a7fc640 1 -- 172.21.15.55:0/2665233978 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3140019f0 con 0x7fb31c15bbe0 2024-04-25T08:58:12.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.199+0000 7fb321add640 1 -- 172.21.15.55:0/2665233978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb31c15bbe0 msgr2=0x7fb31c0cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.199+0000 7fb321add640 1 --2- 172.21.15.55:0/2665233978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb31c15bbe0 0x7fb31c0cd8d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0097d0 tx=0x7fb30c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.199+0000 7fb321add640 1 -- 172.21.15.55:0/2665233978 shutdown_connections 2024-04-25T08:58:12.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.199+0000 7fb321add640 1 --2- 172.21.15.55:0/2665233978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb31c15bbe0 0x7fb31c0cd8d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.199+0000 7fb321add640 1 -- 172.21.15.55:0/2665233978 >> 172.21.15.55:0/2665233978 conn(0x7fb31c0b3430 msgr2=0x7fb31c0b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.199+0000 7fb321add640 1 -- 172.21.15.55:0/2665233978 shutdown_connections 2024-04-25T08:58:12.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.199+0000 7fb321add640 1 -- 172.21.15.55:0/2665233978 wait complete. 2024-04-25T08:58:12.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.200+0000 7fb321add640 1 Processor -- start 2024-04-25T08:58:12.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.200+0000 7fb321add640 1 -- start start 2024-04-25T08:58:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb321add640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb31c0cf510 0x7fb31c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb321add640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb31c0d0610 0x7fb31c15e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb321add640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb31c15bbe0 0x7fb31c155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb321add640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0cde10 con 0x7fb31c0d0610 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb321add640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c15bfc0 con 0x7fb31c15bbe0 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb321add640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0cc450 con 0x7fb31c0cf510 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb31affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb31c0d0610 0x7fb31c15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb31affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb31c0d0610 0x7fb31c15e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49566/0 (socket says 172.21.15.55:49566) 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb31affd640 1 -- 172.21.15.55:0/2872818300 learned_addr learned my addr 172.21.15.55:0/2872818300 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb31c0cf510 0x7fb31c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb31bfff640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb31c15bbe0 0x7fb31c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb31affd640 1 -- 172.21.15.55:0/2872818300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb31c0cf510 msgr2=0x7fb31c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb31affd640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb31c0cf510 0x7fb31c154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb31affd640 1 -- 172.21.15.55:0/2872818300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb31c15bbe0 msgr2=0x7fb31c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb31affd640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb31c15bbe0 0x7fb31c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb31affd640 1 -- 172.21.15.55:0/2872818300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c15d3f0 con 0x7fb31c0d0610 2024-04-25T08:58:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.201+0000 7fb31affd640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb31c0d0610 0x7fb31c15e770 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c490 tx=0x7fb31000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.202+0000 7fb303fff640 1 -- 172.21.15.55:0/2872818300 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100052d0 con 0x7fb31c0d0610 2024-04-25T08:58:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.202+0000 7fb303fff640 1 -- 172.21.15.55:0/2872818300 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310005470 con 0x7fb31c0d0610 2024-04-25T08:58:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.202+0000 7fb321add640 1 -- 172.21.15.55:0/2872818300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31c15d6d0 con 0x7fb31c0d0610 2024-04-25T08:58:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.202+0000 7fb303fff640 1 -- 172.21.15.55:0/2872818300 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310012850 con 0x7fb31c0d0610 2024-04-25T08:58:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.202+0000 7fb321add640 1 -- 172.21.15.55:0/2872818300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c15dc90 con 0x7fb31c0d0610 2024-04-25T08:58:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.203+0000 7fb303fff640 1 -- 172.21.15.55:0/2872818300 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb3100129f0 con 0x7fb31c0d0610 2024-04-25T08:58:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.203+0000 7fb303fff640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb30806b4d0 0x7fb30806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.204+0000 7fb303fff640 1 -- 172.21.15.55:0/2872818300 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb31008a040 con 0x7fb31c0d0610 2024-04-25T08:58:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.204+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb30806b4d0 0x7fb30806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.204+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb30806b4d0 0x7fb30806d990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb30c034000 tx=0x7fb30c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.205+0000 7fb3247db740 1 Processor -- start 2024-04-25T08:58:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.205+0000 7fb3247db740 1 -- start start 2024-04-25T08:58:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.205+0000 7fb3247db740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759b10 0x55e74275c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb3247db740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759ef0 0x55e74275c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb3247db740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e74272c770 0x55e74272ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb3247db740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e742695da0 con 0x55e74272c770 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb3247db740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e74263eb80 con 0x55e742759ef0 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb3247db740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e742691e40 con 0x55e742759b10 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e74272c770 0x55e74272ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e74272c770 0x55e74272ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49580/0 (socket says 172.21.15.55:49580) 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb31bfff640 1 -- 172.21.15.55:0/1933275714 learned_addr learned my addr 172.21.15.55:0/1933275714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/1933275714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759b10 0x55e74275c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb31bfff640 1 -- 172.21.15.55:0/1933275714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759b10 msgr2=0x55e74275c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb31affd640 1 --2- 172.21.15.55:0/1933275714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759ef0 0x55e74275c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb31bfff640 1 --2- 172.21.15.55:0/1933275714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759b10 0x55e74275c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb31bfff640 1 -- 172.21.15.55:0/1933275714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759ef0 msgr2=0x55e74275c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb31bfff640 1 --2- 172.21.15.55:0/1933275714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759ef0 0x55e74275c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb31bfff640 1 -- 172.21.15.55:0/1933275714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e742648f10 con 0x55e74272c770 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb31bfff640 1 --2- 172.21.15.55:0/1933275714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e74272c770 0x55e74272ff80 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb314002180 tx=0x7fb31400e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54eb05de4ff1eb85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb3017fa640 1 -- 172.21.15.55:0/1933275714 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314019070 con 0x55e74272c770 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb3017fa640 1 -- 172.21.15.55:0/1933275714 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb314014480 con 0x55e74272c770 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.206+0000 7fb3017fa640 1 -- 172.21.15.55:0/1933275714 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314014850 con 0x55e74272c770 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.207+0000 7fb3247db740 1 -- 172.21.15.55:0/1933275714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e74272c770 msgr2=0x55e74272ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.207+0000 7fb3247db740 1 --2- 172.21.15.55:0/1933275714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e74272c770 0x55e74272ff80 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb314002180 tx=0x7fb31400e5f0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.207+0000 7fb3247db740 1 -- 172.21.15.55:0/1933275714 shutdown_connections 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.207+0000 7fb3247db740 1 --2- 172.21.15.55:0/1933275714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e74272c770 0x55e74272ff80 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.207+0000 7fb3247db740 1 --2- 172.21.15.55:0/1933275714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759ef0 0x55e74275c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.207+0000 7fb3247db740 1 --2- 172.21.15.55:0/1933275714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759b10 0x55e74275c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.207+0000 7fb3247db740 1 -- 172.21.15.55:0/1933275714 >> 172.21.15.55:0/1933275714 conn(0x55e74272e9e0 msgr2=0x55e742777320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.207+0000 7fb3247db740 1 -- 172.21.15.55:0/1933275714 shutdown_connections 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.207+0000 7fb3247db740 1 -- 172.21.15.55:0/1933275714 wait complete. 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.208+0000 7fb3247db740 1 -- start start 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.208+0000 7fb3247db740 1 Processor -- start 2024-04-25T08:58:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.208+0000 7fb3247db740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759b10 0x55e7427601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.208+0000 7fb3247db740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759ef0 0x55e742758190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.208+0000 7fb3247db740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.208+0000 7fb3247db740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e742731b90 con 0x55e7427586d0 2024-04-25T08:58:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.208+0000 7fb3247db740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7426344b0 con 0x55e742759b10 2024-04-25T08:58:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.208+0000 7fb3247db740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e742731e70 con 0x55e742759ef0 2024-04-25T08:58:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb3247db740 10 client.0 _ll_register_callbacks cb 0x55e742674180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49586/0 (socket says 172.21.15.55:49586) 2024-04-25T08:58:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb31bfff640 1 -- 172.21.15.55:0/553175178 learned_addr learned my addr 172.21.15.55:0/553175178 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759b10 0x55e7427601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb31affd640 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759ef0 0x55e742758190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb31bfff640 1 -- 172.21.15.55:0/553175178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759ef0 msgr2=0x55e742758190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb31bfff640 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759ef0 0x55e742758190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb31bfff640 1 -- 172.21.15.55:0/553175178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759b10 msgr2=0x55e7427601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb31bfff640 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759b10 0x55e7427601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb31bfff640 1 -- 172.21.15.55:0/553175178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7424747d0 con 0x55e7427586d0 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb31bfff640 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427550a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fb3140016c0 tx=0x7fb3140014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e78b9d2d5fe79f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb2fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/553175178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314019040 con 0x55e7427586d0 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/553175178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb314014ca0 con 0x55e7427586d0 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb3247db740 1 -- 172.21.15.55:0/553175178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb314014480 con 0x55e7427586d0 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/553175178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb31402b050 con 0x55e7427586d0 2024-04-25T08:58:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb3247db740 10 client.6984 fetch_fsmap learned FSMap version 42 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.209+0000 7fb3247db740 1 -- 172.21.15.55:0/553175178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55e7423aa3f0 con 0x55e7427586d0 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.210+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/553175178 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb314014480 con 0x55e7427586d0 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.210+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/553175178 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 42) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb31402e020 con 0x55e7427586d0 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.210+0000 7fb3247db740 10 client.6984 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.210+0000 7fb3247db740 10 client.6984 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.210+0000 7fb3247db740 20 client.6984 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.210+0000 7fb3247db740 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55e74275d6d0 0x55e742778920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.210+0000 7fb3247db740 4 client.6984 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.210+0000 7fb3247db740 1 -- 172.21.15.55:0/553175178 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7426a32e0 con 0x55e74275d6d0 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.210+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55e74275d6d0 0x55e742778920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.210+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55e74275d6d0 0x55e742778920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f53e1260a75c7f16 server_cookie=f80ed89ccd26c4f7 in_seq=0 out_seq=0 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.210+0000 7fb2fa7fc640 10 client.6984 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/553175178 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e7426a32e0 con 0x55e74275d6d0 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb2fa7fc640 10 client.6984 handle_command_reply: tid=0 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 1 client.6984 shutdown 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 1 -- 172.21.15.55:0/553175178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 msgr2=0x55e7427550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427550a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fb3140016c0 tx=0x7fb3140014d0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 1 -- 172.21.15.55:0/553175178 shutdown_connections 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55e74275d6d0 0x55e742778920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427550a0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759ef0 0x55e742758190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 1 --2- 172.21.15.55:0/553175178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759b10 0x55e7427601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 1 -- 172.21.15.55:0/553175178 >> 172.21.15.55:0/553175178 conn(0x55e74272c770 msgr2=0x55e742731370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb2fa7fc640 0 client.6984 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 1 -- 172.21.15.55:0/553175178 shutdown_connections 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 1 -- 172.21.15.55:0/553175178 wait complete. 2024-04-25T08:58:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.211+0000 7fb3247db740 20 client.6984 trim_cache size 0 max 16384 2024-04-25T08:58:12.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.226+0000 7fb3247db740 1 Processor -- start 2024-04-25T08:58:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.226+0000 7fb3247db740 1 -- start start 2024-04-25T08:58:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.227+0000 7fb3247db740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7427586d0 0x55e742754100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.227+0000 7fb3247db740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e742759b10 0x55e742755080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.227+0000 7fb3247db740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759ef0 0x55e7427799f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.227+0000 7fb3247db740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c1fdad0 con 0x55e742759b10 2024-04-25T08:58:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.227+0000 7fb3247db740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c144820 con 0x55e7427586d0 2024-04-25T08:58:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.227+0000 7fb3247db740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c143c20 con 0x55e742759ef0 2024-04-25T08:58:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.227+0000 7fb31affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e742759b10 0x55e742755080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.227+0000 7fb31affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e742759b10 0x55e742755080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49598/0 (socket says 172.21.15.55:49598) 2024-04-25T08:58:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.227+0000 7fb31affd640 1 -- 172.21.15.55:0/3967217343 learned_addr learned my addr 172.21.15.55:0/3967217343 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:12.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.228+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/3967217343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7427586d0 0x55e742754100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.228+0000 7fb31bfff640 1 --2- 172.21.15.55:0/3967217343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759ef0 0x55e7427799f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.228+0000 7fb31affd640 1 -- 172.21.15.55:0/3967217343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759ef0 msgr2=0x55e7427799f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.228+0000 7fb31affd640 1 --2- 172.21.15.55:0/3967217343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759ef0 0x55e7427799f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.228+0000 7fb31affd640 1 -- 172.21.15.55:0/3967217343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7427586d0 msgr2=0x55e742754100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.228+0000 7fb31affd640 1 --2- 172.21.15.55:0/3967217343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7427586d0 0x55e742754100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.228+0000 7fb31affd640 1 -- 172.21.15.55:0/3967217343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e74236a0f0 con 0x55e742759b10 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.228+0000 7fb31affd640 1 --2- 172.21.15.55:0/3967217343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e742759b10 0x55e742755080 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb310058340 tx=0x7fb3100584c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ff4539a637be8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.228+0000 7fb300ff9640 1 -- 172.21.15.55:0/3967217343 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310070020 con 0x55e742759b10 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.228+0000 7fb300ff9640 1 -- 172.21.15.55:0/3967217343 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3100701c0 con 0x55e742759b10 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.228+0000 7fb300ff9640 1 -- 172.21.15.55:0/3967217343 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310012ce0 con 0x55e742759b10 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.229+0000 7fb3247db740 1 -- 172.21.15.55:0/3967217343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e742759b10 msgr2=0x55e742755080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.229+0000 7fb3247db740 1 --2- 172.21.15.55:0/3967217343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e742759b10 0x55e742755080 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb310058340 tx=0x7fb3100584c0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.229+0000 7fb3247db740 1 -- 172.21.15.55:0/3967217343 shutdown_connections 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.229+0000 7fb3247db740 1 --2- 172.21.15.55:0/3967217343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759ef0 0x55e7427799f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.229+0000 7fb3247db740 1 --2- 172.21.15.55:0/3967217343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e742759b10 0x55e742755080 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.229+0000 7fb3247db740 1 --2- 172.21.15.55:0/3967217343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7427586d0 0x55e742754100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.229+0000 7fb3247db740 1 -- 172.21.15.55:0/3967217343 >> 172.21.15.55:0/3967217343 conn(0x55e74272c770 msgr2=0x55e742777320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.229+0000 7fb3247db740 1 -- 172.21.15.55:0/3967217343 shutdown_connections 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.229+0000 7fb3247db740 1 -- 172.21.15.55:0/3967217343 wait complete. 2024-04-25T08:58:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.229+0000 7fb3247db740 1 -- start start 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.229+0000 7fb3247db740 1 Processor -- start 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb3247db740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427799f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb3247db740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759b10 0x55e742779f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb3247db740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759ef0 0x55e742778b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb3247db740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e742732d40 con 0x55e7427586d0 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb3247db740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c144220 con 0x55e742759ef0 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb3247db740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7427746f0 con 0x55e742759b10 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb3247db740 10 client.0 _ll_register_callbacks cb 0x7fb3140019f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb31b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427799f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb31b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427799f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49602/0 (socket says 172.21.15.55:49602) 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb31b7fe640 1 -- 172.21.15.55:0/1401914603 learned_addr learned my addr 172.21.15.55:0/1401914603 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb31affd640 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759b10 0x55e742779f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb31bfff640 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759ef0 0x55e742778b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb31b7fe640 1 -- 172.21.15.55:0/1401914603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759b10 msgr2=0x55e742779f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759b10 0x55e742779f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb31b7fe640 1 -- 172.21.15.55:0/1401914603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759ef0 msgr2=0x55e742778b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759ef0 0x55e742778b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.230+0000 7fb31b7fe640 1 -- 172.21.15.55:0/1401914603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e742755fd0 con 0x55e7427586d0 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb31b7fe640 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427799f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0097d0 tx=0x7fb30c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff1cc4b378ae0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb2fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/1401914603 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c037040 con 0x55e7427586d0 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb3247db740 1 -- 172.21.15.55:0/1401914603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3100701c0 con 0x55e7427586d0 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/1401914603 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb30c03cbc0 con 0x55e7427586d0 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/1401914603 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb30c03cdc0 con 0x55e7427586d0 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb3247db740 10 client.6990 fetch_fsmap learned FSMap version 42 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb3247db740 1 -- 172.21.15.55:0/1401914603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55e74274aa80 con 0x55e7427586d0 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/1401914603 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3100701c0 con 0x55e7427586d0 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/1401914603 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 42) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb30c004020 con 0x55e7427586d0 2024-04-25T08:58:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb3247db740 10 client.6990 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb3247db740 10 client.6990 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb3247db740 20 client.6990 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb3247db740 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55e7427e5820 0x55e7427790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb3247db740 4 client.6990 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb3247db740 1 -- 172.21.15.55:0/1401914603 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e74269d630 con 0x55e7427e5820 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.231+0000 7fb31affd640 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55e7427e5820 0x55e7427790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb31affd640 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55e7427e5820 0x55e7427790a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=621d54995ec8bb0 server_cookie=5bb666b8d94e51b in_seq=0 out_seq=0 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb2fa7fc640 10 client.6990 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb2fa7fc640 1 -- 172.21.15.55:0/1401914603 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e74269d630 con 0x55e7427e5820 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb2fa7fc640 10 client.6990 handle_command_reply: tid=0 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 1 client.6990 shutdown 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 1 -- 172.21.15.55:0/1401914603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 msgr2=0x55e7427799f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427799f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0097d0 tx=0x7fb30c004730 comp rx=0 tx=0).stop 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 1 -- 172.21.15.55:0/1401914603 shutdown_connections 2024-04-25T08:58:12.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55e7427e5820 0x55e7427790a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e742759ef0 0x55e742778b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e742759b10 0x55e742779f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 1 --2- 172.21.15.55:0/1401914603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7427586d0 0x55e7427799f0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb2fa7fc640 0 client.6990 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:12.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 1 -- 172.21.15.55:0/1401914603 >> 172.21.15.55:0/1401914603 conn(0x55e74272c770 msgr2=0x55e742754d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 1 -- 172.21.15.55:0/1401914603 shutdown_connections 2024-04-25T08:58:12.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 1 -- 172.21.15.55:0/1401914603 wait complete. 2024-04-25T08:58:12.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.232+0000 7fb3247db740 20 client.6990 trim_cache size 0 max 16384 2024-04-25T08:58:12.230 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:58:12.231 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:58:12.231 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-25T08:58:12.231 INFO:teuthology.orchestra.run.smithi055.stdout: "d092e0cb-e9c4-46e1-96a6-650d910fea0c": { 2024-04-25T08:58:12.231 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/subdir", 2024-04-25T08:58:12.231 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "d092e0cb-e9c4-46e1-96a6-650d910fea0c", 2024-04-25T08:58:12.231 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive" 2024-04-25T08:58:12.231 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:58:12.231 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:58:12.231 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:58:12.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 -- 172.21.15.55:0/2872818300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb30806b4d0 msgr2=0x7fb30806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb30806b4d0 0x7fb30806d990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb30c034000 tx=0x7fb30c02e000 comp rx=0 tx=0).stop 2024-04-25T08:58:12.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 -- 172.21.15.55:0/2872818300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb31c0d0610 msgr2=0x7fb31c15e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:12.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb31c0d0610 0x7fb31c15e770 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c490 tx=0x7fb31000c950 comp rx=0 tx=0).stop 2024-04-25T08:58:12.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 -- 172.21.15.55:0/2872818300 shutdown_connections 2024-04-25T08:58:12.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb30806b4d0 0x7fb30806d990 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb31c15bbe0 0x7fb31c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb31c0d0610 0x7fb31c15e770 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 --2- 172.21.15.55:0/2872818300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb31c0cf510 0x7fb31c154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:12.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 -- 172.21.15.55:0/2872818300 >> 172.21.15.55:0/2872818300 conn(0x7fb31c0b3430 msgr2=0x7fb31c099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:12.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 -- 172.21.15.55:0/2872818300 shutdown_connections 2024-04-25T08:58:12.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:12.233+0000 7fb321add640 1 -- 172.21.15.55:0/2872818300 wait complete. 2024-04-25T08:58:12.234 INFO:tasks.cephfs.filesystem:scrub status for tag:d092e0cb-e9c4-46e1-96a6-650d910fea0c - {'path': '/subdir', 'tag': 'd092e0cb-e9c4-46e1-96a6-650d910fea0c', 'options': 'recursive'} 2024-04-25T08:58:14.306 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T08:58:14.317+0000 7f7581a89640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T08:58:40.089 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:58:40.092 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:58:42.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:42.235 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T08:58:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.362+0000 7f53ab658640 1 Processor -- start 2024-04-25T08:58:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.362+0000 7f53ab658640 1 -- start start 2024-04-25T08:58:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53ab658640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a40d3b90 0x7f53a40d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53ab658640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53a40d0f60 0x7f53a40b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53ab658640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a40d4090 con 0x7f53a415dca0 2024-04-25T08:58:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53ab658640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a40b6b20 con 0x7f53a40d0f60 2024-04-25T08:58:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53ab658640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40d4370 con 0x7f53a40d3b90 2024-04-25T08:58:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53a9bf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53a40d0f60 0x7f53a40b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53a9bf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53a40d0f60 0x7f53a40b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39318/0 (socket says 172.21.15.55:39318) 2024-04-25T08:58:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53a9bf5640 1 -- 172.21.15.55:0/2175927800 learned_addr learned my addr 172.21.15.55:0/2175927800 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/2175927800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a40d3b90 0x7f53a40d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53a9bf5640 1 -- 172.21.15.55:0/2175927800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a40d3b90 msgr2=0x7f53a40d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53a9bf5640 1 --2- 172.21.15.55:0/2175927800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a40d3b90 0x7f53a40d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53a9bf5640 1 -- 172.21.15.55:0/2175927800 >> v1:172.21.15.167:6789/0 conn(0x7f53a415dca0 legacy=0x7f53a40ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.363+0000 7f53a9bf5640 1 -- 172.21.15.55:0/2175927800 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40d4650 con 0x7f53a40d0f60 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.364+0000 7f53a9bf5640 1 --2- 172.21.15.55:0/2175927800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53a40d0f60 0x7f53a40b2500 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f539c009e50 tx=0x7f539c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaa9a657655f444 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.364+0000 7f539bfff640 1 -- 172.21.15.55:0/2175927800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c036070 con 0x7f53a40d0f60 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.364+0000 7f539bfff640 1 -- 172.21.15.55:0/2175927800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c031600 con 0x7f53a40d0f60 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.364+0000 7f539bfff640 1 -- 172.21.15.55:0/2175927800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0319d0 con 0x7f53a40d0f60 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.365+0000 7f53ab658640 1 -- 172.21.15.55:0/2175927800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53a40d0f60 msgr2=0x7f53a40b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.365+0000 7f53ab658640 1 --2- 172.21.15.55:0/2175927800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53a40d0f60 0x7f53a40b2500 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f539c009e50 tx=0x7f539c02a710 comp rx=0 tx=0).stop 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.365+0000 7f53ab658640 1 -- 172.21.15.55:0/2175927800 shutdown_connections 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.365+0000 7f53ab658640 1 --2- 172.21.15.55:0/2175927800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53a40d0f60 0x7f53a40b2500 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.365+0000 7f53ab658640 1 --2- 172.21.15.55:0/2175927800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a40d3b90 0x7f53a40d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.365+0000 7f53ab658640 1 -- 172.21.15.55:0/2175927800 >> 172.21.15.55:0/2175927800 conn(0x7f53a40726c0 msgr2=0x7f53a4072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.365+0000 7f53ab658640 1 -- 172.21.15.55:0/2175927800 shutdown_connections 2024-04-25T08:58:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.365+0000 7f53ab658640 1 -- 172.21.15.55:0/2175927800 wait complete. 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.366+0000 7f53ab658640 1 Processor -- start 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.366+0000 7f53ab658640 1 -- start start 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53ab658640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53a40d0f60 0x7f53a40ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53ab658640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53a40d3b90 0x7f53a415b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53ab658640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a415dca0 0x7f53a415b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53ab658640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a415e080 con 0x7f53a40d0f60 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53ab658640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40cf050 con 0x7f53a40d3b90 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53ab658640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a415e200 con 0x7f53a415dca0 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53a93f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53a40d0f60 0x7f53a40ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53a93f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53a40d0f60 0x7f53a40ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39320/0 (socket says 172.21.15.55:39320) 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53a93f4640 1 -- 172.21.15.55:0/2368443751 learned_addr learned my addr 172.21.15.55:0/2368443751 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53a40d3b90 0x7f53a415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53a9bf5640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a415dca0 0x7f53a415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.367+0000 7f53a93f4640 1 -- 172.21.15.55:0/2368443751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a415dca0 msgr2=0x7f53a415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.368+0000 7f53a93f4640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a415dca0 0x7f53a415b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.368+0000 7f53a93f4640 1 -- 172.21.15.55:0/2368443751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53a40d3b90 msgr2=0x7f53a415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.368+0000 7f53a93f4640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53a40d3b90 0x7f53a415b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.368+0000 7f53a93f4640 1 -- 172.21.15.55:0/2368443751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a415f030 con 0x7f53a40d0f60 2024-04-25T08:58:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.368+0000 7f53a93f4640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53a40d0f60 0x7f53a40ca150 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c3f0 tx=0x7f53a000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.368+0000 7f5399ffb640 1 -- 172.21.15.55:0/2368443751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a00052d0 con 0x7f53a40d0f60 2024-04-25T08:58:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.368+0000 7f5399ffb640 1 -- 172.21.15.55:0/2368443751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a0005490 con 0x7f53a40d0f60 2024-04-25T08:58:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.368+0000 7f53ab658640 1 -- 172.21.15.55:0/2368443751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a415f310 con 0x7f53a40d0f60 2024-04-25T08:58:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.368+0000 7f5399ffb640 1 -- 172.21.15.55:0/2368443751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a0007260 con 0x7f53a40d0f60 2024-04-25T08:58:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.368+0000 7f53ab658640 1 -- 172.21.15.55:0/2368443751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a415fb40 con 0x7f53a40d0f60 2024-04-25T08:58:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.370+0000 7f5399ffb640 1 -- 172.21.15.55:0/2368443751 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f53a0007400 con 0x7f53a40d0f60 2024-04-25T08:58:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.370+0000 7f5399ffb640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f538806b4d0 0x7f538806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.371+0000 7f5399ffb640 1 -- 172.21.15.55:0/2368443751 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f53a0089760 con 0x7f53a40d0f60 2024-04-25T08:58:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.371+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f538806b4d0 0x7f538806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.371+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f538806b4d0 0x7f538806d990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f53a40cfd90 tx=0x7f5394009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.371+0000 7f53ae437740 1 Processor -- start 2024-04-25T08:58:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.372+0000 7f53ae437740 1 -- start start 2024-04-25T08:58:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.372+0000 7f53ae437740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f393b10 0x55931f396320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.372+0000 7f53ae437740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f396860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.372+0000 7f53ae437740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f366770 0x55931f369f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.372+0000 7f53ae437740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55931f2cfda0 con 0x55931f393ef0 2024-04-25T08:58:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.372+0000 7f53ae437740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55931f278b80 con 0x55931f393b10 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.372+0000 7f53ae437740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55931f2cbe40 con 0x55931f366770 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.372+0000 7f53a8bf3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f396860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.372+0000 7f53a8bf3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f396860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39326/0 (socket says 172.21.15.55:39326) 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.372+0000 7f53a8bf3640 1 -- 172.21.15.55:0/1445057707 learned_addr learned my addr 172.21.15.55:0/1445057707 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.373+0000 7f53a8bf3640 1 -- 172.21.15.55:0/1445057707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f366770 msgr2=0x55931f369f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.373+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/1445057707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f366770 0x55931f369f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.373+0000 7f53a8bf3640 1 -- 172.21.15.55:0/1445057707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f393b10 msgr2=0x55931f396320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.373+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/1445057707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f393b10 0x55931f396320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.373+0000 7f53a8bf3640 1 -- 172.21.15.55:0/1445057707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55931f282f10 con 0x55931f393ef0 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.373+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/1445057707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f396860 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5394006d40 tx=0x7f5394014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d86877860363245 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.373+0000 7f538effd640 1 -- 172.21.15.55:0/1445057707 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539401b070 con 0x55931f393ef0 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.373+0000 7f538effd640 1 -- 172.21.15.55:0/1445057707 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394027070 con 0x55931f393ef0 2024-04-25T08:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.373+0000 7f538effd640 1 -- 172.21.15.55:0/1445057707 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394003a20 con 0x55931f393ef0 2024-04-25T08:58:42.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.374+0000 7f53ae437740 1 -- 172.21.15.55:0/1445057707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 msgr2=0x55931f396860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.374+0000 7f53ae437740 1 --2- 172.21.15.55:0/1445057707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f396860 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5394006d40 tx=0x7f5394014000 comp rx=0 tx=0).stop 2024-04-25T08:58:42.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.374+0000 7f53ae437740 1 -- 172.21.15.55:0/1445057707 shutdown_connections 2024-04-25T08:58:42.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.374+0000 7f53ae437740 1 --2- 172.21.15.55:0/1445057707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f366770 0x55931f369f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.374+0000 7f53ae437740 1 --2- 172.21.15.55:0/1445057707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f396860 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.374+0000 7f53ae437740 1 --2- 172.21.15.55:0/1445057707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f393b10 0x55931f396320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.374+0000 7f53ae437740 1 -- 172.21.15.55:0/1445057707 >> 172.21.15.55:0/1445057707 conn(0x55931f3689e0 msgr2=0x55931f3b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.374+0000 7f53ae437740 1 -- 172.21.15.55:0/1445057707 shutdown_connections 2024-04-25T08:58:42.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.374+0000 7f53ae437740 1 -- 172.21.15.55:0/1445057707 wait complete. 2024-04-25T08:58:42.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.374+0000 7f53ae437740 1 -- start start 2024-04-25T08:58:42.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.374+0000 7f53ae437740 1 Processor -- start 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.375+0000 7f53ae437740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393b10 0x55931f36af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.375+0000 7f53ae437740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f36b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.375+0000 7f53ae437740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 0x55931f3ac960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.375+0000 7f53ae437740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55931f36bb90 con 0x55931f393ef0 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.375+0000 7f53ae437740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55931f26e4b0 con 0x55931f38a750 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.375+0000 7f53ae437740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55931f36be70 con 0x55931f393b10 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.375+0000 7f53ae437740 10 client.0 _ll_register_callbacks cb 0x55931f2ae180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.375+0000 7f53a8bf3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f36b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.375+0000 7f53a8bf3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f36b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39334/0 (socket says 172.21.15.55:39334) 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.375+0000 7f53a8bf3640 1 -- 172.21.15.55:0/1572167854 learned_addr learned my addr 172.21.15.55:0/1572167854 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f53a9bf5640 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 0x55931f3ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f53a93f4640 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393b10 0x55931f36af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f53a8bf3640 1 -- 172.21.15.55:0/1572167854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393b10 msgr2=0x55931f36af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393b10 0x55931f36af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f53a8bf3640 1 -- 172.21.15.55:0/1572167854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 msgr2=0x55931f3ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 0x55931f3ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f53a8bf3640 1 -- 172.21.15.55:0/1572167854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55931f0ae7d0 con 0x55931f393ef0 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f36b4d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5394004410 tx=0x7f5394004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3e2ef4bc0798e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f5383fff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f5383fff640 1 -- 172.21.15.55:0/1572167854 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539401b040 con 0x55931f393ef0 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f5383fff640 1 -- 172.21.15.55:0/1572167854 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5394022940 con 0x55931f393ef0 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f53ae437740 1 -- 172.21.15.55:0/1572167854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5394027070 con 0x55931f393ef0 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f5383fff640 1 -- 172.21.15.55:0/1572167854 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f539403d050 con 0x55931f393ef0 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f53ae437740 10 client.7002 fetch_fsmap learned FSMap version 43 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f53ae437740 1 -- 172.21.15.55:0/1572167854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55931efe43f0 con 0x55931f393ef0 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f5383fff640 1 -- 172.21.15.55:0/1572167854 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394027070 con 0x55931f393ef0 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.376+0000 7f5383fff640 1 -- 172.21.15.55:0/1572167854 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5394040020 con 0x55931f393ef0 2024-04-25T08:58:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.377+0000 7f53ae437740 10 client.7002 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.377+0000 7f53ae437740 10 client.7002 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.377+0000 7f53ae437740 20 client.7002 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.377+0000 7f53ae437740 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55931f3acea0 0x55931f3ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.377+0000 7f53ae437740 4 client.7002 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.377+0000 7f53ae437740 1 -- 172.21.15.55:0/1572167854 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55931f2dd2e0 con 0x55931f3acea0 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.377+0000 7f53a93f4640 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55931f3acea0 0x55931f3ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.377+0000 7f5383fff640 10 client.7002 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.377+0000 7f53a93f4640 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55931f3acea0 0x55931f3ad280 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e27d79a7adabf85 server_cookie=ad1aff30da6695eb in_seq=0 out_seq=0 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f5383fff640 1 -- 172.21.15.55:0/1572167854 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55931f2dd2e0 con 0x55931f3acea0 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f5383fff640 10 client.7002 handle_command_reply: tid=0 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 1 client.7002 shutdown 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 1 -- 172.21.15.55:0/1572167854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 msgr2=0x55931f36b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f36b4d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5394004410 tx=0x7f5394004730 comp rx=0 tx=0).stop 2024-04-25T08:58:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 1 -- 172.21.15.55:0/1572167854 shutdown_connections 2024-04-25T08:58:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55931f3acea0 0x55931f3ad280 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 0x55931f3ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f5383fff640 0 client.7002 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393ef0 0x55931f36b4d0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 1 --2- 172.21.15.55:0/1572167854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393b10 0x55931f36af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 1 -- 172.21.15.55:0/1572167854 >> 172.21.15.55:0/1572167854 conn(0x55931f366770 msgr2=0x55931f367400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 1 -- 172.21.15.55:0/1572167854 shutdown_connections 2024-04-25T08:58:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 1 -- 172.21.15.55:0/1572167854 wait complete. 2024-04-25T08:58:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.378+0000 7f53ae437740 20 client.7002 trim_cache size 0 max 16384 2024-04-25T08:58:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.393+0000 7f53ae437740 1 Processor -- start 2024-04-25T08:58:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.394+0000 7f53ae437740 1 -- start start 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.394+0000 7f53ae437740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 0x55931f36be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.394+0000 7f53ae437740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f366e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.394+0000 7f53ae437740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393ef0 0x55931f3673a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.394+0000 7f53ae437740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55931f3ae5e0 con 0x55931f393b10 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.394+0000 7f53ae437740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a42000f0 con 0x55931f38a750 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.394+0000 7f53ae437740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a41ff290 con 0x55931f393ef0 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.394+0000 7f53a8bf3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f366e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.394+0000 7f53a8bf3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f366e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39340/0 (socket says 172.21.15.55:39340) 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.394+0000 7f53a8bf3640 1 -- 172.21.15.55:0/2861071072 learned_addr learned my addr 172.21.15.55:0/2861071072 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53a8bf3640 1 -- 172.21.15.55:0/2861071072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393ef0 msgr2=0x55931f3673a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/2861071072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393ef0 0x55931f3673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53a8bf3640 1 -- 172.21.15.55:0/2861071072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 msgr2=0x55931f36be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/2861071072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 0x55931f36be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53a8bf3640 1 -- 172.21.15.55:0/2861071072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55931f3ad5f0 con 0x55931f393b10 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/2861071072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f366e60 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5394022a00 tx=0x7f539402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355d5d43b3b77bb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f538e7fc640 1 -- 172.21.15.55:0/2861071072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539401b040 con 0x55931f393b10 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f538e7fc640 1 -- 172.21.15.55:0/2861071072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394027070 con 0x55931f393b10 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f538e7fc640 1 -- 172.21.15.55:0/2861071072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394014890 con 0x55931f393b10 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53ae437740 1 -- 172.21.15.55:0/2861071072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 msgr2=0x55931f366e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53ae437740 1 --2- 172.21.15.55:0/2861071072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f366e60 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5394022a00 tx=0x7f539402e070 comp rx=0 tx=0).stop 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53ae437740 1 -- 172.21.15.55:0/2861071072 shutdown_connections 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53ae437740 1 --2- 172.21.15.55:0/2861071072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393ef0 0x55931f3673a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53ae437740 1 --2- 172.21.15.55:0/2861071072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f366e60 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53ae437740 1 --2- 172.21.15.55:0/2861071072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 0x55931f36be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53ae437740 1 -- 172.21.15.55:0/2861071072 >> 172.21.15.55:0/2861071072 conn(0x55931f366770 msgr2=0x55931f36b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53ae437740 1 -- 172.21.15.55:0/2861071072 shutdown_connections 2024-04-25T08:58:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.395+0000 7f53ae437740 1 -- 172.21.15.55:0/2861071072 wait complete. 2024-04-25T08:58:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.396+0000 7f53ae437740 1 -- start start 2024-04-25T08:58:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.396+0000 7f53ae437740 1 Processor -- start 2024-04-25T08:58:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53ae437740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 0x55931f41b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53ae437740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f365600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53ae437740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393ef0 0x55931f365b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53ae437740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4161300 con 0x55931f393b10 2024-04-25T08:58:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53ae437740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4160d00 con 0x55931f38a750 2024-04-25T08:58:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53ae437740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55931f41bbc0 con 0x55931f393ef0 2024-04-25T08:58:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53ae437740 10 client.0 _ll_register_callbacks cb 0x7f53940095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53a8bf3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f365600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53a8bf3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f365600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39354/0 (socket says 172.21.15.55:39354) 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53a8bf3640 1 -- 172.21.15.55:0/4063494022 learned_addr learned my addr 172.21.15.55:0/4063494022 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53a93f4640 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 0x55931f41b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53a9bf5640 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393ef0 0x55931f365b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53a8bf3640 1 -- 172.21.15.55:0/4063494022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393ef0 msgr2=0x55931f365b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393ef0 0x55931f365b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53a8bf3640 1 -- 172.21.15.55:0/4063494022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 msgr2=0x55931f41b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 0x55931f41b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53a8bf3640 1 -- 172.21.15.55:0/4063494022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55931efa40f0 con 0x55931f393b10 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.397+0000 7f53a9bf5640 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393ef0 0x55931f365b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f53a8bf3640 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f365600 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f5394011880 tx=0x7f5394018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9aae7e02011b409 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f5383fff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f5383fff640 1 -- 172.21.15.55:0/4063494022 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539404e060 con 0x55931f393b10 2024-04-25T08:58:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f5383fff640 1 -- 172.21.15.55:0/4063494022 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5394014640 con 0x55931f393b10 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f53ae437740 1 -- 172.21.15.55:0/4063494022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5394027070 con 0x55931f393b10 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f5383fff640 1 -- 172.21.15.55:0/4063494022 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5394054050 con 0x55931f393b10 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f53ae437740 10 client.7008 fetch_fsmap learned FSMap version 43 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f53ae437740 1 -- 172.21.15.55:0/4063494022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55931f41b900 con 0x55931f393b10 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f5383fff640 1 -- 172.21.15.55:0/4063494022 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394027070 con 0x55931f393b10 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f5383fff640 1 -- 172.21.15.55:0/4063494022 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5394057020 con 0x55931f393b10 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f53ae437740 10 client.7008 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f53ae437740 10 client.7008 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f53ae437740 20 client.7008 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f53ae437740 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55931f3672c0 0x55931f388470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f53ae437740 4 client.7008 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f53ae437740 1 -- 172.21.15.55:0/4063494022 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55931f2d7630 con 0x55931f3672c0 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.398+0000 7f53a93f4640 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55931f3672c0 0x55931f388470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53a93f4640 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55931f3672c0 0x55931f388470 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b97184c931c64a28 server_cookie=710995ad145e8733 in_seq=0 out_seq=0 2024-04-25T08:58:42.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f5383fff640 10 client.7008 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f5383fff640 1 -- 172.21.15.55:0/4063494022 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55931f2d7630 con 0x55931f3672c0 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f5383fff640 10 client.7008 handle_command_reply: tid=0 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 1 client.7008 shutdown 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 1 -- 172.21.15.55:0/4063494022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 msgr2=0x55931f365600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f365600 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f5394011880 tx=0x7f5394018000 comp rx=0 tx=0).stop 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 1 -- 172.21.15.55:0/4063494022 shutdown_connections 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55931f3672c0 0x55931f388470 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55931f393ef0 0x55931f365b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55931f393b10 0x55931f365600 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f5383fff640 0 client.7008 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 1 --2- 172.21.15.55:0/4063494022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55931f38a750 0x55931f41b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 1 -- 172.21.15.55:0/4063494022 >> 172.21.15.55:0/4063494022 conn(0x55931f366770 msgr2=0x55931f3b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 1 -- 172.21.15.55:0/4063494022 shutdown_connections 2024-04-25T08:58:42.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 1 -- 172.21.15.55:0/4063494022 wait complete. 2024-04-25T08:58:42.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.399+0000 7f53ae437740 20 client.7008 trim_cache size 0 max 16384 2024-04-25T08:58:42.395 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:58:42.395 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-25T08:58:42.395 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-25T08:58:42.395 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:58:42.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 -- 172.21.15.55:0/2368443751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f538806b4d0 msgr2=0x7f538806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f538806b4d0 0x7f538806d990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f53a40cfd90 tx=0x7f5394009190 comp rx=0 tx=0).stop 2024-04-25T08:58:42.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 -- 172.21.15.55:0/2368443751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53a40d0f60 msgr2=0x7f53a40ca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53a40d0f60 0x7f53a40ca150 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c3f0 tx=0x7f53a000c8b0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 -- 172.21.15.55:0/2368443751 shutdown_connections 2024-04-25T08:58:42.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f538806b4d0 0x7f538806d990 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a415dca0 0x7f53a415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53a40d3b90 0x7f53a415b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 --2- 172.21.15.55:0/2368443751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53a40d0f60 0x7f53a40ca150 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 -- 172.21.15.55:0/2368443751 >> 172.21.15.55:0/2368443751 conn(0x7f53a40726c0 msgr2=0x7f53a415a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 -- 172.21.15.55:0/2368443751 shutdown_connections 2024-04-25T08:58:42.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.400+0000 7f53ab658640 1 -- 172.21.15.55:0/2368443751 wait complete. 2024-04-25T08:58:42.400 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:58:42.400 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:58:42.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.512+0000 7ff8eddd5640 1 Processor -- start 2024-04-25T08:58:42.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.512+0000 7ff8eddd5640 1 -- start start 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.513+0000 7ff8eddd5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff8e815dce0 0x7ff8e80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.513+0000 7ff8eddd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8e80b5b60 0x7ff8e80b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.513+0000 7ff8eddd5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e815e0c0 con 0x7ff8e80d35b0 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.513+0000 7ff8eddd5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80d2510 con 0x7ff8e80b5b60 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.513+0000 7ff8eddd5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80d27f0 con 0x7ff8e815dce0 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.513+0000 7ff8e7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8e80b5b60 0x7ff8e80b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.513+0000 7ff8e6ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff8e80d35b0 0x7ff8e80b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50276/0 (socket says 172.21.15.55:50276) 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.513+0000 7ff8e7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8e80b5b60 0x7ff8e80b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39362/0 (socket says 172.21.15.55:39362) 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.513+0000 7ff8e6ffd640 1 -- 172.21.15.55:0/2675925023 learned_addr learned my addr 172.21.15.55:0/2675925023 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.514+0000 7ff8e77fe640 1 --2- 172.21.15.55:0/2675925023 >> v2:172.21.15.167:3300/0 conn(0x7ff8e815dce0 0x7ff8e80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.514+0000 7ff8e7fff640 1 -- 172.21.15.55:0/2675925023 >> v2:172.21.15.167:3300/0 conn(0x7ff8e815dce0 msgr2=0x7ff8e80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.514+0000 7ff8e7fff640 1 --2- 172.21.15.55:0/2675925023 >> v2:172.21.15.167:3300/0 conn(0x7ff8e815dce0 0x7ff8e80d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.514+0000 7ff8e7fff640 1 -- 172.21.15.55:0/2675925023 >> v1:172.21.15.55:6789/0 conn(0x7ff8e80d35b0 legacy=0x7ff8e80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.514+0000 7ff8e7fff640 1 -- 172.21.15.55:0/2675925023 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e80d2ad0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.514+0000 7ff8e67fc640 1 -- 172.21.15.55:0/2675925023 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147483153 0 0) 0x7ff8e815e0c0 con 0x7ff8e80d35b0 2024-04-25T08:58:42.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.514+0000 7ff8e7fff640 1 --2- 172.21.15.55:0/2675925023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80b5b60 0x7ff8e80b6b00 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80ce220 tx=0x7ff8e002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99c147505989466 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.514+0000 7ff8e67fc640 1 -- 172.21.15.55:0/2675925023 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0007740 con 0x7ff8e80b5b60 2024-04-25T08:58:42.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.515+0000 7ff8e67fc640 1 -- 172.21.15.55:0/2675925023 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e00078e0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.515+0000 7ff8e67fc640 1 -- 172.21.15.55:0/2675925023 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0007cb0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.515+0000 7ff8eddd5640 1 -- 172.21.15.55:0/2675925023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80b5b60 msgr2=0x7ff8e80b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.515+0000 7ff8eddd5640 1 --2- 172.21.15.55:0/2675925023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80b5b60 0x7ff8e80b6b00 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80ce220 tx=0x7ff8e002a680 comp rx=0 tx=0).stop 2024-04-25T08:58:42.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.515+0000 7ff8eddd5640 1 -- 172.21.15.55:0/2675925023 shutdown_connections 2024-04-25T08:58:42.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.515+0000 7ff8eddd5640 1 --2- 172.21.15.55:0/2675925023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80b5b60 0x7ff8e80b6b00 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.515+0000 7ff8eddd5640 1 --2- 172.21.15.55:0/2675925023 >> v2:172.21.15.167:3300/0 conn(0x7ff8e815dce0 0x7ff8e80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.515+0000 7ff8eddd5640 1 -- 172.21.15.55:0/2675925023 >> 172.21.15.55:0/2675925023 conn(0x7ff8e8072900 msgr2=0x7ff8e80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.515+0000 7ff8eddd5640 1 -- 172.21.15.55:0/2675925023 shutdown_connections 2024-04-25T08:58:42.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.515+0000 7ff8eddd5640 1 -- 172.21.15.55:0/2675925023 wait complete. 2024-04-25T08:58:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.516+0000 7ff8eddd5640 1 Processor -- start 2024-04-25T08:58:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.516+0000 7ff8eddd5640 1 -- start start 2024-04-25T08:58:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.517+0000 7ff8eddd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80b5b60 0x7ff8e81f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.517+0000 7ff8eddd5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e80d35b0 0x7ff8e8159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.517+0000 7ff8eddd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e815dce0 0x7ff8e80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.517+0000 7ff8eddd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80b9820 con 0x7ff8e80b5b60 2024-04-25T08:58:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.517+0000 7ff8eddd5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80d3090 con 0x7ff8e80d35b0 2024-04-25T08:58:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.517+0000 7ff8eddd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80b99a0 con 0x7ff8e815dce0 2024-04-25T08:58:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.517+0000 7ff8e77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80b5b60 0x7ff8e81f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.517+0000 7ff8e77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80b5b60 0x7ff8e81f3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39370/0 (socket says 172.21.15.55:39370) 2024-04-25T08:58:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.517+0000 7ff8e77fe640 1 -- 172.21.15.55:0/1639963441 learned_addr learned my addr 172.21.15.55:0/1639963441 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8e6ffd640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e80d35b0 0x7ff8e8159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8e7fff640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e815dce0 0x7ff8e80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8e77fe640 1 -- 172.21.15.55:0/1639963441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e815dce0 msgr2=0x7ff8e80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8e77fe640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e815dce0 0x7ff8e80b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8e77fe640 1 -- 172.21.15.55:0/1639963441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e80d35b0 msgr2=0x7ff8e8159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8e77fe640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e80d35b0 0x7ff8e8159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8e77fe640 1 -- 172.21.15.55:0/1639963441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e81f44d0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8e6ffd640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e80d35b0 0x7ff8e8159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8e7fff640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e815dce0 0x7ff8e80b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8e77fe640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80b5b60 0x7ff8e81f3f90 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800d5f0 tx=0x7ff8d800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8cffff640 1 -- 172.21.15.55:0/1639963441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80125f0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8cffff640 1 -- 172.21.15.55:0/1639963441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8019070 con 0x7ff8e80b5b60 2024-04-25T08:58:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8eddd5640 1 -- 172.21.15.55:0/1639963441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e80aa4e0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8cffff640 1 -- 172.21.15.55:0/1639963441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80129d0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.518+0000 7ff8eddd5640 1 -- 172.21.15.55:0/1639963441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e80aaaa0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.519+0000 7ff8eddd5640 1 -- 172.21.15.55:0/1639963441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e80749b0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.519+0000 7ff8cffff640 1 -- 172.21.15.55:0/1639963441 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff8d8012b70 con 0x7ff8e80b5b60 2024-04-25T08:58:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.520+0000 7ff8cffff640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff8d406b4d0 0x7ff8d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.520+0000 7ff8cffff640 1 -- 172.21.15.55:0/1639963441 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff8d808a5c0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.520+0000 7ff8e6ffd640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff8d406b4d0 0x7ff8d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.520+0000 7ff8e6ffd640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff8d406b4d0 0x7ff8d406d990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80b4930 tx=0x7ff8dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.524+0000 7ff8cffff640 1 -- 172.21.15.55:0/1639963441 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff8e81f44d0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.745+0000 7ff8eddd5640 1 -- 172.21.15.55:0/1639963441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8e80d14a0 con 0x7ff8e80b5b60 2024-04-25T08:58:42.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.745+0000 7ff8cffff640 1 -- 172.21.15.55:0/1639963441 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4941 (secure 0 0 0) 0x7ff8d8059440 con 0x7ff8e80b5b60 2024-04-25T08:58:42.735 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:58:42.735 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:58:14.292405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6852},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6852":{"gid":6852,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":6,"addr":"172.21.15.55:6837/2486130786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2486130786},{"type":"v1","addr":"172.21.15.55:6837","nonce":2486130786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:58:42.735 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 43 2024-04-25T08:58:42.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 -- 172.21.15.55:0/1639963441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff8d406b4d0 msgr2=0x7ff8d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff8d406b4d0 0x7ff8d406d990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80b4930 tx=0x7ff8dc009040 comp rx=0 tx=0).stop 2024-04-25T08:58:42.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 -- 172.21.15.55:0/1639963441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80b5b60 msgr2=0x7ff8e81f3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80b5b60 0x7ff8e81f3f90 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800d5f0 tx=0x7ff8d800dab0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 -- 172.21.15.55:0/1639963441 shutdown_connections 2024-04-25T08:58:42.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff8d406b4d0 0x7ff8d406d990 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e815dce0 0x7ff8e80b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e80d35b0 0x7ff8e8159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 --2- 172.21.15.55:0/1639963441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80b5b60 0x7ff8e81f3f90 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 -- 172.21.15.55:0/1639963441 >> 172.21.15.55:0/1639963441 conn(0x7ff8e8072900 msgr2=0x7ff8e80ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 -- 172.21.15.55:0/1639963441 shutdown_connections 2024-04-25T08:58:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.747+0000 7ff8eddd5640 1 -- 172.21.15.55:0/1639963441 wait complete. 2024-04-25T08:58:42.748 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T08:58:42.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.861+0000 7fc97e6fc640 1 Processor -- start 2024-04-25T08:58:42.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.861+0000 7fc97e6fc640 1 -- start start 2024-04-25T08:58:42.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.862+0000 7fc97e6fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc97815b7b0 0x7fc9780ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.862+0000 7fc97e6fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97815f000 con 0x7fc97815e820 2024-04-25T08:58:42.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.862+0000 7fc97e6fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97815ed20 con 0x7fc9780cf760 2024-04-25T08:58:42.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.862+0000 7fc97e6fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780ced00 con 0x7fc97815b7b0 2024-04-25T08:58:42.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.862+0000 7fc97cc99640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc97815e820 0x7fc9780cc080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50286/0 (socket says 172.21.15.55:50286) 2024-04-25T08:58:42.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.862+0000 7fc97cc99640 1 -- 172.21.15.55:0/2857925269 learned_addr learned my addr 172.21.15.55:0/2857925269 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:42.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.862+0000 7fc977fff640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc97815b7b0 0x7fc9780ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.862+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989878007 0 0) 0x7fc97815f000 con 0x7fc97815e820 2024-04-25T08:58:42.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.862+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc964003520 con 0x7fc97815e820 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4094778572 0 0) 0x7fc964003520 con 0x7fc97815e820 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc97815b7b0 msgr2=0x7fc9780ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc97815b7b0 0x7fc9780ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 >> v1:172.21.15.167:6789/0 conn(0x7fc9780cf760 legacy=0x7fc97815e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780cdce0 con 0x7fc97815e820 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc9700019f0 con 0x7fc97815e820 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 >> v1:172.21.15.55:6789/0 conn(0x7fc97815e820 legacy=0x7fc9780cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc97815b7b0 0x7fc9640039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc964003f20 0x7fc964004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc964004d40 0x7fc9640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780ced00 con 0x7fc964004d40 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96400ba20 con 0x7fc964003f20 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96400bc20 con 0x7fc97815b7b0 2024-04-25T08:58:42.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc97cc99640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc964004d40 0x7fc9640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc977fff640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc97815b7b0 0x7fc9640039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc9777fe640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc964003f20 0x7fc964004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc97cc99640 1 -- 172.21.15.55:0/2857925269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc97815b7b0 msgr2=0x7fc9640039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc97cc99640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc97815b7b0 0x7fc9640039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc97cc99640 1 -- 172.21.15.55:0/2857925269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc964003f20 msgr2=0x7fc964004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc97cc99640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc964003f20 0x7fc964004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.863+0000 7fc97cc99640 1 -- 172.21.15.55:0/2857925269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964003520 con 0x7fc964004d40 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.864+0000 7fc97cc99640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc964004d40 0x7fc9640051c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc97815ec50 tx=0x7fc964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eeacda8f71f4bfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.864+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000a410 con 0x7fc964004d40 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.864+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97002f070 con 0x7fc964004d40 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.864+0000 7fc976ffd640 1 -- 172.21.15.55:0/2857925269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97002bc30 con 0x7fc964004d40 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.865+0000 7fc97e6fc640 1 -- 172.21.15.55:0/2857925269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc964004d40 msgr2=0x7fc9640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.865+0000 7fc97e6fc640 1 --2- 172.21.15.55:0/2857925269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc964004d40 0x7fc9640051c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc97815ec50 tx=0x7fc964005830 comp rx=0 tx=0).stop 2024-04-25T08:58:42.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.865+0000 7fc97cc99640 1 -- 172.21.15.55:0/2857925269 reap_dead start 2024-04-25T08:58:42.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.865+0000 7fc97e6fc640 1 -- 172.21.15.55:0/2857925269 shutdown_connections 2024-04-25T08:58:42.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.865+0000 7fc97e6fc640 1 -- 172.21.15.55:0/2857925269 >> 172.21.15.55:0/2857925269 conn(0x7fc97806f4a0 msgr2=0x7fc97806f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.865+0000 7fc97e6fc640 1 -- 172.21.15.55:0/2857925269 shutdown_connections 2024-04-25T08:58:42.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.865+0000 7fc97e6fc640 1 -- 172.21.15.55:0/2857925269 wait complete. 2024-04-25T08:58:42.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.866+0000 7fc97e6fc640 1 Processor -- start 2024-04-25T08:58:42.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.866+0000 7fc97e6fc640 1 -- start start 2024-04-25T08:58:42.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc97e6fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc978156bb0 0x7fc9780b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc97e6fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9780b3e50 0x7fc978158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc97e6fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9781594f0 0x7fc9781e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc97e6fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781619f0 con 0x7fc9780b3e50 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc97e6fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780ce330 con 0x7fc9781594f0 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc97e6fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780ce7c0 con 0x7fc978156bb0 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9780b3e50 0x7fc978158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9780b3e50 0x7fc978158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39380/0 (socket says 172.21.15.55:39380) 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc9777fe640 1 -- 172.21.15.55:0/1438063979 learned_addr learned my addr 172.21.15.55:0/1438063979 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc977fff640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc978156bb0 0x7fc9780b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc97cc99640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9781594f0 0x7fc9781e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc9777fe640 1 -- 172.21.15.55:0/1438063979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc978156bb0 msgr2=0x7fc9780b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc9777fe640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc978156bb0 0x7fc9780b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc9777fe640 1 -- 172.21.15.55:0/1438063979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9781594f0 msgr2=0x7fc9781e70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc9777fe640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9781594f0 0x7fc9781e70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc9777fe640 1 -- 172.21.15.55:0/1438063979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9781e9540 con 0x7fc9780b3e50 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc97cc99640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9781594f0 0x7fc9781e70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.867+0000 7fc9777fe640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9780b3e50 0x7fc978158fb0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc96800f8b0 tx=0x7fc96800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.868+0000 7fc974ff9640 1 -- 172.21.15.55:0/1438063979 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680052e0 con 0x7fc9780b3e50 2024-04-25T08:58:42.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.868+0000 7fc974ff9640 1 -- 172.21.15.55:0/1438063979 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc968018070 con 0x7fc9780b3e50 2024-04-25T08:58:42.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.868+0000 7fc974ff9640 1 -- 172.21.15.55:0/1438063979 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96800d970 con 0x7fc9780b3e50 2024-04-25T08:58:42.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.868+0000 7fc97e6fc640 1 -- 172.21.15.55:0/1438063979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9781e84a0 con 0x7fc9780b3e50 2024-04-25T08:58:42.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.868+0000 7fc97e6fc640 1 -- 172.21.15.55:0/1438063979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9781e8a60 con 0x7fc9780b3e50 2024-04-25T08:58:42.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.869+0000 7fc974ff9640 1 -- 172.21.15.55:0/1438063979 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc96800db10 con 0x7fc9780b3e50 2024-04-25T08:58:42.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.869+0000 7fc974ff9640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc95806b4d0 0x7fc95806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.869+0000 7fc974ff9640 1 -- 172.21.15.55:0/1438063979 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc96808a220 con 0x7fc9780b3e50 2024-04-25T08:58:42.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.870+0000 7fc977fff640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc95806b4d0 0x7fc95806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.870+0000 7fc977fff640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc95806b4d0 0x7fc95806d990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc960009bc0 tx=0x7fc960009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.871+0000 7fc981400740 1 Processor -- start 2024-04-25T08:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.871+0000 7fc981400740 1 -- start start 2024-04-25T08:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.871+0000 7fc981400740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcd0590 0x55a0dfcd26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.871+0000 7fc981400740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfcd0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.871+0000 7fc981400740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.871+0000 7fc981400740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0dfc33c60 con 0x55a0dfcd0590 2024-04-25T08:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.871+0000 7fc981400740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0dfbd2d80 con 0x55a0dfcfb050 2024-04-25T08:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.871+0000 7fc981400740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0dfc2fd00 con 0x55a0dfd0cc60 2024-04-25T08:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.871+0000 7fc977fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcd0590 0x55a0dfcd26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc977fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcd0590 0x55a0dfcd26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39386/0 (socket says 172.21.15.55:39386) 2024-04-25T08:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc977fff640 1 -- 172.21.15.55:0/2231539016 learned_addr learned my addr 172.21.15.55:0/2231539016 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc9777fe640 1 --2- 172.21.15.55:0/2231539016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfcd0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc97cc99640 1 --2- 172.21.15.55:0/2231539016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc977fff640 1 -- 172.21.15.55:0/2231539016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 msgr2=0x55a0dfcd0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc977fff640 1 --2- 172.21.15.55:0/2231539016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfcd0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc977fff640 1 -- 172.21.15.55:0/2231539016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcfb050 msgr2=0x55a0dfcfb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc977fff640 1 --2- 172.21.15.55:0/2231539016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc977fff640 1 -- 172.21.15.55:0/2231539016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0dfa147c0 con 0x55a0dfcd0590 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc97cc99640 1 --2- 172.21.15.55:0/2231539016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc977fff640 1 --2- 172.21.15.55:0/2231539016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcd0590 0x55a0dfcd26f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc960004040 tx=0x7fc960017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123cfe7c7bdb99d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc96dffb640 1 -- 172.21.15.55:0/2231539016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96001b070 con 0x55a0dfcd0590 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc96dffb640 1 -- 172.21.15.55:0/2231539016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc960003da0 con 0x55a0dfcd0590 2024-04-25T08:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.872+0000 7fc96dffb640 1 -- 172.21.15.55:0/2231539016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960022630 con 0x55a0dfcd0590 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.873+0000 7fc981400740 1 -- 172.21.15.55:0/2231539016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcd0590 msgr2=0x55a0dfcd26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.873+0000 7fc981400740 1 --2- 172.21.15.55:0/2231539016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcd0590 0x55a0dfcd26f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc960004040 tx=0x7fc960017000 comp rx=0 tx=0).stop 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.873+0000 7fc981400740 1 -- 172.21.15.55:0/2231539016 shutdown_connections 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.873+0000 7fc981400740 1 --2- 172.21.15.55:0/2231539016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.873+0000 7fc981400740 1 --2- 172.21.15.55:0/2231539016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfcd0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.873+0000 7fc981400740 1 --2- 172.21.15.55:0/2231539016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcd0590 0x55a0dfcd26f0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.873+0000 7fc981400740 1 -- 172.21.15.55:0/2231539016 >> 172.21.15.55:0/2231539016 conn(0x55a0dfc986e0 msgr2=0x55a0dfd16050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.873+0000 7fc981400740 1 -- 172.21.15.55:0/2231539016 shutdown_connections 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.873+0000 7fc981400740 1 -- 172.21.15.55:0/2231539016 wait complete. 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.873+0000 7fc981400740 1 -- start start 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc981400740 1 Processor -- start 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc981400740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcd0590 0x55a0dfcea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc981400740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc981400740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfce8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc981400740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0dfbd0840 con 0x55a0dfcfb050 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc981400740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0dfcf8ba0 con 0x55a0dfcd0590 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc981400740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0dfce8c70 con 0x55a0dfd0cc60 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc981400740 10 client.0 _ll_register_callbacks cb 0x55a0dfbea980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39398/0 (socket says 172.21.15.55:39398) 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc9777fe640 1 -- 172.21.15.55:0/1589743341 learned_addr learned my addr 172.21.15.55:0/1589743341 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.874+0000 7fc977fff640 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcd0590 0x55a0dfcea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc97cc99640 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfce8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc9777fe640 1 -- 172.21.15.55:0/1589743341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 msgr2=0x55a0dfce8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc9777fe640 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfce8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc9777fe640 1 -- 172.21.15.55:0/1589743341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcd0590 msgr2=0x55a0dfcea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc9777fe640 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcd0590 0x55a0dfcea760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc9777fe640 1 -- 172.21.15.55:0/1589743341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0dfa74f50 con 0x55a0dfcfb050 2024-04-25T08:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc9777fe640 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfc860 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc968054d70 tx=0x7fc968058330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4412423085273ff1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc956ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc956ffd640 1 -- 172.21.15.55:0/1589743341 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc968086020 con 0x55a0dfcfb050 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc956ffd640 1 -- 172.21.15.55:0/1589743341 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc968070210 con 0x55a0dfcfb050 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc981400740 1 -- 172.21.15.55:0/1589743341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc960003da0 con 0x55a0dfcfb050 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc956ffd640 1 -- 172.21.15.55:0/1589743341 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc968070070 con 0x55a0dfcfb050 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc981400740 10 client.7029 fetch_fsmap learned FSMap version 43 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc981400740 1 -- 172.21.15.55:0/1589743341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55a0df9080b0 con 0x55a0dfcfb050 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc956ffd640 1 -- 172.21.15.55:0/1589743341 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc960003da0 con 0x55a0dfcfb050 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc956ffd640 1 -- 172.21.15.55:0/1589743341 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc9680772f0 con 0x55a0dfcfb050 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc981400740 10 client.7029 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc981400740 10 client.7029 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc981400740 20 client.7029 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc981400740 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55a0dfd10560 0x55a0dfd10940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc981400740 4 client.7029 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.875+0000 7fc981400740 1 -- 172.21.15.55:0/1589743341 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0dfbf3e60 con 0x55a0dfd10560 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.876+0000 7fc977fff640 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55a0dfd10560 0x55a0dfd10940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.876+0000 7fc956ffd640 10 client.7029 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.876+0000 7fc977fff640 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55a0dfd10560 0x55a0dfd10940 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57499558e2b316dc server_cookie=1aef6de04e7398d in_seq=0 out_seq=0 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.876+0000 7fc956ffd640 1 -- 172.21.15.55:0/1589743341 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a0dfbf3e60 con 0x55a0dfd10560 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.876+0000 7fc956ffd640 10 client.7029 handle_command_reply: tid=0 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 1 client.7029 shutdown 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 1 -- 172.21.15.55:0/1589743341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 msgr2=0x55a0dfcfc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfc860 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc968054d70 tx=0x7fc968058330 comp rx=0 tx=0).stop 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 1 -- 172.21.15.55:0/1589743341 shutdown_connections 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55a0dfd10560 0x55a0dfd10940 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfce8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfc860 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc956ffd640 0 client.7029 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 1 --2- 172.21.15.55:0/1589743341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcd0590 0x55a0dfcea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 1 -- 172.21.15.55:0/1589743341 >> 172.21.15.55:0/1589743341 conn(0x55a0dfc986e0 msgr2=0x55a0dfd193b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 1 -- 172.21.15.55:0/1589743341 shutdown_connections 2024-04-25T08:58:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 1 -- 172.21.15.55:0/1589743341 wait complete. 2024-04-25T08:58:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.877+0000 7fc981400740 20 client.7029 trim_cache size 0 max 16384 2024-04-25T08:58:42.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.889+0000 7fc981400740 1 Processor -- start 2024-04-25T08:58:42.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.889+0000 7fc981400740 1 -- start start 2024-04-25T08:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.889+0000 7fc981400740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfcd0590 0x55a0dfcfbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.889+0000 7fc981400740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcf5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc981400740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfd0cc60 0x55a0dfcf5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc981400740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781ffcf0 con 0x55a0dfcfb050 2024-04-25T08:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc981400740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780b5b90 con 0x55a0dfd0cc60 2024-04-25T08:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc981400740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781ff6f0 con 0x55a0dfcd0590 2024-04-25T08:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcf5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcf5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39414/0 (socket says 172.21.15.55:39414) 2024-04-25T08:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc9777fe640 1 -- 172.21.15.55:0/2350370007 learned_addr learned my addr 172.21.15.55:0/2350370007 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc977fff640 1 --2- 172.21.15.55:0/2350370007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfcd0590 0x55a0dfcfbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc97cc99640 1 --2- 172.21.15.55:0/2350370007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfd0cc60 0x55a0dfcf5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc9777fe640 1 -- 172.21.15.55:0/2350370007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfcd0590 msgr2=0x55a0dfcfbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc9777fe640 1 --2- 172.21.15.55:0/2350370007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfcd0590 0x55a0dfcfbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc9777fe640 1 -- 172.21.15.55:0/2350370007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfd0cc60 msgr2=0x55a0dfcf5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc9777fe640 1 --2- 172.21.15.55:0/2350370007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfd0cc60 0x55a0dfcf5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc9777fe640 1 -- 172.21.15.55:0/2350370007 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0dfcfdd10 con 0x55a0dfcfb050 2024-04-25T08:58:42.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc977fff640 1 --2- 172.21.15.55:0/2350370007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfcd0590 0x55a0dfcfbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:42.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc97cc99640 1 --2- 172.21.15.55:0/2350370007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfd0cc60 0x55a0dfcf5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:42.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc9777fe640 1 --2- 172.21.15.55:0/2350370007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcf5440 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc968056bc0 tx=0x7fc96806d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad4070da0e745c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc96d7fa640 1 -- 172.21.15.55:0/2350370007 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96807c070 con 0x55a0dfcfb050 2024-04-25T08:58:42.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc96d7fa640 1 -- 172.21.15.55:0/2350370007 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96808a070 con 0x55a0dfcfb050 2024-04-25T08:58:42.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.890+0000 7fc96d7fa640 1 -- 172.21.15.55:0/2350370007 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc968086070 con 0x55a0dfcfb050 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.891+0000 7fc981400740 1 -- 172.21.15.55:0/2350370007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 msgr2=0x55a0dfcf5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.891+0000 7fc981400740 1 --2- 172.21.15.55:0/2350370007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcf5440 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc968056bc0 tx=0x7fc96806d000 comp rx=0 tx=0).stop 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.891+0000 7fc981400740 1 -- 172.21.15.55:0/2350370007 shutdown_connections 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.891+0000 7fc981400740 1 --2- 172.21.15.55:0/2350370007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfd0cc60 0x55a0dfcf5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.891+0000 7fc981400740 1 --2- 172.21.15.55:0/2350370007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcf5440 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.891+0000 7fc981400740 1 --2- 172.21.15.55:0/2350370007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfcd0590 0x55a0dfcfbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.891+0000 7fc981400740 1 -- 172.21.15.55:0/2350370007 >> 172.21.15.55:0/2350370007 conn(0x55a0dfc986e0 msgr2=0x55a0dfcf7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.891+0000 7fc981400740 1 -- 172.21.15.55:0/2350370007 shutdown_connections 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.891+0000 7fc981400740 1 -- 172.21.15.55:0/2350370007 wait complete. 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.891+0000 7fc981400740 1 -- start start 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc981400740 1 Processor -- start 2024-04-25T08:58:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc981400740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcd0590 0x55a0dfd111c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc981400740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc981400740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfcfb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc981400740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0dfcfe230 con 0x55a0dfcfb050 2024-04-25T08:58:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc981400740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0dfce8ad0 con 0x55a0dfcd0590 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc981400740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0dfcfe720 con 0x55a0dfd0cc60 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc981400740 10 client.0 _ll_register_callbacks cb 0x7fc9600098b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39418/0 (socket says 172.21.15.55:39418) 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc9777fe640 1 -- 172.21.15.55:0/706967540 learned_addr learned my addr 172.21.15.55:0/706967540 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.892+0000 7fc977fff640 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcd0590 0x55a0dfd111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc97cc99640 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfcfb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc9777fe640 1 -- 172.21.15.55:0/706967540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 msgr2=0x55a0dfcfb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc9777fe640 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfcfb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc9777fe640 1 -- 172.21.15.55:0/706967540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcd0590 msgr2=0x55a0dfd111c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc9777fe640 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcd0590 0x55a0dfd111c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc9777fe640 1 -- 172.21.15.55:0/706967540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0dfd2f6d0 con 0x55a0dfcfb050 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc9777fe640 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfb430 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc968054d70 tx=0x7fc968088590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0681a7643a6127d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc956ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc956ffd640 1 -- 172.21.15.55:0/706967540 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96807c070 con 0x55a0dfcfb050 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc956ffd640 1 -- 172.21.15.55:0/706967540 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc968070410 con 0x55a0dfcfb050 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc981400740 1 -- 172.21.15.55:0/706967540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc96808a070 con 0x55a0dfcfb050 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc956ffd640 1 -- 172.21.15.55:0/706967540 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc96806b050 con 0x55a0dfcfb050 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc981400740 10 client.7035 fetch_fsmap learned FSMap version 43 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc981400740 1 -- 172.21.15.55:0/706967540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55a0dfd2f6d0 con 0x55a0dfcfb050 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc956ffd640 1 -- 172.21.15.55:0/706967540 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96808a070 con 0x55a0dfcfb050 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc956ffd640 1 -- 172.21.15.55:0/706967540 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc968057d60 con 0x55a0dfcfb050 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc981400740 10 client.7035 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc981400740 10 client.7035 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.893+0000 7fc981400740 20 client.7035 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55a0dfcfa450 0x55a0dfcfa830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 4 client.7035 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T08:58:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 -- 172.21.15.55:0/706967540 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55a0dfc411a0 con 0x55a0dfcfa450 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc977fff640 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55a0dfcfa450 0x55a0dfcfa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc956ffd640 10 client.7035 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc977fff640 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55a0dfcfa450 0x55a0dfcfa830 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1eaf26387f5ae8a server_cookie=c8ce850139c553c1 in_seq=0 out_seq=0 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc956ffd640 1 -- 172.21.15.55:0/706967540 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+236 (crc 0 0 0) 0x55a0dfc411a0 con 0x55a0dfcfa450 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc956ffd640 10 client.7035 handle_command_reply: tid=0 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 client.7035 shutdown 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 -- 172.21.15.55:0/706967540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 msgr2=0x55a0dfcfb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfb430 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc968054d70 tx=0x7fc968088590 comp rx=0 tx=0).stop 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 -- 172.21.15.55:0/706967540 shutdown_connections 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55a0dfcfa450 0x55a0dfcfa830 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a0dfd0cc60 0x55a0dfcfb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc956ffd640 0 client.7035 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0dfcfb050 0x55a0dfcfb430 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 --2- 172.21.15.55:0/706967540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0dfcd0590 0x55a0dfd111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 -- 172.21.15.55:0/706967540 >> 172.21.15.55:0/706967540 conn(0x55a0dfc986e0 msgr2=0x55a0dfcfc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.894+0000 7fc981400740 1 -- 172.21.15.55:0/706967540 shutdown_connections 2024-04-25T08:58:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc981400740 1 -- 172.21.15.55:0/706967540 wait complete. 2024-04-25T08:58:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc981400740 20 client.7035 trim_cache size 0 max 16384 2024-04-25T08:58:42.891 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:58:42.891 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T08:58:42.891 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:58:42.891 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "dentry", 2024-04-25T08:58:42.891 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 997127802, 2024-04-25T08:58:42.891 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627776, 2024-04-25T08:58:42.892 INFO:teuthology.orchestra.run.smithi055.stdout: "frag": "*", 2024-04-25T08:58:42.892 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "file_to_be_damaged", 2024-04-25T08:58:42.892 INFO:teuthology.orchestra.run.smithi055.stdout: "snap_id": "head", 2024-04-25T08:58:42.892 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/subdir/file_to_be_damaged" 2024-04-25T08:58:42.892 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:58:42.892 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T08:58:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 -- 172.21.15.55:0/1438063979 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc95806b4d0 msgr2=0x7fc95806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc95806b4d0 0x7fc95806d990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc960009bc0 tx=0x7fc960009190 comp rx=0 tx=0).stop 2024-04-25T08:58:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 -- 172.21.15.55:0/1438063979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9780b3e50 msgr2=0x7fc978158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9780b3e50 0x7fc978158fb0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc96800f8b0 tx=0x7fc96800fcb0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 -- 172.21.15.55:0/1438063979 shutdown_connections 2024-04-25T08:58:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc95806b4d0 0x7fc95806d990 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9781594f0 0x7fc9781e70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9780b3e50 0x7fc978158fb0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 --2- 172.21.15.55:0/1438063979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc978156bb0 0x7fc9780b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 -- 172.21.15.55:0/1438063979 >> 172.21.15.55:0/1438063979 conn(0x7fc97806f4a0 msgr2=0x7fc97815c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 -- 172.21.15.55:0/1438063979 shutdown_connections 2024-04-25T08:58:42.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:42.895+0000 7fc97e6fc640 1 -- 172.21.15.55:0/1438063979 wait complete. 2024-04-25T08:58:42.895 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T08:58:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.006+0000 7f243d6d2640 1 Processor -- start 2024-04-25T08:58:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.006+0000 7f243d6d2640 1 -- start start 2024-04-25T08:58:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.007+0000 7f243d6d2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f243815dce0 0x7f24380d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.007+0000 7f243d6d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24380b5b60 0x7f24380b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.007+0000 7f243d6d2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243815e0c0 con 0x7f24380d35b0 2024-04-25T08:58:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.007+0000 7f243d6d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24380d2510 con 0x7f24380b5b60 2024-04-25T08:58:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.007+0000 7f243d6d2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24380d27f0 con 0x7f243815dce0 2024-04-25T08:58:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.007+0000 7f24377fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24380b5b60 0x7f24380b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.007+0000 7f24377fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24380b5b60 0x7f24380b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39430/0 (socket says 172.21.15.55:39430) 2024-04-25T08:58:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.007+0000 7f24377fe640 1 -- 172.21.15.55:0/1715187741 learned_addr learned my addr 172.21.15.55:0/1715187741 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.007+0000 7f2436ffd640 1 --2- 172.21.15.55:0/1715187741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f243815dce0 0x7f24380d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.008+0000 7f24377fe640 1 -- 172.21.15.55:0/1715187741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f243815dce0 msgr2=0x7f24380d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.008+0000 7f24377fe640 1 --2- 172.21.15.55:0/1715187741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f243815dce0 0x7f24380d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.008+0000 7f24377fe640 1 -- 172.21.15.55:0/1715187741 >> v1:172.21.15.167:6789/0 conn(0x7f24380d35b0 legacy=0x7f24380b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.008+0000 7f24377fe640 1 -- 172.21.15.55:0/1715187741 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380d2ad0 con 0x7f24380b5b60 2024-04-25T08:58:43.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.008+0000 7f24377fe640 1 --2- 172.21.15.55:0/1715187741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24380b5b60 0x7f24380b6b00 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2430009e50 tx=0x7f243002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e99d4063007fbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.008+0000 7f24367fc640 1 -- 172.21.15.55:0/1715187741 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430036070 con 0x7f24380b5b60 2024-04-25T08:58:43.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.008+0000 7f24367fc640 1 -- 172.21.15.55:0/1715187741 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2430031600 con 0x7f24380b5b60 2024-04-25T08:58:43.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.008+0000 7f24367fc640 1 -- 172.21.15.55:0/1715187741 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24300319d0 con 0x7f24380b5b60 2024-04-25T08:58:43.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.009+0000 7f243d6d2640 1 -- 172.21.15.55:0/1715187741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24380b5b60 msgr2=0x7f24380b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.009+0000 7f243d6d2640 1 --2- 172.21.15.55:0/1715187741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24380b5b60 0x7f24380b6b00 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2430009e50 tx=0x7f243002a710 comp rx=0 tx=0).stop 2024-04-25T08:58:43.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.009+0000 7f243d6d2640 1 -- 172.21.15.55:0/1715187741 shutdown_connections 2024-04-25T08:58:43.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.009+0000 7f243d6d2640 1 --2- 172.21.15.55:0/1715187741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24380b5b60 0x7f24380b6b00 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.009+0000 7f243d6d2640 1 --2- 172.21.15.55:0/1715187741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f243815dce0 0x7f24380d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.009+0000 7f243d6d2640 1 -- 172.21.15.55:0/1715187741 >> 172.21.15.55:0/1715187741 conn(0x7f2438072900 msgr2=0x7f24380d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.009+0000 7f243d6d2640 1 -- 172.21.15.55:0/1715187741 shutdown_connections 2024-04-25T08:58:43.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.009+0000 7f243d6d2640 1 -- 172.21.15.55:0/1715187741 wait complete. 2024-04-25T08:58:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.010+0000 7f243d6d2640 1 Processor -- start 2024-04-25T08:58:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.010+0000 7f243d6d2640 1 -- start start 2024-04-25T08:58:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f243d6d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24380b5b60 0x7f24380cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f243d6d2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24380d35b0 0x7f2438160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f243d6d2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f243815dce0 0x7f24380caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f243d6d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380b9820 con 0x7f24380b5b60 2024-04-25T08:58:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f243d6d2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380d3090 con 0x7f24380d35b0 2024-04-25T08:58:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f243d6d2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24380b99a0 con 0x7f243815dce0 2024-04-25T08:58:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f2436ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24380b5b60 0x7f24380cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f2436ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24380b5b60 0x7f24380cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39434/0 (socket says 172.21.15.55:39434) 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f2436ffd640 1 -- 172.21.15.55:0/1901059035 learned_addr learned my addr 172.21.15.55:0/1901059035 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f242ffff640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24380d35b0 0x7f2438160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f24377fe640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f243815dce0 0x7f24380caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f2436ffd640 1 -- 172.21.15.55:0/1901059035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f243815dce0 msgr2=0x7f24380caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f2436ffd640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f243815dce0 0x7f24380caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f2436ffd640 1 -- 172.21.15.55:0/1901059035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24380d35b0 msgr2=0x7f2438160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f2436ffd640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24380d35b0 0x7f2438160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f2436ffd640 1 -- 172.21.15.55:0/1901059035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2438161000 con 0x7f24380b5b60 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.011+0000 7f242ffff640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24380d35b0 0x7f2438160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.012+0000 7f2436ffd640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24380b5b60 0x7f24380cc080 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f242800d5f0 tx=0x7f242800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.012+0000 7f242f7fe640 1 -- 172.21.15.55:0/1901059035 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280125f0 con 0x7f24380b5b60 2024-04-25T08:58:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.012+0000 7f242f7fe640 1 -- 172.21.15.55:0/1901059035 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2428019070 con 0x7f24380b5b60 2024-04-25T08:58:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.012+0000 7f242f7fe640 1 -- 172.21.15.55:0/1901059035 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280129d0 con 0x7f24380b5b60 2024-04-25T08:58:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.012+0000 7f243d6d2640 1 -- 172.21.15.55:0/1901059035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243815fa20 con 0x7f24380b5b60 2024-04-25T08:58:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.012+0000 7f243d6d2640 1 -- 172.21.15.55:0/1901059035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243815ffe0 con 0x7f24380b5b60 2024-04-25T08:58:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.013+0000 7f243d6d2640 1 -- 172.21.15.55:0/1901059035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24380749b0 con 0x7f24380b5b60 2024-04-25T08:58:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.013+0000 7f242f7fe640 1 -- 172.21.15.55:0/1901059035 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2428012b70 con 0x7f24380b5b60 2024-04-25T08:58:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.014+0000 7f242f7fe640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f241806b4d0 0x7f241806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.014+0000 7f242f7fe640 1 -- 172.21.15.55:0/1901059035 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f242808a650 con 0x7f24380b5b60 2024-04-25T08:58:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.014+0000 7f242ffff640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f241806b4d0 0x7f241806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.014+0000 7f242ffff640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f241806b4d0 0x7f241806d990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f243815a980 tx=0x7f2420009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.018+0000 7f242f7fe640 1 -- 172.21.15.55:0/1901059035 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2428059440 con 0x7f24380b5b60 2024-04-25T08:58:43.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.236+0000 7f243d6d2640 1 -- 172.21.15.55:0/1901059035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f243815d4e0 con 0x7f24380b5b60 2024-04-25T08:58:43.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.237+0000 7f242f7fe640 1 -- 172.21.15.55:0/1901059035 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f2428058d40 con 0x7f24380b5b60 2024-04-25T08:58:43.226 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:58:43.226 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T08:58:43.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 -- 172.21.15.55:0/1901059035 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f241806b4d0 msgr2=0x7f241806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f241806b4d0 0x7f241806d990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f243815a980 tx=0x7f2420009040 comp rx=0 tx=0).stop 2024-04-25T08:58:43.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 -- 172.21.15.55:0/1901059035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24380b5b60 msgr2=0x7f24380cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24380b5b60 0x7f24380cc080 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f242800d5f0 tx=0x7f242800dab0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 -- 172.21.15.55:0/1901059035 shutdown_connections 2024-04-25T08:58:43.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f241806b4d0 0x7f241806d990 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f243815dce0 0x7f24380caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24380d35b0 0x7f2438160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 --2- 172.21.15.55:0/1901059035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24380b5b60 0x7f24380cc080 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 -- 172.21.15.55:0/1901059035 >> 172.21.15.55:0/1901059035 conn(0x7f2438072900 msgr2=0x7f24380ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 -- 172.21.15.55:0/1901059035 shutdown_connections 2024-04-25T08:58:43.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.239+0000 7f243d6d2640 1 -- 172.21.15.55:0/1901059035 wait complete. 2024-04-25T08:58:43.239 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T08:58:43.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:43.239 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-04-25T08:58:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.355+0000 7fe350370640 1 Processor -- start 2024-04-25T08:58:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.355+0000 7fe350370640 1 -- start start 2024-04-25T08:58:43.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.356+0000 7fe350370640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe3481610b0 0x7fe3480b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.356+0000 7fe350370640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe348162040 con 0x7fe3480cef40 2024-04-25T08:58:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.356+0000 7fe350370640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe348162320 con 0x7fe3481618d0 2024-04-25T08:58:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.356+0000 7fe350370640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3480d1ea0 con 0x7fe3481610b0 2024-04-25T08:58:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.356+0000 7fe34e90d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe3480cef40 0x7fe3480d2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50302/0 (socket says 172.21.15.55:50302) 2024-04-25T08:58:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.356+0000 7fe34e90d640 1 -- 172.21.15.55:0/3230480112 learned_addr learned my addr 172.21.15.55:0/3230480112 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.356+0000 7fe34e10c640 1 --2- 172.21.15.55:0/3230480112 >> v2:172.21.15.167:3300/0 conn(0x7fe3481610b0 0x7fe3480b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.356+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489880960 0 0) 0x7fe348162040 con 0x7fe3480cef40 2024-04-25T08:58:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.356+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe334003520 con 0x7fe3480cef40 2024-04-25T08:58:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3783972667 0 0) 0x7fe334003520 con 0x7fe3480cef40 2024-04-25T08:58:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 >> v2:172.21.15.167:3300/0 conn(0x7fe3481610b0 msgr2=0x7fe3480b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 --2- 172.21.15.55:0/3230480112 >> v2:172.21.15.167:3300/0 conn(0x7fe3481610b0 0x7fe3480b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 >> v1:172.21.15.167:6789/0 conn(0x7fe3481618d0 legacy=0x7fe3480ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe348162600 con 0x7fe3480cef40 2024-04-25T08:58:43.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fe3400019f0 con 0x7fe3480cef40 2024-04-25T08:58:43.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 >> v1:172.21.15.55:6789/0 conn(0x7fe3480cef40 legacy=0x7fe3480d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 --2- 172.21.15.55:0/3230480112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3340039b0 0x7fe334003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 --2- 172.21.15.55:0/3230480112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3340043b0 0x7fe334004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 --2- 172.21.15.55:0/3230480112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe334005120 0x7fe33400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480d1ea0 con 0x7fe3340043b0 2024-04-25T08:58:43.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33400c060 con 0x7fe3340039b0 2024-04-25T08:58:43.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33400c260 con 0x7fe334005120 2024-04-25T08:58:43.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d90b640 1 --2- 172.21.15.55:0/3230480112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3340043b0 0x7fe334004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34e10c640 1 --2- 172.21.15.55:0/3230480112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3340039b0 0x7fe334003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34e90d640 1 --2- 172.21.15.55:0/3230480112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe334005120 0x7fe33400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d90b640 1 -- 172.21.15.55:0/3230480112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe334005120 msgr2=0x7fe33400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d90b640 1 --2- 172.21.15.55:0/3230480112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe334005120 0x7fe33400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d90b640 1 -- 172.21.15.55:0/3230480112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3340039b0 msgr2=0x7fe334003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d90b640 1 --2- 172.21.15.55:0/3230480112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3340039b0 0x7fe334003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34d90b640 1 -- 172.21.15.55:0/3230480112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe334003520 con 0x7fe3340043b0 2024-04-25T08:58:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.357+0000 7fe34e90d640 1 -- 172.21.15.55:0/3230480112 reap_dead start 2024-04-25T08:58:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.358+0000 7fe34d90b640 1 --2- 172.21.15.55:0/3230480112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3340043b0 0x7fe334004880 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe338001860 tx=0x7fe334005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fb77ef2912af88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.358+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338037070 con 0x7fe3340043b0 2024-04-25T08:58:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.358+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33802abf0 con 0x7fe3340043b0 2024-04-25T08:58:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.358+0000 7fe34d10a640 1 -- 172.21.15.55:0/3230480112 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338001430 con 0x7fe3340043b0 2024-04-25T08:58:43.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.358+0000 7fe350370640 1 -- 172.21.15.55:0/3230480112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3340043b0 msgr2=0x7fe334004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.358+0000 7fe350370640 1 --2- 172.21.15.55:0/3230480112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3340043b0 0x7fe334004880 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe338001860 tx=0x7fe334005830 comp rx=0 tx=0).stop 2024-04-25T08:58:43.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.359+0000 7fe350370640 1 -- 172.21.15.55:0/3230480112 shutdown_connections 2024-04-25T08:58:43.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.359+0000 7fe350370640 1 --2- 172.21.15.55:0/3230480112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3340043b0 0x7fe334004880 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.359+0000 7fe350370640 1 -- 172.21.15.55:0/3230480112 >> 172.21.15.55:0/3230480112 conn(0x7fe3480b5570 msgr2=0x7fe3480b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.359+0000 7fe350370640 1 -- 172.21.15.55:0/3230480112 shutdown_connections 2024-04-25T08:58:43.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.359+0000 7fe350370640 1 -- 172.21.15.55:0/3230480112 wait complete. 2024-04-25T08:58:43.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.360+0000 7fe350370640 1 Processor -- start 2024-04-25T08:58:43.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.360+0000 7fe350370640 1 -- start start 2024-04-25T08:58:43.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.360+0000 7fe350370640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3340043b0 0x7fe34815a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe350370640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3480c9240 0x7fe3480c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe350370640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe34815f2c0 0x7fe34815f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe350370640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe348161d10 con 0x7fe3480c9240 2024-04-25T08:58:43.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe350370640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480b6c00 con 0x7fe34815f2c0 2024-04-25T08:58:43.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe350370640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe348161490 con 0x7fe3340043b0 2024-04-25T08:58:43.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe34d90b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3480c9240 0x7fe3480c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe34d90b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3480c9240 0x7fe3480c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39458/0 (socket says 172.21.15.55:39458) 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe34d90b640 1 -- 172.21.15.55:0/1204198196 learned_addr learned my addr 172.21.15.55:0/1204198196 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe34d90b640 1 -- 172.21.15.55:0/1204198196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3340043b0 msgr2=0x7fe34815a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe34e10c640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3340043b0 0x7fe34815a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe34d90b640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3340043b0 0x7fe34815a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe34d90b640 1 -- 172.21.15.55:0/1204198196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe34815f2c0 msgr2=0x7fe34815f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe34d90b640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe34815f2c0 0x7fe34815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe34d90b640 1 -- 172.21.15.55:0/1204198196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe348160020 con 0x7fe3480c9240 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe34d90b640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3480c9240 0x7fe3480c96c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe33802a6c0 tx=0x7fe338001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe33effd640 1 -- 172.21.15.55:0/1204198196 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33803f030 con 0x7fe3480c9240 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe33effd640 1 -- 172.21.15.55:0/1204198196 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe338005070 con 0x7fe3480c9240 2024-04-25T08:58:43.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe350370640 1 -- 172.21.15.55:0/1204198196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe348160300 con 0x7fe3480c9240 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe33effd640 1 -- 172.21.15.55:0/1204198196 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338037040 con 0x7fe3480c9240 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.361+0000 7fe350370640 1 -- 172.21.15.55:0/1204198196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3481608c0 con 0x7fe3480c9240 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.363+0000 7fe33effd640 1 -- 172.21.15.55:0/1204198196 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe338042070 con 0x7fe3480c9240 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.363+0000 7fe33effd640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe32c06b500 0x7fe32c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.363+0000 7fe33effd640 1 -- 172.21.15.55:0/1204198196 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe3380a9ea0 con 0x7fe3480c9240 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.363+0000 7fe34e10c640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe32c06b500 0x7fe32c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.364+0000 7fe34e10c640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe32c06b500 0x7fe32c06d9c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe3480cd480 tx=0x7fe344008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.364+0000 7fe35307c740 1 Processor -- start 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.365+0000 7fe35307c740 1 -- start start 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.365+0000 7fe35307c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a66f70 0x564fa7a67350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.365+0000 7fe35307c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a36ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.365+0000 7fe35307c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a37420 0x564fa7a5f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.365+0000 7fe35307c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fa799fc90 con 0x564fa7a67990 2024-04-25T08:58:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.365+0000 7fe35307c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fa7948f50 con 0x564fa7a66f70 2024-04-25T08:58:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.365+0000 7fe35307c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fa799bd30 con 0x564fa7a37420 2024-04-25T08:58:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.365+0000 7fe34d90b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a36ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.365+0000 7fe34d90b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a36ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39470/0 (socket says 172.21.15.55:39470) 2024-04-25T08:58:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.365+0000 7fe34d90b640 1 -- 172.21.15.55:0/3354424397 learned_addr learned my addr 172.21.15.55:0/3354424397 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.366+0000 7fe34e10c640 1 --2- 172.21.15.55:0/3354424397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a66f70 0x564fa7a67350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.366+0000 7fe34e90d640 1 --2- 172.21.15.55:0/3354424397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a37420 0x564fa7a5f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.366+0000 7fe34d90b640 1 -- 172.21.15.55:0/3354424397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a37420 msgr2=0x564fa7a5f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.366+0000 7fe34d90b640 1 --2- 172.21.15.55:0/3354424397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a37420 0x564fa7a5f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.366+0000 7fe34d90b640 1 -- 172.21.15.55:0/3354424397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a66f70 msgr2=0x564fa7a67350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.366+0000 7fe34d90b640 1 --2- 172.21.15.55:0/3354424397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a66f70 0x564fa7a67350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.366+0000 7fe34d90b640 1 -- 172.21.15.55:0/3354424397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fa777ca50 con 0x564fa7a67990 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.366+0000 7fe34d90b640 1 --2- 172.21.15.55:0/3354424397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a36ee0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fe338035040 tx=0x7fe338078d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3f4edb5ba9774d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.366+0000 7fe32bfff640 1 -- 172.21.15.55:0/3354424397 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3380a6070 con 0x564fa7a67990 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.366+0000 7fe32bfff640 1 -- 172.21.15.55:0/3354424397 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe338080d30 con 0x564fa7a67990 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.366+0000 7fe32bfff640 1 -- 172.21.15.55:0/3354424397 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338090030 con 0x564fa7a67990 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.367+0000 7fe35307c740 1 -- 172.21.15.55:0/3354424397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 msgr2=0x564fa7a36ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.367+0000 7fe35307c740 1 --2- 172.21.15.55:0/3354424397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a36ee0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fe338035040 tx=0x7fe338078d20 comp rx=0 tx=0).stop 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.367+0000 7fe35307c740 1 -- 172.21.15.55:0/3354424397 shutdown_connections 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.367+0000 7fe35307c740 1 --2- 172.21.15.55:0/3354424397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a37420 0x564fa7a5f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.367+0000 7fe35307c740 1 --2- 172.21.15.55:0/3354424397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a36ee0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.367+0000 7fe35307c740 1 --2- 172.21.15.55:0/3354424397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a66f70 0x564fa7a67350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.367+0000 7fe35307c740 1 -- 172.21.15.55:0/3354424397 >> 172.21.15.55:0/3354424397 conn(0x564fa7a39360 msgr2=0x564fa7a81d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.367+0000 7fe35307c740 1 -- 172.21.15.55:0/3354424397 shutdown_connections 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.367+0000 7fe35307c740 1 -- 172.21.15.55:0/3354424397 wait complete. 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.367+0000 7fe35307c740 1 -- start start 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.367+0000 7fe35307c740 1 Processor -- start 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.368+0000 7fe35307c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a60670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.368+0000 7fe35307c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a69040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.368+0000 7fe35307c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 0x564fa7a85190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.368+0000 7fe35307c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fa799bd30 con 0x564fa7a67990 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.368+0000 7fe35307c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fa793e700 con 0x564fa7a536f0 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.368+0000 7fe35307c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fa799fc90 con 0x564fa7a66f70 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.368+0000 7fe35307c740 10 client.0 _ll_register_callbacks cb 0x564fa7996150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.368+0000 7fe34d90b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a69040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.368+0000 7fe34d90b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a69040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39486/0 (socket says 172.21.15.55:39486) 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.368+0000 7fe34d90b640 1 -- 172.21.15.55:0/4262385233 learned_addr learned my addr 172.21.15.55:0/4262385233 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe34e90d640 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 0x564fa7a85190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe34e10c640 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a60670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe34d90b640 1 -- 172.21.15.55:0/4262385233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 msgr2=0x564fa7a60670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe34d90b640 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a60670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe34d90b640 1 -- 172.21.15.55:0/4262385233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 msgr2=0x564fa7a85190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe34d90b640 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 0x564fa7a85190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe34d90b640 1 -- 172.21.15.55:0/4262385233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564fa76743e0 con 0x564fa7a67990 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe34e90d640 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 0x564fa7a85190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe34e10c640 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a60670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe34d90b640 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a69040 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe3380a8420 tx=0x7fe33807b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461ec4ba03915a4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe3297fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe3297fa640 1 -- 172.21.15.55:0/4262385233 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3380a6070 con 0x564fa7a67990 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe3297fa640 1 -- 172.21.15.55:0/4262385233 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe338077a70 con 0x564fa7a67990 2024-04-25T08:58:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe35307c740 1 -- 172.21.15.55:0/4262385233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe338080d30 con 0x564fa7a67990 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe3297fa640 1 -- 172.21.15.55:0/4262385233 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe338097050 con 0x564fa7a67990 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe35307c740 10 client.7053 fetch_fsmap learned FSMap version 43 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe35307c740 1 -- 172.21.15.55:0/4262385233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x564fa77dd1e0 con 0x564fa7a67990 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe3297fa640 1 -- 172.21.15.55:0/4262385233 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe338080d30 con 0x564fa7a67990 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe3297fa640 1 -- 172.21.15.55:0/4262385233 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe33804c060 con 0x564fa7a67990 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe35307c740 10 client.7053 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe35307c740 10 client.7053 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.369+0000 7fe35307c740 20 client.7053 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.370+0000 7fe35307c740 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x564fa7a68260 0x564fa7a686b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.370+0000 7fe35307c740 4 client.7053 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.370+0000 7fe35307c740 1 -- 172.21.15.55:0/4262385233 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564fa79ad1d0 con 0x564fa7a68260 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.370+0000 7fe34e10c640 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x564fa7a68260 0x564fa7a686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.370+0000 7fe3297fa640 10 client.7053 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:43.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.370+0000 7fe34e10c640 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x564fa7a68260 0x564fa7a686b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=215a694be804b7d5 server_cookie=2773d446ad1c1ba5 in_seq=0 out_seq=0 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe3297fa640 1 -- 172.21.15.55:0/4262385233 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564fa79ad1d0 con 0x564fa7a68260 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe3297fa640 10 client.7053 handle_command_reply: tid=0 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 1 client.7053 shutdown 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 1 -- 172.21.15.55:0/4262385233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 msgr2=0x564fa7a69040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a69040 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe3380a8420 tx=0x7fe33807b070 comp rx=0 tx=0).stop 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 1 -- 172.21.15.55:0/4262385233 shutdown_connections 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x564fa7a68260 0x564fa7a686b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 0x564fa7a85190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a69040 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 1 --2- 172.21.15.55:0/4262385233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a60670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe3297fa640 0 client.7053 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:43.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 1 -- 172.21.15.55:0/4262385233 >> 172.21.15.55:0/4262385233 conn(0x564fa7a37420 msgr2=0x564fa7a36680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 1 -- 172.21.15.55:0/4262385233 shutdown_connections 2024-04-25T08:58:43.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 1 -- 172.21.15.55:0/4262385233 wait complete. 2024-04-25T08:58:43.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.371+0000 7fe35307c740 20 client.7053 trim_cache size 0 max 16384 2024-04-25T08:58:43.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.387+0000 7fe35307c740 1 Processor -- start 2024-04-25T08:58:43.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.387+0000 7fe35307c740 1 -- start start 2024-04-25T08:58:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.387+0000 7fe35307c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 0x564fa7a60680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.387+0000 7fe35307c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a63ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.387+0000 7fe35307c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a35df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.387+0000 7fe35307c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe348200560 con 0x564fa7a67990 2024-04-25T08:58:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.387+0000 7fe35307c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3481ff720 con 0x564fa7a536f0 2024-04-25T08:58:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.387+0000 7fe35307c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3481feb50 con 0x564fa7a66f70 2024-04-25T08:58:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.387+0000 7fe34e90d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a35df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.387+0000 7fe34e90d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a35df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39502/0 (socket says 172.21.15.55:39502) 2024-04-25T08:58:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.387+0000 7fe34e90d640 1 -- 172.21.15.55:0/2219426088 learned_addr learned my addr 172.21.15.55:0/2219426088 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe34d90b640 1 --2- 172.21.15.55:0/2219426088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a63ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe34e10c640 1 --2- 172.21.15.55:0/2219426088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 0x564fa7a60680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe34e90d640 1 -- 172.21.15.55:0/2219426088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 msgr2=0x564fa7a63ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe34e90d640 1 --2- 172.21.15.55:0/2219426088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a63ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe34e90d640 1 -- 172.21.15.55:0/2219426088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 msgr2=0x564fa7a60680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe34e90d640 1 --2- 172.21.15.55:0/2219426088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 0x564fa7a60680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe34e90d640 1 -- 172.21.15.55:0/2219426088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fa7a52ed0 con 0x564fa7a67990 2024-04-25T08:58:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe34e10c640 1 --2- 172.21.15.55:0/2219426088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 0x564fa7a60680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe34e90d640 1 --2- 172.21.15.55:0/2219426088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a35df0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe3480b6b50 tx=0x7fe340005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e903d5fe52fa87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe32b7fe640 1 -- 172.21.15.55:0/2219426088 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340019070 con 0x564fa7a67990 2024-04-25T08:58:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe32b7fe640 1 -- 172.21.15.55:0/2219426088 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe340007710 con 0x564fa7a67990 2024-04-25T08:58:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.388+0000 7fe32b7fe640 1 -- 172.21.15.55:0/2219426088 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340014400 con 0x564fa7a67990 2024-04-25T08:58:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.389+0000 7fe35307c740 1 -- 172.21.15.55:0/2219426088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 msgr2=0x564fa7a35df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.389+0000 7fe35307c740 1 --2- 172.21.15.55:0/2219426088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a35df0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe3480b6b50 tx=0x7fe340005f40 comp rx=0 tx=0).stop 2024-04-25T08:58:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.389+0000 7fe35307c740 1 -- 172.21.15.55:0/2219426088 shutdown_connections 2024-04-25T08:58:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.389+0000 7fe35307c740 1 --2- 172.21.15.55:0/2219426088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a67990 0x564fa7a35df0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.389+0000 7fe35307c740 1 --2- 172.21.15.55:0/2219426088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a63ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.389+0000 7fe35307c740 1 --2- 172.21.15.55:0/2219426088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a536f0 0x564fa7a60680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.389+0000 7fe35307c740 1 -- 172.21.15.55:0/2219426088 >> 172.21.15.55:0/2219426088 conn(0x564fa7a37420 msgr2=0x564fa7a91420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.389+0000 7fe35307c740 1 -- 172.21.15.55:0/2219426088 shutdown_connections 2024-04-25T08:58:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.389+0000 7fe35307c740 1 -- 172.21.15.55:0/2219426088 wait complete. 2024-04-25T08:58:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.389+0000 7fe35307c740 1 -- start start 2024-04-25T08:58:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.389+0000 7fe35307c740 1 Processor -- start 2024-04-25T08:58:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.390+0000 7fe35307c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a536f0 0x564fa7a605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.390+0000 7fe35307c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a60b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.390+0000 7fe35307c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a67990 0x564fa7a93bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.390+0000 7fe35307c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fa7948f50 con 0x564fa7a536f0 2024-04-25T08:58:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.390+0000 7fe35307c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3481ff120 con 0x564fa7a67990 2024-04-25T08:58:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.390+0000 7fe35307c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fa7a62ba0 con 0x564fa7a66f70 2024-04-25T08:58:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.390+0000 7fe35307c740 10 client.0 _ll_register_callbacks cb 0x564fa7a3e860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.390+0000 7fe34e10c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a536f0 0x564fa7a605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.390+0000 7fe34e10c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a536f0 0x564fa7a605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39512/0 (socket says 172.21.15.55:39512) 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.390+0000 7fe34e10c640 1 -- 172.21.15.55:0/1670034119 learned_addr learned my addr 172.21.15.55:0/1670034119 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe34e90d640 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a67990 0x564fa7a93bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe34e10c640 1 -- 172.21.15.55:0/1670034119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 msgr2=0x564fa7a60b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe34d90b640 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a60b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe34e10c640 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a60b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe34e10c640 1 -- 172.21.15.55:0/1670034119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a67990 msgr2=0x564fa7a93bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe34e10c640 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a67990 0x564fa7a93bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe34e10c640 1 -- 172.21.15.55:0/1670034119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564fa764d4a0 con 0x564fa7a536f0 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe34e10c640 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a536f0 0x564fa7a605e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x564fa7a68c80 tx=0x7fe344004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807b177d209c1077 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe3297fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe3297fa640 1 -- 172.21.15.55:0/1670034119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344004240 con 0x564fa7a536f0 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe3297fa640 1 -- 172.21.15.55:0/1670034119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe3440043e0 con 0x564fa7a536f0 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe35307c740 1 -- 172.21.15.55:0/1670034119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe340007710 con 0x564fa7a536f0 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe3297fa640 1 -- 172.21.15.55:0/1670034119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe344039050 con 0x564fa7a536f0 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe35307c740 10 client.7059 fetch_fsmap learned FSMap version 43 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe35307c740 1 -- 172.21.15.55:0/1670034119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x564fa7a9f7b0 con 0x564fa7a536f0 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe3297fa640 1 -- 172.21.15.55:0/1670034119 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe340007710 con 0x564fa7a536f0 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe3297fa640 1 -- 172.21.15.55:0/1670034119 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe34403c020 con 0x564fa7a536f0 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe35307c740 10 client.7059 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe35307c740 10 client.7059 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe35307c740 20 client.7059 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe35307c740 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x564fa7a81f80 0x564fa7a94100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe35307c740 4 client.7059 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-04-25T08:58:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.391+0000 7fe35307c740 1 -- 172.21.15.55:0/1670034119 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) v1 -- 0x564fa79a7520 con 0x564fa7a81f80 2024-04-25T08:58:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.392+0000 7fe34d90b640 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x564fa7a81f80 0x564fa7a94100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.392+0000 7fe34d90b640 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x564fa7a81f80 0x564fa7a94100 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1799e04a10410d40 server_cookie=70baf6adc248142d in_seq=0 out_seq=0 2024-04-25T08:58:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.392+0000 7fe3297fa640 10 client.7059 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.392+0000 7fe3297fa640 1 -- 172.21.15.55:0/1670034119 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564fa79a7520 con 0x564fa7a81f80 2024-04-25T08:58:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.392+0000 7fe3297fa640 10 client.7059 handle_command_reply: tid=0 2024-04-25T08:58:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.392+0000 7fe35307c740 1 client.7059 shutdown 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.392+0000 7fe35307c740 1 -- 172.21.15.55:0/1670034119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a536f0 msgr2=0x564fa7a605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.392+0000 7fe35307c740 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a536f0 0x564fa7a605e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x564fa7a68c80 tx=0x7fe344004730 comp rx=0 tx=0).stop 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe35307c740 1 -- 172.21.15.55:0/1670034119 shutdown_connections 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe35307c740 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x564fa7a81f80 0x564fa7a94100 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe35307c740 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564fa7a67990 0x564fa7a93bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe35307c740 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564fa7a66f70 0x564fa7a60b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe35307c740 1 --2- 172.21.15.55:0/1670034119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564fa7a536f0 0x564fa7a605e0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe3297fa640 0 client.7059 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe35307c740 1 -- 172.21.15.55:0/1670034119 >> 172.21.15.55:0/1670034119 conn(0x564fa7a37420 msgr2=0x564fa7a63c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe35307c740 1 -- 172.21.15.55:0/1670034119 shutdown_connections 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe35307c740 1 -- 172.21.15.55:0/1670034119 wait complete. 2024-04-25T08:58:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe35307c740 20 client.7059 trim_cache size 0 max 16384 2024-04-25T08:58:43.391 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:58:43.391 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-25T08:58:43.391 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "ed71ff89-64f6-4ab4-a35a-1aa17aac3b3f", 2024-04-25T08:58:43.391 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-25T08:58:43.391 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:58:43.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 -- 172.21.15.55:0/1204198196 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe32c06b500 msgr2=0x7fe32c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe32c06b500 0x7fe32c06d9c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe3480cd480 tx=0x7fe344008040 comp rx=0 tx=0).stop 2024-04-25T08:58:43.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 -- 172.21.15.55:0/1204198196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3480c9240 msgr2=0x7fe3480c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3480c9240 0x7fe3480c96c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe33802a6c0 tx=0x7fe338001230 comp rx=0 tx=0).stop 2024-04-25T08:58:43.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 -- 172.21.15.55:0/1204198196 shutdown_connections 2024-04-25T08:58:43.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe32c06b500 0x7fe32c06d9c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe34815f2c0 0x7fe34815f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3480c9240 0x7fe3480c96c0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 --2- 172.21.15.55:0/1204198196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3340043b0 0x7fe34815a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 -- 172.21.15.55:0/1204198196 >> 172.21.15.55:0/1204198196 conn(0x7fe3480b5570 msgr2=0x7fe3480ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 -- 172.21.15.55:0/1204198196 shutdown_connections 2024-04-25T08:58:43.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.393+0000 7fe350370640 1 -- 172.21.15.55:0/1204198196 wait complete. 2024-04-25T08:58:43.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:58:43.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T08:58:43.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.508+0000 7f7d47c88640 1 Processor -- start 2024-04-25T08:58:43.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.508+0000 7f7d47c88640 1 -- start start 2024-04-25T08:58:43.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d47c88640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d40144e70 0x7f7d4006d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d47c88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d400cf0e0 0x7f7d400cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d47c88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4006dcb0 con 0x7f7d4006d7a0 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d47c88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4015bfe0 con 0x7f7d400cf0e0 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d47c88640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4006df90 con 0x7f7d40144e70 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d46225640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d400cf0e0 0x7f7d400cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d45223640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7d4006d7a0 0x7f7d400ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50314/0 (socket says 172.21.15.55:50314) 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d45223640 1 -- 172.21.15.55:0/815693779 learned_addr learned my addr 172.21.15.55:0/815693779 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d45a24640 1 --2- 172.21.15.55:0/815693779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d40144e70 0x7f7d4006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d46225640 1 -- 172.21.15.55:0/815693779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d40144e70 msgr2=0x7f7d4006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d46225640 1 --2- 172.21.15.55:0/815693779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d40144e70 0x7f7d4006d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d46225640 1 -- 172.21.15.55:0/815693779 >> v1:172.21.15.55:6789/0 conn(0x7f7d4006d7a0 legacy=0x7f7d400ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d44a22640 1 -- 172.21.15.55:0/815693779 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816459632 0 0) 0x7f7d4006dcb0 con 0x7f7d4006d7a0 2024-04-25T08:58:43.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.509+0000 7f7d46225640 1 -- 172.21.15.55:0/815693779 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4006e270 con 0x7f7d400cf0e0 2024-04-25T08:58:43.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.510+0000 7f7d46225640 1 --2- 172.21.15.55:0/815693779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d400cf0e0 0x7f7d400cc300 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009d90 tx=0x7f7d3802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec832b33fd09ddc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.510+0000 7f7d44a22640 1 -- 172.21.15.55:0/815693779 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38031600 con 0x7f7d400cf0e0 2024-04-25T08:58:43.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.510+0000 7f7d44a22640 1 -- 172.21.15.55:0/815693779 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d380317a0 con 0x7f7d400cf0e0 2024-04-25T08:58:43.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.510+0000 7f7d44a22640 1 -- 172.21.15.55:0/815693779 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38031b70 con 0x7f7d400cf0e0 2024-04-25T08:58:43.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.511+0000 7f7d47c88640 1 -- 172.21.15.55:0/815693779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d400cf0e0 msgr2=0x7f7d400cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.511+0000 7f7d47c88640 1 --2- 172.21.15.55:0/815693779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d400cf0e0 0x7f7d400cc300 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009d90 tx=0x7f7d3802a5d0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.511+0000 7f7d47c88640 1 -- 172.21.15.55:0/815693779 shutdown_connections 2024-04-25T08:58:43.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.511+0000 7f7d47c88640 1 --2- 172.21.15.55:0/815693779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d400cf0e0 0x7f7d400cc300 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.511+0000 7f7d47c88640 1 --2- 172.21.15.55:0/815693779 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d40144e70 0x7f7d4006d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.511+0000 7f7d47c88640 1 -- 172.21.15.55:0/815693779 >> 172.21.15.55:0/815693779 conn(0x7f7d4006aba0 msgr2=0x7f7d4006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.511+0000 7f7d47c88640 1 -- 172.21.15.55:0/815693779 shutdown_connections 2024-04-25T08:58:43.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.511+0000 7f7d47c88640 1 -- 172.21.15.55:0/815693779 wait complete. 2024-04-25T08:58:43.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.512+0000 7f7d47c88640 1 Processor -- start 2024-04-25T08:58:43.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.512+0000 7f7d47c88640 1 -- start start 2024-04-25T08:58:43.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d47c88640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4006d7a0 0x7f7d400b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d47c88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d400cf0e0 0x7f7d400a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d47c88640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d40144e70 0x7f7d40152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d47c88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d40145630 con 0x7f7d400cf0e0 2024-04-25T08:58:43.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d47c88640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d401454b0 con 0x7f7d4006d7a0 2024-04-25T08:58:43.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d47c88640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400cc840 con 0x7f7d40144e70 2024-04-25T08:58:43.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d45223640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d400cf0e0 0x7f7d400a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d45223640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d400cf0e0 0x7f7d400a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39534/0 (socket says 172.21.15.55:39534) 2024-04-25T08:58:43.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d45223640 1 -- 172.21.15.55:0/820597926 learned_addr learned my addr 172.21.15.55:0/820597926 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d45a24640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4006d7a0 0x7f7d400b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d46225640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d40144e70 0x7f7d40152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d45223640 1 -- 172.21.15.55:0/820597926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d40144e70 msgr2=0x7f7d40152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d45223640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d40144e70 0x7f7d40152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d45223640 1 -- 172.21.15.55:0/820597926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4006d7a0 msgr2=0x7f7d400b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d45223640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4006d7a0 0x7f7d400b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d45223640 1 -- 172.21.15.55:0/820597926 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400a8c10 con 0x7f7d400cf0e0 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d46225640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d40144e70 0x7f7d40152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d45223640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d400cf0e0 0x7f7d400a84a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000c470 tx=0x7f7d3000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d367fc640 1 -- 172.21.15.55:0/820597926 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30017070 con 0x7f7d400cf0e0 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d367fc640 1 -- 172.21.15.55:0/820597926 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d30005ce0 con 0x7f7d400cf0e0 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d47c88640 1 -- 172.21.15.55:0/820597926 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d400a8ef0 con 0x7f7d400cf0e0 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.513+0000 7f7d367fc640 1 -- 172.21.15.55:0/820597926 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300072b0 con 0x7f7d400cf0e0 2024-04-25T08:58:43.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.514+0000 7f7d47c88640 1 -- 172.21.15.55:0/820597926 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d400a94b0 con 0x7f7d400cf0e0 2024-04-25T08:58:43.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.515+0000 7f7d367fc640 1 -- 172.21.15.55:0/820597926 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d3001a070 con 0x7f7d400cf0e0 2024-04-25T08:58:43.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.516+0000 7f7d367fc640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d2406b4d0 0x7f7d2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.516+0000 7f7d367fc640 1 -- 172.21.15.55:0/820597926 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7d30089600 con 0x7f7d400cf0e0 2024-04-25T08:58:43.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.516+0000 7f7d45a24640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d2406b4d0 0x7f7d2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.516+0000 7f7d45a24640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d2406b4d0 0x7f7d2406d990 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009a30 tx=0x7f7d3c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.517+0000 7f7d4a988740 1 Processor -- start 2024-04-25T08:58:43.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.517+0000 7f7d4a988740 1 -- start start 2024-04-25T08:58:43.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 0x55d057a33320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30ef0 0x55d057a33860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a03770 0x55d057a06f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d4a988740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d05796cda0 con 0x55d057a03770 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d4a988740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d057915b80 con 0x55d057a30ef0 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d4a988740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d057968e40 con 0x55d057a30b10 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d46225640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a03770 0x55d057a06f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d46225640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a03770 0x55d057a06f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39550/0 (socket says 172.21.15.55:39550) 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d46225640 1 -- 172.21.15.55:0/4226009135 learned_addr learned my addr 172.21.15.55:0/4226009135 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d45223640 1 --2- 172.21.15.55:0/4226009135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30ef0 0x55d057a33860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d45a24640 1 --2- 172.21.15.55:0/4226009135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 0x55d057a33320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d46225640 1 -- 172.21.15.55:0/4226009135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 msgr2=0x55d057a33320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d46225640 1 --2- 172.21.15.55:0/4226009135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 0x55d057a33320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d46225640 1 -- 172.21.15.55:0/4226009135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30ef0 msgr2=0x55d057a33860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d46225640 1 --2- 172.21.15.55:0/4226009135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30ef0 0x55d057a33860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d46225640 1 -- 172.21.15.55:0/4226009135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d05791ff10 con 0x55d057a03770 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d46225640 1 --2- 172.21.15.55:0/4226009135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a03770 0x55d057a06f80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f7d3802abc0 tx=0x7f7d3802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836204ea22db7bf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d237fe640 1 -- 172.21.15.55:0/4226009135 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38009450 con 0x55d057a03770 2024-04-25T08:58:43.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d237fe640 1 -- 172.21.15.55:0/4226009135 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d380319a0 con 0x55d057a03770 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.518+0000 7f7d237fe640 1 -- 172.21.15.55:0/4226009135 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38031d50 con 0x55d057a03770 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.519+0000 7f7d4a988740 1 -- 172.21.15.55:0/4226009135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a03770 msgr2=0x55d057a06f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.519+0000 7f7d4a988740 1 --2- 172.21.15.55:0/4226009135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a03770 0x55d057a06f80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f7d3802abc0 tx=0x7f7d3802e000 comp rx=0 tx=0).stop 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.519+0000 7f7d4a988740 1 -- 172.21.15.55:0/4226009135 shutdown_connections 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.519+0000 7f7d4a988740 1 --2- 172.21.15.55:0/4226009135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a03770 0x55d057a06f80 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.519+0000 7f7d4a988740 1 --2- 172.21.15.55:0/4226009135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30ef0 0x55d057a33860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.519+0000 7f7d4a988740 1 --2- 172.21.15.55:0/4226009135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 0x55d057a33320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.519+0000 7f7d4a988740 1 -- 172.21.15.55:0/4226009135 >> 172.21.15.55:0/4226009135 conn(0x55d057a059e0 msgr2=0x55d057a4e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.519+0000 7f7d4a988740 1 -- 172.21.15.55:0/4226009135 shutdown_connections 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.519+0000 7f7d4a988740 1 -- 172.21.15.55:0/4226009135 wait complete. 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.520+0000 7f7d4a988740 1 -- start start 2024-04-25T08:58:43.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.520+0000 7f7d4a988740 1 Processor -- start 2024-04-25T08:58:43.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 0x55d057a2f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30ef0 0x55d057a50780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a341f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d4a988740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d057a08b90 con 0x55d057a50cc0 2024-04-25T08:58:43.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d4a988740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d05790b4b0 con 0x55d057a30ef0 2024-04-25T08:58:43.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d4a988740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d057a08e70 con 0x55d057a30b10 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d4a988740 10 client.0 _ll_register_callbacks cb 0x55d05794b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d46225640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d46225640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a341f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39552/0 (socket says 172.21.15.55:39552) 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d46225640 1 -- 172.21.15.55:0/3782988758 learned_addr learned my addr 172.21.15.55:0/3782988758 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d45223640 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30ef0 0x55d057a50780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d45a24640 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 0x55d057a2f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d46225640 1 -- 172.21.15.55:0/3782988758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 msgr2=0x55d057a2f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d46225640 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 0x55d057a2f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d46225640 1 -- 172.21.15.55:0/3782988758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30ef0 msgr2=0x55d057a50780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d46225640 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30ef0 0x55d057a50780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d46225640 1 -- 172.21.15.55:0/3782988758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d05774b7d0 con 0x55d057a50cc0 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d46225640 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a341f0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009d90 tx=0x7f7d38004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511b92c60e151907 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3782988758 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380317a0 con 0x55d057a50cc0 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3782988758 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7d38031d60 con 0x55d057a50cc0 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.521+0000 7f7d4a988740 1 -- 172.21.15.55:0/3782988758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d380319a0 con 0x55d057a50cc0 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3782988758 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d38057050 con 0x55d057a50cc0 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d4a988740 10 client.7074 fetch_fsmap learned FSMap version 43 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d4a988740 1 -- 172.21.15.55:0/3782988758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55d0576813f0 con 0x55d057a50cc0 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3782988758 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d380319a0 con 0x55d057a50cc0 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3782988758 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7d3805a020 con 0x55d057a50cc0 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d4a988740 10 client.7074 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d4a988740 10 client.7074 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d4a988740 20 client.7074 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55d057a4f920 0x55d057a4fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d4a988740 4 client.7074 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d4a988740 1 -- 172.21.15.55:0/3782988758 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d05797a2e0 con 0x55d057a4f920 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d45a24640 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55d057a4f920 0x55d057a4fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d20ff9640 10 client.7074 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.522+0000 7f7d45a24640 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55d057a4f920 0x55d057a4fd30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de8a8cea3a2c300c server_cookie=9932e28152a1b09 in_seq=0 out_seq=0 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3782988758 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d05797a2e0 con 0x55d057a4f920 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d20ff9640 10 client.7074 handle_command_reply: tid=0 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 1 client.7074 shutdown 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 1 -- 172.21.15.55:0/3782988758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 msgr2=0x55d057a341f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a341f0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009d90 tx=0x7f7d38004ab0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 1 -- 172.21.15.55:0/3782988758 shutdown_connections 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55d057a4f920 0x55d057a4fd30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a341f0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30ef0 0x55d057a50780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3782988758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 0x55d057a2f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d20ff9640 0 client.7074 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:43.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 1 -- 172.21.15.55:0/3782988758 >> 172.21.15.55:0/3782988758 conn(0x55d057a03770 msgr2=0x55d057a2b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 1 -- 172.21.15.55:0/3782988758 shutdown_connections 2024-04-25T08:58:43.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 1 -- 172.21.15.55:0/3782988758 wait complete. 2024-04-25T08:58:43.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.523+0000 7f7d4a988740 20 client.7074 trim_cache size 0 max 16384 2024-04-25T08:58:43.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.539+0000 7f7d4a988740 1 Processor -- start 2024-04-25T08:58:43.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.539+0000 7f7d4a988740 1 -- start start 2024-04-25T08:58:43.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.539+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 0x55d057a02be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.539+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a30ef0 0x55d057a30190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.539+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a50cc0 0x55d057a68310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d4a988740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d401fdbf0 con 0x55d057a30ef0 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d4a988740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400ad160 con 0x55d057a50cc0 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d4a988740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400afbe0 con 0x55d057a30b10 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d45223640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a30ef0 0x55d057a30190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d45223640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a30ef0 0x55d057a30190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39562/0 (socket says 172.21.15.55:39562) 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d45223640 1 -- 172.21.15.55:0/176013385 learned_addr learned my addr 172.21.15.55:0/176013385 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d45223640 1 -- 172.21.15.55:0/176013385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 msgr2=0x55d057a02be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d45223640 1 --2- 172.21.15.55:0/176013385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 0x55d057a02be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d45223640 1 -- 172.21.15.55:0/176013385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a50cc0 msgr2=0x55d057a68310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d45223640 1 --2- 172.21.15.55:0/176013385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a50cc0 0x55d057a68310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d45223640 1 -- 172.21.15.55:0/176013385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0576410f0 con 0x55d057a30ef0 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d45223640 1 --2- 172.21.15.55:0/176013385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a30ef0 0x55d057a30190 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f7d300579e0 tx=0x7f7d3005e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be424422e8086b77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d22ffd640 1 -- 172.21.15.55:0/176013385 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30055fe0 con 0x55d057a30ef0 2024-04-25T08:58:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d22ffd640 1 -- 172.21.15.55:0/176013385 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3006f030 con 0x55d057a30ef0 2024-04-25T08:58:43.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.540+0000 7f7d22ffd640 1 -- 172.21.15.55:0/176013385 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3005ff60 con 0x55d057a30ef0 2024-04-25T08:58:43.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.541+0000 7f7d4a988740 1 -- 172.21.15.55:0/176013385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a30ef0 msgr2=0x55d057a30190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.541+0000 7f7d4a988740 1 --2- 172.21.15.55:0/176013385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a30ef0 0x55d057a30190 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f7d300579e0 tx=0x7f7d3005e040 comp rx=0 tx=0).stop 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.541+0000 7f7d4a988740 1 -- 172.21.15.55:0/176013385 shutdown_connections 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.541+0000 7f7d4a988740 1 --2- 172.21.15.55:0/176013385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a50cc0 0x55d057a68310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.541+0000 7f7d4a988740 1 --2- 172.21.15.55:0/176013385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a30ef0 0x55d057a30190 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.541+0000 7f7d4a988740 1 --2- 172.21.15.55:0/176013385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30b10 0x55d057a02be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.541+0000 7f7d4a988740 1 -- 172.21.15.55:0/176013385 >> 172.21.15.55:0/176013385 conn(0x55d057a03770 msgr2=0x55d057a2f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.541+0000 7f7d4a988740 1 -- 172.21.15.55:0/176013385 shutdown_connections 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.541+0000 7f7d4a988740 1 -- 172.21.15.55:0/176013385 wait complete. 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.541+0000 7f7d4a988740 1 -- start start 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.541+0000 7f7d4a988740 1 Processor -- start 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.542+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30b10 0x55d057a046a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.542+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30ef0 0x55d057a43cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.542+0000 7f7d4a988740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a441f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.542+0000 7f7d4a988740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d057a4dd70 con 0x55d057a50cc0 2024-04-25T08:58:43.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.542+0000 7f7d4a988740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400acb60 con 0x55d057a30b10 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.542+0000 7f7d4a988740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d057a03d80 con 0x55d057a30ef0 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.542+0000 7f7d4a988740 10 client.0 _ll_register_callbacks cb 0x7f7d3c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.542+0000 7f7d46225640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.542+0000 7f7d46225640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39568/0 (socket says 172.21.15.55:39568) 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.542+0000 7f7d46225640 1 -- 172.21.15.55:0/3614463089 learned_addr learned my addr 172.21.15.55:0/3614463089 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d45223640 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30ef0 0x55d057a43cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d45a24640 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30b10 0x55d057a046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d46225640 1 -- 172.21.15.55:0/3614463089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30ef0 msgr2=0x55d057a43cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d46225640 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30ef0 0x55d057a43cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d46225640 1 -- 172.21.15.55:0/3614463089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30b10 msgr2=0x55d057a046a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d46225640 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30b10 0x55d057a046a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d46225640 1 -- 172.21.15.55:0/3614463089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d057a04be0 con 0x55d057a50cc0 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d45a24640 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30b10 0x55d057a046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d46225640 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a441f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f7d38003ce0 tx=0x7f7d38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afb5c46ace1c153 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:58:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3614463089 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38031d60 con 0x55d057a50cc0 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3614463089 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7d38003fd0 con 0x55d057a50cc0 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d4a988740 1 -- 172.21.15.55:0/3614463089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d3006f030 con 0x55d057a50cc0 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3614463089 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d38068050 con 0x55d057a50cc0 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d4a988740 10 client.7080 fetch_fsmap learned FSMap version 43 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d4a988740 1 -- 172.21.15.55:0/3614463089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55d057a4b960 con 0x55d057a50cc0 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3614463089 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3006f030 con 0x55d057a50cc0 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.543+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3614463089 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7d3806b020 con 0x55d057a50cc0 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 10 client.7080 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 10 client.7080 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 20 client.7080 populate_metadata read hostname 'smithi055' 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55d057a4e520 0x55d057a44730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 4 client.7080 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 -- 172.21.15.55:0/3614463089 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d057a52010 con 0x55d057a4e520 2024-04-25T08:58:43.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d45a24640 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55d057a4e520 0x55d057a44730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d45a24640 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55d057a4e520 0x55d057a44730 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=317e214fd9824731 server_cookie=2f96cca6ec515163 in_seq=0 out_seq=0 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d20ff9640 10 client.7080 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d20ff9640 1 -- 172.21.15.55:0/3614463089 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x55d057a52010 con 0x55d057a4e520 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d20ff9640 10 client.7080 handle_command_reply: tid=0 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 client.7080 shutdown 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 -- 172.21.15.55:0/3614463089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 msgr2=0x55d057a441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a441f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f7d38003ce0 tx=0x7f7d38004a40 comp rx=0 tx=0).stop 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 -- 172.21.15.55:0/3614463089 shutdown_connections 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55d057a4e520 0x55d057a44730 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d057a50cc0 0x55d057a441f0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d057a30ef0 0x55d057a43cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 --2- 172.21.15.55:0/3614463089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d057a30b10 0x55d057a046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d20ff9640 0 client.7080 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 -- 172.21.15.55:0/3614463089 >> 172.21.15.55:0/3614463089 conn(0x55d057a03770 msgr2=0x55d057a50390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 -- 172.21.15.55:0/3614463089 shutdown_connections 2024-04-25T08:58:43.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.544+0000 7f7d4a988740 1 -- 172.21.15.55:0/3614463089 wait complete. 2024-04-25T08:58:43.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d4a988740 20 client.7080 trim_cache size 0 max 16384 2024-04-25T08:58:43.540 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:58:43.540 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:58:43.540 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-25T08:58:43.540 INFO:teuthology.orchestra.run.smithi055.stdout: "ed71ff89-64f6-4ab4-a35a-1aa17aac3b3f": { 2024-04-25T08:58:43.540 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/subdir", 2024-04-25T08:58:43.540 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "ed71ff89-64f6-4ab4-a35a-1aa17aac3b3f", 2024-04-25T08:58:43.540 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-25T08:58:43.540 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:58:43.541 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:58:43.541 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:58:43.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 -- 172.21.15.55:0/820597926 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d2406b4d0 msgr2=0x7f7d2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d2406b4d0 0x7f7d2406d990 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009a30 tx=0x7f7d3c008040 comp rx=0 tx=0).stop 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 -- 172.21.15.55:0/820597926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d400cf0e0 msgr2=0x7f7d400a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d400cf0e0 0x7f7d400a84a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000c470 tx=0x7f7d3000c930 comp rx=0 tx=0).stop 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 -- 172.21.15.55:0/820597926 shutdown_connections 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7d2406b4d0 0x7f7d2406d990 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d40144e70 0x7f7d40152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d400cf0e0 0x7f7d400a84a0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 --2- 172.21.15.55:0/820597926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4006d7a0 0x7f7d400b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 -- 172.21.15.55:0/820597926 >> 172.21.15.55:0/820597926 conn(0x7f7d4006aba0 msgr2=0x7f7d4015e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 -- 172.21.15.55:0/820597926 shutdown_connections 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:58:43.545+0000 7f7d47c88640 1 -- 172.21.15.55:0/820597926 wait complete. 2024-04-25T08:58:43.545 INFO:tasks.cephfs.filesystem:scrub status for tag:ed71ff89-64f6-4ab4-a35a-1aa17aac3b3f - {'path': '/subdir', 'tag': 'ed71ff89-64f6-4ab4-a35a-1aa17aac3b3f', 'options': 'recursive,repair'} 2024-04-25T08:59:10.219 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:59:10.222 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:59:13.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:13.546 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T08:59:13.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.674+0000 7f4a2dbb0640 1 Processor -- start 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.674+0000 7f4a2dbb0640 1 -- start start 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a2dbb0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a280cfe70 0x7f4a280ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a2dbb0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a2815e110 0x7f4a2815e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a2dbb0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2815f000 con 0x7f4a2815b7b0 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a2dbb0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a280ced00 con 0x7f4a2815e110 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a2dbb0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a280ce330 con 0x7f4a280cfe70 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a27fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a2815e110 0x7f4a2815e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a27fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a2815e110 0x7f4a2815e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37908/0 (socket says 172.21.15.55:37908) 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a27fff640 1 -- 172.21.15.55:0/1952770833 learned_addr learned my addr 172.21.15.55:0/1952770833 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a277fe640 1 --1- 172.21.15.55:0/1952770833 >> v1:172.21.15.55:6789/0 conn(0x7f4a2815b7b0 0x7f4a280cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42510/0 (socket says 172.21.15.55:42510) 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a26ffd640 1 --2- 172.21.15.55:0/1952770833 >> v2:172.21.15.167:3300/0 conn(0x7f4a280cfe70 0x7f4a280ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a27fff640 1 -- 172.21.15.55:0/1952770833 >> v2:172.21.15.167:3300/0 conn(0x7f4a280cfe70 msgr2=0x7f4a280ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a27fff640 1 --2- 172.21.15.55:0/1952770833 >> v2:172.21.15.167:3300/0 conn(0x7f4a280cfe70 0x7f4a280ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a27fff640 1 -- 172.21.15.55:0/1952770833 >> v1:172.21.15.55:6789/0 conn(0x7f4a2815b7b0 legacy=0x7f4a280cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a267fc640 1 -- 172.21.15.55:0/1952770833 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141260981 0 0) 0x7f4a2815f000 con 0x7f4a2815b7b0 2024-04-25T08:59:13.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.675+0000 7f4a27fff640 1 -- 172.21.15.55:0/1952770833 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2815ea60 con 0x7f4a2815e110 2024-04-25T08:59:13.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.676+0000 7f4a27fff640 1 --2- 172.21.15.55:0/1952770833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2815e110 0x7f4a2815e520 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f4a28072e40 tx=0x7f4a2002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59201004ab789277 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.676+0000 7f4a267fc640 1 -- 172.21.15.55:0/1952770833 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20036070 con 0x7f4a2815e110 2024-04-25T08:59:13.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.676+0000 7f4a267fc640 1 -- 172.21.15.55:0/1952770833 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a20031600 con 0x7f4a2815e110 2024-04-25T08:59:13.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.676+0000 7f4a267fc640 1 -- 172.21.15.55:0/1952770833 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a200319d0 con 0x7f4a2815e110 2024-04-25T08:59:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.677+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/1952770833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2815e110 msgr2=0x7f4a2815e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.677+0000 7f4a2dbb0640 1 --2- 172.21.15.55:0/1952770833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2815e110 0x7f4a2815e520 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f4a28072e40 tx=0x7f4a2002a730 comp rx=0 tx=0).stop 2024-04-25T08:59:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.677+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/1952770833 shutdown_connections 2024-04-25T08:59:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.677+0000 7f4a2dbb0640 1 --2- 172.21.15.55:0/1952770833 >> v2:172.21.15.167:3300/0 conn(0x7f4a280cfe70 0x7f4a280ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.677+0000 7f4a2dbb0640 1 --2- 172.21.15.55:0/1952770833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2815e110 0x7f4a2815e520 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.677+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/1952770833 >> 172.21.15.55:0/1952770833 conn(0x7f4a2806f4a0 msgr2=0x7f4a2806f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.677+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/1952770833 shutdown_connections 2024-04-25T08:59:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.677+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/1952770833 wait complete. 2024-04-25T08:59:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.678+0000 7f4a2dbb0640 1 Processor -- start 2024-04-25T08:59:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.678+0000 7f4a2dbb0640 1 -- start start 2024-04-25T08:59:13.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a2dbb0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a280cfe70 0x7f4a28158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a2dbb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a2815b7b0 0x7f4a281f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a2dbb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a2815e110 0x7f4a28156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a2dbb0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280cdfc0 con 0x7f4a280cfe70 2024-04-25T08:59:13.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a2dbb0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280cdce0 con 0x7f4a2815e110 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a2dbb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a281619f0 con 0x7f4a2815b7b0 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a280cfe70 0x7f4a28158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a280cfe70 0x7f4a28158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37920/0 (socket says 172.21.15.55:37920) 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a277fe640 1 -- 172.21.15.55:0/2523749535 learned_addr learned my addr 172.21.15.55:0/2523749535 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a27fff640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a2815e110 0x7f4a28156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a26ffd640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a2815b7b0 0x7f4a281f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a277fe640 1 -- 172.21.15.55:0/2523749535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a2815b7b0 msgr2=0x7f4a281f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a277fe640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a2815b7b0 0x7f4a281f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a277fe640 1 -- 172.21.15.55:0/2523749535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a2815e110 msgr2=0x7f4a28156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a277fe640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a2815e110 0x7f4a28156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a277fe640 1 -- 172.21.15.55:0/2523749535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280b5fd0 con 0x7f4a280cfe70 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.679+0000 7f4a277fe640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a280cfe70 0x7f4a28158df0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c4d0 tx=0x7f4a1800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.680+0000 7f4a0ffff640 1 -- 172.21.15.55:0/2523749535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18018070 con 0x7f4a280cfe70 2024-04-25T08:59:13.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.680+0000 7f4a0ffff640 1 -- 172.21.15.55:0/2523749535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18007500 con 0x7f4a280cfe70 2024-04-25T08:59:13.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.680+0000 7f4a0ffff640 1 -- 172.21.15.55:0/2523749535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18004a20 con 0x7f4a280cfe70 2024-04-25T08:59:13.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.680+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/2523749535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a280b62b0 con 0x7f4a280cfe70 2024-04-25T08:59:13.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.680+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/2523749535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a280b6b50 con 0x7f4a280cfe70 2024-04-25T08:59:13.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.681+0000 7f4a0ffff640 1 -- 172.21.15.55:0/2523749535 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4a1801b070 con 0x7f4a280cfe70 2024-04-25T08:59:13.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.682+0000 7f4a0ffff640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a1406b4d0 0x7f4a1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.682+0000 7f4a0ffff640 1 -- 172.21.15.55:0/2523749535 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4a18089490 con 0x7f4a280cfe70 2024-04-25T08:59:13.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.682+0000 7f4a26ffd640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a1406b4d0 0x7f4a1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.682+0000 7f4a26ffd640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a1406b4d0 0x7f4a1406d990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4a280c4e60 tx=0x7f4a1c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.683+0000 7f4a30994740 1 Processor -- start 2024-04-25T08:59:13.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.683+0000 7f4a30994740 1 -- start start 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a30994740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d84320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a30994740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472d84860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a30994740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d54770 0x556472d57f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a30994740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556472cbdda0 con 0x556472d54770 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a30994740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556472c66b80 con 0x556472d81b10 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a30994740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556472cb9e40 con 0x556472d81ef0 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a27fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d54770 0x556472d57f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a27fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d54770 0x556472d57f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37932/0 (socket says 172.21.15.55:37932) 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a27fff640 1 -- 172.21.15.55:0/3089907211 learned_addr learned my addr 172.21.15.55:0/3089907211 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a277fe640 1 --2- 172.21.15.55:0/3089907211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d84320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a26ffd640 1 --2- 172.21.15.55:0/3089907211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472d84860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a27fff640 1 -- 172.21.15.55:0/3089907211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 msgr2=0x556472d84860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a27fff640 1 --2- 172.21.15.55:0/3089907211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472d84860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a27fff640 1 -- 172.21.15.55:0/3089907211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 msgr2=0x556472d84320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a27fff640 1 --2- 172.21.15.55:0/3089907211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d84320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a27fff640 1 -- 172.21.15.55:0/3089907211 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556472c70f10 con 0x556472d54770 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a277fe640 1 --2- 172.21.15.55:0/3089907211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d84320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a27fff640 1 --2- 172.21.15.55:0/3089907211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d54770 0x556472d57f80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f4a2002a770 tx=0x7f4a2002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce55ae06fcd54729 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.684+0000 7f4a0d7fa640 1 -- 172.21.15.55:0/3089907211 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20042070 con 0x556472d54770 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.685+0000 7f4a0d7fa640 1 -- 172.21.15.55:0/3089907211 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a20037040 con 0x556472d54770 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.685+0000 7f4a0d7fa640 1 -- 172.21.15.55:0/3089907211 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20036040 con 0x556472d54770 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.685+0000 7f4a30994740 1 -- 172.21.15.55:0/3089907211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d54770 msgr2=0x556472d57f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.685+0000 7f4a30994740 1 --2- 172.21.15.55:0/3089907211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d54770 0x556472d57f80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f4a2002a770 tx=0x7f4a2002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.685+0000 7f4a30994740 1 -- 172.21.15.55:0/3089907211 shutdown_connections 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.685+0000 7f4a30994740 1 --2- 172.21.15.55:0/3089907211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d54770 0x556472d57f80 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.685+0000 7f4a30994740 1 --2- 172.21.15.55:0/3089907211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472d84860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.685+0000 7f4a30994740 1 --2- 172.21.15.55:0/3089907211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d84320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.685+0000 7f4a30994740 1 -- 172.21.15.55:0/3089907211 >> 172.21.15.55:0/3089907211 conn(0x556472d569e0 msgr2=0x556472d9f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.685+0000 7f4a30994740 1 -- 172.21.15.55:0/3089907211 shutdown_connections 2024-04-25T08:59:13.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.685+0000 7f4a30994740 1 -- 172.21.15.55:0/3089907211 wait complete. 2024-04-25T08:59:13.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.686+0000 7f4a30994740 1 -- start start 2024-04-25T08:59:13.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.686+0000 7f4a30994740 1 Processor -- start 2024-04-25T08:59:13.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a30994740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d80ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a30994740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472da2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a30994740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d78710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a30994740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556472d59b90 con 0x556472d78290 2024-04-25T08:59:13.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a30994740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556472c5c4b0 con 0x556472d81b10 2024-04-25T08:59:13.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a30994740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556472d59e70 con 0x556472d81ef0 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a30994740 10 client.0 _ll_register_callbacks cb 0x556472c9c180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a27fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d78710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a27fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d78710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37934/0 (socket says 172.21.15.55:37934) 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a27fff640 1 -- 172.21.15.55:0/1498922615 learned_addr learned my addr 172.21.15.55:0/1498922615 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a26ffd640 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472da2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a277fe640 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d80ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a27fff640 1 -- 172.21.15.55:0/1498922615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 msgr2=0x556472da2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a27fff640 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472da2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a27fff640 1 -- 172.21.15.55:0/1498922615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 msgr2=0x556472d80ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a27fff640 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d80ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a27fff640 1 -- 172.21.15.55:0/1498922615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556472a9c7d0 con 0x556472d78290 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a27fff640 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d78710 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009f10 tx=0x7f4a20004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40efe23b861d20e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.687+0000 7f4a067fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a067fc640 1 -- 172.21.15.55:0/1498922615 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20036070 con 0x556472d78290 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a067fc640 1 -- 172.21.15.55:0/1498922615 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4a20004240 con 0x556472d78290 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a30994740 1 -- 172.21.15.55:0/1498922615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a20037040 con 0x556472d78290 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a067fc640 1 -- 172.21.15.55:0/1498922615 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a20050050 con 0x556472d78290 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a30994740 10 client.7095 fetch_fsmap learned FSMap version 44 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a30994740 1 -- 172.21.15.55:0/1498922615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5564729d23f0 con 0x556472d78290 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a067fc640 1 -- 172.21.15.55:0/1498922615 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a20037040 con 0x556472d78290 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a067fc640 1 -- 172.21.15.55:0/1498922615 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4a20053020 con 0x556472d78290 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a30994740 10 client.7095 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a30994740 10 client.7095 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a30994740 20 client.7095 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a30994740 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x556472d7afe0 0x556472d7b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a30994740 4 client.7095 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:13.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a30994740 1 -- 172.21.15.55:0/1498922615 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556472ccb2e0 con 0x556472d7afe0 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.688+0000 7f4a277fe640 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x556472d7afe0 0x556472d7b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a277fe640 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x556472d7afe0 0x556472d7b3e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=243e7d82744ab7b3 server_cookie=5861bdbf905b391c in_seq=0 out_seq=0 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a067fc640 10 client.7095 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a067fc640 1 -- 172.21.15.55:0/1498922615 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556472ccb2e0 con 0x556472d7afe0 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a067fc640 10 client.7095 handle_command_reply: tid=0 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a30994740 1 client.7095 shutdown 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a30994740 1 -- 172.21.15.55:0/1498922615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 msgr2=0x556472d78710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a30994740 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d78710 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009f10 tx=0x7f4a20004ab0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a30994740 1 -- 172.21.15.55:0/1498922615 shutdown_connections 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a30994740 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x556472d7afe0 0x556472d7b3e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a30994740 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d78710 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a30994740 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472da2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a30994740 1 --2- 172.21.15.55:0/1498922615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d80ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a067fc640 0 client.7095 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a30994740 1 -- 172.21.15.55:0/1498922615 >> 172.21.15.55:0/1498922615 conn(0x556472d54770 msgr2=0x556472d80190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a30994740 1 -- 172.21.15.55:0/1498922615 shutdown_connections 2024-04-25T08:59:13.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.689+0000 7f4a30994740 1 -- 172.21.15.55:0/1498922615 wait complete. 2024-04-25T08:59:13.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.690+0000 7f4a30994740 20 client.7095 trim_cache size 0 max 16384 2024-04-25T08:59:13.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.705+0000 7f4a30994740 1 Processor -- start 2024-04-25T08:59:13.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.705+0000 7f4a30994740 1 -- start start 2024-04-25T08:59:13.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a30994740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d4fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a30994740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472da2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a30994740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472dc1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a30994740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a281ffdd0 con 0x556472d78290 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a30994740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280b1f80 con 0x556472d81b10 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a30994740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280b1380 con 0x556472d81ef0 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d4fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d4fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37946/0 (socket says 172.21.15.55:37946) 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a277fe640 1 -- 172.21.15.55:0/4024432106 learned_addr learned my addr 172.21.15.55:0/4024432106 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a26ffd640 1 --2- 172.21.15.55:0/4024432106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472da2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a27fff640 1 --2- 172.21.15.55:0/4024432106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472dc1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a277fe640 1 -- 172.21.15.55:0/4024432106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 msgr2=0x556472dc1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a277fe640 1 --2- 172.21.15.55:0/4024432106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472dc1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a277fe640 1 -- 172.21.15.55:0/4024432106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 msgr2=0x556472da2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a277fe640 1 --2- 172.21.15.55:0/4024432106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472da2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a277fe640 1 -- 172.21.15.55:0/4024432106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564729920f0 con 0x556472d78290 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a26ffd640 1 --2- 172.21.15.55:0/4024432106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472da2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:13.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a27fff640 1 --2- 172.21.15.55:0/4024432106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472dc1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a277fe640 1 --2- 172.21.15.55:0/4024432106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d4fd70 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f4a18057e80 tx=0x7f4a18087890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b8a60c865b1937 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a0cff9640 1 -- 172.21.15.55:0/4024432106 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18055d60 con 0x556472d78290 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a0cff9640 1 -- 172.21.15.55:0/4024432106 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18055fc0 con 0x556472d78290 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.706+0000 7f4a0cff9640 1 -- 172.21.15.55:0/4024432106 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1806bbd0 con 0x556472d78290 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.707+0000 7f4a30994740 1 -- 172.21.15.55:0/4024432106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 msgr2=0x556472d4fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.707+0000 7f4a30994740 1 --2- 172.21.15.55:0/4024432106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d4fd70 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f4a18057e80 tx=0x7f4a18087890 comp rx=0 tx=0).stop 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.707+0000 7f4a30994740 1 -- 172.21.15.55:0/4024432106 shutdown_connections 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.707+0000 7f4a30994740 1 --2- 172.21.15.55:0/4024432106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472dc1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.707+0000 7f4a30994740 1 --2- 172.21.15.55:0/4024432106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472da2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.707+0000 7f4a30994740 1 --2- 172.21.15.55:0/4024432106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472d4fd70 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.707+0000 7f4a30994740 1 -- 172.21.15.55:0/4024432106 >> 172.21.15.55:0/4024432106 conn(0x556472d54770 msgr2=0x556472d7b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.707+0000 7f4a30994740 1 -- 172.21.15.55:0/4024432106 shutdown_connections 2024-04-25T08:59:13.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.707+0000 7f4a30994740 1 -- 172.21.15.55:0/4024432106 wait complete. 2024-04-25T08:59:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.708+0000 7f4a30994740 1 -- start start 2024-04-25T08:59:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.708+0000 7f4a30994740 1 Processor -- start 2024-04-25T08:59:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.708+0000 7f4a30994740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472e0c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.708+0000 7f4a30994740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d87200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a30994740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472d80c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a30994740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556472da2030 con 0x556472d78290 2024-04-25T08:59:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a30994740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280b1980 con 0x556472d81b10 2024-04-25T08:59:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a30994740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556472d78ac0 con 0x556472d81ef0 2024-04-25T08:59:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a30994740 10 client.0 _ll_register_callbacks cb 0x7f4a2002af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472e0c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472e0c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37950/0 (socket says 172.21.15.55:37950) 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a277fe640 1 -- 172.21.15.55:0/290746134 learned_addr learned my addr 172.21.15.55:0/290746134 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a27fff640 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472d80c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a26ffd640 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d87200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a277fe640 1 -- 172.21.15.55:0/290746134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 msgr2=0x556472d80c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a277fe640 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472d80c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a277fe640 1 -- 172.21.15.55:0/290746134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 msgr2=0x556472d87200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a277fe640 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d87200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a277fe640 1 -- 172.21.15.55:0/290746134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556472d78dc0 con 0x556472d78290 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a277fe640 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472e0c7d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f4a180011e0 tx=0x7f4a18009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b745137a52f21a17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a067fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a067fc640 1 -- 172.21.15.55:0/290746134 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18073020 con 0x556472d78290 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a067fc640 1 -- 172.21.15.55:0/290746134 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4a18060090 con 0x556472d78290 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a30994740 1 -- 172.21.15.55:0/290746134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a18055fc0 con 0x556472d78290 2024-04-25T08:59:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a067fc640 1 -- 172.21.15.55:0/290746134 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a1807d050 con 0x556472d78290 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a30994740 10 client.7101 fetch_fsmap learned FSMap version 44 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a30994740 1 -- 172.21.15.55:0/290746134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x556472daeb30 con 0x556472d78290 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.709+0000 7f4a067fc640 1 -- 172.21.15.55:0/290746134 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18055fc0 con 0x556472d78290 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a067fc640 1 -- 172.21.15.55:0/290746134 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4a18080020 con 0x556472d78290 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 10 client.7101 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 10 client.7101 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 20 client.7101 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x556472dc1f40 0x556472d7f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 4 client.7101 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 1 -- 172.21.15.55:0/290746134 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556472cc5630 con 0x556472dc1f40 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a26ffd640 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x556472dc1f40 0x556472d7f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a26ffd640 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x556472dc1f40 0x556472d7f610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=810611bb66d6e5f server_cookie=8e727c6942c40f02 in_seq=0 out_seq=0 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a067fc640 10 client.7101 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:59:13.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a067fc640 1 -- 172.21.15.55:0/290746134 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556472cc5630 con 0x556472dc1f40 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a067fc640 10 client.7101 handle_command_reply: tid=0 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 1 client.7101 shutdown 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 1 -- 172.21.15.55:0/290746134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 msgr2=0x556472e0c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472e0c7d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f4a180011e0 tx=0x7f4a18009040 comp rx=0 tx=0).stop 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 1 -- 172.21.15.55:0/290746134 shutdown_connections 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x556472dc1f40 0x556472d7f610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556472d81ef0 0x556472d80c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556472d81b10 0x556472d87200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a067fc640 0 client.7101 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 1 --2- 172.21.15.55:0/290746134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556472d78290 0x556472e0c7d0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.710+0000 7f4a30994740 1 -- 172.21.15.55:0/290746134 >> 172.21.15.55:0/290746134 conn(0x556472d54770 msgr2=0x556472da0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a30994740 1 -- 172.21.15.55:0/290746134 shutdown_connections 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a30994740 1 -- 172.21.15.55:0/290746134 wait complete. 2024-04-25T08:59:13.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a30994740 20 client.7101 trim_cache size 0 max 16384 2024-04-25T08:59:13.707 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:59:13.707 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-25T08:59:13.707 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-25T08:59:13.707 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:59:13.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/2523749535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a1406b4d0 msgr2=0x7f4a1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a1406b4d0 0x7f4a1406d990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4a280c4e60 tx=0x7f4a1c008040 comp rx=0 tx=0).stop 2024-04-25T08:59:13.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/2523749535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a280cfe70 msgr2=0x7f4a28158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a280cfe70 0x7f4a28158df0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c4d0 tx=0x7f4a1800c990 comp rx=0 tx=0).stop 2024-04-25T08:59:13.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/2523749535 shutdown_connections 2024-04-25T08:59:13.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a1406b4d0 0x7f4a1406d990 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a2815e110 0x7f4a28156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a2815b7b0 0x7f4a281f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 --2- 172.21.15.55:0/2523749535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a280cfe70 0x7f4a28158df0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/2523749535 >> 172.21.15.55:0/2523749535 conn(0x7f4a2806f4a0 msgr2=0x7f4a281599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/2523749535 shutdown_connections 2024-04-25T08:59:13.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.711+0000 7f4a2dbb0640 1 -- 172.21.15.55:0/2523749535 wait complete. 2024-04-25T08:59:13.711 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:59:13.712 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.823+0000 7f5ad0bf4640 1 Processor -- start 2024-04-25T08:59:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.823+0000 7f5ad0bf4640 1 -- start start 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.824+0000 7f5ad0bf4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15dce0 0x7f5acc0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.824+0000 7f5ad0bf4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5acc0d35b0 0x7f5acc0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.824+0000 7f5ad0bf4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5acc15e0c0 con 0x7f5acc0d1f90 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.824+0000 7f5ad0bf4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5acc0b7b10 con 0x7f5acc0d35b0 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.824+0000 7f5ad0bf4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0d2510 con 0x7f5acc15dce0 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.824+0000 7f5acad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5acc0d1f90 0x7f5acc06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42512/0 (socket says 172.21.15.55:42512) 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.824+0000 7f5acad9d640 1 -- 172.21.15.55:0/3062897910 learned_addr learned my addr 172.21.15.55:0/3062897910 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.824+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108428958 0 0) 0x7f5acc15e0c0 con 0x7f5acc0d1f90 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.824+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ab4003520 con 0x7f5acc0d1f90 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.824+0000 7f5ac9d9b640 1 --2- 172.21.15.55:0/3062897910 >> v2:172.21.15.167:3300/0 conn(0x7f5acc0d35b0 0x7f5acc0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.824+0000 7f5aca59c640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15dce0 0x7f5acc0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 800508609 0 0) 0x7f5ab4003520 con 0x7f5acc0d1f90 2024-04-25T08:59:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15dce0 msgr2=0x7f5acc0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15dce0 0x7f5acc0d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 >> v2:172.21.15.167:3300/0 conn(0x7f5acc0d35b0 msgr2=0x7f5acc0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 --2- 172.21.15.55:0/3062897910 >> v2:172.21.15.167:3300/0 conn(0x7f5acc0d35b0 0x7f5acc0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc0d27f0 con 0x7f5acc0d1f90 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f5ac4001670 con 0x7f5acc0d1f90 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 >> v1:172.21.15.55:6789/0 conn(0x7f5acc0d1f90 legacy=0x7f5acc06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ab40039b0 0x7f5ab4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15dce0 0x7f5ab4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 0x7f5ab40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0b7b10 con 0x7f5ab4004d40 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0d2510 con 0x7f5ab40039b0 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab400ba70 con 0x7f5acc15dce0 2024-04-25T08:59:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5acad9d640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 0x7f5ab40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5aca59c640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ab40039b0 0x7f5ab4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5ac9d9b640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15dce0 0x7f5ab4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5acad9d640 1 -- 172.21.15.55:0/3062897910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15dce0 msgr2=0x7f5ab4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5acad9d640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15dce0 0x7f5ab4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5acad9d640 1 -- 172.21.15.55:0/3062897910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ab40039b0 msgr2=0x7f5ab4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5acad9d640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ab40039b0 0x7f5ab4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.825+0000 7f5acad9d640 1 -- 172.21.15.55:0/3062897910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab4003520 con 0x7f5ab4004d40 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.826+0000 7f5acad9d640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 0x7f5ab40051c0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4007fd0 tx=0x7f5ab4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbd9c529fce0927 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.826+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4007d50 con 0x7f5ab4004d40 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.826+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac4005ad0 con 0x7f5ab4004d40 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.826+0000 7f5ac959a640 1 -- 172.21.15.55:0/3062897910 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4007070 con 0x7f5ab4004d40 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.826+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3062897910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 msgr2=0x7f5ab40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.826+0000 7f5ad0bf4640 1 --2- 172.21.15.55:0/3062897910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 0x7f5ab40051c0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4007fd0 tx=0x7f5ab4005830 comp rx=0 tx=0).stop 2024-04-25T08:59:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.826+0000 7f5acad9d640 1 -- 172.21.15.55:0/3062897910 reap_dead start 2024-04-25T08:59:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.827+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3062897910 shutdown_connections 2024-04-25T08:59:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.827+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3062897910 >> 172.21.15.55:0/3062897910 conn(0x7f5acc072900 msgr2=0x7f5acc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.827+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3062897910 shutdown_connections 2024-04-25T08:59:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.827+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3062897910 wait complete. 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.828+0000 7f5ad0bf4640 1 Processor -- start 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.828+0000 7f5ad0bf4640 1 -- start start 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5ad0bf4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 0x7f5acc0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5ad0bf4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5acc15e2b0 0x7f5acc150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5ad0bf4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc0b44d0 0x7f5acc0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5ad0bf4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0d3090 con 0x7f5ab4004d40 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5ad0bf4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0d2db0 con 0x7f5acc15e2b0 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5ad0bf4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0b9820 con 0x7f5acc0b44d0 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5aca59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 0x7f5acc0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5aca59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 0x7f5acc0c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37964/0 (socket says 172.21.15.55:37964) 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5aca59c640 1 -- 172.21.15.55:0/3917837698 learned_addr learned my addr 172.21.15.55:0/3917837698 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5aca59c640 1 -- 172.21.15.55:0/3917837698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc0b44d0 msgr2=0x7f5acc0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5ac9d9b640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5acc15e2b0 0x7f5acc150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5acad9d640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc0b44d0 0x7f5acc0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5aca59c640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc0b44d0 0x7f5acc0b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5aca59c640 1 -- 172.21.15.55:0/3917837698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5acc15e2b0 msgr2=0x7f5acc150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5aca59c640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5acc15e2b0 0x7f5acc150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5aca59c640 1 -- 172.21.15.55:0/3917837698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc0d0960 con 0x7f5ab4004d40 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5aca59c640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 0x7f5acc0c8be0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5abc004630 tx=0x7f5abc007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5abaffd640 1 -- 172.21.15.55:0/3917837698 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc015420 con 0x7f5ab4004d40 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5abaffd640 1 -- 172.21.15.55:0/3917837698 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc01a070 con 0x7f5ab4004d40 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.829+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3917837698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc0c9270 con 0x7f5ab4004d40 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.830+0000 7f5abaffd640 1 -- 172.21.15.55:0/3917837698 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc015800 con 0x7f5ab4004d40 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.830+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3917837698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc0c9830 con 0x7f5ab4004d40 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.830+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3917837698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5acc0749b0 con 0x7f5ab4004d40 2024-04-25T08:59:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.831+0000 7f5abaffd640 1 -- 172.21.15.55:0/3917837698 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5abc0159a0 con 0x7f5ab4004d40 2024-04-25T08:59:13.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.831+0000 7f5abaffd640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5aac06b4d0 0x7f5aac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:13.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.832+0000 7f5abaffd640 1 -- 172.21.15.55:0/3917837698 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5abc08ab10 con 0x7f5ab4004d40 2024-04-25T08:59:13.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.832+0000 7f5ac9d9b640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5aac06b4d0 0x7f5aac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:13.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.832+0000 7f5ac9d9b640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5aac06b4d0 0x7f5aac06d990 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0d42e0 tx=0x7f5ac0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:13.836+0000 7f5abaffd640 1 -- 172.21.15.55:0/3917837698 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5abc059990 con 0x7f5ab4004d40 2024-04-25T08:59:14.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.052+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3917837698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5acc0d4030 con 0x7f5ab4004d40 2024-04-25T08:59:14.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.053+0000 7f5abaffd640 1 -- 172.21.15.55:0/3917837698 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f5abc059290 con 0x7f5ab4004d40 2024-04-25T08:59:14.042 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:14.042 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:58:50.293987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6852},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6852":{"gid":6852,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":15,"addr":"172.21.15.55:6837/2486130786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2486130786},{"type":"v1","addr":"172.21.15.55:6837","nonce":2486130786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:59:14.042 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 44 2024-04-25T08:59:14.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3917837698 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5aac06b4d0 msgr2=0x7f5aac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5aac06b4d0 0x7f5aac06d990 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0d42e0 tx=0x7f5ac0008040 comp rx=0 tx=0).stop 2024-04-25T08:59:14.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3917837698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 msgr2=0x7f5acc0c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 0x7f5acc0c8be0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5abc004630 tx=0x7f5abc007700 comp rx=0 tx=0).stop 2024-04-25T08:59:14.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3917837698 shutdown_connections 2024-04-25T08:59:14.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5aac06b4d0 0x7f5aac06d990 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc0b44d0 0x7f5acc0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5acc15e2b0 0x7f5acc150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 --2- 172.21.15.55:0/3917837698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ab4004d40 0x7f5acc0c8be0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3917837698 >> 172.21.15.55:0/3917837698 conn(0x7f5acc072900 msgr2=0x7f5acc0b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3917837698 shutdown_connections 2024-04-25T08:59:14.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.055+0000 7f5ad0bf4640 1 -- 172.21.15.55:0/3917837698 wait complete. 2024-04-25T08:59:14.055 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T08:59:14.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.168+0000 7fab4bcdb640 1 Processor -- start 2024-04-25T08:59:14.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.169+0000 7fab4bcdb640 1 -- start start 2024-04-25T08:59:14.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.169+0000 7fab4bcdb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fab440b5580 0x7fab440b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.169+0000 7fab4bcdb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fab440b24c0 0x7fab440b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.169+0000 7fab4bcdb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4406c4b0 con 0x7fab440b98b0 2024-04-25T08:59:14.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.169+0000 7fab4bcdb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4415bb80 con 0x7fab440b5580 2024-04-25T08:59:14.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.169+0000 7fab4bcdb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4406c790 con 0x7fab440b24c0 2024-04-25T08:59:14.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.169+0000 7fab49276640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fab440b5580 0x7fab440b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.169+0000 7fab49a77640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fab440b98b0 0x7fab4415eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42520/0 (socket says 172.21.15.55:42520) 2024-04-25T08:59:14.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.169+0000 7fab49a77640 1 -- 172.21.15.55:0/585061681 learned_addr learned my addr 172.21.15.55:0/585061681 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:14.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.170+0000 7fab49276640 1 -- 172.21.15.55:0/585061681 >> v2:172.21.15.167:3300/0 conn(0x7fab440b24c0 msgr2=0x7fab440b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:14.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.170+0000 7fab49276640 1 --2- 172.21.15.55:0/585061681 >> v2:172.21.15.167:3300/0 conn(0x7fab440b24c0 0x7fab440b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.170+0000 7fab49276640 1 -- 172.21.15.55:0/585061681 >> v1:172.21.15.55:6789/0 conn(0x7fab440b98b0 legacy=0x7fab4415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.170+0000 7fab48a75640 1 -- 172.21.15.55:0/585061681 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830423066 0 0) 0x7fab4406c4b0 con 0x7fab440b98b0 2024-04-25T08:59:14.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.170+0000 7fab49276640 1 -- 172.21.15.55:0/585061681 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4406ca70 con 0x7fab440b5580 2024-04-25T08:59:14.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.170+0000 7fab49276640 1 --2- 172.21.15.55:0/585061681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab440b5580 0x7fab440b5a30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fab44162790 tx=0x7fab3402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9663253c34e0196 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.171+0000 7fab48a75640 1 -- 172.21.15.55:0/585061681 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34037070 con 0x7fab440b5580 2024-04-25T08:59:14.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.171+0000 7fab48a75640 1 -- 172.21.15.55:0/585061681 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3402add0 con 0x7fab440b5580 2024-04-25T08:59:14.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.171+0000 7fab48a75640 1 -- 172.21.15.55:0/585061681 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34032660 con 0x7fab440b5580 2024-04-25T08:59:14.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.171+0000 7fab4bcdb640 1 -- 172.21.15.55:0/585061681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab440b5580 msgr2=0x7fab440b5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.171+0000 7fab4bcdb640 1 --2- 172.21.15.55:0/585061681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab440b5580 0x7fab440b5a30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fab44162790 tx=0x7fab3402a080 comp rx=0 tx=0).stop 2024-04-25T08:59:14.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.171+0000 7fab4bcdb640 1 -- 172.21.15.55:0/585061681 shutdown_connections 2024-04-25T08:59:14.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.171+0000 7fab4bcdb640 1 --2- 172.21.15.55:0/585061681 >> v2:172.21.15.167:3300/0 conn(0x7fab440b24c0 0x7fab440b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.171+0000 7fab4bcdb640 1 --2- 172.21.15.55:0/585061681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab440b5580 0x7fab440b5a30 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.171+0000 7fab4bcdb640 1 -- 172.21.15.55:0/585061681 >> 172.21.15.55:0/585061681 conn(0x7fab440d0580 msgr2=0x7fab440d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.171+0000 7fab4bcdb640 1 -- 172.21.15.55:0/585061681 shutdown_connections 2024-04-25T08:59:14.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.171+0000 7fab4bcdb640 1 -- 172.21.15.55:0/585061681 wait complete. 2024-04-25T08:59:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.172+0000 7fab4bcdb640 1 Processor -- start 2024-04-25T08:59:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.173+0000 7fab4bcdb640 1 -- start start 2024-04-25T08:59:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.173+0000 7fab4bcdb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab440b24c0 0x7fab441f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.173+0000 7fab4bcdb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab440b5580 0x7fab44152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.173+0000 7fab4bcdb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab44152fb0 0x7fab440b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.173+0000 7fab4bcdb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab440cec40 con 0x7fab440b5580 2024-04-25T08:59:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.173+0000 7fab4bcdb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4406c140 con 0x7fab44152fb0 2024-04-25T08:59:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.173+0000 7fab4bcdb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab440b2e30 con 0x7fab440b24c0 2024-04-25T08:59:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.173+0000 7fab49276640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab440b5580 0x7fab44152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.173+0000 7fab49276640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab440b5580 0x7fab44152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37988/0 (socket says 172.21.15.55:37988) 2024-04-25T08:59:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.173+0000 7fab49276640 1 -- 172.21.15.55:0/3049253976 learned_addr learned my addr 172.21.15.55:0/3049253976 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:14.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab4a278640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab44152fb0 0x7fab440b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab49a77640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab440b24c0 0x7fab441f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab49276640 1 -- 172.21.15.55:0/3049253976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab440b24c0 msgr2=0x7fab441f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab49276640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab440b24c0 0x7fab441f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab49276640 1 -- 172.21.15.55:0/3049253976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab44152fb0 msgr2=0x7fab440b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab49276640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab44152fb0 0x7fab440b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab49276640 1 -- 172.21.15.55:0/3049253976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab440c7630 con 0x7fab440b5580 2024-04-25T08:59:14.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab4a278640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab44152fb0 0x7fab440b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:14.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab49276640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab440b5580 0x7fab44152910 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fab3402a670 tx=0x7fab340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab3a7fc640 1 -- 172.21.15.55:0/3049253976 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34041070 con 0x7fab440b5580 2024-04-25T08:59:14.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab3a7fc640 1 -- 172.21.15.55:0/3049253976 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3403c670 con 0x7fab440b5580 2024-04-25T08:59:14.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab4bcdb640 1 -- 172.21.15.55:0/3049253976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab440c7910 con 0x7fab440b5580 2024-04-25T08:59:14.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab3a7fc640 1 -- 172.21.15.55:0/3049253976 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34037040 con 0x7fab440b5580 2024-04-25T08:59:14.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.174+0000 7fab4bcdb640 1 -- 172.21.15.55:0/3049253976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab440c7ed0 con 0x7fab440b5580 2024-04-25T08:59:14.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.176+0000 7fab3a7fc640 1 -- 172.21.15.55:0/3049253976 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab34044070 con 0x7fab440b5580 2024-04-25T08:59:14.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.176+0000 7fab3a7fc640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab2806b4d0 0x7fab2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.176+0000 7fab3a7fc640 1 -- 172.21.15.55:0/3049253976 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fab340aad70 con 0x7fab440b5580 2024-04-25T08:59:14.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.176+0000 7fab49a77640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab2806b4d0 0x7fab2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.176+0000 7fab49a77640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab2806b4d0 0x7fab2806d990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fab40000f60 tx=0x7fab40007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.177+0000 7fab4e9de740 1 Processor -- start 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.177+0000 7fab4e9de740 1 -- start start 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd51970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4e9de740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fccb4c60 con 0x55c4fcd7c050 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4e9de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fcc53d80 con 0x55c4fcd8dc60 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4e9de740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4fccb0d00 con 0x55c4fcd51590 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4a278640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4a278640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38000/0 (socket says 172.21.15.55:38000) 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4a278640 1 -- 172.21.15.55:0/1434763417 learned_addr learned my addr 172.21.15.55:0/1434763417 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab49a77640 1 --2- 172.21.15.55:0/1434763417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab49276640 1 --2- 172.21.15.55:0/1434763417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd51970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4a278640 1 -- 172.21.15.55:0/1434763417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 msgr2=0x55c4fcd536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4a278640 1 --2- 172.21.15.55:0/1434763417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4a278640 1 -- 172.21.15.55:0/1434763417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd8dc60 msgr2=0x55c4fcd51970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4a278640 1 --2- 172.21.15.55:0/1434763417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd51970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4a278640 1 -- 172.21.15.55:0/1434763417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4fca957c0 con 0x55c4fcd7c050 2024-04-25T08:59:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.178+0000 7fab4a278640 1 --2- 172.21.15.55:0/1434763417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7c4d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009fd0 tx=0x7fab3c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a8d9e1564f1e91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab277fe640 1 -- 172.21.15.55:0/1434763417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c01a070 con 0x55c4fcd7c050 2024-04-25T08:59:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab277fe640 1 -- 172.21.15.55:0/1434763417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c015410 con 0x55c4fcd7c050 2024-04-25T08:59:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab277fe640 1 -- 172.21.15.55:0/1434763417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c0157c0 con 0x55c4fcd7c050 2024-04-25T08:59:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab4e9de740 1 -- 172.21.15.55:0/1434763417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 msgr2=0x55c4fcd7c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab4e9de740 1 --2- 172.21.15.55:0/1434763417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7c4d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009fd0 tx=0x7fab3c00c8b0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab4e9de740 1 -- 172.21.15.55:0/1434763417 shutdown_connections 2024-04-25T08:59:14.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab4e9de740 1 --2- 172.21.15.55:0/1434763417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7c4d0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab4e9de740 1 --2- 172.21.15.55:0/1434763417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd51970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab4e9de740 1 --2- 172.21.15.55:0/1434763417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab4e9de740 1 -- 172.21.15.55:0/1434763417 >> 172.21.15.55:0/1434763417 conn(0x55c4fcd196e0 msgr2=0x55c4fcd97050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab4e9de740 1 -- 172.21.15.55:0/1434763417 shutdown_connections 2024-04-25T08:59:14.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.179+0000 7fab4e9de740 1 -- 172.21.15.55:0/1434763417 wait complete. 2024-04-25T08:59:14.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.180+0000 7fab4e9de740 1 -- start start 2024-04-25T08:59:14.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.180+0000 7fab4e9de740 1 Processor -- start 2024-04-25T08:59:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd78dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd7c050 0x55c4fcd91750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd91c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4e9de740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fcc51840 con 0x55c4fcd8dc60 2024-04-25T08:59:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4e9de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fcd79ba0 con 0x55c4fcd7c050 2024-04-25T08:59:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4e9de740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4fcda7eb0 con 0x55c4fcd51590 2024-04-25T08:59:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4e9de740 10 client.0 _ll_register_callbacks cb 0x55c4fcc6b980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4a278640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd91c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4a278640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd91c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38008/0 (socket says 172.21.15.55:38008) 2024-04-25T08:59:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4a278640 1 -- 172.21.15.55:0/2614046991 learned_addr learned my addr 172.21.15.55:0/2614046991 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab49a77640 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd78dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab49276640 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd7c050 0x55c4fcd91750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4a278640 1 -- 172.21.15.55:0/2614046991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 msgr2=0x55c4fcd78dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4a278640 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd78dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4a278640 1 -- 172.21.15.55:0/2614046991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd7c050 msgr2=0x55c4fcd91750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4a278640 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd7c050 0x55c4fcd91750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4a278640 1 -- 172.21.15.55:0/2614046991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4fcaf5f50 con 0x55c4fcd8dc60 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab4a278640 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd91c90 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009f70 tx=0x7fab3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca21835e13ec72ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.181+0000 7fab24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab24ff9640 1 -- 172.21.15.55:0/2614046991 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c01a040 con 0x55c4fcd8dc60 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab24ff9640 1 -- 172.21.15.55:0/2614046991 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fab3c015a30 con 0x55c4fcd8dc60 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab4e9de740 1 -- 172.21.15.55:0/2614046991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab3c015410 con 0x55c4fcd8dc60 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab24ff9640 1 -- 172.21.15.55:0/2614046991 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab3c02c050 con 0x55c4fcd8dc60 2024-04-25T08:59:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab4e9de740 10 client.7122 fetch_fsmap learned FSMap version 44 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab4e9de740 1 -- 172.21.15.55:0/2614046991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55c4fc9890b0 con 0x55c4fcd8dc60 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab24ff9640 1 -- 172.21.15.55:0/2614046991 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c015410 con 0x55c4fcd8dc60 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab24ff9640 1 -- 172.21.15.55:0/2614046991 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fab3c02f020 con 0x55c4fcd8dc60 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab4e9de740 10 client.7122 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab4e9de740 10 client.7122 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab4e9de740 20 client.7122 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab4e9de740 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55c4fcd7e3c0 0x55c4fcd7e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab4e9de740 4 client.7122 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab4e9de740 1 -- 172.21.15.55:0/2614046991 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4fcc74e60 con 0x55c4fcd7e3c0 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.182+0000 7fab49a77640 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55c4fcd7e3c0 0x55c4fcd7e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab24ff9640 10 client.7122 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab49a77640 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55c4fcd7e3c0 0x55c4fcd7e7a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da17ce59398e12 server_cookie=f7d6234c37fa29f8 in_seq=0 out_seq=0 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab24ff9640 1 -- 172.21.15.55:0/2614046991 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c4fcc74e60 con 0x55c4fcd7e3c0 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab24ff9640 10 client.7122 handle_command_reply: tid=0 2024-04-25T08:59:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab4e9de740 1 client.7122 shutdown 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab4e9de740 1 -- 172.21.15.55:0/2614046991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 msgr2=0x55c4fcd91c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab4e9de740 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd91c90 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009f70 tx=0x7fab3c004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab4e9de740 1 -- 172.21.15.55:0/2614046991 shutdown_connections 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab4e9de740 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55c4fcd7e3c0 0x55c4fcd7e7a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab4e9de740 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd91c90 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab4e9de740 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd7c050 0x55c4fcd91750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab4e9de740 1 --2- 172.21.15.55:0/2614046991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd78dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab24ff9640 0 client.7122 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab4e9de740 1 -- 172.21.15.55:0/2614046991 >> 172.21.15.55:0/2614046991 conn(0x55c4fcd196e0 msgr2=0x55c4fcd79d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.183+0000 7fab4e9de740 1 -- 172.21.15.55:0/2614046991 shutdown_connections 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.184+0000 7fab4e9de740 1 -- 172.21.15.55:0/2614046991 wait complete. 2024-04-25T08:59:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.184+0000 7fab4e9de740 20 client.7122 trim_cache size 0 max 16384 2024-04-25T08:59:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.195+0000 7fab4e9de740 1 Processor -- start 2024-04-25T08:59:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.196+0000 7fab4e9de740 1 -- start start 2024-04-25T08:59:14.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.196+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd78450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.196+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.196+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd79930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.196+0000 7fab4e9de740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab44157de0 con 0x55c4fcd8dc60 2024-04-25T08:59:14.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.196+0000 7fab4e9de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab441571e0 con 0x55c4fcd7c050 2024-04-25T08:59:14.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.196+0000 7fab4e9de740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab441577e0 con 0x55c4fcd51590 2024-04-25T08:59:14.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.196+0000 7fab4a278640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd79930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.196+0000 7fab4a278640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd79930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38010/0 (socket says 172.21.15.55:38010) 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.196+0000 7fab4a278640 1 -- 172.21.15.55:0/2912635247 learned_addr learned my addr 172.21.15.55:0/2912635247 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4a278640 1 -- 172.21.15.55:0/2912635247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 msgr2=0x55c4fcd78450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab49276640 1 --2- 172.21.15.55:0/2912635247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4a278640 1 --2- 172.21.15.55:0/2912635247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd78450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4a278640 1 -- 172.21.15.55:0/2912635247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd7c050 msgr2=0x55c4fcd7db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4a278640 1 --2- 172.21.15.55:0/2912635247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4a278640 1 -- 172.21.15.55:0/2912635247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4fcd92280 con 0x55c4fcd8dc60 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab49276640 1 --2- 172.21.15.55:0/2912635247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4a278640 1 --2- 172.21.15.55:0/2912635247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd79930 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009780 tx=0x7fab3c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da60b3b69c007f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab26ffd640 1 -- 172.21.15.55:0/2912635247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c01a020 con 0x55c4fcd8dc60 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab26ffd640 1 -- 172.21.15.55:0/2912635247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c015410 con 0x55c4fcd8dc60 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab26ffd640 1 -- 172.21.15.55:0/2912635247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00ce60 con 0x55c4fcd8dc60 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4e9de740 1 -- 172.21.15.55:0/2912635247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 msgr2=0x55c4fcd79930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4e9de740 1 --2- 172.21.15.55:0/2912635247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd79930 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009780 tx=0x7fab3c01c000 comp rx=0 tx=0).stop 2024-04-25T08:59:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4e9de740 1 -- 172.21.15.55:0/2912635247 shutdown_connections 2024-04-25T08:59:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4e9de740 1 --2- 172.21.15.55:0/2912635247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd79930 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4e9de740 1 --2- 172.21.15.55:0/2912635247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4e9de740 1 --2- 172.21.15.55:0/2912635247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd78450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.197+0000 7fab4e9de740 1 -- 172.21.15.55:0/2912635247 >> 172.21.15.55:0/2912635247 conn(0x55c4fcd196e0 msgr2=0x55c4fcd907c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.198+0000 7fab4e9de740 1 -- 172.21.15.55:0/2912635247 shutdown_connections 2024-04-25T08:59:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.198+0000 7fab4e9de740 1 -- 172.21.15.55:0/2912635247 wait complete. 2024-04-25T08:59:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.198+0000 7fab4e9de740 1 -- start start 2024-04-25T08:59:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.198+0000 7fab4e9de740 1 Processor -- start 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd9aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab4e9de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd7acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab4e9de740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fcd793e0 con 0x55c4fcd7c050 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab4e9de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4fcd90640 con 0x55c4fcd8dc60 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab4e9de740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4fcda6e10 con 0x55c4fcd51590 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab4e9de740 10 client.0 _ll_register_callbacks cb 0x7fab3c0097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab49276640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab49276640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38024/0 (socket says 172.21.15.55:38024) 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab49276640 1 -- 172.21.15.55:0/1578045172 learned_addr learned my addr 172.21.15.55:0/1578045172 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab49a77640 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd9aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab4a278640 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd7acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab49276640 1 -- 172.21.15.55:0/1578045172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 msgr2=0x55c4fcd9aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab49276640 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd9aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab49276640 1 -- 172.21.15.55:0/1578045172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd8dc60 msgr2=0x55c4fcd7acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab49276640 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd7acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.199+0000 7fab49276640 1 -- 172.21.15.55:0/1578045172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4fcd531b0 con 0x55c4fcd7c050 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab49276640 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7a790 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fab340a91a0 tx=0x7fab34009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1a55d8d98ca345 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab24ff9640 1 -- 172.21.15.55:0/1578045172 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340819f0 con 0x55c4fcd7c050 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab24ff9640 1 -- 172.21.15.55:0/1578045172 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fab340789c0 con 0x55c4fcd7c050 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab4e9de740 1 -- 172.21.15.55:0/1578045172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab3c015410 con 0x55c4fcd7c050 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab24ff9640 1 -- 172.21.15.55:0/1578045172 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab34081c80 con 0x55c4fcd7c050 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab4e9de740 10 client.7128 fetch_fsmap learned FSMap version 44 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab4e9de740 1 -- 172.21.15.55:0/1578045172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55c4fcd50a40 con 0x55c4fcd7c050 2024-04-25T08:59:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab24ff9640 1 -- 172.21.15.55:0/1578045172 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c015410 con 0x55c4fcd7c050 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab24ff9640 1 -- 172.21.15.55:0/1578045172 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fab340a2b60 con 0x55c4fcd7c050 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab4e9de740 10 client.7128 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab4e9de740 10 client.7128 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab4e9de740 20 client.7128 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab4e9de740 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55c4fcd79980 0x55c4fcd79d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab4e9de740 4 client.7128 mds_command: new command op to 6852 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab4e9de740 1 -- 172.21.15.55:0/1578045172 --> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55c4fccc21a0 con 0x55c4fcd79980 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.200+0000 7fab49a77640 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55c4fcd79980 0x55c4fcd79d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab24ff9640 10 client.7128 ms_handle_connect on v2:172.21.15.55:6835/2486130786 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab49a77640 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55c4fcd79980 0x55c4fcd79d60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b759581bb803267 server_cookie=af2145ce26595860 in_seq=0 out_seq=0 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab24ff9640 1 -- 172.21.15.55:0/1578045172 <== mds.0 v2:172.21.15.55:6835/2486130786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c4fccc21a0 con 0x55c4fcd79980 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab24ff9640 10 client.7128 handle_command_reply: tid=0 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 1 client.7128 shutdown 2024-04-25T08:59:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 1 -- 172.21.15.55:0/1578045172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 msgr2=0x55c4fcd7a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7a790 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fab340a91a0 tx=0x7fab34009480 comp rx=0 tx=0).stop 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 1 -- 172.21.15.55:0/1578045172 shutdown_connections 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.55:6835/2486130786,v1:172.21.15.55:6837/2486130786] conn(0x55c4fcd79980 0x55c4fcd79d60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4fcd8dc60 0x55c4fcd7acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c4fcd7c050 0x55c4fcd7a790 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab24ff9640 0 client.7128 ms_handle_reset on v2:172.21.15.55:6835/2486130786 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 1 --2- 172.21.15.55:0/1578045172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c4fcd51590 0x55c4fcd9aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 1 -- 172.21.15.55:0/1578045172 >> 172.21.15.55:0/1578045172 conn(0x55c4fcd196e0 msgr2=0x55c4fcd8e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 1 -- 172.21.15.55:0/1578045172 shutdown_connections 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 1 -- 172.21.15.55:0/1578045172 wait complete. 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.201+0000 7fab4e9de740 20 client.7128 trim_cache size 0 max 16384 2024-04-25T08:59:14.196 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:14.197 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 -- 172.21.15.55:0/3049253976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab2806b4d0 msgr2=0x7fab2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab2806b4d0 0x7fab2806d990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fab40000f60 tx=0x7fab40007c00 comp rx=0 tx=0).stop 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 -- 172.21.15.55:0/3049253976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab440b5580 msgr2=0x7fab44152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab440b5580 0x7fab44152910 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fab3402a670 tx=0x7fab340046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 -- 172.21.15.55:0/3049253976 shutdown_connections 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab2806b4d0 0x7fab2806d990 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab44152fb0 0x7fab440b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab440b5580 0x7fab44152910 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 --2- 172.21.15.55:0/3049253976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab440b24c0 0x7fab441f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 -- 172.21.15.55:0/3049253976 >> 172.21.15.55:0/3049253976 conn(0x7fab440d0580 msgr2=0x7fab44074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 -- 172.21.15.55:0/3049253976 shutdown_connections 2024-04-25T08:59:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.202+0000 7fab4bcdb640 1 -- 172.21.15.55:0/3049253976 wait complete. 2024-04-25T08:59:14.201 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T08:59:14.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.312+0000 7f1510761640 1 Processor -- start 2024-04-25T08:59:14.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.312+0000 7f1510761640 1 -- start start 2024-04-25T08:59:14.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.313+0000 7f1510761640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f150815bf00 0x7f15080cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.313+0000 7f1510761640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f15080cc310 0x7f150815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.313+0000 7f1510761640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f150815c820 0x7f150806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.313+0000 7f1510761640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15081455e0 con 0x7f150815bf00 2024-04-25T08:59:14.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.313+0000 7f1510761640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150806d450 con 0x7f15080cc310 2024-04-25T08:59:14.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.313+0000 7f1510761640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15080ce6c0 con 0x7f150815c820 2024-04-25T08:59:14.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.313+0000 7f150e4fd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f150815bf00 0x7f15080cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.313+0000 7f150e4fd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f150815bf00 0x7f15080cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38034/0 (socket says 172.21.15.55:38034) 2024-04-25T08:59:14.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.313+0000 7f150e4fd640 1 -- 172.21.15.55:0/1669629595 learned_addr learned my addr 172.21.15.55:0/1669629595 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:14.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.314+0000 7f150ecfe640 1 --2- 172.21.15.55:0/1669629595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f150815c820 0x7f150806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.314+0000 7f150dcfc640 1 --2- 172.21.15.55:0/1669629595 >> v2:172.21.15.167:3300/0 conn(0x7f15080cc310 0x7f150815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.314+0000 7f150e4fd640 1 -- 172.21.15.55:0/1669629595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f150815c820 msgr2=0x7f150806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:14.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.314+0000 7f150e4fd640 1 --2- 172.21.15.55:0/1669629595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f150815c820 0x7f150806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.314+0000 7f150e4fd640 1 -- 172.21.15.55:0/1669629595 >> v2:172.21.15.167:3300/0 conn(0x7f15080cc310 msgr2=0x7f150815c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:14.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.314+0000 7f150e4fd640 1 --2- 172.21.15.55:0/1669629595 >> v2:172.21.15.167:3300/0 conn(0x7f15080cc310 0x7f150815c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.314+0000 7f150e4fd640 1 -- 172.21.15.55:0/1669629595 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15080cc7b0 con 0x7f150815bf00 2024-04-25T08:59:14.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.314+0000 7f150e4fd640 1 --2- 172.21.15.55:0/1669629595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150815bf00 0x7f15080cbdd0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f150806b900 tx=0x7f150402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26620f0b460ba4d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f150d4fb640 1 -- 172.21.15.55:0/1669629595 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504037070 con 0x7f150815bf00 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f150d4fb640 1 -- 172.21.15.55:0/1669629595 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504032440 con 0x7f150815bf00 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f150d4fb640 1 -- 172.21.15.55:0/1669629595 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504032810 con 0x7f150815bf00 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f1510761640 1 -- 172.21.15.55:0/1669629595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150815bf00 msgr2=0x7f15080cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f1510761640 1 --2- 172.21.15.55:0/1669629595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150815bf00 0x7f15080cbdd0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f150806b900 tx=0x7f150402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f1510761640 1 -- 172.21.15.55:0/1669629595 shutdown_connections 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f1510761640 1 --2- 172.21.15.55:0/1669629595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f150815c820 0x7f150806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f1510761640 1 --2- 172.21.15.55:0/1669629595 >> v2:172.21.15.167:3300/0 conn(0x7f15080cc310 0x7f150815c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f1510761640 1 --2- 172.21.15.55:0/1669629595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150815bf00 0x7f15080cbdd0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f1510761640 1 -- 172.21.15.55:0/1669629595 >> 172.21.15.55:0/1669629595 conn(0x7f150806aba0 msgr2=0x7f150806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f1510761640 1 -- 172.21.15.55:0/1669629595 shutdown_connections 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.315+0000 7f1510761640 1 -- 172.21.15.55:0/1669629595 wait complete. 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.316+0000 7f1510761640 1 Processor -- start 2024-04-25T08:59:14.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.316+0000 7f1510761640 1 -- start start 2024-04-25T08:59:14.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.317+0000 7f1510761640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15080cc310 0x7f150813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.317+0000 7f1510761640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150815bf00 0x7f1508143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.317+0000 7f1510761640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150815c820 0x7f1508143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.317+0000 7f1510761640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15080cd050 con 0x7f150815c820 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.317+0000 7f1510761640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15080ccd70 con 0x7f150815bf00 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.317+0000 7f1510761640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150815ccd0 con 0x7f15080cc310 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.317+0000 7f150ecfe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150815c820 0x7f1508143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.317+0000 7f150ecfe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150815c820 0x7f1508143a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38038/0 (socket says 172.21.15.55:38038) 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.317+0000 7f150ecfe640 1 -- 172.21.15.55:0/3225684873 learned_addr learned my addr 172.21.15.55:0/3225684873 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.317+0000 7f150ecfe640 1 -- 172.21.15.55:0/3225684873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15080cc310 msgr2=0x7f150813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.318+0000 7f150ecfe640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15080cc310 0x7f150813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.318+0000 7f150ecfe640 1 -- 172.21.15.55:0/3225684873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150815bf00 msgr2=0x7f1508143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.318+0000 7f150ecfe640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150815bf00 0x7f1508143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.318+0000 7f150ecfe640 1 -- 172.21.15.55:0/3225684873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508158900 con 0x7f150815c820 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.318+0000 7f150ecfe640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150815c820 0x7f1508143a40 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f1500007e90 tx=0x7f150000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.318+0000 7f14feffd640 1 -- 172.21.15.55:0/3225684873 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500014420 con 0x7f150815c820 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.318+0000 7f14feffd640 1 -- 172.21.15.55:0/3225684873 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1500019070 con 0x7f150815c820 2024-04-25T08:59:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.318+0000 7f1510761640 1 -- 172.21.15.55:0/3225684873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150813b6e0 con 0x7f150815c820 2024-04-25T08:59:14.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.318+0000 7f14feffd640 1 -- 172.21.15.55:0/3225684873 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500014820 con 0x7f150815c820 2024-04-25T08:59:14.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.318+0000 7f1510761640 1 -- 172.21.15.55:0/3225684873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150814d8d0 con 0x7f150815c820 2024-04-25T08:59:14.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.319+0000 7f1510761640 1 -- 172.21.15.55:0/3225684873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150806bb30 con 0x7f150815c820 2024-04-25T08:59:14.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.319+0000 7f14feffd640 1 -- 172.21.15.55:0/3225684873 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f15000149c0 con 0x7f150815c820 2024-04-25T08:59:14.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.320+0000 7f14feffd640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14ec06b4d0 0x7f14ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.320+0000 7f14feffd640 1 -- 172.21.15.55:0/3225684873 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f150008a9c0 con 0x7f150815c820 2024-04-25T08:59:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.320+0000 7f150e4fd640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14ec06b4d0 0x7f14ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.320+0000 7f150e4fd640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14ec06b4d0 0x7f14ec06d990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1504034000 tx=0x7f150402c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.324+0000 7f14feffd640 1 -- 172.21.15.55:0/3225684873 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f150008ce20 con 0x7f150815c820 2024-04-25T08:59:14.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.547+0000 7f1510761640 1 -- 172.21.15.55:0/3225684873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1508144e00 con 0x7f150815c820 2024-04-25T08:59:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.547+0000 7f14feffd640 1 -- 172.21.15.55:0/3225684873 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f150005f070 con 0x7f150815c820 2024-04-25T08:59:14.537 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:14.537 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T08:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.549+0000 7f1510761640 1 -- 172.21.15.55:0/3225684873 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14ec06b4d0 msgr2=0x7f14ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.549+0000 7f1510761640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14ec06b4d0 0x7f14ec06d990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1504034000 tx=0x7f150402c000 comp rx=0 tx=0).stop 2024-04-25T08:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.549+0000 7f1510761640 1 -- 172.21.15.55:0/3225684873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150815c820 msgr2=0x7f1508143a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.549+0000 7f1510761640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150815c820 0x7f1508143a40 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f1500007e90 tx=0x7f150000e4b0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.549+0000 7f1510761640 1 -- 172.21.15.55:0/3225684873 shutdown_connections 2024-04-25T08:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.549+0000 7f1510761640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14ec06b4d0 0x7f14ec06d990 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.549+0000 7f1510761640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150815c820 0x7f1508143a40 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.549+0000 7f1510761640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150815bf00 0x7f1508143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.549+0000 7f1510761640 1 --2- 172.21.15.55:0/3225684873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15080cc310 0x7f150813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.549+0000 7f1510761640 1 -- 172.21.15.55:0/3225684873 >> 172.21.15.55:0/3225684873 conn(0x7f150806aba0 msgr2=0x7f150806d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.550+0000 7f1510761640 1 -- 172.21.15.55:0/3225684873 shutdown_connections 2024-04-25T08:59:14.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.550+0000 7f1510761640 1 -- 172.21.15.55:0/3225684873 wait complete. 2024-04-25T08:59:14.549 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T08:59:14.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:59:14.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.661+0000 7efe42769640 1 Processor -- start 2024-04-25T08:59:14.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.661+0000 7efe42769640 1 -- start start 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.662+0000 7efe42769640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe3c06b2b0 0x7efe3c1689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.662+0000 7efe42769640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c161970 con 0x7efe3c162360 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.662+0000 7efe42769640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c06b780 con 0x7efe3c0ce130 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.662+0000 7efe42769640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c06ba60 con 0x7efe3c06b2b0 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.662+0000 7efe40d06640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe3c06b2b0 0x7efe3c1689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.662+0000 7efe3bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efe3c162360 0x7efe3c0cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42526/0 (socket says 172.21.15.55:42526) 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.662+0000 7efe40d06640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe3c06b2b0 0x7efe3c1689d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38052/0 (socket says 172.21.15.55:38052) 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.662+0000 7efe3bfff640 1 -- 172.21.15.55:0/314304102 learned_addr learned my addr 172.21.15.55:0/314304102 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.663+0000 7efe40d06640 1 -- 172.21.15.55:0/314304102 >> v1:172.21.15.167:6789/0 conn(0x7efe3c0ce130 legacy=0x7efe3c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.663+0000 7efe40d06640 1 -- 172.21.15.55:0/314304102 >> v1:172.21.15.55:6789/0 conn(0x7efe3c162360 legacy=0x7efe3c0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.663+0000 7efe40d06640 1 -- 172.21.15.55:0/314304102 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c06bd40 con 0x7efe3c06b2b0 2024-04-25T08:59:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.663+0000 7efe3affd640 1 -- 172.21.15.55:0/314304102 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892136396 0 0) 0x7efe2c001110 con 0x7efe3c162360 2024-04-25T08:59:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.663+0000 7efe40d06640 1 --2- 172.21.15.55:0/314304102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3c06b2b0 0x7efe3c1689d0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7efe34009d90 tx=0x7efe3402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a598e7341c852815 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.664+0000 7efe3affd640 1 -- 172.21.15.55:0/314304102 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34007740 con 0x7efe3c06b2b0 2024-04-25T08:59:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.664+0000 7efe3affd640 1 -- 172.21.15.55:0/314304102 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe340078e0 con 0x7efe3c06b2b0 2024-04-25T08:59:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.664+0000 7efe3affd640 1 -- 172.21.15.55:0/314304102 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34007cb0 con 0x7efe3c06b2b0 2024-04-25T08:59:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.664+0000 7efe42769640 1 -- 172.21.15.55:0/314304102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3c06b2b0 msgr2=0x7efe3c1689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.664+0000 7efe42769640 1 --2- 172.21.15.55:0/314304102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3c06b2b0 0x7efe3c1689d0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7efe34009d90 tx=0x7efe3402a6f0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.664+0000 7efe42769640 1 -- 172.21.15.55:0/314304102 shutdown_connections 2024-04-25T08:59:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.664+0000 7efe42769640 1 --2- 172.21.15.55:0/314304102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3c06b2b0 0x7efe3c1689d0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.664+0000 7efe42769640 1 -- 172.21.15.55:0/314304102 >> 172.21.15.55:0/314304102 conn(0x7efe3c0cc8d0 msgr2=0x7efe3c0ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.664+0000 7efe42769640 1 -- 172.21.15.55:0/314304102 shutdown_connections 2024-04-25T08:59:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.664+0000 7efe42769640 1 -- 172.21.15.55:0/314304102 wait complete. 2024-04-25T08:59:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.665+0000 7efe42769640 1 Processor -- start 2024-04-25T08:59:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.666+0000 7efe42769640 1 -- start start 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.666+0000 7efe42769640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe3c06b2b0 0x7efe3c0c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.666+0000 7efe42769640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3c0ce130 0x7efe3c14d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.666+0000 7efe42769640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe3c14e8c0 0x7efe3c0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.666+0000 7efe42769640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c06eac0 con 0x7efe3c0ce130 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.666+0000 7efe42769640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c06c300 con 0x7efe3c06b2b0 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.666+0000 7efe42769640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c06ec40 con 0x7efe3c14e8c0 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.666+0000 7efe3b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3c0ce130 0x7efe3c14d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.666+0000 7efe3b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3c0ce130 0x7efe3c14d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38058/0 (socket says 172.21.15.55:38058) 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.666+0000 7efe3b7fe640 1 -- 172.21.15.55:0/1032733436 learned_addr learned my addr 172.21.15.55:0/1032733436 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe3bfff640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe3c06b2b0 0x7efe3c0c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe40d06640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe3c14e8c0 0x7efe3c0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe3b7fe640 1 -- 172.21.15.55:0/1032733436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe3c14e8c0 msgr2=0x7efe3c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe3b7fe640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe3c14e8c0 0x7efe3c0c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe3b7fe640 1 -- 172.21.15.55:0/1032733436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe3c06b2b0 msgr2=0x7efe3c0c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe3b7fe640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe3c06b2b0 0x7efe3c0c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe3b7fe640 1 -- 172.21.15.55:0/1032733436 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c14d580 con 0x7efe3c0ce130 2024-04-25T08:59:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe40d06640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe3c14e8c0 0x7efe3c0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe3bfff640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe3c06b2b0 0x7efe3c0c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe3b7fe640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3c0ce130 0x7efe3c14d040 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c400 tx=0x7efe3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe38ff9640 1 -- 172.21.15.55:0/1032733436 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30017070 con 0x7efe3c0ce130 2024-04-25T08:59:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe38ff9640 1 -- 172.21.15.55:0/1032733436 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe300052d0 con 0x7efe3c0ce130 2024-04-25T08:59:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe42769640 1 -- 172.21.15.55:0/1032733436 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c14d820 con 0x7efe3c0ce130 2024-04-25T08:59:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe38ff9640 1 -- 172.21.15.55:0/1032733436 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30003830 con 0x7efe3c0ce130 2024-04-25T08:59:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.667+0000 7efe42769640 1 -- 172.21.15.55:0/1032733436 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c14e0c0 con 0x7efe3c0ce130 2024-04-25T08:59:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.668+0000 7efe42769640 1 -- 172.21.15.55:0/1032733436 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c0749b0 con 0x7efe3c0ce130 2024-04-25T08:59:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.669+0000 7efe38ff9640 1 -- 172.21.15.55:0/1032733436 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe3001a070 con 0x7efe3c0ce130 2024-04-25T08:59:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.669+0000 7efe38ff9640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efe2806b4d0 0x7efe2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.669+0000 7efe38ff9640 1 -- 172.21.15.55:0/1032733436 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7efe30089580 con 0x7efe3c0ce130 2024-04-25T08:59:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.669+0000 7efe3bfff640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efe2806b4d0 0x7efe2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.670+0000 7efe3bfff640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efe2806b4d0 0x7efe2806d990 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efe2c000f60 tx=0x7efe2c007a10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.673+0000 7efe38ff9640 1 -- 172.21.15.55:0/1032733436 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe30058400 con 0x7efe3c0ce130 2024-04-25T08:59:14.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.891+0000 7efe42769640 1 -- 172.21.15.55:0/1032733436 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efe3c0cd2f0 con 0x7efe3c0ce130 2024-04-25T08:59:14.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.892+0000 7efe38ff9640 1 -- 172.21.15.55:0/1032733436 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7efe30057d00 con 0x7efe3c0ce130 2024-04-25T08:59:14.881 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:59:14.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 -- 172.21.15.55:0/1032733436 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efe2806b4d0 msgr2=0x7efe2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efe2806b4d0 0x7efe2806d990 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efe2c000f60 tx=0x7efe2c007a10 comp rx=0 tx=0).stop 2024-04-25T08:59:14.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 -- 172.21.15.55:0/1032733436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3c0ce130 msgr2=0x7efe3c14d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:14.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3c0ce130 0x7efe3c14d040 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c400 tx=0x7efe3000c8c0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 -- 172.21.15.55:0/1032733436 shutdown_connections 2024-04-25T08:59:14.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efe2806b4d0 0x7efe2806d990 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe3c14e8c0 0x7efe3c0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3c0ce130 0x7efe3c14d040 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 --2- 172.21.15.55:0/1032733436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe3c06b2b0 0x7efe3c0c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:14.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 -- 172.21.15.55:0/1032733436 >> 172.21.15.55:0/1032733436 conn(0x7efe3c0cc8d0 msgr2=0x7efe3c0ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:14.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 -- 172.21.15.55:0/1032733436 shutdown_connections 2024-04-25T08:59:14.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:14.894+0000 7efe42769640 1 -- 172.21.15.55:0/1032733436 wait complete. 2024-04-25T08:59:14.894 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:59:14.894 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:59:14.894 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T08:59:14.894 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:59:14.894 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:14.894 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:59:14.894 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:59:14.894 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:59:14.894 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:14.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:14.895 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T08:59:14.910 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T08:59:14.911 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42402sec preferred_lft 42402sec 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:59:14.912 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T08:59:14.913 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:14.913 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:59:14.913 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:59:14.913 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T08:59:14.913 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:14.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:14.913 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:59:14.974 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:59:14.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:14.976 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T08:59:15.032 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T08:59:15.032 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:59:15.032 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:59:15.032 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:59:15.033 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:59:15.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:15.033 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:59:15.033 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:59:15.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:59:15.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:59:15.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:59:15.033 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:59:15.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:15.118 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:59:15.132 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:59:15.133 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:59:15.133 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:15.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:15.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T08:59:15.197 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:59:15.198 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:15.253 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:15.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:59:15.253 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:15.308 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:59:15.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:15.309 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:15.391 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:15.391 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:59:15.392 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:59:15.400 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:15.400 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:59:15.400 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:59:15.400 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:59:15.400 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:59:15.405 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:15.405 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:59:15.405 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:59:15.405 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:59:15.405 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:59:15.405 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:59:15.405 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:59:15.405 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:59:15.406 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:59:15.406 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:59:15.406 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:59:15.406 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:59:15.406 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:59:15.407 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:59:15.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:15.408 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:15.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:15.473 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:59:15.529 INFO:teuthology.orchestra.run.smithi055.stdout:client5903 2024-04-25T08:59:15.530 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:59:15.530 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:15.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:15.586 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T08:59:15.641 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:59:15.642 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T08:59:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.736+0000 7f1884cedf40 1 Processor -- start 2024-04-25T08:59:15.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.736+0000 7f1884cedf40 1 -- start start 2024-04-25T08:59:15.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1884cedf40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd507d5b00 0x55fd50876f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1884cedf40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd507d5ee0 0x55fd507a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1884cedf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd5087ee50 0x55fd507a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1884cedf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd5087b540 con 0x55fd5087ee50 2024-04-25T08:59:15.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1884cedf40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd5074cdf0 con 0x55fd507d5b00 2024-04-25T08:59:15.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1884cedf40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd507ed5b0 con 0x55fd507d5ee0 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1882fef640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd5087ee50 0x55fd507a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1882fef640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd5087ee50 0x55fd507a68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38072/0 (socket says 172.21.15.55:38072) 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1882fef640 1 -- 172.21.15.55:0/2136216845 learned_addr learned my addr 172.21.15.55:0/2136216845 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f18827ee640 1 --2- 172.21.15.55:0/2136216845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd507d5b00 0x55fd50876f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f187bfff640 1 --2- 172.21.15.55:0/2136216845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd507d5ee0 0x55fd507a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1882fef640 1 -- 172.21.15.55:0/2136216845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd507d5ee0 msgr2=0x55fd507a7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1882fef640 1 --2- 172.21.15.55:0/2136216845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd507d5ee0 0x55fd507a7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1882fef640 1 -- 172.21.15.55:0/2136216845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd507d5b00 msgr2=0x55fd50876f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1882fef640 1 --2- 172.21.15.55:0/2136216845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd507d5b00 0x55fd50876f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f1882fef640 1 -- 172.21.15.55:0/2136216845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd506d2c50 con 0x55fd5087ee50 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.737+0000 7f187bfff640 1 --2- 172.21.15.55:0/2136216845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd507d5ee0 0x55fd507a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f1882fef640 1 --2- 172.21.15.55:0/2136216845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd5087ee50 0x55fd507a68e0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f187c054040 tx=0x7f187c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5be822425ad65bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f18817ec640 1 -- 172.21.15.55:0/2136216845 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c055040 con 0x55fd5087ee50 2024-04-25T08:59:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f18817ec640 1 -- 172.21.15.55:0/2136216845 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c051bc0 con 0x55fd5087ee50 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f18817ec640 1 -- 172.21.15.55:0/2136216845 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c065480 con 0x55fd5087ee50 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f1884cedf40 1 -- 172.21.15.55:0/2136216845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd5087ee50 msgr2=0x55fd507a68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f1884cedf40 1 --2- 172.21.15.55:0/2136216845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd5087ee50 0x55fd507a68e0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f187c054040 tx=0x7f187c050000 comp rx=0 tx=0).stop 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f1884cedf40 1 -- 172.21.15.55:0/2136216845 shutdown_connections 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f1884cedf40 1 --2- 172.21.15.55:0/2136216845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd5087ee50 0x55fd507a68e0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f1884cedf40 1 --2- 172.21.15.55:0/2136216845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd507d5ee0 0x55fd507a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f1884cedf40 1 --2- 172.21.15.55:0/2136216845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd507d5b00 0x55fd50876f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f1884cedf40 1 -- 172.21.15.55:0/2136216845 >> 172.21.15.55:0/2136216845 conn(0x55fd507d03d0 msgr2=0x55fd5087a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f1884cedf40 1 -- 172.21.15.55:0/2136216845 shutdown_connections 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.738+0000 7f1884cedf40 1 -- 172.21.15.55:0/2136216845 wait complete. 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.739+0000 7f1884cedf40 1 Processor -- start 2024-04-25T08:59:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.739+0000 7f1884cedf40 1 -- start start 2024-04-25T08:59:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f1884cedf40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd507d5b00 0x55fd50876150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f1884cedf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd507d5ee0 0x55fd507eb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f1884cedf40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd5087ee50 0x55fd50866a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f1884cedf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd5087dae0 con 0x55fd507d5ee0 2024-04-25T08:59:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f1884cedf40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd507d1d80 con 0x55fd507d5b00 2024-04-25T08:59:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f1884cedf40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd50878610 con 0x55fd5087ee50 2024-04-25T08:59:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f187bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd507d5ee0 0x55fd507eb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f187bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd507d5ee0 0x55fd507eb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38086/0 (socket says 172.21.15.55:38086) 2024-04-25T08:59:15.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f187bfff640 1 -- 172.21.15.55:0/2498705651 learned_addr learned my addr 172.21.15.55:0/2498705651 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:15.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f18827ee640 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd507d5b00 0x55fd50876150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f1882fef640 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd5087ee50 0x55fd50866a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f187bfff640 1 -- 172.21.15.55:0/2498705651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd5087ee50 msgr2=0x55fd50866a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f187bfff640 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd5087ee50 0x55fd50866a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f187bfff640 1 -- 172.21.15.55:0/2498705651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd507d5b00 msgr2=0x55fd50876150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f187bfff640 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd507d5b00 0x55fd50876150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f187bfff640 1 -- 172.21.15.55:0/2498705651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd507a82c0 con 0x55fd507d5ee0 2024-04-25T08:59:15.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f187bfff640 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd507d5ee0 0x55fd507eb740 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f186c00cef0 tx=0x7f186c00a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f187b7fe640 1 -- 172.21.15.55:0/2498705651 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c010470 con 0x55fd507d5ee0 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f187b7fe640 1 -- 172.21.15.55:0/2498705651 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c010610 con 0x55fd507d5ee0 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.740+0000 7f1884cedf40 1 -- 172.21.15.55:0/2498705651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fd5087bb40 con 0x55fd507d5ee0 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.741+0000 7f187b7fe640 1 -- 172.21.15.55:0/2498705651 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0109c0 con 0x55fd507d5ee0 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.741+0000 7f1884cedf40 1 -- 172.21.15.55:0/2498705651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd5087c100 con 0x55fd507d5ee0 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.742+0000 7f187b7fe640 1 -- 172.21.15.55:0/2498705651 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f186c00e040 con 0x55fd507d5ee0 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.742+0000 7f187b7fe640 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1864069eb0 0x7f186406c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.742+0000 7f187b7fe640 1 -- 172.21.15.55:0/2498705651 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f186c088c70 con 0x55fd507d5ee0 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.742+0000 7f18827ee640 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1864069eb0 0x7f186406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.743+0000 7f1884cedf40 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55fd50873460 0x55fd5087c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.743+0000 7f1884cedf40 1 -- 172.21.15.55:0/2498705651 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76) v9 -- 0x55fd507ebc80 con 0x55fd50873460 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.743+0000 7f18827ee640 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1864069eb0 0x7f186406c370 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1874005fd0 tx=0x7f1874005a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.743+0000 7f1882fef640 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55fd50873460 0x55fd5087c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.743+0000 7f1882fef640 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55fd50873460 0x55fd5087c620 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:15.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1882fef640 1 -- 172.21.15.55:0/2498705651 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v76'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f187c065480 con 0x55fd50873460 2024-04-25T08:59:15.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1884cedf40 1 -- 172.21.15.55:0/2498705651 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55fd50873460 msgr2=0x55fd5087c620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1884cedf40 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55fd50873460 0x55fd5087c620 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1884cedf40 1 -- 172.21.15.55:0/2498705651 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1864069eb0 msgr2=0x7f186406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1884cedf40 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1864069eb0 0x7f186406c370 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1874005fd0 tx=0x7f1874005a50 comp rx=0 tx=0).stop 2024-04-25T08:59:15.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1884cedf40 1 -- 172.21.15.55:0/2498705651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd507d5ee0 msgr2=0x55fd507eb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:15.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1884cedf40 1 --2- 172.21.15.55:0/2498705651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd507d5ee0 0x55fd507eb740 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f186c00cef0 tx=0x7f186c00a5a0 comp rx=0 tx=0).stop 2024-04-25T08:59:15.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1882fef640 1 -- 172.21.15.55:0/2498705651 reap_dead start 2024-04-25T08:59:15.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1884cedf40 1 -- 172.21.15.55:0/2498705651 shutdown_connections 2024-04-25T08:59:15.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1884cedf40 1 -- 172.21.15.55:0/2498705651 >> 172.21.15.55:0/2498705651 conn(0x55fd507d03d0 msgr2=0x55fd507a7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:15.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1884cedf40 1 -- 172.21.15.55:0/2498705651 shutdown_connections 2024-04-25T08:59:15.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:15.745+0000 7f1884cedf40 1 -- 172.21.15.55:0/2498705651 wait complete. 2024-04-25T08:59:15.738 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:59:15.738 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:59:15.817 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:59:15.855 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:59:15.855 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:59:15.855 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:15.872 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:59:15.873 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:15.928 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:16.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.082+0000 7f7c5a9fe640 1 Processor -- start 2024-04-25T08:59:16.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.082+0000 7f7c5a9fe640 1 -- start start 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c5a9fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5415dce0 0x7f7c540d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c5a9fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c540b5b60 0x7f7c540b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c5a9fe640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5415e0c0 con 0x7f7c540d35b0 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c5a9fe640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c540d2510 con 0x7f7c540b5b60 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c5a9fe640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540d27f0 con 0x7f7c5415dce0 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c537fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7c540d35b0 0x7f7c540b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42536/0 (socket says 172.21.15.55:42536) 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c537fe640 1 -- 172.21.15.55:0/611557995 learned_addr learned my addr 172.21.15.55:0/611557995 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c53fff640 1 --2- 172.21.15.55:0/611557995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5415dce0 0x7f7c540d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c58f9b640 1 --2- 172.21.15.55:0/611557995 >> v2:172.21.15.167:3300/0 conn(0x7f7c540b5b60 0x7f7c540b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c52ffd640 1 -- 172.21.15.55:0/611557995 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765864465 0 0) 0x7f7c5415e0c0 con 0x7f7c540d35b0 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c52ffd640 1 -- 172.21.15.55:0/611557995 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c40003520 con 0x7f7c540d35b0 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c53fff640 1 -- 172.21.15.55:0/611557995 >> v2:172.21.15.167:3300/0 conn(0x7f7c540b5b60 msgr2=0x7f7c540b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c53fff640 1 --2- 172.21.15.55:0/611557995 >> v2:172.21.15.167:3300/0 conn(0x7f7c540b5b60 0x7f7c540b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c53fff640 1 -- 172.21.15.55:0/611557995 >> v1:172.21.15.55:6789/0 conn(0x7f7c540d35b0 legacy=0x7f7c540b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c53fff640 1 -- 172.21.15.55:0/611557995 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540d2ad0 con 0x7f7c5415dce0 2024-04-25T08:59:16.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.083+0000 7f7c58f9b640 1 --2- 172.21.15.55:0/611557995 >> v2:172.21.15.167:3300/0 conn(0x7f7c540b5b60 0x7f7c540b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.084+0000 7f7c53fff640 1 --2- 172.21.15.55:0/611557995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5415dce0 0x7f7c540d1a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0097a0 tx=0x7f7c3c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db487ff57c75e11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.084+0000 7f7c52ffd640 1 -- 172.21.15.55:0/611557995 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c037070 con 0x7f7c5415dce0 2024-04-25T08:59:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.084+0000 7f7c52ffd640 1 -- 172.21.15.55:0/611557995 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c032440 con 0x7f7c5415dce0 2024-04-25T08:59:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.084+0000 7f7c52ffd640 1 -- 172.21.15.55:0/611557995 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0327f0 con 0x7f7c5415dce0 2024-04-25T08:59:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.085+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/611557995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5415dce0 msgr2=0x7f7c540d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.085+0000 7f7c5a9fe640 1 --2- 172.21.15.55:0/611557995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5415dce0 0x7f7c540d1a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0097a0 tx=0x7f7c3c02a180 comp rx=0 tx=0).stop 2024-04-25T08:59:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.085+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/611557995 shutdown_connections 2024-04-25T08:59:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.085+0000 7f7c5a9fe640 1 --2- 172.21.15.55:0/611557995 >> v2:172.21.15.167:3300/0 conn(0x7f7c540b5b60 0x7f7c540b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.085+0000 7f7c5a9fe640 1 --2- 172.21.15.55:0/611557995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5415dce0 0x7f7c540d1a50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.085+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/611557995 >> 172.21.15.55:0/611557995 conn(0x7f7c54072900 msgr2=0x7f7c540d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.085+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/611557995 shutdown_connections 2024-04-25T08:59:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.085+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/611557995 wait complete. 2024-04-25T08:59:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.086+0000 7f7c5a9fe640 1 Processor -- start 2024-04-25T08:59:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.086+0000 7f7c5a9fe640 1 -- start start 2024-04-25T08:59:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.087+0000 7f7c5a9fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c540b5b60 0x7f7c54160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.087+0000 7f7c5a9fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540d35b0 0x7f7c540c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.087+0000 7f7c5a9fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5415dce0 0x7f7c5414dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.087+0000 7f7c5a9fe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540b9820 con 0x7f7c540d35b0 2024-04-25T08:59:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.087+0000 7f7c5a9fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540d3090 con 0x7f7c540b5b60 2024-04-25T08:59:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.087+0000 7f7c5a9fe640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540b99a0 con 0x7f7c5415dce0 2024-04-25T08:59:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.087+0000 7f7c537fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540d35b0 0x7f7c540c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.087+0000 7f7c537fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540d35b0 0x7f7c540c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38102/0 (socket says 172.21.15.55:38102) 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.087+0000 7f7c537fe640 1 -- 172.21.15.55:0/64541186 learned_addr learned my addr 172.21.15.55:0/64541186 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.087+0000 7f7c53fff640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c540b5b60 0x7f7c54160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.087+0000 7f7c58f9b640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5415dce0 0x7f7c5414dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.088+0000 7f7c537fe640 1 -- 172.21.15.55:0/64541186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5415dce0 msgr2=0x7f7c5414dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.088+0000 7f7c537fe640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5415dce0 0x7f7c5414dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.088+0000 7f7c537fe640 1 -- 172.21.15.55:0/64541186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c540b5b60 msgr2=0x7f7c54160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.088+0000 7f7c537fe640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c540b5b60 0x7f7c54160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.088+0000 7f7c537fe640 1 -- 172.21.15.55:0/64541186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540c8cf0 con 0x7f7c540d35b0 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.088+0000 7f7c537fe640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540d35b0 0x7f7c540c9d90 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c500 tx=0x7f7c4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.088+0000 7f7c50ff9640 1 -- 172.21.15.55:0/64541186 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44017070 con 0x7f7c540d35b0 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.088+0000 7f7c50ff9640 1 -- 172.21.15.55:0/64541186 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c44005ce0 con 0x7f7c540d35b0 2024-04-25T08:59:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.088+0000 7f7c50ff9640 1 -- 172.21.15.55:0/64541186 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44007330 con 0x7f7c540d35b0 2024-04-25T08:59:16.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.088+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/64541186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c540c8fd0 con 0x7f7c540d35b0 2024-04-25T08:59:16.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.088+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/64541186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c540c9870 con 0x7f7c540d35b0 2024-04-25T08:59:16.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.089+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/64541186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c540c91a0 con 0x7f7c540d35b0 2024-04-25T08:59:16.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.089+0000 7f7c50ff9640 1 -- 172.21.15.55:0/64541186 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c4401a070 con 0x7f7c540d35b0 2024-04-25T08:59:16.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.090+0000 7f7c50ff9640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 0x7f7c3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.090+0000 7f7c50ff9640 1 -- 172.21.15.55:0/64541186 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7c440896c0 con 0x7f7c540d35b0 2024-04-25T08:59:16.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.090+0000 7f7c53fff640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 0x7f7c3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.091+0000 7f7c53fff640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 0x7f7c3406d990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c034000 tx=0x7f7c3c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.094+0000 7f7c50ff9640 1 -- 172.21.15.55:0/64541186 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c44058600 con 0x7f7c540d35b0 2024-04-25T08:59:16.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.277+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/64541186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c540749b0 con 0x7f7c540d35b0 2024-04-25T08:59:16.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.278+0000 7f7c50ff9640 1 -- 172.21.15.55:0/64541186 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16892 (secure 0 0 0) 0x7f7c44057f00 con 0x7f7c540d35b0 2024-04-25T08:59:16.268 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:16.268 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":76,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:58:24.676099+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:47.819814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:48.522459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.a","mappings":[{"from":6,"to":0}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/173615501":"2024-04-26T08:58:03.267866+0000","172.21.15.55:6835/173615501":"2024-04-26T08:58:03.267866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:16.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/64541186 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 msgr2=0x7f7c3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 0x7f7c3406d990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c034000 tx=0x7f7c3c02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:16.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/64541186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540d35b0 msgr2=0x7f7c540c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540d35b0 0x7f7c540c9d90 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c500 tx=0x7f7c4400c9c0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/64541186 shutdown_connections 2024-04-25T08:59:16.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 0x7f7c3406d990 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5415dce0 0x7f7c5414dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540d35b0 0x7f7c540c9d90 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 --2- 172.21.15.55:0/64541186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c540b5b60 0x7f7c54160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/64541186 >> 172.21.15.55:0/64541186 conn(0x7f7c54072900 msgr2=0x7f7c540b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:16.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/64541186 shutdown_connections 2024-04-25T08:59:16.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.281+0000 7f7c5a9fe640 1 -- 172.21.15.55:0/64541186 wait complete. 2024-04-25T08:59:16.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:57:47.819814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:57:48.522459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:59:16.281 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:59:16.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.397+0000 7f89cedcf640 1 Processor -- start 2024-04-25T08:59:16.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.397+0000 7f89cedcf640 1 -- start start 2024-04-25T08:59:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.397+0000 7f89cedcf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c815dc80 0x7f89c8161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.397+0000 7f89cedcf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89c80b97c0 0x7f89c80b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.397+0000 7f89cedcf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f89c80b5a30 0x7f89c806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.397+0000 7f89cedcf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c80b5ea0 con 0x7f89c80b97c0 2024-04-25T08:59:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.397+0000 7f89cedcf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c81627a0 con 0x7f89c80b5a30 2024-04-25T08:59:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.397+0000 7f89cedcf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c81621e0 con 0x7f89c815dc80 2024-04-25T08:59:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.398+0000 7f89c7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89c80b97c0 0x7f89c80b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.398+0000 7f89c7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89c80b97c0 0x7f89c80b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38114/0 (socket says 172.21.15.55:38114) 2024-04-25T08:59:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.398+0000 7f89c7fff640 1 -- 172.21.15.55:0/3641540028 learned_addr learned my addr 172.21.15.55:0/3641540028 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.398+0000 7f89c7fff640 1 -- 172.21.15.55:0/3641540028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c815dc80 msgr2=0x7f89c8161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.398+0000 7f89c7fff640 1 --2- 172.21.15.55:0/3641540028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c815dc80 0x7f89c8161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.398+0000 7f89c7fff640 1 -- 172.21.15.55:0/3641540028 >> v2:172.21.15.167:3300/0 conn(0x7f89c80b5a30 msgr2=0x7f89c806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.398+0000 7f89c7fff640 1 --2- 172.21.15.55:0/3641540028 >> v2:172.21.15.167:3300/0 conn(0x7f89c80b5a30 0x7f89c806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.398+0000 7f89c7fff640 1 -- 172.21.15.55:0/3641540028 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c81624c0 con 0x7f89c80b97c0 2024-04-25T08:59:16.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.399+0000 7f89c7fff640 1 --2- 172.21.15.55:0/3641540028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89c80b97c0 0x7f89c80b54f0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f89c80d16d0 tx=0x7f89b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5af86f096cd7eb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.399+0000 7f89c77fe640 1 -- 172.21.15.55:0/3641540028 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4037070 con 0x7f89c80b97c0 2024-04-25T08:59:16.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.399+0000 7f89c77fe640 1 -- 172.21.15.55:0/3641540028 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b4032440 con 0x7f89c80b97c0 2024-04-25T08:59:16.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.399+0000 7f89c77fe640 1 -- 172.21.15.55:0/3641540028 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4032810 con 0x7f89c80b97c0 2024-04-25T08:59:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.399+0000 7f89cedcf640 1 -- 172.21.15.55:0/3641540028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89c80b97c0 msgr2=0x7f89c80b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.399+0000 7f89cedcf640 1 --2- 172.21.15.55:0/3641540028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89c80b97c0 0x7f89c80b54f0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f89c80d16d0 tx=0x7f89b402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.400+0000 7f89cedcf640 1 -- 172.21.15.55:0/3641540028 shutdown_connections 2024-04-25T08:59:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.400+0000 7f89cedcf640 1 --2- 172.21.15.55:0/3641540028 >> v2:172.21.15.167:3300/0 conn(0x7f89c80b5a30 0x7f89c806bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.400+0000 7f89cedcf640 1 --2- 172.21.15.55:0/3641540028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89c80b97c0 0x7f89c80b54f0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.400+0000 7f89cedcf640 1 --2- 172.21.15.55:0/3641540028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c815dc80 0x7f89c8161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.400+0000 7f89cedcf640 1 -- 172.21.15.55:0/3641540028 >> 172.21.15.55:0/3641540028 conn(0x7f89c80d04f0 msgr2=0x7f89c80d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.400+0000 7f89cedcf640 1 -- 172.21.15.55:0/3641540028 shutdown_connections 2024-04-25T08:59:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.400+0000 7f89cedcf640 1 -- 172.21.15.55:0/3641540028 wait complete. 2024-04-25T08:59:16.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.401+0000 7f89cedcf640 1 Processor -- start 2024-04-25T08:59:16.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.401+0000 7f89cedcf640 1 -- start start 2024-04-25T08:59:16.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89cedcf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89c80b5a30 0x7f89c80cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89cedcf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c80b97c0 0x7f89c814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89cedcf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c815dc80 0x7f89c80ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89cedcf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c8161db0 con 0x7f89c80b5a30 2024-04-25T08:59:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89cedcf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c815e060 con 0x7f89c815dc80 2024-04-25T08:59:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89cedcf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c8161f30 con 0x7f89c80b97c0 2024-04-25T08:59:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89ccb6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89c80b5a30 0x7f89c80cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89ccb6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89c80b5a30 0x7f89c80cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38116/0 (socket says 172.21.15.55:38116) 2024-04-25T08:59:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89ccb6b640 1 -- 172.21.15.55:0/114600823 learned_addr learned my addr 172.21.15.55:0/114600823 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89c7fff640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c80b97c0 0x7f89c814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89cd36c640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c815dc80 0x7f89c80ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89ccb6b640 1 -- 172.21.15.55:0/114600823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c80b97c0 msgr2=0x7f89c814ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89ccb6b640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c80b97c0 0x7f89c814ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89ccb6b640 1 -- 172.21.15.55:0/114600823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c815dc80 msgr2=0x7f89c80ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89ccb6b640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c815dc80 0x7f89c80ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89ccb6b640 1 -- 172.21.15.55:0/114600823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c80cb770 con 0x7f89c80b5a30 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89c7fff640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c80b97c0 0x7f89c814ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89cd36c640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c815dc80 0x7f89c80ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89ccb6b640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89c80b5a30 0x7f89c80cb230 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00b410 tx=0x7f89bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89c57fa640 1 -- 172.21.15.55:0/114600823 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc015020 con 0x7f89c80b5a30 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89c57fa640 1 -- 172.21.15.55:0/114600823 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc011850 con 0x7f89c80b5a30 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89cedcf640 1 -- 172.21.15.55:0/114600823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c80c8110 con 0x7f89c80b5a30 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.402+0000 7f89c57fa640 1 -- 172.21.15.55:0/114600823 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc011c40 con 0x7f89c80b5a30 2024-04-25T08:59:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.403+0000 7f89cedcf640 1 -- 172.21.15.55:0/114600823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c80c86d0 con 0x7f89c80b5a30 2024-04-25T08:59:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.403+0000 7f89cedcf640 1 -- 172.21.15.55:0/114600823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c80750b0 con 0x7f89c80b5a30 2024-04-25T08:59:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.404+0000 7f89c57fa640 1 -- 172.21.15.55:0/114600823 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f89bc018020 con 0x7f89c80b5a30 2024-04-25T08:59:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.404+0000 7f89c57fa640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89ac06b4d0 0x7f89ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.404+0000 7f89c57fa640 1 -- 172.21.15.55:0/114600823 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f89bc08a1c0 con 0x7f89c80b5a30 2024-04-25T08:59:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.404+0000 7f89c7fff640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89ac06b4d0 0x7f89ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.405+0000 7f89c7fff640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89ac06b4d0 0x7f89ac06d990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f89b4034000 tx=0x7f89b402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.408+0000 7f89c57fa640 1 -- 172.21.15.55:0/114600823 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f89bc01f020 con 0x7f89c80b5a30 2024-04-25T08:59:16.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.589+0000 7f89cedcf640 1 -- 172.21.15.55:0/114600823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89c80b6c30 con 0x7f89c80b5a30 2024-04-25T08:59:16.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.590+0000 7f89c57fa640 1 -- 172.21.15.55:0/114600823 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89bc0172c0 con 0x7f89c80b5a30 2024-04-25T08:59:16.579 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.591+0000 7f89cedcf640 1 -- 172.21.15.55:0/114600823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89ac06b4d0 msgr2=0x7f89ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.591+0000 7f89cedcf640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89ac06b4d0 0x7f89ac06d990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f89b4034000 tx=0x7f89b402e000 comp rx=0 tx=0).stop 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.591+0000 7f89cedcf640 1 -- 172.21.15.55:0/114600823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89c80b5a30 msgr2=0x7f89c80cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.591+0000 7f89cedcf640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89c80b5a30 0x7f89c80cb230 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00b410 tx=0x7f89bc00b8d0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.592+0000 7f89cedcf640 1 -- 172.21.15.55:0/114600823 shutdown_connections 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.592+0000 7f89cedcf640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89ac06b4d0 0x7f89ac06d990 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.592+0000 7f89cedcf640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c815dc80 0x7f89c80ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.592+0000 7f89cedcf640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c80b97c0 0x7f89c814ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.592+0000 7f89cedcf640 1 --2- 172.21.15.55:0/114600823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89c80b5a30 0x7f89c80cb230 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.592+0000 7f89cedcf640 1 -- 172.21.15.55:0/114600823 >> 172.21.15.55:0/114600823 conn(0x7f89c80d04f0 msgr2=0x7f89c80d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.592+0000 7f89cedcf640 1 -- 172.21.15.55:0/114600823 shutdown_connections 2024-04-25T08:59:16.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.592+0000 7f89cedcf640 1 -- 172.21.15.55:0/114600823 wait complete. 2024-04-25T08:59:16.592 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:59:16.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.707+0000 7f198b0b3640 1 Processor -- start 2024-04-25T08:59:16.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.707+0000 7f198b0b3640 1 -- start start 2024-04-25T08:59:16.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.707+0000 7f198b0b3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f19840b97c0 0x7f19840b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f198b0b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19840b5a30 0x7f19840d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f198b0b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840b5e40 con 0x7f198415dc80 2024-04-25T08:59:16.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f198b0b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1984161f80 con 0x7f19840b5a30 2024-04-25T08:59:16.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f198b0b3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19841627a0 con 0x7f19840b97c0 2024-04-25T08:59:16.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f1989650640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19840b5a30 0x7f19840d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f1988e4f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f198415dc80 0x7f1984161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42552/0 (socket says 172.21.15.55:42552) 2024-04-25T08:59:16.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f1988e4f640 1 -- 172.21.15.55:0/2177012334 learned_addr learned my addr 172.21.15.55:0/2177012334 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:16.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f1983fff640 1 --2- 172.21.15.55:0/2177012334 >> v2:172.21.15.167:3300/0 conn(0x7f19840b97c0 0x7f19840b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f1989650640 1 -- 172.21.15.55:0/2177012334 >> v2:172.21.15.167:3300/0 conn(0x7f19840b97c0 msgr2=0x7f19840b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:16.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f1989650640 1 --2- 172.21.15.55:0/2177012334 >> v2:172.21.15.167:3300/0 conn(0x7f19840b97c0 0x7f19840b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f1989650640 1 -- 172.21.15.55:0/2177012334 >> v1:172.21.15.55:6789/0 conn(0x7f198415dc80 legacy=0x7f1984161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f19837fe640 1 -- 172.21.15.55:0/2177012334 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496104838 0 0) 0x7f1978001110 con 0x7f198415dc80 2024-04-25T08:59:16.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.708+0000 7f1989650640 1 -- 172.21.15.55:0/2177012334 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19841621e0 con 0x7f19840b5a30 2024-04-25T08:59:16.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.709+0000 7f1989650640 1 --2- 172.21.15.55:0/2177012334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19840b5a30 0x7f19840d2470 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f198406ba70 tx=0x7f197c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b72b462a1b05b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.709+0000 7f19837fe640 1 -- 172.21.15.55:0/2177012334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c007740 con 0x7f19840b5a30 2024-04-25T08:59:16.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.709+0000 7f19837fe640 1 -- 172.21.15.55:0/2177012334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c0078e0 con 0x7f19840b5a30 2024-04-25T08:59:16.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.709+0000 7f19837fe640 1 -- 172.21.15.55:0/2177012334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c007cb0 con 0x7f19840b5a30 2024-04-25T08:59:16.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.709+0000 7f198b0b3640 1 -- 172.21.15.55:0/2177012334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19840b5a30 msgr2=0x7f19840d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.709+0000 7f198b0b3640 1 --2- 172.21.15.55:0/2177012334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19840b5a30 0x7f19840d2470 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f198406ba70 tx=0x7f197c02a680 comp rx=0 tx=0).stop 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.709+0000 7f198b0b3640 1 -- 172.21.15.55:0/2177012334 shutdown_connections 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.709+0000 7f198b0b3640 1 --2- 172.21.15.55:0/2177012334 >> v2:172.21.15.167:3300/0 conn(0x7f19840b97c0 0x7f19840b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.709+0000 7f198b0b3640 1 --2- 172.21.15.55:0/2177012334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19840b5a30 0x7f19840d2470 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.709+0000 7f198b0b3640 1 -- 172.21.15.55:0/2177012334 >> 172.21.15.55:0/2177012334 conn(0x7f19840d04f0 msgr2=0x7f19840d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.710+0000 7f198b0b3640 1 -- 172.21.15.55:0/2177012334 shutdown_connections 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.710+0000 7f198b0b3640 1 -- 172.21.15.55:0/2177012334 wait complete. 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.711+0000 7f198b0b3640 1 Processor -- start 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.711+0000 7f198b0b3640 1 -- start start 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f198b0b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19840b5a30 0x7f198414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f198b0b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19840b97c0 0x7f19841601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f198b0b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f198415dc80 0x7f1984160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f198b0b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198415e060 con 0x7f19840b97c0 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f198b0b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19840d1c70 con 0x7f19840b5a30 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f198b0b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840d29b0 con 0x7f198415dc80 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f1983fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19840b97c0 0x7f19841601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f1983fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19840b97c0 0x7f19841601f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38134/0 (socket says 172.21.15.55:38134) 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f1983fff640 1 -- 172.21.15.55:0/2160132494 learned_addr learned my addr 172.21.15.55:0/2160132494 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f1989650640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f198415dc80 0x7f1984160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f1988e4f640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19840b5a30 0x7f198414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f1983fff640 1 -- 172.21.15.55:0/2160132494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f198415dc80 msgr2=0x7f1984160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f1983fff640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f198415dc80 0x7f1984160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f1983fff640 1 -- 172.21.15.55:0/2160132494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19840b5a30 msgr2=0x7f198414dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f1983fff640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19840b5a30 0x7f198414dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f1983fff640 1 -- 172.21.15.55:0/2160132494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19841f6f30 con 0x7f19840b97c0 2024-04-25T08:59:16.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f1983fff640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19840b97c0 0x7f19841601f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f197000c7f0 tx=0x7f197000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.712+0000 7f19817fa640 1 -- 172.21.15.55:0/2160132494 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970015070 con 0x7f19840b97c0 2024-04-25T08:59:16.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.713+0000 7f19817fa640 1 -- 172.21.15.55:0/2160132494 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1970004240 con 0x7f19840b97c0 2024-04-25T08:59:16.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.713+0000 7f198b0b3640 1 -- 172.21.15.55:0/2160132494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19841f7210 con 0x7f19840b97c0 2024-04-25T08:59:16.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.713+0000 7f19817fa640 1 -- 172.21.15.55:0/2160132494 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970007620 con 0x7f19840b97c0 2024-04-25T08:59:16.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.713+0000 7f198b0b3640 1 -- 172.21.15.55:0/2160132494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19841f77d0 con 0x7f19840b97c0 2024-04-25T08:59:16.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.713+0000 7f198b0b3640 1 -- 172.21.15.55:0/2160132494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19841f79d0 con 0x7f19840b97c0 2024-04-25T08:59:16.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.714+0000 7f19817fa640 1 -- 172.21.15.55:0/2160132494 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f19700079d0 con 0x7f19840b97c0 2024-04-25T08:59:16.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.714+0000 7f19817fa640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f196806b4d0 0x7f196806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:16.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.714+0000 7f19817fa640 1 -- 172.21.15.55:0/2160132494 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f197008a250 con 0x7f19840b97c0 2024-04-25T08:59:16.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.714+0000 7f1988e4f640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f196806b4d0 0x7f196806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:16.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.715+0000 7f1988e4f640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f196806b4d0 0x7f196806d990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1978007fd0 tx=0x7f1978007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:16.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.719+0000 7f19817fa640 1 -- 172.21.15.55:0/2160132494 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f19841f79d0 con 0x7f19840b97c0 2024-04-25T08:59:16.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.900+0000 7f198b0b3640 1 -- 172.21.15.55:0/2160132494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19840750b0 con 0x7f19840b97c0 2024-04-25T08:59:16.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.900+0000 7f19817fa640 1 -- 172.21.15.55:0/2160132494 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1970058a80 con 0x7f19840b97c0 2024-04-25T08:59:16.889 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.902+0000 7f198b0b3640 1 -- 172.21.15.55:0/2160132494 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f196806b4d0 msgr2=0x7f196806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.902+0000 7f198b0b3640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f196806b4d0 0x7f196806d990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1978007fd0 tx=0x7f1978007de0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.902+0000 7f198b0b3640 1 -- 172.21.15.55:0/2160132494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19840b97c0 msgr2=0x7f19841601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.902+0000 7f198b0b3640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19840b97c0 0x7f19841601f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f197000c7f0 tx=0x7f197000ccb0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.902+0000 7f198b0b3640 1 -- 172.21.15.55:0/2160132494 shutdown_connections 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.902+0000 7f198b0b3640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f196806b4d0 0x7f196806d990 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.902+0000 7f198b0b3640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f198415dc80 0x7f1984160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.902+0000 7f198b0b3640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19840b97c0 0x7f19841601f0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.902+0000 7f198b0b3640 1 --2- 172.21.15.55:0/2160132494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19840b5a30 0x7f198414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.902+0000 7f198b0b3640 1 -- 172.21.15.55:0/2160132494 >> 172.21.15.55:0/2160132494 conn(0x7f19840d04f0 msgr2=0x7f19840d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:16.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.903+0000 7f198b0b3640 1 -- 172.21.15.55:0/2160132494 shutdown_connections 2024-04-25T08:59:16.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:16.903+0000 7f198b0b3640 1 -- 172.21.15.55:0/2160132494 wait complete. 2024-04-25T08:59:16.902 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:59:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.017+0000 7f20f4fc8640 1 Processor -- start 2024-04-25T08:59:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.017+0000 7f20f4fc8640 1 -- start start 2024-04-25T08:59:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.018+0000 7f20f4fc8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20f00b97c0 0x7f20f00b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.018+0000 7f20f4fc8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f00b5e40 con 0x7f20f015dc80 2024-04-25T08:59:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.018+0000 7f20f4fc8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f01627a0 con 0x7f20f00b5a30 2024-04-25T08:59:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.018+0000 7f20f4fc8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f0161f80 con 0x7f20f00b97c0 2024-04-25T08:59:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.018+0000 7f20ee59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f20f015dc80 0x7f20f0161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42566/0 (socket says 172.21.15.55:42566) 2024-04-25T08:59:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.018+0000 7f20ee59c640 1 -- 172.21.15.55:0/2809888932 learned_addr learned my addr 172.21.15.55:0/2809888932 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.018+0000 7f20edd9b640 1 --2- 172.21.15.55:0/2809888932 >> v2:172.21.15.55:3300/0 conn(0x7f20f00b97c0 0x7f20f00b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.019+0000 7f20edd9b640 1 -- 172.21.15.55:0/2809888932 >> v1:172.21.15.167:6789/0 conn(0x7f20f00b5a30 legacy=0x7f20f00d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.019+0000 7f20edd9b640 1 -- 172.21.15.55:0/2809888932 >> v1:172.21.15.55:6789/0 conn(0x7f20f015dc80 legacy=0x7f20f0161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.019+0000 7f20edd9b640 1 -- 172.21.15.55:0/2809888932 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f01621e0 con 0x7f20f00b97c0 2024-04-25T08:59:17.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.019+0000 7f20edd9b640 1 --2- 172.21.15.55:0/2809888932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00b97c0 0x7f20f00b54f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f20d80097a0 tx=0x7f20d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bb43193d78cd55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.020+0000 7f20ed59a640 1 -- 172.21.15.55:0/2809888932 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8037070 con 0x7f20f00b97c0 2024-04-25T08:59:17.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.020+0000 7f20ed59a640 1 -- 172.21.15.55:0/2809888932 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d8032440 con 0x7f20f00b97c0 2024-04-25T08:59:17.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.020+0000 7f20ed59a640 1 -- 172.21.15.55:0/2809888932 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8032810 con 0x7f20f00b97c0 2024-04-25T08:59:17.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.020+0000 7f20f4fc8640 1 -- 172.21.15.55:0/2809888932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00b97c0 msgr2=0x7f20f00b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.020+0000 7f20f4fc8640 1 --2- 172.21.15.55:0/2809888932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00b97c0 0x7f20f00b54f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f20d80097a0 tx=0x7f20d802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.020+0000 7f20f4fc8640 1 -- 172.21.15.55:0/2809888932 shutdown_connections 2024-04-25T08:59:17.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.020+0000 7f20f4fc8640 1 --2- 172.21.15.55:0/2809888932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00b97c0 0x7f20f00b54f0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.020+0000 7f20f4fc8640 1 -- 172.21.15.55:0/2809888932 >> 172.21.15.55:0/2809888932 conn(0x7f20f00d04f0 msgr2=0x7f20f00d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:17.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.020+0000 7f20f4fc8640 1 -- 172.21.15.55:0/2809888932 shutdown_connections 2024-04-25T08:59:17.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.020+0000 7f20f4fc8640 1 -- 172.21.15.55:0/2809888932 wait complete. 2024-04-25T08:59:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.022+0000 7f20f4fc8640 1 Processor -- start 2024-04-25T08:59:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.022+0000 7f20f4fc8640 1 -- start start 2024-04-25T08:59:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.022+0000 7f20f4fc8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00b5a30 0x7f20f01f7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.022+0000 7f20f4fc8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20f00b97c0 0x7f20f01f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.022+0000 7f20f4fc8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20f015dc80 0x7f20f01f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.022+0000 7f20f4fc8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f015e060 con 0x7f20f00b5a30 2024-04-25T08:59:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.022+0000 7f20f4fc8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00d1c70 con 0x7f20f00b97c0 2024-04-25T08:59:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.022+0000 7f20f4fc8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00d2b80 con 0x7f20f015dc80 2024-04-25T08:59:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.022+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00b5a30 0x7f20f01f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00b5a30 0x7f20f01f7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38144/0 (socket says 172.21.15.55:38144) 2024-04-25T08:59:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20ee59c640 1 -- 172.21.15.55:0/563684138 learned_addr learned my addr 172.21.15.55:0/563684138 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20edd9b640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20f00b97c0 0x7f20f01f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20eed9d640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20f015dc80 0x7f20f01f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20ee59c640 1 -- 172.21.15.55:0/563684138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20f015dc80 msgr2=0x7f20f01f7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20ee59c640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20f015dc80 0x7f20f01f7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20ee59c640 1 -- 172.21.15.55:0/563684138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20f00b97c0 msgr2=0x7f20f01f7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20ee59c640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20f00b97c0 0x7f20f01f7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20ee59c640 1 -- 172.21.15.55:0/563684138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f00cd220 con 0x7f20f00b5a30 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20edd9b640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20f00b97c0 0x7f20f01f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20ee59c640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00b5a30 0x7f20f01f7410 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c3c0 tx=0x7f20e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20e6ffd640 1 -- 172.21.15.55:0/563684138 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8017070 con 0x7f20f00b5a30 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20e6ffd640 1 -- 172.21.15.55:0/563684138 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e8005ce0 con 0x7f20f00b5a30 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20f4fc8640 1 -- 172.21.15.55:0/563684138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f00cd500 con 0x7f20f00b5a30 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20e6ffd640 1 -- 172.21.15.55:0/563684138 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e80072f0 con 0x7f20f00b5a30 2024-04-25T08:59:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.023+0000 7f20f4fc8640 1 -- 172.21.15.55:0/563684138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f00cdac0 con 0x7f20f00b5a30 2024-04-25T08:59:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.024+0000 7f20f4fc8640 1 -- 172.21.15.55:0/563684138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f00750b0 con 0x7f20f00b5a30 2024-04-25T08:59:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.025+0000 7f20e6ffd640 1 -- 172.21.15.55:0/563684138 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f20e801a070 con 0x7f20f00b5a30 2024-04-25T08:59:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.025+0000 7f20e6ffd640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d006b4d0 0x7f20d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.025+0000 7f20e6ffd640 1 -- 172.21.15.55:0/563684138 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f20e80895e0 con 0x7f20f00b5a30 2024-04-25T08:59:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.025+0000 7f20edd9b640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d006b4d0 0x7f20d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.026+0000 7f20edd9b640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d006b4d0 0x7f20d006d990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f20d8034000 tx=0x7f20d802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.029+0000 7f20e6ffd640 1 -- 172.21.15.55:0/563684138 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20f00b5e40 con 0x7f20f00b5a30 2024-04-25T08:59:17.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.209+0000 7f20f4fc8640 1 -- 172.21.15.55:0/563684138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20f00cde10 con 0x7f20f00b5a30 2024-04-25T08:59:17.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.210+0000 7f20e6ffd640 1 -- 172.21.15.55:0/563684138 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20e8058460 con 0x7f20f00b5a30 2024-04-25T08:59:17.199 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:59:17.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 -- 172.21.15.55:0/563684138 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d006b4d0 msgr2=0x7f20d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d006b4d0 0x7f20d006d990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f20d8034000 tx=0x7f20d802e000 comp rx=0 tx=0).stop 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 -- 172.21.15.55:0/563684138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00b5a30 msgr2=0x7f20f01f7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00b5a30 0x7f20f01f7410 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c3c0 tx=0x7f20e800c880 comp rx=0 tx=0).stop 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 -- 172.21.15.55:0/563684138 shutdown_connections 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f20d006b4d0 0x7f20d006d990 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20f015dc80 0x7f20f01f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20f00b97c0 0x7f20f01f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 --2- 172.21.15.55:0/563684138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00b5a30 0x7f20f01f7410 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 -- 172.21.15.55:0/563684138 >> 172.21.15.55:0/563684138 conn(0x7f20f00d04f0 msgr2=0x7f20f01601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 -- 172.21.15.55:0/563684138 shutdown_connections 2024-04-25T08:59:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.212+0000 7f20f4fc8640 1 -- 172.21.15.55:0/563684138 wait complete. 2024-04-25T08:59:17.212 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:59:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.324+0000 7f3bae79e640 1 Processor -- start 2024-04-25T08:59:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.324+0000 7f3bae79e640 1 -- start start 2024-04-25T08:59:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.325+0000 7f3bae79e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba80b9720 0x7f3ba80ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.325+0000 7f3bae79e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3ba80cece0 0x7f3ba80d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.325+0000 7f3bae79e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba8161f80 con 0x7f3ba8161090 2024-04-25T08:59:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.325+0000 7f3bae79e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba80cf130 con 0x7f3ba80cece0 2024-04-25T08:59:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.325+0000 7f3bae79e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba80d21a0 con 0x7f3ba80b9720 2024-04-25T08:59:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.325+0000 7f3ba7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3ba8161090 0x7f3ba8161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42568/0 (socket says 172.21.15.55:42568) 2024-04-25T08:59:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.325+0000 7f3ba7fff640 1 -- 172.21.15.55:0/660015631 learned_addr learned my addr 172.21.15.55:0/660015631 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.325+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604435906 0 0) 0x7f3ba8161f80 con 0x7f3ba8161090 2024-04-25T08:59:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.325+0000 7f3ba77fe640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba80b9720 0x7f3ba80ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.325+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b90003520 con 0x7f3ba8161090 2024-04-25T08:59:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.325+0000 7f3bacd3b640 1 --2- 172.21.15.55:0/660015631 >> v2:172.21.15.167:3300/0 conn(0x7f3ba80cece0 0x7f3ba80d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2780058458 0 0) 0x7f3b90003520 con 0x7f3ba8161090 2024-04-25T08:59:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba80b9720 msgr2=0x7f3ba80ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba80b9720 0x7f3ba80ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 >> v2:172.21.15.167:3300/0 conn(0x7f3ba80cece0 msgr2=0x7f3ba80d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 --2- 172.21.15.55:0/660015631 >> v2:172.21.15.167:3300/0 conn(0x7f3ba80cece0 0x7f3ba80d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8162260 con 0x7f3ba8161090 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f3b98001670 con 0x7f3ba8161090 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 >> v1:172.21.15.55:6789/0 conn(0x7f3ba8161090 legacy=0x7f3ba8161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b900039b0 0x7f3b90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba80b9720 0x7f3b90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b90004d40 0x7f3b900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba80cf130 con 0x7f3b900039b0 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba80d21a0 con 0x7f3b90004d40 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9000b9c0 con 0x7f3ba80b9720 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba7fff640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b900039b0 0x7f3b90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba77fe640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba80b9720 0x7f3b90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3bacd3b640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b90004d40 0x7f3b900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba7fff640 1 -- 172.21.15.55:0/660015631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba80b9720 msgr2=0x7f3b90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba7fff640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba80b9720 0x7f3b90004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba7fff640 1 -- 172.21.15.55:0/660015631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b90004d40 msgr2=0x7f3b900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba7fff640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b90004d40 0x7f3b900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.326+0000 7f3ba7fff640 1 -- 172.21.15.55:0/660015631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90003520 con 0x7f3b900039b0 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.327+0000 7f3ba7fff640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b900039b0 0x7f3b90003dd0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3b98007fd0 tx=0x7f3b90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c45d7ec69d68e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.327+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98007d50 con 0x7f3b900039b0 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.327+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b98005ad0 con 0x7f3b900039b0 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.327+0000 7f3ba6ffd640 1 -- 172.21.15.55:0/660015631 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98007070 con 0x7f3b900039b0 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.328+0000 7f3bae79e640 1 -- 172.21.15.55:0/660015631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b900039b0 msgr2=0x7f3b90003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.328+0000 7f3bae79e640 1 --2- 172.21.15.55:0/660015631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b900039b0 0x7f3b90003dd0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3b98007fd0 tx=0x7f3b90005830 comp rx=0 tx=0).stop 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.328+0000 7f3bacd3b640 1 -- 172.21.15.55:0/660015631 reap_dead start 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.328+0000 7f3bae79e640 1 -- 172.21.15.55:0/660015631 shutdown_connections 2024-04-25T08:59:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.328+0000 7f3bae79e640 1 -- 172.21.15.55:0/660015631 >> 172.21.15.55:0/660015631 conn(0x7f3ba80b55e0 msgr2=0x7f3ba80b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.328+0000 7f3bae79e640 1 -- 172.21.15.55:0/660015631 shutdown_connections 2024-04-25T08:59:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.328+0000 7f3bae79e640 1 -- 172.21.15.55:0/660015631 wait complete. 2024-04-25T08:59:17.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.329+0000 7f3bae79e640 1 Processor -- start 2024-04-25T08:59:17.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.329+0000 7f3bae79e640 1 -- start start 2024-04-25T08:59:17.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bae79e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b900039b0 0x7f3ba80c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bae79e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba8153af0 0x7f3ba8153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bae79e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba81544b0 0x7f3ba80c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bae79e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba8161470 con 0x7f3ba81544b0 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bae79e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba80d1e30 con 0x7f3b900039b0 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bae79e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba80ce7a0 con 0x7f3ba8153af0 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bacd3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba81544b0 0x7f3ba80c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bacd3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba81544b0 0x7f3ba80c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38162/0 (socket says 172.21.15.55:38162) 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bacd3b640 1 -- 172.21.15.55:0/1631889665 learned_addr learned my addr 172.21.15.55:0/1631889665 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3ba7fff640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b900039b0 0x7f3ba80c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3ba77fe640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba8153af0 0x7f3ba8153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bacd3b640 1 -- 172.21.15.55:0/1631889665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba8153af0 msgr2=0x7f3ba8153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bacd3b640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba8153af0 0x7f3ba8153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bacd3b640 1 -- 172.21.15.55:0/1631889665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b900039b0 msgr2=0x7f3ba80c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bacd3b640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b900039b0 0x7f3ba80c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.330+0000 7f3bacd3b640 1 -- 172.21.15.55:0/1631889665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8154930 con 0x7f3ba81544b0 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.331+0000 7f3bacd3b640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba81544b0 0x7f3ba80c8440 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80c73f0 tx=0x7f3ba00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.331+0000 7f3ba4ff9640 1 -- 172.21.15.55:0/1631889665 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0011de0 con 0x7f3ba81544b0 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.331+0000 7f3ba4ff9640 1 -- 172.21.15.55:0/1631889665 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba001b070 con 0x7f3ba81544b0 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.331+0000 7f3bae79e640 1 -- 172.21.15.55:0/1631889665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba80cdb40 con 0x7f3ba81544b0 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.331+0000 7f3ba4ff9640 1 -- 172.21.15.55:0/1631889665 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0003990 con 0x7f3ba81544b0 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.331+0000 7f3bae79e640 1 -- 172.21.15.55:0/1631889665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba80c7c40 con 0x7f3ba81544b0 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.332+0000 7f3bae79e640 1 -- 172.21.15.55:0/1631889665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba80750b0 con 0x7f3ba81544b0 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.332+0000 7f3ba4ff9640 1 -- 172.21.15.55:0/1631889665 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3ba0005d10 con 0x7f3ba81544b0 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.333+0000 7f3ba4ff9640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b9406b500 0x7f3b9406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.333+0000 7f3ba4ff9640 1 -- 172.21.15.55:0/1631889665 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3ba008a3f0 con 0x7f3ba81544b0 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.333+0000 7f3ba7fff640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b9406b500 0x7f3b9406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.333+0000 7f3ba7fff640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b9406b500 0x7f3b9406d9c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3b98033000 tx=0x7f3b98009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.337+0000 7f3ba4ff9640 1 -- 172.21.15.55:0/1631889665 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ba0059270 con 0x7f3ba81544b0 2024-04-25T08:59:17.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.530+0000 7f3bae79e640 1 -- 172.21.15.55:0/1631889665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ba80d4370 con 0x7f3ba81544b0 2024-04-25T08:59:17.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.530+0000 7f3ba4ff9640 1 -- 172.21.15.55:0/1631889665 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v76) v1 ==== 80+0+120 (secure 0 0 0) 0x7f3ba0058b70 con 0x7f3ba81544b0 2024-04-25T08:59:17.520 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/173615501 2024-04-26T08:58:03.267866+0000 2024-04-25T08:59:17.520 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/173615501 2024-04-26T08:58:03.267866+0000 2024-04-25T08:59:17.520 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-04-25T08:59:17.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 -- 172.21.15.55:0/1631889665 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b9406b500 msgr2=0x7f3b9406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b9406b500 0x7f3b9406d9c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3b98033000 tx=0x7f3b98009030 comp rx=0 tx=0).stop 2024-04-25T08:59:17.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 -- 172.21.15.55:0/1631889665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba81544b0 msgr2=0x7f3ba80c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba81544b0 0x7f3ba80c8440 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80c73f0 tx=0x7f3ba00115a0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 -- 172.21.15.55:0/1631889665 shutdown_connections 2024-04-25T08:59:17.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3b9406b500 0x7f3b9406d9c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba81544b0 0x7f3ba80c8440 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ba8153af0 0x7f3ba8153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 --2- 172.21.15.55:0/1631889665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b900039b0 0x7f3ba80c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 -- 172.21.15.55:0/1631889665 >> 172.21.15.55:0/1631889665 conn(0x7f3ba80b55e0 msgr2=0x7f3ba80b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 -- 172.21.15.55:0/1631889665 shutdown_connections 2024-04-25T08:59:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.533+0000 7f3bae79e640 1 -- 172.21.15.55:0/1631889665 wait complete. 2024-04-25T08:59:17.533 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:59:17.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:17.533 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:17.560 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:59:17.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:17.560 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:59:17.615 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:59:17.615 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:17.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:59:17.635 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:59:17.635 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:17.671 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:59:17.671 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:59:17.671 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:17.691 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:59:17.692 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:17.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.823+0000 7fa5ec2cb640 1 Processor -- start 2024-04-25T08:59:17.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.823+0000 7fa5ec2cb640 1 -- start start 2024-04-25T08:59:17.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.824+0000 7fa5ec2cb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa5e415dce0 0x7fa5e40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.824+0000 7fa5ec2cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5e40d35b0 0x7fa5e40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.824+0000 7fa5ec2cb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e415e0c0 con 0x7fa5e40d1f90 2024-04-25T08:59:17.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.824+0000 7fa5ec2cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40b7b10 con 0x7fa5e40d35b0 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.824+0000 7fa5ec2cb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40d2510 con 0x7fa5e415dce0 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.824+0000 7fa5e9866640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5e40d35b0 0x7fa5e40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.824+0000 7fa5e9866640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5e40d35b0 0x7fa5e40b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38172/0 (socket says 172.21.15.55:38172) 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.824+0000 7fa5e9866640 1 -- 172.21.15.55:0/1006939111 learned_addr learned my addr 172.21.15.55:0/1006939111 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.825+0000 7fa5ea067640 1 --2- 172.21.15.55:0/1006939111 >> v2:172.21.15.167:3300/0 conn(0x7fa5e415dce0 0x7fa5e40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.825+0000 7fa5e9866640 1 -- 172.21.15.55:0/1006939111 >> v2:172.21.15.167:3300/0 conn(0x7fa5e415dce0 msgr2=0x7fa5e40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.825+0000 7fa5e9866640 1 --2- 172.21.15.55:0/1006939111 >> v2:172.21.15.167:3300/0 conn(0x7fa5e415dce0 0x7fa5e40d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.825+0000 7fa5e9866640 1 -- 172.21.15.55:0/1006939111 >> v1:172.21.15.167:6789/0 conn(0x7fa5e40d1f90 legacy=0x7fa5e406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.825+0000 7fa5e9866640 1 -- 172.21.15.55:0/1006939111 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40d27f0 con 0x7fa5e40d35b0 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.825+0000 7fa5ea067640 1 --2- 172.21.15.55:0/1006939111 >> v2:172.21.15.167:3300/0 conn(0x7fa5e415dce0 0x7fa5e40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.825+0000 7fa5e9866640 1 --2- 172.21.15.55:0/1006939111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e40d35b0 0x7fa5e40b5450 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40ce220 tx=0x7fa5d802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268a91718c7bca24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.826+0000 7fa5e9065640 1 -- 172.21.15.55:0/1006939111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8037070 con 0x7fa5e40d35b0 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.826+0000 7fa5e9065640 1 -- 172.21.15.55:0/1006939111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d8032440 con 0x7fa5e40d35b0 2024-04-25T08:59:17.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.826+0000 7fa5e9065640 1 -- 172.21.15.55:0/1006939111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8032810 con 0x7fa5e40d35b0 2024-04-25T08:59:17.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.826+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/1006939111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e40d35b0 msgr2=0x7fa5e40b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.826+0000 7fa5ec2cb640 1 --2- 172.21.15.55:0/1006939111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e40d35b0 0x7fa5e40b5450 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40ce220 tx=0x7fa5d802a230 comp rx=0 tx=0).stop 2024-04-25T08:59:17.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.826+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/1006939111 shutdown_connections 2024-04-25T08:59:17.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.826+0000 7fa5ec2cb640 1 --2- 172.21.15.55:0/1006939111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e40d35b0 0x7fa5e40b5450 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.826+0000 7fa5ec2cb640 1 --2- 172.21.15.55:0/1006939111 >> v2:172.21.15.167:3300/0 conn(0x7fa5e415dce0 0x7fa5e40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.826+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/1006939111 >> 172.21.15.55:0/1006939111 conn(0x7fa5e4072900 msgr2=0x7fa5e40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:17.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.826+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/1006939111 shutdown_connections 2024-04-25T08:59:17.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.826+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/1006939111 wait complete. 2024-04-25T08:59:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.827+0000 7fa5ec2cb640 1 Processor -- start 2024-04-25T08:59:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.827+0000 7fa5ec2cb640 1 -- start start 2024-04-25T08:59:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.828+0000 7fa5ec2cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e40d1f90 0x7fa5e40aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.828+0000 7fa5ec2cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5e40d35b0 0x7fa5e40aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.828+0000 7fa5ec2cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5e415dce0 0x7fa5e41f7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.828+0000 7fa5ec2cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40d3090 con 0x7fa5e40d1f90 2024-04-25T08:59:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.828+0000 7fa5ec2cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40d2db0 con 0x7fa5e415dce0 2024-04-25T08:59:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.828+0000 7fa5ec2cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40b9820 con 0x7fa5e40d35b0 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.828+0000 7fa5ea067640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e40d1f90 0x7fa5e40aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.828+0000 7fa5ea067640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e40d1f90 0x7fa5e40aa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38180/0 (socket says 172.21.15.55:38180) 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.828+0000 7fa5ea067640 1 -- 172.21.15.55:0/2284612278 learned_addr learned my addr 172.21.15.55:0/2284612278 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.828+0000 7fa5e9866640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5e40d35b0 0x7fa5e40aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.828+0000 7fa5ea868640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5e415dce0 0x7fa5e41f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.829+0000 7fa5ea067640 1 -- 172.21.15.55:0/2284612278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5e40d35b0 msgr2=0x7fa5e40aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.829+0000 7fa5ea067640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5e40d35b0 0x7fa5e40aa8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.829+0000 7fa5ea067640 1 -- 172.21.15.55:0/2284612278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5e415dce0 msgr2=0x7fa5e41f7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.829+0000 7fa5ea067640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5e415dce0 0x7fa5e41f7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.829+0000 7fa5ea067640 1 -- 172.21.15.55:0/2284612278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40c7e20 con 0x7fa5e40d1f90 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.829+0000 7fa5ea067640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e40d1f90 0x7fa5e40aa3b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00c7f0 tx=0x7fa5dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.829+0000 7fa5e2ffd640 1 -- 172.21.15.55:0/2284612278 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc015070 con 0x7fa5e40d1f90 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.829+0000 7fa5e2ffd640 1 -- 172.21.15.55:0/2284612278 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc007820 con 0x7fa5e40d1f90 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.829+0000 7fa5e2ffd640 1 -- 172.21.15.55:0/2284612278 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc007bd0 con 0x7fa5e40d1f90 2024-04-25T08:59:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.829+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/2284612278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e40c8100 con 0x7fa5e40d1f90 2024-04-25T08:59:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.829+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/2284612278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e40c86c0 con 0x7fa5e40d1f90 2024-04-25T08:59:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.830+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/2284612278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e4067490 con 0x7fa5e40d1f90 2024-04-25T08:59:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.830+0000 7fa5e2ffd640 1 -- 172.21.15.55:0/2284612278 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa5dc018070 con 0x7fa5e40d1f90 2024-04-25T08:59:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.831+0000 7fa5e2ffd640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d006b4d0 0x7fa5d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.831+0000 7fa5e2ffd640 1 -- 172.21.15.55:0/2284612278 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa5dc08a370 con 0x7fa5e40d1f90 2024-04-25T08:59:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.831+0000 7fa5e9866640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d006b4d0 0x7fa5d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.831+0000 7fa5e9866640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d006b4d0 0x7fa5d006d990 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8034000 tx=0x7fa5d802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:17.835+0000 7fa5e2ffd640 1 -- 172.21.15.55:0/2284612278 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5e4067490 con 0x7fa5e40d1f90 2024-04-25T08:59:18.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.059+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/2284612278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5e40b9310 con 0x7fa5e40d1f90 2024-04-25T08:59:18.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.059+0000 7fa5e2ffd640 1 -- 172.21.15.55:0/2284612278 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4942 (secure 0 0 0) 0x7fa5dc059e20 con 0x7fa5e40d1f90 2024-04-25T08:59:18.049 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:18.049 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:58:50.293987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6852},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6852":{"gid":6852,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":15,"addr":"172.21.15.55:6837/2486130786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2486130786},{"type":"v1","addr":"172.21.15.55:6837","nonce":2486130786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:59:18.049 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 44 2024-04-25T08:59:18.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.061+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/2284612278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d006b4d0 msgr2=0x7fa5d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.061+0000 7fa5ec2cb640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d006b4d0 0x7fa5d006d990 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8034000 tx=0x7fa5d802e000 comp rx=0 tx=0).stop 2024-04-25T08:59:18.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.061+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/2284612278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e40d1f90 msgr2=0x7fa5e40aa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.061+0000 7fa5ec2cb640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e40d1f90 0x7fa5e40aa3b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00c7f0 tx=0x7fa5dc00ccb0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.061+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/2284612278 shutdown_connections 2024-04-25T08:59:18.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.061+0000 7fa5ec2cb640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d006b4d0 0x7fa5d006d990 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.061+0000 7fa5ec2cb640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5e415dce0 0x7fa5e41f7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.061+0000 7fa5ec2cb640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5e40d35b0 0x7fa5e40aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.061+0000 7fa5ec2cb640 1 --2- 172.21.15.55:0/2284612278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e40d1f90 0x7fa5e40aa3b0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.062+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/2284612278 >> 172.21.15.55:0/2284612278 conn(0x7fa5e4072900 msgr2=0x7fa5e40d3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:18.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.062+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/2284612278 shutdown_connections 2024-04-25T08:59:18.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.062+0000 7fa5ec2cb640 1 -- 172.21.15.55:0/2284612278 wait complete. 2024-04-25T08:59:18.062 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:18.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.174+0000 7f4f67102640 1 Processor -- start 2024-04-25T08:59:18.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.174+0000 7f4f67102640 1 -- start start 2024-04-25T08:59:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f67102640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4f6015dce0 0x7f4f600d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f67102640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6015e0c0 con 0x7f4f600b5b60 2024-04-25T08:59:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f67102640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f600d2510 con 0x7f4f600d35b0 2024-04-25T08:59:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f67102640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f600d27f0 con 0x7f4f6015dce0 2024-04-25T08:59:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f6569f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4f600b5b60 0x7f4f600b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42578/0 (socket says 172.21.15.55:42578) 2024-04-25T08:59:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f6569f640 1 -- 172.21.15.55:0/3681864693 learned_addr learned my addr 172.21.15.55:0/3681864693 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f64e9e640 1 --2- 172.21.15.55:0/3681864693 >> v2:172.21.15.167:3300/0 conn(0x7f4f6015dce0 0x7f4f600d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508369747 0 0) 0x7f4f6015e0c0 con 0x7f4f600b5b60 2024-04-25T08:59:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f50003520 con 0x7f4f600b5b60 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 931456768 0 0) 0x7f4f50003520 con 0x7f4f600b5b60 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 >> v2:172.21.15.167:3300/0 conn(0x7f4f6015dce0 msgr2=0x7f4f600d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f5f7fe640 1 --2- 172.21.15.55:0/3681864693 >> v2:172.21.15.167:3300/0 conn(0x7f4f6015dce0 0x7f4f600d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 >> v1:172.21.15.167:6789/0 conn(0x7f4f600d35b0 legacy=0x7f4f600b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f600d2ad0 con 0x7f4f600b5b60 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f4f580019f0 con 0x7f4f600b5b60 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f64e9e640 1 --2- 172.21.15.55:0/3681864693 >> v2:172.21.15.167:3300/0 conn(0x7f4f6015dce0 0x7f4f600d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 >> v1:172.21.15.55:6789/0 conn(0x7f4f600b5b60 legacy=0x7f4f600b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f5f7fe640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f500039b0 0x7f4f50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.175+0000 7f4f5f7fe640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f50004800 0x7f4f50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f5f7fe640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f500051c0 0x7f4f5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600d27f0 con 0x7f4f500051c0 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5000c060 con 0x7f4f50004800 2024-04-25T08:59:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5000c260 con 0x7f4f500039b0 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f6569f640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f500051c0 0x7f4f5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f5ffff640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f50004800 0x7f4f50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f64e9e640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f500039b0 0x7f4f50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f6569f640 1 -- 172.21.15.55:0/3681864693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f500039b0 msgr2=0x7f4f50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f6569f640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f500039b0 0x7f4f50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f6569f640 1 -- 172.21.15.55:0/3681864693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f50004800 msgr2=0x7f4f50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f6569f640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f50004800 0x7f4f50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f6569f640 1 -- 172.21.15.55:0/3681864693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f50003520 con 0x7f4f500051c0 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.176+0000 7f4f5ffff640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f50004800 0x7f4f50004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f6569f640 1 -- 172.21.15.55:0/3681864693 reap_dead start 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f6569f640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f500051c0 0x7f4f5000b9c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800a860 tx=0x7f4f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67826a93283db9e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5800a480 con 0x7f4f500051c0 2024-04-25T08:59:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5802f070 con 0x7f4f500051c0 2024-04-25T08:59:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f5f7fe640 1 -- 172.21.15.55:0/3681864693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5802bca0 con 0x7f4f500051c0 2024-04-25T08:59:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f67102640 1 -- 172.21.15.55:0/3681864693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f500051c0 msgr2=0x7f4f5000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f67102640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f500051c0 0x7f4f5000b9c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800a860 tx=0x7f4f50005830 comp rx=0 tx=0).stop 2024-04-25T08:59:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f67102640 1 -- 172.21.15.55:0/3681864693 shutdown_connections 2024-04-25T08:59:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f67102640 1 --2- 172.21.15.55:0/3681864693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f500051c0 0x7f4f5000b9c0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f67102640 1 -- 172.21.15.55:0/3681864693 >> 172.21.15.55:0/3681864693 conn(0x7f4f60072900 msgr2=0x7f4f600d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f67102640 1 -- 172.21.15.55:0/3681864693 shutdown_connections 2024-04-25T08:59:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.177+0000 7f4f67102640 1 -- 172.21.15.55:0/3681864693 wait complete. 2024-04-25T08:59:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.178+0000 7f4f67102640 1 Processor -- start 2024-04-25T08:59:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.178+0000 7f4f67102640 1 -- start start 2024-04-25T08:59:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.179+0000 7f4f67102640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f500051c0 0x7f4f60155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.179+0000 7f4f67102640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f601495d0 0x7f4f60145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.179+0000 7f4f67102640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f60145fc0 0x7f4f60146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.179+0000 7f4f67102640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600b9820 con 0x7f4f601495d0 2024-04-25T08:59:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.179+0000 7f4f67102640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600d3090 con 0x7f4f60145fc0 2024-04-25T08:59:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.179+0000 7f4f67102640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600b99a0 con 0x7f4f500051c0 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.179+0000 7f4f5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f601495d0 0x7f4f60145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.179+0000 7f4f5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f601495d0 0x7f4f60145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38204/0 (socket says 172.21.15.55:38204) 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.179+0000 7f4f5ffff640 1 -- 172.21.15.55:0/1262590510 learned_addr learned my addr 172.21.15.55:0/1262590510 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f6569f640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f60145fc0 0x7f4f60146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f64e9e640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f500051c0 0x7f4f60155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f5ffff640 1 -- 172.21.15.55:0/1262590510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f500051c0 msgr2=0x7f4f60155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f5ffff640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f500051c0 0x7f4f60155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f5ffff640 1 -- 172.21.15.55:0/1262590510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f60145fc0 msgr2=0x7f4f60146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f5ffff640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f60145fc0 0x7f4f60146470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f5ffff640 1 -- 172.21.15.55:0/1262590510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f60153b80 con 0x7f4f601495d0 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f5ffff640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f601495d0 0x7f4f60145a80 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c000c00 tx=0x7f4f4c00e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f5d7fa640 1 -- 172.21.15.55:0/1262590510 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c019070 con 0x7f4f601495d0 2024-04-25T08:59:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f5d7fa640 1 -- 172.21.15.55:0/1262590510 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c0052e0 con 0x7f4f601495d0 2024-04-25T08:59:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f67102640 1 -- 172.21.15.55:0/1262590510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f60155f50 con 0x7f4f601495d0 2024-04-25T08:59:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f5d7fa640 1 -- 172.21.15.55:0/1262590510 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c005490 con 0x7f4f601495d0 2024-04-25T08:59:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.180+0000 7f4f67102640 1 -- 172.21.15.55:0/1262590510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f60155c50 con 0x7f4f601495d0 2024-04-25T08:59:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.181+0000 7f4f67102640 1 -- 172.21.15.55:0/1262590510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f600749b0 con 0x7f4f601495d0 2024-04-25T08:59:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.182+0000 7f4f5d7fa640 1 -- 172.21.15.55:0/1262590510 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4f4c01c070 con 0x7f4f601495d0 2024-04-25T08:59:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.182+0000 7f4f5d7fa640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f4406b500 0x7f4f4406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.182+0000 7f4f5d7fa640 1 -- 172.21.15.55:0/1262590510 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4f4c089710 con 0x7f4f601495d0 2024-04-25T08:59:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.182+0000 7f4f64e9e640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f4406b500 0x7f4f4406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.183+0000 7f4f64e9e640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f4406b500 0x7f4f4406d9c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009af0 tx=0x7f4f54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.187+0000 7f4f5d7fa640 1 -- 172.21.15.55:0/1262590510 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4f4c057eb0 con 0x7f4f601495d0 2024-04-25T08:59:18.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.369+0000 7f4f67102640 1 -- 172.21.15.55:0/1262590510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f600b3770 con 0x7f4f601495d0 2024-04-25T08:59:18.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.370+0000 7f4f5d7fa640 1 -- 172.21.15.55:0/1262590510 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16892 (secure 0 0 0) 0x7f4f4c05bf50 con 0x7f4f601495d0 2024-04-25T08:59:18.359 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:18.359 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":76,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:58:24.676099+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:47.819814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:48.522459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.a","mappings":[{"from":6,"to":0}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/173615501":"2024-04-26T08:58:03.267866+0000","172.21.15.55:6835/173615501":"2024-04-26T08:58:03.267866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:18.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 -- 172.21.15.55:0/1262590510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f4406b500 msgr2=0x7f4f4406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f4406b500 0x7f4f4406d9c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009af0 tx=0x7f4f54008040 comp rx=0 tx=0).stop 2024-04-25T08:59:18.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 -- 172.21.15.55:0/1262590510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f601495d0 msgr2=0x7f4f60145a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f601495d0 0x7f4f60145a80 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c000c00 tx=0x7f4f4c00e910 comp rx=0 tx=0).stop 2024-04-25T08:59:18.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 -- 172.21.15.55:0/1262590510 shutdown_connections 2024-04-25T08:59:18.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f4406b500 0x7f4f4406d9c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f60145fc0 0x7f4f60146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f601495d0 0x7f4f60145a80 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 --2- 172.21.15.55:0/1262590510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f500051c0 0x7f4f60155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 -- 172.21.15.55:0/1262590510 >> 172.21.15.55:0/1262590510 conn(0x7f4f60072900 msgr2=0x7f4f600b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 -- 172.21.15.55:0/1262590510 shutdown_connections 2024-04-25T08:59:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.372+0000 7f4f67102640 1 -- 172.21.15.55:0/1262590510 wait complete. 2024-04-25T08:59:18.372 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:57:47.819814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:57:48.522459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:59:18.372 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:59:18.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.488+0000 7f63cea5a640 1 Processor -- start 2024-04-25T08:59:18.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.488+0000 7f63cea5a640 1 -- start start 2024-04-25T08:59:18.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.489+0000 7f63cea5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f63c815dca0 0x7f63c80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.489+0000 7f63cea5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d3b90 0x7f63c80d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.489+0000 7f63cea5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c80d4090 con 0x7f63c80cee80 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.489+0000 7f63cea5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c80b6b20 con 0x7f63c815dca0 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.489+0000 7f63cea5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80d4370 con 0x7f63c80d3b90 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.489+0000 7f63c7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f63c815dca0 0x7f63c80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.489+0000 7f63c77fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d3b90 0x7f63c80d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.489+0000 7f63c7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f63c815dca0 0x7f63c80ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:37240/0 (socket says 172.21.15.55:37240) 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.489+0000 7f63c7fff640 1 -- 172.21.15.55:0/2742433762 learned_addr learned my addr 172.21.15.55:0/2742433762 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.489+0000 7f63ccff7640 1 --1- 172.21.15.55:0/2742433762 >> v1:172.21.15.167:6789/0 conn(0x7f63c80cee80 0x7f63c80b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:48290/0 (socket says 172.21.15.55:48290) 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.490+0000 7f63c77fe640 1 -- 172.21.15.55:0/2742433762 >> v2:172.21.15.167:3300/0 conn(0x7f63c815dca0 msgr2=0x7f63c80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.490+0000 7f63c77fe640 1 --2- 172.21.15.55:0/2742433762 >> v2:172.21.15.167:3300/0 conn(0x7f63c815dca0 0x7f63c80ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.490+0000 7f63c77fe640 1 -- 172.21.15.55:0/2742433762 >> v1:172.21.15.167:6789/0 conn(0x7f63c80cee80 legacy=0x7f63c80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.490+0000 7f63c6ffd640 1 -- 172.21.15.55:0/2742433762 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644663814 0 0) 0x7f63c80d4090 con 0x7f63c80cee80 2024-04-25T08:59:18.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.490+0000 7f63c77fe640 1 -- 172.21.15.55:0/2742433762 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c80d4650 con 0x7f63c80d3b90 2024-04-25T08:59:18.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.490+0000 7f63c77fe640 1 --2- 172.21.15.55:0/2742433762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d3b90 0x7f63c80d0a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f63b80097a0 tx=0x7f63b802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d79cdcad9878fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.491+0000 7f63c6ffd640 1 -- 172.21.15.55:0/2742433762 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8037070 con 0x7f63c80d3b90 2024-04-25T08:59:18.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.491+0000 7f63c6ffd640 1 -- 172.21.15.55:0/2742433762 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8032440 con 0x7f63c80d3b90 2024-04-25T08:59:18.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.491+0000 7f63c6ffd640 1 -- 172.21.15.55:0/2742433762 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8032810 con 0x7f63c80d3b90 2024-04-25T08:59:18.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.491+0000 7f63cea5a640 1 -- 172.21.15.55:0/2742433762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d3b90 msgr2=0x7f63c80d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.491+0000 7f63cea5a640 1 --2- 172.21.15.55:0/2742433762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d3b90 0x7f63c80d0a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f63b80097a0 tx=0x7f63b802a180 comp rx=0 tx=0).stop 2024-04-25T08:59:18.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.491+0000 7f63cea5a640 1 -- 172.21.15.55:0/2742433762 shutdown_connections 2024-04-25T08:59:18.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.491+0000 7f63cea5a640 1 --2- 172.21.15.55:0/2742433762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d3b90 0x7f63c80d0a20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.491+0000 7f63cea5a640 1 --2- 172.21.15.55:0/2742433762 >> v2:172.21.15.167:3300/0 conn(0x7f63c815dca0 0x7f63c80ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.491+0000 7f63cea5a640 1 -- 172.21.15.55:0/2742433762 >> 172.21.15.55:0/2742433762 conn(0x7f63c80726c0 msgr2=0x7f63c8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:18.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.491+0000 7f63cea5a640 1 -- 172.21.15.55:0/2742433762 shutdown_connections 2024-04-25T08:59:18.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.491+0000 7f63cea5a640 1 -- 172.21.15.55:0/2742433762 wait complete. 2024-04-25T08:59:18.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.492+0000 7f63cea5a640 1 Processor -- start 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.493+0000 7f63cea5a640 1 -- start start 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.493+0000 7f63cea5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63c80cee80 0x7f63c815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.493+0000 7f63cea5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c80d3b90 0x7f63c80c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.493+0000 7f63cea5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c815dca0 0x7f63c80ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.493+0000 7f63cea5a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c815e200 con 0x7f63c80cee80 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.493+0000 7f63cea5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c815e080 con 0x7f63c80d3b90 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.493+0000 7f63cea5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80d0f60 con 0x7f63c815dca0 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.493+0000 7f63c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63c80cee80 0x7f63c815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.493+0000 7f63c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63c80cee80 0x7f63c815a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38218/0 (socket says 172.21.15.55:38218) 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.493+0000 7f63c7fff640 1 -- 172.21.15.55:0/2196636395 learned_addr learned my addr 172.21.15.55:0/2196636395 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63ccff7640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c815dca0 0x7f63c80ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63c77fe640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c80d3b90 0x7f63c80c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63c7fff640 1 -- 172.21.15.55:0/2196636395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c815dca0 msgr2=0x7f63c80ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63c7fff640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c815dca0 0x7f63c80ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63c7fff640 1 -- 172.21.15.55:0/2196636395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c80d3b90 msgr2=0x7f63c80c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63c7fff640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c80d3b90 0x7f63c80c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63c7fff640 1 -- 172.21.15.55:0/2196636395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c8157ad0 con 0x7f63c80cee80 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63c77fe640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c80d3b90 0x7f63c80c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63c7fff640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63c80cee80 0x7f63c815a4f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00e840 tx=0x7f63bc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63c4ff9640 1 -- 172.21.15.55:0/2196636395 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc017070 con 0x7f63c80cee80 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63c4ff9640 1 -- 172.21.15.55:0/2196636395 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc00c8e0 con 0x7f63c80cee80 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63cea5a640 1 -- 172.21.15.55:0/2196636395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c8157d90 con 0x7f63c80cee80 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63c4ff9640 1 -- 172.21.15.55:0/2196636395 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc00ccd0 con 0x7f63c80cee80 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.494+0000 7f63cea5a640 1 -- 172.21.15.55:0/2196636395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c8158350 con 0x7f63c80cee80 2024-04-25T08:59:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.495+0000 7f63cea5a640 1 -- 172.21.15.55:0/2196636395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c80d2d10 con 0x7f63c80cee80 2024-04-25T08:59:18.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.496+0000 7f63c4ff9640 1 -- 172.21.15.55:0/2196636395 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f63bc01a070 con 0x7f63c80cee80 2024-04-25T08:59:18.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.496+0000 7f63c4ff9640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f63b406b4d0 0x7f63b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.496+0000 7f63c4ff9640 1 -- 172.21.15.55:0/2196636395 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f63bc08a180 con 0x7f63c80cee80 2024-04-25T08:59:18.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.496+0000 7f63c77fe640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f63b406b4d0 0x7f63b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.497+0000 7f63c77fe640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f63b406b4d0 0x7f63b406d990 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f63b8034000 tx=0x7f63b802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.500+0000 7f63c4ff9640 1 -- 172.21.15.55:0/2196636395 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f63c80d2d10 con 0x7f63c80cee80 2024-04-25T08:59:18.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.682+0000 7f63cea5a640 1 -- 172.21.15.55:0/2196636395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63c80750b0 con 0x7f63c80cee80 2024-04-25T08:59:18.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.682+0000 7f63c4ff9640 1 -- 172.21.15.55:0/2196636395 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63bc058f70 con 0x7f63c80cee80 2024-04-25T08:59:18.671 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:59:18.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 -- 172.21.15.55:0/2196636395 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f63b406b4d0 msgr2=0x7f63b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f63b406b4d0 0x7f63b406d990 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f63b8034000 tx=0x7f63b802e000 comp rx=0 tx=0).stop 2024-04-25T08:59:18.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 -- 172.21.15.55:0/2196636395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63c80cee80 msgr2=0x7f63c815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63c80cee80 0x7f63c815a4f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00e840 tx=0x7f63bc00ed00 comp rx=0 tx=0).stop 2024-04-25T08:59:18.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 -- 172.21.15.55:0/2196636395 shutdown_connections 2024-04-25T08:59:18.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f63b406b4d0 0x7f63b406d990 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c815dca0 0x7f63c80ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c80d3b90 0x7f63c80c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 --2- 172.21.15.55:0/2196636395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63c80cee80 0x7f63c815a4f0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 -- 172.21.15.55:0/2196636395 >> 172.21.15.55:0/2196636395 conn(0x7f63c80726c0 msgr2=0x7f63c80b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:18.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 -- 172.21.15.55:0/2196636395 shutdown_connections 2024-04-25T08:59:18.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.684+0000 7f63cea5a640 1 -- 172.21.15.55:0/2196636395 wait complete. 2024-04-25T08:59:18.684 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:59:18.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.798+0000 7fe9bb7b7640 1 Processor -- start 2024-04-25T08:59:18.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.799+0000 7fe9bb7b7640 1 -- start start 2024-04-25T08:59:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.799+0000 7fe9bb7b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9b415dca0 0x7fe9b40ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.799+0000 7fe9bb7b7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b40d4090 con 0x7fe9b40d1130 2024-04-25T08:59:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.799+0000 7fe9bb7b7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b40d4370 con 0x7fe9b40d3b90 2024-04-25T08:59:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.799+0000 7fe9bb7b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b40b6b20 con 0x7fe9b415dca0 2024-04-25T08:59:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9b9d54640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe9b40d1130 0x7fe9b40b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32904/0 (socket says 172.21.15.55:32904) 2024-04-25T08:59:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9b9d54640 1 -- 172.21.15.55:0/2361093632 learned_addr learned my addr 172.21.15.55:0/2361093632 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214500783 0 0) 0x7fe9b40d4090 con 0x7fe9b40d1130 2024-04-25T08:59:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9a0003520 con 0x7fe9b40d1130 2024-04-25T08:59:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9b9553640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9b415dca0 0x7fe9b40ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1746224357 0 0) 0x7fe9a0003520 con 0x7fe9b40d1130 2024-04-25T08:59:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9b415dca0 msgr2=0x7fe9b40ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9b415dca0 0x7fe9b40ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 >> v1:172.21.15.167:6789/0 conn(0x7fe9b40d3b90 legacy=0x7fe9b40d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b40d4650 con 0x7fe9b40d1130 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fe9ac0019f0 con 0x7fe9b40d1130 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 >> v1:172.21.15.55:6789/0 conn(0x7fe9b40d1130 legacy=0x7fe9b40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a00039e0 0x7fe9a0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9a0004800 0x7fe9a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a00051c0 0x7fe9a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a000c090 con 0x7fe9a00039e0 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a000c210 con 0x7fe9a00051c0 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a000c410 con 0x7fe9a0004800 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9b9553640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9b415dca0 0x7fe9b40ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.800+0000 7fe9b9553640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a00039e0 0x7fe9a0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.801+0000 7fe9b9d54640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a00051c0 0x7fe9a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.801+0000 7fe9b8d52640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9a0004800 0x7fe9a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.801+0000 7fe9b9553640 1 -- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9a0004800 msgr2=0x7fe9a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.801+0000 7fe9b9553640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9a0004800 0x7fe9a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.801+0000 7fe9b9553640 1 -- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a00051c0 msgr2=0x7fe9a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.801+0000 7fe9b9553640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a00051c0 0x7fe9a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.801+0000 7fe9b9553640 1 -- 172.21.15.55:0/2361093632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a0003520 con 0x7fe9a00039e0 2024-04-25T08:59:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.801+0000 7fe9b9553640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a00039e0 0x7fe9a0003e00 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006fd0 tx=0x7fe9a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4911d43f3ef0810 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.802+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0037070 con 0x7fe9a00039e0 2024-04-25T08:59:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.802+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b002aae0 con 0x7fe9a00039e0 2024-04-25T08:59:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.802+0000 7fe9abfff640 1 -- 172.21.15.55:0/2361093632 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b000f040 con 0x7fe9a00039e0 2024-04-25T08:59:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.802+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2361093632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a00039e0 msgr2=0x7fe9a0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.802+0000 7fe9bb7b7640 1 --2- 172.21.15.55:0/2361093632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a00039e0 0x7fe9a0003e00 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006fd0 tx=0x7fe9a0005830 comp rx=0 tx=0).stop 2024-04-25T08:59:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.802+0000 7fe9b9d54640 1 -- 172.21.15.55:0/2361093632 reap_dead start 2024-04-25T08:59:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.802+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2361093632 shutdown_connections 2024-04-25T08:59:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.802+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2361093632 >> 172.21.15.55:0/2361093632 conn(0x7fe9b40726c0 msgr2=0x7fe9b4072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.802+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2361093632 shutdown_connections 2024-04-25T08:59:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.802+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2361093632 wait complete. 2024-04-25T08:59:18.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.803+0000 7fe9bb7b7640 1 Processor -- start 2024-04-25T08:59:18.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.804+0000 7fe9bb7b7640 1 -- start start 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.804+0000 7fe9bb7b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a00039e0 0x7fe9b4156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.804+0000 7fe9bb7b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9b4159e10 0x7fe9b40ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.804+0000 7fe9bb7b7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b415a290 0x7fe9b40adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.804+0000 7fe9bb7b7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b415e200 con 0x7fe9b415a290 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.804+0000 7fe9bb7b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b415e080 con 0x7fe9a00039e0 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.804+0000 7fe9bb7b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b40b8280 con 0x7fe9b4159e10 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.804+0000 7fe9b9d54640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b415a290 0x7fe9b40adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.804+0000 7fe9b9d54640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b415a290 0x7fe9b40adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41358/0 (socket says 172.21.15.55:41358) 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.804+0000 7fe9b9d54640 1 -- 172.21.15.55:0/2734144514 learned_addr learned my addr 172.21.15.55:0/2734144514 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9b9553640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a00039e0 0x7fe9b4156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9b8d52640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9b4159e10 0x7fe9b40ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9b9d54640 1 -- 172.21.15.55:0/2734144514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9b4159e10 msgr2=0x7fe9b40ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9b9d54640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9b4159e10 0x7fe9b40ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9b9d54640 1 -- 172.21.15.55:0/2734144514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a00039e0 msgr2=0x7fe9b4156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9b9d54640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a00039e0 0x7fe9b4156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9b9d54640 1 -- 172.21.15.55:0/2734144514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b40aad10 con 0x7fe9b415a290 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9b9553640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a00039e0 0x7fe9b4156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9b9d54640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b415a290 0x7fe9b40adba0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40b9640 tx=0x7fe9ac007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9a9ffb640 1 -- 172.21.15.55:0/2734144514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac017020 con 0x7fe9b415a290 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9a9ffb640 1 -- 172.21.15.55:0/2734144514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac00ab80 con 0x7fe9b415a290 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2734144514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b40aaff0 con 0x7fe9b415a290 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9a9ffb640 1 -- 172.21.15.55:0/2734144514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0133f0 con 0x7fe9b415a290 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.805+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2734144514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b40ab5b0 con 0x7fe9b415a290 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.806+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2734144514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b40750b0 con 0x7fe9b415a290 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.806+0000 7fe9a9ffb640 1 -- 172.21.15.55:0/2734144514 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe9ac01a020 con 0x7fe9b415a290 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.807+0000 7fe9a9ffb640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe99806b500 0x7fe99806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.807+0000 7fe9a9ffb640 1 -- 172.21.15.55:0/2734144514 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe9ac08a990 con 0x7fe9b415a290 2024-04-25T08:59:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.807+0000 7fe9b9553640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe99806b500 0x7fe99806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.807+0000 7fe9b9553640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe99806b500 0x7fe99806d9c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006fd0 tx=0x7fe9b002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.811+0000 7fe9a9ffb640 1 -- 172.21.15.55:0/2734144514 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe9ac021020 con 0x7fe9b415a290 2024-04-25T08:59:18.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.991+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2734144514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9b415d4d0 con 0x7fe9b415a290 2024-04-25T08:59:18.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.991+0000 7fe9a9ffb640 1 -- 172.21.15.55:0/2734144514 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe9ac059810 con 0x7fe9b415a290 2024-04-25T08:59:18.981 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2734144514 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe99806b500 msgr2=0x7fe99806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe99806b500 0x7fe99806d9c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006fd0 tx=0x7fe9b002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2734144514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b415a290 msgr2=0x7fe9b40adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b415a290 0x7fe9b40adba0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40b9640 tx=0x7fe9ac007b00 comp rx=0 tx=0).stop 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2734144514 shutdown_connections 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe99806b500 0x7fe99806d9c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b415a290 0x7fe9b40adba0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9b4159e10 0x7fe9b40ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 --2- 172.21.15.55:0/2734144514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a00039e0 0x7fe9b4156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2734144514 >> 172.21.15.55:0/2734144514 conn(0x7fe9b40726c0 msgr2=0x7fe9b40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2734144514 shutdown_connections 2024-04-25T08:59:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:18.993+0000 7fe9bb7b7640 1 -- 172.21.15.55:0/2734144514 wait complete. 2024-04-25T08:59:18.993 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:59:19.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.109+0000 7f62ccdb0640 1 Processor -- start 2024-04-25T08:59:19.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.109+0000 7f62ccdb0640 1 -- start start 2024-04-25T08:59:19.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62ccdb0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f62c815dc80 0x7f62c8161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62ccdb0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62c80b97c0 0x7f62c80b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62ccdb0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c80b5e40 con 0x7f62c80b5a30 2024-04-25T08:59:19.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62ccdb0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c81627a0 con 0x7f62c80b97c0 2024-04-25T08:59:19.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62ccdb0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c81621e0 con 0x7f62c815dc80 2024-04-25T08:59:19.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62bffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62c80b97c0 0x7f62c80b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62bffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62c80b97c0 0x7f62c80b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41360/0 (socket says 172.21.15.55:41360) 2024-04-25T08:59:19.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62bffff640 1 -- 172.21.15.55:0/1697631128 learned_addr learned my addr 172.21.15.55:0/1697631128 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62c659c640 1 --2- 172.21.15.55:0/1697631128 >> v2:172.21.15.167:3300/0 conn(0x7f62c815dc80 0x7f62c8161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62bffff640 1 -- 172.21.15.55:0/1697631128 >> v2:172.21.15.167:3300/0 conn(0x7f62c815dc80 msgr2=0x7f62c8161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62bffff640 1 --2- 172.21.15.55:0/1697631128 >> v2:172.21.15.167:3300/0 conn(0x7f62c815dc80 0x7f62c8161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62bffff640 1 -- 172.21.15.55:0/1697631128 >> v1:172.21.15.167:6789/0 conn(0x7f62c80b5a30 legacy=0x7f62c806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.110+0000 7f62bffff640 1 -- 172.21.15.55:0/1697631128 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c81624c0 con 0x7f62c80b97c0 2024-04-25T08:59:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.111+0000 7f62bffff640 1 --2- 172.21.15.55:0/1697631128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c80b97c0 0x7f62c80b54f0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f62c806dab0 tx=0x7f62b002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ced3c41026d8a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.111+0000 7f62c5d9b640 1 -- 172.21.15.55:0/1697631128 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0037070 con 0x7f62c80b97c0 2024-04-25T08:59:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.111+0000 7f62c5d9b640 1 -- 172.21.15.55:0/1697631128 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0032440 con 0x7f62c80b97c0 2024-04-25T08:59:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.111+0000 7f62c5d9b640 1 -- 172.21.15.55:0/1697631128 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0032810 con 0x7f62c80b97c0 2024-04-25T08:59:19.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.112+0000 7f62ccdb0640 1 -- 172.21.15.55:0/1697631128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c80b97c0 msgr2=0x7f62c80b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.112+0000 7f62ccdb0640 1 --2- 172.21.15.55:0/1697631128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c80b97c0 0x7f62c80b54f0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f62c806dab0 tx=0x7f62b002a230 comp rx=0 tx=0).stop 2024-04-25T08:59:19.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.112+0000 7f62ccdb0640 1 -- 172.21.15.55:0/1697631128 shutdown_connections 2024-04-25T08:59:19.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.112+0000 7f62ccdb0640 1 --2- 172.21.15.55:0/1697631128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c80b97c0 0x7f62c80b54f0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.112+0000 7f62ccdb0640 1 --2- 172.21.15.55:0/1697631128 >> v2:172.21.15.167:3300/0 conn(0x7f62c815dc80 0x7f62c8161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.112+0000 7f62ccdb0640 1 -- 172.21.15.55:0/1697631128 >> 172.21.15.55:0/1697631128 conn(0x7f62c80d04f0 msgr2=0x7f62c80d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.112+0000 7f62ccdb0640 1 -- 172.21.15.55:0/1697631128 shutdown_connections 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.112+0000 7f62ccdb0640 1 -- 172.21.15.55:0/1697631128 wait complete. 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.113+0000 7f62ccdb0640 1 Processor -- start 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.113+0000 7f62ccdb0640 1 -- start start 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62ccdb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62c80b5a30 0x7f62c80cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62ccdb0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c80b97c0 0x7f62c80cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62ccdb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62c815dc80 0x7f62c814c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62ccdb0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8161db0 con 0x7f62c80b97c0 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62ccdb0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c815e060 con 0x7f62c815dc80 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62ccdb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8161f30 con 0x7f62c80b5a30 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c80b97c0 0x7f62c80cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c80b97c0 0x7f62c80cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41368/0 (socket says 172.21.15.55:41368) 2024-04-25T08:59:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62bffff640 1 -- 172.21.15.55:0/2424721969 learned_addr learned my addr 172.21.15.55:0/2424721969 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62c659c640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62c80b5a30 0x7f62c80cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62c6d9d640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62c815dc80 0x7f62c814c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62bffff640 1 -- 172.21.15.55:0/2424721969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62c80b5a30 msgr2=0x7f62c80cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62bffff640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62c80b5a30 0x7f62c80cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62bffff640 1 -- 172.21.15.55:0/2424721969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62c815dc80 msgr2=0x7f62c814c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62bffff640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62c815dc80 0x7f62c814c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62bffff640 1 -- 172.21.15.55:0/2424721969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c80cba70 con 0x7f62c80b97c0 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62c6d9d640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62c815dc80 0x7f62c814c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62c659c640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62c80b5a30 0x7f62c80cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.114+0000 7f62bffff640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c80b97c0 0x7f62c80cd290 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f62b0000c00 tx=0x7f62b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.115+0000 7f62beffd640 1 -- 172.21.15.55:0/2424721969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0041020 con 0x7f62c80b97c0 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.115+0000 7f62beffd640 1 -- 172.21.15.55:0/2424721969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b00306c0 con 0x7f62c80b97c0 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.115+0000 7f62ccdb0640 1 -- 172.21.15.55:0/2424721969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c815fd50 con 0x7f62c80b97c0 2024-04-25T08:59:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.115+0000 7f62beffd640 1 -- 172.21.15.55:0/2424721969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0037040 con 0x7f62c80b97c0 2024-04-25T08:59:19.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.115+0000 7f62ccdb0640 1 -- 172.21.15.55:0/2424721969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c8160310 con 0x7f62c80b97c0 2024-04-25T08:59:19.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.116+0000 7f62ccdb0640 1 -- 172.21.15.55:0/2424721969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c80750b0 con 0x7f62c80b97c0 2024-04-25T08:59:19.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.116+0000 7f62beffd640 1 -- 172.21.15.55:0/2424721969 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f62b0044020 con 0x7f62c80b97c0 2024-04-25T08:59:19.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.117+0000 7f62beffd640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62a806b4d0 0x7f62a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.117+0000 7f62beffd640 1 -- 172.21.15.55:0/2424721969 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f62b00aaa30 con 0x7f62c80b97c0 2024-04-25T08:59:19.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.117+0000 7f62c659c640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62a806b4d0 0x7f62a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.117+0000 7f62c659c640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62a806b4d0 0x7f62a806d990 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006fd0 tx=0x7f62b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.121+0000 7f62beffd640 1 -- 172.21.15.55:0/2424721969 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f62b004b030 con 0x7f62c80b97c0 2024-04-25T08:59:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.306+0000 7f62ccdb0640 1 -- 172.21.15.55:0/2424721969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f62c80d0a50 con 0x7f62c80b97c0 2024-04-25T08:59:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.306+0000 7f62beffd640 1 -- 172.21.15.55:0/2424721969 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f62c80b5e40 con 0x7f62c80b97c0 2024-04-25T08:59:19.296 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:59:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 -- 172.21.15.55:0/2424721969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62a806b4d0 msgr2=0x7f62a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62a806b4d0 0x7f62a806d990 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006fd0 tx=0x7f62b8008040 comp rx=0 tx=0).stop 2024-04-25T08:59:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 -- 172.21.15.55:0/2424721969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c80b97c0 msgr2=0x7f62c80cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c80b97c0 0x7f62c80cd290 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f62b0000c00 tx=0x7f62b00046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 -- 172.21.15.55:0/2424721969 shutdown_connections 2024-04-25T08:59:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62a806b4d0 0x7f62a806d990 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62c815dc80 0x7f62c814c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c80b97c0 0x7f62c80cd290 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 --2- 172.21.15.55:0/2424721969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62c80b5a30 0x7f62c80cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 -- 172.21.15.55:0/2424721969 >> 172.21.15.55:0/2424721969 conn(0x7f62c80d04f0 msgr2=0x7f62c80cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 -- 172.21.15.55:0/2424721969 shutdown_connections 2024-04-25T08:59:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.309+0000 7f62ccdb0640 1 -- 172.21.15.55:0/2424721969 wait complete. 2024-04-25T08:59:19.309 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:19.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.420+0000 7f29d44ac640 1 Processor -- start 2024-04-25T08:59:19.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.421+0000 7f29d44ac640 1 -- start start 2024-04-25T08:59:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.421+0000 7f29d44ac640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f29cc15f120 0x7f29cc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.421+0000 7f29d44ac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29cc0ce830 0x7f29cc0cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.421+0000 7f29d44ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29cc0cfbe0 0x7f29cc099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.421+0000 7f29d44ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc0d09f0 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.421+0000 7f29d44ac640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc0cec70 con 0x7f29cc15f120 2024-04-25T08:59:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.421+0000 7f29d44ac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0d0430 con 0x7f29cc0ce830 2024-04-25T08:59:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d2a49640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29cc0cfbe0 0x7f29cc099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d2a49640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29cc0cfbe0 0x7f29cc099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41384/0 (socket says 172.21.15.55:41384) 2024-04-25T08:59:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d2a49640 1 -- 172.21.15.55:0/162754217 learned_addr learned my addr 172.21.15.55:0/162754217 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d1a47640 1 --2- 172.21.15.55:0/162754217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29cc0ce830 0x7f29cc0cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d2248640 1 --2- 172.21.15.55:0/162754217 >> v2:172.21.15.167:3300/0 conn(0x7f29cc15f120 0x7f29cc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d2a49640 1 -- 172.21.15.55:0/162754217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29cc0ce830 msgr2=0x7f29cc0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d2a49640 1 --2- 172.21.15.55:0/162754217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29cc0ce830 0x7f29cc0cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d2a49640 1 -- 172.21.15.55:0/162754217 >> v2:172.21.15.167:3300/0 conn(0x7f29cc15f120 msgr2=0x7f29cc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d2a49640 1 --2- 172.21.15.55:0/162754217 >> v2:172.21.15.167:3300/0 conn(0x7f29cc15f120 0x7f29cc0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d2a49640 1 -- 172.21.15.55:0/162754217 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc0d0710 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d1a47640 1 --2- 172.21.15.55:0/162754217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29cc0ce830 0x7f29cc0cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.422+0000 7f29d2248640 1 --2- 172.21.15.55:0/162754217 >> v2:172.21.15.167:3300/0 conn(0x7f29cc15f120 0x7f29cc0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.423+0000 7f29d2a49640 1 --2- 172.21.15.55:0/162754217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0cfbe0 0x7f29cc099a40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f29cc09b000 tx=0x7f29bc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad5968e4dcc441f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.423+0000 7f29d1246640 1 -- 172.21.15.55:0/162754217 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc036070 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.423+0000 7f29d1246640 1 -- 172.21.15.55:0/162754217 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc031600 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.423+0000 7f29d1246640 1 -- 172.21.15.55:0/162754217 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0319d0 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.423+0000 7f29d44ac640 1 -- 172.21.15.55:0/162754217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0cfbe0 msgr2=0x7f29cc099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.423+0000 7f29d44ac640 1 --2- 172.21.15.55:0/162754217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0cfbe0 0x7f29cc099a40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f29cc09b000 tx=0x7f29bc02a730 comp rx=0 tx=0).stop 2024-04-25T08:59:19.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.423+0000 7f29d44ac640 1 -- 172.21.15.55:0/162754217 shutdown_connections 2024-04-25T08:59:19.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.423+0000 7f29d44ac640 1 --2- 172.21.15.55:0/162754217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0cfbe0 0x7f29cc099a40 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.423+0000 7f29d44ac640 1 --2- 172.21.15.55:0/162754217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29cc0ce830 0x7f29cc0cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.423+0000 7f29d44ac640 1 --2- 172.21.15.55:0/162754217 >> v2:172.21.15.167:3300/0 conn(0x7f29cc15f120 0x7f29cc0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.423+0000 7f29d44ac640 1 -- 172.21.15.55:0/162754217 >> 172.21.15.55:0/162754217 conn(0x7f29cc0d1900 msgr2=0x7f29cc0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.424+0000 7f29d44ac640 1 -- 172.21.15.55:0/162754217 shutdown_connections 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.424+0000 7f29d44ac640 1 -- 172.21.15.55:0/162754217 wait complete. 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.425+0000 7f29d44ac640 1 Processor -- start 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.425+0000 7f29d44ac640 1 -- start start 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.425+0000 7f29d44ac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29cc0ce830 0x7f29cc0b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.425+0000 7f29d44ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0cfbe0 0x7f29cc0b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.425+0000 7f29d44ac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29cc15f120 0x7f29cc0ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.425+0000 7f29d44ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0cc480 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.425+0000 7f29d44ac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0ccab0 con 0x7f29cc0ce830 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.425+0000 7f29d44ac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c5450 con 0x7f29cc15f120 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d1a47640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0cfbe0 0x7f29cc0b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d1a47640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0cfbe0 0x7f29cc0b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41390/0 (socket says 172.21.15.55:41390) 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d1a47640 1 -- 172.21.15.55:0/1238587280 learned_addr learned my addr 172.21.15.55:0/1238587280 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:19.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d2a49640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29cc15f120 0x7f29cc0ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d2248640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29cc0ce830 0x7f29cc0b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d1a47640 1 -- 172.21.15.55:0/1238587280 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29cc15f120 msgr2=0x7f29cc0ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d1a47640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29cc15f120 0x7f29cc0ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d1a47640 1 -- 172.21.15.55:0/1238587280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29cc0ce830 msgr2=0x7f29cc0b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d1a47640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29cc0ce830 0x7f29cc0b0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d1a47640 1 -- 172.21.15.55:0/1238587280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc0ae9c0 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d1a47640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0cfbe0 0x7f29cc0b6e30 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f29c000c7c0 tx=0x7f29c000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29caffd640 1 -- 172.21.15.55:0/1238587280 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0015070 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29caffd640 1 -- 172.21.15.55:0/1238587280 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c0007a30 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d44ac640 1 -- 172.21.15.55:0/1238587280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc0c5820 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29caffd640 1 -- 172.21.15.55:0/1238587280 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0007e00 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.426+0000 7f29d44ac640 1 -- 172.21.15.55:0/1238587280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc0c5de0 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.427+0000 7f29d44ac640 1 -- 172.21.15.55:0/1238587280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29cc067850 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.428+0000 7f29caffd640 1 -- 172.21.15.55:0/1238587280 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f29c0018070 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.428+0000 7f29caffd640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f29b806b4d0 0x7f29b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.428+0000 7f29caffd640 1 -- 172.21.15.55:0/1238587280 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f29c008a040 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.428+0000 7f29d2248640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f29b806b4d0 0x7f29b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.429+0000 7f29d2248640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f29b806b4d0 0x7f29b806d990 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f29c400aac0 tx=0x7f29c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.432+0000 7f29caffd640 1 -- 172.21.15.55:0/1238587280 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29c0058870 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.649+0000 7f29d44ac640 1 -- 172.21.15.55:0/1238587280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29cc0749b0 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.649+0000 7f29caffd640 1 -- 172.21.15.55:0/1238587280 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f29c005c910 con 0x7f29cc0cfbe0 2024-04-25T08:59:19.639 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:19.639 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:58:50.293987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6852},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6852":{"gid":6852,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":15,"addr":"172.21.15.55:6837/2486130786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2486130786},{"type":"v1","addr":"172.21.15.55:6837","nonce":2486130786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:59:19.639 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 44 2024-04-25T08:59:19.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 -- 172.21.15.55:0/1238587280 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f29b806b4d0 msgr2=0x7f29b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f29b806b4d0 0x7f29b806d990 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f29c400aac0 tx=0x7f29c4008040 comp rx=0 tx=0).stop 2024-04-25T08:59:19.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 -- 172.21.15.55:0/1238587280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0cfbe0 msgr2=0x7f29cc0b6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0cfbe0 0x7f29cc0b6e30 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f29c000c7c0 tx=0x7f29c000cc80 comp rx=0 tx=0).stop 2024-04-25T08:59:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 -- 172.21.15.55:0/1238587280 shutdown_connections 2024-04-25T08:59:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f29b806b4d0 0x7f29b806d990 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29cc15f120 0x7f29cc0ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0cfbe0 0x7f29cc0b6e30 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 --2- 172.21.15.55:0/1238587280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29cc0ce830 0x7f29cc0b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 -- 172.21.15.55:0/1238587280 >> 172.21.15.55:0/1238587280 conn(0x7f29cc0d1900 msgr2=0x7f29cc09a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 -- 172.21.15.55:0/1238587280 shutdown_connections 2024-04-25T08:59:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.651+0000 7f29d44ac640 1 -- 172.21.15.55:0/1238587280 wait complete. 2024-04-25T08:59:19.652 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:19.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.764+0000 7ff0c595a640 1 Processor -- start 2024-04-25T08:59:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.764+0000 7ff0c595a640 1 -- start start 2024-04-25T08:59:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.765+0000 7ff0c595a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff0c015eaa0 0x7ff0c015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.765+0000 7ff0c595a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c00cd2c0 con 0x7ff0c00ccdc0 2024-04-25T08:59:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.765+0000 7ff0c595a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c00cd5a0 con 0x7ff0c0144450 2024-04-25T08:59:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.765+0000 7ff0c595a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c00cdb60 con 0x7ff0c015eaa0 2024-04-25T08:59:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.765+0000 7ff0be7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff0c00ccdc0 0x7ff0c00722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32908/0 (socket says 172.21.15.55:32908) 2024-04-25T08:59:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.765+0000 7ff0be7fc640 1 -- 172.21.15.55:0/2573342369 learned_addr learned my addr 172.21.15.55:0/2573342369 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.765+0000 7ff0bf7fe640 1 --2- 172.21.15.55:0/2573342369 >> v2:172.21.15.167:3300/0 conn(0x7ff0c015eaa0 0x7ff0c015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.766+0000 7ff0bdffb640 1 -- 172.21.15.55:0/2573342369 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767414257 0 0) 0x7ff0c00cd2c0 con 0x7ff0c00ccdc0 2024-04-25T08:59:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.766+0000 7ff0bdffb640 1 -- 172.21.15.55:0/2573342369 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0ac003520 con 0x7ff0c00ccdc0 2024-04-25T08:59:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.766+0000 7ff0bf7fe640 1 -- 172.21.15.55:0/2573342369 >> v1:172.21.15.167:6789/0 conn(0x7ff0c0144450 legacy=0x7ff0c00c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.766+0000 7ff0bf7fe640 1 -- 172.21.15.55:0/2573342369 >> v1:172.21.15.55:6789/0 conn(0x7ff0c00ccdc0 legacy=0x7ff0c00722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.766+0000 7ff0bdffb640 1 -- 172.21.15.55:0/2573342369 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1568233279 0 0) 0x7ff0ac003520 con 0x7ff0c00ccdc0 2024-04-25T08:59:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.766+0000 7ff0bf7fe640 1 -- 172.21.15.55:0/2573342369 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00cd880 con 0x7ff0c015eaa0 2024-04-25T08:59:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.767+0000 7ff0bf7fe640 1 --2- 172.21.15.55:0/2573342369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c015eaa0 0x7ff0c015ef30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009d90 tx=0x7ff0b002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ac90ea5209e5010 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.767+0000 7ff0bdffb640 1 -- 172.21.15.55:0/2573342369 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8001670 con 0x7ff0c015eaa0 2024-04-25T08:59:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.767+0000 7ff0bdffb640 1 -- 172.21.15.55:0/2573342369 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b0007540 con 0x7ff0c015eaa0 2024-04-25T08:59:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.767+0000 7ff0bdffb640 1 -- 172.21.15.55:0/2573342369 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0007910 con 0x7ff0c015eaa0 2024-04-25T08:59:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.767+0000 7ff0c595a640 1 -- 172.21.15.55:0/2573342369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c015eaa0 msgr2=0x7ff0c015ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.767+0000 7ff0c595a640 1 --2- 172.21.15.55:0/2573342369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c015eaa0 0x7ff0c015ef30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009d90 tx=0x7ff0b002a5f0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.767+0000 7ff0c595a640 1 -- 172.21.15.55:0/2573342369 shutdown_connections 2024-04-25T08:59:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.767+0000 7ff0c595a640 1 --2- 172.21.15.55:0/2573342369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c015eaa0 0x7ff0c015ef30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.767+0000 7ff0c595a640 1 -- 172.21.15.55:0/2573342369 >> 172.21.15.55:0/2573342369 conn(0x7ff0c00b2370 msgr2=0x7ff0c00b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.767+0000 7ff0c595a640 1 -- 172.21.15.55:0/2573342369 shutdown_connections 2024-04-25T08:59:19.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.767+0000 7ff0c595a640 1 -- 172.21.15.55:0/2573342369 wait complete. 2024-04-25T08:59:19.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.769+0000 7ff0c595a640 1 Processor -- start 2024-04-25T08:59:19.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.769+0000 7ff0c595a640 1 -- start start 2024-04-25T08:59:19.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.769+0000 7ff0c595a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0c00ccdc0 0x7ff0c00b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.769+0000 7ff0c595a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c0144450 0x7ff0c0142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.769+0000 7ff0c595a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c015eaa0 0x7ff0c0143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.769+0000 7ff0c595a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0072b30 con 0x7ff0c0144450 2024-04-25T08:59:19.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.769+0000 7ff0c595a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00729b0 con 0x7ff0c015eaa0 2024-04-25T08:59:19.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.769+0000 7ff0c595a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00af6a0 con 0x7ff0c00ccdc0 2024-04-25T08:59:19.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0be7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c0144450 0x7ff0c0142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0be7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c0144450 0x7ff0c0142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41400/0 (socket says 172.21.15.55:41400) 2024-04-25T08:59:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0be7fc640 1 -- 172.21.15.55:0/1196444380 learned_addr learned my addr 172.21.15.55:0/1196444380 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0bf7fe640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c015eaa0 0x7ff0c0143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0beffd640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0c00ccdc0 0x7ff0c00b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0be7fc640 1 -- 172.21.15.55:0/1196444380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0c00ccdc0 msgr2=0x7ff0c00b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0be7fc640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0c00ccdc0 0x7ff0c00b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0be7fc640 1 -- 172.21.15.55:0/1196444380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c015eaa0 msgr2=0x7ff0c0143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0be7fc640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c015eaa0 0x7ff0c0143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0be7fc640 1 -- 172.21.15.55:0/1196444380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c01f7140 con 0x7ff0c0144450 2024-04-25T08:59:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0beffd640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0c00ccdc0 0x7ff0c00b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0be7fc640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c0144450 0x7ff0c0142ef0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800c780 tx=0x7ff0a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0b7fff640 1 -- 172.21.15.55:0/1196444380 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8017070 con 0x7ff0c0144450 2024-04-25T08:59:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0b7fff640 1 -- 172.21.15.55:0/1196444380 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a8005ad0 con 0x7ff0c0144450 2024-04-25T08:59:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0c595a640 1 -- 172.21.15.55:0/1196444380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c01f7420 con 0x7ff0c0144450 2024-04-25T08:59:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0b7fff640 1 -- 172.21.15.55:0/1196444380 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8007070 con 0x7ff0c0144450 2024-04-25T08:59:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.770+0000 7ff0c595a640 1 -- 172.21.15.55:0/1196444380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c01f79e0 con 0x7ff0c0144450 2024-04-25T08:59:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.771+0000 7ff0c595a640 1 -- 172.21.15.55:0/1196444380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c00749b0 con 0x7ff0c0144450 2024-04-25T08:59:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.772+0000 7ff0b7fff640 1 -- 172.21.15.55:0/1196444380 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff0a801a070 con 0x7ff0c0144450 2024-04-25T08:59:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.772+0000 7ff0b7fff640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff0a006b4d0 0x7ff0a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.773+0000 7ff0beffd640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff0a006b4d0 0x7ff0a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.773+0000 7ff0b7fff640 1 -- 172.21.15.55:0/1196444380 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff0a8089780 con 0x7ff0c0144450 2024-04-25T08:59:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.773+0000 7ff0beffd640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff0a006b4d0 0x7ff0a006d990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8007fd0 tx=0x7ff0b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.777+0000 7ff0b7fff640 1 -- 172.21.15.55:0/1196444380 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0a8057f20 con 0x7ff0c0144450 2024-04-25T08:59:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.959+0000 7ff0c595a640 1 -- 172.21.15.55:0/1196444380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0c006fb80 con 0x7ff0c0144450 2024-04-25T08:59:19.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.960+0000 7ff0b7fff640 1 -- 172.21.15.55:0/1196444380 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16892 (secure 0 0 0) 0x7ff0a805bfc0 con 0x7ff0c0144450 2024-04-25T08:59:19.949 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:19.949 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":76,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:58:24.676099+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:47.819814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:48.522459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.a","mappings":[{"from":6,"to":0}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/173615501":"2024-04-26T08:58:03.267866+0000","172.21.15.55:6835/173615501":"2024-04-26T08:58:03.267866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:19.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.961+0000 7ff0c595a640 1 -- 172.21.15.55:0/1196444380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff0a006b4d0 msgr2=0x7ff0a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.961+0000 7ff0c595a640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff0a006b4d0 0x7ff0a006d990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8007fd0 tx=0x7ff0b8009040 comp rx=0 tx=0).stop 2024-04-25T08:59:19.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.961+0000 7ff0c595a640 1 -- 172.21.15.55:0/1196444380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c0144450 msgr2=0x7ff0c0142ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:19.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.961+0000 7ff0c595a640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c0144450 0x7ff0c0142ef0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800c780 tx=0x7ff0a800cc40 comp rx=0 tx=0).stop 2024-04-25T08:59:19.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.961+0000 7ff0c595a640 1 -- 172.21.15.55:0/1196444380 shutdown_connections 2024-04-25T08:59:19.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.961+0000 7ff0c595a640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff0a006b4d0 0x7ff0a006d990 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.961+0000 7ff0c595a640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c015eaa0 0x7ff0c0143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.961+0000 7ff0c595a640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c0144450 0x7ff0c0142ef0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.961+0000 7ff0c595a640 1 --2- 172.21.15.55:0/1196444380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0c00ccdc0 0x7ff0c00b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:19.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.961+0000 7ff0c595a640 1 -- 172.21.15.55:0/1196444380 >> 172.21.15.55:0/1196444380 conn(0x7ff0c00b2370 msgr2=0x7ff0c00b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:19.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.962+0000 7ff0c595a640 1 -- 172.21.15.55:0/1196444380 shutdown_connections 2024-04-25T08:59:19.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:19.962+0000 7ff0c595a640 1 -- 172.21.15.55:0/1196444380 wait complete. 2024-04-25T08:59:19.962 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:59:19.962 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:20.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.074+0000 7fede38f5640 1 Processor -- start 2024-04-25T08:59:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.074+0000 7fede38f5640 1 -- start start 2024-04-25T08:59:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.075+0000 7fede38f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc15baf0 0x7feddc0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.075+0000 7fede38f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feddc070a10 0x7feddc072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.075+0000 7fede38f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc0ce810 con 0x7feddc0ce380 2024-04-25T08:59:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.075+0000 7fede38f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc073210 con 0x7feddc070a10 2024-04-25T08:59:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.075+0000 7fede38f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0cecc0 con 0x7feddc15baf0 2024-04-25T08:59:20.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.076+0000 7fede0e90640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feddc070a10 0x7feddc072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.076+0000 7fede1691640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc15baf0 0x7feddc0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.076+0000 7fede0e90640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feddc070a10 0x7feddc072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:50560/0 (socket says 172.21.15.55:50560) 2024-04-25T08:59:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.076+0000 7fede1e92640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7feddc0ce380 0x7feddc0cb990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:40592/0 (socket says 172.21.15.55:40592) 2024-04-25T08:59:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.076+0000 7fede0e90640 1 -- 172.21.15.55:0/1494530860 learned_addr learned my addr 172.21.15.55:0/1494530860 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.076+0000 7fede0e90640 1 -- 172.21.15.55:0/1494530860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc15baf0 msgr2=0x7feddc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.076+0000 7fede0e90640 1 --2- 172.21.15.55:0/1494530860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc15baf0 0x7feddc0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.076+0000 7fede0e90640 1 -- 172.21.15.55:0/1494530860 >> v1:172.21.15.167:6789/0 conn(0x7feddc0ce380 legacy=0x7feddc0cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.076+0000 7fede0e90640 1 -- 172.21.15.55:0/1494530860 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc0cefa0 con 0x7feddc070a10 2024-04-25T08:59:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.076+0000 7fede1691640 1 --2- 172.21.15.55:0/1494530860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc15baf0 0x7feddc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.077+0000 7fede0e90640 1 --2- 172.21.15.55:0/1494530860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc070a10 0x7feddc072b10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009870 tx=0x7fedd002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aea383432771fab1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.077+0000 7feddbfff640 1 -- 172.21.15.55:0/1494530860 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0037070 con 0x7feddc070a10 2024-04-25T08:59:20.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.077+0000 7feddbfff640 1 -- 172.21.15.55:0/1494530860 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd0032440 con 0x7feddc070a10 2024-04-25T08:59:20.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.077+0000 7feddbfff640 1 -- 172.21.15.55:0/1494530860 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0032810 con 0x7feddc070a10 2024-04-25T08:59:20.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.077+0000 7fede38f5640 1 -- 172.21.15.55:0/1494530860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc070a10 msgr2=0x7feddc072b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.078+0000 7fede38f5640 1 --2- 172.21.15.55:0/1494530860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc070a10 0x7feddc072b10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009870 tx=0x7fedd002a130 comp rx=0 tx=0).stop 2024-04-25T08:59:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.078+0000 7fede38f5640 1 -- 172.21.15.55:0/1494530860 shutdown_connections 2024-04-25T08:59:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.078+0000 7fede38f5640 1 --2- 172.21.15.55:0/1494530860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc070a10 0x7feddc072b10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.078+0000 7fede38f5640 1 --2- 172.21.15.55:0/1494530860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc15baf0 0x7feddc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.078+0000 7fede38f5640 1 -- 172.21.15.55:0/1494530860 >> 172.21.15.55:0/1494530860 conn(0x7feddc0b2370 msgr2=0x7feddc0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.078+0000 7fede38f5640 1 -- 172.21.15.55:0/1494530860 shutdown_connections 2024-04-25T08:59:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.078+0000 7fede38f5640 1 -- 172.21.15.55:0/1494530860 wait complete. 2024-04-25T08:59:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.079+0000 7fede38f5640 1 Processor -- start 2024-04-25T08:59:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.079+0000 7fede38f5640 1 -- start start 2024-04-25T08:59:20.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede38f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc070a10 0x7feddc152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede38f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feddc0ce380 0x7feddc0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede38f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc15baf0 0x7feddc0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede38f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0cc0a0 con 0x7feddc0ce380 2024-04-25T08:59:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede38f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0704f0 con 0x7feddc15baf0 2024-04-25T08:59:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede38f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0cc220 con 0x7feddc070a10 2024-04-25T08:59:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede0e90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feddc0ce380 0x7feddc0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede0e90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feddc0ce380 0x7feddc0cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41412/0 (socket says 172.21.15.55:41412) 2024-04-25T08:59:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede0e90640 1 -- 172.21.15.55:0/526379972 learned_addr learned my addr 172.21.15.55:0/526379972 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede1691640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc070a10 0x7feddc152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede1e92640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc15baf0 0x7feddc0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede0e90640 1 -- 172.21.15.55:0/526379972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc070a10 msgr2=0x7feddc152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede0e90640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc070a10 0x7feddc152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede0e90640 1 -- 172.21.15.55:0/526379972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc15baf0 msgr2=0x7feddc0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede0e90640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc15baf0 0x7feddc0cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede0e90640 1 -- 172.21.15.55:0/526379972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc1534a0 con 0x7feddc0ce380 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede1e92640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc15baf0 0x7feddc0cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede0e90640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feddc0ce380 0x7feddc0cae90 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fedd0000c00 tx=0x7fedd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fedd9ffb640 1 -- 172.21.15.55:0/526379972 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0037040 con 0x7feddc0ce380 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fedd9ffb640 1 -- 172.21.15.55:0/526379972 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd0042070 con 0x7feddc0ce380 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fedd9ffb640 1 -- 172.21.15.55:0/526379972 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0030880 con 0x7feddc0ce380 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.080+0000 7fede38f5640 1 -- 172.21.15.55:0/526379972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc15ea10 con 0x7feddc0ce380 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.081+0000 7fede38f5640 1 -- 172.21.15.55:0/526379972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc1e5850 con 0x7feddc0ce380 2024-04-25T08:59:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.082+0000 7fede38f5640 1 -- 172.21.15.55:0/526379972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc1e5640 con 0x7feddc0ce380 2024-04-25T08:59:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.082+0000 7fedd9ffb640 1 -- 172.21.15.55:0/526379972 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fedd0030a20 con 0x7feddc0ce380 2024-04-25T08:59:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.083+0000 7fedd9ffb640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedc806b4d0 0x7fedc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.083+0000 7fede1691640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedc806b4d0 0x7fedc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.083+0000 7fedd9ffb640 1 -- 172.21.15.55:0/526379972 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fedd00aabf0 con 0x7feddc0ce380 2024-04-25T08:59:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.083+0000 7fede1691640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedc806b4d0 0x7fedc806d990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009930 tx=0x7fedd4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.087+0000 7fedd9ffb640 1 -- 172.21.15.55:0/526379972 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fedd0079940 con 0x7feddc0ce380 2024-04-25T08:59:20.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.305+0000 7fede38f5640 1 -- 172.21.15.55:0/526379972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feddc0749b0 con 0x7feddc0ce380 2024-04-25T08:59:20.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.306+0000 7fedd9ffb640 1 -- 172.21.15.55:0/526379972 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4942 (secure 0 0 0) 0x7fedd0079240 con 0x7feddc0ce380 2024-04-25T08:59:20.295 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:20.295 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:58:50.293987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6852},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6852":{"gid":6852,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":15,"addr":"172.21.15.55:6837/2486130786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2486130786},{"type":"v1","addr":"172.21.15.55:6837","nonce":2486130786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:59:20.295 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 44 2024-04-25T08:59:20.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.307+0000 7fede38f5640 1 -- 172.21.15.55:0/526379972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedc806b4d0 msgr2=0x7fedc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.308+0000 7fede38f5640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedc806b4d0 0x7fedc806d990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009930 tx=0x7fedd4008040 comp rx=0 tx=0).stop 2024-04-25T08:59:20.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.308+0000 7fede38f5640 1 -- 172.21.15.55:0/526379972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feddc0ce380 msgr2=0x7feddc0cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.308+0000 7fede38f5640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feddc0ce380 0x7feddc0cae90 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fedd0000c00 tx=0x7fedd00046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.308+0000 7fede38f5640 1 -- 172.21.15.55:0/526379972 shutdown_connections 2024-04-25T08:59:20.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.308+0000 7fede38f5640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedc806b4d0 0x7fedc806d990 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.308+0000 7fede38f5640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc15baf0 0x7feddc0cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.308+0000 7fede38f5640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feddc0ce380 0x7feddc0cae90 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.308+0000 7fede38f5640 1 --2- 172.21.15.55:0/526379972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc070a10 0x7feddc152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.308+0000 7fede38f5640 1 -- 172.21.15.55:0/526379972 >> 172.21.15.55:0/526379972 conn(0x7feddc0b2370 msgr2=0x7feddc155130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.308+0000 7fede38f5640 1 -- 172.21.15.55:0/526379972 shutdown_connections 2024-04-25T08:59:20.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.308+0000 7fede38f5640 1 -- 172.21.15.55:0/526379972 wait complete. 2024-04-25T08:59:20.308 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:20.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.419+0000 7f519ca8f640 1 Processor -- start 2024-04-25T08:59:20.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.419+0000 7f519ca8f640 1 -- start start 2024-04-25T08:59:20.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.420+0000 7f519ca8f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51980d35b0 0x7f51980b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.420+0000 7f519ca8f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51980b5990 0x7f51980b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.420+0000 7f519ca8f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519815e0c0 con 0x7f519815dce0 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.420+0000 7f519ca8f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51980d2510 con 0x7f51980d35b0 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.420+0000 7f519ca8f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51980d27f0 con 0x7f51980b5990 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.420+0000 7f5196d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51980b5990 0x7f51980b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.420+0000 7f5196d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51980b5990 0x7f51980b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:59320/0 (socket says 172.21.15.55:59320) 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.420+0000 7f518ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51980d35b0 0x7f51980b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.420+0000 7f5196d9d640 1 -- 172.21.15.55:0/384108454 learned_addr learned my addr 172.21.15.55:0/384108454 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.421+0000 7f5196d9d640 1 -- 172.21.15.55:0/384108454 >> v2:172.21.15.167:3300/0 conn(0x7f51980d35b0 msgr2=0x7f51980b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.421+0000 7f5196d9d640 1 --2- 172.21.15.55:0/384108454 >> v2:172.21.15.167:3300/0 conn(0x7f51980d35b0 0x7f51980b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.421+0000 7f5196d9d640 1 -- 172.21.15.55:0/384108454 >> v1:172.21.15.167:6789/0 conn(0x7f519815dce0 legacy=0x7f51980d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.421+0000 7f5196d9d640 1 -- 172.21.15.55:0/384108454 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51980d2ad0 con 0x7f51980b5990 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.421+0000 7f5196d9d640 1 --2- 172.21.15.55:0/384108454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51980b5990 0x7f51980b6b00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5190009e50 tx=0x7f519002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8c39992c0240c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.421+0000 7f5195d9b640 1 -- 172.21.15.55:0/384108454 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190036070 con 0x7f51980b5990 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.422+0000 7f5195d9b640 1 -- 172.21.15.55:0/384108454 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190031600 con 0x7f51980b5990 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.422+0000 7f5195d9b640 1 -- 172.21.15.55:0/384108454 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900319d0 con 0x7f51980b5990 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.422+0000 7f519ca8f640 1 -- 172.21.15.55:0/384108454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51980b5990 msgr2=0x7f51980b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.422+0000 7f519ca8f640 1 --2- 172.21.15.55:0/384108454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51980b5990 0x7f51980b6b00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5190009e50 tx=0x7f519002a710 comp rx=0 tx=0).stop 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.422+0000 7f519ca8f640 1 -- 172.21.15.55:0/384108454 shutdown_connections 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.422+0000 7f519ca8f640 1 --2- 172.21.15.55:0/384108454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51980b5990 0x7f51980b6b00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.422+0000 7f519ca8f640 1 --2- 172.21.15.55:0/384108454 >> v2:172.21.15.167:3300/0 conn(0x7f51980d35b0 0x7f51980b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.422+0000 7f519ca8f640 1 -- 172.21.15.55:0/384108454 >> 172.21.15.55:0/384108454 conn(0x7f5198072900 msgr2=0x7f51980d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.422+0000 7f519ca8f640 1 -- 172.21.15.55:0/384108454 shutdown_connections 2024-04-25T08:59:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.422+0000 7f519ca8f640 1 -- 172.21.15.55:0/384108454 wait complete. 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.423+0000 7f519ca8f640 1 Processor -- start 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.423+0000 7f519ca8f640 1 -- start start 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.424+0000 7f519ca8f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51980b5990 0x7f5198160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.424+0000 7f519ca8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51980d35b0 0x7f51981f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.424+0000 7f519ca8f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f519815dce0 0x7f519815e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.424+0000 7f519ca8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51980d2160 con 0x7f51980d35b0 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.424+0000 7f519ca8f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51980d3090 con 0x7f51980b5990 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.424+0000 7f519ca8f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51981f7430 con 0x7f519815dce0 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.424+0000 7f518ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51980d35b0 0x7f51981f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.424+0000 7f518ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51980d35b0 0x7f51981f6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41420/0 (socket says 172.21.15.55:41420) 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.424+0000 7f518ffff640 1 -- 172.21.15.55:0/1736082194 learned_addr learned my addr 172.21.15.55:0/1736082194 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.424+0000 7f519659c640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51980b5990 0x7f5198160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.424+0000 7f5196d9d640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f519815dce0 0x7f519815e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f518ffff640 1 -- 172.21.15.55:0/1736082194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f519815dce0 msgr2=0x7f519815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f518ffff640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f519815dce0 0x7f519815e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f518ffff640 1 -- 172.21.15.55:0/1736082194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51980b5990 msgr2=0x7f5198160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f518ffff640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51980b5990 0x7f5198160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f518ffff640 1 -- 172.21.15.55:0/1736082194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51981f7660 con 0x7f51980d35b0 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f5196d9d640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f519815dce0 0x7f519815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f519659c640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51980b5990 0x7f5198160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f518ffff640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51980d35b0 0x7f51981f6ef0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f518000e9b0 tx=0x7f518000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f518effd640 1 -- 172.21.15.55:0/1736082194 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180017070 con 0x7f51980d35b0 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f518effd640 1 -- 172.21.15.55:0/1736082194 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518000c9a0 con 0x7f51980d35b0 2024-04-25T08:59:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f519ca8f640 1 -- 172.21.15.55:0/1736082194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51981f7940 con 0x7f51980d35b0 2024-04-25T08:59:20.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f518effd640 1 -- 172.21.15.55:0/1736082194 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518000cd70 con 0x7f51980d35b0 2024-04-25T08:59:20.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.425+0000 7f519ca8f640 1 -- 172.21.15.55:0/1736082194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51980cbc70 con 0x7f51980d35b0 2024-04-25T08:59:20.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.426+0000 7f519ca8f640 1 -- 172.21.15.55:0/1736082194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51980749b0 con 0x7f51980d35b0 2024-04-25T08:59:20.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.427+0000 7f518effd640 1 -- 172.21.15.55:0/1736082194 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f518001a070 con 0x7f51980d35b0 2024-04-25T08:59:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.427+0000 7f518effd640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f517806b4d0 0x7f517806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.427+0000 7f518effd640 1 -- 172.21.15.55:0/1736082194 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f518008a5b0 con 0x7f51980d35b0 2024-04-25T08:59:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.427+0000 7f519659c640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f517806b4d0 0x7f517806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.428+0000 7f519659c640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f517806b4d0 0x7f517806d990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5188001660 tx=0x7f5188009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.431+0000 7f518effd640 1 -- 172.21.15.55:0/1736082194 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5180059430 con 0x7f51980d35b0 2024-04-25T08:59:20.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.649+0000 7f519ca8f640 1 -- 172.21.15.55:0/1736082194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f519815d350 con 0x7f51980d35b0 2024-04-25T08:59:20.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.650+0000 7f518effd640 1 -- 172.21.15.55:0/1736082194 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f5180058d30 con 0x7f51980d35b0 2024-04-25T08:59:20.639 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:20.639 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:57:49.554460+0000","modified":"2024-04-25T08:58:50.293987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6852},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6852":{"gid":6852,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":15,"addr":"172.21.15.55:6837/2486130786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2486130786},{"type":"v1","addr":"172.21.15.55:6837","nonce":2486130786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:59:20.639 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 44 2024-04-25T08:59:20.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.651+0000 7f519ca8f640 1 -- 172.21.15.55:0/1736082194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f517806b4d0 msgr2=0x7f517806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.651+0000 7f519ca8f640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f517806b4d0 0x7f517806d990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5188001660 tx=0x7f5188009040 comp rx=0 tx=0).stop 2024-04-25T08:59:20.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.651+0000 7f519ca8f640 1 -- 172.21.15.55:0/1736082194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51980d35b0 msgr2=0x7f51981f6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.652+0000 7f519ca8f640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51980d35b0 0x7f51981f6ef0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f518000e9b0 tx=0x7f518000ee70 comp rx=0 tx=0).stop 2024-04-25T08:59:20.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.652+0000 7f519ca8f640 1 -- 172.21.15.55:0/1736082194 shutdown_connections 2024-04-25T08:59:20.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.652+0000 7f519ca8f640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f517806b4d0 0x7f517806d990 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.652+0000 7f519ca8f640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f519815dce0 0x7f519815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.652+0000 7f519ca8f640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51980d35b0 0x7f51981f6ef0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.652+0000 7f519ca8f640 1 --2- 172.21.15.55:0/1736082194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51980b5990 0x7f5198160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.652+0000 7f519ca8f640 1 -- 172.21.15.55:0/1736082194 >> 172.21.15.55:0/1736082194 conn(0x7f5198072900 msgr2=0x7f51980b8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:20.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.652+0000 7f519ca8f640 1 -- 172.21.15.55:0/1736082194 shutdown_connections 2024-04-25T08:59:20.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.652+0000 7f519ca8f640 1 -- 172.21.15.55:0/1736082194 wait complete. 2024-04-25T08:59:20.652 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.764+0000 7fd3a10cb640 1 Processor -- start 2024-04-25T08:59:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.764+0000 7fd3a10cb640 1 -- start start 2024-04-25T08:59:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.764+0000 7fd3a10cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0b2570 0x7fd39c0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.764+0000 7fd3a10cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39c0b2ae0 con 0x7fd39c16a9d0 2024-04-25T08:59:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.764+0000 7fd3a10cb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39c0b2dc0 con 0x7fd39c0cfb00 2024-04-25T08:59:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.764+0000 7fd3a10cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c16adb0 con 0x7fd39c0b2570 2024-04-25T08:59:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.765+0000 7fd39ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd39c16a9d0 0x7fd39c0cf3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32916/0 (socket says 172.21.15.55:32916) 2024-04-25T08:59:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.765+0000 7fd39ad9d640 1 -- 172.21.15.55:0/1412653589 learned_addr learned my addr 172.21.15.55:0/1412653589 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.765+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554982732 0 0) 0x7fd39c0b2ae0 con 0x7fd39c16a9d0 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.765+0000 7fd39b59e640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0b2570 0x7fd39c0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd384003970 con 0x7fd39c16a9d0 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809576069 0 0) 0x7fd39c0b2dc0 con 0x7fd39c0cfb00 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd39c0b2ae0 con 0x7fd39c0cfb00 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2476703178 0 0) 0x7fd384003970 con 0x7fd39c16a9d0 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0b2570 msgr2=0x7fd39c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0b2570 0x7fd39c0ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 >> v1:172.21.15.167:6789/0 conn(0x7fd39c0cfb00 legacy=0x7fd39c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c0b30a0 con 0x7fd39c16a9d0 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fd38c001670 con 0x7fd39c16a9d0 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 >> v1:172.21.15.55:6789/0 conn(0x7fd39c16a9d0 legacy=0x7fd39c0cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0b2570 0x7fd384003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd384004370 0x7fd384006c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd384007170 0x7fd3840075f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c16adb0 con 0x7fd384004370 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd384007b30 con 0x7fd384007170 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd384007d30 con 0x7fd39c0b2570 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd39a59c640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd384004370 0x7fd384006c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd39ad9d640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0b2570 0x7fd384003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd39b59e640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd384007170 0x7fd3840075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd39a59c640 1 -- 172.21.15.55:0/1412653589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0b2570 msgr2=0x7fd384003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd39a59c640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0b2570 0x7fd384003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd39a59c640 1 -- 172.21.15.55:0/1412653589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd384007170 msgr2=0x7fd3840075f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd39a59c640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd384007170 0x7fd3840075f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.839+0000 7fd39a59c640 1 -- 172.21.15.55:0/1412653589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384003970 con 0x7fd384004370 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.840+0000 7fd39a59c640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd384004370 0x7fd384006c30 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd3900018d0 tx=0x7fd384003570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce172584eae74b55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.840+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3900014f0 con 0x7fd384004370 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.840+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3900052d0 con 0x7fd384004370 2024-04-25T08:59:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.840+0000 7fd399d9b640 1 -- 172.21.15.55:0/1412653589 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39002ac60 con 0x7fd384004370 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.841+0000 7fd3a10cb640 1 -- 172.21.15.55:0/1412653589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd384004370 msgr2=0x7fd384006c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.841+0000 7fd3a10cb640 1 --2- 172.21.15.55:0/1412653589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd384004370 0x7fd384006c30 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd3900018d0 tx=0x7fd384003570 comp rx=0 tx=0).stop 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.841+0000 7fd39b59e640 1 -- 172.21.15.55:0/1412653589 reap_dead start 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.841+0000 7fd3a10cb640 1 -- 172.21.15.55:0/1412653589 shutdown_connections 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.841+0000 7fd3a10cb640 1 -- 172.21.15.55:0/1412653589 >> 172.21.15.55:0/1412653589 conn(0x7fd39c066d80 msgr2=0x7fd39c06aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.841+0000 7fd3a10cb640 1 -- 172.21.15.55:0/1412653589 shutdown_connections 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.841+0000 7fd3a10cb640 1 -- 172.21.15.55:0/1412653589 wait complete. 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.842+0000 7fd3a10cb640 1 Processor -- start 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.842+0000 7fd3a10cb640 1 -- start start 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.843+0000 7fd3a10cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd384004370 0x7fd39c089b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.843+0000 7fd3a10cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd39c157890 0x7fd39c0c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.843+0000 7fd3a10cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0cd6e0 0x7fd39c0c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.843+0000 7fd3a10cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0b3b80 con 0x7fd39c157890 2024-04-25T08:59:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.843+0000 7fd3a10cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0b3660 con 0x7fd384004370 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.843+0000 7fd3a10cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c06eee0 con 0x7fd39c0cd6e0 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.843+0000 7fd39a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd39c157890 0x7fd39c0c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.843+0000 7fd39a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd39c157890 0x7fd39c0c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41436/0 (socket says 172.21.15.55:41436) 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.843+0000 7fd39a59c640 1 -- 172.21.15.55:0/3672759315 learned_addr learned my addr 172.21.15.55:0/3672759315 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.843+0000 7fd39b59e640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0cd6e0 0x7fd39c0c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.843+0000 7fd39ad9d640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd384004370 0x7fd39c089b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd39a59c640 1 -- 172.21.15.55:0/3672759315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0cd6e0 msgr2=0x7fd39c0c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd39a59c640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0cd6e0 0x7fd39c0c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd39a59c640 1 -- 172.21.15.55:0/3672759315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd384004370 msgr2=0x7fd39c089b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd39a59c640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd384004370 0x7fd39c089b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd39a59c640 1 -- 172.21.15.55:0/3672759315 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c0c5540 con 0x7fd39c157890 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd39ad9d640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd384004370 0x7fd39c089b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd39a59c640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd39c157890 0x7fd39c0c5000 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd390005040 tx=0x7fd3900012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd3837fe640 1 -- 172.21.15.55:0/3672759315 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390040020 con 0x7fd39c157890 2024-04-25T08:59:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd3837fe640 1 -- 172.21.15.55:0/3672759315 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd390005480 con 0x7fd39c157890 2024-04-25T08:59:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd3a10cb640 1 -- 172.21.15.55:0/3672759315 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c0cc660 con 0x7fd39c157890 2024-04-25T08:59:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd3837fe640 1 -- 172.21.15.55:0/3672759315 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3900014f0 con 0x7fd39c157890 2024-04-25T08:59:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.844+0000 7fd3a10cb640 1 -- 172.21.15.55:0/3672759315 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c0ccc20 con 0x7fd39c157890 2024-04-25T08:59:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.845+0000 7fd3a10cb640 1 -- 172.21.15.55:0/3672759315 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c0749b0 con 0x7fd39c157890 2024-04-25T08:59:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.845+0000 7fd3837fe640 1 -- 172.21.15.55:0/3672759315 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd390043020 con 0x7fd39c157890 2024-04-25T08:59:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.846+0000 7fd3837fe640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd38806b4d0 0x7fd38806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.846+0000 7fd39ad9d640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd38806b4d0 0x7fd38806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.846+0000 7fd3837fe640 1 -- 172.21.15.55:0/3672759315 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd3900aa440 con 0x7fd39c157890 2024-04-25T08:59:20.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.846+0000 7fd39ad9d640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd38806b4d0 0x7fd38806d990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd38c007d00 tx=0x7fd38c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:20.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:20.850+0000 7fd3837fe640 1 -- 172.21.15.55:0/3672759315 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd39004a030 con 0x7fd39c157890 2024-04-25T08:59:21.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.037+0000 7fd3a10cb640 1 -- 172.21.15.55:0/3672759315 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd39c0c5770 con 0x7fd39c157890 2024-04-25T08:59:21.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.038+0000 7fd3837fe640 1 -- 172.21.15.55:0/3672759315 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16892 (secure 0 0 0) 0x7fd39c0c5540 con 0x7fd39c157890 2024-04-25T08:59:21.028 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:21.028 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":76,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:58:24.676099+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:57:47.819814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T08:57:48.522459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.a","mappings":[{"from":6,"to":0}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/173615501":"2024-04-26T08:58:03.267866+0000","172.21.15.55:6835/173615501":"2024-04-26T08:58:03.267866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 -- 172.21.15.55:0/3672759315 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd38806b4d0 msgr2=0x7fd38806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd38806b4d0 0x7fd38806d990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd38c007d00 tx=0x7fd38c009040 comp rx=0 tx=0).stop 2024-04-25T08:59:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 -- 172.21.15.55:0/3672759315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd39c157890 msgr2=0x7fd39c0c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd39c157890 0x7fd39c0c5000 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd390005040 tx=0x7fd3900012d0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 -- 172.21.15.55:0/3672759315 shutdown_connections 2024-04-25T08:59:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd38806b4d0 0x7fd38806d990 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd39c0cd6e0 0x7fd39c0c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd39c157890 0x7fd39c0c5000 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 --2- 172.21.15.55:0/3672759315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd384004370 0x7fd39c089b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 -- 172.21.15.55:0/3672759315 >> 172.21.15.55:0/3672759315 conn(0x7fd39c066d80 msgr2=0x7fd39c16ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 -- 172.21.15.55:0/3672759315 shutdown_connections 2024-04-25T08:59:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.041+0000 7fd3a10cb640 1 -- 172.21.15.55:0/3672759315 wait complete. 2024-04-25T08:59:21.041 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:59:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.153+0000 7f912bbf5640 1 Processor -- start 2024-04-25T08:59:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.154+0000 7f912bbf5640 1 -- start start 2024-04-25T08:59:21.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.154+0000 7f912bbf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9124161090 0x7f9124161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.154+0000 7f912bbf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91240ceeb0 0x7f91240d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.154+0000 7f912bbf5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9124161f80 con 0x7f91240b9720 2024-04-25T08:59:21.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.154+0000 7f912bbf5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91240d21a0 con 0x7f91240ceeb0 2024-04-25T08:59:21.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.154+0000 7f912bbf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9124162260 con 0x7f9124161090 2024-04-25T08:59:21.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.155+0000 7f912a192640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91240ceeb0 0x7f91240d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.155+0000 7f9129190640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f91240b9720 0x7f91240ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32922/0 (socket says 172.21.15.55:32922) 2024-04-25T08:59:21.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.155+0000 7f9129190640 1 -- 172.21.15.55:0/731928286 learned_addr learned my addr 172.21.15.55:0/731928286 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:21.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.155+0000 7f9129991640 1 --2- 172.21.15.55:0/731928286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9124161090 0x7f9124161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.155+0000 7f912a192640 1 -- 172.21.15.55:0/731928286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9124161090 msgr2=0x7f9124161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:21.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.155+0000 7f912a192640 1 --2- 172.21.15.55:0/731928286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9124161090 0x7f9124161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.155+0000 7f912a192640 1 -- 172.21.15.55:0/731928286 >> v1:172.21.15.55:6789/0 conn(0x7f91240b9720 legacy=0x7f91240ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:21.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.155+0000 7f912a192640 1 -- 172.21.15.55:0/731928286 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124162540 con 0x7f91240ceeb0 2024-04-25T08:59:21.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.155+0000 7f912898f640 1 -- 172.21.15.55:0/731928286 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292609629 0 0) 0x7f9124161f80 con 0x7f91240b9720 2024-04-25T08:59:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912a192640 1 --2- 172.21.15.55:0/731928286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91240ceeb0 0x7f91240d2630 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f911c009d90 tx=0x7f911c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6492cab6b02baba9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912898f640 1 -- 172.21.15.55:0/731928286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c007740 con 0x7f91240ceeb0 2024-04-25T08:59:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912898f640 1 -- 172.21.15.55:0/731928286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c0078e0 con 0x7f91240ceeb0 2024-04-25T08:59:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912898f640 1 -- 172.21.15.55:0/731928286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c007cb0 con 0x7f91240ceeb0 2024-04-25T08:59:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912bbf5640 1 -- 172.21.15.55:0/731928286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91240ceeb0 msgr2=0x7f91240d2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912bbf5640 1 --2- 172.21.15.55:0/731928286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91240ceeb0 0x7f91240d2630 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f911c009d90 tx=0x7f911c02a660 comp rx=0 tx=0).stop 2024-04-25T08:59:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912bbf5640 1 -- 172.21.15.55:0/731928286 shutdown_connections 2024-04-25T08:59:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912bbf5640 1 --2- 172.21.15.55:0/731928286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91240ceeb0 0x7f91240d2630 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912bbf5640 1 --2- 172.21.15.55:0/731928286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9124161090 0x7f9124161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912bbf5640 1 -- 172.21.15.55:0/731928286 >> 172.21.15.55:0/731928286 conn(0x7f91240b55e0 msgr2=0x7f91240b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912bbf5640 1 -- 172.21.15.55:0/731928286 shutdown_connections 2024-04-25T08:59:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.156+0000 7f912bbf5640 1 -- 172.21.15.55:0/731928286 wait complete. 2024-04-25T08:59:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.158+0000 7f912bbf5640 1 Processor -- start 2024-04-25T08:59:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.158+0000 7f912bbf5640 1 -- start start 2024-04-25T08:59:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.158+0000 7f912bbf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91240b9720 0x7f91241561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.158+0000 7f912bbf5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91240ceeb0 0x7f91240cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.158+0000 7f912bbf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9124161090 0x7f9124154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.158+0000 7f912bbf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9124161c70 con 0x7f91240b9720 2024-04-25T08:59:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.158+0000 7f912bbf5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9124161470 con 0x7f91240ceeb0 2024-04-25T08:59:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.158+0000 7f912bbf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91240d2b70 con 0x7f9124161090 2024-04-25T08:59:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.158+0000 7f9129991640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91240b9720 0x7f91241561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.158+0000 7f9129991640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91240b9720 0x7f91241561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41456/0 (socket says 172.21.15.55:41456) 2024-04-25T08:59:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.158+0000 7f9129991640 1 -- 172.21.15.55:0/3936458849 learned_addr learned my addr 172.21.15.55:0/3936458849 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f912a192640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9124161090 0x7f9124154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f9129190640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91240ceeb0 0x7f91240cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f9129991640 1 -- 172.21.15.55:0/3936458849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9124161090 msgr2=0x7f9124154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f9129991640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9124161090 0x7f9124154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f9129991640 1 -- 172.21.15.55:0/3936458849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91240ceeb0 msgr2=0x7f91240cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f9129991640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91240ceeb0 0x7f91240cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f9129991640 1 -- 172.21.15.55:0/3936458849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124157440 con 0x7f91240b9720 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f9129991640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91240b9720 0x7f91241561d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f912000d620 tx=0x7f912000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f911a7fc640 1 -- 172.21.15.55:0/3936458849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000b620 con 0x7f91240b9720 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f911a7fc640 1 -- 172.21.15.55:0/3936458849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9120019070 con 0x7f91240b9720 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f911a7fc640 1 -- 172.21.15.55:0/3936458849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000ba00 con 0x7f91240b9720 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f912bbf5640 1 -- 172.21.15.55:0/3936458849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91241568c0 con 0x7f91240b9720 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.159+0000 7f912bbf5640 1 -- 172.21.15.55:0/3936458849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9124156e80 con 0x7f91240b9720 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.160+0000 7f912bbf5640 1 -- 172.21.15.55:0/3936458849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91240750b0 con 0x7f91240b9720 2024-04-25T08:59:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.161+0000 7f911a7fc640 1 -- 172.21.15.55:0/3936458849 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f912000bba0 con 0x7f91240b9720 2024-04-25T08:59:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.161+0000 7f911a7fc640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f910806b4d0 0x7f910806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.161+0000 7f911a7fc640 1 -- 172.21.15.55:0/3936458849 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f912008a6b0 con 0x7f91240b9720 2024-04-25T08:59:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.161+0000 7f9129190640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f910806b4d0 0x7f910806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.162+0000 7f9129190640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f910806b4d0 0x7f910806d990 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9114007fd0 tx=0x7f9114009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:21.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.165+0000 7f911a7fc640 1 -- 172.21.15.55:0/3936458849 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f91200594a0 con 0x7f91240b9720 2024-04-25T08:59:21.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.382+0000 7f912bbf5640 1 -- 172.21.15.55:0/3936458849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f91240b5cf0 con 0x7f91240b9720 2024-04-25T08:59:21.371 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T08:59:21.382+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:59:21.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.388+0000 7f911a7fc640 1 -- 172.21.15.55:0/3936458849 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9120058da0 con 0x7f91240b9720 2024-04-25T08:59:21.377 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:59:21.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 -- 172.21.15.55:0/3936458849 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f910806b4d0 msgr2=0x7f910806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:21.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f910806b4d0 0x7f910806d990 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9114007fd0 tx=0x7f9114009040 comp rx=0 tx=0).stop 2024-04-25T08:59:21.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 -- 172.21.15.55:0/3936458849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91240b9720 msgr2=0x7f91241561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:21.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91240b9720 0x7f91241561d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f912000d620 tx=0x7f912000dae0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 -- 172.21.15.55:0/3936458849 shutdown_connections 2024-04-25T08:59:21.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f910806b4d0 0x7f910806d990 secure :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9114007fd0 tx=0x7f9114009040 comp rx=0 tx=0).stop 2024-04-25T08:59:21.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9124161090 0x7f9124154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91240ceeb0 0x7f91240cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 --2- 172.21.15.55:0/3936458849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91240b9720 0x7f91241561d0 secure :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f912000d620 tx=0x7f912000dae0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 -- 172.21.15.55:0/3936458849 >> 172.21.15.55:0/3936458849 conn(0x7f91240b55e0 msgr2=0x7f91240d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:21.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 -- 172.21.15.55:0/3936458849 shutdown_connections 2024-04-25T08:59:21.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.391+0000 7f912bbf5640 1 -- 172.21.15.55:0/3936458849 wait complete. 2024-04-25T08:59:21.382 INFO:tasks.ceph.mds.c.smithi055.stderr: -4034> 2024-04-25T08:58:09.279+0000 7f048ce25640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:59:21.392 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:59:21.412 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T08:59:21.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.508+0000 7fdba2b7e640 1 Processor -- start 2024-04-25T08:59:21.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.508+0000 7fdba2b7e640 1 -- start start 2024-04-25T08:59:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba2b7e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb9c144e70 0x7fdb9c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba2b7e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdb9c06d7a0 0x7fdb9c0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba2b7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdb9c0cef10 0x7fdb9c071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba2b7e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9c15bfe0 con 0x7fdb9c0cef10 2024-04-25T08:59:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba2b7e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9c06dcb0 con 0x7fdb9c06d7a0 2024-04-25T08:59:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba2b7e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c06df90 con 0x7fdb9c144e70 2024-04-25T08:59:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba111b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdb9c0cef10 0x7fdb9c071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba111b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdb9c0cef10 0x7fdb9c071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41488/0 (socket says 172.21.15.55:41488) 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba111b640 1 -- 172.21.15.55:0/666104333 learned_addr learned my addr 172.21.15.55:0/666104333 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdb93fff640 1 --2- 172.21.15.55:0/666104333 >> v2:172.21.15.167:3300/0 conn(0x7fdb9c06d7a0 0x7fdb9c0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba091a640 1 --2- 172.21.15.55:0/666104333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb9c144e70 0x7fdb9c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba111b640 1 -- 172.21.15.55:0/666104333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb9c144e70 msgr2=0x7fdb9c06d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba111b640 1 --2- 172.21.15.55:0/666104333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb9c144e70 0x7fdb9c06d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba111b640 1 -- 172.21.15.55:0/666104333 >> v2:172.21.15.167:3300/0 conn(0x7fdb9c06d7a0 msgr2=0x7fdb9c0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba111b640 1 --2- 172.21.15.55:0/666104333 >> v2:172.21.15.167:3300/0 conn(0x7fdb9c06d7a0 0x7fdb9c0ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.509+0000 7fdba111b640 1 -- 172.21.15.55:0/666104333 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c06e270 con 0x7fdb9c0cef10 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.510+0000 7fdba111b640 1 --2- 172.21.15.55:0/666104333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb9c0cef10 0x7fdb9c071220 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c06f730 tx=0x7fdb9402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4187b0c0e0ace2f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.510+0000 7fdb937fe640 1 -- 172.21.15.55:0/666104333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94036070 con 0x7fdb9c0cef10 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.510+0000 7fdb937fe640 1 -- 172.21.15.55:0/666104333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb94031600 con 0x7fdb9c0cef10 2024-04-25T08:59:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.510+0000 7fdb937fe640 1 -- 172.21.15.55:0/666104333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940319d0 con 0x7fdb9c0cef10 2024-04-25T08:59:21.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.511+0000 7fdba2b7e640 1 -- 172.21.15.55:0/666104333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb9c0cef10 msgr2=0x7fdb9c071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:21.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.511+0000 7fdba2b7e640 1 --2- 172.21.15.55:0/666104333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb9c0cef10 0x7fdb9c071220 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c06f730 tx=0x7fdb9402a610 comp rx=0 tx=0).stop 2024-04-25T08:59:21.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.511+0000 7fdba2b7e640 1 -- 172.21.15.55:0/666104333 shutdown_connections 2024-04-25T08:59:21.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.511+0000 7fdba2b7e640 1 --2- 172.21.15.55:0/666104333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb9c0cef10 0x7fdb9c071220 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.511+0000 7fdba2b7e640 1 --2- 172.21.15.55:0/666104333 >> v2:172.21.15.167:3300/0 conn(0x7fdb9c06d7a0 0x7fdb9c0ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.511+0000 7fdba2b7e640 1 --2- 172.21.15.55:0/666104333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb9c144e70 0x7fdb9c06d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.511+0000 7fdba2b7e640 1 -- 172.21.15.55:0/666104333 >> 172.21.15.55:0/666104333 conn(0x7fdb9c06aba0 msgr2=0x7fdb9c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:21.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.511+0000 7fdba2b7e640 1 -- 172.21.15.55:0/666104333 shutdown_connections 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.511+0000 7fdba2b7e640 1 -- 172.21.15.55:0/666104333 wait complete. 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.512+0000 7fdba2b7e640 1 Processor -- start 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.512+0000 7fdba2b7e640 1 -- start start 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdba2b7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c06d7a0 0x7fdb9c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdba2b7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb9c0cef10 0x7fdb9c0aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdba2b7e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb9c144e70 0x7fdb9c0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdba2b7e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1454b0 con 0x7fdb9c0cef10 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdba2b7e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0cf380 con 0x7fdb9c06d7a0 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdba2b7e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c145630 con 0x7fdb9c144e70 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdb93fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb9c0cef10 0x7fdb9c0aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdb93fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb9c0cef10 0x7fdb9c0aee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41502/0 (socket says 172.21.15.55:41502) 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdb93fff640 1 -- 172.21.15.55:0/1279727351 learned_addr learned my addr 172.21.15.55:0/1279727351 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdba111b640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb9c144e70 0x7fdb9c0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdba091a640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c06d7a0 0x7fdb9c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdb93fff640 1 -- 172.21.15.55:0/1279727351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb9c144e70 msgr2=0x7fdb9c0afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdb93fff640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb9c144e70 0x7fdb9c0afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdb93fff640 1 -- 172.21.15.55:0/1279727351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c06d7a0 msgr2=0x7fdb9c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdb93fff640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c06d7a0 0x7fdb9c0b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdb93fff640 1 -- 172.21.15.55:0/1279727351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0b2b10 con 0x7fdb9c0cef10 2024-04-25T08:59:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.513+0000 7fdb93fff640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb9c0cef10 0x7fdb9c0aee00 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00d7d0 tx=0x7fdb8c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.514+0000 7fdb917fa640 1 -- 172.21.15.55:0/1279727351 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0096a0 con 0x7fdb9c0cef10 2024-04-25T08:59:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.514+0000 7fdb917fa640 1 -- 172.21.15.55:0/1279727351 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c019070 con 0x7fdb9c0cef10 2024-04-25T08:59:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.514+0000 7fdba2b7e640 1 -- 172.21.15.55:0/1279727351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c0b2df0 con 0x7fdb9c0cef10 2024-04-25T08:59:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.514+0000 7fdb917fa640 1 -- 172.21.15.55:0/1279727351 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c009a60 con 0x7fdb9c0cef10 2024-04-25T08:59:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.514+0000 7fdba2b7e640 1 -- 172.21.15.55:0/1279727351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c0b33b0 con 0x7fdb9c0cef10 2024-04-25T08:59:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.515+0000 7fdba2b7e640 1 -- 172.21.15.55:0/1279727351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9c0750b0 con 0x7fdb9c0cef10 2024-04-25T08:59:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.515+0000 7fdb917fa640 1 -- 172.21.15.55:0/1279727351 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdb8c009c00 con 0x7fdb9c0cef10 2024-04-25T08:59:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.516+0000 7fdb917fa640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb8806b4d0 0x7fdb8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.516+0000 7fdb917fa640 1 -- 172.21.15.55:0/1279727351 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fdb8c08a5b0 con 0x7fdb9c0cef10 2024-04-25T08:59:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.516+0000 7fdba091a640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb8806b4d0 0x7fdb8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.516+0000 7fdba091a640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb8806b4d0 0x7fdb8806d990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c153dc0 tx=0x7fdb98008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:21.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.520+0000 7fdb917fa640 1 -- 172.21.15.55:0/1279727351 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdb8c058cf0 con 0x7fdb9c0cef10 2024-04-25T08:59:21.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:21.744+0000 7fdba2b7e640 1 -- 172.21.15.55:0/1279727351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdb9c0aebe0 con 0x7fdb9c0cef10 2024-04-25T08:59:22.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.389+0000 7fdb917fa640 1 -- 172.21.15.55:0/1279727351 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdb8c05cd90 con 0x7fdb9c0cef10 2024-04-25T08:59:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 -- 172.21.15.55:0/1279727351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb8806b4d0 msgr2=0x7fdb8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb8806b4d0 0x7fdb8806d990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c153dc0 tx=0x7fdb98008040 comp rx=0 tx=0).stop 2024-04-25T08:59:22.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 -- 172.21.15.55:0/1279727351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb9c0cef10 msgr2=0x7fdb9c0aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:22.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb9c0cef10 0x7fdb9c0aee00 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00d7d0 tx=0x7fdb8c00dc90 comp rx=0 tx=0).stop 2024-04-25T08:59:22.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 -- 172.21.15.55:0/1279727351 shutdown_connections 2024-04-25T08:59:22.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb8806b4d0 0x7fdb8806d990 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:22.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb9c144e70 0x7fdb9c0afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:22.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb9c0cef10 0x7fdb9c0aee00 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:22.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 --2- 172.21.15.55:0/1279727351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c06d7a0 0x7fdb9c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:22.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 -- 172.21.15.55:0/1279727351 >> 172.21.15.55:0/1279727351 conn(0x7fdb9c06aba0 msgr2=0x7fdb9c142590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:22.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 -- 172.21.15.55:0/1279727351 shutdown_connections 2024-04-25T08:59:22.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.392+0000 7fdba2b7e640 1 -- 172.21.15.55:0/1279727351 wait complete. 2024-04-25T08:59:22.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:59:22.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.557+0000 7faa3f4cb640 1 Processor -- start 2024-04-25T08:59:22.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.557+0000 7faa3f4cb640 1 -- start start 2024-04-25T08:59:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.558+0000 7faa3f4cb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faa380b3f80 0x7faa38162350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.558+0000 7faa3f4cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa38161400 0x7faa380cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.558+0000 7faa3f4cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cfed0 con 0x7faa380b35e0 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.558+0000 7faa3f4cb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa38162890 con 0x7faa380b3f80 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.558+0000 7faa3f4cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380cf850 con 0x7faa38161400 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.558+0000 7faa3d267640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faa380b35e0 0x7faa38160cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32938/0 (socket says 172.21.15.55:32938) 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.558+0000 7faa3d267640 1 -- 172.21.15.55:0/642851881 learned_addr learned my addr 172.21.15.55:0/642851881 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa3da68640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa38161400 0x7faa380cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa3ca66640 1 --2- 172.21.15.55:0/642851881 >> v2:172.21.15.167:3300/0 conn(0x7faa380b3f80 0x7faa38162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016297482 0 0) 0x7faa380cfed0 con 0x7faa380b35e0 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa20003520 con 0x7faa380b35e0 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3887051379 0 0) 0x7faa20003520 con 0x7faa380b35e0 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa38161400 msgr2=0x7faa380cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa38161400 0x7faa380cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 >> v2:172.21.15.167:3300/0 conn(0x7faa380b3f80 msgr2=0x7faa38162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 --2- 172.21.15.55:0/642851881 >> v2:172.21.15.167:3300/0 conn(0x7faa380b3f80 0x7faa38162350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa380cfb30 con 0x7faa380b35e0 2024-04-25T08:59:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7faa280019f0 con 0x7faa380b35e0 2024-04-25T08:59:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa3ca66640 1 --2- 172.21.15.55:0/642851881 >> v2:172.21.15.167:3300/0 conn(0x7faa380b3f80 0x7faa38162350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 >> v1:172.21.15.55:6789/0 conn(0x7faa380b35e0 legacy=0x7faa38160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa38161400 0x7faa200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20003f30 0x7faa20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa20004d40 0x7faa200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa38162890 con 0x7faa20004d40 2024-04-25T08:59:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa380cf850 con 0x7faa20003f30 2024-04-25T08:59:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2000ba10 con 0x7faa38161400 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa3da68640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa20004d40 0x7faa200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa3d267640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa38161400 0x7faa200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.559+0000 7faa3ca66640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20003f30 0x7faa20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.560+0000 7faa3da68640 1 -- 172.21.15.55:0/642851881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa38161400 msgr2=0x7faa200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.560+0000 7faa3da68640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa38161400 0x7faa200039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.560+0000 7faa3da68640 1 -- 172.21.15.55:0/642851881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20003f30 msgr2=0x7faa20004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.560+0000 7faa3da68640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20003f30 0x7faa20004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.560+0000 7faa3da68640 1 -- 172.21.15.55:0/642851881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa20003520 con 0x7faa20004d40 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.560+0000 7faa3da68640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa20004d40 0x7faa200051c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7faa30009af0 tx=0x7faa20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995101b3c54c02d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.560+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30036070 con 0x7faa20004d40 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.560+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30031400 con 0x7faa20004d40 2024-04-25T08:59:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.560+0000 7faa37fff640 1 -- 172.21.15.55:0/642851881 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30009690 con 0x7faa20004d40 2024-04-25T08:59:22.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.561+0000 7faa3f4cb640 1 -- 172.21.15.55:0/642851881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa20004d40 msgr2=0x7faa200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:22.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.561+0000 7faa3f4cb640 1 --2- 172.21.15.55:0/642851881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa20004d40 0x7faa200051c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7faa30009af0 tx=0x7faa20005830 comp rx=0 tx=0).stop 2024-04-25T08:59:22.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.561+0000 7faa3da68640 1 -- 172.21.15.55:0/642851881 reap_dead start 2024-04-25T08:59:22.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.561+0000 7faa3f4cb640 1 -- 172.21.15.55:0/642851881 shutdown_connections 2024-04-25T08:59:22.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.561+0000 7faa3f4cb640 1 -- 172.21.15.55:0/642851881 >> 172.21.15.55:0/642851881 conn(0x7faa3806f4c0 msgr2=0x7faa3806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:22.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.561+0000 7faa3f4cb640 1 -- 172.21.15.55:0/642851881 shutdown_connections 2024-04-25T08:59:22.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.561+0000 7faa3f4cb640 1 -- 172.21.15.55:0/642851881 wait complete. 2024-04-25T08:59:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.562+0000 7faa3f4cb640 1 Processor -- start 2024-04-25T08:59:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.562+0000 7faa3f4cb640 1 -- start start 2024-04-25T08:59:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3f4cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20004d40 0x7faa380b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3f4cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa380cb1b0 0x7faa3815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3f4cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa380c7e30 0x7faa380b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3f4cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d05d0 con 0x7faa380c7e30 2024-04-25T08:59:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3f4cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d0450 con 0x7faa20004d40 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3f4cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380b39c0 con 0x7faa380cb1b0 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3da68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa380c7e30 0x7faa380b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3da68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa380c7e30 0x7faa380b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41528/0 (socket says 172.21.15.55:41528) 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3da68640 1 -- 172.21.15.55:0/1829921253 learned_addr learned my addr 172.21.15.55:0/1829921253 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3d267640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20004d40 0x7faa380b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3ca66640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa380cb1b0 0x7faa3815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3da68640 1 -- 172.21.15.55:0/1829921253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa380cb1b0 msgr2=0x7faa3815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3da68640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa380cb1b0 0x7faa3815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3da68640 1 -- 172.21.15.55:0/1829921253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20004d40 msgr2=0x7faa380b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3da68640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20004d40 0x7faa380b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.563+0000 7faa3da68640 1 -- 172.21.15.55:0/1829921253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa380b4930 con 0x7faa380c7e30 2024-04-25T08:59:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.564+0000 7faa3da68640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa380c7e30 0x7faa380b63d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7faa30009af0 tx=0x7faa30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.564+0000 7faa35ffb640 1 -- 172.21.15.55:0/1829921253 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30036040 con 0x7faa380c7e30 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.564+0000 7faa35ffb640 1 -- 172.21.15.55:0/1829921253 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30041070 con 0x7faa380c7e30 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.564+0000 7faa3f4cb640 1 -- 172.21.15.55:0/1829921253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3815acc0 con 0x7faa380c7e30 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.564+0000 7faa35ffb640 1 -- 172.21.15.55:0/1829921253 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30009690 con 0x7faa380c7e30 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.564+0000 7faa3f4cb640 1 -- 172.21.15.55:0/1829921253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa380c8ef0 con 0x7faa380c7e30 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.565+0000 7faa3f4cb640 1 -- 172.21.15.55:0/1829921253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa380750b0 con 0x7faa380c7e30 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.565+0000 7faa35ffb640 1 -- 172.21.15.55:0/1829921253 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faa30004270 con 0x7faa380c7e30 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.566+0000 7faa35ffb640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa2406b500 0x7faa2406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.566+0000 7faa35ffb640 1 -- 172.21.15.55:0/1829921253 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5939+0+0 (secure 0 0 0) 0x7faa300a9ba0 con 0x7faa380c7e30 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.566+0000 7faa3d267640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa2406b500 0x7faa2406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.566+0000 7faa3d267640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa2406b500 0x7faa2406d9c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7faa28004dc0 tx=0x7faa28006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.570+0000 7faa35ffb640 1 -- 172.21.15.55:0/1829921253 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faa3004a020 con 0x7faa380c7e30 2024-04-25T08:59:22.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:22.750+0000 7faa3f4cb640 1 -- 172.21.15.55:0/1829921253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa380b7870 con 0x7faa380c7e30 2024-04-25T08:59:23.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.394+0000 7faa35ffb640 1 -- 172.21.15.55:0/1829921253 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) v1 ==== 181+0+0 (secure 0 0 0) 0x7faa300781b0 con 0x7faa380c7e30 2024-04-25T08:59:23.383 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:59:23.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.397+0000 7faa3f4cb640 1 -- 172.21.15.55:0/1829921253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa2406b500 msgr2=0x7faa2406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:23.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.397+0000 7faa3f4cb640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa2406b500 0x7faa2406d9c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7faa28004dc0 tx=0x7faa28006040 comp rx=0 tx=0).stop 2024-04-25T08:59:23.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.397+0000 7faa3f4cb640 1 -- 172.21.15.55:0/1829921253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa380c7e30 msgr2=0x7faa380b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:23.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.397+0000 7faa3f4cb640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa380c7e30 0x7faa380b63d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7faa30009af0 tx=0x7faa30004730 comp rx=0 tx=0).stop 2024-04-25T08:59:23.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.397+0000 7faa3f4cb640 1 -- 172.21.15.55:0/1829921253 shutdown_connections 2024-04-25T08:59:23.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.397+0000 7faa3f4cb640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faa2406b500 0x7faa2406d9c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.397+0000 7faa3f4cb640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa380c7e30 0x7faa380b63d0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.397+0000 7faa3f4cb640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa380cb1b0 0x7faa3815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.397+0000 7faa3f4cb640 1 --2- 172.21.15.55:0/1829921253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20004d40 0x7faa380b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.397+0000 7faa3f4cb640 1 -- 172.21.15.55:0/1829921253 >> 172.21.15.55:0/1829921253 conn(0x7faa3806f4c0 msgr2=0x7faa380b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:23.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.398+0000 7faa3f4cb640 1 -- 172.21.15.55:0/1829921253 shutdown_connections 2024-04-25T08:59:23.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.398+0000 7faa3f4cb640 1 -- 172.21.15.55:0/1829921253 wait complete. 2024-04-25T08:59:23.401 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:59:23.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.522+0000 7fe4365d5640 1 Processor -- start 2024-04-25T08:59:23.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.522+0000 7fe4365d5640 1 -- start start 2024-04-25T08:59:23.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.523+0000 7fe4365d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4300b35e0 0x7fe430162350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:23.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.523+0000 7fe4365d5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe430161400 0x7fe4300cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:23.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.523+0000 7fe4365d5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4300cfed0 con 0x7fe4300b3f80 2024-04-25T08:59:23.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.523+0000 7fe4365d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe430162890 con 0x7fe4300b35e0 2024-04-25T08:59:23.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.523+0000 7fe4365d5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4300cf850 con 0x7fe430161400 2024-04-25T08:59:23.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.523+0000 7fe42ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4300b35e0 0x7fe430162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:23.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.523+0000 7fe42ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4300b35e0 0x7fe430162350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41540/0 (socket says 172.21.15.55:41540) 2024-04-25T08:59:23.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.523+0000 7fe42ffff640 1 -- 172.21.15.55:0/1565549960 learned_addr learned my addr 172.21.15.55:0/1565549960 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:23.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.524+0000 7fe434b72640 1 --2- 172.21.15.55:0/1565549960 >> v2:172.21.15.167:3300/0 conn(0x7fe430161400 0x7fe4300cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:23.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.524+0000 7fe42ffff640 1 -- 172.21.15.55:0/1565549960 >> v2:172.21.15.167:3300/0 conn(0x7fe430161400 msgr2=0x7fe4300cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:23.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.524+0000 7fe42ffff640 1 --2- 172.21.15.55:0/1565549960 >> v2:172.21.15.167:3300/0 conn(0x7fe430161400 0x7fe4300cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.524+0000 7fe42ffff640 1 -- 172.21.15.55:0/1565549960 >> v1:172.21.15.167:6789/0 conn(0x7fe4300b3f80 legacy=0x7fe430160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:23.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.524+0000 7fe42ffff640 1 -- 172.21.15.55:0/1565549960 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4300cfb30 con 0x7fe4300b35e0 2024-04-25T08:59:23.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.524+0000 7fe42ffff640 1 --2- 172.21.15.55:0/1565549960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4300b35e0 0x7fe430162350 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe4300732a0 tx=0x7fe42002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bf34f28f5eae9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:23.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.525+0000 7fe42effd640 1 -- 172.21.15.55:0/1565549960 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420037070 con 0x7fe4300b35e0 2024-04-25T08:59:23.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.525+0000 7fe42effd640 1 -- 172.21.15.55:0/1565549960 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe420032440 con 0x7fe4300b35e0 2024-04-25T08:59:23.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.525+0000 7fe42effd640 1 -- 172.21.15.55:0/1565549960 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420032810 con 0x7fe4300b35e0 2024-04-25T08:59:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.525+0000 7fe4365d5640 1 -- 172.21.15.55:0/1565549960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4300b35e0 msgr2=0x7fe430162350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.525+0000 7fe4365d5640 1 --2- 172.21.15.55:0/1565549960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4300b35e0 0x7fe430162350 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe4300732a0 tx=0x7fe42002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.525+0000 7fe4365d5640 1 -- 172.21.15.55:0/1565549960 shutdown_connections 2024-04-25T08:59:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.525+0000 7fe4365d5640 1 --2- 172.21.15.55:0/1565549960 >> v2:172.21.15.167:3300/0 conn(0x7fe430161400 0x7fe4300cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.525+0000 7fe4365d5640 1 --2- 172.21.15.55:0/1565549960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4300b35e0 0x7fe430162350 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.525+0000 7fe4365d5640 1 -- 172.21.15.55:0/1565549960 >> 172.21.15.55:0/1565549960 conn(0x7fe43006f4c0 msgr2=0x7fe43006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.525+0000 7fe4365d5640 1 -- 172.21.15.55:0/1565549960 shutdown_connections 2024-04-25T08:59:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.525+0000 7fe4365d5640 1 -- 172.21.15.55:0/1565549960 wait complete. 2024-04-25T08:59:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.526+0000 7fe4365d5640 1 Processor -- start 2024-04-25T08:59:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.527+0000 7fe4365d5640 1 -- start start 2024-04-25T08:59:23.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.527+0000 7fe4365d5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4300b35e0 0x7fe4301f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:23.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.527+0000 7fe4365d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4300b3f80 0x7fe4300c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.527+0000 7fe4365d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe430161400 0x7fe4300ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.527+0000 7fe4365d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4300d05d0 con 0x7fe4300b3f80 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.527+0000 7fe4365d5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4300d0450 con 0x7fe4300b35e0 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.527+0000 7fe4365d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4300b39c0 con 0x7fe430161400 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.527+0000 7fe42f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4300b3f80 0x7fe4300c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.527+0000 7fe42f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4300b3f80 0x7fe4300c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41554/0 (socket says 172.21.15.55:41554) 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.527+0000 7fe42f7fe640 1 -- 172.21.15.55:0/3200956167 learned_addr learned my addr 172.21.15.55:0/3200956167 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe42ffff640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4300b35e0 0x7fe4301f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe434b72640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe430161400 0x7fe4300ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe42f7fe640 1 -- 172.21.15.55:0/3200956167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe430161400 msgr2=0x7fe4300ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe42f7fe640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe430161400 0x7fe4300ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe42f7fe640 1 -- 172.21.15.55:0/3200956167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4300b35e0 msgr2=0x7fe4301f79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe42f7fe640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4300b35e0 0x7fe4301f79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe42f7fe640 1 -- 172.21.15.55:0/3200956167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4300b7400 con 0x7fe4300b3f80 2024-04-25T08:59:23.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe42ffff640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4300b35e0 0x7fe4301f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:23.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe42f7fe640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4300b3f80 0x7fe4300c81f0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c430 tx=0x7fe42400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:23.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe42cff9640 1 -- 172.21.15.55:0/3200956167 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424011790 con 0x7fe4300b3f80 2024-04-25T08:59:23.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe42cff9640 1 -- 172.21.15.55:0/3200956167 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424017070 con 0x7fe4300b3f80 2024-04-25T08:59:23.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe42cff9640 1 -- 172.21.15.55:0/3200956167 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424011bb0 con 0x7fe4300b3f80 2024-04-25T08:59:23.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe4365d5640 1 -- 172.21.15.55:0/3200956167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43014a740 con 0x7fe4300b3f80 2024-04-25T08:59:23.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.528+0000 7fe4365d5640 1 -- 172.21.15.55:0/3200956167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43015bd70 con 0x7fe4300b3f80 2024-04-25T08:59:23.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.529+0000 7fe4365d5640 1 -- 172.21.15.55:0/3200956167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4300750b0 con 0x7fe4300b3f80 2024-04-25T08:59:23.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.530+0000 7fe42cff9640 1 -- 172.21.15.55:0/3200956167 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe42401c460 con 0x7fe4300b3f80 2024-04-25T08:59:23.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.530+0000 7fe42cff9640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe41c06b4d0 0x7fe41c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:23.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.530+0000 7fe42cff9640 1 -- 172.21.15.55:0/3200956167 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5501+0+0 (secure 0 0 0) 0x7fe42408a050 con 0x7fe4300b3f80 2024-04-25T08:59:23.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.530+0000 7fe42ffff640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe41c06b4d0 0x7fe41c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:23.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.531+0000 7fe42ffff640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe41c06b4d0 0x7fe41c06d990 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe420034000 tx=0x7fe42002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:23.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.534+0000 7fe42cff9640 1 -- 172.21.15.55:0/3200956167 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe424058fb0 con 0x7fe4300b3f80 2024-04-25T08:59:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:23.715+0000 7fe4365d5640 1 -- 172.21.15.55:0/3200956167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe4300b7870 con 0x7fe4300b3f80 2024-04-25T08:59:24.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.403+0000 7fe42cff9640 1 -- 172.21.15.55:0/3200956167 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe4240588b0 con 0x7fe4300b3f80 2024-04-25T08:59:24.392 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-25T08:59:24.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.406+0000 7fe4365d5640 1 -- 172.21.15.55:0/3200956167 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe41c06b4d0 msgr2=0x7fe41c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.406+0000 7fe4365d5640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe41c06b4d0 0x7fe41c06d990 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe420034000 tx=0x7fe42002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.406+0000 7fe4365d5640 1 -- 172.21.15.55:0/3200956167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4300b3f80 msgr2=0x7fe4300c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.406+0000 7fe4365d5640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4300b3f80 0x7fe4300c81f0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c430 tx=0x7fe42400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.407+0000 7fe4365d5640 1 -- 172.21.15.55:0/3200956167 shutdown_connections 2024-04-25T08:59:24.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.407+0000 7fe4365d5640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe41c06b4d0 0x7fe41c06d990 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.407+0000 7fe4365d5640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe430161400 0x7fe4300ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.407+0000 7fe4365d5640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4300b3f80 0x7fe4300c81f0 secure :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c430 tx=0x7fe42400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.407+0000 7fe4365d5640 1 --2- 172.21.15.55:0/3200956167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4300b35e0 0x7fe4301f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.407+0000 7fe4365d5640 1 -- 172.21.15.55:0/3200956167 >> 172.21.15.55:0/3200956167 conn(0x7fe43006f4c0 msgr2=0x7fe43006d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:24.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.410+0000 7fe4365d5640 1 -- 172.21.15.55:0/3200956167 shutdown_connections 2024-04-25T08:59:24.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.410+0000 7fe4365d5640 1 -- 172.21.15.55:0/3200956167 wait complete. 2024-04-25T08:59:24.416 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:59:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.536+0000 7f969d57d640 1 Processor -- start 2024-04-25T08:59:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.536+0000 7f969d57d640 1 -- start start 2024-04-25T08:59:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f969d57d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f969815dbb0 0x7f96980b9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f969d57d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96980d1e20 0x7f96980b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f969d57d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f96980b5aa0 0x7f969806c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f969d57d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96980d2670 con 0x7f96980d1e20 2024-04-25T08:59:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f969d57d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96980d2950 con 0x7f96980b5aa0 2024-04-25T08:59:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f969d57d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96980d2c30 con 0x7f969815dbb0 2024-04-25T08:59:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f968ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96980d1e20 0x7f96980b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f968ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96980d1e20 0x7f96980b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41564/0 (socket says 172.21.15.55:41564) 2024-04-25T08:59:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f968ffff640 1 -- 172.21.15.55:0/3869202505 learned_addr learned my addr 172.21.15.55:0/3869202505 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f9696ffd640 1 --2- 172.21.15.55:0/3869202505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f969815dbb0 0x7f96980b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f96977fe640 1 --2- 172.21.15.55:0/3869202505 >> v2:172.21.15.167:3300/0 conn(0x7f96980b5aa0 0x7f969806c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f968ffff640 1 -- 172.21.15.55:0/3869202505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f969815dbb0 msgr2=0x7f96980b9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f968ffff640 1 --2- 172.21.15.55:0/3869202505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f969815dbb0 0x7f96980b9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f968ffff640 1 -- 172.21.15.55:0/3869202505 >> v2:172.21.15.167:3300/0 conn(0x7f96980b5aa0 msgr2=0x7f969806c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f968ffff640 1 --2- 172.21.15.55:0/3869202505 >> v2:172.21.15.167:3300/0 conn(0x7f96980b5aa0 0x7f969806c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f968ffff640 1 -- 172.21.15.55:0/3869202505 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980d2f10 con 0x7f96980d1e20 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f9696ffd640 1 --2- 172.21.15.55:0/3869202505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f969815dbb0 0x7f96980b9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.537+0000 7f96977fe640 1 --2- 172.21.15.55:0/3869202505 >> v2:172.21.15.167:3300/0 conn(0x7f96980b5aa0 0x7f969806c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.538+0000 7f968ffff640 1 --2- 172.21.15.55:0/3869202505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96980d1e20 0x7f96980b5560 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f96980d2b60 tx=0x7f968002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba584a750bf1b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.538+0000 7f96967fc640 1 -- 172.21.15.55:0/3869202505 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680037070 con 0x7f96980d1e20 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.538+0000 7f96967fc640 1 -- 172.21.15.55:0/3869202505 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9680032440 con 0x7f96980d1e20 2024-04-25T08:59:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.538+0000 7f96967fc640 1 -- 172.21.15.55:0/3869202505 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680032810 con 0x7f96980d1e20 2024-04-25T08:59:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.539+0000 7f969d57d640 1 -- 172.21.15.55:0/3869202505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96980d1e20 msgr2=0x7f96980b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.539+0000 7f969d57d640 1 --2- 172.21.15.55:0/3869202505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96980d1e20 0x7f96980b5560 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f96980d2b60 tx=0x7f968002a1c0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.539+0000 7f969d57d640 1 -- 172.21.15.55:0/3869202505 shutdown_connections 2024-04-25T08:59:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.539+0000 7f969d57d640 1 --2- 172.21.15.55:0/3869202505 >> v2:172.21.15.167:3300/0 conn(0x7f96980b5aa0 0x7f969806c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.539+0000 7f969d57d640 1 --2- 172.21.15.55:0/3869202505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96980d1e20 0x7f96980b5560 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.539+0000 7f969d57d640 1 --2- 172.21.15.55:0/3869202505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f969815dbb0 0x7f96980b9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.539+0000 7f969d57d640 1 -- 172.21.15.55:0/3869202505 >> 172.21.15.55:0/3869202505 conn(0x7f96980d0560 msgr2=0x7f96980d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.539+0000 7f969d57d640 1 -- 172.21.15.55:0/3869202505 shutdown_connections 2024-04-25T08:59:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.539+0000 7f969d57d640 1 -- 172.21.15.55:0/3869202505 wait complete. 2024-04-25T08:59:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.540+0000 7f969d57d640 1 Processor -- start 2024-04-25T08:59:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.540+0000 7f969d57d640 1 -- start start 2024-04-25T08:59:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f969d57d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96980b5aa0 0x7f969815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f969d57d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96980d1e20 0x7f96981e4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f969d57d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f969815dbb0 0x7f96981e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f969d57d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969815e110 con 0x7f96980b5aa0 2024-04-25T08:59:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f969d57d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969815df90 con 0x7f96980d1e20 2024-04-25T08:59:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f969d57d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96980d2260 con 0x7f969815dbb0 2024-04-25T08:59:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f9696ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96980b5aa0 0x7f969815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f9696ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96980b5aa0 0x7f969815c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41576/0 (socket says 172.21.15.55:41576) 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f9696ffd640 1 -- 172.21.15.55:0/4068886086 learned_addr learned my addr 172.21.15.55:0/4068886086 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f96977fe640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f969815dbb0 0x7f96981e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f968ffff640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96980d1e20 0x7f96981e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f9696ffd640 1 -- 172.21.15.55:0/4068886086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f969815dbb0 msgr2=0x7f96981e4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f9696ffd640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f969815dbb0 0x7f96981e4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f9696ffd640 1 -- 172.21.15.55:0/4068886086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96980d1e20 msgr2=0x7f96981e4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f9696ffd640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96980d1e20 0x7f96981e4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f9696ffd640 1 -- 172.21.15.55:0/4068886086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980cbe10 con 0x7f96980b5aa0 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f9696ffd640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96980b5aa0 0x7f969815c8c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f968800c7f0 tx=0x7f968800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f968f7fe640 1 -- 172.21.15.55:0/4068886086 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688015070 con 0x7f96980b5aa0 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f968f7fe640 1 -- 172.21.15.55:0/4068886086 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688007820 con 0x7f96980b5aa0 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f969d57d640 1 -- 172.21.15.55:0/4068886086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96980cc0f0 con 0x7f96980b5aa0 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f968f7fe640 1 -- 172.21.15.55:0/4068886086 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688007bd0 con 0x7f96980b5aa0 2024-04-25T08:59:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.541+0000 7f969d57d640 1 -- 172.21.15.55:0/4068886086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96980cc6b0 con 0x7f96980b5aa0 2024-04-25T08:59:24.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.542+0000 7f969d57d640 1 -- 172.21.15.55:0/4068886086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96980750b0 con 0x7f96980b5aa0 2024-04-25T08:59:24.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.543+0000 7f968f7fe640 1 -- 172.21.15.55:0/4068886086 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9688018070 con 0x7f96980b5aa0 2024-04-25T08:59:24.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.543+0000 7f968f7fe640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f967806b4d0 0x7f967806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.544+0000 7f968ffff640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f967806b4d0 0x7f967806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.544+0000 7f968f7fe640 1 -- 172.21.15.55:0/4068886086 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f968808a040 con 0x7f96980b5aa0 2024-04-25T08:59:24.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.544+0000 7f968ffff640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f967806b4d0 0x7f967806d990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9680034000 tx=0x7f968002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.548+0000 7f968f7fe640 1 -- 172.21.15.55:0/4068886086 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f96880591f0 con 0x7f96980b5aa0 2024-04-25T08:59:24.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.729+0000 7f969d57d640 1 -- 172.21.15.55:0/4068886086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f96980ca0c0 con 0x7f96980b5aa0 2024-04-25T08:59:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.732+0000 7f968f7fe640 1 -- 172.21.15.55:0/4068886086 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9688058af0 con 0x7f96980b5aa0 2024-04-25T08:59:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.734+0000 7f969d57d640 1 -- 172.21.15.55:0/4068886086 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f967806b4d0 msgr2=0x7f967806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.734+0000 7f969d57d640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f967806b4d0 0x7f967806d990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9680034000 tx=0x7f968002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.734+0000 7f969d57d640 1 -- 172.21.15.55:0/4068886086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96980b5aa0 msgr2=0x7f969815c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.734+0000 7f969d57d640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96980b5aa0 0x7f969815c8c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f968800c7f0 tx=0x7f968800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.734+0000 7f969d57d640 1 -- 172.21.15.55:0/4068886086 shutdown_connections 2024-04-25T08:59:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.734+0000 7f969d57d640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f967806b4d0 0x7f967806d990 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.734+0000 7f969d57d640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f969815dbb0 0x7f96981e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.734+0000 7f969d57d640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96980d1e20 0x7f96981e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.734+0000 7f969d57d640 1 --2- 172.21.15.55:0/4068886086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96980b5aa0 0x7f969815c8c0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.735+0000 7f969d57d640 1 -- 172.21.15.55:0/4068886086 >> 172.21.15.55:0/4068886086 conn(0x7f96980d0560 msgr2=0x7f96980d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.735+0000 7f969d57d640 1 -- 172.21.15.55:0/4068886086 shutdown_connections 2024-04-25T08:59:24.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.735+0000 7f969d57d640 1 -- 172.21.15.55:0/4068886086 wait complete. 2024-04-25T08:59:24.734 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T08:59:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.847+0000 7f8c9e37e640 1 Processor -- start 2024-04-25T08:59:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.847+0000 7f8c9e37e640 1 -- start start 2024-04-25T08:59:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9e37e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c980d35b0 0x7f8c980b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9e37e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c980b5990 0x7f8c980b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9e37e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9815e0c0 con 0x7f8c9815dce0 2024-04-25T08:59:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9e37e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c980b5de0 con 0x7f8c980b5990 2024-04-25T08:59:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9e37e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980d2510 con 0x7f8c980d35b0 2024-04-25T08:59:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9c91b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c980b5990 0x7f8c980b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9c91b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c980b5990 0x7f8c980b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41582/0 (socket says 172.21.15.55:41582) 2024-04-25T08:59:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c97fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8c9815dce0 0x7f8c980d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32948/0 (socket says 172.21.15.55:32948) 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9c91b640 1 -- 172.21.15.55:0/3320541869 learned_addr learned my addr 172.21.15.55:0/3320541869 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9c91b640 1 -- 172.21.15.55:0/3320541869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c980d35b0 msgr2=0x7f8c980b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9c91b640 1 --2- 172.21.15.55:0/3320541869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c980d35b0 0x7f8c980b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9c91b640 1 -- 172.21.15.55:0/3320541869 >> v1:172.21.15.55:6789/0 conn(0x7f8c9815dce0 legacy=0x7f8c980d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c96ffd640 1 -- 172.21.15.55:0/3320541869 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289956744 0 0) 0x7f8c9815e0c0 con 0x7f8c9815dce0 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.848+0000 7f8c9c91b640 1 -- 172.21.15.55:0/3320541869 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c980d27f0 con 0x7f8c980b5990 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c9c91b640 1 --2- 172.21.15.55:0/3320541869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c980b5990 0x7f8c980b6b00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009e50 tx=0x7f8c9002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6daf9aee91488ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c96ffd640 1 -- 172.21.15.55:0/3320541869 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90036070 con 0x7f8c980b5990 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c96ffd640 1 -- 172.21.15.55:0/3320541869 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c90031600 con 0x7f8c980b5990 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c96ffd640 1 -- 172.21.15.55:0/3320541869 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c900319d0 con 0x7f8c980b5990 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c9e37e640 1 -- 172.21.15.55:0/3320541869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c980b5990 msgr2=0x7f8c980b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c9e37e640 1 --2- 172.21.15.55:0/3320541869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c980b5990 0x7f8c980b6b00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009e50 tx=0x7f8c9002a710 comp rx=0 tx=0).stop 2024-04-25T08:59:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c9e37e640 1 -- 172.21.15.55:0/3320541869 shutdown_connections 2024-04-25T08:59:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c9e37e640 1 --2- 172.21.15.55:0/3320541869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c980d35b0 0x7f8c980b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c9e37e640 1 --2- 172.21.15.55:0/3320541869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c980b5990 0x7f8c980b6b00 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c9e37e640 1 -- 172.21.15.55:0/3320541869 >> 172.21.15.55:0/3320541869 conn(0x7f8c98072900 msgr2=0x7f8c980d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c9e37e640 1 -- 172.21.15.55:0/3320541869 shutdown_connections 2024-04-25T08:59:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.849+0000 7f8c9e37e640 1 -- 172.21.15.55:0/3320541869 wait complete. 2024-04-25T08:59:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.851+0000 7f8c9e37e640 1 Processor -- start 2024-04-25T08:59:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.851+0000 7f8c9e37e640 1 -- start start 2024-04-25T08:59:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.851+0000 7f8c9e37e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c980b5990 0x7f8c980c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.851+0000 7f8c9e37e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c980d35b0 0x7f8c980b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.851+0000 7f8c9e37e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9815dce0 0x7f8c980c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.851+0000 7f8c9e37e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980d3090 con 0x7f8c980d35b0 2024-04-25T08:59:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.851+0000 7f8c9e37e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980d2db0 con 0x7f8c980b5990 2024-04-25T08:59:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.851+0000 7f8c9e37e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980d2160 con 0x7f8c9815dce0 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c980d35b0 0x7f8c980b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c980d35b0 0x7f8c980b4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41586/0 (socket says 172.21.15.55:41586) 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c977fe640 1 -- 172.21.15.55:0/1118896641 learned_addr learned my addr 172.21.15.55:0/1118896641 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c977fe640 1 -- 172.21.15.55:0/1118896641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9815dce0 msgr2=0x7f8c980c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c9c91b640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9815dce0 0x7f8c980c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c97fff640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c980b5990 0x7f8c980c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c977fe640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9815dce0 0x7f8c980c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c977fe640 1 -- 172.21.15.55:0/1118896641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c980b5990 msgr2=0x7f8c980c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c977fe640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c980b5990 0x7f8c980c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c977fe640 1 -- 172.21.15.55:0/1118896641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c980c99a0 con 0x7f8c980d35b0 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c9c91b640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9815dce0 0x7f8c980c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c97fff640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c980b5990 0x7f8c980c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c977fe640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c980d35b0 0x7f8c980b4840 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00b4a0 tx=0x7f8c8c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c94ff9640 1 -- 172.21.15.55:0/1118896641 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c014070 con 0x7f8c980d35b0 2024-04-25T08:59:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c94ff9640 1 -- 172.21.15.55:0/1118896641 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c010610 con 0x7f8c980d35b0 2024-04-25T08:59:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c9e37e640 1 -- 172.21.15.55:0/1118896641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c980c76d0 con 0x7f8c980d35b0 2024-04-25T08:59:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c94ff9640 1 -- 172.21.15.55:0/1118896641 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c010a00 con 0x7f8c980d35b0 2024-04-25T08:59:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.852+0000 7f8c9e37e640 1 -- 172.21.15.55:0/1118896641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c980c7c90 con 0x7f8c980d35b0 2024-04-25T08:59:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.853+0000 7f8c9e37e640 1 -- 172.21.15.55:0/1118896641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c980749b0 con 0x7f8c980d35b0 2024-04-25T08:59:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.854+0000 7f8c94ff9640 1 -- 172.21.15.55:0/1118896641 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c8c017070 con 0x7f8c980d35b0 2024-04-25T08:59:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.854+0000 7f8c94ff9640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c8406b4d0 0x7f8c8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.854+0000 7f8c94ff9640 1 -- 172.21.15.55:0/1118896641 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8c8c0899a0 con 0x7f8c980d35b0 2024-04-25T08:59:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.854+0000 7f8c97fff640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c8406b4d0 0x7f8c8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.855+0000 7f8c97fff640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c8406b4d0 0x7f8c8406d990 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8c88000f60 tx=0x7f8c88009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:24.858+0000 7f8c94ff9640 1 -- 172.21.15.55:0/1118896641 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c8c058ac0 con 0x7f8c980d35b0 2024-04-25T08:59:25.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.110+0000 7f8c9e37e640 1 -- 172.21.15.55:0/1118896641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7f8c980c7e60 con 0x7f8c980d35b0 2024-04-25T08:59:25.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.411+0000 7f8c94ff9640 1 -- 172.21.15.55:0/1118896641 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v285) v1 ==== 166+0+0 (secure 0 0 0) 0x7f8c8c0583c0 con 0x7f8c980d35b0 2024-04-25T08:59:25.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 -- 172.21.15.55:0/1118896641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c8406b4d0 msgr2=0x7f8c8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c8406b4d0 0x7f8c8406d990 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8c88000f60 tx=0x7f8c88009040 comp rx=0 tx=0).stop 2024-04-25T08:59:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 -- 172.21.15.55:0/1118896641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c980d35b0 msgr2=0x7f8c980b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c980d35b0 0x7f8c980b4840 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00b4a0 tx=0x7f8c8c00b960 comp rx=0 tx=0).stop 2024-04-25T08:59:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 -- 172.21.15.55:0/1118896641 shutdown_connections 2024-04-25T08:59:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c8406b4d0 0x7f8c8406d990 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9815dce0 0x7f8c980c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c980d35b0 0x7f8c980b4840 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 --2- 172.21.15.55:0/1118896641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c980b5990 0x7f8c980c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 -- 172.21.15.55:0/1118896641 >> 172.21.15.55:0/1118896641 conn(0x7f8c98072900 msgr2=0x7f8c980b8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 -- 172.21.15.55:0/1118896641 shutdown_connections 2024-04-25T08:59:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.413+0000 7f8c9e37e640 1 -- 172.21.15.55:0/1118896641 wait complete. 2024-04-25T08:59:25.414 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T08:59:25.414 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T08:59:25.414 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T08:59:25.414 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.527+0000 7f4811dd5640 1 Processor -- start 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.527+0000 7f4811dd5640 1 -- start start 2024-04-25T08:59:25.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.528+0000 7f4811dd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c0d35b0 0x7f480c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.528+0000 7f4811dd5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f480c0b5990 0x7f480c0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.528+0000 7f4811dd5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480c15e0c0 con 0x7f480c15dce0 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.528+0000 7f4811dd5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480c0b5de0 con 0x7f480c0b5990 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.528+0000 7f4811dd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0d2510 con 0x7f480c0d35b0 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480affd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c0d35b0 0x7f480c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f480c0b5990 0x7f480c0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f480c0b5990 0x7f480c0b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:50718/0 (socket says 172.21.15.55:50718) 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f480c15dce0 0x7f480c0d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:40634/0 (socket says 172.21.15.55:40634) 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480affd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c0d35b0 0x7f480c0b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:59496/0 (socket says 172.21.15.55:59496) 2024-04-25T08:59:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480bfff640 1 -- 172.21.15.55:0/2507272631 learned_addr learned my addr 172.21.15.55:0/2507272631 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480bfff640 1 -- 172.21.15.55:0/2507272631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c0d35b0 msgr2=0x7f480c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480bfff640 1 --2- 172.21.15.55:0/2507272631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c0d35b0 0x7f480c0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480bfff640 1 -- 172.21.15.55:0/2507272631 >> v1:172.21.15.167:6789/0 conn(0x7f480c15dce0 legacy=0x7f480c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480bfff640 1 -- 172.21.15.55:0/2507272631 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c0d27f0 con 0x7f480c0b5990 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480a7fc640 1 -- 172.21.15.55:0/2507272631 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983235977 0 0) 0x7f480c15e0c0 con 0x7f480c15dce0 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.529+0000 7f480affd640 1 --2- 172.21.15.55:0/2507272631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c0d35b0 0x7f480c0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.530+0000 7f480bfff640 1 --2- 172.21.15.55:0/2507272631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f480c0b5990 0x7f480c0b6b00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4804009e50 tx=0x7f480402a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6445bf58ad4f3cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.530+0000 7f480a7fc640 1 -- 172.21.15.55:0/2507272631 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804036070 con 0x7f480c0b5990 2024-04-25T08:59:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.530+0000 7f480a7fc640 1 -- 172.21.15.55:0/2507272631 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804031600 con 0x7f480c0b5990 2024-04-25T08:59:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.530+0000 7f480a7fc640 1 -- 172.21.15.55:0/2507272631 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040319d0 con 0x7f480c0b5990 2024-04-25T08:59:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.531+0000 7f4811dd5640 1 -- 172.21.15.55:0/2507272631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f480c0b5990 msgr2=0x7f480c0b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.531+0000 7f4811dd5640 1 --2- 172.21.15.55:0/2507272631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f480c0b5990 0x7f480c0b6b00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4804009e50 tx=0x7f480402a730 comp rx=0 tx=0).stop 2024-04-25T08:59:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.531+0000 7f4811dd5640 1 -- 172.21.15.55:0/2507272631 shutdown_connections 2024-04-25T08:59:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.531+0000 7f4811dd5640 1 --2- 172.21.15.55:0/2507272631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f480c0b5990 0x7f480c0b6b00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.531+0000 7f4811dd5640 1 --2- 172.21.15.55:0/2507272631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c0d35b0 0x7f480c0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.531+0000 7f4811dd5640 1 -- 172.21.15.55:0/2507272631 >> 172.21.15.55:0/2507272631 conn(0x7f480c072900 msgr2=0x7f480c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.531+0000 7f4811dd5640 1 -- 172.21.15.55:0/2507272631 shutdown_connections 2024-04-25T08:59:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.531+0000 7f4811dd5640 1 -- 172.21.15.55:0/2507272631 wait complete. 2024-04-25T08:59:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.532+0000 7f4811dd5640 1 Processor -- start 2024-04-25T08:59:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.532+0000 7f4811dd5640 1 -- start start 2024-04-25T08:59:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f4811dd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0b5990 0x7f480c160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f4811dd5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f480c0d35b0 0x7f480c154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f4811dd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c15dce0 0x7f480c153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f4811dd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0d3090 con 0x7f480c0b5990 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f4811dd5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0d2db0 con 0x7f480c0d35b0 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f4811dd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0d2160 con 0x7f480c15dce0 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f480b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0b5990 0x7f480c160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f480b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0b5990 0x7f480c160910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41592/0 (socket says 172.21.15.55:41592) 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f480b7fe640 1 -- 172.21.15.55:0/1988445747 learned_addr learned my addr 172.21.15.55:0/1988445747 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f480affd640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f480c0d35b0 0x7f480c154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f480bfff640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c15dce0 0x7f480c153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f480b7fe640 1 -- 172.21.15.55:0/1988445747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c15dce0 msgr2=0x7f480c153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f480b7fe640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c15dce0 0x7f480c153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f480b7fe640 1 -- 172.21.15.55:0/1988445747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f480c0d35b0 msgr2=0x7f480c154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f480b7fe640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f480c0d35b0 0x7f480c154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f480b7fe640 1 -- 172.21.15.55:0/1988445747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c15ee30 con 0x7f480c0b5990 2024-04-25T08:59:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.533+0000 7f480bfff640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c15dce0 0x7f480c153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.534+0000 7f480b7fe640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0b5990 0x7f480c160910 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00c430 tx=0x7f47fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.534+0000 7f47f3fff640 1 -- 172.21.15.55:0/1988445747 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0074e0 con 0x7f480c0b5990 2024-04-25T08:59:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.534+0000 7f47f3fff640 1 -- 172.21.15.55:0/1988445747 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc0047e0 con 0x7f480c0b5990 2024-04-25T08:59:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.534+0000 7f4811dd5640 1 -- 172.21.15.55:0/1988445747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c0c90c0 con 0x7f480c0b5990 2024-04-25T08:59:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.534+0000 7f47f3fff640 1 -- 172.21.15.55:0/1988445747 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc004bd0 con 0x7f480c0b5990 2024-04-25T08:59:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.534+0000 7f4811dd5640 1 -- 172.21.15.55:0/1988445747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480c0c9680 con 0x7f480c0b5990 2024-04-25T08:59:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.535+0000 7f4811dd5640 1 -- 172.21.15.55:0/1988445747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480c0749b0 con 0x7f480c0b5990 2024-04-25T08:59:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.535+0000 7f47f3fff640 1 -- 172.21.15.55:0/1988445747 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f47fc011070 con 0x7f480c0b5990 2024-04-25T08:59:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.536+0000 7f47f3fff640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f47f806b4d0 0x7f47f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.536+0000 7f47f3fff640 1 -- 172.21.15.55:0/1988445747 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f47fc089b10 con 0x7f480c0b5990 2024-04-25T08:59:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.536+0000 7f480affd640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f47f806b4d0 0x7f47f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.536+0000 7f480affd640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f47f806b4d0 0x7f47f806d990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f480c0c6cb0 tx=0x7f4800009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.540+0000 7f47f3fff640 1 -- 172.21.15.55:0/1988445747 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f480c15ee30 con 0x7f480c0b5990 2024-04-25T08:59:25.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.727+0000 7f4811dd5640 1 -- 172.21.15.55:0/1988445747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f480c0b6f40 con 0x7f480c0b5990 2024-04-25T08:59:25.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.728+0000 7f47f3fff640 1 -- 172.21.15.55:0/1988445747 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+13149 (secure 0 0 0) 0x7f47fc058c30 con 0x7f480c0b5990 2024-04-25T08:59:25.717 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:25.717 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:59:24.395158+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/2486130786":"2024-04-26T08:59:21.383347+0000","172.21.15.55:6835/2486130786":"2024-04-26T08:59:21.383347+0000","172.21.15.55:6837/173615501":"2024-04-26T08:58:03.267866+0000","172.21.15.55:6835/173615501":"2024-04-26T08:58:03.267866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:25.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.729+0000 7f4811dd5640 1 -- 172.21.15.55:0/1988445747 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f47f806b4d0 msgr2=0x7f47f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.729+0000 7f4811dd5640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f47f806b4d0 0x7f47f806d990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f480c0c6cb0 tx=0x7f4800009190 comp rx=0 tx=0).stop 2024-04-25T08:59:25.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.729+0000 7f4811dd5640 1 -- 172.21.15.55:0/1988445747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0b5990 msgr2=0x7f480c160910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.729+0000 7f4811dd5640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0b5990 0x7f480c160910 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00c430 tx=0x7f47fc00c8f0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.730+0000 7f4811dd5640 1 -- 172.21.15.55:0/1988445747 shutdown_connections 2024-04-25T08:59:25.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.730+0000 7f4811dd5640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f47f806b4d0 0x7f47f806d990 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.730+0000 7f4811dd5640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f480c15dce0 0x7f480c153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.730+0000 7f4811dd5640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f480c0d35b0 0x7f480c154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.730+0000 7f4811dd5640 1 --2- 172.21.15.55:0/1988445747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0b5990 0x7f480c160910 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.730+0000 7f4811dd5640 1 -- 172.21.15.55:0/1988445747 >> 172.21.15.55:0/1988445747 conn(0x7f480c072900 msgr2=0x7f480c0ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.730+0000 7f4811dd5640 1 -- 172.21.15.55:0/1988445747 shutdown_connections 2024-04-25T08:59:25.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.730+0000 7f4811dd5640 1 -- 172.21.15.55:0/1988445747 wait complete. 2024-04-25T08:59:25.730 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:59:25.730 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:59:25.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.845+0000 7fa5f7522640 1 Processor -- start 2024-04-25T08:59:25.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.845+0000 7fa5f7522640 1 -- start start 2024-04-25T08:59:25.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5f7522640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f00b5c00 0x7fa5f0168c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5f7522640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f01627a0 con 0x7fa5f015dc80 2024-04-25T08:59:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5f7522640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f01621e0 con 0x7fa5f00b97c0 2024-04-25T08:59:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5f7522640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0161f80 con 0x7fa5f00b5c00 2024-04-25T08:59:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5f52be640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa5f015dc80 0x7fa5f0161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32960/0 (socket says 172.21.15.55:32960) 2024-04-25T08:59:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5f52be640 1 -- 172.21.15.55:0/4044815939 learned_addr learned my addr 172.21.15.55:0/4044815939 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5f5abf640 1 --2- 172.21.15.55:0/4044815939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f00b5c00 0x7fa5f0168c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5e7fff640 1 -- 172.21.15.55:0/4044815939 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850994644 0 0) 0x7fa5f01627a0 con 0x7fa5f015dc80 2024-04-25T08:59:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5e7fff640 1 -- 172.21.15.55:0/4044815939 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5dc003520 con 0x7fa5f015dc80 2024-04-25T08:59:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5e7fff640 1 -- 172.21.15.55:0/4044815939 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113243764 0 0) 0x7fa5f01621e0 con 0x7fa5f00b97c0 2024-04-25T08:59:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5e7fff640 1 -- 172.21.15.55:0/4044815939 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f01627a0 con 0x7fa5f00b97c0 2024-04-25T08:59:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5e7fff640 1 -- 172.21.15.55:0/4044815939 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 827642557 0 0) 0x7fa5dc003520 con 0x7fa5f015dc80 2024-04-25T08:59:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5f5abf640 1 -- 172.21.15.55:0/4044815939 >> v1:172.21.15.167:6789/0 conn(0x7fa5f00b97c0 legacy=0x7fa5f00b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5f5abf640 1 -- 172.21.15.55:0/4044815939 >> v1:172.21.15.55:6789/0 conn(0x7fa5f015dc80 legacy=0x7fa5f0161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.846+0000 7fa5f5abf640 1 -- 172.21.15.55:0/4044815939 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f01624c0 con 0x7fa5f00b5c00 2024-04-25T08:59:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.847+0000 7fa5f5abf640 1 --2- 172.21.15.55:0/4044815939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f00b5c00 0x7fa5f0168c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009dc0 tx=0x7fa5e802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6fd6103ede5cfa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.847+0000 7fa5e7fff640 1 -- 172.21.15.55:0/4044815939 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec001670 con 0x7fa5f00b5c00 2024-04-25T08:59:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.847+0000 7fa5e7fff640 1 -- 172.21.15.55:0/4044815939 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8007540 con 0x7fa5f00b5c00 2024-04-25T08:59:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.847+0000 7fa5e7fff640 1 -- 172.21.15.55:0/4044815939 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80078f0 con 0x7fa5f00b5c00 2024-04-25T08:59:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.848+0000 7fa5f7522640 1 -- 172.21.15.55:0/4044815939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f00b5c00 msgr2=0x7fa5f0168c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.848+0000 7fa5f7522640 1 --2- 172.21.15.55:0/4044815939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f00b5c00 0x7fa5f0168c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009dc0 tx=0x7fa5e802a660 comp rx=0 tx=0).stop 2024-04-25T08:59:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.848+0000 7fa5f7522640 1 -- 172.21.15.55:0/4044815939 shutdown_connections 2024-04-25T08:59:25.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.848+0000 7fa5f7522640 1 --2- 172.21.15.55:0/4044815939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f00b5c00 0x7fa5f0168c00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.848+0000 7fa5f7522640 1 -- 172.21.15.55:0/4044815939 >> 172.21.15.55:0/4044815939 conn(0x7fa5f00d04f0 msgr2=0x7fa5f00d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:25.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.848+0000 7fa5f7522640 1 -- 172.21.15.55:0/4044815939 shutdown_connections 2024-04-25T08:59:25.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.848+0000 7fa5f7522640 1 -- 172.21.15.55:0/4044815939 wait complete. 2024-04-25T08:59:25.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.849+0000 7fa5f7522640 1 Processor -- start 2024-04-25T08:59:25.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.849+0000 7fa5f7522640 1 -- start start 2024-04-25T08:59:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f7522640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f00b5c00 0x7fa5f00cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f7522640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f00b97c0 0x7fa5f01e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f7522640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f015dc80 0x7fa5f01e8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f7522640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00d3480 con 0x7fa5f015dc80 2024-04-25T08:59:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f7522640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f015e060 con 0x7fa5f00b5c00 2024-04-25T08:59:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f7522640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00d3600 con 0x7fa5f00b97c0 2024-04-25T08:59:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f5abf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f015dc80 0x7fa5f01e8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f5abf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f015dc80 0x7fa5f01e8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41598/0 (socket says 172.21.15.55:41598) 2024-04-25T08:59:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f5abf640 1 -- 172.21.15.55:0/1065242785 learned_addr learned my addr 172.21.15.55:0/1065242785 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f52be640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f00b5c00 0x7fa5f00cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f4abd640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f00b97c0 0x7fa5f01e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f5abf640 1 -- 172.21.15.55:0/1065242785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f00b97c0 msgr2=0x7fa5f01e80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f5abf640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f00b97c0 0x7fa5f01e80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f5abf640 1 -- 172.21.15.55:0/1065242785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f00b5c00 msgr2=0x7fa5f00cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f5abf640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f00b5c00 0x7fa5f00cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f5abf640 1 -- 172.21.15.55:0/1065242785 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00c9280 con 0x7fa5f015dc80 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.850+0000 7fa5f52be640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f00b5c00 0x7fa5f00cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.851+0000 7fa5f5abf640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f015dc80 0x7fa5f01e8620 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009ee0 tx=0x7fa5e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.851+0000 7fa5e5ffb640 1 -- 172.21.15.55:0/1065242785 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e803f070 con 0x7fa5f015dc80 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.851+0000 7fa5e5ffb640 1 -- 172.21.15.55:0/1065242785 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8031c40 con 0x7fa5f015dc80 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.851+0000 7fa5f7522640 1 -- 172.21.15.55:0/1065242785 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00c9560 con 0x7fa5f015dc80 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.851+0000 7fa5e5ffb640 1 -- 172.21.15.55:0/1065242785 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8009450 con 0x7fa5f015dc80 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.851+0000 7fa5f7522640 1 -- 172.21.15.55:0/1065242785 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00c9b20 con 0x7fa5f015dc80 2024-04-25T08:59:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.852+0000 7fa5f7522640 1 -- 172.21.15.55:0/1065242785 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f00750b0 con 0x7fa5f015dc80 2024-04-25T08:59:25.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.852+0000 7fa5e5ffb640 1 -- 172.21.15.55:0/1065242785 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa5e8043410 con 0x7fa5f015dc80 2024-04-25T08:59:25.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.852+0000 7fa5e5ffb640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d406b500 0x7fa5d406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:25.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.852+0000 7fa5f52be640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d406b500 0x7fa5d406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:25.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.852+0000 7fa5e5ffb640 1 -- 172.21.15.55:0/1065242785 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa5e80ab220 con 0x7fa5f015dc80 2024-04-25T08:59:25.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.853+0000 7fa5f52be640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d406b500 0x7fa5d406d9c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0011e0 tx=0x7fa5ec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:25.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:25.856+0000 7fa5e5ffb640 1 -- 172.21.15.55:0/1065242785 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5e807a210 con 0x7fa5f015dc80 2024-04-25T08:59:26.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.037+0000 7fa5f7522640 1 -- 172.21.15.55:0/1065242785 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5f00ce050 con 0x7fa5f015dc80 2024-04-25T08:59:26.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.037+0000 7fa5e5ffb640 1 -- 172.21.15.55:0/1065242785 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5e80ab020 con 0x7fa5f015dc80 2024-04-25T08:59:26.027 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:59:26.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 -- 172.21.15.55:0/1065242785 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d406b500 msgr2=0x7fa5d406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:26.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d406b500 0x7fa5d406d9c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0011e0 tx=0x7fa5ec009040 comp rx=0 tx=0).stop 2024-04-25T08:59:26.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 -- 172.21.15.55:0/1065242785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f015dc80 msgr2=0x7fa5f01e8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:26.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f015dc80 0x7fa5f01e8620 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009ee0 tx=0x7fa5e8004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:26.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 -- 172.21.15.55:0/1065242785 shutdown_connections 2024-04-25T08:59:26.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa5d406b500 0x7fa5d406d9c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:26.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f015dc80 0x7fa5f01e8620 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:26.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f00b97c0 0x7fa5f01e80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:26.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 --2- 172.21.15.55:0/1065242785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f00b5c00 0x7fa5f00cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:26.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 -- 172.21.15.55:0/1065242785 >> 172.21.15.55:0/1065242785 conn(0x7fa5f00d04f0 msgr2=0x7fa5f00b70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:26.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 -- 172.21.15.55:0/1065242785 shutdown_connections 2024-04-25T08:59:26.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.039+0000 7fa5f7522640 1 -- 172.21.15.55:0/1065242785 wait complete. 2024-04-25T08:59:26.040 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T08:59:26.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.151+0000 7f396ec2a640 1 Processor -- start 2024-04-25T08:59:26.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.151+0000 7f396ec2a640 1 -- start start 2024-04-25T08:59:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f396ec2a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f396815dce0 0x7f39680d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f396ec2a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f39680d35b0 0x7f39680b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f396ec2a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396815e0c0 con 0x7f39680d1f90 2024-04-25T08:59:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f396ec2a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39680b7b10 con 0x7f39680d35b0 2024-04-25T08:59:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f396ec2a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39680d2510 con 0x7f396815dce0 2024-04-25T08:59:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f3967fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f39680d35b0 0x7f39680b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f396d1c7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f39680d1f90 0x7f396806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32966/0 (socket says 172.21.15.55:32966) 2024-04-25T08:59:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f396d1c7640 1 -- 172.21.15.55:0/1613038993 learned_addr learned my addr 172.21.15.55:0/1613038993 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f3967fff640 1 -- 172.21.15.55:0/1613038993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f396815dce0 msgr2=0x7f39680d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f396c9c6640 1 --2- 172.21.15.55:0/1613038993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f396815dce0 0x7f39680d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f3967fff640 1 --2- 172.21.15.55:0/1613038993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f396815dce0 0x7f39680d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f39677fe640 1 -- 172.21.15.55:0/1613038993 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835920685 0 0) 0x7f396815e0c0 con 0x7f39680d1f90 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f3967fff640 1 -- 172.21.15.55:0/1613038993 >> v1:172.21.15.55:6789/0 conn(0x7f39680d1f90 legacy=0x7f396806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f3967fff640 1 -- 172.21.15.55:0/1613038993 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39680d27f0 con 0x7f39680d35b0 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.152+0000 7f396c9c6640 1 --2- 172.21.15.55:0/1613038993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f396815dce0 0x7f39680d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.153+0000 7f3967fff640 1 --2- 172.21.15.55:0/1613038993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39680d35b0 0x7f39680b5450 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f395c0097a0 tx=0x7f395c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6906a18ec0ce2ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.153+0000 7f39677fe640 1 -- 172.21.15.55:0/1613038993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c037070 con 0x7f39680d35b0 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.153+0000 7f39677fe640 1 -- 172.21.15.55:0/1613038993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c02ae50 con 0x7f39680d35b0 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.153+0000 7f39677fe640 1 -- 172.21.15.55:0/1613038993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c032660 con 0x7f39680d35b0 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.154+0000 7f396ec2a640 1 -- 172.21.15.55:0/1613038993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39680d35b0 msgr2=0x7f39680b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.154+0000 7f396ec2a640 1 --2- 172.21.15.55:0/1613038993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39680d35b0 0x7f39680b5450 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f395c0097a0 tx=0x7f395c02a100 comp rx=0 tx=0).stop 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.154+0000 7f396ec2a640 1 -- 172.21.15.55:0/1613038993 shutdown_connections 2024-04-25T08:59:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.154+0000 7f396ec2a640 1 --2- 172.21.15.55:0/1613038993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39680d35b0 0x7f39680b5450 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.154+0000 7f396ec2a640 1 --2- 172.21.15.55:0/1613038993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f396815dce0 0x7f39680d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.154+0000 7f396ec2a640 1 -- 172.21.15.55:0/1613038993 >> 172.21.15.55:0/1613038993 conn(0x7f3968072900 msgr2=0x7f39680d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.154+0000 7f396ec2a640 1 -- 172.21.15.55:0/1613038993 shutdown_connections 2024-04-25T08:59:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.154+0000 7f396ec2a640 1 -- 172.21.15.55:0/1613038993 wait complete. 2024-04-25T08:59:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.155+0000 7f396ec2a640 1 Processor -- start 2024-04-25T08:59:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.155+0000 7f396ec2a640 1 -- start start 2024-04-25T08:59:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396ec2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39680d1f90 0x7f39680b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396ec2a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39680d35b0 0x7f396814d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396ec2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396815dce0 0x7f396814deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396ec2a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680d3090 con 0x7f39680d1f90 2024-04-25T08:59:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396ec2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680d2db0 con 0x7f396815dce0 2024-04-25T08:59:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396ec2a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39680b9820 con 0x7f39680d35b0 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396c9c6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39680d1f90 0x7f39680b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396c9c6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39680d1f90 0x7f39680b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41616/0 (socket says 172.21.15.55:41616) 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396c9c6640 1 -- 172.21.15.55:0/3189625283 learned_addr learned my addr 172.21.15.55:0/3189625283 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f3967fff640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39680d35b0 0x7f396814d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396d1c7640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396815dce0 0x7f396814deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396c9c6640 1 -- 172.21.15.55:0/3189625283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39680d35b0 msgr2=0x7f396814d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396c9c6640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39680d35b0 0x7f396814d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396c9c6640 1 -- 172.21.15.55:0/3189625283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396815dce0 msgr2=0x7f396814deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396c9c6640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396815dce0 0x7f396814deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f396c9c6640 1 -- 172.21.15.55:0/3189625283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39681f4610 con 0x7f39680d1f90 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.156+0000 7f3967fff640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39680d35b0 0x7f396814d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.157+0000 7f396c9c6640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39680d1f90 0x7f39680b46a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f395800c7f0 tx=0x7f395800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.157+0000 7f39657fa640 1 -- 172.21.15.55:0/3189625283 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958015070 con 0x7f39680d1f90 2024-04-25T08:59:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.157+0000 7f39657fa640 1 -- 172.21.15.55:0/3189625283 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958007a30 con 0x7f39680d1f90 2024-04-25T08:59:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.157+0000 7f396ec2a640 1 -- 172.21.15.55:0/3189625283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396815e3e0 con 0x7f39680d1f90 2024-04-25T08:59:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.157+0000 7f39657fa640 1 -- 172.21.15.55:0/3189625283 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958007e00 con 0x7f39680d1f90 2024-04-25T08:59:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.157+0000 7f396ec2a640 1 -- 172.21.15.55:0/3189625283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396815e9a0 con 0x7f39680d1f90 2024-04-25T08:59:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.158+0000 7f396ec2a640 1 -- 172.21.15.55:0/3189625283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39680d1a50 con 0x7f39680d1f90 2024-04-25T08:59:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.158+0000 7f39657fa640 1 -- 172.21.15.55:0/3189625283 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3958018070 con 0x7f39680d1f90 2024-04-25T08:59:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.159+0000 7f39657fa640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f395406b4d0 0x7f395406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.159+0000 7f39657fa640 1 -- 172.21.15.55:0/3189625283 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3958089e80 con 0x7f39680d1f90 2024-04-25T08:59:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.159+0000 7f3967fff640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f395406b4d0 0x7f395406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.159+0000 7f3967fff640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f395406b4d0 0x7f395406d990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f395c034000 tx=0x7f395c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:26.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.164+0000 7f39657fa640 1 -- 172.21.15.55:0/3189625283 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f39680d1a50 con 0x7f39680d1f90 2024-04-25T08:59:26.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:26.412+0000 7f396ec2a640 1 -- 172.21.15.55:0/3189625283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f39680749b0 con 0x7f39680d1f90 2024-04-25T08:59:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.420+0000 7f39657fa640 1 -- 172.21.15.55:0/3189625283 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v287) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3958059030 con 0x7f39680d1f90 2024-04-25T08:59:27.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 -- 172.21.15.55:0/3189625283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f395406b4d0 msgr2=0x7f395406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f395406b4d0 0x7f395406d990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f395c034000 tx=0x7f395c02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 -- 172.21.15.55:0/3189625283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39680d1f90 msgr2=0x7f39680b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39680d1f90 0x7f39680b46a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f395800c7f0 tx=0x7f395800cbf0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 -- 172.21.15.55:0/3189625283 shutdown_connections 2024-04-25T08:59:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f395406b4d0 0x7f395406d990 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396815dce0 0x7f396814deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39680d35b0 0x7f396814d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 --2- 172.21.15.55:0/3189625283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39680d1f90 0x7f39680b46a0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 -- 172.21.15.55:0/3189625283 >> 172.21.15.55:0/3189625283 conn(0x7f3968072900 msgr2=0x7f39680d3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 -- 172.21.15.55:0/3189625283 shutdown_connections 2024-04-25T08:59:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.423+0000 7f396ec2a640 1 -- 172.21.15.55:0/3189625283 wait complete. 2024-04-25T08:59:27.426 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:59:27.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.547+0000 7f5aec9a9640 1 Processor -- start 2024-04-25T08:59:27.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.547+0000 7f5aec9a9640 1 -- start start 2024-04-25T08:59:27.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.548+0000 7f5aec9a9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ae80d3b90 0x7f5ae80d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:27.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.548+0000 7f5aec9a9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ae80d0f60 0x7f5ae80b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:27.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.548+0000 7f5aec9a9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae80d4090 con 0x7f5ae815dca0 2024-04-25T08:59:27.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.548+0000 7f5aec9a9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae80b6b20 con 0x7f5ae80d3b90 2024-04-25T08:59:27.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.548+0000 7f5aec9a9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80d1390 con 0x7f5ae80d0f60 2024-04-25T08:59:27.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.548+0000 7f5ae5d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ae80d3b90 0x7f5ae80d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:27.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.548+0000 7f5ae6d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ae80d0f60 0x7f5ae80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:27.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.548+0000 7f5ae5d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ae80d3b90 0x7f5ae80d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:50760/0 (socket says 172.21.15.55:50760) 2024-04-25T08:59:27.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.548+0000 7f5ae5d9b640 1 -- 172.21.15.55:0/1092653307 learned_addr learned my addr 172.21.15.55:0/1092653307 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.549+0000 7f5ae6d9d640 1 -- 172.21.15.55:0/1092653307 >> v2:172.21.15.167:3300/0 conn(0x7f5ae80d3b90 msgr2=0x7f5ae80d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.549+0000 7f5ae6d9d640 1 --2- 172.21.15.55:0/1092653307 >> v2:172.21.15.167:3300/0 conn(0x7f5ae80d3b90 0x7f5ae80d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.549+0000 7f5ae6d9d640 1 -- 172.21.15.55:0/1092653307 >> v1:172.21.15.167:6789/0 conn(0x7f5ae815dca0 legacy=0x7f5ae80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.549+0000 7f5ae6d9d640 1 -- 172.21.15.55:0/1092653307 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80d4370 con 0x7f5ae80d0f60 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.549+0000 7f5ae559a640 1 -- 172.21.15.55:0/1092653307 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478946242 0 0) 0x7f5ae80d4090 con 0x7f5ae815dca0 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.549+0000 7f5ae5d9b640 1 --2- 172.21.15.55:0/1092653307 >> v2:172.21.15.167:3300/0 conn(0x7f5ae80d3b90 0x7f5ae80d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.550+0000 7f5ae6d9d640 1 --2- 172.21.15.55:0/1092653307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ae80d0f60 0x7f5ae80b2500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009d90 tx=0x7f5ae002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daaa0049b34d642d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.550+0000 7f5ae559a640 1 -- 172.21.15.55:0/1092653307 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0007740 con 0x7f5ae80d0f60 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.550+0000 7f5ae559a640 1 -- 172.21.15.55:0/1092653307 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae00078e0 con 0x7f5ae80d0f60 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.550+0000 7f5ae559a640 1 -- 172.21.15.55:0/1092653307 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0007cb0 con 0x7f5ae80d0f60 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.550+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1092653307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ae80d0f60 msgr2=0x7f5ae80b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.550+0000 7f5aec9a9640 1 --2- 172.21.15.55:0/1092653307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ae80d0f60 0x7f5ae80b2500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009d90 tx=0x7f5ae002a660 comp rx=0 tx=0).stop 2024-04-25T08:59:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.550+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1092653307 shutdown_connections 2024-04-25T08:59:27.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.550+0000 7f5aec9a9640 1 --2- 172.21.15.55:0/1092653307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ae80d0f60 0x7f5ae80b2500 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.550+0000 7f5aec9a9640 1 --2- 172.21.15.55:0/1092653307 >> v2:172.21.15.167:3300/0 conn(0x7f5ae80d3b90 0x7f5ae80d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.550+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1092653307 >> 172.21.15.55:0/1092653307 conn(0x7f5ae80726c0 msgr2=0x7f5ae8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:27.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.550+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1092653307 shutdown_connections 2024-04-25T08:59:27.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.551+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1092653307 wait complete. 2024-04-25T08:59:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.552+0000 7f5aec9a9640 1 Processor -- start 2024-04-25T08:59:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.552+0000 7f5aec9a9640 1 -- start start 2024-04-25T08:59:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5aec9a9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ae80d0f60 0x7f5ae80cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5aec9a9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ae80d3b90 0x7f5ae81f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5aec9a9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ae815dca0 0x7f5ae80ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5aec9a9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80cf050 con 0x7f5ae80d0f60 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5aec9a9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80b6d50 con 0x7f5ae815dca0 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5aec9a9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae815e080 con 0x7f5ae80d3b90 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ae659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ae80d0f60 0x7f5ae80cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ae659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ae80d0f60 0x7f5ae80cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41630/0 (socket says 172.21.15.55:41630) 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ae659c640 1 -- 172.21.15.55:0/1083897383 learned_addr learned my addr 172.21.15.55:0/1083897383 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ae5d9b640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ae80d3b90 0x7f5ae81f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ae6d9d640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ae815dca0 0x7f5ae80ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ae659c640 1 -- 172.21.15.55:0/1083897383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ae80d3b90 msgr2=0x7f5ae81f6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ae659c640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ae80d3b90 0x7f5ae81f6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ae659c640 1 -- 172.21.15.55:0/1083897383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ae815dca0 msgr2=0x7f5ae80ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ae659c640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ae815dca0 0x7f5ae80ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ae659c640 1 -- 172.21.15.55:0/1083897383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80cc310 con 0x7f5ae80d0f60 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ae659c640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ae80d0f60 0x7f5ae80cb650 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800c410 tx=0x7f5ad800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.553+0000 7f5ad6ffd640 1 -- 172.21.15.55:0/1083897383 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8017070 con 0x7f5ae80d0f60 2024-04-25T08:59:27.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.554+0000 7f5ad6ffd640 1 -- 172.21.15.55:0/1083897383 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad80035f0 con 0x7f5ae80d0f60 2024-04-25T08:59:27.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.554+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1083897383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae81f7530 con 0x7f5ae80d0f60 2024-04-25T08:59:27.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.554+0000 7f5ad6ffd640 1 -- 172.21.15.55:0/1083897383 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad80039e0 con 0x7f5ae80d0f60 2024-04-25T08:59:27.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.554+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1083897383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae81f77d0 con 0x7f5ae80d0f60 2024-04-25T08:59:27.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.554+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1083897383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae80750b0 con 0x7f5ae80d0f60 2024-04-25T08:59:27.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.555+0000 7f5ad6ffd640 1 -- 172.21.15.55:0/1083897383 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5ad801a070 con 0x7f5ae80d0f60 2024-04-25T08:59:27.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.555+0000 7f5ad6ffd640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac806b500 0x7f5ac806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:27.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.556+0000 7f5ae5d9b640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac806b500 0x7f5ac806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:27.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.556+0000 7f5ad6ffd640 1 -- 172.21.15.55:0/1083897383 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5ad8089230 con 0x7f5ae80d0f60 2024-04-25T08:59:27.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.556+0000 7f5ae5d9b640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac806b500 0x7f5ac806d9c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80cbc90 tx=0x7f5adc009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:27.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.560+0000 7f5ad6ffd640 1 -- 172.21.15.55:0/1083897383 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5ad8057d90 con 0x7f5ae80d0f60 2024-04-25T08:59:27.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.746+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1083897383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5ae80b7c20 con 0x7f5ae80d0f60 2024-04-25T08:59:27.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.754+0000 7f5ad6ffd640 1 -- 172.21.15.55:0/1083897383 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5ad8087e20 con 0x7f5ae80d0f60 2024-04-25T08:59:27.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1083897383 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac806b500 msgr2=0x7f5ac806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:27.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac806b500 0x7f5ac806d9c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80cbc90 tx=0x7f5adc009240 comp rx=0 tx=0).stop 2024-04-25T08:59:27.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1083897383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ae80d0f60 msgr2=0x7f5ae80cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:27.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ae80d0f60 0x7f5ae80cb650 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800c410 tx=0x7f5ad800c8d0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1083897383 shutdown_connections 2024-04-25T08:59:27.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac806b500 0x7f5ac806d9c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ae815dca0 0x7f5ae80ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ae80d3b90 0x7f5ae81f6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 --2- 172.21.15.55:0/1083897383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ae80d0f60 0x7f5ae80cb650 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:27.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1083897383 >> 172.21.15.55:0/1083897383 conn(0x7f5ae80726c0 msgr2=0x7f5ae80cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:27.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1083897383 shutdown_connections 2024-04-25T08:59:27.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:27.756+0000 7f5aec9a9640 1 -- 172.21.15.55:0/1083897383 wait complete. 2024-04-25T08:59:27.756 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:59:27.756 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:59:27.794 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:59:27.841 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:59:27.841 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:59:27.841 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:27.857 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:59:27.857 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:59:27.857 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:27.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:59:27.874 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:59:27.875 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:27.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:59:27.912 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T08:59:27.913 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:27.931 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:59:27.931 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:59:27.931 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:28.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.064+0000 7fc95f77e640 1 Processor -- start 2024-04-25T08:59:28.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.065+0000 7fc95f77e640 1 -- start start 2024-04-25T08:59:28.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.065+0000 7fc95f77e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc9580d35b0 0x7fc9580b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.065+0000 7fc95f77e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9580b5990 0x7fc9580b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.065+0000 7fc95f77e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95815e0c0 con 0x7fc95815dce0 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.065+0000 7fc95f77e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9580d2510 con 0x7fc9580d35b0 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.065+0000 7fc95f77e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580d27f0 con 0x7fc9580b5990 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc95d51a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc95815dce0 0x7fc9580d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32976/0 (socket says 172.21.15.55:32976) 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc95d51a640 1 -- 172.21.15.55:0/1190842553 learned_addr learned my addr 172.21.15.55:0/1190842553 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822160693 0 0) 0x7fc95815e0c0 con 0x7fc95815dce0 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc944003520 con 0x7fc95815dce0 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc95cd19640 1 --2- 172.21.15.55:0/1190842553 >> v2:172.21.15.167:3300/0 conn(0x7fc9580d35b0 0x7fc9580b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc95dd1b640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9580b5990 0x7fc9580b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3268028194 0 0) 0x7fc944003520 con 0x7fc95815dce0 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9580b5990 msgr2=0x7fc9580b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9580b5990 0x7fc9580b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 >> v2:172.21.15.167:3300/0 conn(0x7fc9580d35b0 msgr2=0x7fc9580b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 --2- 172.21.15.55:0/1190842553 >> v2:172.21.15.167:3300/0 conn(0x7fc9580d35b0 0x7fc9580b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580d2ad0 con 0x7fc95815dce0 2024-04-25T08:59:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc954001670 con 0x7fc95815dce0 2024-04-25T08:59:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 >> v1:172.21.15.55:6789/0 conn(0x7fc95815dce0 legacy=0x7fc9580d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9440039b0 0x7fc944003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9580b5990 0x7fc944004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc944004d40 0x7fc9440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580d2510 con 0x7fc944004d40 2024-04-25T08:59:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580d27f0 con 0x7fc9440039b0 2024-04-25T08:59:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94400baa0 con 0x7fc9580b5990 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc95dd1b640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc944004d40 0x7fc9440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc95cd19640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9580b5990 0x7fc944004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.066+0000 7fc95d51a640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9440039b0 0x7fc944003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.067+0000 7fc95dd1b640 1 -- 172.21.15.55:0/1190842553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9580b5990 msgr2=0x7fc944004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.067+0000 7fc95dd1b640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9580b5990 0x7fc944004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.067+0000 7fc95dd1b640 1 -- 172.21.15.55:0/1190842553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9440039b0 msgr2=0x7fc944003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.067+0000 7fc95dd1b640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9440039b0 0x7fc944003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.067+0000 7fc95dd1b640 1 -- 172.21.15.55:0/1190842553 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944003520 con 0x7fc944004d40 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.067+0000 7fc95dd1b640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc944004d40 0x7fc9440051c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc950007360 tx=0x7fc944005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9b62f1fe8dd484 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.067+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950033070 con 0x7fc944004d40 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.068+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95002f680 con 0x7fc944004d40 2024-04-25T08:59:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.068+0000 7fc94ffff640 1 -- 172.21.15.55:0/1190842553 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950009be0 con 0x7fc944004d40 2024-04-25T08:59:28.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.068+0000 7fc95f77e640 1 -- 172.21.15.55:0/1190842553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc944004d40 msgr2=0x7fc9440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:28.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.068+0000 7fc95f77e640 1 --2- 172.21.15.55:0/1190842553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc944004d40 0x7fc9440051c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc950007360 tx=0x7fc944005830 comp rx=0 tx=0).stop 2024-04-25T08:59:28.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.068+0000 7fc95dd1b640 1 -- 172.21.15.55:0/1190842553 reap_dead start 2024-04-25T08:59:28.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.068+0000 7fc95f77e640 1 -- 172.21.15.55:0/1190842553 shutdown_connections 2024-04-25T08:59:28.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.068+0000 7fc95f77e640 1 -- 172.21.15.55:0/1190842553 >> 172.21.15.55:0/1190842553 conn(0x7fc958072900 msgr2=0x7fc9580d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:28.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.068+0000 7fc95f77e640 1 -- 172.21.15.55:0/1190842553 shutdown_connections 2024-04-25T08:59:28.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.068+0000 7fc95f77e640 1 -- 172.21.15.55:0/1190842553 wait complete. 2024-04-25T08:59:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.069+0000 7fc95f77e640 1 Processor -- start 2024-04-25T08:59:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.069+0000 7fc95f77e640 1 -- start start 2024-04-25T08:59:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95f77e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc958152a10 0x7fc958154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95f77e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc958154bd0 0x7fc9580ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95f77e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc958153110 0x7fc95815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95f77e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580d2160 con 0x7fc958153110 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95f77e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580d3090 con 0x7fc958152a10 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95f77e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580cc730 con 0x7fc958154bd0 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95dd1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc958153110 0x7fc95815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95dd1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc958153110 0x7fc95815efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41640/0 (socket says 172.21.15.55:41640) 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95dd1b640 1 -- 172.21.15.55:0/2719109103 learned_addr learned my addr 172.21.15.55:0/2719109103 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95cd19640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc958154bd0 0x7fc9580ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95d51a640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc958152a10 0x7fc958154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.070+0000 7fc95dd1b640 1 -- 172.21.15.55:0/2719109103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc958154bd0 msgr2=0x7fc9580ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.071+0000 7fc95dd1b640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc958154bd0 0x7fc9580ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.071+0000 7fc95dd1b640 1 -- 172.21.15.55:0/2719109103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc958152a10 msgr2=0x7fc958154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.071+0000 7fc95dd1b640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc958152a10 0x7fc958154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.071+0000 7fc95dd1b640 1 -- 172.21.15.55:0/2719109103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580cbb90 con 0x7fc958153110 2024-04-25T08:59:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.071+0000 7fc95dd1b640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc958153110 0x7fc95815efa0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc950007450 tx=0x7fc950004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.071+0000 7fc94dffb640 1 -- 172.21.15.55:0/2719109103 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950047070 con 0x7fc958153110 2024-04-25T08:59:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.071+0000 7fc94dffb640 1 -- 172.21.15.55:0/2719109103 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95002f480 con 0x7fc958153110 2024-04-25T08:59:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.071+0000 7fc95f77e640 1 -- 172.21.15.55:0/2719109103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9580cbe00 con 0x7fc958153110 2024-04-25T08:59:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.071+0000 7fc94dffb640 1 -- 172.21.15.55:0/2719109103 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950033040 con 0x7fc958153110 2024-04-25T08:59:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.071+0000 7fc95f77e640 1 -- 172.21.15.55:0/2719109103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9580cc3c0 con 0x7fc958153110 2024-04-25T08:59:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.072+0000 7fc95f77e640 1 -- 172.21.15.55:0/2719109103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9580749b0 con 0x7fc958153110 2024-04-25T08:59:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.073+0000 7fc94dffb640 1 -- 172.21.15.55:0/2719109103 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc950036070 con 0x7fc958153110 2024-04-25T08:59:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.073+0000 7fc94dffb640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93c06b4d0 0x7fc93c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.073+0000 7fc94dffb640 1 -- 172.21.15.55:0/2719109103 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc9500aa430 con 0x7fc958153110 2024-04-25T08:59:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.073+0000 7fc95d51a640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93c06b4d0 0x7fc93c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.073+0000 7fc95d51a640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93c06b4d0 0x7fc93c06d990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc954004840 tx=0x7fc9540078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:28.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.077+0000 7fc94dffb640 1 -- 172.21.15.55:0/2719109103 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc95002f650 con 0x7fc958153110 2024-04-25T08:59:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.297+0000 7fc95f77e640 1 -- 172.21.15.55:0/2719109103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9580b7b70 con 0x7fc958153110 2024-04-25T08:59:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.298+0000 7fc94dffb640 1 -- 172.21.15.55:0/2719109103 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fc950078f90 con 0x7fc958153110 2024-04-25T08:59:28.287 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:28.287 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/864469615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":864469615},{"type":"v1","addr":"172.21.15.55:6836","nonce":864469615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/721577444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":721577444},{"type":"v1","addr":"172.21.15.167:6834","nonce":721577444}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2097989379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2097989379},{"type":"v1","addr":"172.21.15.167:6835","nonce":2097989379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":7254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2778523753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2778523753},{"type":"v1","addr":"172.21.15.55:6837","nonce":2778523753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46}],"filesystems":[]} 2024-04-25T08:59:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 46 2024-04-25T08:59:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 -- 172.21.15.55:0/2719109103 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93c06b4d0 msgr2=0x7fc93c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93c06b4d0 0x7fc93c06d990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc954004840 tx=0x7fc9540078f0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 -- 172.21.15.55:0/2719109103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc958153110 msgr2=0x7fc95815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc958153110 0x7fc95815efa0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc950007450 tx=0x7fc950004ab0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 -- 172.21.15.55:0/2719109103 shutdown_connections 2024-04-25T08:59:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc93c06b4d0 0x7fc93c06d990 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc958153110 0x7fc95815efa0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc958154bd0 0x7fc9580ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 --2- 172.21.15.55:0/2719109103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc958152a10 0x7fc958154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 -- 172.21.15.55:0/2719109103 >> 172.21.15.55:0/2719109103 conn(0x7fc958072900 msgr2=0x7fc9580b82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 -- 172.21.15.55:0/2719109103 shutdown_connections 2024-04-25T08:59:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.300+0000 7fc95f77e640 1 -- 172.21.15.55:0/2719109103 wait complete. 2024-04-25T08:59:28.300 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:59:28.300 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:59:28.301 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:59:28.301 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:59:28.301 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:59:28.301 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:59:28.301 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:59:28.301 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:59:28.302 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:59:28.302 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:59:28.302 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:59:28.302 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:59:28.302 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:59:28.303 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:59:28.303 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:59:28.303 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:59:28.310 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:59:28.310 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:59:28.311 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:59:28.311 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:59:28.313 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:59:28.313 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:59:28.314 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:59:28.314 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:59:28.353 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:59:28.353 DEBUG:teuthology.parallel:result is None 2024-04-25T08:59:28.353 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:59:28.354 DEBUG:teuthology.parallel:result is None 2024-04-25T08:59:28.357 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:59:28.357 DEBUG:teuthology.parallel:result is None 2024-04-25T08:59:28.357 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:59:28.357 DEBUG:teuthology.parallel:result is None 2024-04-25T08:59:28.358 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:59:28.428 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-25T08:59:28.429 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T08:59:28.436 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T08:59:28.437 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T08:59:28.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.476+0000 7f2e19fe7640 1 Processor -- start 2024-04-25T08:59:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.476+0000 7f2e19fe7640 1 -- start start 2024-04-25T08:59:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.477+0000 7f2e19fe7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 0x7f2e1415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.477+0000 7f2e19fe7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2e1406d260 0x7f2e140b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.477+0000 7f2e19fe7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1406da40 con 0x7f2e140b4730 2024-04-25T08:59:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.477+0000 7f2e19fe7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e140b4ba0 con 0x7f2e1406d260 2024-04-25T08:59:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.477+0000 7f2e19fe7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1415c050 con 0x7f2e140aedc0 2024-04-25T08:59:28.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.478+0000 7f2e12ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2e1406d260 0x7f2e140b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.478+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 0x7f2e1415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.478+0000 7f2e13fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2e140b4730 0x7f2e140b26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:40690/0 (socket says 172.21.15.55:40690) 2024-04-25T08:59:28.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.478+0000 7f2e13fff640 1 -- 172.21.15.55:0/1982731520 learned_addr learned my addr 172.21.15.55:0/1982731520 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:28.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.478+0000 7f2e127fc640 1 -- 172.21.15.55:0/1982731520 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619611417 0 0) 0x7f2e1406da40 con 0x7f2e140b4730 2024-04-25T08:59:28.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.478+0000 7f2e137fe640 1 -- 172.21.15.55:0/1982731520 >> v2:172.21.15.167:3300/0 conn(0x7f2e1406d260 msgr2=0x7f2e140b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:28.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.478+0000 7f2e137fe640 1 --2- 172.21.15.55:0/1982731520 >> v2:172.21.15.167:3300/0 conn(0x7f2e1406d260 0x7f2e140b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.478+0000 7f2e137fe640 1 -- 172.21.15.55:0/1982731520 >> v1:172.21.15.167:6789/0 conn(0x7f2e140b4730 legacy=0x7f2e140b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:28.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.478+0000 7f2e137fe640 1 -- 172.21.15.55:0/1982731520 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1406dd20 con 0x7f2e140aedc0 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e137fe640 1 --2- 172.21.15.55:0/1982731520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 0x7f2e1415ae20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e040097a0 tx=0x7f2e0402a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3892cd3f79b2cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e127fc640 1 -- 172.21.15.55:0/1982731520 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04037070 con 0x7f2e140aedc0 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e127fc640 1 -- 172.21.15.55:0/1982731520 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0402ae40 con 0x7f2e140aedc0 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e127fc640 1 -- 172.21.15.55:0/1982731520 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04032660 con 0x7f2e140aedc0 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e19fe7640 1 -- 172.21.15.55:0/1982731520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 msgr2=0x7f2e1415ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e19fe7640 1 --2- 172.21.15.55:0/1982731520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 0x7f2e1415ae20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e040097a0 tx=0x7f2e0402a0f0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e19fe7640 1 -- 172.21.15.55:0/1982731520 shutdown_connections 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e19fe7640 1 --2- 172.21.15.55:0/1982731520 >> v2:172.21.15.167:3300/0 conn(0x7f2e1406d260 0x7f2e140b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e19fe7640 1 --2- 172.21.15.55:0/1982731520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 0x7f2e1415ae20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e19fe7640 1 -- 172.21.15.55:0/1982731520 >> 172.21.15.55:0/1982731520 conn(0x7f2e1406aba0 msgr2=0x7f2e1406af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e19fe7640 1 -- 172.21.15.55:0/1982731520 shutdown_connections 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.479+0000 7f2e19fe7640 1 -- 172.21.15.55:0/1982731520 wait complete. 2024-04-25T08:59:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.481+0000 7f2e19fe7640 1 Processor -- start 2024-04-25T08:59:28.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.481+0000 7f2e19fe7640 1 -- start start 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.481+0000 7f2e19fe7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e1406d260 0x7f2e140cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.481+0000 7f2e19fe7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 0x7f2e141578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.481+0000 7f2e19fe7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e140b4730 0x7f2e14157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e19fe7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1415c2a0 con 0x7f2e140b4730 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e19fe7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140af1a0 con 0x7f2e1406d260 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e19fe7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1406d6c0 con 0x7f2e140aedc0 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e13fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e140b4730 0x7f2e14157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e12ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 0x7f2e141578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e13fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e140b4730 0x7f2e14157e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41666/0 (socket says 172.21.15.55:41666) 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e1406d260 0x7f2e140cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e13fff640 1 -- 172.21.15.55:0/896302673 learned_addr learned my addr 172.21.15.55:0/896302673 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e12ffd640 1 -- 172.21.15.55:0/896302673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e1406d260 msgr2=0x7f2e140cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e12ffd640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e1406d260 0x7f2e140cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e12ffd640 1 -- 172.21.15.55:0/896302673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e140b4730 msgr2=0x7f2e14157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e12ffd640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e140b4730 0x7f2e14157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e12ffd640 1 -- 172.21.15.55:0/896302673 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e141e4bf0 con 0x7f2e140aedc0 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e13fff640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e140b4730 0x7f2e14157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e12ffd640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 0x7f2e141578f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800e850 tx=0x7f2e0800ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2dfbfff640 1 -- 172.21.15.55:0/896302673 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08017070 con 0x7f2e140aedc0 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2dfbfff640 1 -- 172.21.15.55:0/896302673 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0800c940 con 0x7f2e140aedc0 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2dfbfff640 1 -- 172.21.15.55:0/896302673 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0800cd10 con 0x7f2e140aedc0 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.482+0000 7f2e19fe7640 1 -- 172.21.15.55:0/896302673 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e141e4ed0 con 0x7f2e140aedc0 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.483+0000 7f2e19fe7640 1 -- 172.21.15.55:0/896302673 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e141e5490 con 0x7f2e140aedc0 2024-04-25T08:59:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.483+0000 7f2e19fe7640 1 -- 172.21.15.55:0/896302673 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e140750b0 con 0x7f2e140aedc0 2024-04-25T08:59:28.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.484+0000 7f2dfbfff640 1 -- 172.21.15.55:0/896302673 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e0801a070 con 0x7f2e140aedc0 2024-04-25T08:59:28.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.485+0000 7f2dfbfff640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0006b500 0x7f2e0006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:28.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.485+0000 7f2dfbfff640 1 -- 172.21.15.55:0/896302673 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2e0808a580 con 0x7f2e140aedc0 2024-04-25T08:59:28.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.485+0000 7f2e137fe640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0006b500 0x7f2e0006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:28.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.485+0000 7f2e137fe640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0006b500 0x7f2e0006d9c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2e04034000 tx=0x7f2e0402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:28.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.489+0000 7f2dfbfff640 1 -- 172.21.15.55:0/896302673 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e080590c0 con 0x7f2e140aedc0 2024-04-25T08:59:28.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:28.682+0000 7f2e19fe7640 1 -- 172.21.15.55:0/896302673 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2e140add40 con 0x7f2e140aedc0 2024-04-25T08:59:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.442+0000 7f2dfbfff640 1 -- 172.21.15.55:0/896302673 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2e0805d160 con 0x7f2e140aedc0 2024-04-25T08:59:29.431 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.445+0000 7f2e19fe7640 1 -- 172.21.15.55:0/896302673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0006b500 msgr2=0x7f2e0006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.445+0000 7f2e19fe7640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0006b500 0x7f2e0006d9c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2e04034000 tx=0x7f2e0402e000 comp rx=0 tx=0).stop 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.445+0000 7f2e19fe7640 1 -- 172.21.15.55:0/896302673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 msgr2=0x7f2e141578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.445+0000 7f2e19fe7640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 0x7f2e141578f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800e850 tx=0x7f2e0800ed10 comp rx=0 tx=0).stop 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.445+0000 7f2e19fe7640 1 -- 172.21.15.55:0/896302673 shutdown_connections 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.445+0000 7f2e19fe7640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e0006b500 0x7f2e0006d9c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.445+0000 7f2e19fe7640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e140b4730 0x7f2e14157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.445+0000 7f2e19fe7640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e140aedc0 0x7f2e141578f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.445+0000 7f2e19fe7640 1 --2- 172.21.15.55:0/896302673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e1406d260 0x7f2e140cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.445+0000 7f2e19fe7640 1 -- 172.21.15.55:0/896302673 >> 172.21.15.55:0/896302673 conn(0x7f2e1406aba0 msgr2=0x7f2e1415a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.445+0000 7f2e19fe7640 1 -- 172.21.15.55:0/896302673 shutdown_connections 2024-04-25T08:59:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.446+0000 7f2e19fe7640 1 -- 172.21.15.55:0/896302673 wait complete. 2024-04-25T08:59:29.449 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:59:29.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.567+0000 7f78f4716640 1 Processor -- start 2024-04-25T08:59:29.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.567+0000 7f78f4716640 1 -- start start 2024-04-25T08:59:29.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.568+0000 7f78f4716640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78ec0d35b0 0x7f78ec0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.568+0000 7f78f4716640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec15e0c0 con 0x7f78ec0b5990 2024-04-25T08:59:29.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.568+0000 7f78f4716640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec0d2510 con 0x7f78ec15dce0 2024-04-25T08:59:29.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.568+0000 7f78f4716640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec0d27f0 con 0x7f78ec0d35b0 2024-04-25T08:59:29.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.568+0000 7f78f1cb1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78ec0d35b0 0x7f78ec0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.568+0000 7f78f2cb3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f78ec0b5990 0x7f78ec0b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55210/0 (socket says 172.21.15.55:55210) 2024-04-25T08:59:29.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.568+0000 7f78f2cb3640 1 -- 172.21.15.55:0/1998939047 learned_addr learned my addr 172.21.15.55:0/1998939047 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:29.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.568+0000 7f78f1cb1640 1 -- 172.21.15.55:0/1998939047 >> v1:172.21.15.167:6789/0 conn(0x7f78ec15dce0 legacy=0x7f78ec0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.568+0000 7f78f1cb1640 1 -- 172.21.15.55:0/1998939047 >> v1:172.21.15.55:6789/0 conn(0x7f78ec0b5990 legacy=0x7f78ec0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.568+0000 7f78f1cb1640 1 -- 172.21.15.55:0/1998939047 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0d2ad0 con 0x7f78ec0d35b0 2024-04-25T08:59:29.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.569+0000 7f78f1cb1640 1 --2- 172.21.15.55:0/1998939047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec0d35b0 0x7f78ec0b5450 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f78e00097a0 tx=0x7f78e002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af402040790d1519 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:29.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.569+0000 7f78f14b0640 1 -- 172.21.15.55:0/1998939047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0037070 con 0x7f78ec0d35b0 2024-04-25T08:59:29.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.569+0000 7f78f14b0640 1 -- 172.21.15.55:0/1998939047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e0032440 con 0x7f78ec0d35b0 2024-04-25T08:59:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.569+0000 7f78f14b0640 1 -- 172.21.15.55:0/1998939047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0032810 con 0x7f78ec0d35b0 2024-04-25T08:59:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.570+0000 7f78f4716640 1 -- 172.21.15.55:0/1998939047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec0d35b0 msgr2=0x7f78ec0b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.570+0000 7f78f4716640 1 --2- 172.21.15.55:0/1998939047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec0d35b0 0x7f78ec0b5450 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f78e00097a0 tx=0x7f78e002a230 comp rx=0 tx=0).stop 2024-04-25T08:59:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.570+0000 7f78f4716640 1 -- 172.21.15.55:0/1998939047 shutdown_connections 2024-04-25T08:59:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.570+0000 7f78f4716640 1 --2- 172.21.15.55:0/1998939047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec0d35b0 0x7f78ec0b5450 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.570+0000 7f78f4716640 1 -- 172.21.15.55:0/1998939047 >> 172.21.15.55:0/1998939047 conn(0x7f78ec072900 msgr2=0x7f78ec0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.570+0000 7f78f4716640 1 -- 172.21.15.55:0/1998939047 shutdown_connections 2024-04-25T08:59:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.570+0000 7f78f4716640 1 -- 172.21.15.55:0/1998939047 wait complete. 2024-04-25T08:59:29.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.571+0000 7f78f4716640 1 Processor -- start 2024-04-25T08:59:29.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.571+0000 7f78f4716640 1 -- start start 2024-04-25T08:59:29.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f4716640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78ec0b5990 0x7f78ec1f69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f4716640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78ec0d35b0 0x7f78ec0c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f4716640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec15dce0 0x7f78ec0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f4716640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0d2160 con 0x7f78ec15dce0 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f4716640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0d3090 con 0x7f78ec0d35b0 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f4716640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0ca1b0 con 0x7f78ec0b5990 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f2cb3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec15dce0 0x7f78ec0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f2cb3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec15dce0 0x7f78ec0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55498/0 (socket says 172.21.15.55:55498) 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f2cb3640 1 -- 172.21.15.55:0/312366588 learned_addr learned my addr 172.21.15.55:0/312366588 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f24b2640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78ec0b5990 0x7f78ec1f69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f1cb1640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78ec0d35b0 0x7f78ec0c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f2cb3640 1 -- 172.21.15.55:0/312366588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78ec0b5990 msgr2=0x7f78ec1f69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f2cb3640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78ec0b5990 0x7f78ec1f69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f2cb3640 1 -- 172.21.15.55:0/312366588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78ec0d35b0 msgr2=0x7f78ec0c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f2cb3640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78ec0d35b0 0x7f78ec0c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.572+0000 7f78f2cb3640 1 -- 172.21.15.55:0/312366588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec1f6f30 con 0x7f78ec15dce0 2024-04-25T08:59:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.573+0000 7f78f2cb3640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec15dce0 0x7f78ec0ccab0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00cbc0 tx=0x7f78dc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.573+0000 7f78eaffd640 1 -- 172.21.15.55:0/312366588 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc017070 con 0x7f78ec15dce0 2024-04-25T08:59:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.573+0000 7f78eaffd640 1 -- 172.21.15.55:0/312366588 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc00ad40 con 0x7f78ec15dce0 2024-04-25T08:59:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.573+0000 7f78f4716640 1 -- 172.21.15.55:0/312366588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec0c95a0 con 0x7f78ec15dce0 2024-04-25T08:59:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.573+0000 7f78eaffd640 1 -- 172.21.15.55:0/312366588 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc012600 con 0x7f78ec15dce0 2024-04-25T08:59:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.573+0000 7f78f4716640 1 -- 172.21.15.55:0/312366588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec0c9b60 con 0x7f78ec15dce0 2024-04-25T08:59:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.574+0000 7f78f4716640 1 -- 172.21.15.55:0/312366588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec0749b0 con 0x7f78ec15dce0 2024-04-25T08:59:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.574+0000 7f78eaffd640 1 -- 172.21.15.55:0/312366588 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f78dc01a070 con 0x7f78ec15dce0 2024-04-25T08:59:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.575+0000 7f78eaffd640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78d806b4d0 0x7f78d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.575+0000 7f78eaffd640 1 -- 172.21.15.55:0/312366588 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f78dc089a20 con 0x7f78ec15dce0 2024-04-25T08:59:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.575+0000 7f78f24b2640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78d806b4d0 0x7f78d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.575+0000 7f78f24b2640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78d806b4d0 0x7f78d806d990 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f78e40016e0 tx=0x7f78e4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:29.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.579+0000 7f78eaffd640 1 -- 172.21.15.55:0/312366588 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f78dc058630 con 0x7f78ec15dce0 2024-04-25T08:59:29.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.835+0000 7f78f4716640 1 -- 172.21.15.55:0/312366588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f78ec0b7950 con 0x7f78ec15dce0 2024-04-25T08:59:29.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.836+0000 7f78eaffd640 1 -- 172.21.15.55:0/312366588 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f78dc05c6d0 con 0x7f78ec15dce0 2024-04-25T08:59:29.825 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:29.825 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:59:29.825 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-25T08:59:29.825 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.825 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-25T08:59:29.825 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm4IxeGBAAwuzfw8fkgBWLS/OHkVRPdA==", 2024-04-25T08:59:29.825 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.825 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:59:29.825 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmz17MIxAAOjfHLP2pVtyOH1KkaFBdpw==", 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.826 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcJlOHxAAWRBqx21VaZdp7n+bG6QdjA==", 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmbKyTKhAARg7pgR8TeZKNHV38FuAv+g==", 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.827 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDgGSpmMDqwHRAAte7ZpF14thK4VEsC4getWg==", 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.828 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDjGSpm7bEhHRAALQKewGfpKljGFsW75+h/Dg==", 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDmGSpmjg2RHBAA+DxXqJHuPIGUsVvwUirEwg==", 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.829 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.830 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.830 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.830 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-25T08:59:29.830 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDpGSpmxft1HBAAsIYtKh97QF4WhdL9kI2QeA==", 2024-04-25T08:59:29.830 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.830 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:29.830 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:59:29.830 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.830 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.830 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.830 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDvGSpm4QDFIRAAlMSvRI/gNR4p8BgQdRUcBA==", 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyGSpmARfiHxAABn3CWZTkyRxXpTUxKGi71A==", 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:59:29.831 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1GSpmLHBmHRAA4xXuyYK95pq8g+DAXREvKQ==", 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4GSpmMbpPGxAAP7YWBUzcafaowcZG1ZWhDA==", 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.832 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw==", 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.833 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcP0TNxAA02w2xuYx7fMlMbZpgy53hQ==", 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmpD8INBAA29l06IV/RnM5qxOD6VL3MA==", 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:59:29.834 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDaGSpm8xftABAADCQqbD2gknLM2w+MV/H29A==", 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.835 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDYGSpmHI4oORAAQoQL0ylKsbBRG+EldcMd4g==", 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmk2Q/FRAAwGHbq7UsFI+OdwcBOqLnlA==", 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T08:59:29.836 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm6NfaERAAtb5ZheEavSDdOCOxeM0a2Q==", 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-25T08:59:29.837 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:59:29.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 -- 172.21.15.55:0/312366588 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78d806b4d0 msgr2=0x7f78d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78d806b4d0 0x7f78d806d990 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f78e40016e0 tx=0x7f78e4009040 comp rx=0 tx=0).stop 2024-04-25T08:59:29.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 -- 172.21.15.55:0/312366588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec15dce0 msgr2=0x7f78ec0ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec15dce0 0x7f78ec0ccab0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00cbc0 tx=0x7f78dc00a430 comp rx=0 tx=0).stop 2024-04-25T08:59:29.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 -- 172.21.15.55:0/312366588 shutdown_connections 2024-04-25T08:59:29.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78d806b4d0 0x7f78d806d990 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec15dce0 0x7f78ec0ccab0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78ec0d35b0 0x7f78ec0c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 --2- 172.21.15.55:0/312366588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78ec0b5990 0x7f78ec1f69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 -- 172.21.15.55:0/312366588 >> 172.21.15.55:0/312366588 conn(0x7f78ec072900 msgr2=0x7f78ec0b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 -- 172.21.15.55:0/312366588 shutdown_connections 2024-04-25T08:59:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.838+0000 7f78f4716640 1 -- 172.21.15.55:0/312366588 wait complete. 2024-04-25T08:59:29.840 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.952+0000 7fa0beef5640 1 Processor -- start 2024-04-25T08:59:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.953+0000 7fa0beef5640 1 -- start start 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.953+0000 7fa0beef5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0b815ba10 0x7fa0b8099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.953+0000 7fa0beef5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa0b806c3c0 0x7fa0b80cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.953+0000 7fa0beef5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b809a3a0 con 0x7fa0b8099f80 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.953+0000 7fa0beef5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b80cbe50 con 0x7fa0b806c3c0 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.953+0000 7fa0beef5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80cfe80 con 0x7fa0b815ba10 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.953+0000 7fa0bd492640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa0b806c3c0 0x7fa0b80cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.954+0000 7fa0bd492640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa0b806c3c0 0x7fa0b80cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55502/0 (socket says 172.21.15.55:55502) 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.954+0000 7fa0bd492640 1 -- 172.21.15.55:0/2353353592 learned_addr learned my addr 172.21.15.55:0/2353353592 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.954+0000 7fa0bcc91640 1 --2- 172.21.15.55:0/2353353592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0b815ba10 0x7fa0b8099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.954+0000 7fa0bd492640 1 -- 172.21.15.55:0/2353353592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0b815ba10 msgr2=0x7fa0b8099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.954+0000 7fa0bd492640 1 --2- 172.21.15.55:0/2353353592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0b815ba10 0x7fa0b8099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.954+0000 7fa0bd492640 1 -- 172.21.15.55:0/2353353592 >> v1:172.21.15.167:6789/0 conn(0x7fa0b8099f80 legacy=0x7fa0b806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.954+0000 7fa0bd492640 1 -- 172.21.15.55:0/2353353592 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b806c900 con 0x7fa0b806c3c0 2024-04-25T08:59:29.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.954+0000 7fa0bcc91640 1 --2- 172.21.15.55:0/2353353592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0b815ba10 0x7fa0b8099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:29.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.954+0000 7fa0bd492640 1 --2- 172.21.15.55:0/2353353592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b806c3c0 0x7fa0b80cd220 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009e50 tx=0x7fa0b002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12834596068e3400 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:29.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.955+0000 7fa0b77fe640 1 -- 172.21.15.55:0/2353353592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0036070 con 0x7fa0b806c3c0 2024-04-25T08:59:29.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.955+0000 7fa0b77fe640 1 -- 172.21.15.55:0/2353353592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b0031600 con 0x7fa0b806c3c0 2024-04-25T08:59:29.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.955+0000 7fa0b77fe640 1 -- 172.21.15.55:0/2353353592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b00319d0 con 0x7fa0b806c3c0 2024-04-25T08:59:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.955+0000 7fa0beef5640 1 -- 172.21.15.55:0/2353353592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b806c3c0 msgr2=0x7fa0b80cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.955+0000 7fa0beef5640 1 --2- 172.21.15.55:0/2353353592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b806c3c0 0x7fa0b80cd220 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009e50 tx=0x7fa0b002a710 comp rx=0 tx=0).stop 2024-04-25T08:59:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.955+0000 7fa0beef5640 1 -- 172.21.15.55:0/2353353592 shutdown_connections 2024-04-25T08:59:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.955+0000 7fa0beef5640 1 --2- 172.21.15.55:0/2353353592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b806c3c0 0x7fa0b80cd220 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.955+0000 7fa0beef5640 1 --2- 172.21.15.55:0/2353353592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0b815ba10 0x7fa0b8099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.955+0000 7fa0beef5640 1 -- 172.21.15.55:0/2353353592 >> 172.21.15.55:0/2353353592 conn(0x7fa0b80b32f0 msgr2=0x7fa0b80b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.955+0000 7fa0beef5640 1 -- 172.21.15.55:0/2353353592 shutdown_connections 2024-04-25T08:59:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.955+0000 7fa0beef5640 1 -- 172.21.15.55:0/2353353592 wait complete. 2024-04-25T08:59:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.956+0000 7fa0beef5640 1 Processor -- start 2024-04-25T08:59:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.957+0000 7fa0beef5640 1 -- start start 2024-04-25T08:59:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.957+0000 7fa0beef5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0b806c3c0 0x7fa0b81f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.957+0000 7fa0beef5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0b8099f80 0x7fa0b81f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.957+0000 7fa0beef5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b815ba10 0x7fa0b806ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.957+0000 7fa0beef5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80cd760 con 0x7fa0b815ba10 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.957+0000 7fa0beef5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b806cec0 con 0x7fa0b8099f80 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.957+0000 7fa0beef5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80cd8e0 con 0x7fa0b806c3c0 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.957+0000 7fa0bd492640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b815ba10 0x7fa0b806ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0bd492640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b815ba10 0x7fa0b806ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55510/0 (socket says 172.21.15.55:55510) 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0bd492640 1 -- 172.21.15.55:0/1788341736 learned_addr learned my addr 172.21.15.55:0/1788341736 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0bcc91640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0b806c3c0 0x7fa0b81f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0b7fff640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0b8099f80 0x7fa0b81f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0bd492640 1 -- 172.21.15.55:0/1788341736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0b806c3c0 msgr2=0x7fa0b81f7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0bd492640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0b806c3c0 0x7fa0b81f7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0bd492640 1 -- 172.21.15.55:0/1788341736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0b8099f80 msgr2=0x7fa0b81f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0bd492640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0b8099f80 0x7fa0b81f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0bd492640 1 -- 172.21.15.55:0/1788341736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b81f7f40 con 0x7fa0b815ba10 2024-04-25T08:59:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0bd492640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b815ba10 0x7fa0b806ffd0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0034040 tx=0x7fa0b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0b57fa640 1 -- 172.21.15.55:0/1788341736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0041020 con 0x7fa0b815ba10 2024-04-25T08:59:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0b57fa640 1 -- 172.21.15.55:0/1788341736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b00077a0 con 0x7fa0b815ba10 2024-04-25T08:59:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0beef5640 1 -- 172.21.15.55:0/1788341736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b81f8220 con 0x7fa0b815ba10 2024-04-25T08:59:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0b57fa640 1 -- 172.21.15.55:0/1788341736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0036040 con 0x7fa0b815ba10 2024-04-25T08:59:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.958+0000 7fa0beef5640 1 -- 172.21.15.55:0/1788341736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b8070510 con 0x7fa0b815ba10 2024-04-25T08:59:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.959+0000 7fa0beef5640 1 -- 172.21.15.55:0/1788341736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b81f8740 con 0x7fa0b815ba10 2024-04-25T08:59:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.960+0000 7fa0b57fa640 1 -- 172.21.15.55:0/1788341736 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa0b0044020 con 0x7fa0b815ba10 2024-04-25T08:59:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.960+0000 7fa0b57fa640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa09c06b4d0 0x7fa09c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.960+0000 7fa0b57fa640 1 -- 172.21.15.55:0/1788341736 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0b00aaa90 con 0x7fa0b815ba10 2024-04-25T08:59:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.960+0000 7fa0bcc91640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa09c06b4d0 0x7fa09c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.961+0000 7fa0bcc91640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa09c06b4d0 0x7fa09c06d990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac006e80 tx=0x7fa0ac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:29.964+0000 7fa0b57fa640 1 -- 172.21.15.55:0/1788341736 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0b81f8740 con 0x7fa0b815ba10 2024-04-25T08:59:30.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.145+0000 7fa0beef5640 1 -- 172.21.15.55:0/1788341736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0b80749b0 con 0x7fa0b815ba10 2024-04-25T08:59:30.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.146+0000 7fa0b57fa640 1 -- 172.21.15.55:0/1788341736 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+12892 (secure 0 0 0) 0x7fa0b004b030 con 0x7fa0b815ba10 2024-04-25T08:59:30.135 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:30.136 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":83,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:59:29.453273+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:30.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 -- 172.21.15.55:0/1788341736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa09c06b4d0 msgr2=0x7fa09c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa09c06b4d0 0x7fa09c06d990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac006e80 tx=0x7fa0ac008040 comp rx=0 tx=0).stop 2024-04-25T08:59:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 -- 172.21.15.55:0/1788341736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b815ba10 msgr2=0x7fa0b806ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b815ba10 0x7fa0b806ffd0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0034040 tx=0x7fa0b0004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 -- 172.21.15.55:0/1788341736 shutdown_connections 2024-04-25T08:59:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa09c06b4d0 0x7fa09c06d990 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b815ba10 0x7fa0b806ffd0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0b8099f80 0x7fa0b81f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 --2- 172.21.15.55:0/1788341736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0b806c3c0 0x7fa0b81f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 -- 172.21.15.55:0/1788341736 >> 172.21.15.55:0/1788341736 conn(0x7fa0b80b32f0 msgr2=0x7fa0b815ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 -- 172.21.15.55:0/1788341736 shutdown_connections 2024-04-25T08:59:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.148+0000 7fa0beef5640 1 -- 172.21.15.55:0/1788341736 wait complete. 2024-04-25T08:59:30.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:59:30.149 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:59:30.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.264+0000 7ff40b2d2640 1 Processor -- start 2024-04-25T08:59:30.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.264+0000 7ff40b2d2640 1 -- start start 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40b2d2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff4040ce9d0 0x7ff4040cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40b2d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4040cc300 0x7ff4040cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40b2d2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40406dcb0 con 0x7ff404144e70 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40b2d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40415bfe0 con 0x7ff4040cc300 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40b2d2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40406df90 con 0x7ff4040ce9d0 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40986f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4040cc300 0x7ff4040cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40986f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4040cc300 0x7ff4040cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55520/0 (socket says 172.21.15.55:55520) 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40986f640 1 -- 172.21.15.55:0/1795075524 learned_addr learned my addr 172.21.15.55:0/1795075524 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40886d640 1 --2- 172.21.15.55:0/1795075524 >> v2:172.21.15.167:3300/0 conn(0x7ff4040ce9d0 0x7ff4040cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40986f640 1 -- 172.21.15.55:0/1795075524 >> v2:172.21.15.167:3300/0 conn(0x7ff4040ce9d0 msgr2=0x7ff4040cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40986f640 1 --2- 172.21.15.55:0/1795075524 >> v2:172.21.15.167:3300/0 conn(0x7ff4040ce9d0 0x7ff4040cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40986f640 1 -- 172.21.15.55:0/1795075524 >> v1:172.21.15.167:6789/0 conn(0x7ff404144e70 legacy=0x7ff40406d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.265+0000 7ff40986f640 1 -- 172.21.15.55:0/1795075524 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40406e270 con 0x7ff4040cc300 2024-04-25T08:59:30.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.266+0000 7ff40986f640 1 --2- 172.21.15.55:0/1795075524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4040cc300 0x7ff4040cc740 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff404072560 tx=0x7ff3f402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535231a1a529593f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.266+0000 7ff403fff640 1 -- 172.21.15.55:0/1795075524 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4036070 con 0x7ff4040cc300 2024-04-25T08:59:30.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.266+0000 7ff403fff640 1 -- 172.21.15.55:0/1795075524 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4031600 con 0x7ff4040cc300 2024-04-25T08:59:30.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.266+0000 7ff403fff640 1 -- 172.21.15.55:0/1795075524 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40319d0 con 0x7ff4040cc300 2024-04-25T08:59:30.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.267+0000 7ff40b2d2640 1 -- 172.21.15.55:0/1795075524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4040cc300 msgr2=0x7ff4040cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.267+0000 7ff40b2d2640 1 --2- 172.21.15.55:0/1795075524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4040cc300 0x7ff4040cc740 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff404072560 tx=0x7ff3f402a660 comp rx=0 tx=0).stop 2024-04-25T08:59:30.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.267+0000 7ff40b2d2640 1 -- 172.21.15.55:0/1795075524 shutdown_connections 2024-04-25T08:59:30.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.267+0000 7ff40b2d2640 1 --2- 172.21.15.55:0/1795075524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4040cc300 0x7ff4040cc740 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.267+0000 7ff40b2d2640 1 --2- 172.21.15.55:0/1795075524 >> v2:172.21.15.167:3300/0 conn(0x7ff4040ce9d0 0x7ff4040cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.267+0000 7ff40b2d2640 1 -- 172.21.15.55:0/1795075524 >> 172.21.15.55:0/1795075524 conn(0x7ff40406aba0 msgr2=0x7ff40406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.267+0000 7ff40b2d2640 1 -- 172.21.15.55:0/1795075524 shutdown_connections 2024-04-25T08:59:30.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.267+0000 7ff40b2d2640 1 -- 172.21.15.55:0/1795075524 wait complete. 2024-04-25T08:59:30.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.268+0000 7ff40b2d2640 1 Processor -- start 2024-04-25T08:59:30.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.268+0000 7ff40b2d2640 1 -- start start 2024-04-25T08:59:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40b2d2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4040cc300 0x7ff40413c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40b2d2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4040ce9d0 0x7ff40413d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40b2d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff404144e70 0x7ff4041f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40b2d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40406d970 con 0x7ff404144e70 2024-04-25T08:59:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40b2d2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4040cf3a0 con 0x7ff4040ce9d0 2024-04-25T08:59:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40b2d2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4041454b0 con 0x7ff4040cc300 2024-04-25T08:59:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40986f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff404144e70 0x7ff4041f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40986f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff404144e70 0x7ff4041f1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55522/0 (socket says 172.21.15.55:55522) 2024-04-25T08:59:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40986f640 1 -- 172.21.15.55:0/2882692435 learned_addr learned my addr 172.21.15.55:0/2882692435 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40886d640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4040ce9d0 0x7ff40413d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40906e640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4040cc300 0x7ff40413c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40986f640 1 -- 172.21.15.55:0/2882692435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4040cc300 msgr2=0x7ff40413c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40986f640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4040cc300 0x7ff40413c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40986f640 1 -- 172.21.15.55:0/2882692435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4040ce9d0 msgr2=0x7ff40413d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40986f640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4040ce9d0 0x7ff40413d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40986f640 1 -- 172.21.15.55:0/2882692435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40413de40 con 0x7ff404144e70 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40906e640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4040cc300 0x7ff40413c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.269+0000 7ff40986f640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff404144e70 0x7ff4041f1690 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009f40 tx=0x7ff3f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.270+0000 7ff401ffb640 1 -- 172.21.15.55:0/2882692435 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4036050 con 0x7ff404144e70 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.270+0000 7ff401ffb640 1 -- 172.21.15.55:0/2882692435 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4042070 con 0x7ff404144e70 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.270+0000 7ff40b2d2640 1 -- 172.21.15.55:0/2882692435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40413e120 con 0x7ff404144e70 2024-04-25T08:59:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.270+0000 7ff401ffb640 1 -- 172.21.15.55:0/2882692435 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4009510 con 0x7ff404144e70 2024-04-25T08:59:30.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.270+0000 7ff40b2d2640 1 -- 172.21.15.55:0/2882692435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40413e6e0 con 0x7ff404144e70 2024-04-25T08:59:30.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.271+0000 7ff40b2d2640 1 -- 172.21.15.55:0/2882692435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4040750b0 con 0x7ff404144e70 2024-04-25T08:59:30.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.271+0000 7ff401ffb640 1 -- 172.21.15.55:0/2882692435 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff3f4007bd0 con 0x7ff404144e70 2024-04-25T08:59:30.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.272+0000 7ff401ffb640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff3f006b4d0 0x7ff3f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.272+0000 7ff401ffb640 1 -- 172.21.15.55:0/2882692435 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff3f40aae70 con 0x7ff404144e70 2024-04-25T08:59:30.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.272+0000 7ff40906e640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff3f006b4d0 0x7ff3f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.272+0000 7ff40906e640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff3f006b4d0 0x7ff3f006d990 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00a830 tx=0x7ff3fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.276+0000 7ff401ffb640 1 -- 172.21.15.55:0/2882692435 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff3f407a040 con 0x7ff404144e70 2024-04-25T08:59:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.459+0000 7ff40b2d2640 1 -- 172.21.15.55:0/2882692435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff40406b120 con 0x7ff404144e70 2024-04-25T08:59:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.460+0000 7ff401ffb640 1 -- 172.21.15.55:0/2882692435 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3f4079940 con 0x7ff404144e70 2024-04-25T08:59:30.449 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:59:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 -- 172.21.15.55:0/2882692435 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff3f006b4d0 msgr2=0x7ff3f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff3f006b4d0 0x7ff3f006d990 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00a830 tx=0x7ff3fc008040 comp rx=0 tx=0).stop 2024-04-25T08:59:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 -- 172.21.15.55:0/2882692435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff404144e70 msgr2=0x7ff4041f1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff404144e70 0x7ff4041f1690 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009f40 tx=0x7ff3f4004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 -- 172.21.15.55:0/2882692435 shutdown_connections 2024-04-25T08:59:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff3f006b4d0 0x7ff3f006d990 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff404144e70 0x7ff4041f1690 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4040ce9d0 0x7ff40413d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 --2- 172.21.15.55:0/2882692435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4040cc300 0x7ff40413c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 -- 172.21.15.55:0/2882692435 >> 172.21.15.55:0/2882692435 conn(0x7ff40406aba0 msgr2=0x7ff404140040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 -- 172.21.15.55:0/2882692435 shutdown_connections 2024-04-25T08:59:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.462+0000 7ff40b2d2640 1 -- 172.21.15.55:0/2882692435 wait complete. 2024-04-25T08:59:30.462 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:59:30.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.574+0000 7f12737d5640 1 Processor -- start 2024-04-25T08:59:30.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.574+0000 7f12737d5640 1 -- start start 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f12737d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f126c15dce0 0x7f126c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f12737d5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f126c0d35b0 0x7f126c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f12737d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c15e0c0 con 0x7f126c0d1f90 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f12737d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0b7b10 con 0x7f126c15dce0 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f12737d5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0d2510 con 0x7f126c0d35b0 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f1271571640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f126c15dce0 0x7f126c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f1271d72640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f126c0d1f90 0x7f126c06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55224/0 (socket says 172.21.15.55:55224) 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f1271d72640 1 -- 172.21.15.55:0/2502736062 learned_addr learned my addr 172.21.15.55:0/2502736062 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f1270d70640 1 --2- 172.21.15.55:0/2502736062 >> v2:172.21.15.167:3300/0 conn(0x7f126c0d35b0 0x7f126c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f1271571640 1 -- 172.21.15.55:0/2502736062 >> v2:172.21.15.167:3300/0 conn(0x7f126c0d35b0 msgr2=0x7f126c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f1271571640 1 --2- 172.21.15.55:0/2502736062 >> v2:172.21.15.167:3300/0 conn(0x7f126c0d35b0 0x7f126c0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f1271571640 1 -- 172.21.15.55:0/2502736062 >> v1:172.21.15.55:6789/0 conn(0x7f126c0d1f90 legacy=0x7f126c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f1271571640 1 -- 172.21.15.55:0/2502736062 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0d27f0 con 0x7f126c15dce0 2024-04-25T08:59:30.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.575+0000 7f1270d70640 1 --2- 172.21.15.55:0/2502736062 >> v2:172.21.15.167:3300/0 conn(0x7f126c0d35b0 0x7f126c0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.576+0000 7f1271571640 1 --2- 172.21.15.55:0/2502736062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c15dce0 0x7f126c0d1a50 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f126c0cdfa0 tx=0x7f126802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ee49c33aa27257 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.576+0000 7f1263fff640 1 -- 172.21.15.55:0/2502736062 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268037070 con 0x7f126c15dce0 2024-04-25T08:59:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.576+0000 7f1263fff640 1 -- 172.21.15.55:0/2502736062 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268032440 con 0x7f126c15dce0 2024-04-25T08:59:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.576+0000 7f1263fff640 1 -- 172.21.15.55:0/2502736062 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268032810 con 0x7f126c15dce0 2024-04-25T08:59:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.577+0000 7f12737d5640 1 -- 172.21.15.55:0/2502736062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c15dce0 msgr2=0x7f126c0d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.577+0000 7f12737d5640 1 --2- 172.21.15.55:0/2502736062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c15dce0 0x7f126c0d1a50 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f126c0cdfa0 tx=0x7f126802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.577+0000 7f12737d5640 1 -- 172.21.15.55:0/2502736062 shutdown_connections 2024-04-25T08:59:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.577+0000 7f12737d5640 1 --2- 172.21.15.55:0/2502736062 >> v2:172.21.15.167:3300/0 conn(0x7f126c0d35b0 0x7f126c0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.577+0000 7f12737d5640 1 --2- 172.21.15.55:0/2502736062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c15dce0 0x7f126c0d1a50 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.577+0000 7f12737d5640 1 -- 172.21.15.55:0/2502736062 >> 172.21.15.55:0/2502736062 conn(0x7f126c072900 msgr2=0x7f126c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.577+0000 7f12737d5640 1 -- 172.21.15.55:0/2502736062 shutdown_connections 2024-04-25T08:59:30.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.577+0000 7f12737d5640 1 -- 172.21.15.55:0/2502736062 wait complete. 2024-04-25T08:59:30.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.578+0000 7f12737d5640 1 Processor -- start 2024-04-25T08:59:30.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.578+0000 7f12737d5640 1 -- start start 2024-04-25T08:59:30.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f12737d5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c0d1f90 0x7f126c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f12737d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0d35b0 0x7f126c0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f12737d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f126c15dce0 0x7f126c15e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f12737d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0d3090 con 0x7f126c0d35b0 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f12737d5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0d2db0 con 0x7f126c0d1f90 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f12737d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0b9820 con 0x7f126c15dce0 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1270d70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0d35b0 0x7f126c0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1270d70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0d35b0 0x7f126c0cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55538/0 (socket says 172.21.15.55:55538) 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1270d70640 1 -- 172.21.15.55:0/2116190548 learned_addr learned my addr 172.21.15.55:0/2116190548 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1271571640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c0d1f90 0x7f126c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1271d72640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f126c15dce0 0x7f126c15e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1270d70640 1 -- 172.21.15.55:0/2116190548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f126c15dce0 msgr2=0x7f126c15e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1270d70640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f126c15dce0 0x7f126c15e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1270d70640 1 -- 172.21.15.55:0/2116190548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c0d1f90 msgr2=0x7f126c152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1270d70640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c0d1f90 0x7f126c152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1270d70640 1 -- 172.21.15.55:0/2116190548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0ccd30 con 0x7f126c0d35b0 2024-04-25T08:59:30.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1271571640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c0d1f90 0x7f126c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:30.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.579+0000 7f1270d70640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0d35b0 0x7f126c0cc500 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c7f0 tx=0x7f125c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.580+0000 7f1261ffb640 1 -- 172.21.15.55:0/2116190548 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c015070 con 0x7f126c0d35b0 2024-04-25T08:59:30.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.580+0000 7f1261ffb640 1 -- 172.21.15.55:0/2116190548 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c007a30 con 0x7f126c0d35b0 2024-04-25T08:59:30.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.580+0000 7f12737d5640 1 -- 172.21.15.55:0/2116190548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c0cd010 con 0x7f126c0d35b0 2024-04-25T08:59:30.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.580+0000 7f1261ffb640 1 -- 172.21.15.55:0/2116190548 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c007e00 con 0x7f126c0d35b0 2024-04-25T08:59:30.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.580+0000 7f12737d5640 1 -- 172.21.15.55:0/2116190548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c0c7e90 con 0x7f126c0d35b0 2024-04-25T08:59:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.581+0000 7f12737d5640 1 -- 172.21.15.55:0/2116190548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c0749b0 con 0x7f126c0d35b0 2024-04-25T08:59:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.581+0000 7f1261ffb640 1 -- 172.21.15.55:0/2116190548 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f125c018070 con 0x7f126c0d35b0 2024-04-25T08:59:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.582+0000 7f1261ffb640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125006b4d0 0x7f125006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.582+0000 7f1261ffb640 1 -- 172.21.15.55:0/2116190548 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f125c089db0 con 0x7f126c0d35b0 2024-04-25T08:59:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.582+0000 7f1271571640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125006b4d0 0x7f125006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.582+0000 7f1271571640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125006b4d0 0x7f125006d990 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1268034000 tx=0x7f126802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.586+0000 7f1261ffb640 1 -- 172.21.15.55:0/2116190548 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f125c059010 con 0x7f126c0d35b0 2024-04-25T08:59:30.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.774+0000 7f12737d5640 1 -- 172.21.15.55:0/2116190548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f126c0d4720 con 0x7f126c0d35b0 2024-04-25T08:59:30.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.774+0000 7f1261ffb640 1 -- 172.21.15.55:0/2116190548 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) v1 ==== 84+0+65 (secure 0 0 0) 0x7f125c058910 con 0x7f126c0d35b0 2024-04-25T08:59:30.764 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:30.764 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T08:59:30.764 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T08:59:30.764 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-25T08:59:30.764 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-25T08:59:30.764 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:30.764 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T08:59:30.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.776+0000 7f12737d5640 1 -- 172.21.15.55:0/2116190548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125006b4d0 msgr2=0x7f125006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.776+0000 7f12737d5640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125006b4d0 0x7f125006d990 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1268034000 tx=0x7f126802e000 comp rx=0 tx=0).stop 2024-04-25T08:59:30.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.777+0000 7f12737d5640 1 -- 172.21.15.55:0/2116190548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0d35b0 msgr2=0x7f126c0cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.777+0000 7f12737d5640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0d35b0 0x7f126c0cc500 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c7f0 tx=0x7f125c00ccb0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.777+0000 7f12737d5640 1 -- 172.21.15.55:0/2116190548 shutdown_connections 2024-04-25T08:59:30.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.777+0000 7f12737d5640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f125006b4d0 0x7f125006d990 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.777+0000 7f12737d5640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f126c15dce0 0x7f126c15e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.777+0000 7f12737d5640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f126c0d35b0 0x7f126c0cc500 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.777+0000 7f12737d5640 1 --2- 172.21.15.55:0/2116190548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f126c0d1f90 0x7f126c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.777+0000 7f12737d5640 1 -- 172.21.15.55:0/2116190548 >> 172.21.15.55:0/2116190548 conn(0x7f126c072900 msgr2=0x7f126c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.777+0000 7f12737d5640 1 -- 172.21.15.55:0/2116190548 shutdown_connections 2024-04-25T08:59:30.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.777+0000 7f12737d5640 1 -- 172.21.15.55:0/2116190548 wait complete. 2024-04-25T08:59:30.777 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:59:30.777 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:59:30.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.893+0000 7f9890ecb640 1 Processor -- start 2024-04-25T08:59:30.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.893+0000 7f9890ecb640 1 -- start start 2024-04-25T08:59:30.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9890ecb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f988c1610b0 0x7f988c0b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9890ecb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c0cef40 0x7f988c0d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9890ecb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988c162040 con 0x7f988c1618d0 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9890ecb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988c0d1ea0 con 0x7f988c1610b0 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9890ecb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c162320 con 0x7f988c0cef40 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9883fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f988c1618d0 0x7f988c0ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55228/0 (socket says 172.21.15.55:55228) 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9883fff640 1 -- 172.21.15.55:0/1939811671 learned_addr learned my addr 172.21.15.55:0/1939811671 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f988a59c640 1 --2- 172.21.15.55:0/1939811671 >> v2:172.21.15.167:3300/0 conn(0x7f988c1610b0 0x7f988c0b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f988ad9d640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c0cef40 0x7f988c0d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792519973 0 0) 0x7f988c162040 con 0x7f988c1618d0 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9878003520 con 0x7f988c1618d0 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3950943285 0 0) 0x7f9878003520 con 0x7f988c1618d0 2024-04-25T08:59:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c0cef40 msgr2=0x7f988c0d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9889d9b640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c0cef40 0x7f988c0d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 >> v2:172.21.15.167:3300/0 conn(0x7f988c1610b0 msgr2=0x7f988c0b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9889d9b640 1 --2- 172.21.15.55:0/1939811671 >> v2:172.21.15.167:3300/0 conn(0x7f988c1610b0 0x7f988c0b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c162600 con 0x7f988c1618d0 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f9874001690 con 0x7f988c1618d0 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.894+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 >> v1:172.21.15.55:6789/0 conn(0x7f988c1618d0 legacy=0x7f988c0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f9889d9b640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98780039b0 0x7f9878003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f9889d9b640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c0cef40 0x7f9878004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f9889d9b640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878004d40 0x7f98780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c0d1ea0 con 0x7f9878004d40 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c162320 con 0x7f98780039b0 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987800ba10 con 0x7f988c0cef40 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f988ad9d640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878004d40 0x7f98780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f988a59c640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98780039b0 0x7f9878003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f9883fff640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c0cef40 0x7f9878004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f988ad9d640 1 -- 172.21.15.55:0/1939811671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c0cef40 msgr2=0x7f9878004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f988ad9d640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c0cef40 0x7f9878004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f988ad9d640 1 -- 172.21.15.55:0/1939811671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98780039b0 msgr2=0x7f9878003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f988ad9d640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98780039b0 0x7f9878003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.895+0000 7f988ad9d640 1 -- 172.21.15.55:0/1939811671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9878003520 con 0x7f9878004d40 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.896+0000 7f988ad9d640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878004d40 0x7f98780051c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f9884009f90 tx=0x7f9878005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c5ed6367b145c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.896+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884009c10 con 0x7f9878004d40 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.896+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9884036070 con 0x7f9878004d40 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.896+0000 7f9889d9b640 1 -- 172.21.15.55:0/1939811671 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884031850 con 0x7f9878004d40 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.896+0000 7f9890ecb640 1 -- 172.21.15.55:0/1939811671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878004d40 msgr2=0x7f98780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.896+0000 7f9890ecb640 1 --2- 172.21.15.55:0/1939811671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878004d40 0x7f98780051c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f9884009f90 tx=0x7f9878005830 comp rx=0 tx=0).stop 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.896+0000 7f988ad9d640 1 -- 172.21.15.55:0/1939811671 reap_dead start 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.896+0000 7f9890ecb640 1 -- 172.21.15.55:0/1939811671 shutdown_connections 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.896+0000 7f9890ecb640 1 -- 172.21.15.55:0/1939811671 >> 172.21.15.55:0/1939811671 conn(0x7f988c0b5570 msgr2=0x7f988c0b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.896+0000 7f9890ecb640 1 -- 172.21.15.55:0/1939811671 shutdown_connections 2024-04-25T08:59:30.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.896+0000 7f9890ecb640 1 -- 172.21.15.55:0/1939811671 wait complete. 2024-04-25T08:59:30.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.898+0000 7f9890ecb640 1 Processor -- start 2024-04-25T08:59:30.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.898+0000 7f9890ecb640 1 -- start start 2024-04-25T08:59:30.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.898+0000 7f9890ecb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9878004d40 0x7f988c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.898+0000 7f9890ecb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c158420 0x7f988c15f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.898+0000 7f9890ecb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c1f3bc0 0x7f988c1f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.898+0000 7f9890ecb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c161d10 con 0x7f988c1f3bc0 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.898+0000 7f9890ecb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c0b6c00 con 0x7f9878004d40 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.898+0000 7f9890ecb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c161490 con 0x7f988c158420 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f988ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c1f3bc0 0x7f988c1f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f988ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c1f3bc0 0x7f988c1f4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55560/0 (socket says 172.21.15.55:55560) 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f988ad9d640 1 -- 172.21.15.55:0/182893210 learned_addr learned my addr 172.21.15.55:0/182893210 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f9883fff640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c158420 0x7f988c15f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f988a59c640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9878004d40 0x7f988c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f988ad9d640 1 -- 172.21.15.55:0/182893210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c158420 msgr2=0x7f988c15f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f988ad9d640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c158420 0x7f988c15f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f988ad9d640 1 -- 172.21.15.55:0/182893210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9878004d40 msgr2=0x7f988c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f988ad9d640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9878004d40 0x7f988c155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f988ad9d640 1 -- 172.21.15.55:0/182893210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c156160 con 0x7f988c1f3bc0 2024-04-25T08:59:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f988a59c640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9878004d40 0x7f988c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f988ad9d640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c1f3bc0 0x7f988c1f4040 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f9884009f90 tx=0x7f9884009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f9882ffd640 1 -- 172.21.15.55:0/182893210 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884009c10 con 0x7f988c1f3bc0 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f9882ffd640 1 -- 172.21.15.55:0/182893210 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9884003990 con 0x7f988c1f3bc0 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f9890ecb640 1 -- 172.21.15.55:0/182893210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988c156440 con 0x7f988c1f3bc0 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f9882ffd640 1 -- 172.21.15.55:0/182893210 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884003d80 con 0x7f988c1f3bc0 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.899+0000 7f9890ecb640 1 -- 172.21.15.55:0/182893210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988c156a00 con 0x7f988c1f3bc0 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.900+0000 7f9890ecb640 1 -- 172.21.15.55:0/182893210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988c0750b0 con 0x7f988c1f3bc0 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.901+0000 7f9882ffd640 1 -- 172.21.15.55:0/182893210 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9884005d10 con 0x7f988c1f3bc0 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.901+0000 7f9882ffd640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f986c06b4d0 0x7f986c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.901+0000 7f988a59c640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f986c06b4d0 0x7f986c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.901+0000 7f9882ffd640 1 -- 172.21.15.55:0/182893210 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98840ab5f0 con 0x7f988c1f3bc0 2024-04-25T08:59:30.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.902+0000 7f988a59c640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f986c06b4d0 0x7f986c06d990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f987c009ab0 tx=0x7f987c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:30.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:30.906+0000 7f9882ffd640 1 -- 172.21.15.55:0/182893210 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f988404a060 con 0x7f988c1f3bc0 2024-04-25T08:59:31.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.086+0000 7f9890ecb640 1 -- 172.21.15.55:0/182893210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f988c068090 con 0x7f988c1f3bc0 2024-04-25T08:59:31.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.443+0000 7f9882ffd640 1 -- 172.21.15.55:0/182893210 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) v1 ==== 138+0+0 (secure 0 0 0) 0x7f988402e050 con 0x7f988c1f3bc0 2024-04-25T08:59:31.432 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.445+0000 7f9890ecb640 1 -- 172.21.15.55:0/182893210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f986c06b4d0 msgr2=0x7f986c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.445+0000 7f9890ecb640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f986c06b4d0 0x7f986c06d990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f987c009ab0 tx=0x7f987c008040 comp rx=0 tx=0).stop 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.445+0000 7f9890ecb640 1 -- 172.21.15.55:0/182893210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c1f3bc0 msgr2=0x7f988c1f4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.445+0000 7f9890ecb640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c1f3bc0 0x7f988c1f4040 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f9884009f90 tx=0x7f9884009750 comp rx=0 tx=0).stop 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.445+0000 7f9890ecb640 1 -- 172.21.15.55:0/182893210 shutdown_connections 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.445+0000 7f9890ecb640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f986c06b4d0 0x7f986c06d990 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.445+0000 7f9890ecb640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c1f3bc0 0x7f988c1f4040 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.445+0000 7f9890ecb640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f988c158420 0x7f988c15f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.445+0000 7f9890ecb640 1 --2- 172.21.15.55:0/182893210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9878004d40 0x7f988c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.445+0000 7f9890ecb640 1 -- 172.21.15.55:0/182893210 >> 172.21.15.55:0/182893210 conn(0x7f988c0b5570 msgr2=0x7f988c0b6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.446+0000 7f9890ecb640 1 -- 172.21.15.55:0/182893210 shutdown_connections 2024-04-25T08:59:31.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.446+0000 7f9890ecb640 1 -- 172.21.15.55:0/182893210 wait complete. 2024-04-25T08:59:31.449 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:59:31.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.569+0000 7f14ce5ee640 1 Processor -- start 2024-04-25T08:59:31.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.569+0000 7f14ce5ee640 1 -- start start 2024-04-25T08:59:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.570+0000 7f14ce5ee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14c80d03e0 0x7f14c80d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.570+0000 7f14ce5ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c815dd90 0x7f14c80d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.570+0000 7f14ce5ee640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c80d0d00 con 0x7f14c80d1a30 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.570+0000 7f14ce5ee640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80d2410 con 0x7f14c80d03e0 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.570+0000 7f14ce5ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80d26f0 con 0x7f14c815dd90 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.570+0000 7f14c7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14c80d03e0 0x7f14c80d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.570+0000 7f14c7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14c80d03e0 0x7f14c80d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55576/0 (socket says 172.21.15.55:55576) 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.570+0000 7f14c7fff640 1 -- 172.21.15.55:0/1462230680 learned_addr learned my addr 172.21.15.55:0/1462230680 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.570+0000 7f14c77fe640 1 --2- 172.21.15.55:0/1462230680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c815dd90 0x7f14c80d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.571+0000 7f14c7fff640 1 -- 172.21.15.55:0/1462230680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c815dd90 msgr2=0x7f14c80d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.571+0000 7f14c7fff640 1 --2- 172.21.15.55:0/1462230680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c815dd90 0x7f14c80d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.571+0000 7f14c7fff640 1 -- 172.21.15.55:0/1462230680 >> v1:172.21.15.167:6789/0 conn(0x7f14c80d1a30 legacy=0x7f14c80b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.571+0000 7f14c7fff640 1 -- 172.21.15.55:0/1462230680 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80d29d0 con 0x7f14c80d03e0 2024-04-25T08:59:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.571+0000 7f14c7fff640 1 --2- 172.21.15.55:0/1462230680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c80d03e0 0x7f14c80d34b0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009870 tx=0x7f14b802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba7a1df464b8db8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.571+0000 7f14c6ffd640 1 -- 172.21.15.55:0/1462230680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8037070 con 0x7f14c80d03e0 2024-04-25T08:59:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.571+0000 7f14c6ffd640 1 -- 172.21.15.55:0/1462230680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b802ae50 con 0x7f14c80d03e0 2024-04-25T08:59:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.571+0000 7f14c6ffd640 1 -- 172.21.15.55:0/1462230680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8032860 con 0x7f14c80d03e0 2024-04-25T08:59:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.572+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1462230680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c80d03e0 msgr2=0x7f14c80d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.572+0000 7f14ce5ee640 1 --2- 172.21.15.55:0/1462230680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c80d03e0 0x7f14c80d34b0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009870 tx=0x7f14b802a300 comp rx=0 tx=0).stop 2024-04-25T08:59:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.572+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1462230680 shutdown_connections 2024-04-25T08:59:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.572+0000 7f14ce5ee640 1 --2- 172.21.15.55:0/1462230680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c815dd90 0x7f14c80d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.572+0000 7f14ce5ee640 1 --2- 172.21.15.55:0/1462230680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c80d03e0 0x7f14c80d34b0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.572+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1462230680 >> 172.21.15.55:0/1462230680 conn(0x7f14c8072900 msgr2=0x7f14c806c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.572+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1462230680 shutdown_connections 2024-04-25T08:59:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.572+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1462230680 wait complete. 2024-04-25T08:59:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.573+0000 7f14ce5ee640 1 Processor -- start 2024-04-25T08:59:31.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.573+0000 7f14ce5ee640 1 -- start start 2024-04-25T08:59:31.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14ce5ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c80d03e0 0x7f14c8160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14ce5ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c80d1a30 0x7f14c815e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14ce5ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c815dd90 0x7f14c814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14ce5ee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80b9820 con 0x7f14c80d03e0 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14ce5ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80d2f90 con 0x7f14c80d1a30 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14ce5ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80b99a0 con 0x7f14c815dd90 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c80d03e0 0x7f14c8160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c80d03e0 0x7f14c8160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55590/0 (socket says 172.21.15.55:55590) 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14c7fff640 1 -- 172.21.15.55:0/1231908050 learned_addr learned my addr 172.21.15.55:0/1231908050 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14c77fe640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c80d1a30 0x7f14c815e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14ccb8b640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c815dd90 0x7f14c814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.574+0000 7f14c7fff640 1 -- 172.21.15.55:0/1231908050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c815dd90 msgr2=0x7f14c814ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.575+0000 7f14c7fff640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c815dd90 0x7f14c814ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.575+0000 7f14c7fff640 1 -- 172.21.15.55:0/1231908050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c80d1a30 msgr2=0x7f14c815e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.575+0000 7f14c7fff640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c80d1a30 0x7f14c815e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.575+0000 7f14c7fff640 1 -- 172.21.15.55:0/1231908050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c815e6b0 con 0x7f14c80d03e0 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.575+0000 7f14c77fe640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c80d1a30 0x7f14c815e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.575+0000 7f14c7fff640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c80d03e0 0x7f14c8160a60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f14b8000c00 tx=0x7f14b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.575+0000 7f14c4ff9640 1 -- 172.21.15.55:0/1231908050 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8041020 con 0x7f14c80d03e0 2024-04-25T08:59:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.575+0000 7f14c4ff9640 1 -- 172.21.15.55:0/1231908050 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b803c870 con 0x7f14c80d03e0 2024-04-25T08:59:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.575+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1231908050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c814d3f0 con 0x7f14c80d03e0 2024-04-25T08:59:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.575+0000 7f14c4ff9640 1 -- 172.21.15.55:0/1231908050 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8037040 con 0x7f14c80d03e0 2024-04-25T08:59:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.575+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1231908050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c815ec30 con 0x7f14c80d03e0 2024-04-25T08:59:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.576+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1231908050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c80749b0 con 0x7f14c80d03e0 2024-04-25T08:59:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.576+0000 7f14c4ff9640 1 -- 172.21.15.55:0/1231908050 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f14b8044020 con 0x7f14c80d03e0 2024-04-25T08:59:31.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.577+0000 7f14c4ff9640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14a806b500 0x7f14a806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:31.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.577+0000 7f14c4ff9640 1 -- 172.21.15.55:0/1231908050 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f14b80aa8a0 con 0x7f14c80d03e0 2024-04-25T08:59:31.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.577+0000 7f14c77fe640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14a806b500 0x7f14a806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:31.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.577+0000 7f14c77fe640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14a806b500 0x7f14a806d9c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f14c81613c0 tx=0x7f14b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:31.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.581+0000 7f14c4ff9640 1 -- 172.21.15.55:0/1231908050 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f14b804b030 con 0x7f14c80d03e0 2024-04-25T08:59:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:31.762+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1231908050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f14c80d0ac0 con 0x7f14c80d03e0 2024-04-25T08:59:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.445+0000 7f14c4ff9640 1 -- 172.21.15.55:0/1231908050 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) v1 ==== 170+0+0 (secure 0 0 0) 0x7f14b8079900 con 0x7f14c80d03e0 2024-04-25T08:59:32.435 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-25T08:59:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.450+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1231908050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14a806b500 msgr2=0x7f14a806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.450+0000 7f14ce5ee640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14a806b500 0x7f14a806d9c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f14c81613c0 tx=0x7f14b0008040 comp rx=0 tx=0).stop 2024-04-25T08:59:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.450+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1231908050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c80d03e0 msgr2=0x7f14c8160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.450+0000 7f14ce5ee640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c80d03e0 0x7f14c8160a60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f14b8000c00 tx=0x7f14b80046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.451+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1231908050 shutdown_connections 2024-04-25T08:59:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.451+0000 7f14ce5ee640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14a806b500 0x7f14a806d9c0 secure :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f14c81613c0 tx=0x7f14b0008040 comp rx=0 tx=0).stop 2024-04-25T08:59:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.451+0000 7f14ce5ee640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c815dd90 0x7f14c814ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.451+0000 7f14ce5ee640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c80d1a30 0x7f14c815e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.451+0000 7f14ce5ee640 1 --2- 172.21.15.55:0/1231908050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c80d03e0 0x7f14c8160a60 secure :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f14b8000c00 tx=0x7f14b80046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.451+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1231908050 >> 172.21.15.55:0/1231908050 conn(0x7f14c8072900 msgr2=0x7f14c80caae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:32.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.452+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1231908050 shutdown_connections 2024-04-25T08:59:32.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.452+0000 7f14ce5ee640 1 -- 172.21.15.55:0/1231908050 wait complete. 2024-04-25T08:59:32.467 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:59:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.587+0000 7f4a24f4c640 1 Processor -- start 2024-04-25T08:59:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.587+0000 7f4a24f4c640 1 -- start start 2024-04-25T08:59:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.588+0000 7f4a24f4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a2015bbe0 0x7f4a200cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.588+0000 7f4a24f4c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a200d0610 0x7f4a200cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.588+0000 7f4a24f4c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a200cc830 con 0x7f4a200cf510 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.588+0000 7f4a24f4c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a200ccb10 con 0x7f4a200d0610 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.588+0000 7f4a24f4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200ccdf0 con 0x7f4a2015bbe0 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.588+0000 7f4a1ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a200d0610 0x7f4a200cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.588+0000 7f4a1ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a200d0610 0x7f4a200cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55600/0 (socket says 172.21.15.55:55600) 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.588+0000 7f4a1ed9d640 1 -- 172.21.15.55:0/3626628040 learned_addr learned my addr 172.21.15.55:0/3626628040 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.589+0000 7f4a1e59c640 1 --2- 172.21.15.55:0/3626628040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a2015bbe0 0x7f4a200cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.589+0000 7f4a1ed9d640 1 -- 172.21.15.55:0/3626628040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a2015bbe0 msgr2=0x7f4a200cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.589+0000 7f4a1ed9d640 1 --2- 172.21.15.55:0/3626628040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a2015bbe0 0x7f4a200cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.589+0000 7f4a1ed9d640 1 -- 172.21.15.55:0/3626628040 >> v1:172.21.15.167:6789/0 conn(0x7f4a200cf510 legacy=0x7f4a200cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.589+0000 7f4a1ed9d640 1 -- 172.21.15.55:0/3626628040 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200cd0d0 con 0x7f4a200d0610 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.589+0000 7f4a1ed9d640 1 --2- 172.21.15.55:0/3626628040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a200d0610 0x7f4a200cf970 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009e50 tx=0x7f4a1002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a1aa4fa6e6fdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.590+0000 7f4a1d59a640 1 -- 172.21.15.55:0/3626628040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10036070 con 0x7f4a200d0610 2024-04-25T08:59:32.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.590+0000 7f4a1d59a640 1 -- 172.21.15.55:0/3626628040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10031600 con 0x7f4a200d0610 2024-04-25T08:59:32.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.590+0000 7f4a1d59a640 1 -- 172.21.15.55:0/3626628040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100319d0 con 0x7f4a200d0610 2024-04-25T08:59:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.590+0000 7f4a24f4c640 1 -- 172.21.15.55:0/3626628040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a200d0610 msgr2=0x7f4a200cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.590+0000 7f4a24f4c640 1 --2- 172.21.15.55:0/3626628040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a200d0610 0x7f4a200cf970 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009e50 tx=0x7f4a1002a710 comp rx=0 tx=0).stop 2024-04-25T08:59:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.590+0000 7f4a24f4c640 1 -- 172.21.15.55:0/3626628040 shutdown_connections 2024-04-25T08:59:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.590+0000 7f4a24f4c640 1 --2- 172.21.15.55:0/3626628040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a200d0610 0x7f4a200cf970 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.590+0000 7f4a24f4c640 1 --2- 172.21.15.55:0/3626628040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a2015bbe0 0x7f4a200cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.590+0000 7f4a24f4c640 1 -- 172.21.15.55:0/3626628040 >> 172.21.15.55:0/3626628040 conn(0x7f4a200b3430 msgr2=0x7f4a200b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.590+0000 7f4a24f4c640 1 -- 172.21.15.55:0/3626628040 shutdown_connections 2024-04-25T08:59:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.590+0000 7f4a24f4c640 1 -- 172.21.15.55:0/3626628040 wait complete. 2024-04-25T08:59:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.592+0000 7f4a24f4c640 1 Processor -- start 2024-04-25T08:59:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.592+0000 7f4a24f4c640 1 -- start start 2024-04-25T08:59:32.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.592+0000 7f4a24f4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a200cf510 0x7f4a201559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.592+0000 7f4a24f4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a200d0610 0x7f4a201566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.592+0000 7f4a24f4c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2015bbe0 0x7f4a20156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.592+0000 7f4a24f4c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200cde10 con 0x7f4a2015bbe0 2024-04-25T08:59:32.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.592+0000 7f4a24f4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2015bfc0 con 0x7f4a200d0610 2024-04-25T08:59:32.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.592+0000 7f4a24f4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200cc450 con 0x7f4a200cf510 2024-04-25T08:59:32.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a1ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2015bbe0 0x7f4a20156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a1ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2015bbe0 0x7f4a20156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55616/0 (socket says 172.21.15.55:55616) 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a1ed9d640 1 -- 172.21.15.55:0/2913071439 learned_addr learned my addr 172.21.15.55:0/2913071439 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a1e59c640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a200cf510 0x7f4a201559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a1dd9b640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a200d0610 0x7f4a201566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a1ed9d640 1 -- 172.21.15.55:0/2913071439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a200cf510 msgr2=0x7f4a201559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a1ed9d640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a200cf510 0x7f4a201559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a1ed9d640 1 -- 172.21.15.55:0/2913071439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a200d0610 msgr2=0x7f4a201566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a1ed9d640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a200d0610 0x7f4a201566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a1ed9d640 1 -- 172.21.15.55:0/2913071439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a201572c0 con 0x7f4a2015bbe0 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a1ed9d640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2015bbe0 0x7f4a20156c30 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009e50 tx=0x7f4a10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a16ffd640 1 -- 172.21.15.55:0/2913071439 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10036050 con 0x7f4a2015bbe0 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a16ffd640 1 -- 172.21.15.55:0/2913071439 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10042070 con 0x7f4a2015bbe0 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a16ffd640 1 -- 172.21.15.55:0/2913071439 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10009510 con 0x7f4a2015bbe0 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a24f4c640 1 -- 172.21.15.55:0/2913071439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a20157560 con 0x7f4a2015bbe0 2024-04-25T08:59:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.593+0000 7f4a24f4c640 1 -- 172.21.15.55:0/2913071439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a20157b20 con 0x7f4a2015bbe0 2024-04-25T08:59:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.594+0000 7f4a24f4c640 1 -- 172.21.15.55:0/2913071439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a200750b0 con 0x7f4a2015bbe0 2024-04-25T08:59:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.595+0000 7f4a16ffd640 1 -- 172.21.15.55:0/2913071439 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4a10007bd0 con 0x7f4a2015bbe0 2024-04-25T08:59:32.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.595+0000 7f4a16ffd640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a0006b4d0 0x7f4a0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:32.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.595+0000 7f4a16ffd640 1 -- 172.21.15.55:0/2913071439 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4a100aaed0 con 0x7f4a2015bbe0 2024-04-25T08:59:32.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.595+0000 7f4a1e59c640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a0006b4d0 0x7f4a0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:32.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.596+0000 7f4a1e59c640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a0006b4d0 0x7f4a0006d990 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4a2015b010 tx=0x7f4a18008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.600+0000 7f4a16ffd640 1 -- 172.21.15.55:0/2913071439 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4a10079760 con 0x7f4a2015bbe0 2024-04-25T08:59:32.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:32.816+0000 7f4a24f4c640 1 -- 172.21.15.55:0/2913071439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4a200b42d0 con 0x7f4a2015bbe0 2024-04-25T08:59:33.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.477+0000 7f4a16ffd640 1 -- 172.21.15.55:0/2913071439 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v49) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4a1007d800 con 0x7f4a2015bbe0 2024-04-25T08:59:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 12 and data pool 13 2024-04-25T08:59:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.490+0000 7f4a24f4c640 1 -- 172.21.15.55:0/2913071439 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a0006b4d0 msgr2=0x7f4a0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.491+0000 7f4a24f4c640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a0006b4d0 0x7f4a0006d990 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4a2015b010 tx=0x7f4a18008040 comp rx=0 tx=0).stop 2024-04-25T08:59:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.491+0000 7f4a24f4c640 1 -- 172.21.15.55:0/2913071439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2015bbe0 msgr2=0x7f4a20156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.491+0000 7f4a24f4c640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2015bbe0 0x7f4a20156c30 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009e50 tx=0x7f4a10004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.491+0000 7f4a24f4c640 1 -- 172.21.15.55:0/2913071439 shutdown_connections 2024-04-25T08:59:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.491+0000 7f4a24f4c640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4a0006b4d0 0x7f4a0006d990 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.491+0000 7f4a24f4c640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2015bbe0 0x7f4a20156c30 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.491+0000 7f4a24f4c640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a200d0610 0x7f4a201566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.491+0000 7f4a24f4c640 1 --2- 172.21.15.55:0/2913071439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a200cf510 0x7f4a201559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.491+0000 7f4a24f4c640 1 -- 172.21.15.55:0/2913071439 >> 172.21.15.55:0/2913071439 conn(0x7f4a200b3430 msgr2=0x7f4a200b6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.492+0000 7f4a24f4c640 1 -- 172.21.15.55:0/2913071439 shutdown_connections 2024-04-25T08:59:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.493+0000 7f4a24f4c640 1 -- 172.21.15.55:0/2913071439 wait complete. 2024-04-25T08:59:33.498 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.613+0000 7fc8dac5a640 1 Processor -- start 2024-04-25T08:59:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.613+0000 7fc8dac5a640 1 -- start start 2024-04-25T08:59:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8dac5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d406c2d0 0x7fc8d406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8dac5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8d40acd80 0x7fc8d40ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8dac5a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d406dc70 con 0x7fc8d406bef0 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8dac5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d406eb20 con 0x7fc8d40acd80 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8dac5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d406df10 con 0x7fc8d406c2d0 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8d89f6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc8d406bef0 0x7fc8d415c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55236/0 (socket says 172.21.15.55:55236) 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8d89f6640 1 -- 172.21.15.55:0/539943915 learned_addr learned my addr 172.21.15.55:0/539943915 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cbfff640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d406c2d0 0x7fc8d406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8d91f7640 1 --2- 172.21.15.55:0/539943915 >> v2:172.21.15.167:3300/0 conn(0x7fc8d40acd80 0x7fc8d40ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342217984 0 0) 0x7fc8d406dc70 con 0x7fc8d406bef0 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8bc003520 con 0x7fc8d406bef0 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1293347999 0 0) 0x7fc8bc003520 con 0x7fc8d406bef0 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d406c2d0 msgr2=0x7fc8d406efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d406c2d0 0x7fc8d406efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 >> v2:172.21.15.167:3300/0 conn(0x7fc8d40acd80 msgr2=0x7fc8d40ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 --2- 172.21.15.55:0/539943915 >> v2:172.21.15.167:3300/0 conn(0x7fc8d40acd80 0x7fc8d40ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d406e1f0 con 0x7fc8d406bef0 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc8d0001670 con 0x7fc8d406bef0 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 >> v1:172.21.15.55:6789/0 conn(0x7fc8d406bef0 legacy=0x7fc8d415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d406c2d0 0x7fc8bc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 0x7fc8bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8bc004d40 0x7fc8bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d406eb20 con 0x7fc8bc003f30 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.614+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d406df10 con 0x7fc8bc004d40 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.615+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc00b9c0 con 0x7fc8d406c2d0 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.615+0000 7fc8cbfff640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 0x7fc8bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.615+0000 7fc8d89f6640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d406c2d0 0x7fc8bc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.615+0000 7fc8d91f7640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8bc004d40 0x7fc8bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.615+0000 7fc8cbfff640 1 -- 172.21.15.55:0/539943915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d406c2d0 msgr2=0x7fc8bc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.615+0000 7fc8cbfff640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d406c2d0 0x7fc8bc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.615+0000 7fc8cbfff640 1 -- 172.21.15.55:0/539943915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8bc004d40 msgr2=0x7fc8bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.615+0000 7fc8cbfff640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8bc004d40 0x7fc8bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.615+0000 7fc8cbfff640 1 -- 172.21.15.55:0/539943915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc003520 con 0x7fc8bc003f30 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.616+0000 7fc8cbfff640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 0x7fc8bc004800 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009ac0 tx=0x7fc8bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0f6d52d76ad63e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.616+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4036070 con 0x7fc8bc003f30 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.616+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c4031400 con 0x7fc8bc003f30 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.616+0000 7fc8cb7fe640 1 -- 172.21.15.55:0/539943915 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4009690 con 0x7fc8bc003f30 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.616+0000 7fc8dac5a640 1 -- 172.21.15.55:0/539943915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 msgr2=0x7fc8bc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.616+0000 7fc8dac5a640 1 --2- 172.21.15.55:0/539943915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 0x7fc8bc004800 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009ac0 tx=0x7fc8bc005830 comp rx=0 tx=0).stop 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.616+0000 7fc8d91f7640 1 -- 172.21.15.55:0/539943915 reap_dead start 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.616+0000 7fc8dac5a640 1 -- 172.21.15.55:0/539943915 shutdown_connections 2024-04-25T08:59:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.616+0000 7fc8dac5a640 1 -- 172.21.15.55:0/539943915 >> 172.21.15.55:0/539943915 conn(0x7fc8d40b2220 msgr2=0x7fc8d40cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.616+0000 7fc8dac5a640 1 -- 172.21.15.55:0/539943915 shutdown_connections 2024-04-25T08:59:33.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.616+0000 7fc8dac5a640 1 -- 172.21.15.55:0/539943915 wait complete. 2024-04-25T08:59:33.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.618+0000 7fc8dac5a640 1 Processor -- start 2024-04-25T08:59:33.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.618+0000 7fc8dac5a640 1 -- start start 2024-04-25T08:59:33.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.618+0000 7fc8dac5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 0x7fc8d414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.618+0000 7fc8dac5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d4146000 0x7fc8d414a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.618+0000 7fc8dac5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d4141c60 0x7fc8d414d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.618+0000 7fc8dac5a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40ada00 con 0x7fc8bc003f30 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.618+0000 7fc8dac5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d406e7b0 con 0x7fc8d4141c60 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.618+0000 7fc8dac5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40adb80 con 0x7fc8d4146000 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8d89f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 0x7fc8d414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8d89f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 0x7fc8d414a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55622/0 (socket says 172.21.15.55:55622) 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8d89f6640 1 -- 172.21.15.55:0/3047910414 learned_addr learned my addr 172.21.15.55:0/3047910414 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8cbfff640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d4146000 0x7fc8d414a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8d91f7640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d4141c60 0x7fc8d414d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8d89f6640 1 -- 172.21.15.55:0/3047910414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d4146000 msgr2=0x7fc8d414a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8d89f6640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d4146000 0x7fc8d414a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8d89f6640 1 -- 172.21.15.55:0/3047910414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d4141c60 msgr2=0x7fc8d414d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8d89f6640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d4141c60 0x7fc8d414d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8d89f6640 1 -- 172.21.15.55:0/3047910414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d41f2d80 con 0x7fc8bc003f30 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8cbfff640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d4146000 0x7fc8d414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:33.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8d91f7640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d4141c60 0x7fc8d414d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8d89f6640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 0x7fc8d414a300 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0007340 tx=0x7fc8d0007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8c97fa640 1 -- 172.21.15.55:0/3047910414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d001a070 con 0x7fc8bc003f30 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8c97fa640 1 -- 172.21.15.55:0/3047910414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d000f8e0 con 0x7fc8bc003f30 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8c97fa640 1 -- 172.21.15.55:0/3047910414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d000fcd0 con 0x7fc8bc003f30 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8dac5a640 1 -- 172.21.15.55:0/3047910414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d41f3060 con 0x7fc8bc003f30 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.619+0000 7fc8dac5a640 1 -- 172.21.15.55:0/3047910414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d41f3620 con 0x7fc8bc003f30 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.620+0000 7fc8dac5a640 1 -- 172.21.15.55:0/3047910414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d40749b0 con 0x7fc8bc003f30 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.621+0000 7fc8c97fa640 1 -- 172.21.15.55:0/3047910414 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc8d001d070 con 0x7fc8bc003f30 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.621+0000 7fc8c97fa640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8c006b500 0x7fc8c006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.621+0000 7fc8c97fa640 1 -- 172.21.15.55:0/3047910414 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8d0089b20 con 0x7fc8bc003f30 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.621+0000 7fc8cbfff640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8c006b500 0x7fc8c006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.621+0000 7fc8cbfff640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8c006b500 0x7fc8c006d9c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4033000 tx=0x7fc8c4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.625+0000 7fc8c97fa640 1 -- 172.21.15.55:0/3047910414 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc8d0058a30 con 0x7fc8bc003f30 2024-04-25T08:59:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.806+0000 7fc8dac5a640 1 -- 172.21.15.55:0/3047910414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8d40d0b70 con 0x7fc8bc003f30 2024-04-25T08:59:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.807+0000 7fc8c97fa640 1 -- 172.21.15.55:0/3047910414 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16673 (secure 0 0 0) 0x7fc8d0058330 con 0x7fc8bc003f30 2024-04-25T08:59:33.797 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:33.797 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":86,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:59:32.818249+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:31.118316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:31.794522+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 -- 172.21.15.55:0/3047910414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8c006b500 msgr2=0x7fc8c006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8c006b500 0x7fc8c006d9c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4033000 tx=0x7fc8c4008030 comp rx=0 tx=0).stop 2024-04-25T08:59:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 -- 172.21.15.55:0/3047910414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 msgr2=0x7fc8d414a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 0x7fc8d414a300 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0007340 tx=0x7fc8d0007800 comp rx=0 tx=0).stop 2024-04-25T08:59:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 -- 172.21.15.55:0/3047910414 shutdown_connections 2024-04-25T08:59:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8c006b500 0x7fc8c006d9c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d4141c60 0x7fc8d414d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8d4146000 0x7fc8d414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 --2- 172.21.15.55:0/3047910414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8bc003f30 0x7fc8d414a300 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 -- 172.21.15.55:0/3047910414 >> 172.21.15.55:0/3047910414 conn(0x7fc8d40b2220 msgr2=0x7fc8d40afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 -- 172.21.15.55:0/3047910414 shutdown_connections 2024-04-25T08:59:33.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.810+0000 7fc8dac5a640 1 -- 172.21.15.55:0/3047910414 wait complete. 2024-04-25T08:59:33.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:33.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.922+0000 7fa2463b0640 1 Processor -- start 2024-04-25T08:59:33.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.922+0000 7fa2463b0640 1 -- start start 2024-04-25T08:59:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.923+0000 7fa2463b0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa24015ba10 0x7fa240099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.923+0000 7fa2463b0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa24006c3c0 0x7fa2400cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.923+0000 7fa2463b0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24006c900 con 0x7fa240099f80 2024-04-25T08:59:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.923+0000 7fa2463b0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2400cbe50 con 0x7fa24015ba10 2024-04-25T08:59:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.923+0000 7fa2463b0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24009a3d0 con 0x7fa24006c3c0 2024-04-25T08:59:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.923+0000 7fa23f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa240099f80 0x7fa24006bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55246/0 (socket says 172.21.15.55:55246) 2024-04-25T08:59:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.923+0000 7fa23f7fe640 1 -- 172.21.15.55:0/2167079151 learned_addr learned my addr 172.21.15.55:0/2167079151 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.923+0000 7fa23ffff640 1 --2- 172.21.15.55:0/2167079151 >> v2:172.21.15.167:3300/0 conn(0x7fa24015ba10 0x7fa240099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.923+0000 7fa24494d640 1 --2- 172.21.15.55:0/2167079151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa24006c3c0 0x7fa2400cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.923+0000 7fa23effd640 1 -- 172.21.15.55:0/2167079151 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132162271 0 0) 0x7fa24006c900 con 0x7fa240099f80 2024-04-25T08:59:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.923+0000 7fa23effd640 1 -- 172.21.15.55:0/2167079151 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa228003520 con 0x7fa240099f80 2024-04-25T08:59:33.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.924+0000 7fa23ffff640 1 -- 172.21.15.55:0/2167079151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa24006c3c0 msgr2=0x7fa2400cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:33.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.924+0000 7fa23ffff640 1 --2- 172.21.15.55:0/2167079151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa24006c3c0 0x7fa2400cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.924+0000 7fa23ffff640 1 -- 172.21.15.55:0/2167079151 >> v1:172.21.15.55:6789/0 conn(0x7fa240099f80 legacy=0x7fa24006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.924+0000 7fa23effd640 1 -- 172.21.15.55:0/2167079151 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 140529576 0 0) 0x7fa228003520 con 0x7fa240099f80 2024-04-25T08:59:33.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.924+0000 7fa23ffff640 1 -- 172.21.15.55:0/2167079151 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24006cbe0 con 0x7fa24015ba10 2024-04-25T08:59:33.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.924+0000 7fa23ffff640 1 --2- 172.21.15.55:0/2167079151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24015ba10 0x7fa240099a40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa2300097a0 tx=0x7fa23002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92f6efc8d8178d65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.925+0000 7fa23effd640 1 -- 172.21.15.55:0/2167079151 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230037070 con 0x7fa24015ba10 2024-04-25T08:59:33.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.925+0000 7fa23effd640 1 -- 172.21.15.55:0/2167079151 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23002aba0 con 0x7fa24015ba10 2024-04-25T08:59:33.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.925+0000 7fa23effd640 1 -- 172.21.15.55:0/2167079151 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234001670 con 0x7fa24015ba10 2024-04-25T08:59:33.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.925+0000 7fa2463b0640 1 -- 172.21.15.55:0/2167079151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24015ba10 msgr2=0x7fa240099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.925+0000 7fa2463b0640 1 --2- 172.21.15.55:0/2167079151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24015ba10 0x7fa240099a40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa2300097a0 tx=0x7fa23002a110 comp rx=0 tx=0).stop 2024-04-25T08:59:33.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.925+0000 7fa2463b0640 1 -- 172.21.15.55:0/2167079151 shutdown_connections 2024-04-25T08:59:33.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.925+0000 7fa2463b0640 1 --2- 172.21.15.55:0/2167079151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa24006c3c0 0x7fa2400cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.925+0000 7fa2463b0640 1 --2- 172.21.15.55:0/2167079151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24015ba10 0x7fa240099a40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.925+0000 7fa2463b0640 1 -- 172.21.15.55:0/2167079151 >> 172.21.15.55:0/2167079151 conn(0x7fa2400b32f0 msgr2=0x7fa2400b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:33.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.925+0000 7fa2463b0640 1 -- 172.21.15.55:0/2167079151 shutdown_connections 2024-04-25T08:59:33.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.925+0000 7fa2463b0640 1 -- 172.21.15.55:0/2167079151 wait complete. 2024-04-25T08:59:33.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.926+0000 7fa2463b0640 1 Processor -- start 2024-04-25T08:59:33.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.927+0000 7fa2463b0640 1 -- start start 2024-04-25T08:59:33.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.927+0000 7fa2463b0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24006c3c0 0x7fa2400c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.927+0000 7fa2463b0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa240099f80 0x7fa240154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.927+0000 7fa2463b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa24015ba10 0x7fa2400cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.927+0000 7fa2463b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400cd760 con 0x7fa24015ba10 2024-04-25T08:59:33.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.927+0000 7fa2463b0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400cfe80 con 0x7fa24006c3c0 2024-04-25T08:59:33.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.927+0000 7fa2463b0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400cd8e0 con 0x7fa240099f80 2024-04-25T08:59:33.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.927+0000 7fa24494d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa24015ba10 0x7fa2400cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.927+0000 7fa24494d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa24015ba10 0x7fa2400cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55638/0 (socket says 172.21.15.55:55638) 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.927+0000 7fa24494d640 1 -- 172.21.15.55:0/1160222185 learned_addr learned my addr 172.21.15.55:0/1160222185 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa23ffff640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24006c3c0 0x7fa2400c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa23f7fe640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa240099f80 0x7fa240154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa24494d640 1 -- 172.21.15.55:0/1160222185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa240099f80 msgr2=0x7fa240154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa24494d640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa240099f80 0x7fa240154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa24494d640 1 -- 172.21.15.55:0/1160222185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24006c3c0 msgr2=0x7fa2400c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa24494d640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24006c3c0 0x7fa2400c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa24494d640 1 -- 172.21.15.55:0/1160222185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400c6890 con 0x7fa24015ba10 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa23ffff640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24006c3c0 0x7fa2400c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa23f7fe640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa240099f80 0x7fa240154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa24494d640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa24015ba10 0x7fa2400cb050 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa23800efc0 tx=0x7fa23800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa23cff9640 1 -- 172.21.15.55:0/1160222185 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238018020 con 0x7fa24015ba10 2024-04-25T08:59:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa23cff9640 1 -- 172.21.15.55:0/1160222185 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa238014480 con 0x7fa24015ba10 2024-04-25T08:59:33.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa2463b0640 1 -- 172.21.15.55:0/1160222185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2400c9fb0 con 0x7fa24015ba10 2024-04-25T08:59:33.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa23cff9640 1 -- 172.21.15.55:0/1160222185 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238014870 con 0x7fa24015ba10 2024-04-25T08:59:33.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.928+0000 7fa2463b0640 1 -- 172.21.15.55:0/1160222185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2400ca570 con 0x7fa24015ba10 2024-04-25T08:59:33.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.929+0000 7fa2463b0640 1 -- 172.21.15.55:0/1160222185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2400749b0 con 0x7fa24015ba10 2024-04-25T08:59:33.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.930+0000 7fa23cff9640 1 -- 172.21.15.55:0/1160222185 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa238005d10 con 0x7fa24015ba10 2024-04-25T08:59:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.930+0000 7fa23cff9640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 0x7fa22c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.930+0000 7fa23cff9640 1 -- 172.21.15.55:0/1160222185 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa23808b0a0 con 0x7fa24015ba10 2024-04-25T08:59:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.930+0000 7fa23ffff640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 0x7fa22c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.931+0000 7fa23ffff640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 0x7fa22c06d990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa230034000 tx=0x7fa23002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:33.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:33.934+0000 7fa23cff9640 1 -- 172.21.15.55:0/1160222185 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa238022030 con 0x7fa24015ba10 2024-04-25T08:59:34.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.114+0000 7fa2463b0640 1 -- 172.21.15.55:0/1160222185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa24009a570 con 0x7fa24015ba10 2024-04-25T08:59:34.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.116+0000 7fa23cff9640 1 -- 172.21.15.55:0/1160222185 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16673 (secure 0 0 0) 0x7fa238010040 con 0x7fa24015ba10 2024-04-25T08:59:34.105 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:34.105 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":86,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:59:32.818249+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:31.118316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:31.794522+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:34.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 -- 172.21.15.55:0/1160222185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 msgr2=0x7fa22c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 0x7fa22c06d990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa230034000 tx=0x7fa23002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:34.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 -- 172.21.15.55:0/1160222185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa24015ba10 msgr2=0x7fa2400cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa24015ba10 0x7fa2400cb050 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa23800efc0 tx=0x7fa23800c490 comp rx=0 tx=0).stop 2024-04-25T08:59:34.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 -- 172.21.15.55:0/1160222185 shutdown_connections 2024-04-25T08:59:34.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 0x7fa22c06d990 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa24015ba10 0x7fa2400cb050 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa240099f80 0x7fa240154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 --2- 172.21.15.55:0/1160222185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24006c3c0 0x7fa2400c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 -- 172.21.15.55:0/1160222185 >> 172.21.15.55:0/1160222185 conn(0x7fa2400b32f0 msgr2=0x7fa24006bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:34.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 -- 172.21.15.55:0/1160222185 shutdown_connections 2024-04-25T08:59:34.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.118+0000 7fa2463b0640 1 -- 172.21.15.55:0/1160222185 wait complete. 2024-04-25T08:59:34.119 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:59:34.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.233+0000 7fcc2c934640 1 Processor -- start 2024-04-25T08:59:34.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.233+0000 7fcc2c934640 1 -- start start 2024-04-25T08:59:34.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.234+0000 7fcc2c934640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc2815e040 0x7fcc280cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:34.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.234+0000 7fcc2c934640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc280cc7e0 con 0x7fcc280ce410 2024-04-25T08:59:34.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.234+0000 7fcc2c934640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc280cb350 con 0x7fcc280cee20 2024-04-25T08:59:34.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.234+0000 7fcc2c934640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc280ce9d0 con 0x7fcc2815e040 2024-04-25T08:59:34.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.234+0000 7fcc2659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc2815e040 0x7fcc280cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:34.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.235+0000 7fcc2659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc2815e040 0x7fcc280cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55648/0 (socket says 172.21.15.55:55648) 2024-04-25T08:59:34.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.235+0000 7fcc2659c640 1 -- 172.21.15.55:0/332136227 learned_addr learned my addr 172.21.15.55:0/332136227 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:34.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.235+0000 7fcc2659c640 1 -- 172.21.15.55:0/332136227 >> v1:172.21.15.167:6789/0 conn(0x7fcc280cee20 legacy=0x7fcc280ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:34.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.235+0000 7fcc2659c640 1 -- 172.21.15.55:0/332136227 >> v1:172.21.15.55:6789/0 conn(0x7fcc280ce410 legacy=0x7fcc280cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.235+0000 7fcc2659c640 1 -- 172.21.15.55:0/332136227 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280cb5f0 con 0x7fcc2815e040 2024-04-25T08:59:34.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.235+0000 7fcc2559a640 1 -- 172.21.15.55:0/332136227 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631761583 0 0) 0x7fcc280cc7e0 con 0x7fcc280ce410 2024-04-25T08:59:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.236+0000 7fcc2659c640 1 --2- 172.21.15.55:0/332136227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc2815e040 0x7fcc280cdbb0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fcc200098a0 tx=0x7fcc2002a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af507e92de1234d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.236+0000 7fcc2559a640 1 -- 172.21.15.55:0/332136227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc20037070 con 0x7fcc2815e040 2024-04-25T08:59:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.236+0000 7fcc2559a640 1 -- 172.21.15.55:0/332136227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc20032440 con 0x7fcc2815e040 2024-04-25T08:59:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.236+0000 7fcc2559a640 1 -- 172.21.15.55:0/332136227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc20032810 con 0x7fcc2815e040 2024-04-25T08:59:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.236+0000 7fcc2c934640 1 -- 172.21.15.55:0/332136227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc2815e040 msgr2=0x7fcc280cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.236+0000 7fcc2c934640 1 --2- 172.21.15.55:0/332136227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc2815e040 0x7fcc280cdbb0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fcc200098a0 tx=0x7fcc2002a2e0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.236+0000 7fcc2c934640 1 -- 172.21.15.55:0/332136227 shutdown_connections 2024-04-25T08:59:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.236+0000 7fcc2c934640 1 --2- 172.21.15.55:0/332136227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc2815e040 0x7fcc280cdbb0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.236+0000 7fcc2c934640 1 -- 172.21.15.55:0/332136227 >> 172.21.15.55:0/332136227 conn(0x7fcc280b2390 msgr2=0x7fcc280b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.236+0000 7fcc2c934640 1 -- 172.21.15.55:0/332136227 shutdown_connections 2024-04-25T08:59:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.236+0000 7fcc2c934640 1 -- 172.21.15.55:0/332136227 wait complete. 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.238+0000 7fcc2c934640 1 Processor -- start 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.238+0000 7fcc2c934640 1 -- start start 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.238+0000 7fcc2c934640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc280ce410 0x7fcc2815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.238+0000 7fcc2c934640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc280cee20 0x7fcc28157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.238+0000 7fcc2c934640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc2815e040 0x7fcc280b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.238+0000 7fcc2c934640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2815e420 con 0x7fcc280cee20 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.238+0000 7fcc2c934640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280cbbb0 con 0x7fcc280ce410 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.238+0000 7fcc2c934640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280ce0f0 con 0x7fcc2815e040 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc25d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc280cee20 0x7fcc28157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc25d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc280cee20 0x7fcc28157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55650/0 (socket says 172.21.15.55:55650) 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc25d9b640 1 -- 172.21.15.55:0/79351860 learned_addr learned my addr 172.21.15.55:0/79351860 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc25d9b640 1 -- 172.21.15.55:0/79351860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc2815e040 msgr2=0x7fcc280b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc25d9b640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc2815e040 0x7fcc280b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc25d9b640 1 -- 172.21.15.55:0/79351860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc280ce410 msgr2=0x7fcc2815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc25d9b640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc280ce410 0x7fcc2815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc25d9b640 1 -- 172.21.15.55:0/79351860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280b2ac0 con 0x7fcc280cee20 2024-04-25T08:59:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc25d9b640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc280cee20 0x7fcc28157fe0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c410 tx=0x7fcc1000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc1effd640 1 -- 172.21.15.55:0/79351860 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10017070 con 0x7fcc280cee20 2024-04-25T08:59:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc1effd640 1 -- 172.21.15.55:0/79351860 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc100035f0 con 0x7fcc280cee20 2024-04-25T08:59:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc2c934640 1 -- 172.21.15.55:0/79351860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc28158520 con 0x7fcc280cee20 2024-04-25T08:59:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc1effd640 1 -- 172.21.15.55:0/79351860 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc100039e0 con 0x7fcc280cee20 2024-04-25T08:59:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.239+0000 7fcc2c934640 1 -- 172.21.15.55:0/79351860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc280c8de0 con 0x7fcc280cee20 2024-04-25T08:59:34.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.240+0000 7fcc2c934640 1 -- 172.21.15.55:0/79351860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc280750b0 con 0x7fcc280cee20 2024-04-25T08:59:34.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.241+0000 7fcc1effd640 1 -- 172.21.15.55:0/79351860 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc1001a070 con 0x7fcc280cee20 2024-04-25T08:59:34.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.241+0000 7fcc1effd640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc0806b500 0x7fcc0806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:34.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.241+0000 7fcc2659c640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc0806b500 0x7fcc0806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:34.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.241+0000 7fcc1effd640 1 -- 172.21.15.55:0/79351860 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc10089580 con 0x7fcc280cee20 2024-04-25T08:59:34.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.242+0000 7fcc2659c640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc0806b500 0x7fcc0806d9c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcc20034000 tx=0x7fcc2002c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:34.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.246+0000 7fcc1effd640 1 -- 172.21.15.55:0/79351860 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc10058490 con 0x7fcc280cee20 2024-04-25T08:59:34.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.462+0000 7fcc2c934640 1 -- 172.21.15.55:0/79351860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcc280c6a00 con 0x7fcc280cee20 2024-04-25T08:59:34.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.482+0000 7fcc1effd640 1 -- 172.21.15.55:0/79351860 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcc10057d90 con 0x7fcc280cee20 2024-04-25T08:59:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.484+0000 7fcc2c934640 1 -- 172.21.15.55:0/79351860 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc0806b500 msgr2=0x7fcc0806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.484+0000 7fcc2c934640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc0806b500 0x7fcc0806d9c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcc20034000 tx=0x7fcc2002c000 comp rx=0 tx=0).stop 2024-04-25T08:59:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.484+0000 7fcc2c934640 1 -- 172.21.15.55:0/79351860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc280cee20 msgr2=0x7fcc28157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.484+0000 7fcc2c934640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc280cee20 0x7fcc28157fe0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c410 tx=0x7fcc1000c8d0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.484+0000 7fcc2c934640 1 -- 172.21.15.55:0/79351860 shutdown_connections 2024-04-25T08:59:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.484+0000 7fcc2c934640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc0806b500 0x7fcc0806d9c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.484+0000 7fcc2c934640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc2815e040 0x7fcc280b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.484+0000 7fcc2c934640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc280cee20 0x7fcc28157fe0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.484+0000 7fcc2c934640 1 --2- 172.21.15.55:0/79351860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc280ce410 0x7fcc2815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.484+0000 7fcc2c934640 1 -- 172.21.15.55:0/79351860 >> 172.21.15.55:0/79351860 conn(0x7fcc280b2390 msgr2=0x7fcc280b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.485+0000 7fcc2c934640 1 -- 172.21.15.55:0/79351860 shutdown_connections 2024-04-25T08:59:34.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.485+0000 7fcc2c934640 1 -- 172.21.15.55:0/79351860 wait complete. 2024-04-25T08:59:34.484 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:59:34.484 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:59:34.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.599+0000 7f5235e88640 1 Processor -- start 2024-04-25T08:59:34.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.599+0000 7f5235e88640 1 -- start start 2024-04-25T08:59:34.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f5235e88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52300b42c0 0x7f523015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f5235e88640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52300b46a0 0x7f52301549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f5235e88640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523015b370 con 0x7f523015aef0 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f5235e88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52300d05d0 con 0x7f52300b42c0 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f5235e88640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523015b650 con 0x7f52300b46a0 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f522f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52300b42c0 0x7f523015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f522f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52300b42c0 0x7f523015ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55664/0 (socket says 172.21.15.55:55664) 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f522f7fe640 1 -- 172.21.15.55:0/1015597591 learned_addr learned my addr 172.21.15.55:0/1015597591 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f522ffff640 1 --2- 172.21.15.55:0/1015597591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52300b46a0 0x7f52301549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f522f7fe640 1 -- 172.21.15.55:0/1015597591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52300b46a0 msgr2=0x7f52301549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f522f7fe640 1 --2- 172.21.15.55:0/1015597591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52300b46a0 0x7f52301549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f522f7fe640 1 -- 172.21.15.55:0/1015597591 >> v1:172.21.15.167:6789/0 conn(0x7f523015aef0 legacy=0x7f52300cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.600+0000 7f522f7fe640 1 -- 172.21.15.55:0/1015597591 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523015b930 con 0x7f52300b42c0 2024-04-25T08:59:34.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.601+0000 7f522f7fe640 1 --2- 172.21.15.55:0/1015597591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52300b42c0 0x7f523015ef40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5220009870 tx=0x7f522002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcb59adbfae65c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.601+0000 7f522e7fc640 1 -- 172.21.15.55:0/1015597591 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220037070 con 0x7f52300b42c0 2024-04-25T08:59:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.601+0000 7f522e7fc640 1 -- 172.21.15.55:0/1015597591 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220032440 con 0x7f52300b42c0 2024-04-25T08:59:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.601+0000 7f522e7fc640 1 -- 172.21.15.55:0/1015597591 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220032810 con 0x7f52300b42c0 2024-04-25T08:59:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.602+0000 7f5235e88640 1 -- 172.21.15.55:0/1015597591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52300b42c0 msgr2=0x7f523015ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.602+0000 7f5235e88640 1 --2- 172.21.15.55:0/1015597591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52300b42c0 0x7f523015ef40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5220009870 tx=0x7f522002a130 comp rx=0 tx=0).stop 2024-04-25T08:59:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.602+0000 7f5235e88640 1 -- 172.21.15.55:0/1015597591 shutdown_connections 2024-04-25T08:59:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.602+0000 7f5235e88640 1 --2- 172.21.15.55:0/1015597591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52300b46a0 0x7f52301549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.602+0000 7f5235e88640 1 --2- 172.21.15.55:0/1015597591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52300b42c0 0x7f523015ef40 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.602+0000 7f5235e88640 1 -- 172.21.15.55:0/1015597591 >> 172.21.15.55:0/1015597591 conn(0x7f523006aba0 msgr2=0x7f523006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.602+0000 7f5235e88640 1 -- 172.21.15.55:0/1015597591 shutdown_connections 2024-04-25T08:59:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.602+0000 7f5235e88640 1 -- 172.21.15.55:0/1015597591 wait complete. 2024-04-25T08:59:34.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.603+0000 7f5235e88640 1 Processor -- start 2024-04-25T08:59:34.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.603+0000 7f5235e88640 1 -- start start 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f5235e88640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52300b42c0 0x7f52301f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f5235e88640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52300b46a0 0x7f52301fb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f5235e88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f523015aef0 0x7f52300b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f5235e88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523006ec60 con 0x7f523015aef0 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f5235e88640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523006eae0 con 0x7f52300b42c0 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f5235e88640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5230154f10 con 0x7f52300b46a0 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f522ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f523015aef0 0x7f52300b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f522ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f523015aef0 0x7f52300b0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55666/0 (socket says 172.21.15.55:55666) 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f522ffff640 1 -- 172.21.15.55:0/3080399179 learned_addr learned my addr 172.21.15.55:0/3080399179 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f522f7fe640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52300b42c0 0x7f52301f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f522effd640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52300b46a0 0x7f52301fb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f522ffff640 1 -- 172.21.15.55:0/3080399179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52300b46a0 msgr2=0x7f52301fb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.604+0000 7f522ffff640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52300b46a0 0x7f52301fb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.605+0000 7f522ffff640 1 -- 172.21.15.55:0/3080399179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52300b42c0 msgr2=0x7f52301f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.605+0000 7f522ffff640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52300b42c0 0x7f52301f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.605+0000 7f522ffff640 1 -- 172.21.15.55:0/3080399179 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52301fbe10 con 0x7f523015aef0 2024-04-25T08:59:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.605+0000 7f522f7fe640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52300b42c0 0x7f52301f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.605+0000 7f522ffff640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f523015aef0 0x7f52300b0e90 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f522800efc0 tx=0x7f522800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.605+0000 7f5217fff640 1 -- 172.21.15.55:0/3080399179 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228018020 con 0x7f523015aef0 2024-04-25T08:59:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.605+0000 7f5217fff640 1 -- 172.21.15.55:0/3080399179 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5228014480 con 0x7f523015aef0 2024-04-25T08:59:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.605+0000 7f5235e88640 1 -- 172.21.15.55:0/3080399179 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52301fc0f0 con 0x7f523015aef0 2024-04-25T08:59:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.605+0000 7f5217fff640 1 -- 172.21.15.55:0/3080399179 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228014870 con 0x7f523015aef0 2024-04-25T08:59:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.605+0000 7f5235e88640 1 -- 172.21.15.55:0/3080399179 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52301f83a0 con 0x7f523015aef0 2024-04-25T08:59:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.606+0000 7f5235e88640 1 -- 172.21.15.55:0/3080399179 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52301f7ee0 con 0x7f523015aef0 2024-04-25T08:59:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.606+0000 7f5217fff640 1 -- 172.21.15.55:0/3080399179 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5228005d10 con 0x7f523015aef0 2024-04-25T08:59:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.607+0000 7f5217fff640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f521c06b4d0 0x7f521c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.607+0000 7f5217fff640 1 -- 172.21.15.55:0/3080399179 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f522808ae00 con 0x7f523015aef0 2024-04-25T08:59:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.607+0000 7f522f7fe640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f521c06b4d0 0x7f521c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.607+0000 7f522f7fe640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f521c06b4d0 0x7f521c06d990 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5220034000 tx=0x7f522002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:34.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.611+0000 7f5217fff640 1 -- 172.21.15.55:0/3080399179 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52301f7ee0 con 0x7f523015aef0 2024-04-25T08:59:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:34.831+0000 7f5235e88640 1 -- 172.21.15.55:0/3080399179 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f52300750b0 con 0x7f523015aef0 2024-04-25T08:59:35.430 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T08:59:35.441+0000 7f31ffa9f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:59:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.489+0000 7f5217fff640 1 -- 172.21.15.55:0/3080399179 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5228022070 con 0x7f523015aef0 2024-04-25T08:59:35.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 -- 172.21.15.55:0/3080399179 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f521c06b4d0 msgr2=0x7f521c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f521c06b4d0 0x7f521c06d990 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5220034000 tx=0x7f522002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:35.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 -- 172.21.15.55:0/3080399179 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f523015aef0 msgr2=0x7f52300b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f523015aef0 0x7f52300b0e90 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f522800efc0 tx=0x7f522800c490 comp rx=0 tx=0).stop 2024-04-25T08:59:35.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 -- 172.21.15.55:0/3080399179 shutdown_connections 2024-04-25T08:59:35.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f521c06b4d0 0x7f521c06d990 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f523015aef0 0x7f52300b0e90 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52300b46a0 0x7f52301fb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 --2- 172.21.15.55:0/3080399179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52300b42c0 0x7f52301f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 -- 172.21.15.55:0/3080399179 >> 172.21.15.55:0/3080399179 conn(0x7f523006aba0 msgr2=0x7f52300cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:35.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 -- 172.21.15.55:0/3080399179 shutdown_connections 2024-04-25T08:59:35.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.492+0000 7f5235e88640 1 -- 172.21.15.55:0/3080399179 wait complete. 2024-04-25T08:59:35.494 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:59:35.495 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:35.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.613+0000 7f6b7c15c640 1 Processor -- start 2024-04-25T08:59:35.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.613+0000 7f6b7c15c640 1 -- start start 2024-04-25T08:59:35.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b7c15c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b7415bf00 0x7f6b740cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b7c15c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b740cc310 0x7f6b7415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b7c15c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740ce6c0 con 0x7f6b7415c820 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b7c15c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b741455e0 con 0x7f6b7415bf00 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b7c15c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7406d450 con 0x7f6b740cc310 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b7a6f9640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6b7415c820 0x7f6b7406d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55274/0 (socket says 172.21.15.55:55274) 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b79ef8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b7415bf00 0x7f6b740cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b7a6f9640 1 -- 172.21.15.55:0/435299817 learned_addr learned my addr 172.21.15.55:0/435299817 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b796f7640 1 --2- 172.21.15.55:0/435299817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b740cc310 0x7f6b7415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b78ef6640 1 -- 172.21.15.55:0/435299817 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154071503 0 0) 0x7f6b6c001490 con 0x7f6b7415c820 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b78ef6640 1 -- 172.21.15.55:0/435299817 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b60003520 con 0x7f6b7415c820 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b79ef8640 1 -- 172.21.15.55:0/435299817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b740cc310 msgr2=0x7f6b7415c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b79ef8640 1 --2- 172.21.15.55:0/435299817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b740cc310 0x7f6b7415c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b79ef8640 1 -- 172.21.15.55:0/435299817 >> v1:172.21.15.55:6789/0 conn(0x7f6b7415c820 legacy=0x7f6b7406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.614+0000 7f6b79ef8640 1 -- 172.21.15.55:0/435299817 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b740cc7b0 con 0x7f6b7415bf00 2024-04-25T08:59:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.615+0000 7f6b79ef8640 1 --2- 172.21.15.55:0/435299817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b7415bf00 0x7f6b740cbdd0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6b700097a0 tx=0x7f6b7002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d051c42c0f23cda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.615+0000 7f6b78ef6640 1 -- 172.21.15.55:0/435299817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70037070 con 0x7f6b7415bf00 2024-04-25T08:59:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.615+0000 7f6b78ef6640 1 -- 172.21.15.55:0/435299817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b70032440 con 0x7f6b7415bf00 2024-04-25T08:59:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.615+0000 7f6b78ef6640 1 -- 172.21.15.55:0/435299817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700327f0 con 0x7f6b7415bf00 2024-04-25T08:59:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.616+0000 7f6b7c15c640 1 -- 172.21.15.55:0/435299817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b7415bf00 msgr2=0x7f6b740cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.616+0000 7f6b7c15c640 1 --2- 172.21.15.55:0/435299817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b7415bf00 0x7f6b740cbdd0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6b700097a0 tx=0x7f6b7002a180 comp rx=0 tx=0).stop 2024-04-25T08:59:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.616+0000 7f6b7c15c640 1 -- 172.21.15.55:0/435299817 shutdown_connections 2024-04-25T08:59:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.616+0000 7f6b7c15c640 1 --2- 172.21.15.55:0/435299817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b740cc310 0x7f6b7415c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.616+0000 7f6b7c15c640 1 --2- 172.21.15.55:0/435299817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b7415bf00 0x7f6b740cbdd0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.616+0000 7f6b7c15c640 1 -- 172.21.15.55:0/435299817 >> 172.21.15.55:0/435299817 conn(0x7f6b7406aba0 msgr2=0x7f6b7406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.616+0000 7f6b7c15c640 1 -- 172.21.15.55:0/435299817 shutdown_connections 2024-04-25T08:59:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.616+0000 7f6b7c15c640 1 -- 172.21.15.55:0/435299817 wait complete. 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.617+0000 7f6b7c15c640 1 Processor -- start 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.617+0000 7f6b7c15c640 1 -- start start 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7c15c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b740cc310 0x7f6b7413b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7c15c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7415bf00 0x7f6b74140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7c15c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b7415c820 0x7f6b740cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7c15c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740cd050 con 0x7f6b7415c820 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7c15c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740ccd70 con 0x7f6b740cc310 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7c15c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7415cca0 con 0x7f6b7415bf00 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7a6f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b7415c820 0x7f6b740cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7a6f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b7415c820 0x7f6b740cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55680/0 (socket says 172.21.15.55:55680) 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7a6f9640 1 -- 172.21.15.55:0/3482016834 learned_addr learned my addr 172.21.15.55:0/3482016834 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b79ef8640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b740cc310 0x7f6b7413b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b796f7640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7415bf00 0x7f6b74140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7a6f9640 1 -- 172.21.15.55:0/3482016834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7415bf00 msgr2=0x7f6b74140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7a6f9640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7415bf00 0x7f6b74140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7a6f9640 1 -- 172.21.15.55:0/3482016834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b740cc310 msgr2=0x7f6b7413b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7a6f9640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b740cc310 0x7f6b7413b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b7a6f9640 1 -- 172.21.15.55:0/3482016834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7413b800 con 0x7f6b7415c820 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b79ef8640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b740cc310 0x7f6b7413b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.618+0000 7f6b796f7640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7415bf00 0x7f6b74140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.619+0000 7f6b7a6f9640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b7415c820 0x7f6b740cee40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00cb10 tx=0x7f6b6c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.619+0000 7f6b6a7fc640 1 -- 172.21.15.55:0/3482016834 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c017070 con 0x7f6b7415c820 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.619+0000 7f6b6a7fc640 1 -- 172.21.15.55:0/3482016834 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c00ac10 con 0x7f6b7415c820 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.619+0000 7f6b6a7fc640 1 -- 172.21.15.55:0/3482016834 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c012400 con 0x7f6b7415c820 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.619+0000 7f6b7c15c640 1 -- 172.21.15.55:0/3482016834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7413c690 con 0x7f6b7415c820 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.619+0000 7f6b7c15c640 1 -- 172.21.15.55:0/3482016834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7413cf30 con 0x7f6b7415c820 2024-04-25T08:59:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.620+0000 7f6b7c15c640 1 -- 172.21.15.55:0/3482016834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7406bb30 con 0x7f6b7415c820 2024-04-25T08:59:35.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.620+0000 7f6b6a7fc640 1 -- 172.21.15.55:0/3482016834 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6b6c01a070 con 0x7f6b7415c820 2024-04-25T08:59:35.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.620+0000 7f6b6a7fc640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b5806b4d0 0x7f6b5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.621+0000 7f6b6a7fc640 1 -- 172.21.15.55:0/3482016834 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b6c089ee0 con 0x7f6b7415c820 2024-04-25T08:59:35.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.621+0000 7f6b79ef8640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b5806b4d0 0x7f6b5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.621+0000 7f6b79ef8640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b5806b4d0 0x7f6b5806d990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6b70034000 tx=0x7f6b7002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:35.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.625+0000 7f6b6a7fc640 1 -- 172.21.15.55:0/3482016834 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6b740ce6c0 con 0x7f6b7415c820 2024-04-25T08:59:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.845+0000 7f6b7c15c640 1 -- 172.21.15.55:0/3482016834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b74071e40 con 0x7f6b7415c820 2024-04-25T08:59:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.845+0000 7f6b6a7fc640 1 -- 172.21.15.55:0/3482016834 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f6b6c058df0 con 0x7f6b7415c820 2024-04-25T08:59:35.835 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:35.835 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T08:59:34.832597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7323":{"gid":7323,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3953928431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3953928431},{"type":"v1","addr":"172.21.15.55:6837","nonce":3953928431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:59:35.835 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2024-04-25T08:59:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 -- 172.21.15.55:0/3482016834 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b5806b4d0 msgr2=0x7f6b5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b5806b4d0 0x7f6b5806d990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6b70034000 tx=0x7f6b7002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 -- 172.21.15.55:0/3482016834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b7415c820 msgr2=0x7f6b740cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b7415c820 0x7f6b740cee40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00cb10 tx=0x7f6b6c00a060 comp rx=0 tx=0).stop 2024-04-25T08:59:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 -- 172.21.15.55:0/3482016834 shutdown_connections 2024-04-25T08:59:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b5806b4d0 0x7f6b5806d990 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b7415c820 0x7f6b740cee40 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7415bf00 0x7f6b74140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 --2- 172.21.15.55:0/3482016834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b740cc310 0x7f6b7413b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 -- 172.21.15.55:0/3482016834 >> 172.21.15.55:0/3482016834 conn(0x7f6b7406aba0 msgr2=0x7f6b7415e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 -- 172.21.15.55:0/3482016834 shutdown_connections 2024-04-25T08:59:35.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.847+0000 7f6b7c15c640 1 -- 172.21.15.55:0/3482016834 wait complete. 2024-04-25T08:59:35.847 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:35.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.959+0000 7f2876310640 1 Processor -- start 2024-04-25T08:59:35.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.959+0000 7f2876310640 1 -- start start 2024-04-25T08:59:35.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.960+0000 7f2876310640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28700d35b0 0x7f28700b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.960+0000 7f2876310640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f28700b5990 0x7f28700b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.960+0000 7f2876310640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287015e0c0 con 0x7f287015dce0 2024-04-25T08:59:35.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.960+0000 7f2876310640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28700b5de0 con 0x7f28700b5990 2024-04-25T08:59:35.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.960+0000 7f2876310640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700d2510 con 0x7f28700d35b0 2024-04-25T08:59:35.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.960+0000 7f286ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f287015dce0 0x7f28700d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55290/0 (socket says 172.21.15.55:55290) 2024-04-25T08:59:35.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.960+0000 7f286ffff640 1 -- 172.21.15.55:0/3638974950 learned_addr learned my addr 172.21.15.55:0/3638974950 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:35.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.960+0000 7f28748ad640 1 --2- 172.21.15.55:0/3638974950 >> v2:172.21.15.167:3300/0 conn(0x7f28700b5990 0x7f28700b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.960+0000 7f286f7fe640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28700d35b0 0x7f28700b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.960+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832797088 0 0) 0x7f287015e0c0 con 0x7f287015dce0 2024-04-25T08:59:35.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f285c003520 con 0x7f287015dce0 2024-04-25T08:59:35.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2105728402 0 0) 0x7f285c003520 con 0x7f287015dce0 2024-04-25T08:59:35.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28700d35b0 msgr2=0x7f28700b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:35.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28700d35b0 0x7f28700b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 >> v2:172.21.15.167:3300/0 conn(0x7f28700b5990 msgr2=0x7f28700b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:35.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 --2- 172.21.15.55:0/3638974950 >> v2:172.21.15.167:3300/0 conn(0x7f28700b5990 0x7f28700b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700d27f0 con 0x7f287015dce0 2024-04-25T08:59:35.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f2858001670 con 0x7f287015dce0 2024-04-25T08:59:35.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 >> v1:172.21.15.55:6789/0 conn(0x7f287015dce0 legacy=0x7f28700d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f285c0039b0 0x7f285c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 0x7f285c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28700d35b0 0x7f285c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700b5de0 con 0x7f285c004800 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700d2510 con 0x7f285c0039b0 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c00b9c0 con 0x7f28700d35b0 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286f7fe640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 0x7f285c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286ffff640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f285c0039b0 0x7f285c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f28748ad640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28700d35b0 0x7f285c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286f7fe640 1 -- 172.21.15.55:0/3638974950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28700d35b0 msgr2=0x7f285c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286f7fe640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28700d35b0 0x7f285c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286f7fe640 1 -- 172.21.15.55:0/3638974950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f285c0039b0 msgr2=0x7f285c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:35.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286f7fe640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f285c0039b0 0x7f285c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.961+0000 7f286f7fe640 1 -- 172.21.15.55:0/3638974950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c003520 con 0x7f285c004800 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.962+0000 7f286f7fe640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 0x7f285c004c80 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f2860009ac0 tx=0x7f285c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc005b8306f14ae6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.962+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860036070 con 0x7f285c004800 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.962+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860031400 con 0x7f285c004800 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.962+0000 7f286effd640 1 -- 172.21.15.55:0/3638974950 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860009690 con 0x7f285c004800 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.963+0000 7f2876310640 1 -- 172.21.15.55:0/3638974950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 msgr2=0x7f285c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.963+0000 7f2876310640 1 --2- 172.21.15.55:0/3638974950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 0x7f285c004c80 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f2860009ac0 tx=0x7f285c005830 comp rx=0 tx=0).stop 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.963+0000 7f28748ad640 1 -- 172.21.15.55:0/3638974950 reap_dead start 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.963+0000 7f2876310640 1 -- 172.21.15.55:0/3638974950 shutdown_connections 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.963+0000 7f2876310640 1 -- 172.21.15.55:0/3638974950 >> 172.21.15.55:0/3638974950 conn(0x7f2870072900 msgr2=0x7f28700d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.963+0000 7f2876310640 1 -- 172.21.15.55:0/3638974950 shutdown_connections 2024-04-25T08:59:35.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.963+0000 7f2876310640 1 -- 172.21.15.55:0/3638974950 wait complete. 2024-04-25T08:59:35.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.964+0000 7f2876310640 1 Processor -- start 2024-04-25T08:59:35.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.964+0000 7f2876310640 1 -- start start 2024-04-25T08:59:35.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f2876310640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 0x7f28700c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f2876310640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870155bd0 0x7f2870156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f2876310640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2870153c80 0x7f2870154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f2876310640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700d3090 con 0x7f285c004800 2024-04-25T08:59:35.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f2876310640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700d2db0 con 0x7f2870155bd0 2024-04-25T08:59:35.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f2876310640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700d2160 con 0x7f2870153c80 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f286ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 0x7f28700c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f286ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 0x7f28700c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55710/0 (socket says 172.21.15.55:55710) 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f286ffff640 1 -- 172.21.15.55:0/3193611122 learned_addr learned my addr 172.21.15.55:0/3193611122 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f286f7fe640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870155bd0 0x7f2870156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f28748ad640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2870153c80 0x7f2870154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f286ffff640 1 -- 172.21.15.55:0/3193611122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2870153c80 msgr2=0x7f2870154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f286ffff640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2870153c80 0x7f2870154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f286ffff640 1 -- 172.21.15.55:0/3193611122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870155bd0 msgr2=0x7f2870156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f286ffff640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870155bd0 0x7f2870156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f286ffff640 1 -- 172.21.15.55:0/3193611122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700c9740 con 0x7f285c004800 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f286f7fe640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870155bd0 0x7f2870156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.965+0000 7f286ffff640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 0x7f28700c9200 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f2858007370 tx=0x7f2858007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.966+0000 7f286cff9640 1 -- 172.21.15.55:0/3193611122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285801a070 con 0x7f285c004800 2024-04-25T08:59:35.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.966+0000 7f286cff9640 1 -- 172.21.15.55:0/3193611122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285800f8e0 con 0x7f285c004800 2024-04-25T08:59:35.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.966+0000 7f2876310640 1 -- 172.21.15.55:0/3193611122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28701566d0 con 0x7f285c004800 2024-04-25T08:59:35.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.966+0000 7f286cff9640 1 -- 172.21.15.55:0/3193611122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285800fcb0 con 0x7f285c004800 2024-04-25T08:59:35.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.966+0000 7f2876310640 1 -- 172.21.15.55:0/3193611122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2870156c90 con 0x7f285c004800 2024-04-25T08:59:35.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.967+0000 7f2876310640 1 -- 172.21.15.55:0/3193611122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28700749b0 con 0x7f285c004800 2024-04-25T08:59:35.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.967+0000 7f286cff9640 1 -- 172.21.15.55:0/3193611122 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f285801d360 con 0x7f285c004800 2024-04-25T08:59:35.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.968+0000 7f286cff9640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f285006b500 0x7f285006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:35.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.968+0000 7f286cff9640 1 -- 172.21.15.55:0/3193611122 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2858089b40 con 0x7f285c004800 2024-04-25T08:59:35.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.968+0000 7f286f7fe640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f285006b500 0x7f285006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:35.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.968+0000 7f286f7fe640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f285006b500 0x7f285006d9c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2860033000 tx=0x7f2860008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:35.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:35.972+0000 7f286cff9640 1 -- 172.21.15.55:0/3193611122 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f28700c9740 con 0x7f285c004800 2024-04-25T08:59:36.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.153+0000 7f2876310640 1 -- 172.21.15.55:0/3193611122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28700cee10 con 0x7f285c004800 2024-04-25T08:59:36.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.154+0000 7f286cff9640 1 -- 172.21.15.55:0/3193611122 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16660 (secure 0 0 0) 0x7f2858058930 con 0x7f285c004800 2024-04-25T08:59:36.143 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:36.143 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":87,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:59:34.463295+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:31.118316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:31.794522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:36.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 -- 172.21.15.55:0/3193611122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f285006b500 msgr2=0x7f285006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f285006b500 0x7f285006d9c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2860033000 tx=0x7f2860008030 comp rx=0 tx=0).stop 2024-04-25T08:59:36.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 -- 172.21.15.55:0/3193611122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 msgr2=0x7f28700c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 0x7f28700c9200 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f2858007370 tx=0x7f2858007830 comp rx=0 tx=0).stop 2024-04-25T08:59:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 -- 172.21.15.55:0/3193611122 shutdown_connections 2024-04-25T08:59:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f285006b500 0x7f285006d9c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2870153c80 0x7f2870154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870155bd0 0x7f2870156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 --2- 172.21.15.55:0/3193611122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285c004800 0x7f28700c9200 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 -- 172.21.15.55:0/3193611122 >> 172.21.15.55:0/3193611122 conn(0x7f2870072900 msgr2=0x7f28700d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 -- 172.21.15.55:0/3193611122 shutdown_connections 2024-04-25T08:59:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.156+0000 7f2876310640 1 -- 172.21.15.55:0/3193611122 wait complete. 2024-04-25T08:59:36.156 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:59:36.157 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:59:36.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.268+0000 7f2fc2a15640 1 Processor -- start 2024-04-25T08:59:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.268+0000 7f2fc2a15640 1 -- start start 2024-04-25T08:59:36.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.269+0000 7f2fc2a15640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fbc0d35b0 0x7f2fbc0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.269+0000 7f2fc2a15640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fbc0b5990 0x7f2fbc0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.269+0000 7f2fc2a15640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc15e0c0 con 0x7f2fbc15dce0 2024-04-25T08:59:36.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.269+0000 7f2fc2a15640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b5de0 con 0x7f2fbc0b5990 2024-04-25T08:59:36.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.269+0000 7f2fc2a15640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0d2510 con 0x7f2fbc0d35b0 2024-04-25T08:59:36.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.269+0000 7f2fc0fb2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fbc0b5990 0x7f2fbc0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.269+0000 7f2fc0fb2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fbc0b5990 0x7f2fbc0b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55712/0 (socket says 172.21.15.55:55712) 2024-04-25T08:59:36.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.269+0000 7f2fc0fb2640 1 -- 172.21.15.55:0/314053701 learned_addr learned my addr 172.21.15.55:0/314053701 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:36.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.270+0000 7f2fbb7fe640 1 --2- 172.21.15.55:0/314053701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fbc0d35b0 0x7f2fbc0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.270+0000 7f2fc0fb2640 1 -- 172.21.15.55:0/314053701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fbc0d35b0 msgr2=0x7f2fbc0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:36.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.270+0000 7f2fc0fb2640 1 --2- 172.21.15.55:0/314053701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fbc0d35b0 0x7f2fbc0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.270+0000 7f2fc0fb2640 1 -- 172.21.15.55:0/314053701 >> v1:172.21.15.167:6789/0 conn(0x7f2fbc15dce0 legacy=0x7f2fbc0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:36.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.270+0000 7f2fc0fb2640 1 -- 172.21.15.55:0/314053701 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0d27f0 con 0x7f2fbc0b5990 2024-04-25T08:59:36.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.270+0000 7f2fc0fb2640 1 --2- 172.21.15.55:0/314053701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fbc0b5990 0x7f2fbc0b6b00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009e50 tx=0x7f2fb402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e04bca8f9f4192 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:36.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.271+0000 7f2fbaffd640 1 -- 172.21.15.55:0/314053701 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4036070 con 0x7f2fbc0b5990 2024-04-25T08:59:36.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.271+0000 7f2fbaffd640 1 -- 172.21.15.55:0/314053701 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb4031600 con 0x7f2fbc0b5990 2024-04-25T08:59:36.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.271+0000 7f2fbaffd640 1 -- 172.21.15.55:0/314053701 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40319d0 con 0x7f2fbc0b5990 2024-04-25T08:59:36.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.271+0000 7f2fc2a15640 1 -- 172.21.15.55:0/314053701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fbc0b5990 msgr2=0x7f2fbc0b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.271+0000 7f2fc2a15640 1 --2- 172.21.15.55:0/314053701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fbc0b5990 0x7f2fbc0b6b00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009e50 tx=0x7f2fb402a710 comp rx=0 tx=0).stop 2024-04-25T08:59:36.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.271+0000 7f2fc2a15640 1 -- 172.21.15.55:0/314053701 shutdown_connections 2024-04-25T08:59:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.271+0000 7f2fc2a15640 1 --2- 172.21.15.55:0/314053701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fbc0b5990 0x7f2fbc0b6b00 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.271+0000 7f2fc2a15640 1 --2- 172.21.15.55:0/314053701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fbc0d35b0 0x7f2fbc0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.271+0000 7f2fc2a15640 1 -- 172.21.15.55:0/314053701 >> 172.21.15.55:0/314053701 conn(0x7f2fbc072900 msgr2=0x7f2fbc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.271+0000 7f2fc2a15640 1 -- 172.21.15.55:0/314053701 shutdown_connections 2024-04-25T08:59:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.271+0000 7f2fc2a15640 1 -- 172.21.15.55:0/314053701 wait complete. 2024-04-25T08:59:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.272+0000 7f2fc2a15640 1 Processor -- start 2024-04-25T08:59:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.273+0000 7f2fc2a15640 1 -- start start 2024-04-25T08:59:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.273+0000 7f2fc2a15640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fbc0b5990 0x7f2fbc152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.273+0000 7f2fc2a15640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fbc0d35b0 0x7f2fbc153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.273+0000 7f2fc2a15640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fbc15dce0 0x7f2fbc153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.273+0000 7f2fc2a15640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0d3090 con 0x7f2fbc15dce0 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.273+0000 7f2fc2a15640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0d2db0 con 0x7f2fbc0b5990 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.273+0000 7f2fc2a15640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0d2160 con 0x7f2fbc0d35b0 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.273+0000 7f2fc0fb2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fbc15dce0 0x7f2fbc153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.273+0000 7f2fc0fb2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fbc15dce0 0x7f2fbc153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55714/0 (socket says 172.21.15.55:55714) 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.273+0000 7f2fc0fb2640 1 -- 172.21.15.55:0/2475234801 learned_addr learned my addr 172.21.15.55:0/2475234801 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fbbfff640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fbc0b5990 0x7f2fbc152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fbb7fe640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fbc0d35b0 0x7f2fbc153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fc0fb2640 1 -- 172.21.15.55:0/2475234801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fbc0d35b0 msgr2=0x7f2fbc153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fc0fb2640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fbc0d35b0 0x7f2fbc153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fc0fb2640 1 -- 172.21.15.55:0/2475234801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fbc0b5990 msgr2=0x7f2fbc152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fc0fb2640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fbc0b5990 0x7f2fbc152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fc0fb2640 1 -- 172.21.15.55:0/2475234801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0c8950 con 0x7f2fbc15dce0 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fc0fb2640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fbc15dce0 0x7f2fbc153230 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4034040 tx=0x7f2fb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fb8ff9640 1 -- 172.21.15.55:0/2475234801 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4036050 con 0x7f2fbc15dce0 2024-04-25T08:59:36.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fb8ff9640 1 -- 172.21.15.55:0/2475234801 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb4042070 con 0x7f2fbc15dce0 2024-04-25T08:59:36.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fc2a15640 1 -- 172.21.15.55:0/2475234801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc0c8bf0 con 0x7f2fbc15dce0 2024-04-25T08:59:36.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fb8ff9640 1 -- 172.21.15.55:0/2475234801 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4009510 con 0x7f2fbc15dce0 2024-04-25T08:59:36.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.274+0000 7f2fc2a15640 1 -- 172.21.15.55:0/2475234801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc0c91b0 con 0x7f2fbc15dce0 2024-04-25T08:59:36.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.275+0000 7f2fc2a15640 1 -- 172.21.15.55:0/2475234801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc0cf5f0 con 0x7f2fbc15dce0 2024-04-25T08:59:36.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.275+0000 7f2fb8ff9640 1 -- 172.21.15.55:0/2475234801 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2fb4007bd0 con 0x7f2fbc15dce0 2024-04-25T08:59:36.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.276+0000 7f2fb8ff9640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fa806b4d0 0x7f2fa806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.276+0000 7f2fb8ff9640 1 -- 172.21.15.55:0/2475234801 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fb40ab020 con 0x7f2fbc15dce0 2024-04-25T08:59:36.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.276+0000 7f2fbbfff640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fa806b4d0 0x7f2fa806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.276+0000 7f2fbbfff640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fa806b4d0 0x7f2fa806d990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2fac007fd0 tx=0x7f2fac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.280+0000 7f2fb8ff9640 1 -- 172.21.15.55:0/2475234801 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2fbc0cf5f0 con 0x7f2fbc15dce0 2024-04-25T08:59:36.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.461+0000 7f2fc2a15640 1 -- 172.21.15.55:0/2475234801 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fbc0b9390 con 0x7f2fa806b4d0 2024-04-25T08:59:36.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.467+0000 7f2fb8ff9640 1 -- 172.21.15.55:0/2475234801 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237642 (secure 0 0 0) 0x7f2fbc0b9390 con 0x7f2fa806b4d0 2024-04-25T08:59:36.459 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:36.460 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 -- 172.21.15.55:0/2475234801 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fa806b4d0 msgr2=0x7f2fa806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fa806b4d0 0x7f2fa806d990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2fac007fd0 tx=0x7f2fac009040 comp rx=0 tx=0).stop 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 -- 172.21.15.55:0/2475234801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fbc15dce0 msgr2=0x7f2fbc153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fbc15dce0 0x7f2fbc153230 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4034040 tx=0x7f2fb4004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 -- 172.21.15.55:0/2475234801 shutdown_connections 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2fa806b4d0 0x7f2fa806d990 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fbc15dce0 0x7f2fbc153230 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fbc0d35b0 0x7f2fbc153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 --2- 172.21.15.55:0/2475234801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fbc0b5990 0x7f2fbc152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 -- 172.21.15.55:0/2475234801 >> 172.21.15.55:0/2475234801 conn(0x7f2fbc072900 msgr2=0x7f2fbc0b6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 -- 172.21.15.55:0/2475234801 shutdown_connections 2024-04-25T08:59:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.470+0000 7f2fc2a15640 1 -- 172.21.15.55:0/2475234801 wait complete. 2024-04-25T08:59:36.471 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-04-25T08:59:34.629569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":10,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":249888,"kb_used_data":8740,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724832,"statfs":{"total":773094113280,"available":772838227968,"internally_reserved":0,"allocated":8949760,"data_stored":4451885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000582"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450640+0000","last_change":"2024-04-25T08:59:31.450640+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450640+0000","last_undegraded":"2024-04-25T08:59:31.450640+0000","last_fullsized":"2024-04-25T08:59:31.450640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.448970+0000","last_change":"2024-04-25T08:59:31.448970+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.448970+0000","last_undegraded":"2024-04-25T08:59:31.448970+0000","last_fullsized":"2024-04-25T08:59:31.448970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450423+0000","last_change":"2024-04-25T08:59:31.450423+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450423+0000","last_undegraded":"2024-04-25T08:59:31.450423+0000","last_fullsized":"2024-04-25T08:59:31.450423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450560+0000","last_change":"2024-04-25T08:59:31.450560+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450560+0000","last_undegraded":"2024-04-25T08:59:31.450560+0000","last_fullsized":"2024-04-25T08:59:31.450560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:31.437995+0000","last_change":"2024-04-25T08:59:31.437995+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.437995+0000","last_undegraded":"2024-04-25T08:59:31.437995+0000","last_fullsized":"2024-04-25T08:59:31.437995+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":280,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T08:59:29.466101+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:59:29.466101+0000","last_peered":"2024-04-25T08:59:29.466101+0000","last_clean":"2024-04-25T08:59:29.466101+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:59:29.466101+0000","last_undegraded":"2024-04-25T08:59:29.466101+0000","last_fullsized":"2024-04-25T08:59:29.466101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32700,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1556480,"data_stored":995967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":405599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509516,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":962560,"data_stored":405599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":962560,"data_stored":405599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":405599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":405599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1556480,"data_stored":995967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":431956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:59:36.475 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:59:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.624+0000 7fed8dff5640 1 Processor -- start 2024-04-25T08:59:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.624+0000 7fed8dff5640 1 -- start start 2024-04-25T08:59:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.624+0000 7fed8dff5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed8815dc30 0x7fed8806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.624+0000 7fed8dff5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed880b1b30 0x7fed880d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.624+0000 7fed8dff5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8806c1f0 con 0x7fed8806cc00 2024-04-25T08:59:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.624+0000 7fed8dff5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed880cfb40 con 0x7fed880b1b30 2024-04-25T08:59:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.624+0000 7fed8dff5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed880b2060 con 0x7fed8815dc30 2024-04-25T08:59:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.625+0000 7fed87fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed880b1b30 0x7fed880d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.625+0000 7fed877fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed8815dc30 0x7fed8806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.625+0000 7fed87fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed880b1b30 0x7fed880d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:60514/0 (socket says 172.21.15.55:60514) 2024-04-25T08:59:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.625+0000 7fed86ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fed8806cc00 0x7fed880b1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:36374/0 (socket says 172.21.15.55:36374) 2024-04-25T08:59:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.625+0000 7fed87fff640 1 -- 172.21.15.55:0/342583239 learned_addr learned my addr 172.21.15.55:0/342583239 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:36.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.625+0000 7fed87fff640 1 -- 172.21.15.55:0/342583239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed8815dc30 msgr2=0x7fed8806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:36.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.625+0000 7fed87fff640 1 --2- 172.21.15.55:0/342583239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed8815dc30 0x7fed8806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.625+0000 7fed87fff640 1 -- 172.21.15.55:0/342583239 >> v1:172.21.15.167:6789/0 conn(0x7fed8806cc00 legacy=0x7fed880b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.625+0000 7fed867fc640 1 -- 172.21.15.55:0/342583239 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394419881 0 0) 0x7fed7c001110 con 0x7fed8806cc00 2024-04-25T08:59:36.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.625+0000 7fed87fff640 1 -- 172.21.15.55:0/342583239 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed880b2340 con 0x7fed880b1b30 2024-04-25T08:59:36.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.625+0000 7fed877fe640 1 --2- 172.21.15.55:0/342583239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed8815dc30 0x7fed8806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:36.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.626+0000 7fed87fff640 1 --2- 172.21.15.55:0/342583239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed880b1b30 0x7fed880d0300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fed80009e50 tx=0x7fed8002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f612029e58a84a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:36.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.626+0000 7fed867fc640 1 -- 172.21.15.55:0/342583239 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80036070 con 0x7fed880b1b30 2024-04-25T08:59:36.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.626+0000 7fed867fc640 1 -- 172.21.15.55:0/342583239 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed80031600 con 0x7fed880b1b30 2024-04-25T08:59:36.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.626+0000 7fed867fc640 1 -- 172.21.15.55:0/342583239 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800319d0 con 0x7fed880b1b30 2024-04-25T08:59:36.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.627+0000 7fed8dff5640 1 -- 172.21.15.55:0/342583239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed880b1b30 msgr2=0x7fed880d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.627+0000 7fed8dff5640 1 --2- 172.21.15.55:0/342583239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed880b1b30 0x7fed880d0300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fed80009e50 tx=0x7fed8002a710 comp rx=0 tx=0).stop 2024-04-25T08:59:36.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.627+0000 7fed8dff5640 1 -- 172.21.15.55:0/342583239 shutdown_connections 2024-04-25T08:59:36.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.627+0000 7fed8dff5640 1 --2- 172.21.15.55:0/342583239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed880b1b30 0x7fed880d0300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.627+0000 7fed8dff5640 1 --2- 172.21.15.55:0/342583239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed8815dc30 0x7fed8806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.627+0000 7fed8dff5640 1 -- 172.21.15.55:0/342583239 >> 172.21.15.55:0/342583239 conn(0x7fed880d1900 msgr2=0x7fed880d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:36.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.627+0000 7fed8dff5640 1 -- 172.21.15.55:0/342583239 shutdown_connections 2024-04-25T08:59:36.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.627+0000 7fed8dff5640 1 -- 172.21.15.55:0/342583239 wait complete. 2024-04-25T08:59:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.628+0000 7fed8dff5640 1 Processor -- start 2024-04-25T08:59:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.628+0000 7fed8dff5640 1 -- start start 2024-04-25T08:59:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed8dff5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8806cc00 0x7fed8815f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed8dff5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed880b1b30 0x7fed880c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed8dff5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed8815dc30 0x7fed88153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed8dff5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8815e010 con 0x7fed8815dc30 2024-04-25T08:59:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed8dff5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed880cfde0 con 0x7fed8806cc00 2024-04-25T08:59:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed8dff5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed880d0840 con 0x7fed880b1b30 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed87fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed8815dc30 0x7fed88153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed87fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed8815dc30 0x7fed88153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55724/0 (socket says 172.21.15.55:55724) 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed87fff640 1 -- 172.21.15.55:0/3041689633 learned_addr learned my addr 172.21.15.55:0/3041689633 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed877fe640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8806cc00 0x7fed8815f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed86ffd640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed880b1b30 0x7fed880c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed87fff640 1 -- 172.21.15.55:0/3041689633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed880b1b30 msgr2=0x7fed880c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed87fff640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed880b1b30 0x7fed880c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed87fff640 1 -- 172.21.15.55:0/3041689633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8806cc00 msgr2=0x7fed8815f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed87fff640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8806cc00 0x7fed8815f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed87fff640 1 -- 172.21.15.55:0/3041689633 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed88154300 con 0x7fed8815dc30 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed877fe640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8806cc00 0x7fed8815f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.629+0000 7fed87fff640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed8815dc30 0x7fed88153dc0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fed80009e50 tx=0x7fed80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.630+0000 7fed6ffff640 1 -- 172.21.15.55:0/3041689633 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80041020 con 0x7fed8815dc30 2024-04-25T08:59:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.630+0000 7fed6ffff640 1 -- 172.21.15.55:0/3041689633 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed80037040 con 0x7fed8815dc30 2024-04-25T08:59:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.630+0000 7fed8dff5640 1 -- 172.21.15.55:0/3041689633 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8815f970 con 0x7fed8815dc30 2024-04-25T08:59:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.630+0000 7fed6ffff640 1 -- 172.21.15.55:0/3041689633 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80036050 con 0x7fed8815dc30 2024-04-25T08:59:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.630+0000 7fed8dff5640 1 -- 172.21.15.55:0/3041689633 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8815ff30 con 0x7fed8815dc30 2024-04-25T08:59:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.631+0000 7fed8dff5640 1 -- 172.21.15.55:0/3041689633 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed88067850 con 0x7fed8815dc30 2024-04-25T08:59:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.631+0000 7fed6ffff640 1 -- 172.21.15.55:0/3041689633 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed80007c50 con 0x7fed8815dc30 2024-04-25T08:59:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.632+0000 7fed6ffff640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed7406b4d0 0x7fed7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.632+0000 7fed6ffff640 1 -- 172.21.15.55:0/3041689633 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed800aa960 con 0x7fed8815dc30 2024-04-25T08:59:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.632+0000 7fed877fe640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed7406b4d0 0x7fed7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.632+0000 7fed877fe640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed7406b4d0 0x7fed7406d990 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fed78009af0 tx=0x7fed78008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.636+0000 7fed6ffff640 1 -- 172.21.15.55:0/3041689633 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fed8004b060 con 0x7fed8815dc30 2024-04-25T08:59:36.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.814+0000 7fed8dff5640 1 -- 172.21.15.55:0/3041689633 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed880b07c0 con 0x7fed7406b4d0 2024-04-25T08:59:36.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.820+0000 7fed6ffff640 1 -- 172.21.15.55:0/3041689633 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250343 (secure 0 0 0) 0x7fed880b07c0 con 0x7fed7406b4d0 2024-04-25T08:59:36.812 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:36.813 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:59:36.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.823+0000 7fed8dff5640 1 -- 172.21.15.55:0/3041689633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed7406b4d0 msgr2=0x7fed7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.823+0000 7fed8dff5640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed7406b4d0 0x7fed7406d990 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fed78009af0 tx=0x7fed78008040 comp rx=0 tx=0).stop 2024-04-25T08:59:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.823+0000 7fed8dff5640 1 -- 172.21.15.55:0/3041689633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed8815dc30 msgr2=0x7fed88153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.823+0000 7fed8dff5640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed8815dc30 0x7fed88153dc0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fed80009e50 tx=0x7fed80004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.823+0000 7fed8dff5640 1 -- 172.21.15.55:0/3041689633 shutdown_connections 2024-04-25T08:59:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.823+0000 7fed8dff5640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed7406b4d0 0x7fed7406d990 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.823+0000 7fed8dff5640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed8815dc30 0x7fed88153dc0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.823+0000 7fed8dff5640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed880b1b30 0x7fed880c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.823+0000 7fed8dff5640 1 --2- 172.21.15.55:0/3041689633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8806cc00 0x7fed8815f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.823+0000 7fed8dff5640 1 -- 172.21.15.55:0/3041689633 >> 172.21.15.55:0/3041689633 conn(0x7fed880d1900 msgr2=0x7fed880ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.823+0000 7fed8dff5640 1 -- 172.21.15.55:0/3041689633 shutdown_connections 2024-04-25T08:59:36.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.824+0000 7fed8dff5640 1 -- 172.21.15.55:0/3041689633 wait complete. 2024-04-25T08:59:36.823 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-04-25T08:59:36.629854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":197,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254684,"kb_used_data":9380,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720036,"statfs":{"total":773094113280,"available":772833316864,"internally_reserved":0,"allocated":9605120,"data_stored":4732360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.185358"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471225+0000","last_change":"2024-04-25T08:59:33.485591+0000","last_active":"2024-04-25T08:59:34.471225+0000","last_peered":"2024-04-25T08:59:34.471225+0000","last_clean":"2024-04-25T08:59:34.471225+0000","last_became_active":"2024-04-25T08:59:33.485270+0000","last_became_peered":"2024-04-25T08:59:33.485270+0000","last_unstale":"2024-04-25T08:59:34.471225+0000","last_undegraded":"2024-04-25T08:59:34.471225+0000","last_fullsized":"2024-04-25T08:59:34.471225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:44.759906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470340+0000","last_change":"2024-04-25T08:59:33.487428+0000","last_active":"2024-04-25T08:59:34.470340+0000","last_peered":"2024-04-25T08:59:34.470340+0000","last_clean":"2024-04-25T08:59:34.470340+0000","last_became_active":"2024-04-25T08:59:33.487122+0000","last_became_peered":"2024-04-25T08:59:33.487122+0000","last_unstale":"2024-04-25T08:59:34.470340+0000","last_undegraded":"2024-04-25T08:59:34.470340+0000","last_fullsized":"2024-04-25T08:59:34.470340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:40.677654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473529+0000","last_change":"2024-04-25T08:59:33.481919+0000","last_active":"2024-04-25T08:59:34.473529+0000","last_peered":"2024-04-25T08:59:34.473529+0000","last_clean":"2024-04-25T08:59:34.473529+0000","last_became_active":"2024-04-25T08:59:33.481671+0000","last_became_peered":"2024-04-25T08:59:33.481671+0000","last_unstale":"2024-04-25T08:59:34.473529+0000","last_undegraded":"2024-04-25T08:59:34.473529+0000","last_fullsized":"2024-04-25T08:59:34.473529+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:38.662705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.486809+0000","last_change":"2024-04-25T08:59:33.482528+0000","last_active":"2024-04-25T08:59:33.486809+0000","last_peered":"2024-04-25T08:59:33.486809+0000","last_clean":"2024-04-25T08:59:33.486809+0000","last_became_active":"2024-04-25T08:59:33.482248+0000","last_became_peered":"2024-04-25T08:59:33.482248+0000","last_unstale":"2024-04-25T08:59:33.486809+0000","last_undegraded":"2024-04-25T08:59:33.486809+0000","last_fullsized":"2024-04-25T08:59:33.486809+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:27.525341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490185+0000","last_change":"2024-04-25T08:59:33.489289+0000","last_active":"2024-04-25T08:59:33.490185+0000","last_peered":"2024-04-25T08:59:33.490185+0000","last_clean":"2024-04-25T08:59:33.490185+0000","last_became_active":"2024-04-25T08:59:33.488378+0000","last_became_peered":"2024-04-25T08:59:33.488378+0000","last_unstale":"2024-04-25T08:59:33.490185+0000","last_undegraded":"2024-04-25T08:59:33.490185+0000","last_fullsized":"2024-04-25T08:59:33.490185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:17.712953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473272+0000","last_change":"2024-04-25T08:59:33.486006+0000","last_active":"2024-04-25T08:59:34.473272+0000","last_peered":"2024-04-25T08:59:34.473272+0000","last_clean":"2024-04-25T08:59:34.473272+0000","last_became_active":"2024-04-25T08:59:33.485708+0000","last_became_peered":"2024-04-25T08:59:33.485708+0000","last_unstale":"2024-04-25T08:59:34.473272+0000","last_undegraded":"2024-04-25T08:59:34.473272+0000","last_fullsized":"2024-04-25T08:59:34.473272+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:05.103716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.487677+0000","last_change":"2024-04-25T08:59:33.481878+0000","last_active":"2024-04-25T08:59:33.487677+0000","last_peered":"2024-04-25T08:59:33.487677+0000","last_clean":"2024-04-25T08:59:33.487677+0000","last_became_active":"2024-04-25T08:59:33.481549+0000","last_became_peered":"2024-04-25T08:59:33.481549+0000","last_unstale":"2024-04-25T08:59:33.487677+0000","last_undegraded":"2024-04-25T08:59:33.487677+0000","last_fullsized":"2024-04-25T08:59:33.487677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:51.693954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490458+0000","last_change":"2024-04-25T08:59:33.489742+0000","last_active":"2024-04-25T08:59:33.490458+0000","last_peered":"2024-04-25T08:59:33.490458+0000","last_clean":"2024-04-25T08:59:33.490458+0000","last_became_active":"2024-04-25T08:59:33.489472+0000","last_became_peered":"2024-04-25T08:59:33.489472+0000","last_unstale":"2024-04-25T08:59:33.490458+0000","last_undegraded":"2024-04-25T08:59:33.490458+0000","last_fullsized":"2024-04-25T08:59:33.490458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:16.803764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470926+0000","last_change":"2024-04-25T08:59:33.492585+0000","last_active":"2024-04-25T08:59:34.470926+0000","last_peered":"2024-04-25T08:59:34.470926+0000","last_clean":"2024-04-25T08:59:34.470926+0000","last_became_active":"2024-04-25T08:59:33.492032+0000","last_became_peered":"2024-04-25T08:59:33.492032+0000","last_unstale":"2024-04-25T08:59:34.470926+0000","last_undegraded":"2024-04-25T08:59:34.470926+0000","last_fullsized":"2024-04-25T08:59:34.470926+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:16.803764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470677+0000","last_change":"2024-04-25T08:59:33.492662+0000","last_active":"2024-04-25T08:59:34.470677+0000","last_peered":"2024-04-25T08:59:34.470677+0000","last_clean":"2024-04-25T08:59:34.470677+0000","last_became_active":"2024-04-25T08:59:33.492153+0000","last_became_peered":"2024-04-25T08:59:33.492153+0000","last_unstale":"2024-04-25T08:59:34.470677+0000","last_undegraded":"2024-04-25T08:59:34.470677+0000","last_fullsized":"2024-04-25T08:59:34.470677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:01.528790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470906+0000","last_change":"2024-04-25T08:59:33.480997+0000","last_active":"2024-04-25T08:59:34.470906+0000","last_peered":"2024-04-25T08:59:34.470906+0000","last_clean":"2024-04-25T08:59:34.470906+0000","last_became_active":"2024-04-25T08:59:33.480666+0000","last_became_peered":"2024-04-25T08:59:33.480666+0000","last_unstale":"2024-04-25T08:59:34.470906+0000","last_undegraded":"2024-04-25T08:59:34.470906+0000","last_fullsized":"2024-04-25T08:59:34.470906+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:16.088847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473509+0000","last_change":"2024-04-25T08:59:33.486549+0000","last_active":"2024-04-25T08:59:34.473509+0000","last_peered":"2024-04-25T08:59:34.473509+0000","last_clean":"2024-04-25T08:59:34.473509+0000","last_became_active":"2024-04-25T08:59:33.486014+0000","last_became_peered":"2024-04-25T08:59:33.486014+0000","last_unstale":"2024-04-25T08:59:34.473509+0000","last_undegraded":"2024-04-25T08:59:34.473509+0000","last_fullsized":"2024-04-25T08:59:34.473509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:16.544816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471226+0000","last_change":"2024-04-25T08:59:33.480745+0000","last_active":"2024-04-25T08:59:34.471226+0000","last_peered":"2024-04-25T08:59:34.471226+0000","last_clean":"2024-04-25T08:59:34.471226+0000","last_became_active":"2024-04-25T08:59:33.480458+0000","last_became_peered":"2024-04-25T08:59:33.480458+0000","last_unstale":"2024-04-25T08:59:34.471226+0000","last_undegraded":"2024-04-25T08:59:34.471226+0000","last_fullsized":"2024-04-25T08:59:34.471226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:39.831860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488373+0000","last_change":"2024-04-25T08:59:33.486493+0000","last_active":"2024-04-25T08:59:33.488373+0000","last_peered":"2024-04-25T08:59:33.488373+0000","last_clean":"2024-04-25T08:59:33.488373+0000","last_became_active":"2024-04-25T08:59:33.485837+0000","last_became_peered":"2024-04-25T08:59:33.485837+0000","last_unstale":"2024-04-25T08:59:33.488373+0000","last_undegraded":"2024-04-25T08:59:33.488373+0000","last_fullsized":"2024-04-25T08:59:33.488373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:40.979833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498034+0000","last_change":"2024-04-25T08:59:33.489778+0000","last_active":"2024-04-25T08:59:33.498034+0000","last_peered":"2024-04-25T08:59:33.498034+0000","last_clean":"2024-04-25T08:59:33.498034+0000","last_became_active":"2024-04-25T08:59:33.489514+0000","last_became_peered":"2024-04-25T08:59:33.489514+0000","last_unstale":"2024-04-25T08:59:33.498034+0000","last_undegraded":"2024-04-25T08:59:33.498034+0000","last_fullsized":"2024-04-25T08:59:33.498034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:16.803764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473762+0000","last_change":"2024-04-25T08:59:33.495035+0000","last_active":"2024-04-25T08:59:34.473762+0000","last_peered":"2024-04-25T08:59:34.473762+0000","last_clean":"2024-04-25T08:59:34.473762+0000","last_became_active":"2024-04-25T08:59:33.494739+0000","last_became_peered":"2024-04-25T08:59:33.494739+0000","last_unstale":"2024-04-25T08:59:34.473762+0000","last_undegraded":"2024-04-25T08:59:34.473762+0000","last_fullsized":"2024-04-25T08:59:34.473762+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:07.192195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488336+0000","last_change":"2024-04-25T08:59:33.484405+0000","last_active":"2024-04-25T08:59:33.488336+0000","last_peered":"2024-04-25T08:59:33.488336+0000","last_clean":"2024-04-25T08:59:33.488336+0000","last_became_active":"2024-04-25T08:59:33.482624+0000","last_became_peered":"2024-04-25T08:59:33.482624+0000","last_unstale":"2024-04-25T08:59:33.488336+0000","last_undegraded":"2024-04-25T08:59:33.488336+0000","last_fullsized":"2024-04-25T08:59:33.488336+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:55.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473597+0000","last_change":"2024-04-25T08:59:33.485682+0000","last_active":"2024-04-25T08:59:34.473597+0000","last_peered":"2024-04-25T08:59:34.473597+0000","last_clean":"2024-04-25T08:59:34.473597+0000","last_became_active":"2024-04-25T08:59:33.485410+0000","last_became_peered":"2024-04-25T08:59:33.485410+0000","last_unstale":"2024-04-25T08:59:34.473597+0000","last_undegraded":"2024-04-25T08:59:34.473597+0000","last_fullsized":"2024-04-25T08:59:34.473597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:46.869053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473472+0000","last_change":"2024-04-25T08:59:33.485903+0000","last_active":"2024-04-25T08:59:34.473472+0000","last_peered":"2024-04-25T08:59:34.473472+0000","last_clean":"2024-04-25T08:59:34.473472+0000","last_became_active":"2024-04-25T08:59:33.485144+0000","last_became_peered":"2024-04-25T08:59:33.485144+0000","last_unstale":"2024-04-25T08:59:34.473472+0000","last_undegraded":"2024-04-25T08:59:34.473472+0000","last_fullsized":"2024-04-25T08:59:34.473472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:00.891178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471295+0000","last_change":"2024-04-25T08:59:33.494003+0000","last_active":"2024-04-25T08:59:34.471295+0000","last_peered":"2024-04-25T08:59:34.471295+0000","last_clean":"2024-04-25T08:59:34.471295+0000","last_became_active":"2024-04-25T08:59:33.493533+0000","last_became_peered":"2024-04-25T08:59:33.493533+0000","last_unstale":"2024-04-25T08:59:34.471295+0000","last_undegraded":"2024-04-25T08:59:34.471295+0000","last_fullsized":"2024-04-25T08:59:34.471295+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:55.574254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473277+0000","last_change":"2024-04-25T08:59:33.486174+0000","last_active":"2024-04-25T08:59:34.473277+0000","last_peered":"2024-04-25T08:59:34.473277+0000","last_clean":"2024-04-25T08:59:34.473277+0000","last_became_active":"2024-04-25T08:59:33.485376+0000","last_became_peered":"2024-04-25T08:59:33.485376+0000","last_unstale":"2024-04-25T08:59:34.473277+0000","last_undegraded":"2024-04-25T08:59:34.473277+0000","last_fullsized":"2024-04-25T08:59:34.473277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:23.321835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470675+0000","last_change":"2024-04-25T08:59:33.481229+0000","last_active":"2024-04-25T08:59:34.470675+0000","last_peered":"2024-04-25T08:59:34.470675+0000","last_clean":"2024-04-25T08:59:34.470675+0000","last_became_active":"2024-04-25T08:59:33.480697+0000","last_became_peered":"2024-04-25T08:59:33.480697+0000","last_unstale":"2024-04-25T08:59:34.470675+0000","last_undegraded":"2024-04-25T08:59:34.470675+0000","last_fullsized":"2024-04-25T08:59:34.470675+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:18.281359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.480830+0000","last_change":"2024-04-25T08:59:33.478198+0000","last_active":"2024-04-25T08:59:33.480830+0000","last_peered":"2024-04-25T08:59:33.480830+0000","last_clean":"2024-04-25T08:59:33.480830+0000","last_became_active":"2024-04-25T08:59:33.477907+0000","last_became_peered":"2024-04-25T08:59:33.477907+0000","last_unstale":"2024-04-25T08:59:33.480830+0000","last_undegraded":"2024-04-25T08:59:33.480830+0000","last_fullsized":"2024-04-25T08:59:33.480830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:12.092783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470873+0000","last_change":"2024-04-25T08:59:33.486375+0000","last_active":"2024-04-25T08:59:34.470873+0000","last_peered":"2024-04-25T08:59:34.470873+0000","last_clean":"2024-04-25T08:59:34.470873+0000","last_became_active":"2024-04-25T08:59:33.484674+0000","last_became_peered":"2024-04-25T08:59:33.484674+0000","last_unstale":"2024-04-25T08:59:34.470873+0000","last_undegraded":"2024-04-25T08:59:34.470873+0000","last_fullsized":"2024-04-25T08:59:34.470873+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:17.712953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488888+0000","last_change":"2024-04-25T08:59:33.486570+0000","last_active":"2024-04-25T08:59:33.488888+0000","last_peered":"2024-04-25T08:59:33.488888+0000","last_clean":"2024-04-25T08:59:33.488888+0000","last_became_active":"2024-04-25T08:59:33.486194+0000","last_became_peered":"2024-04-25T08:59:33.486194+0000","last_unstale":"2024-04-25T08:59:33.488888+0000","last_undegraded":"2024-04-25T08:59:33.488888+0000","last_fullsized":"2024-04-25T08:59:33.488888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:37.307074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470424+0000","last_change":"2024-04-25T08:59:33.484769+0000","last_active":"2024-04-25T08:59:34.470424+0000","last_peered":"2024-04-25T08:59:34.470424+0000","last_clean":"2024-04-25T08:59:34.470424+0000","last_became_active":"2024-04-25T08:59:33.484449+0000","last_became_peered":"2024-04-25T08:59:33.484449+0000","last_unstale":"2024-04-25T08:59:34.470424+0000","last_undegraded":"2024-04-25T08:59:34.470424+0000","last_fullsized":"2024-04-25T08:59:34.470424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:51.693954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.489495+0000","last_change":"2024-04-25T08:59:33.486917+0000","last_active":"2024-04-25T08:59:33.489495+0000","last_peered":"2024-04-25T08:59:33.489495+0000","last_clean":"2024-04-25T08:59:33.489495+0000","last_became_active":"2024-04-25T08:59:33.486279+0000","last_became_peered":"2024-04-25T08:59:33.486279+0000","last_unstale":"2024-04-25T08:59:33.489495+0000","last_undegraded":"2024-04-25T08:59:33.489495+0000","last_fullsized":"2024-04-25T08:59:33.489495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:51.693954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471438+0000","last_change":"2024-04-25T08:59:32.461674+0000","last_active":"2024-04-25T08:59:34.471438+0000","last_peered":"2024-04-25T08:59:34.471438+0000","last_clean":"2024-04-25T08:59:34.471438+0000","last_became_active":"2024-04-25T08:59:32.460461+0000","last_became_peered":"2024-04-25T08:59:32.460461+0000","last_unstale":"2024-04-25T08:59:34.471438+0000","last_undegraded":"2024-04-25T08:59:34.471438+0000","last_fullsized":"2024-04-25T08:59:34.471438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:39.901295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471332+0000","last_change":"2024-04-25T08:59:33.494462+0000","last_active":"2024-04-25T08:59:34.471332+0000","last_peered":"2024-04-25T08:59:34.471332+0000","last_clean":"2024-04-25T08:59:34.471332+0000","last_became_active":"2024-04-25T08:59:33.494052+0000","last_became_peered":"2024-04-25T08:59:33.494052+0000","last_unstale":"2024-04-25T08:59:34.471332+0000","last_undegraded":"2024-04-25T08:59:34.471332+0000","last_fullsized":"2024-04-25T08:59:34.471332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:55.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498802+0000","last_change":"2024-04-25T08:59:32.467296+0000","last_active":"2024-04-25T08:59:33.498802+0000","last_peered":"2024-04-25T08:59:33.498802+0000","last_clean":"2024-04-25T08:59:33.498802+0000","last_became_active":"2024-04-25T08:59:32.467016+0000","last_became_peered":"2024-04-25T08:59:32.467016+0000","last_unstale":"2024-04-25T08:59:33.498802+0000","last_undegraded":"2024-04-25T08:59:33.498802+0000","last_fullsized":"2024-04-25T08:59:33.498802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:55.181008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471147+0000","last_change":"2024-04-25T08:59:33.482935+0000","last_active":"2024-04-25T08:59:34.471147+0000","last_peered":"2024-04-25T08:59:34.471147+0000","last_clean":"2024-04-25T08:59:34.471147+0000","last_became_active":"2024-04-25T08:59:33.482585+0000","last_became_peered":"2024-04-25T08:59:33.482585+0000","last_unstale":"2024-04-25T08:59:34.471147+0000","last_undegraded":"2024-04-25T08:59:34.471147+0000","last_fullsized":"2024-04-25T08:59:34.471147+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:08.837422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.503929+0000","last_change":"2024-04-25T08:59:32.465587+0000","last_active":"2024-04-25T08:59:33.503929+0000","last_peered":"2024-04-25T08:59:33.503929+0000","last_clean":"2024-04-25T08:59:33.503929+0000","last_became_active":"2024-04-25T08:59:32.465163+0000","last_became_peered":"2024-04-25T08:59:32.465163+0000","last_unstale":"2024-04-25T08:59:33.503929+0000","last_undegraded":"2024-04-25T08:59:33.503929+0000","last_fullsized":"2024-04-25T08:59:33.503929+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:43.753849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470503+0000","last_change":"2024-04-25T08:59:33.488643+0000","last_active":"2024-04-25T08:59:34.470503+0000","last_peered":"2024-04-25T08:59:34.470503+0000","last_clean":"2024-04-25T08:59:34.470503+0000","last_became_active":"2024-04-25T08:59:33.488328+0000","last_became_peered":"2024-04-25T08:59:33.488328+0000","last_unstale":"2024-04-25T08:59:34.470503+0000","last_undegraded":"2024-04-25T08:59:34.470503+0000","last_fullsized":"2024-04-25T08:59:34.470503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.159698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.503784+0000","last_change":"2024-04-25T08:59:32.465821+0000","last_active":"2024-04-25T08:59:33.503784+0000","last_peered":"2024-04-25T08:59:33.503784+0000","last_clean":"2024-04-25T08:59:33.503784+0000","last_became_active":"2024-04-25T08:59:32.465489+0000","last_became_peered":"2024-04-25T08:59:32.465489+0000","last_unstale":"2024-04-25T08:59:33.503784+0000","last_undegraded":"2024-04-25T08:59:33.503784+0000","last_fullsized":"2024-04-25T08:59:33.503784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:16.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498810+0000","last_change":"2024-04-25T08:59:32.466860+0000","last_active":"2024-04-25T08:59:33.498810+0000","last_peered":"2024-04-25T08:59:33.498810+0000","last_clean":"2024-04-25T08:59:33.498810+0000","last_became_active":"2024-04-25T08:59:32.466545+0000","last_became_peered":"2024-04-25T08:59:32.466545+0000","last_unstale":"2024-04-25T08:59:33.498810+0000","last_undegraded":"2024-04-25T08:59:33.498810+0000","last_fullsized":"2024-04-25T08:59:33.498810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:56.661725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490829+0000","last_change":"2024-04-25T08:59:33.488817+0000","last_active":"2024-04-25T08:59:33.490829+0000","last_peered":"2024-04-25T08:59:33.490829+0000","last_clean":"2024-04-25T08:59:33.490829+0000","last_became_active":"2024-04-25T08:59:33.488561+0000","last_became_peered":"2024-04-25T08:59:33.488561+0000","last_unstale":"2024-04-25T08:59:33.490829+0000","last_undegraded":"2024-04-25T08:59:33.490829+0000","last_fullsized":"2024-04-25T08:59:33.490829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:17.712953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498774+0000","last_change":"2024-04-25T08:59:32.467767+0000","last_active":"2024-04-25T08:59:33.498774+0000","last_peered":"2024-04-25T08:59:33.498774+0000","last_clean":"2024-04-25T08:59:33.498774+0000","last_became_active":"2024-04-25T08:59:32.467478+0000","last_became_peered":"2024-04-25T08:59:32.467478+0000","last_unstale":"2024-04-25T08:59:33.498774+0000","last_undegraded":"2024-04-25T08:59:33.498774+0000","last_fullsized":"2024-04-25T08:59:33.498774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:03.367165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470185+0000","last_change":"2024-04-25T08:59:33.485806+0000","last_active":"2024-04-25T08:59:34.470185+0000","last_peered":"2024-04-25T08:59:34.470185+0000","last_clean":"2024-04-25T08:59:34.470185+0000","last_became_active":"2024-04-25T08:59:33.485533+0000","last_became_peered":"2024-04-25T08:59:33.485533+0000","last_unstale":"2024-04-25T08:59:34.470185+0000","last_undegraded":"2024-04-25T08:59:34.470185+0000","last_fullsized":"2024-04-25T08:59:34.470185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:11.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.474425+0000","last_change":"2024-04-25T08:59:32.462535+0000","last_active":"2024-04-25T08:59:33.474425+0000","last_peered":"2024-04-25T08:59:33.474425+0000","last_clean":"2024-04-25T08:59:33.474425+0000","last_became_active":"2024-04-25T08:59:32.462227+0000","last_became_peered":"2024-04-25T08:59:32.462227+0000","last_unstale":"2024-04-25T08:59:33.474425+0000","last_undegraded":"2024-04-25T08:59:33.474425+0000","last_fullsized":"2024-04-25T08:59:33.474425+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:50.687897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471144+0000","last_change":"2024-04-25T08:59:33.477587+0000","last_active":"2024-04-25T08:59:34.471144+0000","last_peered":"2024-04-25T08:59:34.471144+0000","last_clean":"2024-04-25T08:59:34.471144+0000","last_became_active":"2024-04-25T08:59:33.477320+0000","last_became_peered":"2024-04-25T08:59:33.477320+0000","last_unstale":"2024-04-25T08:59:34.471144+0000","last_undegraded":"2024-04-25T08:59:34.471144+0000","last_fullsized":"2024-04-25T08:59:34.471144+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:37.797255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450640+0000","last_change":"2024-04-25T08:59:31.450640+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450640+0000","last_undegraded":"2024-04-25T08:59:31.450640+0000","last_fullsized":"2024-04-25T08:59:31.450640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471360+0000","last_change":"2024-04-25T08:59:33.480479+0000","last_active":"2024-04-25T08:59:34.471360+0000","last_peered":"2024-04-25T08:59:34.471360+0000","last_clean":"2024-04-25T08:59:34.471360+0000","last_became_active":"2024-04-25T08:59:33.479941+0000","last_became_peered":"2024-04-25T08:59:33.479941+0000","last_unstale":"2024-04-25T08:59:34.471360+0000","last_undegraded":"2024-04-25T08:59:34.471360+0000","last_fullsized":"2024-04-25T08:59:34.471360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:55.839095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471500+0000","last_change":"2024-04-25T08:59:32.462940+0000","last_active":"2024-04-25T08:59:34.471500+0000","last_peered":"2024-04-25T08:59:34.471500+0000","last_clean":"2024-04-25T08:59:34.471500+0000","last_became_active":"2024-04-25T08:59:32.462642+0000","last_became_peered":"2024-04-25T08:59:32.462642+0000","last_unstale":"2024-04-25T08:59:34.471500+0000","last_undegraded":"2024-04-25T08:59:34.471500+0000","last_fullsized":"2024-04-25T08:59:34.471500+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:25.266567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.484053+0000","last_change":"2024-04-25T08:59:33.479219+0000","last_active":"2024-04-25T08:59:33.484053+0000","last_peered":"2024-04-25T08:59:33.484053+0000","last_clean":"2024-04-25T08:59:33.484053+0000","last_became_active":"2024-04-25T08:59:33.478959+0000","last_became_peered":"2024-04-25T08:59:33.478959+0000","last_unstale":"2024-04-25T08:59:33.484053+0000","last_undegraded":"2024-04-25T08:59:33.484053+0000","last_fullsized":"2024-04-25T08:59:33.484053+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:40.979833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471033+0000","last_change":"2024-04-25T08:59:32.464153+0000","last_active":"2024-04-25T08:59:34.471033+0000","last_peered":"2024-04-25T08:59:34.471033+0000","last_clean":"2024-04-25T08:59:34.471033+0000","last_became_active":"2024-04-25T08:59:32.463856+0000","last_became_peered":"2024-04-25T08:59:32.463856+0000","last_unstale":"2024-04-25T08:59:34.471033+0000","last_undegraded":"2024-04-25T08:59:34.471033+0000","last_fullsized":"2024-04-25T08:59:34.471033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:12.560960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490857+0000","last_change":"2024-04-25T08:59:33.488687+0000","last_active":"2024-04-25T08:59:33.490857+0000","last_peered":"2024-04-25T08:59:33.490857+0000","last_clean":"2024-04-25T08:59:33.490857+0000","last_became_active":"2024-04-25T08:59:33.488397+0000","last_became_peered":"2024-04-25T08:59:33.488397+0000","last_unstale":"2024-04-25T08:59:33.490857+0000","last_undegraded":"2024-04-25T08:59:33.490857+0000","last_fullsized":"2024-04-25T08:59:33.490857+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:51.961543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470650+0000","last_change":"2024-04-25T08:59:32.459689+0000","last_active":"2024-04-25T08:59:34.470650+0000","last_peered":"2024-04-25T08:59:34.470650+0000","last_clean":"2024-04-25T08:59:34.470650+0000","last_became_active":"2024-04-25T08:59:32.459347+0000","last_became_peered":"2024-04-25T08:59:32.459347+0000","last_unstale":"2024-04-25T08:59:34.470650+0000","last_undegraded":"2024-04-25T08:59:34.470650+0000","last_fullsized":"2024-04-25T08:59:34.470650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:40.856799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.489479+0000","last_change":"2024-04-25T08:59:33.487405+0000","last_active":"2024-04-25T08:59:33.489479+0000","last_peered":"2024-04-25T08:59:33.489479+0000","last_clean":"2024-04-25T08:59:33.489479+0000","last_became_active":"2024-04-25T08:59:33.487120+0000","last_became_peered":"2024-04-25T08:59:33.487120+0000","last_unstale":"2024-04-25T08:59:33.489479+0000","last_undegraded":"2024-04-25T08:59:33.489479+0000","last_fullsized":"2024-04-25T08:59:33.489479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:01.528790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.504161+0000","last_change":"2024-04-25T08:59:32.458761+0000","last_active":"2024-04-25T08:59:33.504161+0000","last_peered":"2024-04-25T08:59:33.504161+0000","last_clean":"2024-04-25T08:59:33.504161+0000","last_became_active":"2024-04-25T08:59:32.458483+0000","last_became_peered":"2024-04-25T08:59:32.458483+0000","last_unstale":"2024-04-25T08:59:33.504161+0000","last_undegraded":"2024-04-25T08:59:33.504161+0000","last_fullsized":"2024-04-25T08:59:33.504161+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:26.519284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488291+0000","last_change":"2024-04-25T08:59:33.484209+0000","last_active":"2024-04-25T08:59:33.488291+0000","last_peered":"2024-04-25T08:59:33.488291+0000","last_clean":"2024-04-25T08:59:33.488291+0000","last_became_active":"2024-04-25T08:59:33.483823+0000","last_became_peered":"2024-04-25T08:59:33.483823+0000","last_unstale":"2024-04-25T08:59:33.488291+0000","last_undegraded":"2024-04-25T08:59:33.488291+0000","last_fullsized":"2024-04-25T08:59:33.488291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:55.574254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.448970+0000","last_change":"2024-04-25T08:59:31.448970+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.448970+0000","last_undegraded":"2024-04-25T08:59:31.448970+0000","last_fullsized":"2024-04-25T08:59:31.448970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471081+0000","last_change":"2024-04-25T08:59:33.485452+0000","last_active":"2024-04-25T08:59:34.471081+0000","last_peered":"2024-04-25T08:59:34.471081+0000","last_clean":"2024-04-25T08:59:34.471081+0000","last_became_active":"2024-04-25T08:59:33.485055+0000","last_became_peered":"2024-04-25T08:59:33.485055+0000","last_unstale":"2024-04-25T08:59:34.471081+0000","last_undegraded":"2024-04-25T08:59:34.471081+0000","last_fullsized":"2024-04-25T08:59:34.471081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:16.190343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471245+0000","last_change":"2024-04-25T08:59:32.466365+0000","last_active":"2024-04-25T08:59:34.471245+0000","last_peered":"2024-04-25T08:59:34.471245+0000","last_clean":"2024-04-25T08:59:34.471245+0000","last_became_active":"2024-04-25T08:59:32.466124+0000","last_became_peered":"2024-04-25T08:59:32.466124+0000","last_unstale":"2024-04-25T08:59:34.471245+0000","last_undegraded":"2024-04-25T08:59:34.471245+0000","last_fullsized":"2024-04-25T08:59:34.471245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:49.960557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.473234+0000","last_change":"2024-04-25T08:59:32.463142+0000","last_active":"2024-04-25T08:59:33.473234+0000","last_peered":"2024-04-25T08:59:33.473234+0000","last_clean":"2024-04-25T08:59:33.473234+0000","last_became_active":"2024-04-25T08:59:32.462585+0000","last_became_peered":"2024-04-25T08:59:32.462585+0000","last_unstale":"2024-04-25T08:59:33.473234+0000","last_undegraded":"2024-04-25T08:59:33.473234+0000","last_fullsized":"2024-04-25T08:59:33.473234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:11.928530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.504512+0000","last_change":"2024-04-25T08:59:32.464239+0000","last_active":"2024-04-25T08:59:33.504512+0000","last_peered":"2024-04-25T08:59:33.504512+0000","last_clean":"2024-04-25T08:59:33.504512+0000","last_became_active":"2024-04-25T08:59:32.463876+0000","last_became_peered":"2024-04-25T08:59:32.463876+0000","last_unstale":"2024-04-25T08:59:33.504512+0000","last_undegraded":"2024-04-25T08:59:33.504512+0000","last_fullsized":"2024-04-25T08:59:33.504512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:36.301017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470356+0000","last_change":"2024-04-25T08:59:33.482352+0000","last_active":"2024-04-25T08:59:34.470356+0000","last_peered":"2024-04-25T08:59:34.470356+0000","last_clean":"2024-04-25T08:59:34.470356+0000","last_became_active":"2024-04-25T08:59:33.482057+0000","last_became_peered":"2024-04-25T08:59:33.482057+0000","last_unstale":"2024-04-25T08:59:34.470356+0000","last_undegraded":"2024-04-25T08:59:34.470356+0000","last_fullsized":"2024-04-25T08:59:34.470356+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:09.843668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471551+0000","last_change":"2024-04-25T08:59:32.458378+0000","last_active":"2024-04-25T08:59:34.471551+0000","last_peered":"2024-04-25T08:59:34.471551+0000","last_clean":"2024-04-25T08:59:34.471551+0000","last_became_active":"2024-04-25T08:59:32.458100+0000","last_became_peered":"2024-04-25T08:59:32.458100+0000","last_unstale":"2024-04-25T08:59:34.471551+0000","last_undegraded":"2024-04-25T08:59:34.471551+0000","last_fullsized":"2024-04-25T08:59:34.471551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:34.920038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471429+0000","last_change":"2024-04-25T08:59:33.485007+0000","last_active":"2024-04-25T08:59:34.471429+0000","last_peered":"2024-04-25T08:59:34.471429+0000","last_clean":"2024-04-25T08:59:34.471429+0000","last_became_active":"2024-04-25T08:59:33.484663+0000","last_became_peered":"2024-04-25T08:59:33.484663+0000","last_unstale":"2024-04-25T08:59:34.471429+0000","last_undegraded":"2024-04-25T08:59:34.471429+0000","last_fullsized":"2024-04-25T08:59:34.471429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:12.964055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.504366+0000","last_change":"2024-04-25T08:59:32.467240+0000","last_active":"2024-04-25T08:59:33.504366+0000","last_peered":"2024-04-25T08:59:33.504366+0000","last_clean":"2024-04-25T08:59:33.504366+0000","last_became_active":"2024-04-25T08:59:32.466929+0000","last_became_peered":"2024-04-25T08:59:32.466929+0000","last_unstale":"2024-04-25T08:59:33.504366+0000","last_undegraded":"2024-04-25T08:59:33.504366+0000","last_fullsized":"2024-04-25T08:59:33.504366+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:07.831365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.483769+0000","last_change":"2024-04-25T08:59:33.480680+0000","last_active":"2024-04-25T08:59:33.483769+0000","last_peered":"2024-04-25T08:59:33.483769+0000","last_clean":"2024-04-25T08:59:33.483769+0000","last_became_active":"2024-04-25T08:59:33.480406+0000","last_became_peered":"2024-04-25T08:59:33.480406+0000","last_unstale":"2024-04-25T08:59:33.483769+0000","last_undegraded":"2024-04-25T08:59:33.483769+0000","last_fullsized":"2024-04-25T08:59:33.483769+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:26.708112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.475393+0000","last_change":"2024-04-25T08:59:32.464604+0000","last_active":"2024-04-25T08:59:33.475393+0000","last_peered":"2024-04-25T08:59:33.475393+0000","last_clean":"2024-04-25T08:59:33.475393+0000","last_became_active":"2024-04-25T08:59:32.464269+0000","last_became_peered":"2024-04-25T08:59:32.464269+0000","last_unstale":"2024-04-25T08:59:33.475393+0000","last_undegraded":"2024-04-25T08:59:33.475393+0000","last_fullsized":"2024-04-25T08:59:33.475393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:15.797707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473554+0000","last_change":"2024-04-25T08:59:33.485631+0000","last_active":"2024-04-25T08:59:34.473554+0000","last_peered":"2024-04-25T08:59:34.473554+0000","last_clean":"2024-04-25T08:59:34.473554+0000","last_became_active":"2024-04-25T08:59:33.481772+0000","last_became_peered":"2024-04-25T08:59:33.481772+0000","last_unstale":"2024-04-25T08:59:34.473554+0000","last_undegraded":"2024-04-25T08:59:34.473554+0000","last_fullsized":"2024-04-25T08:59:34.473554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:24.257915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471365+0000","last_change":"2024-04-25T08:59:32.463576+0000","last_active":"2024-04-25T08:59:34.471365+0000","last_peered":"2024-04-25T08:59:34.471365+0000","last_clean":"2024-04-25T08:59:34.471365+0000","last_became_active":"2024-04-25T08:59:32.463274+0000","last_became_peered":"2024-04-25T08:59:32.463274+0000","last_unstale":"2024-04-25T08:59:34.471365+0000","last_undegraded":"2024-04-25T08:59:34.471365+0000","last_fullsized":"2024-04-25T08:59:34.471365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:43.153641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.487750+0000","last_change":"2024-04-25T08:59:33.480755+0000","last_active":"2024-04-25T08:59:33.487750+0000","last_peered":"2024-04-25T08:59:33.487750+0000","last_clean":"2024-04-25T08:59:33.487750+0000","last_became_active":"2024-04-25T08:59:33.480461+0000","last_became_peered":"2024-04-25T08:59:33.480461+0000","last_unstale":"2024-04-25T08:59:33.487750+0000","last_undegraded":"2024-04-25T08:59:33.487750+0000","last_fullsized":"2024-04-25T08:59:33.487750+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:37.307074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473606+0000","last_change":"2024-04-25T08:59:32.461135+0000","last_active":"2024-04-25T08:59:34.473606+0000","last_peered":"2024-04-25T08:59:34.473606+0000","last_clean":"2024-04-25T08:59:34.473606+0000","last_became_active":"2024-04-25T08:59:32.460310+0000","last_became_peered":"2024-04-25T08:59:32.460310+0000","last_unstale":"2024-04-25T08:59:34.473606+0000","last_undegraded":"2024-04-25T08:59:34.473606+0000","last_fullsized":"2024-04-25T08:59:34.473606+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:42.156606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473311+0000","last_change":"2024-04-25T08:59:33.487545+0000","last_active":"2024-04-25T08:59:34.473311+0000","last_peered":"2024-04-25T08:59:34.473311+0000","last_clean":"2024-04-25T08:59:34.473311+0000","last_became_active":"2024-04-25T08:59:33.487195+0000","last_became_peered":"2024-04-25T08:59:33.487195+0000","last_unstale":"2024-04-25T08:59:34.473311+0000","last_undegraded":"2024-04-25T08:59:34.473311+0000","last_fullsized":"2024-04-25T08:59:34.473311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:51.912742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473309+0000","last_change":"2024-04-25T08:59:32.460633+0000","last_active":"2024-04-25T08:59:34.473309+0000","last_peered":"2024-04-25T08:59:34.473309+0000","last_clean":"2024-04-25T08:59:34.473309+0000","last_became_active":"2024-04-25T08:59:32.460329+0000","last_became_peered":"2024-04-25T08:59:32.460329+0000","last_unstale":"2024-04-25T08:59:34.473309+0000","last_undegraded":"2024-04-25T08:59:34.473309+0000","last_fullsized":"2024-04-25T08:59:34.473309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:53.773940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488033+0000","last_change":"2024-04-25T08:59:33.485286+0000","last_active":"2024-04-25T08:59:33.488033+0000","last_peered":"2024-04-25T08:59:33.488033+0000","last_clean":"2024-04-25T08:59:33.488033+0000","last_became_active":"2024-04-25T08:59:33.484962+0000","last_became_peered":"2024-04-25T08:59:33.484962+0000","last_unstale":"2024-04-25T08:59:33.488033+0000","last_undegraded":"2024-04-25T08:59:33.488033+0000","last_fullsized":"2024-04-25T08:59:33.488033+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:01.528790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471048+0000","last_change":"2024-04-25T08:59:32.464201+0000","last_active":"2024-04-25T08:59:34.471048+0000","last_peered":"2024-04-25T08:59:34.471048+0000","last_clean":"2024-04-25T08:59:34.471048+0000","last_became_active":"2024-04-25T08:59:32.463911+0000","last_became_peered":"2024-04-25T08:59:32.463911+0000","last_unstale":"2024-04-25T08:59:34.471048+0000","last_undegraded":"2024-04-25T08:59:34.471048+0000","last_fullsized":"2024-04-25T08:59:34.471048+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:03.978039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.487062+0000","last_change":"2024-04-25T08:59:33.481688+0000","last_active":"2024-04-25T08:59:33.487062+0000","last_peered":"2024-04-25T08:59:33.487062+0000","last_clean":"2024-04-25T08:59:33.487062+0000","last_became_active":"2024-04-25T08:59:33.481355+0000","last_became_peered":"2024-04-25T08:59:33.481355+0000","last_unstale":"2024-04-25T08:59:33.487062+0000","last_undegraded":"2024-04-25T08:59:33.487062+0000","last_fullsized":"2024-04-25T08:59:33.487062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:12.934586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450423+0000","last_change":"2024-04-25T08:59:31.450423+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450423+0000","last_undegraded":"2024-04-25T08:59:31.450423+0000","last_fullsized":"2024-04-25T08:59:31.450423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470420+0000","last_change":"2024-04-25T08:59:33.491914+0000","last_active":"2024-04-25T08:59:34.470420+0000","last_peered":"2024-04-25T08:59:34.470420+0000","last_clean":"2024-04-25T08:59:34.470420+0000","last_became_active":"2024-04-25T08:59:33.491596+0000","last_became_peered":"2024-04-25T08:59:33.491596+0000","last_unstale":"2024-04-25T08:59:34.470420+0000","last_undegraded":"2024-04-25T08:59:34.470420+0000","last_fullsized":"2024-04-25T08:59:34.470420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:04.984096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450560+0000","last_change":"2024-04-25T08:59:31.450560+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450560+0000","last_undegraded":"2024-04-25T08:59:31.450560+0000","last_fullsized":"2024-04-25T08:59:31.450560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471220+0000","last_change":"2024-04-25T08:59:33.491700+0000","last_active":"2024-04-25T08:59:34.471220+0000","last_peered":"2024-04-25T08:59:34.471220+0000","last_clean":"2024-04-25T08:59:34.471220+0000","last_became_active":"2024-04-25T08:59:33.491448+0000","last_became_peered":"2024-04-25T08:59:33.491448+0000","last_unstale":"2024-04-25T08:59:34.471220+0000","last_undegraded":"2024-04-25T08:59:34.471220+0000","last_fullsized":"2024-04-25T08:59:34.471220+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:04.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470874+0000","last_change":"2024-04-25T08:59:32.459979+0000","last_active":"2024-04-25T08:59:34.470874+0000","last_peered":"2024-04-25T08:59:34.470874+0000","last_clean":"2024-04-25T08:59:34.470874+0000","last_became_active":"2024-04-25T08:59:32.459035+0000","last_became_peered":"2024-04-25T08:59:32.459035+0000","last_unstale":"2024-04-25T08:59:34.470874+0000","last_undegraded":"2024-04-25T08:59:34.470874+0000","last_fullsized":"2024-04-25T08:59:34.470874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:29.629464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488303+0000","last_change":"2024-04-25T08:59:33.486075+0000","last_active":"2024-04-25T08:59:33.488303+0000","last_peered":"2024-04-25T08:59:33.488303+0000","last_clean":"2024-04-25T08:59:33.488303+0000","last_became_active":"2024-04-25T08:59:33.485770+0000","last_became_peered":"2024-04-25T08:59:33.485770+0000","last_unstale":"2024-04-25T08:59:33.488303+0000","last_undegraded":"2024-04-25T08:59:33.488303+0000","last_fullsized":"2024-04-25T08:59:33.488303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:59.058020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471325+0000","last_change":"2024-04-25T08:59:32.462805+0000","last_active":"2024-04-25T08:59:34.471325+0000","last_peered":"2024-04-25T08:59:34.471325+0000","last_clean":"2024-04-25T08:59:34.471325+0000","last_became_active":"2024-04-25T08:59:32.462539+0000","last_became_peered":"2024-04-25T08:59:32.462539+0000","last_unstale":"2024-04-25T08:59:34.471325+0000","last_undegraded":"2024-04-25T08:59:34.471325+0000","last_fullsized":"2024-04-25T08:59:34.471325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:44.042275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.483741+0000","last_change":"2024-04-25T08:59:33.477267+0000","last_active":"2024-04-25T08:59:33.483741+0000","last_peered":"2024-04-25T08:59:33.483741+0000","last_clean":"2024-04-25T08:59:33.483741+0000","last_became_active":"2024-04-25T08:59:33.476984+0000","last_became_peered":"2024-04-25T08:59:33.476984+0000","last_unstale":"2024-04-25T08:59:33.483741+0000","last_undegraded":"2024-04-25T08:59:33.483741+0000","last_fullsized":"2024-04-25T08:59:33.483741+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:59.058020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.475058+0000","last_change":"2024-04-25T08:59:32.465049+0000","last_active":"2024-04-25T08:59:33.475058+0000","last_peered":"2024-04-25T08:59:33.475058+0000","last_clean":"2024-04-25T08:59:33.475058+0000","last_became_active":"2024-04-25T08:59:32.464006+0000","last_became_peered":"2024-04-25T08:59:32.464006+0000","last_unstale":"2024-04-25T08:59:33.475058+0000","last_undegraded":"2024-04-25T08:59:33.475058+0000","last_fullsized":"2024-04-25T08:59:33.475058+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:00.522733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.484830+0000","last_change":"2024-04-25T08:59:33.483344+0000","last_active":"2024-04-25T08:59:33.484830+0000","last_peered":"2024-04-25T08:59:33.484830+0000","last_clean":"2024-04-25T08:59:33.484830+0000","last_became_active":"2024-04-25T08:59:33.483070+0000","last_became_peered":"2024-04-25T08:59:33.483070+0000","last_unstale":"2024-04-25T08:59:33.484830+0000","last_undegraded":"2024-04-25T08:59:33.484830+0000","last_fullsized":"2024-04-25T08:59:33.484830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:04.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.475841+0000","last_change":"2024-04-25T08:59:32.465761+0000","last_active":"2024-04-25T08:59:33.475841+0000","last_peered":"2024-04-25T08:59:33.475841+0000","last_clean":"2024-04-25T08:59:33.475841+0000","last_became_active":"2024-04-25T08:59:32.465411+0000","last_became_peered":"2024-04-25T08:59:32.465411+0000","last_unstale":"2024-04-25T08:59:33.475841+0000","last_undegraded":"2024-04-25T08:59:33.475841+0000","last_fullsized":"2024-04-25T08:59:33.475841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:50.953911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470603+0000","last_change":"2024-04-25T08:59:33.481868+0000","last_active":"2024-04-25T08:59:34.470603+0000","last_peered":"2024-04-25T08:59:34.470603+0000","last_clean":"2024-04-25T08:59:34.470603+0000","last_became_active":"2024-04-25T08:59:33.481590+0000","last_became_peered":"2024-04-25T08:59:33.481590+0000","last_unstale":"2024-04-25T08:59:34.470603+0000","last_undegraded":"2024-04-25T08:59:34.470603+0000","last_fullsized":"2024-04-25T08:59:34.470603+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:50.966614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471390+0000","last_change":"2024-04-25T08:59:32.463330+0000","last_active":"2024-04-25T08:59:34.471390+0000","last_peered":"2024-04-25T08:59:34.471390+0000","last_clean":"2024-04-25T08:59:34.471390+0000","last_became_active":"2024-04-25T08:59:32.463073+0000","last_became_peered":"2024-04-25T08:59:32.463073+0000","last_unstale":"2024-04-25T08:59:34.471390+0000","last_undegraded":"2024-04-25T08:59:34.471390+0000","last_fullsized":"2024-04-25T08:59:34.471390+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:44.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471335+0000","last_change":"2024-04-25T08:59:33.493939+0000","last_active":"2024-04-25T08:59:34.471335+0000","last_peered":"2024-04-25T08:59:34.471335+0000","last_clean":"2024-04-25T08:59:34.471335+0000","last_became_active":"2024-04-25T08:59:33.493207+0000","last_became_peered":"2024-04-25T08:59:33.493207+0000","last_unstale":"2024-04-25T08:59:34.471335+0000","last_undegraded":"2024-04-25T08:59:34.471335+0000","last_fullsized":"2024-04-25T08:59:34.471335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:51.961543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.474392+0000","last_change":"2024-04-25T08:59:32.461693+0000","last_active":"2024-04-25T08:59:33.474392+0000","last_peered":"2024-04-25T08:59:33.474392+0000","last_clean":"2024-04-25T08:59:33.474392+0000","last_became_active":"2024-04-25T08:59:32.461445+0000","last_became_peered":"2024-04-25T08:59:32.461445+0000","last_unstale":"2024-04-25T08:59:33.474392+0000","last_undegraded":"2024-04-25T08:59:33.474392+0000","last_fullsized":"2024-04-25T08:59:33.474392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:44.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470620+0000","last_change":"2024-04-25T08:59:32.465998+0000","last_active":"2024-04-25T08:59:34.470620+0000","last_peered":"2024-04-25T08:59:34.470620+0000","last_clean":"2024-04-25T08:59:34.470620+0000","last_became_active":"2024-04-25T08:59:32.465578+0000","last_became_peered":"2024-04-25T08:59:32.465578+0000","last_unstale":"2024-04-25T08:59:34.470620+0000","last_undegraded":"2024-04-25T08:59:34.470620+0000","last_fullsized":"2024-04-25T08:59:34.470620+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:16.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":289,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470812+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:59:34.470812+0000","last_peered":"2024-04-25T08:59:34.470812+0000","last_clean":"2024-04-25T08:59:34.470812+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:59:34.470812+0000","last_undegraded":"2024-04-25T08:59:34.470812+0000","last_fullsized":"2024-04-25T08:59:34.470812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1646592,"data_stored":1035444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1060864,"data_stored":445700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":446640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":445006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1060864,"data_stored":446618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":445588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1646592,"data_stored":1035408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":431956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:59:36.827 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:59:36.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.976+0000 7fc577722640 1 Processor -- start 2024-04-25T08:59:36.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.976+0000 7fc577722640 1 -- start start 2024-04-25T08:59:36.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc577722640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57015dce0 0x7fc5700d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc577722640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57015e0c0 con 0x7fc5700d35b0 2024-04-25T08:59:36.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc577722640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5700d2510 con 0x7fc5700b5b60 2024-04-25T08:59:36.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc577722640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700d27f0 con 0x7fc57015dce0 2024-04-25T08:59:36.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc574cbd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc5700d35b0 0x7fc5700b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55292/0 (socket says 172.21.15.55:55292) 2024-04-25T08:59:36.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc574cbd640 1 -- 172.21.15.55:0/3812668090 learned_addr learned my addr 172.21.15.55:0/3812668090 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:36.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc5754be640 1 --2- 172.21.15.55:0/3812668090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57015dce0 0x7fc5700d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc567fff640 1 -- 172.21.15.55:0/3812668090 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519097171 0 0) 0x7fc57015e0c0 con 0x7fc5700d35b0 2024-04-25T08:59:36.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc567fff640 1 -- 172.21.15.55:0/3812668090 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc55c003520 con 0x7fc5700d35b0 2024-04-25T08:59:36.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc567fff640 1 -- 172.21.15.55:0/3812668090 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362907137 0 0) 0x7fc5700d2510 con 0x7fc5700b5b60 2024-04-25T08:59:36.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc567fff640 1 -- 172.21.15.55:0/3812668090 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc57015e0c0 con 0x7fc5700b5b60 2024-04-25T08:59:36.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc5754be640 1 -- 172.21.15.55:0/3812668090 >> v1:172.21.15.167:6789/0 conn(0x7fc5700b5b60 legacy=0x7fc5700b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc5754be640 1 -- 172.21.15.55:0/3812668090 >> v1:172.21.15.55:6789/0 conn(0x7fc5700d35b0 legacy=0x7fc5700b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.977+0000 7fc5754be640 1 -- 172.21.15.55:0/3812668090 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700d2ad0 con 0x7fc57015dce0 2024-04-25T08:59:36.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.978+0000 7fc5754be640 1 --2- 172.21.15.55:0/3812668090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57015dce0 0x7fc5700d1a50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc5680097d0 tx=0x7fc56802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd01c4c30a367f06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:36.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.978+0000 7fc567fff640 1 -- 172.21.15.55:0/3812668090 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568037070 con 0x7fc57015dce0 2024-04-25T08:59:36.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.978+0000 7fc567fff640 1 -- 172.21.15.55:0/3812668090 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568032440 con 0x7fc57015dce0 2024-04-25T08:59:36.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.978+0000 7fc567fff640 1 -- 172.21.15.55:0/3812668090 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5680327f0 con 0x7fc57015dce0 2024-04-25T08:59:36.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.979+0000 7fc577722640 1 -- 172.21.15.55:0/3812668090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57015dce0 msgr2=0x7fc5700d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.979+0000 7fc577722640 1 --2- 172.21.15.55:0/3812668090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57015dce0 0x7fc5700d1a50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc5680097d0 tx=0x7fc56802a210 comp rx=0 tx=0).stop 2024-04-25T08:59:36.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.979+0000 7fc577722640 1 -- 172.21.15.55:0/3812668090 shutdown_connections 2024-04-25T08:59:36.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.979+0000 7fc577722640 1 --2- 172.21.15.55:0/3812668090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc57015dce0 0x7fc5700d1a50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.979+0000 7fc577722640 1 -- 172.21.15.55:0/3812668090 >> 172.21.15.55:0/3812668090 conn(0x7fc570072900 msgr2=0x7fc5700d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:36.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.979+0000 7fc577722640 1 -- 172.21.15.55:0/3812668090 shutdown_connections 2024-04-25T08:59:36.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.979+0000 7fc577722640 1 -- 172.21.15.55:0/3812668090 wait complete. 2024-04-25T08:59:36.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.980+0000 7fc577722640 1 Processor -- start 2024-04-25T08:59:36.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.980+0000 7fc577722640 1 -- start start 2024-04-25T08:59:36.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc577722640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5700b5b60 0x7fc570160620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc577722640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5700d35b0 0x7fc5700c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc577722640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc57015dce0 0x7fc5700c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc577722640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700b9820 con 0x7fc5700b5b60 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc577722640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700d3090 con 0x7fc57015dce0 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc577722640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700b99a0 con 0x7fc5700d35b0 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc5754be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5700b5b60 0x7fc570160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc5754be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5700b5b60 0x7fc570160620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55726/0 (socket says 172.21.15.55:55726) 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc5754be640 1 -- 172.21.15.55:0/2123211568 learned_addr learned my addr 172.21.15.55:0/2123211568 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc574cbd640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5700d35b0 0x7fc5700c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc575cbf640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc57015dce0 0x7fc5700c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc5754be640 1 -- 172.21.15.55:0/2123211568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5700d35b0 msgr2=0x7fc5700c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc5754be640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5700d35b0 0x7fc5700c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc5754be640 1 -- 172.21.15.55:0/2123211568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc57015dce0 msgr2=0x7fc5700c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc5754be640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc57015dce0 0x7fc5700c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc5754be640 1 -- 172.21.15.55:0/2123211568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700c90b0 con 0x7fc5700b5b60 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc5754be640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5700b5b60 0x7fc570160620 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fc56802a250 tx=0x7fc5680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:36.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.981+0000 7fc565ffb640 1 -- 172.21.15.55:0/2123211568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568041020 con 0x7fc5700b5b60 2024-04-25T08:59:36.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.982+0000 7fc565ffb640 1 -- 172.21.15.55:0/2123211568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56803d6e0 con 0x7fc5700b5b60 2024-04-25T08:59:36.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.982+0000 7fc577722640 1 -- 172.21.15.55:0/2123211568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5700c9380 con 0x7fc5700b5b60 2024-04-25T08:59:36.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.982+0000 7fc565ffb640 1 -- 172.21.15.55:0/2123211568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568037040 con 0x7fc5700b5b60 2024-04-25T08:59:36.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.982+0000 7fc577722640 1 -- 172.21.15.55:0/2123211568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57015e590 con 0x7fc5700b5b60 2024-04-25T08:59:36.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.983+0000 7fc577722640 1 -- 172.21.15.55:0/2123211568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5700749b0 con 0x7fc5700b5b60 2024-04-25T08:59:36.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.983+0000 7fc565ffb640 1 -- 172.21.15.55:0/2123211568 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc568044020 con 0x7fc5700b5b60 2024-04-25T08:59:36.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.984+0000 7fc565ffb640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc55406b4d0 0x7fc55406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:36.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.984+0000 7fc565ffb640 1 -- 172.21.15.55:0/2123211568 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5680aa980 con 0x7fc5700b5b60 2024-04-25T08:59:36.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.984+0000 7fc574cbd640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc55406b4d0 0x7fc55406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:36.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.984+0000 7fc574cbd640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc55406b4d0 0x7fc55406d990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc5700ca520 tx=0x7fc560009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:36.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:36.988+0000 7fc565ffb640 1 -- 172.21.15.55:0/2123211568 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc56804b030 con 0x7fc5700b5b60 2024-04-25T08:59:37.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.167+0000 7fc577722640 1 -- 172.21.15.55:0/2123211568 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc5700b4e80 con 0x7fc55406b4d0 2024-04-25T08:59:37.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.172+0000 7fc565ffb640 1 -- 172.21.15.55:0/2123211568 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250343 (secure 0 0 0) 0x7fc5700b4e80 con 0x7fc55406b4d0 2024-04-25T08:59:37.165 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:37.166 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.175+0000 7fc577722640 1 -- 172.21.15.55:0/2123211568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc55406b4d0 msgr2=0x7fc55406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.175+0000 7fc577722640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc55406b4d0 0x7fc55406d990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc5700ca520 tx=0x7fc560009040 comp rx=0 tx=0).stop 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.175+0000 7fc577722640 1 -- 172.21.15.55:0/2123211568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5700b5b60 msgr2=0x7fc570160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.175+0000 7fc577722640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5700b5b60 0x7fc570160620 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fc56802a250 tx=0x7fc5680046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.175+0000 7fc577722640 1 -- 172.21.15.55:0/2123211568 shutdown_connections 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.175+0000 7fc577722640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc55406b4d0 0x7fc55406d990 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.175+0000 7fc577722640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc57015dce0 0x7fc5700c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.175+0000 7fc577722640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5700d35b0 0x7fc5700c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.175+0000 7fc577722640 1 --2- 172.21.15.55:0/2123211568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5700b5b60 0x7fc570160620 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.176+0000 7fc577722640 1 -- 172.21.15.55:0/2123211568 >> 172.21.15.55:0/2123211568 conn(0x7fc570072900 msgr2=0x7fc57015cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.176+0000 7fc577722640 1 -- 172.21.15.55:0/2123211568 shutdown_connections 2024-04-25T08:59:37.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.176+0000 7fc577722640 1 -- 172.21.15.55:0/2123211568 wait complete. 2024-04-25T08:59:37.175 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-04-25T08:59:36.629854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":197,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254684,"kb_used_data":9380,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720036,"statfs":{"total":773094113280,"available":772833316864,"internally_reserved":0,"allocated":9605120,"data_stored":4732360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.185358"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471225+0000","last_change":"2024-04-25T08:59:33.485591+0000","last_active":"2024-04-25T08:59:34.471225+0000","last_peered":"2024-04-25T08:59:34.471225+0000","last_clean":"2024-04-25T08:59:34.471225+0000","last_became_active":"2024-04-25T08:59:33.485270+0000","last_became_peered":"2024-04-25T08:59:33.485270+0000","last_unstale":"2024-04-25T08:59:34.471225+0000","last_undegraded":"2024-04-25T08:59:34.471225+0000","last_fullsized":"2024-04-25T08:59:34.471225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:44.759906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470340+0000","last_change":"2024-04-25T08:59:33.487428+0000","last_active":"2024-04-25T08:59:34.470340+0000","last_peered":"2024-04-25T08:59:34.470340+0000","last_clean":"2024-04-25T08:59:34.470340+0000","last_became_active":"2024-04-25T08:59:33.487122+0000","last_became_peered":"2024-04-25T08:59:33.487122+0000","last_unstale":"2024-04-25T08:59:34.470340+0000","last_undegraded":"2024-04-25T08:59:34.470340+0000","last_fullsized":"2024-04-25T08:59:34.470340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:40.677654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473529+0000","last_change":"2024-04-25T08:59:33.481919+0000","last_active":"2024-04-25T08:59:34.473529+0000","last_peered":"2024-04-25T08:59:34.473529+0000","last_clean":"2024-04-25T08:59:34.473529+0000","last_became_active":"2024-04-25T08:59:33.481671+0000","last_became_peered":"2024-04-25T08:59:33.481671+0000","last_unstale":"2024-04-25T08:59:34.473529+0000","last_undegraded":"2024-04-25T08:59:34.473529+0000","last_fullsized":"2024-04-25T08:59:34.473529+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:38.662705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.486809+0000","last_change":"2024-04-25T08:59:33.482528+0000","last_active":"2024-04-25T08:59:33.486809+0000","last_peered":"2024-04-25T08:59:33.486809+0000","last_clean":"2024-04-25T08:59:33.486809+0000","last_became_active":"2024-04-25T08:59:33.482248+0000","last_became_peered":"2024-04-25T08:59:33.482248+0000","last_unstale":"2024-04-25T08:59:33.486809+0000","last_undegraded":"2024-04-25T08:59:33.486809+0000","last_fullsized":"2024-04-25T08:59:33.486809+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:27.525341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490185+0000","last_change":"2024-04-25T08:59:33.489289+0000","last_active":"2024-04-25T08:59:33.490185+0000","last_peered":"2024-04-25T08:59:33.490185+0000","last_clean":"2024-04-25T08:59:33.490185+0000","last_became_active":"2024-04-25T08:59:33.488378+0000","last_became_peered":"2024-04-25T08:59:33.488378+0000","last_unstale":"2024-04-25T08:59:33.490185+0000","last_undegraded":"2024-04-25T08:59:33.490185+0000","last_fullsized":"2024-04-25T08:59:33.490185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:17.712953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473272+0000","last_change":"2024-04-25T08:59:33.486006+0000","last_active":"2024-04-25T08:59:34.473272+0000","last_peered":"2024-04-25T08:59:34.473272+0000","last_clean":"2024-04-25T08:59:34.473272+0000","last_became_active":"2024-04-25T08:59:33.485708+0000","last_became_peered":"2024-04-25T08:59:33.485708+0000","last_unstale":"2024-04-25T08:59:34.473272+0000","last_undegraded":"2024-04-25T08:59:34.473272+0000","last_fullsized":"2024-04-25T08:59:34.473272+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:05.103716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.487677+0000","last_change":"2024-04-25T08:59:33.481878+0000","last_active":"2024-04-25T08:59:33.487677+0000","last_peered":"2024-04-25T08:59:33.487677+0000","last_clean":"2024-04-25T08:59:33.487677+0000","last_became_active":"2024-04-25T08:59:33.481549+0000","last_became_peered":"2024-04-25T08:59:33.481549+0000","last_unstale":"2024-04-25T08:59:33.487677+0000","last_undegraded":"2024-04-25T08:59:33.487677+0000","last_fullsized":"2024-04-25T08:59:33.487677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:51.693954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490458+0000","last_change":"2024-04-25T08:59:33.489742+0000","last_active":"2024-04-25T08:59:33.490458+0000","last_peered":"2024-04-25T08:59:33.490458+0000","last_clean":"2024-04-25T08:59:33.490458+0000","last_became_active":"2024-04-25T08:59:33.489472+0000","last_became_peered":"2024-04-25T08:59:33.489472+0000","last_unstale":"2024-04-25T08:59:33.490458+0000","last_undegraded":"2024-04-25T08:59:33.490458+0000","last_fullsized":"2024-04-25T08:59:33.490458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:16.803764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470926+0000","last_change":"2024-04-25T08:59:33.492585+0000","last_active":"2024-04-25T08:59:34.470926+0000","last_peered":"2024-04-25T08:59:34.470926+0000","last_clean":"2024-04-25T08:59:34.470926+0000","last_became_active":"2024-04-25T08:59:33.492032+0000","last_became_peered":"2024-04-25T08:59:33.492032+0000","last_unstale":"2024-04-25T08:59:34.470926+0000","last_undegraded":"2024-04-25T08:59:34.470926+0000","last_fullsized":"2024-04-25T08:59:34.470926+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:16.803764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470677+0000","last_change":"2024-04-25T08:59:33.492662+0000","last_active":"2024-04-25T08:59:34.470677+0000","last_peered":"2024-04-25T08:59:34.470677+0000","last_clean":"2024-04-25T08:59:34.470677+0000","last_became_active":"2024-04-25T08:59:33.492153+0000","last_became_peered":"2024-04-25T08:59:33.492153+0000","last_unstale":"2024-04-25T08:59:34.470677+0000","last_undegraded":"2024-04-25T08:59:34.470677+0000","last_fullsized":"2024-04-25T08:59:34.470677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:01.528790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470906+0000","last_change":"2024-04-25T08:59:33.480997+0000","last_active":"2024-04-25T08:59:34.470906+0000","last_peered":"2024-04-25T08:59:34.470906+0000","last_clean":"2024-04-25T08:59:34.470906+0000","last_became_active":"2024-04-25T08:59:33.480666+0000","last_became_peered":"2024-04-25T08:59:33.480666+0000","last_unstale":"2024-04-25T08:59:34.470906+0000","last_undegraded":"2024-04-25T08:59:34.470906+0000","last_fullsized":"2024-04-25T08:59:34.470906+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:16.088847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473509+0000","last_change":"2024-04-25T08:59:33.486549+0000","last_active":"2024-04-25T08:59:34.473509+0000","last_peered":"2024-04-25T08:59:34.473509+0000","last_clean":"2024-04-25T08:59:34.473509+0000","last_became_active":"2024-04-25T08:59:33.486014+0000","last_became_peered":"2024-04-25T08:59:33.486014+0000","last_unstale":"2024-04-25T08:59:34.473509+0000","last_undegraded":"2024-04-25T08:59:34.473509+0000","last_fullsized":"2024-04-25T08:59:34.473509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:16.544816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471226+0000","last_change":"2024-04-25T08:59:33.480745+0000","last_active":"2024-04-25T08:59:34.471226+0000","last_peered":"2024-04-25T08:59:34.471226+0000","last_clean":"2024-04-25T08:59:34.471226+0000","last_became_active":"2024-04-25T08:59:33.480458+0000","last_became_peered":"2024-04-25T08:59:33.480458+0000","last_unstale":"2024-04-25T08:59:34.471226+0000","last_undegraded":"2024-04-25T08:59:34.471226+0000","last_fullsized":"2024-04-25T08:59:34.471226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:39.831860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488373+0000","last_change":"2024-04-25T08:59:33.486493+0000","last_active":"2024-04-25T08:59:33.488373+0000","last_peered":"2024-04-25T08:59:33.488373+0000","last_clean":"2024-04-25T08:59:33.488373+0000","last_became_active":"2024-04-25T08:59:33.485837+0000","last_became_peered":"2024-04-25T08:59:33.485837+0000","last_unstale":"2024-04-25T08:59:33.488373+0000","last_undegraded":"2024-04-25T08:59:33.488373+0000","last_fullsized":"2024-04-25T08:59:33.488373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:40.979833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498034+0000","last_change":"2024-04-25T08:59:33.489778+0000","last_active":"2024-04-25T08:59:33.498034+0000","last_peered":"2024-04-25T08:59:33.498034+0000","last_clean":"2024-04-25T08:59:33.498034+0000","last_became_active":"2024-04-25T08:59:33.489514+0000","last_became_peered":"2024-04-25T08:59:33.489514+0000","last_unstale":"2024-04-25T08:59:33.498034+0000","last_undegraded":"2024-04-25T08:59:33.498034+0000","last_fullsized":"2024-04-25T08:59:33.498034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:16.803764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473762+0000","last_change":"2024-04-25T08:59:33.495035+0000","last_active":"2024-04-25T08:59:34.473762+0000","last_peered":"2024-04-25T08:59:34.473762+0000","last_clean":"2024-04-25T08:59:34.473762+0000","last_became_active":"2024-04-25T08:59:33.494739+0000","last_became_peered":"2024-04-25T08:59:33.494739+0000","last_unstale":"2024-04-25T08:59:34.473762+0000","last_undegraded":"2024-04-25T08:59:34.473762+0000","last_fullsized":"2024-04-25T08:59:34.473762+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:07.192195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488336+0000","last_change":"2024-04-25T08:59:33.484405+0000","last_active":"2024-04-25T08:59:33.488336+0000","last_peered":"2024-04-25T08:59:33.488336+0000","last_clean":"2024-04-25T08:59:33.488336+0000","last_became_active":"2024-04-25T08:59:33.482624+0000","last_became_peered":"2024-04-25T08:59:33.482624+0000","last_unstale":"2024-04-25T08:59:33.488336+0000","last_undegraded":"2024-04-25T08:59:33.488336+0000","last_fullsized":"2024-04-25T08:59:33.488336+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:55.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473597+0000","last_change":"2024-04-25T08:59:33.485682+0000","last_active":"2024-04-25T08:59:34.473597+0000","last_peered":"2024-04-25T08:59:34.473597+0000","last_clean":"2024-04-25T08:59:34.473597+0000","last_became_active":"2024-04-25T08:59:33.485410+0000","last_became_peered":"2024-04-25T08:59:33.485410+0000","last_unstale":"2024-04-25T08:59:34.473597+0000","last_undegraded":"2024-04-25T08:59:34.473597+0000","last_fullsized":"2024-04-25T08:59:34.473597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:46.869053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473472+0000","last_change":"2024-04-25T08:59:33.485903+0000","last_active":"2024-04-25T08:59:34.473472+0000","last_peered":"2024-04-25T08:59:34.473472+0000","last_clean":"2024-04-25T08:59:34.473472+0000","last_became_active":"2024-04-25T08:59:33.485144+0000","last_became_peered":"2024-04-25T08:59:33.485144+0000","last_unstale":"2024-04-25T08:59:34.473472+0000","last_undegraded":"2024-04-25T08:59:34.473472+0000","last_fullsized":"2024-04-25T08:59:34.473472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:00.891178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471295+0000","last_change":"2024-04-25T08:59:33.494003+0000","last_active":"2024-04-25T08:59:34.471295+0000","last_peered":"2024-04-25T08:59:34.471295+0000","last_clean":"2024-04-25T08:59:34.471295+0000","last_became_active":"2024-04-25T08:59:33.493533+0000","last_became_peered":"2024-04-25T08:59:33.493533+0000","last_unstale":"2024-04-25T08:59:34.471295+0000","last_undegraded":"2024-04-25T08:59:34.471295+0000","last_fullsized":"2024-04-25T08:59:34.471295+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:55.574254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473277+0000","last_change":"2024-04-25T08:59:33.486174+0000","last_active":"2024-04-25T08:59:34.473277+0000","last_peered":"2024-04-25T08:59:34.473277+0000","last_clean":"2024-04-25T08:59:34.473277+0000","last_became_active":"2024-04-25T08:59:33.485376+0000","last_became_peered":"2024-04-25T08:59:33.485376+0000","last_unstale":"2024-04-25T08:59:34.473277+0000","last_undegraded":"2024-04-25T08:59:34.473277+0000","last_fullsized":"2024-04-25T08:59:34.473277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:23.321835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470675+0000","last_change":"2024-04-25T08:59:33.481229+0000","last_active":"2024-04-25T08:59:34.470675+0000","last_peered":"2024-04-25T08:59:34.470675+0000","last_clean":"2024-04-25T08:59:34.470675+0000","last_became_active":"2024-04-25T08:59:33.480697+0000","last_became_peered":"2024-04-25T08:59:33.480697+0000","last_unstale":"2024-04-25T08:59:34.470675+0000","last_undegraded":"2024-04-25T08:59:34.470675+0000","last_fullsized":"2024-04-25T08:59:34.470675+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:18.281359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.480830+0000","last_change":"2024-04-25T08:59:33.478198+0000","last_active":"2024-04-25T08:59:33.480830+0000","last_peered":"2024-04-25T08:59:33.480830+0000","last_clean":"2024-04-25T08:59:33.480830+0000","last_became_active":"2024-04-25T08:59:33.477907+0000","last_became_peered":"2024-04-25T08:59:33.477907+0000","last_unstale":"2024-04-25T08:59:33.480830+0000","last_undegraded":"2024-04-25T08:59:33.480830+0000","last_fullsized":"2024-04-25T08:59:33.480830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:12.092783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470873+0000","last_change":"2024-04-25T08:59:33.486375+0000","last_active":"2024-04-25T08:59:34.470873+0000","last_peered":"2024-04-25T08:59:34.470873+0000","last_clean":"2024-04-25T08:59:34.470873+0000","last_became_active":"2024-04-25T08:59:33.484674+0000","last_became_peered":"2024-04-25T08:59:33.484674+0000","last_unstale":"2024-04-25T08:59:34.470873+0000","last_undegraded":"2024-04-25T08:59:34.470873+0000","last_fullsized":"2024-04-25T08:59:34.470873+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:17.712953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488888+0000","last_change":"2024-04-25T08:59:33.486570+0000","last_active":"2024-04-25T08:59:33.488888+0000","last_peered":"2024-04-25T08:59:33.488888+0000","last_clean":"2024-04-25T08:59:33.488888+0000","last_became_active":"2024-04-25T08:59:33.486194+0000","last_became_peered":"2024-04-25T08:59:33.486194+0000","last_unstale":"2024-04-25T08:59:33.488888+0000","last_undegraded":"2024-04-25T08:59:33.488888+0000","last_fullsized":"2024-04-25T08:59:33.488888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:37.307074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470424+0000","last_change":"2024-04-25T08:59:33.484769+0000","last_active":"2024-04-25T08:59:34.470424+0000","last_peered":"2024-04-25T08:59:34.470424+0000","last_clean":"2024-04-25T08:59:34.470424+0000","last_became_active":"2024-04-25T08:59:33.484449+0000","last_became_peered":"2024-04-25T08:59:33.484449+0000","last_unstale":"2024-04-25T08:59:34.470424+0000","last_undegraded":"2024-04-25T08:59:34.470424+0000","last_fullsized":"2024-04-25T08:59:34.470424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:51.693954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.489495+0000","last_change":"2024-04-25T08:59:33.486917+0000","last_active":"2024-04-25T08:59:33.489495+0000","last_peered":"2024-04-25T08:59:33.489495+0000","last_clean":"2024-04-25T08:59:33.489495+0000","last_became_active":"2024-04-25T08:59:33.486279+0000","last_became_peered":"2024-04-25T08:59:33.486279+0000","last_unstale":"2024-04-25T08:59:33.489495+0000","last_undegraded":"2024-04-25T08:59:33.489495+0000","last_fullsized":"2024-04-25T08:59:33.489495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:51.693954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471438+0000","last_change":"2024-04-25T08:59:32.461674+0000","last_active":"2024-04-25T08:59:34.471438+0000","last_peered":"2024-04-25T08:59:34.471438+0000","last_clean":"2024-04-25T08:59:34.471438+0000","last_became_active":"2024-04-25T08:59:32.460461+0000","last_became_peered":"2024-04-25T08:59:32.460461+0000","last_unstale":"2024-04-25T08:59:34.471438+0000","last_undegraded":"2024-04-25T08:59:34.471438+0000","last_fullsized":"2024-04-25T08:59:34.471438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:39.901295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471332+0000","last_change":"2024-04-25T08:59:33.494462+0000","last_active":"2024-04-25T08:59:34.471332+0000","last_peered":"2024-04-25T08:59:34.471332+0000","last_clean":"2024-04-25T08:59:34.471332+0000","last_became_active":"2024-04-25T08:59:33.494052+0000","last_became_peered":"2024-04-25T08:59:33.494052+0000","last_unstale":"2024-04-25T08:59:34.471332+0000","last_undegraded":"2024-04-25T08:59:34.471332+0000","last_fullsized":"2024-04-25T08:59:34.471332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:55.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498802+0000","last_change":"2024-04-25T08:59:32.467296+0000","last_active":"2024-04-25T08:59:33.498802+0000","last_peered":"2024-04-25T08:59:33.498802+0000","last_clean":"2024-04-25T08:59:33.498802+0000","last_became_active":"2024-04-25T08:59:32.467016+0000","last_became_peered":"2024-04-25T08:59:32.467016+0000","last_unstale":"2024-04-25T08:59:33.498802+0000","last_undegraded":"2024-04-25T08:59:33.498802+0000","last_fullsized":"2024-04-25T08:59:33.498802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:55.181008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471147+0000","last_change":"2024-04-25T08:59:33.482935+0000","last_active":"2024-04-25T08:59:34.471147+0000","last_peered":"2024-04-25T08:59:34.471147+0000","last_clean":"2024-04-25T08:59:34.471147+0000","last_became_active":"2024-04-25T08:59:33.482585+0000","last_became_peered":"2024-04-25T08:59:33.482585+0000","last_unstale":"2024-04-25T08:59:34.471147+0000","last_undegraded":"2024-04-25T08:59:34.471147+0000","last_fullsized":"2024-04-25T08:59:34.471147+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:08.837422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.503929+0000","last_change":"2024-04-25T08:59:32.465587+0000","last_active":"2024-04-25T08:59:33.503929+0000","last_peered":"2024-04-25T08:59:33.503929+0000","last_clean":"2024-04-25T08:59:33.503929+0000","last_became_active":"2024-04-25T08:59:32.465163+0000","last_became_peered":"2024-04-25T08:59:32.465163+0000","last_unstale":"2024-04-25T08:59:33.503929+0000","last_undegraded":"2024-04-25T08:59:33.503929+0000","last_fullsized":"2024-04-25T08:59:33.503929+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:43.753849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470503+0000","last_change":"2024-04-25T08:59:33.488643+0000","last_active":"2024-04-25T08:59:34.470503+0000","last_peered":"2024-04-25T08:59:34.470503+0000","last_clean":"2024-04-25T08:59:34.470503+0000","last_became_active":"2024-04-25T08:59:33.488328+0000","last_became_peered":"2024-04-25T08:59:33.488328+0000","last_unstale":"2024-04-25T08:59:34.470503+0000","last_undegraded":"2024-04-25T08:59:34.470503+0000","last_fullsized":"2024-04-25T08:59:34.470503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.159698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.503784+0000","last_change":"2024-04-25T08:59:32.465821+0000","last_active":"2024-04-25T08:59:33.503784+0000","last_peered":"2024-04-25T08:59:33.503784+0000","last_clean":"2024-04-25T08:59:33.503784+0000","last_became_active":"2024-04-25T08:59:32.465489+0000","last_became_peered":"2024-04-25T08:59:32.465489+0000","last_unstale":"2024-04-25T08:59:33.503784+0000","last_undegraded":"2024-04-25T08:59:33.503784+0000","last_fullsized":"2024-04-25T08:59:33.503784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:16.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498810+0000","last_change":"2024-04-25T08:59:32.466860+0000","last_active":"2024-04-25T08:59:33.498810+0000","last_peered":"2024-04-25T08:59:33.498810+0000","last_clean":"2024-04-25T08:59:33.498810+0000","last_became_active":"2024-04-25T08:59:32.466545+0000","last_became_peered":"2024-04-25T08:59:32.466545+0000","last_unstale":"2024-04-25T08:59:33.498810+0000","last_undegraded":"2024-04-25T08:59:33.498810+0000","last_fullsized":"2024-04-25T08:59:33.498810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:56.661725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490829+0000","last_change":"2024-04-25T08:59:33.488817+0000","last_active":"2024-04-25T08:59:33.490829+0000","last_peered":"2024-04-25T08:59:33.490829+0000","last_clean":"2024-04-25T08:59:33.490829+0000","last_became_active":"2024-04-25T08:59:33.488561+0000","last_became_peered":"2024-04-25T08:59:33.488561+0000","last_unstale":"2024-04-25T08:59:33.490829+0000","last_undegraded":"2024-04-25T08:59:33.490829+0000","last_fullsized":"2024-04-25T08:59:33.490829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:17.712953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498774+0000","last_change":"2024-04-25T08:59:32.467767+0000","last_active":"2024-04-25T08:59:33.498774+0000","last_peered":"2024-04-25T08:59:33.498774+0000","last_clean":"2024-04-25T08:59:33.498774+0000","last_became_active":"2024-04-25T08:59:32.467478+0000","last_became_peered":"2024-04-25T08:59:32.467478+0000","last_unstale":"2024-04-25T08:59:33.498774+0000","last_undegraded":"2024-04-25T08:59:33.498774+0000","last_fullsized":"2024-04-25T08:59:33.498774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:03.367165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470185+0000","last_change":"2024-04-25T08:59:33.485806+0000","last_active":"2024-04-25T08:59:34.470185+0000","last_peered":"2024-04-25T08:59:34.470185+0000","last_clean":"2024-04-25T08:59:34.470185+0000","last_became_active":"2024-04-25T08:59:33.485533+0000","last_became_peered":"2024-04-25T08:59:33.485533+0000","last_unstale":"2024-04-25T08:59:34.470185+0000","last_undegraded":"2024-04-25T08:59:34.470185+0000","last_fullsized":"2024-04-25T08:59:34.470185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:11.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.474425+0000","last_change":"2024-04-25T08:59:32.462535+0000","last_active":"2024-04-25T08:59:33.474425+0000","last_peered":"2024-04-25T08:59:33.474425+0000","last_clean":"2024-04-25T08:59:33.474425+0000","last_became_active":"2024-04-25T08:59:32.462227+0000","last_became_peered":"2024-04-25T08:59:32.462227+0000","last_unstale":"2024-04-25T08:59:33.474425+0000","last_undegraded":"2024-04-25T08:59:33.474425+0000","last_fullsized":"2024-04-25T08:59:33.474425+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:50.687897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471144+0000","last_change":"2024-04-25T08:59:33.477587+0000","last_active":"2024-04-25T08:59:34.471144+0000","last_peered":"2024-04-25T08:59:34.471144+0000","last_clean":"2024-04-25T08:59:34.471144+0000","last_became_active":"2024-04-25T08:59:33.477320+0000","last_became_peered":"2024-04-25T08:59:33.477320+0000","last_unstale":"2024-04-25T08:59:34.471144+0000","last_undegraded":"2024-04-25T08:59:34.471144+0000","last_fullsized":"2024-04-25T08:59:34.471144+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:37.797255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450640+0000","last_change":"2024-04-25T08:59:31.450640+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450640+0000","last_undegraded":"2024-04-25T08:59:31.450640+0000","last_fullsized":"2024-04-25T08:59:31.450640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471360+0000","last_change":"2024-04-25T08:59:33.480479+0000","last_active":"2024-04-25T08:59:34.471360+0000","last_peered":"2024-04-25T08:59:34.471360+0000","last_clean":"2024-04-25T08:59:34.471360+0000","last_became_active":"2024-04-25T08:59:33.479941+0000","last_became_peered":"2024-04-25T08:59:33.479941+0000","last_unstale":"2024-04-25T08:59:34.471360+0000","last_undegraded":"2024-04-25T08:59:34.471360+0000","last_fullsized":"2024-04-25T08:59:34.471360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:55.839095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471500+0000","last_change":"2024-04-25T08:59:32.462940+0000","last_active":"2024-04-25T08:59:34.471500+0000","last_peered":"2024-04-25T08:59:34.471500+0000","last_clean":"2024-04-25T08:59:34.471500+0000","last_became_active":"2024-04-25T08:59:32.462642+0000","last_became_peered":"2024-04-25T08:59:32.462642+0000","last_unstale":"2024-04-25T08:59:34.471500+0000","last_undegraded":"2024-04-25T08:59:34.471500+0000","last_fullsized":"2024-04-25T08:59:34.471500+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:25.266567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.484053+0000","last_change":"2024-04-25T08:59:33.479219+0000","last_active":"2024-04-25T08:59:33.484053+0000","last_peered":"2024-04-25T08:59:33.484053+0000","last_clean":"2024-04-25T08:59:33.484053+0000","last_became_active":"2024-04-25T08:59:33.478959+0000","last_became_peered":"2024-04-25T08:59:33.478959+0000","last_unstale":"2024-04-25T08:59:33.484053+0000","last_undegraded":"2024-04-25T08:59:33.484053+0000","last_fullsized":"2024-04-25T08:59:33.484053+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:40.979833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471033+0000","last_change":"2024-04-25T08:59:32.464153+0000","last_active":"2024-04-25T08:59:34.471033+0000","last_peered":"2024-04-25T08:59:34.471033+0000","last_clean":"2024-04-25T08:59:34.471033+0000","last_became_active":"2024-04-25T08:59:32.463856+0000","last_became_peered":"2024-04-25T08:59:32.463856+0000","last_unstale":"2024-04-25T08:59:34.471033+0000","last_undegraded":"2024-04-25T08:59:34.471033+0000","last_fullsized":"2024-04-25T08:59:34.471033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:12.560960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490857+0000","last_change":"2024-04-25T08:59:33.488687+0000","last_active":"2024-04-25T08:59:33.490857+0000","last_peered":"2024-04-25T08:59:33.490857+0000","last_clean":"2024-04-25T08:59:33.490857+0000","last_became_active":"2024-04-25T08:59:33.488397+0000","last_became_peered":"2024-04-25T08:59:33.488397+0000","last_unstale":"2024-04-25T08:59:33.490857+0000","last_undegraded":"2024-04-25T08:59:33.490857+0000","last_fullsized":"2024-04-25T08:59:33.490857+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:51.961543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470650+0000","last_change":"2024-04-25T08:59:32.459689+0000","last_active":"2024-04-25T08:59:34.470650+0000","last_peered":"2024-04-25T08:59:34.470650+0000","last_clean":"2024-04-25T08:59:34.470650+0000","last_became_active":"2024-04-25T08:59:32.459347+0000","last_became_peered":"2024-04-25T08:59:32.459347+0000","last_unstale":"2024-04-25T08:59:34.470650+0000","last_undegraded":"2024-04-25T08:59:34.470650+0000","last_fullsized":"2024-04-25T08:59:34.470650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:40.856799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.489479+0000","last_change":"2024-04-25T08:59:33.487405+0000","last_active":"2024-04-25T08:59:33.489479+0000","last_peered":"2024-04-25T08:59:33.489479+0000","last_clean":"2024-04-25T08:59:33.489479+0000","last_became_active":"2024-04-25T08:59:33.487120+0000","last_became_peered":"2024-04-25T08:59:33.487120+0000","last_unstale":"2024-04-25T08:59:33.489479+0000","last_undegraded":"2024-04-25T08:59:33.489479+0000","last_fullsized":"2024-04-25T08:59:33.489479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:01.528790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.504161+0000","last_change":"2024-04-25T08:59:32.458761+0000","last_active":"2024-04-25T08:59:33.504161+0000","last_peered":"2024-04-25T08:59:33.504161+0000","last_clean":"2024-04-25T08:59:33.504161+0000","last_became_active":"2024-04-25T08:59:32.458483+0000","last_became_peered":"2024-04-25T08:59:32.458483+0000","last_unstale":"2024-04-25T08:59:33.504161+0000","last_undegraded":"2024-04-25T08:59:33.504161+0000","last_fullsized":"2024-04-25T08:59:33.504161+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:26.519284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488291+0000","last_change":"2024-04-25T08:59:33.484209+0000","last_active":"2024-04-25T08:59:33.488291+0000","last_peered":"2024-04-25T08:59:33.488291+0000","last_clean":"2024-04-25T08:59:33.488291+0000","last_became_active":"2024-04-25T08:59:33.483823+0000","last_became_peered":"2024-04-25T08:59:33.483823+0000","last_unstale":"2024-04-25T08:59:33.488291+0000","last_undegraded":"2024-04-25T08:59:33.488291+0000","last_fullsized":"2024-04-25T08:59:33.488291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:55.574254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.448970+0000","last_change":"2024-04-25T08:59:31.448970+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.448970+0000","last_undegraded":"2024-04-25T08:59:31.448970+0000","last_fullsized":"2024-04-25T08:59:31.448970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471081+0000","last_change":"2024-04-25T08:59:33.485452+0000","last_active":"2024-04-25T08:59:34.471081+0000","last_peered":"2024-04-25T08:59:34.471081+0000","last_clean":"2024-04-25T08:59:34.471081+0000","last_became_active":"2024-04-25T08:59:33.485055+0000","last_became_peered":"2024-04-25T08:59:33.485055+0000","last_unstale":"2024-04-25T08:59:34.471081+0000","last_undegraded":"2024-04-25T08:59:34.471081+0000","last_fullsized":"2024-04-25T08:59:34.471081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:16.190343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471245+0000","last_change":"2024-04-25T08:59:32.466365+0000","last_active":"2024-04-25T08:59:34.471245+0000","last_peered":"2024-04-25T08:59:34.471245+0000","last_clean":"2024-04-25T08:59:34.471245+0000","last_became_active":"2024-04-25T08:59:32.466124+0000","last_became_peered":"2024-04-25T08:59:32.466124+0000","last_unstale":"2024-04-25T08:59:34.471245+0000","last_undegraded":"2024-04-25T08:59:34.471245+0000","last_fullsized":"2024-04-25T08:59:34.471245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:49.960557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.473234+0000","last_change":"2024-04-25T08:59:32.463142+0000","last_active":"2024-04-25T08:59:33.473234+0000","last_peered":"2024-04-25T08:59:33.473234+0000","last_clean":"2024-04-25T08:59:33.473234+0000","last_became_active":"2024-04-25T08:59:32.462585+0000","last_became_peered":"2024-04-25T08:59:32.462585+0000","last_unstale":"2024-04-25T08:59:33.473234+0000","last_undegraded":"2024-04-25T08:59:33.473234+0000","last_fullsized":"2024-04-25T08:59:33.473234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:11.928530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.504512+0000","last_change":"2024-04-25T08:59:32.464239+0000","last_active":"2024-04-25T08:59:33.504512+0000","last_peered":"2024-04-25T08:59:33.504512+0000","last_clean":"2024-04-25T08:59:33.504512+0000","last_became_active":"2024-04-25T08:59:32.463876+0000","last_became_peered":"2024-04-25T08:59:32.463876+0000","last_unstale":"2024-04-25T08:59:33.504512+0000","last_undegraded":"2024-04-25T08:59:33.504512+0000","last_fullsized":"2024-04-25T08:59:33.504512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:36.301017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470356+0000","last_change":"2024-04-25T08:59:33.482352+0000","last_active":"2024-04-25T08:59:34.470356+0000","last_peered":"2024-04-25T08:59:34.470356+0000","last_clean":"2024-04-25T08:59:34.470356+0000","last_became_active":"2024-04-25T08:59:33.482057+0000","last_became_peered":"2024-04-25T08:59:33.482057+0000","last_unstale":"2024-04-25T08:59:34.470356+0000","last_undegraded":"2024-04-25T08:59:34.470356+0000","last_fullsized":"2024-04-25T08:59:34.470356+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:09.843668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471551+0000","last_change":"2024-04-25T08:59:32.458378+0000","last_active":"2024-04-25T08:59:34.471551+0000","last_peered":"2024-04-25T08:59:34.471551+0000","last_clean":"2024-04-25T08:59:34.471551+0000","last_became_active":"2024-04-25T08:59:32.458100+0000","last_became_peered":"2024-04-25T08:59:32.458100+0000","last_unstale":"2024-04-25T08:59:34.471551+0000","last_undegraded":"2024-04-25T08:59:34.471551+0000","last_fullsized":"2024-04-25T08:59:34.471551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:34.920038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471429+0000","last_change":"2024-04-25T08:59:33.485007+0000","last_active":"2024-04-25T08:59:34.471429+0000","last_peered":"2024-04-25T08:59:34.471429+0000","last_clean":"2024-04-25T08:59:34.471429+0000","last_became_active":"2024-04-25T08:59:33.484663+0000","last_became_peered":"2024-04-25T08:59:33.484663+0000","last_unstale":"2024-04-25T08:59:34.471429+0000","last_undegraded":"2024-04-25T08:59:34.471429+0000","last_fullsized":"2024-04-25T08:59:34.471429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:12.964055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.504366+0000","last_change":"2024-04-25T08:59:32.467240+0000","last_active":"2024-04-25T08:59:33.504366+0000","last_peered":"2024-04-25T08:59:33.504366+0000","last_clean":"2024-04-25T08:59:33.504366+0000","last_became_active":"2024-04-25T08:59:32.466929+0000","last_became_peered":"2024-04-25T08:59:32.466929+0000","last_unstale":"2024-04-25T08:59:33.504366+0000","last_undegraded":"2024-04-25T08:59:33.504366+0000","last_fullsized":"2024-04-25T08:59:33.504366+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:07.831365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.483769+0000","last_change":"2024-04-25T08:59:33.480680+0000","last_active":"2024-04-25T08:59:33.483769+0000","last_peered":"2024-04-25T08:59:33.483769+0000","last_clean":"2024-04-25T08:59:33.483769+0000","last_became_active":"2024-04-25T08:59:33.480406+0000","last_became_peered":"2024-04-25T08:59:33.480406+0000","last_unstale":"2024-04-25T08:59:33.483769+0000","last_undegraded":"2024-04-25T08:59:33.483769+0000","last_fullsized":"2024-04-25T08:59:33.483769+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:26.708112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.475393+0000","last_change":"2024-04-25T08:59:32.464604+0000","last_active":"2024-04-25T08:59:33.475393+0000","last_peered":"2024-04-25T08:59:33.475393+0000","last_clean":"2024-04-25T08:59:33.475393+0000","last_became_active":"2024-04-25T08:59:32.464269+0000","last_became_peered":"2024-04-25T08:59:32.464269+0000","last_unstale":"2024-04-25T08:59:33.475393+0000","last_undegraded":"2024-04-25T08:59:33.475393+0000","last_fullsized":"2024-04-25T08:59:33.475393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:15.797707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473554+0000","last_change":"2024-04-25T08:59:33.485631+0000","last_active":"2024-04-25T08:59:34.473554+0000","last_peered":"2024-04-25T08:59:34.473554+0000","last_clean":"2024-04-25T08:59:34.473554+0000","last_became_active":"2024-04-25T08:59:33.481772+0000","last_became_peered":"2024-04-25T08:59:33.481772+0000","last_unstale":"2024-04-25T08:59:34.473554+0000","last_undegraded":"2024-04-25T08:59:34.473554+0000","last_fullsized":"2024-04-25T08:59:34.473554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:24.257915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471365+0000","last_change":"2024-04-25T08:59:32.463576+0000","last_active":"2024-04-25T08:59:34.471365+0000","last_peered":"2024-04-25T08:59:34.471365+0000","last_clean":"2024-04-25T08:59:34.471365+0000","last_became_active":"2024-04-25T08:59:32.463274+0000","last_became_peered":"2024-04-25T08:59:32.463274+0000","last_unstale":"2024-04-25T08:59:34.471365+0000","last_undegraded":"2024-04-25T08:59:34.471365+0000","last_fullsized":"2024-04-25T08:59:34.471365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:43.153641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.487750+0000","last_change":"2024-04-25T08:59:33.480755+0000","last_active":"2024-04-25T08:59:33.487750+0000","last_peered":"2024-04-25T08:59:33.487750+0000","last_clean":"2024-04-25T08:59:33.487750+0000","last_became_active":"2024-04-25T08:59:33.480461+0000","last_became_peered":"2024-04-25T08:59:33.480461+0000","last_unstale":"2024-04-25T08:59:33.487750+0000","last_undegraded":"2024-04-25T08:59:33.487750+0000","last_fullsized":"2024-04-25T08:59:33.487750+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:37.307074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473606+0000","last_change":"2024-04-25T08:59:32.461135+0000","last_active":"2024-04-25T08:59:34.473606+0000","last_peered":"2024-04-25T08:59:34.473606+0000","last_clean":"2024-04-25T08:59:34.473606+0000","last_became_active":"2024-04-25T08:59:32.460310+0000","last_became_peered":"2024-04-25T08:59:32.460310+0000","last_unstale":"2024-04-25T08:59:34.473606+0000","last_undegraded":"2024-04-25T08:59:34.473606+0000","last_fullsized":"2024-04-25T08:59:34.473606+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:42.156606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473311+0000","last_change":"2024-04-25T08:59:33.487545+0000","last_active":"2024-04-25T08:59:34.473311+0000","last_peered":"2024-04-25T08:59:34.473311+0000","last_clean":"2024-04-25T08:59:34.473311+0000","last_became_active":"2024-04-25T08:59:33.487195+0000","last_became_peered":"2024-04-25T08:59:33.487195+0000","last_unstale":"2024-04-25T08:59:34.473311+0000","last_undegraded":"2024-04-25T08:59:34.473311+0000","last_fullsized":"2024-04-25T08:59:34.473311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:51.912742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473309+0000","last_change":"2024-04-25T08:59:32.460633+0000","last_active":"2024-04-25T08:59:34.473309+0000","last_peered":"2024-04-25T08:59:34.473309+0000","last_clean":"2024-04-25T08:59:34.473309+0000","last_became_active":"2024-04-25T08:59:32.460329+0000","last_became_peered":"2024-04-25T08:59:32.460329+0000","last_unstale":"2024-04-25T08:59:34.473309+0000","last_undegraded":"2024-04-25T08:59:34.473309+0000","last_fullsized":"2024-04-25T08:59:34.473309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:53.773940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488033+0000","last_change":"2024-04-25T08:59:33.485286+0000","last_active":"2024-04-25T08:59:33.488033+0000","last_peered":"2024-04-25T08:59:33.488033+0000","last_clean":"2024-04-25T08:59:33.488033+0000","last_became_active":"2024-04-25T08:59:33.484962+0000","last_became_peered":"2024-04-25T08:59:33.484962+0000","last_unstale":"2024-04-25T08:59:33.488033+0000","last_undegraded":"2024-04-25T08:59:33.488033+0000","last_fullsized":"2024-04-25T08:59:33.488033+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:01.528790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471048+0000","last_change":"2024-04-25T08:59:32.464201+0000","last_active":"2024-04-25T08:59:34.471048+0000","last_peered":"2024-04-25T08:59:34.471048+0000","last_clean":"2024-04-25T08:59:34.471048+0000","last_became_active":"2024-04-25T08:59:32.463911+0000","last_became_peered":"2024-04-25T08:59:32.463911+0000","last_unstale":"2024-04-25T08:59:34.471048+0000","last_undegraded":"2024-04-25T08:59:34.471048+0000","last_fullsized":"2024-04-25T08:59:34.471048+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:03.978039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.487062+0000","last_change":"2024-04-25T08:59:33.481688+0000","last_active":"2024-04-25T08:59:33.487062+0000","last_peered":"2024-04-25T08:59:33.487062+0000","last_clean":"2024-04-25T08:59:33.487062+0000","last_became_active":"2024-04-25T08:59:33.481355+0000","last_became_peered":"2024-04-25T08:59:33.481355+0000","last_unstale":"2024-04-25T08:59:33.487062+0000","last_undegraded":"2024-04-25T08:59:33.487062+0000","last_fullsized":"2024-04-25T08:59:33.487062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:12.934586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450423+0000","last_change":"2024-04-25T08:59:31.450423+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450423+0000","last_undegraded":"2024-04-25T08:59:31.450423+0000","last_fullsized":"2024-04-25T08:59:31.450423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470420+0000","last_change":"2024-04-25T08:59:33.491914+0000","last_active":"2024-04-25T08:59:34.470420+0000","last_peered":"2024-04-25T08:59:34.470420+0000","last_clean":"2024-04-25T08:59:34.470420+0000","last_became_active":"2024-04-25T08:59:33.491596+0000","last_became_peered":"2024-04-25T08:59:33.491596+0000","last_unstale":"2024-04-25T08:59:34.470420+0000","last_undegraded":"2024-04-25T08:59:34.470420+0000","last_fullsized":"2024-04-25T08:59:34.470420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:04.984096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450560+0000","last_change":"2024-04-25T08:59:31.450560+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450560+0000","last_undegraded":"2024-04-25T08:59:31.450560+0000","last_fullsized":"2024-04-25T08:59:31.450560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471220+0000","last_change":"2024-04-25T08:59:33.491700+0000","last_active":"2024-04-25T08:59:34.471220+0000","last_peered":"2024-04-25T08:59:34.471220+0000","last_clean":"2024-04-25T08:59:34.471220+0000","last_became_active":"2024-04-25T08:59:33.491448+0000","last_became_peered":"2024-04-25T08:59:33.491448+0000","last_unstale":"2024-04-25T08:59:34.471220+0000","last_undegraded":"2024-04-25T08:59:34.471220+0000","last_fullsized":"2024-04-25T08:59:34.471220+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:04.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470874+0000","last_change":"2024-04-25T08:59:32.459979+0000","last_active":"2024-04-25T08:59:34.470874+0000","last_peered":"2024-04-25T08:59:34.470874+0000","last_clean":"2024-04-25T08:59:34.470874+0000","last_became_active":"2024-04-25T08:59:32.459035+0000","last_became_peered":"2024-04-25T08:59:32.459035+0000","last_unstale":"2024-04-25T08:59:34.470874+0000","last_undegraded":"2024-04-25T08:59:34.470874+0000","last_fullsized":"2024-04-25T08:59:34.470874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:29.629464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488303+0000","last_change":"2024-04-25T08:59:33.486075+0000","last_active":"2024-04-25T08:59:33.488303+0000","last_peered":"2024-04-25T08:59:33.488303+0000","last_clean":"2024-04-25T08:59:33.488303+0000","last_became_active":"2024-04-25T08:59:33.485770+0000","last_became_peered":"2024-04-25T08:59:33.485770+0000","last_unstale":"2024-04-25T08:59:33.488303+0000","last_undegraded":"2024-04-25T08:59:33.488303+0000","last_fullsized":"2024-04-25T08:59:33.488303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:59.058020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471325+0000","last_change":"2024-04-25T08:59:32.462805+0000","last_active":"2024-04-25T08:59:34.471325+0000","last_peered":"2024-04-25T08:59:34.471325+0000","last_clean":"2024-04-25T08:59:34.471325+0000","last_became_active":"2024-04-25T08:59:32.462539+0000","last_became_peered":"2024-04-25T08:59:32.462539+0000","last_unstale":"2024-04-25T08:59:34.471325+0000","last_undegraded":"2024-04-25T08:59:34.471325+0000","last_fullsized":"2024-04-25T08:59:34.471325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:44.042275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.483741+0000","last_change":"2024-04-25T08:59:33.477267+0000","last_active":"2024-04-25T08:59:33.483741+0000","last_peered":"2024-04-25T08:59:33.483741+0000","last_clean":"2024-04-25T08:59:33.483741+0000","last_became_active":"2024-04-25T08:59:33.476984+0000","last_became_peered":"2024-04-25T08:59:33.476984+0000","last_unstale":"2024-04-25T08:59:33.483741+0000","last_undegraded":"2024-04-25T08:59:33.483741+0000","last_fullsized":"2024-04-25T08:59:33.483741+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:59.058020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.475058+0000","last_change":"2024-04-25T08:59:32.465049+0000","last_active":"2024-04-25T08:59:33.475058+0000","last_peered":"2024-04-25T08:59:33.475058+0000","last_clean":"2024-04-25T08:59:33.475058+0000","last_became_active":"2024-04-25T08:59:32.464006+0000","last_became_peered":"2024-04-25T08:59:32.464006+0000","last_unstale":"2024-04-25T08:59:33.475058+0000","last_undegraded":"2024-04-25T08:59:33.475058+0000","last_fullsized":"2024-04-25T08:59:33.475058+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:00.522733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.484830+0000","last_change":"2024-04-25T08:59:33.483344+0000","last_active":"2024-04-25T08:59:33.484830+0000","last_peered":"2024-04-25T08:59:33.484830+0000","last_clean":"2024-04-25T08:59:33.484830+0000","last_became_active":"2024-04-25T08:59:33.483070+0000","last_became_peered":"2024-04-25T08:59:33.483070+0000","last_unstale":"2024-04-25T08:59:33.484830+0000","last_undegraded":"2024-04-25T08:59:33.484830+0000","last_fullsized":"2024-04-25T08:59:33.484830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:04.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.475841+0000","last_change":"2024-04-25T08:59:32.465761+0000","last_active":"2024-04-25T08:59:33.475841+0000","last_peered":"2024-04-25T08:59:33.475841+0000","last_clean":"2024-04-25T08:59:33.475841+0000","last_became_active":"2024-04-25T08:59:32.465411+0000","last_became_peered":"2024-04-25T08:59:32.465411+0000","last_unstale":"2024-04-25T08:59:33.475841+0000","last_undegraded":"2024-04-25T08:59:33.475841+0000","last_fullsized":"2024-04-25T08:59:33.475841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:50.953911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470603+0000","last_change":"2024-04-25T08:59:33.481868+0000","last_active":"2024-04-25T08:59:34.470603+0000","last_peered":"2024-04-25T08:59:34.470603+0000","last_clean":"2024-04-25T08:59:34.470603+0000","last_became_active":"2024-04-25T08:59:33.481590+0000","last_became_peered":"2024-04-25T08:59:33.481590+0000","last_unstale":"2024-04-25T08:59:34.470603+0000","last_undegraded":"2024-04-25T08:59:34.470603+0000","last_fullsized":"2024-04-25T08:59:34.470603+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:50.966614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471390+0000","last_change":"2024-04-25T08:59:32.463330+0000","last_active":"2024-04-25T08:59:34.471390+0000","last_peered":"2024-04-25T08:59:34.471390+0000","last_clean":"2024-04-25T08:59:34.471390+0000","last_became_active":"2024-04-25T08:59:32.463073+0000","last_became_peered":"2024-04-25T08:59:32.463073+0000","last_unstale":"2024-04-25T08:59:34.471390+0000","last_undegraded":"2024-04-25T08:59:34.471390+0000","last_fullsized":"2024-04-25T08:59:34.471390+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:44.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471335+0000","last_change":"2024-04-25T08:59:33.493939+0000","last_active":"2024-04-25T08:59:34.471335+0000","last_peered":"2024-04-25T08:59:34.471335+0000","last_clean":"2024-04-25T08:59:34.471335+0000","last_became_active":"2024-04-25T08:59:33.493207+0000","last_became_peered":"2024-04-25T08:59:33.493207+0000","last_unstale":"2024-04-25T08:59:34.471335+0000","last_undegraded":"2024-04-25T08:59:34.471335+0000","last_fullsized":"2024-04-25T08:59:34.471335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:51.961543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.474392+0000","last_change":"2024-04-25T08:59:32.461693+0000","last_active":"2024-04-25T08:59:33.474392+0000","last_peered":"2024-04-25T08:59:33.474392+0000","last_clean":"2024-04-25T08:59:33.474392+0000","last_became_active":"2024-04-25T08:59:32.461445+0000","last_became_peered":"2024-04-25T08:59:32.461445+0000","last_unstale":"2024-04-25T08:59:33.474392+0000","last_undegraded":"2024-04-25T08:59:33.474392+0000","last_fullsized":"2024-04-25T08:59:33.474392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:44.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470620+0000","last_change":"2024-04-25T08:59:32.465998+0000","last_active":"2024-04-25T08:59:34.470620+0000","last_peered":"2024-04-25T08:59:34.470620+0000","last_clean":"2024-04-25T08:59:34.470620+0000","last_became_active":"2024-04-25T08:59:32.465578+0000","last_became_peered":"2024-04-25T08:59:32.465578+0000","last_unstale":"2024-04-25T08:59:34.470620+0000","last_undegraded":"2024-04-25T08:59:34.470620+0000","last_fullsized":"2024-04-25T08:59:34.470620+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:16.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":289,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470812+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:59:34.470812+0000","last_peered":"2024-04-25T08:59:34.470812+0000","last_clean":"2024-04-25T08:59:34.470812+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:59:34.470812+0000","last_undegraded":"2024-04-25T08:59:34.470812+0000","last_fullsized":"2024-04-25T08:59:34.470812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1646592,"data_stored":1035444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1060864,"data_stored":445700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":446640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":445006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1060864,"data_stored":446618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":445588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1646592,"data_stored":1035408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":431956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:59:37.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2024-04-25T08:59:37.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:59:32.444052+0000', 'last_change': '2024-04-25T08:59:32.444052+0000', 'last_active': '2024-04-25T08:59:32.444052+0000', 'last_peered': '2024-04-25T08:59:32.444052+0000', 'last_clean': '2024-04-25T08:59:32.444052+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:32.444052+0000', 'last_undegraded': '2024-04-25T08:59:32.444052+0000', 'last_fullsized': '2024-04-25T08:59:32.444052+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:59:37.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2024-04-25T08:59:37.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:59:32.444052+0000', 'last_change': '2024-04-25T08:59:32.444052+0000', 'last_active': '2024-04-25T08:59:32.444052+0000', 'last_peered': '2024-04-25T08:59:32.444052+0000', 'last_clean': '2024-04-25T08:59:32.444052+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:32.444052+0000', 'last_undegraded': '2024-04-25T08:59:32.444052+0000', 'last_fullsized': '2024-04-25T08:59:32.444052+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:59:37.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2024-04-25T08:59:37.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:59:32.444052+0000', 'last_change': '2024-04-25T08:59:32.444052+0000', 'last_active': '2024-04-25T08:59:32.444052+0000', 'last_peered': '2024-04-25T08:59:32.444052+0000', 'last_clean': '2024-04-25T08:59:32.444052+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:32.444052+0000', 'last_undegraded': '2024-04-25T08:59:32.444052+0000', 'last_fullsized': '2024-04-25T08:59:32.444052+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:59:37.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2024-04-25T08:59:37.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:59:32.444052+0000', 'last_change': '2024-04-25T08:59:32.444052+0000', 'last_active': '2024-04-25T08:59:32.444052+0000', 'last_peered': '2024-04-25T08:59:32.444052+0000', 'last_clean': '2024-04-25T08:59:32.444052+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:32.444052+0000', 'last_undegraded': '2024-04-25T08:59:32.444052+0000', 'last_fullsized': '2024-04-25T08:59:32.444052+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:59:32.444052+0000', 'last_change': '2024-04-25T08:59:32.444052+0000', 'last_active': '2024-04-25T08:59:32.444052+0000', 'last_peered': '2024-04-25T08:59:32.444052+0000', 'last_clean': '2024-04-25T08:59:32.444052+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:32.444052+0000', 'last_undegraded': '2024-04-25T08:59:32.444052+0000', 'last_fullsized': '2024-04-25T08:59:32.444052+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:59:32.444052+0000', 'last_change': '2024-04-25T08:59:32.444052+0000', 'last_active': '2024-04-25T08:59:32.444052+0000', 'last_peered': '2024-04-25T08:59:32.444052+0000', 'last_clean': '2024-04-25T08:59:32.444052+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:32.444052+0000', 'last_undegraded': '2024-04-25T08:59:32.444052+0000', 'last_fullsized': '2024-04-25T08:59:32.444052+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:59:32.444052+0000', 'last_change': '2024-04-25T08:59:32.444052+0000', 'last_active': '2024-04-25T08:59:32.444052+0000', 'last_peered': '2024-04-25T08:59:32.444052+0000', 'last_clean': '2024-04-25T08:59:32.444052+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:32.444052+0000', 'last_undegraded': '2024-04-25T08:59:32.444052+0000', 'last_fullsized': '2024-04-25T08:59:32.444052+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:31.450640+0000', 'last_change': '2024-04-25T08:59:31.450640+0000', 'last_active': '2024-04-25T08:59:31.437995+0000', 'last_peered': '2024-04-25T08:59:31.437995+0000', 'last_clean': '2024-04-25T08:59:31.437995+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:31.450640+0000', 'last_undegraded': '2024-04-25T08:59:31.450640+0000', 'last_fullsized': '2024-04-25T08:59:31.450640+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:31.448970+0000', 'last_change': '2024-04-25T08:59:31.448970+0000', 'last_active': '2024-04-25T08:59:31.437995+0000', 'last_peered': '2024-04-25T08:59:31.437995+0000', 'last_clean': '2024-04-25T08:59:31.437995+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:31.448970+0000', 'last_undegraded': '2024-04-25T08:59:31.448970+0000', 'last_fullsized': '2024-04-25T08:59:31.448970+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2024-04-25T08:59:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:59:32.444052+0000', 'last_change': '2024-04-25T08:59:32.444052+0000', 'last_active': '2024-04-25T08:59:32.444052+0000', 'last_peered': '2024-04-25T08:59:32.444052+0000', 'last_clean': '2024-04-25T08:59:32.444052+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:32.444052+0000', 'last_undegraded': '2024-04-25T08:59:32.444052+0000', 'last_fullsized': '2024-04-25T08:59:32.444052+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:59:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2024-04-25T08:59:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:59:32.444052+0000', 'last_change': '2024-04-25T08:59:32.444052+0000', 'last_active': '2024-04-25T08:59:32.444052+0000', 'last_peered': '2024-04-25T08:59:32.444052+0000', 'last_clean': '2024-04-25T08:59:32.444052+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:32.444052+0000', 'last_undegraded': '2024-04-25T08:59:32.444052+0000', 'last_fullsized': '2024-04-25T08:59:32.444052+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:59:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2024-04-25T08:59:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:31.450423+0000', 'last_change': '2024-04-25T08:59:31.450423+0000', 'last_active': '2024-04-25T08:59:31.437995+0000', 'last_peered': '2024-04-25T08:59:31.437995+0000', 'last_clean': '2024-04-25T08:59:31.437995+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:31.450423+0000', 'last_undegraded': '2024-04-25T08:59:31.450423+0000', 'last_fullsized': '2024-04-25T08:59:31.450423+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:59:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2024-04-25T08:59:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:59:31.450560+0000', 'last_change': '2024-04-25T08:59:31.450560+0000', 'last_active': '2024-04-25T08:59:31.437995+0000', 'last_peered': '2024-04-25T08:59:31.437995+0000', 'last_clean': '2024-04-25T08:59:31.437995+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:31.450560+0000', 'last_undegraded': '2024-04-25T08:59:31.450560+0000', 'last_fullsized': '2024-04-25T08:59:31.450560+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:31.437995+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:59:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2024-04-25T08:59:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:59:32.444052+0000', 'last_change': '2024-04-25T08:59:32.444052+0000', 'last_active': '2024-04-25T08:59:32.444052+0000', 'last_peered': '2024-04-25T08:59:32.444052+0000', 'last_clean': '2024-04-25T08:59:32.444052+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:59:32.444052+0000', 'last_undegraded': '2024-04-25T08:59:32.444052+0000', 'last_fullsized': '2024-04-25T08:59:32.444052+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'last_clean_scrub_stamp': '2024-04-25T08:59:32.444052+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:59:37.211 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:59:37.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.327+0000 7f64e16b3640 1 Processor -- start 2024-04-25T08:59:37.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.327+0000 7f64e16b3640 1 -- start start 2024-04-25T08:59:37.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64e16b3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64dc1451d0 0x7f64dc0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64e16b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64dc06e8f0 0x7f64dc071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64e16b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64dc0cbf80 0x7f64dc0716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64e16b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64dc06e460 con 0x7f64dc0cbf80 2024-04-25T08:59:37.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64e16b3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64dc06d570 con 0x7f64dc1451d0 2024-04-25T08:59:37.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64e16b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc06d850 con 0x7f64dc06e8f0 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64db7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64dc0cbf80 0x7f64dc0716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64db7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64dc0cbf80 0x7f64dc0716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55734/0 (socket says 172.21.15.55:55734) 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64db7fe640 1 -- 172.21.15.55:0/789757113 learned_addr learned my addr 172.21.15.55:0/789757113 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64daffd640 1 --2- 172.21.15.55:0/789757113 >> v2:172.21.15.167:3300/0 conn(0x7f64dc1451d0 0x7f64dc0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64da7fc640 1 --2- 172.21.15.55:0/789757113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64dc06e8f0 0x7f64dc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64db7fe640 1 -- 172.21.15.55:0/789757113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64dc06e8f0 msgr2=0x7f64dc071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64db7fe640 1 --2- 172.21.15.55:0/789757113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64dc06e8f0 0x7f64dc071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64db7fe640 1 -- 172.21.15.55:0/789757113 >> v2:172.21.15.167:3300/0 conn(0x7f64dc1451d0 msgr2=0x7f64dc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64db7fe640 1 --2- 172.21.15.55:0/789757113 >> v2:172.21.15.167:3300/0 conn(0x7f64dc1451d0 0x7f64dc0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.328+0000 7f64db7fe640 1 -- 172.21.15.55:0/789757113 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc06db30 con 0x7f64dc0cbf80 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.329+0000 7f64db7fe640 1 --2- 172.21.15.55:0/789757113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64dc0cbf80 0x7f64dc0716d0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f64dc06bb00 tx=0x7f64cc02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b136d3904827d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.329+0000 7f64d9ffb640 1 -- 172.21.15.55:0/789757113 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc036070 con 0x7f64dc0cbf80 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.329+0000 7f64d9ffb640 1 -- 172.21.15.55:0/789757113 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc031600 con 0x7f64dc0cbf80 2024-04-25T08:59:37.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.329+0000 7f64d9ffb640 1 -- 172.21.15.55:0/789757113 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0319d0 con 0x7f64dc0cbf80 2024-04-25T08:59:37.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.330+0000 7f64e16b3640 1 -- 172.21.15.55:0/789757113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64dc0cbf80 msgr2=0x7f64dc0716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.330+0000 7f64e16b3640 1 --2- 172.21.15.55:0/789757113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64dc0cbf80 0x7f64dc0716d0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f64dc06bb00 tx=0x7f64cc02a570 comp rx=0 tx=0).stop 2024-04-25T08:59:37.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.330+0000 7f64e16b3640 1 -- 172.21.15.55:0/789757113 shutdown_connections 2024-04-25T08:59:37.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.330+0000 7f64e16b3640 1 --2- 172.21.15.55:0/789757113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64dc0cbf80 0x7f64dc0716d0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.330+0000 7f64e16b3640 1 --2- 172.21.15.55:0/789757113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64dc06e8f0 0x7f64dc071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.330+0000 7f64e16b3640 1 --2- 172.21.15.55:0/789757113 >> v2:172.21.15.167:3300/0 conn(0x7f64dc1451d0 0x7f64dc0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.330+0000 7f64e16b3640 1 -- 172.21.15.55:0/789757113 >> 172.21.15.55:0/789757113 conn(0x7f64dc06aba0 msgr2=0x7f64dc06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.330+0000 7f64e16b3640 1 -- 172.21.15.55:0/789757113 shutdown_connections 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.330+0000 7f64e16b3640 1 -- 172.21.15.55:0/789757113 wait complete. 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.331+0000 7f64e16b3640 1 Processor -- start 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.331+0000 7f64e16b3640 1 -- start start 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64e16b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64dc06e8f0 0x7f64dc0c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64e16b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64dc0cbf80 0x7f64dc15b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64e16b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1451d0 0x7f64dc0aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64e16b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc1455b0 con 0x7f64dc06e8f0 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64e16b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc06e0f0 con 0x7f64dc1451d0 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64e16b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc145730 con 0x7f64dc0cbf80 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64daffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64dc06e8f0 0x7f64dc0c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64daffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64dc06e8f0 0x7f64dc0c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55738/0 (socket says 172.21.15.55:55738) 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64daffd640 1 -- 172.21.15.55:0/50973460 learned_addr learned my addr 172.21.15.55:0/50973460 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:37.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64da7fc640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64dc0cbf80 0x7f64dc15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64db7fe640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1451d0 0x7f64dc0aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64daffd640 1 -- 172.21.15.55:0/50973460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64dc0cbf80 msgr2=0x7f64dc15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64daffd640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64dc0cbf80 0x7f64dc15b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64daffd640 1 -- 172.21.15.55:0/50973460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1451d0 msgr2=0x7f64dc0aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64daffd640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1451d0 0x7f64dc0aa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.332+0000 7f64daffd640 1 -- 172.21.15.55:0/50973460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc15b8a0 con 0x7f64dc06e8f0 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.333+0000 7f64daffd640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64dc06e8f0 0x7f64dc0c5630 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f64d400e9b0 tx=0x7f64d400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.333+0000 7f64d37fe640 1 -- 172.21.15.55:0/50973460 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4017070 con 0x7f64dc06e8f0 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.333+0000 7f64d37fe640 1 -- 172.21.15.55:0/50973460 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d400c9a0 con 0x7f64dc06e8f0 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.333+0000 7f64e16b3640 1 -- 172.21.15.55:0/50973460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc0aad20 con 0x7f64dc06e8f0 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.333+0000 7f64d37fe640 1 -- 172.21.15.55:0/50973460 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400cd90 con 0x7f64dc06e8f0 2024-04-25T08:59:37.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.333+0000 7f64e16b3640 1 -- 172.21.15.55:0/50973460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc0ab2d0 con 0x7f64dc06e8f0 2024-04-25T08:59:37.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.334+0000 7f64e16b3640 1 -- 172.21.15.55:0/50973460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc0749b0 con 0x7f64dc06e8f0 2024-04-25T08:59:37.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.334+0000 7f64d37fe640 1 -- 172.21.15.55:0/50973460 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64d401a070 con 0x7f64dc06e8f0 2024-04-25T08:59:37.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.335+0000 7f64d37fe640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64bc06b4d0 0x7f64bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.335+0000 7f64d37fe640 1 -- 172.21.15.55:0/50973460 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64d408a100 con 0x7f64dc06e8f0 2024-04-25T08:59:37.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.335+0000 7f64da7fc640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64bc06b4d0 0x7f64bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.335+0000 7f64da7fc640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64bc06b4d0 0x7f64bc06d990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0ace70 tx=0x7f64c4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:37.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.339+0000 7f64d37fe640 1 -- 172.21.15.55:0/50973460 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f64dc15b8a0 con 0x7f64dc06e8f0 2024-04-25T08:59:37.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.592+0000 7f64e16b3640 1 -- 172.21.15.55:0/50973460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f64dc0ae960 con 0x7f64dc06e8f0 2024-04-25T08:59:37.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.592+0000 7f64d37fe640 1 -- 172.21.15.55:0/50973460 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1337 (secure 0 0 0) 0x7f64d4058930 con 0x7f64dc06e8f0 2024-04-25T08:59:37.581 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:37.582 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":379,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":87,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035209,"num_in_osds":8,"osd_in_since":1714035200,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":83},{"state_name":"unknown","count":10},{"state_name":"creating+peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592744,"bytes_used":260796416,"bytes_avail":772833316864,"bytes_total":773094113280,"unknown_pgs_ratio":0.10309278219938278,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":1382,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":51,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7323}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2024-04-25T08:59:00.622658+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:59:37.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 -- 172.21.15.55:0/50973460 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64bc06b4d0 msgr2=0x7f64bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64bc06b4d0 0x7f64bc06d990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0ace70 tx=0x7f64c4009190 comp rx=0 tx=0).stop 2024-04-25T08:59:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 -- 172.21.15.55:0/50973460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64dc06e8f0 msgr2=0x7f64dc0c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64dc06e8f0 0x7f64dc0c5630 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f64d400e9b0 tx=0x7f64d400ee70 comp rx=0 tx=0).stop 2024-04-25T08:59:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 -- 172.21.15.55:0/50973460 shutdown_connections 2024-04-25T08:59:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f64bc06b4d0 0x7f64bc06d990 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1451d0 0x7f64dc0aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64dc0cbf80 0x7f64dc15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 --2- 172.21.15.55:0/50973460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64dc06e8f0 0x7f64dc0c5630 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 -- 172.21.15.55:0/50973460 >> 172.21.15.55:0/50973460 conn(0x7f64dc06aba0 msgr2=0x7f64dc0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 -- 172.21.15.55:0/50973460 shutdown_connections 2024-04-25T08:59:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.594+0000 7f64e16b3640 1 -- 172.21.15.55:0/50973460 wait complete. 2024-04-25T08:59:37.594 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:59:37.595 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:59:37.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.707+0000 7f058b6ee640 1 Processor -- start 2024-04-25T08:59:37.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.707+0000 7f058b6ee640 1 -- start start 2024-04-25T08:59:37.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f058b6ee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0584099a40 0x7f058409a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f058b6ee640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f058415bd40 0x7f05840cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f058b6ee640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05840cf910 con 0x7f0584099e20 2024-04-25T08:59:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f058b6ee640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058415cfd0 con 0x7f0584099a40 2024-04-25T08:59:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f058b6ee640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05840cfb90 con 0x7f058415bd40 2024-04-25T08:59:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f058948a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0584099a40 0x7f058409a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f0589c8b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0584099e20 0x7f058415f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55300/0 (socket says 172.21.15.55:55300) 2024-04-25T08:59:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f0589c8b640 1 -- 172.21.15.55:0/3592828862 learned_addr learned my addr 172.21.15.55:0/3592828862 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f0588c89640 1 --2- 172.21.15.55:0/3592828862 >> v2:172.21.15.167:3300/0 conn(0x7f058415bd40 0x7f05840cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f058948a640 1 -- 172.21.15.55:0/3592828862 >> v2:172.21.15.167:3300/0 conn(0x7f058415bd40 msgr2=0x7f05840cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f058948a640 1 --2- 172.21.15.55:0/3592828862 >> v2:172.21.15.167:3300/0 conn(0x7f058415bd40 0x7f05840cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f058948a640 1 -- 172.21.15.55:0/3592828862 >> v1:172.21.15.55:6789/0 conn(0x7f0584099e20 legacy=0x7f058415f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f058948a640 1 -- 172.21.15.55:0/3592828862 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058415c210 con 0x7f0584099a40 2024-04-25T08:59:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.708+0000 7f0588c89640 1 --2- 172.21.15.55:0/3592828862 >> v2:172.21.15.167:3300/0 conn(0x7f058415bd40 0x7f05840cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.709+0000 7f058948a640 1 --2- 172.21.15.55:0/3592828862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0584099a40 0x7f058409a9c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f058415c120 tx=0x7f058002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b5b55f365967cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.709+0000 7f057bfff640 1 -- 172.21.15.55:0/3592828862 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0580037070 con 0x7f0584099a40 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.709+0000 7f057bfff640 1 -- 172.21.15.55:0/3592828862 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0580032440 con 0x7f0584099a40 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.709+0000 7f057bfff640 1 -- 172.21.15.55:0/3592828862 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058002ae60 con 0x7f0584099a40 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.710+0000 7f058b6ee640 1 -- 172.21.15.55:0/3592828862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0584099a40 msgr2=0x7f058409a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.710+0000 7f058b6ee640 1 --2- 172.21.15.55:0/3592828862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0584099a40 0x7f058409a9c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f058415c120 tx=0x7f058002a110 comp rx=0 tx=0).stop 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.710+0000 7f058b6ee640 1 -- 172.21.15.55:0/3592828862 shutdown_connections 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.710+0000 7f058b6ee640 1 --2- 172.21.15.55:0/3592828862 >> v2:172.21.15.167:3300/0 conn(0x7f058415bd40 0x7f05840cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.710+0000 7f058b6ee640 1 --2- 172.21.15.55:0/3592828862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0584099a40 0x7f058409a9c0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.710+0000 7f058b6ee640 1 -- 172.21.15.55:0/3592828862 >> 172.21.15.55:0/3592828862 conn(0x7f05840b32f0 msgr2=0x7f05840b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.710+0000 7f058b6ee640 1 -- 172.21.15.55:0/3592828862 shutdown_connections 2024-04-25T08:59:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.710+0000 7f058b6ee640 1 -- 172.21.15.55:0/3592828862 wait complete. 2024-04-25T08:59:37.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.711+0000 7f058b6ee640 1 Processor -- start 2024-04-25T08:59:37.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.711+0000 7f058b6ee640 1 -- start start 2024-04-25T08:59:37.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f058b6ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0584099a40 0x7f0584158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f058b6ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0584099e20 0x7f05840c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f058b6ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f058415bd40 0x7f05840c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f058b6ee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058415cab0 con 0x7f058415bd40 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f058b6ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058415c7d0 con 0x7f0584099e20 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f058b6ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058409a250 con 0x7f0584099a40 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0589c8b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f058415bd40 0x7f05840c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0589c8b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f058415bd40 0x7f05840c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55766/0 (socket says 172.21.15.55:55766) 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0589c8b640 1 -- 172.21.15.55:0/1232413633 learned_addr learned my addr 172.21.15.55:0/1232413633 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0588c89640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0584099e20 0x7f05840c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f058948a640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0584099a40 0x7f0584158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0589c8b640 1 -- 172.21.15.55:0/1232413633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0584099a40 msgr2=0x7f0584158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0589c8b640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0584099a40 0x7f0584158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0589c8b640 1 -- 172.21.15.55:0/1232413633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0584099e20 msgr2=0x7f05840c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0589c8b640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0584099e20 0x7f05840c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0589c8b640 1 -- 172.21.15.55:0/1232413633 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05840c7b90 con 0x7f058415bd40 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f058948a640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0584099a40 0x7f0584158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0589c8b640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f058415bd40 0x7f05840c9500 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f057c00cab0 tx=0x7f057c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0579ffb640 1 -- 172.21.15.55:0/1232413633 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c017070 con 0x7f058415bd40 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0579ffb640 1 -- 172.21.15.55:0/1232413633 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c00ac30 con 0x7f058415bd40 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.712+0000 7f0579ffb640 1 -- 172.21.15.55:0/1232413633 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c012400 con 0x7f058415bd40 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.713+0000 7f058b6ee640 1 -- 172.21.15.55:0/1232413633 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05840b1f50 con 0x7f058415bd40 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.713+0000 7f058b6ee640 1 -- 172.21.15.55:0/1232413633 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05840b2510 con 0x7f058415bd40 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.714+0000 7f058b6ee640 1 -- 172.21.15.55:0/1232413633 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05840749b0 con 0x7f058415bd40 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.714+0000 7f0579ffb640 1 -- 172.21.15.55:0/1232413633 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f057c01a070 con 0x7f058415bd40 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.715+0000 7f0579ffb640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f056806b4d0 0x7f056806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.715+0000 7f0579ffb640 1 -- 172.21.15.55:0/1232413633 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f057c089d90 con 0x7f058415bd40 2024-04-25T08:59:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.715+0000 7f058948a640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f056806b4d0 0x7f056806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:37.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.715+0000 7f058948a640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f056806b4d0 0x7f056806d990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0580034000 tx=0x7f058002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:37.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.719+0000 7f0579ffb640 1 -- 172.21.15.55:0/1232413633 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05840cf910 con 0x7f058415bd40 2024-04-25T08:59:37.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.899+0000 7f058b6ee640 1 -- 172.21.15.55:0/1232413633 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f058409a570 con 0x7f056806b4d0 2024-04-25T08:59:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.905+0000 7f0579ffb640 1 -- 172.21.15.55:0/1232413633 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250343 (secure 0 0 0) 0x7f058409a570 con 0x7f056806b4d0 2024-04-25T08:59:37.898 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:37.899 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:59:37.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.908+0000 7f058b6ee640 1 -- 172.21.15.55:0/1232413633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f056806b4d0 msgr2=0x7f056806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.908+0000 7f058b6ee640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f056806b4d0 0x7f056806d990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0580034000 tx=0x7f058002e000 comp rx=0 tx=0).stop 2024-04-25T08:59:37.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.908+0000 7f058b6ee640 1 -- 172.21.15.55:0/1232413633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f058415bd40 msgr2=0x7f05840c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:37.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.908+0000 7f058b6ee640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f058415bd40 0x7f05840c9500 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f057c00cab0 tx=0x7f057c00cf70 comp rx=0 tx=0).stop 2024-04-25T08:59:37.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.908+0000 7f058b6ee640 1 -- 172.21.15.55:0/1232413633 shutdown_connections 2024-04-25T08:59:37.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.908+0000 7f058b6ee640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f056806b4d0 0x7f056806d990 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.908+0000 7f058b6ee640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f058415bd40 0x7f05840c9500 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.908+0000 7f058b6ee640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0584099e20 0x7f05840c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.908+0000 7f058b6ee640 1 --2- 172.21.15.55:0/1232413633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0584099a40 0x7f0584158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:37.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.908+0000 7f058b6ee640 1 -- 172.21.15.55:0/1232413633 >> 172.21.15.55:0/1232413633 conn(0x7f05840b32f0 msgr2=0x7f0584070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:37.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.909+0000 7f058b6ee640 1 -- 172.21.15.55:0/1232413633 shutdown_connections 2024-04-25T08:59:37.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:37.909+0000 7f058b6ee640 1 -- 172.21.15.55:0/1232413633 wait complete. 2024-04-25T08:59:37.908 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-04-25T08:59:36.629854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":197,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254684,"kb_used_data":9380,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720036,"statfs":{"total":773094113280,"available":772833316864,"internally_reserved":0,"allocated":9605120,"data_stored":4732360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.185358"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471225+0000","last_change":"2024-04-25T08:59:33.485591+0000","last_active":"2024-04-25T08:59:34.471225+0000","last_peered":"2024-04-25T08:59:34.471225+0000","last_clean":"2024-04-25T08:59:34.471225+0000","last_became_active":"2024-04-25T08:59:33.485270+0000","last_became_peered":"2024-04-25T08:59:33.485270+0000","last_unstale":"2024-04-25T08:59:34.471225+0000","last_undegraded":"2024-04-25T08:59:34.471225+0000","last_fullsized":"2024-04-25T08:59:34.471225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:44.759906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470340+0000","last_change":"2024-04-25T08:59:33.487428+0000","last_active":"2024-04-25T08:59:34.470340+0000","last_peered":"2024-04-25T08:59:34.470340+0000","last_clean":"2024-04-25T08:59:34.470340+0000","last_became_active":"2024-04-25T08:59:33.487122+0000","last_became_peered":"2024-04-25T08:59:33.487122+0000","last_unstale":"2024-04-25T08:59:34.470340+0000","last_undegraded":"2024-04-25T08:59:34.470340+0000","last_fullsized":"2024-04-25T08:59:34.470340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:40.677654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473529+0000","last_change":"2024-04-25T08:59:33.481919+0000","last_active":"2024-04-25T08:59:34.473529+0000","last_peered":"2024-04-25T08:59:34.473529+0000","last_clean":"2024-04-25T08:59:34.473529+0000","last_became_active":"2024-04-25T08:59:33.481671+0000","last_became_peered":"2024-04-25T08:59:33.481671+0000","last_unstale":"2024-04-25T08:59:34.473529+0000","last_undegraded":"2024-04-25T08:59:34.473529+0000","last_fullsized":"2024-04-25T08:59:34.473529+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:38.662705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.486809+0000","last_change":"2024-04-25T08:59:33.482528+0000","last_active":"2024-04-25T08:59:33.486809+0000","last_peered":"2024-04-25T08:59:33.486809+0000","last_clean":"2024-04-25T08:59:33.486809+0000","last_became_active":"2024-04-25T08:59:33.482248+0000","last_became_peered":"2024-04-25T08:59:33.482248+0000","last_unstale":"2024-04-25T08:59:33.486809+0000","last_undegraded":"2024-04-25T08:59:33.486809+0000","last_fullsized":"2024-04-25T08:59:33.486809+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:27.525341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490185+0000","last_change":"2024-04-25T08:59:33.489289+0000","last_active":"2024-04-25T08:59:33.490185+0000","last_peered":"2024-04-25T08:59:33.490185+0000","last_clean":"2024-04-25T08:59:33.490185+0000","last_became_active":"2024-04-25T08:59:33.488378+0000","last_became_peered":"2024-04-25T08:59:33.488378+0000","last_unstale":"2024-04-25T08:59:33.490185+0000","last_undegraded":"2024-04-25T08:59:33.490185+0000","last_fullsized":"2024-04-25T08:59:33.490185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:17.712953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473272+0000","last_change":"2024-04-25T08:59:33.486006+0000","last_active":"2024-04-25T08:59:34.473272+0000","last_peered":"2024-04-25T08:59:34.473272+0000","last_clean":"2024-04-25T08:59:34.473272+0000","last_became_active":"2024-04-25T08:59:33.485708+0000","last_became_peered":"2024-04-25T08:59:33.485708+0000","last_unstale":"2024-04-25T08:59:34.473272+0000","last_undegraded":"2024-04-25T08:59:34.473272+0000","last_fullsized":"2024-04-25T08:59:34.473272+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:05.103716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.487677+0000","last_change":"2024-04-25T08:59:33.481878+0000","last_active":"2024-04-25T08:59:33.487677+0000","last_peered":"2024-04-25T08:59:33.487677+0000","last_clean":"2024-04-25T08:59:33.487677+0000","last_became_active":"2024-04-25T08:59:33.481549+0000","last_became_peered":"2024-04-25T08:59:33.481549+0000","last_unstale":"2024-04-25T08:59:33.487677+0000","last_undegraded":"2024-04-25T08:59:33.487677+0000","last_fullsized":"2024-04-25T08:59:33.487677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:51.693954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490458+0000","last_change":"2024-04-25T08:59:33.489742+0000","last_active":"2024-04-25T08:59:33.490458+0000","last_peered":"2024-04-25T08:59:33.490458+0000","last_clean":"2024-04-25T08:59:33.490458+0000","last_became_active":"2024-04-25T08:59:33.489472+0000","last_became_peered":"2024-04-25T08:59:33.489472+0000","last_unstale":"2024-04-25T08:59:33.490458+0000","last_undegraded":"2024-04-25T08:59:33.490458+0000","last_fullsized":"2024-04-25T08:59:33.490458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:16.803764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470926+0000","last_change":"2024-04-25T08:59:33.492585+0000","last_active":"2024-04-25T08:59:34.470926+0000","last_peered":"2024-04-25T08:59:34.470926+0000","last_clean":"2024-04-25T08:59:34.470926+0000","last_became_active":"2024-04-25T08:59:33.492032+0000","last_became_peered":"2024-04-25T08:59:33.492032+0000","last_unstale":"2024-04-25T08:59:34.470926+0000","last_undegraded":"2024-04-25T08:59:34.470926+0000","last_fullsized":"2024-04-25T08:59:34.470926+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:16.803764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470677+0000","last_change":"2024-04-25T08:59:33.492662+0000","last_active":"2024-04-25T08:59:34.470677+0000","last_peered":"2024-04-25T08:59:34.470677+0000","last_clean":"2024-04-25T08:59:34.470677+0000","last_became_active":"2024-04-25T08:59:33.492153+0000","last_became_peered":"2024-04-25T08:59:33.492153+0000","last_unstale":"2024-04-25T08:59:34.470677+0000","last_undegraded":"2024-04-25T08:59:34.470677+0000","last_fullsized":"2024-04-25T08:59:34.470677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:01.528790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470906+0000","last_change":"2024-04-25T08:59:33.480997+0000","last_active":"2024-04-25T08:59:34.470906+0000","last_peered":"2024-04-25T08:59:34.470906+0000","last_clean":"2024-04-25T08:59:34.470906+0000","last_became_active":"2024-04-25T08:59:33.480666+0000","last_became_peered":"2024-04-25T08:59:33.480666+0000","last_unstale":"2024-04-25T08:59:34.470906+0000","last_undegraded":"2024-04-25T08:59:34.470906+0000","last_fullsized":"2024-04-25T08:59:34.470906+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:16.088847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473509+0000","last_change":"2024-04-25T08:59:33.486549+0000","last_active":"2024-04-25T08:59:34.473509+0000","last_peered":"2024-04-25T08:59:34.473509+0000","last_clean":"2024-04-25T08:59:34.473509+0000","last_became_active":"2024-04-25T08:59:33.486014+0000","last_became_peered":"2024-04-25T08:59:33.486014+0000","last_unstale":"2024-04-25T08:59:34.473509+0000","last_undegraded":"2024-04-25T08:59:34.473509+0000","last_fullsized":"2024-04-25T08:59:34.473509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:16.544816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471226+0000","last_change":"2024-04-25T08:59:33.480745+0000","last_active":"2024-04-25T08:59:34.471226+0000","last_peered":"2024-04-25T08:59:34.471226+0000","last_clean":"2024-04-25T08:59:34.471226+0000","last_became_active":"2024-04-25T08:59:33.480458+0000","last_became_peered":"2024-04-25T08:59:33.480458+0000","last_unstale":"2024-04-25T08:59:34.471226+0000","last_undegraded":"2024-04-25T08:59:34.471226+0000","last_fullsized":"2024-04-25T08:59:34.471226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:39.831860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488373+0000","last_change":"2024-04-25T08:59:33.486493+0000","last_active":"2024-04-25T08:59:33.488373+0000","last_peered":"2024-04-25T08:59:33.488373+0000","last_clean":"2024-04-25T08:59:33.488373+0000","last_became_active":"2024-04-25T08:59:33.485837+0000","last_became_peered":"2024-04-25T08:59:33.485837+0000","last_unstale":"2024-04-25T08:59:33.488373+0000","last_undegraded":"2024-04-25T08:59:33.488373+0000","last_fullsized":"2024-04-25T08:59:33.488373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:40.979833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498034+0000","last_change":"2024-04-25T08:59:33.489778+0000","last_active":"2024-04-25T08:59:33.498034+0000","last_peered":"2024-04-25T08:59:33.498034+0000","last_clean":"2024-04-25T08:59:33.498034+0000","last_became_active":"2024-04-25T08:59:33.489514+0000","last_became_peered":"2024-04-25T08:59:33.489514+0000","last_unstale":"2024-04-25T08:59:33.498034+0000","last_undegraded":"2024-04-25T08:59:33.498034+0000","last_fullsized":"2024-04-25T08:59:33.498034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:16.803764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473762+0000","last_change":"2024-04-25T08:59:33.495035+0000","last_active":"2024-04-25T08:59:34.473762+0000","last_peered":"2024-04-25T08:59:34.473762+0000","last_clean":"2024-04-25T08:59:34.473762+0000","last_became_active":"2024-04-25T08:59:33.494739+0000","last_became_peered":"2024-04-25T08:59:33.494739+0000","last_unstale":"2024-04-25T08:59:34.473762+0000","last_undegraded":"2024-04-25T08:59:34.473762+0000","last_fullsized":"2024-04-25T08:59:34.473762+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:07.192195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488336+0000","last_change":"2024-04-25T08:59:33.484405+0000","last_active":"2024-04-25T08:59:33.488336+0000","last_peered":"2024-04-25T08:59:33.488336+0000","last_clean":"2024-04-25T08:59:33.488336+0000","last_became_active":"2024-04-25T08:59:33.482624+0000","last_became_peered":"2024-04-25T08:59:33.482624+0000","last_unstale":"2024-04-25T08:59:33.488336+0000","last_undegraded":"2024-04-25T08:59:33.488336+0000","last_fullsized":"2024-04-25T08:59:33.488336+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:55.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473597+0000","last_change":"2024-04-25T08:59:33.485682+0000","last_active":"2024-04-25T08:59:34.473597+0000","last_peered":"2024-04-25T08:59:34.473597+0000","last_clean":"2024-04-25T08:59:34.473597+0000","last_became_active":"2024-04-25T08:59:33.485410+0000","last_became_peered":"2024-04-25T08:59:33.485410+0000","last_unstale":"2024-04-25T08:59:34.473597+0000","last_undegraded":"2024-04-25T08:59:34.473597+0000","last_fullsized":"2024-04-25T08:59:34.473597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:46.869053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473472+0000","last_change":"2024-04-25T08:59:33.485903+0000","last_active":"2024-04-25T08:59:34.473472+0000","last_peered":"2024-04-25T08:59:34.473472+0000","last_clean":"2024-04-25T08:59:34.473472+0000","last_became_active":"2024-04-25T08:59:33.485144+0000","last_became_peered":"2024-04-25T08:59:33.485144+0000","last_unstale":"2024-04-25T08:59:34.473472+0000","last_undegraded":"2024-04-25T08:59:34.473472+0000","last_fullsized":"2024-04-25T08:59:34.473472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:00.891178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471295+0000","last_change":"2024-04-25T08:59:33.494003+0000","last_active":"2024-04-25T08:59:34.471295+0000","last_peered":"2024-04-25T08:59:34.471295+0000","last_clean":"2024-04-25T08:59:34.471295+0000","last_became_active":"2024-04-25T08:59:33.493533+0000","last_became_peered":"2024-04-25T08:59:33.493533+0000","last_unstale":"2024-04-25T08:59:34.471295+0000","last_undegraded":"2024-04-25T08:59:34.471295+0000","last_fullsized":"2024-04-25T08:59:34.471295+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:55.574254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473277+0000","last_change":"2024-04-25T08:59:33.486174+0000","last_active":"2024-04-25T08:59:34.473277+0000","last_peered":"2024-04-25T08:59:34.473277+0000","last_clean":"2024-04-25T08:59:34.473277+0000","last_became_active":"2024-04-25T08:59:33.485376+0000","last_became_peered":"2024-04-25T08:59:33.485376+0000","last_unstale":"2024-04-25T08:59:34.473277+0000","last_undegraded":"2024-04-25T08:59:34.473277+0000","last_fullsized":"2024-04-25T08:59:34.473277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:23.321835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470675+0000","last_change":"2024-04-25T08:59:33.481229+0000","last_active":"2024-04-25T08:59:34.470675+0000","last_peered":"2024-04-25T08:59:34.470675+0000","last_clean":"2024-04-25T08:59:34.470675+0000","last_became_active":"2024-04-25T08:59:33.480697+0000","last_became_peered":"2024-04-25T08:59:33.480697+0000","last_unstale":"2024-04-25T08:59:34.470675+0000","last_undegraded":"2024-04-25T08:59:34.470675+0000","last_fullsized":"2024-04-25T08:59:34.470675+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:18.281359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.480830+0000","last_change":"2024-04-25T08:59:33.478198+0000","last_active":"2024-04-25T08:59:33.480830+0000","last_peered":"2024-04-25T08:59:33.480830+0000","last_clean":"2024-04-25T08:59:33.480830+0000","last_became_active":"2024-04-25T08:59:33.477907+0000","last_became_peered":"2024-04-25T08:59:33.477907+0000","last_unstale":"2024-04-25T08:59:33.480830+0000","last_undegraded":"2024-04-25T08:59:33.480830+0000","last_fullsized":"2024-04-25T08:59:33.480830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:12.092783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470873+0000","last_change":"2024-04-25T08:59:33.486375+0000","last_active":"2024-04-25T08:59:34.470873+0000","last_peered":"2024-04-25T08:59:34.470873+0000","last_clean":"2024-04-25T08:59:34.470873+0000","last_became_active":"2024-04-25T08:59:33.484674+0000","last_became_peered":"2024-04-25T08:59:33.484674+0000","last_unstale":"2024-04-25T08:59:34.470873+0000","last_undegraded":"2024-04-25T08:59:34.470873+0000","last_fullsized":"2024-04-25T08:59:34.470873+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:17.712953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488888+0000","last_change":"2024-04-25T08:59:33.486570+0000","last_active":"2024-04-25T08:59:33.488888+0000","last_peered":"2024-04-25T08:59:33.488888+0000","last_clean":"2024-04-25T08:59:33.488888+0000","last_became_active":"2024-04-25T08:59:33.486194+0000","last_became_peered":"2024-04-25T08:59:33.486194+0000","last_unstale":"2024-04-25T08:59:33.488888+0000","last_undegraded":"2024-04-25T08:59:33.488888+0000","last_fullsized":"2024-04-25T08:59:33.488888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:37.307074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470424+0000","last_change":"2024-04-25T08:59:33.484769+0000","last_active":"2024-04-25T08:59:34.470424+0000","last_peered":"2024-04-25T08:59:34.470424+0000","last_clean":"2024-04-25T08:59:34.470424+0000","last_became_active":"2024-04-25T08:59:33.484449+0000","last_became_peered":"2024-04-25T08:59:33.484449+0000","last_unstale":"2024-04-25T08:59:34.470424+0000","last_undegraded":"2024-04-25T08:59:34.470424+0000","last_fullsized":"2024-04-25T08:59:34.470424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:51.693954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.489495+0000","last_change":"2024-04-25T08:59:33.486917+0000","last_active":"2024-04-25T08:59:33.489495+0000","last_peered":"2024-04-25T08:59:33.489495+0000","last_clean":"2024-04-25T08:59:33.489495+0000","last_became_active":"2024-04-25T08:59:33.486279+0000","last_became_peered":"2024-04-25T08:59:33.486279+0000","last_unstale":"2024-04-25T08:59:33.489495+0000","last_undegraded":"2024-04-25T08:59:33.489495+0000","last_fullsized":"2024-04-25T08:59:33.489495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:51.693954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471438+0000","last_change":"2024-04-25T08:59:32.461674+0000","last_active":"2024-04-25T08:59:34.471438+0000","last_peered":"2024-04-25T08:59:34.471438+0000","last_clean":"2024-04-25T08:59:34.471438+0000","last_became_active":"2024-04-25T08:59:32.460461+0000","last_became_peered":"2024-04-25T08:59:32.460461+0000","last_unstale":"2024-04-25T08:59:34.471438+0000","last_undegraded":"2024-04-25T08:59:34.471438+0000","last_fullsized":"2024-04-25T08:59:34.471438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:39.901295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471332+0000","last_change":"2024-04-25T08:59:33.494462+0000","last_active":"2024-04-25T08:59:34.471332+0000","last_peered":"2024-04-25T08:59:34.471332+0000","last_clean":"2024-04-25T08:59:34.471332+0000","last_became_active":"2024-04-25T08:59:33.494052+0000","last_became_peered":"2024-04-25T08:59:33.494052+0000","last_unstale":"2024-04-25T08:59:34.471332+0000","last_undegraded":"2024-04-25T08:59:34.471332+0000","last_fullsized":"2024-04-25T08:59:34.471332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:55.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498802+0000","last_change":"2024-04-25T08:59:32.467296+0000","last_active":"2024-04-25T08:59:33.498802+0000","last_peered":"2024-04-25T08:59:33.498802+0000","last_clean":"2024-04-25T08:59:33.498802+0000","last_became_active":"2024-04-25T08:59:32.467016+0000","last_became_peered":"2024-04-25T08:59:32.467016+0000","last_unstale":"2024-04-25T08:59:33.498802+0000","last_undegraded":"2024-04-25T08:59:33.498802+0000","last_fullsized":"2024-04-25T08:59:33.498802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:55.181008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471147+0000","last_change":"2024-04-25T08:59:33.482935+0000","last_active":"2024-04-25T08:59:34.471147+0000","last_peered":"2024-04-25T08:59:34.471147+0000","last_clean":"2024-04-25T08:59:34.471147+0000","last_became_active":"2024-04-25T08:59:33.482585+0000","last_became_peered":"2024-04-25T08:59:33.482585+0000","last_unstale":"2024-04-25T08:59:34.471147+0000","last_undegraded":"2024-04-25T08:59:34.471147+0000","last_fullsized":"2024-04-25T08:59:34.471147+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:08.837422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.503929+0000","last_change":"2024-04-25T08:59:32.465587+0000","last_active":"2024-04-25T08:59:33.503929+0000","last_peered":"2024-04-25T08:59:33.503929+0000","last_clean":"2024-04-25T08:59:33.503929+0000","last_became_active":"2024-04-25T08:59:32.465163+0000","last_became_peered":"2024-04-25T08:59:32.465163+0000","last_unstale":"2024-04-25T08:59:33.503929+0000","last_undegraded":"2024-04-25T08:59:33.503929+0000","last_fullsized":"2024-04-25T08:59:33.503929+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:43.753849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470503+0000","last_change":"2024-04-25T08:59:33.488643+0000","last_active":"2024-04-25T08:59:34.470503+0000","last_peered":"2024-04-25T08:59:34.470503+0000","last_clean":"2024-04-25T08:59:34.470503+0000","last_became_active":"2024-04-25T08:59:33.488328+0000","last_became_peered":"2024-04-25T08:59:33.488328+0000","last_unstale":"2024-04-25T08:59:34.470503+0000","last_undegraded":"2024-04-25T08:59:34.470503+0000","last_fullsized":"2024-04-25T08:59:34.470503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.159698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.503784+0000","last_change":"2024-04-25T08:59:32.465821+0000","last_active":"2024-04-25T08:59:33.503784+0000","last_peered":"2024-04-25T08:59:33.503784+0000","last_clean":"2024-04-25T08:59:33.503784+0000","last_became_active":"2024-04-25T08:59:32.465489+0000","last_became_peered":"2024-04-25T08:59:32.465489+0000","last_unstale":"2024-04-25T08:59:33.503784+0000","last_undegraded":"2024-04-25T08:59:33.503784+0000","last_fullsized":"2024-04-25T08:59:33.503784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:16.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498810+0000","last_change":"2024-04-25T08:59:32.466860+0000","last_active":"2024-04-25T08:59:33.498810+0000","last_peered":"2024-04-25T08:59:33.498810+0000","last_clean":"2024-04-25T08:59:33.498810+0000","last_became_active":"2024-04-25T08:59:32.466545+0000","last_became_peered":"2024-04-25T08:59:32.466545+0000","last_unstale":"2024-04-25T08:59:33.498810+0000","last_undegraded":"2024-04-25T08:59:33.498810+0000","last_fullsized":"2024-04-25T08:59:33.498810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:56.661725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490829+0000","last_change":"2024-04-25T08:59:33.488817+0000","last_active":"2024-04-25T08:59:33.490829+0000","last_peered":"2024-04-25T08:59:33.490829+0000","last_clean":"2024-04-25T08:59:33.490829+0000","last_became_active":"2024-04-25T08:59:33.488561+0000","last_became_peered":"2024-04-25T08:59:33.488561+0000","last_unstale":"2024-04-25T08:59:33.490829+0000","last_undegraded":"2024-04-25T08:59:33.490829+0000","last_fullsized":"2024-04-25T08:59:33.490829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:17.712953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.498774+0000","last_change":"2024-04-25T08:59:32.467767+0000","last_active":"2024-04-25T08:59:33.498774+0000","last_peered":"2024-04-25T08:59:33.498774+0000","last_clean":"2024-04-25T08:59:33.498774+0000","last_became_active":"2024-04-25T08:59:32.467478+0000","last_became_peered":"2024-04-25T08:59:32.467478+0000","last_unstale":"2024-04-25T08:59:33.498774+0000","last_undegraded":"2024-04-25T08:59:33.498774+0000","last_fullsized":"2024-04-25T08:59:33.498774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:03.367165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470185+0000","last_change":"2024-04-25T08:59:33.485806+0000","last_active":"2024-04-25T08:59:34.470185+0000","last_peered":"2024-04-25T08:59:34.470185+0000","last_clean":"2024-04-25T08:59:34.470185+0000","last_became_active":"2024-04-25T08:59:33.485533+0000","last_became_peered":"2024-04-25T08:59:33.485533+0000","last_unstale":"2024-04-25T08:59:34.470185+0000","last_undegraded":"2024-04-25T08:59:34.470185+0000","last_fullsized":"2024-04-25T08:59:34.470185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:11.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.474425+0000","last_change":"2024-04-25T08:59:32.462535+0000","last_active":"2024-04-25T08:59:33.474425+0000","last_peered":"2024-04-25T08:59:33.474425+0000","last_clean":"2024-04-25T08:59:33.474425+0000","last_became_active":"2024-04-25T08:59:32.462227+0000","last_became_peered":"2024-04-25T08:59:32.462227+0000","last_unstale":"2024-04-25T08:59:33.474425+0000","last_undegraded":"2024-04-25T08:59:33.474425+0000","last_fullsized":"2024-04-25T08:59:33.474425+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:50.687897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471144+0000","last_change":"2024-04-25T08:59:33.477587+0000","last_active":"2024-04-25T08:59:34.471144+0000","last_peered":"2024-04-25T08:59:34.471144+0000","last_clean":"2024-04-25T08:59:34.471144+0000","last_became_active":"2024-04-25T08:59:33.477320+0000","last_became_peered":"2024-04-25T08:59:33.477320+0000","last_unstale":"2024-04-25T08:59:34.471144+0000","last_undegraded":"2024-04-25T08:59:34.471144+0000","last_fullsized":"2024-04-25T08:59:34.471144+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:37.797255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450640+0000","last_change":"2024-04-25T08:59:31.450640+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450640+0000","last_undegraded":"2024-04-25T08:59:31.450640+0000","last_fullsized":"2024-04-25T08:59:31.450640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471360+0000","last_change":"2024-04-25T08:59:33.480479+0000","last_active":"2024-04-25T08:59:34.471360+0000","last_peered":"2024-04-25T08:59:34.471360+0000","last_clean":"2024-04-25T08:59:34.471360+0000","last_became_active":"2024-04-25T08:59:33.479941+0000","last_became_peered":"2024-04-25T08:59:33.479941+0000","last_unstale":"2024-04-25T08:59:34.471360+0000","last_undegraded":"2024-04-25T08:59:34.471360+0000","last_fullsized":"2024-04-25T08:59:34.471360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:55.839095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471500+0000","last_change":"2024-04-25T08:59:32.462940+0000","last_active":"2024-04-25T08:59:34.471500+0000","last_peered":"2024-04-25T08:59:34.471500+0000","last_clean":"2024-04-25T08:59:34.471500+0000","last_became_active":"2024-04-25T08:59:32.462642+0000","last_became_peered":"2024-04-25T08:59:32.462642+0000","last_unstale":"2024-04-25T08:59:34.471500+0000","last_undegraded":"2024-04-25T08:59:34.471500+0000","last_fullsized":"2024-04-25T08:59:34.471500+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:25.266567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.484053+0000","last_change":"2024-04-25T08:59:33.479219+0000","last_active":"2024-04-25T08:59:33.484053+0000","last_peered":"2024-04-25T08:59:33.484053+0000","last_clean":"2024-04-25T08:59:33.484053+0000","last_became_active":"2024-04-25T08:59:33.478959+0000","last_became_peered":"2024-04-25T08:59:33.478959+0000","last_unstale":"2024-04-25T08:59:33.484053+0000","last_undegraded":"2024-04-25T08:59:33.484053+0000","last_fullsized":"2024-04-25T08:59:33.484053+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:40.979833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471033+0000","last_change":"2024-04-25T08:59:32.464153+0000","last_active":"2024-04-25T08:59:34.471033+0000","last_peered":"2024-04-25T08:59:34.471033+0000","last_clean":"2024-04-25T08:59:34.471033+0000","last_became_active":"2024-04-25T08:59:32.463856+0000","last_became_peered":"2024-04-25T08:59:32.463856+0000","last_unstale":"2024-04-25T08:59:34.471033+0000","last_undegraded":"2024-04-25T08:59:34.471033+0000","last_fullsized":"2024-04-25T08:59:34.471033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:12.560960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.490857+0000","last_change":"2024-04-25T08:59:33.488687+0000","last_active":"2024-04-25T08:59:33.490857+0000","last_peered":"2024-04-25T08:59:33.490857+0000","last_clean":"2024-04-25T08:59:33.490857+0000","last_became_active":"2024-04-25T08:59:33.488397+0000","last_became_peered":"2024-04-25T08:59:33.488397+0000","last_unstale":"2024-04-25T08:59:33.490857+0000","last_undegraded":"2024-04-25T08:59:33.490857+0000","last_fullsized":"2024-04-25T08:59:33.490857+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:51.961543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470650+0000","last_change":"2024-04-25T08:59:32.459689+0000","last_active":"2024-04-25T08:59:34.470650+0000","last_peered":"2024-04-25T08:59:34.470650+0000","last_clean":"2024-04-25T08:59:34.470650+0000","last_became_active":"2024-04-25T08:59:32.459347+0000","last_became_peered":"2024-04-25T08:59:32.459347+0000","last_unstale":"2024-04-25T08:59:34.470650+0000","last_undegraded":"2024-04-25T08:59:34.470650+0000","last_fullsized":"2024-04-25T08:59:34.470650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:40.856799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.489479+0000","last_change":"2024-04-25T08:59:33.487405+0000","last_active":"2024-04-25T08:59:33.489479+0000","last_peered":"2024-04-25T08:59:33.489479+0000","last_clean":"2024-04-25T08:59:33.489479+0000","last_became_active":"2024-04-25T08:59:33.487120+0000","last_became_peered":"2024-04-25T08:59:33.487120+0000","last_unstale":"2024-04-25T08:59:33.489479+0000","last_undegraded":"2024-04-25T08:59:33.489479+0000","last_fullsized":"2024-04-25T08:59:33.489479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:01.528790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.504161+0000","last_change":"2024-04-25T08:59:32.458761+0000","last_active":"2024-04-25T08:59:33.504161+0000","last_peered":"2024-04-25T08:59:33.504161+0000","last_clean":"2024-04-25T08:59:33.504161+0000","last_became_active":"2024-04-25T08:59:32.458483+0000","last_became_peered":"2024-04-25T08:59:32.458483+0000","last_unstale":"2024-04-25T08:59:33.504161+0000","last_undegraded":"2024-04-25T08:59:33.504161+0000","last_fullsized":"2024-04-25T08:59:33.504161+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:26.519284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488291+0000","last_change":"2024-04-25T08:59:33.484209+0000","last_active":"2024-04-25T08:59:33.488291+0000","last_peered":"2024-04-25T08:59:33.488291+0000","last_clean":"2024-04-25T08:59:33.488291+0000","last_became_active":"2024-04-25T08:59:33.483823+0000","last_became_peered":"2024-04-25T08:59:33.483823+0000","last_unstale":"2024-04-25T08:59:33.488291+0000","last_undegraded":"2024-04-25T08:59:33.488291+0000","last_fullsized":"2024-04-25T08:59:33.488291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:55.574254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.448970+0000","last_change":"2024-04-25T08:59:31.448970+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.448970+0000","last_undegraded":"2024-04-25T08:59:31.448970+0000","last_fullsized":"2024-04-25T08:59:31.448970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471081+0000","last_change":"2024-04-25T08:59:33.485452+0000","last_active":"2024-04-25T08:59:34.471081+0000","last_peered":"2024-04-25T08:59:34.471081+0000","last_clean":"2024-04-25T08:59:34.471081+0000","last_became_active":"2024-04-25T08:59:33.485055+0000","last_became_peered":"2024-04-25T08:59:33.485055+0000","last_unstale":"2024-04-25T08:59:34.471081+0000","last_undegraded":"2024-04-25T08:59:34.471081+0000","last_fullsized":"2024-04-25T08:59:34.471081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:16.190343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471245+0000","last_change":"2024-04-25T08:59:32.466365+0000","last_active":"2024-04-25T08:59:34.471245+0000","last_peered":"2024-04-25T08:59:34.471245+0000","last_clean":"2024-04-25T08:59:34.471245+0000","last_became_active":"2024-04-25T08:59:32.466124+0000","last_became_peered":"2024-04-25T08:59:32.466124+0000","last_unstale":"2024-04-25T08:59:34.471245+0000","last_undegraded":"2024-04-25T08:59:34.471245+0000","last_fullsized":"2024-04-25T08:59:34.471245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:49.960557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.473234+0000","last_change":"2024-04-25T08:59:32.463142+0000","last_active":"2024-04-25T08:59:33.473234+0000","last_peered":"2024-04-25T08:59:33.473234+0000","last_clean":"2024-04-25T08:59:33.473234+0000","last_became_active":"2024-04-25T08:59:32.462585+0000","last_became_peered":"2024-04-25T08:59:32.462585+0000","last_unstale":"2024-04-25T08:59:33.473234+0000","last_undegraded":"2024-04-25T08:59:33.473234+0000","last_fullsized":"2024-04-25T08:59:33.473234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:11.928530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.504512+0000","last_change":"2024-04-25T08:59:32.464239+0000","last_active":"2024-04-25T08:59:33.504512+0000","last_peered":"2024-04-25T08:59:33.504512+0000","last_clean":"2024-04-25T08:59:33.504512+0000","last_became_active":"2024-04-25T08:59:32.463876+0000","last_became_peered":"2024-04-25T08:59:32.463876+0000","last_unstale":"2024-04-25T08:59:33.504512+0000","last_undegraded":"2024-04-25T08:59:33.504512+0000","last_fullsized":"2024-04-25T08:59:33.504512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:36.301017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470356+0000","last_change":"2024-04-25T08:59:33.482352+0000","last_active":"2024-04-25T08:59:34.470356+0000","last_peered":"2024-04-25T08:59:34.470356+0000","last_clean":"2024-04-25T08:59:34.470356+0000","last_became_active":"2024-04-25T08:59:33.482057+0000","last_became_peered":"2024-04-25T08:59:33.482057+0000","last_unstale":"2024-04-25T08:59:34.470356+0000","last_undegraded":"2024-04-25T08:59:34.470356+0000","last_fullsized":"2024-04-25T08:59:34.470356+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:09.843668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471551+0000","last_change":"2024-04-25T08:59:32.458378+0000","last_active":"2024-04-25T08:59:34.471551+0000","last_peered":"2024-04-25T08:59:34.471551+0000","last_clean":"2024-04-25T08:59:34.471551+0000","last_became_active":"2024-04-25T08:59:32.458100+0000","last_became_peered":"2024-04-25T08:59:32.458100+0000","last_unstale":"2024-04-25T08:59:34.471551+0000","last_undegraded":"2024-04-25T08:59:34.471551+0000","last_fullsized":"2024-04-25T08:59:34.471551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:34.920038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471429+0000","last_change":"2024-04-25T08:59:33.485007+0000","last_active":"2024-04-25T08:59:34.471429+0000","last_peered":"2024-04-25T08:59:34.471429+0000","last_clean":"2024-04-25T08:59:34.471429+0000","last_became_active":"2024-04-25T08:59:33.484663+0000","last_became_peered":"2024-04-25T08:59:33.484663+0000","last_unstale":"2024-04-25T08:59:34.471429+0000","last_undegraded":"2024-04-25T08:59:34.471429+0000","last_fullsized":"2024-04-25T08:59:34.471429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:12.964055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.504366+0000","last_change":"2024-04-25T08:59:32.467240+0000","last_active":"2024-04-25T08:59:33.504366+0000","last_peered":"2024-04-25T08:59:33.504366+0000","last_clean":"2024-04-25T08:59:33.504366+0000","last_became_active":"2024-04-25T08:59:32.466929+0000","last_became_peered":"2024-04-25T08:59:32.466929+0000","last_unstale":"2024-04-25T08:59:33.504366+0000","last_undegraded":"2024-04-25T08:59:33.504366+0000","last_fullsized":"2024-04-25T08:59:33.504366+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:07.831365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.483769+0000","last_change":"2024-04-25T08:59:33.480680+0000","last_active":"2024-04-25T08:59:33.483769+0000","last_peered":"2024-04-25T08:59:33.483769+0000","last_clean":"2024-04-25T08:59:33.483769+0000","last_became_active":"2024-04-25T08:59:33.480406+0000","last_became_peered":"2024-04-25T08:59:33.480406+0000","last_unstale":"2024-04-25T08:59:33.483769+0000","last_undegraded":"2024-04-25T08:59:33.483769+0000","last_fullsized":"2024-04-25T08:59:33.483769+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:26.708112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.475393+0000","last_change":"2024-04-25T08:59:32.464604+0000","last_active":"2024-04-25T08:59:33.475393+0000","last_peered":"2024-04-25T08:59:33.475393+0000","last_clean":"2024-04-25T08:59:33.475393+0000","last_became_active":"2024-04-25T08:59:32.464269+0000","last_became_peered":"2024-04-25T08:59:32.464269+0000","last_unstale":"2024-04-25T08:59:33.475393+0000","last_undegraded":"2024-04-25T08:59:33.475393+0000","last_fullsized":"2024-04-25T08:59:33.475393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:15.797707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473554+0000","last_change":"2024-04-25T08:59:33.485631+0000","last_active":"2024-04-25T08:59:34.473554+0000","last_peered":"2024-04-25T08:59:34.473554+0000","last_clean":"2024-04-25T08:59:34.473554+0000","last_became_active":"2024-04-25T08:59:33.481772+0000","last_became_peered":"2024-04-25T08:59:33.481772+0000","last_unstale":"2024-04-25T08:59:34.473554+0000","last_undegraded":"2024-04-25T08:59:34.473554+0000","last_fullsized":"2024-04-25T08:59:34.473554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:24.257915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471365+0000","last_change":"2024-04-25T08:59:32.463576+0000","last_active":"2024-04-25T08:59:34.471365+0000","last_peered":"2024-04-25T08:59:34.471365+0000","last_clean":"2024-04-25T08:59:34.471365+0000","last_became_active":"2024-04-25T08:59:32.463274+0000","last_became_peered":"2024-04-25T08:59:32.463274+0000","last_unstale":"2024-04-25T08:59:34.471365+0000","last_undegraded":"2024-04-25T08:59:34.471365+0000","last_fullsized":"2024-04-25T08:59:34.471365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:43.153641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.487750+0000","last_change":"2024-04-25T08:59:33.480755+0000","last_active":"2024-04-25T08:59:33.487750+0000","last_peered":"2024-04-25T08:59:33.487750+0000","last_clean":"2024-04-25T08:59:33.487750+0000","last_became_active":"2024-04-25T08:59:33.480461+0000","last_became_peered":"2024-04-25T08:59:33.480461+0000","last_unstale":"2024-04-25T08:59:33.487750+0000","last_undegraded":"2024-04-25T08:59:33.487750+0000","last_fullsized":"2024-04-25T08:59:33.487750+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:37.307074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473606+0000","last_change":"2024-04-25T08:59:32.461135+0000","last_active":"2024-04-25T08:59:34.473606+0000","last_peered":"2024-04-25T08:59:34.473606+0000","last_clean":"2024-04-25T08:59:34.473606+0000","last_became_active":"2024-04-25T08:59:32.460310+0000","last_became_peered":"2024-04-25T08:59:32.460310+0000","last_unstale":"2024-04-25T08:59:34.473606+0000","last_undegraded":"2024-04-25T08:59:34.473606+0000","last_fullsized":"2024-04-25T08:59:34.473606+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:42.156606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473311+0000","last_change":"2024-04-25T08:59:33.487545+0000","last_active":"2024-04-25T08:59:34.473311+0000","last_peered":"2024-04-25T08:59:34.473311+0000","last_clean":"2024-04-25T08:59:34.473311+0000","last_became_active":"2024-04-25T08:59:33.487195+0000","last_became_peered":"2024-04-25T08:59:33.487195+0000","last_unstale":"2024-04-25T08:59:34.473311+0000","last_undegraded":"2024-04-25T08:59:34.473311+0000","last_fullsized":"2024-04-25T08:59:34.473311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:51.912742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473309+0000","last_change":"2024-04-25T08:59:32.460633+0000","last_active":"2024-04-25T08:59:34.473309+0000","last_peered":"2024-04-25T08:59:34.473309+0000","last_clean":"2024-04-25T08:59:34.473309+0000","last_became_active":"2024-04-25T08:59:32.460329+0000","last_became_peered":"2024-04-25T08:59:32.460329+0000","last_unstale":"2024-04-25T08:59:34.473309+0000","last_undegraded":"2024-04-25T08:59:34.473309+0000","last_fullsized":"2024-04-25T08:59:34.473309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:53.773940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488033+0000","last_change":"2024-04-25T08:59:33.485286+0000","last_active":"2024-04-25T08:59:33.488033+0000","last_peered":"2024-04-25T08:59:33.488033+0000","last_clean":"2024-04-25T08:59:33.488033+0000","last_became_active":"2024-04-25T08:59:33.484962+0000","last_became_peered":"2024-04-25T08:59:33.484962+0000","last_unstale":"2024-04-25T08:59:33.488033+0000","last_undegraded":"2024-04-25T08:59:33.488033+0000","last_fullsized":"2024-04-25T08:59:33.488033+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:01.528790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471048+0000","last_change":"2024-04-25T08:59:32.464201+0000","last_active":"2024-04-25T08:59:34.471048+0000","last_peered":"2024-04-25T08:59:34.471048+0000","last_clean":"2024-04-25T08:59:34.471048+0000","last_became_active":"2024-04-25T08:59:32.463911+0000","last_became_peered":"2024-04-25T08:59:32.463911+0000","last_unstale":"2024-04-25T08:59:34.471048+0000","last_undegraded":"2024-04-25T08:59:34.471048+0000","last_fullsized":"2024-04-25T08:59:34.471048+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:03.978039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.487062+0000","last_change":"2024-04-25T08:59:33.481688+0000","last_active":"2024-04-25T08:59:33.487062+0000","last_peered":"2024-04-25T08:59:33.487062+0000","last_clean":"2024-04-25T08:59:33.487062+0000","last_became_active":"2024-04-25T08:59:33.481355+0000","last_became_peered":"2024-04-25T08:59:33.481355+0000","last_unstale":"2024-04-25T08:59:33.487062+0000","last_undegraded":"2024-04-25T08:59:33.487062+0000","last_fullsized":"2024-04-25T08:59:33.487062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:12.934586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450423+0000","last_change":"2024-04-25T08:59:31.450423+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450423+0000","last_undegraded":"2024-04-25T08:59:31.450423+0000","last_fullsized":"2024-04-25T08:59:31.450423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470420+0000","last_change":"2024-04-25T08:59:33.491914+0000","last_active":"2024-04-25T08:59:34.470420+0000","last_peered":"2024-04-25T08:59:34.470420+0000","last_clean":"2024-04-25T08:59:34.470420+0000","last_became_active":"2024-04-25T08:59:33.491596+0000","last_became_peered":"2024-04-25T08:59:33.491596+0000","last_unstale":"2024-04-25T08:59:34.470420+0000","last_undegraded":"2024-04-25T08:59:34.470420+0000","last_fullsized":"2024-04-25T08:59:34.470420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:04.984096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-25T08:59:31.450560+0000","last_change":"2024-04-25T08:59:31.450560+0000","last_active":"2024-04-25T08:59:31.437995+0000","last_peered":"2024-04-25T08:59:31.437995+0000","last_clean":"2024-04-25T08:59:31.437995+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:31.450560+0000","last_undegraded":"2024-04-25T08:59:31.450560+0000","last_fullsized":"2024-04-25T08:59:31.450560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471220+0000","last_change":"2024-04-25T08:59:33.491700+0000","last_active":"2024-04-25T08:59:34.471220+0000","last_peered":"2024-04-25T08:59:34.471220+0000","last_clean":"2024-04-25T08:59:34.471220+0000","last_became_active":"2024-04-25T08:59:33.491448+0000","last_became_peered":"2024-04-25T08:59:33.491448+0000","last_unstale":"2024-04-25T08:59:34.471220+0000","last_undegraded":"2024-04-25T08:59:34.471220+0000","last_fullsized":"2024-04-25T08:59:34.471220+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:04.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470874+0000","last_change":"2024-04-25T08:59:32.459979+0000","last_active":"2024-04-25T08:59:34.470874+0000","last_peered":"2024-04-25T08:59:34.470874+0000","last_clean":"2024-04-25T08:59:34.470874+0000","last_became_active":"2024-04-25T08:59:32.459035+0000","last_became_peered":"2024-04-25T08:59:32.459035+0000","last_unstale":"2024-04-25T08:59:34.470874+0000","last_undegraded":"2024-04-25T08:59:34.470874+0000","last_fullsized":"2024-04-25T08:59:34.470874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:29.629464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.488303+0000","last_change":"2024-04-25T08:59:33.486075+0000","last_active":"2024-04-25T08:59:33.488303+0000","last_peered":"2024-04-25T08:59:33.488303+0000","last_clean":"2024-04-25T08:59:33.488303+0000","last_became_active":"2024-04-25T08:59:33.485770+0000","last_became_peered":"2024-04-25T08:59:33.485770+0000","last_unstale":"2024-04-25T08:59:33.488303+0000","last_undegraded":"2024-04-25T08:59:33.488303+0000","last_fullsized":"2024-04-25T08:59:33.488303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:59.058020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471325+0000","last_change":"2024-04-25T08:59:32.462805+0000","last_active":"2024-04-25T08:59:34.471325+0000","last_peered":"2024-04-25T08:59:34.471325+0000","last_clean":"2024-04-25T08:59:34.471325+0000","last_became_active":"2024-04-25T08:59:32.462539+0000","last_became_peered":"2024-04-25T08:59:32.462539+0000","last_unstale":"2024-04-25T08:59:34.471325+0000","last_undegraded":"2024-04-25T08:59:34.471325+0000","last_fullsized":"2024-04-25T08:59:34.471325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:44.042275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.483741+0000","last_change":"2024-04-25T08:59:33.477267+0000","last_active":"2024-04-25T08:59:33.483741+0000","last_peered":"2024-04-25T08:59:33.483741+0000","last_clean":"2024-04-25T08:59:33.483741+0000","last_became_active":"2024-04-25T08:59:33.476984+0000","last_became_peered":"2024-04-25T08:59:33.476984+0000","last_unstale":"2024-04-25T08:59:33.483741+0000","last_undegraded":"2024-04-25T08:59:33.483741+0000","last_fullsized":"2024-04-25T08:59:33.483741+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:59.058020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.475058+0000","last_change":"2024-04-25T08:59:32.465049+0000","last_active":"2024-04-25T08:59:33.475058+0000","last_peered":"2024-04-25T08:59:33.475058+0000","last_clean":"2024-04-25T08:59:33.475058+0000","last_became_active":"2024-04-25T08:59:32.464006+0000","last_became_peered":"2024-04-25T08:59:32.464006+0000","last_unstale":"2024-04-25T08:59:33.475058+0000","last_undegraded":"2024-04-25T08:59:33.475058+0000","last_fullsized":"2024-04-25T08:59:33.475058+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:00.522733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.484830+0000","last_change":"2024-04-25T08:59:33.483344+0000","last_active":"2024-04-25T08:59:33.484830+0000","last_peered":"2024-04-25T08:59:33.484830+0000","last_clean":"2024-04-25T08:59:33.484830+0000","last_became_active":"2024-04-25T08:59:33.483070+0000","last_became_peered":"2024-04-25T08:59:33.483070+0000","last_unstale":"2024-04-25T08:59:33.484830+0000","last_undegraded":"2024-04-25T08:59:33.484830+0000","last_fullsized":"2024-04-25T08:59:33.484830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:04.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.475841+0000","last_change":"2024-04-25T08:59:32.465761+0000","last_active":"2024-04-25T08:59:33.475841+0000","last_peered":"2024-04-25T08:59:33.475841+0000","last_clean":"2024-04-25T08:59:33.475841+0000","last_became_active":"2024-04-25T08:59:32.465411+0000","last_became_peered":"2024-04-25T08:59:32.465411+0000","last_unstale":"2024-04-25T08:59:33.475841+0000","last_undegraded":"2024-04-25T08:59:33.475841+0000","last_fullsized":"2024-04-25T08:59:33.475841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:50.953911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470603+0000","last_change":"2024-04-25T08:59:33.481868+0000","last_active":"2024-04-25T08:59:34.470603+0000","last_peered":"2024-04-25T08:59:34.470603+0000","last_clean":"2024-04-25T08:59:34.470603+0000","last_became_active":"2024-04-25T08:59:33.481590+0000","last_became_peered":"2024-04-25T08:59:33.481590+0000","last_unstale":"2024-04-25T08:59:34.470603+0000","last_undegraded":"2024-04-25T08:59:34.470603+0000","last_fullsized":"2024-04-25T08:59:34.470603+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:50.966614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471390+0000","last_change":"2024-04-25T08:59:32.463330+0000","last_active":"2024-04-25T08:59:34.471390+0000","last_peered":"2024-04-25T08:59:34.471390+0000","last_clean":"2024-04-25T08:59:34.471390+0000","last_became_active":"2024-04-25T08:59:32.463073+0000","last_became_peered":"2024-04-25T08:59:32.463073+0000","last_unstale":"2024-04-25T08:59:34.471390+0000","last_undegraded":"2024-04-25T08:59:34.471390+0000","last_fullsized":"2024-04-25T08:59:34.471390+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:44.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471335+0000","last_change":"2024-04-25T08:59:33.493939+0000","last_active":"2024-04-25T08:59:34.471335+0000","last_peered":"2024-04-25T08:59:34.471335+0000","last_clean":"2024-04-25T08:59:34.471335+0000","last_became_active":"2024-04-25T08:59:33.493207+0000","last_became_peered":"2024-04-25T08:59:33.493207+0000","last_unstale":"2024-04-25T08:59:34.471335+0000","last_undegraded":"2024-04-25T08:59:34.471335+0000","last_fullsized":"2024-04-25T08:59:34.471335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:51.961543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T08:59:33.474392+0000","last_change":"2024-04-25T08:59:32.461693+0000","last_active":"2024-04-25T08:59:33.474392+0000","last_peered":"2024-04-25T08:59:33.474392+0000","last_clean":"2024-04-25T08:59:33.474392+0000","last_became_active":"2024-04-25T08:59:32.461445+0000","last_became_peered":"2024-04-25T08:59:32.461445+0000","last_unstale":"2024-04-25T08:59:33.474392+0000","last_undegraded":"2024-04-25T08:59:33.474392+0000","last_fullsized":"2024-04-25T08:59:33.474392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:44.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:59:32.444052+0000","last_change":"2024-04-25T08:59:32.444052+0000","last_active":"2024-04-25T08:59:32.444052+0000","last_peered":"2024-04-25T08:59:32.444052+0000","last_clean":"2024-04-25T08:59:32.444052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:59:32.444052+0000","last_undegraded":"2024-04-25T08:59:32.444052+0000","last_fullsized":"2024-04-25T08:59:32.444052+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470620+0000","last_change":"2024-04-25T08:59:32.465998+0000","last_active":"2024-04-25T08:59:34.470620+0000","last_peered":"2024-04-25T08:59:34.470620+0000","last_clean":"2024-04-25T08:59:34.470620+0000","last_became_active":"2024-04-25T08:59:32.465578+0000","last_became_peered":"2024-04-25T08:59:32.465578+0000","last_unstale":"2024-04-25T08:59:34.470620+0000","last_undegraded":"2024-04-25T08:59:34.470620+0000","last_fullsized":"2024-04-25T08:59:34.470620+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:16.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":289,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470812+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:59:34.470812+0000","last_peered":"2024-04-25T08:59:34.470812+0000","last_clean":"2024-04-25T08:59:34.470812+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:59:34.470812+0000","last_undegraded":"2024-04-25T08:59:34.470812+0000","last_fullsized":"2024-04-25T08:59:34.470812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1646592,"data_stored":1035444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1060864,"data_stored":445700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":446640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":445006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1060864,"data_stored":446618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1052672,"data_stored":445588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1646592,"data_stored":1035408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":431956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:59:40.418 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:59:40.421 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:59:40.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:59:41.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.038+0000 7fb8eeafc640 1 Processor -- start 2024-04-25T08:59:41.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.038+0000 7fb8eeafc640 1 -- start start 2024-04-25T08:59:41.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.039+0000 7fb8eeafc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8e815dce0 0x7fb8e80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.039+0000 7fb8eeafc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8e80b5b60 0x7fb8e80b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.039+0000 7fb8eeafc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e815e0c0 con 0x7fb8e80d35b0 2024-04-25T08:59:41.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.039+0000 7fb8eeafc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e80d2510 con 0x7fb8e815dce0 2024-04-25T08:59:41.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.039+0000 7fb8eeafc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80d27f0 con 0x7fb8e80b5b60 2024-04-25T08:59:41.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.039+0000 7fb8ec898640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8e815dce0 0x7fb8e80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.039+0000 7fb8e7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb8e80d35b0 0x7fb8e80b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49768/0 (socket says 172.21.15.55:49768) 2024-04-25T08:59:41.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.039+0000 7fb8ec898640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8e815dce0 0x7fb8e80d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60262/0 (socket says 172.21.15.55:60262) 2024-04-25T08:59:41.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.039+0000 7fb8e7fff640 1 -- 172.21.15.55:0/1884895659 learned_addr learned my addr 172.21.15.55:0/1884895659 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:41.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.040+0000 7fb8ed099640 1 --2- 172.21.15.55:0/1884895659 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8e80b5b60 0x7fb8e80b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.040+0000 7fb8ec898640 1 -- 172.21.15.55:0/1884895659 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8e80b5b60 msgr2=0x7fb8e80b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.040+0000 7fb8ec898640 1 --2- 172.21.15.55:0/1884895659 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8e80b5b60 0x7fb8e80b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.040+0000 7fb8ec898640 1 -- 172.21.15.55:0/1884895659 >> v1:172.21.15.55:6789/0 conn(0x7fb8e80d35b0 legacy=0x7fb8e80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.040+0000 7fb8ec898640 1 -- 172.21.15.55:0/1884895659 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80d2ad0 con 0x7fb8e815dce0 2024-04-25T08:59:41.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.040+0000 7fb8e77fe640 1 -- 172.21.15.55:0/1884895659 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296714124 0 0) 0x7fb8e815e0c0 con 0x7fb8e80d35b0 2024-04-25T08:59:41.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.040+0000 7fb8ec898640 1 --2- 172.21.15.55:0/1884895659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e815dce0 0x7fb8e80d1a50 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80097a0 tx=0x7fb8d802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3435e62aac929a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.041+0000 7fb8e77fe640 1 -- 172.21.15.55:0/1884895659 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8037070 con 0x7fb8e815dce0 2024-04-25T08:59:41.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.041+0000 7fb8e77fe640 1 -- 172.21.15.55:0/1884895659 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d8032440 con 0x7fb8e815dce0 2024-04-25T08:59:41.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.041+0000 7fb8e77fe640 1 -- 172.21.15.55:0/1884895659 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8032810 con 0x7fb8e815dce0 2024-04-25T08:59:41.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.041+0000 7fb8eeafc640 1 -- 172.21.15.55:0/1884895659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e815dce0 msgr2=0x7fb8e80d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.041+0000 7fb8eeafc640 1 --2- 172.21.15.55:0/1884895659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e815dce0 0x7fb8e80d1a50 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80097a0 tx=0x7fb8d802a180 comp rx=0 tx=0).stop 2024-04-25T08:59:41.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.041+0000 7fb8eeafc640 1 -- 172.21.15.55:0/1884895659 shutdown_connections 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.041+0000 7fb8eeafc640 1 --2- 172.21.15.55:0/1884895659 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8e80b5b60 0x7fb8e80b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.041+0000 7fb8eeafc640 1 --2- 172.21.15.55:0/1884895659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e815dce0 0x7fb8e80d1a50 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.041+0000 7fb8eeafc640 1 -- 172.21.15.55:0/1884895659 >> 172.21.15.55:0/1884895659 conn(0x7fb8e8072900 msgr2=0x7fb8e80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.041+0000 7fb8eeafc640 1 -- 172.21.15.55:0/1884895659 shutdown_connections 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.041+0000 7fb8eeafc640 1 -- 172.21.15.55:0/1884895659 wait complete. 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.042+0000 7fb8eeafc640 1 Processor -- start 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.042+0000 7fb8eeafc640 1 -- start start 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.043+0000 7fb8eeafc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e80b5b60 0x7fb8e815a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.043+0000 7fb8eeafc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8e80d35b0 0x7fb8e81580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.043+0000 7fb8eeafc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8e815dce0 0x7fb8e81f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.043+0000 7fb8eeafc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80b9820 con 0x7fb8e80b5b60 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.043+0000 7fb8eeafc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80d3090 con 0x7fb8e80d35b0 2024-04-25T08:59:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.043+0000 7fb8eeafc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80b99a0 con 0x7fb8e815dce0 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.043+0000 7fb8ec898640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e80b5b60 0x7fb8e815a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8ec898640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e80b5b60 0x7fb8e815a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60278/0 (socket says 172.21.15.55:60278) 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8ec898640 1 -- 172.21.15.55:0/137678615 learned_addr learned my addr 172.21.15.55:0/137678615 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8ed099640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8e815dce0 0x7fb8e81f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8e7fff640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8e80d35b0 0x7fb8e81580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8ec898640 1 -- 172.21.15.55:0/137678615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8e815dce0 msgr2=0x7fb8e81f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8ec898640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8e815dce0 0x7fb8e81f74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8ec898640 1 -- 172.21.15.55:0/137678615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8e80d35b0 msgr2=0x7fb8e81580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8ec898640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8e80d35b0 0x7fb8e81580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8ec898640 1 -- 172.21.15.55:0/137678615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8157d50 con 0x7fb8e80b5b60 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8ec898640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e80b5b60 0x7fb8e815a640 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8000c00 tx=0x7fb8d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8e57fa640 1 -- 172.21.15.55:0/137678615 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8037040 con 0x7fb8e80b5b60 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8e57fa640 1 -- 172.21.15.55:0/137678615 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d8042070 con 0x7fb8e80b5b60 2024-04-25T08:59:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8e57fa640 1 -- 172.21.15.55:0/137678615 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8030a70 con 0x7fb8e80b5b60 2024-04-25T08:59:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8eeafc640 1 -- 172.21.15.55:0/137678615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e81577d0 con 0x7fb8e80b5b60 2024-04-25T08:59:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.044+0000 7fb8eeafc640 1 -- 172.21.15.55:0/137678615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e81585f0 con 0x7fb8e80b5b60 2024-04-25T08:59:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.045+0000 7fb8eeafc640 1 -- 172.21.15.55:0/137678615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e80749b0 con 0x7fb8e80b5b60 2024-04-25T08:59:41.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.046+0000 7fb8e57fa640 1 -- 172.21.15.55:0/137678615 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb8d8030c10 con 0x7fb8e80b5b60 2024-04-25T08:59:41.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.046+0000 7fb8e57fa640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8d406b4d0 0x7fb8d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.046+0000 7fb8e57fa640 1 -- 172.21.15.55:0/137678615 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8d80aacd0 con 0x7fb8e80b5b60 2024-04-25T08:59:41.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.046+0000 7fb8e7fff640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8d406b4d0 0x7fb8d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.047+0000 7fb8e7fff640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8d406b4d0 0x7fb8d406d990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc007fd0 tx=0x7fb8dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.051+0000 7fb8e57fa640 1 -- 172.21.15.55:0/137678615 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8d8079b40 con 0x7fb8e80b5b60 2024-04-25T08:59:41.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.228+0000 7fb8eeafc640 1 -- 172.21.15.55:0/137678615 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8e80d1370 con 0x7fb8d406b4d0 2024-04-25T08:59:41.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.234+0000 7fb8e57fa640 1 -- 172.21.15.55:0/137678615 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252009 (secure 0 0 0) 0x7fb8e80d1370 con 0x7fb8d406b4d0 2024-04-25T08:59:41.226 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:41.227 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 -- 172.21.15.55:0/137678615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8d406b4d0 msgr2=0x7fb8d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8d406b4d0 0x7fb8d406d990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc007fd0 tx=0x7fb8dc009040 comp rx=0 tx=0).stop 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 -- 172.21.15.55:0/137678615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e80b5b60 msgr2=0x7fb8e815a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e80b5b60 0x7fb8e815a640 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8000c00 tx=0x7fb8d80046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 -- 172.21.15.55:0/137678615 shutdown_connections 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8d406b4d0 0x7fb8d406d990 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8e815dce0 0x7fb8e81f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8e80d35b0 0x7fb8e81580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 --2- 172.21.15.55:0/137678615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e80b5b60 0x7fb8e815a640 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 -- 172.21.15.55:0/137678615 >> 172.21.15.55:0/137678615 conn(0x7fb8e8072900 msgr2=0x7fb8e80b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 -- 172.21.15.55:0/137678615 shutdown_connections 2024-04-25T08:59:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.237+0000 7fb8eeafc640 1 -- 172.21.15.55:0/137678615 wait complete. 2024-04-25T08:59:41.237 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-04-25T08:59:40.630757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258984,"kb_used_data":9512,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715736,"statfs":{"total":773094113280,"available":772828913664,"internally_reserved":0,"allocated":9740288,"data_stored":4796004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001492"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471225+0000","last_change":"2024-04-25T08:59:33.485591+0000","last_active":"2024-04-25T08:59:34.471225+0000","last_peered":"2024-04-25T08:59:34.471225+0000","last_clean":"2024-04-25T08:59:34.471225+0000","last_became_active":"2024-04-25T08:59:33.485270+0000","last_became_peered":"2024-04-25T08:59:33.485270+0000","last_unstale":"2024-04-25T08:59:34.471225+0000","last_undegraded":"2024-04-25T08:59:34.471225+0000","last_fullsized":"2024-04-25T08:59:34.471225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:44.759906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184689+0000","last_change":"2024-04-25T08:59:33.486442+0000","last_active":"2024-04-25T08:59:35.184689+0000","last_peered":"2024-04-25T08:59:35.184689+0000","last_clean":"2024-04-25T08:59:35.184689+0000","last_became_active":"2024-04-25T08:59:33.486133+0000","last_became_peered":"2024-04-25T08:59:33.486133+0000","last_unstale":"2024-04-25T08:59:35.184689+0000","last_undegraded":"2024-04-25T08:59:35.184689+0000","last_fullsized":"2024-04-25T08:59:35.184689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:52.232230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470340+0000","last_change":"2024-04-25T08:59:33.487428+0000","last_active":"2024-04-25T08:59:34.470340+0000","last_peered":"2024-04-25T08:59:34.470340+0000","last_clean":"2024-04-25T08:59:34.470340+0000","last_became_active":"2024-04-25T08:59:33.487122+0000","last_became_peered":"2024-04-25T08:59:33.487122+0000","last_unstale":"2024-04-25T08:59:34.470340+0000","last_undegraded":"2024-04-25T08:59:34.470340+0000","last_fullsized":"2024-04-25T08:59:34.470340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:40.677654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473529+0000","last_change":"2024-04-25T08:59:33.481919+0000","last_active":"2024-04-25T08:59:34.473529+0000","last_peered":"2024-04-25T08:59:34.473529+0000","last_clean":"2024-04-25T08:59:34.473529+0000","last_became_active":"2024-04-25T08:59:33.481671+0000","last_became_peered":"2024-04-25T08:59:33.481671+0000","last_unstale":"2024-04-25T08:59:34.473529+0000","last_undegraded":"2024-04-25T08:59:34.473529+0000","last_fullsized":"2024-04-25T08:59:34.473529+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:38.662705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183285+0000","last_change":"2024-04-25T08:59:33.482528+0000","last_active":"2024-04-25T08:59:35.183285+0000","last_peered":"2024-04-25T08:59:35.183285+0000","last_clean":"2024-04-25T08:59:35.183285+0000","last_became_active":"2024-04-25T08:59:33.482248+0000","last_became_peered":"2024-04-25T08:59:33.482248+0000","last_unstale":"2024-04-25T08:59:35.183285+0000","last_undegraded":"2024-04-25T08:59:35.183285+0000","last_fullsized":"2024-04-25T08:59:35.183285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:04.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.688863+0000","last_change":"2024-04-25T08:59:33.489289+0000","last_active":"2024-04-25T08:59:34.688863+0000","last_peered":"2024-04-25T08:59:34.688863+0000","last_clean":"2024-04-25T08:59:34.688863+0000","last_became_active":"2024-04-25T08:59:33.488378+0000","last_became_peered":"2024-04-25T08:59:33.488378+0000","last_unstale":"2024-04-25T08:59:34.688863+0000","last_undegraded":"2024-04-25T08:59:34.688863+0000","last_fullsized":"2024-04-25T08:59:34.688863+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:08.837422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473272+0000","last_change":"2024-04-25T08:59:33.486006+0000","last_active":"2024-04-25T08:59:34.473272+0000","last_peered":"2024-04-25T08:59:34.473272+0000","last_clean":"2024-04-25T08:59:34.473272+0000","last_became_active":"2024-04-25T08:59:33.485708+0000","last_became_peered":"2024-04-25T08:59:33.485708+0000","last_unstale":"2024-04-25T08:59:34.473272+0000","last_undegraded":"2024-04-25T08:59:34.473272+0000","last_fullsized":"2024-04-25T08:59:34.473272+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:05.103716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.688884+0000","last_change":"2024-04-25T08:59:33.481878+0000","last_active":"2024-04-25T08:59:34.688884+0000","last_peered":"2024-04-25T08:59:34.688884+0000","last_clean":"2024-04-25T08:59:34.688884+0000","last_became_active":"2024-04-25T08:59:33.481549+0000","last_became_peered":"2024-04-25T08:59:33.481549+0000","last_unstale":"2024-04-25T08:59:34.688884+0000","last_undegraded":"2024-04-25T08:59:34.688884+0000","last_fullsized":"2024-04-25T08:59:34.688884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:04.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.688918+0000","last_change":"2024-04-25T08:59:33.489742+0000","last_active":"2024-04-25T08:59:34.688918+0000","last_peered":"2024-04-25T08:59:34.688918+0000","last_clean":"2024-04-25T08:59:34.688918+0000","last_became_active":"2024-04-25T08:59:33.489472+0000","last_became_peered":"2024-04-25T08:59:33.489472+0000","last_unstale":"2024-04-25T08:59:34.688918+0000","last_undegraded":"2024-04-25T08:59:34.688918+0000","last_fullsized":"2024-04-25T08:59:34.688918+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:55.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470926+0000","last_change":"2024-04-25T08:59:33.492585+0000","last_active":"2024-04-25T08:59:34.470926+0000","last_peered":"2024-04-25T08:59:34.470926+0000","last_clean":"2024-04-25T08:59:34.470926+0000","last_became_active":"2024-04-25T08:59:33.492032+0000","last_became_peered":"2024-04-25T08:59:33.492032+0000","last_unstale":"2024-04-25T08:59:34.470926+0000","last_undegraded":"2024-04-25T08:59:34.470926+0000","last_fullsized":"2024-04-25T08:59:34.470926+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:16.803764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184428+0000","last_change":"2024-04-25T08:59:33.475487+0000","last_active":"2024-04-25T08:59:35.184428+0000","last_peered":"2024-04-25T08:59:35.184428+0000","last_clean":"2024-04-25T08:59:35.184428+0000","last_became_active":"2024-04-25T08:59:33.475191+0000","last_became_peered":"2024-04-25T08:59:33.475191+0000","last_unstale":"2024-04-25T08:59:35.184428+0000","last_undegraded":"2024-04-25T08:59:35.184428+0000","last_fullsized":"2024-04-25T08:59:35.184428+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:57.306125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470677+0000","last_change":"2024-04-25T08:59:33.492662+0000","last_active":"2024-04-25T08:59:34.470677+0000","last_peered":"2024-04-25T08:59:34.470677+0000","last_clean":"2024-04-25T08:59:34.470677+0000","last_became_active":"2024-04-25T08:59:33.492153+0000","last_became_peered":"2024-04-25T08:59:33.492153+0000","last_unstale":"2024-04-25T08:59:34.470677+0000","last_undegraded":"2024-04-25T08:59:34.470677+0000","last_fullsized":"2024-04-25T08:59:34.470677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:01.528790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470906+0000","last_change":"2024-04-25T08:59:33.480997+0000","last_active":"2024-04-25T08:59:34.470906+0000","last_peered":"2024-04-25T08:59:34.470906+0000","last_clean":"2024-04-25T08:59:34.470906+0000","last_became_active":"2024-04-25T08:59:33.480666+0000","last_became_peered":"2024-04-25T08:59:33.480666+0000","last_unstale":"2024-04-25T08:59:34.470906+0000","last_undegraded":"2024-04-25T08:59:34.470906+0000","last_fullsized":"2024-04-25T08:59:34.470906+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:16.088847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473509+0000","last_change":"2024-04-25T08:59:33.486549+0000","last_active":"2024-04-25T08:59:34.473509+0000","last_peered":"2024-04-25T08:59:34.473509+0000","last_clean":"2024-04-25T08:59:34.473509+0000","last_became_active":"2024-04-25T08:59:33.486014+0000","last_became_peered":"2024-04-25T08:59:33.486014+0000","last_unstale":"2024-04-25T08:59:34.473509+0000","last_undegraded":"2024-04-25T08:59:34.473509+0000","last_fullsized":"2024-04-25T08:59:34.473509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:16.544816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471226+0000","last_change":"2024-04-25T08:59:33.480745+0000","last_active":"2024-04-25T08:59:34.471226+0000","last_peered":"2024-04-25T08:59:34.471226+0000","last_clean":"2024-04-25T08:59:34.471226+0000","last_became_active":"2024-04-25T08:59:33.480458+0000","last_became_peered":"2024-04-25T08:59:33.480458+0000","last_unstale":"2024-04-25T08:59:34.471226+0000","last_undegraded":"2024-04-25T08:59:34.471226+0000","last_fullsized":"2024-04-25T08:59:34.471226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:39.831860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183031+0000","last_change":"2024-04-25T08:59:33.486493+0000","last_active":"2024-04-25T08:59:35.183031+0000","last_peered":"2024-04-25T08:59:35.183031+0000","last_clean":"2024-04-25T08:59:35.183031+0000","last_became_active":"2024-04-25T08:59:33.485837+0000","last_became_peered":"2024-04-25T08:59:33.485837+0000","last_unstale":"2024-04-25T08:59:35.183031+0000","last_undegraded":"2024-04-25T08:59:35.183031+0000","last_fullsized":"2024-04-25T08:59:35.183031+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:44.759906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183524+0000","last_change":"2024-04-25T08:59:33.489778+0000","last_active":"2024-04-25T08:59:35.183524+0000","last_peered":"2024-04-25T08:59:35.183524+0000","last_clean":"2024-04-25T08:59:35.183524+0000","last_became_active":"2024-04-25T08:59:33.489514+0000","last_became_peered":"2024-04-25T08:59:33.489514+0000","last_unstale":"2024-04-25T08:59:35.183524+0000","last_undegraded":"2024-04-25T08:59:35.183524+0000","last_fullsized":"2024-04-25T08:59:35.183524+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:28.073375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473762+0000","last_change":"2024-04-25T08:59:33.495035+0000","last_active":"2024-04-25T08:59:34.473762+0000","last_peered":"2024-04-25T08:59:34.473762+0000","last_clean":"2024-04-25T08:59:34.473762+0000","last_became_active":"2024-04-25T08:59:33.494739+0000","last_became_peered":"2024-04-25T08:59:33.494739+0000","last_unstale":"2024-04-25T08:59:34.473762+0000","last_undegraded":"2024-04-25T08:59:34.473762+0000","last_fullsized":"2024-04-25T08:59:34.473762+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:07.192195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184176+0000","last_change":"2024-04-25T08:59:33.484405+0000","last_active":"2024-04-25T08:59:35.184176+0000","last_peered":"2024-04-25T08:59:35.184176+0000","last_clean":"2024-04-25T08:59:35.184176+0000","last_became_active":"2024-04-25T08:59:33.482624+0000","last_became_peered":"2024-04-25T08:59:33.482624+0000","last_unstale":"2024-04-25T08:59:35.184176+0000","last_undegraded":"2024-04-25T08:59:35.184176+0000","last_fullsized":"2024-04-25T08:59:35.184176+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:11.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473597+0000","last_change":"2024-04-25T08:59:33.485682+0000","last_active":"2024-04-25T08:59:34.473597+0000","last_peered":"2024-04-25T08:59:34.473597+0000","last_clean":"2024-04-25T08:59:34.473597+0000","last_became_active":"2024-04-25T08:59:33.485410+0000","last_became_peered":"2024-04-25T08:59:33.485410+0000","last_unstale":"2024-04-25T08:59:34.473597+0000","last_undegraded":"2024-04-25T08:59:34.473597+0000","last_fullsized":"2024-04-25T08:59:34.473597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:46.869053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473472+0000","last_change":"2024-04-25T08:59:33.485903+0000","last_active":"2024-04-25T08:59:34.473472+0000","last_peered":"2024-04-25T08:59:34.473472+0000","last_clean":"2024-04-25T08:59:34.473472+0000","last_became_active":"2024-04-25T08:59:33.485144+0000","last_became_peered":"2024-04-25T08:59:33.485144+0000","last_unstale":"2024-04-25T08:59:34.473472+0000","last_undegraded":"2024-04-25T08:59:34.473472+0000","last_fullsized":"2024-04-25T08:59:34.473472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:00.891178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183949+0000","last_change":"2024-04-25T08:59:33.493852+0000","last_active":"2024-04-25T08:59:35.183949+0000","last_peered":"2024-04-25T08:59:35.183949+0000","last_clean":"2024-04-25T08:59:35.183949+0000","last_became_active":"2024-04-25T08:59:33.493327+0000","last_became_peered":"2024-04-25T08:59:33.493327+0000","last_unstale":"2024-04-25T08:59:35.183949+0000","last_undegraded":"2024-04-25T08:59:35.183949+0000","last_fullsized":"2024-04-25T08:59:35.183949+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:49.821740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471295+0000","last_change":"2024-04-25T08:59:33.494003+0000","last_active":"2024-04-25T08:59:34.471295+0000","last_peered":"2024-04-25T08:59:34.471295+0000","last_clean":"2024-04-25T08:59:34.471295+0000","last_became_active":"2024-04-25T08:59:33.493533+0000","last_became_peered":"2024-04-25T08:59:33.493533+0000","last_unstale":"2024-04-25T08:59:34.471295+0000","last_undegraded":"2024-04-25T08:59:34.471295+0000","last_fullsized":"2024-04-25T08:59:34.471295+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:55.574254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473277+0000","last_change":"2024-04-25T08:59:33.486174+0000","last_active":"2024-04-25T08:59:34.473277+0000","last_peered":"2024-04-25T08:59:34.473277+0000","last_clean":"2024-04-25T08:59:34.473277+0000","last_became_active":"2024-04-25T08:59:33.485376+0000","last_became_peered":"2024-04-25T08:59:33.485376+0000","last_unstale":"2024-04-25T08:59:34.473277+0000","last_undegraded":"2024-04-25T08:59:34.473277+0000","last_fullsized":"2024-04-25T08:59:34.473277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:23.321835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184288+0000","last_change":"2024-04-25T08:59:33.487271+0000","last_active":"2024-04-25T08:59:35.184288+0000","last_peered":"2024-04-25T08:59:35.184288+0000","last_clean":"2024-04-25T08:59:35.184288+0000","last_became_active":"2024-04-25T08:59:33.487003+0000","last_became_peered":"2024-04-25T08:59:33.487003+0000","last_unstale":"2024-04-25T08:59:35.184288+0000","last_undegraded":"2024-04-25T08:59:35.184288+0000","last_fullsized":"2024-04-25T08:59:35.184288+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:55.821505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470675+0000","last_change":"2024-04-25T08:59:33.481229+0000","last_active":"2024-04-25T08:59:34.470675+0000","last_peered":"2024-04-25T08:59:34.470675+0000","last_clean":"2024-04-25T08:59:34.470675+0000","last_became_active":"2024-04-25T08:59:33.480697+0000","last_became_peered":"2024-04-25T08:59:33.480697+0000","last_unstale":"2024-04-25T08:59:34.470675+0000","last_undegraded":"2024-04-25T08:59:34.470675+0000","last_fullsized":"2024-04-25T08:59:34.470675+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:18.281359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183345+0000","last_change":"2024-04-25T08:59:33.478198+0000","last_active":"2024-04-25T08:59:35.183345+0000","last_peered":"2024-04-25T08:59:35.183345+0000","last_clean":"2024-04-25T08:59:35.183345+0000","last_became_active":"2024-04-25T08:59:33.477907+0000","last_became_peered":"2024-04-25T08:59:33.477907+0000","last_unstale":"2024-04-25T08:59:35.183345+0000","last_undegraded":"2024-04-25T08:59:35.183345+0000","last_fullsized":"2024-04-25T08:59:35.183345+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:55.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470873+0000","last_change":"2024-04-25T08:59:33.486375+0000","last_active":"2024-04-25T08:59:34.470873+0000","last_peered":"2024-04-25T08:59:34.470873+0000","last_clean":"2024-04-25T08:59:34.470873+0000","last_became_active":"2024-04-25T08:59:33.484674+0000","last_became_peered":"2024-04-25T08:59:33.484674+0000","last_unstale":"2024-04-25T08:59:34.470873+0000","last_undegraded":"2024-04-25T08:59:34.470873+0000","last_fullsized":"2024-04-25T08:59:34.470873+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:17.712953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184188+0000","last_change":"2024-04-25T08:59:33.472708+0000","last_active":"2024-04-25T08:59:35.184188+0000","last_peered":"2024-04-25T08:59:35.184188+0000","last_clean":"2024-04-25T08:59:35.184188+0000","last_became_active":"2024-04-25T08:59:33.472188+0000","last_became_peered":"2024-04-25T08:59:33.472188+0000","last_unstale":"2024-04-25T08:59:35.184188+0000","last_undegraded":"2024-04-25T08:59:35.184188+0000","last_fullsized":"2024-04-25T08:59:35.184188+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:13.537365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183949+0000","last_change":"2024-04-25T08:59:33.493616+0000","last_active":"2024-04-25T08:59:35.183949+0000","last_peered":"2024-04-25T08:59:35.183949+0000","last_clean":"2024-04-25T08:59:35.183949+0000","last_became_active":"2024-04-25T08:59:33.492266+0000","last_became_peered":"2024-04-25T08:59:33.492266+0000","last_unstale":"2024-04-25T08:59:35.183949+0000","last_undegraded":"2024-04-25T08:59:35.183949+0000","last_fullsized":"2024-04-25T08:59:35.183949+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:51.760986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183165+0000","last_change":"2024-04-25T08:59:33.486570+0000","last_active":"2024-04-25T08:59:35.183165+0000","last_peered":"2024-04-25T08:59:35.183165+0000","last_clean":"2024-04-25T08:59:35.183165+0000","last_became_active":"2024-04-25T08:59:33.486194+0000","last_became_peered":"2024-04-25T08:59:33.486194+0000","last_unstale":"2024-04-25T08:59:35.183165+0000","last_undegraded":"2024-04-25T08:59:35.183165+0000","last_fullsized":"2024-04-25T08:59:35.183165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:08.837422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470424+0000","last_change":"2024-04-25T08:59:33.484769+0000","last_active":"2024-04-25T08:59:34.470424+0000","last_peered":"2024-04-25T08:59:34.470424+0000","last_clean":"2024-04-25T08:59:34.470424+0000","last_became_active":"2024-04-25T08:59:33.484449+0000","last_became_peered":"2024-04-25T08:59:33.484449+0000","last_unstale":"2024-04-25T08:59:34.470424+0000","last_undegraded":"2024-04-25T08:59:34.470424+0000","last_fullsized":"2024-04-25T08:59:34.470424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:51.693954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183536+0000","last_change":"2024-04-25T08:59:33.486917+0000","last_active":"2024-04-25T08:59:35.183536+0000","last_peered":"2024-04-25T08:59:35.183536+0000","last_clean":"2024-04-25T08:59:35.183536+0000","last_became_active":"2024-04-25T08:59:33.486279+0000","last_became_peered":"2024-04-25T08:59:33.486279+0000","last_unstale":"2024-04-25T08:59:35.183536+0000","last_undegraded":"2024-04-25T08:59:35.183536+0000","last_fullsized":"2024-04-25T08:59:35.183536+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:01.380348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471438+0000","last_change":"2024-04-25T08:59:32.461674+0000","last_active":"2024-04-25T08:59:34.471438+0000","last_peered":"2024-04-25T08:59:34.471438+0000","last_clean":"2024-04-25T08:59:34.471438+0000","last_became_active":"2024-04-25T08:59:32.460461+0000","last_became_peered":"2024-04-25T08:59:32.460461+0000","last_unstale":"2024-04-25T08:59:34.471438+0000","last_undegraded":"2024-04-25T08:59:34.471438+0000","last_fullsized":"2024-04-25T08:59:34.471438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:39.901295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471332+0000","last_change":"2024-04-25T08:59:33.494462+0000","last_active":"2024-04-25T08:59:34.471332+0000","last_peered":"2024-04-25T08:59:34.471332+0000","last_clean":"2024-04-25T08:59:34.471332+0000","last_became_active":"2024-04-25T08:59:33.494052+0000","last_became_peered":"2024-04-25T08:59:33.494052+0000","last_unstale":"2024-04-25T08:59:34.471332+0000","last_undegraded":"2024-04-25T08:59:34.471332+0000","last_fullsized":"2024-04-25T08:59:34.471332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:55.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183664+0000","last_change":"2024-04-25T08:59:32.467296+0000","last_active":"2024-04-25T08:59:35.183664+0000","last_peered":"2024-04-25T08:59:35.183664+0000","last_clean":"2024-04-25T08:59:35.183664+0000","last_became_active":"2024-04-25T08:59:32.467016+0000","last_became_peered":"2024-04-25T08:59:32.467016+0000","last_unstale":"2024-04-25T08:59:35.183664+0000","last_undegraded":"2024-04-25T08:59:35.183664+0000","last_fullsized":"2024-04-25T08:59:35.183664+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:55.181008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471147+0000","last_change":"2024-04-25T08:59:33.482935+0000","last_active":"2024-04-25T08:59:34.471147+0000","last_peered":"2024-04-25T08:59:34.471147+0000","last_clean":"2024-04-25T08:59:34.471147+0000","last_became_active":"2024-04-25T08:59:33.482585+0000","last_became_peered":"2024-04-25T08:59:33.482585+0000","last_unstale":"2024-04-25T08:59:34.471147+0000","last_undegraded":"2024-04-25T08:59:34.471147+0000","last_fullsized":"2024-04-25T08:59:34.471147+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:08.837422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184277+0000","last_change":"2024-04-25T08:59:32.465587+0000","last_active":"2024-04-25T08:59:35.184277+0000","last_peered":"2024-04-25T08:59:35.184277+0000","last_clean":"2024-04-25T08:59:35.184277+0000","last_became_active":"2024-04-25T08:59:32.465163+0000","last_became_peered":"2024-04-25T08:59:32.465163+0000","last_unstale":"2024-04-25T08:59:35.184277+0000","last_undegraded":"2024-04-25T08:59:35.184277+0000","last_fullsized":"2024-04-25T08:59:35.184277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:43.753849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470503+0000","last_change":"2024-04-25T08:59:33.488643+0000","last_active":"2024-04-25T08:59:34.470503+0000","last_peered":"2024-04-25T08:59:34.470503+0000","last_clean":"2024-04-25T08:59:34.470503+0000","last_became_active":"2024-04-25T08:59:33.488328+0000","last_became_peered":"2024-04-25T08:59:33.488328+0000","last_unstale":"2024-04-25T08:59:34.470503+0000","last_undegraded":"2024-04-25T08:59:34.470503+0000","last_fullsized":"2024-04-25T08:59:34.470503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.159698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184022+0000","last_change":"2024-04-25T08:59:32.465821+0000","last_active":"2024-04-25T08:59:35.184022+0000","last_peered":"2024-04-25T08:59:35.184022+0000","last_clean":"2024-04-25T08:59:35.184022+0000","last_became_active":"2024-04-25T08:59:32.465489+0000","last_became_peered":"2024-04-25T08:59:32.465489+0000","last_unstale":"2024-04-25T08:59:35.184022+0000","last_undegraded":"2024-04-25T08:59:35.184022+0000","last_fullsized":"2024-04-25T08:59:35.184022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:16.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184119+0000","last_change":"2024-04-25T08:59:33.491799+0000","last_active":"2024-04-25T08:59:35.184119+0000","last_peered":"2024-04-25T08:59:35.184119+0000","last_clean":"2024-04-25T08:59:35.184119+0000","last_became_active":"2024-04-25T08:59:33.490260+0000","last_became_peered":"2024-04-25T08:59:33.490260+0000","last_unstale":"2024-04-25T08:59:35.184119+0000","last_undegraded":"2024-04-25T08:59:35.184119+0000","last_fullsized":"2024-04-25T08:59:35.184119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:10.462237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183501+0000","last_change":"2024-04-25T08:59:32.466860+0000","last_active":"2024-04-25T08:59:35.183501+0000","last_peered":"2024-04-25T08:59:35.183501+0000","last_clean":"2024-04-25T08:59:35.183501+0000","last_became_active":"2024-04-25T08:59:32.466545+0000","last_became_peered":"2024-04-25T08:59:32.466545+0000","last_unstale":"2024-04-25T08:59:35.183501+0000","last_undegraded":"2024-04-25T08:59:35.183501+0000","last_fullsized":"2024-04-25T08:59:35.183501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:56.661725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183378+0000","last_change":"2024-04-25T08:59:33.488817+0000","last_active":"2024-04-25T08:59:35.183378+0000","last_peered":"2024-04-25T08:59:35.183378+0000","last_clean":"2024-04-25T08:59:35.183378+0000","last_became_active":"2024-04-25T08:59:33.488561+0000","last_became_peered":"2024-04-25T08:59:33.488561+0000","last_unstale":"2024-04-25T08:59:35.183378+0000","last_undegraded":"2024-04-25T08:59:35.183378+0000","last_fullsized":"2024-04-25T08:59:35.183378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:51.961543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183125+0000","last_change":"2024-04-25T08:59:32.467767+0000","last_active":"2024-04-25T08:59:35.183125+0000","last_peered":"2024-04-25T08:59:35.183125+0000","last_clean":"2024-04-25T08:59:35.183125+0000","last_became_active":"2024-04-25T08:59:32.467478+0000","last_became_peered":"2024-04-25T08:59:32.467478+0000","last_unstale":"2024-04-25T08:59:35.183125+0000","last_undegraded":"2024-04-25T08:59:35.183125+0000","last_fullsized":"2024-04-25T08:59:35.183125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:03.367165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470185+0000","last_change":"2024-04-25T08:59:33.485806+0000","last_active":"2024-04-25T08:59:34.470185+0000","last_peered":"2024-04-25T08:59:34.470185+0000","last_clean":"2024-04-25T08:59:34.470185+0000","last_became_active":"2024-04-25T08:59:33.485533+0000","last_became_peered":"2024-04-25T08:59:33.485533+0000","last_unstale":"2024-04-25T08:59:34.470185+0000","last_undegraded":"2024-04-25T08:59:34.470185+0000","last_fullsized":"2024-04-25T08:59:34.470185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:11.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183849+0000","last_change":"2024-04-25T08:59:32.462535+0000","last_active":"2024-04-25T08:59:35.183849+0000","last_peered":"2024-04-25T08:59:35.183849+0000","last_clean":"2024-04-25T08:59:35.183849+0000","last_became_active":"2024-04-25T08:59:32.462227+0000","last_became_peered":"2024-04-25T08:59:32.462227+0000","last_unstale":"2024-04-25T08:59:35.183849+0000","last_undegraded":"2024-04-25T08:59:35.183849+0000","last_fullsized":"2024-04-25T08:59:35.183849+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:50.687897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471144+0000","last_change":"2024-04-25T08:59:33.477587+0000","last_active":"2024-04-25T08:59:34.471144+0000","last_peered":"2024-04-25T08:59:34.471144+0000","last_clean":"2024-04-25T08:59:34.471144+0000","last_became_active":"2024-04-25T08:59:33.477320+0000","last_became_peered":"2024-04-25T08:59:33.477320+0000","last_unstale":"2024-04-25T08:59:34.471144+0000","last_undegraded":"2024-04-25T08:59:34.471144+0000","last_fullsized":"2024-04-25T08:59:34.471144+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:37.797255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183692+0000","last_change":"2024-04-25T08:59:32.462544+0000","last_active":"2024-04-25T08:59:35.183692+0000","last_peered":"2024-04-25T08:59:35.183692+0000","last_clean":"2024-04-25T08:59:35.183692+0000","last_became_active":"2024-04-25T08:59:32.462244+0000","last_became_peered":"2024-04-25T08:59:32.462244+0000","last_unstale":"2024-04-25T08:59:35.183692+0000","last_undegraded":"2024-04-25T08:59:35.183692+0000","last_fullsized":"2024-04-25T08:59:35.183692+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:13.383924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471360+0000","last_change":"2024-04-25T08:59:33.480479+0000","last_active":"2024-04-25T08:59:34.471360+0000","last_peered":"2024-04-25T08:59:34.471360+0000","last_clean":"2024-04-25T08:59:34.471360+0000","last_became_active":"2024-04-25T08:59:33.479941+0000","last_became_peered":"2024-04-25T08:59:33.479941+0000","last_unstale":"2024-04-25T08:59:34.471360+0000","last_undegraded":"2024-04-25T08:59:34.471360+0000","last_fullsized":"2024-04-25T08:59:34.471360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:55.839095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471500+0000","last_change":"2024-04-25T08:59:32.462940+0000","last_active":"2024-04-25T08:59:34.471500+0000","last_peered":"2024-04-25T08:59:34.471500+0000","last_clean":"2024-04-25T08:59:34.471500+0000","last_became_active":"2024-04-25T08:59:32.462642+0000","last_became_peered":"2024-04-25T08:59:32.462642+0000","last_unstale":"2024-04-25T08:59:34.471500+0000","last_undegraded":"2024-04-25T08:59:34.471500+0000","last_fullsized":"2024-04-25T08:59:34.471500+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:25.266567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.688942+0000","last_change":"2024-04-25T08:59:33.479219+0000","last_active":"2024-04-25T08:59:34.688942+0000","last_peered":"2024-04-25T08:59:34.688942+0000","last_clean":"2024-04-25T08:59:34.688942+0000","last_became_active":"2024-04-25T08:59:33.478959+0000","last_became_peered":"2024-04-25T08:59:33.478959+0000","last_unstale":"2024-04-25T08:59:34.688942+0000","last_undegraded":"2024-04-25T08:59:34.688942+0000","last_fullsized":"2024-04-25T08:59:34.688942+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:12.964055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471033+0000","last_change":"2024-04-25T08:59:32.464153+0000","last_active":"2024-04-25T08:59:34.471033+0000","last_peered":"2024-04-25T08:59:34.471033+0000","last_clean":"2024-04-25T08:59:34.471033+0000","last_became_active":"2024-04-25T08:59:32.463856+0000","last_became_peered":"2024-04-25T08:59:32.463856+0000","last_unstale":"2024-04-25T08:59:34.471033+0000","last_undegraded":"2024-04-25T08:59:34.471033+0000","last_fullsized":"2024-04-25T08:59:34.471033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:12.560960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183933+0000","last_change":"2024-04-25T08:59:33.488687+0000","last_active":"2024-04-25T08:59:35.183933+0000","last_peered":"2024-04-25T08:59:35.183933+0000","last_clean":"2024-04-25T08:59:35.183933+0000","last_became_active":"2024-04-25T08:59:33.488397+0000","last_became_peered":"2024-04-25T08:59:33.488397+0000","last_unstale":"2024-04-25T08:59:35.183933+0000","last_undegraded":"2024-04-25T08:59:35.183933+0000","last_fullsized":"2024-04-25T08:59:35.183933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:12.964055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470650+0000","last_change":"2024-04-25T08:59:32.459689+0000","last_active":"2024-04-25T08:59:34.470650+0000","last_peered":"2024-04-25T08:59:34.470650+0000","last_clean":"2024-04-25T08:59:34.470650+0000","last_became_active":"2024-04-25T08:59:32.459347+0000","last_became_peered":"2024-04-25T08:59:32.459347+0000","last_unstale":"2024-04-25T08:59:34.470650+0000","last_undegraded":"2024-04-25T08:59:34.470650+0000","last_fullsized":"2024-04-25T08:59:34.470650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:40.856799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183343+0000","last_change":"2024-04-25T08:59:33.487405+0000","last_active":"2024-04-25T08:59:35.183343+0000","last_peered":"2024-04-25T08:59:35.183343+0000","last_clean":"2024-04-25T08:59:35.183343+0000","last_became_active":"2024-04-25T08:59:33.487120+0000","last_became_peered":"2024-04-25T08:59:33.487120+0000","last_unstale":"2024-04-25T08:59:35.183343+0000","last_undegraded":"2024-04-25T08:59:35.183343+0000","last_fullsized":"2024-04-25T08:59:35.183343+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:55.574254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.689099+0000","last_change":"2024-04-25T08:59:32.458761+0000","last_active":"2024-04-25T08:59:34.689099+0000","last_peered":"2024-04-25T08:59:34.689099+0000","last_clean":"2024-04-25T08:59:34.689099+0000","last_became_active":"2024-04-25T08:59:32.458483+0000","last_became_peered":"2024-04-25T08:59:32.458483+0000","last_unstale":"2024-04-25T08:59:34.689099+0000","last_undegraded":"2024-04-25T08:59:34.689099+0000","last_fullsized":"2024-04-25T08:59:34.689099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:26.519284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184016+0000","last_change":"2024-04-25T08:59:33.484209+0000","last_active":"2024-04-25T08:59:35.184016+0000","last_peered":"2024-04-25T08:59:35.184016+0000","last_clean":"2024-04-25T08:59:35.184016+0000","last_became_active":"2024-04-25T08:59:33.483823+0000","last_became_peered":"2024-04-25T08:59:33.483823+0000","last_unstale":"2024-04-25T08:59:35.184016+0000","last_undegraded":"2024-04-25T08:59:35.184016+0000","last_fullsized":"2024-04-25T08:59:35.184016+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:28.073375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184160+0000","last_change":"2024-04-25T08:59:32.467559+0000","last_active":"2024-04-25T08:59:35.184160+0000","last_peered":"2024-04-25T08:59:35.184160+0000","last_clean":"2024-04-25T08:59:35.184160+0000","last_became_active":"2024-04-25T08:59:32.467260+0000","last_became_peered":"2024-04-25T08:59:32.467260+0000","last_unstale":"2024-04-25T08:59:35.184160+0000","last_undegraded":"2024-04-25T08:59:35.184160+0000","last_fullsized":"2024-04-25T08:59:35.184160+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:03.104349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471081+0000","last_change":"2024-04-25T08:59:33.485452+0000","last_active":"2024-04-25T08:59:34.471081+0000","last_peered":"2024-04-25T08:59:34.471081+0000","last_clean":"2024-04-25T08:59:34.471081+0000","last_became_active":"2024-04-25T08:59:33.485055+0000","last_became_peered":"2024-04-25T08:59:33.485055+0000","last_unstale":"2024-04-25T08:59:34.471081+0000","last_undegraded":"2024-04-25T08:59:34.471081+0000","last_fullsized":"2024-04-25T08:59:34.471081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:16.190343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471245+0000","last_change":"2024-04-25T08:59:32.466365+0000","last_active":"2024-04-25T08:59:34.471245+0000","last_peered":"2024-04-25T08:59:34.471245+0000","last_clean":"2024-04-25T08:59:34.471245+0000","last_became_active":"2024-04-25T08:59:32.466124+0000","last_became_peered":"2024-04-25T08:59:32.466124+0000","last_unstale":"2024-04-25T08:59:34.471245+0000","last_undegraded":"2024-04-25T08:59:34.471245+0000","last_fullsized":"2024-04-25T08:59:34.471245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:49.960557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183735+0000","last_change":"2024-04-25T08:59:33.480224+0000","last_active":"2024-04-25T08:59:35.183735+0000","last_peered":"2024-04-25T08:59:35.183735+0000","last_clean":"2024-04-25T08:59:35.183735+0000","last_became_active":"2024-04-25T08:59:33.479280+0000","last_became_peered":"2024-04-25T08:59:33.479280+0000","last_unstale":"2024-04-25T08:59:35.183735+0000","last_undegraded":"2024-04-25T08:59:35.183735+0000","last_fullsized":"2024-04-25T08:59:35.183735+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:56.159419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.689059+0000","last_change":"2024-04-25T08:59:32.463142+0000","last_active":"2024-04-25T08:59:34.689059+0000","last_peered":"2024-04-25T08:59:34.689059+0000","last_clean":"2024-04-25T08:59:34.689059+0000","last_became_active":"2024-04-25T08:59:32.462585+0000","last_became_peered":"2024-04-25T08:59:32.462585+0000","last_unstale":"2024-04-25T08:59:34.689059+0000","last_undegraded":"2024-04-25T08:59:34.689059+0000","last_fullsized":"2024-04-25T08:59:34.689059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:11.928530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183679+0000","last_change":"2024-04-25T08:59:33.486005+0000","last_active":"2024-04-25T08:59:35.183679+0000","last_peered":"2024-04-25T08:59:35.183679+0000","last_clean":"2024-04-25T08:59:35.183679+0000","last_became_active":"2024-04-25T08:59:33.485719+0000","last_became_peered":"2024-04-25T08:59:33.485719+0000","last_unstale":"2024-04-25T08:59:35.183679+0000","last_undegraded":"2024-04-25T08:59:35.183679+0000","last_fullsized":"2024-04-25T08:59:35.183679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:51.682721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183622+0000","last_change":"2024-04-25T08:59:32.464239+0000","last_active":"2024-04-25T08:59:35.183622+0000","last_peered":"2024-04-25T08:59:35.183622+0000","last_clean":"2024-04-25T08:59:35.183622+0000","last_became_active":"2024-04-25T08:59:32.463876+0000","last_became_peered":"2024-04-25T08:59:32.463876+0000","last_unstale":"2024-04-25T08:59:35.183622+0000","last_undegraded":"2024-04-25T08:59:35.183622+0000","last_fullsized":"2024-04-25T08:59:35.183622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:36.301017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470356+0000","last_change":"2024-04-25T08:59:33.482352+0000","last_active":"2024-04-25T08:59:34.470356+0000","last_peered":"2024-04-25T08:59:34.470356+0000","last_clean":"2024-04-25T08:59:34.470356+0000","last_became_active":"2024-04-25T08:59:33.482057+0000","last_became_peered":"2024-04-25T08:59:33.482057+0000","last_unstale":"2024-04-25T08:59:34.470356+0000","last_undegraded":"2024-04-25T08:59:34.470356+0000","last_fullsized":"2024-04-25T08:59:34.470356+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:09.843668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471551+0000","last_change":"2024-04-25T08:59:32.458378+0000","last_active":"2024-04-25T08:59:34.471551+0000","last_peered":"2024-04-25T08:59:34.471551+0000","last_clean":"2024-04-25T08:59:34.471551+0000","last_became_active":"2024-04-25T08:59:32.458100+0000","last_became_peered":"2024-04-25T08:59:32.458100+0000","last_unstale":"2024-04-25T08:59:34.471551+0000","last_undegraded":"2024-04-25T08:59:34.471551+0000","last_fullsized":"2024-04-25T08:59:34.471551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:34.920038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471429+0000","last_change":"2024-04-25T08:59:33.485007+0000","last_active":"2024-04-25T08:59:34.471429+0000","last_peered":"2024-04-25T08:59:34.471429+0000","last_clean":"2024-04-25T08:59:34.471429+0000","last_became_active":"2024-04-25T08:59:33.484663+0000","last_became_peered":"2024-04-25T08:59:33.484663+0000","last_unstale":"2024-04-25T08:59:34.471429+0000","last_undegraded":"2024-04-25T08:59:34.471429+0000","last_fullsized":"2024-04-25T08:59:34.471429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:12.964055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184384+0000","last_change":"2024-04-25T08:59:32.467240+0000","last_active":"2024-04-25T08:59:35.184384+0000","last_peered":"2024-04-25T08:59:35.184384+0000","last_clean":"2024-04-25T08:59:35.184384+0000","last_became_active":"2024-04-25T08:59:32.466929+0000","last_became_peered":"2024-04-25T08:59:32.466929+0000","last_unstale":"2024-04-25T08:59:35.184384+0000","last_undegraded":"2024-04-25T08:59:35.184384+0000","last_fullsized":"2024-04-25T08:59:35.184384+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:07.831365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183573+0000","last_change":"2024-04-25T08:59:33.480680+0000","last_active":"2024-04-25T08:59:35.183573+0000","last_peered":"2024-04-25T08:59:35.183573+0000","last_clean":"2024-04-25T08:59:35.183573+0000","last_became_active":"2024-04-25T08:59:33.480406+0000","last_became_peered":"2024-04-25T08:59:33.480406+0000","last_unstale":"2024-04-25T08:59:35.183573+0000","last_undegraded":"2024-04-25T08:59:35.183573+0000","last_fullsized":"2024-04-25T08:59:35.183573+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:11.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184131+0000","last_change":"2024-04-25T08:59:32.464604+0000","last_active":"2024-04-25T08:59:35.184131+0000","last_peered":"2024-04-25T08:59:35.184131+0000","last_clean":"2024-04-25T08:59:35.184131+0000","last_became_active":"2024-04-25T08:59:32.464269+0000","last_became_peered":"2024-04-25T08:59:32.464269+0000","last_unstale":"2024-04-25T08:59:35.184131+0000","last_undegraded":"2024-04-25T08:59:35.184131+0000","last_fullsized":"2024-04-25T08:59:35.184131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:15.797707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473554+0000","last_change":"2024-04-25T08:59:33.485631+0000","last_active":"2024-04-25T08:59:34.473554+0000","last_peered":"2024-04-25T08:59:34.473554+0000","last_clean":"2024-04-25T08:59:34.473554+0000","last_became_active":"2024-04-25T08:59:33.481772+0000","last_became_peered":"2024-04-25T08:59:33.481772+0000","last_unstale":"2024-04-25T08:59:34.473554+0000","last_undegraded":"2024-04-25T08:59:34.473554+0000","last_fullsized":"2024-04-25T08:59:34.473554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:24.257915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471365+0000","last_change":"2024-04-25T08:59:32.463576+0000","last_active":"2024-04-25T08:59:34.471365+0000","last_peered":"2024-04-25T08:59:34.471365+0000","last_clean":"2024-04-25T08:59:34.471365+0000","last_became_active":"2024-04-25T08:59:32.463274+0000","last_became_peered":"2024-04-25T08:59:32.463274+0000","last_unstale":"2024-04-25T08:59:34.471365+0000","last_undegraded":"2024-04-25T08:59:34.471365+0000","last_fullsized":"2024-04-25T08:59:34.471365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:43.153641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.688919+0000","last_change":"2024-04-25T08:59:33.480755+0000","last_active":"2024-04-25T08:59:34.688919+0000","last_peered":"2024-04-25T08:59:34.688919+0000","last_clean":"2024-04-25T08:59:34.688919+0000","last_became_active":"2024-04-25T08:59:33.480461+0000","last_became_peered":"2024-04-25T08:59:33.480461+0000","last_unstale":"2024-04-25T08:59:34.688919+0000","last_undegraded":"2024-04-25T08:59:34.688919+0000","last_fullsized":"2024-04-25T08:59:34.688919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:51.961543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473606+0000","last_change":"2024-04-25T08:59:32.461135+0000","last_active":"2024-04-25T08:59:34.473606+0000","last_peered":"2024-04-25T08:59:34.473606+0000","last_clean":"2024-04-25T08:59:34.473606+0000","last_became_active":"2024-04-25T08:59:32.460310+0000","last_became_peered":"2024-04-25T08:59:32.460310+0000","last_unstale":"2024-04-25T08:59:34.473606+0000","last_undegraded":"2024-04-25T08:59:34.473606+0000","last_fullsized":"2024-04-25T08:59:34.473606+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:42.156606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473311+0000","last_change":"2024-04-25T08:59:33.487545+0000","last_active":"2024-04-25T08:59:34.473311+0000","last_peered":"2024-04-25T08:59:34.473311+0000","last_clean":"2024-04-25T08:59:34.473311+0000","last_became_active":"2024-04-25T08:59:33.487195+0000","last_became_peered":"2024-04-25T08:59:33.487195+0000","last_unstale":"2024-04-25T08:59:34.473311+0000","last_undegraded":"2024-04-25T08:59:34.473311+0000","last_fullsized":"2024-04-25T08:59:34.473311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:51.912742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.473309+0000","last_change":"2024-04-25T08:59:32.460633+0000","last_active":"2024-04-25T08:59:34.473309+0000","last_peered":"2024-04-25T08:59:34.473309+0000","last_clean":"2024-04-25T08:59:34.473309+0000","last_became_active":"2024-04-25T08:59:32.460329+0000","last_became_peered":"2024-04-25T08:59:32.460329+0000","last_unstale":"2024-04-25T08:59:34.473309+0000","last_undegraded":"2024-04-25T08:59:34.473309+0000","last_fullsized":"2024-04-25T08:59:34.473309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:53.773940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.689011+0000","last_change":"2024-04-25T08:59:33.485286+0000","last_active":"2024-04-25T08:59:34.689011+0000","last_peered":"2024-04-25T08:59:34.689011+0000","last_clean":"2024-04-25T08:59:34.689011+0000","last_became_active":"2024-04-25T08:59:33.484962+0000","last_became_peered":"2024-04-25T08:59:33.484962+0000","last_unstale":"2024-04-25T08:59:34.689011+0000","last_undegraded":"2024-04-25T08:59:34.689011+0000","last_fullsized":"2024-04-25T08:59:34.689011+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:28.073375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471048+0000","last_change":"2024-04-25T08:59:32.464201+0000","last_active":"2024-04-25T08:59:34.471048+0000","last_peered":"2024-04-25T08:59:34.471048+0000","last_clean":"2024-04-25T08:59:34.471048+0000","last_became_active":"2024-04-25T08:59:32.463911+0000","last_became_peered":"2024-04-25T08:59:32.463911+0000","last_unstale":"2024-04-25T08:59:34.471048+0000","last_undegraded":"2024-04-25T08:59:34.471048+0000","last_fullsized":"2024-04-25T08:59:34.471048+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:03.978039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183495+0000","last_change":"2024-04-25T08:59:33.481688+0000","last_active":"2024-04-25T08:59:35.183495+0000","last_peered":"2024-04-25T08:59:35.183495+0000","last_clean":"2024-04-25T08:59:35.183495+0000","last_became_active":"2024-04-25T08:59:33.481355+0000","last_became_peered":"2024-04-25T08:59:33.481355+0000","last_unstale":"2024-04-25T08:59:35.183495+0000","last_undegraded":"2024-04-25T08:59:35.183495+0000","last_fullsized":"2024-04-25T08:59:35.183495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:12.964055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184293+0000","last_change":"2024-04-25T08:59:32.457315+0000","last_active":"2024-04-25T08:59:35.184293+0000","last_peered":"2024-04-25T08:59:35.184293+0000","last_clean":"2024-04-25T08:59:35.184293+0000","last_became_active":"2024-04-25T08:59:32.457020+0000","last_became_peered":"2024-04-25T08:59:32.457020+0000","last_unstale":"2024-04-25T08:59:35.184293+0000","last_undegraded":"2024-04-25T08:59:35.184293+0000","last_fullsized":"2024-04-25T08:59:35.184293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:55.885976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470420+0000","last_change":"2024-04-25T08:59:33.491914+0000","last_active":"2024-04-25T08:59:34.470420+0000","last_peered":"2024-04-25T08:59:34.470420+0000","last_clean":"2024-04-25T08:59:34.470420+0000","last_became_active":"2024-04-25T08:59:33.491596+0000","last_became_peered":"2024-04-25T08:59:33.491596+0000","last_unstale":"2024-04-25T08:59:34.470420+0000","last_undegraded":"2024-04-25T08:59:34.470420+0000","last_fullsized":"2024-04-25T08:59:34.470420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:04.984096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"87'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184658+0000","last_change":"2024-04-25T08:59:32.463012+0000","last_active":"2024-04-25T08:59:35.184658+0000","last_peered":"2024-04-25T08:59:35.184658+0000","last_clean":"2024-04-25T08:59:35.184658+0000","last_became_active":"2024-04-25T08:59:32.462704+0000","last_became_peered":"2024-04-25T08:59:32.462704+0000","last_unstale":"2024-04-25T08:59:35.184658+0000","last_undegraded":"2024-04-25T08:59:35.184658+0000","last_fullsized":"2024-04-25T08:59:35.184658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:07.061525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471220+0000","last_change":"2024-04-25T08:59:33.491700+0000","last_active":"2024-04-25T08:59:34.471220+0000","last_peered":"2024-04-25T08:59:34.471220+0000","last_clean":"2024-04-25T08:59:34.471220+0000","last_became_active":"2024-04-25T08:59:33.491448+0000","last_became_peered":"2024-04-25T08:59:33.491448+0000","last_unstale":"2024-04-25T08:59:34.471220+0000","last_undegraded":"2024-04-25T08:59:34.471220+0000","last_fullsized":"2024-04-25T08:59:34.471220+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:04.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470874+0000","last_change":"2024-04-25T08:59:32.459979+0000","last_active":"2024-04-25T08:59:34.470874+0000","last_peered":"2024-04-25T08:59:34.470874+0000","last_clean":"2024-04-25T08:59:34.470874+0000","last_became_active":"2024-04-25T08:59:32.459035+0000","last_became_peered":"2024-04-25T08:59:32.459035+0000","last_unstale":"2024-04-25T08:59:34.470874+0000","last_undegraded":"2024-04-25T08:59:34.470874+0000","last_fullsized":"2024-04-25T08:59:34.470874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:29.629464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183620+0000","last_change":"2024-04-25T08:59:33.486075+0000","last_active":"2024-04-25T08:59:35.183620+0000","last_peered":"2024-04-25T08:59:35.183620+0000","last_clean":"2024-04-25T08:59:35.183620+0000","last_became_active":"2024-04-25T08:59:33.485770+0000","last_became_peered":"2024-04-25T08:59:33.485770+0000","last_unstale":"2024-04-25T08:59:35.183620+0000","last_undegraded":"2024-04-25T08:59:35.183620+0000","last_fullsized":"2024-04-25T08:59:35.183620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:40.677654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471325+0000","last_change":"2024-04-25T08:59:32.462805+0000","last_active":"2024-04-25T08:59:34.471325+0000","last_peered":"2024-04-25T08:59:34.471325+0000","last_clean":"2024-04-25T08:59:34.471325+0000","last_became_active":"2024-04-25T08:59:32.462539+0000","last_became_peered":"2024-04-25T08:59:32.462539+0000","last_unstale":"2024-04-25T08:59:34.471325+0000","last_undegraded":"2024-04-25T08:59:34.471325+0000","last_fullsized":"2024-04-25T08:59:34.471325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:44.042275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.688916+0000","last_change":"2024-04-25T08:59:33.477267+0000","last_active":"2024-04-25T08:59:34.688916+0000","last_peered":"2024-04-25T08:59:34.688916+0000","last_clean":"2024-04-25T08:59:34.688916+0000","last_became_active":"2024-04-25T08:59:33.476984+0000","last_became_peered":"2024-04-25T08:59:33.476984+0000","last_unstale":"2024-04-25T08:59:34.688916+0000","last_undegraded":"2024-04-25T08:59:34.688916+0000","last_fullsized":"2024-04-25T08:59:34.688916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:55.574254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184210+0000","last_change":"2024-04-25T08:59:32.465049+0000","last_active":"2024-04-25T08:59:35.184210+0000","last_peered":"2024-04-25T08:59:35.184210+0000","last_clean":"2024-04-25T08:59:35.184210+0000","last_became_active":"2024-04-25T08:59:32.464006+0000","last_became_peered":"2024-04-25T08:59:32.464006+0000","last_unstale":"2024-04-25T08:59:35.184210+0000","last_undegraded":"2024-04-25T08:59:35.184210+0000","last_fullsized":"2024-04-25T08:59:35.184210+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:00.522733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184167+0000","last_change":"2024-04-25T08:59:33.483344+0000","last_active":"2024-04-25T08:59:35.184167+0000","last_peered":"2024-04-25T08:59:35.184167+0000","last_clean":"2024-04-25T08:59:35.184167+0000","last_became_active":"2024-04-25T08:59:33.483070+0000","last_became_peered":"2024-04-25T08:59:33.483070+0000","last_unstale":"2024-04-25T08:59:35.184167+0000","last_undegraded":"2024-04-25T08:59:35.184167+0000","last_fullsized":"2024-04-25T08:59:35.184167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:01.380348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183211+0000","last_change":"2024-04-25T08:59:32.465761+0000","last_active":"2024-04-25T08:59:35.183211+0000","last_peered":"2024-04-25T08:59:35.183211+0000","last_clean":"2024-04-25T08:59:35.183211+0000","last_became_active":"2024-04-25T08:59:32.465411+0000","last_became_peered":"2024-04-25T08:59:32.465411+0000","last_unstale":"2024-04-25T08:59:35.183211+0000","last_undegraded":"2024-04-25T08:59:35.183211+0000","last_fullsized":"2024-04-25T08:59:35.183211+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:50.953911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470603+0000","last_change":"2024-04-25T08:59:33.481868+0000","last_active":"2024-04-25T08:59:34.470603+0000","last_peered":"2024-04-25T08:59:34.470603+0000","last_clean":"2024-04-25T08:59:34.470603+0000","last_became_active":"2024-04-25T08:59:33.481590+0000","last_became_peered":"2024-04-25T08:59:33.481590+0000","last_unstale":"2024-04-25T08:59:34.470603+0000","last_undegraded":"2024-04-25T08:59:34.470603+0000","last_fullsized":"2024-04-25T08:59:34.470603+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:50.966614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471390+0000","last_change":"2024-04-25T08:59:32.463330+0000","last_active":"2024-04-25T08:59:34.471390+0000","last_peered":"2024-04-25T08:59:34.471390+0000","last_clean":"2024-04-25T08:59:34.471390+0000","last_became_active":"2024-04-25T08:59:32.463073+0000","last_became_peered":"2024-04-25T08:59:32.463073+0000","last_unstale":"2024-04-25T08:59:34.471390+0000","last_undegraded":"2024-04-25T08:59:34.471390+0000","last_fullsized":"2024-04-25T08:59:34.471390+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:44.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.471335+0000","last_change":"2024-04-25T08:59:33.493939+0000","last_active":"2024-04-25T08:59:34.471335+0000","last_peered":"2024-04-25T08:59:34.471335+0000","last_clean":"2024-04-25T08:59:34.471335+0000","last_became_active":"2024-04-25T08:59:33.493207+0000","last_became_peered":"2024-04-25T08:59:33.493207+0000","last_unstale":"2024-04-25T08:59:34.471335+0000","last_undegraded":"2024-04-25T08:59:34.471335+0000","last_fullsized":"2024-04-25T08:59:34.471335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:51.961543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.183133+0000","last_change":"2024-04-25T08:59:32.461693+0000","last_active":"2024-04-25T08:59:35.183133+0000","last_peered":"2024-04-25T08:59:35.183133+0000","last_clean":"2024-04-25T08:59:35.183133+0000","last_became_active":"2024-04-25T08:59:32.461445+0000","last_became_peered":"2024-04-25T08:59:32.461445+0000","last_unstale":"2024-04-25T08:59:35.183133+0000","last_undegraded":"2024-04-25T08:59:35.183133+0000","last_fullsized":"2024-04-25T08:59:35.183133+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:44.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:35.184430+0000","last_change":"2024-04-25T08:59:33.477566+0000","last_active":"2024-04-25T08:59:35.184430+0000","last_peered":"2024-04-25T08:59:35.184430+0000","last_clean":"2024-04-25T08:59:35.184430+0000","last_became_active":"2024-04-25T08:59:33.477287+0000","last_became_peered":"2024-04-25T08:59:33.477287+0000","last_unstale":"2024-04-25T08:59:35.184430+0000","last_undegraded":"2024-04-25T08:59:35.184430+0000","last_fullsized":"2024-04-25T08:59:35.184430+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:32.444052+0000","last_clean_scrub_stamp":"2024-04-25T08:59:32.444052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:55.854836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470620+0000","last_change":"2024-04-25T08:59:32.465998+0000","last_active":"2024-04-25T08:59:34.470620+0000","last_peered":"2024-04-25T08:59:34.470620+0000","last_clean":"2024-04-25T08:59:34.470620+0000","last_became_active":"2024-04-25T08:59:32.465578+0000","last_became_peered":"2024-04-25T08:59:32.465578+0000","last_unstale":"2024-04-25T08:59:34.470620+0000","last_undegraded":"2024-04-25T08:59:34.470620+0000","last_fullsized":"2024-04-25T08:59:34.470620+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:59:31.437995+0000","last_clean_scrub_stamp":"2024-04-25T08:59:31.437995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:16.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":289,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T08:59:34.470812+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T08:59:34.470812+0000","last_peered":"2024-04-25T08:59:34.470812+0000","last_clean":"2024-04-25T08:59:34.470812+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T08:59:34.470812+0000","last_undegraded":"2024-04-25T08:59:34.470812+0000","last_fullsized":"2024-04-25T08:59:34.470812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509518,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1658880,"data_stored":1041744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509516,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":452000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509518,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":452940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509517,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":451306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509517,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":452918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509519,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1064960,"data_stored":451888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1658880,"data_stored":1041708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":451500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:59:41.241 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:59:41.242 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:59:41.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.397+0000 7fa3b2d32640 1 Processor -- start 2024-04-25T08:59:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.397+0000 7fa3b2d32640 1 -- start start 2024-04-25T08:59:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.398+0000 7fa3b2d32640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3ac0d0b30 0x7fa3ac0b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.398+0000 7fa3b2d32640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac15e070 con 0x7fa3ac0b9290 2024-04-25T08:59:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.398+0000 7fa3b2d32640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac0d1b10 con 0x7fa3ac15dc90 2024-04-25T08:59:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.398+0000 7fa3b2d32640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac0d1df0 con 0x7fa3ac0d0b30 2024-04-25T08:59:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.398+0000 7fa3b12cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3ac0d0b30 0x7fa3ac0b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.398+0000 7fa3b12cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3ac0d0b30 0x7fa3ac0b6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60290/0 (socket says 172.21.15.55:60290) 2024-04-25T08:59:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.398+0000 7fa3b12cf640 1 -- 172.21.15.55:0/1633912034 learned_addr learned my addr 172.21.15.55:0/1633912034 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.398+0000 7fa3abfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa3ac0b9290 0x7fa3ac0d0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49780/0 (socket says 172.21.15.55:49780) 2024-04-25T08:59:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.399+0000 7fa3b12cf640 1 -- 172.21.15.55:0/1633912034 >> v1:172.21.15.167:6789/0 conn(0x7fa3ac15dc90 legacy=0x7fa3ac0d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.399+0000 7fa3b12cf640 1 -- 172.21.15.55:0/1633912034 >> v1:172.21.15.55:6789/0 conn(0x7fa3ac0b9290 legacy=0x7fa3ac0d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.399+0000 7fa3b12cf640 1 -- 172.21.15.55:0/1633912034 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0d20d0 con 0x7fa3ac0d0b30 2024-04-25T08:59:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.399+0000 7fa3b12cf640 1 --2- 172.21.15.55:0/1633912034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac0d0b30 0x7fa3ac0b6aa0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa394009870 tx=0x7fa39402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516c89399399713d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.399+0000 7fa3ab7fe640 1 -- 172.21.15.55:0/1633912034 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394037070 con 0x7fa3ac0d0b30 2024-04-25T08:59:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.399+0000 7fa3ab7fe640 1 -- 172.21.15.55:0/1633912034 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa394032440 con 0x7fa3ac0d0b30 2024-04-25T08:59:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.399+0000 7fa3ab7fe640 1 -- 172.21.15.55:0/1633912034 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394032810 con 0x7fa3ac0d0b30 2024-04-25T08:59:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.400+0000 7fa3b2d32640 1 -- 172.21.15.55:0/1633912034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac0d0b30 msgr2=0x7fa3ac0b6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.400+0000 7fa3b2d32640 1 --2- 172.21.15.55:0/1633912034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac0d0b30 0x7fa3ac0b6aa0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa394009870 tx=0x7fa39402a2a0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.400+0000 7fa3b2d32640 1 -- 172.21.15.55:0/1633912034 shutdown_connections 2024-04-25T08:59:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.400+0000 7fa3b2d32640 1 --2- 172.21.15.55:0/1633912034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac0d0b30 0x7fa3ac0b6aa0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.400+0000 7fa3b2d32640 1 -- 172.21.15.55:0/1633912034 >> 172.21.15.55:0/1633912034 conn(0x7fa3ac072900 msgr2=0x7fa3ac06c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.400+0000 7fa3b2d32640 1 -- 172.21.15.55:0/1633912034 shutdown_connections 2024-04-25T08:59:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.400+0000 7fa3b2d32640 1 -- 172.21.15.55:0/1633912034 wait complete. 2024-04-25T08:59:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.401+0000 7fa3b2d32640 1 Processor -- start 2024-04-25T08:59:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.401+0000 7fa3b2d32640 1 -- start start 2024-04-25T08:59:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.402+0000 7fa3b2d32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3ac0b9290 0x7fa3ac153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.402+0000 7fa3b2d32640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3ac0d0b30 0x7fa3ac15f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.402+0000 7fa3b2d32640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac15dc90 0x7fa3ac160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.402+0000 7fa3b2d32640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0d3480 con 0x7fa3ac15dc90 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.402+0000 7fa3b2d32640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0d2690 con 0x7fa3ac0b9290 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.402+0000 7fa3b2d32640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0d3600 con 0x7fa3ac0d0b30 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.402+0000 7fa3b12cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac15dc90 0x7fa3ac160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.402+0000 7fa3b12cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac15dc90 0x7fa3ac160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60306/0 (socket says 172.21.15.55:60306) 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.402+0000 7fa3b12cf640 1 -- 172.21.15.55:0/141826042 learned_addr learned my addr 172.21.15.55:0/141826042 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.402+0000 7fa3b0ace640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3ac0b9290 0x7fa3ac153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.402+0000 7fa3abfff640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3ac0d0b30 0x7fa3ac15f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3b12cf640 1 -- 172.21.15.55:0/141826042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3ac0d0b30 msgr2=0x7fa3ac15f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3b12cf640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3ac0d0b30 0x7fa3ac15f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3b12cf640 1 -- 172.21.15.55:0/141826042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3ac0b9290 msgr2=0x7fa3ac153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3b12cf640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3ac0b9290 0x7fa3ac153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3b12cf640 1 -- 172.21.15.55:0/141826042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac15e4b0 con 0x7fa3ac15dc90 2024-04-25T08:59:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3b0ace640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3ac0b9290 0x7fa3ac153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3b12cf640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac15dc90 0x7fa3ac160650 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa394009870 tx=0x7fa3940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3a97fa640 1 -- 172.21.15.55:0/141826042 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394037040 con 0x7fa3ac15dc90 2024-04-25T08:59:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3a97fa640 1 -- 172.21.15.55:0/141826042 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa394042070 con 0x7fa3ac15dc90 2024-04-25T08:59:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3b2d32640 1 -- 172.21.15.55:0/141826042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac15e790 con 0x7fa3ac15dc90 2024-04-25T08:59:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3a97fa640 1 -- 172.21.15.55:0/141826042 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394030c90 con 0x7fa3ac15dc90 2024-04-25T08:59:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.403+0000 7fa3b2d32640 1 -- 172.21.15.55:0/141826042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac15ed50 con 0x7fa3ac15dc90 2024-04-25T08:59:41.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.404+0000 7fa3b2d32640 1 -- 172.21.15.55:0/141826042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac15e240 con 0x7fa3ac15dc90 2024-04-25T08:59:41.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.404+0000 7fa3a97fa640 1 -- 172.21.15.55:0/141826042 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa394047460 con 0x7fa3ac15dc90 2024-04-25T08:59:41.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.405+0000 7fa3a97fa640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b4d0 0x7fa38c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.405+0000 7fa3a97fa640 1 -- 172.21.15.55:0/141826042 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3940aaec0 con 0x7fa3ac15dc90 2024-04-25T08:59:41.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.405+0000 7fa3b0ace640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b4d0 0x7fa38c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.405+0000 7fa3b0ace640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b4d0 0x7fa38c06d990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4006fd0 tx=0x7fa3a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.409+0000 7fa3a97fa640 1 -- 172.21.15.55:0/141826042 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa3940796f0 con 0x7fa3ac15dc90 2024-04-25T08:59:41.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.659+0000 7fa3b2d32640 1 -- 172.21.15.55:0/141826042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa3ac0d0550 con 0x7fa3ac15dc90 2024-04-25T08:59:41.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.662+0000 7fa3a97fa640 1 -- 172.21.15.55:0/141826042 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa39407d790 con 0x7fa3ac15dc90 2024-04-25T08:59:41.651 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-04-25T08:59:41.651 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw== 2024-04-25T08:59:41.651 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2024-04-25T08:59:41.651 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2024-04-25T08:59:41.651 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:59:41.652 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-25T08:59:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 -- 172.21.15.55:0/141826042 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b4d0 msgr2=0x7fa38c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b4d0 0x7fa38c06d990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4006fd0 tx=0x7fa3a4008040 comp rx=0 tx=0).stop 2024-04-25T08:59:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 -- 172.21.15.55:0/141826042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac15dc90 msgr2=0x7fa3ac160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac15dc90 0x7fa3ac160650 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa394009870 tx=0x7fa3940046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 -- 172.21.15.55:0/141826042 shutdown_connections 2024-04-25T08:59:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b4d0 0x7fa38c06d990 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac15dc90 0x7fa3ac160650 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3ac0d0b30 0x7fa3ac15f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 --2- 172.21.15.55:0/141826042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3ac0b9290 0x7fa3ac153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 -- 172.21.15.55:0/141826042 >> 172.21.15.55:0/141826042 conn(0x7fa3ac072900 msgr2=0x7fa3ac0c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 -- 172.21.15.55:0/141826042 shutdown_connections 2024-04-25T08:59:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.664+0000 7fa3b2d32640 1 -- 172.21.15.55:0/141826042 wait complete. 2024-04-25T08:59:41.664 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:41.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.776+0000 7f8ee8f4f640 1 Processor -- start 2024-04-25T08:59:41.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.776+0000 7f8ee8f4f640 1 -- start start 2024-04-25T08:59:41.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.777+0000 7f8ee8f4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee415bd40 0x7f8ee409a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.777+0000 7f8ee8f4f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ee4099e20 0x7f8ee40cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.777+0000 7f8ee8f4f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee40cfb90 con 0x7f8ee4099a40 2024-04-25T08:59:41.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.777+0000 7f8ee8f4f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee415cfd0 con 0x7f8ee4099e20 2024-04-25T08:59:41.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.777+0000 7f8ee8f4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee415c210 con 0x7f8ee415bd40 2024-04-25T08:59:41.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.777+0000 7f8ee2d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ee4099e20 0x7f8ee40cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.777+0000 7f8ed9d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee415bd40 0x7f8ee409a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.777+0000 7f8ed9d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee415bd40 0x7f8ee409a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:33548/0 (socket says 172.21.15.55:33548) 2024-04-25T08:59:41.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.777+0000 7f8ed9d9b640 1 -- 172.21.15.55:0/1685419553 learned_addr learned my addr 172.21.15.55:0/1685419553 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.777+0000 7f8ee259c640 1 --1- 172.21.15.55:0/1685419553 >> v1:172.21.15.167:6789/0 conn(0x7f8ee4099a40 0x7f8ee40cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:33710/0 (socket says 172.21.15.55:33710) 2024-04-25T08:59:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.778+0000 7f8ed9d9b640 1 -- 172.21.15.55:0/1685419553 >> v2:172.21.15.167:3300/0 conn(0x7f8ee4099e20 msgr2=0x7f8ee40cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.778+0000 7f8ed9d9b640 1 --2- 172.21.15.55:0/1685419553 >> v2:172.21.15.167:3300/0 conn(0x7f8ee4099e20 0x7f8ee40cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.778+0000 7f8ed9d9b640 1 -- 172.21.15.55:0/1685419553 >> v1:172.21.15.167:6789/0 conn(0x7f8ee4099a40 legacy=0x7f8ee40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.778+0000 7f8ed9d9b640 1 -- 172.21.15.55:0/1685419553 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee415c4f0 con 0x7f8ee415bd40 2024-04-25T08:59:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.778+0000 7f8ee2d9d640 1 --2- 172.21.15.55:0/1685419553 >> v2:172.21.15.167:3300/0 conn(0x7f8ee4099e20 0x7f8ee40cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:59:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ed9d9b640 1 --2- 172.21.15.55:0/1685419553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee415bd40 0x7f8ee409a9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009870 tx=0x7f8ecc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8be4e81a932b6ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ee1d9b640 1 -- 172.21.15.55:0/1685419553 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc037070 con 0x7f8ee415bd40 2024-04-25T08:59:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ee1d9b640 1 -- 172.21.15.55:0/1685419553 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc032440 con 0x7f8ee415bd40 2024-04-25T08:59:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ee1d9b640 1 -- 172.21.15.55:0/1685419553 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc032810 con 0x7f8ee415bd40 2024-04-25T08:59:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1685419553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee415bd40 msgr2=0x7f8ee409a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ee8f4f640 1 --2- 172.21.15.55:0/1685419553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee415bd40 0x7f8ee409a9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009870 tx=0x7f8ecc02a1c0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1685419553 shutdown_connections 2024-04-25T08:59:41.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ee8f4f640 1 --2- 172.21.15.55:0/1685419553 >> v2:172.21.15.167:3300/0 conn(0x7f8ee4099e20 0x7f8ee40cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ee8f4f640 1 --2- 172.21.15.55:0/1685419553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee415bd40 0x7f8ee409a9c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1685419553 >> 172.21.15.55:0/1685419553 conn(0x7f8ee40b32f0 msgr2=0x7f8ee40b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1685419553 shutdown_connections 2024-04-25T08:59:41.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.779+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1685419553 wait complete. 2024-04-25T08:59:41.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.781+0000 7f8ee8f4f640 1 Processor -- start 2024-04-25T08:59:41.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.781+0000 7f8ee8f4f640 1 -- start start 2024-04-25T08:59:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee8f4f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee4099a40 0x7f8ee40c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee8f4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee4099e20 0x7f8ee40c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee8f4f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ee415bd40 0x7f8ee414ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee8f4f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee409a2b0 con 0x7f8ee4099a40 2024-04-25T08:59:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee8f4f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee415cab0 con 0x7f8ee415bd40 2024-04-25T08:59:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee8f4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40cc930 con 0x7f8ee4099e20 2024-04-25T08:59:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee4099a40 0x7f8ee40c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee4099a40 0x7f8ee40c9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60312/0 (socket says 172.21.15.55:60312) 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee259c640 1 -- 172.21.15.55:0/1765920173 learned_addr learned my addr 172.21.15.55:0/1765920173 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee2d9d640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ee415bd40 0x7f8ee414ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ed9d9b640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee4099e20 0x7f8ee40c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee259c640 1 -- 172.21.15.55:0/1765920173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee4099e20 msgr2=0x7f8ee40c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee259c640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee4099e20 0x7f8ee40c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee259c640 1 -- 172.21.15.55:0/1765920173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ee415bd40 msgr2=0x7f8ee414ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee259c640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ee415bd40 0x7f8ee414ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee259c640 1 -- 172.21.15.55:0/1765920173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40c5ad0 con 0x7f8ee4099a40 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee259c640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee4099a40 0x7f8ee40c9670 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c400 tx=0x7f8ed400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8edb7fe640 1 -- 172.21.15.55:0/1765920173 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40074e0 con 0x7f8ee4099a40 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8edb7fe640 1 -- 172.21.15.55:0/1765920173 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed4007680 con 0x7f8ee4099a40 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1765920173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee40c5db0 con 0x7f8ee4099a40 2024-04-25T08:59:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.782+0000 7f8edb7fe640 1 -- 172.21.15.55:0/1765920173 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4004a00 con 0x7f8ee4099a40 2024-04-25T08:59:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.783+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1765920173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee40c6370 con 0x7f8ee4099a40 2024-04-25T08:59:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.784+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1765920173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee40749b0 con 0x7f8ee4099a40 2024-04-25T08:59:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.784+0000 7f8edb7fe640 1 -- 172.21.15.55:0/1765920173 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ed401a020 con 0x7f8ee4099a40 2024-04-25T08:59:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.784+0000 7f8edb7fe640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ec406b4d0 0x7f8ec406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.784+0000 7f8edb7fe640 1 -- 172.21.15.55:0/1765920173 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ed4089800 con 0x7f8ee4099a40 2024-04-25T08:59:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.784+0000 7f8ed9d9b640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ec406b4d0 0x7f8ec406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.785+0000 7f8ed9d9b640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ec406b4d0 0x7f8ec406d990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc034000 tx=0x7f8ecc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:41.788+0000 7f8edb7fe640 1 -- 172.21.15.55:0/1765920173 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ed4058710 con 0x7f8ee4099a40 2024-04-25T08:59:41.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.004+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1765920173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ee409a570 con 0x7f8ee4099a40 2024-04-25T08:59:41.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.004+0000 7f8edb7fe640 1 -- 172.21.15.55:0/1765920173 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f8ed4058010 con 0x7f8ee4099a40 2024-04-25T08:59:41.994 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:41.994 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T08:59:34.832597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7323":{"gid":7323,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3953928431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3953928431},{"type":"v1","addr":"172.21.15.55:6837","nonce":3953928431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:59:41.994 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2024-04-25T08:59:41.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1765920173 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ec406b4d0 msgr2=0x7f8ec406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ec406b4d0 0x7f8ec406d990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc034000 tx=0x7f8ecc02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1765920173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee4099a40 msgr2=0x7f8ee40c9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee4099a40 0x7f8ee40c9670 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c400 tx=0x7f8ed400c800 comp rx=0 tx=0).stop 2024-04-25T08:59:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1765920173 shutdown_connections 2024-04-25T08:59:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8ec406b4d0 0x7f8ec406d990 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ee415bd40 0x7f8ee414ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ee4099e20 0x7f8ee40c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 --2- 172.21.15.55:0/1765920173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee4099a40 0x7f8ee40c9670 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1765920173 >> 172.21.15.55:0/1765920173 conn(0x7f8ee40b32f0 msgr2=0x7f8ee4070bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1765920173 shutdown_connections 2024-04-25T08:59:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.006+0000 7f8ee8f4f640 1 -- 172.21.15.55:0/1765920173 wait complete. 2024-04-25T08:59:42.409 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:59:32.818559+0000', 'modified': '2024-04-25T08:59:34.832597+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7323}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7323': {'gid': 7323, 'name': 'c', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/3953928431', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 3953928431}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3953928431}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:59:42.409 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:59:42.409 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T08:59:42.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.526+0000 7f14df86f640 1 Processor -- start 2024-04-25T08:59:42.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.526+0000 7f14df86f640 1 -- start start 2024-04-25T08:59:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.527+0000 7f14df86f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f14d815dc50 0x7f14d8070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.527+0000 7f14df86f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d8162690 con 0x7f14d80cd940 2024-04-25T08:59:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.527+0000 7f14df86f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d806c220 con 0x7f14d80cf600 2024-04-25T08:59:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.527+0000 7f14df86f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d80cfe00 con 0x7f14d815dc50 2024-04-25T08:59:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.527+0000 7f14dce0a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f14d80cd940 0x7f14d8161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49792/0 (socket says 172.21.15.55:49792) 2024-04-25T08:59:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.527+0000 7f14dce0a640 1 -- 172.21.15.55:0/3020717267 learned_addr learned my addr 172.21.15.55:0/3020717267 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.527+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235815129 0 0) 0x7f14d8162690 con 0x7f14d80cd940 2024-04-25T08:59:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.527+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c4003520 con 0x7f14d80cd940 2024-04-25T08:59:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.527+0000 7f14dd60b640 1 --2- 172.21.15.55:0/3020717267 >> v2:172.21.15.167:3300/0 conn(0x7f14d815dc50 0x7f14d8070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3585953295 0 0) 0x7f14c4003520 con 0x7f14d80cd940 2024-04-25T08:59:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 >> v2:172.21.15.167:3300/0 conn(0x7f14d815dc50 msgr2=0x7f14d8070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 --2- 172.21.15.55:0/3020717267 >> v2:172.21.15.167:3300/0 conn(0x7f14d815dc50 0x7f14d8070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 >> v1:172.21.15.167:6789/0 conn(0x7f14d80cf600 legacy=0x7f14d8161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80cec10 con 0x7f14d80cd940 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f14c8001670 con 0x7f14d80cd940 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 >> v1:172.21.15.55:6789/0 conn(0x7f14d80cd940 legacy=0x7f14d8161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 --2- 172.21.15.55:0/3020717267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40039b0 0x7f14c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 --2- 172.21.15.55:0/3020717267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c4004800 0x7f14c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 --2- 172.21.15.55:0/3020717267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c40051c0 0x7f14c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80cfe00 con 0x7f14c4004800 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c400c160 con 0x7f14c40039b0 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c400c360 con 0x7f14c40051c0 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14dce0a640 1 --2- 172.21.15.55:0/3020717267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c4004800 0x7f14c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14dd60b640 1 --2- 172.21.15.55:0/3020717267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40039b0 0x7f14c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14dde0c640 1 --2- 172.21.15.55:0/3020717267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c40051c0 0x7f14c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14dce0a640 1 -- 172.21.15.55:0/3020717267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c40051c0 msgr2=0x7f14c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14dce0a640 1 --2- 172.21.15.55:0/3020717267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c40051c0 0x7f14c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14dce0a640 1 -- 172.21.15.55:0/3020717267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40039b0 msgr2=0x7f14c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14dce0a640 1 --2- 172.21.15.55:0/3020717267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14c40039b0 0x7f14c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14dce0a640 1 -- 172.21.15.55:0/3020717267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c4003520 con 0x7f14c4004800 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.528+0000 7f14dde0c640 1 -- 172.21.15.55:0/3020717267 reap_dead start 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.529+0000 7f14dce0a640 1 --2- 172.21.15.55:0/3020717267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c4004800 0x7f14c4004c80 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c210 tx=0x7f14c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ae5ca509d2f260 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.529+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8007d30 con 0x7f14c4004800 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.529+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c80058d0 con 0x7f14c4004800 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.529+0000 7f14cffff640 1 -- 172.21.15.55:0/3020717267 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8005d20 con 0x7f14c4004800 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.530+0000 7f14df86f640 1 -- 172.21.15.55:0/3020717267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c4004800 msgr2=0x7f14c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.530+0000 7f14df86f640 1 --2- 172.21.15.55:0/3020717267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c4004800 0x7f14c4004c80 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c210 tx=0x7f14c4005830 comp rx=0 tx=0).stop 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.530+0000 7f14df86f640 1 -- 172.21.15.55:0/3020717267 shutdown_connections 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.530+0000 7f14df86f640 1 --2- 172.21.15.55:0/3020717267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14c4004800 0x7f14c4004c80 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.530+0000 7f14df86f640 1 -- 172.21.15.55:0/3020717267 >> 172.21.15.55:0/3020717267 conn(0x7f14d806f430 msgr2=0x7f14d806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.530+0000 7f14df86f640 1 -- 172.21.15.55:0/3020717267 shutdown_connections 2024-04-25T08:59:42.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.530+0000 7f14df86f640 1 -- 172.21.15.55:0/3020717267 wait complete. 2024-04-25T08:59:42.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.531+0000 7f14df86f640 1 Processor -- start 2024-04-25T08:59:42.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.531+0000 7f14df86f640 1 -- start start 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14df86f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c4004800 0x7f14d80b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14df86f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14d80b2490 0x7f14d80b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14df86f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d80c6930 0x7f14d80c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14df86f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80cc0c0 con 0x7f14d80b2490 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14df86f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80d0330 con 0x7f14d80c6930 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14df86f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80ce8a0 con 0x7f14c4004800 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dce0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14d80b2490 0x7f14d80b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dce0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14d80b2490 0x7f14d80b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60330/0 (socket says 172.21.15.55:60330) 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dce0a640 1 -- 172.21.15.55:0/2701541469 learned_addr learned my addr 172.21.15.55:0/2701541469 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dde0c640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d80c6930 0x7f14d80c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dd60b640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c4004800 0x7f14d80b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dce0a640 1 -- 172.21.15.55:0/2701541469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c4004800 msgr2=0x7f14d80b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dce0a640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c4004800 0x7f14d80b64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dce0a640 1 -- 172.21.15.55:0/2701541469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d80c6930 msgr2=0x7f14d80c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dce0a640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d80c6930 0x7f14d80c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dce0a640 1 -- 172.21.15.55:0/2701541469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80b4460 con 0x7f14d80b2490 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dd60b640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c4004800 0x7f14d80b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14dce0a640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14d80b2490 0x7f14d80b28f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f14c802adf0 tx=0x7f14c8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14cdffb640 1 -- 172.21.15.55:0/2701541469 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8038040 con 0x7f14d80b2490 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.532+0000 7f14cdffb640 1 -- 172.21.15.55:0/2701541469 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8043070 con 0x7f14d80b2490 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.533+0000 7f14df86f640 1 -- 172.21.15.55:0/2701541469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d80c7720 con 0x7f14d80b2490 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.533+0000 7f14cdffb640 1 -- 172.21.15.55:0/2701541469 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c80072b0 con 0x7f14d80b2490 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.533+0000 7f14df86f640 1 -- 172.21.15.55:0/2701541469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d80c7ce0 con 0x7f14d80b2490 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.534+0000 7f14cdffb640 1 -- 172.21.15.55:0/2701541469 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f14c8007450 con 0x7f14d80b2490 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.535+0000 7f14cdffb640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14bc06b500 0x7f14bc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.535+0000 7f14cdffb640 1 -- 172.21.15.55:0/2701541469 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14c80aa320 con 0x7f14d80b2490 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.535+0000 7f14dd60b640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14bc06b500 0x7f14bc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.535+0000 7f14dd60b640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14bc06b500 0x7f14bc06d9c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009bc0 tx=0x7f14d4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.536+0000 7f14e2572740 1 Processor -- start 2024-04-25T08:59:42.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.536+0000 7f14e2572740 1 -- start start 2024-04-25T08:59:42.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.536+0000 7f14e2572740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be20230 0x562f7be20610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.536+0000 7f14e2572740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be3dad0 0x562f7be3e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.536+0000 7f14e2572740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7bdf5f10 0x562f7be3c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.536+0000 7f14e2572740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f7bd58a10 con 0x562f7bdf5f10 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.536+0000 7f14e2572740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f7bd01b30 con 0x562f7be20230 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.536+0000 7f14e2572740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f7bd54c50 con 0x562f7be3dad0 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.536+0000 7f14dde0c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7bdf5f10 0x562f7be3c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.536+0000 7f14dde0c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7bdf5f10 0x562f7be3c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60340/0 (socket says 172.21.15.55:60340) 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.536+0000 7f14dde0c640 1 -- 172.21.15.55:0/361034150 learned_addr learned my addr 172.21.15.55:0/361034150 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14dd60b640 1 --2- 172.21.15.55:0/361034150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be20230 0x562f7be20610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14dce0a640 1 --2- 172.21.15.55:0/361034150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be3dad0 0x562f7be3e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14dde0c640 1 -- 172.21.15.55:0/361034150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be3dad0 msgr2=0x562f7be3e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14dde0c640 1 --2- 172.21.15.55:0/361034150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be3dad0 0x562f7be3e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14dde0c640 1 -- 172.21.15.55:0/361034150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be20230 msgr2=0x562f7be20610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14dde0c640 1 --2- 172.21.15.55:0/361034150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be20230 0x562f7be20610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14dde0c640 1 -- 172.21.15.55:0/361034150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f7bd16e10 con 0x562f7bdf5f10 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14dde0c640 1 --2- 172.21.15.55:0/361034150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7bdf5f10 0x562f7be3c190 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f14d80b4430 tx=0x7f14d0001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57d7539e943fc3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14c2ffd640 1 -- 172.21.15.55:0/361034150 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0012e30 con 0x562f7bdf5f10 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14c2ffd640 1 -- 172.21.15.55:0/361034150 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d0006b50 con 0x562f7bdf5f10 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14c2ffd640 1 -- 172.21.15.55:0/361034150 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0003970 con 0x562f7bdf5f10 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14e2572740 1 -- 172.21.15.55:0/361034150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7bdf5f10 msgr2=0x562f7be3c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.537+0000 7f14e2572740 1 --2- 172.21.15.55:0/361034150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7bdf5f10 0x562f7be3c190 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f14d80b4430 tx=0x7f14d0001610 comp rx=0 tx=0).stop 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.538+0000 7f14e2572740 1 -- 172.21.15.55:0/361034150 shutdown_connections 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.538+0000 7f14e2572740 1 --2- 172.21.15.55:0/361034150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7bdf5f10 0x562f7be3c190 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.538+0000 7f14e2572740 1 --2- 172.21.15.55:0/361034150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be3dad0 0x562f7be3e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.538+0000 7f14e2572740 1 --2- 172.21.15.55:0/361034150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be20230 0x562f7be20610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.538+0000 7f14e2572740 1 -- 172.21.15.55:0/361034150 >> 172.21.15.55:0/361034150 conn(0x562f7bdf2840 msgr2=0x562f7be3b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.538+0000 7f14e2572740 1 -- 172.21.15.55:0/361034150 shutdown_connections 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.538+0000 7f14e2572740 1 -- 172.21.15.55:0/361034150 wait complete. 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.538+0000 7f14e2572740 1 -- start start 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.538+0000 7f14e2572740 1 Processor -- start 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14e2572740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be20230 0x562f7be33500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14e2572740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be3dad0 0x562f7be23df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14e2572740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be24330 0x562f7be0f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14e2572740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f7bdf6cb0 con 0x562f7be3dad0 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14e2572740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f7bd150c0 con 0x562f7be24330 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14e2572740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f7bdf0770 con 0x562f7be20230 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14e2572740 10 client.0 _ll_register_callbacks cb 0x562f7bd08ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14dce0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be3dad0 0x562f7be23df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14dce0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be3dad0 0x562f7be23df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60342/0 (socket says 172.21.15.55:60342) 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14dce0a640 1 -- 172.21.15.55:0/1408073780 learned_addr learned my addr 172.21.15.55:0/1408073780 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14dd60b640 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be20230 0x562f7be33500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.539+0000 7f14dde0c640 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be24330 0x562f7be0f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14dce0a640 1 -- 172.21.15.55:0/1408073780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be20230 msgr2=0x562f7be33500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14dce0a640 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be20230 0x562f7be33500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14dce0a640 1 -- 172.21.15.55:0/1408073780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be24330 msgr2=0x562f7be0f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14dce0a640 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be24330 0x562f7be0f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14dce0a640 1 -- 172.21.15.55:0/1408073780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f7ba6d2d0 con 0x562f7be3dad0 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14dce0a640 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be3dad0 0x562f7be23df0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f14c80a87b0 tx=0x7f14c8076c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7126c5750c41af21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14b7fff640 1 -- 172.21.15.55:0/1408073780 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8078a90 con 0x562f7be3dad0 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14b7fff640 1 -- 172.21.15.55:0/1408073780 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14c8007d10 con 0x562f7be3dad0 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14e2572740 1 -- 172.21.15.55:0/1408073780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14d0006b50 con 0x562f7be3dad0 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14b7fff640 1 -- 172.21.15.55:0/1408073780 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14c807cbe0 con 0x562f7be3dad0 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14e2572740 10 client.7491 fetch_fsmap learned FSMap version 51 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14e2572740 1 -- 172.21.15.55:0/1408073780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x562f7bb376b0 con 0x562f7be3dad0 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14b7fff640 1 -- 172.21.15.55:0/1408073780 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d0006b50 con 0x562f7be3dad0 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14b7fff640 1 -- 172.21.15.55:0/1408073780 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f14c8077ee0 con 0x562f7be3dad0 2024-04-25T08:59:42.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14e2572740 10 client.7491 fetch_fsmap finished waiting for FSMap version 51 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14e2572740 10 client.7491 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14e2572740 20 client.7491 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14e2572740 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.55:6835/3953928431,v1:172.21.15.55:6837/3953928431] conn(0x562f7be221c0 0x562f7be225a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14e2572740 4 client.7491 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.540+0000 7f14e2572740 1 -- 172.21.15.55:0/1408073780 --> [v2:172.21.15.55:6835/3953928431,v1:172.21.15.55:6837/3953928431] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f7bdb7920 con 0x562f7be221c0 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.541+0000 7f14dd60b640 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.55:6835/3953928431,v1:172.21.15.55:6837/3953928431] conn(0x562f7be221c0 0x562f7be225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.541+0000 7f14b7fff640 10 client.7491 ms_handle_connect on v2:172.21.15.55:6835/3953928431 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.541+0000 7f14dd60b640 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.55:6835/3953928431,v1:172.21.15.55:6837/3953928431] conn(0x562f7be221c0 0x562f7be225a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebd6f503ab87618f server_cookie=6c5afc2de15a26b0 in_seq=0 out_seq=0 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.541+0000 7f14b7fff640 1 -- 172.21.15.55:0/1408073780 <== mds.0 v2:172.21.15.55:6835/3953928431 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562f7bdb7920 con 0x562f7be221c0 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.541+0000 7f14b7fff640 10 client.7491 handle_command_reply: tid=0 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 1 client.7491 shutdown 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 1 -- 172.21.15.55:0/1408073780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be3dad0 msgr2=0x562f7be23df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be3dad0 0x562f7be23df0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f14c80a87b0 tx=0x7f14c8076c90 comp rx=0 tx=0).stop 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 1 -- 172.21.15.55:0/1408073780 shutdown_connections 2024-04-25T08:59:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.55:6835/3953928431,v1:172.21.15.55:6837/3953928431] conn(0x562f7be221c0 0x562f7be225a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be24330 0x562f7be0f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14b7fff640 0 client.7491 ms_handle_reset on v2:172.21.15.55:6835/3953928431 2024-04-25T08:59:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be3dad0 0x562f7be23df0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 1 --2- 172.21.15.55:0/1408073780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be20230 0x562f7be33500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 1 -- 172.21.15.55:0/1408073780 >> 172.21.15.55:0/1408073780 conn(0x562f7bdf5f10 msgr2=0x562f7be3e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 1 -- 172.21.15.55:0/1408073780 shutdown_connections 2024-04-25T08:59:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 1 -- 172.21.15.55:0/1408073780 wait complete. 2024-04-25T08:59:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.542+0000 7f14e2572740 20 client.7491 trim_cache size 0 max 16384 2024-04-25T08:59:42.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.558+0000 7f14e2572740 1 Processor -- start 2024-04-25T08:59:42.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.558+0000 7f14e2572740 1 -- start start 2024-04-25T08:59:42.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14e2572740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be20230 0x562f7be3b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14e2572740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be24330 0x562f7be355a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14e2572740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be3dad0 0x562f7be35ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14e2572740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d81ff890 con 0x562f7be20230 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14e2572740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80b53c0 con 0x562f7be3dad0 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14e2572740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80b59c0 con 0x562f7be24330 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14dd60b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be20230 0x562f7be3b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14dd60b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be20230 0x562f7be3b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60352/0 (socket says 172.21.15.55:60352) 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14dd60b640 1 -- 172.21.15.55:0/1106895018 learned_addr learned my addr 172.21.15.55:0/1106895018 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14dd60b640 1 -- 172.21.15.55:0/1106895018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be24330 msgr2=0x562f7be355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14dd60b640 1 --2- 172.21.15.55:0/1106895018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be24330 0x562f7be355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14dd60b640 1 -- 172.21.15.55:0/1106895018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be3dad0 msgr2=0x562f7be35ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14dd60b640 1 --2- 172.21.15.55:0/1106895018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be3dad0 0x562f7be35ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14dd60b640 1 -- 172.21.15.55:0/1106895018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f7be3ae40 con 0x562f7be20230 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14dd60b640 1 --2- 172.21.15.55:0/1106895018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be20230 0x562f7be3b230 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x562f7be331b0 tx=0x7f14d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca935bbff696d74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14c27fc640 1 -- 172.21.15.55:0/1106895018 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d402cb00 con 0x562f7be20230 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14c27fc640 1 -- 172.21.15.55:0/1106895018 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d402cca0 con 0x562f7be20230 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.559+0000 7f14c27fc640 1 -- 172.21.15.55:0/1106895018 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d402c450 con 0x562f7be20230 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.560+0000 7f14e2572740 1 -- 172.21.15.55:0/1106895018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be20230 msgr2=0x562f7be3b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.560+0000 7f14e2572740 1 --2- 172.21.15.55:0/1106895018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be20230 0x562f7be3b230 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x562f7be331b0 tx=0x7f14d4017000 comp rx=0 tx=0).stop 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.560+0000 7f14e2572740 1 -- 172.21.15.55:0/1106895018 shutdown_connections 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.560+0000 7f14e2572740 1 --2- 172.21.15.55:0/1106895018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be3dad0 0x562f7be35ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.560+0000 7f14e2572740 1 --2- 172.21.15.55:0/1106895018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be24330 0x562f7be355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.560+0000 7f14e2572740 1 --2- 172.21.15.55:0/1106895018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be20230 0x562f7be3b230 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.560+0000 7f14e2572740 1 -- 172.21.15.55:0/1106895018 >> 172.21.15.55:0/1106895018 conn(0x562f7bdf5f10 msgr2=0x562f7be23be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.560+0000 7f14e2572740 1 -- 172.21.15.55:0/1106895018 shutdown_connections 2024-04-25T08:59:42.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.560+0000 7f14e2572740 1 -- 172.21.15.55:0/1106895018 wait complete. 2024-04-25T08:59:42.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.560+0000 7f14e2572740 1 -- start start 2024-04-25T08:59:42.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.561+0000 7f14e2572740 1 Processor -- start 2024-04-25T08:59:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.561+0000 7f14e2572740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be20230 0x562f7bea5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.561+0000 7f14e2572740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be24330 0x562f7be49760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.561+0000 7f14e2572740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be3dad0 0x562f7be49ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.561+0000 7f14e2572740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f7be32fe0 con 0x562f7be24330 2024-04-25T08:59:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.561+0000 7f14e2572740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f7bb376b0 con 0x562f7be20230 2024-04-25T08:59:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.561+0000 7f14e2572740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f7bdef720 con 0x562f7be3dad0 2024-04-25T08:59:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14e2572740 10 client.0 _ll_register_callbacks cb 0x562f7bdf0c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14dce0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be24330 0x562f7be49760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14dce0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be24330 0x562f7be49760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60360/0 (socket says 172.21.15.55:60360) 2024-04-25T08:59:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14dce0a640 1 -- 172.21.15.55:0/2578604875 learned_addr learned my addr 172.21.15.55:0/2578604875 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14dd60b640 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be20230 0x562f7bea5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14dde0c640 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be3dad0 0x562f7be49ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14dce0a640 1 -- 172.21.15.55:0/2578604875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be3dad0 msgr2=0x562f7be49ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14dce0a640 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be3dad0 0x562f7be49ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14dce0a640 1 -- 172.21.15.55:0/2578604875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be20230 msgr2=0x562f7bea5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14dce0a640 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be20230 0x562f7bea5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14dce0a640 1 -- 172.21.15.55:0/2578604875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f7be239f0 con 0x562f7be24330 2024-04-25T08:59:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14dce0a640 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be24330 0x562f7be49760 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c210 tx=0x7f14c8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60592bef7b7f6b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14b7fff640 1 -- 172.21.15.55:0/2578604875 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8078a90 con 0x562f7be24330 2024-04-25T08:59:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14b7fff640 1 -- 172.21.15.55:0/2578604875 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14c80a8370 con 0x562f7be24330 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14e2572740 1 -- 172.21.15.55:0/2578604875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14d402cca0 con 0x562f7be24330 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14b7fff640 1 -- 172.21.15.55:0/2578604875 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14c8074ca0 con 0x562f7be24330 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14e2572740 10 client.7497 fetch_fsmap learned FSMap version 51 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.562+0000 7f14e2572740 1 -- 172.21.15.55:0/2578604875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x562f7be36120 con 0x562f7be24330 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14b7fff640 1 -- 172.21.15.55:0/2578604875 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d402cca0 con 0x562f7be24330 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14b7fff640 1 -- 172.21.15.55:0/2578604875 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f14c808cae0 con 0x562f7be24330 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 10 client.7497 fetch_fsmap finished waiting for FSMap version 51 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 10 client.7497 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 20 client.7497 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.55:6835/3953928431,v1:172.21.15.55:6837/3953928431] conn(0x562f7be22bf0 0x562f7be22fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 4 client.7497 mds_command: new command op to 7323 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 1 -- 172.21.15.55:0/2578604875 --> [v2:172.21.15.55:6835/3953928431,v1:172.21.15.55:6837/3953928431] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562f7bd65f50 con 0x562f7be22bf0 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14dd60b640 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.55:6835/3953928431,v1:172.21.15.55:6837/3953928431] conn(0x562f7be22bf0 0x562f7be22fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14b7fff640 10 client.7497 ms_handle_connect on v2:172.21.15.55:6835/3953928431 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14dd60b640 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.55:6835/3953928431,v1:172.21.15.55:6837/3953928431] conn(0x562f7be22bf0 0x562f7be22fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b76387b7713aead8 server_cookie=31b94a7830af3c2 in_seq=0 out_seq=0 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14b7fff640 1 -- 172.21.15.55:0/2578604875 <== mds.0 v2:172.21.15.55:6835/3953928431 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x562f7bd65f50 con 0x562f7be22bf0 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14b7fff640 10 client.7497 handle_command_reply: tid=0 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 1 client.7497 shutdown 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 1 -- 172.21.15.55:0/2578604875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be24330 msgr2=0x562f7be49760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be24330 0x562f7be49760 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c210 tx=0x7f14c8000bc0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 1 -- 172.21.15.55:0/2578604875 shutdown_connections 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562f7be3dad0 0x562f7be49ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562f7be24330 0x562f7be49760 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.55:6835/3953928431,v1:172.21.15.55:6837/3953928431] conn(0x562f7be22bf0 0x562f7be22fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 1 --2- 172.21.15.55:0/2578604875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f7be20230 0x562f7bea5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14b7fff640 0 client.7497 ms_handle_reset on v2:172.21.15.55:6835/3953928431 2024-04-25T08:59:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.563+0000 7f14e2572740 1 -- 172.21.15.55:0/2578604875 >> 172.21.15.55:0/2578604875 conn(0x562f7bdf5f10 msgr2=0x562f7be1f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14e2572740 1 -- 172.21.15.55:0/2578604875 shutdown_connections 2024-04-25T08:59:42.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14e2572740 1 -- 172.21.15.55:0/2578604875 wait complete. 2024-04-25T08:59:42.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14e2572740 20 client.7497 trim_cache size 0 max 16384 2024-04-25T08:59:42.560 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:59:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T08:59:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T08:59:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7323, 2024-04-25T08:59:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T08:59:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T08:59:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T08:59:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 9.0877189260000009, 2024-04-25T08:59:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 51, 2024-04-25T08:59:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 87, 2024-04-25T08:59:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 87, 2024-04-25T08:59:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 14.121281936999999 2024-04-25T08:59:42.561 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:59:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 -- 172.21.15.55:0/2701541469 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14bc06b500 msgr2=0x7f14bc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14bc06b500 0x7f14bc06d9c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009bc0 tx=0x7f14d4008040 comp rx=0 tx=0).stop 2024-04-25T08:59:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 -- 172.21.15.55:0/2701541469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14d80b2490 msgr2=0x7f14d80b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14d80b2490 0x7f14d80b28f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f14c802adf0 tx=0x7f14c8001a40 comp rx=0 tx=0).stop 2024-04-25T08:59:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 -- 172.21.15.55:0/2701541469 shutdown_connections 2024-04-25T08:59:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f14bc06b500 0x7f14bc06d9c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d80c6930 0x7f14d80c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14d80b2490 0x7f14d80b28f0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 --2- 172.21.15.55:0/2701541469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14c4004800 0x7f14d80b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 -- 172.21.15.55:0/2701541469 >> 172.21.15.55:0/2701541469 conn(0x7f14d806f430 msgr2=0x7f14d815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 -- 172.21.15.55:0/2701541469 shutdown_connections 2024-04-25T08:59:42.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.564+0000 7f14df86f640 1 -- 172.21.15.55:0/2701541469 wait complete. 2024-04-25T08:59:42.564 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:59:42.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.676+0000 7f8811a4d640 1 Processor -- start 2024-04-25T08:59:42.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.676+0000 7f8811a4d640 1 -- start start 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.676+0000 7f8811a4d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f880c15dce0 0x7f880c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.676+0000 7f8811a4d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f880c0b5b60 0x7f880c0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.676+0000 7f8811a4d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c15e0c0 con 0x7f880c0d35b0 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.676+0000 7f8811a4d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880c0d2510 con 0x7f880c0b5b60 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.676+0000 7f8811a4d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c0d27f0 con 0x7f880c15dce0 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.677+0000 7f880b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f880c0b5b60 0x7f880c0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.677+0000 7f880b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f880c0b5b60 0x7f880c0b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60374/0 (socket says 172.21.15.55:60374) 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.677+0000 7f880b7fe640 1 -- 172.21.15.55:0/3489879960 learned_addr learned my addr 172.21.15.55:0/3489879960 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.677+0000 7f880affd640 1 --2- 172.21.15.55:0/3489879960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f880c15dce0 0x7f880c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.677+0000 7f880b7fe640 1 -- 172.21.15.55:0/3489879960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f880c15dce0 msgr2=0x7f880c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.677+0000 7f880b7fe640 1 --2- 172.21.15.55:0/3489879960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f880c15dce0 0x7f880c0d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.677+0000 7f880b7fe640 1 -- 172.21.15.55:0/3489879960 >> v1:172.21.15.167:6789/0 conn(0x7f880c0d35b0 legacy=0x7f880c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.677+0000 7f880b7fe640 1 -- 172.21.15.55:0/3489879960 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c0d2ad0 con 0x7f880c0b5b60 2024-04-25T08:59:42.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.678+0000 7f880b7fe640 1 --2- 172.21.15.55:0/3489879960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f880c0b5b60 0x7f880c0b6b00 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f8804009e50 tx=0x7f880402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f441ae7838a3a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.678+0000 7f880a7fc640 1 -- 172.21.15.55:0/3489879960 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804036070 con 0x7f880c0b5b60 2024-04-25T08:59:42.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.678+0000 7f880a7fc640 1 -- 172.21.15.55:0/3489879960 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8804031600 con 0x7f880c0b5b60 2024-04-25T08:59:42.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.678+0000 7f880a7fc640 1 -- 172.21.15.55:0/3489879960 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88040319d0 con 0x7f880c0b5b60 2024-04-25T08:59:42.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.678+0000 7f8811a4d640 1 -- 172.21.15.55:0/3489879960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f880c0b5b60 msgr2=0x7f880c0b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.678+0000 7f8811a4d640 1 --2- 172.21.15.55:0/3489879960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f880c0b5b60 0x7f880c0b6b00 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f8804009e50 tx=0x7f880402a710 comp rx=0 tx=0).stop 2024-04-25T08:59:42.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.678+0000 7f8811a4d640 1 -- 172.21.15.55:0/3489879960 shutdown_connections 2024-04-25T08:59:42.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.678+0000 7f8811a4d640 1 --2- 172.21.15.55:0/3489879960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f880c0b5b60 0x7f880c0b6b00 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.678+0000 7f8811a4d640 1 --2- 172.21.15.55:0/3489879960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f880c15dce0 0x7f880c0d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.678+0000 7f8811a4d640 1 -- 172.21.15.55:0/3489879960 >> 172.21.15.55:0/3489879960 conn(0x7f880c072900 msgr2=0x7f880c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.679+0000 7f8811a4d640 1 -- 172.21.15.55:0/3489879960 shutdown_connections 2024-04-25T08:59:42.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.679+0000 7f8811a4d640 1 -- 172.21.15.55:0/3489879960 wait complete. 2024-04-25T08:59:42.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.680+0000 7f8811a4d640 1 Processor -- start 2024-04-25T08:59:42.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.680+0000 7f8811a4d640 1 -- start start 2024-04-25T08:59:42.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f8811a4d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f880c0b5b60 0x7f880c152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f8811a4d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f880c0d35b0 0x7f880c0c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f8811a4d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f880c15dce0 0x7f880c0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f8811a4d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c0b9820 con 0x7f880c15dce0 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f8811a4d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c0d3090 con 0x7f880c0b5b60 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f8811a4d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c0b99a0 con 0x7f880c0d35b0 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f880b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f880c15dce0 0x7f880c0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f880b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f880c15dce0 0x7f880c0c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60380/0 (socket says 172.21.15.55:60380) 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f880b7fe640 1 -- 172.21.15.55:0/1850313253 learned_addr learned my addr 172.21.15.55:0/1850313253 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f880affd640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f880c0b5b60 0x7f880c152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f88027fc640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f880c0d35b0 0x7f880c0c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f880b7fe640 1 -- 172.21.15.55:0/1850313253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f880c0d35b0 msgr2=0x7f880c0c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f880b7fe640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f880c0d35b0 0x7f880c0c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f880b7fe640 1 -- 172.21.15.55:0/1850313253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f880c0b5b60 msgr2=0x7f880c152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f880b7fe640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f880c0b5b60 0x7f880c152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f880b7fe640 1 -- 172.21.15.55:0/1850313253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c0c8b90 con 0x7f880c15dce0 2024-04-25T08:59:42.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f880affd640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f880c0b5b60 0x7f880c152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:42.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f88027fc640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f880c0d35b0 0x7f880c0c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:42.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f880b7fe640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f880c15dce0 0x7f880c0c9830 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f8804034040 tx=0x7f8804004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f8808ff9640 1 -- 172.21.15.55:0/1850313253 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804036050 con 0x7f880c15dce0 2024-04-25T08:59:42.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f8808ff9640 1 -- 172.21.15.55:0/1850313253 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8804042070 con 0x7f880c15dce0 2024-04-25T08:59:42.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f8811a4d640 1 -- 172.21.15.55:0/1850313253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880c0c82f0 con 0x7f880c15dce0 2024-04-25T08:59:42.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.681+0000 7f8808ff9640 1 -- 172.21.15.55:0/1850313253 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804009510 con 0x7f880c15dce0 2024-04-25T08:59:42.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.682+0000 7f8811a4d640 1 -- 172.21.15.55:0/1850313253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c0c88b0 con 0x7f880c15dce0 2024-04-25T08:59:42.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.683+0000 7f8811a4d640 1 -- 172.21.15.55:0/1850313253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880c0749b0 con 0x7f880c15dce0 2024-04-25T08:59:42.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.683+0000 7f8808ff9640 1 -- 172.21.15.55:0/1850313253 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8804007bd0 con 0x7f880c15dce0 2024-04-25T08:59:42.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.683+0000 7f8808ff9640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f87ec06b4d0 0x7f87ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:42.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.683+0000 7f8808ff9640 1 -- 172.21.15.55:0/1850313253 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88040ab0f0 con 0x7f880c15dce0 2024-04-25T08:59:42.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.684+0000 7f880affd640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f87ec06b4d0 0x7f87ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:42.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.684+0000 7f880affd640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f87ec06b4d0 0x7f87ec06d990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f87fc006fd0 tx=0x7f87fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:42.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.688+0000 7f8808ff9640 1 -- 172.21.15.55:0/1850313253 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8804045360 con 0x7f880c15dce0 2024-04-25T08:59:42.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.906+0000 7f8811a4d640 1 -- 172.21.15.55:0/1850313253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f880c0b27a0 con 0x7f880c15dce0 2024-04-25T08:59:42.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.907+0000 7f8808ff9640 1 -- 172.21.15.55:0/1850313253 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8804079f70 con 0x7f880c15dce0 2024-04-25T08:59:42.896 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:59:42.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.908+0000 7f8811a4d640 1 -- 172.21.15.55:0/1850313253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f87ec06b4d0 msgr2=0x7f87ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.908+0000 7f8811a4d640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f87ec06b4d0 0x7f87ec06d990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f87fc006fd0 tx=0x7f87fc008040 comp rx=0 tx=0).stop 2024-04-25T08:59:42.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.908+0000 7f8811a4d640 1 -- 172.21.15.55:0/1850313253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f880c15dce0 msgr2=0x7f880c0c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:42.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.908+0000 7f8811a4d640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f880c15dce0 0x7f880c0c9830 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f8804034040 tx=0x7f8804004a40 comp rx=0 tx=0).stop 2024-04-25T08:59:42.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.908+0000 7f8811a4d640 1 -- 172.21.15.55:0/1850313253 shutdown_connections 2024-04-25T08:59:42.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.908+0000 7f8811a4d640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f87ec06b4d0 0x7f87ec06d990 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.908+0000 7f8811a4d640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f880c15dce0 0x7f880c0c9830 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.908+0000 7f8811a4d640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f880c0d35b0 0x7f880c0c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.908+0000 7f8811a4d640 1 --2- 172.21.15.55:0/1850313253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f880c0b5b60 0x7f880c152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:42.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.908+0000 7f8811a4d640 1 -- 172.21.15.55:0/1850313253 >> 172.21.15.55:0/1850313253 conn(0x7f880c072900 msgr2=0x7f880c0d39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:42.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.909+0000 7f8811a4d640 1 -- 172.21.15.55:0/1850313253 shutdown_connections 2024-04-25T08:59:42.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:42.909+0000 7f8811a4d640 1 -- 172.21.15.55:0/1850313253 wait complete. 2024-04-25T08:59:42.908 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:59:42.909 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:59:42.909 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T08:59:42.909 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:59:42.909 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:42.909 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:59:42.909 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:59:42.909 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:59:42.909 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:42.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:42.909 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T08:59:42.925 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:59:42.925 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:59:42.925 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:59:42.925 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:42.925 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:59:42.925 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:42.925 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:42.925 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42374sec preferred_lft 42374sec 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:42.926 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T08:59:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:42.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:42.928 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:59:42.989 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:59:42.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:42.990 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T08:59:43.047 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T08:59:43.047 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:59:43.047 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:59:43.048 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:59:43.048 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:59:43.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:43.048 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:59:43.048 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:59:43.048 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:59:43.048 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:59:43.048 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:59:43.048 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:59:43.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:43.134 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:59:43.149 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:59:43.149 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:59:43.149 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:43.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:43.149 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T08:59:43.214 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:59:43.214 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:43.269 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:43.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:59:43.269 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:43.324 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:59:43.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:43.324 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:43.406 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:43.406 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:59:43.406 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:59:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:59:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:59:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:59:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:59:43.423 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:43.423 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:59:43.423 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:59:43.423 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:59:43.423 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:59:43.423 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:59:43.423 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:59:43.423 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:59:43.423 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:59:43.424 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:59:43.424 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:59:43.424 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:59:43.424 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:59:43.425 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:59:43.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:43.425 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:43.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:43.488 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:59:43.549 INFO:teuthology.orchestra.run.smithi055.stdout:client7506 2024-04-25T08:59:43.549 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:59:43.549 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:43.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:43.605 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-04-25T08:59:43.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:43.665 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-04-25T08:59:43.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:43.721 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-04-25T08:59:43.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:43.777 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-04-25T08:59:43.835 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T08:59:43.836 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T08:59:43.836 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T08:59:43.836 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T08:59:43.836 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-04-25T08:59:43.836 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T08:59:43.943 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-25T08:59:43.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:59:43.952 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:59:43.952 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:44.008 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:59:44.008 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:44.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:59:44.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.216+0000 7f98ecfee640 1 Processor -- start 2024-04-25T08:59:44.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.216+0000 7f98ecfee640 1 -- start start 2024-04-25T08:59:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98ecfee640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f98e806bef0 0x7f98e806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98ecfee640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e806dc70 con 0x7f98e80acd80 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98ecfee640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e806df10 con 0x7f98e806c2d0 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98ecfee640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e806eb20 con 0x7f98e806bef0 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e6d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f98e80acd80 0x7f98e806aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49808/0 (socket says 172.21.15.55:49808) 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e6d9d640 1 -- 172.21.15.55:0/2374134009 learned_addr learned my addr 172.21.15.55:0/2374134009 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597493770 0 0) 0x7f98e806dc70 con 0x7f98e80acd80 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e659c640 1 --2- 172.21.15.55:0/2374134009 >> v2:172.21.15.167:3300/0 conn(0x7f98e806bef0 0x7f98e806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98d4003520 con 0x7f98e80acd80 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4176959096 0 0) 0x7f98d4003520 con 0x7f98e80acd80 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 >> v2:172.21.15.167:3300/0 conn(0x7f98e806bef0 msgr2=0x7f98e806efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e5d9b640 1 --2- 172.21.15.55:0/2374134009 >> v2:172.21.15.167:3300/0 conn(0x7f98e806bef0 0x7f98e806efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 >> v1:172.21.15.167:6789/0 conn(0x7f98e806c2d0 legacy=0x7f98e815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e806e1f0 con 0x7f98e80acd80 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f98e00019f0 con 0x7f98e80acd80 2024-04-25T08:59:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 >> v1:172.21.15.55:6789/0 conn(0x7f98e80acd80 legacy=0x7f98e806aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e5d9b640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d40039b0 0x7f98d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.217+0000 7f98e5d9b640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98d4004800 0x7f98d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e5d9b640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98d40051c0 0x7f98d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e806eb20 con 0x7f98d40039b0 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d400c060 con 0x7f98d4004800 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d400c260 con 0x7f98d40051c0 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e659c640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d40039b0 0x7f98d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98dffff640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98d4004800 0x7f98d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e6d9d640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98d40051c0 0x7f98d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e659c640 1 -- 172.21.15.55:0/2374134009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98d40051c0 msgr2=0x7f98d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e659c640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98d40051c0 0x7f98d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e659c640 1 -- 172.21.15.55:0/2374134009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98d4004800 msgr2=0x7f98d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e659c640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98d4004800 0x7f98d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e659c640 1 -- 172.21.15.55:0/2374134009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4003520 con 0x7f98d40039b0 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98dffff640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98d4004800 0x7f98d4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.218+0000 7f98e6d9d640 1 -- 172.21.15.55:0/2374134009 reap_dead start 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.219+0000 7f98e659c640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d40039b0 0x7f98d4003dd0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009ac0 tx=0x7f98d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c936287ee07db57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.219+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8036070 con 0x7f98d40039b0 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.219+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d8031400 con 0x7f98d40039b0 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.219+0000 7f98e5d9b640 1 -- 172.21.15.55:0/2374134009 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8009690 con 0x7f98d40039b0 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.219+0000 7f98ecfee640 1 -- 172.21.15.55:0/2374134009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d40039b0 msgr2=0x7f98d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.219+0000 7f98ecfee640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d40039b0 0x7f98d4003dd0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009ac0 tx=0x7f98d4005830 comp rx=0 tx=0).stop 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.219+0000 7f98ecfee640 1 -- 172.21.15.55:0/2374134009 shutdown_connections 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.219+0000 7f98ecfee640 1 --2- 172.21.15.55:0/2374134009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d40039b0 0x7f98d4003dd0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.219+0000 7f98ecfee640 1 -- 172.21.15.55:0/2374134009 >> 172.21.15.55:0/2374134009 conn(0x7f98e80b2220 msgr2=0x7f98e80cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.219+0000 7f98ecfee640 1 -- 172.21.15.55:0/2374134009 shutdown_connections 2024-04-25T08:59:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.219+0000 7f98ecfee640 1 -- 172.21.15.55:0/2374134009 wait complete. 2024-04-25T08:59:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.221+0000 7f98ecfee640 1 Processor -- start 2024-04-25T08:59:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.221+0000 7f98ecfee640 1 -- start start 2024-04-25T08:59:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.221+0000 7f98ecfee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98d40039b0 0x7f98e81414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.221+0000 7f98ecfee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e81446f0 0x7f98e815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.221+0000 7f98ecfee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e8158560 0x7f98e81589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.221+0000 7f98ecfee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80ada00 con 0x7f98e81446f0 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.221+0000 7f98ecfee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e806e7b0 con 0x7f98d40039b0 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.221+0000 7f98ecfee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80adb80 con 0x7f98e8158560 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e81446f0 0x7f98e815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e81446f0 0x7f98e815bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60390/0 (socket says 172.21.15.55:60390) 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98dffff640 1 -- 172.21.15.55:0/2729449534 learned_addr learned my addr 172.21.15.55:0/2729449534 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98e6d9d640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e8158560 0x7f98e81589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98e659c640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98d40039b0 0x7f98e81414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98dffff640 1 -- 172.21.15.55:0/2729449534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e8158560 msgr2=0x7f98e81589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98dffff640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e8158560 0x7f98e81589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98dffff640 1 -- 172.21.15.55:0/2729449534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98d40039b0 msgr2=0x7f98e81414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98dffff640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98d40039b0 0x7f98e81414a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98dffff640 1 -- 172.21.15.55:0/2729449534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e815c440 con 0x7f98e81446f0 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98e6d9d640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e8158560 0x7f98e81589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98e659c640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98d40039b0 0x7f98e81414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98dffff640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e81446f0 0x7f98e815bf00 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f98d000e4b0 tx=0x7f98d000e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98deffd640 1 -- 172.21.15.55:0/2729449534 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00052e0 con 0x7f98e81446f0 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98deffd640 1 -- 172.21.15.55:0/2729449534 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d0018070 con 0x7f98e81446f0 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98deffd640 1 -- 172.21.15.55:0/2729449534 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0003830 con 0x7f98e81446f0 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98ecfee640 1 -- 172.21.15.55:0/2729449534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e815c710 con 0x7f98e81446f0 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.222+0000 7f98ecfee640 1 -- 172.21.15.55:0/2729449534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e815ccd0 con 0x7f98e81446f0 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.223+0000 7f98ecfee640 1 -- 172.21.15.55:0/2729449534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e80b2bf0 con 0x7f98e81446f0 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.224+0000 7f98deffd640 1 -- 172.21.15.55:0/2729449534 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f98d00039d0 con 0x7f98e81446f0 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.224+0000 7f98deffd640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 0x7f98c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.224+0000 7f98deffd640 1 -- 172.21.15.55:0/2729449534 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98d0089e20 con 0x7f98e81446f0 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.224+0000 7f98e659c640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 0x7f98c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.225+0000 7f98e659c640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 0x7f98c806d990 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f98d8033000 tx=0x7f98d8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.229+0000 7f98deffd640 1 -- 172.21.15.55:0/2729449534 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98e80b2bf0 con 0x7f98e81446f0 2024-04-25T08:59:44.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.409+0000 7f98ecfee640 1 -- 172.21.15.55:0/2729449534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e8160370 con 0x7f98e81446f0 2024-04-25T08:59:44.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.410+0000 7f98deffd640 1 -- 172.21.15.55:0/2729449534 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16660 (secure 0 0 0) 0x7f98e8160370 con 0x7f98e81446f0 2024-04-25T08:59:44.400 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:44.400 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":87,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T08:59:34.463295+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:31.118316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:31.794522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:59:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 -- 172.21.15.55:0/2729449534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 msgr2=0x7f98c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 0x7f98c806d990 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f98d8033000 tx=0x7f98d8008030 comp rx=0 tx=0).stop 2024-04-25T08:59:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 -- 172.21.15.55:0/2729449534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e81446f0 msgr2=0x7f98e815bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e81446f0 0x7f98e815bf00 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f98d000e4b0 tx=0x7f98d000e970 comp rx=0 tx=0).stop 2024-04-25T08:59:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 -- 172.21.15.55:0/2729449534 shutdown_connections 2024-04-25T08:59:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 0x7f98c806d990 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98e8158560 0x7f98e81589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e81446f0 0x7f98e815bf00 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 --2- 172.21.15.55:0/2729449534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98d40039b0 0x7f98e81414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 -- 172.21.15.55:0/2729449534 >> 172.21.15.55:0/2729449534 conn(0x7f98e80b2220 msgr2=0x7f98e8074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 -- 172.21.15.55:0/2729449534 shutdown_connections 2024-04-25T08:59:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.412+0000 7f98ecfee640 1 -- 172.21.15.55:0/2729449534 wait complete. 2024-04-25T08:59:44.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:59:31.118316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:59:31.794522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:59:44.413 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:59:44.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.528+0000 7ff6ece3a640 1 Processor -- start 2024-04-25T08:59:44.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.528+0000 7ff6ece3a640 1 -- start start 2024-04-25T08:59:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.529+0000 7ff6ece3a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6e80b97c0 0x7ff6e80b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.529+0000 7ff6ece3a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6e80b5a30 0x7ff6e80d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.529+0000 7ff6ece3a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e81627a0 con 0x7ff6e815dc80 2024-04-25T08:59:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.529+0000 7ff6ece3a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e80b5ea0 con 0x7ff6e80b5a30 2024-04-25T08:59:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.529+0000 7ff6ece3a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e8161f80 con 0x7ff6e80b97c0 2024-04-25T08:59:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.529+0000 7ff6e6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6e80b5a30 0x7ff6e80d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.529+0000 7ff6e6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6e80b5a30 0x7ff6e80d2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60398/0 (socket says 172.21.15.55:60398) 2024-04-25T08:59:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.529+0000 7ff6e6d9d640 1 -- 172.21.15.55:0/3311873592 learned_addr learned my addr 172.21.15.55:0/3311873592 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.529+0000 7ff6e5d9b640 1 --2- 172.21.15.55:0/3311873592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6e80b97c0 0x7ff6e80b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.530+0000 7ff6e6d9d640 1 -- 172.21.15.55:0/3311873592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6e80b97c0 msgr2=0x7ff6e80b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.530+0000 7ff6e6d9d640 1 --2- 172.21.15.55:0/3311873592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6e80b97c0 0x7ff6e80b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.530+0000 7ff6e6d9d640 1 -- 172.21.15.55:0/3311873592 >> v1:172.21.15.167:6789/0 conn(0x7ff6e815dc80 legacy=0x7ff6e8161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.530+0000 7ff6e6d9d640 1 -- 172.21.15.55:0/3311873592 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e81621e0 con 0x7ff6e80b5a30 2024-04-25T08:59:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.530+0000 7ff6e6d9d640 1 --2- 172.21.15.55:0/3311873592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b5a30 0x7ff6e80d2470 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009e80 tx=0x7ff6d802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce5d2c6f54c2869 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.531+0000 7ff6e559a640 1 -- 172.21.15.55:0/3311873592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8036070 con 0x7ff6e80b5a30 2024-04-25T08:59:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.531+0000 7ff6e559a640 1 -- 172.21.15.55:0/3311873592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d8031600 con 0x7ff6e80b5a30 2024-04-25T08:59:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.531+0000 7ff6e559a640 1 -- 172.21.15.55:0/3311873592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80319d0 con 0x7ff6e80b5a30 2024-04-25T08:59:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.531+0000 7ff6ece3a640 1 -- 172.21.15.55:0/3311873592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b5a30 msgr2=0x7ff6e80d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.531+0000 7ff6ece3a640 1 --2- 172.21.15.55:0/3311873592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b5a30 0x7ff6e80d2470 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009e80 tx=0x7ff6d802a750 comp rx=0 tx=0).stop 2024-04-25T08:59:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.531+0000 7ff6ece3a640 1 -- 172.21.15.55:0/3311873592 shutdown_connections 2024-04-25T08:59:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.531+0000 7ff6ece3a640 1 --2- 172.21.15.55:0/3311873592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b5a30 0x7ff6e80d2470 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.531+0000 7ff6ece3a640 1 --2- 172.21.15.55:0/3311873592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6e80b97c0 0x7ff6e80b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.531+0000 7ff6ece3a640 1 -- 172.21.15.55:0/3311873592 >> 172.21.15.55:0/3311873592 conn(0x7ff6e80d04f0 msgr2=0x7ff6e80d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:44.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.531+0000 7ff6ece3a640 1 -- 172.21.15.55:0/3311873592 shutdown_connections 2024-04-25T08:59:44.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.531+0000 7ff6ece3a640 1 -- 172.21.15.55:0/3311873592 wait complete. 2024-04-25T08:59:44.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.533+0000 7ff6ece3a640 1 Processor -- start 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.533+0000 7ff6ece3a640 1 -- start start 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.533+0000 7ff6ece3a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6e80b5a30 0x7ff6e80cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.533+0000 7ff6ece3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b97c0 0x7ff6e80b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.533+0000 7ff6ece3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6e815dc80 0x7ff6e8149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.533+0000 7ff6ece3a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e815e060 con 0x7ff6e80b97c0 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.533+0000 7ff6ece3a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80d1c70 con 0x7ff6e815dc80 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.533+0000 7ff6ece3a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80d29b0 con 0x7ff6e80b5a30 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.533+0000 7ff6e5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b97c0 0x7ff6e80b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.533+0000 7ff6e5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b97c0 0x7ff6e80b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60414/0 (socket says 172.21.15.55:60414) 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.533+0000 7ff6e5d9b640 1 -- 172.21.15.55:0/468800380 learned_addr learned my addr 172.21.15.55:0/468800380 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6e6d9d640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6e815dc80 0x7ff6e8149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6e659c640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6e80b5a30 0x7ff6e80cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6e5d9b640 1 -- 172.21.15.55:0/468800380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6e80b5a30 msgr2=0x7ff6e80cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6e5d9b640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6e80b5a30 0x7ff6e80cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6e5d9b640 1 -- 172.21.15.55:0/468800380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6e815dc80 msgr2=0x7ff6e8149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6e5d9b640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6e815dc80 0x7ff6e8149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6e5d9b640 1 -- 172.21.15.55:0/468800380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e81f4100 con 0x7ff6e80b97c0 2024-04-25T08:59:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6e659c640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6e80b5a30 0x7ff6e80cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6e5d9b640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b97c0 0x7ff6e80b5010 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00e9b0 tx=0x7ff6dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6d6ffd640 1 -- 172.21.15.55:0/468800380 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc017070 con 0x7ff6e80b97c0 2024-04-25T08:59:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6d6ffd640 1 -- 172.21.15.55:0/468800380 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc00c9a0 con 0x7ff6e80b97c0 2024-04-25T08:59:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6ece3a640 1 -- 172.21.15.55:0/468800380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e81f43e0 con 0x7ff6e80b97c0 2024-04-25T08:59:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6d6ffd640 1 -- 172.21.15.55:0/468800380 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc00cd70 con 0x7ff6e80b97c0 2024-04-25T08:59:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.534+0000 7ff6ece3a640 1 -- 172.21.15.55:0/468800380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e81f4c80 con 0x7ff6e80b97c0 2024-04-25T08:59:44.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.535+0000 7ff6ece3a640 1 -- 172.21.15.55:0/468800380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e81f45b0 con 0x7ff6e80b97c0 2024-04-25T08:59:44.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.536+0000 7ff6d6ffd640 1 -- 172.21.15.55:0/468800380 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff6dc01a070 con 0x7ff6e80b97c0 2024-04-25T08:59:44.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.536+0000 7ff6d6ffd640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6c806b4d0 0x7ff6c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.536+0000 7ff6d6ffd640 1 -- 172.21.15.55:0/468800380 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6dc08a500 con 0x7ff6e80b97c0 2024-04-25T08:59:44.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.536+0000 7ff6e659c640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6c806b4d0 0x7ff6c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.536+0000 7ff6e659c640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6c806b4d0 0x7ff6c806d990 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0001660 tx=0x7ff6e0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:44.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.540+0000 7ff6d6ffd640 1 -- 172.21.15.55:0/468800380 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff6dc058d30 con 0x7ff6e80b97c0 2024-04-25T08:59:44.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.722+0000 7ff6ece3a640 1 -- 172.21.15.55:0/468800380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6e80750b0 con 0x7ff6e80b97c0 2024-04-25T08:59:44.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.722+0000 7ff6d6ffd640 1 -- 172.21.15.55:0/468800380 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6dc05cdd0 con 0x7ff6e80b97c0 2024-04-25T08:59:44.711 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T08:59:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 -- 172.21.15.55:0/468800380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6c806b4d0 msgr2=0x7ff6c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6c806b4d0 0x7ff6c806d990 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0001660 tx=0x7ff6e0009040 comp rx=0 tx=0).stop 2024-04-25T08:59:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 -- 172.21.15.55:0/468800380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b97c0 msgr2=0x7ff6e80b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b97c0 0x7ff6e80b5010 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00e9b0 tx=0x7ff6dc00ee70 comp rx=0 tx=0).stop 2024-04-25T08:59:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 -- 172.21.15.55:0/468800380 shutdown_connections 2024-04-25T08:59:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6c806b4d0 0x7ff6c806d990 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6e815dc80 0x7ff6e8149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b97c0 0x7ff6e80b5010 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 --2- 172.21.15.55:0/468800380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6e80b5a30 0x7ff6e80cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 -- 172.21.15.55:0/468800380 >> 172.21.15.55:0/468800380 conn(0x7ff6e80d04f0 msgr2=0x7ff6e806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 -- 172.21.15.55:0/468800380 shutdown_connections 2024-04-25T08:59:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.724+0000 7ff6ece3a640 1 -- 172.21.15.55:0/468800380 wait complete. 2024-04-25T08:59:44.724 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:59:44.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.839+0000 7fa776aac640 1 Processor -- start 2024-04-25T08:59:44.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.839+0000 7fa776aac640 1 -- start start 2024-04-25T08:59:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa776aac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa77015dca0 0x7fa7700ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa776aac640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa7700d1130 0x7fa7700b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa776aac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7700d4090 con 0x7fa7700d3b90 2024-04-25T08:59:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa776aac640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7700b6b20 con 0x7fa7700d1130 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa776aac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700d4370 con 0x7fa77015dca0 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa767fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa7700d3b90 0x7fa7700d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49810/0 (socket says 172.21.15.55:49810) 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa767fff640 1 -- 172.21.15.55:0/79367856 learned_addr learned my addr 172.21.15.55:0/79367856 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa774848640 1 --2- 172.21.15.55:0/79367856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa77015dca0 0x7fa7700ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa775049640 1 --2- 172.21.15.55:0/79367856 >> v2:172.21.15.167:3300/0 conn(0x7fa7700d1130 0x7fa7700b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa7677fe640 1 -- 172.21.15.55:0/79367856 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346784592 0 0) 0x7fa7700d4090 con 0x7fa7700d3b90 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa7677fe640 1 -- 172.21.15.55:0/79367856 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa758003520 con 0x7fa7700d3b90 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa774848640 1 -- 172.21.15.55:0/79367856 >> v2:172.21.15.167:3300/0 conn(0x7fa7700d1130 msgr2=0x7fa7700b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa774848640 1 --2- 172.21.15.55:0/79367856 >> v2:172.21.15.167:3300/0 conn(0x7fa7700d1130 0x7fa7700b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa774848640 1 -- 172.21.15.55:0/79367856 >> v1:172.21.15.55:6789/0 conn(0x7fa7700d3b90 legacy=0x7fa7700d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.840+0000 7fa774848640 1 -- 172.21.15.55:0/79367856 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7700d4650 con 0x7fa77015dca0 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.841+0000 7fa774848640 1 --2- 172.21.15.55:0/79367856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa77015dca0 0x7fa7700ce940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0097a0 tx=0x7fa76c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa34466613265e44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.841+0000 7fa7677fe640 1 -- 172.21.15.55:0/79367856 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c037070 con 0x7fa77015dca0 2024-04-25T08:59:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.841+0000 7fa7677fe640 1 -- 172.21.15.55:0/79367856 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c032440 con 0x7fa77015dca0 2024-04-25T08:59:44.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.841+0000 7fa7677fe640 1 -- 172.21.15.55:0/79367856 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c032810 con 0x7fa77015dca0 2024-04-25T08:59:44.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.842+0000 7fa776aac640 1 -- 172.21.15.55:0/79367856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa77015dca0 msgr2=0x7fa7700ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.842+0000 7fa776aac640 1 --2- 172.21.15.55:0/79367856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa77015dca0 0x7fa7700ce940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0097a0 tx=0x7fa76c02a180 comp rx=0 tx=0).stop 2024-04-25T08:59:44.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.842+0000 7fa776aac640 1 -- 172.21.15.55:0/79367856 shutdown_connections 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.842+0000 7fa776aac640 1 --2- 172.21.15.55:0/79367856 >> v2:172.21.15.167:3300/0 conn(0x7fa7700d1130 0x7fa7700b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.842+0000 7fa776aac640 1 --2- 172.21.15.55:0/79367856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa77015dca0 0x7fa7700ce940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.842+0000 7fa776aac640 1 -- 172.21.15.55:0/79367856 >> 172.21.15.55:0/79367856 conn(0x7fa7700726c0 msgr2=0x7fa770072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.842+0000 7fa776aac640 1 -- 172.21.15.55:0/79367856 shutdown_connections 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.842+0000 7fa776aac640 1 -- 172.21.15.55:0/79367856 wait complete. 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.843+0000 7fa776aac640 1 Processor -- start 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.843+0000 7fa776aac640 1 -- start start 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.844+0000 7fa776aac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7700d1130 0x7fa7700cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.844+0000 7fa776aac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7700d3b90 0x7fa770157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.844+0000 7fa776aac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa77015dca0 0x7fa770154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.844+0000 7fa776aac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77015e200 con 0x7fa7700d3b90 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.844+0000 7fa776aac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77015e080 con 0x7fa7700d1130 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.844+0000 7fa776aac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700cee80 con 0x7fa77015dca0 2024-04-25T08:59:44.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.844+0000 7fa767fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7700d3b90 0x7fa770157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.844+0000 7fa767fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7700d3b90 0x7fa770157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60416/0 (socket says 172.21.15.55:60416) 2024-04-25T08:59:44.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.844+0000 7fa767fff640 1 -- 172.21.15.55:0/3541637941 learned_addr learned my addr 172.21.15.55:0/3541637941 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:44.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.844+0000 7fa774848640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7700d1130 0x7fa7700cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.844+0000 7fa775049640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa77015dca0 0x7fa770154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.845+0000 7fa767fff640 1 -- 172.21.15.55:0/3541637941 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa77015dca0 msgr2=0x7fa770154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.845+0000 7fa767fff640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa77015dca0 0x7fa770154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.845+0000 7fa767fff640 1 -- 172.21.15.55:0/3541637941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7700d1130 msgr2=0x7fa7700cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:44.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.845+0000 7fa767fff640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7700d1130 0x7fa7700cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:44.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.845+0000 7fa767fff640 1 -- 172.21.15.55:0/3541637941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa770154c80 con 0x7fa7700d3b90 2024-04-25T08:59:44.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.845+0000 7fa767fff640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7700d3b90 0x7fa770157a20 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fa76000c430 tx=0x7fa76000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:44.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.845+0000 7fa7657fa640 1 -- 172.21.15.55:0/3541637941 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760017070 con 0x7fa7700d3b90 2024-04-25T08:59:44.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.845+0000 7fa7657fa640 1 -- 172.21.15.55:0/3541637941 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa760005ce0 con 0x7fa7700d3b90 2024-04-25T08:59:44.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.845+0000 7fa776aac640 1 -- 172.21.15.55:0/3541637941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7700cac90 con 0x7fa7700d3b90 2024-04-25T08:59:44.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.845+0000 7fa7657fa640 1 -- 172.21.15.55:0/3541637941 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7600072f0 con 0x7fa7700d3b90 2024-04-25T08:59:44.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.845+0000 7fa776aac640 1 -- 172.21.15.55:0/3541637941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa770154970 con 0x7fa7700d3b90 2024-04-25T08:59:44.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.846+0000 7fa776aac640 1 -- 172.21.15.55:0/3541637941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7700750b0 con 0x7fa7700d3b90 2024-04-25T08:59:44.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.846+0000 7fa7657fa640 1 -- 172.21.15.55:0/3541637941 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa76001a070 con 0x7fa7700d3b90 2024-04-25T08:59:44.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.847+0000 7fa7657fa640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa75c06b500 0x7fa75c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:44.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.847+0000 7fa7657fa640 1 -- 172.21.15.55:0/3541637941 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa760089560 con 0x7fa7700d3b90 2024-04-25T08:59:44.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.847+0000 7fa774848640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa75c06b500 0x7fa75c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:44.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.847+0000 7fa774848640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa75c06b500 0x7fa75c06d9c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa76c034000 tx=0x7fa76c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:44.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:44.851+0000 7fa7657fa640 1 -- 172.21.15.55:0/3541637941 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa760057e20 con 0x7fa7700d3b90 2024-04-25T08:59:45.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.030+0000 7fa776aac640 1 -- 172.21.15.55:0/3541637941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa77015c6e0 con 0x7fa7700d3b90 2024-04-25T08:59:45.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.031+0000 7fa7657fa640 1 -- 172.21.15.55:0/3541637941 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa76005bec0 con 0x7fa7700d3b90 2024-04-25T08:59:45.020 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T08:59:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.032+0000 7fa776aac640 1 -- 172.21.15.55:0/3541637941 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa75c06b500 msgr2=0x7fa75c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.033+0000 7fa776aac640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa75c06b500 0x7fa75c06d9c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa76c034000 tx=0x7fa76c02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.033+0000 7fa776aac640 1 -- 172.21.15.55:0/3541637941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7700d3b90 msgr2=0x7fa770157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.033+0000 7fa776aac640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7700d3b90 0x7fa770157a20 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fa76000c430 tx=0x7fa76000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.033+0000 7fa776aac640 1 -- 172.21.15.55:0/3541637941 shutdown_connections 2024-04-25T08:59:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.033+0000 7fa776aac640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa75c06b500 0x7fa75c06d9c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.033+0000 7fa776aac640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa77015dca0 0x7fa770154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.033+0000 7fa776aac640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7700d3b90 0x7fa770157a20 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.033+0000 7fa776aac640 1 --2- 172.21.15.55:0/3541637941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7700d1130 0x7fa7700cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.033+0000 7fa776aac640 1 -- 172.21.15.55:0/3541637941 >> 172.21.15.55:0/3541637941 conn(0x7fa7700726c0 msgr2=0x7fa77015cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.033+0000 7fa776aac640 1 -- 172.21.15.55:0/3541637941 shutdown_connections 2024-04-25T08:59:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.033+0000 7fa776aac640 1 -- 172.21.15.55:0/3541637941 wait complete. 2024-04-25T08:59:45.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:59:45.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.148+0000 7f6b8e6bc640 1 Processor -- start 2024-04-25T08:59:45.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.148+0000 7f6b8e6bc640 1 -- start start 2024-04-25T08:59:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b8e6bc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6b880d3b90 0x7f6b880d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b8e6bc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880d0f60 0x7f6b880b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b8e6bc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b880d4090 con 0x7f6b8815dca0 2024-04-25T08:59:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b8e6bc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b880b6b20 con 0x7f6b880d3b90 2024-04-25T08:59:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b8e6bc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880d1390 con 0x7f6b880d0f60 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b87fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6b8815dca0 0x7f6b880ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49824/0 (socket says 172.21.15.55:49824) 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b87fff640 1 -- 172.21.15.55:0/345828435 learned_addr learned my addr 172.21.15.55:0/345828435 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505676744 0 0) 0x7f6b880d4090 con 0x7f6b8815dca0 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b8cc59640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880d0f60 0x7f6b880b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b70003520 con 0x7f6b8815dca0 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b877fe640 1 --2- 172.21.15.55:0/345828435 >> v2:172.21.15.167:3300/0 conn(0x7f6b880d3b90 0x7f6b880d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 728822229 0 0) 0x7f6b70003520 con 0x7f6b8815dca0 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880d0f60 msgr2=0x7f6b880b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880d0f60 0x7f6b880b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 >> v2:172.21.15.167:3300/0 conn(0x7f6b880d3b90 msgr2=0x7f6b880d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 --2- 172.21.15.55:0/345828435 >> v2:172.21.15.167:3300/0 conn(0x7f6b880d3b90 0x7f6b880d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b880d4370 con 0x7f6b8815dca0 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f6b78001670 con 0x7f6b8815dca0 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b877fe640 1 --2- 172.21.15.55:0/345828435 >> v2:172.21.15.167:3300/0 conn(0x7f6b880d3b90 0x7f6b880d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b8cc59640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880d0f60 0x7f6b880b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 >> v1:172.21.15.55:6789/0 conn(0x7f6b8815dca0 legacy=0x7f6b880ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 0x7f6b70003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880d0f60 0x7f6b70004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b70004d40 0x7f6b700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880d1390 con 0x7f6b700039e0 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7000ba70 con 0x7f6b70004d40 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.149+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7000bc20 con 0x7f6b880d0f60 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.150+0000 7f6b87fff640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 0x7f6b70003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.150+0000 7f6b877fe640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880d0f60 0x7f6b70004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.150+0000 7f6b8cc59640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b70004d40 0x7f6b700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.150+0000 7f6b87fff640 1 -- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880d0f60 msgr2=0x7f6b70004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.150+0000 7f6b87fff640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880d0f60 0x7f6b70004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.150+0000 7f6b87fff640 1 -- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b70004d40 msgr2=0x7f6b700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.150+0000 7f6b87fff640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b70004d40 0x7f6b700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.150+0000 7f6b87fff640 1 -- 172.21.15.55:0/345828435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70003520 con 0x7f6b700039e0 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.150+0000 7f6b877fe640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880d0f60 0x7f6b70004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.150+0000 7f6b8cc59640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b70004d40 0x7f6b700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.150+0000 7f6b87fff640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 0x7f6b70003e00 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800c240 tx=0x7f6b70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f002656b1a9ada41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.151+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78007cf0 con 0x7f6b700039e0 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.151+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b780058d0 con 0x7f6b700039e0 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.151+0000 7f6b86ffd640 1 -- 172.21.15.55:0/345828435 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78005ce0 con 0x7f6b700039e0 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.151+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/345828435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 msgr2=0x7f6b70003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.151+0000 7f6b8e6bc640 1 --2- 172.21.15.55:0/345828435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 0x7f6b70003e00 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800c240 tx=0x7f6b70005830 comp rx=0 tx=0).stop 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.151+0000 7f6b8cc59640 1 -- 172.21.15.55:0/345828435 reap_dead start 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.151+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/345828435 shutdown_connections 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.151+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/345828435 >> 172.21.15.55:0/345828435 conn(0x7f6b880726c0 msgr2=0x7f6b88072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.151+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/345828435 shutdown_connections 2024-04-25T08:59:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.151+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/345828435 wait complete. 2024-04-25T08:59:45.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.152+0000 7f6b8e6bc640 1 Processor -- start 2024-04-25T08:59:45.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.153+0000 7f6b8e6bc640 1 -- start start 2024-04-25T08:59:45.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.153+0000 7f6b8e6bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 0x7f6b881592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.153+0000 7f6b8e6bc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880cd880 0x7f6b88159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.153+0000 7f6b8e6bc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b880cab60 0x7f6b880cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.153+0000 7f6b8e6bc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880cf050 con 0x7f6b700039e0 2024-04-25T08:59:45.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.153+0000 7f6b8e6bc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880b6d50 con 0x7f6b880cab60 2024-04-25T08:59:45.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.153+0000 7f6b8e6bc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8815e080 con 0x7f6b880cd880 2024-04-25T08:59:45.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.153+0000 7f6b87fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 0x7f6b881592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b87fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 0x7f6b881592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60434/0 (socket says 172.21.15.55:60434) 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b87fff640 1 -- 172.21.15.55:0/3261484733 learned_addr learned my addr 172.21.15.55:0/3261484733 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b8cc59640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b880cab60 0x7f6b880cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b877fe640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880cd880 0x7f6b88159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b87fff640 1 -- 172.21.15.55:0/3261484733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880cd880 msgr2=0x7f6b88159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b87fff640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880cd880 0x7f6b88159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b87fff640 1 -- 172.21.15.55:0/3261484733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b880cab60 msgr2=0x7f6b880cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b87fff640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b880cab60 0x7f6b880cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b87fff640 1 -- 172.21.15.55:0/3261484733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b88158da0 con 0x7f6b700039e0 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b8cc59640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b880cab60 0x7f6b880cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b87fff640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 0x7f6b881592f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f6b78001970 tx=0x7f6b880d4540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b84ff9640 1 -- 172.21.15.55:0/3261484733 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78007280 con 0x7f6b700039e0 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b84ff9640 1 -- 172.21.15.55:0/3261484733 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78043070 con 0x7f6b700039e0 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/3261484733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b880cb740 con 0x7f6b700039e0 2024-04-25T08:59:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b84ff9640 1 -- 172.21.15.55:0/3261484733 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78007620 con 0x7f6b700039e0 2024-04-25T08:59:45.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.154+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/3261484733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b880cbd00 con 0x7f6b700039e0 2024-04-25T08:59:45.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.155+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/3261484733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b880750b0 con 0x7f6b700039e0 2024-04-25T08:59:45.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.156+0000 7f6b84ff9640 1 -- 172.21.15.55:0/3261484733 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6b78048460 con 0x7f6b700039e0 2024-04-25T08:59:45.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.156+0000 7f6b84ff9640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b7406b4d0 0x7f6b7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.156+0000 7f6b84ff9640 1 -- 172.21.15.55:0/3261484733 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b780aa850 con 0x7f6b700039e0 2024-04-25T08:59:45.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.156+0000 7f6b877fe640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b7406b4d0 0x7f6b7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.157+0000 7f6b877fe640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b7406b4d0 0x7f6b7406d990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6b880b53c0 tx=0x7f6b7c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.160+0000 7f6b84ff9640 1 -- 172.21.15.55:0/3261484733 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6b88158da0 con 0x7f6b700039e0 2024-04-25T08:59:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.340+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/3261484733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b88072f90 con 0x7f6b700039e0 2024-04-25T08:59:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.340+0000 7f6b84ff9640 1 -- 172.21.15.55:0/3261484733 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b780796d0 con 0x7f6b700039e0 2024-04-25T08:59:45.329 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T08:59:45.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/3261484733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b7406b4d0 msgr2=0x7f6b7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b7406b4d0 0x7f6b7406d990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6b880b53c0 tx=0x7f6b7c008040 comp rx=0 tx=0).stop 2024-04-25T08:59:45.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/3261484733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 msgr2=0x7f6b881592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 0x7f6b881592f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f6b78001970 tx=0x7f6b880d4540 comp rx=0 tx=0).stop 2024-04-25T08:59:45.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/3261484733 shutdown_connections 2024-04-25T08:59:45.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6b7406b4d0 0x7f6b7406d990 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b880cab60 0x7f6b880cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b880cd880 0x7f6b88159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 --2- 172.21.15.55:0/3261484733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700039e0 0x7f6b881592f0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/3261484733 >> 172.21.15.55:0/3261484733 conn(0x7f6b880726c0 msgr2=0x7f6b880b8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:45.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/3261484733 shutdown_connections 2024-04-25T08:59:45.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.342+0000 7f6b8e6bc640 1 -- 172.21.15.55:0/3261484733 wait complete. 2024-04-25T08:59:45.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:59:45.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.455+0000 7f4bc75c8640 1 Processor -- start 2024-04-25T08:59:45.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.455+0000 7f4bc75c8640 1 -- start start 2024-04-25T08:59:45.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.456+0000 7f4bc75c8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4bc00cd940 0x7f4bc00ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.456+0000 7f4bc75c8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc006c220 con 0x7f4bc015dc50 2024-04-25T08:59:45.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.456+0000 7f4bc75c8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc00cec10 con 0x7f4bc0071590 2024-04-25T08:59:45.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.456+0000 7f4bc75c8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc00cfe00 con 0x7f4bc00cd940 2024-04-25T08:59:45.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.456+0000 7f4bc5364640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4bc015dc50 0x7f4bc0070e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49828/0 (socket says 172.21.15.55:49828) 2024-04-25T08:59:45.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.456+0000 7f4bc5364640 1 -- 172.21.15.55:0/2292767583 learned_addr learned my addr 172.21.15.55:0/2292767583 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:45.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.456+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119674310 0 0) 0x7f4bc006c220 con 0x7f4bc015dc50 2024-04-25T08:59:45.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.456+0000 7f4bc5b65640 1 --2- 172.21.15.55:0/2292767583 >> v2:172.21.15.167:3300/0 conn(0x7f4bc00cd940 0x7f4bc00ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.456+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bac003520 con 0x7f4bc015dc50 2024-04-25T08:59:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2319877725 0 0) 0x7f4bac003520 con 0x7f4bc015dc50 2024-04-25T08:59:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 >> v2:172.21.15.167:3300/0 conn(0x7f4bc00cd940 msgr2=0x7f4bc00ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 --2- 172.21.15.55:0/2292767583 >> v2:172.21.15.167:3300/0 conn(0x7f4bc00cd940 0x7f4bc00ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 >> v1:172.21.15.167:6789/0 conn(0x7f4bc0071590 legacy=0x7f4bc00cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00d0050 con 0x7f4bc015dc50 2024-04-25T08:59:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f4bbc001670 con 0x7f4bc015dc50 2024-04-25T08:59:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 >> v1:172.21.15.55:6789/0 conn(0x7f4bc015dc50 legacy=0x7f4bc0070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bac0039b0 0x7f4bac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bac004800 0x7f4bac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bac0051c0 0x7f4bac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00cfe00 con 0x7f4bac0039b0 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac00c060 con 0x7f4bac004800 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac00c260 con 0x7f4bac0051c0 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bc5364640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bac0039b0 0x7f4bac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bc4b63640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bac004800 0x7f4bac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bc5b65640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bac0051c0 0x7f4bac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bc5364640 1 -- 172.21.15.55:0/2292767583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bac0051c0 msgr2=0x7f4bac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bc5364640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bac0051c0 0x7f4bac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bc5364640 1 -- 172.21.15.55:0/2292767583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bac004800 msgr2=0x7f4bac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bc5364640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bac004800 0x7f4bac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bc5364640 1 -- 172.21.15.55:0/2292767583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac003520 con 0x7f4bac0039b0 2024-04-25T08:59:45.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bc4b63640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bac004800 0x7f4bac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bc5b65640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bac0051c0 0x7f4bac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.457+0000 7f4bc5b65640 1 -- 172.21.15.55:0/2292767583 reap_dead start 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.458+0000 7f4bc5364640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bac0039b0 0x7f4bac003dd0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c210 tx=0x7f4bac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add4dd712cdb9529 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.458+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc007d30 con 0x7f4bac0039b0 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.458+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc005af0 con 0x7f4bac0039b0 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.458+0000 7f4bb7fff640 1 -- 172.21.15.55:0/2292767583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc007070 con 0x7f4bac0039b0 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.458+0000 7f4bc75c8640 1 -- 172.21.15.55:0/2292767583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bac0039b0 msgr2=0x7f4bac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.458+0000 7f4bc75c8640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bac0039b0 0x7f4bac003dd0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c210 tx=0x7f4bac005830 comp rx=0 tx=0).stop 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.459+0000 7f4bc75c8640 1 -- 172.21.15.55:0/2292767583 shutdown_connections 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.459+0000 7f4bc75c8640 1 --2- 172.21.15.55:0/2292767583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bac0039b0 0x7f4bac003dd0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.459+0000 7f4bc75c8640 1 -- 172.21.15.55:0/2292767583 >> 172.21.15.55:0/2292767583 conn(0x7f4bc006f430 msgr2=0x7f4bc006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.459+0000 7f4bc75c8640 1 -- 172.21.15.55:0/2292767583 shutdown_connections 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.459+0000 7f4bc75c8640 1 -- 172.21.15.55:0/2292767583 wait complete. 2024-04-25T08:59:45.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.460+0000 7f4bc75c8640 1 Processor -- start 2024-04-25T08:59:45.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.460+0000 7f4bc75c8640 1 -- start start 2024-04-25T08:59:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc75c8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bac0039b0 0x7f4bc014a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc75c8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bc01e7650 0x7f4bc00caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc75c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bc01e7ad0 0x7f4bc00cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc75c8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00ce8a0 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc75c8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00cc0c0 con 0x7f4bc01e7650 2024-04-25T08:59:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc75c8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc015e030 con 0x7f4bac0039b0 2024-04-25T08:59:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc5b65640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bc01e7ad0 0x7f4bc00cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc5b65640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bc01e7ad0 0x7f4bc00cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60448/0 (socket says 172.21.15.55:60448) 2024-04-25T08:59:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc5b65640 1 -- 172.21.15.55:0/3682911627 learned_addr learned my addr 172.21.15.55:0/3682911627 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc5364640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bac0039b0 0x7f4bc014a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc4b63640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bc01e7650 0x7f4bc00caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc5b65640 1 -- 172.21.15.55:0/3682911627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bac0039b0 msgr2=0x7f4bc014a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc5b65640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bac0039b0 0x7f4bc014a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc5b65640 1 -- 172.21.15.55:0/3682911627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bc01e7650 msgr2=0x7f4bc00caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc5b65640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bc01e7650 0x7f4bc00caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc5b65640 1 -- 172.21.15.55:0/3682911627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc014a640 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc5b65640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bc01e7ad0 0x7f4bc00cb000 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00b0a90 tx=0x7f4bb8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bb5ffb640 1 -- 172.21.15.55:0/3682911627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb801a030 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bb5ffb640 1 -- 172.21.15.55:0/3682911627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb8010dd0 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bb5ffb640 1 -- 172.21.15.55:0/3682911627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8003bd0 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.461+0000 7f4bc75c8640 1 -- 172.21.15.55:0/3682911627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc01e80a0 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.462+0000 7f4bc75c8640 1 -- 172.21.15.55:0/3682911627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc00b4590 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.463+0000 7f4bc75c8640 1 -- 172.21.15.55:0/3682911627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc00750b0 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.463+0000 7f4bb5ffb640 1 -- 172.21.15.55:0/3682911627 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4bb8005d10 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.464+0000 7f4bb5ffb640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4ba406b4d0 0x7f4ba406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.464+0000 7f4bc5364640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4ba406b4d0 0x7f4ba406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.464+0000 7f4bb5ffb640 1 -- 172.21.15.55:0/3682911627 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bb808a760 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.464+0000 7f4bc5364640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4ba406b4d0 0x7f4ba406d990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc001eb0 tx=0x7f4bbc02d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:45.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.468+0000 7f4bb5ffb640 1 -- 172.21.15.55:0/3682911627 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4bb8025020 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.661+0000 7f4bc75c8640 1 -- 172.21.15.55:0/3682911627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4bc015d2e0 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.661+0000 7f4bb5ffb640 1 -- 172.21.15.55:0/3682911627 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4bb8059670 con 0x7f4bc01e7ad0 2024-04-25T08:59:45.651 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T08:59:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 -- 172.21.15.55:0/3682911627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4ba406b4d0 msgr2=0x7f4ba406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4ba406b4d0 0x7f4ba406d990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc001eb0 tx=0x7f4bbc02d000 comp rx=0 tx=0).stop 2024-04-25T08:59:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 -- 172.21.15.55:0/3682911627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bc01e7ad0 msgr2=0x7f4bc00cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bc01e7ad0 0x7f4bc00cb000 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00b0a90 tx=0x7f4bb8010590 comp rx=0 tx=0).stop 2024-04-25T08:59:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 -- 172.21.15.55:0/3682911627 shutdown_connections 2024-04-25T08:59:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4ba406b4d0 0x7f4ba406d990 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bc01e7ad0 0x7f4bc00cb000 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bc01e7650 0x7f4bc00caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 --2- 172.21.15.55:0/3682911627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4bac0039b0 0x7f4bc014a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 -- 172.21.15.55:0/3682911627 >> 172.21.15.55:0/3682911627 conn(0x7f4bc006f430 msgr2=0x7f4bc00ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 -- 172.21.15.55:0/3682911627 shutdown_connections 2024-04-25T08:59:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.663+0000 7f4bc75c8640 1 -- 172.21.15.55:0/3682911627 wait complete. 2024-04-25T08:59:45.663 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:59:45.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:45.663 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:45.717 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T08:59:45.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:45.717 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:59:45.741 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:45.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.893+0000 7f7152b6a640 1 Processor -- start 2024-04-25T08:59:45.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.893+0000 7f7152b6a640 1 -- start start 2024-04-25T08:59:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.893+0000 7f7152b6a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f714c15a870 0x7f714c0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.893+0000 7f7152b6a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c0cdb10 con 0x7f714c0cfc40 2024-04-25T08:59:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.893+0000 7f7152b6a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c0cddf0 con 0x7f714c06e2e0 2024-04-25T08:59:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.893+0000 7f7152b6a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0ce720 con 0x7f714c15a870 2024-04-25T08:59:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f7151107640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f714c0cfc40 0x7f714c15bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49844/0 (socket says 172.21.15.55:49844) 2024-04-25T08:59:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f7151107640 1 -- 172.21.15.55:0/3601535706 learned_addr learned my addr 172.21.15.55:0/3601535706 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f7150906640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f714c15a870 0x7f714c0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675184637 0 0) 0x7f714c0cdb10 con 0x7f714c0cfc40 2024-04-25T08:59:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7134003520 con 0x7f714c0cfc40 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441355883 0 0) 0x7f714c0cddf0 con 0x7f714c06e2e0 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f714c0cdb10 con 0x7f714c06e2e0 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 498501632 0 0) 0x7f7134003520 con 0x7f714c0cfc40 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f714c15a870 msgr2=0x7f714c0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f714c15a870 0x7f714c0cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 >> v1:172.21.15.167:6789/0 conn(0x7f714c06e2e0 legacy=0x7f714c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c0ce0d0 con 0x7f714c0cfc40 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f71440019f0 con 0x7f714c0cfc40 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 >> v1:172.21.15.55:6789/0 conn(0x7f714c0cfc40 legacy=0x7f714c15bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7134003b70 0x7f7134003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134004800 0x7f7134004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f714c15a870 0x7f71340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0ce720 con 0x7f7134003b70 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713400ba70 con 0x7f7134004800 2024-04-25T08:59:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713400bc40 con 0x7f714c15a870 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f7150906640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7134003b70 0x7f7134003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f7151107640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f714c15a870 0x7f71340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.894+0000 7f714bfff640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134004800 0x7f7134004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.895+0000 7f7150906640 1 -- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f714c15a870 msgr2=0x7f71340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.895+0000 7f7150906640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f714c15a870 0x7f71340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.895+0000 7f7150906640 1 -- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134004800 msgr2=0x7f7134004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.895+0000 7f7150906640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134004800 0x7f7134004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.895+0000 7f7150906640 1 -- 172.21.15.55:0/3601535706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134003520 con 0x7f7134003b70 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.895+0000 7f7151107640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f714c15a870 0x7f71340051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.895+0000 7f7150906640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7134003b70 0x7f7134003f70 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f713c009ac0 tx=0x7f7134005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4177750f8d700ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.895+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c036070 con 0x7f7134003b70 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.895+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c031400 con 0x7f7134003b70 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.895+0000 7f714b7fe640 1 -- 172.21.15.55:0/3601535706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c009690 con 0x7f7134003b70 2024-04-25T08:59:45.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.896+0000 7f7152b6a640 1 -- 172.21.15.55:0/3601535706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7134003b70 msgr2=0x7f7134003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.896+0000 7f7152b6a640 1 --2- 172.21.15.55:0/3601535706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7134003b70 0x7f7134003f70 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f713c009ac0 tx=0x7f7134005830 comp rx=0 tx=0).stop 2024-04-25T08:59:45.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.896+0000 7f7151107640 1 -- 172.21.15.55:0/3601535706 reap_dead start 2024-04-25T08:59:45.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.896+0000 7f7152b6a640 1 -- 172.21.15.55:0/3601535706 shutdown_connections 2024-04-25T08:59:45.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.896+0000 7f7152b6a640 1 -- 172.21.15.55:0/3601535706 >> 172.21.15.55:0/3601535706 conn(0x7f714c06aba0 msgr2=0x7f714c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:45.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.896+0000 7f7152b6a640 1 -- 172.21.15.55:0/3601535706 shutdown_connections 2024-04-25T08:59:45.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.896+0000 7f7152b6a640 1 -- 172.21.15.55:0/3601535706 wait complete. 2024-04-25T08:59:45.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.897+0000 7f7152b6a640 1 Processor -- start 2024-04-25T08:59:45.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.897+0000 7f7152b6a640 1 -- start start 2024-04-25T08:59:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7152b6a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7134003b70 0x7f714c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7152b6a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f714c0b38f0 0x7f714c0a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7152b6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f714c0a9c50 0x7f714c1e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7152b6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0cd700 con 0x7f714c0a9c50 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7152b6a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0cd580 con 0x7f714c0b38f0 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7152b6a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0cd880 con 0x7f7134003b70 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7151107640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f714c0a9c50 0x7f714c1e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7151107640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f714c0a9c50 0x7f714c1e3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60472/0 (socket says 172.21.15.55:60472) 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7151107640 1 -- 172.21.15.55:0/991670583 learned_addr learned my addr 172.21.15.55:0/991670583 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7150906640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7134003b70 0x7f714c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f714bfff640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f714c0b38f0 0x7f714c0a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7151107640 1 -- 172.21.15.55:0/991670583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7134003b70 msgr2=0x7f714c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7151107640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7134003b70 0x7f714c0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.898+0000 7f7151107640 1 -- 172.21.15.55:0/991670583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f714c0b38f0 msgr2=0x7f714c0a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.899+0000 7f7151107640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f714c0b38f0 0x7f714c0a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.899+0000 7f7151107640 1 -- 172.21.15.55:0/991670583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c145e50 con 0x7f714c0a9c50 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.899+0000 7f7150906640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7134003b70 0x7f714c0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.899+0000 7f7151107640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f714c0a9c50 0x7f714c1e3360 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7144000f80 tx=0x7f714400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.899+0000 7f71497fa640 1 -- 172.21.15.55:0/991670583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714400ec10 con 0x7f714c0a9c50 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.899+0000 7f71497fa640 1 -- 172.21.15.55:0/991670583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7144018070 con 0x7f714c0a9c50 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.899+0000 7f71497fa640 1 -- 172.21.15.55:0/991670583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144013420 con 0x7f714c0a9c50 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.899+0000 7f7152b6a640 1 -- 172.21.15.55:0/991670583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c146cd0 con 0x7f714c0a9c50 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.899+0000 7f7152b6a640 1 -- 172.21.15.55:0/991670583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c147290 con 0x7f714c0a9c50 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.900+0000 7f7152b6a640 1 -- 172.21.15.55:0/991670583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c0749b0 con 0x7f714c0a9c50 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.900+0000 7f71497fa640 1 -- 172.21.15.55:0/991670583 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f71440135c0 con 0x7f714c0a9c50 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.901+0000 7f71497fa640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f713806b470 0x7f713806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.901+0000 7f71497fa640 1 -- 172.21.15.55:0/991670583 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f714408a5d0 con 0x7f714c0a9c50 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.901+0000 7f7150906640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f713806b470 0x7f713806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.901+0000 7f7150906640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f713806b470 0x7f713806d930 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f713c033000 tx=0x7f713c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:45.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:45.905+0000 7f71497fa640 1 -- 172.21.15.55:0/991670583 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f71440593c0 con 0x7f714c0a9c50 2024-04-25T08:59:46.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.122+0000 7f7152b6a640 1 -- 172.21.15.55:0/991670583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f714c0b3cd0 con 0x7f714c0a9c50 2024-04-25T08:59:46.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.122+0000 7f71497fa640 1 -- 172.21.15.55:0/991670583 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f7144058cc0 con 0x7f714c0a9c50 2024-04-25T08:59:46.111 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:46.111 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T08:59:34.832597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7323},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7323":{"gid":7323,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3953928431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3953928431},{"type":"v1","addr":"172.21.15.55:6837","nonce":3953928431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:59:46.112 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2024-04-25T08:59:46.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 -- 172.21.15.55:0/991670583 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f713806b470 msgr2=0x7f713806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f713806b470 0x7f713806d930 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f713c033000 tx=0x7f713c008030 comp rx=0 tx=0).stop 2024-04-25T08:59:46.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 -- 172.21.15.55:0/991670583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f714c0a9c50 msgr2=0x7f714c1e3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f714c0a9c50 0x7f714c1e3360 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7144000f80 tx=0x7f714400e530 comp rx=0 tx=0).stop 2024-04-25T08:59:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 -- 172.21.15.55:0/991670583 shutdown_connections 2024-04-25T08:59:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f713806b470 0x7f713806d930 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f714c0a9c50 0x7f714c1e3360 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f714c0b38f0 0x7f714c0a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 --2- 172.21.15.55:0/991670583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7134003b70 0x7f714c0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 -- 172.21.15.55:0/991670583 >> 172.21.15.55:0/991670583 conn(0x7f714c06aba0 msgr2=0x7f714c0cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 -- 172.21.15.55:0/991670583 shutdown_connections 2024-04-25T08:59:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.124+0000 7f7152b6a640 1 -- 172.21.15.55:0/991670583 wait complete. 2024-04-25T08:59:46.124 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T08:59:46.255 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-25T08:59:46.256 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T08:59:46.256 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:59:46.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.369+0000 7f98e3142640 1 Processor -- start 2024-04-25T08:59:46.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.369+0000 7f98e3142640 1 -- start start 2024-04-25T08:59:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e3142640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98dc06aba0 0x7f98dc06af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e3142640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f98dc0cc8c0 0x7f98dc06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e3142640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98dc070440 con 0x7f98dc06f980 2024-04-25T08:59:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e3142640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc15e280 con 0x7f98dc0cc8c0 2024-04-25T08:59:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e3142640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0caed0 con 0x7f98dc06aba0 2024-04-25T08:59:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e16df640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f98dc0cc8c0 0x7f98dc06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e16df640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f98dc0cc8c0 0x7f98dc06eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60478/0 (socket says 172.21.15.55:60478) 2024-04-25T08:59:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e16df640 1 -- 172.21.15.55:0/2530557220 learned_addr learned my addr 172.21.15.55:0/2530557220 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e0ede640 1 --2- 172.21.15.55:0/2530557220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98dc06aba0 0x7f98dc06af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e16df640 1 -- 172.21.15.55:0/2530557220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98dc06aba0 msgr2=0x7f98dc06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e16df640 1 --2- 172.21.15.55:0/2530557220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98dc06aba0 0x7f98dc06af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e16df640 1 -- 172.21.15.55:0/2530557220 >> v1:172.21.15.167:6789/0 conn(0x7f98dc06f980 legacy=0x7f98dc06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e16df640 1 -- 172.21.15.55:0/2530557220 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc06b4c0 con 0x7f98dc0cc8c0 2024-04-25T08:59:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.370+0000 7f98e0ede640 1 --2- 172.21.15.55:0/2530557220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98dc06aba0 0x7f98dc06af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.371+0000 7f98e16df640 1 --2- 172.21.15.55:0/2530557220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc0cc8c0 0x7f98dc06eac0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009e50 tx=0x7f98d402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0f884a1b3e826 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.371+0000 7f98db7fe640 1 -- 172.21.15.55:0/2530557220 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4036070 con 0x7f98dc0cc8c0 2024-04-25T08:59:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.371+0000 7f98db7fe640 1 -- 172.21.15.55:0/2530557220 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d4031600 con 0x7f98dc0cc8c0 2024-04-25T08:59:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.371+0000 7f98db7fe640 1 -- 172.21.15.55:0/2530557220 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40319d0 con 0x7f98dc0cc8c0 2024-04-25T08:59:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.372+0000 7f98e3142640 1 -- 172.21.15.55:0/2530557220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc0cc8c0 msgr2=0x7f98dc06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.372+0000 7f98e3142640 1 --2- 172.21.15.55:0/2530557220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc0cc8c0 0x7f98dc06eac0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009e50 tx=0x7f98d402a710 comp rx=0 tx=0).stop 2024-04-25T08:59:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.372+0000 7f98e3142640 1 -- 172.21.15.55:0/2530557220 shutdown_connections 2024-04-25T08:59:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.372+0000 7f98e3142640 1 --2- 172.21.15.55:0/2530557220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc0cc8c0 0x7f98dc06eac0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.372+0000 7f98e3142640 1 --2- 172.21.15.55:0/2530557220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98dc06aba0 0x7f98dc06af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.372+0000 7f98e3142640 1 -- 172.21.15.55:0/2530557220 >> 172.21.15.55:0/2530557220 conn(0x7f98dc0d0750 msgr2=0x7f98dc0d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:46.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.372+0000 7f98e3142640 1 -- 172.21.15.55:0/2530557220 shutdown_connections 2024-04-25T08:59:46.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.372+0000 7f98e3142640 1 -- 172.21.15.55:0/2530557220 wait complete. 2024-04-25T08:59:46.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.373+0000 7f98e3142640 1 Processor -- start 2024-04-25T08:59:46.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.373+0000 7f98e3142640 1 -- start start 2024-04-25T08:59:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98e3142640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98dc06aba0 0x7f98dc14f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98e3142640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc06f980 0x7f98dc09c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98e3142640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98dc0cc8c0 0x7f98dc09cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98e3142640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0cb170 con 0x7f98dc06f980 2024-04-25T08:59:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98e3142640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc070160 con 0x7f98dc06aba0 2024-04-25T08:59:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98e3142640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc06b950 con 0x7f98dc0cc8c0 2024-04-25T08:59:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc06f980 0x7f98dc09c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc06f980 0x7f98dc09c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60482/0 (socket says 172.21.15.55:60482) 2024-04-25T08:59:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98dbfff640 1 -- 172.21.15.55:0/2709759993 learned_addr learned my addr 172.21.15.55:0/2709759993 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98e0ede640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98dc06aba0 0x7f98dc14f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98e16df640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98dc0cc8c0 0x7f98dc09cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98dbfff640 1 -- 172.21.15.55:0/2709759993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98dc0cc8c0 msgr2=0x7f98dc09cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98dbfff640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98dc0cc8c0 0x7f98dc09cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98dbfff640 1 -- 172.21.15.55:0/2709759993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98dc06aba0 msgr2=0x7f98dc14f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98dbfff640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98dc06aba0 0x7f98dc14f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.374+0000 7f98dbfff640 1 -- 172.21.15.55:0/2709759993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc09d180 con 0x7f98dc06f980 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.375+0000 7f98dbfff640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc06f980 0x7f98dc09c610 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f98d000c400 tx=0x7f98d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.375+0000 7f98d97fa640 1 -- 172.21.15.55:0/2709759993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00052d0 con 0x7f98dc06f980 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.375+0000 7f98d97fa640 1 -- 172.21.15.55:0/2709759993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d0005490 con 0x7f98dc06f980 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.375+0000 7f98e3142640 1 -- 172.21.15.55:0/2709759993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc09d460 con 0x7f98dc06f980 2024-04-25T08:59:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.375+0000 7f98d97fa640 1 -- 172.21.15.55:0/2709759993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0007260 con 0x7f98dc06f980 2024-04-25T08:59:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.375+0000 7f98e3142640 1 -- 172.21.15.55:0/2709759993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc15c520 con 0x7f98dc06f980 2024-04-25T08:59:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.376+0000 7f98e3142640 1 -- 172.21.15.55:0/2709759993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc0750b0 con 0x7f98dc06f980 2024-04-25T08:59:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.376+0000 7f98d97fa640 1 -- 172.21.15.55:0/2709759993 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f98d0007400 con 0x7f98dc06f980 2024-04-25T08:59:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.377+0000 7f98d97fa640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 0x7f98c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.377+0000 7f98d97fa640 1 -- 172.21.15.55:0/2709759993 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98d00897f0 con 0x7f98dc06f980 2024-04-25T08:59:46.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.377+0000 7f98e0ede640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 0x7f98c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.377+0000 7f98e0ede640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 0x7f98c806d990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f98cc006fd0 tx=0x7f98cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.381+0000 7f98d97fa640 1 -- 172.21.15.55:0/2709759993 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98d00585d0 con 0x7f98dc06f980 2024-04-25T08:59:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.598+0000 7f98e3142640 1 -- 172.21.15.55:0/2709759993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f98dc06d330 con 0x7f98dc06f980 2024-04-25T08:59:46.588 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T08:59:46.599+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:59:46.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.600+0000 7f98d97fa640 1 -- 172.21.15.55:0/2709759993 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f98d0057ed0 con 0x7f98dc06f980 2024-04-25T08:59:46.589 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:59:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.602+0000 7f98e3142640 1 -- 172.21.15.55:0/2709759993 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 msgr2=0x7f98c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.602+0000 7f98e3142640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 0x7f98c806d990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f98cc006fd0 tx=0x7f98cc008040 comp rx=0 tx=0).stop 2024-04-25T08:59:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.602+0000 7f98e3142640 1 -- 172.21.15.55:0/2709759993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc06f980 msgr2=0x7f98dc09c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.602+0000 7f98e3142640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc06f980 0x7f98dc09c610 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f98d000c400 tx=0x7f98d000c8c0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.603+0000 7f98e3142640 1 -- 172.21.15.55:0/2709759993 shutdown_connections 2024-04-25T08:59:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.603+0000 7f98e3142640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f98c806b4d0 0x7f98c806d990 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.603+0000 7f98e3142640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98dc0cc8c0 0x7f98dc09cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.603+0000 7f98e3142640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc06f980 0x7f98dc09c610 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.603+0000 7f98e3142640 1 --2- 172.21.15.55:0/2709759993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98dc06aba0 0x7f98dc14f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.603+0000 7f98e3142640 1 -- 172.21.15.55:0/2709759993 >> 172.21.15.55:0/2709759993 conn(0x7f98dc0d0750 msgr2=0x7f98dc0cd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.603+0000 7f98e3142640 1 -- 172.21.15.55:0/2709759993 shutdown_connections 2024-04-25T08:59:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.603+0000 7f98e3142640 1 -- 172.21.15.55:0/2709759993 wait complete. 2024-04-25T08:59:46.595 INFO:tasks.ceph.mds.c.smithi055.stderr: -4951> 2024-04-25T08:59:35.441+0000 7f31ffa9f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:59:46.604 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-04-25T08:59:46.625 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T08:59:46.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.658+0000 7f0dbb2edf40 1 Processor -- start 2024-04-25T08:59:46.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.658+0000 7f0dbb2edf40 1 -- start start 2024-04-25T08:59:46.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.658+0000 7f0dbb2edf40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cf9df23b00 0x55cf9df1e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.658+0000 7f0dbb2edf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23ee0 0x55cf9def5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.658+0000 7f0dbb2edf40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf9dfca9b0 0x55cf9dfc7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.658+0000 7f0dbb2edf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf9de9adf0 con 0x55cf9df23ee0 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.658+0000 7f0dbb2edf40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf9de9ed50 con 0x55cf9dfca9b0 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.658+0000 7f0dbb2edf40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf9dfc9540 con 0x55cf9df23b00 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.658+0000 7f0db85ed640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23ee0 0x55cf9def5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0db85ed640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23ee0 0x55cf9def5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60534/0 (socket says 172.21.15.55:60534) 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0db85ed640 1 -- 172.21.15.55:0/1822713746 learned_addr learned my addr 172.21.15.55:0/1822713746 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0db85ed640 1 -- 172.21.15.55:0/1822713746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cf9df23b00 msgr2=0x55cf9df1e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0db85ed640 1 --2- 172.21.15.55:0/1822713746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cf9df23b00 0x55cf9df1e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0db85ed640 1 -- 172.21.15.55:0/1822713746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf9dfca9b0 msgr2=0x55cf9dfc7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0db85ed640 1 --2- 172.21.15.55:0/1822713746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf9dfca9b0 0x55cf9dfc7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0db85ed640 1 -- 172.21.15.55:0/1822713746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf9dfb7780 con 0x55cf9df23ee0 2024-04-25T08:59:46.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0db85ed640 1 --2- 172.21.15.55:0/1822713746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23ee0 0x55cf9def5af0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f0da0001db0 tx=0x7f0da000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1014c23cc565aec8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0db75eb640 1 -- 172.21.15.55:0/1822713746 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000bde0 con 0x55cf9df23ee0 2024-04-25T08:59:46.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0db75eb640 1 -- 172.21.15.55:0/1822713746 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da000f400 con 0x55cf9df23ee0 2024-04-25T08:59:46.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0db75eb640 1 -- 172.21.15.55:0/1822713746 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000f7f0 con 0x55cf9df23ee0 2024-04-25T08:59:46.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1822713746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23ee0 msgr2=0x55cf9def5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0dbb2edf40 1 --2- 172.21.15.55:0/1822713746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23ee0 0x55cf9def5af0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f0da0001db0 tx=0x7f0da000b5b0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1822713746 shutdown_connections 2024-04-25T08:59:46.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0dbb2edf40 1 --2- 172.21.15.55:0/1822713746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf9dfca9b0 0x55cf9dfc7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0dbb2edf40 1 --2- 172.21.15.55:0/1822713746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23ee0 0x55cf9def5af0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.659+0000 7f0dbb2edf40 1 --2- 172.21.15.55:0/1822713746 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cf9df23b00 0x55cf9df1e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.660+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1822713746 >> 172.21.15.55:0/1822713746 conn(0x55cf9df1e3d0 msgr2=0x55cf9df1d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.660+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1822713746 shutdown_connections 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.660+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1822713746 wait complete. 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.660+0000 7f0dbb2edf40 1 Processor -- start 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.660+0000 7f0dbb2edf40 1 -- start start 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0dbb2edf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23b00 0x55cf9def1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0dbb2edf40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf9df23ee0 0x55cf9dfb6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0dbb2edf40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cf9dfca9b0 0x55cf9dfc5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0dbb2edf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf9dfc6910 con 0x55cf9df23b00 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0dbb2edf40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf9e051f00 con 0x55cf9df23ee0 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0dbb2edf40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf9df1ecf0 con 0x55cf9dfca9b0 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db8dee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23b00 0x55cf9def1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db8dee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23b00 0x55cf9def1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60536/0 (socket says 172.21.15.55:60536) 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db8dee640 1 -- 172.21.15.55:0/1679362329 learned_addr learned my addr 172.21.15.55:0/1679362329 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db85ed640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf9df23ee0 0x55cf9dfb6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db95ef640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cf9dfca9b0 0x55cf9dfc5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db8dee640 1 -- 172.21.15.55:0/1679362329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cf9dfca9b0 msgr2=0x55cf9dfc5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db8dee640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cf9dfca9b0 0x55cf9dfc5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db8dee640 1 -- 172.21.15.55:0/1679362329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf9df23ee0 msgr2=0x55cf9dfb6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db8dee640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf9df23ee0 0x55cf9dfb6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db8dee640 1 -- 172.21.15.55:0/1679362329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf9dfc8580 con 0x55cf9df23b00 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db85ed640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf9df23ee0 0x55cf9dfb6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db95ef640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cf9dfca9b0 0x55cf9dfc5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db8dee640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23b00 0x55cf9def1b20 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f0da8002190 tx=0x7f0da800b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.661+0000 7f0db65e9640 1 -- 172.21.15.55:0/1679362329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8004230 con 0x55cf9df23b00 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.662+0000 7f0db65e9640 1 -- 172.21.15.55:0/1679362329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da80060d0 con 0x55cf9df23b00 2024-04-25T08:59:46.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.662+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1679362329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf9dfc8000 con 0x55cf9df23b00 2024-04-25T08:59:46.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.662+0000 7f0db65e9640 1 -- 172.21.15.55:0/1679362329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8004520 con 0x55cf9df23b00 2024-04-25T08:59:46.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.662+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1679362329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf9dfc82a0 con 0x55cf9df23b00 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.663+0000 7f0db65e9640 1 -- 172.21.15.55:0/1679362329 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0da8019020 con 0x55cf9df23b00 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.663+0000 7f0db65e9640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d98069ee0 0x7f0d9806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.664+0000 7f0db85ed640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d98069ee0 0x7f0d9806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.664+0000 7f0db65e9640 1 -- 172.21.15.55:0/1679362329 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0da80885e0 con 0x55cf9df23b00 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.664+0000 7f0dbb2edf40 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55cf9df213d0 0x55cf9df217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.664+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1679362329 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e88) v9 -- 0x55cf9df21cf0 con 0x55cf9df213d0 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.664+0000 7f0db95ef640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55cf9df213d0 0x55cf9df217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.664+0000 7f0db85ed640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d98069ee0 0x7f0d9806c3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55cf9def6710 tx=0x7f0da0009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.664+0000 7f0db95ef640 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55cf9df213d0 0x55cf9df217b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0db95ef640 1 -- 172.21.15.55:0/1679362329 <== osd.0 v2:172.21.15.55:6808/382211730 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v88'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0db0054670 con 0x55cf9df213d0 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55cf9df213d0 msgr2=0x55cf9df217b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0dbb2edf40 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55cf9df213d0 0x55cf9df217b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d98069ee0 msgr2=0x7f0d9806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0dbb2edf40 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d98069ee0 0x7f0d9806c3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55cf9def6710 tx=0x7f0da0009000 comp rx=0 tx=0).stop 2024-04-25T08:59:46.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23b00 msgr2=0x55cf9def1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0dbb2edf40 1 --2- 172.21.15.55:0/1679362329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cf9df23b00 0x55cf9def1b20 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f0da8002190 tx=0x7f0da800b570 comp rx=0 tx=0).stop 2024-04-25T08:59:46.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0db95ef640 1 -- 172.21.15.55:0/1679362329 reap_dead start 2024-04-25T08:59:46.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1679362329 shutdown_connections 2024-04-25T08:59:46.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1679362329 >> 172.21.15.55:0/1679362329 conn(0x55cf9df1e3d0 msgr2=0x55cf9def4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:46.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1679362329 shutdown_connections 2024-04-25T08:59:46.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.668+0000 7f0dbb2edf40 1 -- 172.21.15.55:0/1679362329 wait complete. 2024-04-25T08:59:46.660 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-04-25T08:59:46.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.753+0000 7ffa24321280 1 -- start start 2024-04-25T08:59:46.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.753+0000 7ffa24321280 1 Processor -- start 2024-04-25T08:59:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa24321280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6d59ec00 0x556d6d60e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa24321280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6d59f800 0x556d6d60eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa24321280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6d59fc00 0x556d6d60f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa24321280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6e394180 con 0x556d6d59ec00 2024-04-25T08:59:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa24321280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6e394300 con 0x556d6d59fc00 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa24321280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d6e394480 con 0x556d6d59f800 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa22065640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6d59ec00 0x556d6d60e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa22065640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6d59ec00 0x556d6d60e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60548/0 (socket says 172.21.15.55:60548) 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa22065640 1 -- 172.21.15.55:0/3686935083 learned_addr learned my addr 172.21.15.55:0/3686935083 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa22866640 1 --2- 172.21.15.55:0/3686935083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6d59fc00 0x556d6d60f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa21864640 1 --2- 172.21.15.55:0/3686935083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6d59f800 0x556d6d60eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa22065640 1 -- 172.21.15.55:0/3686935083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6d59f800 msgr2=0x556d6d60eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa22065640 1 --2- 172.21.15.55:0/3686935083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6d59f800 0x556d6d60eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa22065640 1 -- 172.21.15.55:0/3686935083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6d59fc00 msgr2=0x556d6d60f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa22065640 1 --2- 172.21.15.55:0/3686935083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6d59fc00 0x556d6d60f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa22065640 1 -- 172.21.15.55:0/3686935083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6d5d4780 con 0x556d6d59ec00 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa22866640 1 --2- 172.21.15.55:0/3686935083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6d59fc00 0x556d6d60f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa21864640 1 --2- 172.21.15.55:0/3686935083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6d59f800 0x556d6d60eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa22065640 1 --2- 172.21.15.55:0/3686935083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6d59ec00 0x556d6d60e580 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x556d6e3bd2c0 tx=0x556d6e458120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb5231507568ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa1f860640 1 -- 172.21.15.55:0/3686935083 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556d6d5c49c0 con 0x556d6d59ec00 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa1f860640 1 -- 172.21.15.55:0/3686935083 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556d6d5cafc0 con 0x556d6d59ec00 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa1f860640 1 -- 172.21.15.55:0/3686935083 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556d6d5c4680 con 0x556d6d59ec00 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa24321280 1 -- 172.21.15.55:0/3686935083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d6d5d43c0 con 0x556d6d59ec00 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa24321280 1 -- 172.21.15.55:0/3686935083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x556d6d5d5680 con 0x556d6d59ec00 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa24321280 4 waiting for MDS map... 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.754+0000 7ffa1f860640 1 -- 172.21.15.55:0/3686935083 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x556d6e462200 con 0x556d6d59ec00 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.755+0000 7ffa1f860640 1 -- 172.21.15.55:0/3686935083 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 52) v1 ==== 2723+0+0 (secure 0 0 0) 0x556d6d5f9180 con 0x556d6d59ec00 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.755+0000 7ffa24321280 4 Got MDS map 52 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.755+0000 7ffa24321280 10 main: JournalTool::main 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.755+0000 7ffa24321280 4 main: JournalTool: connecting to RADOS... 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.755+0000 7ffa24321280 1 Processor -- start 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.755+0000 7ffa24321280 1 -- start start 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa24321280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e377c00 0x556d6d60f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa24321280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0000 0x556d6d60fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa24321280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e4c0400 0x556d6d610100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa24321280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6e394600 con 0x556d6e4c0000 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa24321280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6e394780 con 0x556d6e377c00 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa24321280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d6e394900 con 0x556d6e4c0400 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa22065640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0000 0x556d6d60fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa22065640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0000 0x556d6d60fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60550/0 (socket says 172.21.15.55:60550) 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa22065640 1 -- 172.21.15.55:0/4275055893 learned_addr learned my addr 172.21.15.55:0/4275055893 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa22866640 1 --2- 172.21.15.55:0/4275055893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e377c00 0x556d6d60f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa21864640 1 --2- 172.21.15.55:0/4275055893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e4c0400 0x556d6d610100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa22065640 1 -- 172.21.15.55:0/4275055893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e4c0400 msgr2=0x556d6d610100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa22065640 1 --2- 172.21.15.55:0/4275055893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e4c0400 0x556d6d610100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa22065640 1 -- 172.21.15.55:0/4275055893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e377c00 msgr2=0x556d6d60f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa22065640 1 --2- 172.21.15.55:0/4275055893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e377c00 0x556d6d60f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa22065640 1 -- 172.21.15.55:0/4275055893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6d5d54a0 con 0x556d6e4c0000 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.756+0000 7ffa22065640 1 --2- 172.21.15.55:0/4275055893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0000 0x556d6d60fb80 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x556d6e3bdd40 tx=0x556d6e4581e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efd0a70d17e2f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa1d85c640 1 -- 172.21.15.55:0/4275055893 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556d6d5c4b60 con 0x556d6e4c0000 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa1d85c640 1 -- 172.21.15.55:0/4275055893 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556d6d5cae00 con 0x556d6e4c0000 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa1d85c640 1 -- 172.21.15.55:0/4275055893 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556d6d5c4820 con 0x556d6e4c0000 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa24321280 1 -- 172.21.15.55:0/4275055893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0000 msgr2=0x556d6d60fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa24321280 1 --2- 172.21.15.55:0/4275055893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0000 0x556d6d60fb80 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x556d6e3bdd40 tx=0x556d6e4581e0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa24321280 1 -- 172.21.15.55:0/4275055893 shutdown_connections 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa24321280 1 --2- 172.21.15.55:0/4275055893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e4c0400 0x556d6d610100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa24321280 1 --2- 172.21.15.55:0/4275055893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0000 0x556d6d60fb80 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa24321280 1 --2- 172.21.15.55:0/4275055893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e377c00 0x556d6d60f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa24321280 1 -- 172.21.15.55:0/4275055893 >> 172.21.15.55:0/4275055893 conn(0x556d6e377800 msgr2=0x556d6d687000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa24321280 1 -- 172.21.15.55:0/4275055893 shutdown_connections 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.757+0000 7ffa24321280 1 -- 172.21.15.55:0/4275055893 wait complete. 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.758+0000 7ffa24321280 1 Processor -- start 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.758+0000 7ffa24321280 1 -- start start 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.758+0000 7ffa24321280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e377800 0x556d6d611180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.758+0000 7ffa24321280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e4c1000 0x556d6d610c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.758+0000 7ffa24321280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0c00 0x556d6d610680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.758+0000 7ffa24321280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6e395500 con 0x556d6e4c0c00 2024-04-25T08:59:46.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.758+0000 7ffa24321280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6e394a80 con 0x556d6e4c1000 2024-04-25T08:59:46.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.758+0000 7ffa24321280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d6e395680 con 0x556d6e377800 2024-04-25T08:59:46.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.758+0000 7ffa21864640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0c00 0x556d6d610680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.758+0000 7ffa21864640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0c00 0x556d6d610680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60560/0 (socket says 172.21.15.55:60560) 2024-04-25T08:59:46.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.758+0000 7ffa21864640 1 -- 172.21.15.55:0/3027134204 learned_addr learned my addr 172.21.15.55:0/3027134204 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:46.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa22866640 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e377800 0x556d6d611180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa22065640 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e4c1000 0x556d6d610c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa21864640 1 -- 172.21.15.55:0/3027134204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e377800 msgr2=0x556d6d611180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa21864640 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e377800 0x556d6d611180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa21864640 1 -- 172.21.15.55:0/3027134204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e4c1000 msgr2=0x556d6d610c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa21864640 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e4c1000 0x556d6d610c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa21864640 1 -- 172.21.15.55:0/3027134204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6d5d4000 con 0x556d6e4c0c00 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa22866640 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e377800 0x556d6d611180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa22065640 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e4c1000 0x556d6d610c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa21864640 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0c00 0x556d6d610680 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x556d6e3616e0 tx=0x556d6e4d0180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa1c059640 1 -- 172.21.15.55:0/3027134204 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556d6d5c4b60 con 0x556d6e4c0c00 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa1c059640 1 -- 172.21.15.55:0/3027134204 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556d6d5caa80 con 0x556d6e4c0c00 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa24321280 1 -- 172.21.15.55:0/3027134204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d6d5d4960 con 0x556d6e4c0c00 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa1c059640 1 -- 172.21.15.55:0/3027134204 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556d6d5c4820 con 0x556d6e4c0c00 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa24321280 1 -- 172.21.15.55:0/3027134204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d6d5d5860 con 0x556d6e4c0c00 2024-04-25T08:59:46.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.759+0000 7ffa24321280 4 main: JournalTool: resolving pool 12 2024-04-25T08:59:46.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.760+0000 7ffa1c059640 1 -- 172.21.15.55:0/3027134204 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x556d6e45ec00 con 0x556d6e4c0c00 2024-04-25T08:59:46.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.761+0000 7ffa1c059640 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x556d6e4dec00 0x556d6d611700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.761+0000 7ffa1c059640 1 -- 172.21.15.55:0/3027134204 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x556d6e4c7000 con 0x556d6e4c0c00 2024-04-25T08:59:46.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.761+0000 7ffa22866640 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x556d6e4dec00 0x556d6d611700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.761+0000 7ffa24321280 4 main: JournalTool: creating IoCtx.. 2024-04-25T08:59:46.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.761+0000 7ffa24321280 4 main: Executing for rank 0 2024-04-25T08:59:46.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.761+0000 7ffa22866640 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x556d6e4dec00 0x556d6d611700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x556d6e31e7e0 tx=0x556d6e4d0420 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.761+0000 7ffa24321280 1 -- start start 2024-04-25T08:59:46.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.761+0000 7ffa24321280 1 Processor -- start 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa24321280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e4c0400 0x556d6d610100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa24321280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e4c0000 0x556d6d60fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa24321280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4dfc00 0x556d6d60f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa24321280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6e395980 con 0x556d6e4dfc00 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa24321280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d6e395b00 con 0x556d6e4c0400 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa24321280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d6e395c80 con 0x556d6e4c0000 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa21864640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4dfc00 0x556d6d60f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa21864640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4dfc00 0x556d6d60f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60566/0 (socket says 172.21.15.55:60566) 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa21864640 1 -- 172.21.15.55:0/1465066110 learned_addr learned my addr 172.21.15.55:0/1465066110 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa22065640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e4c0000 0x556d6d60fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa22866640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e4c0400 0x556d6d610100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa21864640 1 -- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e4c0000 msgr2=0x556d6d60fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa21864640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e4c0000 0x556d6d60fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa21864640 1 -- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e4c0400 msgr2=0x556d6d610100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa21864640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e4c0400 0x556d6d610100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa21864640 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d6d5d5a40 con 0x556d6e4dfc00 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.762+0000 7ffa22065640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e4c0000 0x556d6d60fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa21864640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4dfc00 0x556d6d60f600 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x556d6e505740 tx=0x556d6e4d0ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f47d45e4c722dbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa19053640 1 -- 172.21.15.55:0/1465066110 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556d6d892340 con 0x556d6e4dfc00 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa19053640 1 -- 172.21.15.55:0/1465066110 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556d6d5cac40 con 0x556d6e4dfc00 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d6d5d4000 con 0x556d6e4dfc00 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x556d6d5d4960 con 0x556d6e4dfc00 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa24321280 4 waiting for MDS map... 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa19053640 1 -- 172.21.15.55:0/1465066110 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556d6d8924e0 con 0x556d6e4dfc00 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa19053640 1 -- 172.21.15.55:0/1465066110 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x556d6d96c200 con 0x556d6e4dfc00 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa19053640 1 -- 172.21.15.55:0/1465066110 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 52) v1 ==== 2723+0+0 (secure 0 0 0) 0x556d6d976000 con 0x556d6e4dfc00 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa24321280 4 Got MDS map 52 2024-04-25T08:59:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa24321280 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x556d6d96b000 0x556d6d982000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6d96b400 con 0x556d6d96b000 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.763+0000 7ffa22866640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x556d6d96b000 0x556d6d982000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.764+0000 7ffa22866640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x556d6d96b000 0x556d6d982000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=da1e0043e6d24fe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.764+0000 7ffa22866640 1 -- 172.21.15.55:0/1465066110 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x556d6d69a000 con 0x556d6d96b000 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.764+0000 7ffa24321280 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x556d6d96b800 0x556d6d982580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.764+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:2 12.14 12:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6d96bc00 con 0x556d6d96b800 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.765+0000 7ffa22065640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x556d6d96b800 0x556d6d982580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.765+0000 7ffa22065640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x556d6d96b800 0x556d6d982580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=cb673fba2177fae5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.767+0000 7ffa22065640 1 -- 172.21.15.55:0/1465066110 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x556d6d69a500 con 0x556d6d96b800 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.768+0000 7ffa17850640 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:3 12.14 12:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6d990000 con 0x556d6d96b800 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.768+0000 7ffa17850640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x556d6d990400 0x556d6d984680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.768+0000 7ffa17850640 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:4 12.1b 12:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6d990800 con 0x556d6d990400 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.768+0000 7ffa22866640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x556d6d990400 0x556d6d984680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.768+0000 7ffa22065640 1 -- 172.21.15.55:0/1465066110 <== osd.5 v2:172.21.15.167:6800/1337224202 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x556d6d69a500 con 0x556d6d96b800 2024-04-25T08:59:46.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.768+0000 7ffa22866640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x556d6d990400 0x556d6d984680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=49dc78712b60869 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.771+0000 7ffa22866640 1 -- 172.21.15.55:0/1465066110 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556d6d69a000 con 0x556d6d990400 2024-04-25T08:59:46.764 INFO:teuthology.orchestra.run.smithi055.stdout:old journal was 4212724~2605 2024-04-25T08:59:46.764 INFO:teuthology.orchestra.run.smithi055.stdout:new journal start will be 8388608 (4173279 bytes past old end) 2024-04-25T08:59:46.764 INFO:teuthology.orchestra.run.smithi055.stdout:writing journal head 2024-04-25T08:59:46.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.771+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:5 12.14 12:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6d990000 con 0x556d6d96b800 2024-04-25T08:59:46.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.772+0000 7ffa22065640 1 -- 172.21.15.55:0/1465066110 <== osd.5 v2:172.21.15.167:6800/1337224202 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v88'21 uv21 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556d6d69a500 con 0x556d6d96b800 2024-04-25T08:59:46.765 INFO:teuthology.orchestra.run.smithi055.stdout:writing EResetJournal entry 2024-04-25T08:59:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.772+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:6 12.1b 12:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6d990c00 con 0x556d6d990400 2024-04-25T08:59:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.773+0000 7ffa24321280 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x556d6d991000 0x556d6d982b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.773+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:7 12.b 12:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6d991400 con 0x556d6d991000 2024-04-25T08:59:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.773+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:8 12.1f 12:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6d991800 con 0x556d6d96b000 2024-04-25T08:59:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.773+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:9 12.1a 12:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6d96bc00 con 0x556d6d990400 2024-04-25T08:59:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.773+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:10 12.1e 12:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6e4c1c00 con 0x556d6d990400 2024-04-25T08:59:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.773+0000 7ffa24321280 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x556d6e4c1800 0x556d6d983080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.773+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:11 12.1d 12:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6e4c1400 con 0x556d6e4c1800 2024-04-25T08:59:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.773+0000 7ffa22065640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x556d6d991000 0x556d6d982b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.773+0000 7ffa21864640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x556d6e4c1800 0x556d6d983080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.773+0000 7ffa22065640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x556d6d991000 0x556d6d982b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=f4ecc2f77438cf69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.773+0000 7ffa21864640 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x556d6e4c1800 0x556d6d983080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=bee9ee6ce4a38387 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.774+0000 7ffa22866640 1 -- 172.21.15.55:0/1465066110 <== osd.4 v2:172.21.15.167:6808/1392386852 2 ==== osd_op_reply(6 200.00000002 [delete] v88'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556d6d69a000 con 0x556d6d990400 2024-04-25T08:59:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.774+0000 7ffa22866640 1 -- 172.21.15.55:0/1465066110 <== osd.4 v2:172.21.15.167:6808/1392386852 3 ==== osd_op_reply(9 200.00000005 [delete] v88'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556d6d69a000 con 0x556d6d990400 2024-04-25T08:59:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.774+0000 7ffa22866640 1 -- 172.21.15.55:0/1465066110 <== osd.6 v2:172.21.15.167:6820/1814554564 2 ==== osd_op_reply(8 200.00000004 [delete] v88'7 uv6 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556d6d69a000 con 0x556d6d96b000 2024-04-25T08:59:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.774+0000 7ffa22065640 1 -- 172.21.15.55:0/1465066110 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== osd_op_reply(7 200.00000003 [delete] v88'4 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556d6d69a500 con 0x556d6d991000 2024-04-25T08:59:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.775+0000 7ffa17850640 1 -- 172.21.15.55:0/1465066110 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:12 12.1b 12:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x556d6d990800 con 0x556d6d990400 2024-04-25T08:59:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.775+0000 7ffa22866640 1 -- 172.21.15.55:0/1465066110 <== osd.4 v2:172.21.15.167:6808/1392386852 4 ==== osd_op_reply(10 200.00000006 [delete] v88'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556d6d69a000 con 0x556d6d990400 2024-04-25T08:59:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.775+0000 7ffa21864640 1 -- 172.21.15.55:0/1465066110 <== osd.0 v2:172.21.15.55:6808/382211730 1 ==== osd_op_reply(11 200.00000007 [delete] v88'3 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556d6d69a780 con 0x556d6e4c1800 2024-04-25T08:59:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa22866640 1 -- 172.21.15.55:0/1465066110 <== osd.4 v2:172.21.15.167:6808/1392386852 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v88'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556d6d69a000 con 0x556d6d990400 2024-04-25T08:59:46.769 INFO:teuthology.orchestra.run.smithi055.stdout:done 2024-04-25T08:59:46.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x556d6e4c1800 msgr2=0x556d6d983080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa24321280 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x556d6e4c1800 0x556d6d983080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x556d6d991000 msgr2=0x556d6d982b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa24321280 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x556d6d991000 0x556d6d982b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x556d6d990400 msgr2=0x556d6d984680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa24321280 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x556d6d990400 0x556d6d984680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x556d6d96b800 msgr2=0x556d6d982580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa24321280 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x556d6d96b800 0x556d6d982580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x556d6d96b000 msgr2=0x556d6d982000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa24321280 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x556d6d96b000 0x556d6d982000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.776+0000 7ffa22065640 1 -- 172.21.15.55:0/1465066110 reap_dead start 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa22065640 1 -- 172.21.15.55:0/1465066110 reap_dead start 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa22065640 1 -- 172.21.15.55:0/1465066110 reap_dead start 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4dfc00 msgr2=0x556d6d60f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4dfc00 0x556d6d60f600 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x556d6e505740 tx=0x556d6e4d0ae0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 shutdown_connections 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/1465066110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4dfc00 0x556d6d60f600 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 >> 172.21.15.55:0/1465066110 conn(0x556d6e4c0800 msgr2=0x556d6d687800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 shutdown_connections 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/1465066110 wait complete. 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/3027134204 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x556d6e4dec00 msgr2=0x556d6d611700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x556d6e4dec00 0x556d6d611700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x556d6e31e7e0 tx=0x556d6e4d0420 comp rx=0 tx=0).stop 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/3027134204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0c00 msgr2=0x556d6d610680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0c00 0x556d6d610680 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x556d6e3616e0 tx=0x556d6e4d0180 comp rx=0 tx=0).stop 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/3027134204 shutdown_connections 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x556d6e4dec00 0x556d6d611700 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6e4c0c00 0x556d6d610680 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6e4c1000 0x556d6d610c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/3027134204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6e377800 0x556d6d611180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/3027134204 >> 172.21.15.55:0/3027134204 conn(0x556d6e377c00 msgr2=0x556d6d687000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/3027134204 shutdown_connections 2024-04-25T08:59:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/3027134204 wait complete. 2024-04-25T08:59:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/3686935083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6d59ec00 msgr2=0x556d6d60e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/3686935083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6d59ec00 0x556d6d60e580 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x556d6e3bd2c0 tx=0x556d6e458120 comp rx=0 tx=0).stop 2024-04-25T08:59:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 -- 172.21.15.55:0/3686935083 shutdown_connections 2024-04-25T08:59:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/3686935083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d6d59fc00 0x556d6d60f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/3686935083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556d6d59f800 0x556d6d60eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.777+0000 7ffa24321280 1 --2- 172.21.15.55:0/3686935083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d6d59ec00 0x556d6d60e580 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.778+0000 7ffa24321280 1 -- 172.21.15.55:0/3686935083 >> 172.21.15.55:0/3686935083 conn(0x556d6d59f000 msgr2=0x556d6d686800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.778+0000 7ffa24321280 1 -- 172.21.15.55:0/3686935083 shutdown_connections 2024-04-25T08:59:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.778+0000 7ffa24321280 1 -- 172.21.15.55:0/3686935083 wait complete. 2024-04-25T08:59:46.774 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.114233, result: old journal was 4212724~2605 new journal start will be 8388608 (4173279 bytes past old end) writing journal head writing EResetJournal entry done 2024-04-25T08:59:46.775 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T08:59:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.927+0000 7fcab1d16640 1 Processor -- start 2024-04-25T08:59:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.927+0000 7fcab1d16640 1 -- start start 2024-04-25T08:59:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.928+0000 7fcab1d16640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcaac15dc80 0x7fcaac161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.928+0000 7fcab1d16640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcaac0b5c00 0x7fcaac0d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.928+0000 7fcab1d16640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac1627a0 con 0x7fcaac0b97c0 2024-04-25T08:59:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.928+0000 7fcab1d16640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac1621e0 con 0x7fcaac0b5c00 2024-04-25T08:59:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.928+0000 7fcab1d16640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac1624c0 con 0x7fcaac15dc80 2024-04-25T08:59:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.928+0000 7fcaabfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcaac0b5c00 0x7fcaac0d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.928+0000 7fcaabfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcaac0b5c00 0x7fcaac0d2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60582/0 (socket says 172.21.15.55:60582) 2024-04-25T08:59:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.928+0000 7fcaabfff640 1 -- 172.21.15.55:0/3716563455 learned_addr learned my addr 172.21.15.55:0/3716563455 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.929+0000 7fcaab7fe640 1 --2- 172.21.15.55:0/3716563455 >> v2:172.21.15.167:3300/0 conn(0x7fcaac15dc80 0x7fcaac161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.929+0000 7fcaabfff640 1 -- 172.21.15.55:0/3716563455 >> v2:172.21.15.167:3300/0 conn(0x7fcaac15dc80 msgr2=0x7fcaac161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:46.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.929+0000 7fcaabfff640 1 --2- 172.21.15.55:0/3716563455 >> v2:172.21.15.167:3300/0 conn(0x7fcaac15dc80 0x7fcaac161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.929+0000 7fcaabfff640 1 -- 172.21.15.55:0/3716563455 >> v1:172.21.15.167:6789/0 conn(0x7fcaac0b97c0 legacy=0x7fcaac0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:46.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.929+0000 7fcaabfff640 1 -- 172.21.15.55:0/3716563455 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0d1c70 con 0x7fcaac0b5c00 2024-04-25T08:59:46.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.929+0000 7fcaab7fe640 1 --2- 172.21.15.55:0/3716563455 >> v2:172.21.15.167:3300/0 conn(0x7fcaac15dc80 0x7fcaac161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:46.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.929+0000 7fcaabfff640 1 --2- 172.21.15.55:0/3716563455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0b5c00 0x7fcaac0d2470 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fcaac06dab0 tx=0x7fcaa402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe69ededbf6bde5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.930+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/3716563455 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4036070 con 0x7fcaac0b5c00 2024-04-25T08:59:46.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.930+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/3716563455 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa4031600 con 0x7fcaac0b5c00 2024-04-25T08:59:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.930+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/3716563455 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40319d0 con 0x7fcaac0b5c00 2024-04-25T08:59:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.930+0000 7fcab1d16640 1 -- 172.21.15.55:0/3716563455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0b5c00 msgr2=0x7fcaac0d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.930+0000 7fcab1d16640 1 --2- 172.21.15.55:0/3716563455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0b5c00 0x7fcaac0d2470 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fcaac06dab0 tx=0x7fcaa402a6f0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.930+0000 7fcab1d16640 1 -- 172.21.15.55:0/3716563455 shutdown_connections 2024-04-25T08:59:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.930+0000 7fcab1d16640 1 --2- 172.21.15.55:0/3716563455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0b5c00 0x7fcaac0d2470 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.930+0000 7fcab1d16640 1 --2- 172.21.15.55:0/3716563455 >> v2:172.21.15.167:3300/0 conn(0x7fcaac15dc80 0x7fcaac161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.930+0000 7fcab1d16640 1 -- 172.21.15.55:0/3716563455 >> 172.21.15.55:0/3716563455 conn(0x7fcaac0d04f0 msgr2=0x7fcaac0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.930+0000 7fcab1d16640 1 -- 172.21.15.55:0/3716563455 shutdown_connections 2024-04-25T08:59:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.930+0000 7fcab1d16640 1 -- 172.21.15.55:0/3716563455 wait complete. 2024-04-25T08:59:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.931+0000 7fcab1d16640 1 Processor -- start 2024-04-25T08:59:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.932+0000 7fcab1d16640 1 -- start start 2024-04-25T08:59:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.932+0000 7fcab1d16640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0b5c00 0x7fcaac0aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.932+0000 7fcab1d16640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcaac0b97c0 0x7fcaac14ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.932+0000 7fcab1d16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcaac15dc80 0x7fcaac14f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.932+0000 7fcab1d16640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac161f30 con 0x7fcaac0b5c00 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.932+0000 7fcab1d16640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac161db0 con 0x7fcaac15dc80 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.932+0000 7fcab1d16640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0d29b0 con 0x7fcaac0b97c0 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.932+0000 7fcaab7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0b5c00 0x7fcaac0aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.932+0000 7fcaab7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0b5c00 0x7fcaac0aa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60594/0 (socket says 172.21.15.55:60594) 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.932+0000 7fcaab7fe640 1 -- 172.21.15.55:0/3354159716 learned_addr learned my addr 172.21.15.55:0/3354159716 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fcaabfff640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcaac15dc80 0x7fcaac14f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fcaaaffd640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcaac0b97c0 0x7fcaac14ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fcaab7fe640 1 -- 172.21.15.55:0/3354159716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcaac0b97c0 msgr2=0x7fcaac14ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fcaab7fe640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcaac0b97c0 0x7fcaac14ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fcaab7fe640 1 -- 172.21.15.55:0/3354159716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcaac15dc80 msgr2=0x7fcaac14f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fcaab7fe640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcaac15dc80 0x7fcaac14f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fcaab7fe640 1 -- 172.21.15.55:0/3354159716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0aab10 con 0x7fcaac0b5c00 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fcaaaffd640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcaac0b97c0 0x7fcaac14ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:46.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fcaab7fe640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0b5c00 0x7fcaac0aa450 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00c820 tx=0x7fca9c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fca93fff640 1 -- 172.21.15.55:0/3354159716 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c015070 con 0x7fcaac0b5c00 2024-04-25T08:59:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fca93fff640 1 -- 172.21.15.55:0/3354159716 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c007a30 con 0x7fcaac0b5c00 2024-04-25T08:59:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fcab1d16640 1 -- 172.21.15.55:0/3354159716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac14cb90 con 0x7fcaac0b5c00 2024-04-25T08:59:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fca93fff640 1 -- 172.21.15.55:0/3354159716 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c007de0 con 0x7fcaac0b5c00 2024-04-25T08:59:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.933+0000 7fcab1d16640 1 -- 172.21.15.55:0/3354159716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac14d150 con 0x7fcaac0b5c00 2024-04-25T08:59:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.934+0000 7fcab1d16640 1 -- 172.21.15.55:0/3354159716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac0750b0 con 0x7fcaac0b5c00 2024-04-25T08:59:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.934+0000 7fca93fff640 1 -- 172.21.15.55:0/3354159716 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca9c018070 con 0x7fcaac0b5c00 2024-04-25T08:59:46.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.935+0000 7fca93fff640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca9806b4d0 0x7fca9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:46.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.935+0000 7fca93fff640 1 -- 172.21.15.55:0/3354159716 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fca9c08a190 con 0x7fcaac0b5c00 2024-04-25T08:59:46.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.935+0000 7fcaaaffd640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca9806b4d0 0x7fca9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:46.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.935+0000 7fcaaaffd640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca9806b4d0 0x7fca9806d990 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0b2b60 tx=0x7fcaa0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:46.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:46.939+0000 7fca93fff640 1 -- 172.21.15.55:0/3354159716 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca9c058fb0 con 0x7fcaac0b5c00 2024-04-25T08:59:47.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.161+0000 7fcab1d16640 1 -- 172.21.15.55:0/3354159716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fcaac0d1780 con 0x7fcaac0b5c00 2024-04-25T08:59:47.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.612+0000 7fca93fff640 1 -- 172.21.15.55:0/3354159716 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v53) v1 ==== 162+0+0 (secure 0 0 0) 0x7fca9c0588b0 con 0x7fcaac0b5c00 2024-04-25T08:59:47.601 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T08:59:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 -- 172.21.15.55:0/3354159716 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca9806b4d0 msgr2=0x7fca9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca9806b4d0 0x7fca9806d990 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0b2b60 tx=0x7fcaa0009040 comp rx=0 tx=0).stop 2024-04-25T08:59:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 -- 172.21.15.55:0/3354159716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0b5c00 msgr2=0x7fcaac0aa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0b5c00 0x7fcaac0aa450 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00c820 tx=0x7fca9c00cce0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 -- 172.21.15.55:0/3354159716 shutdown_connections 2024-04-25T08:59:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca9806b4d0 0x7fca9806d990 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcaac15dc80 0x7fcaac14f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcaac0b97c0 0x7fcaac14ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 --2- 172.21.15.55:0/3354159716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0b5c00 0x7fcaac0aa450 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 -- 172.21.15.55:0/3354159716 >> 172.21.15.55:0/3354159716 conn(0x7fcaac0d04f0 msgr2=0x7fcaac0b7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 -- 172.21.15.55:0/3354159716 shutdown_connections 2024-04-25T08:59:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.616+0000 7fcab1d16640 1 -- 172.21.15.55:0/3354159716 wait complete. 2024-04-25T08:59:47.618 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:47.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.733+0000 7f00e6fd5640 1 Processor -- start 2024-04-25T08:59:47.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.733+0000 7f00e6fd5640 1 -- start start 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.733+0000 7f00e6fd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f00e015dce0 0x7f00e00d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.733+0000 7f00e6fd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00e00d35b0 0x7f00e00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00e6fd5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e015e0c0 con 0x7f00e00d1f90 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00e6fd5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e00b7b10 con 0x7f00e015dce0 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00e6fd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00d2510 con 0x7f00e00d35b0 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00e4d71640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f00e015dce0 0x7f00e00d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00e4d71640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f00e015dce0 0x7f00e00d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60604/0 (socket says 172.21.15.55:60604) 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00e4d71640 1 -- 172.21.15.55:0/2678275139 learned_addr learned my addr 172.21.15.55:0/2678275139 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00e4d71640 1 -- 172.21.15.55:0/2678275139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00e00d35b0 msgr2=0x7f00e00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00dffff640 1 --2- 172.21.15.55:0/2678275139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00e00d35b0 0x7f00e00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00e4d71640 1 --2- 172.21.15.55:0/2678275139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00e00d35b0 0x7f00e00b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00e4d71640 1 -- 172.21.15.55:0/2678275139 >> v1:172.21.15.167:6789/0 conn(0x7f00e00d1f90 legacy=0x7f00e006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:47.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00e4d71640 1 -- 172.21.15.55:0/2678275139 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e00d27f0 con 0x7f00e015dce0 2024-04-25T08:59:47.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.734+0000 7f00dffff640 1 --2- 172.21.15.55:0/2678275139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00e00d35b0 0x7f00e00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:47.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.735+0000 7f00e4d71640 1 --2- 172.21.15.55:0/2678275139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e015dce0 0x7f00e00d1a50 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009870 tx=0x7f00d402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8435b5ea339fa6cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:47.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.735+0000 7f00df7fe640 1 -- 172.21.15.55:0/2678275139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4037070 con 0x7f00e015dce0 2024-04-25T08:59:47.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.735+0000 7f00df7fe640 1 -- 172.21.15.55:0/2678275139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d4032440 con 0x7f00e015dce0 2024-04-25T08:59:47.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.735+0000 7f00df7fe640 1 -- 172.21.15.55:0/2678275139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4032810 con 0x7f00e015dce0 2024-04-25T08:59:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.735+0000 7f00e6fd5640 1 -- 172.21.15.55:0/2678275139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e015dce0 msgr2=0x7f00e00d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.735+0000 7f00e6fd5640 1 --2- 172.21.15.55:0/2678275139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e015dce0 0x7f00e00d1a50 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009870 tx=0x7f00d402a180 comp rx=0 tx=0).stop 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.735+0000 7f00e6fd5640 1 -- 172.21.15.55:0/2678275139 shutdown_connections 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.735+0000 7f00e6fd5640 1 --2- 172.21.15.55:0/2678275139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00e00d35b0 0x7f00e00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.735+0000 7f00e6fd5640 1 --2- 172.21.15.55:0/2678275139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e015dce0 0x7f00e00d1a50 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.735+0000 7f00e6fd5640 1 -- 172.21.15.55:0/2678275139 >> 172.21.15.55:0/2678275139 conn(0x7f00e0072900 msgr2=0x7f00e00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.735+0000 7f00e6fd5640 1 -- 172.21.15.55:0/2678275139 shutdown_connections 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.736+0000 7f00e6fd5640 1 -- 172.21.15.55:0/2678275139 wait complete. 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.737+0000 7f00e6fd5640 1 Processor -- start 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.737+0000 7f00e6fd5640 1 -- start start 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.737+0000 7f00e6fd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e00d1f90 0x7f00e015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.737+0000 7f00e6fd5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e00d35b0 0x7f00e00c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.737+0000 7f00e6fd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00e015dce0 0x7f00e015e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.737+0000 7f00e6fd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00d3090 con 0x7f00e00d1f90 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.737+0000 7f00e6fd5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00d2db0 con 0x7f00e00d35b0 2024-04-25T08:59:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.737+0000 7f00e6fd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00b9820 con 0x7f00e015dce0 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00e4d71640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e00d1f90 0x7f00e015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00e4d71640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e00d1f90 0x7f00e015bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60614/0 (socket says 172.21.15.55:60614) 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00e4d71640 1 -- 172.21.15.55:0/518310745 learned_addr learned my addr 172.21.15.55:0/518310745 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00e4d71640 1 -- 172.21.15.55:0/518310745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00e015dce0 msgr2=0x7f00e015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00e4d71640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00e015dce0 0x7f00e015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00e4d71640 1 -- 172.21.15.55:0/518310745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e00d35b0 msgr2=0x7f00e00c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00e4d71640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e00d35b0 0x7f00e00c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00e4d71640 1 -- 172.21.15.55:0/518310745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e015fb30 con 0x7f00e00d1f90 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00e4d71640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e00d1f90 0x7f00e015bc60 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009870 tx=0x7f00d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00dd7fa640 1 -- 172.21.15.55:0/518310745 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4037040 con 0x7f00e00d1f90 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00dd7fa640 1 -- 172.21.15.55:0/518310745 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d4042070 con 0x7f00e00d1f90 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00dd7fa640 1 -- 172.21.15.55:0/518310745 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4030bb0 con 0x7f00e00d1f90 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00e6fd5640 1 -- 172.21.15.55:0/518310745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e015fda0 con 0x7f00e00d1f90 2024-04-25T08:59:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.738+0000 7f00e6fd5640 1 -- 172.21.15.55:0/518310745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e0160360 con 0x7f00e00d1f90 2024-04-25T08:59:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.739+0000 7f00e6fd5640 1 -- 172.21.15.55:0/518310745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e00749b0 con 0x7f00e00d1f90 2024-04-25T08:59:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.740+0000 7f00dd7fa640 1 -- 172.21.15.55:0/518310745 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f00d4047460 con 0x7f00e00d1f90 2024-04-25T08:59:47.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.740+0000 7f00dd7fa640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00c406b4d0 0x7f00c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:47.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.740+0000 7f00dd7fa640 1 -- 172.21.15.55:0/518310745 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f00d40aaf00 con 0x7f00e00d1f90 2024-04-25T08:59:47.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.740+0000 7f00dffff640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00c406b4d0 0x7f00c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:47.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.741+0000 7f00dffff640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00c406b4d0 0x7f00c406d990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f00cc006fd0 tx=0x7f00cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:47.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.744+0000 7f00dd7fa640 1 -- 172.21.15.55:0/518310745 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f00d4045360 con 0x7f00e00d1f90 2024-04-25T08:59:47.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.969+0000 7f00e6fd5640 1 -- 172.21.15.55:0/518310745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00e006b080 con 0x7f00e00d1f90 2024-04-25T08:59:47.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.969+0000 7f00dd7fa640 1 -- 172.21.15.55:0/518310745 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f00d4079d20 con 0x7f00e00d1f90 2024-04-25T08:59:47.959 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:47.959 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T08:59:47.616112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":54,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6837/3282261214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3282261214},{"type":"v1","addr":"172.21.15.55:6837","nonce":3282261214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:59:47.959 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 54 2024-04-25T08:59:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 -- 172.21.15.55:0/518310745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00c406b4d0 msgr2=0x7f00c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00c406b4d0 0x7f00c406d990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f00cc006fd0 tx=0x7f00cc008040 comp rx=0 tx=0).stop 2024-04-25T08:59:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 -- 172.21.15.55:0/518310745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e00d1f90 msgr2=0x7f00e015bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e00d1f90 0x7f00e015bc60 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009870 tx=0x7f00d40046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 -- 172.21.15.55:0/518310745 shutdown_connections 2024-04-25T08:59:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f00c406b4d0 0x7f00c406d990 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00e015dce0 0x7f00e015e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e00d35b0 0x7f00e00c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 --2- 172.21.15.55:0/518310745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e00d1f90 0x7f00e015bc60 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 -- 172.21.15.55:0/518310745 >> 172.21.15.55:0/518310745 conn(0x7f00e0072900 msgr2=0x7f00e00b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 -- 172.21.15.55:0/518310745 shutdown_connections 2024-04-25T08:59:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:47.972+0000 7f00e6fd5640 1 -- 172.21.15.55:0/518310745 wait complete. 2024-04-25T08:59:48.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:59:32.818559+0000', 'modified': '2024-04-25T08:59:47.616112+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7557}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7557': {'gid': 7557, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6837/3282261214', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 3282261214}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3282261214}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:59:48.375 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7557:up:replay 2024-04-25T08:59:49.377 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:49.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.504+0000 7f7a90815640 1 Processor -- start 2024-04-25T08:59:49.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.504+0000 7f7a90815640 1 -- start start 2024-04-25T08:59:49.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.505+0000 7f7a90815640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a8c0b1b30 0x7f7a8c1687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.505+0000 7f7a90815640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c06c1f0 con 0x7f7a8c15dc30 2024-04-25T08:59:49.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.505+0000 7f7a90815640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c0cfb40 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.505+0000 7f7a90815640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8c0b2060 con 0x7f7a8c0b1b30 2024-04-25T08:59:49.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.505+0000 7f7a8ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a8c0b1b30 0x7f7a8c1687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.505+0000 7f7a8a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7a8c15dc30 0x7f7a8c06c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33164/0 (socket says 172.21.15.55:33164) 2024-04-25T08:59:49.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.505+0000 7f7a8a59c640 1 -- 172.21.15.55:0/2698031996 learned_addr learned my addr 172.21.15.55:0/2698031996 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:49.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.506+0000 7f7a8ad9d640 1 -- 172.21.15.55:0/2698031996 >> v1:172.21.15.167:6789/0 conn(0x7f7a8c06cdd0 legacy=0x7f7a8c0b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:49.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.506+0000 7f7a8ad9d640 1 -- 172.21.15.55:0/2698031996 >> v1:172.21.15.55:6789/0 conn(0x7f7a8c15dc30 legacy=0x7f7a8c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.506+0000 7f7a8959a640 1 -- 172.21.15.55:0/2698031996 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594374748 0 0) 0x7f7a7c001110 con 0x7f7a8c15dc30 2024-04-25T08:59:49.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.506+0000 7f7a8ad9d640 1 -- 172.21.15.55:0/2698031996 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0b2340 con 0x7f7a8c0b1b30 2024-04-25T08:59:49.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.507+0000 7f7a8ad9d640 1 --2- 172.21.15.55:0/2698031996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c0b1b30 0x7f7a8c1687d0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0cfd10 tx=0x7f7a8402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6aed452255a50b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:49.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.507+0000 7f7a8959a640 1 -- 172.21.15.55:0/2698031996 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84007740 con 0x7f7a8c0b1b30 2024-04-25T08:59:49.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.507+0000 7f7a8959a640 1 -- 172.21.15.55:0/2698031996 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a840078e0 con 0x7f7a8c0b1b30 2024-04-25T08:59:49.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.507+0000 7f7a8959a640 1 -- 172.21.15.55:0/2698031996 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84007cb0 con 0x7f7a8c0b1b30 2024-04-25T08:59:49.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.507+0000 7f7a90815640 1 -- 172.21.15.55:0/2698031996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c0b1b30 msgr2=0x7f7a8c1687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.507+0000 7f7a90815640 1 --2- 172.21.15.55:0/2698031996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c0b1b30 0x7f7a8c1687d0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0cfd10 tx=0x7f7a8402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.507+0000 7f7a90815640 1 -- 172.21.15.55:0/2698031996 shutdown_connections 2024-04-25T08:59:49.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.507+0000 7f7a90815640 1 --2- 172.21.15.55:0/2698031996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c0b1b30 0x7f7a8c1687d0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.507+0000 7f7a90815640 1 -- 172.21.15.55:0/2698031996 >> 172.21.15.55:0/2698031996 conn(0x7f7a8c0d1900 msgr2=0x7f7a8c0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:49.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.507+0000 7f7a90815640 1 -- 172.21.15.55:0/2698031996 shutdown_connections 2024-04-25T08:59:49.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.507+0000 7f7a90815640 1 -- 172.21.15.55:0/2698031996 wait complete. 2024-04-25T08:59:49.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.509+0000 7f7a90815640 1 Processor -- start 2024-04-25T08:59:49.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.509+0000 7f7a90815640 1 -- start start 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.509+0000 7f7a90815640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c06cdd0 0x7f7a8c160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a90815640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a8c0b1b30 0x7f7a8c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a90815640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8c15dc30 0x7f7a8c15f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a90815640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c15e010 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a90815640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0cfde0 con 0x7f7a8c15dc30 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a90815640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0d1310 con 0x7f7a8c0b1b30 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a8a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c06cdd0 0x7f7a8c160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a8a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c06cdd0 0x7f7a8c160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46178/0 (socket says 172.21.15.55:46178) 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a8a59c640 1 -- 172.21.15.55:0/207139122 learned_addr learned my addr 172.21.15.55:0/207139122 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a89d9b640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a8c0b1b30 0x7f7a8c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a8ad9d640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8c15dc30 0x7f7a8c15f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a8a59c640 1 -- 172.21.15.55:0/207139122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a8c0b1b30 msgr2=0x7f7a8c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a8a59c640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a8c0b1b30 0x7f7a8c153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a8a59c640 1 -- 172.21.15.55:0/207139122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8c15dc30 msgr2=0x7f7a8c15f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a8a59c640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8c15dc30 0x7f7a8c15f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a8a59c640 1 -- 172.21.15.55:0/207139122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c15fb50 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a8a59c640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c06cdd0 0x7f7a8c160bf0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c430 tx=0x7f7a7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a7affd640 1 -- 172.21.15.55:0/207139122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c0074e0 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a7affd640 1 -- 172.21.15.55:0/207139122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c0047e0 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a90815640 1 -- 172.21.15.55:0/207139122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8c15fe30 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.510+0000 7f7a7affd640 1 -- 172.21.15.55:0/207139122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c004bd0 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.511+0000 7f7a90815640 1 -- 172.21.15.55:0/207139122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c1603f0 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.512+0000 7f7a90815640 1 -- 172.21.15.55:0/207139122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8c067850 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.512+0000 7f7a7affd640 1 -- 172.21.15.55:0/207139122 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a7c011070 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.513+0000 7f7a7affd640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7a6c06b4d0 0x7f7a6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:49.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.513+0000 7f7a7affd640 1 -- 172.21.15.55:0/207139122 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7a7c089f20 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.513+0000 7f7a89d9b640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7a6c06b4d0 0x7f7a6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:49.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.513+0000 7f7a89d9b640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7a6c06b4d0 0x7f7a6c06d990 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0b7410 tx=0x7f7a80009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:49.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.517+0000 7f7a7affd640 1 -- 172.21.15.55:0/207139122 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a8c06c1f0 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.736+0000 7f7a90815640 1 -- 172.21.15.55:0/207139122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a8c06cb90 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.736+0000 7f7a7affd640 1 -- 172.21.15.55:0/207139122 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f7a7c058d40 con 0x7f7a8c06cdd0 2024-04-25T08:59:49.725 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:49.725 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T08:59:48.625931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":54,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.55:6837/3282261214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3282261214},{"type":"v1","addr":"172.21.15.55:6837","nonce":3282261214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:59:49.726 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 56 2024-04-25T08:59:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 -- 172.21.15.55:0/207139122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7a6c06b4d0 msgr2=0x7f7a6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7a6c06b4d0 0x7f7a6c06d990 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0b7410 tx=0x7f7a80009040 comp rx=0 tx=0).stop 2024-04-25T08:59:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 -- 172.21.15.55:0/207139122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c06cdd0 msgr2=0x7f7a8c160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c06cdd0 0x7f7a8c160bf0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c430 tx=0x7f7a7c00c8f0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 -- 172.21.15.55:0/207139122 shutdown_connections 2024-04-25T08:59:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7a6c06b4d0 0x7f7a6c06d990 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a8c15dc30 0x7f7a8c15f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7a8c0b1b30 0x7f7a8c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 --2- 172.21.15.55:0/207139122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c06cdd0 0x7f7a8c160bf0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 -- 172.21.15.55:0/207139122 >> 172.21.15.55:0/207139122 conn(0x7f7a8c0d1900 msgr2=0x7f7a8c0d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 -- 172.21.15.55:0/207139122 shutdown_connections 2024-04-25T08:59:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:49.738+0000 7f7a90815640 1 -- 172.21.15.55:0/207139122 wait complete. 2024-04-25T08:59:50.140 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:59:32.818559+0000', 'modified': '2024-04-25T08:59:48.625931+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7557}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7557': {'gid': 7557, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.55:6837/3282261214', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 3282261214}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3282261214}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:59:50.140 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7557:up:rejoin 2024-04-25T08:59:51.141 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:59:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.267+0000 7f08a2ae2640 1 Processor -- start 2024-04-25T08:59:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.267+0000 7f08a2ae2640 1 -- start start 2024-04-25T08:59:51.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.267+0000 7f08a2ae2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f089c15f120 0x7f089c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:51.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.267+0000 7f08a2ae2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089c0d0430 con 0x7f089c0ce830 2024-04-25T08:59:51.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.267+0000 7f08a2ae2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089c0d0710 con 0x7f089c0cfdb0 2024-04-25T08:59:51.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.268+0000 7f08a2ae2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089c0d09f0 con 0x7f089c15f120 2024-04-25T08:59:51.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.268+0000 7f089bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f089c0ce830 0x7f089c0cf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33166/0 (socket says 172.21.15.55:33166) 2024-04-25T08:59:51.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.268+0000 7f089bfff640 1 -- 172.21.15.55:0/1706710627 learned_addr learned my addr 172.21.15.55:0/1706710627 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:51.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.268+0000 7f08a087e640 1 --2- 172.21.15.55:0/1706710627 >> v2:172.21.15.167:3300/0 conn(0x7f089c15f120 0x7f089c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:51.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.268+0000 7f089b7fe640 1 -- 172.21.15.55:0/1706710627 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193534331 0 0) 0x7f089c0d0430 con 0x7f089c0ce830 2024-04-25T08:59:51.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.268+0000 7f089b7fe640 1 -- 172.21.15.55:0/1706710627 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0884003520 con 0x7f089c0ce830 2024-04-25T08:59:51.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.268+0000 7f08a087e640 1 -- 172.21.15.55:0/1706710627 >> v1:172.21.15.167:6789/0 conn(0x7f089c0cfdb0 legacy=0x7f089c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:51.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.268+0000 7f08a087e640 1 -- 172.21.15.55:0/1706710627 >> v1:172.21.15.55:6789/0 conn(0x7f089c0ce830 legacy=0x7f089c0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:51.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.268+0000 7f089b7fe640 1 -- 172.21.15.55:0/1706710627 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2044853463 0 0) 0x7f0884003520 con 0x7f089c0ce830 2024-04-25T08:59:51.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.268+0000 7f08a087e640 1 -- 172.21.15.55:0/1706710627 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c0cc7d0 con 0x7f089c15f120 2024-04-25T08:59:51.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.269+0000 7f08a087e640 1 --2- 172.21.15.55:0/1706710627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c15f120 0x7f089c0ce2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f088c0097a0 tx=0x7f088c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=666fbc5149ab93bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:51.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.269+0000 7f089b7fe640 1 -- 172.21.15.55:0/1706710627 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c037070 con 0x7f089c15f120 2024-04-25T08:59:51.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.269+0000 7f089b7fe640 1 -- 172.21.15.55:0/1706710627 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c02ace0 con 0x7f089c15f120 2024-04-25T08:59:51.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.269+0000 7f089b7fe640 1 -- 172.21.15.55:0/1706710627 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890001690 con 0x7f089c15f120 2024-04-25T08:59:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.270+0000 7f08a2ae2640 1 -- 172.21.15.55:0/1706710627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c15f120 msgr2=0x7f089c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.270+0000 7f08a2ae2640 1 --2- 172.21.15.55:0/1706710627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c15f120 0x7f089c0ce2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f088c0097a0 tx=0x7f088c02a250 comp rx=0 tx=0).stop 2024-04-25T08:59:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.270+0000 7f08a2ae2640 1 -- 172.21.15.55:0/1706710627 shutdown_connections 2024-04-25T08:59:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.270+0000 7f08a2ae2640 1 --2- 172.21.15.55:0/1706710627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c15f120 0x7f089c0ce2f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.270+0000 7f08a2ae2640 1 -- 172.21.15.55:0/1706710627 >> 172.21.15.55:0/1706710627 conn(0x7f089c0d1900 msgr2=0x7f089c0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.270+0000 7f08a2ae2640 1 -- 172.21.15.55:0/1706710627 shutdown_connections 2024-04-25T08:59:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.270+0000 7f08a2ae2640 1 -- 172.21.15.55:0/1706710627 wait complete. 2024-04-25T08:59:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.271+0000 7f08a2ae2640 1 Processor -- start 2024-04-25T08:59:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.271+0000 7f08a2ae2640 1 -- start start 2024-04-25T08:59:51.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.272+0000 7f08a2ae2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f089c0ce830 0x7f089c156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:51.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.272+0000 7f08a2ae2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c0cfdb0 0x7f089c06d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:51.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.272+0000 7f08a2ae2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f089c15f120 0x7f089c0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:51.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.272+0000 7f08a2ae2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089c0cc480 con 0x7f089c15f120 2024-04-25T08:59:51.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.272+0000 7f08a2ae2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089c0cec70 con 0x7f089c0cfdb0 2024-04-25T08:59:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.272+0000 7f08a2ae2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089c0c5450 con 0x7f089c0ce830 2024-04-25T08:59:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.272+0000 7f08a107f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f089c15f120 0x7f089c0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.272+0000 7f08a107f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f089c15f120 0x7f089c0c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46190/0 (socket says 172.21.15.55:46190) 2024-04-25T08:59:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.272+0000 7f08a107f640 1 -- 172.21.15.55:0/3022742745 learned_addr learned my addr 172.21.15.55:0/3022742745 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.272+0000 7f08a087e640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f089c0ce830 0x7f089c156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.272+0000 7f089bfff640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c0cfdb0 0x7f089c06d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.273+0000 7f08a107f640 1 -- 172.21.15.55:0/3022742745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f089c0ce830 msgr2=0x7f089c156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.273+0000 7f08a107f640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f089c0ce830 0x7f089c156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.273+0000 7f08a107f640 1 -- 172.21.15.55:0/3022742745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c0cfdb0 msgr2=0x7f089c06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.273+0000 7f08a107f640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c0cfdb0 0x7f089c06d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.273+0000 7f08a107f640 1 -- 172.21.15.55:0/3022742745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c06da20 con 0x7f089c15f120 2024-04-25T08:59:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.273+0000 7f08a107f640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f089c15f120 0x7f089c0c95e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f089400c7d0 tx=0x7f089400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.273+0000 7f08997fa640 1 -- 172.21.15.55:0/3022742745 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894003b70 con 0x7f089c15f120 2024-04-25T08:59:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.273+0000 7f08997fa640 1 -- 172.21.15.55:0/3022742745 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0894003d30 con 0x7f089c15f120 2024-04-25T08:59:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.273+0000 7f08a2ae2640 1 -- 172.21.15.55:0/3022742745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089c0c8b00 con 0x7f089c15f120 2024-04-25T08:59:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.273+0000 7f08997fa640 1 -- 172.21.15.55:0/3022742745 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400aa90 con 0x7f089c15f120 2024-04-25T08:59:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.273+0000 7f08a2ae2640 1 -- 172.21.15.55:0/3022742745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089c1566d0 con 0x7f089c15f120 2024-04-25T08:59:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.274+0000 7f08a2ae2640 1 -- 172.21.15.55:0/3022742745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089c067850 con 0x7f089c15f120 2024-04-25T08:59:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.275+0000 7f08997fa640 1 -- 172.21.15.55:0/3022742745 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f089400ac30 con 0x7f089c15f120 2024-04-25T08:59:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.275+0000 7f08997fa640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f088806b500 0x7f088806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.275+0000 7f08997fa640 1 -- 172.21.15.55:0/3022742745 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0894089fc0 con 0x7f089c15f120 2024-04-25T08:59:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.275+0000 7f08a087e640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f088806b500 0x7f088806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.276+0000 7f08a087e640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f088806b500 0x7f088806d9c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f088c034000 tx=0x7f088c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:51.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.279+0000 7f08997fa640 1 -- 172.21.15.55:0/3022742745 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0894058820 con 0x7f089c15f120 2024-04-25T08:59:51.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.499+0000 7f08a2ae2640 1 -- 172.21.15.55:0/3022742745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f089c0c8790 con 0x7f089c15f120 2024-04-25T08:59:51.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.500+0000 7f08997fa640 1 -- 172.21.15.55:0/3022742745 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f089405c8c0 con 0x7f089c15f120 2024-04-25T08:59:51.489 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T08:59:51.489 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T08:59:49.636449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/3282261214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3282261214},{"type":"v1","addr":"172.21.15.55:6837","nonce":3282261214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:59:51.490 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 57 2024-04-25T08:59:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 -- 172.21.15.55:0/3022742745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f088806b500 msgr2=0x7f088806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f088806b500 0x7f088806d9c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f088c034000 tx=0x7f088c02e000 comp rx=0 tx=0).stop 2024-04-25T08:59:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 -- 172.21.15.55:0/3022742745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f089c15f120 msgr2=0x7f089c0c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f089c15f120 0x7f089c0c95e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f089400c7d0 tx=0x7f089400cc90 comp rx=0 tx=0).stop 2024-04-25T08:59:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 -- 172.21.15.55:0/3022742745 shutdown_connections 2024-04-25T08:59:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f088806b500 0x7f088806d9c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f089c15f120 0x7f089c0c95e0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c0cfdb0 0x7f089c06d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 --2- 172.21.15.55:0/3022742745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f089c0ce830 0x7f089c156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 -- 172.21.15.55:0/3022742745 >> 172.21.15.55:0/3022742745 conn(0x7f089c0d1900 msgr2=0x7f089c15bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 -- 172.21.15.55:0/3022742745 shutdown_connections 2024-04-25T08:59:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:51.502+0000 7f08a2ae2640 1 -- 172.21.15.55:0/3022742745 wait complete. 2024-04-25T08:59:51.905 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:59:32.818559+0000', 'modified': '2024-04-25T08:59:49.636449+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7557}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7557': {'gid': 7557, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6837/3282261214', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 3282261214}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3282261214}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:59:51.905 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:59:51.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T08:59:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.022+0000 7f5930b4c640 1 Processor -- start 2024-04-25T08:59:52.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.022+0000 7f5930b4c640 1 -- start start 2024-04-25T08:59:52.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.023+0000 7f5930b4c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f592c1610b0 0x7f592c0b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.023+0000 7f5930b4c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f592c0cef40 0x7f592c0d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.023+0000 7f5930b4c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c162040 con 0x7f592c1618d0 2024-04-25T08:59:52.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.023+0000 7f5930b4c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0d1ea0 con 0x7f592c1610b0 2024-04-25T08:59:52.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.023+0000 7f5930b4c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c162320 con 0x7f592c0cef40 2024-04-25T08:59:52.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.023+0000 7f592a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f592c1610b0 0x7f592c0b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.023+0000 7f5929d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f592c1618d0 0x7f592c0ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33176/0 (socket says 172.21.15.55:33176) 2024-04-25T08:59:52.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.024+0000 7f5929d9b640 1 -- 172.21.15.55:0/1064618834 learned_addr learned my addr 172.21.15.55:0/1064618834 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:52.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.024+0000 7f592ad9d640 1 --2- 172.21.15.55:0/1064618834 >> v2:172.21.15.167:3300/0 conn(0x7f592c0cef40 0x7f592c0d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.024+0000 7f592a59c640 1 -- 172.21.15.55:0/1064618834 >> v2:172.21.15.167:3300/0 conn(0x7f592c0cef40 msgr2=0x7f592c0d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.024+0000 7f592a59c640 1 --2- 172.21.15.55:0/1064618834 >> v2:172.21.15.167:3300/0 conn(0x7f592c0cef40 0x7f592c0d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.024+0000 7f592a59c640 1 -- 172.21.15.55:0/1064618834 >> v1:172.21.15.55:6789/0 conn(0x7f592c1618d0 legacy=0x7f592c0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.024+0000 7f592a59c640 1 -- 172.21.15.55:0/1064618834 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c162600 con 0x7f592c1610b0 2024-04-25T08:59:52.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.024+0000 7f592959a640 1 -- 172.21.15.55:0/1064618834 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142614722 0 0) 0x7f592c162040 con 0x7f592c1618d0 2024-04-25T08:59:52.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.024+0000 7f592ad9d640 1 --2- 172.21.15.55:0/1064618834 >> v2:172.21.15.167:3300/0 conn(0x7f592c0cef40 0x7f592c0d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:52.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f592a59c640 1 --2- 172.21.15.55:0/1064618834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c1610b0 0x7f592c0b9580 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f592c0b9190 tx=0x7f592402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cb98b97e0363d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f592959a640 1 -- 172.21.15.55:0/1064618834 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924037070 con 0x7f592c1610b0 2024-04-25T08:59:52.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f592959a640 1 -- 172.21.15.55:0/1064618834 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924032440 con 0x7f592c1610b0 2024-04-25T08:59:52.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f592959a640 1 -- 172.21.15.55:0/1064618834 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592402ae60 con 0x7f592c1610b0 2024-04-25T08:59:52.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f5930b4c640 1 -- 172.21.15.55:0/1064618834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c1610b0 msgr2=0x7f592c0b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f5930b4c640 1 --2- 172.21.15.55:0/1064618834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c1610b0 0x7f592c0b9580 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f592c0b9190 tx=0x7f592402a110 comp rx=0 tx=0).stop 2024-04-25T08:59:52.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f5930b4c640 1 -- 172.21.15.55:0/1064618834 shutdown_connections 2024-04-25T08:59:52.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f5930b4c640 1 --2- 172.21.15.55:0/1064618834 >> v2:172.21.15.167:3300/0 conn(0x7f592c0cef40 0x7f592c0d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f5930b4c640 1 --2- 172.21.15.55:0/1064618834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c1610b0 0x7f592c0b9580 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f5930b4c640 1 -- 172.21.15.55:0/1064618834 >> 172.21.15.55:0/1064618834 conn(0x7f592c0b5570 msgr2=0x7f592c0b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:52.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f5930b4c640 1 -- 172.21.15.55:0/1064618834 shutdown_connections 2024-04-25T08:59:52.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.025+0000 7f5930b4c640 1 -- 172.21.15.55:0/1064618834 wait complete. 2024-04-25T08:59:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.027+0000 7f5930b4c640 1 Processor -- start 2024-04-25T08:59:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.027+0000 7f5930b4c640 1 -- start start 2024-04-25T08:59:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.027+0000 7f5930b4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f592c0cef40 0x7f592c14cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.027+0000 7f5930b4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f592c1610b0 0x7f592c1503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.027+0000 7f5930b4c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c1618d0 0x7f592c1f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.027+0000 7f5930b4c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c161d10 con 0x7f592c1618d0 2024-04-25T08:59:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.027+0000 7f5930b4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0b6c00 con 0x7f592c0cef40 2024-04-25T08:59:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.027+0000 7f5930b4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c161490 con 0x7f592c1610b0 2024-04-25T08:59:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f592ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c1618d0 0x7f592c1f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f592ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c1618d0 0x7f592c1f39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46206/0 (socket says 172.21.15.55:46206) 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f592ad9d640 1 -- 172.21.15.55:0/1349486133 learned_addr learned my addr 172.21.15.55:0/1349486133 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f592ad9d640 1 -- 172.21.15.55:0/1349486133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f592c1610b0 msgr2=0x7f592c1503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f592ad9d640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f592c1610b0 0x7f592c1503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f592ad9d640 1 -- 172.21.15.55:0/1349486133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f592c0cef40 msgr2=0x7f592c14cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f592ad9d640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f592c0cef40 0x7f592c14cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f592ad9d640 1 -- 172.21.15.55:0/1349486133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c150920 con 0x7f592c1618d0 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f592ad9d640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c1618d0 0x7f592c1f39f0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f591c00cf20 tx=0x7f591c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f591affd640 1 -- 172.21.15.55:0/1349486133 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c01a070 con 0x7f592c1618d0 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f591affd640 1 -- 172.21.15.55:0/1349486133 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c00d840 con 0x7f592c1618d0 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f591affd640 1 -- 172.21.15.55:0/1349486133 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c00dc30 con 0x7f592c1618d0 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f5930b4c640 1 -- 172.21.15.55:0/1349486133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c154e60 con 0x7f592c1618d0 2024-04-25T08:59:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.028+0000 7f5930b4c640 1 -- 172.21.15.55:0/1349486133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c155420 con 0x7f592c1618d0 2024-04-25T08:59:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.030+0000 7f591affd640 1 -- 172.21.15.55:0/1349486133 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f591c01d070 con 0x7f592c1618d0 2024-04-25T08:59:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.030+0000 7f591affd640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f590c06b4d0 0x7f590c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.030+0000 7f591affd640 1 -- 172.21.15.55:0/1349486133 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f591c08ab20 con 0x7f592c1618d0 2024-04-25T08:59:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.030+0000 7f592a59c640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f590c06b4d0 0x7f590c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.031+0000 7f592a59c640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f590c06b4d0 0x7f590c06d990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5924034000 tx=0x7f592402c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.031+0000 7f593384f740 1 Processor -- start 2024-04-25T08:59:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.031+0000 7f593384f740 1 -- start start 2024-04-25T08:59:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f593384f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c08230 0x562dc4c08610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f593384f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c25ad0 0x562dc4c26020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f593384f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4bddf10 0x562dc4c24190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f593384f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc4b40a10 con 0x562dc4c08230 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f593384f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc4ae9b30 con 0x562dc4bddf10 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f593384f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dc4b3cc50 con 0x562dc4c25ad0 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f592a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c08230 0x562dc4c08610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f592a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c08230 0x562dc4c08610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46214/0 (socket says 172.21.15.55:46214) 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f592a59c640 1 -- 172.21.15.55:0/2269924770 learned_addr learned my addr 172.21.15.55:0/2269924770 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f5929d9b640 1 --2- 172.21.15.55:0/2269924770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c25ad0 0x562dc4c26020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f592ad9d640 1 --2- 172.21.15.55:0/2269924770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4bddf10 0x562dc4c24190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f592a59c640 1 -- 172.21.15.55:0/2269924770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c25ad0 msgr2=0x562dc4c26020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f592a59c640 1 --2- 172.21.15.55:0/2269924770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c25ad0 0x562dc4c26020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f592a59c640 1 -- 172.21.15.55:0/2269924770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4bddf10 msgr2=0x562dc4c24190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f592a59c640 1 --2- 172.21.15.55:0/2269924770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4bddf10 0x562dc4c24190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.032+0000 7f592a59c640 1 -- 172.21.15.55:0/2269924770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dc4afee10 con 0x562dc4c08230 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.033+0000 7f592a59c640 1 --2- 172.21.15.55:0/2269924770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c08230 0x562dc4c08610 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f5924035040 tx=0x7f5924008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec31d024c3ec9c76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.033+0000 7f590bfff640 1 -- 172.21.15.55:0/2269924770 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592404c070 con 0x562dc4c08230 2024-04-25T08:59:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.033+0000 7f590bfff640 1 -- 172.21.15.55:0/2269924770 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924004230 con 0x562dc4c08230 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.033+0000 7f590bfff640 1 -- 172.21.15.55:0/2269924770 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924037040 con 0x562dc4c08230 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.033+0000 7f593384f740 1 -- 172.21.15.55:0/2269924770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c08230 msgr2=0x562dc4c08610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.033+0000 7f593384f740 1 --2- 172.21.15.55:0/2269924770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c08230 0x562dc4c08610 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f5924035040 tx=0x7f5924008030 comp rx=0 tx=0).stop 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.033+0000 7f593384f740 1 -- 172.21.15.55:0/2269924770 shutdown_connections 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.033+0000 7f593384f740 1 --2- 172.21.15.55:0/2269924770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4bddf10 0x562dc4c24190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.033+0000 7f593384f740 1 --2- 172.21.15.55:0/2269924770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c25ad0 0x562dc4c26020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.033+0000 7f593384f740 1 --2- 172.21.15.55:0/2269924770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c08230 0x562dc4c08610 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.033+0000 7f593384f740 1 -- 172.21.15.55:0/2269924770 >> 172.21.15.55:0/2269924770 conn(0x562dc4bda840 msgr2=0x562dc4c23040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.034+0000 7f593384f740 1 -- 172.21.15.55:0/2269924770 shutdown_connections 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.034+0000 7f593384f740 1 -- 172.21.15.55:0/2269924770 wait complete. 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.034+0000 7f593384f740 1 -- start start 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.034+0000 7f593384f740 1 Processor -- start 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f593384f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c1b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f593384f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c25ad0 0x562dc4c244a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f593384f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c1b370 0x562dc4c249e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f593384f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc4bdecb0 con 0x562dc4c25ad0 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f593384f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc4afd0c0 con 0x562dc4c1b370 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f593384f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dc4bd8770 con 0x562dc4c08230 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f593384f740 10 client.0 _ll_register_callbacks cb 0x562dc4af0ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f5929d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c25ad0 0x562dc4c244a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f5929d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c25ad0 0x562dc4c244a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46220/0 (socket says 172.21.15.55:46220) 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f5929d9b640 1 -- 172.21.15.55:0/1895536905 learned_addr learned my addr 172.21.15.55:0/1895536905 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f592a59c640 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c1b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f592ad9d640 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c1b370 0x562dc4c249e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f5929d9b640 1 -- 172.21.15.55:0/1895536905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 msgr2=0x562dc4c1b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.035+0000 7f5929d9b640 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c1b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f5929d9b640 1 -- 172.21.15.55:0/1895536905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c1b370 msgr2=0x562dc4c249e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f5929d9b640 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c1b370 0x562dc4c249e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f5929d9b640 1 -- 172.21.15.55:0/1895536905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562dc48552d0 con 0x562dc4c25ad0 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f592a59c640 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c1b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f5929d9b640 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c25ad0 0x562dc4c244a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f592c154ad0 tx=0x7f5920001590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8ad80c2ab44ee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f59097fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f59097fa640 1 -- 172.21.15.55:0/1895536905 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920019060 con 0x562dc4c25ad0 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f59097fa640 1 -- 172.21.15.55:0/1895536905 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5920014af0 con 0x562dc4c25ad0 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f593384f740 1 -- 172.21.15.55:0/1895536905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5924004230 con 0x562dc4c25ad0 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f59097fa640 1 -- 172.21.15.55:0/1895536905 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5920014cf0 con 0x562dc4c25ad0 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f593384f740 10 client.7629 fetch_fsmap learned FSMap version 57 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f593384f740 1 -- 172.21.15.55:0/1895536905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x562dc491f6b0 con 0x562dc4c25ad0 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f59097fa640 1 -- 172.21.15.55:0/1895536905 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924004230 con 0x562dc4c25ad0 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f59097fa640 1 -- 172.21.15.55:0/1895536905 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 57) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f592001e3b0 con 0x562dc4c25ad0 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f593384f740 10 client.7629 fetch_fsmap finished waiting for FSMap version 57 2024-04-25T08:59:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f593384f740 10 client.7629 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f593384f740 20 client.7629 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f593384f740 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dc4c09540 0x562dc4c0b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f593384f740 4 client.7629 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f593384f740 1 -- 172.21.15.55:0/1895536905 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562dc4b9f920 con 0x562dc4c09540 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.036+0000 7f592a59c640 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dc4c09540 0x562dc4c0b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.037+0000 7f59097fa640 10 client.7629 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.037+0000 7f592a59c640 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dc4c09540 0x562dc4c0b940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae93f5e0ad99b4a8 server_cookie=a30e2be8e2935f26 in_seq=0 out_seq=0 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.037+0000 7f59097fa640 1 -- 172.21.15.55:0/1895536905 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562dc4b9f920 con 0x562dc4c09540 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.037+0000 7f59097fa640 10 client.7629 handle_command_reply: tid=0 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.037+0000 7f593384f740 1 client.7629 shutdown 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f593384f740 1 -- 172.21.15.55:0/1895536905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c25ad0 msgr2=0x562dc4c244a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f593384f740 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c25ad0 0x562dc4c244a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f592c154ad0 tx=0x7f5920001590 comp rx=0 tx=0).stop 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f593384f740 1 -- 172.21.15.55:0/1895536905 shutdown_connections 2024-04-25T08:59:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f593384f740 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dc4c09540 0x562dc4c0b940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f593384f740 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c1b370 0x562dc4c249e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f59097fa640 0 client.7629 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f593384f740 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c25ad0 0x562dc4c244a0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f593384f740 1 --2- 172.21.15.55:0/1895536905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c1b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f593384f740 1 -- 172.21.15.55:0/1895536905 >> 172.21.15.55:0/1895536905 conn(0x562dc4bddf10 msgr2=0x562dc4c265c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f593384f740 1 -- 172.21.15.55:0/1895536905 shutdown_connections 2024-04-25T08:59:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f593384f740 1 -- 172.21.15.55:0/1895536905 wait complete. 2024-04-25T08:59:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.038+0000 7f593384f740 20 client.7629 trim_cache size 0 max 16384 2024-04-25T08:59:52.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.054+0000 7f593384f740 1 Processor -- start 2024-04-25T08:59:52.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.054+0000 7f593384f740 1 -- start start 2024-04-25T08:59:52.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.054+0000 7f593384f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c36280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.054+0000 7f593384f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bde2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.054+0000 7f593384f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c25ad0 0x562dc4bde830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.054+0000 7f593384f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c154650 con 0x562dc4c1b370 2024-04-25T08:59:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.054+0000 7f593384f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c153a50 con 0x562dc4c25ad0 2024-04-25T08:59:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.054+0000 7f593384f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c154050 con 0x562dc4c08230 2024-04-25T08:59:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.054+0000 7f5929d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bde2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.054+0000 7f5929d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bde2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46222/0 (socket says 172.21.15.55:46222) 2024-04-25T08:59:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.054+0000 7f5929d9b640 1 -- 172.21.15.55:0/2698585033 learned_addr learned my addr 172.21.15.55:0/2698585033 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.055+0000 7f5929d9b640 1 -- 172.21.15.55:0/2698585033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 msgr2=0x562dc4c36280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.055+0000 7f5929d9b640 1 --2- 172.21.15.55:0/2698585033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c36280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.055+0000 7f5929d9b640 1 -- 172.21.15.55:0/2698585033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c25ad0 msgr2=0x562dc4bde830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.055+0000 7f5929d9b640 1 --2- 172.21.15.55:0/2698585033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c25ad0 0x562dc4bde830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.055+0000 7f5929d9b640 1 -- 172.21.15.55:0/2698585033 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dc4c1bc40 con 0x562dc4c1b370 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.055+0000 7f5929d9b640 1 --2- 172.21.15.55:0/2698585033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bde2f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f5920001040 tx=0x7f5920011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc3c7e069e1613b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.055+0000 7f590b7fe640 1 -- 172.21.15.55:0/2698585033 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592001e3b0 con 0x562dc4c1b370 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.055+0000 7f590b7fe640 1 -- 172.21.15.55:0/2698585033 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592000b040 con 0x562dc4c1b370 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.055+0000 7f590b7fe640 1 -- 172.21.15.55:0/2698585033 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592001e900 con 0x562dc4c1b370 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.055+0000 7f593384f740 1 -- 172.21.15.55:0/2698585033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 msgr2=0x562dc4bde2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.055+0000 7f593384f740 1 --2- 172.21.15.55:0/2698585033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bde2f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f5920001040 tx=0x7f5920011000 comp rx=0 tx=0).stop 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.056+0000 7f593384f740 1 -- 172.21.15.55:0/2698585033 shutdown_connections 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.056+0000 7f593384f740 1 --2- 172.21.15.55:0/2698585033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c25ad0 0x562dc4bde830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.056+0000 7f593384f740 1 --2- 172.21.15.55:0/2698585033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bde2f0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.056+0000 7f593384f740 1 --2- 172.21.15.55:0/2698585033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c36280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.056+0000 7f593384f740 1 -- 172.21.15.55:0/2698585033 >> 172.21.15.55:0/2698585033 conn(0x562dc4bddf10 msgr2=0x562dc4c45ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.056+0000 7f593384f740 1 -- 172.21.15.55:0/2698585033 shutdown_connections 2024-04-25T08:59:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.056+0000 7f593384f740 1 -- 172.21.15.55:0/2698585033 wait complete. 2024-04-25T08:59:52.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.056+0000 7f593384f740 1 -- start start 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.056+0000 7f593384f740 1 Processor -- start 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f593384f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c77100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f593384f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bd7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f593384f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c25ad0 0x562dc4c24560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f593384f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc4c093c0 con 0x562dc4c1b370 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f593384f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc4c1abe0 con 0x562dc4c25ad0 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f593384f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dc4c09990 con 0x562dc4c08230 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f593384f740 10 client.0 _ll_register_callbacks cb 0x562dc4bd8c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f5929d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bd7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f5929d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bd7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46226/0 (socket says 172.21.15.55:46226) 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f5929d9b640 1 -- 172.21.15.55:0/2809419908 learned_addr learned my addr 172.21.15.55:0/2809419908 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f592a59c640 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c77100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f592ad9d640 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c25ad0 0x562dc4c24560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f5929d9b640 1 -- 172.21.15.55:0/2809419908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 msgr2=0x562dc4c77100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f5929d9b640 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c77100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f5929d9b640 1 -- 172.21.15.55:0/2809419908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c25ad0 msgr2=0x562dc4c24560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f5929d9b640 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c25ad0 0x562dc4c24560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.057+0000 7f5929d9b640 1 -- 172.21.15.55:0/2809419908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562dc4c06650 con 0x562dc4c1b370 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f592a59c640 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c77100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f592ad9d640 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c25ad0 0x562dc4c24560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f5929d9b640 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bd7eb0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f5920001eb0 tx=0x7f5920001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6651f64184b871e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f59097fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f59097fa640 1 -- 172.21.15.55:0/2809419908 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592001eb80 con 0x562dc4c1b370 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f59097fa640 1 -- 172.21.15.55:0/2809419908 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f592001ed20 con 0x562dc4c1b370 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f593384f740 1 -- 172.21.15.55:0/2809419908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f592000b040 con 0x562dc4c1b370 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f59097fa640 1 -- 172.21.15.55:0/2809419908 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5920014450 con 0x562dc4c1b370 2024-04-25T08:59:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f593384f740 10 client.7635 fetch_fsmap learned FSMap version 57 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f593384f740 1 -- 172.21.15.55:0/2809419908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x562dc4c19480 con 0x562dc4c1b370 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f59097fa640 1 -- 172.21.15.55:0/2809419908 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592000b040 con 0x562dc4c1b370 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f59097fa640 1 -- 172.21.15.55:0/2809419908 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 57) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f59200145f0 con 0x562dc4c1b370 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f593384f740 10 client.7635 fetch_fsmap finished waiting for FSMap version 57 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f593384f740 10 client.7635 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f593384f740 20 client.7635 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f593384f740 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dc4bf13b0 0x562dc4bf1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f593384f740 4 client.7635 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f593384f740 1 -- 172.21.15.55:0/2809419908 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562dc4b4df50 con 0x562dc4bf13b0 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.058+0000 7f592a59c640 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dc4bf13b0 0x562dc4bf1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f59097fa640 10 client.7635 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f592a59c640 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dc4bf13b0 0x562dc4bf1790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ee1f0640b534be2 server_cookie=dca3cdc799abd09 in_seq=0 out_seq=0 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f59097fa640 1 -- 172.21.15.55:0/2809419908 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x562dc4b4df50 con 0x562dc4bf13b0 2024-04-25T08:59:52.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f59097fa640 10 client.7635 handle_command_reply: tid=0 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 1 client.7635 shutdown 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 1 -- 172.21.15.55:0/2809419908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 msgr2=0x562dc4bd7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bd7eb0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f5920001eb0 tx=0x7f5920001080 comp rx=0 tx=0).stop 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 1 -- 172.21.15.55:0/2809419908 shutdown_connections 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dc4bf13b0 0x562dc4bf1790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dc4c25ad0 0x562dc4c24560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc4c1b370 0x562dc4bd7eb0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f59097fa640 0 client.7635 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 1 --2- 172.21.15.55:0/2809419908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dc4c08230 0x562dc4c77100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 1 -- 172.21.15.55:0/2809419908 >> 172.21.15.55:0/2809419908 conn(0x562dc4bddf10 msgr2=0x562dc4c0b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 1 -- 172.21.15.55:0/2809419908 shutdown_connections 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 1 -- 172.21.15.55:0/2809419908 wait complete. 2024-04-25T08:59:52.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.059+0000 7f593384f740 20 client.7635 trim_cache size 0 max 16384 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7557, 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.4382286640000004, 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 57, 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 88, 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 88, 2024-04-25T08:59:52.055 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 5.4209344079999999 2024-04-25T08:59:52.056 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:59:52.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 -- 172.21.15.55:0/1349486133 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f590c06b4d0 msgr2=0x7f590c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f590c06b4d0 0x7f590c06d990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5924034000 tx=0x7f592402c000 comp rx=0 tx=0).stop 2024-04-25T08:59:52.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 -- 172.21.15.55:0/1349486133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c1618d0 msgr2=0x7f592c1f39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c1618d0 0x7f592c1f39f0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f591c00cf20 tx=0x7f591c00a7d0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 -- 172.21.15.55:0/1349486133 shutdown_connections 2024-04-25T08:59:52.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f590c06b4d0 0x7f590c06d990 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c1618d0 0x7f592c1f39f0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f592c1610b0 0x7f592c1503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 --2- 172.21.15.55:0/1349486133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f592c0cef40 0x7f592c14cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 -- 172.21.15.55:0/1349486133 >> 172.21.15.55:0/1349486133 conn(0x7f592c0b5570 msgr2=0x7f592c0b7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:52.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 -- 172.21.15.55:0/1349486133 shutdown_connections 2024-04-25T08:59:52.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.060+0000 7f5930b4c640 1 -- 172.21.15.55:0/1349486133 wait complete. 2024-04-25T08:59:52.060 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:59:52.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.172+0000 7f09c5a2a640 1 Processor -- start 2024-04-25T08:59:52.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.172+0000 7f09c5a2a640 1 -- start start 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09c5a2a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09c015bd40 0x7f09c009a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09c5a2a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09c0099e20 0x7f09c00cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09c5a2a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c00cfb90 con 0x7f09c0099a40 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09c5a2a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c015cfd0 con 0x7f09c015bd40 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09c5a2a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c015c210 con 0x7f09c0099e20 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09beffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f09c0099a40 0x7f09c00cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33190/0 (socket says 172.21.15.55:33190) 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09b7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09c015bd40 0x7f09c009a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09beffd640 1 -- 172.21.15.55:0/3510673793 learned_addr learned my addr 172.21.15.55:0/3510673793 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09bf7fe640 1 --2- 172.21.15.55:0/3510673793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09c0099e20 0x7f09c00cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09b7fff640 1 -- 172.21.15.55:0/3510673793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09c0099e20 msgr2=0x7f09c00cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09b7fff640 1 --2- 172.21.15.55:0/3510673793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09c0099e20 0x7f09c00cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09be7fc640 1 -- 172.21.15.55:0/3510673793 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851288630 0 0) 0x7f09c00cfb90 con 0x7f09c0099a40 2024-04-25T08:59:52.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09b7fff640 1 -- 172.21.15.55:0/3510673793 >> v1:172.21.15.55:6789/0 conn(0x7f09c0099a40 legacy=0x7f09c00cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09b7fff640 1 -- 172.21.15.55:0/3510673793 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c015c4f0 con 0x7f09c015bd40 2024-04-25T08:59:52.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.173+0000 7f09bf7fe640 1 --2- 172.21.15.55:0/3510673793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09c0099e20 0x7f09c00cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:59:52.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.174+0000 7f09b7fff640 1 --2- 172.21.15.55:0/3510673793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09c015bd40 0x7f09c009a9c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f09a80097a0 tx=0x7f09a802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4614180a8a1da104 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.174+0000 7f09be7fc640 1 -- 172.21.15.55:0/3510673793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8037070 con 0x7f09c015bd40 2024-04-25T08:59:52.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.174+0000 7f09be7fc640 1 -- 172.21.15.55:0/3510673793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a802ae50 con 0x7f09c015bd40 2024-04-25T08:59:52.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.174+0000 7f09be7fc640 1 -- 172.21.15.55:0/3510673793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8032660 con 0x7f09c015bd40 2024-04-25T08:59:52.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.174+0000 7f09c5a2a640 1 -- 172.21.15.55:0/3510673793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09c015bd40 msgr2=0x7f09c009a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.174+0000 7f09c5a2a640 1 --2- 172.21.15.55:0/3510673793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09c015bd40 0x7f09c009a9c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f09a80097a0 tx=0x7f09a802a100 comp rx=0 tx=0).stop 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.174+0000 7f09c5a2a640 1 -- 172.21.15.55:0/3510673793 shutdown_connections 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.174+0000 7f09c5a2a640 1 --2- 172.21.15.55:0/3510673793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09c0099e20 0x7f09c00cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.174+0000 7f09c5a2a640 1 --2- 172.21.15.55:0/3510673793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09c015bd40 0x7f09c009a9c0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.174+0000 7f09c5a2a640 1 -- 172.21.15.55:0/3510673793 >> 172.21.15.55:0/3510673793 conn(0x7f09c00b32f0 msgr2=0x7f09c00b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.175+0000 7f09c5a2a640 1 -- 172.21.15.55:0/3510673793 shutdown_connections 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.175+0000 7f09c5a2a640 1 -- 172.21.15.55:0/3510673793 wait complete. 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.176+0000 7f09c5a2a640 1 Processor -- start 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.176+0000 7f09c5a2a640 1 -- start start 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.176+0000 7f09c5a2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09c0099a40 0x7f09c00c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.176+0000 7f09c5a2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09c0099e20 0x7f09c00b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.176+0000 7f09c5a2a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09c015bd40 0x7f09c00c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.176+0000 7f09c5a2a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c009a250 con 0x7f09c0099e20 2024-04-25T08:59:52.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.176+0000 7f09c5a2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c015cab0 con 0x7f09c0099a40 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.176+0000 7f09c5a2a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c009a3d0 con 0x7f09c015bd40 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.176+0000 7f09b7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09c0099e20 0x7f09c00b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09b7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09c0099e20 0x7f09c00b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46240/0 (socket says 172.21.15.55:46240) 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09b7fff640 1 -- 172.21.15.55:0/364569370 learned_addr learned my addr 172.21.15.55:0/364569370 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09bf7fe640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09c015bd40 0x7f09c00c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09beffd640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09c0099a40 0x7f09c00c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09b7fff640 1 -- 172.21.15.55:0/364569370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09c015bd40 msgr2=0x7f09c00c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09b7fff640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09c015bd40 0x7f09c00c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09b7fff640 1 -- 172.21.15.55:0/364569370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09c0099a40 msgr2=0x7f09c00c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09b7fff640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09c0099a40 0x7f09c00c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09b7fff640 1 -- 172.21.15.55:0/364569370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c006d3d0 con 0x7f09c0099e20 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09b7fff640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09c0099e20 0x7f09c00b6d50 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f09a80098c0 tx=0x7f09a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09bcff9640 1 -- 172.21.15.55:0/364569370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8041030 con 0x7f09c0099e20 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09bcff9640 1 -- 172.21.15.55:0/364569370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a802ac50 con 0x7f09c0099e20 2024-04-25T08:59:52.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09c5a2a640 1 -- 172.21.15.55:0/364569370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c0158f60 con 0x7f09c0099e20 2024-04-25T08:59:52.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09bcff9640 1 -- 172.21.15.55:0/364569370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8037040 con 0x7f09c0099e20 2024-04-25T08:59:52.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.177+0000 7f09c5a2a640 1 -- 172.21.15.55:0/364569370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c00b43f0 con 0x7f09c0099e20 2024-04-25T08:59:52.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.178+0000 7f09c5a2a640 1 -- 172.21.15.55:0/364569370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c00c6540 con 0x7f09c0099e20 2024-04-25T08:59:52.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.179+0000 7f09bcff9640 1 -- 172.21.15.55:0/364569370 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f09a8044070 con 0x7f09c0099e20 2024-04-25T08:59:52.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.179+0000 7f09bcff9640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09a006b4d0 0x7f09a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:52.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.179+0000 7f09bcff9640 1 -- 172.21.15.55:0/364569370 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f09a80aa8f0 con 0x7f09c0099e20 2024-04-25T08:59:52.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.179+0000 7f09beffd640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09a006b4d0 0x7f09a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:52.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.180+0000 7f09beffd640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09a006b4d0 0x7f09a006d990 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f09b0000f60 tx=0x7f09b0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:52.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.184+0000 7f09bcff9640 1 -- 172.21.15.55:0/364569370 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09c00c6540 con 0x7f09c0099e20 2024-04-25T08:59:52.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.402+0000 7f09c5a2a640 1 -- 172.21.15.55:0/364569370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f09c00749b0 con 0x7f09c0099e20 2024-04-25T08:59:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.403+0000 7f09bcff9640 1 -- 172.21.15.55:0/364569370 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) v1 ==== 53+0+73 (secure 0 0 0) 0x7f09a8044e40 con 0x7f09c0099e20 2024-04-25T08:59:52.392 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:59:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 -- 172.21.15.55:0/364569370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09a006b4d0 msgr2=0x7f09a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09a006b4d0 0x7f09a006d990 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f09b0000f60 tx=0x7f09b0009040 comp rx=0 tx=0).stop 2024-04-25T08:59:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 -- 172.21.15.55:0/364569370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09c0099e20 msgr2=0x7f09c00b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09c0099e20 0x7f09c00b6d50 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f09a80098c0 tx=0x7f09a80046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 -- 172.21.15.55:0/364569370 shutdown_connections 2024-04-25T08:59:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09a006b4d0 0x7f09a006d990 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09c015bd40 0x7f09c00c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09c0099e20 0x7f09c00b6d50 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 --2- 172.21.15.55:0/364569370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09c0099a40 0x7f09c00c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 -- 172.21.15.55:0/364569370 >> 172.21.15.55:0/364569370 conn(0x7f09c00b32f0 msgr2=0x7f09c006fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 -- 172.21.15.55:0/364569370 shutdown_connections 2024-04-25T08:59:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:52.405+0000 7f09c5a2a640 1 -- 172.21.15.55:0/364569370 wait complete. 2024-04-25T08:59:52.404 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:59:52.404 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:59:52.405 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T08:59:52.405 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:59:52.405 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:52.405 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:59:52.405 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:59:52.405 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:59:52.405 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:52.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:52.405 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T08:59:52.421 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:59:52.421 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:59:52.421 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:59:52.421 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:52.421 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T08:59:52.421 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42365sec preferred_lft 42365sec 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:52.422 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:59:52.424 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T08:59:52.424 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:59:52.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:52.424 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:59:52.485 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T08:59:52.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:52.487 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T08:59:52.544 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T08:59:52.544 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:59:52.544 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T08:59:52.544 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T08:59:52.544 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:59:52.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:52.544 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T08:59:52.544 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T08:59:52.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T08:59:52.545 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T08:59:52.545 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T08:59:52.545 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T08:59:52.608 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T08:59:52.619+0000 7fd86060e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:59:52.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:52.630 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T08:59:52.685 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:59:52.685 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:59:52.686 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:52.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:52.686 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T08:59:52.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:59:52.751 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:52.806 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:59:52.806 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:59:52.806 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:52.861 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:59:52.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:52.861 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:52.943 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:52.943 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:59:52.943 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:59:52.952 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:52.952 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:59:52.952 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:59:52.952 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:59:52.952 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:59:52.962 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:59:52.962 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:59:52.962 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T08:59:52.962 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T08:59:52.962 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:59:52.962 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T08:59:52.962 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T08:59:52.962 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T08:59:52.963 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:59:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:59:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:59:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:59:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:59:52.965 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:59:52.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:52.965 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:59:53.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:53.029 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:59:53.086 INFO:teuthology.orchestra.run.smithi055.stdout:client7647 2024-04-25T08:59:53.087 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T08:59:53.087 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:59:53.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:53.142 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-04-25T08:59:53.200 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T08:59:53.211+0000 7fd85c606640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T08:59:53.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:59:53.201 INFO:teuthology.orchestra.run.smithi055.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-04-25T08:59:53.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:53.202 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-04-25T08:59:53.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.358+0000 7f7ea323f640 1 Processor -- start 2024-04-25T08:59:53.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.358+0000 7f7ea323f640 1 -- start start 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.359+0000 7f7ea323f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7e9c0ceeb0 0x7f7e9c168a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.359+0000 7f7ea323f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c161f80 con 0x7f7e9c161090 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.359+0000 7f7ea323f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c162260 con 0x7f7e9c0b9720 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.359+0000 7f7ea323f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c0d21a0 con 0x7f7e9c0ceeb0 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.359+0000 7f7ea0fdb640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7e9c161090 0x7f7e9c161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33194/0 (socket says 172.21.15.55:33194) 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.359+0000 7f7ea0fdb640 1 -- 172.21.15.55:0/1148475954 learned_addr learned my addr 172.21.15.55:0/1148475954 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.359+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/1148475954 >> v2:172.21.15.167:3300/0 conn(0x7f7e9c0ceeb0 0x7f7e9c168a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.359+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570798656 0 0) 0x7f7e9c161f80 con 0x7f7e9c161090 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.359+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e88003520 con 0x7f7e9c161090 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2956163418 0 0) 0x7f7e88003520 con 0x7f7e9c161090 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 >> v2:172.21.15.167:3300/0 conn(0x7f7e9c0ceeb0 msgr2=0x7f7e9c168a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 --2- 172.21.15.55:0/1148475954 >> v2:172.21.15.167:3300/0 conn(0x7f7e9c0ceeb0 0x7f7e9c168a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 >> v1:172.21.15.167:6789/0 conn(0x7f7e9c0b9720 legacy=0x7f7e9c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c162540 con 0x7f7e9c161090 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f7e940019f0 con 0x7f7e9c161090 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 >> v1:172.21.15.55:6789/0 conn(0x7f7e9c161090 legacy=0x7f7e9c161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 --2- 172.21.15.55:0/1148475954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e880039b0 0x7f7e88003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 --2- 172.21.15.55:0/1148475954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e88004800 0x7f7e88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 --2- 172.21.15.55:0/1148475954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e88005210 0x7f7e8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0d21a0 con 0x7f7e88004800 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8800c140 con 0x7f7e88005210 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8800c340 con 0x7f7e880039b0 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/1148475954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e88004800 0x7f7e88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/1148475954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e880039b0 0x7f7e88003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/1148475954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e88005210 0x7f7e8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9bfff640 1 -- 172.21.15.55:0/1148475954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e880039b0 msgr2=0x7f7e88003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/1148475954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e880039b0 0x7f7e88003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9bfff640 1 -- 172.21.15.55:0/1148475954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e88005210 msgr2=0x7f7e8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/1148475954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e88005210 0x7f7e8800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7e9bfff640 1 -- 172.21.15.55:0/1148475954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e88003520 con 0x7f7e88004800 2024-04-25T08:59:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.360+0000 7f7ea17dc640 1 -- 172.21.15.55:0/1148475954 reap_dead start 2024-04-25T08:59:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.361+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/1148475954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e88004800 0x7f7e88004c80 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c012d20 tx=0x7f7e88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a915cc4587d75738 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.361+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0129f0 con 0x7f7e88004800 2024-04-25T08:59:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.361+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0052d0 con 0x7f7e88004800 2024-04-25T08:59:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.361+0000 7f7e9b7fe640 1 -- 172.21.15.55:0/1148475954 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c012310 con 0x7f7e88004800 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.362+0000 7f7ea323f640 1 -- 172.21.15.55:0/1148475954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e88004800 msgr2=0x7f7e88004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.362+0000 7f7ea323f640 1 --2- 172.21.15.55:0/1148475954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e88004800 0x7f7e88004c80 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c012d20 tx=0x7f7e88005830 comp rx=0 tx=0).stop 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.362+0000 7f7ea323f640 1 -- 172.21.15.55:0/1148475954 shutdown_connections 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.362+0000 7f7ea323f640 1 --2- 172.21.15.55:0/1148475954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e88004800 0x7f7e88004c80 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.362+0000 7f7ea323f640 1 -- 172.21.15.55:0/1148475954 >> 172.21.15.55:0/1148475954 conn(0x7f7e9c0b55e0 msgr2=0x7f7e9c0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.362+0000 7f7ea323f640 1 -- 172.21.15.55:0/1148475954 shutdown_connections 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.362+0000 7f7ea323f640 1 -- 172.21.15.55:0/1148475954 wait complete. 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.363+0000 7f7ea323f640 1 Processor -- start 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.363+0000 7f7ea323f640 1 -- start start 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7ea323f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e88004800 0x7f7e9c14d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7ea323f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9c0c95c0 0x7f7e9c0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7ea323f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e9c0c9f80 0x7f7e9c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7ea323f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0ce7a0 con 0x7f7e9c0c95c0 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7ea323f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c161470 con 0x7f7e88004800 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7ea323f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0ce920 con 0x7f7e9c0c9f80 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7e9bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9c0c95c0 0x7f7e9c0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7e9bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9c0c95c0 0x7f7e9c0c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46250/0 (socket says 172.21.15.55:46250) 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7e9bfff640 1 -- 172.21.15.55:0/2074857703 learned_addr learned my addr 172.21.15.55:0/2074857703 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e88004800 0x7f7e9c14d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e9c0c9f80 0x7f7e9c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7e9bfff640 1 -- 172.21.15.55:0/2074857703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e9c0c9f80 msgr2=0x7f7e9c1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e9c0c9f80 0x7f7e9c1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7e9bfff640 1 -- 172.21.15.55:0/2074857703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e88004800 msgr2=0x7f7e9c14d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e88004800 0x7f7e9c14d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7e9bfff640 1 -- 172.21.15.55:0/2074857703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0ccf80 con 0x7f7e9c0c95c0 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e9c0c9f80 0x7f7e9c1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.364+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9c0c95c0 0x7f7e9c0c9a40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c000c00 tx=0x7f7e8c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.365+0000 7f7e997fa640 1 -- 172.21.15.55:0/2074857703 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c007a30 con 0x7f7e9c0c95c0 2024-04-25T08:59:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.365+0000 7f7e997fa640 1 -- 172.21.15.55:0/2074857703 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0129d0 con 0x7f7e9c0c95c0 2024-04-25T08:59:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.365+0000 7f7e997fa640 1 -- 172.21.15.55:0/2074857703 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c005480 con 0x7f7e9c0c95c0 2024-04-25T08:59:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.365+0000 7f7ea323f640 1 -- 172.21.15.55:0/2074857703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c0cd260 con 0x7f7e9c0c95c0 2024-04-25T08:59:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.365+0000 7f7ea323f640 1 -- 172.21.15.55:0/2074857703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c0cd820 con 0x7f7e9c0c95c0 2024-04-25T08:59:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.366+0000 7f7e997fa640 1 -- 172.21.15.55:0/2074857703 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7e8c007030 con 0x7f7e9c0c95c0 2024-04-25T08:59:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.367+0000 7f7e997fa640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7c06b500 0x7f7e7c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.367+0000 7f7e997fa640 1 -- 172.21.15.55:0/2074857703 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7e8c0b22d0 con 0x7f7e9c0c95c0 2024-04-25T08:59:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.367+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7c06b500 0x7f7e7c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.367+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7c06b500 0x7f7e7c06d9c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7e94001560 tx=0x7f7e94006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.368+0000 7f7ea601e740 1 Processor -- start 2024-04-25T08:59:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.368+0000 7f7ea601e740 1 -- start start 2024-04-25T08:59:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.368+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda65b080 0x562dda65d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.368+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b460 0x562dda65ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.368+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda62dce0 0x562dda6314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.368+0000 7f7ea601e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dda596af0 con 0x562dda62dce0 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.368+0000 7f7ea601e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dda53fde0 con 0x562dda65b460 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.368+0000 7f7ea601e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dda592b90 con 0x562dda65b080 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7ea17dc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda62dce0 0x562dda6314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7ea17dc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda62dce0 0x562dda6314f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46258/0 (socket says 172.21.15.55:46258) 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7ea17dc640 1 -- 172.21.15.55:0/3692379321 learned_addr learned my addr 172.21.15.55:0/3692379321 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/3692379321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda65b080 0x562dda65d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/3692379321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b460 0x562dda65ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7ea17dc640 1 -- 172.21.15.55:0/3692379321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda65b080 msgr2=0x562dda65d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/3692379321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda65b080 0x562dda65d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7ea17dc640 1 -- 172.21.15.55:0/3692379321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b460 msgr2=0x562dda65ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/3692379321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b460 0x562dda65ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7ea17dc640 1 -- 172.21.15.55:0/3692379321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dda3777b0 con 0x562dda62dce0 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/3692379321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b460 0x562dda65ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/3692379321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda62dce0 0x562dda6314f0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c073290 tx=0x7f7e84009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4c9152fc8238eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7e927fc640 1 -- 172.21.15.55:0/3692379321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84004240 con 0x562dda62dce0 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7e927fc640 1 -- 172.21.15.55:0/3692379321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8401e070 con 0x562dda62dce0 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.369+0000 7f7e927fc640 1 -- 172.21.15.55:0/3692379321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84014960 con 0x562dda62dce0 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.370+0000 7f7ea601e740 1 -- 172.21.15.55:0/3692379321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda62dce0 msgr2=0x562dda6314f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.370+0000 7f7ea601e740 1 --2- 172.21.15.55:0/3692379321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda62dce0 0x562dda6314f0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c073290 tx=0x7f7e84009190 comp rx=0 tx=0).stop 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.370+0000 7f7ea601e740 1 -- 172.21.15.55:0/3692379321 shutdown_connections 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.370+0000 7f7ea601e740 1 --2- 172.21.15.55:0/3692379321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda62dce0 0x562dda6314f0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.370+0000 7f7ea601e740 1 --2- 172.21.15.55:0/3692379321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b460 0x562dda65ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.370+0000 7f7ea601e740 1 --2- 172.21.15.55:0/3692379321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda65b080 0x562dda65d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.370+0000 7f7ea601e740 1 -- 172.21.15.55:0/3692379321 >> 172.21.15.55:0/3692379321 conn(0x562dda62ff50 msgr2=0x562dda678890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.370+0000 7f7ea601e740 1 -- 172.21.15.55:0/3692379321 shutdown_connections 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.370+0000 7f7ea601e740 1 -- 172.21.15.55:0/3692379321 wait complete. 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.370+0000 7f7ea601e740 1 -- start start 2024-04-25T08:59:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.371+0000 7f7ea601e740 1 Processor -- start 2024-04-25T08:59:53.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.371+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda655bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.371+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b460 0x562dda656b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.371+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda6582a0 0x562dda658720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.371+0000 7f7ea601e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dda633100 con 0x562dda65b080 2024-04-25T08:59:53.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.371+0000 7f7ea601e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dda5353e0 con 0x562dda65b460 2024-04-25T08:59:53.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.371+0000 7f7ea601e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dda6333e0 con 0x562dda6582a0 2024-04-25T08:59:53.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea601e740 10 client.0 _ll_register_callbacks cb 0x562dda552d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:53.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea0fdb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda655bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea0fdb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda655bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46270/0 (socket says 172.21.15.55:46270) 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea0fdb640 1 -- 172.21.15.55:0/1048104590 learned_addr learned my addr 172.21.15.55:0/1048104590 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b460 0x562dda656b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda6582a0 0x562dda658720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea0fdb640 1 -- 172.21.15.55:0/1048104590 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda6582a0 msgr2=0x562dda658720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda6582a0 0x562dda658720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea0fdb640 1 -- 172.21.15.55:0/1048104590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b460 msgr2=0x562dda656b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b460 0x562dda656b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea0fdb640 1 -- 172.21.15.55:0/1048104590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562dda3d7f40 con 0x562dda65b080 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda655bb0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f7e94015e70 tx=0x7f7e9400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a331f8cbc1faa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7e7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/1048104590 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94019070 con 0x562dda65b080 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/1048104590 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7e94014b30 con 0x562dda65b080 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea601e740 1 -- 172.21.15.55:0/1048104590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e8401e070 con 0x562dda65b080 2024-04-25T08:59:53.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/1048104590 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e94030050 con 0x562dda65b080 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea601e740 10 client.7659 fetch_fsmap learned FSMap version 57 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.372+0000 7f7ea601e740 1 -- 172.21.15.55:0/1048104590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x562dda26b0a0 con 0x562dda65b080 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.373+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/1048104590 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8401e070 con 0x562dda65b080 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.373+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/1048104590 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 57) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7e94033020 con 0x562dda65b080 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.373+0000 7f7ea601e740 10 client.7659 fetch_fsmap finished waiting for FSMap version 57 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.373+0000 7f7ea601e740 10 client.7659 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.373+0000 7f7ea601e740 20 client.7659 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.373+0000 7f7ea601e740 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dda67acf0 0x562dda68c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.373+0000 7f7ea601e740 4 client.7659 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.373+0000 7f7ea601e740 1 -- 172.21.15.55:0/1048104590 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562dda5a4030 con 0x562dda67acf0 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.373+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dda67acf0 0x562dda68c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.373+0000 7f7e7b7fe640 10 client.7659 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.373+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dda67acf0 0x562dda68c0c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced658c87967a81c server_cookie=aad13e79f37739ac in_seq=0 out_seq=0 2024-04-25T08:59:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/1048104590 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562dda5a4030 con 0x562dda67acf0 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7e7b7fe640 10 client.7659 handle_command_reply: tid=0 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 1 client.7659 shutdown 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 1 -- 172.21.15.55:0/1048104590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 msgr2=0x562dda655bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda655bb0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f7e94015e70 tx=0x7f7e9400a060 comp rx=0 tx=0).stop 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 1 -- 172.21.15.55:0/1048104590 shutdown_connections 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dda67acf0 0x562dda68c0c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda6582a0 0x562dda658720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b460 0x562dda656b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7e7b7fe640 0 client.7659 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 1 --2- 172.21.15.55:0/1048104590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda655bb0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 1 -- 172.21.15.55:0/1048104590 >> 172.21.15.55:0/1048104590 conn(0x562dda62dce0 msgr2=0x562dda62e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 1 -- 172.21.15.55:0/1048104590 shutdown_connections 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 1 -- 172.21.15.55:0/1048104590 wait complete. 2024-04-25T08:59:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.374+0000 7f7ea601e740 20 client.7659 trim_cache size 0 max 16384 2024-04-25T08:59:53.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.389+0000 7f7ea601e740 1 Processor -- start 2024-04-25T08:59:53.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.389+0000 7f7ea601e740 1 -- start start 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda6582a0 0x562dda633310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda6562e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda65b460 0x562dda6dee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7ea601e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c1fc320 con 0x562dda65b080 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7ea601e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c1fb630 con 0x562dda6582a0 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7ea601e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0d3e60 con 0x562dda65b460 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7e9bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda6562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7e9bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda6562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46282/0 (socket says 172.21.15.55:46282) 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7e9bfff640 1 -- 172.21.15.55:0/4005035489 learned_addr learned my addr 172.21.15.55:0/4005035489 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/4005035489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda65b460 0x562dda6dee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/4005035489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda6582a0 0x562dda633310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7e9bfff640 1 -- 172.21.15.55:0/4005035489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda65b460 msgr2=0x562dda6dee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/4005035489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda65b460 0x562dda6dee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7e9bfff640 1 -- 172.21.15.55:0/4005035489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda6582a0 msgr2=0x562dda633310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/4005035489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda6582a0 0x562dda633310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.390+0000 7f7e9bfff640 1 -- 172.21.15.55:0/4005035489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dda6777c0 con 0x562dda65b080 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/4005035489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda6562e0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c07ce50 tx=0x7f7e8c0b0670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708f4b01dcd13be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7e91ffb640 1 -- 172.21.15.55:0/4005035489 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c084b40 con 0x562dda65b080 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7e91ffb640 1 -- 172.21.15.55:0/4005035489 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0ad040 con 0x562dda65b080 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7e91ffb640 1 -- 172.21.15.55:0/4005035489 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c089100 con 0x562dda65b080 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7ea601e740 1 -- 172.21.15.55:0/4005035489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 msgr2=0x562dda6562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7ea601e740 1 --2- 172.21.15.55:0/4005035489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda6562e0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c07ce50 tx=0x7f7e8c0b0670 comp rx=0 tx=0).stop 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7ea601e740 1 -- 172.21.15.55:0/4005035489 shutdown_connections 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7ea601e740 1 --2- 172.21.15.55:0/4005035489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda65b460 0x562dda6dee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7ea601e740 1 --2- 172.21.15.55:0/4005035489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b080 0x562dda6562e0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7ea601e740 1 --2- 172.21.15.55:0/4005035489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda6582a0 0x562dda633310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7ea601e740 1 -- 172.21.15.55:0/4005035489 >> 172.21.15.55:0/4005035489 conn(0x562dda62dce0 msgr2=0x562dda69b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7ea601e740 1 -- 172.21.15.55:0/4005035489 shutdown_connections 2024-04-25T08:59:53.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.391+0000 7f7ea601e740 1 -- 172.21.15.55:0/4005035489 wait complete. 2024-04-25T08:59:53.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.392+0000 7f7ea601e740 1 -- start start 2024-04-25T08:59:53.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.392+0000 7f7ea601e740 1 Processor -- start 2024-04-25T08:59:53.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda6582a0 0x562dda6e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b080 0x562dda66ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea601e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b460 0x562dda6562e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea601e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dda655a50 con 0x562dda65b460 2024-04-25T08:59:53.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea601e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0d4460 con 0x562dda65b080 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea601e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dda69bd30 con 0x562dda6582a0 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea601e740 10 client.0 _ll_register_callbacks cb 0x7f7e940157e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea17dc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b460 0x562dda6562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea17dc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b460 0x562dda6562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46296/0 (socket says 172.21.15.55:46296) 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea17dc640 1 -- 172.21.15.55:0/4187782853 learned_addr learned my addr 172.21.15.55:0/4187782853 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda6582a0 0x562dda6e71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7e9bfff640 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b080 0x562dda66ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea17dc640 1 -- 172.21.15.55:0/4187782853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda6582a0 msgr2=0x562dda6e71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda6582a0 0x562dda6e71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea17dc640 1 -- 172.21.15.55:0/4187782853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b080 msgr2=0x562dda66ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b080 0x562dda66ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea17dc640 1 -- 172.21.15.55:0/4187782853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562dda66f170 con 0x562dda65b460 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7ea17dc640 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b460 0x562dda6562e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f7e84000c00 tx=0x7f7e84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b58cd6438c6deca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.393+0000 7f7e7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/4187782853 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84032060 con 0x562dda65b460 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/4187782853 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7e84003810 con 0x562dda65b460 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7ea601e740 1 -- 172.21.15.55:0/4187782853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e8c0ad040 con 0x562dda65b460 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/4187782853 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e84014ea0 con 0x562dda65b460 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7ea601e740 10 client.7665 fetch_fsmap learned FSMap version 57 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7ea601e740 1 -- 172.21.15.55:0/4187782853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x562dda6e5480 con 0x562dda65b460 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/4187782853 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0ad040 con 0x562dda65b460 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/4187782853 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 57) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7e84003a10 con 0x562dda65b460 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7ea601e740 10 client.7665 fetch_fsmap finished waiting for FSMap version 57 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7ea601e740 10 client.7665 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7ea601e740 20 client.7665 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7ea601e740 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dda656820 0x562dda659920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7ea601e740 4 client.7665 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7ea601e740 1 -- 172.21.15.55:0/4187782853 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) v1 -- 0x562dda59e380 con 0x562dda656820 2024-04-25T08:59:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.394+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dda656820 0x562dda659920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea0fdb640 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dda656820 0x562dda659920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92286c426f17b430 server_cookie=ce7ead7903667447 in_seq=0 out_seq=0 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7e7b7fe640 10 client.7665 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7e7b7fe640 1 -- 172.21.15.55:0/4187782853 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562dda59e380 con 0x562dda656820 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7e7b7fe640 10 client.7665 handle_command_reply: tid=0 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 1 client.7665 shutdown 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 1 -- 172.21.15.55:0/4187782853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b460 msgr2=0x562dda6562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b460 0x562dda6562e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f7e84000c00 tx=0x7f7e84017000 comp rx=0 tx=0).stop 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 1 -- 172.21.15.55:0/4187782853 shutdown_connections 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562dda656820 0x562dda659920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dda65b460 0x562dda6562e0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562dda65b080 0x562dda66ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7e7b7fe640 0 client.7665 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 1 --2- 172.21.15.55:0/4187782853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562dda6582a0 0x562dda6e71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 1 -- 172.21.15.55:0/4187782853 >> 172.21.15.55:0/4187782853 conn(0x562dda62dce0 msgr2=0x562dda688320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.390 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T08:59:53.395+0000 7fd85c606640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T08:59:43.731639+0000 1=1+0) n(v0 rc2024-04-25T08:59:43.845636+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x556d2f548100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T08:59:43.731639+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T08:59:43.845636+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T08:59:53.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 1 -- 172.21.15.55:0/4187782853 shutdown_connections 2024-04-25T08:59:53.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 1 -- 172.21.15.55:0/4187782853 wait complete. 2024-04-25T08:59:53.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.395+0000 7f7ea601e740 20 client.7665 trim_cache size 0 max 16384 2024-04-25T08:59:53.391 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:59:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-25T08:59:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "d6fb55a8-1c0c-4e9d-8c07-4a7551c22e34", 2024-04-25T08:59:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-25T08:59:53.391 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:59:53.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 -- 172.21.15.55:0/2074857703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7c06b500 msgr2=0x7f7e7c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7c06b500 0x7f7e7c06d9c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7e94001560 tx=0x7f7e94006040 comp rx=0 tx=0).stop 2024-04-25T08:59:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 -- 172.21.15.55:0/2074857703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9c0c95c0 msgr2=0x7f7e9c0c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9c0c95c0 0x7f7e9c0c9a40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c000c00 tx=0x7f7e8c001120 comp rx=0 tx=0).stop 2024-04-25T08:59:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 -- 172.21.15.55:0/2074857703 shutdown_connections 2024-04-25T08:59:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7e7c06b500 0x7f7e7c06d9c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e9c0c9f80 0x7f7e9c1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9c0c95c0 0x7f7e9c0c9a40 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 --2- 172.21.15.55:0/2074857703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e88004800 0x7f7e9c14d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 -- 172.21.15.55:0/2074857703 >> 172.21.15.55:0/2074857703 conn(0x7f7e9c0b55e0 msgr2=0x7f7e9c0b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 -- 172.21.15.55:0/2074857703 shutdown_connections 2024-04-25T08:59:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.396+0000 7f7ea323f640 1 -- 172.21.15.55:0/2074857703 wait complete. 2024-04-25T08:59:53.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:59:53.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.510+0000 7f01dadf5640 1 Processor -- start 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.510+0000 7f01dadf5640 1 -- start start 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.511+0000 7f01dadf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01d4161120 0x7f01d41617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.511+0000 7f01dadf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01d40b5c60 0x7f01d40d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.511+0000 7f01dadf5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d4161500 con 0x7f01d4161ce0 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.511+0000 7f01dadf5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d4162740 con 0x7f01d40b5c60 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.511+0000 7f01dadf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4162180 con 0x7f01d4161120 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.511+0000 7f01d9392640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01d40b5c60 0x7f01d40d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.511+0000 7f01d3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f01d4161ce0 0x7f01d40b5550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33204/0 (socket says 172.21.15.55:33204) 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.511+0000 7f01d3fff640 1 -- 172.21.15.55:0/7676237 learned_addr learned my addr 172.21.15.55:0/7676237 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.511+0000 7f01d8b91640 1 --2- 172.21.15.55:0/7676237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01d4161120 0x7f01d41617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.512+0000 7f01d9392640 1 -- 172.21.15.55:0/7676237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01d4161120 msgr2=0x7f01d41617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.512+0000 7f01d9392640 1 --2- 172.21.15.55:0/7676237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01d4161120 0x7f01d41617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.512+0000 7f01d9392640 1 -- 172.21.15.55:0/7676237 >> v1:172.21.15.55:6789/0 conn(0x7f01d4161ce0 legacy=0x7f01d40b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.512+0000 7f01d37fe640 1 -- 172.21.15.55:0/7676237 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794439329 0 0) 0x7f01d4161500 con 0x7f01d4161ce0 2024-04-25T08:59:53.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.512+0000 7f01d9392640 1 -- 172.21.15.55:0/7676237 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4162460 con 0x7f01d40b5c60 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.512+0000 7f01d9392640 1 --2- 172.21.15.55:0/7676237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d40b5c60 0x7f01d40d2560 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f01c40097a0 tx=0x7f01c402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5969219e249935a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.513+0000 7f01d37fe640 1 -- 172.21.15.55:0/7676237 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4037070 con 0x7f01d40b5c60 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.513+0000 7f01d37fe640 1 -- 172.21.15.55:0/7676237 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c402ae50 con 0x7f01d40b5c60 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.513+0000 7f01d37fe640 1 -- 172.21.15.55:0/7676237 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4032660 con 0x7f01d40b5c60 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.513+0000 7f01dadf5640 1 -- 172.21.15.55:0/7676237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d40b5c60 msgr2=0x7f01d40d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.513+0000 7f01dadf5640 1 --2- 172.21.15.55:0/7676237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d40b5c60 0x7f01d40d2560 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f01c40097a0 tx=0x7f01c402a100 comp rx=0 tx=0).stop 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.513+0000 7f01dadf5640 1 -- 172.21.15.55:0/7676237 shutdown_connections 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.513+0000 7f01dadf5640 1 --2- 172.21.15.55:0/7676237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d40b5c60 0x7f01d40d2560 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.513+0000 7f01dadf5640 1 --2- 172.21.15.55:0/7676237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01d4161120 0x7f01d41617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.513+0000 7f01dadf5640 1 -- 172.21.15.55:0/7676237 >> 172.21.15.55:0/7676237 conn(0x7f01d40d0550 msgr2=0x7f01d40d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.513+0000 7f01dadf5640 1 -- 172.21.15.55:0/7676237 shutdown_connections 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.513+0000 7f01dadf5640 1 -- 172.21.15.55:0/7676237 wait complete. 2024-04-25T08:59:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.514+0000 7f01dadf5640 1 Processor -- start 2024-04-25T08:59:53.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.514+0000 7f01dadf5640 1 -- start start 2024-04-25T08:59:53.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.515+0000 7f01dadf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01d40b5c60 0x7f01d4142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.515+0000 7f01dadf5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01d4161120 0x7f01d40b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.515+0000 7f01dadf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d4161ce0 0x7f01d40b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.515+0000 7f01dadf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40b95f0 con 0x7f01d4161ce0 2024-04-25T08:59:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.515+0000 7f01dadf5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40d2040 con 0x7f01d4161120 2024-04-25T08:59:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.515+0000 7f01dadf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40b9770 con 0x7f01d40b5c60 2024-04-25T08:59:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.515+0000 7f01d9392640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d4161ce0 0x7f01d40b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.515+0000 7f01d9392640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d4161ce0 0x7f01d40b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46320/0 (socket says 172.21.15.55:46320) 2024-04-25T08:59:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.515+0000 7f01d9392640 1 -- 172.21.15.55:0/4242519762 learned_addr learned my addr 172.21.15.55:0/4242519762 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01d8b91640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01d40b5c60 0x7f01d4142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01d9392640 1 -- 172.21.15.55:0/4242519762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01d40b5c60 msgr2=0x7f01d4142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01d3fff640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01d4161120 0x7f01d40b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01d9392640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01d40b5c60 0x7f01d4142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01d9392640 1 -- 172.21.15.55:0/4242519762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01d4161120 msgr2=0x7f01d40b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01d9392640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01d4161120 0x7f01d40b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01d9392640 1 -- 172.21.15.55:0/4242519762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d41432e0 con 0x7f01d4161ce0 2024-04-25T08:59:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01d9392640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d4161ce0 0x7f01d40b42e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f01c4035040 tx=0x7f01c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01d17fa640 1 -- 172.21.15.55:0/4242519762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4041070 con 0x7f01d4161ce0 2024-04-25T08:59:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01d17fa640 1 -- 172.21.15.55:0/4242519762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c403c460 con 0x7f01d4161ce0 2024-04-25T08:59:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01dadf5640 1 -- 172.21.15.55:0/4242519762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d415b7b0 con 0x7f01d4161ce0 2024-04-25T08:59:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01d17fa640 1 -- 172.21.15.55:0/4242519762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4037040 con 0x7f01d4161ce0 2024-04-25T08:59:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.516+0000 7f01dadf5640 1 -- 172.21.15.55:0/4242519762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d40cb020 con 0x7f01d4161ce0 2024-04-25T08:59:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.518+0000 7f01d17fa640 1 -- 172.21.15.55:0/4242519762 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f01c4044070 con 0x7f01d4161ce0 2024-04-25T08:59:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.518+0000 7f01d17fa640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01b406b500 0x7f01b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.519+0000 7f01d17fa640 1 -- 172.21.15.55:0/4242519762 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f01c40aa880 con 0x7f01d4161ce0 2024-04-25T08:59:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.519+0000 7f01d8b91640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01b406b500 0x7f01b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.519+0000 7f01d8b91640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01b406b500 0x7f01b406d9c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009fd0 tx=0x7f01cc00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.519+0000 7f01ddbd5740 1 Processor -- start 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.519+0000 7f01ddbd5740 1 -- start start 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf0d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf0aef0 0x5621aaf0d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaedd770 0x5621aaee0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621aae46da0 con 0x5621aaf0ab10 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621aadefb80 con 0x5621aaf0aef0 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621aae42e40 con 0x5621aaedd770 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01d8b91640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf0d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01d8b91640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf0d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46332/0 (socket says 172.21.15.55:46332) 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01d8b91640 1 -- 172.21.15.55:0/2276468388 learned_addr learned my addr 172.21.15.55:0/2276468388 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01d3fff640 1 --2- 172.21.15.55:0/2276468388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf0aef0 0x5621aaf0d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01d9392640 1 --2- 172.21.15.55:0/2276468388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaedd770 0x5621aaee0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01d8b91640 1 -- 172.21.15.55:0/2276468388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaedd770 msgr2=0x5621aaee0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01d8b91640 1 --2- 172.21.15.55:0/2276468388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaedd770 0x5621aaee0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01d8b91640 1 -- 172.21.15.55:0/2276468388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf0aef0 msgr2=0x5621aaf0d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01d8b91640 1 --2- 172.21.15.55:0/2276468388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf0aef0 0x5621aaf0d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01d8b91640 1 -- 172.21.15.55:0/2276468388 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621aadf9f10 con 0x5621aaf0ab10 2024-04-25T08:59:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.520+0000 7f01d8b91640 1 --2- 172.21.15.55:0/2276468388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf0d320 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0167f0 tx=0x7f01cc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b02d384810fb839 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ca7fc640 1 -- 172.21.15.55:0/2276468388 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc026070 con 0x5621aaf0ab10 2024-04-25T08:59:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ca7fc640 1 -- 172.21.15.55:0/2276468388 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc014b50 con 0x5621aaf0ab10 2024-04-25T08:59:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ca7fc640 1 -- 172.21.15.55:0/2276468388 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc021400 con 0x5621aaf0ab10 2024-04-25T08:59:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ddbd5740 1 -- 172.21.15.55:0/2276468388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 msgr2=0x5621aaf0d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/2276468388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf0d320 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0167f0 tx=0x7f01cc012000 comp rx=0 tx=0).stop 2024-04-25T08:59:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ddbd5740 1 -- 172.21.15.55:0/2276468388 shutdown_connections 2024-04-25T08:59:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/2276468388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaedd770 0x5621aaee0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/2276468388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf0aef0 0x5621aaf0d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/2276468388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf0d320 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ddbd5740 1 -- 172.21.15.55:0/2276468388 >> 172.21.15.55:0/2276468388 conn(0x5621aaedf9e0 msgr2=0x5621aaf28320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ddbd5740 1 -- 172.21.15.55:0/2276468388 shutdown_connections 2024-04-25T08:59:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.521+0000 7f01ddbd5740 1 -- 172.21.15.55:0/2276468388 wait complete. 2024-04-25T08:59:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.522+0000 7f01ddbd5740 1 -- start start 2024-04-25T08:59:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.522+0000 7f01ddbd5740 1 Processor -- start 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf0ab10 0x5621aaf019e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0aef0 0x5621aaf1f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf2ac30 0x5621aaf23db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621aaee2b90 con 0x5621aaf2ac30 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621aade54b0 con 0x5621aaf0ab10 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621aaee2e70 con 0x5621aaf0aef0 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01ddbd5740 10 client.0 _ll_register_callbacks cb 0x5621aae25180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01d9392640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf2ac30 0x5621aaf23db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01d9392640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf2ac30 0x5621aaf23db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46334/0 (socket says 172.21.15.55:46334) 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01d9392640 1 -- 172.21.15.55:0/1009079740 learned_addr learned my addr 172.21.15.55:0/1009079740 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01d3fff640 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0aef0 0x5621aaf1f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01d8b91640 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf0ab10 0x5621aaf019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01d9392640 1 -- 172.21.15.55:0/1009079740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0aef0 msgr2=0x5621aaf1f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01d9392640 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0aef0 0x5621aaf1f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01d9392640 1 -- 172.21.15.55:0/1009079740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf0ab10 msgr2=0x5621aaf019e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01d9392640 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf0ab10 0x5621aaf019e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.523+0000 7f01d9392640 1 -- 172.21.15.55:0/1009079740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621aac257d0 con 0x5621aaf2ac30 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01d9392640 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf2ac30 0x5621aaf23db0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f01c40097a0 tx=0x7f01c40796c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf8c59d4d096975 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01b37fe640 1 -- 172.21.15.55:0/1009079740 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4090020 con 0x5621aaf2ac30 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01b37fe640 1 -- 172.21.15.55:0/1009079740 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f01c407f2b0 con 0x5621aaf2ac30 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1009079740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01cc014b50 con 0x5621aaf2ac30 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01b37fe640 1 -- 172.21.15.55:0/1009079740 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01c404b040 con 0x5621aaf2ac30 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01ddbd5740 10 client.7680 fetch_fsmap learned FSMap version 57 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1009079740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x5621aab5b3f0 con 0x5621aaf2ac30 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01b37fe640 1 -- 172.21.15.55:0/1009079740 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc014b50 con 0x5621aaf2ac30 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01b37fe640 1 -- 172.21.15.55:0/1009079740 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 57) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f01c4081180 con 0x5621aaf2ac30 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01ddbd5740 10 client.7680 fetch_fsmap finished waiting for FSMap version 57 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01ddbd5740 10 client.7680 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01ddbd5740 20 client.7680 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5621aaf0cea0 0x5621aaf0d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01ddbd5740 4 client.7680 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1009079740 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621aae542e0 con 0x5621aaf0cea0 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.524+0000 7f01d8b91640 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5621aaf0cea0 0x5621aaf0d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01b37fe640 10 client.7680 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01d8b91640 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5621aaf0cea0 0x5621aaf0d280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=566f6c1e0089f9ee server_cookie=870b09ddaf3f8897 in_seq=0 out_seq=0 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01b37fe640 1 -- 172.21.15.55:0/1009079740 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5621aae542e0 con 0x5621aaf0cea0 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01b37fe640 10 client.7680 handle_command_reply: tid=0 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01ddbd5740 1 client.7680 shutdown 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1009079740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf2ac30 msgr2=0x5621aaf23db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf2ac30 0x5621aaf23db0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f01c40097a0 tx=0x7f01c40796c0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1009079740 shutdown_connections 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5621aaf0cea0 0x5621aaf0d280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf2ac30 0x5621aaf23db0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0aef0 0x5621aaf1f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01b37fe640 0 client.7680 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/1009079740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf0ab10 0x5621aaf019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.525+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1009079740 >> 172.21.15.55:0/1009079740 conn(0x5621aaedd770 msgr2=0x5621aaee22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.526+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1009079740 shutdown_connections 2024-04-25T08:59:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.526+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1009079740 wait complete. 2024-04-25T08:59:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.526+0000 7f01ddbd5740 20 client.7680 trim_cache size 0 max 16384 2024-04-25T08:59:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.541+0000 7f01ddbd5740 1 Processor -- start 2024-04-25T08:59:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.541+0000 7f01ddbd5740 1 -- start start 2024-04-25T08:59:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf21a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0aef0 0x5621aaf4ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf2ac30 0x5621aaee0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621aaf22780 con 0x5621aaf0ab10 2024-04-25T08:59:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41ffe10 con 0x5621aaf2ac30 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4145b10 con 0x5621aaf0aef0 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01d8b91640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf21a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01d8b91640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf21a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46342/0 (socket says 172.21.15.55:46342) 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01d8b91640 1 -- 172.21.15.55:0/1137196585 learned_addr learned my addr 172.21.15.55:0/1137196585 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01d8b91640 1 -- 172.21.15.55:0/1137196585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0aef0 msgr2=0x5621aaf4ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01d8b91640 1 --2- 172.21.15.55:0/1137196585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0aef0 0x5621aaf4ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01d8b91640 1 -- 172.21.15.55:0/1137196585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf2ac30 msgr2=0x5621aaee0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01d8b91640 1 --2- 172.21.15.55:0/1137196585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf2ac30 0x5621aaee0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01d8b91640 1 -- 172.21.15.55:0/1137196585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621aab1b0f0 con 0x5621aaf0ab10 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01d8b91640 1 --2- 172.21.15.55:0/1137196585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf21a60 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f01cc024040 tx=0x7f01cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ccb996a629035c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01c9ffb640 1 -- 172.21.15.55:0/1137196585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc026040 con 0x5621aaf0ab10 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01c9ffb640 1 -- 172.21.15.55:0/1137196585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc014b10 con 0x5621aaf0ab10 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.542+0000 7f01c9ffb640 1 -- 172.21.15.55:0/1137196585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc038420 con 0x5621aaf0ab10 2024-04-25T08:59:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.543+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1137196585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 msgr2=0x5621aaf21a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.543+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/1137196585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf21a60 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f01cc024040 tx=0x7f01cc014000 comp rx=0 tx=0).stop 2024-04-25T08:59:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.543+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1137196585 shutdown_connections 2024-04-25T08:59:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.543+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/1137196585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf2ac30 0x5621aaee0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.543+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/1137196585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0aef0 0x5621aaf4ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.543+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/1137196585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0ab10 0x5621aaf21a60 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.543+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1137196585 >> 172.21.15.55:0/1137196585 conn(0x5621aaedd770 msgr2=0x5621aaf017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.543+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1137196585 shutdown_connections 2024-04-25T08:59:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.543+0000 7f01ddbd5740 1 -- 172.21.15.55:0/1137196585 wait complete. 2024-04-25T08:59:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.543+0000 7f01ddbd5740 1 -- start start 2024-04-25T08:59:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.544+0000 7f01ddbd5740 1 Processor -- start 2024-04-25T08:59:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.544+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0ab10 0x5621aaee1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.544+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0aef0 0x5621aaf3a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.544+0000 7f01ddbd5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf2ac30 0x5621aaf3ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.544+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4145510 con 0x5621aaf0aef0 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.544+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4144f10 con 0x5621aaf2ac30 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.544+0000 7f01ddbd5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621aaede610 con 0x5621aaf0ab10 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.544+0000 7f01ddbd5740 10 client.0 _ll_register_callbacks cb 0x7f01cc009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0aef0 0x5621aaf3a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0aef0 0x5621aaf3a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46354/0 (socket says 172.21.15.55:46354) 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01d3fff640 1 -- 172.21.15.55:0/3214366091 learned_addr learned my addr 172.21.15.55:0/3214366091 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01d3fff640 1 -- 172.21.15.55:0/3214366091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0ab10 msgr2=0x5621aaee1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01d3fff640 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0ab10 0x5621aaee1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01d9392640 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf2ac30 0x5621aaf3ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01d3fff640 1 -- 172.21.15.55:0/3214366091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf2ac30 msgr2=0x5621aaf3ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:59:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01d3fff640 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf2ac30 0x5621aaf3ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01d3fff640 1 -- 172.21.15.55:0/3214366091 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621aaee17c0 con 0x5621aaf0aef0 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01d3fff640 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0aef0 0x5621aaf3a640 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f01bc007840 tx=0x7f01bc013700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2a71699c4ec7a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01b37fe640 1 -- 172.21.15.55:0/3214366091 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc019070 con 0x5621aaf0aef0 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01b37fe640 1 -- 172.21.15.55:0/3214366091 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f01bc01a920 con 0x5621aaf0aef0 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01ddbd5740 1 -- 172.21.15.55:0/3214366091 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01cc014b10 con 0x5621aaf0aef0 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01b37fe640 1 -- 172.21.15.55:0/3214366091 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01bc025050 con 0x5621aaf0aef0 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01ddbd5740 10 client.7686 fetch_fsmap learned FSMap version 57 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01ddbd5740 1 -- 172.21.15.55:0/3214366091 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x5621aaf2a320 con 0x5621aaf0aef0 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.545+0000 7f01b37fe640 1 -- 172.21.15.55:0/3214366091 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc014b10 con 0x5621aaf0aef0 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01b37fe640 1 -- 172.21.15.55:0/3214366091 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 57) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f01bc028020 con 0x5621aaf0aef0 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01ddbd5740 10 client.7686 fetch_fsmap finished waiting for FSMap version 57 2024-04-25T08:59:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01ddbd5740 10 client.7686 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01ddbd5740 20 client.7686 populate_metadata read hostname 'smithi055' 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5621aaf2a780 0x5621aaf1fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01ddbd5740 4 client.7686 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01ddbd5740 1 -- 172.21.15.55:0/3214366091 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5621aae4e630 con 0x5621aaf2a780 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01d8b91640 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5621aaf2a780 0x5621aaf1fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01b37fe640 10 client.7686 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01d8b91640 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5621aaf2a780 0x5621aaf1fb70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b11a40722093b9ce server_cookie=38df9b44dd17ee95 in_seq=0 out_seq=0 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01b37fe640 1 -- 172.21.15.55:0/3214366091 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+256 (crc 0 0 0) 0x5621aae4e630 con 0x5621aaf2a780 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01b37fe640 10 client.7686 handle_command_reply: tid=0 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01ddbd5740 1 client.7686 shutdown 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01ddbd5740 1 -- 172.21.15.55:0/3214366091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0aef0 msgr2=0x5621aaf3a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0aef0 0x5621aaf3a640 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f01bc007840 tx=0x7f01bc013700 comp rx=0 tx=0).stop 2024-04-25T08:59:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01ddbd5740 1 -- 172.21.15.55:0/3214366091 shutdown_connections 2024-04-25T08:59:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.546+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5621aaf2a780 0x5621aaf1fb70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621aaf2ac30 0x5621aaf3ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621aaf0aef0 0x5621aaf3a640 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01b37fe640 0 client.7686 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T08:59:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01ddbd5740 1 --2- 172.21.15.55:0/3214366091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5621aaf0ab10 0x5621aaee1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01ddbd5740 1 -- 172.21.15.55:0/3214366091 >> 172.21.15.55:0/3214366091 conn(0x5621aaedd770 msgr2=0x5621aaf4ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01ddbd5740 1 -- 172.21.15.55:0/3214366091 shutdown_connections 2024-04-25T08:59:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01ddbd5740 1 -- 172.21.15.55:0/3214366091 wait complete. 2024-04-25T08:59:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01ddbd5740 20 client.7686 trim_cache size 0 max 16384 2024-04-25T08:59:53.543 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T08:59:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:59:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-25T08:59:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "d6fb55a8-1c0c-4e9d-8c07-4a7551c22e34": { 2024-04-25T08:59:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir", 2024-04-25T08:59:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "d6fb55a8-1c0c-4e9d-8c07-4a7551c22e34", 2024-04-25T08:59:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive" 2024-04-25T08:59:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T08:59:53.544 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T08:59:53.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 -- 172.21.15.55:0/4242519762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01b406b500 msgr2=0x7f01b406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01b406b500 0x7f01b406d9c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009fd0 tx=0x7f01cc00b040 comp rx=0 tx=0).stop 2024-04-25T08:59:53.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 -- 172.21.15.55:0/4242519762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d4161ce0 msgr2=0x7f01d40b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:59:53.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d4161ce0 0x7f01d40b42e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f01c4035040 tx=0x7f01c40046c0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 -- 172.21.15.55:0/4242519762 shutdown_connections 2024-04-25T08:59:53.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01b406b500 0x7f01b406d9c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d4161ce0 0x7f01d40b42e0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01d4161120 0x7f01d40b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 --2- 172.21.15.55:0/4242519762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01d40b5c60 0x7f01d4142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:59:53.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 -- 172.21.15.55:0/4242519762 >> 172.21.15.55:0/4242519762 conn(0x7f01d40d0550 msgr2=0x7f01d415a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:59:53.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 -- 172.21.15.55:0/4242519762 shutdown_connections 2024-04-25T08:59:53.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T08:59:53.547+0000 7f01dadf5640 1 -- 172.21.15.55:0/4242519762 wait complete. 2024-04-25T08:59:53.547 INFO:tasks.cephfs.filesystem:scrub status for tag:d6fb55a8-1c0c-4e9d-8c07-4a7551c22e34 - {'path': '/dir', 'tag': 'd6fb55a8-1c0c-4e9d-8c07-4a7551c22e34', 'options': 'recursive'} 2024-04-25T08:59:57.734 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T08:59:57.745+0000 7f7581a89640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T08:59:59.988 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T08:59:59.999+0000 7f7581a89640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2024-04-25T09:00:10.534 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:10.537 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:23.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:23.548 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:00:23.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.674+0000 7f9772a1c640 1 Processor -- start 2024-04-25T09:00:23.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.674+0000 7f9772a1c640 1 -- start start 2024-04-25T09:00:23.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.675+0000 7f9772a1c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976c0b5550 0x7f976c0b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.675+0000 7f9772a1c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f976c0d2560 0x7f976c0d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.675+0000 7f9772a1c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c161500 con 0x7f976c161120 2024-04-25T09:00:23.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.675+0000 7f9772a1c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c0b5ef0 con 0x7f976c0d2560 2024-04-25T09:00:23.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.675+0000 7f9772a1c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c162740 con 0x7f976c0b5550 2024-04-25T09:00:23.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.675+0000 7f9770fb9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f976c0d2560 0x7f976c0d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.675+0000 7f9770fb9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f976c0d2560 0x7f976c0d29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37328/0 (socket says 172.21.15.55:37328) 2024-04-25T09:00:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.675+0000 7f9770fb9640 1 -- 172.21.15.55:0/2187643422 learned_addr learned my addr 172.21.15.55:0/2187643422 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.676+0000 7f976b7fe640 1 --2- 172.21.15.55:0/2187643422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976c0b5550 0x7f976c0b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.676+0000 7f9770fb9640 1 -- 172.21.15.55:0/2187643422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976c0b5550 msgr2=0x7f976c0b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.676+0000 7f9770fb9640 1 --2- 172.21.15.55:0/2187643422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976c0b5550 0x7f976c0b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.676+0000 7f9770fb9640 1 -- 172.21.15.55:0/2187643422 >> v1:172.21.15.167:6789/0 conn(0x7f976c161120 legacy=0x7f976c1617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.676+0000 7f9770fb9640 1 -- 172.21.15.55:0/2187643422 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c161eb0 con 0x7f976c0d2560 2024-04-25T09:00:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.676+0000 7f976b7fe640 1 --2- 172.21.15.55:0/2187643422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976c0b5550 0x7f976c0b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.676+0000 7f9770fb9640 1 --2- 172.21.15.55:0/2187643422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976c0d2560 0x7f976c0d29f0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f976c1628c0 tx=0x7f976402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2eddadc0fc8d45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.677+0000 7f976affd640 1 -- 172.21.15.55:0/2187643422 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764036070 con 0x7f976c0d2560 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.677+0000 7f976affd640 1 -- 172.21.15.55:0/2187643422 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764031600 con 0x7f976c0d2560 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.677+0000 7f976affd640 1 -- 172.21.15.55:0/2187643422 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640319d0 con 0x7f976c0d2560 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.677+0000 7f9772a1c640 1 -- 172.21.15.55:0/2187643422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976c0d2560 msgr2=0x7f976c0d29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.677+0000 7f9772a1c640 1 --2- 172.21.15.55:0/2187643422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976c0d2560 0x7f976c0d29f0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f976c1628c0 tx=0x7f976402a680 comp rx=0 tx=0).stop 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.677+0000 7f9772a1c640 1 -- 172.21.15.55:0/2187643422 shutdown_connections 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.677+0000 7f9772a1c640 1 --2- 172.21.15.55:0/2187643422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976c0d2560 0x7f976c0d29f0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.677+0000 7f9772a1c640 1 --2- 172.21.15.55:0/2187643422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976c0b5550 0x7f976c0b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.677+0000 7f9772a1c640 1 -- 172.21.15.55:0/2187643422 >> 172.21.15.55:0/2187643422 conn(0x7f976c0d0550 msgr2=0x7f976c0d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.677+0000 7f9772a1c640 1 -- 172.21.15.55:0/2187643422 shutdown_connections 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.677+0000 7f9772a1c640 1 -- 172.21.15.55:0/2187643422 wait complete. 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.679+0000 7f9772a1c640 1 Processor -- start 2024-04-25T09:00:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.679+0000 7f9772a1c640 1 -- start start 2024-04-25T09:00:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.679+0000 7f9772a1c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f976c0b5550 0x7f976c155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f9772a1c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976c0d2560 0x7f976c152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f9772a1c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976c161120 0x7f976c159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f9772a1c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0d1d60 con 0x7f976c0d2560 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f9772a1c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c162460 con 0x7f976c0b5550 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f9772a1c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0d2040 con 0x7f976c161120 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f976b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976c0d2560 0x7f976c152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f976b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976c0d2560 0x7f976c152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37340/0 (socket says 172.21.15.55:37340) 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f976b7fe640 1 -- 172.21.15.55:0/116333335 learned_addr learned my addr 172.21.15.55:0/116333335 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f9770fb9640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976c161120 0x7f976c159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f976bfff640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f976c0b5550 0x7f976c155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f976b7fe640 1 -- 172.21.15.55:0/116333335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976c161120 msgr2=0x7f976c159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f976b7fe640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976c161120 0x7f976c159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f976b7fe640 1 -- 172.21.15.55:0/116333335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f976c0b5550 msgr2=0x7f976c155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f976b7fe640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f976c0b5550 0x7f976c155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f976b7fe640 1 -- 172.21.15.55:0/116333335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c153fb0 con 0x7f976c0d2560 2024-04-25T09:00:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f976b7fe640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976c0d2560 0x7f976c152ed0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f976000e7e0 tx=0x7f976000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:23.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f9768ff9640 1 -- 172.21.15.55:0/116333335 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000f040 con 0x7f976c0d2560 2024-04-25T09:00:23.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f9768ff9640 1 -- 172.21.15.55:0/116333335 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9760004030 con 0x7f976c0d2560 2024-04-25T09:00:23.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f9772a1c640 1 -- 172.21.15.55:0/116333335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c154290 con 0x7f976c0d2560 2024-04-25T09:00:23.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f9768ff9640 1 -- 172.21.15.55:0/116333335 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760004400 con 0x7f976c0d2560 2024-04-25T09:00:23.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.680+0000 7f9772a1c640 1 -- 172.21.15.55:0/116333335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c154850 con 0x7f976c0d2560 2024-04-25T09:00:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.682+0000 7f9768ff9640 1 -- 172.21.15.55:0/116333335 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f976000c6d0 con 0x7f976c0d2560 2024-04-25T09:00:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.682+0000 7f9768ff9640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f975806b520 0x7f975806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.683+0000 7f9768ff9640 1 -- 172.21.15.55:0/116333335 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9760089fa0 con 0x7f976c0d2560 2024-04-25T09:00:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.683+0000 7f976bfff640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f975806b520 0x7f975806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.683+0000 7f976bfff640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f975806b520 0x7f975806d9e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f976c0b5430 tx=0x7f975c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.684+0000 7f97757f6740 1 Processor -- start 2024-04-25T09:00:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.684+0000 7f97757f6740 1 -- start start 2024-04-25T09:00:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.684+0000 7f97757f6740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af7cb10 0x55e96af7f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.684+0000 7f97757f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cef0 0x55e96af7f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.684+0000 7f97757f6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af4f770 0x55e96af52f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.684+0000 7f97757f6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e96aeb8da0 con 0x55e96af4f770 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.684+0000 7f97757f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e96ae61b80 con 0x55e96af7cef0 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.684+0000 7f97757f6740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e96aeb4e40 con 0x55e96af7cb10 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.684+0000 7f9770fb9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af4f770 0x55e96af52f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.684+0000 7f9770fb9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af4f770 0x55e96af52f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37352/0 (socket says 172.21.15.55:37352) 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.684+0000 7f9770fb9640 1 -- 172.21.15.55:0/2988262925 learned_addr learned my addr 172.21.15.55:0/2988262925 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f976bfff640 1 --2- 172.21.15.55:0/2988262925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af7cb10 0x55e96af7f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f976b7fe640 1 --2- 172.21.15.55:0/2988262925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cef0 0x55e96af7f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f9770fb9640 1 -- 172.21.15.55:0/2988262925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af7cb10 msgr2=0x55e96af7f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f9770fb9640 1 --2- 172.21.15.55:0/2988262925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af7cb10 0x55e96af7f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f9770fb9640 1 -- 172.21.15.55:0/2988262925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cef0 msgr2=0x55e96af7f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f9770fb9640 1 --2- 172.21.15.55:0/2988262925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cef0 0x55e96af7f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f9770fb9640 1 -- 172.21.15.55:0/2988262925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e96ae6bf10 con 0x55e96af4f770 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f976b7fe640 1 --2- 172.21.15.55:0/2988262925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cef0 0x55e96af7f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f9770fb9640 1 --2- 172.21.15.55:0/2988262925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af4f770 0x55e96af52f80 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f976402a6c0 tx=0x7f976402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a352f071a7064a07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f9751ffb640 1 -- 172.21.15.55:0/2988262925 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764042070 con 0x55e96af4f770 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f9751ffb640 1 -- 172.21.15.55:0/2988262925 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764037040 con 0x55e96af4f770 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.685+0000 7f9751ffb640 1 -- 172.21.15.55:0/2988262925 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764036040 con 0x55e96af4f770 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.686+0000 7f97757f6740 1 -- 172.21.15.55:0/2988262925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af4f770 msgr2=0x55e96af52f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.686+0000 7f97757f6740 1 --2- 172.21.15.55:0/2988262925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af4f770 0x55e96af52f80 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f976402a6c0 tx=0x7f976402e000 comp rx=0 tx=0).stop 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.686+0000 7f97757f6740 1 -- 172.21.15.55:0/2988262925 shutdown_connections 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.686+0000 7f97757f6740 1 --2- 172.21.15.55:0/2988262925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af4f770 0x55e96af52f80 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.686+0000 7f97757f6740 1 --2- 172.21.15.55:0/2988262925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cef0 0x55e96af7f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.686+0000 7f97757f6740 1 --2- 172.21.15.55:0/2988262925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af7cb10 0x55e96af7f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.686+0000 7f97757f6740 1 -- 172.21.15.55:0/2988262925 >> 172.21.15.55:0/2988262925 conn(0x55e96af519e0 msgr2=0x55e96af9a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.686+0000 7f97757f6740 1 -- 172.21.15.55:0/2988262925 shutdown_connections 2024-04-25T09:00:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.686+0000 7f97757f6740 1 -- 172.21.15.55:0/2988262925 wait complete. 2024-04-25T09:00:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.686+0000 7f97757f6740 1 -- start start 2024-04-25T09:00:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.687+0000 7f97757f6740 1 Processor -- start 2024-04-25T09:00:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.687+0000 7f97757f6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cb10 0x55e96af726c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.687+0000 7f97757f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cef0 0x55e96af9d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.687+0000 7f97757f6740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96af7b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.687+0000 7f97757f6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e96af54b90 con 0x55e96af7cb10 2024-04-25T09:00:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.687+0000 7f97757f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e96ae574b0 con 0x55e96af7cef0 2024-04-25T09:00:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.687+0000 7f97757f6740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e96af54e70 con 0x55e96af77c10 2024-04-25T09:00:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f97757f6740 10 client.0 _ll_register_callbacks cb 0x55e96ae97180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f976bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cb10 0x55e96af726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f976bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cb10 0x55e96af726c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37356/0 (socket says 172.21.15.55:37356) 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f976bfff640 1 -- 172.21.15.55:0/3585487884 learned_addr learned my addr 172.21.15.55:0/3585487884 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f976b7fe640 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cef0 0x55e96af9d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f9770fb9640 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96af7b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f976bfff640 1 -- 172.21.15.55:0/3585487884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 msgr2=0x55e96af7b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f976bfff640 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96af7b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f976bfff640 1 -- 172.21.15.55:0/3585487884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cef0 msgr2=0x55e96af9d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f976bfff640 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cef0 0x55e96af9d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f976bfff640 1 -- 172.21.15.55:0/3585487884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e96ac977d0 con 0x55e96af7cb10 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f976bfff640 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cb10 0x55e96af726c0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f975c014730 tx=0x7f975c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69b89cde07e0ea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f974affd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f974affd640 1 -- 172.21.15.55:0/3585487884 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c025020 con 0x55e96af7cb10 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f974affd640 1 -- 172.21.15.55:0/3585487884 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f975c0136b0 con 0x55e96af7cb10 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.688+0000 7f97757f6740 1 -- 172.21.15.55:0/3585487884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9764037040 con 0x55e96af7cb10 2024-04-25T09:00:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f974affd640 1 -- 172.21.15.55:0/3585487884 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f975c02f050 con 0x55e96af7cb10 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f97757f6740 10 client.7698 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f97757f6740 1 -- 172.21.15.55:0/3585487884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55e96abcd3f0 con 0x55e96af7cb10 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f974affd640 1 -- 172.21.15.55:0/3585487884 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764037040 con 0x55e96af7cb10 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f974affd640 1 -- 172.21.15.55:0/3585487884 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f975c032020 con 0x55e96af7cb10 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f97757f6740 10 client.7698 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f97757f6740 10 client.7698 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f97757f6740 20 client.7698 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f97757f6740 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x55e96af770c0 0x55e96af9b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f97757f6740 4 client.7698 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f97757f6740 1 -- 172.21.15.55:0/3585487884 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e96aec62e0 con 0x55e96af770c0 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f976b7fe640 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x55e96af770c0 0x55e96af9b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f974affd640 10 client.7698 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.689+0000 7f976b7fe640 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x55e96af770c0 0x55e96af9b450 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b7613c31c3f814e server_cookie=dbe0f740ad912dd2 in_seq=0 out_seq=0 2024-04-25T09:00:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f974affd640 1 -- 172.21.15.55:0/3585487884 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e96aec62e0 con 0x55e96af770c0 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f974affd640 10 client.7698 handle_command_reply: tid=0 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 1 client.7698 shutdown 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 1 -- 172.21.15.55:0/3585487884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cb10 msgr2=0x55e96af726c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cb10 0x55e96af726c0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f975c014730 tx=0x7f975c000ed0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 1 -- 172.21.15.55:0/3585487884 shutdown_connections 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x55e96af770c0 0x55e96af9b450 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96af7b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cef0 0x55e96af9d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 1 --2- 172.21.15.55:0/3585487884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cb10 0x55e96af726c0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 1 -- 172.21.15.55:0/3585487884 >> 172.21.15.55:0/3585487884 conn(0x55e96af4f770 msgr2=0x55e96af542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f974affd640 0 client.7698 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 1 -- 172.21.15.55:0/3585487884 shutdown_connections 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 1 -- 172.21.15.55:0/3585487884 wait complete. 2024-04-25T09:00:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.690+0000 7f97757f6740 20 client.7698 trim_cache size 0 max 16384 2024-04-25T09:00:23.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.706+0000 7f97757f6740 1 Processor -- start 2024-04-25T09:00:23.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.706+0000 7f97757f6740 1 -- start start 2024-04-25T09:00:23.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.706+0000 7f97757f6740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96af78520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.706+0000 7f97757f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 0x55e96afbceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.706+0000 7f97757f6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af4ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.706+0000 7f97757f6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c1ffd20 con 0x55e96af7cef0 2024-04-25T09:00:23.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.706+0000 7f97757f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c159000 con 0x55e96af7cb10 2024-04-25T09:00:23.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.706+0000 7f97757f6740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c158430 con 0x55e96af77c10 2024-04-25T09:00:23.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.706+0000 7f9770fb9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af4ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.706+0000 7f9770fb9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af4ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37368/0 (socket says 172.21.15.55:37368) 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.706+0000 7f9770fb9640 1 -- 172.21.15.55:0/1131660893 learned_addr learned my addr 172.21.15.55:0/1131660893 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f976b7fe640 1 --2- 172.21.15.55:0/1131660893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 0x55e96afbceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f9770fb9640 1 -- 172.21.15.55:0/1131660893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 msgr2=0x55e96af78520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f976bfff640 1 --2- 172.21.15.55:0/1131660893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96af78520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f9770fb9640 1 --2- 172.21.15.55:0/1131660893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96af78520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f9770fb9640 1 -- 172.21.15.55:0/1131660893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 msgr2=0x55e96afbceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f9770fb9640 1 --2- 172.21.15.55:0/1131660893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 0x55e96afbceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f9770fb9640 1 -- 172.21.15.55:0/1131660893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e96ab8d0f0 con 0x55e96af7cef0 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f976b7fe640 1 --2- 172.21.15.55:0/1131660893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 0x55e96afbceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f9770fb9640 1 --2- 172.21.15.55:0/1131660893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af4ff40 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f976402ac70 tx=0x7f976402f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de401ec00e48d99c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f97517fa640 1 -- 172.21.15.55:0/1131660893 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764036070 con 0x55e96af7cef0 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f97517fa640 1 -- 172.21.15.55:0/1131660893 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976404b070 con 0x55e96af7cef0 2024-04-25T09:00:23.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.707+0000 7f97517fa640 1 -- 172.21.15.55:0/1131660893 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764042040 con 0x55e96af7cef0 2024-04-25T09:00:23.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.708+0000 7f97757f6740 1 -- 172.21.15.55:0/1131660893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 msgr2=0x55e96af4ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.708+0000 7f97757f6740 1 --2- 172.21.15.55:0/1131660893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af4ff40 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f976402ac70 tx=0x7f976402f000 comp rx=0 tx=0).stop 2024-04-25T09:00:23.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.708+0000 7f97757f6740 1 -- 172.21.15.55:0/1131660893 shutdown_connections 2024-04-25T09:00:23.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.708+0000 7f97757f6740 1 --2- 172.21.15.55:0/1131660893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af4ff40 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.708+0000 7f97757f6740 1 --2- 172.21.15.55:0/1131660893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 0x55e96afbceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.708+0000 7f97757f6740 1 --2- 172.21.15.55:0/1131660893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96af78520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.708+0000 7f97757f6740 1 -- 172.21.15.55:0/1131660893 >> 172.21.15.55:0/1131660893 conn(0x55e96af4f770 msgr2=0x55e96af4ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:23.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.708+0000 7f97757f6740 1 -- 172.21.15.55:0/1131660893 shutdown_connections 2024-04-25T09:00:23.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.708+0000 7f97757f6740 1 -- 172.21.15.55:0/1131660893 wait complete. 2024-04-25T09:00:23.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.708+0000 7f97757f6740 1 -- start start 2024-04-25T09:00:23.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.709+0000 7f97757f6740 1 Processor -- start 2024-04-25T09:00:23.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.709+0000 7f97757f6740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96b0045c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.709+0000 7f97757f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 0x55e96af4ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.709+0000 7f97757f6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af50480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.709+0000 7f97757f6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c158a00 con 0x55e96af7cef0 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.709+0000 7f97757f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e96af7c100 con 0x55e96af7cb10 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.709+0000 7f97757f6740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e96af715a0 con 0x55e96af77c10 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.709+0000 7f97757f6740 10 client.0 _ll_register_callbacks cb 0x7f9764009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.709+0000 7f9770fb9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af50480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f9770fb9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af50480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37372/0 (socket says 172.21.15.55:37372) 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f9770fb9640 1 -- 172.21.15.55:0/294531882 learned_addr learned my addr 172.21.15.55:0/294531882 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f976b7fe640 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 0x55e96af4ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f976bfff640 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96b0045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f9770fb9640 1 -- 172.21.15.55:0/294531882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 msgr2=0x55e96b0045c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f9770fb9640 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96b0045c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f9770fb9640 1 -- 172.21.15.55:0/294531882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 msgr2=0x55e96af4ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f9770fb9640 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 0x55e96af4ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f9770fb9640 1 -- 172.21.15.55:0/294531882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e96af4ee40 con 0x55e96af7cef0 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f976b7fe640 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 0x55e96af4ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f9770fb9640 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af50480 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9764009f10 tx=0x7f9764004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9726e7ba9abb97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f974affd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f974affd640 1 -- 172.21.15.55:0/294531882 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764036040 con 0x55e96af7cef0 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f974affd640 1 -- 172.21.15.55:0/294531882 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f976404f420 con 0x55e96af7cef0 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f97757f6740 1 -- 172.21.15.55:0/294531882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f976404b070 con 0x55e96af7cef0 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f974affd640 1 -- 172.21.15.55:0/294531882 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f976405e050 con 0x55e96af7cef0 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f97757f6740 10 client.7704 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.710+0000 7f97757f6740 1 -- 172.21.15.55:0/294531882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55e96af71740 con 0x55e96af7cef0 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f974affd640 1 -- 172.21.15.55:0/294531882 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976404b070 con 0x55e96af7cef0 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f974affd640 1 -- 172.21.15.55:0/294531882 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9764061020 con 0x55e96af7cef0 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f97757f6740 10 client.7704 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f97757f6740 10 client.7704 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f97757f6740 20 client.7704 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f97757f6740 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x55e96afb3010 0x55e96afb33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f97757f6740 4 client.7704 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f97757f6740 1 -- 172.21.15.55:0/294531882 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e96aec0630 con 0x55e96afb3010 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f976bfff640 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x55e96afb3010 0x55e96afb33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f974affd640 10 client.7704 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f976bfff640 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x55e96afb3010 0x55e96afb33f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24c675782f7b05b5 server_cookie=f102e05123a213c4 in_seq=0 out_seq=0 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f974affd640 1 -- 172.21.15.55:0/294531882 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e96aec0630 con 0x55e96afb3010 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f974affd640 10 client.7704 handle_command_reply: tid=0 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f97757f6740 1 client.7704 shutdown 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f97757f6740 1 -- 172.21.15.55:0/294531882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 msgr2=0x55e96af50480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f97757f6740 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af50480 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9764009f10 tx=0x7f9764004ab0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.711+0000 7f97757f6740 1 -- 172.21.15.55:0/294531882 shutdown_connections 2024-04-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f97757f6740 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x55e96afb3010 0x55e96afb33f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f97757f6740 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e96af7cef0 0x55e96af50480 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f97757f6740 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e96af7cb10 0x55e96af4ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f974affd640 0 client.7704 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f97757f6740 1 --2- 172.21.15.55:0/294531882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e96af77c10 0x55e96b0045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f97757f6740 1 -- 172.21.15.55:0/294531882 >> 172.21.15.55:0/294531882 conn(0x55e96af4f770 msgr2=0x55e96af4e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f97757f6740 1 -- 172.21.15.55:0/294531882 shutdown_connections 2024-04-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f97757f6740 1 -- 172.21.15.55:0/294531882 wait complete. 2024-04-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f97757f6740 20 client.7704 trim_cache size 0 max 16384 2024-04-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:00:23.707 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-25T09:00:23.708 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-25T09:00:23.708 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 -- 172.21.15.55:0/116333335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f975806b520 msgr2=0x7f975806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f975806b520 0x7f975806d9e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f976c0b5430 tx=0x7f975c009040 comp rx=0 tx=0).stop 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 -- 172.21.15.55:0/116333335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976c0d2560 msgr2=0x7f976c152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976c0d2560 0x7f976c152ed0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f976000e7e0 tx=0x7f976000eca0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 -- 172.21.15.55:0/116333335 shutdown_connections 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f975806b520 0x7f975806d9e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f976c161120 0x7f976c159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976c0d2560 0x7f976c152ed0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 --2- 172.21.15.55:0/116333335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f976c0b5550 0x7f976c155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 -- 172.21.15.55:0/116333335 >> 172.21.15.55:0/116333335 conn(0x7f976c0d0550 msgr2=0x7f976c155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 -- 172.21.15.55:0/116333335 shutdown_connections 2024-04-25T09:00:23.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.712+0000 7f9772a1c640 1 -- 172.21.15.55:0/116333335 wait complete. 2024-04-25T09:00:23.712 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:00:23.712 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.825+0000 7f250805d640 1 Processor -- start 2024-04-25T09:00:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.825+0000 7f250805d640 1 -- start start 2024-04-25T09:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.826+0000 7f250805d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25000ae9a0 0x7f25000b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.826+0000 7f250805d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250006d550 con 0x7f2500071190 2024-04-25T09:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.826+0000 7f250805d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250006d830 con 0x7f25000b2c60 2024-04-25T09:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.826+0000 7f250805d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250006db10 con 0x7f25000ae9a0 2024-04-25T09:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.826+0000 7f25055f8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25000ae9a0 0x7f25000b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.826+0000 7f2505df9640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2500071190 0x7f2500071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48174/0 (socket says 172.21.15.55:48174) 2024-04-25T09:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.826+0000 7f2505df9640 1 -- 172.21.15.55:0/2990656514 learned_addr learned my addr 172.21.15.55:0/2990656514 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.826+0000 7f25055f8640 1 -- 172.21.15.55:0/2990656514 >> v1:172.21.15.167:6789/0 conn(0x7f25000b2c60 legacy=0x7f25000b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.826+0000 7f25055f8640 1 -- 172.21.15.55:0/2990656514 >> v1:172.21.15.55:6789/0 conn(0x7f2500071190 legacy=0x7f2500071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.826+0000 7f25055f8640 1 -- 172.21.15.55:0/2990656514 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250006ddf0 con 0x7f25000ae9a0 2024-04-25T09:00:23.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.826+0000 7f2504df7640 1 -- 172.21.15.55:0/2990656514 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893848278 0 0) 0x7f250006d550 con 0x7f2500071190 2024-04-25T09:00:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.827+0000 7f25055f8640 1 --2- 172.21.15.55:0/2990656514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25000ae9a0 0x7f25000b2720 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f24f00097d0 tx=0x7f24f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c894cf612125f346 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.827+0000 7f2504df7640 1 -- 172.21.15.55:0/2990656514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0037070 con 0x7f25000ae9a0 2024-04-25T09:00:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.827+0000 7f2504df7640 1 -- 172.21.15.55:0/2990656514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f0032440 con 0x7f25000ae9a0 2024-04-25T09:00:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.827+0000 7f2504df7640 1 -- 172.21.15.55:0/2990656514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0032810 con 0x7f25000ae9a0 2024-04-25T09:00:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.828+0000 7f250805d640 1 -- 172.21.15.55:0/2990656514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25000ae9a0 msgr2=0x7f25000b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.828+0000 7f250805d640 1 --2- 172.21.15.55:0/2990656514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25000ae9a0 0x7f25000b2720 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f24f00097d0 tx=0x7f24f002a270 comp rx=0 tx=0).stop 2024-04-25T09:00:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.828+0000 7f250805d640 1 -- 172.21.15.55:0/2990656514 shutdown_connections 2024-04-25T09:00:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.828+0000 7f250805d640 1 --2- 172.21.15.55:0/2990656514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25000ae9a0 0x7f25000b2720 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.828+0000 7f250805d640 1 -- 172.21.15.55:0/2990656514 >> 172.21.15.55:0/2990656514 conn(0x7f250006aba0 msgr2=0x7f250006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.828+0000 7f250805d640 1 -- 172.21.15.55:0/2990656514 shutdown_connections 2024-04-25T09:00:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.828+0000 7f250805d640 1 -- 172.21.15.55:0/2990656514 wait complete. 2024-04-25T09:00:23.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.829+0000 7f250805d640 1 Processor -- start 2024-04-25T09:00:23.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.829+0000 7f250805d640 1 -- start start 2024-04-25T09:00:23.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f250805d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2500071190 0x7f2500150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f250805d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25000ae9a0 0x7f25001f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f250805d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25000b2c60 0x7f25000b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f250805d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250006e8b0 con 0x7f25000b2c60 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f250805d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000aee30 con 0x7f25000ae9a0 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f250805d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250006d1b0 con 0x7f2500071190 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f25065fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25000b2c60 0x7f25000b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f25065fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25000b2c60 0x7f25000b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37390/0 (socket says 172.21.15.55:37390) 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f25065fa640 1 -- 172.21.15.55:0/3893868063 learned_addr learned my addr 172.21.15.55:0/3893868063 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f2505df9640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2500071190 0x7f2500150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f25055f8640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25000ae9a0 0x7f25001f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f25065fa640 1 -- 172.21.15.55:0/3893868063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2500071190 msgr2=0x7f2500150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f25065fa640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2500071190 0x7f2500150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f25065fa640 1 -- 172.21.15.55:0/3893868063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25000ae9a0 msgr2=0x7f25001f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f25065fa640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25000ae9a0 0x7f25001f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f25065fa640 1 -- 172.21.15.55:0/3893868063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250014e900 con 0x7f25000b2c60 2024-04-25T09:00:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f25055f8640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25000ae9a0 0x7f25001f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f2505df9640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2500071190 0x7f2500150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f25065fa640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25000b2c60 0x7f25000b0340 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c6b0 tx=0x7f24f800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f24f67fc640 1 -- 172.21.15.55:0/3893868063 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8003b70 con 0x7f25000b2c60 2024-04-25T09:00:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.830+0000 7f24f67fc640 1 -- 172.21.15.55:0/3893868063 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f8003d30 con 0x7f25000b2c60 2024-04-25T09:00:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.831+0000 7f250805d640 1 -- 172.21.15.55:0/3893868063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250014ebe0 con 0x7f25000b2c60 2024-04-25T09:00:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.831+0000 7f24f67fc640 1 -- 172.21.15.55:0/3893868063 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8005310 con 0x7f25000b2c60 2024-04-25T09:00:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.831+0000 7f250805d640 1 -- 172.21.15.55:0/3893868063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25001496c0 con 0x7f25000b2c60 2024-04-25T09:00:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.831+0000 7f250805d640 1 -- 172.21.15.55:0/3893868063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25000b2400 con 0x7f25000b2c60 2024-04-25T09:00:23.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.832+0000 7f24f67fc640 1 -- 172.21.15.55:0/3893868063 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f24f80054b0 con 0x7f25000b2c60 2024-04-25T09:00:23.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.832+0000 7f24f67fc640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24e406b4d0 0x7f24e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:23.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.832+0000 7f24f67fc640 1 -- 172.21.15.55:0/3893868063 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f24f808a0c0 con 0x7f25000b2c60 2024-04-25T09:00:23.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.832+0000 7f2505df9640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24e406b4d0 0x7f24e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:23.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.833+0000 7f2505df9640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24e406b4d0 0x7f24e406d990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f24fc000f60 tx=0x7f24fc007c50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:23.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:23.837+0000 7f24f67fc640 1 -- 172.21.15.55:0/3893868063 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f25000b2400 con 0x7f25000b2c60 2024-04-25T09:00:24.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.061+0000 7f250805d640 1 -- 172.21.15.55:0/3893868063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25000749b0 con 0x7f25000b2c60 2024-04-25T09:00:24.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.061+0000 7f24f67fc640 1 -- 172.21.15.55:0/3893868063 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f24f8058ee0 con 0x7f25000b2c60 2024-04-25T09:00:24.050 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:00:24.050 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T08:59:57.635474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":6,"addr":"172.21.15.55:6837/3282261214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3282261214},{"type":"v1","addr":"172.21.15.55:6837","nonce":3282261214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:00:24.051 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 58 2024-04-25T09:00:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.063+0000 7f250805d640 1 -- 172.21.15.55:0/3893868063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24e406b4d0 msgr2=0x7f24e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.063+0000 7f250805d640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24e406b4d0 0x7f24e406d990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f24fc000f60 tx=0x7f24fc007c50 comp rx=0 tx=0).stop 2024-04-25T09:00:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.063+0000 7f250805d640 1 -- 172.21.15.55:0/3893868063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25000b2c60 msgr2=0x7f25000b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.063+0000 7f250805d640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25000b2c60 0x7f25000b0340 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c6b0 tx=0x7f24f800cb70 comp rx=0 tx=0).stop 2024-04-25T09:00:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.063+0000 7f250805d640 1 -- 172.21.15.55:0/3893868063 shutdown_connections 2024-04-25T09:00:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.063+0000 7f250805d640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24e406b4d0 0x7f24e406d990 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.063+0000 7f250805d640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25000b2c60 0x7f25000b0340 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.063+0000 7f250805d640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25000ae9a0 0x7f25001f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.063+0000 7f250805d640 1 --2- 172.21.15.55:0/3893868063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2500071190 0x7f2500150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.063+0000 7f250805d640 1 -- 172.21.15.55:0/3893868063 >> 172.21.15.55:0/3893868063 conn(0x7f250006aba0 msgr2=0x7f25000b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.064+0000 7f250805d640 1 -- 172.21.15.55:0/3893868063 shutdown_connections 2024-04-25T09:00:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.064+0000 7f250805d640 1 -- 172.21.15.55:0/3893868063 wait complete. 2024-04-25T09:00:24.064 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T09:00:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.178+0000 7f0d87b3b640 1 Processor -- start 2024-04-25T09:00:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.178+0000 7f0d87b3b640 1 -- start start 2024-04-25T09:00:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.179+0000 7f0d87b3b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0d800d3b90 0x7f0d800d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.179+0000 7f0d87b3b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d800d0f60 0x7f0d800b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.179+0000 7f0d87b3b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d800d4090 con 0x7f0d8015dca0 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.179+0000 7f0d87b3b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d800b6b20 con 0x7f0d800d3b90 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.179+0000 7f0d87b3b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800d1390 con 0x7f0d800d0f60 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.179+0000 7f0d858d7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0d8015dca0 0x7f0d800ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48190/0 (socket says 172.21.15.55:48190) 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.179+0000 7f0d858d7640 1 -- 172.21.15.55:0/1717304803 learned_addr learned my addr 172.21.15.55:0/1717304803 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.179+0000 7f0d850d6640 1 --2- 172.21.15.55:0/1717304803 >> v2:172.21.15.167:3300/0 conn(0x7f0d800d3b90 0x7f0d800d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.179+0000 7f0d860d8640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d800d0f60 0x7f0d800b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.179+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653646313 0 0) 0x7f0d800d4090 con 0x7f0d8015dca0 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.179+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d6c003520 con 0x7f0d8015dca0 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 516626721 0 0) 0x7f0d6c003520 con 0x7f0d8015dca0 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d800d0f60 msgr2=0x7f0d800b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d800d0f60 0x7f0d800b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 >> v2:172.21.15.167:3300/0 conn(0x7f0d800d3b90 msgr2=0x7f0d800d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 --2- 172.21.15.55:0/1717304803 >> v2:172.21.15.167:3300/0 conn(0x7f0d800d3b90 0x7f0d800d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800d4370 con 0x7f0d8015dca0 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f0d7c001670 con 0x7f0d8015dca0 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 >> v1:172.21.15.55:6789/0 conn(0x7f0d8015dca0 legacy=0x7f0d800ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d800d0f60 0x7f0d6c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d6c003f60 0x7f0d6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d6c004d40 0x7f0d6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800d1390 con 0x7f0d6c004d40 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c00b9c0 con 0x7f0d6c003f60 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c00bb40 con 0x7f0d800d0f60 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d860d8640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d6c004d40 0x7f0d6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d858d7640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d800d0f60 0x7f0d6c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d850d6640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d6c003f60 0x7f0d6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d860d8640 1 -- 172.21.15.55:0/1717304803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d800d0f60 msgr2=0x7f0d6c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d860d8640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d800d0f60 0x7f0d6c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d860d8640 1 -- 172.21.15.55:0/1717304803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d6c003f60 msgr2=0x7f0d6c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d860d8640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d6c003f60 0x7f0d6c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.180+0000 7f0d860d8640 1 -- 172.21.15.55:0/1717304803 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c003520 con 0x7f0d6c004d40 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.181+0000 7f0d860d8640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d6c004d40 0x7f0d6c0051c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009fc0 tx=0x7f0d6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77be6c828e93e84b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.181+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78009c10 con 0x7f0d6c004d40 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.181+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d78036070 con 0x7f0d6c004d40 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.181+0000 7f0d848d5640 1 -- 172.21.15.55:0/1717304803 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78031880 con 0x7f0d6c004d40 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.181+0000 7f0d87b3b640 1 -- 172.21.15.55:0/1717304803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d6c004d40 msgr2=0x7f0d6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.181+0000 7f0d87b3b640 1 --2- 172.21.15.55:0/1717304803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d6c004d40 0x7f0d6c0051c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009fc0 tx=0x7f0d6c005830 comp rx=0 tx=0).stop 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.181+0000 7f0d860d8640 1 -- 172.21.15.55:0/1717304803 reap_dead start 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.182+0000 7f0d87b3b640 1 -- 172.21.15.55:0/1717304803 shutdown_connections 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.182+0000 7f0d87b3b640 1 -- 172.21.15.55:0/1717304803 >> 172.21.15.55:0/1717304803 conn(0x7f0d800726c0 msgr2=0x7f0d80072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.182+0000 7f0d87b3b640 1 -- 172.21.15.55:0/1717304803 shutdown_connections 2024-04-25T09:00:24.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.182+0000 7f0d87b3b640 1 -- 172.21.15.55:0/1717304803 wait complete. 2024-04-25T09:00:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.183+0000 7f0d87b3b640 1 Processor -- start 2024-04-25T09:00:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.183+0000 7f0d87b3b640 1 -- start start 2024-04-25T09:00:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d87b3b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d6c004d40 0x7f0d801f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d87b3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d80152c60 0x7f0d801f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d87b3b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d800cab60 0x7f0d8015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d87b3b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800cf050 con 0x7f0d80152c60 2024-04-25T09:00:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d87b3b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800b6d50 con 0x7f0d800cab60 2024-04-25T09:00:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d87b3b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8015e080 con 0x7f0d6c004d40 2024-04-25T09:00:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d850d6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d80152c60 0x7f0d801f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d850d6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d80152c60 0x7f0d801f3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37410/0 (socket says 172.21.15.55:37410) 2024-04-25T09:00:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d850d6640 1 -- 172.21.15.55:0/2342169763 learned_addr learned my addr 172.21.15.55:0/2342169763 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d860d8640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d800cab60 0x7f0d8015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d858d7640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d6c004d40 0x7f0d801f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d850d6640 1 -- 172.21.15.55:0/2342169763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d6c004d40 msgr2=0x7f0d801f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d850d6640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d6c004d40 0x7f0d801f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d850d6640 1 -- 172.21.15.55:0/2342169763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d800cab60 msgr2=0x7f0d8015f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d850d6640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d800cab60 0x7f0d8015f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d850d6640 1 -- 172.21.15.55:0/2342169763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d801f3d60 con 0x7f0d80152c60 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d858d7640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d6c004d40 0x7f0d801f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d850d6640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d80152c60 0x7f0d801f3510 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0d70011960 tx=0x7f0d70011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d767fc640 1 -- 172.21.15.55:0/2342169763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70019070 con 0x7f0d80152c60 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d767fc640 1 -- 172.21.15.55:0/2342169763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d70004240 con 0x7f0d80152c60 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d87b3b640 1 -- 172.21.15.55:0/2342169763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d801f4040 con 0x7f0d80152c60 2024-04-25T09:00:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d767fc640 1 -- 172.21.15.55:0/2342169763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000f880 con 0x7f0d80152c60 2024-04-25T09:00:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.184+0000 7f0d87b3b640 1 -- 172.21.15.55:0/2342169763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d801f3a50 con 0x7f0d80152c60 2024-04-25T09:00:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.186+0000 7f0d767fc640 1 -- 172.21.15.55:0/2342169763 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d7001c070 con 0x7f0d80152c60 2024-04-25T09:00:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.186+0000 7f0d767fc640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d6406b500 0x7f0d6406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.186+0000 7f0d767fc640 1 -- 172.21.15.55:0/2342169763 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f0d7008a640 con 0x7f0d80152c60 2024-04-25T09:00:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.186+0000 7f0d858d7640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d6406b500 0x7f0d6406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.187+0000 7f0d858d7640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d6406b500 0x7f0d6406d9c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0015d0 tx=0x7f0d7c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.187+0000 7f0d8a842740 1 Processor -- start 2024-04-25T09:00:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.187+0000 7f0d8a842740 1 -- start start 2024-04-25T09:00:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331ed96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f13c60 0x564331ed7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f02050 0x564331f024d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d8a842740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564331e3ac60 con 0x564331ed7590 2024-04-25T09:00:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d8a842740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564331dd9d80 con 0x564331f02050 2024-04-25T09:00:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d8a842740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564331e36d00 con 0x564331f13c60 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d858d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331ed96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d858d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331ed96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37414/0 (socket says 172.21.15.55:37414) 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d858d7640 1 -- 172.21.15.55:0/1757974940 learned_addr learned my addr 172.21.15.55:0/1757974940 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d850d6640 1 --2- 172.21.15.55:0/1757974940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f13c60 0x564331ed7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d860d8640 1 --2- 172.21.15.55:0/1757974940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f02050 0x564331f024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d858d7640 1 -- 172.21.15.55:0/1757974940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f13c60 msgr2=0x564331ed7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d858d7640 1 --2- 172.21.15.55:0/1757974940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f13c60 0x564331ed7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d858d7640 1 -- 172.21.15.55:0/1757974940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f02050 msgr2=0x564331f024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d858d7640 1 --2- 172.21.15.55:0/1757974940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f02050 0x564331f024d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.188+0000 7f0d858d7640 1 -- 172.21.15.55:0/1757974940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564331c1b7c0 con 0x564331ed7590 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.189+0000 7f0d858d7640 1 --2- 172.21.15.55:0/1757974940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331ed96f0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c001730 tx=0x7f0d7c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7840809a4475ffc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.189+0000 7f0d637fe640 1 -- 172.21.15.55:0/1757974940 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c026070 con 0x564331ed7590 2024-04-25T09:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.189+0000 7f0d637fe640 1 -- 172.21.15.55:0/1757974940 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c01c050 con 0x564331ed7590 2024-04-25T09:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.189+0000 7f0d637fe640 1 -- 172.21.15.55:0/1757974940 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c021610 con 0x564331ed7590 2024-04-25T09:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.189+0000 7f0d8a842740 1 -- 172.21.15.55:0/1757974940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 msgr2=0x564331ed96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.189+0000 7f0d8a842740 1 --2- 172.21.15.55:0/1757974940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331ed96f0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c001730 tx=0x7f0d7c013000 comp rx=0 tx=0).stop 2024-04-25T09:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.189+0000 7f0d8a842740 1 -- 172.21.15.55:0/1757974940 shutdown_connections 2024-04-25T09:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.189+0000 7f0d8a842740 1 --2- 172.21.15.55:0/1757974940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f02050 0x564331f024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.189+0000 7f0d8a842740 1 --2- 172.21.15.55:0/1757974940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f13c60 0x564331ed7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.189+0000 7f0d8a842740 1 --2- 172.21.15.55:0/1757974940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331ed96f0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.189+0000 7f0d8a842740 1 -- 172.21.15.55:0/1757974940 >> 172.21.15.55:0/1757974940 conn(0x564331e9f6e0 msgr2=0x564331f1d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.190+0000 7f0d8a842740 1 -- 172.21.15.55:0/1757974940 shutdown_connections 2024-04-25T09:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.190+0000 7f0d8a842740 1 -- 172.21.15.55:0/1757974940 wait complete. 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.190+0000 7f0d8a842740 1 -- start start 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.190+0000 7f0d8a842740 1 Processor -- start 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331ed7590 0x564331f1f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f02050 0x564331f17560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f13c60 0x564331f17aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d8a842740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564331dd7840 con 0x564331f13c60 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d8a842740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564331effba0 con 0x564331ed7590 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d8a842740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564331eeea70 con 0x564331f02050 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d8a842740 10 client.0 _ll_register_callbacks cb 0x564331df1980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d860d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f13c60 0x564331f17aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d860d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f13c60 0x564331f17aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37426/0 (socket says 172.21.15.55:37426) 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d860d8640 1 -- 172.21.15.55:0/844908085 learned_addr learned my addr 172.21.15.55:0/844908085 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d850d6640 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f02050 0x564331f17560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d858d7640 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331ed7590 0x564331f1f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d860d8640 1 -- 172.21.15.55:0/844908085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f02050 msgr2=0x564331f17560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d860d8640 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f02050 0x564331f17560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d860d8640 1 -- 172.21.15.55:0/844908085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331ed7590 msgr2=0x564331f1f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d860d8640 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331ed7590 0x564331f1f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.191+0000 7f0d860d8640 1 -- 172.21.15.55:0/844908085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564331c7bf50 con 0x564331f13c60 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d860d8640 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f13c60 0x564331f17aa0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f0d7802aee0 tx=0x7f0d78004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3038de050a44d55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d60ff9640 1 -- 172.21.15.55:0/844908085 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78031440 con 0x564331f13c60 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d8a842740 1 -- 172.21.15.55:0/844908085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d7c01c050 con 0x564331f13c60 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d60ff9640 1 -- 172.21.15.55:0/844908085 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f0d78047b40 con 0x564331f13c60 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d60ff9640 1 -- 172.21.15.55:0/844908085 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d78047d80 con 0x564331f13c60 2024-04-25T09:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d8a842740 10 client.7725 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d8a842740 1 -- 172.21.15.55:0/844908085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x564331b0f0b0 con 0x564331f13c60 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d60ff9640 1 -- 172.21.15.55:0/844908085 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c01c050 con 0x564331f13c60 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d60ff9640 1 -- 172.21.15.55:0/844908085 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0d780315e0 con 0x564331f13c60 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d8a842740 10 client.7725 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d8a842740 10 client.7725 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d8a842740 20 client.7725 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d8a842740 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x564331f30380 0x564331f30760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d8a842740 4 client.7725 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d8a842740 1 -- 172.21.15.55:0/844908085 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564331dfae60 con 0x564331f30380 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.192+0000 7f0d858d7640 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x564331f30380 0x564331f30760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.193+0000 7f0d60ff9640 10 client.7725 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.193+0000 7f0d858d7640 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x564331f30380 0x564331f30760 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d15c2297aa58ed88 server_cookie=be1bc7202af00117 in_seq=0 out_seq=0 2024-04-25T09:00:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.193+0000 7f0d60ff9640 1 -- 172.21.15.55:0/844908085 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564331dfae60 con 0x564331f30380 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.193+0000 7f0d60ff9640 10 client.7725 handle_command_reply: tid=0 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.193+0000 7f0d8a842740 1 client.7725 shutdown 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.193+0000 7f0d8a842740 1 -- 172.21.15.55:0/844908085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f13c60 msgr2=0x564331f17aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.193+0000 7f0d8a842740 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f13c60 0x564331f17aa0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f0d7802aee0 tx=0x7f0d78004ab0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.194+0000 7f0d8a842740 1 -- 172.21.15.55:0/844908085 shutdown_connections 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.194+0000 7f0d8a842740 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x564331f30380 0x564331f30760 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.194+0000 7f0d8a842740 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f13c60 0x564331f17aa0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.194+0000 7f0d8a842740 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f02050 0x564331f17560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.194+0000 7f0d60ff9640 0 client.7725 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.194+0000 7f0d8a842740 1 --2- 172.21.15.55:0/844908085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331ed7590 0x564331f1f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.194+0000 7f0d8a842740 1 -- 172.21.15.55:0/844908085 >> 172.21.15.55:0/844908085 conn(0x564331e9f6e0 msgr2=0x564331eff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.194+0000 7f0d8a842740 1 -- 172.21.15.55:0/844908085 shutdown_connections 2024-04-25T09:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.194+0000 7f0d8a842740 1 -- 172.21.15.55:0/844908085 wait complete. 2024-04-25T09:00:24.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.194+0000 7f0d8a842740 20 client.7725 trim_cache size 0 max 16384 2024-04-25T09:00:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.206+0000 7f0d8a842740 1 Processor -- start 2024-04-25T09:00:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.206+0000 7f0d8a842740 1 -- start start 2024-04-25T09:00:24.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.206+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331ed7590 0x564331f3fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.206+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f02050 0x564331f36980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.206+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f13c60 0x564331f1f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.206+0000 7f0d8a842740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801ff6d0 con 0x564331f02050 2024-04-25T09:00:24.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.206+0000 7f0d8a842740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80154500 con 0x564331f13c60 2024-04-25T09:00:24.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.206+0000 7f0d8a842740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801ff0d0 con 0x564331ed7590 2024-04-25T09:00:24.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.206+0000 7f0d850d6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f02050 0x564331f36980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.206+0000 7f0d850d6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f02050 0x564331f36980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37436/0 (socket says 172.21.15.55:37436) 2024-04-25T09:00:24.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.206+0000 7f0d850d6640 1 -- 172.21.15.55:0/249221559 learned_addr learned my addr 172.21.15.55:0/249221559 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.207+0000 7f0d850d6640 1 -- 172.21.15.55:0/249221559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331ed7590 msgr2=0x564331f3fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.207+0000 7f0d850d6640 1 --2- 172.21.15.55:0/249221559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331ed7590 0x564331f3fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.207+0000 7f0d850d6640 1 -- 172.21.15.55:0/249221559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f13c60 msgr2=0x564331f1f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.207+0000 7f0d860d8640 1 --2- 172.21.15.55:0/249221559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f13c60 0x564331f1f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.207+0000 7f0d850d6640 1 --2- 172.21.15.55:0/249221559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f13c60 0x564331f1f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.207+0000 7f0d850d6640 1 -- 172.21.15.55:0/249221559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564331ed3e10 con 0x564331f02050 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.207+0000 7f0d850d6640 1 --2- 172.21.15.55:0/249221559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f02050 0x564331f36980 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f0d70058d70 tx=0x7f0d7005f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ec865eb7249aa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.207+0000 7f0d62ffd640 1 -- 172.21.15.55:0/249221559 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70023040 con 0x564331f02050 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.207+0000 7f0d62ffd640 1 -- 172.21.15.55:0/249221559 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7005c070 con 0x564331f02050 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.207+0000 7f0d62ffd640 1 -- 172.21.15.55:0/249221559 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700614f0 con 0x564331f02050 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.208+0000 7f0d8a842740 1 -- 172.21.15.55:0/249221559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f02050 msgr2=0x564331f36980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.208+0000 7f0d8a842740 1 --2- 172.21.15.55:0/249221559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f02050 0x564331f36980 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f0d70058d70 tx=0x7f0d7005f040 comp rx=0 tx=0).stop 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.208+0000 7f0d8a842740 1 -- 172.21.15.55:0/249221559 shutdown_connections 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.208+0000 7f0d8a842740 1 --2- 172.21.15.55:0/249221559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f13c60 0x564331f1f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.208+0000 7f0d8a842740 1 --2- 172.21.15.55:0/249221559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331f02050 0x564331f36980 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.208+0000 7f0d8a842740 1 --2- 172.21.15.55:0/249221559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331ed7590 0x564331f3fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.208+0000 7f0d8a842740 1 -- 172.21.15.55:0/249221559 >> 172.21.15.55:0/249221559 conn(0x564331e9f6e0 msgr2=0x564331eff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.208+0000 7f0d8a842740 1 -- 172.21.15.55:0/249221559 shutdown_connections 2024-04-25T09:00:24.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.208+0000 7f0d8a842740 1 -- 172.21.15.55:0/249221559 wait complete. 2024-04-25T09:00:24.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.208+0000 7f0d8a842740 1 -- start start 2024-04-25T09:00:24.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.208+0000 7f0d8a842740 1 Processor -- start 2024-04-25T09:00:24.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331f12d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f02050 0x564331f2ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d8a842740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f13c60 0x564331f2f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d8a842740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564331eee7b0 con 0x564331ed7590 2024-04-25T09:00:24.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d8a842740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564331f20420 con 0x564331f02050 2024-04-25T09:00:24.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d8a842740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564331ef06a0 con 0x564331f13c60 2024-04-25T09:00:24.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d8a842740 10 client.0 _ll_register_callbacks cb 0x7f0d7c018040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:24.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d858d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331f12d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d858d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331f12d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37440/0 (socket says 172.21.15.55:37440) 2024-04-25T09:00:24.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d858d7640 1 -- 172.21.15.55:0/3930088919 learned_addr learned my addr 172.21.15.55:0/3930088919 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d850d6640 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f02050 0x564331f2ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.209+0000 7f0d860d8640 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f13c60 0x564331f2f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d858d7640 1 -- 172.21.15.55:0/3930088919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f13c60 msgr2=0x564331f2f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d858d7640 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f13c60 0x564331f2f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d858d7640 1 -- 172.21.15.55:0/3930088919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f02050 msgr2=0x564331f2ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d858d7640 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f02050 0x564331f2ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d858d7640 1 -- 172.21.15.55:0/3930088919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564331f1fbd0 con 0x564331ed7590 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d858d7640 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331f12d30 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c024040 tx=0x7f0d7c0078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f6acfd41d523d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d60ff9640 1 -- 172.21.15.55:0/3930088919 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c026040 con 0x564331ed7590 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d60ff9640 1 -- 172.21.15.55:0/3930088919 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f0d7c006e10 con 0x564331ed7590 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d8a842740 1 -- 172.21.15.55:0/3930088919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d7005c070 con 0x564331ed7590 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d60ff9640 1 -- 172.21.15.55:0/3930088919 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d7c03f050 con 0x564331ed7590 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d8a842740 10 client.7731 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d8a842740 1 -- 172.21.15.55:0/3930088919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x564331f1f950 con 0x564331ed7590 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d60ff9640 1 -- 172.21.15.55:0/3930088919 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7005c070 con 0x564331ed7590 2024-04-25T09:00:24.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d60ff9640 1 -- 172.21.15.55:0/3930088919 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0d7c042020 con 0x564331ed7590 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d8a842740 10 client.7731 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d8a842740 10 client.7731 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d8a842740 20 client.7731 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.210+0000 7f0d8a842740 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x564331f36ff0 0x564331f174f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 4 client.7731 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 -- 172.21.15.55:0/3930088919 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x564331e481a0 con 0x564331f36ff0 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d850d6640 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x564331f36ff0 0x564331f174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d60ff9640 10 client.7731 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d850d6640 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x564331f36ff0 0x564331f174f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2185b4061bc5c16b server_cookie=aa1575b62572e443 in_seq=0 out_seq=0 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d60ff9640 1 -- 172.21.15.55:0/3930088919 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+420 (crc 0 0 0) 0x564331e481a0 con 0x564331f36ff0 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d60ff9640 10 client.7731 handle_command_reply: tid=0 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 client.7731 shutdown 2024-04-25T09:00:24.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 -- 172.21.15.55:0/3930088919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 msgr2=0x564331f12d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331f12d30 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c024040 tx=0x7f0d7c0078f0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 -- 172.21.15.55:0/3930088919 shutdown_connections 2024-04-25T09:00:24.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x564331f36ff0 0x564331f174f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564331f13c60 0x564331f2f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564331f02050 0x564331f2ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d60ff9640 0 client.7731 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 --2- 172.21.15.55:0/3930088919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564331ed7590 0x564331f12d30 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 -- 172.21.15.55:0/3930088919 >> 172.21.15.55:0/3930088919 conn(0x564331e9f6e0 msgr2=0x564331f05880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 -- 172.21.15.55:0/3930088919 shutdown_connections 2024-04-25T09:00:24.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 1 -- 172.21.15.55:0/3930088919 wait complete. 2024-04-25T09:00:24.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.211+0000 7f0d8a842740 20 client.7731 trim_cache size 0 max 16384 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "backtrace", 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 1447873716, 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627776, 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir" 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "backtrace", 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2188011350, 2024-04-25T09:00:24.213 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-25T09:00:24.214 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/testdir/hardlink" 2024-04-25T09:00:24.214 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:00:24.214 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:00:24.214 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "dir_frag", 2024-04-25T09:00:24.214 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 3122183135, 2024-04-25T09:00:24.214 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627776, 2024-04-25T09:00:24.214 INFO:teuthology.orchestra.run.smithi055.stdout: "frag": "*", 2024-04-25T09:00:24.214 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir" 2024-04-25T09:00:24.214 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:00:24.214 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T09:00:24.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 -- 172.21.15.55:0/2342169763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d6406b500 msgr2=0x7f0d6406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d6406b500 0x7f0d6406d9c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0015d0 tx=0x7f0d7c009040 comp rx=0 tx=0).stop 2024-04-25T09:00:24.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 -- 172.21.15.55:0/2342169763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d80152c60 msgr2=0x7f0d801f3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d80152c60 0x7f0d801f3510 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0d70011960 tx=0x7f0d70011e20 comp rx=0 tx=0).stop 2024-04-25T09:00:24.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 -- 172.21.15.55:0/2342169763 shutdown_connections 2024-04-25T09:00:24.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0d6406b500 0x7f0d6406d9c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d800cab60 0x7f0d8015f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d80152c60 0x7f0d801f3510 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 --2- 172.21.15.55:0/2342169763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d6c004d40 0x7f0d801f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 -- 172.21.15.55:0/2342169763 >> 172.21.15.55:0/2342169763 conn(0x7f0d800726c0 msgr2=0x7f0d800b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 -- 172.21.15.55:0/2342169763 shutdown_connections 2024-04-25T09:00:24.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.212+0000 7f0d87b3b640 1 -- 172.21.15.55:0/2342169763 wait complete. 2024-04-25T09:00:24.217 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:00:24.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.328+0000 7f1cfeb70640 1 Processor -- start 2024-04-25T09:00:24.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.328+0000 7f1cfeb70640 1 -- start start 2024-04-25T09:00:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.329+0000 7f1cfeb70640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cf815dc30 0x7f1cf806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.329+0000 7f1cfeb70640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cf806cc00 0x7f1cf80b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.329+0000 7f1cfeb70640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf806c1f0 con 0x7f1cf80b1960 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.329+0000 7f1cfeb70640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf80cfb40 con 0x7f1cf806cc00 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.329+0000 7f1cfeb70640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80b2060 con 0x7f1cf815dc30 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.329+0000 7f1cf7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cf806cc00 0x7f1cf80b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.329+0000 7f1cf7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cf806cc00 0x7f1cf80b1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37456/0 (socket says 172.21.15.55:37456) 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.329+0000 7f1cf7fff640 1 -- 172.21.15.55:0/2493022164 learned_addr learned my addr 172.21.15.55:0/2493022164 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.330+0000 7f1cfc90c640 1 --2- 172.21.15.55:0/2493022164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cf815dc30 0x7f1cf806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.330+0000 7f1cf7fff640 1 -- 172.21.15.55:0/2493022164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cf815dc30 msgr2=0x7f1cf806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.330+0000 7f1cf7fff640 1 --2- 172.21.15.55:0/2493022164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cf815dc30 0x7f1cf806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.330+0000 7f1cf7fff640 1 -- 172.21.15.55:0/2493022164 >> v1:172.21.15.167:6789/0 conn(0x7f1cf80b1960 legacy=0x7f1cf8099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.330+0000 7f1cf7fff640 1 -- 172.21.15.55:0/2493022164 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80b2340 con 0x7f1cf806cc00 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.330+0000 7f1cf7fff640 1 --2- 172.21.15.55:0/2493022164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf806cc00 0x7f1cf80b1420 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009870 tx=0x7f1ce002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ce8d6ff4178939 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.331+0000 7f1cf77fe640 1 -- 172.21.15.55:0/2493022164 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0037070 con 0x7f1cf806cc00 2024-04-25T09:00:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.331+0000 7f1cf77fe640 1 -- 172.21.15.55:0/2493022164 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce0032440 con 0x7f1cf806cc00 2024-04-25T09:00:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.331+0000 7f1cf77fe640 1 -- 172.21.15.55:0/2493022164 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0032810 con 0x7f1cf806cc00 2024-04-25T09:00:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.331+0000 7f1cfeb70640 1 -- 172.21.15.55:0/2493022164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf806cc00 msgr2=0x7f1cf80b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.331+0000 7f1cfeb70640 1 --2- 172.21.15.55:0/2493022164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf806cc00 0x7f1cf80b1420 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009870 tx=0x7f1ce002a270 comp rx=0 tx=0).stop 2024-04-25T09:00:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.331+0000 7f1cfeb70640 1 -- 172.21.15.55:0/2493022164 shutdown_connections 2024-04-25T09:00:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.331+0000 7f1cfeb70640 1 --2- 172.21.15.55:0/2493022164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf806cc00 0x7f1cf80b1420 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.331+0000 7f1cfeb70640 1 --2- 172.21.15.55:0/2493022164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cf815dc30 0x7f1cf806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.331+0000 7f1cfeb70640 1 -- 172.21.15.55:0/2493022164 >> 172.21.15.55:0/2493022164 conn(0x7f1cf80d1900 msgr2=0x7f1cf80d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.331+0000 7f1cfeb70640 1 -- 172.21.15.55:0/2493022164 shutdown_connections 2024-04-25T09:00:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.331+0000 7f1cfeb70640 1 -- 172.21.15.55:0/2493022164 wait complete. 2024-04-25T09:00:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.332+0000 7f1cfeb70640 1 Processor -- start 2024-04-25T09:00:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.332+0000 7f1cfeb70640 1 -- start start 2024-04-25T09:00:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.333+0000 7f1cfeb70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf806cc00 0x7f1cf80b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.333+0000 7f1cfeb70640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cf80b1960 0x7f1cf80c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.333+0000 7f1cfeb70640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cf815dc30 0x7f1cf8160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.333+0000 7f1cfeb70640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80b1d80 con 0x7f1cf806cc00 2024-04-25T09:00:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.333+0000 7f1cfeb70640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80cfde0 con 0x7f1cf815dc30 2024-04-25T09:00:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.333+0000 7f1cfeb70640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf815e010 con 0x7f1cf80b1960 2024-04-25T09:00:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.333+0000 7f1cfc90c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf806cc00 0x7f1cf80b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.333+0000 7f1cfc90c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf806cc00 0x7f1cf80b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37466/0 (socket says 172.21.15.55:37466) 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.333+0000 7f1cfc90c640 1 -- 172.21.15.55:0/1911484765 learned_addr learned my addr 172.21.15.55:0/1911484765 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cfd10d640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cf815dc30 0x7f1cf8160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cf7fff640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cf80b1960 0x7f1cf80c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cfc90c640 1 -- 172.21.15.55:0/1911484765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cf80b1960 msgr2=0x7f1cf80c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cfc90c640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cf80b1960 0x7f1cf80c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cfc90c640 1 -- 172.21.15.55:0/1911484765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cf815dc30 msgr2=0x7f1cf8160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cfc90c640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cf815dc30 0x7f1cf8160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cfc90c640 1 -- 172.21.15.55:0/1911484765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80c9a70 con 0x7f1cf806cc00 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cfd10d640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cf815dc30 0x7f1cf8160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cfc90c640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf806cc00 0x7f1cf80b4520 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0007e70 tx=0x7f1cf000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cf57fa640 1 -- 172.21.15.55:0/1911484765 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0014620 con 0x7f1cf806cc00 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cf57fa640 1 -- 172.21.15.55:0/1911484765 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf0019070 con 0x7f1cf806cc00 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cfeb70640 1 -- 172.21.15.55:0/1911484765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf80c9d50 con 0x7f1cf806cc00 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cf57fa640 1 -- 172.21.15.55:0/1911484765 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0014a00 con 0x7f1cf806cc00 2024-04-25T09:00:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.334+0000 7f1cfeb70640 1 -- 172.21.15.55:0/1911484765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf80ca310 con 0x7f1cf806cc00 2024-04-25T09:00:24.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.335+0000 7f1cfeb70640 1 -- 172.21.15.55:0/1911484765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf80749b0 con 0x7f1cf806cc00 2024-04-25T09:00:24.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.336+0000 7f1cf57fa640 1 -- 172.21.15.55:0/1911484765 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1cf0014ba0 con 0x7f1cf806cc00 2024-04-25T09:00:24.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.336+0000 7f1cf57fa640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1cd806b4d0 0x7f1cd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.336+0000 7f1cf57fa640 1 -- 172.21.15.55:0/1911484765 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f1cf008aa50 con 0x7f1cf806cc00 2024-04-25T09:00:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.336+0000 7f1cf7fff640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1cd806b4d0 0x7f1cd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.337+0000 7f1cf7fff640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1cd806b4d0 0x7f1cd806d990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0034000 tx=0x7f1ce002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.340+0000 7f1cf57fa640 1 -- 172.21.15.55:0/1911484765 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1cf00598f0 con 0x7f1cf806cc00 2024-04-25T09:00:24.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.559+0000 7f1cfeb70640 1 -- 172.21.15.55:0/1911484765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1cf80ca6f0 con 0x7f1cf806cc00 2024-04-25T09:00:24.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.559+0000 7f1cf57fa640 1 -- 172.21.15.55:0/1911484765 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f1cf00591f0 con 0x7f1cf806cc00 2024-04-25T09:00:24.548 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:00:24.548 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T09:00:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 -- 172.21.15.55:0/1911484765 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1cd806b4d0 msgr2=0x7f1cd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1cd806b4d0 0x7f1cd806d990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0034000 tx=0x7f1ce002e000 comp rx=0 tx=0).stop 2024-04-25T09:00:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 -- 172.21.15.55:0/1911484765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf806cc00 msgr2=0x7f1cf80b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf806cc00 0x7f1cf80b4520 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0007e70 tx=0x7f1cf000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 -- 172.21.15.55:0/1911484765 shutdown_connections 2024-04-25T09:00:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1cd806b4d0 0x7f1cd806d990 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cf815dc30 0x7f1cf8160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cf80b1960 0x7f1cf80c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 --2- 172.21.15.55:0/1911484765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf806cc00 0x7f1cf80b4520 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 -- 172.21.15.55:0/1911484765 >> 172.21.15.55:0/1911484765 conn(0x7f1cf80d1900 msgr2=0x7f1cf80706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 -- 172.21.15.55:0/1911484765 shutdown_connections 2024-04-25T09:00:24.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.561+0000 7f1cfeb70640 1 -- 172.21.15.55:0/1911484765 wait complete. 2024-04-25T09:00:24.561 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:00:24.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:24.561 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T09:00:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.677+0000 7f785f522640 1 Processor -- start 2024-04-25T09:00:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.677+0000 7f785f522640 1 -- start start 2024-04-25T09:00:24.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.678+0000 7f785f522640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858161090 0x7f7858161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.678+0000 7f785f522640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7858161f80 con 0x7f78580b9720 2024-04-25T09:00:24.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.678+0000 7f785f522640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7858162260 con 0x7f78580ceeb0 2024-04-25T09:00:24.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.678+0000 7f785f522640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78580d21a0 con 0x7f7858161090 2024-04-25T09:00:24.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.678+0000 7f785cabd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f78580b9720 0x7f78580ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48206/0 (socket says 172.21.15.55:48206) 2024-04-25T09:00:24.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.678+0000 7f785cabd640 1 -- 172.21.15.55:0/3915823266 learned_addr learned my addr 172.21.15.55:0/3915823266 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f785d2be640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858161090 0x7f7858161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050015925 0 0) 0x7f7858161f80 con 0x7f78580b9720 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7844003520 con 0x7f78580b9720 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316175282 0 0) 0x7f7858162260 con 0x7f78580ceeb0 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7858161f80 con 0x7f78580ceeb0 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4030767860 0 0) 0x7f7844003520 con 0x7f78580b9720 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858161090 msgr2=0x7f7858161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858161090 0x7f7858161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 >> v1:172.21.15.167:6789/0 conn(0x7f78580ceeb0 legacy=0x7f78580d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858162540 con 0x7f78580b9720 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f7848001670 con 0x7f78580b9720 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 >> v1:172.21.15.55:6789/0 conn(0x7f78580b9720 legacy=0x7f78580ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858161090 0x7f7844003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78440040f0 0x7f7844004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7844004d40 0x7f78440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580d21a0 con 0x7f7844004d40 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784400baa0 con 0x7f78440040f0 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784400bca0 con 0x7f7858161090 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f785dabf640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7844004d40 0x7f78440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f785cabd640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78440040f0 0x7f7844004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f785d2be640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858161090 0x7f7844003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f785dabf640 1 -- 172.21.15.55:0/3915823266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858161090 msgr2=0x7f7844003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f785dabf640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858161090 0x7f7844003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f785dabf640 1 -- 172.21.15.55:0/3915823266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78440040f0 msgr2=0x7f7844004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f785dabf640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78440040f0 0x7f7844004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.679+0000 7f785dabf640 1 -- 172.21.15.55:0/3915823266 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7844003520 con 0x7f7844004d40 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.680+0000 7f785dabf640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7844004d40 0x7f78440051c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f7850001fa0 tx=0x7f7844005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba60973ecd53c194 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.680+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7850001bf0 con 0x7f7844004d40 2024-04-25T09:00:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.680+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850003b70 con 0x7f7844004d40 2024-04-25T09:00:24.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.680+0000 7f784ffff640 1 -- 172.21.15.55:0/3915823266 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500050d0 con 0x7f7844004d40 2024-04-25T09:00:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.681+0000 7f785f522640 1 -- 172.21.15.55:0/3915823266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7844004d40 msgr2=0x7f78440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.681+0000 7f785f522640 1 --2- 172.21.15.55:0/3915823266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7844004d40 0x7f78440051c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f7850001fa0 tx=0x7f7844005830 comp rx=0 tx=0).stop 2024-04-25T09:00:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.681+0000 7f785dabf640 1 -- 172.21.15.55:0/3915823266 reap_dead start 2024-04-25T09:00:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.681+0000 7f785f522640 1 -- 172.21.15.55:0/3915823266 shutdown_connections 2024-04-25T09:00:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.681+0000 7f785f522640 1 -- 172.21.15.55:0/3915823266 >> 172.21.15.55:0/3915823266 conn(0x7f78580b55e0 msgr2=0x7f78580b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.681+0000 7f785f522640 1 -- 172.21.15.55:0/3915823266 shutdown_connections 2024-04-25T09:00:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.681+0000 7f785f522640 1 -- 172.21.15.55:0/3915823266 wait complete. 2024-04-25T09:00:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.682+0000 7f785f522640 1 Processor -- start 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.682+0000 7f785f522640 1 -- start start 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785f522640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7858151ea0 0x7f7858158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785f522640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858158860 0x7f78580c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785f522640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78580c9ee0 0x7f78581f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785f522640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7858161730 con 0x7f7858151ea0 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785f522640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7858161470 con 0x7f78580c9ee0 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785f522640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78581618b0 con 0x7f7858158860 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785d2be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7858151ea0 0x7f7858158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785d2be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7858151ea0 0x7f7858158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37470/0 (socket says 172.21.15.55:37470) 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785d2be640 1 -- 172.21.15.55:0/3167650364 learned_addr learned my addr 172.21.15.55:0/3167650364 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785dabf640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78580c9ee0 0x7f78581f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785cabd640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858158860 0x7f78580c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785d2be640 1 -- 172.21.15.55:0/3167650364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858158860 msgr2=0x7f78580c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785d2be640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858158860 0x7f78580c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785d2be640 1 -- 172.21.15.55:0/3167650364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78580c9ee0 msgr2=0x7f78581f6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785d2be640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78580c9ee0 0x7f78581f6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785d2be640 1 -- 172.21.15.55:0/3167650364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858152bd0 con 0x7f7858151ea0 2024-04-25T09:00:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.683+0000 7f785d2be640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7858151ea0 0x7f7858158320 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f78540119a0 tx=0x7f7854011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.684+0000 7f784dffb640 1 -- 172.21.15.55:0/3167650364 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785400fa90 con 0x7f7858151ea0 2024-04-25T09:00:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.684+0000 7f784dffb640 1 -- 172.21.15.55:0/3167650364 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785400fc30 con 0x7f7858151ea0 2024-04-25T09:00:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.684+0000 7f785f522640 1 -- 172.21.15.55:0/3167650364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7858152e70 con 0x7f7858151ea0 2024-04-25T09:00:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.684+0000 7f784dffb640 1 -- 172.21.15.55:0/3167650364 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854014440 con 0x7f7858151ea0 2024-04-25T09:00:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.684+0000 7f785f522640 1 -- 172.21.15.55:0/3167650364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7858153430 con 0x7f7858151ea0 2024-04-25T09:00:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.685+0000 7f784dffb640 1 -- 172.21.15.55:0/3167650364 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7854012040 con 0x7f7858151ea0 2024-04-25T09:00:24.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.686+0000 7f784dffb640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f783c06b500 0x7f783c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.686+0000 7f784dffb640 1 -- 172.21.15.55:0/3167650364 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f785408a8d0 con 0x7f7858151ea0 2024-04-25T09:00:24.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.686+0000 7f785cabd640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f783c06b500 0x7f783c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.686+0000 7f785cabd640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f783c06b500 0x7f783c06d9c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f78581f6f20 tx=0x7f7848009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.687+0000 7f7862224740 1 Processor -- start 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.687+0000 7f7862224740 1 -- start start 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.687+0000 7f7862224740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111091bb0 0x558111091f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.687+0000 7f7862224740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55811108c830 0x5581110907b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.687+0000 7f7862224740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x558111091130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.687+0000 7f7862224740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558110ff5ac0 con 0x558111090cf0 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.687+0000 7f7862224740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558110f9ed80 con 0x558111091bb0 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f7862224740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558110ff1b60 con 0x55811108c830 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f785dabf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x558111091130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f785dabf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x558111091130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37480/0 (socket says 172.21.15.55:37480) 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f785dabf640 1 -- 172.21.15.55:0/2927829623 learned_addr learned my addr 172.21.15.55:0/2927829623 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f785dabf640 1 -- 172.21.15.55:0/2927829623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55811108c830 msgr2=0x5581110907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f785dabf640 1 --2- 172.21.15.55:0/2927829623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55811108c830 0x5581110907b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f785dabf640 1 -- 172.21.15.55:0/2927829623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111091bb0 msgr2=0x558111091f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f785d2be640 1 --2- 172.21.15.55:0/2927829623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111091bb0 0x558111091f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f785dabf640 1 --2- 172.21.15.55:0/2927829623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111091bb0 0x558111091f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f785dabf640 1 -- 172.21.15.55:0/2927829623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558110dd27e0 con 0x558111090cf0 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f785d2be640 1 --2- 172.21.15.55:0/2927829623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111091bb0 0x558111091f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f785dabf640 1 --2- 172.21.15.55:0/2927829623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x558111091130 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f7850033040 tx=0x7f7850009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a65682b65b78b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f7842ffd640 1 -- 172.21.15.55:0/2927829623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7850041030 con 0x558111090cf0 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f7842ffd640 1 -- 172.21.15.55:0/2927829623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850006b50 con 0x558111090cf0 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.688+0000 7f7842ffd640 1 -- 172.21.15.55:0/2927829623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7850006d00 con 0x558111090cf0 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.689+0000 7f7862224740 1 -- 172.21.15.55:0/2927829623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 msgr2=0x558111091130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.689+0000 7f7862224740 1 --2- 172.21.15.55:0/2927829623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x558111091130 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f7850033040 tx=0x7f7850009030 comp rx=0 tx=0).stop 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.689+0000 7f7862224740 1 -- 172.21.15.55:0/2927829623 shutdown_connections 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.689+0000 7f7862224740 1 --2- 172.21.15.55:0/2927829623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x558111091130 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.689+0000 7f7862224740 1 --2- 172.21.15.55:0/2927829623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55811108c830 0x5581110907b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.689+0000 7f7862224740 1 --2- 172.21.15.55:0/2927829623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111091bb0 0x558111091f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.689+0000 7f7862224740 1 -- 172.21.15.55:0/2927829623 >> 172.21.15.55:0/2927829623 conn(0x55811108ecb0 msgr2=0x5581110d7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.689+0000 7f7862224740 1 -- 172.21.15.55:0/2927829623 shutdown_connections 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.689+0000 7f7862224740 1 -- 172.21.15.55:0/2927829623 wait complete. 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.689+0000 7f7862224740 1 -- start start 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.690+0000 7f7862224740 1 Processor -- start 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.690+0000 7f7862224740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558111090cf0 0x5581110b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.690+0000 7f7862224740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111091bb0 0x5581110bc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.690+0000 7f7862224740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5581110bc670 0x5581110b7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.690+0000 7f7862224740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581110bd740 con 0x5581110bc670 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.690+0000 7f7862224740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558110f94530 con 0x558111091bb0 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.690+0000 7f7862224740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581110bcbc0 con 0x558111090cf0 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.690+0000 7f7862224740 10 client.0 _ll_register_callbacks cb 0x558110fec130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f785dabf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5581110bc670 0x5581110b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f785dabf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5581110bc670 0x5581110b7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37486/0 (socket says 172.21.15.55:37486) 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f785dabf640 1 -- 172.21.15.55:0/2707807651 learned_addr learned my addr 172.21.15.55:0/2707807651 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f785cabd640 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111091bb0 0x5581110bc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f785d2be640 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558111090cf0 0x5581110b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f785dabf640 1 -- 172.21.15.55:0/2707807651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558111090cf0 msgr2=0x5581110b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f785dabf640 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558111090cf0 0x5581110b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f785dabf640 1 -- 172.21.15.55:0/2707807651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111091bb0 msgr2=0x5581110bc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f785dabf640 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111091bb0 0x5581110bc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f785dabf640 1 -- 172.21.15.55:0/2707807651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558110e32f70 con 0x5581110bc670 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f785dabf640 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5581110bc670 0x5581110b7300 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f785002aa70 tx=0x7f785002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c8a0a444355f94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f7837fff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f7837fff640 1 -- 172.21.15.55:0/2707807651 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785004d060 con 0x5581110bc670 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f7837fff640 1 -- 172.21.15.55:0/2707807651 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f7850005270 con 0x5581110bc670 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f7862224740 1 -- 172.21.15.55:0/2707807651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7850006b50 con 0x5581110bc670 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f7837fff640 1 -- 172.21.15.55:0/2707807651 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7850053050 con 0x5581110bc670 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f7862224740 10 client.7749 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.691+0000 7f7862224740 1 -- 172.21.15.55:0/2707807651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x558110cca170 con 0x5581110bc670 2024-04-25T09:00:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.692+0000 7f7837fff640 1 -- 172.21.15.55:0/2707807651 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850006b50 con 0x5581110bc670 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.692+0000 7f7837fff640 1 -- 172.21.15.55:0/2707807651 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7850056020 con 0x5581110bc670 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.692+0000 7f7862224740 10 client.7749 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.692+0000 7f7862224740 10 client.7749 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.692+0000 7f7862224740 20 client.7749 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.692+0000 7f7862224740 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5581110dade0 0x5581110db1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.692+0000 7f7862224740 4 client.7749 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.692+0000 7f7862224740 1 -- 172.21.15.55:0/2707807651 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558111003000 con 0x5581110dade0 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.692+0000 7f785d2be640 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5581110dade0 0x5581110db1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.692+0000 7f7837fff640 10 client.7749 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.692+0000 7f785d2be640 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5581110dade0 0x5581110db1f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bee7bc79c498b4e server_cookie=bfc3eb4c300cfb82 in_seq=0 out_seq=0 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7837fff640 1 -- 172.21.15.55:0/2707807651 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558111003000 con 0x5581110dade0 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7837fff640 10 client.7749 handle_command_reply: tid=0 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 1 client.7749 shutdown 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 1 -- 172.21.15.55:0/2707807651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5581110bc670 msgr2=0x5581110b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5581110bc670 0x5581110b7300 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f785002aa70 tx=0x7f785002c000 comp rx=0 tx=0).stop 2024-04-25T09:00:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 1 -- 172.21.15.55:0/2707807651 shutdown_connections 2024-04-25T09:00:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5581110dade0 0x5581110db1f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5581110bc670 0x5581110b7300 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111091bb0 0x5581110bc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7837fff640 0 client.7749 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 1 --2- 172.21.15.55:0/2707807651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558111090cf0 0x5581110b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 1 -- 172.21.15.55:0/2707807651 >> 172.21.15.55:0/2707807651 conn(0x55811108c830 msgr2=0x55811108bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 1 -- 172.21.15.55:0/2707807651 shutdown_connections 2024-04-25T09:00:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 1 -- 172.21.15.55:0/2707807651 wait complete. 2024-04-25T09:00:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.693+0000 7f7862224740 20 client.7749 trim_cache size 0 max 16384 2024-04-25T09:00:24.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.708+0000 7f7862224740 1 Processor -- start 2024-04-25T09:00:24.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.708+0000 7f7862224740 1 -- start start 2024-04-25T09:00:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f7862224740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x5581110b1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f7862224740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558111091bb0 0x5581110d5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f7862224740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581110bc670 0x558111138840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f7862224740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7858200cc0 con 0x558111090cf0 2024-04-25T09:00:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f7862224740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78581ffef0 con 0x5581110bc670 2024-04-25T09:00:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f7862224740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78581ff320 con 0x558111091bb0 2024-04-25T09:00:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f785d2be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x5581110b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f785d2be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x5581110b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37496/0 (socket says 172.21.15.55:37496) 2024-04-25T09:00:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f785d2be640 1 -- 172.21.15.55:0/42902140 learned_addr learned my addr 172.21.15.55:0/42902140 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f785d2be640 1 -- 172.21.15.55:0/42902140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558111091bb0 msgr2=0x5581110d5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f785d2be640 1 --2- 172.21.15.55:0/42902140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558111091bb0 0x5581110d5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f785d2be640 1 -- 172.21.15.55:0/42902140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581110bc670 msgr2=0x558111138840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f785d2be640 1 --2- 172.21.15.55:0/42902140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581110bc670 0x558111138840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f785d2be640 1 -- 172.21.15.55:0/42902140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558111093a60 con 0x558111090cf0 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.709+0000 7f785d2be640 1 --2- 172.21.15.55:0/42902140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x5581110b1830 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7854088c80 tx=0x7f785405f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cddbb694f008eda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f78427fc640 1 -- 172.21.15.55:0/42902140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854075070 con 0x558111090cf0 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f78427fc640 1 -- 172.21.15.55:0/42902140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7854086030 con 0x558111090cf0 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f78427fc640 1 -- 172.21.15.55:0/42902140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785408a040 con 0x558111090cf0 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f7862224740 1 -- 172.21.15.55:0/42902140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 msgr2=0x5581110b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f7862224740 1 --2- 172.21.15.55:0/42902140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x5581110b1830 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7854088c80 tx=0x7f785405f040 comp rx=0 tx=0).stop 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f7862224740 1 -- 172.21.15.55:0/42902140 shutdown_connections 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f7862224740 1 --2- 172.21.15.55:0/42902140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581110bc670 0x558111138840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f7862224740 1 --2- 172.21.15.55:0/42902140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558111091bb0 0x5581110d5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f7862224740 1 --2- 172.21.15.55:0/42902140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111090cf0 0x5581110b1830 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f7862224740 1 -- 172.21.15.55:0/42902140 >> 172.21.15.55:0/42902140 conn(0x55811108c830 msgr2=0x5581110d9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f7862224740 1 -- 172.21.15.55:0/42902140 shutdown_connections 2024-04-25T09:00:24.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.710+0000 7f7862224740 1 -- 172.21.15.55:0/42902140 wait complete. 2024-04-25T09:00:24.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.711+0000 7f7862224740 1 -- start start 2024-04-25T09:00:24.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.711+0000 7f7862224740 1 Processor -- start 2024-04-25T09:00:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f7862224740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111090cf0 0x5581110b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f7862224740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111091bb0 0x5581110b7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f7862224740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5581110bc670 0x558111136f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f7862224740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811108e0e0 con 0x558111091bb0 2024-04-25T09:00:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f7862224740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78581ff8f0 con 0x558111090cf0 2024-04-25T09:00:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f7862224740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558111091170 con 0x5581110bc670 2024-04-25T09:00:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f7862224740 10 client.0 _ll_register_callbacks cb 0x7f78440036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f785cabd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111091bb0 0x5581110b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f785cabd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111091bb0 0x5581110b7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37502/0 (socket says 172.21.15.55:37502) 2024-04-25T09:00:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f785cabd640 1 -- 172.21.15.55:0/1731614378 learned_addr learned my addr 172.21.15.55:0/1731614378 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f785d2be640 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111090cf0 0x5581110b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f785dabf640 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5581110bc670 0x558111136f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f785cabd640 1 -- 172.21.15.55:0/1731614378 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5581110bc670 msgr2=0x558111136f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f785cabd640 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5581110bc670 0x558111136f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f785cabd640 1 -- 172.21.15.55:0/1731614378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111090cf0 msgr2=0x5581110b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f785cabd640 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111090cf0 0x5581110b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f785cabd640 1 -- 172.21.15.55:0/1731614378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581110baea0 con 0x558111091bb0 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f785cabd640 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111091bb0 0x5581110b7000 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7848001050 tx=0x7f7848015a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5914d0876776f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f7837fff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f7837fff640 1 -- 172.21.15.55:0/1731614378 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78480146a0 con 0x558111091bb0 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f7837fff640 1 -- 172.21.15.55:0/1731614378 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f784801a880 con 0x558111091bb0 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.712+0000 7f7862224740 1 -- 172.21.15.55:0/1731614378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7854086030 con 0x558111091bb0 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7837fff640 1 -- 172.21.15.55:0/1731614378 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f784801aa80 con 0x558111091bb0 2024-04-25T09:00:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7862224740 10 client.7755 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7862224740 1 -- 172.21.15.55:0/1731614378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x558111137db0 con 0x558111091bb0 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7837fff640 1 -- 172.21.15.55:0/1731614378 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7854086030 con 0x558111091bb0 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7837fff640 1 -- 172.21.15.55:0/1731614378 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7848021040 con 0x558111091bb0 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7862224740 10 client.7755 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7862224740 10 client.7755 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7862224740 20 client.7755 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7862224740 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5581110d8aa0 0x558111137440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7862224740 4 client.7755 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7862224740 1 -- 172.21.15.55:0/1731614378 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x558110ffd350 con 0x5581110d8aa0 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f785d2be640 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5581110d8aa0 0x558111137440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f7837fff640 10 client.7755 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.713+0000 7f785d2be640 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5581110d8aa0 0x558111137440 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41e42717cbf59d7a server_cookie=269e2ac7999d1f14 in_seq=0 out_seq=0 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7837fff640 1 -- 172.21.15.55:0/1731614378 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558110ffd350 con 0x5581110d8aa0 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7837fff640 10 client.7755 handle_command_reply: tid=0 2024-04-25T09:00:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 1 client.7755 shutdown 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 1 -- 172.21.15.55:0/1731614378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111091bb0 msgr2=0x5581110b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111091bb0 0x5581110b7000 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7848001050 tx=0x7f7848015a80 comp rx=0 tx=0).stop 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 1 -- 172.21.15.55:0/1731614378 shutdown_connections 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5581110d8aa0 0x558111137440 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5581110bc670 0x558111136f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558111091bb0 0x5581110b7000 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 1 --2- 172.21.15.55:0/1731614378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558111090cf0 0x5581110b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 1 -- 172.21.15.55:0/1731614378 >> 172.21.15.55:0/1731614378 conn(0x55811108c830 msgr2=0x5581110d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7837fff640 0 client.7755 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 1 -- 172.21.15.55:0/1731614378 shutdown_connections 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 1 -- 172.21.15.55:0/1731614378 wait complete. 2024-04-25T09:00:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.714+0000 7f7862224740 20 client.7755 trim_cache size 0 max 16384 2024-04-25T09:00:24.710 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:00:24.710 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-25T09:00:24.710 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "922d7ed4-5dc2-4c8a-b481-876905fa23cb", 2024-04-25T09:00:24.710 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-25T09:00:24.710 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:00:24.710 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T09:00:24.714+0000 7fd85c606640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-25T08:59:43.731639+0000 1=1+0)->f(v1 m2024-04-25T08:59:43.731639+0000) n(v0 rc2024-04-25T08:59:43.845636+0000 2=1+1)->n(v0 rc2024-04-25T08:59:43.845636+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x556d2f548100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T08:59:43.731639+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T08:59:43.845636+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T09:00:24.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 -- 172.21.15.55:0/3167650364 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f783c06b500 msgr2=0x7f783c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f783c06b500 0x7f783c06d9c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f78581f6f20 tx=0x7f7848009040 comp rx=0 tx=0).stop 2024-04-25T09:00:24.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 -- 172.21.15.55:0/3167650364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7858151ea0 msgr2=0x7f7858158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7858151ea0 0x7f7858158320 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f78540119a0 tx=0x7f7854011e60 comp rx=0 tx=0).stop 2024-04-25T09:00:24.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 -- 172.21.15.55:0/3167650364 shutdown_connections 2024-04-25T09:00:24.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f783c06b500 0x7f783c06d9c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78580c9ee0 0x7f78581f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7858158860 0x7f78580c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 --2- 172.21.15.55:0/3167650364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7858151ea0 0x7f7858158320 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 -- 172.21.15.55:0/3167650364 >> 172.21.15.55:0/3167650364 conn(0x7f78580b55e0 msgr2=0x7f78580b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 -- 172.21.15.55:0/3167650364 shutdown_connections 2024-04-25T09:00:24.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.715+0000 7f785f522640 1 -- 172.21.15.55:0/3167650364 wait complete. 2024-04-25T09:00:24.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:24.715 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:00:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.828+0000 7f9c8935c640 1 Processor -- start 2024-04-25T09:00:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.828+0000 7f9c8935c640 1 -- start start 2024-04-25T09:00:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.829+0000 7f9c8935c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 0x7f9c840cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.829+0000 7f9c8935c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c840cc7e0 con 0x7f9c840cee20 2024-04-25T09:00:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.829+0000 7f9c8935c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c840cb350 con 0x7f9c840ce410 2024-04-25T09:00:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.829+0000 7f9c8935c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840ce9d0 con 0x7f9c8415e040 2024-04-25T09:00:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.829+0000 7f9c837fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9c840cee20 0x7f9c840ad600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48218/0 (socket says 172.21.15.55:48218) 2024-04-25T09:00:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.829+0000 7f9c837fe640 1 -- 172.21.15.55:0/3295349490 learned_addr learned my addr 172.21.15.55:0/3295349490 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:00:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.830+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/3295349490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 0x7f9c840cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.830+0000 7f9c81ffb640 1 -- 172.21.15.55:0/3295349490 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231857146 0 0) 0x7f9c840cc7e0 con 0x7f9c840cee20 2024-04-25T09:00:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.830+0000 7f9c81ffb640 1 -- 172.21.15.55:0/3295349490 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c6c003520 con 0x7f9c840cee20 2024-04-25T09:00:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.830+0000 7f9c81ffb640 1 -- 172.21.15.55:0/3295349490 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549150870 0 0) 0x7f9c840cb350 con 0x7f9c840ce410 2024-04-25T09:00:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.830+0000 7f9c81ffb640 1 -- 172.21.15.55:0/3295349490 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c840cc7e0 con 0x7f9c840ce410 2024-04-25T09:00:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.830+0000 7f9c81ffb640 1 -- 172.21.15.55:0/3295349490 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 465850529 0 0) 0x7f9c6c003520 con 0x7f9c840cee20 2024-04-25T09:00:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.830+0000 7f9c82ffd640 1 -- 172.21.15.55:0/3295349490 >> v1:172.21.15.167:6789/0 conn(0x7f9c840ce410 legacy=0x7f9c840cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.830+0000 7f9c82ffd640 1 -- 172.21.15.55:0/3295349490 >> v1:172.21.15.55:6789/0 conn(0x7f9c840cee20 legacy=0x7f9c840ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.830+0000 7f9c82ffd640 1 -- 172.21.15.55:0/3295349490 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c840cb5f0 con 0x7f9c8415e040 2024-04-25T09:00:24.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.831+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/3295349490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 0x7f9c840cdbb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0097d0 tx=0x7f9c7c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=692b0de0ee8dda29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.831+0000 7f9c81ffb640 1 -- 172.21.15.55:0/3295349490 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c037070 con 0x7f9c8415e040 2024-04-25T09:00:24.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.831+0000 7f9c81ffb640 1 -- 172.21.15.55:0/3295349490 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c02ac30 con 0x7f9c8415e040 2024-04-25T09:00:24.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.831+0000 7f9c81ffb640 1 -- 172.21.15.55:0/3295349490 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c740019f0 con 0x7f9c8415e040 2024-04-25T09:00:24.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.831+0000 7f9c8935c640 1 -- 172.21.15.55:0/3295349490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 msgr2=0x7f9c840cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.831+0000 7f9c8935c640 1 --2- 172.21.15.55:0/3295349490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 0x7f9c840cdbb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0097d0 tx=0x7f9c7c02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.832+0000 7f9c8935c640 1 -- 172.21.15.55:0/3295349490 shutdown_connections 2024-04-25T09:00:24.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.832+0000 7f9c8935c640 1 --2- 172.21.15.55:0/3295349490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 0x7f9c840cdbb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.832+0000 7f9c8935c640 1 -- 172.21.15.55:0/3295349490 >> 172.21.15.55:0/3295349490 conn(0x7f9c840b2390 msgr2=0x7f9c840b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.832+0000 7f9c8935c640 1 -- 172.21.15.55:0/3295349490 shutdown_connections 2024-04-25T09:00:24.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.832+0000 7f9c8935c640 1 -- 172.21.15.55:0/3295349490 wait complete. 2024-04-25T09:00:24.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.833+0000 7f9c8935c640 1 Processor -- start 2024-04-25T09:00:24.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.833+0000 7f9c8935c640 1 -- start start 2024-04-25T09:00:24.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c8935c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c840ce410 0x7f9c840c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c8935c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840cee20 0x7f9c8415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c8935c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 0x7f9c840c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c8935c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8415e420 con 0x7f9c840ce410 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c8935c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840cbbb0 con 0x7f9c840cee20 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c8935c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840ce0f0 con 0x7f9c8415e040 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c840ce410 0x7f9c840c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c840ce410 0x7f9c840c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37510/0 (socket says 172.21.15.55:37510) 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c82ffd640 1 -- 172.21.15.55:0/1819887540 learned_addr learned my addr 172.21.15.55:0/1819887540 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c827fc640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840cee20 0x7f9c8415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c837fe640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 0x7f9c840c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c82ffd640 1 -- 172.21.15.55:0/1819887540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 msgr2=0x7f9c840c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 0x7f9c840c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c82ffd640 1 -- 172.21.15.55:0/1819887540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840cee20 msgr2=0x7f9c8415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840cee20 0x7f9c8415b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c82ffd640 1 -- 172.21.15.55:0/1819887540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8415a490 con 0x7f9c840ce410 2024-04-25T09:00:24.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c827fc640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840cee20 0x7f9c8415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:24.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c837fe640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 0x7f9c840c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:24.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c840ce410 0x7f9c840c8320 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0097d0 tx=0x7f9c7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c6b7fe640 1 -- 172.21.15.55:0/1819887540 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c037040 con 0x7f9c840ce410 2024-04-25T09:00:24.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.834+0000 7f9c6b7fe640 1 -- 172.21.15.55:0/1819887540 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c004230 con 0x7f9c840ce410 2024-04-25T09:00:24.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.835+0000 7f9c6b7fe640 1 -- 172.21.15.55:0/1819887540 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c006e10 con 0x7f9c840ce410 2024-04-25T09:00:24.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.835+0000 7f9c8935c640 1 -- 172.21.15.55:0/1819887540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8415a770 con 0x7f9c840ce410 2024-04-25T09:00:24.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.835+0000 7f9c8935c640 1 -- 172.21.15.55:0/1819887540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8415ad30 con 0x7f9c840ce410 2024-04-25T09:00:24.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.836+0000 7f9c6b7fe640 1 -- 172.21.15.55:0/1819887540 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c7c003610 con 0x7f9c840ce410 2024-04-25T09:00:24.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.836+0000 7f9c6b7fe640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c7006b4d0 0x7f9c7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.837+0000 7f9c6b7fe640 1 -- 172.21.15.55:0/1819887540 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f9c7c0ab1b0 con 0x7f9c840ce410 2024-04-25T09:00:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.837+0000 7f9c827fc640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c7006b4d0 0x7f9c7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.837+0000 7f9c827fc640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c7006b4d0 0x7f9c7006d990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9c841f5b30 tx=0x7f9c78009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.837+0000 7f9c8c067740 1 Processor -- start 2024-04-25T09:00:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.838+0000 7f9c8c067740 1 -- start start 2024-04-25T09:00:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.838+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10b10 0x557abdd13320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.838+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10ef0 0x557abdd13860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.838+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdce3770 0x557abdce6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.838+0000 7f9c8c067740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557abdc4cda0 con 0x557abdd10b10 2024-04-25T09:00:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.838+0000 7f9c8c067740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557abdbf5b80 con 0x557abdce3770 2024-04-25T09:00:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.838+0000 7f9c8c067740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557abdc48e40 con 0x557abdd10ef0 2024-04-25T09:00:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.838+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10b10 0x557abdd13320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.838+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10b10 0x557abdd13320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37514/0 (socket says 172.21.15.55:37514) 2024-04-25T09:00:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.838+0000 7f9c82ffd640 1 -- 172.21.15.55:0/3591597489 learned_addr learned my addr 172.21.15.55:0/3591597489 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.839+0000 7f9c827fc640 1 --2- 172.21.15.55:0/3591597489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10ef0 0x557abdd13860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.839+0000 7f9c837fe640 1 --2- 172.21.15.55:0/3591597489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdce3770 0x557abdce6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.839+0000 7f9c82ffd640 1 -- 172.21.15.55:0/3591597489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10ef0 msgr2=0x557abdd13860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.839+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/3591597489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10ef0 0x557abdd13860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.839+0000 7f9c82ffd640 1 -- 172.21.15.55:0/3591597489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdce3770 msgr2=0x557abdce6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.839+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/3591597489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdce3770 0x557abdce6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.839+0000 7f9c82ffd640 1 -- 172.21.15.55:0/3591597489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557abdbfff10 con 0x557abdd10b10 2024-04-25T09:00:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.839+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/3591597489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10b10 0x557abdd13320 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c081a20 tx=0x7f9c7c079740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08f376b32c477d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.839+0000 7f9c68ff9640 1 -- 172.21.15.55:0/3591597489 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c07d990 con 0x557abdd10b10 2024-04-25T09:00:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.839+0000 7f9c68ff9640 1 -- 172.21.15.55:0/3591597489 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c081f50 con 0x557abdd10b10 2024-04-25T09:00:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.839+0000 7f9c68ff9640 1 -- 172.21.15.55:0/3591597489 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c075eb0 con 0x557abdd10b10 2024-04-25T09:00:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.840+0000 7f9c8c067740 1 -- 172.21.15.55:0/3591597489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10b10 msgr2=0x557abdd13320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.840+0000 7f9c8c067740 1 --2- 172.21.15.55:0/3591597489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10b10 0x557abdd13320 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c081a20 tx=0x7f9c7c079740 comp rx=0 tx=0).stop 2024-04-25T09:00:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.840+0000 7f9c8c067740 1 -- 172.21.15.55:0/3591597489 shutdown_connections 2024-04-25T09:00:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.840+0000 7f9c8c067740 1 --2- 172.21.15.55:0/3591597489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdce3770 0x557abdce6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.840+0000 7f9c8c067740 1 --2- 172.21.15.55:0/3591597489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10ef0 0x557abdd13860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.840+0000 7f9c8c067740 1 --2- 172.21.15.55:0/3591597489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10b10 0x557abdd13320 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.840+0000 7f9c8c067740 1 -- 172.21.15.55:0/3591597489 >> 172.21.15.55:0/3591597489 conn(0x557abdce59e0 msgr2=0x557abdd2e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.840+0000 7f9c8c067740 1 -- 172.21.15.55:0/3591597489 shutdown_connections 2024-04-25T09:00:24.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.840+0000 7f9c8c067740 1 -- 172.21.15.55:0/3591597489 wait complete. 2024-04-25T09:00:24.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.840+0000 7f9c8c067740 1 -- start start 2024-04-25T09:00:24.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.840+0000 7f9c8c067740 1 Processor -- start 2024-04-25T09:00:24.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10b10 0x557abdd30dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd13370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd07c00 0x557abdd2f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c8c067740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557abdc4cda0 con 0x557abdd10ef0 2024-04-25T09:00:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c8c067740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557abdbeb4b0 con 0x557abdd07c00 2024-04-25T09:00:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c8c067740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557abdce8b90 con 0x557abdd10b10 2024-04-25T09:00:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c8c067740 10 client.0 _ll_register_callbacks cb 0x557abdc2b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c827fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd13370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c827fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd13370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37520/0 (socket says 172.21.15.55:37520) 2024-04-25T09:00:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c827fc640 1 -- 172.21.15.55:0/1725403139 learned_addr learned my addr 172.21.15.55:0/1725403139 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10b10 0x557abdd30dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c837fe640 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd07c00 0x557abdd2f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.841+0000 7f9c827fc640 1 -- 172.21.15.55:0/1725403139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10b10 msgr2=0x557abdd30dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c827fc640 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10b10 0x557abdd30dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c827fc640 1 -- 172.21.15.55:0/1725403139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd07c00 msgr2=0x557abdd2f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c827fc640 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd07c00 0x557abdd2f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c827fc640 1 -- 172.21.15.55:0/1725403139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557abda2b7d0 con 0x557abdd10ef0 2024-04-25T09:00:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10b10 0x557abdd30dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c837fe640 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd07c00 0x557abdd2f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c827fc640 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd13370 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f9c78005600 tx=0x7f9c78000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f33c275019ff46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c61ffb640 1 -- 172.21.15.55:0/1725403139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78027060 con 0x557abdd10ef0 2024-04-25T09:00:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c61ffb640 1 -- 172.21.15.55:0/1725403139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f9c78010040 con 0x557abdd10ef0 2024-04-25T09:00:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c8c067740 1 -- 172.21.15.55:0/1725403139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9c7c081f50 con 0x557abdd10ef0 2024-04-25T09:00:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c61ffb640 1 -- 172.21.15.55:0/1725403139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c78003a40 con 0x557abdd10ef0 2024-04-25T09:00:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c8c067740 10 client.7767 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c8c067740 1 -- 172.21.15.55:0/1725403139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x557abd9613f0 con 0x557abdd10ef0 2024-04-25T09:00:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c61ffb640 1 -- 172.21.15.55:0/1725403139 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c081f50 con 0x557abdd10ef0 2024-04-25T09:00:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c61ffb640 1 -- 172.21.15.55:0/1725403139 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9c78003be0 con 0x557abdd10ef0 2024-04-25T09:00:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c8c067740 10 client.7767 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c8c067740 10 client.7767 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:00:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c8c067740 20 client.7767 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c8c067740 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x557abdd41970 0x557abdd41d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c8c067740 4 client.7767 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:00:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.842+0000 7f9c8c067740 1 -- 172.21.15.55:0/1725403139 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557abdc5a2e0 con 0x557abdd41970 2024-04-25T09:00:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x557abdd41970 0x557abdd41d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c61ffb640 10 client.7767 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x557abdd41970 0x557abdd41d80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d723f1ce1523bcb7 server_cookie=235284516f9059f1 in_seq=0 out_seq=0 2024-04-25T09:00:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c61ffb640 1 -- 172.21.15.55:0/1725403139 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557abdc5a2e0 con 0x557abdd41970 2024-04-25T09:00:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c61ffb640 10 client.7767 handle_command_reply: tid=0 2024-04-25T09:00:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c8c067740 1 client.7767 shutdown 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c8c067740 1 -- 172.21.15.55:0/1725403139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 msgr2=0x557abdd13370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c8c067740 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd13370 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f9c78005600 tx=0x7f9c78000ed0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c8c067740 1 -- 172.21.15.55:0/1725403139 shutdown_connections 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c8c067740 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x557abdd41970 0x557abdd41d80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c8c067740 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd07c00 0x557abdd2f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c8c067740 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd13370 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c8c067740 1 --2- 172.21.15.55:0/1725403139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10b10 0x557abdd30dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c61ffb640 0 client.7767 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.843+0000 7f9c8c067740 1 -- 172.21.15.55:0/1725403139 >> 172.21.15.55:0/1725403139 conn(0x557abdce3770 msgr2=0x557abdce4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.844+0000 7f9c8c067740 1 -- 172.21.15.55:0/1725403139 shutdown_connections 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.844+0000 7f9c8c067740 1 -- 172.21.15.55:0/1725403139 wait complete. 2024-04-25T09:00:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.844+0000 7f9c8c067740 20 client.7767 trim_cache size 0 max 16384 2024-04-25T09:00:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.859+0000 7f9c8c067740 1 Processor -- start 2024-04-25T09:00:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.859+0000 7f9c8c067740 1 -- start start 2024-04-25T09:00:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd07c00 0x557abdd0e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd10b10 0x557abdd30be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd15a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c8c067740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c841fdd90 con 0x557abdd10ef0 2024-04-25T09:00:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c8c067740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c841fcf30 con 0x557abdd10b10 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c8c067740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c841f57e0 con 0x557abdd07c00 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd15a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd15a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37532/0 (socket says 172.21.15.55:37532) 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c837fe640 1 -- 172.21.15.55:0/390717887 learned_addr learned my addr 172.21.15.55:0/390717887 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/390717887 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd07c00 0x557abdd0e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c827fc640 1 --2- 172.21.15.55:0/390717887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd10b10 0x557abdd30be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c837fe640 1 -- 172.21.15.55:0/390717887 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd07c00 msgr2=0x557abdd0e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c837fe640 1 --2- 172.21.15.55:0/390717887 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd07c00 0x557abdd0e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c837fe640 1 -- 172.21.15.55:0/390717887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd10b10 msgr2=0x557abdd30be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c837fe640 1 --2- 172.21.15.55:0/390717887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd10b10 0x557abdd30be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c837fe640 1 -- 172.21.15.55:0/390717887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557abd9210f0 con 0x557abdd10ef0 2024-04-25T09:00:24.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.860+0000 7f9c837fe640 1 --2- 172.21.15.55:0/390717887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd15a60 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007130 tx=0x7f9c740075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad533ce3b24755 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.868+0000 7f9c63fff640 1 -- 172.21.15.55:0/390717887 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7401a030 con 0x557abdd10ef0 2024-04-25T09:00:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.868+0000 7f9c63fff640 1 -- 172.21.15.55:0/390717887 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74016480 con 0x557abdd10ef0 2024-04-25T09:00:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.868+0000 7f9c63fff640 1 -- 172.21.15.55:0/390717887 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74016650 con 0x557abdd10ef0 2024-04-25T09:00:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.868+0000 7f9c8c067740 1 -- 172.21.15.55:0/390717887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 msgr2=0x557abdd15a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.868+0000 7f9c8c067740 1 --2- 172.21.15.55:0/390717887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd15a60 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007130 tx=0x7f9c740075f0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.868+0000 7f9c8c067740 1 -- 172.21.15.55:0/390717887 shutdown_connections 2024-04-25T09:00:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.868+0000 7f9c8c067740 1 --2- 172.21.15.55:0/390717887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd10ef0 0x557abdd15a60 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.868+0000 7f9c8c067740 1 --2- 172.21.15.55:0/390717887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd10b10 0x557abdd30be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.868+0000 7f9c8c067740 1 --2- 172.21.15.55:0/390717887 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd07c00 0x557abdd0e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.868+0000 7f9c8c067740 1 -- 172.21.15.55:0/390717887 >> 172.21.15.55:0/390717887 conn(0x557abdce3770 msgr2=0x557abdd36410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.869+0000 7f9c8c067740 1 -- 172.21.15.55:0/390717887 shutdown_connections 2024-04-25T09:00:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.869+0000 7f9c8c067740 1 -- 172.21.15.55:0/390717887 wait complete. 2024-04-25T09:00:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.869+0000 7f9c8c067740 1 -- start start 2024-04-25T09:00:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.869+0000 7f9c8c067740 1 Processor -- start 2024-04-25T09:00:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd07c00 0x557abdd15970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd10b10 0x557abdd15eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c8c067740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10ef0 0x557abdd3cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c8c067740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557abdd13a50 con 0x557abdd07c00 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c8c067740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840b3d20 con 0x557abdd10b10 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c8c067740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557abdd135c0 con 0x557abdd10ef0 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c8c067740 10 client.0 _ll_register_callbacks cb 0x7f9c7c009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd07c00 0x557abdd15970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd07c00 0x557abdd15970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37534/0 (socket says 172.21.15.55:37534) 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c82ffd640 1 -- 172.21.15.55:0/725729994 learned_addr learned my addr 172.21.15.55:0/725729994 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c837fe640 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10ef0 0x557abdd3cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c827fc640 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd10b10 0x557abdd15eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c82ffd640 1 -- 172.21.15.55:0/725729994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10ef0 msgr2=0x557abdd3cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10ef0 0x557abdd3cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c82ffd640 1 -- 172.21.15.55:0/725729994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd10b10 msgr2=0x557abdd15eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd10b10 0x557abdd15eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.870+0000 7f9c82ffd640 1 -- 172.21.15.55:0/725729994 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557abdd40d90 con 0x557abdd07c00 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c82ffd640 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd07c00 0x557abdd15970 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c079a00 tx=0x7f9c7c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52909a805cddc5ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c61ffb640 1 -- 172.21.15.55:0/725729994 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c077b40 con 0x557abdd07c00 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c61ffb640 1 -- 172.21.15.55:0/725729994 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f9c7c0a9240 con 0x557abdd07c00 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c8c067740 1 -- 172.21.15.55:0/725729994 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9c74016480 con 0x557abdd07c00 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c61ffb640 1 -- 172.21.15.55:0/725729994 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c7c0982d0 con 0x557abdd07c00 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c8c067740 10 client.7773 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c8c067740 1 -- 172.21.15.55:0/725729994 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x557abdd2ef40 con 0x557abdd07c00 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c61ffb640 1 -- 172.21.15.55:0/725729994 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74016480 con 0x557abdd07c00 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c61ffb640 1 -- 172.21.15.55:0/725729994 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9c7c04f060 con 0x557abdd07c00 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c8c067740 10 client.7773 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c8c067740 10 client.7773 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c8c067740 20 client.7773 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c8c067740 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x557abdd122e0 0x557abdd3d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c8c067740 4 client.7773 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.871+0000 7f9c8c067740 1 -- 172.21.15.55:0/725729994 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557abdc54630 con 0x557abdd122e0 2024-04-25T09:00:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c827fc640 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x557abdd122e0 0x557abdd3d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c827fc640 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x557abdd122e0 0x557abdd3d480 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=417963ca0b288026 server_cookie=9b015e258194d1e1 in_seq=0 out_seq=0 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c61ffb640 10 client.7773 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c61ffb640 1 -- 172.21.15.55:0/725729994 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x557abdc54630 con 0x557abdd122e0 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c61ffb640 10 client.7773 handle_command_reply: tid=0 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c8c067740 1 client.7773 shutdown 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c8c067740 1 -- 172.21.15.55:0/725729994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd07c00 msgr2=0x557abdd15970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c8c067740 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd07c00 0x557abdd15970 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c079a00 tx=0x7f9c7c009190 comp rx=0 tx=0).stop 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c8c067740 1 -- 172.21.15.55:0/725729994 shutdown_connections 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c8c067740 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x557abdd122e0 0x557abdd3d480 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c8c067740 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557abdd10ef0 0x557abdd3cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c8c067740 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557abdd10b10 0x557abdd15eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c8c067740 1 --2- 172.21.15.55:0/725729994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557abdd07c00 0x557abdd15970 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c8c067740 1 -- 172.21.15.55:0/725729994 >> 172.21.15.55:0/725729994 conn(0x557abdce3770 msgr2=0x557abdcdeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.872+0000 7f9c61ffb640 0 client.7773 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8c067740 1 -- 172.21.15.55:0/725729994 shutdown_connections 2024-04-25T09:00:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8c067740 1 -- 172.21.15.55:0/725729994 wait complete. 2024-04-25T09:00:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8c067740 20 client.7773 trim_cache size 0 max 16384 2024-04-25T09:00:24.866 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:00:24.866 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:00:24.866 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-25T09:00:24.866 INFO:teuthology.orchestra.run.smithi055.stdout: "922d7ed4-5dc2-4c8a-b481-876905fa23cb": { 2024-04-25T09:00:24.866 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir", 2024-04-25T09:00:24.866 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "922d7ed4-5dc2-4c8a-b481-876905fa23cb", 2024-04-25T09:00:24.866 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-25T09:00:24.867 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:00:24.867 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:00:24.867 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:00:24.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 -- 172.21.15.55:0/1819887540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c7006b4d0 msgr2=0x7f9c7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c7006b4d0 0x7f9c7006d990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9c841f5b30 tx=0x7f9c78009040 comp rx=0 tx=0).stop 2024-04-25T09:00:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 -- 172.21.15.55:0/1819887540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c840ce410 msgr2=0x7f9c840c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c840ce410 0x7f9c840c8320 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0097d0 tx=0x7f9c7c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 -- 172.21.15.55:0/1819887540 shutdown_connections 2024-04-25T09:00:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c7006b4d0 0x7f9c7006d990 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8415e040 0x7f9c840c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840cee20 0x7f9c8415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 --2- 172.21.15.55:0/1819887540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c840ce410 0x7f9c840c8320 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 -- 172.21.15.55:0/1819887540 >> 172.21.15.55:0/1819887540 conn(0x7f9c840b2390 msgr2=0x7f9c8406fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 -- 172.21.15.55:0/1819887540 shutdown_connections 2024-04-25T09:00:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:24.873+0000 7f9c8935c640 1 -- 172.21.15.55:0/1819887540 wait complete. 2024-04-25T09:00:24.873 INFO:tasks.cephfs.filesystem:scrub status for tag:922d7ed4-5dc2-4c8a-b481-876905fa23cb - {'path': '/dir', 'tag': '922d7ed4-5dc2-4c8a-b481-876905fa23cb', 'options': 'recursive,repair'} 2024-04-25T09:00:40.595 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:40.598 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:54.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:54.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:00:54.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.002+0000 7f484fd29640 1 Processor -- start 2024-04-25T09:00:54.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.003+0000 7f484fd29640 1 -- start start 2024-04-25T09:00:54.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.003+0000 7f484fd29640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f484815df30 0x7f48480cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.003+0000 7f484fd29640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48480d12a0 0x7f4848099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.003+0000 7f484fd29640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48480d0200 con 0x7f484815db50 2024-04-25T09:00:54.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.003+0000 7f484fd29640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484806c020 con 0x7f484815df30 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.003+0000 7f484fd29640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48480d04e0 con 0x7f48480d12a0 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484dac5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f484815db50 0x7f484806cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42056/0 (socket says 172.21.15.55:42056) 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484dac5640 1 -- 172.21.15.55:0/3105639641 learned_addr learned my addr 172.21.15.55:0/3105639641 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690210976 0 0) 0x7f48480d0200 con 0x7f484815db50 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4834003520 con 0x7f484815db50 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484e2c6640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48480d12a0 0x7f4848099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484d2c4640 1 --2- 172.21.15.55:0/3105639641 >> v2:172.21.15.167:3300/0 conn(0x7f484815df30 0x7f48480cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2004887564 0 0) 0x7f4834003520 con 0x7f484815db50 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48480d12a0 msgr2=0x7f4848099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48480d12a0 0x7f4848099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 >> v2:172.21.15.167:3300/0 conn(0x7f484815df30 msgr2=0x7f48480cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 --2- 172.21.15.55:0/3105639641 >> v2:172.21.15.167:3300/0 conn(0x7f484815df30 0x7f48480cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48480d07c0 con 0x7f484815db50 2024-04-25T09:00:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f48440019f0 con 0x7f484815db50 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 >> v1:172.21.15.55:6789/0 conn(0x7f484815db50 legacy=0x7f484806cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 0x7f4834003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4834004800 0x7f4834004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48480d12a0 0x7f48340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484806c020 con 0x7f48340039b0 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48480d04e0 con 0x7f4834004800 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483400b9c0 con 0x7f48480d12a0 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.004+0000 7f484dac5640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 0x7f4834003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.005+0000 7f484d2c4640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4834004800 0x7f4834004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.005+0000 7f484e2c6640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48480d12a0 0x7f48340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.005+0000 7f484dac5640 1 -- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48480d12a0 msgr2=0x7f48340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.005+0000 7f484dac5640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48480d12a0 0x7f48340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.005+0000 7f484dac5640 1 -- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4834004800 msgr2=0x7f4834004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.005+0000 7f484dac5640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4834004800 0x7f4834004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.005+0000 7f484dac5640 1 -- 172.21.15.55:0/3105639641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4834003520 con 0x7f48340039b0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.005+0000 7f484d2c4640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4834004800 0x7f4834004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.005+0000 7f484dac5640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 0x7f4834003dd0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f484400a890 tx=0x7f4834005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bbf9f44d40213d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.006+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400a4e0 con 0x7f48340039b0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.006+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484402f070 con 0x7f48340039b0 2024-04-25T09:00:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.006+0000 7f484cac3640 1 -- 172.21.15.55:0/3105639641 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484402bcf0 con 0x7f48340039b0 2024-04-25T09:00:54.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.006+0000 7f484fd29640 1 -- 172.21.15.55:0/3105639641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 msgr2=0x7f4834003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.006+0000 7f484fd29640 1 --2- 172.21.15.55:0/3105639641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 0x7f4834003dd0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f484400a890 tx=0x7f4834005830 comp rx=0 tx=0).stop 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.006+0000 7f484e2c6640 1 -- 172.21.15.55:0/3105639641 reap_dead start 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.006+0000 7f484fd29640 1 -- 172.21.15.55:0/3105639641 shutdown_connections 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.006+0000 7f484fd29640 1 -- 172.21.15.55:0/3105639641 >> 172.21.15.55:0/3105639641 conn(0x7f48480b3430 msgr2=0x7f48480b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.006+0000 7f484fd29640 1 -- 172.21.15.55:0/3105639641 shutdown_connections 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.006+0000 7f484fd29640 1 -- 172.21.15.55:0/3105639641 wait complete. 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.008+0000 7f484fd29640 1 Processor -- start 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.008+0000 7f484fd29640 1 -- start start 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.008+0000 7f484fd29640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 0x7f48481549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.008+0000 7f484fd29640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4848158cb0 0x7f48481543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.008+0000 7f484fd29640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48480704d0 0x7f4848070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.008+0000 7f484fd29640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4848099a40 con 0x7f48340039b0 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.008+0000 7f484fd29640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48480d0d80 con 0x7f48480704d0 2024-04-25T09:00:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.008+0000 7f484fd29640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4848099bc0 con 0x7f4848158cb0 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.008+0000 7f484dac5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 0x7f48481549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484dac5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 0x7f48481549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51078/0 (socket says 172.21.15.55:51078) 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484dac5640 1 -- 172.21.15.55:0/1300556070 learned_addr learned my addr 172.21.15.55:0/1300556070 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484dac5640 1 -- 172.21.15.55:0/1300556070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4848158cb0 msgr2=0x7f48481543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484d2c4640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4848158cb0 0x7f48481543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484e2c6640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48480704d0 0x7f4848070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484dac5640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4848158cb0 0x7f48481543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484dac5640 1 -- 172.21.15.55:0/1300556070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48480704d0 msgr2=0x7f4848070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484dac5640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48480704d0 0x7f4848070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484dac5640 1 -- 172.21.15.55:0/1300556070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4848159220 con 0x7f48340039b0 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484dac5640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 0x7f48481549b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f484400a890 tx=0x7f4844001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f483e7fc640 1 -- 172.21.15.55:0/1300556070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484402ba90 con 0x7f48340039b0 2024-04-25T09:00:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f483e7fc640 1 -- 172.21.15.55:0/1300556070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484402bc30 con 0x7f48340039b0 2024-04-25T09:00:55.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484fd29640 1 -- 172.21.15.55:0/1300556070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4848159500 con 0x7f48340039b0 2024-04-25T09:00:55.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f483e7fc640 1 -- 172.21.15.55:0/1300556070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844004e30 con 0x7f48340039b0 2024-04-25T09:00:55.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.009+0000 7f484fd29640 1 -- 172.21.15.55:0/1300556070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4848159ac0 con 0x7f48340039b0 2024-04-25T09:00:55.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.011+0000 7f483e7fc640 1 -- 172.21.15.55:0/1300556070 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4844034470 con 0x7f48340039b0 2024-04-25T09:00:55.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.011+0000 7f483e7fc640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f482c06b500 0x7f482c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.011+0000 7f483e7fc640 1 -- 172.21.15.55:0/1300556070 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f48440aa800 con 0x7f48340039b0 2024-04-25T09:00:55.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.011+0000 7f484d2c4640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f482c06b500 0x7f482c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.012+0000 7f484d2c4640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f482c06b500 0x7f482c06d9c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f48481e8510 tx=0x7f4838008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.012+0000 7f4852a2c740 1 Processor -- start 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.012+0000 7f4852a2c740 1 -- start start 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.013+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6d75320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.013+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72ef0 0x5575e6d75860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.013+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d45770 0x5575e6d48f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.013+0000 7f4852a2c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e6caeda0 con 0x5575e6d72b10 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.013+0000 7f4852a2c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e6c57b80 con 0x5575e6d72ef0 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.013+0000 7f4852a2c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575e6caae40 con 0x5575e6d45770 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.013+0000 7f484dac5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6d75320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.013+0000 7f484dac5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6d75320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51082/0 (socket says 172.21.15.55:51082) 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.013+0000 7f484dac5640 1 -- 172.21.15.55:0/2252948800 learned_addr learned my addr 172.21.15.55:0/2252948800 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.013+0000 7f484d2c4640 1 --2- 172.21.15.55:0/2252948800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72ef0 0x5575e6d75860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.013+0000 7f484e2c6640 1 --2- 172.21.15.55:0/2252948800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d45770 0x5575e6d48f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.014+0000 7f484dac5640 1 -- 172.21.15.55:0/2252948800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d45770 msgr2=0x5575e6d48f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.014+0000 7f484dac5640 1 --2- 172.21.15.55:0/2252948800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d45770 0x5575e6d48f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.014+0000 7f484dac5640 1 -- 172.21.15.55:0/2252948800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72ef0 msgr2=0x5575e6d75860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.014+0000 7f484dac5640 1 --2- 172.21.15.55:0/2252948800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72ef0 0x5575e6d75860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.014+0000 7f484dac5640 1 -- 172.21.15.55:0/2252948800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575e6c61f10 con 0x5575e6d72b10 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.014+0000 7f484dac5640 1 --2- 172.21.15.55:0/2252948800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6d75320 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f48440752a0 tx=0x7f4844033eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e18ba685aa467b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.014+0000 7f482b7fe640 1 -- 172.21.15.55:0/2252948800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844078e90 con 0x5575e6d72b10 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.014+0000 7f482b7fe640 1 -- 172.21.15.55:0/2252948800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484408ce50 con 0x5575e6d72b10 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.014+0000 7f482b7fe640 1 -- 172.21.15.55:0/2252948800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484407cfe0 con 0x5575e6d72b10 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.015+0000 7f4852a2c740 1 -- 172.21.15.55:0/2252948800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 msgr2=0x5575e6d75320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.015+0000 7f4852a2c740 1 --2- 172.21.15.55:0/2252948800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6d75320 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f48440752a0 tx=0x7f4844033eb0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.015+0000 7f4852a2c740 1 -- 172.21.15.55:0/2252948800 shutdown_connections 2024-04-25T09:00:55.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.015+0000 7f4852a2c740 1 --2- 172.21.15.55:0/2252948800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d45770 0x5575e6d48f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.015+0000 7f4852a2c740 1 --2- 172.21.15.55:0/2252948800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72ef0 0x5575e6d75860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.015+0000 7f4852a2c740 1 --2- 172.21.15.55:0/2252948800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6d75320 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.015+0000 7f4852a2c740 1 -- 172.21.15.55:0/2252948800 >> 172.21.15.55:0/2252948800 conn(0x5575e6d479e0 msgr2=0x5575e6d90320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.015+0000 7f4852a2c740 1 -- 172.21.15.55:0/2252948800 shutdown_connections 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.015+0000 7f4852a2c740 1 -- 172.21.15.55:0/2252948800 wait complete. 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.015+0000 7f4852a2c740 1 -- start start 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.015+0000 7f4852a2c740 1 Processor -- start 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.016+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72b10 0x5575e6d938f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.016+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d72ef0 0x5575e6d91450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.016+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d91990 0x5575e6d91df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.016+0000 7f4852a2c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e6c57b80 con 0x5575e6d91990 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.016+0000 7f4852a2c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e6c4d4b0 con 0x5575e6d72b10 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.016+0000 7f4852a2c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575e6caeda0 con 0x5575e6d72ef0 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.016+0000 7f4852a2c740 10 client.0 _ll_register_callbacks cb 0x5575e6c8d180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:55.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.016+0000 7f484e2c6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d91990 0x5575e6d91df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.016+0000 7f484e2c6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d91990 0x5575e6d91df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51094/0 (socket says 172.21.15.55:51094) 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.016+0000 7f484e2c6640 1 -- 172.21.15.55:0/3915353014 learned_addr learned my addr 172.21.15.55:0/3915353014 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.016+0000 7f484d2c4640 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d72ef0 0x5575e6d91450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f484dac5640 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72b10 0x5575e6d938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f484e2c6640 1 -- 172.21.15.55:0/3915353014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d72ef0 msgr2=0x5575e6d91450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f484e2c6640 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d72ef0 0x5575e6d91450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f484e2c6640 1 -- 172.21.15.55:0/3915353014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72b10 msgr2=0x5575e6d938f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f484e2c6640 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72b10 0x5575e6d938f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f484e2c6640 1 -- 172.21.15.55:0/3915353014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575e6a8d7d0 con 0x5575e6d91990 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f484e2c6640 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d91990 0x5575e6d91df0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f484806dcc0 tx=0x7f4840015730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be81f3f7116afca6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f4828ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f4828ff9640 1 -- 172.21.15.55:0/3915353014 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840004030 con 0x5575e6d91990 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f4828ff9640 1 -- 172.21.15.55:0/3915353014 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f48400041d0 con 0x5575e6d91990 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f4852a2c740 1 -- 172.21.15.55:0/3915353014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f484408ce50 con 0x5575e6d91990 2024-04-25T09:00:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f4828ff9640 1 -- 172.21.15.55:0/3915353014 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4840004410 con 0x5575e6d91990 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f4852a2c740 10 client.7785 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.017+0000 7f4852a2c740 1 -- 172.21.15.55:0/3915353014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x5575e69c33f0 con 0x5575e6d91990 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.018+0000 7f4828ff9640 1 -- 172.21.15.55:0/3915353014 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484408ce50 con 0x5575e6d91990 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.018+0000 7f4828ff9640 1 -- 172.21.15.55:0/3915353014 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4840003610 con 0x5575e6d91990 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.018+0000 7f4852a2c740 10 client.7785 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.018+0000 7f4852a2c740 10 client.7785 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.018+0000 7f4852a2c740 20 client.7785 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.018+0000 7f4852a2c740 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5575e6d78a50 0x5575e6d78e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.018+0000 7f4852a2c740 4 client.7785 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.018+0000 7f4852a2c740 1 -- 172.21.15.55:0/3915353014 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575e6cbc2e0 con 0x5575e6d78a50 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.018+0000 7f484dac5640 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5575e6d78a50 0x5575e6d78e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.018+0000 7f4828ff9640 10 client.7785 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.018+0000 7f484dac5640 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5575e6d78a50 0x5575e6d78e80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6248081e44fb5fba server_cookie=73dad0a27605358e in_seq=0 out_seq=0 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4828ff9640 1 -- 172.21.15.55:0/3915353014 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5575e6cbc2e0 con 0x5575e6d78a50 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4828ff9640 10 client.7785 handle_command_reply: tid=0 2024-04-25T09:00:55.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 1 client.7785 shutdown 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 1 -- 172.21.15.55:0/3915353014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d91990 msgr2=0x5575e6d91df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d91990 0x5575e6d91df0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f484806dcc0 tx=0x7f4840015730 comp rx=0 tx=0).stop 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 1 -- 172.21.15.55:0/3915353014 shutdown_connections 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5575e6d78a50 0x5575e6d78e80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d91990 0x5575e6d91df0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d72ef0 0x5575e6d91450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4828ff9640 0 client.7785 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 1 --2- 172.21.15.55:0/3915353014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72b10 0x5575e6d938f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 1 -- 172.21.15.55:0/3915353014 >> 172.21.15.55:0/3915353014 conn(0x5575e6d45770 msgr2=0x5575e6d4afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 1 -- 172.21.15.55:0/3915353014 shutdown_connections 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 1 -- 172.21.15.55:0/3915353014 wait complete. 2024-04-25T09:00:55.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.019+0000 7f4852a2c740 20 client.7785 trim_cache size 0 max 16384 2024-04-25T09:00:55.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.035+0000 7f4852a2c740 1 Processor -- start 2024-04-25T09:00:55.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.035+0000 7f4852a2c740 1 -- start start 2024-04-25T09:00:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.035+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72b10 0x5575e6d753b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.035+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72ef0 0x5575e6d8cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.035+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d91990 0x5575e6d8d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.035+0000 7f4852a2c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4848200780 con 0x5575e6d72ef0 2024-04-25T09:00:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.035+0000 7f4852a2c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48481ff9b0 con 0x5575e6d72b10 2024-04-25T09:00:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.035+0000 7f4852a2c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48481562d0 con 0x5575e6d91990 2024-04-25T09:00:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.035+0000 7f484d2c4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72ef0 0x5575e6d8cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.035+0000 7f484d2c4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72ef0 0x5575e6d8cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51108/0 (socket says 172.21.15.55:51108) 2024-04-25T09:00:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.035+0000 7f484d2c4640 1 -- 172.21.15.55:0/1253057957 learned_addr learned my addr 172.21.15.55:0/1253057957 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.036+0000 7f484dac5640 1 --2- 172.21.15.55:0/1253057957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72b10 0x5575e6d753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.036+0000 7f484e2c6640 1 --2- 172.21.15.55:0/1253057957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d91990 0x5575e6d8d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.036+0000 7f484d2c4640 1 -- 172.21.15.55:0/1253057957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d91990 msgr2=0x5575e6d8d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.036+0000 7f484d2c4640 1 --2- 172.21.15.55:0/1253057957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d91990 0x5575e6d8d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.036+0000 7f484d2c4640 1 -- 172.21.15.55:0/1253057957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72b10 msgr2=0x5575e6d753b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.036+0000 7f484d2c4640 1 --2- 172.21.15.55:0/1253057957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72b10 0x5575e6d753b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.036+0000 7f484d2c4640 1 -- 172.21.15.55:0/1253057957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575e69830f0 con 0x5575e6d72ef0 2024-04-25T09:00:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.036+0000 7f484d2c4640 1 --2- 172.21.15.55:0/1253057957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72ef0 0x5575e6d8cd00 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f4838006f80 tx=0x7f4838015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c7c9b293f95a49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.036+0000 7f482affd640 1 -- 172.21.15.55:0/1253057957 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483802d630 con 0x5575e6d72ef0 2024-04-25T09:00:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.036+0000 7f482affd640 1 -- 172.21.15.55:0/1253057957 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483801b050 con 0x5575e6d72ef0 2024-04-25T09:00:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.036+0000 7f482affd640 1 -- 172.21.15.55:0/1253057957 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483802d9d0 con 0x5575e6d72ef0 2024-04-25T09:00:55.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.037+0000 7f4852a2c740 1 -- 172.21.15.55:0/1253057957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72ef0 msgr2=0x5575e6d8cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.037+0000 7f4852a2c740 1 --2- 172.21.15.55:0/1253057957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72ef0 0x5575e6d8cd00 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f4838006f80 tx=0x7f4838015000 comp rx=0 tx=0).stop 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.037+0000 7f4852a2c740 1 -- 172.21.15.55:0/1253057957 shutdown_connections 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.037+0000 7f4852a2c740 1 --2- 172.21.15.55:0/1253057957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d91990 0x5575e6d8d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.037+0000 7f4852a2c740 1 --2- 172.21.15.55:0/1253057957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72ef0 0x5575e6d8cd00 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.037+0000 7f4852a2c740 1 --2- 172.21.15.55:0/1253057957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72b10 0x5575e6d753b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.037+0000 7f4852a2c740 1 -- 172.21.15.55:0/1253057957 >> 172.21.15.55:0/1253057957 conn(0x5575e6d45770 msgr2=0x5575e6d70680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.037+0000 7f4852a2c740 1 -- 172.21.15.55:0/1253057957 shutdown_connections 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.037+0000 7f4852a2c740 1 -- 172.21.15.55:0/1253057957 wait complete. 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.037+0000 7f4852a2c740 1 -- start start 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.037+0000 7f4852a2c740 1 Processor -- start 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.038+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6df78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.038+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72ef0 0x5575e6dfa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.038+0000 7f4852a2c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d91990 0x5575e6da8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.038+0000 7f4852a2c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e6d4c2b0 con 0x5575e6d72b10 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.038+0000 7f4852a2c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48481568d0 con 0x5575e6d72ef0 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.038+0000 7f4852a2c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575e6da2ce0 con 0x5575e6d91990 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.038+0000 7f4852a2c740 10 client.0 _ll_register_callbacks cb 0x7f4844075130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.038+0000 7f484dac5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6df78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f484dac5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6df78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51118/0 (socket says 172.21.15.55:51118) 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f484dac5640 1 -- 172.21.15.55:0/1084835517 learned_addr learned my addr 172.21.15.55:0/1084835517 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f484dac5640 1 -- 172.21.15.55:0/1084835517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d91990 msgr2=0x5575e6da8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f484dac5640 1 --2- 172.21.15.55:0/1084835517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d91990 0x5575e6da8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f484dac5640 1 -- 172.21.15.55:0/1084835517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72ef0 msgr2=0x5575e6dfa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f484dac5640 1 --2- 172.21.15.55:0/1084835517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72ef0 0x5575e6dfa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f484dac5640 1 -- 172.21.15.55:0/1084835517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575e6d8cfe0 con 0x5575e6d72b10 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f484dac5640 1 --2- 172.21.15.55:0/1084835517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6df78f0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4844081760 tx=0x7f4844001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8bf6bc33b9920a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f4828ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f4828ff9640 1 -- 172.21.15.55:0/1084835517 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484408ce50 con 0x5575e6d72b10 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f4828ff9640 1 -- 172.21.15.55:0/1084835517 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f4844075500 con 0x5575e6d72b10 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f4852a2c740 1 -- 172.21.15.55:0/1084835517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f483801b050 con 0x5575e6d72b10 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f4828ff9640 1 -- 172.21.15.55:0/1084835517 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f484409f050 con 0x5575e6d72b10 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f4852a2c740 10 client.7791 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f4852a2c740 1 -- 172.21.15.55:0/1084835517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x5575e6d8cfe0 con 0x5575e6d72b10 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f4828ff9640 1 -- 172.21.15.55:0/1084835517 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483801b050 con 0x5575e6d72b10 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.039+0000 7f4828ff9640 1 -- 172.21.15.55:0/1084835517 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f48440790f0 con 0x5575e6d72b10 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 10 client.7791 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 10 client.7791 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 20 client.7791 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 1 --2- 172.21.15.55:0/1084835517 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5575e6da8ea0 0x5575e6d691d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 4 client.7791 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:00:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 1 -- 172.21.15.55:0/1084835517 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5575e6cb6630 con 0x5575e6da8ea0 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f484d2c4640 1 --2- 172.21.15.55:0/1084835517 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5575e6da8ea0 0x5575e6d691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4828ff9640 10 client.7791 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f484d2c4640 1 --2- 172.21.15.55:0/1084835517 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5575e6da8ea0 0x5575e6d691d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d16f5c5c868d3bb server_cookie=d627139b6657a99b in_seq=0 out_seq=0 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4828ff9640 1 -- 172.21.15.55:0/1084835517 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5575e6cb6630 con 0x5575e6da8ea0 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4828ff9640 10 client.7791 handle_command_reply: tid=0 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 1 client.7791 shutdown 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 1 -- 172.21.15.55:0/1084835517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 msgr2=0x5575e6df78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 1 --2- 172.21.15.55:0/1084835517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6df78f0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4844081760 tx=0x7f4844001360 comp rx=0 tx=0).stop 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 1 -- 172.21.15.55:0/1084835517 shutdown_connections 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 1 --2- 172.21.15.55:0/1084835517 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x5575e6da8ea0 0x5575e6d691d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 1 --2- 172.21.15.55:0/1084835517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5575e6d91990 0x5575e6da8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 1 --2- 172.21.15.55:0/1084835517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575e6d72ef0 0x5575e6dfa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4828ff9640 0 client.7791 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:55.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 1 --2- 172.21.15.55:0/1084835517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5575e6d72b10 0x5575e6df78f0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.040+0000 7f4852a2c740 1 -- 172.21.15.55:0/1084835517 >> 172.21.15.55:0/1084835517 conn(0x5575e6d45770 msgr2=0x5575e6d48f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f4852a2c740 1 -- 172.21.15.55:0/1084835517 shutdown_connections 2024-04-25T09:00:55.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f4852a2c740 1 -- 172.21.15.55:0/1084835517 wait complete. 2024-04-25T09:00:55.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f4852a2c740 20 client.7791 trim_cache size 0 max 16384 2024-04-25T09:00:55.035 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:00:55.035 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-25T09:00:55.035 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-25T09:00:55.035 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:00:55.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 -- 172.21.15.55:0/1300556070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f482c06b500 msgr2=0x7f482c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f482c06b500 0x7f482c06d9c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f48481e8510 tx=0x7f4838008040 comp rx=0 tx=0).stop 2024-04-25T09:00:55.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 -- 172.21.15.55:0/1300556070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 msgr2=0x7f48481549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 0x7f48481549b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f484400a890 tx=0x7f4844001dc0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 -- 172.21.15.55:0/1300556070 shutdown_connections 2024-04-25T09:00:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f482c06b500 0x7f482c06d9c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48480704d0 0x7f4848070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4848158cb0 0x7f48481543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 --2- 172.21.15.55:0/1300556070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48340039b0 0x7f48481549b0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 -- 172.21.15.55:0/1300556070 >> 172.21.15.55:0/1300556070 conn(0x7f48480b3430 msgr2=0x7f4848099f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 -- 172.21.15.55:0/1300556070 shutdown_connections 2024-04-25T09:00:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.041+0000 7f484fd29640 1 -- 172.21.15.55:0/1300556070 wait complete. 2024-04-25T09:00:55.041 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:00:55.041 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.153+0000 7f6301c93640 1 Processor -- start 2024-04-25T09:00:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.153+0000 7f6301c93640 1 -- start start 2024-04-25T09:00:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f6301c93640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62fc15dce0 0x7f62fc0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f6301c93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62fc0d35b0 0x7f62fc0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f6301c93640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62fc15e0c0 con 0x7f62fc0d1f90 2024-04-25T09:00:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f6301c93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62fc0b7b10 con 0x7f62fc0d35b0 2024-04-25T09:00:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f6301c93640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0d2510 con 0x7f62fc15dce0 2024-04-25T09:00:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f62faffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62fc0d35b0 0x7f62fc0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f62faffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62fc0d35b0 0x7f62fc0b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51120/0 (socket says 172.21.15.55:51120) 2024-04-25T09:00:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f62faffd640 1 -- 172.21.15.55:0/2695654718 learned_addr learned my addr 172.21.15.55:0/2695654718 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f62fb7fe640 1 --2- 172.21.15.55:0/2695654718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62fc15dce0 0x7f62fc0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f62faffd640 1 -- 172.21.15.55:0/2695654718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62fc15dce0 msgr2=0x7f62fc0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f62faffd640 1 --2- 172.21.15.55:0/2695654718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62fc15dce0 0x7f62fc0d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f62faffd640 1 -- 172.21.15.55:0/2695654718 >> v1:172.21.15.167:6789/0 conn(0x7f62fc0d1f90 legacy=0x7f62fc06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.154+0000 7f62faffd640 1 -- 172.21.15.55:0/2695654718 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0d27f0 con 0x7f62fc0d35b0 2024-04-25T09:00:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.155+0000 7f62faffd640 1 --2- 172.21.15.55:0/2695654718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62fc0d35b0 0x7f62fc0b5450 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009870 tx=0x7f62f002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316851f7aa1a0e05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.155+0000 7f62fa7fc640 1 -- 172.21.15.55:0/2695654718 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0037070 con 0x7f62fc0d35b0 2024-04-25T09:00:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.155+0000 7f62fa7fc640 1 -- 172.21.15.55:0/2695654718 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f0032440 con 0x7f62fc0d35b0 2024-04-25T09:00:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.155+0000 7f62fa7fc640 1 -- 172.21.15.55:0/2695654718 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0032810 con 0x7f62fc0d35b0 2024-04-25T09:00:55.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.156+0000 7f6301c93640 1 -- 172.21.15.55:0/2695654718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62fc0d35b0 msgr2=0x7f62fc0b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.156+0000 7f6301c93640 1 --2- 172.21.15.55:0/2695654718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62fc0d35b0 0x7f62fc0b5450 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009870 tx=0x7f62f002a180 comp rx=0 tx=0).stop 2024-04-25T09:00:55.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.156+0000 7f6301c93640 1 -- 172.21.15.55:0/2695654718 shutdown_connections 2024-04-25T09:00:55.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.156+0000 7f6301c93640 1 --2- 172.21.15.55:0/2695654718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62fc0d35b0 0x7f62fc0b5450 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.156+0000 7f6301c93640 1 --2- 172.21.15.55:0/2695654718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62fc15dce0 0x7f62fc0d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.156+0000 7f6301c93640 1 -- 172.21.15.55:0/2695654718 >> 172.21.15.55:0/2695654718 conn(0x7f62fc072900 msgr2=0x7f62fc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.156+0000 7f6301c93640 1 -- 172.21.15.55:0/2695654718 shutdown_connections 2024-04-25T09:00:55.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.156+0000 7f6301c93640 1 -- 172.21.15.55:0/2695654718 wait complete. 2024-04-25T09:00:55.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.157+0000 7f6301c93640 1 Processor -- start 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.157+0000 7f6301c93640 1 -- start start 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f6301c93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62fc0d1f90 0x7f62fc153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f6301c93640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62fc0d35b0 0x7f62fc0c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f6301c93640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62fc15dce0 0x7f62fc15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f6301c93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0d3090 con 0x7f62fc0d1f90 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f6301c93640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0d2db0 con 0x7f62fc0d35b0 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f6301c93640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0b9820 con 0x7f62fc15dce0 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f62fb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62fc0d1f90 0x7f62fc153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f62fb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62fc0d1f90 0x7f62fc153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51126/0 (socket says 172.21.15.55:51126) 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f62fb7fe640 1 -- 172.21.15.55:0/3026433441 learned_addr learned my addr 172.21.15.55:0/3026433441 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f62fbfff640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62fc15dce0 0x7f62fc15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f62faffd640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62fc0d35b0 0x7f62fc0c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f62fb7fe640 1 -- 172.21.15.55:0/3026433441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62fc15dce0 msgr2=0x7f62fc15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f62fb7fe640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62fc15dce0 0x7f62fc15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f62fb7fe640 1 -- 172.21.15.55:0/3026433441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62fc0d35b0 msgr2=0x7f62fc0c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f62fb7fe640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62fc0d35b0 0x7f62fc0c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f62fb7fe640 1 -- 172.21.15.55:0/3026433441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0c8870 con 0x7f62fc0d1f90 2024-04-25T09:00:55.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.158+0000 7f62fbfff640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62fc15dce0 0x7f62fc15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:55.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.159+0000 7f62fb7fe640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62fc0d1f90 0x7f62fc153280 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00d800 tx=0x7f62ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.159+0000 7f62e3fff640 1 -- 172.21.15.55:0/3026433441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec00b6c0 con 0x7f62fc0d1f90 2024-04-25T09:00:55.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.159+0000 7f62e3fff640 1 -- 172.21.15.55:0/3026433441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec019070 con 0x7f62fc0d1f90 2024-04-25T09:00:55.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.159+0000 7f6301c93640 1 -- 172.21.15.55:0/3026433441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62fc0c8b50 con 0x7f62fc0d1f90 2024-04-25T09:00:55.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.159+0000 7f62e3fff640 1 -- 172.21.15.55:0/3026433441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec00ba80 con 0x7f62fc0d1f90 2024-04-25T09:00:55.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.159+0000 7f6301c93640 1 -- 172.21.15.55:0/3026433441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62fc0c9110 con 0x7f62fc0d1f90 2024-04-25T09:00:55.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.160+0000 7f6301c93640 1 -- 172.21.15.55:0/3026433441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62fc0749b0 con 0x7f62fc0d1f90 2024-04-25T09:00:55.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.160+0000 7f62e3fff640 1 -- 172.21.15.55:0/3026433441 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f62ec00bc20 con 0x7f62fc0d1f90 2024-04-25T09:00:55.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.161+0000 7f62e3fff640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62e806b4d0 0x7f62e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.161+0000 7f62e3fff640 1 -- 172.21.15.55:0/3026433441 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f62ec08a5f0 con 0x7f62fc0d1f90 2024-04-25T09:00:55.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.161+0000 7f62faffd640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62e806b4d0 0x7f62e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.161+0000 7f62faffd640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62e806b4d0 0x7f62e806d990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f62f0034000 tx=0x7f62f002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.165+0000 7f62e3fff640 1 -- 172.21.15.55:0/3026433441 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f62ec059490 con 0x7f62fc0d1f90 2024-04-25T09:00:55.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.387+0000 7f6301c93640 1 -- 172.21.15.55:0/3026433441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62fc0d1580 con 0x7f62fc0d1f90 2024-04-25T09:00:55.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.388+0000 7f62e3fff640 1 -- 172.21.15.55:0/3026433441 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f62ec058d90 con 0x7f62fc0d1f90 2024-04-25T09:00:55.377 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:00:55.377 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T08:59:57.635474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":6,"addr":"172.21.15.55:6837/3282261214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3282261214},{"type":"v1","addr":"172.21.15.55:6837","nonce":3282261214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:00:55.377 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 58 2024-04-25T09:00:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.389+0000 7f6301c93640 1 -- 172.21.15.55:0/3026433441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62e806b4d0 msgr2=0x7f62e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.389+0000 7f6301c93640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62e806b4d0 0x7f62e806d990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f62f0034000 tx=0x7f62f002e000 comp rx=0 tx=0).stop 2024-04-25T09:00:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.389+0000 7f6301c93640 1 -- 172.21.15.55:0/3026433441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62fc0d1f90 msgr2=0x7f62fc153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.389+0000 7f6301c93640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62fc0d1f90 0x7f62fc153280 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00d800 tx=0x7f62ec00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.389+0000 7f6301c93640 1 -- 172.21.15.55:0/3026433441 shutdown_connections 2024-04-25T09:00:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.389+0000 7f6301c93640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f62e806b4d0 0x7f62e806d990 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.389+0000 7f6301c93640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62fc15dce0 0x7f62fc15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.389+0000 7f6301c93640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62fc0d35b0 0x7f62fc0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.389+0000 7f6301c93640 1 --2- 172.21.15.55:0/3026433441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62fc0d1f90 0x7f62fc153280 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.389+0000 7f6301c93640 1 -- 172.21.15.55:0/3026433441 >> 172.21.15.55:0/3026433441 conn(0x7f62fc072900 msgr2=0x7f62fc0b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.390+0000 7f6301c93640 1 -- 172.21.15.55:0/3026433441 shutdown_connections 2024-04-25T09:00:55.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.390+0000 7f6301c93640 1 -- 172.21.15.55:0/3026433441 wait complete. 2024-04-25T09:00:55.389 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T09:00:55.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.503+0000 7fc1f8977640 1 Processor -- start 2024-04-25T09:00:55.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.503+0000 7fc1f8977640 1 -- start start 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.504+0000 7fc1f8977640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1f415b7b0 0x7fc1f40ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.504+0000 7fc1f8977640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f415f000 con 0x7fc1f415e820 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.504+0000 7fc1f8977640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f415ed20 con 0x7fc1f40cf760 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.504+0000 7fc1f8977640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f40ced00 con 0x7fc1f415b7b0 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.504+0000 7fc1f259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1f415b7b0 0x7fc1f40ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.504+0000 7fc1f2d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc1f415e820 0x7fc1f40cc080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42068/0 (socket says 172.21.15.55:42068) 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.504+0000 7fc1f2d9d640 1 -- 172.21.15.55:0/3763924281 learned_addr learned my addr 172.21.15.55:0/3763924281 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.505+0000 7fc1f259c640 1 -- 172.21.15.55:0/3763924281 >> v1:172.21.15.167:6789/0 conn(0x7fc1f40cf760 legacy=0x7fc1f415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.505+0000 7fc1f259c640 1 -- 172.21.15.55:0/3763924281 >> v1:172.21.15.55:6789/0 conn(0x7fc1f415e820 legacy=0x7fc1f40cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.505+0000 7fc1f259c640 1 -- 172.21.15.55:0/3763924281 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40cdce0 con 0x7fc1f415b7b0 2024-04-25T09:00:55.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.505+0000 7fc1f159a640 1 -- 172.21.15.55:0/3763924281 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656088772 0 0) 0x7fc1f415f000 con 0x7fc1f415e820 2024-04-25T09:00:55.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.505+0000 7fc1f259c640 1 --2- 172.21.15.55:0/3763924281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f415b7b0 0x7fc1f40ce7c0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0097d0 tx=0x7fc1ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649e13eb79e4f407 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.505+0000 7fc1f159a640 1 -- 172.21.15.55:0/3763924281 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec037070 con 0x7fc1f415b7b0 2024-04-25T09:00:55.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.506+0000 7fc1f159a640 1 -- 172.21.15.55:0/3763924281 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec032440 con 0x7fc1f415b7b0 2024-04-25T09:00:55.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.506+0000 7fc1f159a640 1 -- 172.21.15.55:0/3763924281 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec032810 con 0x7fc1f415b7b0 2024-04-25T09:00:55.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.506+0000 7fc1f8977640 1 -- 172.21.15.55:0/3763924281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f415b7b0 msgr2=0x7fc1f40ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.506+0000 7fc1f8977640 1 --2- 172.21.15.55:0/3763924281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f415b7b0 0x7fc1f40ce7c0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0097d0 tx=0x7fc1ec02a270 comp rx=0 tx=0).stop 2024-04-25T09:00:55.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.506+0000 7fc1f8977640 1 -- 172.21.15.55:0/3763924281 shutdown_connections 2024-04-25T09:00:55.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.506+0000 7fc1f8977640 1 --2- 172.21.15.55:0/3763924281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f415b7b0 0x7fc1f40ce7c0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.506+0000 7fc1f8977640 1 -- 172.21.15.55:0/3763924281 >> 172.21.15.55:0/3763924281 conn(0x7fc1f406f4a0 msgr2=0x7fc1f406f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.506+0000 7fc1f8977640 1 -- 172.21.15.55:0/3763924281 shutdown_connections 2024-04-25T09:00:55.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.506+0000 7fc1f8977640 1 -- 172.21.15.55:0/3763924281 wait complete. 2024-04-25T09:00:55.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.507+0000 7fc1f8977640 1 Processor -- start 2024-04-25T09:00:55.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.508+0000 7fc1f8977640 1 -- start start 2024-04-25T09:00:55.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.508+0000 7fc1f8977640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1f40cf760 0x7fc1f40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.508+0000 7fc1f8977640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f415b7b0 0x7fc1f40b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.508+0000 7fc1f8977640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1f415e820 0x7fc1f406ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.508+0000 7fc1f8977640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41619f0 con 0x7fc1f415b7b0 2024-04-25T09:00:55.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.508+0000 7fc1f8977640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40ce330 con 0x7fc1f40cf760 2024-04-25T09:00:55.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.508+0000 7fc1f8977640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40cfbf0 con 0x7fc1f415e820 2024-04-25T09:00:55.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.508+0000 7fc1f1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f415b7b0 0x7fc1f40b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.508+0000 7fc1f1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f415b7b0 0x7fc1f40b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51140/0 (socket says 172.21.15.55:51140) 2024-04-25T09:00:55.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.508+0000 7fc1f1d9b640 1 -- 172.21.15.55:0/3187379574 learned_addr learned my addr 172.21.15.55:0/3187379574 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1f259c640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1f40cf760 0x7fc1f40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1f2d9d640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1f415e820 0x7fc1f406ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1f1d9b640 1 -- 172.21.15.55:0/3187379574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1f415e820 msgr2=0x7fc1f406ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1f1d9b640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1f415e820 0x7fc1f406ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1f1d9b640 1 -- 172.21.15.55:0/3187379574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1f40cf760 msgr2=0x7fc1f40b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1f1d9b640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1f40cf760 0x7fc1f40b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1f1d9b640 1 -- 172.21.15.55:0/3187379574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40b5080 con 0x7fc1f415b7b0 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1f2d9d640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1f415e820 0x7fc1f406ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1f1d9b640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f415b7b0 0x7fc1f40b2f50 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00c450 tx=0x7fc1dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1eaffd640 1 -- 172.21.15.55:0/3187379574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc017070 con 0x7fc1f415b7b0 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1eaffd640 1 -- 172.21.15.55:0/3187379574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0052d0 con 0x7fc1f415b7b0 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1eaffd640 1 -- 172.21.15.55:0/3187379574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc003830 con 0x7fc1f415b7b0 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1f8977640 1 -- 172.21.15.55:0/3187379574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f40b5360 con 0x7fc1f415b7b0 2024-04-25T09:00:55.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.509+0000 7fc1f8977640 1 -- 172.21.15.55:0/3187379574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f40b5c00 con 0x7fc1f415b7b0 2024-04-25T09:00:55.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.511+0000 7fc1eaffd640 1 -- 172.21.15.55:0/3187379574 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc1dc01a070 con 0x7fc1f415b7b0 2024-04-25T09:00:55.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.511+0000 7fc1eaffd640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1d406b4d0 0x7fc1d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.511+0000 7fc1eaffd640 1 -- 172.21.15.55:0/3187379574 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fc1dc089580 con 0x7fc1f415b7b0 2024-04-25T09:00:55.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.511+0000 7fc1f259c640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1d406b4d0 0x7fc1d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.512+0000 7fc1f259c640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1d406b4d0 0x7fc1d406d990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec034000 tx=0x7fc1ec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.512+0000 7fc1fb67f740 1 Processor -- start 2024-04-25T09:00:55.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.512+0000 7fc1fb67f740 1 -- start start 2024-04-25T09:00:55.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.513+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c8166f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.513+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c814970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.513+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c83f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.513+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d7c777c60 con 0x562d7c850c60 2024-04-25T09:00:55.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.513+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d7c716d80 con 0x562d7c814590 2024-04-25T09:00:55.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.513+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d7c773d00 con 0x562d7c83f050 2024-04-25T09:00:55.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.513+0000 7fc1f1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c814970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.513+0000 7fc1f1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c814970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51148/0 (socket says 172.21.15.55:51148) 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.513+0000 7fc1f1d9b640 1 -- 172.21.15.55:0/3927785751 learned_addr learned my addr 172.21.15.55:0/3927785751 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.513+0000 7fc1f259c640 1 --2- 172.21.15.55:0/3927785751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c8166f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.513+0000 7fc1f2d9d640 1 --2- 172.21.15.55:0/3927785751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c83f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.514+0000 7fc1f1d9b640 1 -- 172.21.15.55:0/3927785751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 msgr2=0x562d7c83f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.514+0000 7fc1f1d9b640 1 --2- 172.21.15.55:0/3927785751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c83f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.514+0000 7fc1f1d9b640 1 -- 172.21.15.55:0/3927785751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 msgr2=0x562d7c8166f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.514+0000 7fc1f1d9b640 1 --2- 172.21.15.55:0/3927785751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c8166f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.514+0000 7fc1f1d9b640 1 -- 172.21.15.55:0/3927785751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d7c5587c0 con 0x562d7c850c60 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.514+0000 7fc1f1d9b640 1 --2- 172.21.15.55:0/3927785751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c814970 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc05fe80 tx=0x7fc1dc05bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66361661395285a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.514+0000 7fc1d3fff640 1 -- 172.21.15.55:0/3927785751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc056050 con 0x562d7c850c60 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.514+0000 7fc1d3fff640 1 -- 172.21.15.55:0/3927785751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0543c0 con 0x562d7c850c60 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.514+0000 7fc1d3fff640 1 -- 172.21.15.55:0/3927785751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0892f0 con 0x562d7c850c60 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.514+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3927785751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 msgr2=0x562d7c814970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.514+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/3927785751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c814970 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc05fe80 tx=0x7fc1dc05bdf0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.515+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3927785751 shutdown_connections 2024-04-25T09:00:55.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.515+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/3927785751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c83f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.515+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/3927785751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c814970 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.515+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/3927785751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c8166f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.515+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3927785751 >> 172.21.15.55:0/3927785751 conn(0x562d7c7dc6e0 msgr2=0x562d7c85a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.515+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3927785751 shutdown_connections 2024-04-25T09:00:55.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.515+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3927785751 wait complete. 2024-04-25T09:00:55.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.515+0000 7fc1fb67f740 1 -- start start 2024-04-25T09:00:55.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.515+0000 7fc1fb67f740 1 Processor -- start 2024-04-25T09:00:55.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c841070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c869c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c8539d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d7c714840 con 0x562d7c850c60 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d7c83cba0 con 0x562d7c814590 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d7c86a840 con 0x562d7c83f050 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1fb67f740 10 client.0 _ll_register_callbacks cb 0x562d7c72e980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1f2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c8539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1f2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c8539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51156/0 (socket says 172.21.15.55:51156) 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1f2d9d640 1 -- 172.21.15.55:0/3978370181 learned_addr learned my addr 172.21.15.55:0/3978370181 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1f259c640 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c841070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.516+0000 7fc1f1d9b640 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c869c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1f2d9d640 1 -- 172.21.15.55:0/3978370181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 msgr2=0x562d7c869c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1f2d9d640 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c869c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1f2d9d640 1 -- 172.21.15.55:0/3978370181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 msgr2=0x562d7c841070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1f2d9d640 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c841070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1f2d9d640 1 -- 172.21.15.55:0/3978370181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d7c5b8f50 con 0x562d7c850c60 2024-04-25T09:00:55.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1f2d9d640 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c8539d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40114f0 tx=0x7fc1e40119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddeaeff4deb72ff1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1d17fa640 1 -- 172.21.15.55:0/3978370181 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4019020 con 0x562d7c850c60 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1d17fa640 1 -- 172.21.15.55:0/3978370181 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fc1e4015680 con 0x562d7c850c60 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3978370181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc1dc0543c0 con 0x562d7c850c60 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1d17fa640 1 -- 172.21.15.55:0/3978370181 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1e4023050 con 0x562d7c850c60 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1fb67f740 10 client.7812 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3978370181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x562d7c44c0b0 con 0x562d7c850c60 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1d17fa640 1 -- 172.21.15.55:0/3978370181 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0543c0 con 0x562d7c850c60 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1d17fa640 1 -- 172.21.15.55:0/3978370181 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc1e4026020 con 0x562d7c850c60 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1fb67f740 10 client.7812 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1fb67f740 10 client.7812 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1fb67f740 20 client.7812 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562d7c86a140 0x562d7c877440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.517+0000 7fc1fb67f740 4 client.7812 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:00:55.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.518+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3978370181 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d7c737e60 con 0x562d7c86a140 2024-04-25T09:00:55.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.518+0000 7fc1f259c640 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562d7c86a140 0x562d7c877440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.518+0000 7fc1f259c640 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562d7c86a140 0x562d7c877440 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cb390dbcf0924bf server_cookie=21db94d2a6a16260 in_seq=0 out_seq=0 2024-04-25T09:00:55.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.518+0000 7fc1d17fa640 10 client.7812 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:55.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.518+0000 7fc1d17fa640 1 -- 172.21.15.55:0/3978370181 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562d7c737e60 con 0x562d7c86a140 2024-04-25T09:00:55.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.518+0000 7fc1d17fa640 10 client.7812 handle_command_reply: tid=0 2024-04-25T09:00:55.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.518+0000 7fc1fb67f740 1 client.7812 shutdown 2024-04-25T09:00:55.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3978370181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 msgr2=0x562d7c8539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c8539d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40114f0 tx=0x7fc1e40119b0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3978370181 shutdown_connections 2024-04-25T09:00:55.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562d7c86a140 0x562d7c877440 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c8539d0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c869c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/3978370181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c841070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1d17fa640 0 client.7812 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:55.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3978370181 >> 172.21.15.55:0/3978370181 conn(0x562d7c7dc6e0 msgr2=0x562d7c83c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3978370181 shutdown_connections 2024-04-25T09:00:55.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1fb67f740 1 -- 172.21.15.55:0/3978370181 wait complete. 2024-04-25T09:00:55.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.519+0000 7fc1fb67f740 20 client.7812 trim_cache size 0 max 16384 2024-04-25T09:00:55.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.531+0000 7fc1fb67f740 1 Processor -- start 2024-04-25T09:00:55.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.531+0000 7fc1fb67f740 1 -- start start 2024-04-25T09:00:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.531+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c814590 0x562d7c87b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c83f050 0x562d7c87b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c850c60 0x562d7c869780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41ffe40 con 0x562d7c814590 2024-04-25T09:00:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40b1be0 con 0x562d7c83f050 2024-04-25T09:00:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41f7f70 con 0x562d7c850c60 2024-04-25T09:00:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1f259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c814590 0x562d7c87b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1f259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c814590 0x562d7c87b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51168/0 (socket says 172.21.15.55:51168) 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1f259c640 1 -- 172.21.15.55:0/1631583584 learned_addr learned my addr 172.21.15.55:0/1631583584 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1f259c640 1 -- 172.21.15.55:0/1631583584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c850c60 msgr2=0x562d7c869780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1f259c640 1 --2- 172.21.15.55:0/1631583584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c850c60 0x562d7c869780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1f259c640 1 -- 172.21.15.55:0/1631583584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c83f050 msgr2=0x562d7c87b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1f259c640 1 --2- 172.21.15.55:0/1631583584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c83f050 0x562d7c87b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1f259c640 1 -- 172.21.15.55:0/1631583584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d7c854ca0 con 0x562d7c814590 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1f259c640 1 --2- 172.21.15.55:0/1631583584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c814590 0x562d7c87b460 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0098f0 tx=0x7fc1ec02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709d0b276a1c2bad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1d37fe640 1 -- 172.21.15.55:0/1631583584 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec037040 con 0x562d7c814590 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1d37fe640 1 -- 172.21.15.55:0/1631583584 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec056070 con 0x562d7c814590 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.532+0000 7fc1d37fe640 1 -- 172.21.15.55:0/1631583584 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec050290 con 0x562d7c814590 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.533+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1631583584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c814590 msgr2=0x562d7c87b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.533+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/1631583584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c814590 0x562d7c87b460 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0098f0 tx=0x7fc1ec02c000 comp rx=0 tx=0).stop 2024-04-25T09:00:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.533+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1631583584 shutdown_connections 2024-04-25T09:00:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.533+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/1631583584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c850c60 0x562d7c869780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.533+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/1631583584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c83f050 0x562d7c87b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.533+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/1631583584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c814590 0x562d7c87b460 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.533+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1631583584 >> 172.21.15.55:0/1631583584 conn(0x562d7c7dc6e0 msgr2=0x562d7c8554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.533+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1631583584 shutdown_connections 2024-04-25T09:00:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.533+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1631583584 wait complete. 2024-04-25T09:00:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.533+0000 7fc1fb67f740 1 -- start start 2024-04-25T09:00:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.533+0000 7fc1fb67f740 1 Processor -- start 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.534+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c8c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.534+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c82eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.534+0000 7fc1fb67f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c82f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.534+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d7c852f00 con 0x562d7c850c60 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.534+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40b15e0 con 0x562d7c814590 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.534+0000 7fc1fb67f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d7c830af0 con 0x562d7c83f050 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.534+0000 7fc1fb67f740 10 client.0 _ll_register_callbacks cb 0x7fc1dc057b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.534+0000 7fc1f2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c82f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.534+0000 7fc1f2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c82f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51176/0 (socket says 172.21.15.55:51176) 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.534+0000 7fc1f2d9d640 1 -- 172.21.15.55:0/1987185346 learned_addr learned my addr 172.21.15.55:0/1987185346 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1f259c640 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c8c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1f1d9b640 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c82eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1f2d9d640 1 -- 172.21.15.55:0/1987185346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 msgr2=0x562d7c82eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1f2d9d640 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c82eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1f2d9d640 1 -- 172.21.15.55:0/1987185346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 msgr2=0x562d7c8c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1f2d9d640 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c8c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1f2d9d640 1 -- 172.21.15.55:0/1987185346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d7c83c120 con 0x562d7c850c60 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1f2d9d640 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c82f420 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4001220 tx=0x7fc1e4007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed2d4e7ebe70394 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1d17fa640 1 -- 172.21.15.55:0/1987185346 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e402b030 con 0x562d7c850c60 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1d17fa640 1 -- 172.21.15.55:0/1987185346 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fc1e4010040 con 0x562d7c850c60 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1987185346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc1ec056070 con 0x562d7c850c60 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1d17fa640 1 -- 172.21.15.55:0/1987185346 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1e4019050 con 0x562d7c850c60 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1fb67f740 10 client.7818 fetch_fsmap learned FSMap version 58 2024-04-25T09:00:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1987185346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x562d7c869720 con 0x562d7c850c60 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1d17fa640 1 -- 172.21.15.55:0/1987185346 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec056070 con 0x562d7c850c60 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1d17fa640 1 -- 172.21.15.55:0/1987185346 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc1e4026040 con 0x562d7c850c60 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.535+0000 7fc1fb67f740 10 client.7818 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 10 client.7818 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 20 client.7818 populate_metadata read hostname 'smithi055' 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562d7c8429a0 0x562d7c873160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 4 client.7818 mds_command: new command op to 7557 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1987185346 --> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x562d7c7851a0 con 0x562d7c8429a0 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1f259c640 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562d7c8429a0 0x562d7c873160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1f259c640 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562d7c8429a0 0x562d7c873160 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a63a92e8061de6c3 server_cookie=7e5068cfa8e5582 in_seq=0 out_seq=0 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1d17fa640 10 client.7818 ms_handle_connect on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1d17fa640 1 -- 172.21.15.55:0/1987185346 <== mds.0 v2:172.21.15.55:6835/3282261214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+144 (crc 0 0 0) 0x562d7c7851a0 con 0x562d7c8429a0 2024-04-25T09:00:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1d17fa640 10 client.7818 handle_command_reply: tid=0 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 client.7818 shutdown 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1987185346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 msgr2=0x562d7c82f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c82f420 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4001220 tx=0x7fc1e4007ec0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1987185346 shutdown_connections 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.55:6835/3282261214,v1:172.21.15.55:6837/3282261214] conn(0x562d7c8429a0 0x562d7c873160 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d7c850c60 0x562d7c82f420 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d7c83f050 0x562d7c82eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 --2- 172.21.15.55:0/1987185346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d7c814590 0x562d7c8c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1987185346 >> 172.21.15.55:0/1987185346 conn(0x562d7c7dc6e0 msgr2=0x562d7c869aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1d17fa640 0 client.7818 ms_handle_reset on v2:172.21.15.55:6835/3282261214 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.536+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1987185346 shutdown_connections 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1fb67f740 1 -- 172.21.15.55:0/1987185346 wait complete. 2024-04-25T09:00:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1fb67f740 20 client.7818 trim_cache size 0 max 16384 2024-04-25T09:00:55.532 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:00:55.532 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T09:00:55.532 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:00:55.532 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "backtrace", 2024-04-25T09:00:55.532 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2188011350, 2024-04-25T09:00:55.532 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-25T09:00:55.532 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/testdir/hardlink" 2024-04-25T09:00:55.532 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:00:55.532 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T09:00:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 -- 172.21.15.55:0/3187379574 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1d406b4d0 msgr2=0x7fc1d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1d406b4d0 0x7fc1d406d990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec034000 tx=0x7fc1ec02e000 comp rx=0 tx=0).stop 2024-04-25T09:00:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 -- 172.21.15.55:0/3187379574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f415b7b0 msgr2=0x7fc1f40b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f415b7b0 0x7fc1f40b2f50 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00c450 tx=0x7fc1dc00c910 comp rx=0 tx=0).stop 2024-04-25T09:00:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 -- 172.21.15.55:0/3187379574 shutdown_connections 2024-04-25T09:00:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc1d406b4d0 0x7fc1d406d990 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1f415e820 0x7fc1f406ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f415b7b0 0x7fc1f40b2f50 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 --2- 172.21.15.55:0/3187379574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1f40cf760 0x7fc1f40b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 -- 172.21.15.55:0/3187379574 >> 172.21.15.55:0/3187379574 conn(0x7fc1f406f4a0 msgr2=0x7fc1f415d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 -- 172.21.15.55:0/3187379574 shutdown_connections 2024-04-25T09:00:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.537+0000 7fc1f8977640 1 -- 172.21.15.55:0/3187379574 wait complete. 2024-04-25T09:00:55.537 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:00:55.537 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:55.553 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:00:55.553 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:00:55.609 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:00:55.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.762+0000 7f51c3d9e640 1 Processor -- start 2024-04-25T09:00:55.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.762+0000 7f51c3d9e640 1 -- start start 2024-04-25T09:00:55.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c3d9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51bc0cd320 0x7f51bc0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c3d9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51bc0cfe80 0x7f51bc0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c3d9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc0cd930 con 0x7f51bc15df40 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c3d9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc0cdc10 con 0x7f51bc0cd320 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c3d9e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc0cdef0 con 0x7f51bc0cfe80 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c1b3a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f51bc15df40 0x7f51bc0b19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42074/0 (socket says 172.21.15.55:42074) 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c1b3a640 1 -- 172.21.15.55:0/2993601064 learned_addr learned my addr 172.21.15.55:0/2993601064 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c1339640 1 --2- 172.21.15.55:0/2993601064 >> v2:172.21.15.55:3300/0 conn(0x7f51bc0cd320 0x7f51bc0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c233b640 1 --2- 172.21.15.55:0/2993601064 >> v2:172.21.15.167:3300/0 conn(0x7f51bc0cfe80 0x7f51bc0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c0b38640 1 -- 172.21.15.55:0/2993601064 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120166931 0 0) 0x7f51bc0cd930 con 0x7f51bc15df40 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c0b38640 1 -- 172.21.15.55:0/2993601064 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a8003520 con 0x7f51bc15df40 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c1339640 1 -- 172.21.15.55:0/2993601064 >> v2:172.21.15.167:3300/0 conn(0x7f51bc0cfe80 msgr2=0x7f51bc0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c1339640 1 --2- 172.21.15.55:0/2993601064 >> v2:172.21.15.167:3300/0 conn(0x7f51bc0cfe80 0x7f51bc0cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c1339640 1 -- 172.21.15.55:0/2993601064 >> v1:172.21.15.55:6789/0 conn(0x7f51bc15df40 legacy=0x7f51bc0b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.763+0000 7f51c1339640 1 -- 172.21.15.55:0/2993601064 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0cada0 con 0x7f51bc0cd320 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.764+0000 7f51c1339640 1 --2- 172.21.15.55:0/2993601064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51bc0cd320 0x7f51bc0cf940 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0d1740 tx=0x7f51ac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dd875cac51373c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.764+0000 7f51c0b38640 1 -- 172.21.15.55:0/2993601064 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac037070 con 0x7f51bc0cd320 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.764+0000 7f51c0b38640 1 -- 172.21.15.55:0/2993601064 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac032440 con 0x7f51bc0cd320 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.764+0000 7f51c0b38640 1 -- 172.21.15.55:0/2993601064 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac02ae60 con 0x7f51bc0cd320 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.765+0000 7f51c3d9e640 1 -- 172.21.15.55:0/2993601064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51bc0cd320 msgr2=0x7f51bc0cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.765+0000 7f51c3d9e640 1 --2- 172.21.15.55:0/2993601064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51bc0cd320 0x7f51bc0cf940 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0d1740 tx=0x7f51ac02a110 comp rx=0 tx=0).stop 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.765+0000 7f51c3d9e640 1 -- 172.21.15.55:0/2993601064 shutdown_connections 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.765+0000 7f51c3d9e640 1 --2- 172.21.15.55:0/2993601064 >> v2:172.21.15.167:3300/0 conn(0x7f51bc0cfe80 0x7f51bc0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.765+0000 7f51c3d9e640 1 --2- 172.21.15.55:0/2993601064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51bc0cd320 0x7f51bc0cf940 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.765+0000 7f51c3d9e640 1 -- 172.21.15.55:0/2993601064 >> 172.21.15.55:0/2993601064 conn(0x7f51bc0d06b0 msgr2=0x7f51bc0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.765+0000 7f51c3d9e640 1 -- 172.21.15.55:0/2993601064 shutdown_connections 2024-04-25T09:00:55.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.765+0000 7f51c3d9e640 1 -- 172.21.15.55:0/2993601064 wait complete. 2024-04-25T09:00:55.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.766+0000 7f51c3d9e640 1 Processor -- start 2024-04-25T09:00:55.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.766+0000 7f51c3d9e640 1 -- start start 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c3d9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51bc0cd320 0x7f51bc0b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c3d9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51bc0cfe80 0x7f51bc1f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c3d9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51bc15df40 0x7f51bc14ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c3d9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0c4200 con 0x7f51bc0cd320 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c3d9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0d0290 con 0x7f51bc0cfe80 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c3d9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0c4380 con 0x7f51bc15df40 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c1b3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51bc0cd320 0x7f51bc0b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c1b3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51bc0cd320 0x7f51bc0b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51190/0 (socket says 172.21.15.55:51190) 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c1b3a640 1 -- 172.21.15.55:0/1977769678 learned_addr learned my addr 172.21.15.55:0/1977769678 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c1339640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51bc0cfe80 0x7f51bc1f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c233b640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51bc15df40 0x7f51bc14ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c1b3a640 1 -- 172.21.15.55:0/1977769678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51bc15df40 msgr2=0x7f51bc14ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c1b3a640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51bc15df40 0x7f51bc14ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c1b3a640 1 -- 172.21.15.55:0/1977769678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51bc0cfe80 msgr2=0x7f51bc1f6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c1b3a640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51bc0cfe80 0x7f51bc1f6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c1b3a640 1 -- 172.21.15.55:0/1977769678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc1f72c0 con 0x7f51bc0cd320 2024-04-25T09:00:55.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c1339640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51bc0cfe80 0x7f51bc1f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:55.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.767+0000 7f51c233b640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51bc15df40 0x7f51bc14ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:55.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.768+0000 7f51c1b3a640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51bc0cd320 0x7f51bc0b4540 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c460 tx=0x7f51b800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.768+0000 7f51b27fc640 1 -- 172.21.15.55:0/1977769678 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8017070 con 0x7f51bc0cd320 2024-04-25T09:00:55.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.768+0000 7f51b27fc640 1 -- 172.21.15.55:0/1977769678 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8005ce0 con 0x7f51bc0cd320 2024-04-25T09:00:55.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.768+0000 7f51b27fc640 1 -- 172.21.15.55:0/1977769678 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8007290 con 0x7f51bc0cd320 2024-04-25T09:00:55.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.768+0000 7f51c3d9e640 1 -- 172.21.15.55:0/1977769678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc1f75a0 con 0x7f51bc0cd320 2024-04-25T09:00:55.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.768+0000 7f51c3d9e640 1 -- 172.21.15.55:0/1977769678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc0c8b60 con 0x7f51bc0cd320 2024-04-25T09:00:55.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.769+0000 7f51c3d9e640 1 -- 172.21.15.55:0/1977769678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc071aa0 con 0x7f51bc0cd320 2024-04-25T09:00:55.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.769+0000 7f51b27fc640 1 -- 172.21.15.55:0/1977769678 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f51b801a070 con 0x7f51bc0cd320 2024-04-25T09:00:55.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.770+0000 7f51b27fc640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51a006b4d0 0x7f51a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:55.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.770+0000 7f51b27fc640 1 -- 172.21.15.55:0/1977769678 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f51b8089560 con 0x7f51bc0cd320 2024-04-25T09:00:55.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.770+0000 7f51c1339640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51a006b4d0 0x7f51a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:55.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.770+0000 7f51c1339640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51a006b4d0 0x7f51a006d990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f51ac034000 tx=0x7f51ac02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:55.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.774+0000 7f51b27fc640 1 -- 172.21.15.55:0/1977769678 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51bc071aa0 con 0x7f51bc0cd320 2024-04-25T09:00:55.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.954+0000 7f51c3d9e640 1 -- 172.21.15.55:0/1977769678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51bc0749b0 con 0x7f51bc0cd320 2024-04-25T09:00:55.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.955+0000 7f51b27fc640 1 -- 172.21.15.55:0/1977769678 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16839 (secure 0 0 0) 0x7f51b8058400 con 0x7f51bc0cd320 2024-04-25T09:00:55.944 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:00:55.944 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":90,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:00:24.856931+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:31.118316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:31.794522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.26","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3953928431":"2024-04-26T08:59:46.600027+0000","172.21.15.55:6835/3953928431":"2024-04-26T08:59:46.600027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:00:55.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 -- 172.21.15.55:0/1977769678 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51a006b4d0 msgr2=0x7f51a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51a006b4d0 0x7f51a006d990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f51ac034000 tx=0x7f51ac02e000 comp rx=0 tx=0).stop 2024-04-25T09:00:55.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 -- 172.21.15.55:0/1977769678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51bc0cd320 msgr2=0x7f51bc0b4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:55.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51bc0cd320 0x7f51bc0b4540 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c460 tx=0x7f51b800c920 comp rx=0 tx=0).stop 2024-04-25T09:00:55.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 -- 172.21.15.55:0/1977769678 shutdown_connections 2024-04-25T09:00:55.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f51a006b4d0 0x7f51a006d990 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f51bc15df40 0x7f51bc14ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51bc0cfe80 0x7f51bc1f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 --2- 172.21.15.55:0/1977769678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51bc0cd320 0x7f51bc0b4540 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:55.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 -- 172.21.15.55:0/1977769678 >> 172.21.15.55:0/1977769678 conn(0x7f51bc0d06b0 msgr2=0x7f51bc15cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:55.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 -- 172.21.15.55:0/1977769678 shutdown_connections 2024-04-25T09:00:55.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:55.957+0000 7f51c3d9e640 1 -- 172.21.15.55:0/1977769678 wait complete. 2024-04-25T09:00:55.957 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:59:31.118316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:59:31.794522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:00:55.958 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:00:56.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.072+0000 7fb8b095c640 1 Processor -- start 2024-04-25T09:00:56.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.072+0000 7fb8b095c640 1 -- start start 2024-04-25T09:00:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8b095c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb8ac15dca0 0x7fb8ac0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8b095c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8ac0d3b90 0x7fb8ac0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8b095c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8ac0cee80 0x7fb8ac0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8b095c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac0b6b20 con 0x7fb8ac0cee80 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8b095c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac0d4090 con 0x7fb8ac15dca0 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8b095c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0d4370 con 0x7fb8ac0d3b90 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8aad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8ac0cee80 0x7fb8ac0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8aad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8ac0cee80 0x7fb8ac0d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51194/0 (socket says 172.21.15.55:51194) 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8aad9d640 1 -- 172.21.15.55:0/1979992224 learned_addr learned my addr 172.21.15.55:0/1979992224 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8aa59c640 1 --2- 172.21.15.55:0/1979992224 >> v2:172.21.15.167:3300/0 conn(0x7fb8ac15dca0 0x7fb8ac0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8a3fff640 1 --2- 172.21.15.55:0/1979992224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8ac0d3b90 0x7fb8ac0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8aad9d640 1 -- 172.21.15.55:0/1979992224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8ac0d3b90 msgr2=0x7fb8ac0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8aad9d640 1 --2- 172.21.15.55:0/1979992224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8ac0d3b90 0x7fb8ac0d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8aad9d640 1 -- 172.21.15.55:0/1979992224 >> v2:172.21.15.167:3300/0 conn(0x7fb8ac15dca0 msgr2=0x7fb8ac0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8aad9d640 1 --2- 172.21.15.55:0/1979992224 >> v2:172.21.15.167:3300/0 conn(0x7fb8ac15dca0 0x7fb8ac0ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8aad9d640 1 -- 172.21.15.55:0/1979992224 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0d4650 con 0x7fb8ac0cee80 2024-04-25T09:00:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.073+0000 7fb8a3fff640 1 --2- 172.21.15.55:0/1979992224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8ac0d3b90 0x7fb8ac0d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.074+0000 7fb8aad9d640 1 --2- 172.21.15.55:0/1979992224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8ac0cee80 0x7fb8ac0d0f60 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0b6340 tx=0x7fb8a402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ed881df7510cde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.074+0000 7fb8a9d9b640 1 -- 172.21.15.55:0/1979992224 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4036070 con 0x7fb8ac0cee80 2024-04-25T09:00:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.074+0000 7fb8a9d9b640 1 -- 172.21.15.55:0/1979992224 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4031600 con 0x7fb8ac0cee80 2024-04-25T09:00:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.074+0000 7fb8a9d9b640 1 -- 172.21.15.55:0/1979992224 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a40319d0 con 0x7fb8ac0cee80 2024-04-25T09:00:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.075+0000 7fb8b095c640 1 -- 172.21.15.55:0/1979992224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8ac0cee80 msgr2=0x7fb8ac0d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.075+0000 7fb8b095c640 1 --2- 172.21.15.55:0/1979992224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8ac0cee80 0x7fb8ac0d0f60 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0b6340 tx=0x7fb8a402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.075+0000 7fb8b095c640 1 -- 172.21.15.55:0/1979992224 shutdown_connections 2024-04-25T09:00:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.075+0000 7fb8b095c640 1 --2- 172.21.15.55:0/1979992224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8ac0cee80 0x7fb8ac0d0f60 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.075+0000 7fb8b095c640 1 --2- 172.21.15.55:0/1979992224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8ac0d3b90 0x7fb8ac0d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.075+0000 7fb8b095c640 1 --2- 172.21.15.55:0/1979992224 >> v2:172.21.15.167:3300/0 conn(0x7fb8ac15dca0 0x7fb8ac0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.075+0000 7fb8b095c640 1 -- 172.21.15.55:0/1979992224 >> 172.21.15.55:0/1979992224 conn(0x7fb8ac0726c0 msgr2=0x7fb8ac072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.075+0000 7fb8b095c640 1 -- 172.21.15.55:0/1979992224 shutdown_connections 2024-04-25T09:00:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.075+0000 7fb8b095c640 1 -- 172.21.15.55:0/1979992224 wait complete. 2024-04-25T09:00:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.076+0000 7fb8b095c640 1 Processor -- start 2024-04-25T09:00:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.076+0000 7fb8b095c640 1 -- start start 2024-04-25T09:00:56.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8b095c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8ac0cee80 0x7fb8ac0ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8b095c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8ac0d3b90 0x7fb8ac14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8b095c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8ac15dca0 0x7fb8ac0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8b095c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac15e200 con 0x7fb8ac15dca0 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8b095c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac15e080 con 0x7fb8ac0cee80 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8b095c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0b2500 con 0x7fb8ac0d3b90 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8aad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8ac15dca0 0x7fb8ac0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8aad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8ac15dca0 0x7fb8ac0b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51210/0 (socket says 172.21.15.55:51210) 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8aad9d640 1 -- 172.21.15.55:0/150201775 learned_addr learned my addr 172.21.15.55:0/150201775 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8a3fff640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8ac0d3b90 0x7fb8ac14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8aa59c640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8ac0cee80 0x7fb8ac0ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8aad9d640 1 -- 172.21.15.55:0/150201775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8ac0d3b90 msgr2=0x7fb8ac14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8aad9d640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8ac0d3b90 0x7fb8ac14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8aad9d640 1 -- 172.21.15.55:0/150201775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8ac0cee80 msgr2=0x7fb8ac0ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8aad9d640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8ac0cee80 0x7fb8ac0ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8aad9d640 1 -- 172.21.15.55:0/150201775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac150890 con 0x7fb8ac15dca0 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.077+0000 7fb8aad9d640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8ac15dca0 0x7fb8ac0b4700 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009f40 tx=0x7fb8a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.078+0000 7fb8a2ffd640 1 -- 172.21.15.55:0/150201775 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4036050 con 0x7fb8ac15dca0 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.078+0000 7fb8a2ffd640 1 -- 172.21.15.55:0/150201775 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4042070 con 0x7fb8ac15dca0 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.078+0000 7fb8b095c640 1 -- 172.21.15.55:0/150201775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac150b70 con 0x7fb8ac15dca0 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.078+0000 7fb8a2ffd640 1 -- 172.21.15.55:0/150201775 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4009510 con 0x7fb8ac15dca0 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.078+0000 7fb8b095c640 1 -- 172.21.15.55:0/150201775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac151130 con 0x7fb8ac15dca0 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.079+0000 7fb8b095c640 1 -- 172.21.15.55:0/150201775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac0750b0 con 0x7fb8ac15dca0 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.079+0000 7fb8a2ffd640 1 -- 172.21.15.55:0/150201775 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb8a4007bd0 con 0x7fb8ac15dca0 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.080+0000 7fb8a2ffd640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb88c06b4d0 0x7fb88c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.080+0000 7fb8aa59c640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb88c06b4d0 0x7fb88c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.080+0000 7fb8a2ffd640 1 -- 172.21.15.55:0/150201775 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fb8a40ab040 con 0x7fb8ac15dca0 2024-04-25T09:00:56.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.080+0000 7fb8aa59c640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb88c06b4d0 0x7fb88c06d990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0079a0 tx=0x7fb89c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.084+0000 7fb8a2ffd640 1 -- 172.21.15.55:0/150201775 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8a4079800 con 0x7fb8ac15dca0 2024-04-25T09:00:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.263+0000 7fb8b095c640 1 -- 172.21.15.55:0/150201775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8ac15d360 con 0x7fb8ac15dca0 2024-04-25T09:00:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.263+0000 7fb8a2ffd640 1 -- 172.21.15.55:0/150201775 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8a407d8a0 con 0x7fb8ac15dca0 2024-04-25T09:00:56.253 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:00:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 -- 172.21.15.55:0/150201775 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb88c06b4d0 msgr2=0x7fb88c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb88c06b4d0 0x7fb88c06d990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0079a0 tx=0x7fb89c008040 comp rx=0 tx=0).stop 2024-04-25T09:00:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 -- 172.21.15.55:0/150201775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8ac15dca0 msgr2=0x7fb8ac0b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8ac15dca0 0x7fb8ac0b4700 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009f40 tx=0x7fb8a4004a40 comp rx=0 tx=0).stop 2024-04-25T09:00:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 -- 172.21.15.55:0/150201775 shutdown_connections 2024-04-25T09:00:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb88c06b4d0 0x7fb88c06d990 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8ac15dca0 0x7fb8ac0b4700 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8ac0d3b90 0x7fb8ac14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 --2- 172.21.15.55:0/150201775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8ac0cee80 0x7fb8ac0ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 -- 172.21.15.55:0/150201775 >> 172.21.15.55:0/150201775 conn(0x7fb8ac0726c0 msgr2=0x7fb8ac0b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 -- 172.21.15.55:0/150201775 shutdown_connections 2024-04-25T09:00:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.265+0000 7fb8b095c640 1 -- 172.21.15.55:0/150201775 wait complete. 2024-04-25T09:00:56.265 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:00:56.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.380+0000 7fd8c069e640 1 Processor -- start 2024-04-25T09:00:56.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.380+0000 7fd8c069e640 1 -- start start 2024-04-25T09:00:56.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.381+0000 7fd8c069e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8b815dca0 0x7fd8b80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.381+0000 7fd8c069e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b80d4090 con 0x7fd8b80d3b90 2024-04-25T09:00:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.381+0000 7fd8c069e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b80d4370 con 0x7fd8b80d1130 2024-04-25T09:00:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.381+0000 7fd8c069e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b80b6b20 con 0x7fd8b815dca0 2024-04-25T09:00:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.381+0000 7fd8bdc39640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd8b80d3b90 0x7fd8b80d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42086/0 (socket says 172.21.15.55:42086) 2024-04-25T09:00:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.381+0000 7fd8be43a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8b815dca0 0x7fd8b80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.381+0000 7fd8bdc39640 1 -- 172.21.15.55:0/2591831192 learned_addr learned my addr 172.21.15.55:0/2591831192 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:00:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.381+0000 7fd8bd438640 1 -- 172.21.15.55:0/2591831192 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746049084 0 0) 0x7fd8b80d4090 con 0x7fd8b80d3b90 2024-04-25T09:00:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.381+0000 7fd8bd438640 1 -- 172.21.15.55:0/2591831192 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a0003520 con 0x7fd8b80d3b90 2024-04-25T09:00:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.382+0000 7fd8be43a640 1 -- 172.21.15.55:0/2591831192 >> v1:172.21.15.167:6789/0 conn(0x7fd8b80d1130 legacy=0x7fd8b80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.382+0000 7fd8be43a640 1 -- 172.21.15.55:0/2591831192 >> v1:172.21.15.55:6789/0 conn(0x7fd8b80d3b90 legacy=0x7fd8b80d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.382+0000 7fd8be43a640 1 -- 172.21.15.55:0/2591831192 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80d4650 con 0x7fd8b815dca0 2024-04-25T09:00:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.382+0000 7fd8be43a640 1 --2- 172.21.15.55:0/2591831192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8b815dca0 0x7fd8b80ce940 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00097a0 tx=0x7fd8b002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dba3f2b462a99c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.382+0000 7fd8bd438640 1 -- 172.21.15.55:0/2591831192 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0037070 con 0x7fd8b815dca0 2024-04-25T09:00:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.382+0000 7fd8bd438640 1 -- 172.21.15.55:0/2591831192 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b0032440 con 0x7fd8b815dca0 2024-04-25T09:00:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.382+0000 7fd8bd438640 1 -- 172.21.15.55:0/2591831192 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0032810 con 0x7fd8b815dca0 2024-04-25T09:00:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.383+0000 7fd8c069e640 1 -- 172.21.15.55:0/2591831192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8b815dca0 msgr2=0x7fd8b80ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.383+0000 7fd8c069e640 1 --2- 172.21.15.55:0/2591831192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8b815dca0 0x7fd8b80ce940 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00097a0 tx=0x7fd8b002a230 comp rx=0 tx=0).stop 2024-04-25T09:00:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.383+0000 7fd8c069e640 1 -- 172.21.15.55:0/2591831192 shutdown_connections 2024-04-25T09:00:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.383+0000 7fd8c069e640 1 --2- 172.21.15.55:0/2591831192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8b815dca0 0x7fd8b80ce940 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.383+0000 7fd8c069e640 1 -- 172.21.15.55:0/2591831192 >> 172.21.15.55:0/2591831192 conn(0x7fd8b80726c0 msgr2=0x7fd8b8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.383+0000 7fd8c069e640 1 -- 172.21.15.55:0/2591831192 shutdown_connections 2024-04-25T09:00:56.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.383+0000 7fd8c069e640 1 -- 172.21.15.55:0/2591831192 wait complete. 2024-04-25T09:00:56.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.384+0000 7fd8c069e640 1 Processor -- start 2024-04-25T09:00:56.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.384+0000 7fd8c069e640 1 -- start start 2024-04-25T09:00:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8c069e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8b80d1130 0x7fd8b81f0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8c069e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b80d3b90 0x7fd8b815f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8c069e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8b815dca0 0x7fd8b8156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8c069e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b815e200 con 0x7fd8b80d1130 2024-04-25T09:00:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8c069e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b815e080 con 0x7fd8b80d3b90 2024-04-25T09:00:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8c069e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80cee80 con 0x7fd8b815dca0 2024-04-25T09:00:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8be43a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8b80d1130 0x7fd8b81f0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8be43a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8b80d1130 0x7fd8b81f0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51224/0 (socket says 172.21.15.55:51224) 2024-04-25T09:00:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8be43a640 1 -- 172.21.15.55:0/2899626499 learned_addr learned my addr 172.21.15.55:0/2899626499 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8be43a640 1 -- 172.21.15.55:0/2899626499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8b815dca0 msgr2=0x7fd8b8156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8be43a640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8b815dca0 0x7fd8b8156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8be43a640 1 -- 172.21.15.55:0/2899626499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b80d3b90 msgr2=0x7fd8b815f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8be43a640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b80d3b90 0x7fd8b815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8be43a640 1 -- 172.21.15.55:0/2899626499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8160260 con 0x7fd8b80d1130 2024-04-25T09:00:56.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.385+0000 7fd8be43a640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8b80d1130 0x7fd8b81f0ae0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00098c0 tx=0x7fd8b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.386+0000 7fd8b6ffd640 1 -- 172.21.15.55:0/2899626499 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0037040 con 0x7fd8b80d1130 2024-04-25T09:00:56.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.386+0000 7fd8b6ffd640 1 -- 172.21.15.55:0/2899626499 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b0030500 con 0x7fd8b80d1130 2024-04-25T09:00:56.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.386+0000 7fd8c069e640 1 -- 172.21.15.55:0/2899626499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b8160540 con 0x7fd8b80d1130 2024-04-25T09:00:56.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.386+0000 7fd8b6ffd640 1 -- 172.21.15.55:0/2899626499 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00308d0 con 0x7fd8b80d1130 2024-04-25T09:00:56.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.386+0000 7fd8c069e640 1 -- 172.21.15.55:0/2899626499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b8160b00 con 0x7fd8b80d1130 2024-04-25T09:00:56.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.387+0000 7fd8c069e640 1 -- 172.21.15.55:0/2899626499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b80750b0 con 0x7fd8b80d1130 2024-04-25T09:00:56.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.387+0000 7fd8b6ffd640 1 -- 172.21.15.55:0/2899626499 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd8b0044020 con 0x7fd8b80d1130 2024-04-25T09:00:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.387+0000 7fd8b6ffd640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8a406b4d0 0x7fd8a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.387+0000 7fd8b6ffd640 1 -- 172.21.15.55:0/2899626499 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd8b00aa560 con 0x7fd8b80d1130 2024-04-25T09:00:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.388+0000 7fd8bdc39640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8a406b4d0 0x7fd8a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.388+0000 7fd8bdc39640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8a406b4d0 0x7fd8a406d990 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd8b815a120 tx=0x7fd8ac007930 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.392+0000 7fd8b6ffd640 1 -- 172.21.15.55:0/2899626499 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd8b0079370 con 0x7fd8b80d1130 2024-04-25T09:00:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.574+0000 7fd8c069e640 1 -- 172.21.15.55:0/2899626499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8b80ce7c0 con 0x7fd8b80d1130 2024-04-25T09:00:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.574+0000 7fd8b6ffd640 1 -- 172.21.15.55:0/2899626499 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8b0078c70 con 0x7fd8b80d1130 2024-04-25T09:00:56.563 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T09:00:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 -- 172.21.15.55:0/2899626499 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8a406b4d0 msgr2=0x7fd8a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8a406b4d0 0x7fd8a406d990 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd8b815a120 tx=0x7fd8ac007930 comp rx=0 tx=0).stop 2024-04-25T09:00:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 -- 172.21.15.55:0/2899626499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8b80d1130 msgr2=0x7fd8b81f0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8b80d1130 0x7fd8b81f0ae0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00098c0 tx=0x7fd8b00046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 -- 172.21.15.55:0/2899626499 shutdown_connections 2024-04-25T09:00:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd8a406b4d0 0x7fd8a406d990 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8b815dca0 0x7fd8b8156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b80d3b90 0x7fd8b815f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 --2- 172.21.15.55:0/2899626499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8b80d1130 0x7fd8b81f0ae0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 -- 172.21.15.55:0/2899626499 >> 172.21.15.55:0/2899626499 conn(0x7fd8b80726c0 msgr2=0x7fd8b80d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 -- 172.21.15.55:0/2899626499 shutdown_connections 2024-04-25T09:00:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.576+0000 7fd8c069e640 1 -- 172.21.15.55:0/2899626499 wait complete. 2024-04-25T09:00:56.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:00:56.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.691+0000 7f1528bcf640 1 Processor -- start 2024-04-25T09:00:56.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.691+0000 7f1528bcf640 1 -- start start 2024-04-25T09:00:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.692+0000 7f1528bcf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524144e70 0x7f152406d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.692+0000 7f1528bcf640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152406dcb0 con 0x7f152406d7a0 2024-04-25T09:00:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.692+0000 7f1528bcf640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152406df90 con 0x7f15240cf0e0 2024-04-25T09:00:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.692+0000 7f1528bcf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152415bfe0 con 0x7f1524144e70 2024-04-25T09:00:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.692+0000 7f1521d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f152406d7a0 0x7f15240ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42088/0 (socket says 172.21.15.55:42088) 2024-04-25T09:00:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.692+0000 7f1521d9b640 1 -- 172.21.15.55:0/63355468 learned_addr learned my addr 172.21.15.55:0/63355468 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:00:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.692+0000 7f152259c640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524144e70 0x7f152406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.692+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835469557 0 0) 0x7f152406dcb0 con 0x7f152406d7a0 2024-04-25T09:00:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.692+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f150c003520 con 0x7f152406d7a0 2024-04-25T09:00:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 389554055 0 0) 0x7f150c003520 con 0x7f152406d7a0 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524144e70 msgr2=0x7f152406d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524144e70 0x7f152406d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 >> v1:172.21.15.167:6789/0 conn(0x7f15240cf0e0 legacy=0x7f15240cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152406e270 con 0x7f152406d7a0 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f1518001690 con 0x7f152406d7a0 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 >> v1:172.21.15.55:6789/0 conn(0x7f152406d7a0 legacy=0x7f15240ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150c0039e0 0x7f150c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524144e70 0x7f150c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150c004d40 0x7f150c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152415bfe0 con 0x7f150c0039e0 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c00ba70 con 0x7f150c004d40 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c00bc70 con 0x7f1524144e70 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152259c640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150c0039e0 0x7f150c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f1521d9b640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524144e70 0x7f150c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f1522d9d640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150c004d40 0x7f150c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152259c640 1 -- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524144e70 msgr2=0x7f150c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152259c640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524144e70 0x7f150c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152259c640 1 -- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150c004d40 msgr2=0x7f150c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152259c640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150c004d40 0x7f150c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f152259c640 1 -- 172.21.15.55:0/63355468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c003520 con 0x7f150c0039e0 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f1521d9b640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524144e70 0x7f150c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.693+0000 7f1522d9d640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150c004d40 0x7f150c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.694+0000 7f152259c640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150c0039e0 0x7f150c003dc0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f1514009fc0 tx=0x7f150c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38c6b46217f8fc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.694+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514009c10 con 0x7f150c0039e0 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.694+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1514036070 con 0x7f150c0039e0 2024-04-25T09:00:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.694+0000 7f152159a640 1 -- 172.21.15.55:0/63355468 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514031880 con 0x7f150c0039e0 2024-04-25T09:00:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.695+0000 7f1528bcf640 1 -- 172.21.15.55:0/63355468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150c0039e0 msgr2=0x7f150c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.695+0000 7f1528bcf640 1 --2- 172.21.15.55:0/63355468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150c0039e0 0x7f150c003dc0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f1514009fc0 tx=0x7f150c005830 comp rx=0 tx=0).stop 2024-04-25T09:00:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.695+0000 7f1522d9d640 1 -- 172.21.15.55:0/63355468 reap_dead start 2024-04-25T09:00:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.695+0000 7f1528bcf640 1 -- 172.21.15.55:0/63355468 shutdown_connections 2024-04-25T09:00:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.695+0000 7f1528bcf640 1 -- 172.21.15.55:0/63355468 >> 172.21.15.55:0/63355468 conn(0x7f152406aba0 msgr2=0x7f152406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.695+0000 7f1528bcf640 1 -- 172.21.15.55:0/63355468 shutdown_connections 2024-04-25T09:00:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.695+0000 7f1528bcf640 1 -- 172.21.15.55:0/63355468 wait complete. 2024-04-25T09:00:56.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.696+0000 7f1528bcf640 1 Processor -- start 2024-04-25T09:00:56.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.696+0000 7f1528bcf640 1 -- start start 2024-04-25T09:00:56.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1528bcf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150c0039e0 0x7f152413c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1528bcf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524151c20 0x7f15241520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1528bcf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15240a84a0 0x7f15240a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1528bcf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1524145630 con 0x7f15240a84a0 2024-04-25T09:00:56.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1528bcf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15241454b0 con 0x7f150c0039e0 2024-04-25T09:00:56.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1528bcf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152406d260 con 0x7f1524151c20 2024-04-25T09:00:56.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1522d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15240a84a0 0x7f15240a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1522d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15240a84a0 0x7f15240a8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51248/0 (socket says 172.21.15.55:51248) 2024-04-25T09:00:56.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1522d9d640 1 -- 172.21.15.55:0/2121902679 learned_addr learned my addr 172.21.15.55:0/2121902679 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1521d9b640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524151c20 0x7f15241520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f152259c640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150c0039e0 0x7f152413c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1522d9d640 1 -- 172.21.15.55:0/2121902679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524151c20 msgr2=0x7f15241520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1522d9d640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524151c20 0x7f15241520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1522d9d640 1 -- 172.21.15.55:0/2121902679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150c0039e0 msgr2=0x7f152413c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1522d9d640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150c0039e0 0x7f152413c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1522d9d640 1 -- 172.21.15.55:0/2121902679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240b1100 con 0x7f15240a84a0 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1522d9d640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15240a84a0 0x7f15240a8920 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f1524145920 tx=0x7f151c00e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.697+0000 7f1512ffd640 1 -- 172.21.15.55:0/2121902679 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c019070 con 0x7f15240a84a0 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.698+0000 7f1512ffd640 1 -- 172.21.15.55:0/2121902679 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c0052e0 con 0x7f15240a84a0 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.698+0000 7f1528bcf640 1 -- 172.21.15.55:0/2121902679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15240b13e0 con 0x7f15240a84a0 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.698+0000 7f1512ffd640 1 -- 172.21.15.55:0/2121902679 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c003810 con 0x7f15240a84a0 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.698+0000 7f1528bcf640 1 -- 172.21.15.55:0/2121902679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15240b19a0 con 0x7f15240a84a0 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.698+0000 7f1528bcf640 1 -- 172.21.15.55:0/2121902679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15240750b0 con 0x7f15240a84a0 2024-04-25T09:00:56.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.699+0000 7f1512ffd640 1 -- 172.21.15.55:0/2121902679 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f151c01c070 con 0x7f15240a84a0 2024-04-25T09:00:56.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.699+0000 7f1512ffd640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f150406b4d0 0x7f150406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.699+0000 7f1512ffd640 1 -- 172.21.15.55:0/2121902679 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f151c0896f0 con 0x7f15240a84a0 2024-04-25T09:00:56.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.699+0000 7f152259c640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f150406b4d0 0x7f150406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.700+0000 7f152259c640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f150406b4d0 0x7f150406d990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1514035000 tx=0x7f151402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.704+0000 7f1512ffd640 1 -- 172.21.15.55:0/2121902679 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f151c058500 con 0x7f15240a84a0 2024-04-25T09:00:56.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.882+0000 7f1528bcf640 1 -- 172.21.15.55:0/2121902679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1524067e30 con 0x7f15240a84a0 2024-04-25T09:00:56.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.882+0000 7f1512ffd640 1 -- 172.21.15.55:0/2121902679 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f151c057e00 con 0x7f15240a84a0 2024-04-25T09:00:56.871 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T09:00:56.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 -- 172.21.15.55:0/2121902679 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f150406b4d0 msgr2=0x7f150406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f150406b4d0 0x7f150406d990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1514035000 tx=0x7f151402f000 comp rx=0 tx=0).stop 2024-04-25T09:00:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 -- 172.21.15.55:0/2121902679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15240a84a0 msgr2=0x7f15240a8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15240a84a0 0x7f15240a8920 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f1524145920 tx=0x7f151c00e960 comp rx=0 tx=0).stop 2024-04-25T09:00:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 -- 172.21.15.55:0/2121902679 shutdown_connections 2024-04-25T09:00:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f150406b4d0 0x7f150406d990 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15240a84a0 0x7f15240a8920 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1524151c20 0x7f15241520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 --2- 172.21.15.55:0/2121902679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f150c0039e0 0x7f152413c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 -- 172.21.15.55:0/2121902679 >> 172.21.15.55:0/2121902679 conn(0x7f152406aba0 msgr2=0x7f1524143c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 -- 172.21.15.55:0/2121902679 shutdown_connections 2024-04-25T09:00:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.884+0000 7f1528bcf640 1 -- 172.21.15.55:0/2121902679 wait complete. 2024-04-25T09:00:56.884 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:00:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.999+0000 7f311d86f640 1 Processor -- start 2024-04-25T09:00:56.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.999+0000 7f311d86f640 1 -- start start 2024-04-25T09:00:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.999+0000 7f311d86f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3118145550 0x7f311806ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.999+0000 7f311d86f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f311806bfb0 0x7f31180ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.999+0000 7f311d86f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31180caaf0 0x7f311815f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.999+0000 7f311d86f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311806c540 con 0x7f3118145550 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.999+0000 7f311d86f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31180cdc60 con 0x7f311806bfb0 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:56.999+0000 7f311d86f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31180cdf40 con 0x7f31180caaf0 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.000+0000 7f3116ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3118145550 0x7f311806ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.000+0000 7f3116ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3118145550 0x7f311806ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51254/0 (socket says 172.21.15.55:51254) 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.000+0000 7f3116ffd640 1 -- 172.21.15.55:0/1667453213 learned_addr learned my addr 172.21.15.55:0/1667453213 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.000+0000 7f31177fe640 1 --2- 172.21.15.55:0/1667453213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31180caaf0 0x7f311815f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.000+0000 7f31167fc640 1 --2- 172.21.15.55:0/1667453213 >> v2:172.21.15.167:3300/0 conn(0x7f311806bfb0 0x7f31180ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.000+0000 7f3116ffd640 1 -- 172.21.15.55:0/1667453213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31180caaf0 msgr2=0x7f311815f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.000+0000 7f3116ffd640 1 --2- 172.21.15.55:0/1667453213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31180caaf0 0x7f311815f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.000+0000 7f3116ffd640 1 -- 172.21.15.55:0/1667453213 >> v2:172.21.15.167:3300/0 conn(0x7f311806bfb0 msgr2=0x7f31180ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.000+0000 7f3116ffd640 1 --2- 172.21.15.55:0/1667453213 >> v2:172.21.15.167:3300/0 conn(0x7f311806bfb0 0x7f31180ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.000+0000 7f3116ffd640 1 -- 172.21.15.55:0/1667453213 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31180ce220 con 0x7f3118145550 2024-04-25T09:00:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.000+0000 7f31167fc640 1 --2- 172.21.15.55:0/1667453213 >> v2:172.21.15.167:3300/0 conn(0x7f311806bfb0 0x7f31180ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f3116ffd640 1 --2- 172.21.15.55:0/1667453213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3118145550 0x7f311806ba70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3118071600 tx=0x7f310802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef098c3afb8e675 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f3115ffb640 1 -- 172.21.15.55:0/1667453213 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108037070 con 0x7f3118145550 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f3115ffb640 1 -- 172.21.15.55:0/1667453213 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108032440 con 0x7f3118145550 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f3115ffb640 1 -- 172.21.15.55:0/1667453213 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108032810 con 0x7f3118145550 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f311d86f640 1 -- 172.21.15.55:0/1667453213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3118145550 msgr2=0x7f311806ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f311d86f640 1 --2- 172.21.15.55:0/1667453213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3118145550 0x7f311806ba70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3118071600 tx=0x7f310802a140 comp rx=0 tx=0).stop 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f311d86f640 1 -- 172.21.15.55:0/1667453213 shutdown_connections 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f311d86f640 1 --2- 172.21.15.55:0/1667453213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31180caaf0 0x7f311815f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f311d86f640 1 --2- 172.21.15.55:0/1667453213 >> v2:172.21.15.167:3300/0 conn(0x7f311806bfb0 0x7f31180ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f311d86f640 1 --2- 172.21.15.55:0/1667453213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3118145550 0x7f311806ba70 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f311d86f640 1 -- 172.21.15.55:0/1667453213 >> 172.21.15.55:0/1667453213 conn(0x7f31180cc9e0 msgr2=0x7f31180ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f311d86f640 1 -- 172.21.15.55:0/1667453213 shutdown_connections 2024-04-25T09:00:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.001+0000 7f311d86f640 1 -- 172.21.15.55:0/1667453213 wait complete. 2024-04-25T09:00:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.002+0000 7f311d86f640 1 Processor -- start 2024-04-25T09:00:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.003+0000 7f311d86f640 1 -- start start 2024-04-25T09:00:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.003+0000 7f311d86f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311806bfb0 0x7f31180c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.003+0000 7f311d86f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31180caaf0 0x7f31180ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.003+0000 7f311d86f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3118145550 0x7f31180aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.003+0000 7f311d86f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31180acdf0 con 0x7f311806bfb0 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.003+0000 7f311d86f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311806adc0 con 0x7f3118145550 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.003+0000 7f311d86f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31180acf70 con 0x7f31180caaf0 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.003+0000 7f3116ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311806bfb0 0x7f31180c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f3116ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311806bfb0 0x7f31180c61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51256/0 (socket says 172.21.15.55:51256) 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f3116ffd640 1 -- 172.21.15.55:0/4275104425 learned_addr learned my addr 172.21.15.55:0/4275104425 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f3116ffd640 1 -- 172.21.15.55:0/4275104425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31180caaf0 msgr2=0x7f31180ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f3116ffd640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31180caaf0 0x7f31180ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f31177fe640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3118145550 0x7f31180aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f3116ffd640 1 -- 172.21.15.55:0/4275104425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3118145550 msgr2=0x7f31180aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f3116ffd640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3118145550 0x7f31180aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f3116ffd640 1 -- 172.21.15.55:0/4275104425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31180c66f0 con 0x7f311806bfb0 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f31177fe640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3118145550 0x7f31180aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f3116ffd640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311806bfb0 0x7f31180c61b0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f31080097c0 tx=0x7f31080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f30fffff640 1 -- 172.21.15.55:0/4275104425 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108037040 con 0x7f311806bfb0 2024-04-25T09:00:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f30fffff640 1 -- 172.21.15.55:0/4275104425 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108042070 con 0x7f311806bfb0 2024-04-25T09:00:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f311d86f640 1 -- 172.21.15.55:0/4275104425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31181f2650 con 0x7f311806bfb0 2024-04-25T09:00:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f30fffff640 1 -- 172.21.15.55:0/4275104425 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108030bb0 con 0x7f311806bfb0 2024-04-25T09:00:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.004+0000 7f311d86f640 1 -- 172.21.15.55:0/4275104425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31181f2090 con 0x7f311806bfb0 2024-04-25T09:00:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.005+0000 7f311d86f640 1 -- 172.21.15.55:0/4275104425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31180750b0 con 0x7f311806bfb0 2024-04-25T09:00:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.006+0000 7f30fffff640 1 -- 172.21.15.55:0/4275104425 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3108047460 con 0x7f311806bfb0 2024-04-25T09:00:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.006+0000 7f30fffff640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f310406b4d0 0x7f310406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.006+0000 7f30fffff640 1 -- 172.21.15.55:0/4275104425 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f31080aae80 con 0x7f311806bfb0 2024-04-25T09:00:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.006+0000 7f31167fc640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f310406b4d0 0x7f310406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.007+0000 7f31167fc640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f310406b4d0 0x7f310406d990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f310c006fd0 tx=0x7f310c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:56.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.010+0000 7f30fffff640 1 -- 172.21.15.55:0/4275104425 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f31180c66f0 con 0x7f311806bfb0 2024-04-25T09:00:57.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.204+0000 7f311d86f640 1 -- 172.21.15.55:0/4275104425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f31180b16d0 con 0x7f311806bfb0 2024-04-25T09:00:57.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.204+0000 7f30fffff640 1 -- 172.21.15.55:0/4275104425 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v90) v1 ==== 80+0+122 (secure 0 0 0) 0x7f3108045360 con 0x7f311806bfb0 2024-04-25T09:00:57.193 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/3953928431 2024-04-26T08:59:46.600027+0000 2024-04-25T09:00:57.193 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/3953928431 2024-04-26T08:59:46.600027+0000 2024-04-25T09:00:57.193 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-04-25T09:00:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 -- 172.21.15.55:0/4275104425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f310406b4d0 msgr2=0x7f310406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f310406b4d0 0x7f310406d990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f310c006fd0 tx=0x7f310c008040 comp rx=0 tx=0).stop 2024-04-25T09:00:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 -- 172.21.15.55:0/4275104425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311806bfb0 msgr2=0x7f31180c61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311806bfb0 0x7f31180c61b0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f31080097c0 tx=0x7f31080046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 -- 172.21.15.55:0/4275104425 shutdown_connections 2024-04-25T09:00:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f310406b4d0 0x7f310406d990 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3118145550 0x7f31180aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31180caaf0 0x7f31180ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 --2- 172.21.15.55:0/4275104425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311806bfb0 0x7f31180c61b0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 -- 172.21.15.55:0/4275104425 >> 172.21.15.55:0/4275104425 conn(0x7f31180cc9e0 msgr2=0x7f31180c9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 -- 172.21.15.55:0/4275104425 shutdown_connections 2024-04-25T09:00:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.206+0000 7f311d86f640 1 -- 172.21.15.55:0/4275104425 wait complete. 2024-04-25T09:00:57.205 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:00:57.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:57.206 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:00:57.233 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:00:57.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:00:57.234 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:00:57.289 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.442+0000 7f91f7790640 1 Processor -- start 2024-04-25T09:00:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.442+0000 7f91f7790640 1 -- start start 2024-04-25T09:00:57.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.442+0000 7f91f7790640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91f015dce0 0x7f91f00d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.442+0000 7f91f7790640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91f00d35b0 0x7f91f00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f7790640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91f00d1f90 0x7f91f00b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f7790640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f015e0c0 con 0x7f91f00d35b0 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f7790640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f00d2510 con 0x7f91f00d1f90 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f7790640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00d27f0 con 0x7f91f015dce0 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f4d2b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91f00d35b0 0x7f91f00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f4d2b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91f00d35b0 0x7f91f00b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51270/0 (socket says 172.21.15.55:51270) 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f4d2b640 1 -- 172.21.15.55:0/2586320906 learned_addr learned my addr 172.21.15.55:0/2586320906 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f5d2d640 1 --2- 172.21.15.55:0/2586320906 >> v2:172.21.15.167:3300/0 conn(0x7f91f00d1f90 0x7f91f00b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f552c640 1 --2- 172.21.15.55:0/2586320906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91f015dce0 0x7f91f00d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f4d2b640 1 -- 172.21.15.55:0/2586320906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91f015dce0 msgr2=0x7f91f00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f4d2b640 1 --2- 172.21.15.55:0/2586320906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91f015dce0 0x7f91f00d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f4d2b640 1 -- 172.21.15.55:0/2586320906 >> v2:172.21.15.167:3300/0 conn(0x7f91f00d1f90 msgr2=0x7f91f00b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f4d2b640 1 --2- 172.21.15.55:0/2586320906 >> v2:172.21.15.167:3300/0 conn(0x7f91f00d1f90 0x7f91f00b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.443+0000 7f91f4d2b640 1 -- 172.21.15.55:0/2586320906 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00d2ad0 con 0x7f91f00d35b0 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91f4d2b640 1 --2- 172.21.15.55:0/2586320906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f00d35b0 0x7f91f00b5450 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f91f0161710 tx=0x7f91e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bad138cf11acd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91e7fff640 1 -- 172.21.15.55:0/2586320906 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0037070 con 0x7f91f00d35b0 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91e7fff640 1 -- 172.21.15.55:0/2586320906 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e0032440 con 0x7f91f00d35b0 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91e7fff640 1 -- 172.21.15.55:0/2586320906 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0032810 con 0x7f91f00d35b0 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91f7790640 1 -- 172.21.15.55:0/2586320906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f00d35b0 msgr2=0x7f91f00b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91f7790640 1 --2- 172.21.15.55:0/2586320906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f00d35b0 0x7f91f00b5450 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f91f0161710 tx=0x7f91e002a140 comp rx=0 tx=0).stop 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91f7790640 1 -- 172.21.15.55:0/2586320906 shutdown_connections 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91f7790640 1 --2- 172.21.15.55:0/2586320906 >> v2:172.21.15.167:3300/0 conn(0x7f91f00d1f90 0x7f91f00b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91f7790640 1 --2- 172.21.15.55:0/2586320906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f00d35b0 0x7f91f00b5450 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91f7790640 1 --2- 172.21.15.55:0/2586320906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91f015dce0 0x7f91f00d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91f7790640 1 -- 172.21.15.55:0/2586320906 >> 172.21.15.55:0/2586320906 conn(0x7f91f0072900 msgr2=0x7f91f00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.444+0000 7f91f7790640 1 -- 172.21.15.55:0/2586320906 shutdown_connections 2024-04-25T09:00:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.445+0000 7f91f7790640 1 -- 172.21.15.55:0/2586320906 wait complete. 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.446+0000 7f91f7790640 1 Processor -- start 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.446+0000 7f91f7790640 1 -- start start 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.446+0000 7f91f7790640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91f00d1f90 0x7f91f00d3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.446+0000 7f91f7790640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f00d35b0 0x7f91f00d4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.446+0000 7f91f7790640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91f015dce0 0x7f91f015f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.446+0000 7f91f7790640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00b9820 con 0x7f91f00d35b0 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.446+0000 7f91f7790640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00d3090 con 0x7f91f015dce0 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.446+0000 7f91f7790640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00b99a0 con 0x7f91f00d1f90 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.446+0000 7f91f4d2b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f00d35b0 0x7f91f00d4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f4d2b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f00d35b0 0x7f91f00d4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51274/0 (socket says 172.21.15.55:51274) 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f4d2b640 1 -- 172.21.15.55:0/356958398 learned_addr learned my addr 172.21.15.55:0/356958398 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f552c640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91f00d1f90 0x7f91f00d3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f5d2d640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91f015dce0 0x7f91f015f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f4d2b640 1 -- 172.21.15.55:0/356958398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91f00d1f90 msgr2=0x7f91f00d3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f4d2b640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91f00d1f90 0x7f91f00d3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f4d2b640 1 -- 172.21.15.55:0/356958398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91f015dce0 msgr2=0x7f91f015f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f4d2b640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91f015dce0 0x7f91f015f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f4d2b640 1 -- 172.21.15.55:0/356958398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f01f35f0 con 0x7f91f00d35b0 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f5d2d640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91f015dce0 0x7f91f015f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f552c640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91f00d1f90 0x7f91f00d3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f4d2b640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f00d35b0 0x7f91f00d4420 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f91e0000c00 tx=0x7f91e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91e5ffb640 1 -- 172.21.15.55:0/356958398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0041020 con 0x7f91f00d35b0 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91e5ffb640 1 -- 172.21.15.55:0/356958398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e00306c0 con 0x7f91f00d35b0 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f7790640 1 -- 172.21.15.55:0/356958398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f01f38d0 con 0x7f91f00d35b0 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91e5ffb640 1 -- 172.21.15.55:0/356958398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0037040 con 0x7f91f00d35b0 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.447+0000 7f91f7790640 1 -- 172.21.15.55:0/356958398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f01f3e90 con 0x7f91f00d35b0 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.448+0000 7f91f7790640 1 -- 172.21.15.55:0/356958398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f00749b0 con 0x7f91f00d35b0 2024-04-25T09:00:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.449+0000 7f91e5ffb640 1 -- 172.21.15.55:0/356958398 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f91e0044020 con 0x7f91f00d35b0 2024-04-25T09:00:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.449+0000 7f91e5ffb640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d406b4d0 0x7f91d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.449+0000 7f91e5ffb640 1 -- 172.21.15.55:0/356958398 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f91e00aa9e0 con 0x7f91f00d35b0 2024-04-25T09:00:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.449+0000 7f91f552c640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d406b4d0 0x7f91d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.450+0000 7f91f552c640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d406b4d0 0x7f91d406d990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f91e8006fd0 tx=0x7f91e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.453+0000 7f91e5ffb640 1 -- 172.21.15.55:0/356958398 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f91e004b030 con 0x7f91f00d35b0 2024-04-25T09:00:57.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.670+0000 7f91f7790640 1 -- 172.21.15.55:0/356958398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91f006b080 con 0x7f91f00d35b0 2024-04-25T09:00:57.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.671+0000 7f91e5ffb640 1 -- 172.21.15.55:0/356958398 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f91e0079880 con 0x7f91f00d35b0 2024-04-25T09:00:57.660 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:00:57.660 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T08:59:57.635474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":6,"addr":"172.21.15.55:6837/3282261214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3282261214},{"type":"v1","addr":"172.21.15.55:6837","nonce":3282261214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:00:57.660 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 58 2024-04-25T09:00:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.672+0000 7f91f7790640 1 -- 172.21.15.55:0/356958398 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d406b4d0 msgr2=0x7f91d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.673+0000 7f91f7790640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d406b4d0 0x7f91d406d990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f91e8006fd0 tx=0x7f91e8008040 comp rx=0 tx=0).stop 2024-04-25T09:00:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.673+0000 7f91f7790640 1 -- 172.21.15.55:0/356958398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f00d35b0 msgr2=0x7f91f00d4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.673+0000 7f91f7790640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f00d35b0 0x7f91f00d4420 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f91e0000c00 tx=0x7f91e00046c0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.673+0000 7f91f7790640 1 -- 172.21.15.55:0/356958398 shutdown_connections 2024-04-25T09:00:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.673+0000 7f91f7790640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f91d406b4d0 0x7f91d406d990 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.673+0000 7f91f7790640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91f015dce0 0x7f91f015f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.673+0000 7f91f7790640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f00d35b0 0x7f91f00d4420 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.673+0000 7f91f7790640 1 --2- 172.21.15.55:0/356958398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91f00d1f90 0x7f91f00d3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.673+0000 7f91f7790640 1 -- 172.21.15.55:0/356958398 >> 172.21.15.55:0/356958398 conn(0x7f91f0072900 msgr2=0x7f91f00b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.673+0000 7f91f7790640 1 -- 172.21.15.55:0/356958398 shutdown_connections 2024-04-25T09:00:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.673+0000 7f91f7790640 1 -- 172.21.15.55:0/356958398 wait complete. 2024-04-25T09:00:57.672 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T09:00:57.800 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-25T09:00:57.800 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:00:57.800 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:00:57.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.913+0000 7f71a3c58640 1 Processor -- start 2024-04-25T09:00:57.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.913+0000 7f71a3c58640 1 -- start start 2024-04-25T09:00:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.914+0000 7f71a3c58640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f719c15b910 0x7f719c0cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.914+0000 7f71a3c58640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c15e0b0 0x7f719c0d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.914+0000 7f71a3c58640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c15f2d0 con 0x7f719c15e510 2024-04-25T09:00:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.914+0000 7f71a3c58640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c15e9d0 con 0x7f719c15b910 2024-04-25T09:00:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.914+0000 7f71a3c58640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c15ecb0 con 0x7f719c15e0b0 2024-04-25T09:00:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.914+0000 7f71a21f5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f719c15e510 0x7f719c161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42102/0 (socket says 172.21.15.55:42102) 2024-04-25T09:00:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.914+0000 7f71a21f5640 1 -- 172.21.15.55:0/2878361990 learned_addr learned my addr 172.21.15.55:0/2878361990 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:00:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a11f3640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c15e0b0 0x7f719c0d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a19f4640 1 --2- 172.21.15.55:0/2878361990 >> v2:172.21.15.167:3300/0 conn(0x7f719c15b910 0x7f719c0cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873599676 0 0) 0x7f719c15f2d0 con 0x7f719c15e510 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7188003520 con 0x7f719c15e510 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2826402545 0 0) 0x7f7188003520 con 0x7f719c15e510 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c15e0b0 msgr2=0x7f719c0d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c15e0b0 0x7f719c0d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 >> v2:172.21.15.167:3300/0 conn(0x7f719c15b910 msgr2=0x7f719c0cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 --2- 172.21.15.55:0/2878361990 >> v2:172.21.15.167:3300/0 conn(0x7f719c15b910 0x7f719c0cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c15ef90 con 0x7f719c15e510 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f71940019f0 con 0x7f719c15e510 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 >> v1:172.21.15.55:6789/0 conn(0x7f719c15e510 legacy=0x7f719c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71880039b0 0x7f7188003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7188004800 0x7f7188004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c15e0b0 0x7f71880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c15e9d0 con 0x7f7188004800 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c15ecb0 con 0x7f71880039b0 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718800b9c0 con 0x7f719c15e0b0 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a11f3640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7188004800 0x7f7188004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a19f4640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71880039b0 0x7f7188003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a21f5640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c15e0b0 0x7f71880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a11f3640 1 -- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c15e0b0 msgr2=0x7f71880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a11f3640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c15e0b0 0x7f71880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a11f3640 1 -- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71880039b0 msgr2=0x7f7188003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a11f3640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71880039b0 0x7f7188003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a11f3640 1 -- 172.21.15.55:0/2878361990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188003520 con 0x7f7188004800 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.915+0000 7f71a21f5640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c15e0b0 0x7f71880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.916+0000 7f71a11f3640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7188004800 0x7f7188004c80 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f718c009ac0 tx=0x7f7188005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e06ac34b82429f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.916+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c036070 con 0x7f7188004800 2024-04-25T09:00:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.916+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c031400 con 0x7f7188004800 2024-04-25T09:00:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.916+0000 7f71a09f2640 1 -- 172.21.15.55:0/2878361990 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c009690 con 0x7f7188004800 2024-04-25T09:00:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.917+0000 7f71a3c58640 1 -- 172.21.15.55:0/2878361990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7188004800 msgr2=0x7f7188004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.917+0000 7f71a3c58640 1 --2- 172.21.15.55:0/2878361990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7188004800 0x7f7188004c80 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f718c009ac0 tx=0x7f7188005830 comp rx=0 tx=0).stop 2024-04-25T09:00:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.917+0000 7f71a21f5640 1 -- 172.21.15.55:0/2878361990 reap_dead start 2024-04-25T09:00:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.917+0000 7f71a3c58640 1 -- 172.21.15.55:0/2878361990 shutdown_connections 2024-04-25T09:00:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.917+0000 7f71a3c58640 1 -- 172.21.15.55:0/2878361990 >> 172.21.15.55:0/2878361990 conn(0x7f719c0726c0 msgr2=0x7f719c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.917+0000 7f71a3c58640 1 -- 172.21.15.55:0/2878361990 shutdown_connections 2024-04-25T09:00:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.917+0000 7f71a3c58640 1 -- 172.21.15.55:0/2878361990 wait complete. 2024-04-25T09:00:57.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.918+0000 7f71a3c58640 1 Processor -- start 2024-04-25T09:00:57.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.918+0000 7f71a3c58640 1 -- start start 2024-04-25T09:00:57.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a3c58640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7188004800 0x7f719c14fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a3c58640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0c8740 0x7f719c0d3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a3c58640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0c9c70 0x7f719c0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a3c58640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c160c20 con 0x7f719c0c8740 2024-04-25T09:00:57.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a3c58640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c160aa0 con 0x7f719c0c9c70 2024-04-25T09:00:57.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a3c58640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c160da0 con 0x7f7188004800 2024-04-25T09:00:57.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a11f3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0c8740 0x7f719c0d3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a11f3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0c8740 0x7f719c0d3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51292/0 (socket says 172.21.15.55:51292) 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a11f3640 1 -- 172.21.15.55:0/2726042581 learned_addr learned my addr 172.21.15.55:0/2726042581 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a21f5640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0c9c70 0x7f719c0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a19f4640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7188004800 0x7f719c14fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a11f3640 1 -- 172.21.15.55:0/2726042581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7188004800 msgr2=0x7f719c14fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a11f3640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7188004800 0x7f719c14fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a11f3640 1 -- 172.21.15.55:0/2726042581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0c9c70 msgr2=0x7f719c0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a11f3640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0c9c70 0x7f719c0ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a11f3640 1 -- 172.21.15.55:0/2726042581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0c8bd0 con 0x7f719c0c8740 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a21f5640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0c9c70 0x7f719c0ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.919+0000 7f71a11f3640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0c8740 0x7f719c0d3ef0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f718c009be0 tx=0x7f718c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.920+0000 7f71927fc640 1 -- 172.21.15.55:0/2726042581 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c040020 con 0x7f719c0c8740 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.920+0000 7f71927fc640 1 -- 172.21.15.55:0/2726042581 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c003a40 con 0x7f719c0c8740 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.920+0000 7f71a3c58640 1 -- 172.21.15.55:0/2726042581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c0c8eb0 con 0x7f719c0c8740 2024-04-25T09:00:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.920+0000 7f71927fc640 1 -- 172.21.15.55:0/2726042581 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c036040 con 0x7f719c0c8740 2024-04-25T09:00:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.920+0000 7f71a3c58640 1 -- 172.21.15.55:0/2726042581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c0c9470 con 0x7f719c0c8740 2024-04-25T09:00:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.921+0000 7f71a3c58640 1 -- 172.21.15.55:0/2726042581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c0750b0 con 0x7f719c0c8740 2024-04-25T09:00:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.921+0000 7f71927fc640 1 -- 172.21.15.55:0/2726042581 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f718c043020 con 0x7f719c0c8740 2024-04-25T09:00:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.922+0000 7f71927fc640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f718006b500 0x7f718006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.922+0000 7f71927fc640 1 -- 172.21.15.55:0/2726042581 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f718c0aa5b0 con 0x7f719c0c8740 2024-04-25T09:00:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.922+0000 7f71a19f4640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f718006b500 0x7f718006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.922+0000 7f71a19f4640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f718006b500 0x7f718006d9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7198009b80 tx=0x7f7198008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:57.926+0000 7f71927fc640 1 -- 172.21.15.55:0/2726042581 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f718c04a030 con 0x7f719c0c8740 2024-04-25T09:00:58.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.144+0000 7f71a3c58640 1 -- 172.21.15.55:0/2726042581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f719c0c7320 con 0x7f719c0c8740 2024-04-25T09:00:58.133 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T09:00:58.144+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:00:58.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.147+0000 7f71927fc640 1 -- 172.21.15.55:0/2726042581 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7f718c0793c0 con 0x7f719c0c8740 2024-04-25T09:00:58.136 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:00:58.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.150+0000 7f71a3c58640 1 -- 172.21.15.55:0/2726042581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f718006b500 msgr2=0x7f718006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.150+0000 7f71a3c58640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f718006b500 0x7f718006d9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7198009b80 tx=0x7f7198008040 comp rx=0 tx=0).stop 2024-04-25T09:00:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.150+0000 7f71a3c58640 1 -- 172.21.15.55:0/2726042581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0c8740 msgr2=0x7f719c0d3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.150+0000 7f71a3c58640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0c8740 0x7f719c0d3ef0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f718c009be0 tx=0x7f718c004730 comp rx=0 tx=0).stop 2024-04-25T09:00:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.151+0000 7f71a3c58640 1 -- 172.21.15.55:0/2726042581 shutdown_connections 2024-04-25T09:00:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.151+0000 7f71a3c58640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f718006b500 0x7f718006d9c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.151+0000 7f71a3c58640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0c9c70 0x7f719c0ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.151+0000 7f71a3c58640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0c8740 0x7f719c0d3ef0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.151+0000 7f71a3c58640 1 --2- 172.21.15.55:0/2726042581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7188004800 0x7f719c14fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.151+0000 7f71a3c58640 1 -- 172.21.15.55:0/2726042581 >> 172.21.15.55:0/2726042581 conn(0x7f719c0726c0 msgr2=0x7f719c15a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.151+0000 7f71a3c58640 1 -- 172.21.15.55:0/2726042581 shutdown_connections 2024-04-25T09:00:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.151+0000 7f71a3c58640 1 -- 172.21.15.55:0/2726042581 wait complete. 2024-04-25T09:00:58.143 INFO:tasks.ceph.mds.c.smithi055.stderr: -4540> 2024-04-25T08:59:52.619+0000 7fd86060e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:00:58.143 INFO:tasks.ceph.mds.c.smithi055.stderr: -4198> 2024-04-25T08:59:53.211+0000 7fd85c606640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T09:00:58.144 INFO:tasks.ceph.mds.c.smithi055.stderr: -4036> 2024-04-25T08:59:53.395+0000 7fd85c606640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T08:59:43.731639+0000 1=1+0) n(v0 rc2024-04-25T08:59:43.845636+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x556d2f548100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T08:59:43.731639+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T08:59:43.845636+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T09:00:58.148 INFO:tasks.ceph.mds.c.smithi055.stderr: -2196> 2024-04-25T09:00:24.714+0000 7fd85c606640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-25T08:59:43.731639+0000 1=1+0)->f(v1 m2024-04-25T08:59:43.731639+0000) n(v0 rc2024-04-25T08:59:43.845636+0000 2=1+1)->n(v0 rc2024-04-25T08:59:43.845636+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x556d2f548100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T08:59:43.731639+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T08:59:43.845636+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T09:00:58.154 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T09:00:58.176 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T09:00:58.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.205+0000 7f526b436740 1 -- start start 2024-04-25T09:00:58.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.205+0000 7f526b436740 1 Processor -- start 2024-04-25T09:00:58.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526b436740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561540d72c00 0x561540de2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526b436740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561540d73800 0x561540de2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526b436740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561540d73c00 0x561540de3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526b436740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561540e4e780 con 0x561540d73c00 2024-04-25T09:00:58.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526b436740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561540e4e600 con 0x561540d73800 2024-04-25T09:00:58.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526b436740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561540e4e480 con 0x561540d72c00 2024-04-25T09:00:58.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526955e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561540d73c00 0x561540de3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526955e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561540d73c00 0x561540de3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51318/0 (socket says 172.21.15.55:51318) 2024-04-25T09:00:58.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526955e640 1 -- 172.21.15.55:0/1596325861 learned_addr learned my addr 172.21.15.55:0/1596325861 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:58.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f5268d5d640 1 --2- 172.21.15.55:0/1596325861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561540d72c00 0x561540de2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526855c640 1 --2- 172.21.15.55:0/1596325861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561540d73800 0x561540de2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526955e640 1 -- 172.21.15.55:0/1596325861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561540d72c00 msgr2=0x561540de2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526955e640 1 --2- 172.21.15.55:0/1596325861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561540d72c00 0x561540de2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526955e640 1 -- 172.21.15.55:0/1596325861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561540d73800 msgr2=0x561540de2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526955e640 1 --2- 172.21.15.55:0/1596325861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561540d73800 0x561540de2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526955e640 1 -- 172.21.15.55:0/1596325861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561540d9f680 con 0x561540d73c00 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f5268d5d640 1 --2- 172.21.15.55:0/1596325861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561540d72c00 0x561540de2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526855c640 1 --2- 172.21.15.55:0/1596325861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561540d73800 0x561540de2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526955e640 1 --2- 172.21.15.55:0/1596325861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561540d73c00 0x561540de3080 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x561541b8dc80 tx=0x561541c36420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cf13db1b067df4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f5266558640 1 -- 172.21.15.55:0/1596325861 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561540d98680 con 0x561540d73c00 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f5266558640 1 -- 172.21.15.55:0/1596325861 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561540dbc1c0 con 0x561540d73c00 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f5266558640 1 -- 172.21.15.55:0/1596325861 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561540d989c0 con 0x561540d73c00 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526b436740 1 -- 172.21.15.55:0/1596325861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561540d9fa40 con 0x561540d73c00 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526b436740 1 -- 172.21.15.55:0/1596325861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x561540d9f2c0 con 0x561540d73c00 2024-04-25T09:00:58.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.206+0000 7f526b436740 4 waiting for MDS map... 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.207+0000 7f5266558640 1 -- 172.21.15.55:0/1596325861 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x561541c48600 con 0x561540d73c00 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.207+0000 7f5266558640 1 -- 172.21.15.55:0/1596325861 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 59) v1 ==== 2723+0+0 (secure 0 0 0) 0x561540dcb180 con 0x561540d73c00 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.207+0000 7f526b436740 4 Got MDS map 59 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.207+0000 7f526b436740 4 datascan.main: Using metadata pool output 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.207+0000 7f526b436740 4 datascan.main: connecting to RADOS... 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.207+0000 7f526b436740 1 Processor -- start 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.207+0000 7f526b436740 1 -- start start 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526b436740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d000 0x561540de3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526b436740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561541c4d400 0x561540de3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526b436740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561541c4d800 0x561540de4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526b436740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561540e4e300 con 0x561541c4d000 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526b436740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561540e4e000 con 0x561541c4d800 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526b436740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561540dd2900 con 0x561541c4d400 2024-04-25T09:00:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526855c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d000 0x561540de3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526855c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d000 0x561540de3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51326/0 (socket says 172.21.15.55:51326) 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526855c640 1 -- 172.21.15.55:0/2041600498 learned_addr learned my addr 172.21.15.55:0/2041600498 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f5268d5d640 1 --2- 172.21.15.55:0/2041600498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561541c4d400 0x561540de3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526855c640 1 -- 172.21.15.55:0/2041600498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561541c4d400 msgr2=0x561540de3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526855c640 1 --2- 172.21.15.55:0/2041600498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561541c4d400 0x561540de3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526855c640 1 -- 172.21.15.55:0/2041600498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561541c4d800 msgr2=0x561540de4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526855c640 1 --2- 172.21.15.55:0/2041600498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561541c4d800 0x561540de4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.208+0000 7f526855c640 1 -- 172.21.15.55:0/2041600498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561540d9f4a0 con 0x561541c4d000 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f526855c640 1 --2- 172.21.15.55:0/2041600498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d000 0x561540de3600 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x561541b8d260 tx=0x561541c36240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c37b67faa7fa631 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f5264554640 1 -- 172.21.15.55:0/2041600498 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561540d98680 con 0x561541c4d000 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f5264554640 1 -- 172.21.15.55:0/2041600498 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561540dbcc40 con 0x561541c4d000 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f5264554640 1 -- 172.21.15.55:0/2041600498 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561540d989c0 con 0x561541c4d000 2024-04-25T09:00:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f526b436740 1 -- 172.21.15.55:0/2041600498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d000 msgr2=0x561540de3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f526b436740 1 --2- 172.21.15.55:0/2041600498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d000 0x561540de3600 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x561541b8d260 tx=0x561541c36240 comp rx=0 tx=0).stop 2024-04-25T09:00:58.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f526b436740 1 -- 172.21.15.55:0/2041600498 shutdown_connections 2024-04-25T09:00:58.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f526b436740 1 --2- 172.21.15.55:0/2041600498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561541c4d800 0x561540de4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f526b436740 1 --2- 172.21.15.55:0/2041600498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561541c4d400 0x561540de3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f526b436740 1 --2- 172.21.15.55:0/2041600498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d000 0x561540de3600 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f526b436740 1 -- 172.21.15.55:0/2041600498 >> 172.21.15.55:0/2041600498 conn(0x561541c4cc00 msgr2=0x561540e5b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f526b436740 1 -- 172.21.15.55:0/2041600498 shutdown_connections 2024-04-25T09:00:58.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.209+0000 7f526b436740 1 -- 172.21.15.55:0/2041600498 wait complete. 2024-04-25T09:00:58.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.210+0000 7f526b436740 1 Processor -- start 2024-04-25T09:00:58.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.210+0000 7f526b436740 1 -- start start 2024-04-25T09:00:58.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.210+0000 7f526b436740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561541c4d000 0x561540de5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.210+0000 7f526b436740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d400 0x561540de4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.210+0000 7f526b436740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561541c4d800 0x561540de4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.210+0000 7f526b436740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561540e4f380 con 0x561541c4d400 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.210+0000 7f526b436740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561540e4e000 con 0x561541c4d000 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.210+0000 7f526b436740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561540e4f500 con 0x561541c4d800 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.210+0000 7f5268d5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d400 0x561540de4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.210+0000 7f5268d5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d400 0x561540de4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51330/0 (socket says 172.21.15.55:51330) 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.210+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 learned_addr learned my addr 172.21.15.55:0/3379322458 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f526855c640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561541c4d800 0x561540de4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561541c4d800 msgr2=0x561540de4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f526855c640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561541c4d000 0x561540de5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f5268d5d640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561541c4d800 0x561540de4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561541c4d000 msgr2=0x561540de5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f5268d5d640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561541c4d000 0x561540de5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561540d9f860 con 0x561541c4d400 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f526855c640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561541c4d000 0x561540de5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f5268d5d640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d400 0x561540de4c00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x561541c57da0 tx=0x561541c5ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f5262d51640 1 -- 172.21.15.55:0/3379322458 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561540d98680 con 0x561541c4d400 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f5262d51640 1 -- 172.21.15.55:0/3379322458 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561540dbd340 con 0x561541c4d400 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561540d9f680 con 0x561541c4d400 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f5262d51640 1 -- 172.21.15.55:0/3379322458 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561540d989c0 con 0x561541c4d400 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561540d9fa40 con 0x561541c4d400 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.211+0000 7f526b436740 4 datascan.init: resolving metadata pool 12 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.212+0000 7f5262d51640 1 -- 172.21.15.55:0/3379322458 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x561541b6ec00 con 0x561541c4d400 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.212+0000 7f5262d51640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x561541cbc800 0x561540de5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.213+0000 7f5262d51640 1 -- 172.21.15.55:0/3379322458 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x561541b6cc00 con 0x561541c4d400 2024-04-25T09:00:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.213+0000 7f526b436740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.213+0000 7f526b436740 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.213+0000 7f526b436740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.213+0000 7f526855c640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x561541cbc800 0x561540de5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.213+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x561541cbcc00 0x561540de4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.213+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541cbd000 con 0x561541cbcc00 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.213+0000 7f526855c640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x561541cbcc00 0x561540de4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.213+0000 7f526855c640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x561541cbc800 0x561540de5700 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x561541c56990 tx=0x561541c36180 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.213+0000 7f526855c640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x561541cbcc00 0x561540de4100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.214+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== osd_op_reply(1 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x561541cbcc00 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.214+0000 7f5263d53640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x5615410ec000 0x5615410f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.214+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:2 13.20 13:04000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410ec400 con 0x5615410ec000 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.214+0000 7f526955e640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x5615410ec000 0x5615410f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.214+0000 7f526955e640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x5615410ec000 0x5615410f2000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.215+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== osd_op_reply(2 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ec000 2024-04-25T09:00:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.215+0000 7f5264554640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5615410ecc00 0x5615410f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.215+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:3 13.10 13:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410ed000 con 0x5615410ecc00 2024-04-25T09:00:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.215+0000 7f5268d5d640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5615410ecc00 0x5615410f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.215+0000 7f5268d5d640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5615410ecc00 0x5615410f2580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.217+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(3 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x5615410ecc00 2024-04-25T09:00:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.217+0000 7f5263d53640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5615410ec800 0x5615410f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.217+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:4 13.30 13:0c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410ed800 con 0x5615410ec800 2024-04-25T09:00:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.218+0000 7f526855c640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5615410ec800 0x5615410f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.218+0000 7f526855c640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5615410ec800 0x5615410f2b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.220+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== osd_op_reply(4 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ec800 2024-04-25T09:00:58.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.220+0000 7f5264554640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5615410ed400 0x5615410f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.220+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:5 13.8 13:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104000 con 0x5615410ed400 2024-04-25T09:00:58.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.221+0000 7f526955e640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5615410ed400 0x5615410f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.221+0000 7f526955e640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5615410ed400 0x5615410f3600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.223+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.2 v2:172.21.15.55:6824/2942240833 1 ==== osd_op_reply(5 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ed400 2024-04-25T09:00:58.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.223+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:6 13.28 13:14000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410edc00 con 0x5615410ed400 2024-04-25T09:00:58.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.223+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.2 v2:172.21.15.55:6824/2942240833 2 ==== osd_op_reply(6 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ed400 2024-04-25T09:00:58.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.223+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:7 13.18 13:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104400 con 0x561541cbcc00 2024-04-25T09:00:58.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.224+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.7 v2:172.21.15.167:6816/2254116283 2 ==== osd_op_reply(7 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x561541cbcc00 2024-04-25T09:00:58.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.224+0000 7f5263d53640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x561541c4c800 0x5615410f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.224+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:8 13.38 13:1c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541cbd000 con 0x561541c4c800 2024-04-25T09:00:58.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.224+0000 7f5268d5d640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x561541c4c800 0x5615410f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.224+0000 7f5268d5d640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x561541c4c800 0x5615410f3080 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.226+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== osd_op_reply(8 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x561541c4c800 2024-04-25T09:00:58.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.226+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:9 13.4 13:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104800 con 0x5615410ec000 2024-04-25T09:00:58.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.227+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.6 v2:172.21.15.167:6820/1814554564 2 ==== osd_op_reply(9 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ec000 2024-04-25T09:00:58.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.227+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:10 13.24 13:24000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541b43400 con 0x5615410ec000 2024-04-25T09:00:58.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.227+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.6 v2:172.21.15.167:6820/1814554564 3 ==== osd_op_reply(10 [pgnls start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ec000 2024-04-25T09:00:58.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.227+0000 7f5264554640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5615410ed800 0x5615410f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.227+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:11 13.14 13:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410ec400 con 0x5615410ed800 2024-04-25T09:00:58.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.228+0000 7f526855c640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5615410ed800 0x5615410f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.228+0000 7f526855c640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5615410ed800 0x5615410f3b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.230+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.0 v2:172.21.15.55:6808/382211730 1 ==== osd_op_reply(11 [pgnls start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ed800 2024-04-25T09:00:58.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.230+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:12 13.34 13:2c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541b43000 con 0x5615410ec000 2024-04-25T09:00:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.231+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.6 v2:172.21.15.167:6820/1814554564 4 ==== osd_op_reply(12 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ec000 2024-04-25T09:00:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.231+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:13 13.c 13:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410edc00 con 0x5615410ecc00 2024-04-25T09:00:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.231+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.1 v2:172.21.15.55:6800/2726345870 2 ==== osd_op_reply(13 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x5615410ecc00 2024-04-25T09:00:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.231+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:14 13.2c 13:34000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104400 con 0x5615410ed400 2024-04-25T09:00:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.231+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.2 v2:172.21.15.55:6824/2942240833 3 ==== osd_op_reply(14 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ed400 2024-04-25T09:00:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.231+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:15 13.1c 13:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541c4c400 con 0x5615410ec000 2024-04-25T09:00:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.231+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.6 v2:172.21.15.167:6820/1814554564 5 ==== osd_op_reply(15 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ec000 2024-04-25T09:00:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.231+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:16 13.3c 13:3c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104000 con 0x5615410ed400 2024-04-25T09:00:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.232+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.2 v2:172.21.15.55:6824/2942240833 4 ==== osd_op_reply(16 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ed400 2024-04-25T09:00:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.232+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:17 13.2 13:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104800 con 0x561541c4c800 2024-04-25T09:00:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.232+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.5 v2:172.21.15.167:6800/1337224202 2 ==== osd_op_reply(17 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x561541c4c800 2024-04-25T09:00:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.232+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:18 13.22 13:44000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104c00 con 0x5615410ecc00 2024-04-25T09:00:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.232+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.1 v2:172.21.15.55:6800/2726345870 3 ==== osd_op_reply(18 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x5615410ecc00 2024-04-25T09:00:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.232+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:19 13.12 13:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104400 con 0x5615410ed800 2024-04-25T09:00:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.233+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.0 v2:172.21.15.55:6808/382211730 2 ==== osd_op_reply(19 [pgnls start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ed800 2024-04-25T09:00:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.233+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:20 13.32 13:4c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541105000 con 0x5615410ed400 2024-04-25T09:00:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.233+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.2 v2:172.21.15.55:6824/2942240833 5 ==== osd_op_reply(20 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ed400 2024-04-25T09:00:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.233+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:21 13.a 13:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541c4c400 con 0x5615410ed400 2024-04-25T09:00:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.233+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.2 v2:172.21.15.55:6824/2942240833 6 ==== osd_op_reply(21 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ed400 2024-04-25T09:00:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.233+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:22 13.2a 13:54000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541105400 con 0x5615410ecc00 2024-04-25T09:00:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.233+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.1 v2:172.21.15.55:6800/2726345870 4 ==== osd_op_reply(22 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x5615410ecc00 2024-04-25T09:00:58.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.233+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:23 13.1a 13:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541b43400 con 0x5615410ecc00 2024-04-25T09:00:58.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.233+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.1 v2:172.21.15.55:6800/2726345870 5 ==== osd_op_reply(23 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x5615410ecc00 2024-04-25T09:00:58.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.233+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:24 13.3a 13:5c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104800 con 0x561541c4c800 2024-04-25T09:00:58.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.234+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.5 v2:172.21.15.167:6800/1337224202 3 ==== osd_op_reply(24 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x561541c4c800 2024-04-25T09:00:58.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.234+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:25 13.6 13:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541b43000 con 0x5615410ec800 2024-04-25T09:00:58.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.234+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.4 v2:172.21.15.167:6808/1392386852 2 ==== osd_op_reply(25 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ec800 2024-04-25T09:00:58.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.234+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:26 13.26 13:64000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104000 con 0x561541cbcc00 2024-04-25T09:00:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.235+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.7 v2:172.21.15.167:6816/2254116283 3 ==== osd_op_reply(26 [pgnls start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x561541cbcc00 2024-04-25T09:00:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.235+0000 7f5264554640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x561541105c00 0x5615410f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.235+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:27 13.16 13:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111e000 con 0x561541105c00 2024-04-25T09:00:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.235+0000 7f526955e640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x561541105c00 0x5615410f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.235+0000 7f526955e640 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x561541105c00 0x5615410f4100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.235+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== osd_op_reply(27 [pgnls start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x561541105c00 2024-04-25T09:00:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.235+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:28 13.36 13:6c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541105800 con 0x5615410ec000 2024-04-25T09:00:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.236+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.6 v2:172.21.15.167:6820/1814554564 6 ==== osd_op_reply(28 [pgnls start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ec000 2024-04-25T09:00:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.236+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:29 13.e 13:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111e400 con 0x561541cbcc00 2024-04-25T09:00:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.236+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.7 v2:172.21.15.167:6816/2254116283 4 ==== osd_op_reply(29 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x561541cbcc00 2024-04-25T09:00:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.236+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:30 13.2e 13:74000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410ed000 con 0x5615410ed400 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.236+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.2 v2:172.21.15.55:6824/2942240833 7 ==== osd_op_reply(30 [pgnls start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ed400 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.236+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:31 13.1e 13:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111e800 con 0x5615410ec800 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.237+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.4 v2:172.21.15.167:6808/1392386852 3 ==== osd_op_reply(31 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ec800 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.237+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:32 13.3e 13:7c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410edc00 con 0x5615410ecc00 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.237+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.1 v2:172.21.15.55:6800/2726345870 6 ==== osd_op_reply(32 [pgnls start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x5615410ecc00 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.237+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:33 13.1 13:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111ec00 con 0x5615410ec000 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.237+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.6 v2:172.21.15.167:6820/1814554564 7 ==== osd_op_reply(33 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ec000 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.237+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:34 13.21 13:84000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541cbd000 con 0x5615410ec800 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.238+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.4 v2:172.21.15.167:6808/1392386852 4 ==== osd_op_reply(34 [pgnls start_epoch 91 out=49b] v87'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ec800 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.238+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:35 13.11 13:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111f000 con 0x5615410ecc00 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.238+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.1 v2:172.21.15.55:6800/2726345870 7 ==== osd_op_reply(35 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x5615410ecc00 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.238+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:36 13.31 13:8c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104c00 con 0x561541105c00 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.238+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.3 v2:172.21.15.55:6816/2016500802 2 ==== osd_op_reply(36 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x561541105c00 2024-04-25T09:00:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.238+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:37 13.9 13:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111f400 con 0x561541c4c800 2024-04-25T09:00:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.238+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.5 v2:172.21.15.167:6800/1337224202 4 ==== osd_op_reply(37 [pgnls start_epoch 91 out=49b] v87'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x561541c4c800 2024-04-25T09:00:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.238+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:38 13.29 13:94000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541105400 con 0x5615410ec000 2024-04-25T09:00:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.239+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.6 v2:172.21.15.167:6820/1814554564 8 ==== osd_op_reply(38 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ec000 2024-04-25T09:00:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.239+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:39 13.19 13:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111f800 con 0x561541105c00 2024-04-25T09:00:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.239+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.3 v2:172.21.15.55:6816/2016500802 3 ==== osd_op_reply(39 [pgnls start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x561541105c00 2024-04-25T09:00:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.239+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:40 13.39 13:9c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104800 con 0x5615410ed400 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.239+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.2 v2:172.21.15.55:6824/2942240833 8 ==== osd_op_reply(40 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ed400 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.239+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:41 13.5 13:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111e000 con 0x5615410ec800 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.240+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.4 v2:172.21.15.167:6808/1392386852 5 ==== osd_op_reply(41 [pgnls start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ec800 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.240+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:42 13.25 13:a4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541b43400 con 0x5615410ec800 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.240+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.4 v2:172.21.15.167:6808/1392386852 6 ==== osd_op_reply(42 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ec800 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.240+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:43 13.15 13:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541105000 con 0x5615410ec800 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.240+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.4 v2:172.21.15.167:6808/1392386852 7 ==== osd_op_reply(43 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ec800 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.240+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:44 13.35 13:ac000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541b43000 con 0x5615410ecc00 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.241+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.1 v2:172.21.15.55:6800/2726345870 8 ==== osd_op_reply(44 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x5615410ecc00 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.241+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:45 13.d 13:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541105800 con 0x5615410ec800 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.241+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.4 v2:172.21.15.167:6808/1392386852 8 ==== osd_op_reply(45 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ec800 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.241+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:46 13.2d 13:b4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410edc00 con 0x5615410ed800 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.241+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.0 v2:172.21.15.55:6808/382211730 3 ==== osd_op_reply(46 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ed800 2024-04-25T09:00:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.241+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:47 13.1d 13:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104c00 con 0x561541cbcc00 2024-04-25T09:00:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.242+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.7 v2:172.21.15.167:6816/2254116283 5 ==== osd_op_reply(47 [pgnls start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x561541cbcc00 2024-04-25T09:00:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.242+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:48 13.3d 13:bc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410ec400 con 0x561541cbcc00 2024-04-25T09:00:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.242+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.7 v2:172.21.15.167:6816/2254116283 6 ==== osd_op_reply(48 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x561541cbcc00 2024-04-25T09:00:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.242+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:49 13.3 13:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104400 con 0x5615410ed800 2024-04-25T09:00:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.242+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.0 v2:172.21.15.55:6808/382211730 4 ==== osd_op_reply(49 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ed800 2024-04-25T09:00:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.242+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:50 13.23 13:c4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111e000 con 0x5615410ecc00 2024-04-25T09:00:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.243+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.1 v2:172.21.15.55:6800/2726345870 9 ==== osd_op_reply(50 [pgnls start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x5615410ecc00 2024-04-25T09:00:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.243+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:51 13.13 13:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104000 con 0x561541cbcc00 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.243+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.7 v2:172.21.15.167:6816/2254116283 7 ==== osd_op_reply(51 [pgnls start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x561541cbcc00 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.243+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:52 13.33 13:cc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111ec00 con 0x561541cbcc00 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.243+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.7 v2:172.21.15.167:6816/2254116283 8 ==== osd_op_reply(52 [pgnls start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x561541cbcc00 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.243+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:53 13.b 13:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410ed000 con 0x561541c4c800 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.244+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.5 v2:172.21.15.167:6800/1337224202 5 ==== osd_op_reply(53 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x561541c4c800 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.244+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:54 13.2b 13:d4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541105000 con 0x5615410ed400 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.244+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.2 v2:172.21.15.55:6824/2942240833 9 ==== osd_op_reply(54 [pgnls start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ed400 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.244+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:55 13.1b 13:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541c4c400 con 0x5615410ec800 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.244+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.4 v2:172.21.15.167:6808/1392386852 9 ==== osd_op_reply(55 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ec800 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.244+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:56 13.3b 13:dc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541105800 con 0x5615410ec800 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.245+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.4 v2:172.21.15.167:6808/1392386852 10 ==== osd_op_reply(56 [pgnls start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ec800 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.245+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:57 13.7 13:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111e400 con 0x561541cbcc00 2024-04-25T09:00:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.245+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.7 v2:172.21.15.167:6816/2254116283 9 ==== osd_op_reply(57 [pgnls start_epoch 91 out=81b] v87'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x561540e60000 con 0x561541cbcc00 2024-04-25T09:00:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.245+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:58 13.7 13:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541cbd400 con 0x561541cbcc00 2024-04-25T09:00:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.245+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.7 v2:172.21.15.167:6816/2254116283 10 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x561540e60000 con 0x561541cbcc00 2024-04-25T09:00:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.245+0000 7f526b436740 10 datascan.operator(): handling object 1099511627777.0 2024-04-25T09:00:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.245+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:59 13.7 13:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541cbd800 con 0x561541cbcc00 2024-04-25T09:00:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.247+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.7 v2:172.21.15.167:6816/2254116283 11 ==== osd_op_reply(59 10000000001.00000000 [call] v91'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561540e60000 con 0x561541cbcc00 2024-04-25T09:00:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.247+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:60 13.27 13:e4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541cbdc00 con 0x5615410ecc00 2024-04-25T09:00:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.247+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.1 v2:172.21.15.55:6800/2726345870 10 ==== osd_op_reply(60 [pgnls start_epoch 91 out=49b] v87'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x5615410ecc00 2024-04-25T09:00:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.247+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:61 13.17 13:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111e800 con 0x561541c4c800 2024-04-25T09:00:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.248+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.5 v2:172.21.15.167:6800/1337224202 6 ==== osd_op_reply(61 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x561541c4c800 2024-04-25T09:00:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.248+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:62 13.37 13:ec000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541104c00 con 0x561541c4c800 2024-04-25T09:00:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.248+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 <== osd.5 v2:172.21.15.167:6800/1337224202 7 ==== osd_op_reply(62 [pgnls start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60780 con 0x561541c4c800 2024-04-25T09:00:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.248+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:63 13.f 13:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111fc00 con 0x5615410ec000 2024-04-25T09:00:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.248+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.6 v2:172.21.15.167:6820/1814554564 9 ==== osd_op_reply(63 [pgnls start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ec000 2024-04-25T09:00:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.248+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:64 13.2f 13:f4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5615410edc00 con 0x5615410ec800 2024-04-25T09:00:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.249+0000 7f526855c640 1 -- 172.21.15.55:0/3379322458 <== osd.4 v2:172.21.15.167:6808/1392386852 11 ==== osd_op_reply(64 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60000 con 0x5615410ec800 2024-04-25T09:00:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.249+0000 7f5264554640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:65 13.1f 13:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x56154111f000 con 0x5615410ec000 2024-04-25T09:00:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.249+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.6 v2:172.21.15.167:6820/1814554564 10 ==== osd_op_reply(65 [pgnls start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ec000 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.249+0000 7f5263d53640 1 -- 172.21.15.55:0/3379322458 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:66 13.3f 13:fc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x561541b43400 con 0x5615410ec000 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.249+0000 7f526955e640 1 -- 172.21.15.55:0/3379322458 <== osd.6 v2:172.21.15.167:6820/1814554564 11 ==== osd_op_reply(66 [pgnls start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561540e60500 con 0x5615410ec000 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5615410ed800 msgr2=0x5615410f3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5615410ed800 0x5615410f3b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5615410ecc00 msgr2=0x5615410f2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5615410ecc00 0x5615410f2580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5615410ed400 msgr2=0x5615410f3600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5615410ed400 0x5615410f3600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x561541105c00 msgr2=0x5615410f4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x561541105c00 0x5615410f4100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5615410ec800 msgr2=0x5615410f2b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5615410ec800 0x5615410f2b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x561541c4c800 msgr2=0x5615410f3080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 reap_dead start 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x561541c4c800 0x5615410f3080 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x5615410ec000 msgr2=0x5615410f2000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x5615410ec000 0x5615410f2000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 reap_dead start 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x561541cbcc00 msgr2=0x561540de4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x561541cbcc00 0x561540de4100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f5268d5d640 1 -- 172.21.15.55:0/3379322458 reap_dead start 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x561541cbc800 msgr2=0x561540de5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x561541cbc800 0x561540de5700 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x561541c56990 tx=0x561541c36180 comp rx=0 tx=0).stop 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d400 msgr2=0x561540de4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d400 0x561540de4c00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x561541c57da0 tx=0x561541c5ec00 comp rx=0 tx=0).stop 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 shutdown_connections 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x561541cbc800 0x561540de5700 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/3379322458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561541c4d400 0x561540de4c00 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 >> 172.21.15.55:0/3379322458 conn(0x561541c4cc00 msgr2=0x561540e5b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 shutdown_connections 2024-04-25T09:00:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/3379322458 wait complete. 2024-04-25T09:00:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/1596325861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561540d73c00 msgr2=0x561540de3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/1596325861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561540d73c00 0x561540de3080 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x561541b8dc80 tx=0x561541c36420 comp rx=0 tx=0).stop 2024-04-25T09:00:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/1596325861 shutdown_connections 2024-04-25T09:00:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/1596325861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561540d73c00 0x561540de3080 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/1596325861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561540d73800 0x561540de2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 --2- 172.21.15.55:0/1596325861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561540d72c00 0x561540de2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/1596325861 >> 172.21.15.55:0/1596325861 conn(0x561540d73000 msgr2=0x561540e5a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/1596325861 shutdown_connections 2024-04-25T09:00:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.250+0000 7f526b436740 1 -- 172.21.15.55:0/1596325861 wait complete. 2024-04-25T09:00:58.244 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.089700, result: 2024-04-25T09:00:58.244 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-04-25T09:00:58.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.335+0000 7ff6d6d1f740 1 -- start start 2024-04-25T09:00:58.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.335+0000 7ff6d6d1f740 1 Processor -- start 2024-04-25T09:00:58.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d6d1f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bbaeec00 0x5572bbb5e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d6d1f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bbaef800 0x5572bbb5eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d6d1f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bbaefc00 0x5572bbb5f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d6d1f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bbbca180 con 0x5572bbaef800 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d6d1f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bbbca300 con 0x5572bbaeec00 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d6d1f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5572bbbca480 con 0x5572bbaefc00 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d43d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bbaef800 0x5572bbb5eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d43d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bbaef800 0x5572bbb5eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51348/0 (socket says 172.21.15.55:51348) 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d4bd2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bbaeec00 0x5572bbb5e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2643863562 learned_addr learned my addr 172.21.15.55:0/2643863562 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/2643863562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bbaefc00 0x5572bbb5f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2643863562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bbaefc00 msgr2=0x5572bbb5f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/2643863562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bbaefc00 0x5572bbb5f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2643863562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bbaeec00 msgr2=0x5572bbb5e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/2643863562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bbaeec00 0x5572bbb5e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.336+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2643863562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572bbb1b680 con 0x5572bbaef800 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/2643863562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bbaef800 0x5572bbb5eb00 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x5572bc9031d0 tx=0x5572bc9ba120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c4c31f12bd0e17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d23cd640 1 -- 172.21.15.55:0/2643863562 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572bbb149c0 con 0x5572bbaef800 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d23cd640 1 -- 172.21.15.55:0/2643863562 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5572bbb381c0 con 0x5572bbaef800 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d23cd640 1 -- 172.21.15.55:0/2643863562 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572bbb14680 con 0x5572bbaef800 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2643863562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572bbb1b860 con 0x5572bbaef800 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2643863562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5572bbb1b2c0 con 0x5572bbaef800 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d6d1f740 4 waiting for MDS map... 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d23cd640 1 -- 172.21.15.55:0/2643863562 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x5572bc9cc200 con 0x5572bbaef800 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d23cd640 1 -- 172.21.15.55:0/2643863562 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 59) v1 ==== 2723+0+0 (secure 0 0 0) 0x5572bbb47180 con 0x5572bbaef800 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d6d1f740 4 Got MDS map 59 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d6d1f740 4 datascan.main: Using metadata pool output 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.337+0000 7ff6d6d1f740 4 datascan.main: connecting to RADOS... 2024-04-25T09:00:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.338+0000 7ff6d6d1f740 1 Processor -- start 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.338+0000 7ff6d6d1f740 1 -- start start 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.338+0000 7ff6d6d1f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bc8cfc00 0x5572bbb5f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.338+0000 7ff6d6d1f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0c000 0x5572bbb5fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.338+0000 7ff6d6d1f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bca0c400 0x5572bbb60100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.338+0000 7ff6d6d1f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bbbca600 con 0x5572bca0c000 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.338+0000 7ff6d6d1f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bbbca780 con 0x5572bca0c400 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.338+0000 7ff6d6d1f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5572bbbca900 con 0x5572bc8cfc00 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.338+0000 7ff6d4bd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0c000 0x5572bbb5fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.338+0000 7ff6d4bd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0c000 0x5572bbb5fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51356/0 (socket says 172.21.15.55:51356) 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.338+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/172364491 learned_addr learned my addr 172.21.15.55:0/172364491 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/172364491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bc8cfc00 0x5572bbb5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/172364491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bca0c400 0x5572bbb60100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/172364491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bc8cfc00 msgr2=0x5572bbb5f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d4bd2640 1 --2- 172.21.15.55:0/172364491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bc8cfc00 0x5572bbb5f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/172364491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bca0c400 msgr2=0x5572bbb60100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d4bd2640 1 --2- 172.21.15.55:0/172364491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bca0c400 0x5572bbb60100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/172364491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572bbb1b4a0 con 0x5572bca0c000 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/172364491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bc8cfc00 0x5572bbb5f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/172364491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bca0c400 0x5572bbb60100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d4bd2640 1 --2- 172.21.15.55:0/172364491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0c000 0x5572bbb5fb80 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x5572bc9b4f30 tx=0x5572bca1c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff01baa9992f008 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d03c9640 1 -- 172.21.15.55:0/172364491 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572bbb149c0 con 0x5572bca0c000 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d03c9640 1 -- 172.21.15.55:0/172364491 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5572bbb38e00 con 0x5572bca0c000 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d03c9640 1 -- 172.21.15.55:0/172364491 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572bbb14680 con 0x5572bca0c000 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/172364491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0c000 msgr2=0x5572bbb5fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/172364491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0c000 0x5572bbb5fb80 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x5572bc9b4f30 tx=0x5572bca1c000 comp rx=0 tx=0).stop 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/172364491 shutdown_connections 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/172364491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bca0c400 0x5572bbb60100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/172364491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0c000 0x5572bbb5fb80 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/172364491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bc8cfc00 0x5572bbb5f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/172364491 >> 172.21.15.55:0/172364491 conn(0x5572bc8cf800 msgr2=0x5572bbbd7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/172364491 shutdown_connections 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.339+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/172364491 wait complete. 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.340+0000 7ff6d6d1f740 1 Processor -- start 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.340+0000 7ff6d6d1f740 1 -- start start 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.340+0000 7ff6d6d1f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bc8cf800 0x5572bbb61180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.340+0000 7ff6d6d1f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bca0d000 0x5572bbb60c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d6d1f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0cc00 0x5572bbb60680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d6d1f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bbbcbc80 con 0x5572bca0cc00 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d6d1f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bbbcbb00 con 0x5572bc8cf800 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d6d1f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5572bbbcb980 con 0x5572bca0d000 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d43d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0cc00 0x5572bbb60680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d43d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0cc00 0x5572bbb60680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51360/0 (socket says 172.21.15.55:51360) 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 learned_addr learned my addr 172.21.15.55:0/2054261404 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d4bd2640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bca0d000 0x5572bbb60c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bc8cf800 0x5572bbb61180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bca0d000 msgr2=0x5572bbb60c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bca0d000 0x5572bbb60c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bc8cf800 msgr2=0x5572bbb61180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bc8cf800 0x5572bbb61180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572bbb1b0e0 con 0x5572bca0cc00 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0cc00 0x5572bbb60680 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x5572bc903e90 tx=0x5572bc9ba1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6cebc6640 1 -- 172.21.15.55:0/2054261404 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572bbb14b60 con 0x5572bca0cc00 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6cebc6640 1 -- 172.21.15.55:0/2054261404 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5572bbb38c40 con 0x5572bca0cc00 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572bbb1ba40 con 0x5572bca0cc00 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6cebc6640 1 -- 172.21.15.55:0/2054261404 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572bbb14820 con 0x5572bca0cc00 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572bbb1a3c0 con 0x5572bca0cc00 2024-04-25T09:00:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.341+0000 7ff6d6d1f740 4 datascan.init: resolving metadata pool 12 2024-04-25T09:00:58.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.343+0000 7ff6cebc6640 1 -- 172.21.15.55:0/2054261404 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x5572bca22c00 con 0x5572bca0cc00 2024-04-25T09:00:58.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.343+0000 7ff6cebc6640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5572bca33000 0x5572bbb61700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.343+0000 7ff6cebc6640 1 -- 172.21.15.55:0/2054261404 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x5572bca13200 con 0x5572bca0cc00 2024-04-25T09:00:58.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.343+0000 7ff6d6d1f740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:00:58.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.343+0000 7ff6d6d1f740 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-25T09:00:58.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.343+0000 7ff6d6d1f740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:00:58.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.343+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5572bca33000 0x5572bbb61700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.343+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x5572bca0c800 0x5572bbb60100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.343+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0c400 con 0x5572bca0c800 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.343+0000 7ff6d4bd2640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x5572bca0c800 0x5572bbb60100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.343+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5572bca33000 0x5572bbb61700 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5572bc903b90 tx=0x5572bca1cea0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.344+0000 7ff6d4bd2640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x5572bca0c800 0x5572bbb60100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.344+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv25 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.344+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x5572bca0c000 0x5572bbb5fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.344+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:2 12.1f 12:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0dc00 con 0x5572bca0c000 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.344+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x5572bca0c000 0x5572bbb5fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.345+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x5572bca0c000 0x5572bbb5fb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.345+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.345+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5572bca0d400 0x5572bbb5f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.345+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:3 13.0 13:00000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0d800 con 0x5572bca0d400 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.345+0000 7ff6d4bd2640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5572bca0d400 0x5572bbb5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.345+0000 7ff6d4bd2640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5572bca0d400 0x5572bbb5f600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.346+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.346+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:4 13.20 13:04000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe72000 con 0x5572bca0c000 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.346+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.346+0000 7ff6d03c9640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5572bbe72400 0x5572bbe80000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.346+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:5 13.10 13:08000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe72800 con 0x5572bbe72400 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.347+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5572bbe72400 0x5572bbe80000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.347+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5572bbe72400 0x5572bbe80000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.347+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.347+0000 7ff6cfbc8640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5572bbe73000 0x5572bbe80580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.347+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:6 13.30 13:0c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73400 con 0x5572bbe73000 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.347+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5572bbe73000 0x5572bbe80580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.348+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5572bbe73000 0x5572bbe80580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.348+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.348+0000 7ff6d03c9640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5572bbe72c00 0x5572bbe80b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.348+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:7 13.8 13:10000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe72000 con 0x5572bbe72c00 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.348+0000 7ff6d4bd2640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5572bbe72c00 0x5572bbe80b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.348+0000 7ff6d4bd2640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5572bbe72c00 0x5572bbe80b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.349+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.349+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:8 13.28 13:14000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73400 con 0x5572bbe72c00 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.349+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.349+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:9 13.18 13:18000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0dc00 con 0x5572bca0d400 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.349+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 2 ==== osd_op_reply(9 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.349+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:10 13.38 13:1c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73800 con 0x5572bca0c800 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.349+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.350+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:11 13.4 13:20000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca33c00 con 0x5572bca0c000 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.350+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 3 ==== osd_op_reply(11 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.350+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:12 13.24 13:24000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73c00 con 0x5572bca0c000 2024-04-25T09:00:58.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.350+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 4 ==== osd_op_reply(12 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.350+0000 7ff6d03c9640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5572bbe72000 0x5572bbe81080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.350+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:13 13.14 13:28000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73400 con 0x5572bbe72000 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.350+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5572bbe72000 0x5572bbe81080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.351+0000 7ff6d43d1640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5572bbe72000 0x5572bbe81080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.351+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.351+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:14 13.34 13:2c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73800 con 0x5572bca0c000 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.351+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.351+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:15 13.c 13:30000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0d800 con 0x5572bbe72400 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.351+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 2 ==== osd_op_reply(15 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.352+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:16 13.2c 13:34000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c000 con 0x5572bbe72c00 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.352+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 3 ==== osd_op_reply(16 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.352+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:17 13.1c 13:38000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0dc00 con 0x5572bca0c000 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.352+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.352+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:18 13.3c 13:3c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c400 con 0x5572bbe72c00 2024-04-25T09:00:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.352+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 4 ==== osd_op_reply(18 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.352+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:19 13.2 13:40000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8d400 con 0x5572bca0c800 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.353+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.353+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:20 13.22 13:44000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c800 con 0x5572bbe72400 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.353+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.353+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:21 13.12 13:48000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8d800 con 0x5572bbe72000 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.353+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.353+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:22 13.32 13:4c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8cc00 con 0x5572bbe72c00 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.353+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.353+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:23 13.a 13:50000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8dc00 con 0x5572bbe72c00 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.354+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 6 ==== osd_op_reply(23 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.354+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:24 13.2a 13:54000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8d000 con 0x5572bbe72400 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.354+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.354+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:25 13.1a 13:58000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c800 con 0x5572bbe72400 2024-04-25T09:00:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.354+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 5 ==== osd_op_reply(25 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.354+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:26 13.3a 13:5c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe92000 con 0x5572bca0c800 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.355+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 4 ==== osd_op_reply(26 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.355+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:27 13.6 13:60000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0d800 con 0x5572bbe73000 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.355+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 2 ==== osd_op_reply(27 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.355+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:28 13.26 13:64000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe92400 con 0x5572bca0d400 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.355+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.355+0000 7ff6d03c9640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x5572bbe72800 0x5572bbe81600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.355+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:29 13.16 13:68000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73400 con 0x5572bbe72800 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.356+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x5572bbe72800 0x5572bbe81600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.356+0000 7ff6d53d3640 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x5572bbe72800 0x5572bbe81600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.356+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== osd_op_reply(29 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe72800 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.356+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:30 13.36 13:6c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe92800 con 0x5572bca0c000 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.356+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 7 ==== osd_op_reply(30 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.356+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:31 13.e 13:70000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca32c00 con 0x5572bca0d400 2024-04-25T09:00:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.357+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 4 ==== osd_op_reply(31 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.357+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:32 13.2e 13:74000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe92c00 con 0x5572bbe72c00 2024-04-25T09:00:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.357+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 7 ==== osd_op_reply(32 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.357+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:33 13.1e 13:78000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca32800 con 0x5572bbe73000 2024-04-25T09:00:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.357+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 3 ==== osd_op_reply(33 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.357+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:34 13.3e 13:7c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe93000 con 0x5572bbe72400 2024-04-25T09:00:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.358+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 6 ==== osd_op_reply(34 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.358+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:35 13.1 13:80000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c000 con 0x5572bca0c000 2024-04-25T09:00:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.358+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 8 ==== osd_op_reply(35 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.358+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:36 13.21 13:84000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe93400 con 0x5572bbe73000 2024-04-25T09:00:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.358+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 91 out=49b] v87'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.358+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:37 13.11 13:88000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c400 con 0x5572bbe72400 2024-04-25T09:00:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.359+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 7 ==== osd_op_reply(37 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.359+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:38 13.31 13:8c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe92000 con 0x5572bbe72800 2024-04-25T09:00:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.359+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.3 v2:172.21.15.55:6816/2016500802 2 ==== osd_op_reply(38 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe72800 2024-04-25T09:00:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.359+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:39 13.9 13:90000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0dc00 con 0x5572bca0c800 2024-04-25T09:00:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.359+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 91 out=49b] v87'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.359+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:40 13.29 13:94000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe93800 con 0x5572bca0c000 2024-04-25T09:00:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.360+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 9 ==== osd_op_reply(40 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.360+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:41 13.19 13:98000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0d800 con 0x5572bbe72800 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.360+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.3 v2:172.21.15.55:6816/2016500802 3 ==== osd_op_reply(41 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe72800 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.360+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:42 13.39 13:9c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe93c00 con 0x5572bbe72c00 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.360+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 8 ==== osd_op_reply(42 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.360+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:43 13.5 13:a0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73c00 con 0x5572bbe73000 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.360+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 5 ==== osd_op_reply(43 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.360+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:44 13.25 13:a4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8d400 con 0x5572bbe73000 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.361+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 6 ==== osd_op_reply(44 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.361+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:45 13.15 13:a8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73800 con 0x5572bbe73000 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.361+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 7 ==== osd_op_reply(45 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.361+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:46 13.35 13:ac000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8cc00 con 0x5572bbe72400 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.361+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 8 ==== osd_op_reply(46 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.361+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:47 13.d 13:b0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca33c00 con 0x5572bbe73000 2024-04-25T09:00:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.362+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 8 ==== osd_op_reply(47 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.362+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:48 13.2d 13:b4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8dc00 con 0x5572bbe72000 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.362+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 3 ==== osd_op_reply(48 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.362+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:49 13.1d 13:b8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8d800 con 0x5572bca0d400 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.362+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 5 ==== osd_op_reply(49 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.362+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:50 13.3d 13:bc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe93000 con 0x5572bca0d400 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.362+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 6 ==== osd_op_reply(50 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.362+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:51 13.3 13:c0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8d000 con 0x5572bbe72000 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.363+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 4 ==== osd_op_reply(51 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.363+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:52 13.23 13:c4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe92800 con 0x5572bbe72400 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.363+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 9 ==== osd_op_reply(52 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.363+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:53 13.13 13:c8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c800 con 0x5572bca0d400 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.363+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 7 ==== osd_op_reply(53 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.363+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:54 13.33 13:cc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe93400 con 0x5572bca0d400 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.364+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 8 ==== osd_op_reply(54 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.364+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:55 13.b 13:d0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c400 con 0x5572bca0c800 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.364+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 6 ==== osd_op_reply(55 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.364+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:56 13.2b 13:d4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe92000 con 0x5572bbe72c00 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.364+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 9 ==== osd_op_reply(56 [pgnls-filter start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.364+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:57 13.1b 13:d8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8cc00 con 0x5572bbe73000 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.365+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 9 ==== osd_op_reply(57 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.365+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:58 13.3b 13:dc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c000 con 0x5572bbe73000 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.365+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 10 ==== osd_op_reply(58 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.365+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:59 13.7 13:e0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8dc00 con 0x5572bca0d400 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.365+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 9 ==== osd_op_reply(59 [pgnls-filter start_epoch 91 out=81b] v91'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.366+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:60 13.0 13:00000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0c400 con 0x5572bca0d400 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.366+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 10 ==== osd_op_reply(60 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.366+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:61 13.20 13:04000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca32800 con 0x5572bca0c000 2024-04-25T09:00:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.366+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 10 ==== osd_op_reply(61 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.366+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:62 13.10 13:08000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8d400 con 0x5572bbe72400 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.366+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 10 ==== osd_op_reply(62 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.367+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:63 13.30 13:0c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73400 con 0x5572bbe73000 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.367+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 11 ==== osd_op_reply(63 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.367+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:64 13.8 13:10000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8cc00 con 0x5572bbe72c00 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.367+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 10 ==== osd_op_reply(64 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.367+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:65 13.28 13:14000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe93800 con 0x5572bbe72c00 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.367+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 11 ==== osd_op_reply(65 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.367+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:66 13.18 13:18000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8d800 con 0x5572bca0d400 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.368+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 11 ==== osd_op_reply(66 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.368+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:67 13.38 13:1c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe92400 con 0x5572bca0c800 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.368+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 7 ==== osd_op_reply(67 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.368+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:68 13.4 13:20000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0d800 con 0x5572bca0c000 2024-04-25T09:00:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.368+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 11 ==== osd_op_reply(68 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.368+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:69 13.24 13:24000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe92c00 con 0x5572bca0c000 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.369+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 12 ==== osd_op_reply(69 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.369+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:70 13.14 13:28000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0dc00 con 0x5572bbe72000 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.369+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 5 ==== osd_op_reply(70 [pgnls-filter start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.369+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:71 13.34 13:2c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe93c00 con 0x5572bca0c000 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.369+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 13 ==== osd_op_reply(71 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.369+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:72 13.c 13:30000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca33c00 con 0x5572bbe72400 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.369+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 11 ==== osd_op_reply(72 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.370+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:73 13.2c 13:34000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe93000 con 0x5572bbe72c00 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.370+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.370+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:74 13.1c 13:38000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca32c00 con 0x5572bca0c000 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.370+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 14 ==== osd_op_reply(74 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.370+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:75 13.3c 13:3c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe93400 con 0x5572bbe72c00 2024-04-25T09:00:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.370+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 13 ==== osd_op_reply(75 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.370+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:76 13.2 13:40000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73c00 con 0x5572bca0c800 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.371+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.371+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:77 13.22 13:44000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe92000 con 0x5572bbe72400 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.371+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 12 ==== osd_op_reply(77 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.371+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:78 13.12 13:48000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73800 con 0x5572bbe72000 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.371+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 6 ==== osd_op_reply(78 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.371+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:79 13.32 13:4c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe93800 con 0x5572bbe72c00 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.372+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.372+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:80 13.a 13:50000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea8000 con 0x5572bbe72c00 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.372+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 15 ==== osd_op_reply(80 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.372+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:81 13.2a 13:54000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c800 con 0x5572bbe72400 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.372+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 13 ==== osd_op_reply(81 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.372+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:82 13.1a 13:58000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea8400 con 0x5572bbe72400 2024-04-25T09:00:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.372+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 14 ==== osd_op_reply(82 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.372+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:83 13.3a 13:5c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c400 con 0x5572bca0c800 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.373+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 9 ==== osd_op_reply(83 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.373+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:84 13.6 13:60000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea8800 con 0x5572bbe73000 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.373+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 12 ==== osd_op_reply(84 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.374+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:85 13.26 13:64000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8dc00 con 0x5572bca0d400 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.374+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.374+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:86 13.16 13:68000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea8c00 con 0x5572bbe72800 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.374+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.3 v2:172.21.15.55:6816/2016500802 4 ==== osd_op_reply(86 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe72800 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.374+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:87 13.36 13:6c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8cc00 con 0x5572bca0c000 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.375+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 15 ==== osd_op_reply(87 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.375+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:88 13.e 13:70000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea9000 con 0x5572bca0d400 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.375+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.375+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:89 13.2e 13:74000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0c400 con 0x5572bbe72c00 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.375+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 16 ==== osd_op_reply(89 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.375+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:90 13.1e 13:78000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea9400 con 0x5572bbe73000 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.376+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 13 ==== osd_op_reply(90 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.376+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:91 13.3e 13:7c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8d800 con 0x5572bbe72400 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.376+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 15 ==== osd_op_reply(91 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.376+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:92 13.1 13:80000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea9800 con 0x5572bca0c000 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.376+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 16 ==== osd_op_reply(92 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.376+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:93 13.21 13:84000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73c00 con 0x5572bbe73000 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.376+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 14 ==== osd_op_reply(93 [pgnls-filter start_epoch 91 out=49b] v87'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.376+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:94 13.11 13:88000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea9c00 con 0x5572bbe72400 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.377+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 16 ==== osd_op_reply(94 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.377+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:95 13.31 13:8c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73400 con 0x5572bbe72800 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.377+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.3 v2:172.21.15.55:6816/2016500802 5 ==== osd_op_reply(95 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe72800 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.377+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:96 13.9 13:90000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c400 con 0x5572bca0c800 2024-04-25T09:00:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.377+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 10 ==== osd_op_reply(96 [pgnls-filter start_epoch 91 out=49b] v87'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.377+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:97 13.29 13:94000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73800 con 0x5572bca0c000 2024-04-25T09:00:58.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.378+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 17 ==== osd_op_reply(97 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.378+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:98 13.19 13:98000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8dc00 con 0x5572bbe72800 2024-04-25T09:00:58.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.378+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.3 v2:172.21.15.55:6816/2016500802 6 ==== osd_op_reply(98 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe72800 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.378+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:99 13.39 13:9c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca32800 con 0x5572bbe72c00 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.378+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 17 ==== osd_op_reply(99 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.378+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:100 13.5 13:a0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c000 con 0x5572bbe73000 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.378+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 15 ==== osd_op_reply(100 [pgnls-filter start_epoch 91 out=49b] v87'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.379+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:101 13.25 13:a4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca32c00 con 0x5572bbe73000 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.379+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 16 ==== osd_op_reply(101 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.379+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:102 13.15 13:a8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8d000 con 0x5572bbe73000 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.379+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 17 ==== osd_op_reply(102 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.379+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:103 13.35 13:ac000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca33c00 con 0x5572bbe72400 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.380+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 17 ==== osd_op_reply(103 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.380+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:104 13.d 13:b0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8d400 con 0x5572bbe73000 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.380+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 18 ==== osd_op_reply(104 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.380+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:105 13.2d 13:b4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0d800 con 0x5572bbe72000 2024-04-25T09:00:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.380+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 7 ==== osd_op_reply(105 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.380+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:106 13.1d 13:b8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c800 con 0x5572bca0d400 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.381+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 14 ==== osd_op_reply(106 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.381+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:107 13.3d 13:bc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0dc00 con 0x5572bca0d400 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.381+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 15 ==== osd_op_reply(107 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.381+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:108 13.3 13:c0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8cc00 con 0x5572bbe72000 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.381+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 8 ==== osd_op_reply(108 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.381+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:109 13.23 13:c4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea8000 con 0x5572bbe72400 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.381+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 18 ==== osd_op_reply(109 [pgnls-filter start_epoch 91 out=49b] v87'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.381+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:110 13.13 13:c8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8dc00 con 0x5572bca0d400 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.382+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 16 ==== osd_op_reply(110 [pgnls-filter start_epoch 91 out=49b] v87'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.382+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:111 13.33 13:cc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea8800 con 0x5572bca0d400 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.382+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 17 ==== osd_op_reply(111 [pgnls-filter start_epoch 91 out=49b] v87'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.382+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:112 13.b 13:d0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c000 con 0x5572bca0c800 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.382+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 11 ==== osd_op_reply(112 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.382+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:113 13.2b 13:d4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbeb2000 con 0x5572bbe72c00 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.383+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.2 v2:172.21.15.55:6824/2942240833 18 ==== osd_op_reply(113 [pgnls-filter start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bbe72c00 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.383+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:114 13.1b 13:d8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73c00 con 0x5572bbe73000 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.383+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 19 ==== osd_op_reply(114 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.383+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:115 13.3b 13:dc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbeb2400 con 0x5572bbe73000 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.384+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 20 ==== osd_op_reply(115 [pgnls-filter start_epoch 91 out=49b] v87'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.384+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:116 13.7 13:e0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73400 con 0x5572bca0d400 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.384+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 18 ==== osd_op_reply(116 [pgnls-filter start_epoch 91 out=81b] v91'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.384+0000 7ff6d6d1f740 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.384+0000 7ff6d6d1f740 10 datascan.operator(): handling object 10000000001.0 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.384+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:117 13.7 13:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c800 con 0x5572bca0d400 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.384+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.7 v2:172.21.15.167:6816/2254116283 19 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0d400 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.384+0000 7ff6d6d1f740 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-04-25T09:00:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.384+0000 7ff6d6d1f740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.384+0000 7ff6d6d1f740 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.384+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:118 12.10 12:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8dc00 con 0x5572bbe72000 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.385+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 9 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+59 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.385+0000 7ff6d6d1f740 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.385+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe8c000 con 0x5572bca0c000 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.385+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 18 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=581b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+581 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.385+0000 7ff6d6d1f740 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.385+0000 7ff6d6d1f740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.385+0000 7ff6d6d1f740 20 datascan.get_frag_of: frag is * 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.385+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:120 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea9000 con 0x5572bbe72000 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.386+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 10 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.386+0000 7ff6d6d1f740 10 datascan.find_or_create_dirfrag: read_version = 17 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.386+0000 7ff6d6d1f740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.386+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:121 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea8800 con 0x5572bbe72000 2024-04-25T09:00:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.386+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 11 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.386+0000 7ff6d6d1f740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.386+0000 7ff6d6d1f740 20 datascan.read_dentry: file_head not found in result 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.386+0000 7ff6d6d1f740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.386+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:122 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0c400 con 0x5572bbe72000 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.388+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.0 v2:172.21.15.55:6808/382211730 12 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v91'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72000 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.388+0000 7ff6d6d1f740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.388+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:123 13.27 13:e4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bca0dc00 con 0x5572bbe72400 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.388+0000 7ff6d43d1640 1 -- 172.21.15.55:0/2054261404 <== osd.1 v2:172.21.15.55:6800/2726345870 19 ==== osd_op_reply(123 [pgnls-filter start_epoch 91 out=49b] v87'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc780 con 0x5572bbe72400 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.388+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:124 13.17 13:e8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbe73800 con 0x5572bca0c800 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.389+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 12 ==== osd_op_reply(124 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.389+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:125 13.37 13:ec000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbeb2800 con 0x5572bca0c800 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.389+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 <== osd.5 v2:172.21.15.167:6800/1337224202 13 ==== osd_op_reply(125 [pgnls-filter start_epoch 91 out=49b] v87'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc000 con 0x5572bca0c800 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.389+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:126 13.f 13:f0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea8c00 con 0x5572bca0c000 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.389+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 19 ==== osd_op_reply(126 [pgnls-filter start_epoch 91 out=49b] v87'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.389+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:127 13.2f 13:f4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbeb2c00 con 0x5572bbe73000 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.4 v2:172.21.15.167:6808/1392386852 21 ==== osd_op_reply(127 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bbe73000 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6cfbc8640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:128 13.1f 13:f8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbea9400 con 0x5572bca0c000 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 20 ==== osd_op_reply(128 [pgnls-filter start_epoch 91 out=49b] v87'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d03c9640 1 -- 172.21.15.55:0/2054261404 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:129 13.3f 13:fc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x5572bbeb3000 con 0x5572bca0c000 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d53d3640 1 -- 172.21.15.55:0/2054261404 <== osd.6 v2:172.21.15.167:6820/1814554564 21 ==== osd_op_reply(129 [pgnls-filter start_epoch 91 out=49b] v87'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5572bbbdc500 con 0x5572bca0c000 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5572bbe72000 msgr2=0x5572bbe81080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5572bbe72000 0x5572bbe81080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5572bbe72400 msgr2=0x5572bbe80000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5572bbe72400 0x5572bbe80000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5572bbe72c00 msgr2=0x5572bbe80b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5572bbe72c00 0x5572bbe80b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x5572bbe72800 msgr2=0x5572bbe81600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x5572bbe72800 0x5572bbe81600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 reap_dead start 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5572bbe73000 msgr2=0x5572bbe80580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5572bbe73000 0x5572bbe80580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x5572bca0c800 msgr2=0x5572bbb60100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x5572bca0c800 0x5572bbb60100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x5572bca0c000 msgr2=0x5572bbb5fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x5572bca0c000 0x5572bbb5fb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5572bca0d400 msgr2=0x5572bbb5f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5572bca0d400 0x5572bbb5f600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d4bd2640 1 -- 172.21.15.55:0/2054261404 reap_dead start 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5572bca33000 msgr2=0x5572bbb61700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5572bca33000 0x5572bbb61700 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5572bc903b90 tx=0x5572bca1cea0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0cc00 msgr2=0x5572bbb60680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0cc00 0x5572bbb60680 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x5572bc903e90 tx=0x5572bc9ba1e0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 shutdown_connections 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5572bca33000 0x5572bbb61700 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2054261404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bca0cc00 0x5572bbb60680 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.390+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 >> 172.21.15.55:0/2054261404 conn(0x5572bc8cfc00 msgr2=0x5572bbbd7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.391+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 shutdown_connections 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.391+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2054261404 wait complete. 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.391+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2643863562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bbaef800 msgr2=0x5572bbb5eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.391+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2643863562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bbaef800 0x5572bbb5eb00 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x5572bc9031d0 tx=0x5572bc9ba120 comp rx=0 tx=0).stop 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.391+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2643863562 shutdown_connections 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.391+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2643863562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5572bbaefc00 0x5572bbb5f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.391+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2643863562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5572bbaef800 0x5572bbb5eb00 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.391+0000 7ff6d6d1f740 1 --2- 172.21.15.55:0/2643863562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5572bbaeec00 0x5572bbb5e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.391+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2643863562 >> 172.21.15.55:0/2643863562 conn(0x5572bbaef000 msgr2=0x5572bbbd6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.391+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2643863562 shutdown_connections 2024-04-25T09:00:58.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.391+0000 7ff6d6d1f740 1 -- 172.21.15.55:0/2643863562 wait complete. 2024-04-25T09:00:58.393 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.148323, result: 2024-04-25T09:00:58.393 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T09:00:58.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.474+0000 7fd021816740 1 -- start start 2024-04-25T09:00:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd021816740 1 Processor -- start 2024-04-25T09:00:58.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd021816740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6cfdec00 0x55db6d04e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd021816740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6cfdf800 0x55db6d04eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd021816740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6cfdfc00 0x55db6d04f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd021816740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6de94180 con 0x55db6cfdfc00 2024-04-25T09:00:58.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd021816740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6de94300 con 0x55db6cfdec00 2024-04-25T09:00:58.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd021816740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db6de94480 con 0x55db6cfdf800 2024-04-25T09:00:58.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd01fce4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6cfdfc00 0x55db6d04f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd01fce4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6cfdfc00 0x55db6d04f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51380/0 (socket says 172.21.15.55:51380) 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd01fce4640 1 -- 172.21.15.55:0/3941366893 learned_addr learned my addr 172.21.15.55:0/3941366893 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd01ece2640 1 --2- 172.21.15.55:0/3941366893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6cfdf800 0x55db6d04eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.475+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/3941366893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6cfdec00 0x55db6d04e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd01fce4640 1 -- 172.21.15.55:0/3941366893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6cfdf800 msgr2=0x55db6d04eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd01fce4640 1 --2- 172.21.15.55:0/3941366893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6cfdf800 0x55db6d04eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd01fce4640 1 -- 172.21.15.55:0/3941366893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6cfdec00 msgr2=0x55db6d04e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd01fce4640 1 --2- 172.21.15.55:0/3941366893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6cfdec00 0x55db6d04e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd01fce4640 1 -- 172.21.15.55:0/3941366893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db6d00b680 con 0x55db6cfdfc00 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd01fce4640 1 --2- 172.21.15.55:0/3941366893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6cfdfc00 0x55db6d04f080 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x55db6dde3c80 tx=0x55db6dea0420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a2c097ab9b943f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd01ccde640 1 -- 172.21.15.55:0/3941366893 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55db6d004680 con 0x55db6cfdfc00 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd01ccde640 1 -- 172.21.15.55:0/3941366893 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55db6d028540 con 0x55db6cfdfc00 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd01ccde640 1 -- 172.21.15.55:0/3941366893 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55db6d004b60 con 0x55db6cfdfc00 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd021816740 1 -- 172.21.15.55:0/3941366893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db6d00b860 con 0x55db6cfdfc00 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd021816740 1 -- 172.21.15.55:0/3941366893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55db6d00b2c0 con 0x55db6cfdfc00 2024-04-25T09:00:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd021816740 4 waiting for MDS map... 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd01ccde640 1 -- 172.21.15.55:0/3941366893 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x55db6deb8600 con 0x55db6cfdfc00 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd01ccde640 1 -- 172.21.15.55:0/3941366893 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 59) v1 ==== 2723+0+0 (secure 0 0 0) 0x55db6d037180 con 0x55db6cfdfc00 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd021816740 4 Got MDS map 59 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd021816740 4 datascan.main: Using metadata pool output 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.476+0000 7fd021816740 4 datascan.main: connecting to RADOS... 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.477+0000 7fd021816740 1 Processor -- start 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.477+0000 7fd021816740 1 -- start start 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.477+0000 7fd021816740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6debb000 0x55db6d04f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.477+0000 7fd021816740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb400 0x55db6d04fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.477+0000 7fd021816740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6debb800 0x55db6d050100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.477+0000 7fd021816740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6de94600 con 0x55db6debb400 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.477+0000 7fd021816740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6de94780 con 0x55db6debb000 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.477+0000 7fd021816740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db6de94900 con 0x55db6debb800 2024-04-25T09:00:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01f4e3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb400 0x55db6d04fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01f4e3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb400 0x55db6d04fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51384/0 (socket says 172.21.15.55:51384) 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01f4e3640 1 -- 172.21.15.55:0/62834254 learned_addr learned my addr 172.21.15.55:0/62834254 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01ece2640 1 --2- 172.21.15.55:0/62834254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6debb000 0x55db6d04f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01ece2640 1 --2- 172.21.15.55:0/62834254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6debb800 0x55db6d050100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01f4e3640 1 -- 172.21.15.55:0/62834254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6debb800 msgr2=0x55db6d050100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/62834254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6debb800 0x55db6d050100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01f4e3640 1 -- 172.21.15.55:0/62834254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6debb000 msgr2=0x55db6d04f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/62834254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6debb000 0x55db6d04f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01f4e3640 1 -- 172.21.15.55:0/62834254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db6d00b4a0 con 0x55db6debb400 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/62834254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb400 0x55db6d04fb80 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x55db6dde3200 tx=0x55db6dea0240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6e9054ebd4fc3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01acda640 1 -- 172.21.15.55:0/62834254 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55db6d0049c0 con 0x55db6debb400 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01acda640 1 -- 172.21.15.55:0/62834254 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55db6d028e00 con 0x55db6debb400 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.478+0000 7fd01acda640 1 -- 172.21.15.55:0/62834254 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55db6d004680 con 0x55db6debb400 2024-04-25T09:00:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.479+0000 7fd021816740 1 -- 172.21.15.55:0/62834254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb400 msgr2=0x55db6d04fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.479+0000 7fd021816740 1 --2- 172.21.15.55:0/62834254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb400 0x55db6d04fb80 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x55db6dde3200 tx=0x55db6dea0240 comp rx=0 tx=0).stop 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.479+0000 7fd021816740 1 -- 172.21.15.55:0/62834254 shutdown_connections 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.479+0000 7fd021816740 1 --2- 172.21.15.55:0/62834254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6debb800 0x55db6d050100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.479+0000 7fd021816740 1 --2- 172.21.15.55:0/62834254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb400 0x55db6d04fb80 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.479+0000 7fd021816740 1 --2- 172.21.15.55:0/62834254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6debb000 0x55db6d04f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.479+0000 7fd021816740 1 -- 172.21.15.55:0/62834254 >> 172.21.15.55:0/62834254 conn(0x55db6debac00 msgr2=0x55db6d0c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.479+0000 7fd021816740 1 -- 172.21.15.55:0/62834254 shutdown_connections 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.479+0000 7fd021816740 1 -- 172.21.15.55:0/62834254 wait complete. 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.479+0000 7fd021816740 1 Processor -- start 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.479+0000 7fd021816740 1 -- start start 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd021816740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6debb000 0x55db6d051180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd021816740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6debb400 0x55db6d050c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd021816740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb800 0x55db6d050680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd021816740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6de95b00 con 0x55db6debb800 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd021816740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6de95980 con 0x55db6debb000 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd021816740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db6de95800 con 0x55db6debb400 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd01ece2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb800 0x55db6d050680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd01ece2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb800 0x55db6d050680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51400/0 (socket says 172.21.15.55:51400) 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 learned_addr learned my addr 172.21.15.55:0/849276294 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6debb400 0x55db6d050c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6debb000 0x55db6d051180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6debb400 msgr2=0x55db6d050c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6debb400 0x55db6d050c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6debb000 msgr2=0x55db6d051180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6debb000 0x55db6d051180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db6d00b680 con 0x55db6debb800 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.480+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb800 0x55db6d050680 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x55db6dea3c20 tx=0x55db6dd71620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.481+0000 7fd0194d7640 1 -- 172.21.15.55:0/849276294 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55db6d0049c0 con 0x55db6debb800 2024-04-25T09:00:58.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.481+0000 7fd0194d7640 1 -- 172.21.15.55:0/849276294 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55db6d028a80 con 0x55db6debb800 2024-04-25T09:00:58.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.481+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55db6d00b860 con 0x55db6debb800 2024-04-25T09:00:58.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.481+0000 7fd0194d7640 1 -- 172.21.15.55:0/849276294 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55db6d004680 con 0x55db6debb800 2024-04-25T09:00:58.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.481+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db6d00b0e0 con 0x55db6debb800 2024-04-25T09:00:58.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.481+0000 7fd021816740 4 datascan.init: resolving metadata pool 12 2024-04-25T09:00:58.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.482+0000 7fd0194d7640 1 -- 172.21.15.55:0/849276294 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x55db6df26c00 con 0x55db6debb800 2024-04-25T09:00:58.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.482+0000 7fd0194d7640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55db6df30800 0x55db6d051700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.482+0000 7fd0194d7640 1 -- 172.21.15.55:0/849276294 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x55db6ddcaa00 con 0x55db6debb800 2024-04-25T09:00:58.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.482+0000 7fd021816740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:00:58.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.482+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55db6df30800 0x55db6d051700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.482+0000 7fd021816740 4 datascan.main: resolving metadata pool 12 2024-04-25T09:00:58.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.482+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55db6df30c00 0x55db6d050100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.482+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:1 12.0 12:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6df31000 con 0x55db6df30c00 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.483+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55db6df30c00 0x55db6d050100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.483+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55db6df30800 0x55db6d051700 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55db6dde3200 tx=0x55db6dea01e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.483+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55db6df30c00 0x55db6d050100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.483+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== osd_op_reply(1 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6df30c00 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.483+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55db6df31000 0x55db6d360000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.483+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:2 12.10 12:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364000 con 0x55db6df31000 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.483+0000 7fd01fce4640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55db6df31000 0x55db6d360000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.484+0000 7fd01fce4640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55db6df31000 0x55db6d360000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.484+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 1 ==== osd_op_reply(2 [pgnls start_epoch 91 out=177b] v91'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.484+0000 7fd01fce4640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55db6d364000 0x55db6d360580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.484+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:3 12.8 12:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6deba400 con 0x55db6d364000 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.484+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55db6d364000 0x55db6d360580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.484+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55db6d364000 0x55db6d360580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.485+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== osd_op_reply(3 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364000 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.485+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55db6deba400 0x55db6d360b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.485+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:4 12.18 12:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab000 con 0x55db6deba400 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.485+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55db6deba400 0x55db6d360b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.485+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55db6deba400 0x55db6d360b00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.485+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(4 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.485+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55db6ddab000 0x55db6d361080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.485+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:5 12.4 12:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364400 con 0x55db6ddab000 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.486+0000 7fd01fce4640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55db6ddab000 0x55db6d361080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.486+0000 7fd01fce4640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55db6ddab000 0x55db6d361080 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.486+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== osd_op_reply(5 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.486+0000 7fd01fce4640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55db6d364400 0x55db6d361b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.486+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:6 12.14 12:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6deba800 con 0x55db6d364400 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.486+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55db6d364400 0x55db6d361b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.487+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55db6d364400 0x55db6d361b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.487+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== osd_op_reply(6 [pgnls start_epoch 91 out=149b] v90'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364400 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.487+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:7 12.c 12:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6deba800 con 0x55db6df31000 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.487+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 2 ==== osd_op_reply(7 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.487+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:8 12.1c 12:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6deba800 con 0x55db6df31000 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.488+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 3 ==== osd_op_reply(8 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.488+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:9 12.2 12:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6deba800 con 0x55db6df30c00 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.488+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.4 v2:172.21.15.167:6808/1392386852 2 ==== osd_op_reply(9 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6df30c00 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.488+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:10 12.12 12:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6deba800 con 0x55db6d364000 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.488+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.3 v2:172.21.15.55:6816/2016500802 2 ==== osd_op_reply(10 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364000 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.488+0000 7fd01f4e3640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55db6deba800 0x55db6d362680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.488+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:11 12.a 12:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6deba800 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.488+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55db6deba800 0x55db6d362680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.488+0000 7fd01ece2640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55db6deba800 0x55db6d362680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.489+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.2 v2:172.21.15.55:6824/2942240833 1 ==== osd_op_reply(11 [pgnls start_epoch 91 out=81b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba800 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.489+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:12 12.1a 12:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6df30c00 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.489+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.4 v2:172.21.15.167:6808/1392386852 3 ==== osd_op_reply(12 [pgnls start_epoch 91 out=49b] v88'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6df30c00 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.489+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:13 12.6 12:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6deba400 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.489+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 2 ==== osd_op_reply(13 [pgnls start_epoch 91 out=77b] v90'7 uv7 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.489+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:14 12.16 12:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6ddab000 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.490+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 2 ==== osd_op_reply(14 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.490+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:15 12.e 12:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6df31000 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.490+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 4 ==== osd_op_reply(15 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.490+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:16 12.1e 12:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6df30c00 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.490+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.4 v2:172.21.15.167:6808/1392386852 4 ==== osd_op_reply(16 [pgnls start_epoch 91 out=49b] v88'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6df30c00 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.490+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:17 12.1 12:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6ddab000 2024-04-25T09:00:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.490+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 3 ==== osd_op_reply(17 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.490+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:18 12.11 12:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6d364400 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.491+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.5 v2:172.21.15.167:6800/1337224202 2 ==== osd_op_reply(18 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364400 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.491+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:19 12.9 12:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6deba800 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.491+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.2 v2:172.21.15.55:6824/2942240833 2 ==== osd_op_reply(19 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba800 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.491+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:20 12.19 12:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6df31000 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.491+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 5 ==== osd_op_reply(20 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.491+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:21 12.5 12:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6ddab000 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.492+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 4 ==== osd_op_reply(21 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.492+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:22 12.15 12:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6ddab400 con 0x55db6ddab000 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.492+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 5 ==== osd_op_reply(22 [pgnls start_epoch 91 out=97b] v90'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.492+0000 7fd01fce4640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55db6ddab400 0x55db6d362100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.492+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:23 12.d 12:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6ddab400 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.492+0000 7fd01fce4640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55db6ddab400 0x55db6d362100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.492+0000 7fd01fce4640 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55db6ddab400 0x55db6d362100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.493+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== osd_op_reply(23 [pgnls start_epoch 91 out=74b] v86'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab400 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.493+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:24 12.1d 12:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6df31000 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.493+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 6 ==== osd_op_reply(24 [pgnls start_epoch 91 out=73b] v90'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.493+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:25 12.3 12:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6df31000 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.493+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 7 ==== osd_op_reply(25 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.493+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:26 12.13 12:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6deba400 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.494+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 3 ==== osd_op_reply(26 [pgnls start_epoch 91 out=98b] v90'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.494+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:27 12.b 12:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6d364000 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.494+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.3 v2:172.21.15.55:6816/2016500802 3 ==== osd_op_reply(27 [pgnls start_epoch 91 out=76b] v90'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364000 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.494+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:28 12.1b 12:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6df30c00 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.494+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.4 v2:172.21.15.167:6808/1392386852 5 ==== osd_op_reply(28 [pgnls start_epoch 91 out=73b] v90'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6df30c00 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.494+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:29 12.7 12:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6deba400 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.494+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 4 ==== osd_op_reply(29 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.495+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:30 12.17 12:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6ddab000 2024-04-25T09:00:58.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.495+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 6 ==== osd_op_reply(30 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.495+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:31 12.f 12:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6ddab000 2024-04-25T09:00:58.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.495+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 7 ==== osd_op_reply(31 [pgnls start_epoch 91 out=73b] v86'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.495+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:32 12.1f 12:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6ddab000 2024-04-25T09:00:58.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.495+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 8 ==== osd_op_reply(32 [pgnls start_epoch 91 out=101b] v90'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.495+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.495+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:33 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6df31400 con 0x55db6df31000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:34 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6df31800 con 0x55db6df31000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:35 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6df31c00 con 0x55db6df31000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd021816740 20 datascan.scan_links: injected ino detected 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:36 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d365800 con 0x55db6df31000 2024-04-25T09:00:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.496+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:37 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d365400 con 0x55db6df31000 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:38 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d365000 con 0x55db6d364400 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.5 v2:172.21.15.167:6800/1337224202 3 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364400 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:39 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6df31000 2024-04-25T09:00:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.497+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:40 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6df31400 con 0x55db6deba800 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.2 v2:172.21.15.55:6824/2942240833 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba800 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:41 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6df31800 con 0x55db6df31000 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 14 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:42 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d365c00 con 0x55db6ddab000 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T09:00:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.498+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:43 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d386000 con 0x55db6df31000 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:44 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d386400 con 0x55db6deba400 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 5 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 200.00000002 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T09:00:58.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:45 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d386800 con 0x55db6deba400 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 6 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.499+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:46 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d386c00 con 0x55db6ddab000 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.500+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 10 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1163 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.500+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:47 12.0 12:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d387000 con 0x55db6df30c00 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.500+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.4 v2:172.21.15.167:6808/1392386852 6 ==== osd_op_reply(47 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6df30c00 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.500+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:48 12.10 12:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df31000 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.501+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 16 ==== osd_op_reply(48 [pgnls start_epoch 91 out=177b] v91'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.501+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:49 12.8 12:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6d364000 2024-04-25T09:00:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.501+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.3 v2:172.21.15.55:6816/2016500802 4 ==== osd_op_reply(49 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364000 2024-04-25T09:00:58.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.501+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:50 12.18 12:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6deba400 2024-04-25T09:00:58.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.501+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 7 ==== osd_op_reply(50 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.501+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:51 12.4 12:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6ddab000 2024-04-25T09:00:58.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.501+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 11 ==== osd_op_reply(51 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.501+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:52 12.14 12:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6d364400 2024-04-25T09:00:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.502+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.5 v2:172.21.15.167:6800/1337224202 4 ==== osd_op_reply(52 [pgnls start_epoch 91 out=149b] v90'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364400 2024-04-25T09:00:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.502+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:53 12.c 12:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df31000 2024-04-25T09:00:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.502+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 17 ==== osd_op_reply(53 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.502+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:54 12.1c 12:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df31000 2024-04-25T09:00:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.502+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 18 ==== osd_op_reply(54 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.502+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:55 12.2 12:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df30c00 2024-04-25T09:00:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.503+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.4 v2:172.21.15.167:6808/1392386852 7 ==== osd_op_reply(55 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6df30c00 2024-04-25T09:00:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.503+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:56 12.12 12:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6d364000 2024-04-25T09:00:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.503+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.3 v2:172.21.15.55:6816/2016500802 5 ==== osd_op_reply(56 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364000 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.503+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:57 12.a 12:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6deba800 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.503+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.2 v2:172.21.15.55:6824/2942240833 4 ==== osd_op_reply(57 [pgnls start_epoch 91 out=81b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba800 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.503+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:58 12.1a 12:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df30c00 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.503+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.4 v2:172.21.15.167:6808/1392386852 8 ==== osd_op_reply(58 [pgnls start_epoch 91 out=49b] v88'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6df30c00 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.503+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:59 12.6 12:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6deba400 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.504+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 8 ==== osd_op_reply(59 [pgnls start_epoch 91 out=77b] v90'7 uv7 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.504+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:60 12.16 12:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6ddab000 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.504+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 12 ==== osd_op_reply(60 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.504+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:61 12.e 12:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df31000 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.504+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 19 ==== osd_op_reply(61 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.504+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:62 12.1e 12:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df30c00 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.505+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.4 v2:172.21.15.167:6808/1392386852 9 ==== osd_op_reply(62 [pgnls start_epoch 91 out=49b] v88'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6df30c00 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.505+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:63 12.1 12:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6ddab000 2024-04-25T09:00:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.505+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 13 ==== osd_op_reply(63 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.505+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:64 12.11 12:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6d364400 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.505+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.5 v2:172.21.15.167:6800/1337224202 5 ==== osd_op_reply(64 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364400 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.505+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:65 12.9 12:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6deba800 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.505+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.2 v2:172.21.15.55:6824/2942240833 5 ==== osd_op_reply(65 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba800 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.505+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:66 12.19 12:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df31000 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.506+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 20 ==== osd_op_reply(66 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.506+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:67 12.5 12:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6ddab000 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.506+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 14 ==== osd_op_reply(67 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.506+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:68 12.15 12:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6ddab000 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.506+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 15 ==== osd_op_reply(68 [pgnls start_epoch 91 out=97b] v90'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.506+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:69 12.d 12:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6ddab400 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.507+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.7 v2:172.21.15.167:6816/2254116283 2 ==== osd_op_reply(69 [pgnls start_epoch 91 out=74b] v86'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab400 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.507+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:70 12.1d 12:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df31000 2024-04-25T09:00:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.507+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 21 ==== osd_op_reply(70 [pgnls start_epoch 91 out=73b] v90'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.507+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:71 12.3 12:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df31000 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.507+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 22 ==== osd_op_reply(71 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.507+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:72 12.13 12:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6deba400 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.507+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 9 ==== osd_op_reply(72 [pgnls start_epoch 91 out=98b] v90'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.507+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:73 12.b 12:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6d364000 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.507+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.3 v2:172.21.15.55:6816/2016500802 6 ==== osd_op_reply(73 [pgnls start_epoch 91 out=76b] v90'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364000 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.507+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:74 12.1b 12:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df30c00 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.508+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.4 v2:172.21.15.167:6808/1392386852 10 ==== osd_op_reply(74 [pgnls start_epoch 91 out=73b] v90'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6df30c00 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.508+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:75 12.7 12:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6deba400 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.508+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 10 ==== osd_op_reply(75 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.508+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:76 12.17 12:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6ddab000 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.508+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 16 ==== osd_op_reply(76 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.508+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:77 12.f 12:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6ddab000 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.509+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 17 ==== osd_op_reply(77 [pgnls start_epoch 91 out=73b] v86'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.509+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:78 12.1f 12:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6ddab000 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.509+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 18 ==== osd_op_reply(78 [pgnls start_epoch 91 out=101b] v90'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.509+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.509+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:79 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d387400 con 0x55db6df31000 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.509+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 23 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.509+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.509+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:80 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d387800 con 0x55db6df31000 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.509+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 24 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.509+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.509+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:81 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d387c00 con 0x55db6df31000 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 25 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 20 datascan.scan_links: injected ino detected 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-04-25T09:00:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:82 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d386400 con 0x55db6df31000 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 26 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:83 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d386800 con 0x55db6df31000 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 27 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.510+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:84 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d387000 con 0x55db6d364400 2024-04-25T09:00:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.511+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 <== osd.5 v2:172.21.15.167:6800/1337224202 6 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc780 con 0x55db6d364400 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.511+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.511+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:85 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d386000 con 0x55db6df31000 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.511+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 28 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.511+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.511+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:86 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d365400 con 0x55db6deba800 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.511+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.2 v2:172.21.15.55:6824/2942240833 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba800 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:87 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364c00 con 0x55db6df31000 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 29 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:88 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d365c00 con 0x55db6ddab000 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 19 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d386c00 con 0x55db6df31000 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 30 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.512+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:90 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d387400 con 0x55db6deba400 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 11 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 200.00000002 2024-04-25T09:00:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:91 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d387800 con 0x55db6deba400 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 12 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.513+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:92 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d387c00 con 0x55db6ddab000 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.514+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.6 v2:172.21.15.167:6820/1814554564 20 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1163 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6ddab000 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.514+0000 7fd021816740 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.514+0000 7fd021816740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.514+0000 7fd021816740 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.514+0000 7fd021816740 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-04-25T09:00:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.514+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:93 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d386400 con 0x55db6df31000 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.514+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 31 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.514+0000 7fd021816740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.514+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:94 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d386800 con 0x55db6df31000 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.515+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 32 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v91'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.515+0000 7fd021816740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.515+0000 7fd021816740 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.515+0000 7fd021816740 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.515+0000 7fd021816740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.515+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:95 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d386000 con 0x55db6df31000 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.515+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 33 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.515+0000 7fd021816740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.515+0000 7fd021816740 20 datascan.scan_links: first is now 2 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.515+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:96 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d364800 con 0x55db6df31000 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.517+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.0 v2:172.21.15.55:6808/382211730 34 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v91'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55db6d0cc500 con 0x55db6df31000 2024-04-25T09:00:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.517+0000 7fd021816740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.517+0000 7fd021816740 10 datascan.scan_links: updating inotable 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.517+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:97 12.13 12:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d387400 con 0x55db6deba400 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.517+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 13 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+50 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.517+0000 7fd021816740 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.517+0000 7fd021816740 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.517+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:98 12.13 12:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d387800 con 0x55db6deba400 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd01ece2640 1 -- 172.21.15.55:0/849276294 <== osd.1 v2:172.21.15.55:6800/2726345870 14 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v91'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55db6d0cc000 con 0x55db6deba400 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 10 datascan.scan_links: updating snaptable 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:99 12.d 12:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v9 -- 0x55db6d365800 con 0x55db6ddab400 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd01fce4640 1 -- 172.21.15.55:0/849276294 <== osd.7 v2:172.21.15.167:6816/2254116283 3 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55db6d0cc280 con 0x55db6ddab400 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55db6df31000 msgr2=0x55db6d360000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55db6df31000 0x55db6d360000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55db6deba400 msgr2=0x55db6d360b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55db6deba400 0x55db6d360b00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55db6deba800 msgr2=0x55db6d362680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55db6deba800 0x55db6d362680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55db6d364000 msgr2=0x55db6d360580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 reap_dead start 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55db6d364000 0x55db6d360580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55db6df30c00 msgr2=0x55db6d050100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55db6df30c00 0x55db6d050100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55db6d364400 msgr2=0x55db6d361b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55db6d364400 0x55db6d361b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55db6ddab000 msgr2=0x55db6d361080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55db6ddab000 0x55db6d361080 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55db6ddab400 msgr2=0x55db6d362100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55db6ddab400 0x55db6d362100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd01f4e3640 1 -- 172.21.15.55:0/849276294 reap_dead start 2024-04-25T09:00:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55db6df30800 msgr2=0x55db6d051700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55db6df30800 0x55db6d051700 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55db6dde3200 tx=0x55db6dea01e0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb800 msgr2=0x55db6d050680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb800 0x55db6d050680 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x55db6dea3c20 tx=0x55db6dd71620 comp rx=0 tx=0).stop 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 shutdown_connections 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55db6df30800 0x55db6d051700 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 --2- 172.21.15.55:0/849276294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6debb800 0x55db6d050680 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.519+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 >> 172.21.15.55:0/849276294 conn(0x55db6debac00 msgr2=0x55db6d0c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.520+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 shutdown_connections 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.520+0000 7fd021816740 1 -- 172.21.15.55:0/849276294 wait complete. 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.520+0000 7fd021816740 1 -- 172.21.15.55:0/3941366893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6cfdfc00 msgr2=0x55db6d04f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.520+0000 7fd021816740 1 --2- 172.21.15.55:0/3941366893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6cfdfc00 0x55db6d04f080 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x55db6dde3c80 tx=0x55db6dea0420 comp rx=0 tx=0).stop 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.520+0000 7fd021816740 1 -- 172.21.15.55:0/3941366893 shutdown_connections 2024-04-25T09:00:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.520+0000 7fd021816740 1 --2- 172.21.15.55:0/3941366893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db6cfdfc00 0x55db6d04f080 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.520+0000 7fd021816740 1 --2- 172.21.15.55:0/3941366893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db6cfdf800 0x55db6d04eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.520+0000 7fd021816740 1 --2- 172.21.15.55:0/3941366893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db6cfdec00 0x55db6d04e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.520+0000 7fd021816740 1 -- 172.21.15.55:0/3941366893 >> 172.21.15.55:0/3941366893 conn(0x55db6cfdf000 msgr2=0x55db6d0c6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.520+0000 7fd021816740 1 -- 172.21.15.55:0/3941366893 shutdown_connections 2024-04-25T09:00:58.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.520+0000 7fd021816740 1 -- 172.21.15.55:0/3941366893 wait complete. 2024-04-25T09:00:58.530 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.137277, result: 2024-04-25T09:00:58.530 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:00:58.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.673+0000 7fbb3dbb7640 1 Processor -- start 2024-04-25T09:00:58.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.674+0000 7fbb3dbb7640 1 -- start start 2024-04-25T09:00:58.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.674+0000 7fbb3dbb7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbb3815bbe0 0x7fbb380cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.674+0000 7fbb3dbb7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb380cf510 0x7fbb380cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.674+0000 7fbb3dbb7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb380cff00 0x7fbb380d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.674+0000 7fbb3dbb7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb380cc830 con 0x7fbb380cf510 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.674+0000 7fbb3dbb7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb380ccb10 con 0x7fbb3815bbe0 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.674+0000 7fbb3dbb7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380ccdf0 con 0x7fbb380cff00 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.674+0000 7fbb36ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb380cf510 0x7fbb380cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.675+0000 7fbb36ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb380cf510 0x7fbb380cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36356/0 (socket says 172.21.15.55:36356) 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.675+0000 7fbb36ffd640 1 -- 172.21.15.55:0/2779501660 learned_addr learned my addr 172.21.15.55:0/2779501660 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.675+0000 7fbb377fe640 1 --2- 172.21.15.55:0/2779501660 >> v2:172.21.15.167:3300/0 conn(0x7fbb3815bbe0 0x7fbb380cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.675+0000 7fbb37fff640 1 --2- 172.21.15.55:0/2779501660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb380cff00 0x7fbb380d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.675+0000 7fbb36ffd640 1 -- 172.21.15.55:0/2779501660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb380cff00 msgr2=0x7fbb380d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.675+0000 7fbb36ffd640 1 --2- 172.21.15.55:0/2779501660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb380cff00 0x7fbb380d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.675+0000 7fbb36ffd640 1 -- 172.21.15.55:0/2779501660 >> v2:172.21.15.167:3300/0 conn(0x7fbb3815bbe0 msgr2=0x7fbb380cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.675+0000 7fbb36ffd640 1 --2- 172.21.15.55:0/2779501660 >> v2:172.21.15.167:3300/0 conn(0x7fbb3815bbe0 0x7fbb380cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.675+0000 7fbb36ffd640 1 -- 172.21.15.55:0/2779501660 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb380cd0d0 con 0x7fbb380cf510 2024-04-25T09:00:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.675+0000 7fbb37fff640 1 --2- 172.21.15.55:0/2779501660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb380cff00 0x7fbb380d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:00:58.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb36ffd640 1 --2- 172.21.15.55:0/2779501660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb380cf510 0x7fbb380cf970 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbb3809a700 tx=0x7fbb2c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7fc65c75736958 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb367fc640 1 -- 172.21.15.55:0/2779501660 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c037070 con 0x7fbb380cf510 2024-04-25T09:00:58.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb367fc640 1 -- 172.21.15.55:0/2779501660 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c032440 con 0x7fbb380cf510 2024-04-25T09:00:58.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb367fc640 1 -- 172.21.15.55:0/2779501660 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c032810 con 0x7fbb380cf510 2024-04-25T09:00:58.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/2779501660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb380cf510 msgr2=0x7fbb380cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb3dbb7640 1 --2- 172.21.15.55:0/2779501660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb380cf510 0x7fbb380cf970 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbb3809a700 tx=0x7fbb2c02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/2779501660 shutdown_connections 2024-04-25T09:00:58.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb3dbb7640 1 --2- 172.21.15.55:0/2779501660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb380cff00 0x7fbb380d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb3dbb7640 1 --2- 172.21.15.55:0/2779501660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb380cf510 0x7fbb380cf970 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb3dbb7640 1 --2- 172.21.15.55:0/2779501660 >> v2:172.21.15.167:3300/0 conn(0x7fbb3815bbe0 0x7fbb380cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/2779501660 >> 172.21.15.55:0/2779501660 conn(0x7fbb380b3430 msgr2=0x7fbb380b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/2779501660 shutdown_connections 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.676+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/2779501660 wait complete. 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.677+0000 7fbb3dbb7640 1 Processor -- start 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.678+0000 7fbb3dbb7640 1 -- start start 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.678+0000 7fbb3dbb7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb380cf510 0x7fbb3815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.678+0000 7fbb3dbb7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb380cff00 0x7fbb38151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.678+0000 7fbb3dbb7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb3815bbe0 0x7fbb380cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.678+0000 7fbb3dbb7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380cde10 con 0x7fbb380cf510 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.678+0000 7fbb3dbb7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3815bfc0 con 0x7fbb380cff00 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.678+0000 7fbb3dbb7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380cc450 con 0x7fbb3815bbe0 2024-04-25T09:00:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.678+0000 7fbb377fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb380cf510 0x7fbb3815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb377fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb380cf510 0x7fbb3815ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36370/0 (socket says 172.21.15.55:36370) 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb377fe640 1 -- 172.21.15.55:0/3842341948 learned_addr learned my addr 172.21.15.55:0/3842341948 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb36ffd640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb380cff00 0x7fbb38151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb37fff640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb3815bbe0 0x7fbb380cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb377fe640 1 -- 172.21.15.55:0/3842341948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb3815bbe0 msgr2=0x7fbb380cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb377fe640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb3815bbe0 0x7fbb380cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb377fe640 1 -- 172.21.15.55:0/3842341948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb380cff00 msgr2=0x7fbb38151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb377fe640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb380cff00 0x7fbb38151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb377fe640 1 -- 172.21.15.55:0/3842341948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3815e770 con 0x7fbb380cf510 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb377fe640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb380cf510 0x7fbb3815ce70 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800e9b0 tx=0x7fbb2800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb1ffff640 1 -- 172.21.15.55:0/3842341948 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28017070 con 0x7fbb380cf510 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb1ffff640 1 -- 172.21.15.55:0/3842341948 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2800c9a0 con 0x7fbb380cf510 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb1ffff640 1 -- 172.21.15.55:0/3842341948 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2800cd90 con 0x7fbb380cf510 2024-04-25T09:00:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/3842341948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3815c390 con 0x7fbb380cf510 2024-04-25T09:00:58.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.679+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/3842341948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3815c950 con 0x7fbb380cf510 2024-04-25T09:00:58.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.680+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/3842341948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb380750b0 con 0x7fbb380cf510 2024-04-25T09:00:58.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.681+0000 7fbb1ffff640 1 -- 172.21.15.55:0/3842341948 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb2801a070 con 0x7fbb380cf510 2024-04-25T09:00:58.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.681+0000 7fbb1ffff640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb2406b4d0 0x7fbb2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:58.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.681+0000 7fbb1ffff640 1 -- 172.21.15.55:0/3842341948 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fbb2808a500 con 0x7fbb380cf510 2024-04-25T09:00:58.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.681+0000 7fbb36ffd640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb2406b4d0 0x7fbb2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.682+0000 7fbb36ffd640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb2406b4d0 0x7fbb2406d990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c034000 tx=0x7fbb2c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:58.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.685+0000 7fbb1ffff640 1 -- 172.21.15.55:0/3842341948 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb28058cf0 con 0x7fbb380cf510 2024-04-25T09:00:58.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:58.906+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/3842341948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fbb380b42d0 con 0x7fbb380cf510 2024-04-25T09:00:59.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.154+0000 7fbb1ffff640 1 -- 172.21.15.55:0/3842341948 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v60) v1 ==== 162+0+0 (secure 0 0 0) 0x7fbb2805cd90 con 0x7fbb380cf510 2024-04-25T09:00:59.143 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:00:59.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/3842341948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb2406b4d0 msgr2=0x7fbb2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb2406b4d0 0x7fbb2406d990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c034000 tx=0x7fbb2c02e000 comp rx=0 tx=0).stop 2024-04-25T09:00:59.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/3842341948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb380cf510 msgr2=0x7fbb3815ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb380cf510 0x7fbb3815ce70 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800e9b0 tx=0x7fbb2800ee70 comp rx=0 tx=0).stop 2024-04-25T09:00:59.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/3842341948 shutdown_connections 2024-04-25T09:00:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb2406b4d0 0x7fbb2406d990 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb3815bbe0 0x7fbb380cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb380cff00 0x7fbb38151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 --2- 172.21.15.55:0/3842341948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb380cf510 0x7fbb3815ce70 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/3842341948 >> 172.21.15.55:0/3842341948 conn(0x7fbb380b3430 msgr2=0x7fbb3809a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/3842341948 shutdown_connections 2024-04-25T09:00:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.156+0000 7fbb3dbb7640 1 -- 172.21.15.55:0/3842341948 wait complete. 2024-04-25T09:00:59.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:00:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.272+0000 7f3c38a1f640 1 Processor -- start 2024-04-25T09:00:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.272+0000 7f3c38a1f640 1 -- start start 2024-04-25T09:00:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c38a1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c3415dce0 0x7f3c340d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c38a1f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3c340d35b0 0x7f3c340b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c38a1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c340d1f90 0x7f3c340b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c38a1f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3415e0c0 con 0x7f3c3415dce0 2024-04-25T09:00:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c38a1f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c340d2510 con 0x7f3c340d35b0 2024-04-25T09:00:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c38a1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340d27f0 con 0x7f3c340d1f90 2024-04-25T09:00:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c3259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c3415dce0 0x7f3c340d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c3259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c3415dce0 0x7f3c340d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36376/0 (socket says 172.21.15.55:36376) 2024-04-25T09:00:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c3259c640 1 -- 172.21.15.55:0/2772841684 learned_addr learned my addr 172.21.15.55:0/2772841684 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c3259c640 1 -- 172.21.15.55:0/2772841684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c340d1f90 msgr2=0x7f3c340b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c3259c640 1 --2- 172.21.15.55:0/2772841684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c340d1f90 0x7f3c340b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c3259c640 1 -- 172.21.15.55:0/2772841684 >> v2:172.21.15.167:3300/0 conn(0x7f3c340d35b0 msgr2=0x7f3c340b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:00:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c3259c640 1 --2- 172.21.15.55:0/2772841684 >> v2:172.21.15.167:3300/0 conn(0x7f3c340d35b0 0x7f3c340b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.273+0000 7f3c3259c640 1 -- 172.21.15.55:0/2772841684 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340d2ad0 con 0x7f3c3415dce0 2024-04-25T09:00:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.274+0000 7f3c3259c640 1 --2- 172.21.15.55:0/2772841684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3415dce0 0x7f3c340d1a50 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f3c340cdfa0 tx=0x7f3c2402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b40fe29e2d9b638 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.274+0000 7f3c3159a640 1 -- 172.21.15.55:0/2772841684 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24037070 con 0x7f3c3415dce0 2024-04-25T09:00:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.274+0000 7f3c3159a640 1 -- 172.21.15.55:0/2772841684 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c24032440 con 0x7f3c3415dce0 2024-04-25T09:00:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.274+0000 7f3c3159a640 1 -- 172.21.15.55:0/2772841684 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24032810 con 0x7f3c3415dce0 2024-04-25T09:00:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.275+0000 7f3c38a1f640 1 -- 172.21.15.55:0/2772841684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3415dce0 msgr2=0x7f3c340d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.275+0000 7f3c38a1f640 1 --2- 172.21.15.55:0/2772841684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3415dce0 0x7f3c340d1a50 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f3c340cdfa0 tx=0x7f3c2402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.275+0000 7f3c38a1f640 1 -- 172.21.15.55:0/2772841684 shutdown_connections 2024-04-25T09:00:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.275+0000 7f3c38a1f640 1 --2- 172.21.15.55:0/2772841684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c340d1f90 0x7f3c340b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.275+0000 7f3c38a1f640 1 --2- 172.21.15.55:0/2772841684 >> v2:172.21.15.167:3300/0 conn(0x7f3c340d35b0 0x7f3c340b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.275+0000 7f3c38a1f640 1 --2- 172.21.15.55:0/2772841684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3415dce0 0x7f3c340d1a50 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.275+0000 7f3c38a1f640 1 -- 172.21.15.55:0/2772841684 >> 172.21.15.55:0/2772841684 conn(0x7f3c34072900 msgr2=0x7f3c340d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.275+0000 7f3c38a1f640 1 -- 172.21.15.55:0/2772841684 shutdown_connections 2024-04-25T09:00:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.275+0000 7f3c38a1f640 1 -- 172.21.15.55:0/2772841684 wait complete. 2024-04-25T09:00:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.276+0000 7f3c38a1f640 1 Processor -- start 2024-04-25T09:00:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.276+0000 7f3c38a1f640 1 -- start start 2024-04-25T09:00:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c38a1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c340d1f90 0x7f3c3415e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c38a1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c340d35b0 0x7f3c3414d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c38a1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3415dce0 0x7f3c340aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c38a1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340b9820 con 0x7f3c3415dce0 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c38a1f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340d3090 con 0x7f3c340d1f90 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c38a1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340b99a0 con 0x7f3c340d35b0 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c32d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3415dce0 0x7f3c340aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c32d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3415dce0 0x7f3c340aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36384/0 (socket says 172.21.15.55:36384) 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c32d9d640 1 -- 172.21.15.55:0/1504210576 learned_addr learned my addr 172.21.15.55:0/1504210576 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c31d9b640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c340d35b0 0x7f3c3414d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c32d9d640 1 -- 172.21.15.55:0/1504210576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c340d35b0 msgr2=0x7f3c3414d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c32d9d640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c340d35b0 0x7f3c3414d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c3259c640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c340d1f90 0x7f3c3415e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c32d9d640 1 -- 172.21.15.55:0/1504210576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c340d1f90 msgr2=0x7f3c3415e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c32d9d640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c340d1f90 0x7f3c3415e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c32d9d640 1 -- 172.21.15.55:0/1504210576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340aa9d0 con 0x7f3c3415dce0 2024-04-25T09:00:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.277+0000 7f3c3259c640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c340d1f90 0x7f3c3415e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:00:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.278+0000 7f3c32d9d640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3415dce0 0x7f3c340aa490 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00b970 tx=0x7f3c2c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.278+0000 7f3c22ffd640 1 -- 172.21.15.55:0/1504210576 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c019070 con 0x7f3c3415dce0 2024-04-25T09:00:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.278+0000 7f3c22ffd640 1 -- 172.21.15.55:0/1504210576 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c00cb60 con 0x7f3c3415dce0 2024-04-25T09:00:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.278+0000 7f3c38a1f640 1 -- 172.21.15.55:0/1504210576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3415eb80 con 0x7f3c3415dce0 2024-04-25T09:00:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.278+0000 7f3c22ffd640 1 -- 172.21.15.55:0/1504210576 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c014440 con 0x7f3c3415dce0 2024-04-25T09:00:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.278+0000 7f3c38a1f640 1 -- 172.21.15.55:0/1504210576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3415f140 con 0x7f3c3415dce0 2024-04-25T09:00:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.279+0000 7f3c38a1f640 1 -- 172.21.15.55:0/1504210576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c340749b0 con 0x7f3c3415dce0 2024-04-25T09:00:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.279+0000 7f3c22ffd640 1 -- 172.21.15.55:0/1504210576 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3c2c01c070 con 0x7f3c3415dce0 2024-04-25T09:00:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.280+0000 7f3c22ffd640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1406b4d0 0x7f3c1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.280+0000 7f3c22ffd640 1 -- 172.21.15.55:0/1504210576 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f3c2c08a020 con 0x7f3c3415dce0 2024-04-25T09:00:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.280+0000 7f3c3259c640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1406b4d0 0x7f3c1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.280+0000 7f3c3259c640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1406b4d0 0x7f3c1406d990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3c24034000 tx=0x7f3c2402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:00:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.284+0000 7f3c22ffd640 1 -- 172.21.15.55:0/1504210576 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3c2c058dd0 con 0x7f3c3415dce0 2024-04-25T09:00:59.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.502+0000 7f3c38a1f640 1 -- 172.21.15.55:0/1504210576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c3415a4d0 con 0x7f3c3415dce0 2024-04-25T09:00:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.503+0000 7f3c22ffd640 1 -- 172.21.15.55:0/1504210576 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f3c2c0586d0 con 0x7f3c3415dce0 2024-04-25T09:00:59.492 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:00:59.492 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T09:00:59.157062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7872":{"gid":7872,"name":"c","rank":0,"incarnation":61,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6837/2841450668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2841450668},{"type":"v1","addr":"172.21.15.55:6837","nonce":2841450668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:00:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 61 2024-04-25T09:00:59.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 -- 172.21.15.55:0/1504210576 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1406b4d0 msgr2=0x7f3c1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1406b4d0 0x7f3c1406d990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3c24034000 tx=0x7f3c2402e000 comp rx=0 tx=0).stop 2024-04-25T09:00:59.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 -- 172.21.15.55:0/1504210576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3415dce0 msgr2=0x7f3c340aa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:00:59.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3415dce0 0x7f3c340aa490 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00b970 tx=0x7f3c2c00be30 comp rx=0 tx=0).stop 2024-04-25T09:00:59.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 -- 172.21.15.55:0/1504210576 shutdown_connections 2024-04-25T09:00:59.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1406b4d0 0x7f3c1406d990 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3415dce0 0x7f3c340aa490 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c340d35b0 0x7f3c3414d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 --2- 172.21.15.55:0/1504210576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c340d1f90 0x7f3c3415e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:00:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 -- 172.21.15.55:0/1504210576 >> 172.21.15.55:0/1504210576 conn(0x7f3c34072900 msgr2=0x7f3c340d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:00:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 -- 172.21.15.55:0/1504210576 shutdown_connections 2024-04-25T09:00:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:00:59.505+0000 7f3c38a1f640 1 -- 172.21.15.55:0/1504210576 wait complete. 2024-04-25T09:00:59.907 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:59:32.818559+0000', 'modified': '2024-04-25T09:00:59.157062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7872}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7872': {'gid': 7872, 'name': 'c', 'rank': 0, 'incarnation': 61, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6837/2841450668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 2841450668}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 2841450668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:00:59.907 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7872:up:replay 2024-04-25T09:01:00.909 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:01.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.032+0000 7ff84de38640 1 Processor -- start 2024-04-25T09:01:01.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.033+0000 7ff84de38640 1 -- start start 2024-04-25T09:01:01.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.033+0000 7ff84de38640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff84815dc30 0x7ff84806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.033+0000 7ff84de38640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff84806cc00 0x7ff8480b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.033+0000 7ff84de38640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84806c1f0 con 0x7ff8480b1960 2024-04-25T09:01:01.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.033+0000 7ff84de38640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8480cfb40 con 0x7ff84806cc00 2024-04-25T09:01:01.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.033+0000 7ff84de38640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480b2060 con 0x7ff84815dc30 2024-04-25T09:01:01.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff846ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff84806cc00 0x7ff8480b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff8477fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff84815dc30 0x7ff84806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff8477fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff84815dc30 0x7ff84806c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:45886/0 (socket says 172.21.15.55:45886) 2024-04-25T09:01:01.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff846ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff84806cc00 0x7ff8480b1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:55352/0 (socket says 172.21.15.55:55352) 2024-04-25T09:01:01.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff8477fe640 1 -- 172.21.15.55:0/3335671761 learned_addr learned my addr 172.21.15.55:0/3335671761 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:01.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff847fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff8480b1960 0x7ff848099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:47702/0 (socket says 172.21.15.55:47702) 2024-04-25T09:01:01.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff8477fe640 1 -- 172.21.15.55:0/3335671761 >> v2:172.21.15.167:3300/0 conn(0x7ff84806cc00 msgr2=0x7ff8480b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:01.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff8477fe640 1 --2- 172.21.15.55:0/3335671761 >> v2:172.21.15.167:3300/0 conn(0x7ff84806cc00 0x7ff8480b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff8477fe640 1 -- 172.21.15.55:0/3335671761 >> v1:172.21.15.167:6789/0 conn(0x7ff8480b1960 legacy=0x7ff848099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff8477fe640 1 -- 172.21.15.55:0/3335671761 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480b2340 con 0x7ff84815dc30 2024-04-25T09:01:01.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff8467fc640 1 -- 172.21.15.55:0/3335671761 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973253135 0 0) 0x7ff840001490 con 0x7ff8480b1960 2024-04-25T09:01:01.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.034+0000 7ff846ffd640 1 --2- 172.21.15.55:0/3335671761 >> v2:172.21.15.167:3300/0 conn(0x7ff84806cc00 0x7ff8480b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:01.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.035+0000 7ff8477fe640 1 --2- 172.21.15.55:0/3335671761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff84815dc30 0x7ff84806c6c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff838009870 tx=0x7ff83802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a276da5cc81b2813 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:01.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.035+0000 7ff8467fc640 1 -- 172.21.15.55:0/3335671761 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838037070 con 0x7ff84815dc30 2024-04-25T09:01:01.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.035+0000 7ff8467fc640 1 -- 172.21.15.55:0/3335671761 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff838032440 con 0x7ff84815dc30 2024-04-25T09:01:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.035+0000 7ff8467fc640 1 -- 172.21.15.55:0/3335671761 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838032810 con 0x7ff84815dc30 2024-04-25T09:01:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.036+0000 7ff84de38640 1 -- 172.21.15.55:0/3335671761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff84815dc30 msgr2=0x7ff84806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.036+0000 7ff84de38640 1 --2- 172.21.15.55:0/3335671761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff84815dc30 0x7ff84806c6c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff838009870 tx=0x7ff83802a250 comp rx=0 tx=0).stop 2024-04-25T09:01:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.036+0000 7ff84de38640 1 -- 172.21.15.55:0/3335671761 shutdown_connections 2024-04-25T09:01:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.036+0000 7ff84de38640 1 --2- 172.21.15.55:0/3335671761 >> v2:172.21.15.167:3300/0 conn(0x7ff84806cc00 0x7ff8480b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.036+0000 7ff84de38640 1 --2- 172.21.15.55:0/3335671761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff84815dc30 0x7ff84806c6c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.036+0000 7ff84de38640 1 -- 172.21.15.55:0/3335671761 >> 172.21.15.55:0/3335671761 conn(0x7ff8480d1900 msgr2=0x7ff8480d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.036+0000 7ff84de38640 1 -- 172.21.15.55:0/3335671761 shutdown_connections 2024-04-25T09:01:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.036+0000 7ff84de38640 1 -- 172.21.15.55:0/3335671761 wait complete. 2024-04-25T09:01:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.037+0000 7ff84de38640 1 Processor -- start 2024-04-25T09:01:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.037+0000 7ff84de38640 1 -- start start 2024-04-25T09:01:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.038+0000 7ff84de38640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84806cc00 0x7ff84814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.038+0000 7ff84de38640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8480b1960 0x7ff8480b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.038+0000 7ff84de38640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff84815dc30 0x7ff8480b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.038+0000 7ff84de38640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480b1d80 con 0x7ff84806cc00 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.038+0000 7ff84de38640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480cfde0 con 0x7ff84815dc30 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.038+0000 7ff84de38640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84815e010 con 0x7ff8480b1960 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.038+0000 7ff8477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84806cc00 0x7ff84814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.038+0000 7ff8477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84806cc00 0x7ff84814cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36386/0 (socket says 172.21.15.55:36386) 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.038+0000 7ff8477fe640 1 -- 172.21.15.55:0/2948922493 learned_addr learned my addr 172.21.15.55:0/2948922493 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.038+0000 7ff846ffd640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8480b1960 0x7ff8480b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.038+0000 7ff847fff640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff84815dc30 0x7ff8480b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.039+0000 7ff8477fe640 1 -- 172.21.15.55:0/2948922493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8480b1960 msgr2=0x7ff8480b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.039+0000 7ff8477fe640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8480b1960 0x7ff8480b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.039+0000 7ff8477fe640 1 -- 172.21.15.55:0/2948922493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff84815dc30 msgr2=0x7ff8480b6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.039+0000 7ff8477fe640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff84815dc30 0x7ff8480b6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.039+0000 7ff8477fe640 1 -- 172.21.15.55:0/2948922493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480b7410 con 0x7ff84806cc00 2024-04-25T09:01:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.039+0000 7ff8477fe640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84806cc00 0x7ff84814cb50 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7ff838000c00 tx=0x7ff8380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:01.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.039+0000 7ff82ffff640 1 -- 172.21.15.55:0/2948922493 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838037040 con 0x7ff84806cc00 2024-04-25T09:01:01.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.039+0000 7ff82ffff640 1 -- 172.21.15.55:0/2948922493 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff838042070 con 0x7ff84806cc00 2024-04-25T09:01:01.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.039+0000 7ff84de38640 1 -- 172.21.15.55:0/2948922493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84815e830 con 0x7ff84806cc00 2024-04-25T09:01:01.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.039+0000 7ff82ffff640 1 -- 172.21.15.55:0/2948922493 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838030880 con 0x7ff84806cc00 2024-04-25T09:01:01.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.039+0000 7ff84de38640 1 -- 172.21.15.55:0/2948922493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8480b70f0 con 0x7ff84806cc00 2024-04-25T09:01:01.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.040+0000 7ff84de38640 1 -- 172.21.15.55:0/2948922493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8480749b0 con 0x7ff84806cc00 2024-04-25T09:01:01.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.041+0000 7ff82ffff640 1 -- 172.21.15.55:0/2948922493 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff838030a20 con 0x7ff84806cc00 2024-04-25T09:01:01.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.041+0000 7ff82ffff640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff83406b4d0 0x7ff83406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:01.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.041+0000 7ff82ffff640 1 -- 172.21.15.55:0/2948922493 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7ff8380aa9c0 con 0x7ff84806cc00 2024-04-25T09:01:01.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.041+0000 7ff846ffd640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff83406b4d0 0x7ff83406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.042+0000 7ff846ffd640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff83406b4d0 0x7ff83406d990 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009560 tx=0x7ff83c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:01.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.045+0000 7ff82ffff640 1 -- 172.21.15.55:0/2948922493 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff8380ace20 con 0x7ff84806cc00 2024-04-25T09:01:01.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.266+0000 7ff84de38640 1 -- 172.21.15.55:0/2948922493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8480d1e60 con 0x7ff84806cc00 2024-04-25T09:01:01.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.267+0000 7ff82ffff640 1 -- 172.21.15.55:0/2948922493 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4944 (secure 0 0 0) 0x7ff8380790a0 con 0x7ff84806cc00 2024-04-25T09:01:01.256 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:01.256 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T09:01:00.165682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7872":{"gid":7872,"name":"c","rank":0,"incarnation":61,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.55:6837/2841450668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2841450668},{"type":"v1","addr":"172.21.15.55:6837","nonce":2841450668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:01:01.256 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 63 2024-04-25T09:01:01.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 -- 172.21.15.55:0/2948922493 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff83406b4d0 msgr2=0x7ff83406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff83406b4d0 0x7ff83406d990 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009560 tx=0x7ff83c009190 comp rx=0 tx=0).stop 2024-04-25T09:01:01.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 -- 172.21.15.55:0/2948922493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84806cc00 msgr2=0x7ff84814cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:01.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84806cc00 0x7ff84814cb50 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7ff838000c00 tx=0x7ff8380046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 -- 172.21.15.55:0/2948922493 shutdown_connections 2024-04-25T09:01:01.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff83406b4d0 0x7ff83406d990 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff84815dc30 0x7ff8480b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8480b1960 0x7ff8480b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 --2- 172.21.15.55:0/2948922493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84806cc00 0x7ff84814cb50 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:01.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 -- 172.21.15.55:0/2948922493 >> 172.21.15.55:0/2948922493 conn(0x7ff8480d1900 msgr2=0x7ff848070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:01.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 -- 172.21.15.55:0/2948922493 shutdown_connections 2024-04-25T09:01:01.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:01.269+0000 7ff84de38640 1 -- 172.21.15.55:0/2948922493 wait complete. 2024-04-25T09:01:01.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:59:32.818559+0000', 'modified': '2024-04-25T09:01:00.165682+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7872}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7872': {'gid': 7872, 'name': 'c', 'rank': 0, 'incarnation': 61, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.55:6837/2841450668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 2841450668}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 2841450668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:01:01.675 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7872:up:rejoin 2024-04-25T09:01:02.676 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:02.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.802+0000 7fa0e125d640 1 Processor -- start 2024-04-25T09:01:02.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.802+0000 7fa0e125d640 1 -- start start 2024-04-25T09:01:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.803+0000 7fa0e125d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa0dc15c9f0 0x7fa0dc1664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.803+0000 7fa0e125d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc0ce6c0 con 0x7fa0dc15bf00 2024-04-25T09:01:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.803+0000 7fa0e125d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc0cc4e0 con 0x7fa0dc06e8f0 2024-04-25T09:01:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.803+0000 7fa0e125d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc1455e0 con 0x7fa0dc15c9f0 2024-04-25T09:01:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.803+0000 7fa0db59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa0dc15c9f0 0x7fa0dc1664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.803+0000 7fa0dad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa0dc15bf00 0x7fa0dc0cbdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43246/0 (socket says 172.21.15.55:43246) 2024-04-25T09:01:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.803+0000 7fa0dad9d640 1 -- 172.21.15.55:0/2381630276 learned_addr learned my addr 172.21.15.55:0/2381630276 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.803+0000 7fa0db59e640 1 -- 172.21.15.55:0/2381630276 >> v1:172.21.15.167:6789/0 conn(0x7fa0dc06e8f0 legacy=0x7fa0dc15c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.803+0000 7fa0db59e640 1 -- 172.21.15.55:0/2381630276 >> v1:172.21.15.55:6789/0 conn(0x7fa0dc15bf00 legacy=0x7fa0dc0cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.803+0000 7fa0db59e640 1 -- 172.21.15.55:0/2381630276 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc0cc7b0 con 0x7fa0dc15c9f0 2024-04-25T09:01:02.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.804+0000 7fa0db59e640 1 --2- 172.21.15.55:0/2381630276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0dc15c9f0 0x7fa0dc1664c0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009d90 tx=0x7fa0d402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e58ef23681d326 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.804+0000 7fa0d9d9b640 1 -- 172.21.15.55:0/2381630276 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4007740 con 0x7fa0dc15c9f0 2024-04-25T09:01:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.804+0000 7fa0d9d9b640 1 -- 172.21.15.55:0/2381630276 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d40078e0 con 0x7fa0dc15c9f0 2024-04-25T09:01:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.804+0000 7fa0d9d9b640 1 -- 172.21.15.55:0/2381630276 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4007cb0 con 0x7fa0dc15c9f0 2024-04-25T09:01:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.804+0000 7fa0e125d640 1 -- 172.21.15.55:0/2381630276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0dc15c9f0 msgr2=0x7fa0dc1664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.804+0000 7fa0e125d640 1 --2- 172.21.15.55:0/2381630276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0dc15c9f0 0x7fa0dc1664c0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009d90 tx=0x7fa0d402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.804+0000 7fa0e125d640 1 -- 172.21.15.55:0/2381630276 shutdown_connections 2024-04-25T09:01:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.804+0000 7fa0e125d640 1 --2- 172.21.15.55:0/2381630276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0dc15c9f0 0x7fa0dc1664c0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.804+0000 7fa0e125d640 1 -- 172.21.15.55:0/2381630276 >> 172.21.15.55:0/2381630276 conn(0x7fa0dc06aba0 msgr2=0x7fa0dc06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.805+0000 7fa0e125d640 1 -- 172.21.15.55:0/2381630276 shutdown_connections 2024-04-25T09:01:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.805+0000 7fa0e125d640 1 -- 172.21.15.55:0/2381630276 wait complete. 2024-04-25T09:01:02.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.806+0000 7fa0e125d640 1 Processor -- start 2024-04-25T09:01:02.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.806+0000 7fa0e125d640 1 -- start start 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0e125d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0dc06e8f0 0x7fa0dc159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0e125d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0dc15bf00 0x7fa0dc140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0e125d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0dc15c9f0 0x7fa0dc141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0e125d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0ccd70 con 0x7fa0dc15bf00 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0e125d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc06d450 con 0x7fa0dc06e8f0 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0e125d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0cd050 con 0x7fa0dc15c9f0 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0da59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0dc15bf00 0x7fa0dc140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0da59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0dc15bf00 0x7fa0dc140c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36400/0 (socket says 172.21.15.55:36400) 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0da59c640 1 -- 172.21.15.55:0/1674199613 learned_addr learned my addr 172.21.15.55:0/1674199613 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0dad9d640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0dc06e8f0 0x7fa0dc159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0db59e640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0dc15c9f0 0x7fa0dc141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0da59c640 1 -- 172.21.15.55:0/1674199613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0dc15c9f0 msgr2=0x7fa0dc141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0da59c640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0dc15c9f0 0x7fa0dc141190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0da59c640 1 -- 172.21.15.55:0/1674199613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0dc06e8f0 msgr2=0x7fa0dc159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0da59c640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0dc06e8f0 0x7fa0dc159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.807+0000 7fa0da59c640 1 -- 172.21.15.55:0/1674199613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc13ef90 con 0x7fa0dc15bf00 2024-04-25T09:01:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.808+0000 7fa0da59c640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0dc15bf00 0x7fa0dc140c50 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c400 tx=0x7fa0d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.808+0000 7fa0c37fe640 1 -- 172.21.15.55:0/1674199613 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0017070 con 0x7fa0dc15bf00 2024-04-25T09:01:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.808+0000 7fa0c37fe640 1 -- 172.21.15.55:0/1674199613 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d00035f0 con 0x7fa0dc15bf00 2024-04-25T09:01:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.808+0000 7fa0c37fe640 1 -- 172.21.15.55:0/1674199613 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0003a20 con 0x7fa0dc15bf00 2024-04-25T09:01:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.808+0000 7fa0e125d640 1 -- 172.21.15.55:0/1674199613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc138bf0 con 0x7fa0dc15bf00 2024-04-25T09:01:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.808+0000 7fa0e125d640 1 -- 172.21.15.55:0/1674199613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc1391b0 con 0x7fa0dc15bf00 2024-04-25T09:01:02.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.809+0000 7fa0e125d640 1 -- 172.21.15.55:0/1674199613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc06bb30 con 0x7fa0dc15bf00 2024-04-25T09:01:02.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.809+0000 7fa0c37fe640 1 -- 172.21.15.55:0/1674199613 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa0d001a070 con 0x7fa0dc15bf00 2024-04-25T09:01:02.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.810+0000 7fa0c37fe640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c806b4d0 0x7fa0c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.810+0000 7fa0c37fe640 1 -- 172.21.15.55:0/1674199613 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fa0d00895e0 con 0x7fa0dc15bf00 2024-04-25T09:01:02.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.810+0000 7fa0dad9d640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c806b4d0 0x7fa0c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.810+0000 7fa0dad9d640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c806b4d0 0x7fa0c806d990 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc007fd0 tx=0x7fa0cc007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:02.814+0000 7fa0c37fe640 1 -- 172.21.15.55:0/1674199613 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0d0057d40 con 0x7fa0dc15bf00 2024-04-25T09:01:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.033+0000 7fa0e125d640 1 -- 172.21.15.55:0/1674199613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0dc15b7a0 con 0x7fa0dc15bf00 2024-04-25T09:01:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.033+0000 7fa0c37fe640 1 -- 172.21.15.55:0/1674199613 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fa0d005bde0 con 0x7fa0dc15bf00 2024-04-25T09:01:03.023 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:03.023 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T09:01:01.173411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7872":{"gid":7872,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/2841450668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2841450668},{"type":"v1","addr":"172.21.15.55:6837","nonce":2841450668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:01:03.023 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 64 2024-04-25T09:01:03.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 -- 172.21.15.55:0/1674199613 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c806b4d0 msgr2=0x7fa0c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c806b4d0 0x7fa0c806d990 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc007fd0 tx=0x7fa0cc007e80 comp rx=0 tx=0).stop 2024-04-25T09:01:03.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 -- 172.21.15.55:0/1674199613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0dc15bf00 msgr2=0x7fa0dc140c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0dc15bf00 0x7fa0dc140c50 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c400 tx=0x7fa0d000c8c0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 -- 172.21.15.55:0/1674199613 shutdown_connections 2024-04-25T09:01:03.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa0c806b4d0 0x7fa0c806d990 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0dc15c9f0 0x7fa0dc141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0dc15bf00 0x7fa0dc140c50 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 --2- 172.21.15.55:0/1674199613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0dc06e8f0 0x7fa0dc159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 -- 172.21.15.55:0/1674199613 >> 172.21.15.55:0/1674199613 conn(0x7fa0dc06aba0 msgr2=0x7fa0dc071190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 -- 172.21.15.55:0/1674199613 shutdown_connections 2024-04-25T09:01:03.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.035+0000 7fa0e125d640 1 -- 172.21.15.55:0/1674199613 wait complete. 2024-04-25T09:01:03.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:59:32.818559+0000', 'modified': '2024-04-25T09:01:01.173411+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7872}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7872': {'gid': 7872, 'name': 'c', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6837/2841450668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 2841450668}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 2841450668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:01:03.438 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:01:03.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:01:03.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.553+0000 7ff5d89f4640 1 Processor -- start 2024-04-25T09:01:03.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.553+0000 7ff5d89f4640 1 -- start start 2024-04-25T09:01:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.554+0000 7ff5d89f4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5d40b9720 0x7ff5d40ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.554+0000 7ff5d89f4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d40cf0f0 con 0x7ff5d4161090 2024-04-25T09:01:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.554+0000 7ff5d89f4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d4161f80 con 0x7ff5d40cece0 2024-04-25T09:01:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.554+0000 7ff5d89f4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d40d21a0 con 0x7ff5d40b9720 2024-04-25T09:01:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.554+0000 7ff5d1d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5d40b9720 0x7ff5d40ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.555+0000 7ff5d259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff5d4161090 0x7ff5d4161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43262/0 (socket says 172.21.15.55:43262) 2024-04-25T09:01:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.555+0000 7ff5d259c640 1 -- 172.21.15.55:0/3734281804 learned_addr learned my addr 172.21.15.55:0/3734281804 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.555+0000 7ff5d1d9b640 1 -- 172.21.15.55:0/3734281804 >> v1:172.21.15.167:6789/0 conn(0x7ff5d40cece0 legacy=0x7ff5d40d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.555+0000 7ff5d1d9b640 1 -- 172.21.15.55:0/3734281804 >> v1:172.21.15.55:6789/0 conn(0x7ff5d4161090 legacy=0x7ff5d4161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.555+0000 7ff5d1d9b640 1 -- 172.21.15.55:0/3734281804 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d4162260 con 0x7ff5d40b9720 2024-04-25T09:01:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.555+0000 7ff5d159a640 1 -- 172.21.15.55:0/3734281804 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61813293 0 0) 0x7ff5c4001110 con 0x7ff5d4161090 2024-04-25T09:01:03.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.556+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/3734281804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5d40b9720 0x7ff5d40ce7a0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40d2320 tx=0x7ff5c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc1915073518713 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.556+0000 7ff5d159a640 1 -- 172.21.15.55:0/3734281804 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8037070 con 0x7ff5d40b9720 2024-04-25T09:01:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.556+0000 7ff5d159a640 1 -- 172.21.15.55:0/3734281804 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c8032440 con 0x7ff5d40b9720 2024-04-25T09:01:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.556+0000 7ff5d159a640 1 -- 172.21.15.55:0/3734281804 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8032810 con 0x7ff5d40b9720 2024-04-25T09:01:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.556+0000 7ff5d89f4640 1 -- 172.21.15.55:0/3734281804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5d40b9720 msgr2=0x7ff5d40ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.556+0000 7ff5d89f4640 1 --2- 172.21.15.55:0/3734281804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5d40b9720 0x7ff5d40ce7a0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40d2320 tx=0x7ff5c802a180 comp rx=0 tx=0).stop 2024-04-25T09:01:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.556+0000 7ff5d89f4640 1 -- 172.21.15.55:0/3734281804 shutdown_connections 2024-04-25T09:01:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.556+0000 7ff5d89f4640 1 --2- 172.21.15.55:0/3734281804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5d40b9720 0x7ff5d40ce7a0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.556+0000 7ff5d89f4640 1 -- 172.21.15.55:0/3734281804 >> 172.21.15.55:0/3734281804 conn(0x7ff5d40b55e0 msgr2=0x7ff5d40b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.556+0000 7ff5d89f4640 1 -- 172.21.15.55:0/3734281804 shutdown_connections 2024-04-25T09:01:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.556+0000 7ff5d89f4640 1 -- 172.21.15.55:0/3734281804 wait complete. 2024-04-25T09:01:03.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.558+0000 7ff5d89f4640 1 Processor -- start 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.558+0000 7ff5d89f4640 1 -- start start 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.558+0000 7ff5d89f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5d40b9720 0x7ff5d4154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.558+0000 7ff5d89f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5d40cece0 0x7ff5d40b8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.558+0000 7ff5d89f4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5d4161090 0x7ff5d41582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.558+0000 7ff5d89f4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4161470 con 0x7ff5d40b9720 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.558+0000 7ff5d89f4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40d1e30 con 0x7ff5d40cece0 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.558+0000 7ff5d89f4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40d2d40 con 0x7ff5d4161090 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5d40b9720 0x7ff5d4154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5d40b9720 0x7ff5d4154bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36412/0 (socket says 172.21.15.55:36412) 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d259c640 1 -- 172.21.15.55:0/2935205088 learned_addr learned my addr 172.21.15.55:0/2935205088 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5d40cece0 0x7ff5d40b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d2d9d640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5d4161090 0x7ff5d41582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d259c640 1 -- 172.21.15.55:0/2935205088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5d4161090 msgr2=0x7ff5d41582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d259c640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5d4161090 0x7ff5d41582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d259c640 1 -- 172.21.15.55:0/2935205088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5d40cece0 msgr2=0x7ff5d40b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d259c640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5d40cece0 0x7ff5d40b8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d259c640 1 -- 172.21.15.55:0/2935205088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d4155100 con 0x7ff5d40b9720 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d2d9d640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5d4161090 0x7ff5d41582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5d40cece0 0x7ff5d40b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d259c640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5d40b9720 0x7ff5d4154bc0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400c420 tx=0x7ff5c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2935205088 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40074e0 con 0x7ff5d40b9720 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2935205088 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c40047e0 con 0x7ff5d40b9720 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d89f4640 1 -- 172.21.15.55:0/2935205088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d40cc080 con 0x7ff5d40b9720 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2935205088 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4004c10 con 0x7ff5d40b9720 2024-04-25T09:01:03.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.559+0000 7ff5d89f4640 1 -- 172.21.15.55:0/2935205088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d40cc640 con 0x7ff5d40b9720 2024-04-25T09:01:03.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.561+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2935205088 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff5c4011070 con 0x7ff5d40b9720 2024-04-25T09:01:03.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.561+0000 7ff5c2ffd640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5b406b500 0x7ff5b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.561+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2935205088 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7ff5c4089e70 con 0x7ff5d40b9720 2024-04-25T09:01:03.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.561+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5b406b500 0x7ff5b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.562+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5b406b500 0x7ff5b406d9c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8034000 tx=0x7ff5c802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.562+0000 7ff5db7ce740 1 Processor -- start 2024-04-25T09:01:03.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.562+0000 7ff5db7ce740 1 -- start start 2024-04-25T09:01:03.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb46230 0x557b5bb46610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb64020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb1bf10 0x557b5bb62190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5ba7ea10 con 0x557b5bb63ad0 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5ba27b30 con 0x557b5bb46230 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b5ba7ac50 con 0x557b5bb1bf10 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5d1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb64020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5d1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb64020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36418/0 (socket says 172.21.15.55:36418) 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5d1d9b640 1 -- 172.21.15.55:0/146126215 learned_addr learned my addr 172.21.15.55:0/146126215 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5d2d9d640 1 --2- 172.21.15.55:0/146126215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb1bf10 0x557b5bb62190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5d259c640 1 --2- 172.21.15.55:0/146126215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb46230 0x557b5bb46610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5d1d9b640 1 -- 172.21.15.55:0/146126215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb1bf10 msgr2=0x557b5bb62190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/146126215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb1bf10 0x557b5bb62190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5d1d9b640 1 -- 172.21.15.55:0/146126215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb46230 msgr2=0x557b5bb46610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/146126215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb46230 0x557b5bb46610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.563+0000 7ff5d1d9b640 1 -- 172.21.15.55:0/146126215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b5ba3ce10 con 0x557b5bb63ad0 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.564+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/146126215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb64020 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ff5c802a770 tx=0x7ff5c802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61643233eca88987 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.564+0000 7ff5b3fff640 1 -- 172.21.15.55:0/146126215 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c804f070 con 0x557b5bb63ad0 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.564+0000 7ff5b3fff640 1 -- 172.21.15.55:0/146126215 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c8038040 con 0x557b5bb63ad0 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.564+0000 7ff5b3fff640 1 -- 172.21.15.55:0/146126215 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8037050 con 0x557b5bb63ad0 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.564+0000 7ff5db7ce740 1 -- 172.21.15.55:0/146126215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 msgr2=0x557b5bb64020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.564+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/146126215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb64020 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ff5c802a770 tx=0x7ff5c802c000 comp rx=0 tx=0).stop 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.564+0000 7ff5db7ce740 1 -- 172.21.15.55:0/146126215 shutdown_connections 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.564+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/146126215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb1bf10 0x557b5bb62190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.564+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/146126215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb64020 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.564+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/146126215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb46230 0x557b5bb46610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.564+0000 7ff5db7ce740 1 -- 172.21.15.55:0/146126215 >> 172.21.15.55:0/146126215 conn(0x557b5bb18840 msgr2=0x557b5bb61040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.565+0000 7ff5db7ce740 1 -- 172.21.15.55:0/146126215 shutdown_connections 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.565+0000 7ff5db7ce740 1 -- 172.21.15.55:0/146126215 wait complete. 2024-04-25T09:01:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.565+0000 7ff5db7ce740 1 -- start start 2024-04-25T09:01:03.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.565+0000 7ff5db7ce740 1 Processor -- start 2024-04-25T09:01:03.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bb67e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb63ad0 0x557b5bb44570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb49c20 0x557b5bb4a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5bb1ccb0 con 0x557b5bb46230 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5ba3b0c0 con 0x557b5bb63ad0 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b5bb16770 con 0x557b5bb49c20 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5db7ce740 10 client.0 _ll_register_callbacks cb 0x557b5ba2eec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5d259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bb67e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5d259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bb67e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36430/0 (socket says 172.21.15.55:36430) 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5d259c640 1 -- 172.21.15.55:0/3171787066 learned_addr learned my addr 172.21.15.55:0/3171787066 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb63ad0 0x557b5bb44570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5d2d9d640 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb49c20 0x557b5bb4a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5d259c640 1 -- 172.21.15.55:0/3171787066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb49c20 msgr2=0x557b5bb4a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5d259c640 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb49c20 0x557b5bb4a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5d259c640 1 -- 172.21.15.55:0/3171787066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb63ad0 msgr2=0x557b5bb44570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5d259c640 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb63ad0 0x557b5bb44570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5d259c640 1 -- 172.21.15.55:0/3171787066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b5b7932d0 con 0x557b5bb46230 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.566+0000 7ff5d2d9d640 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb49c20 0x557b5bb4a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5d259c640 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bb67e40 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40882d0 tx=0x7ff5c4057f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6688e863b27fc8ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5b17fa640 1 -- 172.21.15.55:0/3171787066 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c405c670 con 0x557b5bb46230 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5b17fa640 1 -- 172.21.15.55:0/3171787066 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7ff5c405c150 con 0x557b5bb46230 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3171787066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5c8038040 con 0x557b5bb46230 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5b17fa640 1 -- 172.21.15.55:0/3171787066 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5c4060c30 con 0x557b5bb46230 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5db7ce740 10 client.7950 fetch_fsmap learned FSMap version 64 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3171787066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x557b5b85d6b0 con 0x557b5bb46230 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5b17fa640 1 -- 172.21.15.55:0/3171787066 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c8038040 con 0x557b5bb46230 2024-04-25T09:01:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5b17fa640 1 -- 172.21.15.55:0/3171787066 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff5c4057970 con 0x557b5bb46230 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5db7ce740 10 client.7950 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5db7ce740 10 client.7950 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5db7ce740 20 client.7950 populate_metadata read hostname 'smithi055' 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x557b5bb48200 0x557b5bb48620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5db7ce740 4 client.7950 mds_command: new command op to 7872 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3171787066 --> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b5badd920 con 0x557b5bb48200 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.567+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x557b5bb48200 0x557b5bb48620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.568+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x557b5bb48200 0x557b5bb48620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37994e2b85519767 server_cookie=58e2076cdb244e47 in_seq=0 out_seq=0 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.568+0000 7ff5b17fa640 10 client.7950 ms_handle_connect on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.568+0000 7ff5b17fa640 1 -- 172.21.15.55:0/3171787066 <== mds.0 v2:172.21.15.55:6835/2841450668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557b5badd920 con 0x557b5bb48200 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.568+0000 7ff5b17fa640 10 client.7950 handle_command_reply: tid=0 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.568+0000 7ff5db7ce740 1 client.7950 shutdown 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.568+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3171787066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 msgr2=0x557b5bb67e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.568+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bb67e40 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40882d0 tx=0x7ff5c4057f70 comp rx=0 tx=0).stop 2024-04-25T09:01:03.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.568+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3171787066 shutdown_connections 2024-04-25T09:01:03.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.568+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x557b5bb48200 0x557b5bb48620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.569+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb49c20 0x557b5bb4a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.569+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb63ad0 0x557b5bb44570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.569+0000 7ff5b17fa640 0 client.7950 ms_handle_reset on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:03.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.569+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/3171787066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bb67e40 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.569+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3171787066 >> 172.21.15.55:0/3171787066 conn(0x557b5bb1bf10 msgr2=0x557b5bb645c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.569+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3171787066 shutdown_connections 2024-04-25T09:01:03.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.569+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3171787066 wait complete. 2024-04-25T09:01:03.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.569+0000 7ff5db7ce740 20 client.7950 trim_cache size 0 max 16384 2024-04-25T09:01:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.585+0000 7ff5db7ce740 1 Processor -- start 2024-04-25T09:01:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.585+0000 7ff5db7ce740 1 -- start start 2024-04-25T09:01:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.585+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb46230 0x557b5bb61040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.585+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb49c20 0x557b5bb61580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.585+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb48f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.585+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4156fb0 con 0x557b5bb63ad0 2024-04-25T09:01:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.585+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d41f8010 con 0x557b5bb49c20 2024-04-25T09:01:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.585+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d41569b0 con 0x557b5bb46230 2024-04-25T09:01:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5d2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb48f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5d2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb48f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36446/0 (socket says 172.21.15.55:36446) 2024-04-25T09:01:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5d2d9d640 1 -- 172.21.15.55:0/3446473509 learned_addr learned my addr 172.21.15.55:0/3446473509 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5d259c640 1 --2- 172.21.15.55:0/3446473509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb46230 0x557b5bb61040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/3446473509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb49c20 0x557b5bb61580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5d2d9d640 1 -- 172.21.15.55:0/3446473509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb46230 msgr2=0x557b5bb61040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5d2d9d640 1 --2- 172.21.15.55:0/3446473509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb46230 0x557b5bb61040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5d2d9d640 1 -- 172.21.15.55:0/3446473509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb49c20 msgr2=0x557b5bb61580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5d2d9d640 1 --2- 172.21.15.55:0/3446473509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb49c20 0x557b5bb61580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5d2d9d640 1 -- 172.21.15.55:0/3446473509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b5bb58bb0 con 0x557b5bb63ad0 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5d2d9d640 1 --2- 172.21.15.55:0/3446473509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb48f00 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0050b0 tx=0x7ff5cc005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0a7d97cf4e8a55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5b37fe640 1 -- 172.21.15.55:0/3446473509 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0057c0 con 0x557b5bb63ad0 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5b37fe640 1 -- 172.21.15.55:0/3446473509 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc01b070 con 0x557b5bb63ad0 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.586+0000 7ff5b37fe640 1 -- 172.21.15.55:0/3446473509 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc001e20 con 0x557b5bb63ad0 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.587+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3446473509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 msgr2=0x557b5bb48f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.587+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/3446473509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb48f00 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0050b0 tx=0x7ff5cc005570 comp rx=0 tx=0).stop 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.587+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3446473509 shutdown_connections 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.587+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/3446473509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb63ad0 0x557b5bb48f00 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.587+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/3446473509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb49c20 0x557b5bb61580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.587+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/3446473509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb46230 0x557b5bb61040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.587+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3446473509 >> 172.21.15.55:0/3446473509 conn(0x557b5bb1bf10 msgr2=0x557b5bb485e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.587+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3446473509 shutdown_connections 2024-04-25T09:01:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.587+0000 7ff5db7ce740 1 -- 172.21.15.55:0/3446473509 wait complete. 2024-04-25T09:01:03.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.587+0000 7ff5db7ce740 1 -- start start 2024-04-25T09:01:03.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.587+0000 7ff5db7ce740 1 Processor -- start 2024-04-25T09:01:03.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bbcbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb49c20 0x557b5bb43290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5db7ce740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb63ad0 0x557b5bbcccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5bb477d0 con 0x557b5bb46230 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5bb4a5e0 con 0x557b5bb49c20 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5db7ce740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b5bb452a0 con 0x557b5bb63ad0 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5db7ce740 10 client.0 _ll_register_callbacks cb 0x557b5bb16c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5d259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bbcbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5d259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bbcbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36458/0 (socket says 172.21.15.55:36458) 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5d259c640 1 -- 172.21.15.55:0/1917559466 learned_addr learned my addr 172.21.15.55:0/1917559466 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5d2d9d640 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb63ad0 0x557b5bbcccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.588+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb49c20 0x557b5bb43290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5d259c640 1 -- 172.21.15.55:0/1917559466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb63ad0 msgr2=0x557b5bbcccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5d259c640 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb63ad0 0x557b5bbcccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5d259c640 1 -- 172.21.15.55:0/1917559466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb49c20 msgr2=0x557b5bb43290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5d259c640 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb49c20 0x557b5bb43290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5d259c640 1 -- 172.21.15.55:0/1917559466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b5bb454b0 con 0x557b5bb46230 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb49c20 0x557b5bb43290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5d259c640 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bbcbca0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4000fb0 tx=0x7ff5c40881a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8dba04252822c20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5b17fa640 1 -- 172.21.15.55:0/1917559466 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c405c670 con 0x557b5bb46230 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5b17fa640 1 -- 172.21.15.55:0/1917559466 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7ff5c406dc60 con 0x557b5bb46230 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5db7ce740 1 -- 172.21.15.55:0/1917559466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5cc01b070 con 0x557b5bb46230 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5b17fa640 1 -- 172.21.15.55:0/1917559466 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5c4057e80 con 0x557b5bb46230 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5db7ce740 10 client.7956 fetch_fsmap learned FSMap version 64 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5db7ce740 1 -- 172.21.15.55:0/1917559466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x557b5bb437d0 con 0x557b5bb46230 2024-04-25T09:01:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5b17fa640 1 -- 172.21.15.55:0/1917559466 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc01b070 con 0x557b5bb46230 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5b17fa640 1 -- 172.21.15.55:0/1917559466 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff5c4054270 con 0x557b5bb46230 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5db7ce740 10 client.7956 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5db7ce740 10 client.7956 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5db7ce740 20 client.7956 populate_metadata read hostname 'smithi055' 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x557b5bb57040 0x557b5bb73530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5db7ce740 4 client.7956 mds_command: new command op to 7872 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5db7ce740 1 -- 172.21.15.55:0/1917559466 --> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557b5ba8bf50 con 0x557b5bb57040 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.589+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x557b5bb57040 0x557b5bb73530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5b17fa640 10 client.7956 ms_handle_connect on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5d1d9b640 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x557b5bb57040 0x557b5bb73530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38df0c0513a0c614 server_cookie=6818f1d4daf757f2 in_seq=0 out_seq=0 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5b17fa640 1 -- 172.21.15.55:0/1917559466 <== mds.0 v2:172.21.15.55:6835/2841450668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x557b5ba8bf50 con 0x557b5bb57040 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5b17fa640 10 client.7956 handle_command_reply: tid=0 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 1 client.7956 shutdown 2024-04-25T09:01:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 1 -- 172.21.15.55:0/1917559466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 msgr2=0x557b5bbcbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bbcbca0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4000fb0 tx=0x7ff5c40881a0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 1 -- 172.21.15.55:0/1917559466 shutdown_connections 2024-04-25T09:01:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x557b5bb57040 0x557b5bb73530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b5bb63ad0 0x557b5bbcccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b5bb49c20 0x557b5bb43290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 1 --2- 172.21.15.55:0/1917559466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b5bb46230 0x557b5bbcbca0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5b17fa640 0 client.7956 ms_handle_reset on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 1 -- 172.21.15.55:0/1917559466 >> 172.21.15.55:0/1917559466 conn(0x557b5bb1bf10 msgr2=0x557b5bb1c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 1 -- 172.21.15.55:0/1917559466 shutdown_connections 2024-04-25T09:01:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 1 -- 172.21.15.55:0/1917559466 wait complete. 2024-04-25T09:01:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.590+0000 7ff5db7ce740 20 client.7956 trim_cache size 0 max 16384 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7872, 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.4296443459999999, 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 64, 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 91, 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 91, 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 5.4007492270000004 2024-04-25T09:01:03.587 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:01:03.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 -- 172.21.15.55:0/2935205088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5b406b500 msgr2=0x7ff5b406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5b406b500 0x7ff5b406d9c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8034000 tx=0x7ff5c802e000 comp rx=0 tx=0).stop 2024-04-25T09:01:03.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 -- 172.21.15.55:0/2935205088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5d40b9720 msgr2=0x7ff5d4154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5d40b9720 0x7ff5d4154bc0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400c420 tx=0x7ff5c400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 -- 172.21.15.55:0/2935205088 shutdown_connections 2024-04-25T09:01:03.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5b406b500 0x7ff5b406d9c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5d4161090 0x7ff5d41582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5d40cece0 0x7ff5d40b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 --2- 172.21.15.55:0/2935205088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5d40b9720 0x7ff5d4154bc0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 -- 172.21.15.55:0/2935205088 >> 172.21.15.55:0/2935205088 conn(0x7ff5d40b55e0 msgr2=0x7ff5d40b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 -- 172.21.15.55:0/2935205088 shutdown_connections 2024-04-25T09:01:03.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.591+0000 7ff5d89f4640 1 -- 172.21.15.55:0/2935205088 wait complete. 2024-04-25T09:01:03.590 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:01:03.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.703+0000 7fa8eaf9b640 1 Processor -- start 2024-04-25T09:01:03.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.703+0000 7fa8eaf9b640 1 -- start start 2024-04-25T09:01:03.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8eaf9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e415dce0 0x7fa8e40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8eaf9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8e40b5b60 0x7fa8e40b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8eaf9b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e415e0c0 con 0x7fa8e40d35b0 2024-04-25T09:01:03.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8eaf9b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e40d2510 con 0x7fa8e40b5b60 2024-04-25T09:01:03.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8eaf9b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40d27f0 con 0x7fa8e415dce0 2024-04-25T09:01:03.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8e9538640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8e40b5b60 0x7fa8e40b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8e9538640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8e40b5b60 0x7fa8e40b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36470/0 (socket says 172.21.15.55:36470) 2024-04-25T09:01:03.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8e9538640 1 -- 172.21.15.55:0/3545176760 learned_addr learned my addr 172.21.15.55:0/3545176760 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:03.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8e8d37640 1 --2- 172.21.15.55:0/3545176760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e415dce0 0x7fa8e40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8e9538640 1 -- 172.21.15.55:0/3545176760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e415dce0 msgr2=0x7fa8e40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8e9538640 1 --2- 172.21.15.55:0/3545176760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e415dce0 0x7fa8e40d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8e9538640 1 -- 172.21.15.55:0/3545176760 >> v1:172.21.15.167:6789/0 conn(0x7fa8e40d35b0 legacy=0x7fa8e40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.704+0000 7fa8e9538640 1 -- 172.21.15.55:0/3545176760 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40d2ad0 con 0x7fa8e40b5b60 2024-04-25T09:01:03.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.705+0000 7fa8e9538640 1 --2- 172.21.15.55:0/3545176760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e40b5b60 0x7fa8e40b6b00 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009e50 tx=0x7fa8dc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15b6c0bacba74a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.705+0000 7fa8e37fe640 1 -- 172.21.15.55:0/3545176760 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc036070 con 0x7fa8e40b5b60 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.705+0000 7fa8e37fe640 1 -- 172.21.15.55:0/3545176760 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc031600 con 0x7fa8e40b5b60 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.705+0000 7fa8e37fe640 1 -- 172.21.15.55:0/3545176760 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0319d0 con 0x7fa8e40b5b60 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.706+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/3545176760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e40b5b60 msgr2=0x7fa8e40b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.706+0000 7fa8eaf9b640 1 --2- 172.21.15.55:0/3545176760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e40b5b60 0x7fa8e40b6b00 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009e50 tx=0x7fa8dc02a710 comp rx=0 tx=0).stop 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.706+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/3545176760 shutdown_connections 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.706+0000 7fa8eaf9b640 1 --2- 172.21.15.55:0/3545176760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e40b5b60 0x7fa8e40b6b00 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.706+0000 7fa8eaf9b640 1 --2- 172.21.15.55:0/3545176760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e415dce0 0x7fa8e40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.706+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/3545176760 >> 172.21.15.55:0/3545176760 conn(0x7fa8e4072900 msgr2=0x7fa8e40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.706+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/3545176760 shutdown_connections 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.706+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/3545176760 wait complete. 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.707+0000 7fa8eaf9b640 1 Processor -- start 2024-04-25T09:01:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.707+0000 7fa8eaf9b640 1 -- start start 2024-04-25T09:01:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8eaf9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e40b5b60 0x7fa8e4152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8eaf9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e40d35b0 0x7fa8e40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8eaf9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e415dce0 0x7fa8e40c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8eaf9b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40b9820 con 0x7fa8e40d35b0 2024-04-25T09:01:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8eaf9b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40d3090 con 0x7fa8e40b5b60 2024-04-25T09:01:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8eaf9b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40b99a0 con 0x7fa8e415dce0 2024-04-25T09:01:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8e3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e40d35b0 0x7fa8e40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8e3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e40d35b0 0x7fa8e40c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36472/0 (socket says 172.21.15.55:36472) 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8e3fff640 1 -- 172.21.15.55:0/1383117248 learned_addr learned my addr 172.21.15.55:0/1383117248 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8e8d37640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e40b5b60 0x7fa8e4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8e9538640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e415dce0 0x7fa8e40c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8e3fff640 1 -- 172.21.15.55:0/1383117248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e415dce0 msgr2=0x7fa8e40c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8e3fff640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e415dce0 0x7fa8e40c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8e3fff640 1 -- 172.21.15.55:0/1383117248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e40b5b60 msgr2=0x7fa8e4152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8e3fff640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e40b5b60 0x7fa8e4152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8e3fff640 1 -- 172.21.15.55:0/1383117248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40c8b90 con 0x7fa8e40d35b0 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.708+0000 7fa8e3fff640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e40d35b0 0x7fa8e40c92f0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000c400 tx=0x7fa8d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.709+0000 7fa8e17fa640 1 -- 172.21.15.55:0/1383117248 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d00052d0 con 0x7fa8e40d35b0 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.709+0000 7fa8e17fa640 1 -- 172.21.15.55:0/1383117248 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d0005490 con 0x7fa8e40d35b0 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.709+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/1383117248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e40c82f0 con 0x7fa8e40d35b0 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.709+0000 7fa8e17fa640 1 -- 172.21.15.55:0/1383117248 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0007260 con 0x7fa8e40d35b0 2024-04-25T09:01:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.709+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/1383117248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e40c88b0 con 0x7fa8e40d35b0 2024-04-25T09:01:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.710+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/1383117248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e40749b0 con 0x7fa8e40d35b0 2024-04-25T09:01:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.710+0000 7fa8e17fa640 1 -- 172.21.15.55:0/1383117248 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa8d0007400 con 0x7fa8e40d35b0 2024-04-25T09:01:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.711+0000 7fa8e17fa640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8c806b4d0 0x7fa8c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.711+0000 7fa8e17fa640 1 -- 172.21.15.55:0/1383117248 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fa8d0089770 con 0x7fa8e40d35b0 2024-04-25T09:01:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.711+0000 7fa8e8d37640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8c806b4d0 0x7fa8c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.711+0000 7fa8e8d37640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8c806b4d0 0x7fa8c806d990 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009aa0 tx=0x7fa8d8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.715+0000 7fa8e17fa640 1 -- 172.21.15.55:0/1383117248 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8d0057ed0 con 0x7fa8e40d35b0 2024-04-25T09:01:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.934+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/1383117248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa8e40b27a0 con 0x7fa8e40d35b0 2024-04-25T09:01:03.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.934+0000 7fa8e17fa640 1 -- 172.21.15.55:0/1383117248 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa8d005bf70 con 0x7fa8e40d35b0 2024-04-25T09:01:03.923 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:01:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/1383117248 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8c806b4d0 msgr2=0x7fa8c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8c806b4d0 0x7fa8c806d990 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009aa0 tx=0x7fa8d8009190 comp rx=0 tx=0).stop 2024-04-25T09:01:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/1383117248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e40d35b0 msgr2=0x7fa8e40c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e40d35b0 0x7fa8e40c92f0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000c400 tx=0x7fa8d000c8c0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/1383117248 shutdown_connections 2024-04-25T09:01:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8c806b4d0 0x7fa8c806d990 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e415dce0 0x7fa8e40c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e40d35b0 0x7fa8e40c92f0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 --2- 172.21.15.55:0/1383117248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e40b5b60 0x7fa8e4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/1383117248 >> 172.21.15.55:0/1383117248 conn(0x7fa8e4072900 msgr2=0x7fa8e40d39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/1383117248 shutdown_connections 2024-04-25T09:01:03.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:03.936+0000 7fa8eaf9b640 1 -- 172.21.15.55:0/1383117248 wait complete. 2024-04-25T09:01:03.936 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:01:03.936 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:01:03.936 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T09:01:03.936 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:01:03.936 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:01:03.936 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:01:03.936 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:01:03.936 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:01:03.936 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:01:03.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:03.937 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T09:01:03.952 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:01:03.952 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:01:03.952 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:01:03.952 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:01:03.953 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42293sec preferred_lft 42293sec 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:03.954 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:01:03.955 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:01:03.955 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T09:01:03.955 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:03.955 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:01:03.955 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:01:03.955 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T09:01:03.955 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:03.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:03.955 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:01:04.016 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:01:04.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:04.018 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T09:01:04.074 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T09:01:04.074 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:01:04.074 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:01:04.074 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:01:04.074 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:01:04.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:04.075 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:01:04.075 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:01:04.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:01:04.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:01:04.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:01:04.075 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:01:04.150 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T09:01:04.162+0000 7fc02c1b4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:01:04.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:04.160 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:01:04.215 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:01:04.215 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:01:04.215 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:01:04.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:04.215 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T09:01:04.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:01:04.280 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:01:04.335 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:01:04.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:01:04.336 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:01:04.391 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:01:04.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:04.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:01:04.474 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:01:04.474 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:01:04.474 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:01:04.482 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:01:04.483 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:01:04.483 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:01:04.483 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:01:04.483 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:01:04.488 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:01:04.488 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:01:04.488 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:01:04.488 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:01:04.488 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:01:04.489 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T09:01:04.489 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T09:01:04.489 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T09:01:04.490 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:01:04.490 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:01:04.490 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:01:04.490 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:01:04.490 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:01:04.492 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:04.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:01:04.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:04.559 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:01:04.615 INFO:teuthology.orchestra.run.smithi055.stdout:client7965 2024-04-25T09:01:04.616 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:01:04.616 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:04.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:04.672 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T09:01:04.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.829+0000 7fcad1a3f640 1 Processor -- start 2024-04-25T09:01:04.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.829+0000 7fcad1a3f640 1 -- start start 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.830+0000 7fcad1a3f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcacc161090 0x7fcacc161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.830+0000 7fcad1a3f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc0ceeb0 0x7fcacc0d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.830+0000 7fcad1a3f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc161f80 con 0x7fcacc0b9720 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.830+0000 7fcad1a3f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc0d21a0 con 0x7fcacc161090 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.830+0000 7fcad1a3f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc162260 con 0x7fcacc0ceeb0 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.830+0000 7fcacaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcacc161090 0x7fcacc161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.830+0000 7fcacaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcacc161090 0x7fcacc161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36482/0 (socket says 172.21.15.55:36482) 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.830+0000 7fcacaffd640 1 -- 172.21.15.55:0/2643010794 learned_addr learned my addr 172.21.15.55:0/2643010794 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.830+0000 7fcaca7fc640 1 --1- 172.21.15.55:0/2643010794 >> v1:172.21.15.55:6789/0 conn(0x7fcacc0b9720 0x7fcacc0ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43274/0 (socket says 172.21.15.55:43274) 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.831+0000 7fcacaffd640 1 -- 172.21.15.55:0/2643010794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc0ceeb0 msgr2=0x7fcacc0d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.831+0000 7fcacb7fe640 1 --2- 172.21.15.55:0/2643010794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc0ceeb0 0x7fcacc0d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.831+0000 7fcacaffd640 1 --2- 172.21.15.55:0/2643010794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc0ceeb0 0x7fcacc0d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.831+0000 7fcacaffd640 1 -- 172.21.15.55:0/2643010794 >> v1:172.21.15.55:6789/0 conn(0x7fcacc0b9720 legacy=0x7fcacc0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.831+0000 7fcac9ffb640 1 -- 172.21.15.55:0/2643010794 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452703349 0 0) 0x7fcacc161f80 con 0x7fcacc0b9720 2024-04-25T09:01:04.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.831+0000 7fcacaffd640 1 -- 172.21.15.55:0/2643010794 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc162540 con 0x7fcacc161090 2024-04-25T09:01:04.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.831+0000 7fcacb7fe640 1 --2- 172.21.15.55:0/2643010794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc0ceeb0 0x7fcacc0d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:04.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.831+0000 7fcacaffd640 1 --2- 172.21.15.55:0/2643010794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcacc161090 0x7fcacc161730 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009870 tx=0x7fcabc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d500ce06fdf644 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.831+0000 7fcac9ffb640 1 -- 172.21.15.55:0/2643010794 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc037070 con 0x7fcacc161090 2024-04-25T09:01:04.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.832+0000 7fcac9ffb640 1 -- 172.21.15.55:0/2643010794 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc032440 con 0x7fcacc161090 2024-04-25T09:01:04.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.832+0000 7fcac9ffb640 1 -- 172.21.15.55:0/2643010794 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc032810 con 0x7fcacc161090 2024-04-25T09:01:04.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.832+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2643010794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcacc161090 msgr2=0x7fcacc161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.832+0000 7fcad1a3f640 1 --2- 172.21.15.55:0/2643010794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcacc161090 0x7fcacc161730 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009870 tx=0x7fcabc02a1c0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.832+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2643010794 shutdown_connections 2024-04-25T09:01:04.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.832+0000 7fcad1a3f640 1 --2- 172.21.15.55:0/2643010794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc0ceeb0 0x7fcacc0d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.832+0000 7fcad1a3f640 1 --2- 172.21.15.55:0/2643010794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcacc161090 0x7fcacc161730 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.832+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2643010794 >> 172.21.15.55:0/2643010794 conn(0x7fcacc0b55e0 msgr2=0x7fcacc0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.832+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2643010794 shutdown_connections 2024-04-25T09:01:04.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.832+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2643010794 wait complete. 2024-04-25T09:01:04.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.833+0000 7fcad1a3f640 1 Processor -- start 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.834+0000 7fcad1a3f640 1 -- start start 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.834+0000 7fcad1a3f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcacc0b9720 0x7fcacc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.834+0000 7fcad1a3f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc0ceeb0 0x7fcacc0aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.834+0000 7fcad1a3f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc161090 0x7fcacc0b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.834+0000 7fcad1a3f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc161c70 con 0x7fcacc0b9720 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.834+0000 7fcad1a3f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc161470 con 0x7fcacc0ceeb0 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.834+0000 7fcad1a3f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc0d2b70 con 0x7fcacc161090 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.834+0000 7fcacaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcacc0b9720 0x7fcacc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcacaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcacc0b9720 0x7fcacc0b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36492/0 (socket says 172.21.15.55:36492) 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcacaffd640 1 -- 172.21.15.55:0/2644069407 learned_addr learned my addr 172.21.15.55:0/2644069407 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcacb7fe640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc161090 0x7fcacc0b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcaca7fc640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc0ceeb0 0x7fcacc0aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcacaffd640 1 -- 172.21.15.55:0/2644069407 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc161090 msgr2=0x7fcacc0b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcacaffd640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc161090 0x7fcacc0b7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcacaffd640 1 -- 172.21.15.55:0/2644069407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc0ceeb0 msgr2=0x7fcacc0aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcacaffd640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc0ceeb0 0x7fcacc0aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcacaffd640 1 -- 172.21.15.55:0/2644069407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc15ce90 con 0x7fcacc0b9720 2024-04-25T09:01:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcacaffd640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcacc0b9720 0x7fcacc0b4d90 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009870 tx=0x7fcabc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcab3fff640 1 -- 172.21.15.55:0/2644069407 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc041020 con 0x7fcacc0b9720 2024-04-25T09:01:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcab3fff640 1 -- 172.21.15.55:0/2644069407 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc030970 con 0x7fcacc0b9720 2024-04-25T09:01:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2644069407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc15d170 con 0x7fcacc0b9720 2024-04-25T09:01:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcab3fff640 1 -- 172.21.15.55:0/2644069407 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc037040 con 0x7fcacc0b9720 2024-04-25T09:01:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.835+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2644069407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc15d730 con 0x7fcacc0b9720 2024-04-25T09:01:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.837+0000 7fcab3fff640 1 -- 172.21.15.55:0/2644069407 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcabc044020 con 0x7fcacc0b9720 2024-04-25T09:01:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.837+0000 7fcab3fff640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcab806b4d0 0x7fcab806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.837+0000 7fcab3fff640 1 -- 172.21.15.55:0/2644069407 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fcabc0aac70 con 0x7fcacc0b9720 2024-04-25T09:01:04.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.837+0000 7fcaca7fc640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcab806b4d0 0x7fcab806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.838+0000 7fcaca7fc640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcab806b4d0 0x7fcab806d990 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcacc160aa0 tx=0x7fcac0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.839+0000 7fcad4818740 1 Processor -- start 2024-04-25T09:01:04.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.839+0000 7fcad4818740 1 -- start start 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcad4818740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05afcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcad4818740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05af7830 0x558b05afb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcad4818740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afbcf0 0x558b05afc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcad4818740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b05a60ac0 con 0x558b05afcbb0 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcad4818740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b05a09d80 con 0x558b05afbcf0 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcad4818740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b05a5cb60 con 0x558b05af7830 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcacaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05afcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcacaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05afcf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36494/0 (socket says 172.21.15.55:36494) 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcacaffd640 1 -- 172.21.15.55:0/3978226425 learned_addr learned my addr 172.21.15.55:0/3978226425 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcacb7fe640 1 --2- 172.21.15.55:0/3978226425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afbcf0 0x558b05afc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcaca7fc640 1 --2- 172.21.15.55:0/3978226425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05af7830 0x558b05afb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcacaffd640 1 -- 172.21.15.55:0/3978226425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05af7830 msgr2=0x558b05afb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcacaffd640 1 --2- 172.21.15.55:0/3978226425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05af7830 0x558b05afb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcacaffd640 1 -- 172.21.15.55:0/3978226425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afbcf0 msgr2=0x558b05afc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcacaffd640 1 --2- 172.21.15.55:0/3978226425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afbcf0 0x558b05afc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcacaffd640 1 -- 172.21.15.55:0/3978226425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b0583d7e0 con 0x558b05afcbb0 2024-04-25T09:01:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcacaffd640 1 --2- 172.21.15.55:0/3978226425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05afcf90 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0a9100 tx=0x7fcabc0980f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f3f430ae7a0156 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.841+0000 7fcab17fa640 1 -- 172.21.15.55:0/3978226425 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc079330 con 0x558b05afcbb0 2024-04-25T09:01:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.842+0000 7fcab17fa640 1 -- 172.21.15.55:0/3978226425 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc07d480 con 0x558b05afcbb0 2024-04-25T09:01:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.842+0000 7fcab17fa640 1 -- 172.21.15.55:0/3978226425 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc081a40 con 0x558b05afcbb0 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.842+0000 7fcad4818740 1 -- 172.21.15.55:0/3978226425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 msgr2=0x558b05afcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.842+0000 7fcad4818740 1 --2- 172.21.15.55:0/3978226425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05afcf90 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0a9100 tx=0x7fcabc0980f0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.843+0000 7fcad4818740 1 -- 172.21.15.55:0/3978226425 shutdown_connections 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.843+0000 7fcad4818740 1 --2- 172.21.15.55:0/3978226425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afbcf0 0x558b05afc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.843+0000 7fcad4818740 1 --2- 172.21.15.55:0/3978226425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05af7830 0x558b05afb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.843+0000 7fcad4818740 1 --2- 172.21.15.55:0/3978226425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05afcf90 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.843+0000 7fcad4818740 1 -- 172.21.15.55:0/3978226425 >> 172.21.15.55:0/3978226425 conn(0x558b05af9cb0 msgr2=0x558b05b42770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.843+0000 7fcad4818740 1 -- 172.21.15.55:0/3978226425 shutdown_connections 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.843+0000 7fcad4818740 1 -- 172.21.15.55:0/3978226425 wait complete. 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.844+0000 7fcad4818740 1 -- start start 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.844+0000 7fcad4818740 1 Processor -- start 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcad4818740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05afbcf0 0x558b05b19010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcad4818740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05b486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcad4818740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05b4abe0 0x558b05b4a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcad4818740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b05a60ac0 con 0x558b05afcbb0 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcad4818740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b059ff530 con 0x558b05b4abe0 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcad4818740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b05b28740 con 0x558b05afbcf0 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcad4818740 10 client.0 _ll_register_callbacks cb 0x558b05a57130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcaca7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05b486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcaca7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05b486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36496/0 (socket says 172.21.15.55:36496) 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcaca7fc640 1 -- 172.21.15.55:0/3349336448 learned_addr learned my addr 172.21.15.55:0/3349336448 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcacaffd640 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05afbcf0 0x558b05b19010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcacb7fe640 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05b4abe0 0x558b05b4a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcaca7fc640 1 -- 172.21.15.55:0/3349336448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05afbcf0 msgr2=0x558b05b19010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcaca7fc640 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05afbcf0 0x558b05b19010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcaca7fc640 1 -- 172.21.15.55:0/3349336448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05b4abe0 msgr2=0x558b05b4a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcaca7fc640 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05b4abe0 0x558b05b4a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcaca7fc640 1 -- 172.21.15.55:0/3349336448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b0589df70 con 0x558b05afcbb0 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcaca7fc640 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05b486a0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005aa0 tx=0x7fcac0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6680a381750f831 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.845+0000 7fcaaa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/3349336448 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0026060 con 0x558b05afcbb0 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/3349336448 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fcac0021b60 con 0x558b05afcbb0 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcad4818740 1 -- 172.21.15.55:0/3349336448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcabc07d480 con 0x558b05afcbb0 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/3349336448 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcac0021d60 con 0x558b05afcbb0 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcad4818740 10 client.7980 fetch_fsmap learned FSMap version 64 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcad4818740 1 -- 172.21.15.55:0/3349336448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x558b05735170 con 0x558b05afcbb0 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/3349336448 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc07d480 con 0x558b05afcbb0 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/3349336448 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcac0012410 con 0x558b05afcbb0 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcad4818740 10 client.7980 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcad4818740 10 client.7980 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcad4818740 20 client.7980 populate_metadata read hostname 'smithi055' 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcad4818740 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x558b05b19a70 0x558b05b19e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcad4818740 4 client.7980 mds_command: new command op to 7872 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcad4818740 1 -- 172.21.15.55:0/3349336448 --> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b05a6e000 con 0x558b05b19a70 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.846+0000 7fcacaffd640 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x558b05b19a70 0x558b05b19e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.847+0000 7fcaaa7fc640 10 client.7980 ms_handle_connect on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.847+0000 7fcacaffd640 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x558b05b19a70 0x558b05b19e80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3d4377f93c21599 server_cookie=e81d602a20b74c1 in_seq=0 out_seq=0 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.847+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/3349336448 <== mds.0 v2:172.21.15.55:6835/2841450668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558b05a6e000 con 0x558b05b19a70 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.847+0000 7fcaaa7fc640 10 client.7980 handle_command_reply: tid=0 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.847+0000 7fcad4818740 1 client.7980 shutdown 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.847+0000 7fcad4818740 1 -- 172.21.15.55:0/3349336448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 msgr2=0x558b05b486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.847+0000 7fcad4818740 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05b486a0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005aa0 tx=0x7fcac0000ed0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.847+0000 7fcad4818740 1 -- 172.21.15.55:0/3349336448 shutdown_connections 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.847+0000 7fcad4818740 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05b4abe0 0x558b05b4a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.847+0000 7fcad4818740 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afcbb0 0x558b05b486a0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.847+0000 7fcad4818740 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x558b05b19a70 0x558b05b19e80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.848+0000 7fcad4818740 1 --2- 172.21.15.55:0/3349336448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05afbcf0 0x558b05b19010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.848+0000 7fcad4818740 1 -- 172.21.15.55:0/3349336448 >> 172.21.15.55:0/3349336448 conn(0x558b05af7830 msgr2=0x558b05afd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.848+0000 7fcaaa7fc640 0 client.7980 ms_handle_reset on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:04.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.848+0000 7fcad4818740 1 -- 172.21.15.55:0/3349336448 shutdown_connections 2024-04-25T09:01:04.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.848+0000 7fcad4818740 1 -- 172.21.15.55:0/3349336448 wait complete. 2024-04-25T09:01:04.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.848+0000 7fcad4818740 20 client.7980 trim_cache size 0 max 16384 2024-04-25T09:01:04.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.864+0000 7fcad4818740 1 Processor -- start 2024-04-25T09:01:04.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.864+0000 7fcad4818740 1 -- start start 2024-04-25T09:01:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcad4818740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05afbcf0 0x558b05b20fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcad4818740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afcbb0 0x558b05b49b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcad4818740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05b4abe0 0x558b05b547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcad4818740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc1ffed0 con 0x558b05b4abe0 2024-04-25T09:01:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcad4818740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc1ff0d0 con 0x558b05afcbb0 2024-04-25T09:01:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcad4818740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc15f2f0 con 0x558b05afbcf0 2024-04-25T09:01:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcacb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05b4abe0 0x558b05b547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcacb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05b4abe0 0x558b05b547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36512/0 (socket says 172.21.15.55:36512) 2024-04-25T09:01:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcacb7fe640 1 -- 172.21.15.55:0/900649303 learned_addr learned my addr 172.21.15.55:0/900649303 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcaca7fc640 1 --2- 172.21.15.55:0/900649303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afcbb0 0x558b05b49b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcacaffd640 1 --2- 172.21.15.55:0/900649303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05afbcf0 0x558b05b20fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcacb7fe640 1 -- 172.21.15.55:0/900649303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05afbcf0 msgr2=0x558b05b20fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcacb7fe640 1 --2- 172.21.15.55:0/900649303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05afbcf0 0x558b05b20fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcacb7fe640 1 -- 172.21.15.55:0/900649303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afcbb0 msgr2=0x558b05b49b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcacb7fe640 1 --2- 172.21.15.55:0/900649303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afcbb0 0x558b05b49b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcacb7fe640 1 -- 172.21.15.55:0/900649303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b05af90c0 con 0x558b05b4abe0 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcacb7fe640 1 --2- 172.21.15.55:0/900649303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05b4abe0 0x558b05b547e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fcac400c420 tx=0x7fcac400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47022c5b2354b2bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcab0ff9640 1 -- 172.21.15.55:0/900649303 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac400b8e0 con 0x558b05b4abe0 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.865+0000 7fcab0ff9640 1 -- 172.21.15.55:0/900649303 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac401c070 con 0x558b05b4abe0 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.866+0000 7fcab0ff9640 1 -- 172.21.15.55:0/900649303 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac400bce0 con 0x558b05b4abe0 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.866+0000 7fcad4818740 1 -- 172.21.15.55:0/900649303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05b4abe0 msgr2=0x558b05b547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.866+0000 7fcad4818740 1 --2- 172.21.15.55:0/900649303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05b4abe0 0x558b05b547e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fcac400c420 tx=0x7fcac400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.866+0000 7fcad4818740 1 -- 172.21.15.55:0/900649303 shutdown_connections 2024-04-25T09:01:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.866+0000 7fcad4818740 1 --2- 172.21.15.55:0/900649303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05b4abe0 0x558b05b547e0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.866+0000 7fcad4818740 1 --2- 172.21.15.55:0/900649303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afcbb0 0x558b05b49b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.866+0000 7fcad4818740 1 --2- 172.21.15.55:0/900649303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05afbcf0 0x558b05b20fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.866+0000 7fcad4818740 1 -- 172.21.15.55:0/900649303 >> 172.21.15.55:0/900649303 conn(0x558b05af7830 msgr2=0x558b05b65360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.866+0000 7fcad4818740 1 -- 172.21.15.55:0/900649303 shutdown_connections 2024-04-25T09:01:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.866+0000 7fcad4818740 1 -- 172.21.15.55:0/900649303 wait complete. 2024-04-25T09:01:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.867+0000 7fcad4818740 1 -- start start 2024-04-25T09:01:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.867+0000 7fcad4818740 1 Processor -- start 2024-04-25T09:01:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcad4818740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afbcf0 0x558b05b1aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcad4818740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afcbb0 0x558b05bad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcad4818740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05b4abe0 0x558b05b1e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcad4818740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b05b20a30 con 0x558b05afbcf0 2024-04-25T09:01:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcad4818740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc15f8f0 con 0x558b05afcbb0 2024-04-25T09:01:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcad4818740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b05b38ba0 con 0x558b05b4abe0 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcad4818740 10 client.0 _ll_register_callbacks cb 0x7fcabc032ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcacaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afbcf0 0x558b05b1aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcacaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afbcf0 0x558b05b1aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36514/0 (socket says 172.21.15.55:36514) 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcacaffd640 1 -- 172.21.15.55:0/4198712621 learned_addr learned my addr 172.21.15.55:0/4198712621 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcacb7fe640 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05b4abe0 0x558b05b1e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcaca7fc640 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afcbb0 0x558b05bad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcacaffd640 1 -- 172.21.15.55:0/4198712621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05b4abe0 msgr2=0x558b05b1e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcacaffd640 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05b4abe0 0x558b05b1e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcacaffd640 1 -- 172.21.15.55:0/4198712621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afcbb0 msgr2=0x558b05bad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcacaffd640 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afcbb0 0x558b05bad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcacaffd640 1 -- 172.21.15.55:0/4198712621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b05b1b430 con 0x558b05afbcf0 2024-04-25T09:01:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcacaffd640 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afbcf0 0x558b05b1aef0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fcabc035040 tx=0x7fcabc098050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e002a4f19b2efa39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcaaa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.868+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/4198712621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc07d480 con 0x558b05afbcf0 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/4198712621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fcabc0773d0 con 0x558b05afbcf0 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcad4818740 1 -- 172.21.15.55:0/4198712621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcac401c070 con 0x558b05afbcf0 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/4198712621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcabc077630 con 0x558b05afbcf0 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcad4818740 10 client.7986 fetch_fsmap learned FSMap version 64 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcad4818740 1 -- 172.21.15.55:0/4198712621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x558b05bae160 con 0x558b05afbcf0 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/4198712621 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac401c070 con 0x558b05afbcf0 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/4198712621 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcabc08e030 con 0x558b05afbcf0 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcad4818740 10 client.7986 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcad4818740 10 client.7986 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcad4818740 20 client.7986 populate_metadata read hostname 'smithi055' 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcad4818740 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x558b05b1cf20 0x558b05b547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcad4818740 4 client.7986 mds_command: new command op to 7872 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T09:01:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcad4818740 1 -- 172.21.15.55:0/4198712621 --> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x558b05a68350 con 0x558b05b1cf20 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcaca7fc640 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x558b05b1cf20 0x558b05b547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcaaa7fc640 10 client.7986 ms_handle_connect on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.869+0000 7fcaca7fc640 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x558b05b1cf20 0x558b05b547e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30d83a05c4328d23 server_cookie=eef39e3d3c68bbdf in_seq=0 out_seq=0 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcaaa7fc640 1 -- 172.21.15.55:0/4198712621 <== mds.0 v2:172.21.15.55:6835/2841450668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558b05a68350 con 0x558b05b1cf20 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcaaa7fc640 10 client.7986 handle_command_reply: tid=0 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 1 client.7986 shutdown 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 1 -- 172.21.15.55:0/4198712621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afbcf0 msgr2=0x558b05b1aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afbcf0 0x558b05b1aef0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fcabc035040 tx=0x7fcabc098050 comp rx=0 tx=0).stop 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 1 -- 172.21.15.55:0/4198712621 shutdown_connections 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x558b05b1cf20 0x558b05b547e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcaaa7fc640 0 client.7986 ms_handle_reset on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b05b4abe0 0x558b05b1e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b05afcbb0 0x558b05bad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 1 --2- 172.21.15.55:0/4198712621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558b05afbcf0 0x558b05b1aef0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 1 -- 172.21.15.55:0/4198712621 >> 172.21.15.55:0/4198712621 conn(0x558b05af7830 msgr2=0x558b05b49b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 1 -- 172.21.15.55:0/4198712621 shutdown_connections 2024-04-25T09:01:04.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 1 -- 172.21.15.55:0/4198712621 wait complete. 2024-04-25T09:01:04.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.870+0000 7fcad4818740 20 client.7986 trim_cache size 0 max 16384 2024-04-25T09:01:04.866 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:01:04.866 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-25T09:01:04.866 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "9447b11f-41d7-444b-968b-26d4133be936", 2024-04-25T09:01:04.866 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-25T09:01:04.867 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:01:04.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2644069407 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcab806b4d0 msgr2=0x7fcab806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcab806b4d0 0x7fcab806d990 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcacc160aa0 tx=0x7fcac0009040 comp rx=0 tx=0).stop 2024-04-25T09:01:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2644069407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcacc0b9720 msgr2=0x7fcacc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcacc0b9720 0x7fcacc0b4d90 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009870 tx=0x7fcabc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2644069407 shutdown_connections 2024-04-25T09:01:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcab806b4d0 0x7fcab806d990 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc161090 0x7fcacc0b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc0ceeb0 0x7fcacc0aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 --2- 172.21.15.55:0/2644069407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcacc0b9720 0x7fcacc0b4d90 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2644069407 >> 172.21.15.55:0/2644069407 conn(0x7fcacc0b55e0 msgr2=0x7fcacc0d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2644069407 shutdown_connections 2024-04-25T09:01:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.871+0000 7fcad1a3f640 1 -- 172.21.15.55:0/2644069407 wait complete. 2024-04-25T09:01:04.868 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T09:01:04.872+0000 7fc0281ac640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x5558a337c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:01:04.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:04.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:01:04.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.991+0000 7fc3daa6f640 1 Processor -- start 2024-04-25T09:01:04.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.991+0000 7fc3daa6f640 1 -- start start 2024-04-25T09:01:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.992+0000 7fc3daa6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc3d4144e70 0x7fc3d406d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.992+0000 7fc3daa6f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d406dcb0 con 0x7fc3d406d7a0 2024-04-25T09:01:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.992+0000 7fc3daa6f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d406df90 con 0x7fc3d40cf0e0 2024-04-25T09:01:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.992+0000 7fc3daa6f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d415bfe0 con 0x7fc3d4144e70 2024-04-25T09:01:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.992+0000 7fc3d880b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc3d4144e70 0x7fc3d406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.992+0000 7fc3d3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc3d406d7a0 0x7fc3d40ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43276/0 (socket says 172.21.15.55:43276) 2024-04-25T09:01:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.992+0000 7fc3d3fff640 1 -- 172.21.15.55:0/2003662122 learned_addr learned my addr 172.21.15.55:0/2003662122 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.992+0000 7fc3d880b640 1 -- 172.21.15.55:0/2003662122 >> v1:172.21.15.167:6789/0 conn(0x7fc3d40cf0e0 legacy=0x7fc3d40cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.992+0000 7fc3d880b640 1 -- 172.21.15.55:0/2003662122 >> v1:172.21.15.55:6789/0 conn(0x7fc3d406d7a0 legacy=0x7fc3d40ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.992+0000 7fc3d880b640 1 -- 172.21.15.55:0/2003662122 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d406e270 con 0x7fc3d4144e70 2024-04-25T09:01:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.992+0000 7fc3d37fe640 1 -- 172.21.15.55:0/2003662122 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199299169 0 0) 0x7fc3d406dcb0 con 0x7fc3d406d7a0 2024-04-25T09:01:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.993+0000 7fc3d880b640 1 --2- 172.21.15.55:0/2003662122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3d4144e70 0x7fc3d406d260 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fc3d415c160 tx=0x7fc3c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2526d0319c63d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.993+0000 7fc3d37fe640 1 -- 172.21.15.55:0/2003662122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8037070 con 0x7fc3d4144e70 2024-04-25T09:01:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.993+0000 7fc3d37fe640 1 -- 172.21.15.55:0/2003662122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8032440 con 0x7fc3d4144e70 2024-04-25T09:01:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.993+0000 7fc3d37fe640 1 -- 172.21.15.55:0/2003662122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8032810 con 0x7fc3d4144e70 2024-04-25T09:01:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.994+0000 7fc3daa6f640 1 -- 172.21.15.55:0/2003662122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3d4144e70 msgr2=0x7fc3d406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.994+0000 7fc3daa6f640 1 --2- 172.21.15.55:0/2003662122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3d4144e70 0x7fc3d406d260 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fc3d415c160 tx=0x7fc3c802a180 comp rx=0 tx=0).stop 2024-04-25T09:01:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.994+0000 7fc3daa6f640 1 -- 172.21.15.55:0/2003662122 shutdown_connections 2024-04-25T09:01:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.994+0000 7fc3daa6f640 1 --2- 172.21.15.55:0/2003662122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3d4144e70 0x7fc3d406d260 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.994+0000 7fc3daa6f640 1 -- 172.21.15.55:0/2003662122 >> 172.21.15.55:0/2003662122 conn(0x7fc3d406aba0 msgr2=0x7fc3d406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.994+0000 7fc3daa6f640 1 -- 172.21.15.55:0/2003662122 shutdown_connections 2024-04-25T09:01:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.994+0000 7fc3daa6f640 1 -- 172.21.15.55:0/2003662122 wait complete. 2024-04-25T09:01:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.995+0000 7fc3daa6f640 1 Processor -- start 2024-04-25T09:01:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.995+0000 7fc3daa6f640 1 -- start start 2024-04-25T09:01:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.996+0000 7fc3daa6f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d406d7a0 0x7fc3d4142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.996+0000 7fc3daa6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3d40cf0e0 0x7fc3d41503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.996+0000 7fc3daa6f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d4144e70 0x7fc3d41508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.996+0000 7fc3daa6f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4145630 con 0x7fc3d40cf0e0 2024-04-25T09:01:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.996+0000 7fc3daa6f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d41454b0 con 0x7fc3d4144e70 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.996+0000 7fc3daa6f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d40cca10 con 0x7fc3d406d7a0 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.996+0000 7fc3d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3d40cf0e0 0x7fc3d41503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.996+0000 7fc3d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3d40cf0e0 0x7fc3d41503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36526/0 (socket says 172.21.15.55:36526) 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.996+0000 7fc3d3fff640 1 -- 172.21.15.55:0/3619196002 learned_addr learned my addr 172.21.15.55:0/3619196002 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.996+0000 7fc3d880b640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d406d7a0 0x7fc3d4142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.996+0000 7fc3d900c640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d4144e70 0x7fc3d41508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3d3fff640 1 -- 172.21.15.55:0/3619196002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d406d7a0 msgr2=0x7fc3d4142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3d3fff640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d406d7a0 0x7fc3d4142c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3d3fff640 1 -- 172.21.15.55:0/3619196002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d4144e70 msgr2=0x7fc3d41508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3d3fff640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d4144e70 0x7fc3d41508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3d3fff640 1 -- 172.21.15.55:0/3619196002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d40b3760 con 0x7fc3d40cf0e0 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3d880b640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d406d7a0 0x7fc3d4142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3d3fff640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3d40cf0e0 0x7fc3d41503b0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000c4a0 tx=0x7fc3c000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3d17fa640 1 -- 172.21.15.55:0/3619196002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0018070 con 0x7fc3d40cf0e0 2024-04-25T09:01:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3d17fa640 1 -- 172.21.15.55:0/3619196002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c00074e0 con 0x7fc3d40cf0e0 2024-04-25T09:01:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3daa6f640 1 -- 172.21.15.55:0/3619196002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d40b3a40 con 0x7fc3d40cf0e0 2024-04-25T09:01:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3d17fa640 1 -- 172.21.15.55:0/3619196002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0004a20 con 0x7fc3d40cf0e0 2024-04-25T09:01:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.997+0000 7fc3daa6f640 1 -- 172.21.15.55:0/3619196002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d40b4000 con 0x7fc3d40cf0e0 2024-04-25T09:01:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:04.999+0000 7fc3d17fa640 1 -- 172.21.15.55:0/3619196002 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3c001b070 con 0x7fc3d40cf0e0 2024-04-25T09:01:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.000+0000 7fc3d17fa640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc3b806b4d0 0x7fc3b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.000+0000 7fc3d17fa640 1 -- 172.21.15.55:0/3619196002 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fc3c0089530 con 0x7fc3d40cf0e0 2024-04-25T09:01:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.000+0000 7fc3d880b640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc3b806b4d0 0x7fc3b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.000+0000 7fc3dd77a740 1 Processor -- start 2024-04-25T09:01:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.000+0000 7fc3d880b640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc3b806b4d0 0x7fc3b806d990 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8034000 tx=0x7fc3c802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.000+0000 7fc3dd77a740 1 -- start start 2024-04-25T09:01:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.001+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a4189f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.001+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a4189f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.001+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4186f770 0x556a41872f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.001+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a417d8da0 con 0x556a4186f770 2024-04-25T09:01:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.001+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a41781b80 con 0x556a4189cb10 2024-04-25T09:01:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.001+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a417d4e40 con 0x556a4189cef0 2024-04-25T09:01:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.001+0000 7fc3d900c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4186f770 0x556a41872f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.001+0000 7fc3d900c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4186f770 0x556a41872f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36540/0 (socket says 172.21.15.55:36540) 2024-04-25T09:01:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.001+0000 7fc3d900c640 1 -- 172.21.15.55:0/3415562164 learned_addr learned my addr 172.21.15.55:0/3415562164 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:04.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.001+0000 7fc3d880b640 1 --2- 172.21.15.55:0/3415562164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a4189f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.001+0000 7fc3d3fff640 1 --2- 172.21.15.55:0/3415562164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a4189f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.002+0000 7fc3d900c640 1 -- 172.21.15.55:0/3415562164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 msgr2=0x556a4189f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.002+0000 7fc3d900c640 1 --2- 172.21.15.55:0/3415562164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a4189f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.002+0000 7fc3d900c640 1 -- 172.21.15.55:0/3415562164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 msgr2=0x556a4189f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.002+0000 7fc3d900c640 1 --2- 172.21.15.55:0/3415562164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a4189f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.002+0000 7fc3d900c640 1 -- 172.21.15.55:0/3415562164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a4178bf10 con 0x556a4186f770 2024-04-25T09:01:04.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.002+0000 7fc3d900c640 1 --2- 172.21.15.55:0/3415562164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4186f770 0x556a41872f80 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc001f00 tx=0x7fc3cc001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5525c93272e25e09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.002+0000 7fc3be7fc640 1 -- 172.21.15.55:0/3415562164 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00fdf0 con 0x556a4186f770 2024-04-25T09:01:04.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.002+0000 7fc3be7fc640 1 -- 172.21.15.55:0/3415562164 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc018070 con 0x556a4186f770 2024-04-25T09:01:04.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.002+0000 7fc3be7fc640 1 -- 172.21.15.55:0/3415562164 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc003b70 con 0x556a4186f770 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.003+0000 7fc3dd77a740 1 -- 172.21.15.55:0/3415562164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4186f770 msgr2=0x556a41872f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.003+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/3415562164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4186f770 0x556a41872f80 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc001f00 tx=0x7fc3cc001670 comp rx=0 tx=0).stop 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.003+0000 7fc3dd77a740 1 -- 172.21.15.55:0/3415562164 shutdown_connections 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.003+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/3415562164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4186f770 0x556a41872f80 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.003+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/3415562164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a4189f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.003+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/3415562164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a4189f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.003+0000 7fc3dd77a740 1 -- 172.21.15.55:0/3415562164 >> 172.21.15.55:0/3415562164 conn(0x556a418719e0 msgr2=0x556a418ba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.003+0000 7fc3dd77a740 1 -- 172.21.15.55:0/3415562164 shutdown_connections 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.003+0000 7fc3dd77a740 1 -- 172.21.15.55:0/3415562164 wait complete. 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.003+0000 7fc3dd77a740 1 -- start start 2024-04-25T09:01:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.004+0000 7fc3dd77a740 1 Processor -- start 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.004+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cb10 0x556a418bd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.004+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a41873f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.004+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a41893be0 0x556a418744d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.004+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a41874b90 con 0x556a4189cb10 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.004+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a417774b0 con 0x556a41893be0 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.004+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a41874e70 con 0x556a4189cef0 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3dd77a740 10 client.0 _ll_register_callbacks cb 0x556a417b7180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3d880b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cb10 0x556a418bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3d880b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cb10 0x556a418bd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36556/0 (socket says 172.21.15.55:36556) 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3d880b640 1 -- 172.21.15.55:0/155274005 learned_addr learned my addr 172.21.15.55:0/155274005 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3d900c640 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a41893be0 0x556a418744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3d3fff640 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a41873f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3d880b640 1 -- 172.21.15.55:0/155274005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 msgr2=0x556a41873f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3d880b640 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a41873f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3d880b640 1 -- 172.21.15.55:0/155274005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a41893be0 msgr2=0x556a418744d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3d880b640 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a41893be0 0x556a418744d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3d880b640 1 -- 172.21.15.55:0/155274005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a415b77d0 con 0x556a4189cb10 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3d880b640 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cb10 0x556a418bd600 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009890 tx=0x7fc3c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20aa4cec9697e6ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3b37fe640 1 -- 172.21.15.55:0/155274005 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8037050 con 0x556a4189cb10 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3b37fe640 1 -- 172.21.15.55:0/155274005 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fc3c8032650 con 0x556a4189cb10 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.005+0000 7fc3dd77a740 1 -- 172.21.15.55:0/155274005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3cc018070 con 0x556a4189cb10 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3b37fe640 1 -- 172.21.15.55:0/155274005 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3c8058050 con 0x556a4189cb10 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3dd77a740 10 client.8001 fetch_fsmap learned FSMap version 64 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3dd77a740 1 -- 172.21.15.55:0/155274005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x556a414ed3f0 con 0x556a4189cb10 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3b37fe640 1 -- 172.21.15.55:0/155274005 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc018070 con 0x556a4189cb10 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3b37fe640 1 -- 172.21.15.55:0/155274005 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc3c805b020 con 0x556a4189cb10 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3dd77a740 10 client.8001 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3dd77a740 10 client.8001 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:01:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3dd77a740 20 client.8001 populate_metadata read hostname 'smithi055' 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x556a41894ed0 0x556a418bc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3dd77a740 4 client.8001 mds_command: new command op to 7872 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3dd77a740 1 -- 172.21.15.55:0/155274005 --> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a417e62e0 con 0x556a41894ed0 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3d3fff640 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x556a41894ed0 0x556a418bc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.006+0000 7fc3b37fe640 10 client.8001 ms_handle_connect on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.007+0000 7fc3d3fff640 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x556a41894ed0 0x556a418bc4a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77e89626ae131f84 server_cookie=31e0a32d5e702a1d in_seq=0 out_seq=0 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.007+0000 7fc3b37fe640 1 -- 172.21.15.55:0/155274005 <== mds.0 v2:172.21.15.55:6835/2841450668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556a417e62e0 con 0x556a41894ed0 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.007+0000 7fc3b37fe640 10 client.8001 handle_command_reply: tid=0 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.007+0000 7fc3dd77a740 1 client.8001 shutdown 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3dd77a740 1 -- 172.21.15.55:0/155274005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cb10 msgr2=0x556a418bd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cb10 0x556a418bd600 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009890 tx=0x7fc3c8004730 comp rx=0 tx=0).stop 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3dd77a740 1 -- 172.21.15.55:0/155274005 shutdown_connections 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a41893be0 0x556a418744d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x556a41894ed0 0x556a418bc4a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a41873f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/155274005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cb10 0x556a418bd600 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3b37fe640 0 client.8001 ms_handle_reset on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3dd77a740 1 -- 172.21.15.55:0/155274005 >> 172.21.15.55:0/155274005 conn(0x556a4186f770 msgr2=0x556a41870400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3dd77a740 1 -- 172.21.15.55:0/155274005 shutdown_connections 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3dd77a740 1 -- 172.21.15.55:0/155274005 wait complete. 2024-04-25T09:01:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.008+0000 7fc3dd77a740 20 client.8001 trim_cache size 0 max 16384 2024-04-25T09:01:05.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.023+0000 7fc3dd77a740 1 Processor -- start 2024-04-25T09:01:05.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.023+0000 7fc3dd77a740 1 -- start start 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.024+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a41893be0 0x556a41897100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.024+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a4186e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.024+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a4186eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.024+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d41ffe30 con 0x556a41893be0 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.024+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d414f810 con 0x556a4189cb10 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.024+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4142390 con 0x556a4189cef0 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.024+0000 7fc3d880b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a41893be0 0x556a41897100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.024+0000 7fc3d880b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a41893be0 0x556a41897100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36572/0 (socket says 172.21.15.55:36572) 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.024+0000 7fc3d880b640 1 -- 172.21.15.55:0/2635031227 learned_addr learned my addr 172.21.15.55:0/2635031227 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.025+0000 7fc3d900c640 1 --2- 172.21.15.55:0/2635031227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a4186eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.025+0000 7fc3d3fff640 1 --2- 172.21.15.55:0/2635031227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a4186e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.025+0000 7fc3d880b640 1 -- 172.21.15.55:0/2635031227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 msgr2=0x556a4186eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:05.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.025+0000 7fc3d880b640 1 --2- 172.21.15.55:0/2635031227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a4186eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.025+0000 7fc3d880b640 1 -- 172.21.15.55:0/2635031227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 msgr2=0x556a4186e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.025+0000 7fc3d880b640 1 --2- 172.21.15.55:0/2635031227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a4186e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.025+0000 7fc3d880b640 1 -- 172.21.15.55:0/2635031227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a414ad0f0 con 0x556a41893be0 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.025+0000 7fc3d880b640 1 --2- 172.21.15.55:0/2635031227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a41893be0 0x556a41897100 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8000c00 tx=0x7fc3c8049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554d0c0c95713f35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.025+0000 7fc3bdffb640 1 -- 172.21.15.55:0/2635031227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8037040 con 0x556a41893be0 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.025+0000 7fc3bdffb640 1 -- 172.21.15.55:0/2635031227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8050070 con 0x556a41893be0 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.025+0000 7fc3bdffb640 1 -- 172.21.15.55:0/2635031227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8032b80 con 0x556a41893be0 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.026+0000 7fc3dd77a740 1 -- 172.21.15.55:0/2635031227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a41893be0 msgr2=0x556a41897100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.026+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/2635031227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a41893be0 0x556a41897100 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8000c00 tx=0x7fc3c8049000 comp rx=0 tx=0).stop 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.026+0000 7fc3dd77a740 1 -- 172.21.15.55:0/2635031227 shutdown_connections 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.026+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/2635031227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a4189cef0 0x556a4186eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.026+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/2635031227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a4186e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.026+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/2635031227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a41893be0 0x556a41897100 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.026+0000 7fc3dd77a740 1 -- 172.21.15.55:0/2635031227 >> 172.21.15.55:0/2635031227 conn(0x556a4186f770 msgr2=0x556a4189bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.026+0000 7fc3dd77a740 1 -- 172.21.15.55:0/2635031227 shutdown_connections 2024-04-25T09:01:05.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.026+0000 7fc3dd77a740 1 -- 172.21.15.55:0/2635031227 wait complete. 2024-04-25T09:01:05.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.026+0000 7fc3dd77a740 1 -- start start 2024-04-25T09:01:05.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.027+0000 7fc3dd77a740 1 Processor -- start 2024-04-25T09:01:05.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.027+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a41893be0 0x556a41870850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.027+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a41872f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.027+0000 7fc3dd77a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cef0 0x556a4186e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.027+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4189f7f0 con 0x556a4189cef0 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.027+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d414f210 con 0x556a4189cb10 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.027+0000 7fc3dd77a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a418983d0 con 0x556a41893be0 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.027+0000 7fc3dd77a740 10 client.0 _ll_register_callbacks cb 0x7fc3cc001980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.027+0000 7fc3d900c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cef0 0x556a4186e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.027+0000 7fc3d900c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cef0 0x556a4186e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36576/0 (socket says 172.21.15.55:36576) 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.027+0000 7fc3d900c640 1 -- 172.21.15.55:0/670186708 learned_addr learned my addr 172.21.15.55:0/670186708 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3d880b640 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a41893be0 0x556a41870850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3d3fff640 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a41872f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3d900c640 1 -- 172.21.15.55:0/670186708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a41893be0 msgr2=0x556a41870850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3d900c640 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a41893be0 0x556a41870850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3d900c640 1 -- 172.21.15.55:0/670186708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 msgr2=0x556a41872f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3d900c640 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a41872f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3d900c640 1 -- 172.21.15.55:0/670186708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a41895c40 con 0x556a4189cef0 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3d900c640 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cef0 0x556a4186e600 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc015040 tx=0x7fc3cc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503a931daa37f7eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3b37fe640 1 -- 172.21.15.55:0/670186708 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc003e40 con 0x556a4189cef0 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3b37fe640 1 -- 172.21.15.55:0/670186708 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fc3cc0050d0 con 0x556a4189cef0 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3dd77a740 1 -- 172.21.15.55:0/670186708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3c8050070 con 0x556a4189cef0 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3b37fe640 1 -- 172.21.15.55:0/670186708 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3cc02f050 con 0x556a4189cef0 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3dd77a740 10 client.8007 fetch_fsmap learned FSMap version 64 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.028+0000 7fc3dd77a740 1 -- 172.21.15.55:0/670186708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x556a41925740 con 0x556a4189cef0 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3b37fe640 1 -- 172.21.15.55:0/670186708 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8050070 con 0x556a4189cef0 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3b37fe640 1 -- 172.21.15.55:0/670186708 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc3cc032020 con 0x556a4189cef0 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3dd77a740 10 client.8007 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:01:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3dd77a740 10 client.8007 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3dd77a740 20 client.8007 populate_metadata read hostname 'smithi055' 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x556a4186fc50 0x556a4186eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3dd77a740 4 client.8007 mds_command: new command op to 7872 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3dd77a740 1 -- 172.21.15.55:0/670186708 --> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556a417e0630 con 0x556a4186fc50 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3d880b640 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x556a4186fc50 0x556a4186eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3b37fe640 10 client.8007 ms_handle_connect on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3d880b640 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x556a4186fc50 0x556a4186eb40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=213aa6ac1e3ed71a server_cookie=f0fb1d4a28971eb6 in_seq=0 out_seq=0 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3b37fe640 1 -- 172.21.15.55:0/670186708 <== mds.0 v2:172.21.15.55:6835/2841450668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x556a417e0630 con 0x556a4186fc50 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3b37fe640 10 client.8007 handle_command_reply: tid=0 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3dd77a740 1 client.8007 shutdown 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3dd77a740 1 -- 172.21.15.55:0/670186708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cef0 msgr2=0x556a4186e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.029+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cef0 0x556a4186e600 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc015040 tx=0x7fc3cc001250 comp rx=0 tx=0).stop 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3dd77a740 1 -- 172.21.15.55:0/670186708 shutdown_connections 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a4189cef0 0x556a4186e600 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a4189cb10 0x556a41872f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x556a4186fc50 0x556a4186eb40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3dd77a740 1 --2- 172.21.15.55:0/670186708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556a41893be0 0x556a41870850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3b37fe640 0 client.8007 ms_handle_reset on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3dd77a740 1 -- 172.21.15.55:0/670186708 >> 172.21.15.55:0/670186708 conn(0x556a4186f770 msgr2=0x556a418b9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3dd77a740 1 -- 172.21.15.55:0/670186708 shutdown_connections 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3dd77a740 1 -- 172.21.15.55:0/670186708 wait complete. 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3dd77a740 20 client.8007 trim_cache size 0 max 16384 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi055.stdout: "9447b11f-41d7-444b-968b-26d4133be936": { 2024-04-25T09:01:05.026 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir", 2024-04-25T09:01:05.026 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "9447b11f-41d7-444b-968b-26d4133be936", 2024-04-25T09:01:05.026 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-25T09:01:05.026 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:05.026 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:05.026 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 -- 172.21.15.55:0/3619196002 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc3b806b4d0 msgr2=0x7fc3b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc3b806b4d0 0x7fc3b806d990 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8034000 tx=0x7fc3c802e000 comp rx=0 tx=0).stop 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 -- 172.21.15.55:0/3619196002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3d40cf0e0 msgr2=0x7fc3d41503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3d40cf0e0 0x7fc3d41503b0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000c4a0 tx=0x7fc3c000c960 comp rx=0 tx=0).stop 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 -- 172.21.15.55:0/3619196002 shutdown_connections 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc3b806b4d0 0x7fc3b806d990 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d4144e70 0x7fc3d41508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3d40cf0e0 0x7fc3d41503b0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 --2- 172.21.15.55:0/3619196002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d406d7a0 0x7fc3d4142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 -- 172.21.15.55:0/3619196002 >> 172.21.15.55:0/3619196002 conn(0x7fc3d406aba0 msgr2=0x7fc3d415c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 -- 172.21.15.55:0/3619196002 shutdown_connections 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:05.030+0000 7fc3daa6f640 1 -- 172.21.15.55:0/3619196002 wait complete. 2024-04-25T09:01:05.031 INFO:tasks.cephfs.filesystem:scrub status for tag:9447b11f-41d7-444b-968b-26d4133be936 - {'path': '/dir', 'tag': '9447b11f-41d7-444b-968b-26d4133be936', 'options': 'recursive,repair'} 2024-04-25T09:01:10.665 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:10.668 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:35.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:35.032 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:01:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.160+0000 7f7e109b6640 1 Processor -- start 2024-04-25T09:01:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.160+0000 7f7e109b6640 1 -- start start 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.161+0000 7f7e109b6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7e0c15b7b0 0x7f7e0c0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.161+0000 7f7e109b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e0c0cf760 0x7f7e0c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.161+0000 7f7e109b6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c15f000 con 0x7f7e0c15e110 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.161+0000 7f7e109b6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0c0ced00 con 0x7f7e0c0cf760 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.161+0000 7f7e109b6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0c0ce330 con 0x7f7e0c15b7b0 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.162+0000 7f7e09d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e0c0cf760 0x7f7e0c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.162+0000 7f7e09d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e0c0cf760 0x7f7e0c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40324/0 (socket says 172.21.15.55:40324) 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.162+0000 7f7e09d9b640 1 -- 172.21.15.55:0/7211019 learned_addr learned my addr 172.21.15.55:0/7211019 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.162+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/7211019 >> v2:172.21.15.167:3300/0 conn(0x7f7e0c15b7b0 0x7f7e0c0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.162+0000 7f7e09d9b640 1 -- 172.21.15.55:0/7211019 >> v2:172.21.15.167:3300/0 conn(0x7f7e0c15b7b0 msgr2=0x7f7e0c0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.162+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/7211019 >> v2:172.21.15.167:3300/0 conn(0x7f7e0c15b7b0 0x7f7e0c0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.162+0000 7f7e09d9b640 1 -- 172.21.15.55:0/7211019 >> v1:172.21.15.167:6789/0 conn(0x7f7e0c15e110 legacy=0x7f7e0c15e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.162+0000 7f7e09d9b640 1 -- 172.21.15.55:0/7211019 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c15ed20 con 0x7f7e0c0cf760 2024-04-25T09:01:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.163+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/7211019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c0cf760 0x7f7e0c0cfbf0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009870 tx=0x7f7df402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75d7be99771bb65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.163+0000 7f7e0959a640 1 -- 172.21.15.55:0/7211019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4037070 con 0x7f7e0c0cf760 2024-04-25T09:01:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.163+0000 7f7e0959a640 1 -- 172.21.15.55:0/7211019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df4032440 con 0x7f7e0c0cf760 2024-04-25T09:01:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.163+0000 7f7e0959a640 1 -- 172.21.15.55:0/7211019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4032810 con 0x7f7e0c0cf760 2024-04-25T09:01:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.163+0000 7f7e109b6640 1 -- 172.21.15.55:0/7211019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c0cf760 msgr2=0x7f7e0c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.163+0000 7f7e109b6640 1 --2- 172.21.15.55:0/7211019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c0cf760 0x7f7e0c0cfbf0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009870 tx=0x7f7df402a270 comp rx=0 tx=0).stop 2024-04-25T09:01:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.163+0000 7f7e109b6640 1 -- 172.21.15.55:0/7211019 shutdown_connections 2024-04-25T09:01:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.163+0000 7f7e109b6640 1 --2- 172.21.15.55:0/7211019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c0cf760 0x7f7e0c0cfbf0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.163+0000 7f7e109b6640 1 --2- 172.21.15.55:0/7211019 >> v2:172.21.15.167:3300/0 conn(0x7f7e0c15b7b0 0x7f7e0c0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.164+0000 7f7e109b6640 1 -- 172.21.15.55:0/7211019 >> 172.21.15.55:0/7211019 conn(0x7f7e0c06f4a0 msgr2=0x7f7e0c06f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.164+0000 7f7e109b6640 1 -- 172.21.15.55:0/7211019 shutdown_connections 2024-04-25T09:01:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.164+0000 7f7e109b6640 1 -- 172.21.15.55:0/7211019 wait complete. 2024-04-25T09:01:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.165+0000 7f7e109b6640 1 Processor -- start 2024-04-25T09:01:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.165+0000 7f7e109b6640 1 -- start start 2024-04-25T09:01:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e109b6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0c0cf760 0x7f7e0c0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e109b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c15b7b0 0x7f7e0c14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e109b6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e0c15e110 0x7f7e0c0b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e109b6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c1619f0 con 0x7f7e0c15b7b0 2024-04-25T09:01:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e109b6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0cdfc0 con 0x7f7e0c15e110 2024-04-25T09:01:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e109b6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0cc080 con 0x7f7e0c0cf760 2024-04-25T09:01:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e09d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c15b7b0 0x7f7e0c14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e09d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c15b7b0 0x7f7e0c14bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40332/0 (socket says 172.21.15.55:40332) 2024-04-25T09:01:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e09d9b640 1 -- 172.21.15.55:0/1768750989 learned_addr learned my addr 172.21.15.55:0/1768750989 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0c0cf760 0x7f7e0c0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e09d9b640 1 -- 172.21.15.55:0/1768750989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0c0cf760 msgr2=0x7f7e0c0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e0ad9d640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e0c15e110 0x7f7e0c0b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0c0cf760 0x7f7e0c0b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e09d9b640 1 -- 172.21.15.55:0/1768750989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e0c15e110 msgr2=0x7f7e0c0b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e0c15e110 0x7f7e0c0b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e09d9b640 1 -- 172.21.15.55:0/1768750989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0b4c60 con 0x7f7e0c15b7b0 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e0ad9d640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e0c15e110 0x7f7e0c0b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.166+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c15b7b0 0x7f7e0c14bca0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009870 tx=0x7f7df40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.167+0000 7f7e02ffd640 1 -- 172.21.15.55:0/1768750989 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4037040 con 0x7f7e0c15b7b0 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.167+0000 7f7e02ffd640 1 -- 172.21.15.55:0/1768750989 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df4004230 con 0x7f7e0c15b7b0 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.167+0000 7f7e109b6640 1 -- 172.21.15.55:0/1768750989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c0b4f40 con 0x7f7e0c15b7b0 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.167+0000 7f7e02ffd640 1 -- 172.21.15.55:0/1768750989 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4003610 con 0x7f7e0c15b7b0 2024-04-25T09:01:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.167+0000 7f7e109b6640 1 -- 172.21.15.55:0/1768750989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c0b5500 con 0x7f7e0c15b7b0 2024-04-25T09:01:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.168+0000 7f7e02ffd640 1 -- 172.21.15.55:0/1768750989 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7df40037b0 con 0x7f7e0c15b7b0 2024-04-25T09:01:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.169+0000 7f7e02ffd640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 0x7f7dec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.169+0000 7f7e02ffd640 1 -- 172.21.15.55:0/1768750989 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f7df40ab1b0 con 0x7f7e0c15b7b0 2024-04-25T09:01:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.169+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 0x7f7dec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.169+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 0x7f7dec06d990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7e04006fd0 tx=0x7f7e04008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.170+0000 7f7e1378b740 1 Processor -- start 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.170+0000 7f7e1378b740 1 -- start start 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3dac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3dac860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3d7c770 0x5597f3d7ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e1378b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597f3ce5da0 con 0x5597f3da9b10 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e1378b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597f3c8eb80 con 0x5597f3da9ef0 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e1378b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597f3ce1e40 con 0x5597f3d7c770 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e0a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3dac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e0a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3dac320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40340/0 (socket says 172.21.15.55:40340) 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e0a59c640 1 -- 172.21.15.55:0/2326576281 learned_addr learned my addr 172.21.15.55:0/2326576281 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/2326576281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3dac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e0ad9d640 1 --2- 172.21.15.55:0/2326576281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3d7c770 0x5597f3d7ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e0a59c640 1 -- 172.21.15.55:0/2326576281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3d7c770 msgr2=0x5597f3d7ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/2326576281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3d7c770 0x5597f3d7ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e0a59c640 1 -- 172.21.15.55:0/2326576281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 msgr2=0x5597f3dac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/2326576281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3dac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e0a59c640 1 -- 172.21.15.55:0/2326576281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597f3c98f10 con 0x5597f3da9b10 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/2326576281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3dac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.171+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/2326576281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3dac320 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400e8f0 tx=0x7f7e04011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9cb2f7c8e16736 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7debfff640 1 -- 172.21.15.55:0/2326576281 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04025070 con 0x5597f3da9b10 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7debfff640 1 -- 172.21.15.55:0/2326576281 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04015640 con 0x5597f3da9b10 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7debfff640 1 -- 172.21.15.55:0/2326576281 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400f040 con 0x5597f3da9b10 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7e1378b740 1 -- 172.21.15.55:0/2326576281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 msgr2=0x5597f3dac320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7e1378b740 1 --2- 172.21.15.55:0/2326576281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3dac320 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400e8f0 tx=0x7f7e04011000 comp rx=0 tx=0).stop 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7e1378b740 1 -- 172.21.15.55:0/2326576281 shutdown_connections 2024-04-25T09:01:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7e1378b740 1 --2- 172.21.15.55:0/2326576281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3d7c770 0x5597f3d7ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7e1378b740 1 --2- 172.21.15.55:0/2326576281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3dac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7e1378b740 1 --2- 172.21.15.55:0/2326576281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3dac320 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7e1378b740 1 -- 172.21.15.55:0/2326576281 >> 172.21.15.55:0/2326576281 conn(0x5597f3d7e9e0 msgr2=0x5597f3dc7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7e1378b740 1 -- 172.21.15.55:0/2326576281 shutdown_connections 2024-04-25T09:01:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.172+0000 7f7e1378b740 1 -- 172.21.15.55:0/2326576281 wait complete. 2024-04-25T09:01:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.173+0000 7f7e1378b740 1 -- start start 2024-04-25T09:01:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.173+0000 7f7e1378b740 1 Processor -- start 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3da9b10 0x5597f3dc9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9ef0 0x5597f3dc8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3dc9ac0 0x5597f3dc8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e1378b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597f3d81b90 con 0x5597f3da9ef0 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e1378b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597f3c844b0 con 0x5597f3dc9ac0 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e1378b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597f3d81e70 con 0x5597f3da9b10 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e1378b740 10 client.0 _ll_register_callbacks cb 0x5597f3cc4180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e09d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9ef0 0x5597f3dc8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e09d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9ef0 0x5597f3dc8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40344/0 (socket says 172.21.15.55:40344) 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e09d9b640 1 -- 172.21.15.55:0/176624808 learned_addr learned my addr 172.21.15.55:0/176624808 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e0ad9d640 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3dc9ac0 0x5597f3dc8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3da9b10 0x5597f3dc9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e09d9b640 1 -- 172.21.15.55:0/176624808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3da9b10 msgr2=0x5597f3dc9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.174+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3da9b10 0x5597f3dc9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e09d9b640 1 -- 172.21.15.55:0/176624808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3dc9ac0 msgr2=0x5597f3dc8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3dc9ac0 0x5597f3dc8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e09d9b640 1 -- 172.21.15.55:0/176624808 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597f3ac47d0 con 0x5597f3da9ef0 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9ef0 0x5597f3dc8450 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009630 tx=0x7f7df407a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adffddbc3a90e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7de97fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7de97fa640 1 -- 172.21.15.55:0/176624808 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4079cb0 con 0x5597f3da9ef0 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7de97fa640 1 -- 172.21.15.55:0/176624808 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f7df4081b60 con 0x5597f3da9ef0 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e1378b740 1 -- 172.21.15.55:0/176624808 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e04015640 con 0x5597f3da9ef0 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7de97fa640 1 -- 172.21.15.55:0/176624808 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7df4081ff0 con 0x5597f3da9ef0 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e1378b740 10 client.8019 fetch_fsmap learned FSMap version 64 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e1378b740 1 -- 172.21.15.55:0/176624808 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x5597f39fa3f0 con 0x5597f3da9ef0 2024-04-25T09:01:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7de97fa640 1 -- 172.21.15.55:0/176624808 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04015640 con 0x5597f3da9ef0 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7de97fa640 1 -- 172.21.15.55:0/176624808 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7df404e060 con 0x5597f3da9ef0 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e1378b740 10 client.8019 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e1378b740 10 client.8019 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e1378b740 20 client.8019 populate_metadata read hostname 'smithi055' 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e1378b740 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x5597f3dc2d10 0x5597f3dc3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e1378b740 4 client.8019 mds_command: new command op to 7872 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.175+0000 7f7e1378b740 1 -- 172.21.15.55:0/176624808 --> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597f3cf32e0 con 0x5597f3dc2d10 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.176+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x5597f3dc2d10 0x5597f3dc3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.176+0000 7f7de97fa640 10 client.8019 ms_handle_connect on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.176+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x5597f3dc2d10 0x5597f3dc3120 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=565f7e08d51a68cc server_cookie=7677e4cb18bdc571 in_seq=0 out_seq=0 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.176+0000 7f7de97fa640 1 -- 172.21.15.55:0/176624808 <== mds.0 v2:172.21.15.55:6835/2841450668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5597f3cf32e0 con 0x5597f3dc2d10 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.176+0000 7f7de97fa640 10 client.8019 handle_command_reply: tid=0 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.176+0000 7f7e1378b740 1 client.8019 shutdown 2024-04-25T09:01:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7e1378b740 1 -- 172.21.15.55:0/176624808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9ef0 msgr2=0x5597f3dc8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7e1378b740 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9ef0 0x5597f3dc8450 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009630 tx=0x7f7df407a090 comp rx=0 tx=0).stop 2024-04-25T09:01:35.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7e1378b740 1 -- 172.21.15.55:0/176624808 shutdown_connections 2024-04-25T09:01:35.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7e1378b740 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3dc9ac0 0x5597f3dc8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7e1378b740 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9ef0 0x5597f3dc8450 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7e1378b740 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x5597f3dc2d10 0x5597f3dc3120 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7e1378b740 1 --2- 172.21.15.55:0/176624808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3da9b10 0x5597f3dc9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7e1378b740 1 -- 172.21.15.55:0/176624808 >> 172.21.15.55:0/176624808 conn(0x5597f3d7c770 msgr2=0x5597f3d7b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7de97fa640 0 client.8019 ms_handle_reset on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:35.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7e1378b740 1 -- 172.21.15.55:0/176624808 shutdown_connections 2024-04-25T09:01:35.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7e1378b740 1 -- 172.21.15.55:0/176624808 wait complete. 2024-04-25T09:01:35.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.177+0000 7f7e1378b740 20 client.8019 trim_cache size 0 max 16384 2024-04-25T09:01:35.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.193+0000 7f7e1378b740 1 Processor -- start 2024-04-25T09:01:35.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.193+0000 7f7e1378b740 1 -- start start 2024-04-25T09:01:35.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.193+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3d9e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.193+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3d7b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.193+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3dc9ac0 0x5597f3d7bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.193+0000 7f7e1378b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c200140 con 0x5597f3da9b10 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.193+0000 7f7e1378b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c1ff300 con 0x5597f3da9ef0 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.193+0000 7f7e1378b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0b2090 con 0x5597f3dc9ac0 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.193+0000 7f7e0a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3d9e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.193+0000 7f7e0a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3d9e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40354/0 (socket says 172.21.15.55:40354) 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.193+0000 7f7e0a59c640 1 -- 172.21.15.55:0/286918203 learned_addr learned my addr 172.21.15.55:0/286918203 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.194+0000 7f7e0ad9d640 1 --2- 172.21.15.55:0/286918203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3dc9ac0 0x5597f3d7bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.194+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/286918203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3d7b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.194+0000 7f7e0a59c640 1 -- 172.21.15.55:0/286918203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3dc9ac0 msgr2=0x5597f3d7bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.194+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/286918203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3dc9ac0 0x5597f3d7bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.194+0000 7f7e0a59c640 1 -- 172.21.15.55:0/286918203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 msgr2=0x5597f3d7b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.194+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/286918203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3d7b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.194+0000 7f7e0a59c640 1 -- 172.21.15.55:0/286918203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597f39ba0f0 con 0x5597f3da9b10 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.194+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/286918203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3d9e3b0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x5597f3d84070 tx=0x7f7e0401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871b5a418d19f190 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.194+0000 7f7deb7fe640 1 -- 172.21.15.55:0/286918203 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04025040 con 0x5597f3da9b10 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.194+0000 7f7deb7fe640 1 -- 172.21.15.55:0/286918203 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04015680 con 0x5597f3da9b10 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.194+0000 7f7deb7fe640 1 -- 172.21.15.55:0/286918203 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04015c50 con 0x5597f3da9b10 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.195+0000 7f7e1378b740 1 -- 172.21.15.55:0/286918203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 msgr2=0x5597f3d9e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.195+0000 7f7e1378b740 1 --2- 172.21.15.55:0/286918203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3d9e3b0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x5597f3d84070 tx=0x7f7e0401d000 comp rx=0 tx=0).stop 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.195+0000 7f7e1378b740 1 -- 172.21.15.55:0/286918203 shutdown_connections 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.195+0000 7f7e1378b740 1 --2- 172.21.15.55:0/286918203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3dc9ac0 0x5597f3d7bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.195+0000 7f7e1378b740 1 --2- 172.21.15.55:0/286918203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3d7b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.195+0000 7f7e1378b740 1 --2- 172.21.15.55:0/286918203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3d9e3b0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.195+0000 7f7e1378b740 1 -- 172.21.15.55:0/286918203 >> 172.21.15.55:0/286918203 conn(0x5597f3d7c770 msgr2=0x5597f3dc8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.195+0000 7f7e1378b740 1 -- 172.21.15.55:0/286918203 shutdown_connections 2024-04-25T09:01:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.195+0000 7f7e1378b740 1 -- 172.21.15.55:0/286918203 wait complete. 2024-04-25T09:01:35.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.195+0000 7f7e1378b740 1 -- start start 2024-04-25T09:01:35.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.195+0000 7f7e1378b740 1 Processor -- start 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.196+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3e31720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.196+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3d7b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.196+0000 7f7e1378b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3dc9ac0 0x5597f3d7bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.196+0000 7f7e1378b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597f3d7cff0 con 0x5597f3da9b10 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.196+0000 7f7e1378b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0c9200 con 0x5597f3da9ef0 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.196+0000 7f7e1378b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597f3de9cf0 con 0x5597f3dc9ac0 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.196+0000 7f7e1378b740 10 client.0 _ll_register_callbacks cb 0x7f7e04009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.196+0000 7f7e0a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3e31720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.196+0000 7f7e0a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3e31720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40362/0 (socket says 172.21.15.55:40362) 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.196+0000 7f7e0a59c640 1 -- 172.21.15.55:0/855913462 learned_addr learned my addr 172.21.15.55:0/855913462 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.196+0000 7f7e0ad9d640 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3dc9ac0 0x5597f3d7bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3d7b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e0a59c640 1 -- 172.21.15.55:0/855913462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3dc9ac0 msgr2=0x5597f3d7bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3dc9ac0 0x5597f3d7bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e0a59c640 1 -- 172.21.15.55:0/855913462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 msgr2=0x5597f3d7b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3d7b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e0a59c640 1 -- 172.21.15.55:0/855913462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597f3d9fbb0 con 0x5597f3da9b10 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e0ad9d640 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3dc9ac0 0x5597f3d7bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e0a59c640 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3e31720 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009210 tx=0x7f7e04004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc11f9602fe38b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7de97fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7de97fa640 1 -- 172.21.15.55:0/855913462 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04033070 con 0x5597f3da9b10 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7de97fa640 1 -- 172.21.15.55:0/855913462 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f7e04015c50 con 0x5597f3da9b10 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e1378b740 1 -- 172.21.15.55:0/855913462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e04015680 con 0x5597f3da9b10 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7de97fa640 1 -- 172.21.15.55:0/855913462 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e0403f050 con 0x5597f3da9b10 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e1378b740 10 client.8025 fetch_fsmap learned FSMap version 64 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e1378b740 1 -- 172.21.15.55:0/855913462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x5597f3dc77a0 con 0x5597f3da9b10 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7de97fa640 1 -- 172.21.15.55:0/855913462 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04015680 con 0x5597f3da9b10 2024-04-25T09:01:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7de97fa640 1 -- 172.21.15.55:0/855913462 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7e04042020 con 0x5597f3da9b10 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e1378b740 10 client.8025 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e1378b740 10 client.8025 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e1378b740 20 client.8025 populate_metadata read hostname 'smithi055' 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e1378b740 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x5597f3d839c0 0x5597f3dd5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e1378b740 4 client.8025 mds_command: new command op to 7872 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.197+0000 7f7e1378b740 1 -- 172.21.15.55:0/855913462 --> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5597f3ced630 con 0x5597f3d839c0 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x5597f3d839c0 0x5597f3dd5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e09d9b640 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x5597f3d839c0 0x5597f3dd5c70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=639c84c0632e4deb server_cookie=b1c56f29eaf763ae in_seq=0 out_seq=0 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7de97fa640 10 client.8025 ms_handle_connect on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7de97fa640 1 -- 172.21.15.55:0/855913462 <== mds.0 v2:172.21.15.55:6835/2841450668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5597f3ced630 con 0x5597f3d839c0 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7de97fa640 10 client.8025 handle_command_reply: tid=0 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 1 client.8025 shutdown 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 1 -- 172.21.15.55:0/855913462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 msgr2=0x5597f3e31720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3e31720 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009210 tx=0x7f7e04004730 comp rx=0 tx=0).stop 2024-04-25T09:01:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 1 -- 172.21.15.55:0/855913462 shutdown_connections 2024-04-25T09:01:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x5597f3d839c0 0x5597f3dd5c70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5597f3dc9ac0 0x5597f3d7bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597f3da9ef0 0x5597f3d7b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 1 --2- 172.21.15.55:0/855913462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5597f3da9b10 0x5597f3e31720 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7de97fa640 0 client.8025 ms_handle_reset on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 1 -- 172.21.15.55:0/855913462 >> 172.21.15.55:0/855913462 conn(0x5597f3d7c770 msgr2=0x5597f3d77b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 1 -- 172.21.15.55:0/855913462 shutdown_connections 2024-04-25T09:01:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 1 -- 172.21.15.55:0/855913462 wait complete. 2024-04-25T09:01:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.198+0000 7f7e1378b740 20 client.8025 trim_cache size 0 max 16384 2024-04-25T09:01:35.193 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:01:35.194 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-25T09:01:35.194 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-25T09:01:35.194 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 -- 172.21.15.55:0/1768750989 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 msgr2=0x7f7dec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 0x7f7dec06d990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7e04006fd0 tx=0x7f7e04008040 comp rx=0 tx=0).stop 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 -- 172.21.15.55:0/1768750989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c15b7b0 msgr2=0x7f7e0c14bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c15b7b0 0x7f7e0c14bca0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009870 tx=0x7f7df40046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 -- 172.21.15.55:0/1768750989 shutdown_connections 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 0x7f7dec06d990 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e0c15e110 0x7f7e0c0b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c15b7b0 0x7f7e0c14bca0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 --2- 172.21.15.55:0/1768750989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0c0cf760 0x7f7e0c0b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 -- 172.21.15.55:0/1768750989 >> 172.21.15.55:0/1768750989 conn(0x7f7e0c06f4a0 msgr2=0x7f7e0c06caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 -- 172.21.15.55:0/1768750989 shutdown_connections 2024-04-25T09:01:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.199+0000 7f7e109b6640 1 -- 172.21.15.55:0/1768750989 wait complete. 2024-04-25T09:01:35.199 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:01:35.199 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:35.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.312+0000 7ff0aa01f640 1 Processor -- start 2024-04-25T09:01:35.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.312+0000 7ff0aa01f640 1 -- start start 2024-04-25T09:01:35.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0aa01f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff0a40b5b60 0x7ff0a41687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0aa01f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a415e0c0 con 0x7ff0a415dce0 2024-04-25T09:01:35.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0aa01f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a40d2510 con 0x7ff0a40d35b0 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0aa01f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a40b7b10 con 0x7ff0a40b5b60 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff0a415dce0 0x7ff0a40d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40708/0 (socket says 172.21.15.55:40708) 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a37fe640 1 -- 172.21.15.55:0/1496051964 learned_addr learned my addr 172.21.15.55:0/1496051964 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a3fff640 1 --2- 172.21.15.55:0/1496051964 >> v2:172.21.15.167:3300/0 conn(0x7ff0a40b5b60 0x7ff0a41687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783428964 0 0) 0x7ff0a415e0c0 con 0x7ff0a415dce0 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff08c003520 con 0x7ff0a415dce0 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2278462633 0 0) 0x7ff08c003520 con 0x7ff0a415dce0 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 >> v2:172.21.15.167:3300/0 conn(0x7ff0a40b5b60 msgr2=0x7ff0a41687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 --2- 172.21.15.55:0/1496051964 >> v2:172.21.15.167:3300/0 conn(0x7ff0a40b5b60 0x7ff0a41687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 >> v1:172.21.15.167:6789/0 conn(0x7ff0a40d35b0 legacy=0x7ff0a40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a40d27f0 con 0x7ff0a415dce0 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7ff098001670 con 0x7ff0a415dce0 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 >> v1:172.21.15.55:6789/0 conn(0x7ff0a415dce0 legacy=0x7ff0a40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 --2- 172.21.15.55:0/1496051964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff08c0039b0 0x7ff08c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 --2- 172.21.15.55:0/1496051964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff08c004800 0x7ff08c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 --2- 172.21.15.55:0/1496051964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff08c0051c0 0x7ff08c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40b7b10 con 0x7ff08c0051c0 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c00c060 con 0x7ff08c0039b0 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.313+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c00c260 con 0x7ff08c004800 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.314+0000 7ff0a3fff640 1 --2- 172.21.15.55:0/1496051964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff08c0051c0 0x7ff08c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.314+0000 7ff0a37fe640 1 --2- 172.21.15.55:0/1496051964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff08c0039b0 0x7ff08c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.314+0000 7ff0a2ffd640 1 --2- 172.21.15.55:0/1496051964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff08c004800 0x7ff08c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.314+0000 7ff0a3fff640 1 -- 172.21.15.55:0/1496051964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff08c004800 msgr2=0x7ff08c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.314+0000 7ff0a3fff640 1 --2- 172.21.15.55:0/1496051964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff08c004800 0x7ff08c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.314+0000 7ff0a3fff640 1 -- 172.21.15.55:0/1496051964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff08c0039b0 msgr2=0x7ff08c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.314+0000 7ff0a3fff640 1 --2- 172.21.15.55:0/1496051964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff08c0039b0 0x7ff08c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.314+0000 7ff0a3fff640 1 -- 172.21.15.55:0/1496051964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c003520 con 0x7ff08c0051c0 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.314+0000 7ff0a3fff640 1 -- 172.21.15.55:0/1496051964 reap_dead start 2024-04-25T09:01:35.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.315+0000 7ff0a3fff640 1 --2- 172.21.15.55:0/1496051964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff08c0051c0 0x7ff08c00b9c0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009fc0 tx=0x7ff08c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e674211c0a8c074 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.315+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c035020 con 0x7ff08c0051c0 2024-04-25T09:01:35.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.315+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c003bd0 con 0x7ff08c0051c0 2024-04-25T09:01:35.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.315+0000 7ff0a27fc640 1 -- 172.21.15.55:0/1496051964 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c009c10 con 0x7ff08c0051c0 2024-04-25T09:01:35.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.315+0000 7ff0aa01f640 1 -- 172.21.15.55:0/1496051964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff08c0051c0 msgr2=0x7ff08c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.315+0000 7ff0aa01f640 1 --2- 172.21.15.55:0/1496051964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff08c0051c0 0x7ff08c00b9c0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009fc0 tx=0x7ff08c005830 comp rx=0 tx=0).stop 2024-04-25T09:01:35.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.315+0000 7ff0aa01f640 1 -- 172.21.15.55:0/1496051964 shutdown_connections 2024-04-25T09:01:35.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.315+0000 7ff0aa01f640 1 --2- 172.21.15.55:0/1496051964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff08c0051c0 0x7ff08c00b9c0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.315+0000 7ff0aa01f640 1 -- 172.21.15.55:0/1496051964 >> 172.21.15.55:0/1496051964 conn(0x7ff0a4072900 msgr2=0x7ff0a40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.315+0000 7ff0aa01f640 1 -- 172.21.15.55:0/1496051964 shutdown_connections 2024-04-25T09:01:35.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.315+0000 7ff0aa01f640 1 -- 172.21.15.55:0/1496051964 wait complete. 2024-04-25T09:01:35.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.316+0000 7ff0aa01f640 1 Processor -- start 2024-04-25T09:01:35.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.317+0000 7ff0aa01f640 1 -- start start 2024-04-25T09:01:35.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.317+0000 7ff0aa01f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff08c0051c0 0x7ff0a41562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.317+0000 7ff0aa01f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0a415e2b0 0x7ff0a41f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.317+0000 7ff0aa01f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a41f6fb0 0x7ff0a40cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.317+0000 7ff0aa01f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40d3090 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.317+0000 7ff0aa01f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40d2db0 con 0x7ff0a415e2b0 2024-04-25T09:01:35.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.317+0000 7ff0aa01f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40b9820 con 0x7ff08c0051c0 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.317+0000 7ff0a3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a41f6fb0 0x7ff0a40cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.317+0000 7ff0a3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a41f6fb0 0x7ff0a40cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40386/0 (socket says 172.21.15.55:40386) 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.317+0000 7ff0a3fff640 1 -- 172.21.15.55:0/3699425050 learned_addr learned my addr 172.21.15.55:0/3699425050 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff0a37fe640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff08c0051c0 0x7ff0a41562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff0a2ffd640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0a415e2b0 0x7ff0a41f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff0a3fff640 1 -- 172.21.15.55:0/3699425050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff08c0051c0 msgr2=0x7ff0a41562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff0a3fff640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff08c0051c0 0x7ff0a41562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff0a3fff640 1 -- 172.21.15.55:0/3699425050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0a415e2b0 msgr2=0x7ff0a41f6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff0a3fff640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0a415e2b0 0x7ff0a41f6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff0a3fff640 1 -- 172.21.15.55:0/3699425050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a4161280 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff0a37fe640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff08c0051c0 0x7ff0a41562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff0a3fff640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a41f6fb0 0x7ff0a40cbdd0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00e230 tx=0x7ff09c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff08bfff640 1 -- 172.21.15.55:0/3699425050 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c035030 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff08bfff640 1 -- 172.21.15.55:0/3699425050 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c043070 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff0aa01f640 1 -- 172.21.15.55:0/3699425050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a4160700 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff08bfff640 1 -- 172.21.15.55:0/3699425050 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c02d070 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.318+0000 7ff0aa01f640 1 -- 172.21.15.55:0/3699425050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a4160cc0 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.319+0000 7ff0aa01f640 1 -- 172.21.15.55:0/3699425050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a40749b0 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.320+0000 7ff08bfff640 1 -- 172.21.15.55:0/3699425050 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff09c005d10 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.320+0000 7ff08bfff640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff09006b500 0x7ff09006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.320+0000 7ff0a37fe640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff09006b500 0x7ff09006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.320+0000 7ff08bfff640 1 -- 172.21.15.55:0/3699425050 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7ff09c0ab050 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.321+0000 7ff0a37fe640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff09006b500 0x7ff09006d9c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff098007cb0 tx=0x7ff098009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.325+0000 7ff08bfff640 1 -- 172.21.15.55:0/3699425050 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff09c079f20 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.546+0000 7ff0aa01f640 1 -- 172.21.15.55:0/3699425050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0a415d360 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.547+0000 7ff08bfff640 1 -- 172.21.15.55:0/3699425050 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4944 (secure 0 0 0) 0x7ff09c079820 con 0x7ff0a41f6fb0 2024-04-25T09:01:35.536 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:35.536 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T09:01:01.173411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7872":{"gid":7872,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/2841450668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2841450668},{"type":"v1","addr":"172.21.15.55:6837","nonce":2841450668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:01:35.537 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 64 2024-04-25T09:01:35.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 -- 172.21.15.55:0/3699425050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff09006b500 msgr2=0x7ff09006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff09006b500 0x7ff09006d9c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff098007cb0 tx=0x7ff098009040 comp rx=0 tx=0).stop 2024-04-25T09:01:35.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 -- 172.21.15.55:0/3699425050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a41f6fb0 msgr2=0x7ff0a40cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a41f6fb0 0x7ff0a40cbdd0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00e230 tx=0x7ff09c009750 comp rx=0 tx=0).stop 2024-04-25T09:01:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 -- 172.21.15.55:0/3699425050 shutdown_connections 2024-04-25T09:01:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff09006b500 0x7ff09006d9c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a41f6fb0 0x7ff0a40cbdd0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0a415e2b0 0x7ff0a41f6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 --2- 172.21.15.55:0/3699425050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff08c0051c0 0x7ff0a41562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 -- 172.21.15.55:0/3699425050 >> 172.21.15.55:0/3699425050 conn(0x7ff0a4072900 msgr2=0x7ff0a40b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 -- 172.21.15.55:0/3699425050 shutdown_connections 2024-04-25T09:01:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.549+0000 7ff0aa01f640 1 -- 172.21.15.55:0/3699425050 wait complete. 2024-04-25T09:01:35.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T09:01:35.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.664+0000 7f779ea6f640 1 Processor -- start 2024-04-25T09:01:35.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.664+0000 7f779ea6f640 1 -- start start 2024-04-25T09:01:35.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f779ea6f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f77980b2740 0x7f779815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f779ea6f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779806c150 con 0x7f77980d0490 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f779ea6f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779806c430 con 0x7f77980ce1a0 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f779ea6f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77980d2000 con 0x7f77980b2740 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f779c80b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f77980d0490 0x7f77980d0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40714/0 (socket says 172.21.15.55:40714) 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f779c80b640 1 -- 172.21.15.55:0/4170704061 learned_addr learned my addr 172.21.15.55:0/4170704061 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021608316 0 0) 0x7f779806c150 con 0x7f77980d0490 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f7797fff640 1 --2- 172.21.15.55:0/4170704061 >> v2:172.21.15.167:3300/0 conn(0x7f77980b2740 0x7f779815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7788003520 con 0x7f77980d0490 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2159988815 0 0) 0x7f7788003520 con 0x7f77980d0490 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 >> v2:172.21.15.167:3300/0 conn(0x7f77980b2740 msgr2=0x7f779815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 --2- 172.21.15.55:0/4170704061 >> v2:172.21.15.167:3300/0 conn(0x7f77980b2740 0x7f779815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 >> v1:172.21.15.167:6789/0 conn(0x7f77980ce1a0 legacy=0x7f77980ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779806c710 con 0x7f77980d0490 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f778c001670 con 0x7f77980d0490 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 >> v1:172.21.15.55:6789/0 conn(0x7f77980d0490 legacy=0x7f77980d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 --2- 172.21.15.55:0/4170704061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77880039b0 0x7f7788003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 --2- 172.21.15.55:0/4170704061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 0x7f7788004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 --2- 172.21.15.55:0/4170704061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77880051c0 0x7f778800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778800c130 con 0x7f7788004800 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778800c2e0 con 0x7f77880039b0 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.665+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778800c4e0 con 0x7f77880051c0 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.666+0000 7f7797fff640 1 --2- 172.21.15.55:0/4170704061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 0x7f7788004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.666+0000 7f779c80b640 1 --2- 172.21.15.55:0/4170704061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77880039b0 0x7f7788003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.666+0000 7f779d00c640 1 --2- 172.21.15.55:0/4170704061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77880051c0 0x7f778800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.666+0000 7f7797fff640 1 -- 172.21.15.55:0/4170704061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77880051c0 msgr2=0x7f778800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.666+0000 7f7797fff640 1 --2- 172.21.15.55:0/4170704061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77880051c0 0x7f778800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.666+0000 7f7797fff640 1 -- 172.21.15.55:0/4170704061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77880039b0 msgr2=0x7f7788003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.666+0000 7f7797fff640 1 --2- 172.21.15.55:0/4170704061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77880039b0 0x7f7788003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.666+0000 7f7797fff640 1 -- 172.21.15.55:0/4170704061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788003520 con 0x7f7788004800 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.666+0000 7f779d00c640 1 -- 172.21.15.55:0/4170704061 reap_dead start 2024-04-25T09:01:35.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.667+0000 7f7797fff640 1 --2- 172.21.15.55:0/4170704061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 0x7f7788004c80 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f7784009ac0 tx=0x7f7788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770ccb1df5a4d308 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.667+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784036070 con 0x7f7788004800 2024-04-25T09:01:35.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.667+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7784031400 con 0x7f7788004800 2024-04-25T09:01:35.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.667+0000 7f77977fe640 1 -- 172.21.15.55:0/4170704061 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784009690 con 0x7f7788004800 2024-04-25T09:01:35.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.667+0000 7f779ea6f640 1 -- 172.21.15.55:0/4170704061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 msgr2=0x7f7788004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.667+0000 7f779ea6f640 1 --2- 172.21.15.55:0/4170704061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 0x7f7788004c80 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f7784009ac0 tx=0x7f7788005830 comp rx=0 tx=0).stop 2024-04-25T09:01:35.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.667+0000 7f779ea6f640 1 -- 172.21.15.55:0/4170704061 shutdown_connections 2024-04-25T09:01:35.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.667+0000 7f779ea6f640 1 --2- 172.21.15.55:0/4170704061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 0x7f7788004c80 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.667+0000 7f779ea6f640 1 -- 172.21.15.55:0/4170704061 >> 172.21.15.55:0/4170704061 conn(0x7f77980b5660 msgr2=0x7f77980b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.667+0000 7f779ea6f640 1 -- 172.21.15.55:0/4170704061 shutdown_connections 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.667+0000 7f779ea6f640 1 -- 172.21.15.55:0/4170704061 wait complete. 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.669+0000 7f779ea6f640 1 Processor -- start 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.669+0000 7f779ea6f640 1 -- start start 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.669+0000 7f779ea6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 0x7f77980b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.669+0000 7f779ea6f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77980cd3b0 0x7f77981f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.669+0000 7f779ea6f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77980ac490 0x7f77980ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.669+0000 7f779ea6f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779815e020 con 0x7f7788004800 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.669+0000 7f779ea6f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779815ec90 con 0x7f77980cd3b0 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.669+0000 7f779ea6f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779815ee10 con 0x7f77980ac490 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779c80b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 0x7f77980b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779c80b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 0x7f77980b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40406/0 (socket says 172.21.15.55:40406) 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779c80b640 1 -- 172.21.15.55:0/983458787 learned_addr learned my addr 172.21.15.55:0/983458787 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779d00c640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77980ac490 0x7f77980ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f7797fff640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77980cd3b0 0x7f77981f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779c80b640 1 -- 172.21.15.55:0/983458787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77980ac490 msgr2=0x7f77980ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779c80b640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77980ac490 0x7f77980ac910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779c80b640 1 -- 172.21.15.55:0/983458787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77980cd3b0 msgr2=0x7f77981f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779c80b640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77980cd3b0 0x7f77981f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779c80b640 1 -- 172.21.15.55:0/983458787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77981f4860 con 0x7f7788004800 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779d00c640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77980ac490 0x7f77980ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f7797fff640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77980cd3b0 0x7f77981f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779c80b640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 0x7f77980b1f00 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f778c0072c0 tx=0x7f778c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f77957fa640 1 -- 172.21.15.55:0/983458787 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c00f960 con 0x7f7788004800 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f77957fa640 1 -- 172.21.15.55:0/983458787 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c018070 con 0x7f7788004800 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779ea6f640 1 -- 172.21.15.55:0/983458787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77980abb40 con 0x7f7788004800 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f77957fa640 1 -- 172.21.15.55:0/983458787 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c00fd40 con 0x7f7788004800 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.670+0000 7f779ea6f640 1 -- 172.21.15.55:0/983458787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77980aad80 con 0x7f7788004800 2024-04-25T09:01:35.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.672+0000 7f77957fa640 1 -- 172.21.15.55:0/983458787 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f778c01d460 con 0x7f7788004800 2024-04-25T09:01:35.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.672+0000 7f77957fa640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f777c06b500 0x7f777c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.672+0000 7f77957fa640 1 -- 172.21.15.55:0/983458787 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f778c08a390 con 0x7f7788004800 2024-04-25T09:01:35.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.672+0000 7f7797fff640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f777c06b500 0x7f777c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.673+0000 7f7797fff640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f777c06b500 0x7f777c06d9c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7784033000 tx=0x7f7784008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.673+0000 7f77a1772740 1 Processor -- start 2024-04-25T09:01:35.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.673+0000 7f77a1772740 1 -- start start 2024-04-25T09:01:35.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f77a1772740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614be590 0x561a614c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f77a1772740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614fac60 0x561a614be970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f77a1772740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614e9050 0x561a614e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f77a1772740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a61421c60 con 0x561a614e9050 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f77a1772740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a613c0d80 con 0x561a614be590 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f77a1772740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a6141dd00 con 0x561a614fac60 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f779d00c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614e9050 0x561a614e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f779d00c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614e9050 0x561a614e94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40422/0 (socket says 172.21.15.55:40422) 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f779d00c640 1 -- 172.21.15.55:0/3402995364 learned_addr learned my addr 172.21.15.55:0/3402995364 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f779d00c640 1 -- 172.21.15.55:0/3402995364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614fac60 msgr2=0x561a614be970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f779d00c640 1 --2- 172.21.15.55:0/3402995364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614fac60 0x561a614be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f779d00c640 1 -- 172.21.15.55:0/3402995364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614be590 msgr2=0x561a614c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f779d00c640 1 --2- 172.21.15.55:0/3402995364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614be590 0x561a614c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.674+0000 7f779d00c640 1 -- 172.21.15.55:0/3402995364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a612027c0 con 0x561a614e9050 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f779d00c640 1 --2- 172.21.15.55:0/3402995364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614e9050 0x561a614e94d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7798068780 tx=0x7f7790001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5f703896071c60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77827fc640 1 -- 172.21.15.55:0/3402995364 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779001a070 con 0x561a614e9050 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77827fc640 1 -- 172.21.15.55:0/3402995364 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790005070 con 0x561a614e9050 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77827fc640 1 -- 172.21.15.55:0/3402995364 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790005420 con 0x561a614e9050 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77a1772740 1 -- 172.21.15.55:0/3402995364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614e9050 msgr2=0x561a614e94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77a1772740 1 --2- 172.21.15.55:0/3402995364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614e9050 0x561a614e94d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7798068780 tx=0x7f7790001610 comp rx=0 tx=0).stop 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77a1772740 1 -- 172.21.15.55:0/3402995364 shutdown_connections 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77a1772740 1 --2- 172.21.15.55:0/3402995364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614e9050 0x561a614e94d0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77a1772740 1 --2- 172.21.15.55:0/3402995364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614fac60 0x561a614be970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77a1772740 1 --2- 172.21.15.55:0/3402995364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614be590 0x561a614c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77a1772740 1 -- 172.21.15.55:0/3402995364 >> 172.21.15.55:0/3402995364 conn(0x561a614866e0 msgr2=0x561a61504050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77a1772740 1 -- 172.21.15.55:0/3402995364 shutdown_connections 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.675+0000 7f77a1772740 1 -- 172.21.15.55:0/3402995364 wait complete. 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.676+0000 7f77a1772740 1 -- start start 2024-04-25T09:01:35.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.676+0000 7f77a1772740 1 Processor -- start 2024-04-25T09:01:35.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f77a1772740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a614e3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f77a1772740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614e9050 0x561a614e9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f77a1772740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614fac60 0x561a614fd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f77a1772740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a613be840 con 0x561a614be590 2024-04-25T09:01:35.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f77a1772740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a614e6ba0 con 0x561a614fac60 2024-04-25T09:01:35.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f77a1772740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a614fc620 con 0x561a614e9050 2024-04-25T09:01:35.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f779c80b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a614e3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f77a1772740 10 client.0 _ll_register_callbacks cb 0x561a613d8980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f779c80b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a614e3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40430/0 (socket says 172.21.15.55:40430) 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f779c80b640 1 -- 172.21.15.55:0/3020215641 learned_addr learned my addr 172.21.15.55:0/3020215641 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f7797fff640 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614e9050 0x561a614e9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f779d00c640 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614fac60 0x561a614fd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f779c80b640 1 -- 172.21.15.55:0/3020215641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614e9050 msgr2=0x561a614e9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f779c80b640 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614e9050 0x561a614e9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f779c80b640 1 -- 172.21.15.55:0/3020215641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614fac60 msgr2=0x561a614fd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f779c80b640 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614fac60 0x561a614fd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f779c80b640 1 -- 172.21.15.55:0/3020215641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a61262f50 con 0x561a614be590 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f7797fff640 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614e9050 0x561a614e9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.677+0000 7f779d00c640 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614fac60 0x561a614fd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f779c80b640 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a614e3d50 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f778c054ea0 tx=0x7f778c059140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c0fee53a3b8f47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77777fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77777fe640 1 -- 172.21.15.55:0/3020215641 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c061150 con 0x561a614be590 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77777fe640 1 -- 172.21.15.55:0/3020215641 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f778c060cc0 con 0x561a614be590 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77a1772740 1 -- 172.21.15.55:0/3020215641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7790005070 con 0x561a614be590 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77777fe640 1 -- 172.21.15.55:0/3020215641 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f778c060ec0 con 0x561a614be590 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77a1772740 10 client.8043 fetch_fsmap learned FSMap version 64 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77a1772740 1 -- 172.21.15.55:0/3020215641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x561a610f60b0 con 0x561a614be590 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77777fe640 1 -- 172.21.15.55:0/3020215641 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790005070 con 0x561a614be590 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77777fe640 1 -- 172.21.15.55:0/3020215641 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f778c057e90 con 0x561a614be590 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77a1772740 10 client.8043 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77a1772740 10 client.8043 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77a1772740 20 client.8043 populate_metadata read hostname 'smithi055' 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77a1772740 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x561a614fb2e0 0x561a614fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77a1772740 4 client.8043 mds_command: new command op to 7872 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f77a1772740 1 -- 172.21.15.55:0/3020215641 --> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a613e1e60 con 0x561a614fb2e0 2024-04-25T09:01:35.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.678+0000 7f7797fff640 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x561a614fb2e0 0x561a614fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77777fe640 10 client.8043 ms_handle_connect on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f7797fff640 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x561a614fb2e0 0x561a614fb6c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8081f1eea45f49cd server_cookie=74046ddfcd85f43 in_seq=0 out_seq=0 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77777fe640 1 -- 172.21.15.55:0/3020215641 <== mds.0 v2:172.21.15.55:6835/2841450668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561a613e1e60 con 0x561a614fb2e0 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77777fe640 10 client.8043 handle_command_reply: tid=0 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77a1772740 1 client.8043 shutdown 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77a1772740 1 -- 172.21.15.55:0/3020215641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 msgr2=0x561a614e3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77a1772740 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a614e3d50 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f778c054ea0 tx=0x7f778c059140 comp rx=0 tx=0).stop 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77a1772740 1 -- 172.21.15.55:0/3020215641 shutdown_connections 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77a1772740 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614fac60 0x561a614fd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77a1772740 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x561a614fb2e0 0x561a614fb6c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77a1772740 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614e9050 0x561a614e9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77a1772740 1 --2- 172.21.15.55:0/3020215641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a614e3d50 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77777fe640 0 client.8043 ms_handle_reset on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77a1772740 1 -- 172.21.15.55:0/3020215641 >> 172.21.15.55:0/3020215641 conn(0x561a614866e0 msgr2=0x561a614e6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77a1772740 1 -- 172.21.15.55:0/3020215641 shutdown_connections 2024-04-25T09:01:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.679+0000 7f77a1772740 1 -- 172.21.15.55:0/3020215641 wait complete. 2024-04-25T09:01:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.680+0000 7f77a1772740 20 client.8043 trim_cache size 0 max 16384 2024-04-25T09:01:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.691+0000 7f77a1772740 1 Processor -- start 2024-04-25T09:01:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.691+0000 7f77a1772740 1 -- start start 2024-04-25T09:01:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f77a1772740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614be590 0x561a614e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f77a1772740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614e9050 0x561a614fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f77a1772740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614fac60 0x561a614fd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f77a1772740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77981ff650 con 0x561a614fac60 2024-04-25T09:01:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f77a1772740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980cb6b0 con 0x561a614e9050 2024-04-25T09:01:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f77a1772740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77980cbcb0 con 0x561a614be590 2024-04-25T09:01:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f779d00c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614fac60 0x561a614fd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f779d00c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614fac60 0x561a614fd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40440/0 (socket says 172.21.15.55:40440) 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f779d00c640 1 -- 172.21.15.55:0/2683211758 learned_addr learned my addr 172.21.15.55:0/2683211758 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f779c80b640 1 --2- 172.21.15.55:0/2683211758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614be590 0x561a614e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f7797fff640 1 --2- 172.21.15.55:0/2683211758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614e9050 0x561a614fc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f779d00c640 1 -- 172.21.15.55:0/2683211758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614be590 msgr2=0x561a614e70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f779d00c640 1 --2- 172.21.15.55:0/2683211758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614be590 0x561a614e70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f779d00c640 1 -- 172.21.15.55:0/2683211758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614e9050 msgr2=0x561a614fc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f779d00c640 1 --2- 172.21.15.55:0/2683211758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614e9050 0x561a614fc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.692+0000 7f779d00c640 1 -- 172.21.15.55:0/2683211758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a614e97a0 con 0x561a614fac60 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f779d00c640 1 --2- 172.21.15.55:0/2683211758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614fac60 0x561a614fd030 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f7790018040 tx=0x7f779000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce9ea084e63d585 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f7781ffb640 1 -- 172.21.15.55:0/2683211758 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779001a040 con 0x561a614fac60 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f7781ffb640 1 -- 172.21.15.55:0/2683211758 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790025070 con 0x561a614fac60 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f7781ffb640 1 -- 172.21.15.55:0/2683211758 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790005780 con 0x561a614fac60 2024-04-25T09:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f77a1772740 1 -- 172.21.15.55:0/2683211758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614fac60 msgr2=0x561a614fd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f77a1772740 1 --2- 172.21.15.55:0/2683211758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614fac60 0x561a614fd030 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f7790018040 tx=0x7f779000e000 comp rx=0 tx=0).stop 2024-04-25T09:01:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f77a1772740 1 -- 172.21.15.55:0/2683211758 shutdown_connections 2024-04-25T09:01:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f77a1772740 1 --2- 172.21.15.55:0/2683211758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614fac60 0x561a614fd030 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f77a1772740 1 --2- 172.21.15.55:0/2683211758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614e9050 0x561a614fc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f77a1772740 1 --2- 172.21.15.55:0/2683211758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614be590 0x561a614e70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f77a1772740 1 -- 172.21.15.55:0/2683211758 >> 172.21.15.55:0/2683211758 conn(0x561a614866e0 msgr2=0x561a61526b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f77a1772740 1 -- 172.21.15.55:0/2683211758 shutdown_connections 2024-04-25T09:01:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.693+0000 7f77a1772740 1 -- 172.21.15.55:0/2683211758 wait complete. 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.694+0000 7f77a1772740 1 -- start start 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.694+0000 7f77a1772740 1 Processor -- start 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f77a1772740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a615073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f77a1772740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614e9050 0x561a6156e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f77a1772740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614fac60 0x561a614fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f77a1772740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a614e9970 con 0x561a614be590 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f77a1772740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a614ea900 con 0x561a614fac60 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f77a1772740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a615178c0 con 0x561a614e9050 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f77a1772740 10 client.0 _ll_register_callbacks cb 0x7f7790003990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f779c80b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a615073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f779c80b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a615073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40452/0 (socket says 172.21.15.55:40452) 2024-04-25T09:01:35.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f779c80b640 1 -- 172.21.15.55:0/1356896716 learned_addr learned my addr 172.21.15.55:0/1356896716 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f7797fff640 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614e9050 0x561a6156e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f779d00c640 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614fac60 0x561a614fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f779c80b640 1 -- 172.21.15.55:0/1356896716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614e9050 msgr2=0x561a6156e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f779c80b640 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614e9050 0x561a6156e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f779c80b640 1 -- 172.21.15.55:0/1356896716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614fac60 msgr2=0x561a614fcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f779c80b640 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614fac60 0x561a614fcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f779c80b640 1 -- 172.21.15.55:0/1356896716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a614bc8f0 con 0x561a614be590 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f779c80b640 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a615073a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f778c058740 tx=0x7f778c08a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88826396aea92492 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.695+0000 7f77777fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77777fe640 1 -- 172.21.15.55:0/1356896716 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c061150 con 0x561a614be590 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77777fe640 1 -- 172.21.15.55:0/1356896716 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f778c08a0c0 con 0x561a614be590 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77a1772740 1 -- 172.21.15.55:0/1356896716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7790025070 con 0x561a614be590 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77777fe640 1 -- 172.21.15.55:0/1356896716 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f778c07f050 con 0x561a614be590 2024-04-25T09:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77a1772740 10 client.8049 fetch_fsmap learned FSMap version 64 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77a1772740 1 -- 172.21.15.55:0/1356896716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x561a6156f5b0 con 0x561a614be590 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77777fe640 1 -- 172.21.15.55:0/1356896716 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790025070 con 0x561a614be590 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77777fe640 1 -- 172.21.15.55:0/1356896716 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f778c077320 con 0x561a614be590 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77a1772740 10 client.8049 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77a1772740 10 client.8049 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77a1772740 20 client.8049 populate_metadata read hostname 'smithi055' 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77a1772740 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x561a61516da0 0x561a61503fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77a1772740 4 client.8049 mds_command: new command op to 7872 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77a1772740 1 -- 172.21.15.55:0/1356896716 --> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x561a6142f1a0 con 0x561a61516da0 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f7797fff640 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x561a61516da0 0x561a61503fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f77777fe640 10 client.8049 ms_handle_connect on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.696+0000 7f7797fff640 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x561a61516da0 0x561a61503fa0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5c67ba25ca791f server_cookie=33a1ad70287d2aa2 in_seq=0 out_seq=0 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77777fe640 1 -- 172.21.15.55:0/1356896716 <== mds.0 v2:172.21.15.55:6835/2841450668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561a6142f1a0 con 0x561a61516da0 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77777fe640 10 client.8049 handle_command_reply: tid=0 2024-04-25T09:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 1 client.8049 shutdown 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 1 -- 172.21.15.55:0/1356896716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 msgr2=0x561a615073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a615073a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f778c058740 tx=0x7f778c08a050 comp rx=0 tx=0).stop 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 1 -- 172.21.15.55:0/1356896716 shutdown_connections 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a614fac60 0x561a614fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.55:6835/2841450668,v1:172.21.15.55:6837/2841450668] conn(0x561a61516da0 0x561a61503fa0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561a614e9050 0x561a6156e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 1 --2- 172.21.15.55:0/1356896716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a614be590 0x561a615073a0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77777fe640 0 client.8049 ms_handle_reset on v2:172.21.15.55:6835/2841450668 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 1 -- 172.21.15.55:0/1356896716 >> 172.21.15.55:0/1356896716 conn(0x561a614866e0 msgr2=0x561a614e5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 1 -- 172.21.15.55:0/1356896716 shutdown_connections 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 1 -- 172.21.15.55:0/1356896716 wait complete. 2024-04-25T09:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.697+0000 7f77a1772740 20 client.8049 trim_cache size 0 max 16384 2024-04-25T09:01:35.692 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:35.692 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-04-25T09:01:35.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 -- 172.21.15.55:0/983458787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f777c06b500 msgr2=0x7f777c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f777c06b500 0x7f777c06d9c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7784033000 tx=0x7f7784008030 comp rx=0 tx=0).stop 2024-04-25T09:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 -- 172.21.15.55:0/983458787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 msgr2=0x7f77980b1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 0x7f77980b1f00 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f778c0072c0 tx=0x7f778c007780 comp rx=0 tx=0).stop 2024-04-25T09:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 -- 172.21.15.55:0/983458787 shutdown_connections 2024-04-25T09:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f777c06b500 0x7f777c06d9c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77980ac490 0x7f77980ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77980cd3b0 0x7f77981f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 --2- 172.21.15.55:0/983458787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004800 0x7f77980b1f00 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 -- 172.21.15.55:0/983458787 >> 172.21.15.55:0/983458787 conn(0x7f77980b5660 msgr2=0x7f77980ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 -- 172.21.15.55:0/983458787 shutdown_connections 2024-04-25T09:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.698+0000 7f779ea6f640 1 -- 172.21.15.55:0/983458787 wait complete. 2024-04-25T09:01:35.697 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:01:35.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.808+0000 7fae269e7640 1 Processor -- start 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.809+0000 7fae269e7640 1 -- start start 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.809+0000 7fae269e7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2015ba10 0x7fae20099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.809+0000 7fae269e7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae2006c3c0 0x7fae200cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.809+0000 7fae269e7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2009a3a0 con 0x7fae20099f80 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.809+0000 7fae269e7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae200cbe50 con 0x7fae2006c3c0 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.809+0000 7fae269e7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae200cfe80 con 0x7fae2015ba10 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.809+0000 7fae24f84640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae2006c3c0 0x7fae200cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.809+0000 7fae1f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fae20099f80 0x7fae2006bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40724/0 (socket says 172.21.15.55:40724) 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.809+0000 7fae1f7fe640 1 -- 172.21.15.55:0/157637342 learned_addr learned my addr 172.21.15.55:0/157637342 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.810+0000 7fae1ffff640 1 --2- 172.21.15.55:0/157637342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2015ba10 0x7fae20099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.810+0000 7fae24f84640 1 -- 172.21.15.55:0/157637342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2015ba10 msgr2=0x7fae20099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.810+0000 7fae24f84640 1 --2- 172.21.15.55:0/157637342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2015ba10 0x7fae20099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.810+0000 7fae24f84640 1 -- 172.21.15.55:0/157637342 >> v1:172.21.15.55:6789/0 conn(0x7fae20099f80 legacy=0x7fae2006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.810+0000 7fae24f84640 1 -- 172.21.15.55:0/157637342 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2006c900 con 0x7fae2006c3c0 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.810+0000 7fae1ffff640 1 --2- 172.21.15.55:0/157637342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2015ba10 0x7fae20099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.810+0000 7fae24f84640 1 --2- 172.21.15.55:0/157637342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae2006c3c0 0x7fae200cd220 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fae18009d90 tx=0x7fae1802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9f2b6e633d6fa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.811+0000 7fae1effd640 1 -- 172.21.15.55:0/157637342 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18007740 con 0x7fae2006c3c0 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.811+0000 7fae1effd640 1 -- 172.21.15.55:0/157637342 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae180078e0 con 0x7fae2006c3c0 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.811+0000 7fae1effd640 1 -- 172.21.15.55:0/157637342 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18007cb0 con 0x7fae2006c3c0 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.811+0000 7fae269e7640 1 -- 172.21.15.55:0/157637342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae2006c3c0 msgr2=0x7fae200cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.811+0000 7fae269e7640 1 --2- 172.21.15.55:0/157637342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae2006c3c0 0x7fae200cd220 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fae18009d90 tx=0x7fae1802a660 comp rx=0 tx=0).stop 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.811+0000 7fae269e7640 1 -- 172.21.15.55:0/157637342 shutdown_connections 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.811+0000 7fae269e7640 1 --2- 172.21.15.55:0/157637342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae2006c3c0 0x7fae200cd220 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.811+0000 7fae269e7640 1 --2- 172.21.15.55:0/157637342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2015ba10 0x7fae20099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.811+0000 7fae269e7640 1 -- 172.21.15.55:0/157637342 >> 172.21.15.55:0/157637342 conn(0x7fae200b32f0 msgr2=0x7fae200b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.811+0000 7fae269e7640 1 -- 172.21.15.55:0/157637342 shutdown_connections 2024-04-25T09:01:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.811+0000 7fae269e7640 1 -- 172.21.15.55:0/157637342 wait complete. 2024-04-25T09:01:35.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.812+0000 7fae269e7640 1 Processor -- start 2024-04-25T09:01:35.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.813+0000 7fae269e7640 1 -- start start 2024-04-25T09:01:35.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.813+0000 7fae269e7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae2006c3c0 0x7fae200c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.813+0000 7fae269e7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20099f80 0x7fae20159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.813+0000 7fae269e7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2015ba10 0x7fae20159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.813+0000 7fae269e7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200cd760 con 0x7fae2006c3c0 2024-04-25T09:01:35.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.813+0000 7fae269e7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2006cec0 con 0x7fae20099f80 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.813+0000 7fae269e7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae200cd8e0 con 0x7fae2015ba10 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.813+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae2006c3c0 0x7fae200c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.813+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae2006c3c0 0x7fae200c5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40482/0 (socket says 172.21.15.55:40482) 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.813+0000 7fae1ffff640 1 -- 172.21.15.55:0/3943366940 learned_addr learned my addr 172.21.15.55:0/3943366940 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae24f84640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2015ba10 0x7fae20159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae1f7fe640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20099f80 0x7fae20159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae1ffff640 1 -- 172.21.15.55:0/3943366940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2015ba10 msgr2=0x7fae20159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae1ffff640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2015ba10 0x7fae20159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae1ffff640 1 -- 172.21.15.55:0/3943366940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20099f80 msgr2=0x7fae20159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae1ffff640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20099f80 0x7fae20159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae1ffff640 1 -- 172.21.15.55:0/3943366940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200b0720 con 0x7fae2006c3c0 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae1ffff640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae2006c3c0 0x7fae200c5e20 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fae1000d800 tx=0x7fae1000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae1cff9640 1 -- 172.21.15.55:0/3943366940 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10004030 con 0x7fae2006c3c0 2024-04-25T09:01:35.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae1cff9640 1 -- 172.21.15.55:0/3943366940 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae100041d0 con 0x7fae2006c3c0 2024-04-25T09:01:35.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae1cff9640 1 -- 172.21.15.55:0/3943366940 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000b6c0 con 0x7fae2006c3c0 2024-04-25T09:01:35.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae269e7640 1 -- 172.21.15.55:0/3943366940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2015cca0 con 0x7fae2006c3c0 2024-04-25T09:01:35.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.814+0000 7fae269e7640 1 -- 172.21.15.55:0/3943366940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2015d260 con 0x7fae2006c3c0 2024-04-25T09:01:35.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.815+0000 7fae269e7640 1 -- 172.21.15.55:0/3943366940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae200749b0 con 0x7fae2006c3c0 2024-04-25T09:01:35.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.816+0000 7fae1cff9640 1 -- 172.21.15.55:0/3943366940 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae1000b860 con 0x7fae2006c3c0 2024-04-25T09:01:35.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.816+0000 7fae1cff9640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0c06b4d0 0x7fae0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.816+0000 7fae1cff9640 1 -- 172.21.15.55:0/3943366940 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fae1008a530 con 0x7fae2006c3c0 2024-04-25T09:01:35.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.816+0000 7fae1f7fe640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0c06b4d0 0x7fae0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.817+0000 7fae1f7fe640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0c06b4d0 0x7fae0c06d990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fae201f7b90 tx=0x7fae14009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:35.820+0000 7fae1cff9640 1 -- 172.21.15.55:0/3943366940 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae10059370 con 0x7fae2006c3c0 2024-04-25T09:01:36.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.049+0000 7fae269e7640 1 -- 172.21.15.55:0/3943366940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fae2009a570 con 0x7fae2006c3c0 2024-04-25T09:01:36.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.049+0000 7fae1cff9640 1 -- 172.21.15.55:0/3943366940 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fae10058c70 con 0x7fae2006c3c0 2024-04-25T09:01:36.038 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:36.038 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:01:36.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.051+0000 7fae269e7640 1 -- 172.21.15.55:0/3943366940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0c06b4d0 msgr2=0x7fae0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.051+0000 7fae269e7640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0c06b4d0 0x7fae0c06d990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fae201f7b90 tx=0x7fae14009040 comp rx=0 tx=0).stop 2024-04-25T09:01:36.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.051+0000 7fae269e7640 1 -- 172.21.15.55:0/3943366940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae2006c3c0 msgr2=0x7fae200c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.051+0000 7fae269e7640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae2006c3c0 0x7fae200c5e20 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fae1000d800 tx=0x7fae1000dcc0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.051+0000 7fae269e7640 1 -- 172.21.15.55:0/3943366940 shutdown_connections 2024-04-25T09:01:36.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.051+0000 7fae269e7640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fae0c06b4d0 0x7fae0c06d990 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.051+0000 7fae269e7640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2015ba10 0x7fae20159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.051+0000 7fae269e7640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20099f80 0x7fae20159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.051+0000 7fae269e7640 1 --2- 172.21.15.55:0/3943366940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae2006c3c0 0x7fae200c5e20 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.051+0000 7fae269e7640 1 -- 172.21.15.55:0/3943366940 >> 172.21.15.55:0/3943366940 conn(0x7fae200b32f0 msgr2=0x7fae20070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.051+0000 7fae269e7640 1 -- 172.21.15.55:0/3943366940 shutdown_connections 2024-04-25T09:01:36.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.052+0000 7fae269e7640 1 -- 172.21.15.55:0/3943366940 wait complete. 2024-04-25T09:01:36.051 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:01:36.051 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:01:36.052 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:01:36.094 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:01:36.140 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:01:36.140 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:01:36.140 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:36.156 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:01:36.156 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:36.212 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:36.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.365+0000 7fbb5de2a640 1 Processor -- start 2024-04-25T09:01:36.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.365+0000 7fbb5de2a640 1 -- start start 2024-04-25T09:01:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.366+0000 7fbb5de2a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbb5815fed0 0x7fbb580b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.366+0000 7fbb5de2a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580717d0 con 0x7fbb5806f270 2024-04-25T09:01:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.366+0000 7fbb5de2a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb58071a70 con 0x7fbb5815ba30 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.366+0000 7fbb5de2a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb58160400 con 0x7fbb5815fed0 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.366+0000 7fbb56ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbb5806f270 0x7fbb580b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40732/0 (socket says 172.21.15.55:40732) 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.366+0000 7fbb56ffd640 1 -- 172.21.15.55:0/253042000 learned_addr learned my addr 172.21.15.55:0/253042000 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.366+0000 7fbb57fff640 1 --2- 172.21.15.55:0/253042000 >> v2:172.21.15.167:3300/0 conn(0x7fbb5815fed0 0x7fbb580b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.366+0000 7fbb567fc640 1 -- 172.21.15.55:0/253042000 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658156570 0 0) 0x7fbb580717d0 con 0x7fbb5806f270 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.366+0000 7fbb567fc640 1 -- 172.21.15.55:0/253042000 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb40003520 con 0x7fbb5806f270 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.366+0000 7fbb567fc640 1 -- 172.21.15.55:0/253042000 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778977451 0 0) 0x7fbb58071a70 con 0x7fbb5815ba30 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.366+0000 7fbb567fc640 1 -- 172.21.15.55:0/253042000 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb580717d0 con 0x7fbb5815ba30 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.367+0000 7fbb567fc640 1 -- 172.21.15.55:0/253042000 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 589185111 0 0) 0x7fbb40003520 con 0x7fbb5806f270 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.367+0000 7fbb57fff640 1 -- 172.21.15.55:0/253042000 >> v1:172.21.15.167:6789/0 conn(0x7fbb5815ba30 legacy=0x7fbb5806eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.367+0000 7fbb57fff640 1 -- 172.21.15.55:0/253042000 >> v1:172.21.15.55:6789/0 conn(0x7fbb5806f270 legacy=0x7fbb580b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.367+0000 7fbb57fff640 1 -- 172.21.15.55:0/253042000 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58071d50 con 0x7fbb5815fed0 2024-04-25T09:01:36.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.367+0000 7fbb57fff640 1 --2- 172.21.15.55:0/253042000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5815fed0 0x7fbb580b32a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009d90 tx=0x7fbb5002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9df1a58a4f922717 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.368+0000 7fbb567fc640 1 -- 172.21.15.55:0/253042000 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c001670 con 0x7fbb5815fed0 2024-04-25T09:01:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.368+0000 7fbb567fc640 1 -- 172.21.15.55:0/253042000 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb50007540 con 0x7fbb5815fed0 2024-04-25T09:01:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.368+0000 7fbb567fc640 1 -- 172.21.15.55:0/253042000 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50007910 con 0x7fbb5815fed0 2024-04-25T09:01:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.368+0000 7fbb5de2a640 1 -- 172.21.15.55:0/253042000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5815fed0 msgr2=0x7fbb580b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.368+0000 7fbb5de2a640 1 --2- 172.21.15.55:0/253042000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5815fed0 0x7fbb580b32a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009d90 tx=0x7fbb5002a680 comp rx=0 tx=0).stop 2024-04-25T09:01:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.368+0000 7fbb5de2a640 1 -- 172.21.15.55:0/253042000 shutdown_connections 2024-04-25T09:01:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.368+0000 7fbb5de2a640 1 --2- 172.21.15.55:0/253042000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5815fed0 0x7fbb580b32a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.368+0000 7fbb5de2a640 1 -- 172.21.15.55:0/253042000 >> 172.21.15.55:0/253042000 conn(0x7fbb580cc540 msgr2=0x7fbb580cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.368+0000 7fbb5de2a640 1 -- 172.21.15.55:0/253042000 shutdown_connections 2024-04-25T09:01:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.368+0000 7fbb5de2a640 1 -- 172.21.15.55:0/253042000 wait complete. 2024-04-25T09:01:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.369+0000 7fbb5de2a640 1 Processor -- start 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.369+0000 7fbb5de2a640 1 -- start start 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.370+0000 7fbb5de2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5806f270 0x7fbb5814a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.370+0000 7fbb5de2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5815ba30 0x7fbb5815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.370+0000 7fbb5de2a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb5815fed0 0x7fbb5815e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.370+0000 7fbb5de2a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580ca2a0 con 0x7fbb5806f270 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.370+0000 7fbb5de2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580ca420 con 0x7fbb5815ba30 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.370+0000 7fbb5de2a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580b37e0 con 0x7fbb5815fed0 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.370+0000 7fbb577fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5806f270 0x7fbb5814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.370+0000 7fbb577fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5806f270 0x7fbb5814a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40492/0 (socket says 172.21.15.55:40492) 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.370+0000 7fbb577fe640 1 -- 172.21.15.55:0/297271219 learned_addr learned my addr 172.21.15.55:0/297271219 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.370+0000 7fbb57fff640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb5815fed0 0x7fbb5815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.370+0000 7fbb56ffd640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5815ba30 0x7fbb5815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb577fe640 1 -- 172.21.15.55:0/297271219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb5815fed0 msgr2=0x7fbb5815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb577fe640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb5815fed0 0x7fbb5815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb577fe640 1 -- 172.21.15.55:0/297271219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5815ba30 msgr2=0x7fbb5815ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb577fe640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5815ba30 0x7fbb5815ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb577fe640 1 -- 172.21.15.55:0/297271219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5815d470 con 0x7fbb5806f270 2024-04-25T09:01:36.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb56ffd640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5815ba30 0x7fbb5815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:36.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb57fff640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb5815fed0 0x7fbb5815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:36.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb577fe640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5806f270 0x7fbb5814a670 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c4c0 tx=0x7fbb4800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb3ffff640 1 -- 172.21.15.55:0/297271219 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb480052d0 con 0x7fbb5806f270 2024-04-25T09:01:36.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb3ffff640 1 -- 172.21.15.55:0/297271219 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb48005470 con 0x7fbb5806f270 2024-04-25T09:01:36.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb5de2a640 1 -- 172.21.15.55:0/297271219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5815b220 con 0x7fbb5806f270 2024-04-25T09:01:36.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb3ffff640 1 -- 172.21.15.55:0/297271219 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48012870 con 0x7fbb5806f270 2024-04-25T09:01:36.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.371+0000 7fbb5de2a640 1 -- 172.21.15.55:0/297271219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5815d9d0 con 0x7fbb5806f270 2024-04-25T09:01:36.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.372+0000 7fbb5de2a640 1 -- 172.21.15.55:0/297271219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb580749b0 con 0x7fbb5806f270 2024-04-25T09:01:36.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.373+0000 7fbb3ffff640 1 -- 172.21.15.55:0/297271219 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb48012a10 con 0x7fbb5806f270 2024-04-25T09:01:36.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.373+0000 7fbb3ffff640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb4406b4d0 0x7fbb4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.373+0000 7fbb3ffff640 1 -- 172.21.15.55:0/297271219 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fbb48089f30 con 0x7fbb5806f270 2024-04-25T09:01:36.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.373+0000 7fbb56ffd640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb4406b4d0 0x7fbb4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.373+0000 7fbb56ffd640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb4406b4d0 0x7fbb4406d990 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbb5806e710 tx=0x7fbb4c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.377+0000 7fbb3ffff640 1 -- 172.21.15.55:0/297271219 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb5815d470 con 0x7fbb5806f270 2024-04-25T09:01:36.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.560+0000 7fbb5de2a640 1 -- 172.21.15.55:0/297271219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb580b0a20 con 0x7fbb5806f270 2024-04-25T09:01:36.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.561+0000 7fbb3ffff640 1 -- 172.21.15.55:0/297271219 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16969 (secure 0 0 0) 0x7fbb48058d70 con 0x7fbb5806f270 2024-04-25T09:01:36.550 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:36.550 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:00:58.145570+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:31.118316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:31.794522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.26","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3282261214":"2024-04-26T09:00:58.145549+0000","172.21.15.55:6835/3282261214":"2024-04-26T09:00:58.145549+0000","172.21.15.55:6837/3953928431":"2024-04-26T08:59:46.600027+0000","172.21.15.55:6835/3953928431":"2024-04-26T08:59:46.600027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:36.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 -- 172.21.15.55:0/297271219 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb4406b4d0 msgr2=0x7fbb4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb4406b4d0 0x7fbb4406d990 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbb5806e710 tx=0x7fbb4c009040 comp rx=0 tx=0).stop 2024-04-25T09:01:36.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 -- 172.21.15.55:0/297271219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5806f270 msgr2=0x7fbb5814a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5806f270 0x7fbb5814a670 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c4c0 tx=0x7fbb4800c980 comp rx=0 tx=0).stop 2024-04-25T09:01:36.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 -- 172.21.15.55:0/297271219 shutdown_connections 2024-04-25T09:01:36.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbb4406b4d0 0x7fbb4406d990 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb5815fed0 0x7fbb5815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb5815ba30 0x7fbb5815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 --2- 172.21.15.55:0/297271219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5806f270 0x7fbb5814a670 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 -- 172.21.15.55:0/297271219 >> 172.21.15.55:0/297271219 conn(0x7fbb580cc540 msgr2=0x7fbb580b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 -- 172.21.15.55:0/297271219 shutdown_connections 2024-04-25T09:01:36.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.563+0000 7fbb5de2a640 1 -- 172.21.15.55:0/297271219 wait complete. 2024-04-25T09:01:36.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:59:31.118316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:59:31.794522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:01:36.563 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:01:36.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.679+0000 7ff19b4b5640 1 Processor -- start 2024-04-25T09:01:36.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.679+0000 7ff19b4b5640 1 -- start start 2024-04-25T09:01:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.680+0000 7ff19b4b5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19415dc80 0x7ff194161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.680+0000 7ff19b4b5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1941627a0 con 0x7ff1940b5c00 2024-04-25T09:01:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.680+0000 7ff19b4b5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1941621e0 con 0x7ff1940b97c0 2024-04-25T09:01:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.680+0000 7ff19b4b5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1941624c0 con 0x7ff19415dc80 2024-04-25T09:01:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.680+0000 7ff199a52640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff1940b5c00 0x7ff1940d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40736/0 (socket says 172.21.15.55:40736) 2024-04-25T09:01:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.680+0000 7ff199a52640 1 -- 172.21.15.55:0/2229734493 learned_addr learned my addr 172.21.15.55:0/2229734493 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058717690 0 0) 0x7ff1941627a0 con 0x7ff1940b5c00 2024-04-25T09:01:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff199251640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19415dc80 0x7ff194161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff17c003520 con 0x7ff1940b5c00 2024-04-25T09:01:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 180366295 0 0) 0x7ff17c003520 con 0x7ff1940b5c00 2024-04-25T09:01:36.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19415dc80 msgr2=0x7ff194161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19415dc80 0x7ff194161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 >> v1:172.21.15.167:6789/0 conn(0x7ff1940b97c0 legacy=0x7ff1940b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1940d1c70 con 0x7ff1940b5c00 2024-04-25T09:01:36.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7ff1840019f0 con 0x7ff1940b5c00 2024-04-25T09:01:36.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 >> v1:172.21.15.55:6789/0 conn(0x7ff1940b5c00 legacy=0x7ff1940d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff17c0039e0 0x7ff17c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19415dc80 0x7ff17c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff17c004d40 0x7ff17c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1941624c0 con 0x7ff17c0039e0 2024-04-25T09:01:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c00ba70 con 0x7ff17c004d40 2024-04-25T09:01:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c00bc70 con 0x7ff19415dc80 2024-04-25T09:01:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff199251640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff17c0039e0 0x7ff17c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff199a52640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff17c004d40 0x7ff17c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff198a50640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19415dc80 0x7ff17c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff199251640 1 -- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19415dc80 msgr2=0x7ff17c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff199251640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19415dc80 0x7ff17c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff199251640 1 -- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff17c004d40 msgr2=0x7ff17c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff199251640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff17c004d40 0x7ff17c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff199251640 1 -- 172.21.15.55:0/2229734493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c003520 con 0x7ff17c0039e0 2024-04-25T09:01:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff198a50640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19415dc80 0x7ff17c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.681+0000 7ff199a52640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff17c004d40 0x7ff17c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.682+0000 7ff199251640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff17c0039e0 0x7ff17c003e00 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009a90 tx=0x7ff17c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c191b5e604369d87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.682+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c036070 con 0x7ff17c0039e0 2024-04-25T09:01:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.682+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c031400 con 0x7ff17c0039e0 2024-04-25T09:01:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.682+0000 7ff193fff640 1 -- 172.21.15.55:0/2229734493 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c009690 con 0x7ff17c0039e0 2024-04-25T09:01:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.683+0000 7ff19b4b5640 1 -- 172.21.15.55:0/2229734493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff17c0039e0 msgr2=0x7ff17c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.683+0000 7ff19b4b5640 1 --2- 172.21.15.55:0/2229734493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff17c0039e0 0x7ff17c003e00 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009a90 tx=0x7ff17c005830 comp rx=0 tx=0).stop 2024-04-25T09:01:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.683+0000 7ff199a52640 1 -- 172.21.15.55:0/2229734493 reap_dead start 2024-04-25T09:01:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.683+0000 7ff19b4b5640 1 -- 172.21.15.55:0/2229734493 shutdown_connections 2024-04-25T09:01:36.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.683+0000 7ff19b4b5640 1 -- 172.21.15.55:0/2229734493 >> 172.21.15.55:0/2229734493 conn(0x7ff1940d04f0 msgr2=0x7ff1940d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.683+0000 7ff19b4b5640 1 -- 172.21.15.55:0/2229734493 shutdown_connections 2024-04-25T09:01:36.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.683+0000 7ff19b4b5640 1 -- 172.21.15.55:0/2229734493 wait complete. 2024-04-25T09:01:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.684+0000 7ff19b4b5640 1 Processor -- start 2024-04-25T09:01:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.684+0000 7ff19b4b5640 1 -- start start 2024-04-25T09:01:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff19b4b5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff17c0039e0 0x7ff19415e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff19b4b5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff19415a1a0 0x7ff1940b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff19b4b5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19414cb70 0x7ff1940ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff19b4b5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1941619f0 con 0x7ff19415a1a0 2024-04-25T09:01:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff19b4b5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff194161870 con 0x7ff17c0039e0 2024-04-25T09:01:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff19b4b5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff194161b70 con 0x7ff19414cb70 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff198a50640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff19415a1a0 0x7ff1940b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff198a50640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff19415a1a0 0x7ff1940b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40512/0 (socket says 172.21.15.55:40512) 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff199251640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff17c0039e0 0x7ff19415e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff198a50640 1 -- 172.21.15.55:0/4182871847 learned_addr learned my addr 172.21.15.55:0/4182871847 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff199a52640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19414cb70 0x7ff1940ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff198a50640 1 -- 172.21.15.55:0/4182871847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19414cb70 msgr2=0x7ff1940ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff198a50640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19414cb70 0x7ff1940ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff198a50640 1 -- 172.21.15.55:0/4182871847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff17c0039e0 msgr2=0x7ff19415e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff198a50640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff17c0039e0 0x7ff19415e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.685+0000 7ff198a50640 1 -- 172.21.15.55:0/4182871847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19414a200 con 0x7ff19415a1a0 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.686+0000 7ff198a50640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff19415a1a0 0x7ff1940b2220 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7ff18800e570 tx=0x7ff18800ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.686+0000 7ff191ffb640 1 -- 172.21.15.55:0/4182871847 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1880052e0 con 0x7ff19415a1a0 2024-04-25T09:01:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.686+0000 7ff191ffb640 1 -- 172.21.15.55:0/4182871847 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff188018070 con 0x7ff19415a1a0 2024-04-25T09:01:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.686+0000 7ff19b4b5640 1 -- 172.21.15.55:0/4182871847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19414a4e0 con 0x7ff19415a1a0 2024-04-25T09:01:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.686+0000 7ff191ffb640 1 -- 172.21.15.55:0/4182871847 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff188003810 con 0x7ff19415a1a0 2024-04-25T09:01:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.686+0000 7ff19b4b5640 1 -- 172.21.15.55:0/4182871847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19414aaa0 con 0x7ff19415a1a0 2024-04-25T09:01:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.687+0000 7ff19b4b5640 1 -- 172.21.15.55:0/4182871847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1940750b0 con 0x7ff19415a1a0 2024-04-25T09:01:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.687+0000 7ff191ffb640 1 -- 172.21.15.55:0/4182871847 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff1880039b0 con 0x7ff19415a1a0 2024-04-25T09:01:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.688+0000 7ff191ffb640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff18006b500 0x7ff18006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.688+0000 7ff191ffb640 1 -- 172.21.15.55:0/4182871847 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7ff188089e00 con 0x7ff19415a1a0 2024-04-25T09:01:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.688+0000 7ff199251640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff18006b500 0x7ff18006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.688+0000 7ff199251640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff18006b500 0x7ff18006d9c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff18c033000 tx=0x7ff18c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.692+0000 7ff191ffb640 1 -- 172.21.15.55:0/4182871847 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff1880585f0 con 0x7ff19415a1a0 2024-04-25T09:01:36.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.873+0000 7ff19b4b5640 1 -- 172.21.15.55:0/4182871847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1940b5590 con 0x7ff19415a1a0 2024-04-25T09:01:36.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.873+0000 7ff191ffb640 1 -- 172.21.15.55:0/4182871847 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff18805c690 con 0x7ff19415a1a0 2024-04-25T09:01:36.862 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:01:36.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.875+0000 7ff19b4b5640 1 -- 172.21.15.55:0/4182871847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff18006b500 msgr2=0x7ff18006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.875+0000 7ff19b4b5640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff18006b500 0x7ff18006d9c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff18c033000 tx=0x7ff18c008030 comp rx=0 tx=0).stop 2024-04-25T09:01:36.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.875+0000 7ff19b4b5640 1 -- 172.21.15.55:0/4182871847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff19415a1a0 msgr2=0x7ff1940b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.875+0000 7ff19b4b5640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff19415a1a0 0x7ff1940b2220 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7ff18800e570 tx=0x7ff18800ea30 comp rx=0 tx=0).stop 2024-04-25T09:01:36.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.876+0000 7ff19b4b5640 1 -- 172.21.15.55:0/4182871847 shutdown_connections 2024-04-25T09:01:36.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.876+0000 7ff19b4b5640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff18006b500 0x7ff18006d9c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.876+0000 7ff19b4b5640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff19414cb70 0x7ff1940ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.876+0000 7ff19b4b5640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff19415a1a0 0x7ff1940b2220 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.876+0000 7ff19b4b5640 1 --2- 172.21.15.55:0/4182871847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff17c0039e0 0x7ff19415e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.876+0000 7ff19b4b5640 1 -- 172.21.15.55:0/4182871847 >> 172.21.15.55:0/4182871847 conn(0x7ff1940d04f0 msgr2=0x7ff1940b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.876+0000 7ff19b4b5640 1 -- 172.21.15.55:0/4182871847 shutdown_connections 2024-04-25T09:01:36.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.876+0000 7ff19b4b5640 1 -- 172.21.15.55:0/4182871847 wait complete. 2024-04-25T09:01:36.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:01:36.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.990+0000 7f2a4bab3640 1 Processor -- start 2024-04-25T09:01:36.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.990+0000 7f2a4bab3640 1 -- start start 2024-04-25T09:01:36.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.991+0000 7f2a4bab3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a4415dca0 0x7f2a440ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.991+0000 7f2a4bab3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a440d1130 0x7f2a440b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.991+0000 7f2a4bab3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a440d4090 con 0x7f2a440d3b90 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.991+0000 7f2a4bab3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a440b6b20 con 0x7f2a4415dca0 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.991+0000 7f2a4bab3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440d4370 con 0x7f2a440d1130 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.991+0000 7f2a4984f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a4415dca0 0x7f2a440ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.991+0000 7f2a4904e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2a440d3b90 0x7f2a440d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40746/0 (socket says 172.21.15.55:40746) 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.991+0000 7f2a4904e640 1 -- 172.21.15.55:0/3163341754 learned_addr learned my addr 172.21.15.55:0/3163341754 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.992+0000 7f2a4a050640 1 --2- 172.21.15.55:0/3163341754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a440d1130 0x7f2a440b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.992+0000 7f2a4984f640 1 -- 172.21.15.55:0/3163341754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a440d1130 msgr2=0x7f2a440b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.992+0000 7f2a4984f640 1 --2- 172.21.15.55:0/3163341754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a440d1130 0x7f2a440b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.992+0000 7f2a4984f640 1 -- 172.21.15.55:0/3163341754 >> v1:172.21.15.55:6789/0 conn(0x7f2a440d3b90 legacy=0x7f2a440d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.992+0000 7f2a4984f640 1 -- 172.21.15.55:0/3163341754 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440d4650 con 0x7f2a4415dca0 2024-04-25T09:01:36.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.992+0000 7f2a4884d640 1 -- 172.21.15.55:0/3163341754 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069880170 0 0) 0x7f2a440d4090 con 0x7f2a440d3b90 2024-04-25T09:01:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.992+0000 7f2a4984f640 1 --2- 172.21.15.55:0/3163341754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4415dca0 0x7f2a440ce940 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0097a0 tx=0x7f2a3c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b745921993e980e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.992+0000 7f2a4884d640 1 -- 172.21.15.55:0/3163341754 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c037070 con 0x7f2a4415dca0 2024-04-25T09:01:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.992+0000 7f2a4884d640 1 -- 172.21.15.55:0/3163341754 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c032440 con 0x7f2a4415dca0 2024-04-25T09:01:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.993+0000 7f2a4884d640 1 -- 172.21.15.55:0/3163341754 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c032810 con 0x7f2a4415dca0 2024-04-25T09:01:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.993+0000 7f2a4bab3640 1 -- 172.21.15.55:0/3163341754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4415dca0 msgr2=0x7f2a440ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.993+0000 7f2a4bab3640 1 --2- 172.21.15.55:0/3163341754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4415dca0 0x7f2a440ce940 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0097a0 tx=0x7f2a3c02a180 comp rx=0 tx=0).stop 2024-04-25T09:01:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.993+0000 7f2a4bab3640 1 -- 172.21.15.55:0/3163341754 shutdown_connections 2024-04-25T09:01:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.993+0000 7f2a4bab3640 1 --2- 172.21.15.55:0/3163341754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a440d1130 0x7f2a440b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.993+0000 7f2a4bab3640 1 --2- 172.21.15.55:0/3163341754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4415dca0 0x7f2a440ce940 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.993+0000 7f2a4bab3640 1 -- 172.21.15.55:0/3163341754 >> 172.21.15.55:0/3163341754 conn(0x7f2a440726c0 msgr2=0x7f2a44072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.993+0000 7f2a4bab3640 1 -- 172.21.15.55:0/3163341754 shutdown_connections 2024-04-25T09:01:36.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.993+0000 7f2a4bab3640 1 -- 172.21.15.55:0/3163341754 wait complete. 2024-04-25T09:01:36.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.994+0000 7f2a4bab3640 1 Processor -- start 2024-04-25T09:01:36.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.994+0000 7f2a4bab3640 1 -- start start 2024-04-25T09:01:36.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4bab3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a440d1130 0x7f2a44152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4bab3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a440d3b90 0x7f2a440cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4bab3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4415dca0 0x7f2a440adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4bab3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4415e200 con 0x7f2a4415dca0 2024-04-25T09:01:36.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4bab3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4415e080 con 0x7f2a440d3b90 2024-04-25T09:01:36.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4bab3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440cee80 con 0x7f2a440d1130 2024-04-25T09:01:36.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4a050640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4415dca0 0x7f2a440adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4a050640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4415dca0 0x7f2a440adb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40530/0 (socket says 172.21.15.55:40530) 2024-04-25T09:01:36.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4a050640 1 -- 172.21.15.55:0/2479240637 learned_addr learned my addr 172.21.15.55:0/2479240637 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:36.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4904e640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a440d3b90 0x7f2a440cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4984f640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a440d1130 0x7f2a44152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4a050640 1 -- 172.21.15.55:0/2479240637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a440d1130 msgr2=0x7f2a44152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4a050640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a440d1130 0x7f2a44152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4a050640 1 -- 172.21.15.55:0/2479240637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a440d3b90 msgr2=0x7f2a440cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4a050640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a440d3b90 0x7f2a440cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4a050640 1 -- 172.21.15.55:0/2479240637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440cd870 con 0x7f2a4415dca0 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.995+0000 7f2a4904e640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a440d3b90 0x7f2a440cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.996+0000 7f2a4a050640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4415dca0 0x7f2a440adb80 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f2a34007e70 tx=0x7f2a3400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.996+0000 7f2a427fc640 1 -- 172.21.15.55:0/2479240637 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34014620 con 0x7f2a4415dca0 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.996+0000 7f2a427fc640 1 -- 172.21.15.55:0/2479240637 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34019070 con 0x7f2a4415dca0 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.996+0000 7f2a427fc640 1 -- 172.21.15.55:0/2479240637 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34014a20 con 0x7f2a4415dca0 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.996+0000 7f2a4bab3640 1 -- 172.21.15.55:0/2479240637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a440ccfd0 con 0x7f2a4415dca0 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.996+0000 7f2a4bab3640 1 -- 172.21.15.55:0/2479240637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a440cd590 con 0x7f2a4415dca0 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.997+0000 7f2a4bab3640 1 -- 172.21.15.55:0/2479240637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a440750b0 con 0x7f2a4415dca0 2024-04-25T09:01:36.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.997+0000 7f2a427fc640 1 -- 172.21.15.55:0/2479240637 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2a34014bc0 con 0x7f2a4415dca0 2024-04-25T09:01:36.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.998+0000 7f2a427fc640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a3006b4d0 0x7f2a3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.998+0000 7f2a427fc640 1 -- 172.21.15.55:0/2479240637 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f2a3408aaf0 con 0x7f2a4415dca0 2024-04-25T09:01:36.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.998+0000 7f2a4984f640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a3006b4d0 0x7f2a3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:36.998+0000 7f2a4984f640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a3006b4d0 0x7f2a3006d990 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c034000 tx=0x7f2a3c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.002+0000 7f2a427fc640 1 -- 172.21.15.55:0/2479240637 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2a34059930 con 0x7f2a4415dca0 2024-04-25T09:01:37.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.186+0000 7f2a4bab3640 1 -- 172.21.15.55:0/2479240637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a440cdb90 con 0x7f2a4415dca0 2024-04-25T09:01:37.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.186+0000 7f2a427fc640 1 -- 172.21.15.55:0/2479240637 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a34059230 con 0x7f2a4415dca0 2024-04-25T09:01:37.175 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.188+0000 7f2a4bab3640 1 -- 172.21.15.55:0/2479240637 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a3006b4d0 msgr2=0x7f2a3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.188+0000 7f2a4bab3640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a3006b4d0 0x7f2a3006d990 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c034000 tx=0x7f2a3c02e000 comp rx=0 tx=0).stop 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.188+0000 7f2a4bab3640 1 -- 172.21.15.55:0/2479240637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4415dca0 msgr2=0x7f2a440adb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.188+0000 7f2a4bab3640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4415dca0 0x7f2a440adb80 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f2a34007e70 tx=0x7f2a3400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.188+0000 7f2a4bab3640 1 -- 172.21.15.55:0/2479240637 shutdown_connections 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.188+0000 7f2a4bab3640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2a3006b4d0 0x7f2a3006d990 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.188+0000 7f2a4bab3640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4415dca0 0x7f2a440adb80 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.188+0000 7f2a4bab3640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a440d3b90 0x7f2a440cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.188+0000 7f2a4bab3640 1 --2- 172.21.15.55:0/2479240637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a440d1130 0x7f2a44152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.188+0000 7f2a4bab3640 1 -- 172.21.15.55:0/2479240637 >> 172.21.15.55:0/2479240637 conn(0x7f2a440726c0 msgr2=0x7f2a440d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.189+0000 7f2a4bab3640 1 -- 172.21.15.55:0/2479240637 shutdown_connections 2024-04-25T09:01:37.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.189+0000 7f2a4bab3640 1 -- 172.21.15.55:0/2479240637 wait complete. 2024-04-25T09:01:37.188 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:01:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.304+0000 7f11e50d2640 1 Processor -- start 2024-04-25T09:01:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.304+0000 7f11e50d2640 1 -- start start 2024-04-25T09:01:37.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.305+0000 7f11e50d2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f11e015dfa0 0x7f11e009a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.305+0000 7f11e50d2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e006cdd0 0x7f11e00cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.305+0000 7f11e50d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e00d02f0 con 0x7f11e015dbc0 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.305+0000 7f11e50d2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e006c210 con 0x7f11e015dfa0 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.305+0000 7f11e50d2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00d0f00 con 0x7f11e006cdd0 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.305+0000 7f11ded9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f11e015dbc0 0x7f11e006c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40752/0 (socket says 172.21.15.55:40752) 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.305+0000 7f11ded9d640 1 -- 172.21.15.55:0/2384607002 learned_addr learned my addr 172.21.15.55:0/2384607002 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.305+0000 7f11d7fff640 1 --2- 172.21.15.55:0/2384607002 >> v2:172.21.15.167:3300/0 conn(0x7f11e015dfa0 0x7f11e009a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.305+0000 7f11df59e640 1 --2- 172.21.15.55:0/2384607002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e006cdd0 0x7f11e00cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.306+0000 7f11d7fff640 1 -- 172.21.15.55:0/2384607002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e006cdd0 msgr2=0x7f11e00cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.306+0000 7f11d7fff640 1 --2- 172.21.15.55:0/2384607002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e006cdd0 0x7f11e00cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.306+0000 7f11d7fff640 1 -- 172.21.15.55:0/2384607002 >> v1:172.21.15.55:6789/0 conn(0x7f11e015dbc0 legacy=0x7f11e006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.306+0000 7f11d7fff640 1 -- 172.21.15.55:0/2384607002 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e00d05d0 con 0x7f11e015dfa0 2024-04-25T09:01:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.306+0000 7f11df59e640 1 --2- 172.21.15.55:0/2384607002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e006cdd0 0x7f11e00cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:37.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.307+0000 7f11d7fff640 1 --2- 172.21.15.55:0/2384607002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e015dfa0 0x7f11e009a530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f11c80097a0 tx=0x7f11c802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df4745a703424e70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:37.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.309+0000 7f11de59c640 1 -- 172.21.15.55:0/2384607002 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8037070 con 0x7f11e015dfa0 2024-04-25T09:01:37.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.309+0000 7f11de59c640 1 -- 172.21.15.55:0/2384607002 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8032440 con 0x7f11e015dfa0 2024-04-25T09:01:37.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.309+0000 7f11de59c640 1 -- 172.21.15.55:0/2384607002 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8032810 con 0x7f11e015dfa0 2024-04-25T09:01:37.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.310+0000 7f11e50d2640 1 -- 172.21.15.55:0/2384607002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e015dfa0 msgr2=0x7f11e009a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.310+0000 7f11e50d2640 1 --2- 172.21.15.55:0/2384607002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e015dfa0 0x7f11e009a530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f11c80097a0 tx=0x7f11c802a180 comp rx=0 tx=0).stop 2024-04-25T09:01:37.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.310+0000 7f11e50d2640 1 -- 172.21.15.55:0/2384607002 shutdown_connections 2024-04-25T09:01:37.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.310+0000 7f11e50d2640 1 --2- 172.21.15.55:0/2384607002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e006cdd0 0x7f11e00cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.310+0000 7f11e50d2640 1 --2- 172.21.15.55:0/2384607002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e015dfa0 0x7f11e009a530 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.310+0000 7f11e50d2640 1 -- 172.21.15.55:0/2384607002 >> 172.21.15.55:0/2384607002 conn(0x7f11e00b3410 msgr2=0x7f11e00b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:37.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.310+0000 7f11e50d2640 1 -- 172.21.15.55:0/2384607002 shutdown_connections 2024-04-25T09:01:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.310+0000 7f11e50d2640 1 -- 172.21.15.55:0/2384607002 wait complete. 2024-04-25T09:01:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.311+0000 7f11e50d2640 1 Processor -- start 2024-04-25T09:01:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.311+0000 7f11e50d2640 1 -- start start 2024-04-25T09:01:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.312+0000 7f11e50d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11e006cdd0 0x7f11e009b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.312+0000 7f11e50d2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e015dbc0 0x7f11e0151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.312+0000 7f11e50d2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e00ceb10 0x7f11e00cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.312+0000 7f11e50d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00d0b90 con 0x7f11e006cdd0 2024-04-25T09:01:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.312+0000 7f11e50d2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00d00a0 con 0x7f11e00ceb10 2024-04-25T09:01:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.312+0000 7f11e50d2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00d1390 con 0x7f11e015dbc0 2024-04-25T09:01:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.312+0000 7f11ded9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11e006cdd0 0x7f11e009b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.312+0000 7f11ded9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11e006cdd0 0x7f11e009b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40538/0 (socket says 172.21.15.55:40538) 2024-04-25T09:01:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.312+0000 7f11ded9d640 1 -- 172.21.15.55:0/1119075875 learned_addr learned my addr 172.21.15.55:0/1119075875 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.313+0000 7f11d7fff640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e015dbc0 0x7f11e0151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.313+0000 7f11df59e640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e00ceb10 0x7f11e00cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.313+0000 7f11ded9d640 1 -- 172.21.15.55:0/1119075875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e015dbc0 msgr2=0x7f11e0151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.313+0000 7f11ded9d640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e015dbc0 0x7f11e0151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.313+0000 7f11ded9d640 1 -- 172.21.15.55:0/1119075875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e00ceb10 msgr2=0x7f11e00cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.313+0000 7f11ded9d640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e00ceb10 0x7f11e00cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.313+0000 7f11ded9d640 1 -- 172.21.15.55:0/1119075875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e00cf0b0 con 0x7f11e006cdd0 2024-04-25T09:01:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.313+0000 7f11d7fff640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e015dbc0 0x7f11e0151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:37.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.313+0000 7f11ded9d640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11e006cdd0 0x7f11e009b680 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f11d000c400 tx=0x7f11d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:37.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.314+0000 7f11d77fe640 1 -- 172.21.15.55:0/1119075875 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0017070 con 0x7f11e006cdd0 2024-04-25T09:01:37.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.314+0000 7f11d77fe640 1 -- 172.21.15.55:0/1119075875 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d0005ce0 con 0x7f11e006cdd0 2024-04-25T09:01:37.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.314+0000 7f11e50d2640 1 -- 172.21.15.55:0/1119075875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e0155440 con 0x7f11e006cdd0 2024-04-25T09:01:37.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.314+0000 7f11d77fe640 1 -- 172.21.15.55:0/1119075875 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d00072f0 con 0x7f11e006cdd0 2024-04-25T09:01:37.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.314+0000 7f11e50d2640 1 -- 172.21.15.55:0/1119075875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e00cc5c0 con 0x7f11e006cdd0 2024-04-25T09:01:37.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.315+0000 7f11e50d2640 1 -- 172.21.15.55:0/1119075875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e00750b0 con 0x7f11e006cdd0 2024-04-25T09:01:37.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.316+0000 7f11d77fe640 1 -- 172.21.15.55:0/1119075875 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f11d001a070 con 0x7f11e006cdd0 2024-04-25T09:01:37.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.316+0000 7f11d77fe640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f11c006b500 0x7f11c006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.316+0000 7f11d77fe640 1 -- 172.21.15.55:0/1119075875 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f11d0089750 con 0x7f11e006cdd0 2024-04-25T09:01:37.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.316+0000 7f11d7fff640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f11c006b500 0x7f11c006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.317+0000 7f11d7fff640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f11c006b500 0x7f11c006d9c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f11c8034000 tx=0x7f11c802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.321+0000 7f11d77fe640 1 -- 172.21.15.55:0/1119075875 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f11d0058470 con 0x7f11e006cdd0 2024-04-25T09:01:37.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.499+0000 7f11e50d2640 1 -- 172.21.15.55:0/1119075875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11e00b4320 con 0x7f11e006cdd0 2024-04-25T09:01:37.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.499+0000 7f11d77fe640 1 -- 172.21.15.55:0/1119075875 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11d0057d70 con 0x7f11e006cdd0 2024-04-25T09:01:37.488 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T09:01:37.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 -- 172.21.15.55:0/1119075875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f11c006b500 msgr2=0x7f11c006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f11c006b500 0x7f11c006d9c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f11c8034000 tx=0x7f11c802e000 comp rx=0 tx=0).stop 2024-04-25T09:01:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 -- 172.21.15.55:0/1119075875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11e006cdd0 msgr2=0x7f11e009b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11e006cdd0 0x7f11e009b680 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f11d000c400 tx=0x7f11d000c8c0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 -- 172.21.15.55:0/1119075875 shutdown_connections 2024-04-25T09:01:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f11c006b500 0x7f11c006d9c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11e00ceb10 0x7f11e00cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11e015dbc0 0x7f11e0151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 --2- 172.21.15.55:0/1119075875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11e006cdd0 0x7f11e009b680 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 -- 172.21.15.55:0/1119075875 >> 172.21.15.55:0/1119075875 conn(0x7f11e00b3410 msgr2=0x7f11e015cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 -- 172.21.15.55:0/1119075875 shutdown_connections 2024-04-25T09:01:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.501+0000 7f11e50d2640 1 -- 172.21.15.55:0/1119075875 wait complete. 2024-04-25T09:01:37.501 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:01:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.615+0000 7f9f3f509640 1 Processor -- start 2024-04-25T09:01:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.615+0000 7f9f3f509640 1 -- start start 2024-04-25T09:01:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.616+0000 7f9f3f509640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f380b9720 0x7f9f380ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.616+0000 7f9f3f509640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9f380cece0 0x7f9f380d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.616+0000 7f9f3f509640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f38161f80 con 0x7f9f38161090 2024-04-25T09:01:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.616+0000 7f9f3f509640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f380cf130 con 0x7f9f380cece0 2024-04-25T09:01:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.616+0000 7f9f3f509640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380d21a0 con 0x7f9f380b9720 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.616+0000 7f9f3d2a5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9f38161090 0x7f9f38161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40756/0 (socket says 172.21.15.55:40756) 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.616+0000 7f9f3d2a5640 1 -- 172.21.15.55:0/1861154927 learned_addr learned my addr 172.21.15.55:0/1861154927 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.616+0000 7f9f3daa6640 1 --2- 172.21.15.55:0/1861154927 >> v2:172.21.15.167:3300/0 conn(0x7f9f380cece0 0x7f9f380d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.616+0000 7f9f3caa4640 1 --2- 172.21.15.55:0/1861154927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f380b9720 0x7f9f380ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.616+0000 7f9f37fff640 1 -- 172.21.15.55:0/1861154927 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171006829 0 0) 0x7f9f38161f80 con 0x7f9f38161090 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.616+0000 7f9f37fff640 1 -- 172.21.15.55:0/1861154927 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f20003520 con 0x7f9f38161090 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.617+0000 7f9f3caa4640 1 -- 172.21.15.55:0/1861154927 >> v2:172.21.15.167:3300/0 conn(0x7f9f380cece0 msgr2=0x7f9f380d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.617+0000 7f9f37fff640 1 -- 172.21.15.55:0/1861154927 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2437706155 0 0) 0x7f9f20003520 con 0x7f9f38161090 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.617+0000 7f9f3caa4640 1 --2- 172.21.15.55:0/1861154927 >> v2:172.21.15.167:3300/0 conn(0x7f9f380cece0 0x7f9f380d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.617+0000 7f9f3caa4640 1 -- 172.21.15.55:0/1861154927 >> v1:172.21.15.55:6789/0 conn(0x7f9f38161090 legacy=0x7f9f38161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.617+0000 7f9f3caa4640 1 -- 172.21.15.55:0/1861154927 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f38162260 con 0x7f9f380b9720 2024-04-25T09:01:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.617+0000 7f9f3daa6640 1 --2- 172.21.15.55:0/1861154927 >> v2:172.21.15.167:3300/0 conn(0x7f9f380cece0 0x7f9f380d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:37.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.617+0000 7f9f3caa4640 1 --2- 172.21.15.55:0/1861154927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f380b9720 0x7f9f380ce7a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0097a0 tx=0x7f9f2c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9853aa84d89f9b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:37.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.617+0000 7f9f37fff640 1 -- 172.21.15.55:0/1861154927 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c037070 con 0x7f9f380b9720 2024-04-25T09:01:37.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.618+0000 7f9f37fff640 1 -- 172.21.15.55:0/1861154927 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c02aba0 con 0x7f9f380b9720 2024-04-25T09:01:37.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.618+0000 7f9f37fff640 1 -- 172.21.15.55:0/1861154927 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f280019f0 con 0x7f9f380b9720 2024-04-25T09:01:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.618+0000 7f9f3f509640 1 -- 172.21.15.55:0/1861154927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f380b9720 msgr2=0x7f9f380ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.618+0000 7f9f3f509640 1 --2- 172.21.15.55:0/1861154927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f380b9720 0x7f9f380ce7a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0097a0 tx=0x7f9f2c02a110 comp rx=0 tx=0).stop 2024-04-25T09:01:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.618+0000 7f9f3f509640 1 -- 172.21.15.55:0/1861154927 shutdown_connections 2024-04-25T09:01:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.618+0000 7f9f3f509640 1 --2- 172.21.15.55:0/1861154927 >> v2:172.21.15.167:3300/0 conn(0x7f9f380cece0 0x7f9f380d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.618+0000 7f9f3f509640 1 --2- 172.21.15.55:0/1861154927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f380b9720 0x7f9f380ce7a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.618+0000 7f9f3f509640 1 -- 172.21.15.55:0/1861154927 >> 172.21.15.55:0/1861154927 conn(0x7f9f380b55e0 msgr2=0x7f9f380b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.618+0000 7f9f3f509640 1 -- 172.21.15.55:0/1861154927 shutdown_connections 2024-04-25T09:01:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.618+0000 7f9f3f509640 1 -- 172.21.15.55:0/1861154927 wait complete. 2024-04-25T09:01:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.619+0000 7f9f3f509640 1 Processor -- start 2024-04-25T09:01:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.619+0000 7f9f3f509640 1 -- start start 2024-04-25T09:01:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3f509640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f380b9720 0x7f9f38154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3f509640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f380cece0 0x7f9f3815ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3f509640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f38161090 0x7f9f380cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3f509640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38161470 con 0x7f9f380b9720 2024-04-25T09:01:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3f509640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380d1e30 con 0x7f9f38161090 2024-04-25T09:01:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3f509640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380d2b70 con 0x7f9f380cece0 2024-04-25T09:01:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3d2a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f380b9720 0x7f9f38154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3d2a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f380b9720 0x7f9f38154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40554/0 (socket says 172.21.15.55:40554) 2024-04-25T09:01:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3d2a5640 1 -- 172.21.15.55:0/4158878495 learned_addr learned my addr 172.21.15.55:0/4158878495 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3caa4640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f380cece0 0x7f9f3815ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3daa6640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f38161090 0x7f9f380cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3d2a5640 1 -- 172.21.15.55:0/4158878495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f380cece0 msgr2=0x7f9f3815ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3d2a5640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f380cece0 0x7f9f3815ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3d2a5640 1 -- 172.21.15.55:0/4158878495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f38161090 msgr2=0x7f9f380cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3d2a5640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f38161090 0x7f9f380cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.620+0000 7f9f3d2a5640 1 -- 172.21.15.55:0/4158878495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380cbab0 con 0x7f9f380b9720 2024-04-25T09:01:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.621+0000 7f9f3d2a5640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f380b9720 0x7f9f38154d50 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800cc70 tx=0x7f9f2800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.621+0000 7f9f35ffb640 1 -- 172.21.15.55:0/4158878495 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28017070 con 0x7f9f380b9720 2024-04-25T09:01:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.621+0000 7f9f35ffb640 1 -- 172.21.15.55:0/4158878495 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2800ad40 con 0x7f9f380b9720 2024-04-25T09:01:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.621+0000 7f9f35ffb640 1 -- 172.21.15.55:0/4158878495 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28012600 con 0x7f9f380b9720 2024-04-25T09:01:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.621+0000 7f9f3f509640 1 -- 172.21.15.55:0/4158878495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f380cbd90 con 0x7f9f380b9720 2024-04-25T09:01:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.621+0000 7f9f3f509640 1 -- 172.21.15.55:0/4158878495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f380cc350 con 0x7f9f380b9720 2024-04-25T09:01:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.622+0000 7f9f3f509640 1 -- 172.21.15.55:0/4158878495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f380750b0 con 0x7f9f380b9720 2024-04-25T09:01:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.622+0000 7f9f35ffb640 1 -- 172.21.15.55:0/4158878495 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9f2801a070 con 0x7f9f380b9720 2024-04-25T09:01:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.623+0000 7f9f35ffb640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f2406b4d0 0x7f9f2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.623+0000 7f9f35ffb640 1 -- 172.21.15.55:0/4158878495 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f9f28089fb0 con 0x7f9f380b9720 2024-04-25T09:01:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.623+0000 7f9f3caa4640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f2406b4d0 0x7f9f2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.623+0000 7f9f3caa4640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f2406b4d0 0x7f9f2406d990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c034000 tx=0x7f9f2c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.627+0000 7f9f35ffb640 1 -- 172.21.15.55:0/4158878495 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f280587a0 con 0x7f9f380b9720 2024-04-25T09:01:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.820+0000 7f9f3f509640 1 -- 172.21.15.55:0/4158878495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f380d1700 con 0x7f9f380b9720 2024-04-25T09:01:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.820+0000 7f9f35ffb640 1 -- 172.21.15.55:0/4158878495 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v91) v1 ==== 80+0+244 (secure 0 0 0) 0x7f9f2805c840 con 0x7f9f380b9720 2024-04-25T09:01:37.810 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/3282261214 2024-04-26T09:00:58.145549+0000 2024-04-25T09:01:37.810 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/3282261214 2024-04-26T09:00:58.145549+0000 2024-04-25T09:01:37.810 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/3953928431 2024-04-26T08:59:46.600027+0000 2024-04-25T09:01:37.810 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/3953928431 2024-04-26T08:59:46.600027+0000 2024-04-25T09:01:37.812 INFO:teuthology.orchestra.run.smithi055.stderr:listed 4 entries 2024-04-25T09:01:37.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 -- 172.21.15.55:0/4158878495 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f2406b4d0 msgr2=0x7f9f2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f2406b4d0 0x7f9f2406d990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c034000 tx=0x7f9f2c02e000 comp rx=0 tx=0).stop 2024-04-25T09:01:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 -- 172.21.15.55:0/4158878495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f380b9720 msgr2=0x7f9f38154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f380b9720 0x7f9f38154d50 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800cc70 tx=0x7f9f2800a430 comp rx=0 tx=0).stop 2024-04-25T09:01:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 -- 172.21.15.55:0/4158878495 shutdown_connections 2024-04-25T09:01:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9f2406b4d0 0x7f9f2406d990 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f38161090 0x7f9f380cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f380cece0 0x7f9f3815ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 --2- 172.21.15.55:0/4158878495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f380b9720 0x7f9f38154d50 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 -- 172.21.15.55:0/4158878495 >> 172.21.15.55:0/4158878495 conn(0x7f9f380b55e0 msgr2=0x7f9f380d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 -- 172.21.15.55:0/4158878495 shutdown_connections 2024-04-25T09:01:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:37.822+0000 7f9f3f509640 1 -- 172.21.15.55:0/4158878495 wait complete. 2024-04-25T09:01:37.822 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:01:37.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:37.822 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:01:37.850 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:01:37.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:37.850 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:01:37.906 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:01:37.906 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:37.926 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:01:37.926 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:01:37.926 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:37.962 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:01:37.962 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:01:37.962 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:37.984 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:01:37.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:38.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.114+0000 7fcc448b3640 1 Processor -- start 2024-04-25T09:01:38.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.114+0000 7fcc448b3640 1 -- start start 2024-04-25T09:01:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.114+0000 7fcc448b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc40071190 0x7fcc400ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.114+0000 7fcc448b3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc400b3730 0x7fcc4015e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.114+0000 7fcc448b3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4006d550 con 0x7fcc40071570 2024-04-25T09:01:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.114+0000 7fcc448b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc400aeee0 con 0x7fcc40071190 2024-04-25T09:01:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.114+0000 7fcc448b3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4006d830 con 0x7fcc400b3730 2024-04-25T09:01:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.115+0000 7fcc3e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc40071190 0x7fcc400ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.115+0000 7fcc3e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc40071190 0x7fcc400ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40566/0 (socket says 172.21.15.55:40566) 2024-04-25T09:01:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.115+0000 7fcc3e59c640 1 -- 172.21.15.55:0/3261171817 learned_addr learned my addr 172.21.15.55:0/3261171817 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.115+0000 7fcc3e59c640 1 -- 172.21.15.55:0/3261171817 >> v2:172.21.15.167:3300/0 conn(0x7fcc400b3730 msgr2=0x7fcc4015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.115+0000 7fcc3e59c640 1 --2- 172.21.15.55:0/3261171817 >> v2:172.21.15.167:3300/0 conn(0x7fcc400b3730 0x7fcc4015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.115+0000 7fcc3e59c640 1 -- 172.21.15.55:0/3261171817 >> v1:172.21.15.167:6789/0 conn(0x7fcc40071570 legacy=0x7fcc4015daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:38.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.115+0000 7fcc3e59c640 1 -- 172.21.15.55:0/3261171817 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4006db10 con 0x7fcc40071190 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.116+0000 7fcc3e59c640 1 --2- 172.21.15.55:0/3261171817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc40071190 0x7fcc400ae9a0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000aa10 tx=0x7fcc3002b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d577a915f3e12d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.116+0000 7fcc3dd9b640 1 -- 172.21.15.55:0/3261171817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3000b040 con 0x7fcc40071190 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.116+0000 7fcc3dd9b640 1 -- 172.21.15.55:0/3261171817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc30032600 con 0x7fcc40071190 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.116+0000 7fcc3dd9b640 1 -- 172.21.15.55:0/3261171817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc300329d0 con 0x7fcc40071190 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.116+0000 7fcc448b3640 1 -- 172.21.15.55:0/3261171817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc40071190 msgr2=0x7fcc400ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.116+0000 7fcc448b3640 1 --2- 172.21.15.55:0/3261171817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc40071190 0x7fcc400ae9a0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000aa10 tx=0x7fcc3002b610 comp rx=0 tx=0).stop 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.116+0000 7fcc448b3640 1 -- 172.21.15.55:0/3261171817 shutdown_connections 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.116+0000 7fcc448b3640 1 --2- 172.21.15.55:0/3261171817 >> v2:172.21.15.167:3300/0 conn(0x7fcc400b3730 0x7fcc4015e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.116+0000 7fcc448b3640 1 --2- 172.21.15.55:0/3261171817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc40071190 0x7fcc400ae9a0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.116+0000 7fcc448b3640 1 -- 172.21.15.55:0/3261171817 >> 172.21.15.55:0/3261171817 conn(0x7fcc4006aba0 msgr2=0x7fcc4006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.116+0000 7fcc448b3640 1 -- 172.21.15.55:0/3261171817 shutdown_connections 2024-04-25T09:01:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.117+0000 7fcc448b3640 1 -- 172.21.15.55:0/3261171817 wait complete. 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.118+0000 7fcc448b3640 1 Processor -- start 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.118+0000 7fcc448b3640 1 -- start start 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc448b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc40071190 0x7fcc401f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc448b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc40071570 0x7fcc401f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc448b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc400b3730 0x7fcc40158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc448b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc40071a00 con 0x7fcc40071190 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc448b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4006e0d0 con 0x7fcc400b3730 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc448b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4006e8b0 con 0x7fcc40071570 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc3e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc40071190 0x7fcc401f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc3e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc40071190 0x7fcc401f2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40580/0 (socket says 172.21.15.55:40580) 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc3e59c640 1 -- 172.21.15.55:0/3162823285 learned_addr learned my addr 172.21.15.55:0/3162823285 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc3ed9d640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc400b3730 0x7fcc40158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc35d9b640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc40071570 0x7fcc401f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc3e59c640 1 -- 172.21.15.55:0/3162823285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc40071570 msgr2=0x7fcc401f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc3e59c640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc40071570 0x7fcc401f2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc3e59c640 1 -- 172.21.15.55:0/3162823285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc400b3730 msgr2=0x7fcc40158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc3e59c640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc400b3730 0x7fcc40158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc3e59c640 1 -- 172.21.15.55:0/3162823285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc401f3560 con 0x7fcc40071190 2024-04-25T09:01:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.119+0000 7fcc3e59c640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc40071190 0x7fcc401f2630 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fcc30000c00 tx=0x7fcc300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.120+0000 7fcc377fe640 1 -- 172.21.15.55:0/3162823285 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc300319c0 con 0x7fcc40071190 2024-04-25T09:01:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.120+0000 7fcc377fe640 1 -- 172.21.15.55:0/3162823285 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc30031b60 con 0x7fcc40071190 2024-04-25T09:01:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.120+0000 7fcc448b3640 1 -- 172.21.15.55:0/3162823285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc401f38a0 con 0x7fcc40071190 2024-04-25T09:01:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.120+0000 7fcc377fe640 1 -- 172.21.15.55:0/3162823285 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30004030 con 0x7fcc40071190 2024-04-25T09:01:38.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.120+0000 7fcc448b3640 1 -- 172.21.15.55:0/3162823285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc401f40e0 con 0x7fcc40071190 2024-04-25T09:01:38.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.121+0000 7fcc448b3640 1 -- 172.21.15.55:0/3162823285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc400749b0 con 0x7fcc40071190 2024-04-25T09:01:38.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.121+0000 7fcc377fe640 1 -- 172.21.15.55:0/3162823285 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc300041d0 con 0x7fcc40071190 2024-04-25T09:01:38.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.122+0000 7fcc377fe640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc2006b4d0 0x7fcc2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.122+0000 7fcc377fe640 1 -- 172.21.15.55:0/3162823285 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fcc300aac20 con 0x7fcc40071190 2024-04-25T09:01:38.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.122+0000 7fcc35d9b640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc2006b4d0 0x7fcc2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.122+0000 7fcc35d9b640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc2006b4d0 0x7fcc2006d990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcc280017f0 tx=0x7fcc28009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:38.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.126+0000 7fcc377fe640 1 -- 172.21.15.55:0/3162823285 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc401f38a0 con 0x7fcc40071190 2024-04-25T09:01:38.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.343+0000 7fcc448b3640 1 -- 172.21.15.55:0/3162823285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc400cf360 con 0x7fcc40071190 2024-04-25T09:01:38.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.344+0000 7fcc377fe640 1 -- 172.21.15.55:0/3162823285 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fcc3003f020 con 0x7fcc40071190 2024-04-25T09:01:38.333 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:38.333 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T09:01:01.173411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7872":{"gid":7872,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/2841450668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2841450668},{"type":"v1","addr":"172.21.15.55:6837","nonce":2841450668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:01:38.333 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 64 2024-04-25T09:01:38.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 -- 172.21.15.55:0/3162823285 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc2006b4d0 msgr2=0x7fcc2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc2006b4d0 0x7fcc2006d990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcc280017f0 tx=0x7fcc28009040 comp rx=0 tx=0).stop 2024-04-25T09:01:38.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 -- 172.21.15.55:0/3162823285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc40071190 msgr2=0x7fcc401f2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc40071190 0x7fcc401f2630 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fcc30000c00 tx=0x7fcc300046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 -- 172.21.15.55:0/3162823285 shutdown_connections 2024-04-25T09:01:38.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcc2006b4d0 0x7fcc2006d990 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc400b3730 0x7fcc40158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc40071570 0x7fcc401f2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 --2- 172.21.15.55:0/3162823285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc40071190 0x7fcc401f2630 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 -- 172.21.15.55:0/3162823285 >> 172.21.15.55:0/3162823285 conn(0x7fcc4006aba0 msgr2=0x7fcc4015da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:38.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 -- 172.21.15.55:0/3162823285 shutdown_connections 2024-04-25T09:01:38.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.346+0000 7fcc448b3640 1 -- 172.21.15.55:0/3162823285 wait complete. 2024-04-25T09:01:38.346 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:38.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.458+0000 7f62bd38b640 1 Processor -- start 2024-04-25T09:01:38.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.458+0000 7f62bd38b640 1 -- start start 2024-04-25T09:01:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.459+0000 7f62bd38b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b8071190 0x7f62b80ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.459+0000 7f62bd38b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62b8071570 0x7f62b815daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.459+0000 7f62bd38b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b806d550 con 0x7f62b815e030 2024-04-25T09:01:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.459+0000 7f62bd38b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b80aeee0 con 0x7f62b8071570 2024-04-25T09:01:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.459+0000 7f62bd38b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b806d830 con 0x7f62b8071190 2024-04-25T09:01:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.459+0000 7f62b67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62b8071570 0x7f62b815daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.459+0000 7f62b67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62b8071570 0x7f62b815daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40582/0 (socket says 172.21.15.55:40582) 2024-04-25T09:01:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.459+0000 7f62b67fc640 1 -- 172.21.15.55:0/1959522983 learned_addr learned my addr 172.21.15.55:0/1959522983 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.459+0000 7f62b6ffd640 1 --2- 172.21.15.55:0/1959522983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b8071190 0x7f62b80ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.460+0000 7f62b67fc640 1 -- 172.21.15.55:0/1959522983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b8071190 msgr2=0x7f62b80ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.460+0000 7f62b67fc640 1 --2- 172.21.15.55:0/1959522983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b8071190 0x7f62b80ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.460+0000 7f62b67fc640 1 -- 172.21.15.55:0/1959522983 >> v1:172.21.15.167:6789/0 conn(0x7f62b815e030 legacy=0x7f62b80b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.460+0000 7f62b67fc640 1 -- 172.21.15.55:0/1959522983 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b806db10 con 0x7f62b8071570 2024-04-25T09:01:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.460+0000 7f62b67fc640 1 --2- 172.21.15.55:0/1959522983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62b8071570 0x7f62b815daf0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f62a000aa10 tx=0x7f62a002b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d435256689a7d5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.460+0000 7f62b5ffb640 1 -- 172.21.15.55:0/1959522983 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a000b040 con 0x7f62b8071570 2024-04-25T09:01:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.461+0000 7f62b5ffb640 1 -- 172.21.15.55:0/1959522983 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a0030710 con 0x7f62b8071570 2024-04-25T09:01:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.461+0000 7f62b5ffb640 1 -- 172.21.15.55:0/1959522983 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0030ae0 con 0x7f62b8071570 2024-04-25T09:01:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.461+0000 7f62bd38b640 1 -- 172.21.15.55:0/1959522983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62b8071570 msgr2=0x7f62b815daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.461+0000 7f62bd38b640 1 --2- 172.21.15.55:0/1959522983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62b8071570 0x7f62b815daf0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f62a000aa10 tx=0x7f62a002b610 comp rx=0 tx=0).stop 2024-04-25T09:01:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.461+0000 7f62bd38b640 1 -- 172.21.15.55:0/1959522983 shutdown_connections 2024-04-25T09:01:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.461+0000 7f62bd38b640 1 --2- 172.21.15.55:0/1959522983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62b8071570 0x7f62b815daf0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.461+0000 7f62bd38b640 1 --2- 172.21.15.55:0/1959522983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b8071190 0x7f62b80ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.461+0000 7f62bd38b640 1 -- 172.21.15.55:0/1959522983 >> 172.21.15.55:0/1959522983 conn(0x7f62b806aba0 msgr2=0x7f62b806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.461+0000 7f62bd38b640 1 -- 172.21.15.55:0/1959522983 shutdown_connections 2024-04-25T09:01:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.461+0000 7f62bd38b640 1 -- 172.21.15.55:0/1959522983 wait complete. 2024-04-25T09:01:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.462+0000 7f62bd38b640 1 Processor -- start 2024-04-25T09:01:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.462+0000 7f62bd38b640 1 -- start start 2024-04-25T09:01:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.463+0000 7f62bd38b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62b8071190 0x7f62b81f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.463+0000 7f62bd38b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b8071570 0x7f62b80afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.463+0000 7f62bd38b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62b815e030 0x7f62b80cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.463+0000 7f62bd38b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b806e8b0 con 0x7f62b815e030 2024-04-25T09:01:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.463+0000 7f62bd38b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b806e0d0 con 0x7f62b8071190 2024-04-25T09:01:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.463+0000 7f62bd38b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80719d0 con 0x7f62b8071570 2024-04-25T09:01:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.463+0000 7f62b77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62b815e030 0x7f62b80cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.463+0000 7f62b77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62b815e030 0x7f62b80cf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40584/0 (socket says 172.21.15.55:40584) 2024-04-25T09:01:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.463+0000 7f62b77fe640 1 -- 172.21.15.55:0/2334572455 learned_addr learned my addr 172.21.15.55:0/2334572455 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62b67fc640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b8071570 0x7f62b80afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62b6ffd640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62b8071190 0x7f62b81f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62b77fe640 1 -- 172.21.15.55:0/2334572455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b8071570 msgr2=0x7f62b80afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62b77fe640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b8071570 0x7f62b80afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62b77fe640 1 -- 172.21.15.55:0/2334572455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62b8071190 msgr2=0x7f62b81f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62b77fe640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62b8071190 0x7f62b81f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62b77fe640 1 -- 172.21.15.55:0/2334572455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b80b03e0 con 0x7f62b815e030 2024-04-25T09:01:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62b6ffd640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62b8071190 0x7f62b81f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62b77fe640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62b815e030 0x7f62b80cf5c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f62a800c6e0 tx=0x7f62a800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:38.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62af7fe640 1 -- 172.21.15.55:0/2334572455 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8003b70 con 0x7f62b815e030 2024-04-25T09:01:38.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62af7fe640 1 -- 172.21.15.55:0/2334572455 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a8003d30 con 0x7f62b815e030 2024-04-25T09:01:38.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62bd38b640 1 -- 172.21.15.55:0/2334572455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b80b06c0 con 0x7f62b815e030 2024-04-25T09:01:38.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62af7fe640 1 -- 172.21.15.55:0/2334572455 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8005310 con 0x7f62b815e030 2024-04-25T09:01:38.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.464+0000 7f62bd38b640 1 -- 172.21.15.55:0/2334572455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b80b0c80 con 0x7f62b815e030 2024-04-25T09:01:38.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.465+0000 7f62bd38b640 1 -- 172.21.15.55:0/2334572455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b80749b0 con 0x7f62b815e030 2024-04-25T09:01:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.466+0000 7f62af7fe640 1 -- 172.21.15.55:0/2334572455 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f62a80054b0 con 0x7f62b815e030 2024-04-25T09:01:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.466+0000 7f62af7fe640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f629806b500 0x7f629806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.466+0000 7f62af7fe640 1 -- 172.21.15.55:0/2334572455 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f62a808a160 con 0x7f62b815e030 2024-04-25T09:01:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.466+0000 7f62b6ffd640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f629806b500 0x7f629806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.467+0000 7f62b6ffd640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f629806b500 0x7f629806d9c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f62b81534e0 tx=0x7f62b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.470+0000 7f62af7fe640 1 -- 172.21.15.55:0/2334572455 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f62a8058f10 con 0x7f62b815e030 2024-04-25T09:01:38.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.649+0000 7f62bd38b640 1 -- 172.21.15.55:0/2334572455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62b806e470 con 0x7f62b815e030 2024-04-25T09:01:38.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.651+0000 7f62af7fe640 1 -- 172.21.15.55:0/2334572455 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16969 (secure 0 0 0) 0x7f62a8058810 con 0x7f62b815e030 2024-04-25T09:01:38.640 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:38.640 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:00:58.145570+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:31.118316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:31.794522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.26","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3282261214":"2024-04-26T09:00:58.145549+0000","172.21.15.55:6835/3282261214":"2024-04-26T09:00:58.145549+0000","172.21.15.55:6837/3953928431":"2024-04-26T08:59:46.600027+0000","172.21.15.55:6835/3953928431":"2024-04-26T08:59:46.600027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.652+0000 7f62bd38b640 1 -- 172.21.15.55:0/2334572455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f629806b500 msgr2=0x7f629806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.652+0000 7f62bd38b640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f629806b500 0x7f629806d9c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f62b81534e0 tx=0x7f62b0008040 comp rx=0 tx=0).stop 2024-04-25T09:01:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.652+0000 7f62bd38b640 1 -- 172.21.15.55:0/2334572455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62b815e030 msgr2=0x7f62b80cf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.652+0000 7f62bd38b640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62b815e030 0x7f62b80cf5c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f62a800c6e0 tx=0x7f62a800cba0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.653+0000 7f62bd38b640 1 -- 172.21.15.55:0/2334572455 shutdown_connections 2024-04-25T09:01:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.653+0000 7f62bd38b640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f629806b500 0x7f629806d9c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.653+0000 7f62bd38b640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62b815e030 0x7f62b80cf5c0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.653+0000 7f62bd38b640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b8071570 0x7f62b80afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.653+0000 7f62bd38b640 1 --2- 172.21.15.55:0/2334572455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62b8071190 0x7f62b81f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.653+0000 7f62bd38b640 1 -- 172.21.15.55:0/2334572455 >> 172.21.15.55:0/2334572455 conn(0x7f62b806aba0 msgr2=0x7f62b814e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:38.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.653+0000 7f62bd38b640 1 -- 172.21.15.55:0/2334572455 shutdown_connections 2024-04-25T09:01:38.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.653+0000 7f62bd38b640 1 -- 172.21.15.55:0/2334572455 wait complete. 2024-04-25T09:01:38.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:59:31.118316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:59:31.794522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:01:38.654 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:01:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.769+0000 7f52d50cd640 1 Processor -- start 2024-04-25T09:01:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.769+0000 7f52d50cd640 1 -- start start 2024-04-25T09:01:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52d50cd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0144e70 0x7f52d006d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52d50cd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52d00cf0e0 0x7f52d00cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52d50cd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d006dcb0 con 0x7f52d006d7a0 2024-04-25T09:01:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52d50cd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d015bfe0 con 0x7f52d00cf0e0 2024-04-25T09:01:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52d50cd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d006df90 con 0x7f52d0144e70 2024-04-25T09:01:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52ce59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f52d006d7a0 0x7f52d00ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60622/0 (socket says 172.21.15.55:60622) 2024-04-25T09:01:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52ce59c640 1 -- 172.21.15.55:0/2137862979 learned_addr learned my addr 172.21.15.55:0/2137862979 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cf59e640 1 --2- 172.21.15.55:0/2137862979 >> v2:172.21.15.167:3300/0 conn(0x7f52d00cf0e0 0x7f52d00cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019080290 0 0) 0x7f52d006dcb0 con 0x7f52d006d7a0 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc003520 con 0x7f52d006d7a0 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52ced9d640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0144e70 0x7f52d006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2812684832 0 0) 0x7f52bc003520 con 0x7f52d006d7a0 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0144e70 msgr2=0x7f52d006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cdd9b640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0144e70 0x7f52d006d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 >> v2:172.21.15.167:3300/0 conn(0x7f52d00cf0e0 msgr2=0x7f52d00cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cdd9b640 1 --2- 172.21.15.55:0/2137862979 >> v2:172.21.15.167:3300/0 conn(0x7f52d00cf0e0 0x7f52d00cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d006e270 con 0x7f52d006d7a0 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f52b8001690 con 0x7f52d006d7a0 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52ced9d640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0144e70 0x7f52d006d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cf59e640 1 --2- 172.21.15.55:0/2137862979 >> v2:172.21.15.167:3300/0 conn(0x7f52d00cf0e0 0x7f52d00cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.770+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 >> v1:172.21.15.55:6789/0 conn(0x7f52d006d7a0 legacy=0x7f52d00ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52cdd9b640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52cdd9b640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52bc004800 0x7f52bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52cdd9b640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0144e70 0x7f52bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d015bfe0 con 0x7f52bc0039b0 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d006df90 con 0x7f52bc004800 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc00baf0 con 0x7f52d0144e70 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52ced9d640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52ce59c640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52bc004800 0x7f52bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52cf59e640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0144e70 0x7f52bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52ced9d640 1 -- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0144e70 msgr2=0x7f52bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52ced9d640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0144e70 0x7f52bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52ced9d640 1 -- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52bc004800 msgr2=0x7f52bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52ced9d640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52bc004800 0x7f52bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52ced9d640 1 -- 172.21.15.55:0/2137862979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc003520 con 0x7f52bc0039b0 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.771+0000 7f52ce59c640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52bc004800 0x7f52bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.772+0000 7f52ced9d640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52bc003dd0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f52c00073b0 tx=0x7f52bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcafb637750ce7df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.772+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0009c80 con 0x7f52bc0039b0 2024-04-25T09:01:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.772+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c002e620 con 0x7f52bc0039b0 2024-04-25T09:01:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.772+0000 7f52cdd9b640 1 -- 172.21.15.55:0/2137862979 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c002e9d0 con 0x7f52bc0039b0 2024-04-25T09:01:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.772+0000 7f52d50cd640 1 -- 172.21.15.55:0/2137862979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 msgr2=0x7f52bc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.772+0000 7f52d50cd640 1 --2- 172.21.15.55:0/2137862979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52bc003dd0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f52c00073b0 tx=0x7f52bc005830 comp rx=0 tx=0).stop 2024-04-25T09:01:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.772+0000 7f52cf59e640 1 -- 172.21.15.55:0/2137862979 reap_dead start 2024-04-25T09:01:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.772+0000 7f52d50cd640 1 -- 172.21.15.55:0/2137862979 shutdown_connections 2024-04-25T09:01:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.772+0000 7f52d50cd640 1 -- 172.21.15.55:0/2137862979 >> 172.21.15.55:0/2137862979 conn(0x7f52d006aba0 msgr2=0x7f52d006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.772+0000 7f52d50cd640 1 -- 172.21.15.55:0/2137862979 shutdown_connections 2024-04-25T09:01:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.772+0000 7f52d50cd640 1 -- 172.21.15.55:0/2137862979 wait complete. 2024-04-25T09:01:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.774+0000 7f52d50cd640 1 Processor -- start 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.774+0000 7f52d50cd640 1 -- start start 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52d50cd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52d0143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52d50cd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0143c80 0x7f52d015e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52d50cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d015eb40 0x7f52d015c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52d50cd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0145630 con 0x7f52bc0039b0 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52d50cd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d01454b0 con 0x7f52d015eb40 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52d50cd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d006d260 con 0x7f52d0143c80 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52ced9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52d0143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52ced9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52d0143740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52082/0 (socket says 172.21.15.55:52082) 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52ced9d640 1 -- 172.21.15.55:0/3842519527 learned_addr learned my addr 172.21.15.55:0/3842519527 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52ce59c640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0143c80 0x7f52d015e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52cf59e640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d015eb40 0x7f52d015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52ced9d640 1 -- 172.21.15.55:0/3842519527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0143c80 msgr2=0x7f52d015e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52ced9d640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0143c80 0x7f52d015e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52ced9d640 1 -- 172.21.15.55:0/3842519527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d015eb40 msgr2=0x7f52d015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52ced9d640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d015eb40 0x7f52d015c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52ced9d640 1 -- 172.21.15.55:0/3842519527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d015cfb0 con 0x7f52bc0039b0 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52ced9d640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52d0143740 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f52c00074d0 tx=0x7f52c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52c77fe640 1 -- 172.21.15.55:0/3842519527 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0009c80 con 0x7f52bc0039b0 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.775+0000 7f52c77fe640 1 -- 172.21.15.55:0/3842519527 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c00369c0 con 0x7f52bc0039b0 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.776+0000 7f52d50cd640 1 -- 172.21.15.55:0/3842519527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d00af510 con 0x7f52bc0039b0 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.776+0000 7f52c77fe640 1 -- 172.21.15.55:0/3842519527 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0036db0 con 0x7f52bc0039b0 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.776+0000 7f52d50cd640 1 -- 172.21.15.55:0/3842519527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d00afad0 con 0x7f52bc0039b0 2024-04-25T09:01:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.776+0000 7f52d50cd640 1 -- 172.21.15.55:0/3842519527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d00750b0 con 0x7f52bc0039b0 2024-04-25T09:01:38.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.777+0000 7f52c77fe640 1 -- 172.21.15.55:0/3842519527 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f52c0049400 con 0x7f52bc0039b0 2024-04-25T09:01:38.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.777+0000 7f52c77fe640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52b006b4d0 0x7f52b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:38.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.777+0000 7f52c77fe640 1 -- 172.21.15.55:0/3842519527 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f52c00ab2b0 con 0x7f52bc0039b0 2024-04-25T09:01:38.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.777+0000 7f52ce59c640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52b006b4d0 0x7f52b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:38.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.778+0000 7f52ce59c640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52b006b4d0 0x7f52b006d990 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f52b8001880 tx=0x7f52b8007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:38.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.782+0000 7f52c77fe640 1 -- 172.21.15.55:0/3842519527 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52c003d070 con 0x7f52bc0039b0 2024-04-25T09:01:38.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.964+0000 7f52d50cd640 1 -- 172.21.15.55:0/3842519527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52d00aebe0 con 0x7f52bc0039b0 2024-04-25T09:01:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.964+0000 7f52c77fe640 1 -- 172.21.15.55:0/3842519527 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52c0032030 con 0x7f52bc0039b0 2024-04-25T09:01:38.953 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:01:38.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 -- 172.21.15.55:0/3842519527 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52b006b4d0 msgr2=0x7f52b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52b006b4d0 0x7f52b006d990 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f52b8001880 tx=0x7f52b8007040 comp rx=0 tx=0).stop 2024-04-25T09:01:38.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 -- 172.21.15.55:0/3842519527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 msgr2=0x7f52d0143740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:38.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52d0143740 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f52c00074d0 tx=0x7f52c0004ab0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 -- 172.21.15.55:0/3842519527 shutdown_connections 2024-04-25T09:01:38.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52b006b4d0 0x7f52b006d990 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d015eb40 0x7f52d015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d0143c80 0x7f52d015e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 --2- 172.21.15.55:0/3842519527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52d0143740 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:38.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 -- 172.21.15.55:0/3842519527 >> 172.21.15.55:0/3842519527 conn(0x7f52d006aba0 msgr2=0x7f52d00b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:38.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 -- 172.21.15.55:0/3842519527 shutdown_connections 2024-04-25T09:01:38.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:38.966+0000 7f52d50cd640 1 -- 172.21.15.55:0/3842519527 wait complete. 2024-04-25T09:01:38.966 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:01:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.081+0000 7febb305d640 1 Processor -- start 2024-04-25T09:01:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.081+0000 7febb305d640 1 -- start start 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb305d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7febac0b7030 0x7febac0b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb305d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7febac0ce230 0x7febac0ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb305d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac0cfcf0 con 0x7febac15ba70 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb305d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac0cffd0 con 0x7febac0ce230 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb305d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac0d02b0 con 0x7febac0b7030 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb15fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7febac0ce230 0x7febac0ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb15fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7febac0ce230 0x7febac0ce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52090/0 (socket says 172.21.15.55:52090) 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb15fa640 1 -- 172.21.15.55:0/2047663962 learned_addr learned my addr 172.21.15.55:0/2047663962 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febabfff640 1 --2- 172.21.15.55:0/2047663962 >> v2:172.21.15.167:3300/0 conn(0x7febac0b7030 0x7febac0b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb15fa640 1 -- 172.21.15.55:0/2047663962 >> v2:172.21.15.167:3300/0 conn(0x7febac0b7030 msgr2=0x7febac0b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb15fa640 1 --2- 172.21.15.55:0/2047663962 >> v2:172.21.15.167:3300/0 conn(0x7febac0b7030 0x7febac0b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb15fa640 1 -- 172.21.15.55:0/2047663962 >> v1:172.21.15.167:6789/0 conn(0x7febac15ba70 legacy=0x7febac0d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.082+0000 7febb15fa640 1 -- 172.21.15.55:0/2047663962 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0d0590 con 0x7febac0ce230 2024-04-25T09:01:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.083+0000 7febb15fa640 1 --2- 172.21.15.55:0/2047663962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac0ce230 0x7febac0ce650 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7febac0b43f0 tx=0x7feba402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bf4d6d6beec88f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.083+0000 7febab7fe640 1 -- 172.21.15.55:0/2047663962 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4036070 con 0x7febac0ce230 2024-04-25T09:01:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.083+0000 7febab7fe640 1 -- 172.21.15.55:0/2047663962 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba4031600 con 0x7febac0ce230 2024-04-25T09:01:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.083+0000 7febab7fe640 1 -- 172.21.15.55:0/2047663962 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba40319d0 con 0x7febac0ce230 2024-04-25T09:01:39.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.084+0000 7febb305d640 1 -- 172.21.15.55:0/2047663962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac0ce230 msgr2=0x7febac0ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.084+0000 7febb305d640 1 --2- 172.21.15.55:0/2047663962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac0ce230 0x7febac0ce650 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7febac0b43f0 tx=0x7feba402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.084+0000 7febb305d640 1 -- 172.21.15.55:0/2047663962 shutdown_connections 2024-04-25T09:01:39.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.084+0000 7febb305d640 1 --2- 172.21.15.55:0/2047663962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac0ce230 0x7febac0ce650 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.084+0000 7febb305d640 1 --2- 172.21.15.55:0/2047663962 >> v2:172.21.15.167:3300/0 conn(0x7febac0b7030 0x7febac0b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.084+0000 7febb305d640 1 -- 172.21.15.55:0/2047663962 >> 172.21.15.55:0/2047663962 conn(0x7febac06f4a0 msgr2=0x7febac06f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:39.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.084+0000 7febb305d640 1 -- 172.21.15.55:0/2047663962 shutdown_connections 2024-04-25T09:01:39.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.084+0000 7febb305d640 1 -- 172.21.15.55:0/2047663962 wait complete. 2024-04-25T09:01:39.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.085+0000 7febb305d640 1 Processor -- start 2024-04-25T09:01:39.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.085+0000 7febb305d640 1 -- start start 2024-04-25T09:01:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb305d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac0b7030 0x7febac0b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb305d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febac0ce230 0x7febac0b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb305d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac15ba70 0x7febac0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb305d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0cf980 con 0x7febac0b7030 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb305d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0ceb90 con 0x7febac15ba70 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb305d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac15be50 con 0x7febac0ce230 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb0df9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac0b7030 0x7febac0b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb0df9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac0b7030 0x7febac0b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52102/0 (socket says 172.21.15.55:52102) 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb0df9640 1 -- 172.21.15.55:0/3049616712 learned_addr learned my addr 172.21.15.55:0/3049616712 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febabfff640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febac0ce230 0x7febac0b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb15fa640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac15ba70 0x7febac0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb0df9640 1 -- 172.21.15.55:0/3049616712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febac0ce230 msgr2=0x7febac0b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb0df9640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febac0ce230 0x7febac0b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb0df9640 1 -- 172.21.15.55:0/3049616712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac15ba70 msgr2=0x7febac0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb0df9640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac15ba70 0x7febac0b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.086+0000 7febb0df9640 1 -- 172.21.15.55:0/3049616712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac1f1460 con 0x7febac0b7030 2024-04-25T09:01:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.087+0000 7febb0df9640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac0b7030 0x7febac0b5540 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7feba000c3c0 tx=0x7feba000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.087+0000 7feba97fa640 1 -- 172.21.15.55:0/3049616712 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba00052d0 con 0x7febac0b7030 2024-04-25T09:01:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.087+0000 7feba97fa640 1 -- 172.21.15.55:0/3049616712 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba0005490 con 0x7febac0b7030 2024-04-25T09:01:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.087+0000 7feba97fa640 1 -- 172.21.15.55:0/3049616712 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0007260 con 0x7febac0b7030 2024-04-25T09:01:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.087+0000 7febb305d640 1 -- 172.21.15.55:0/3049616712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac1f1720 con 0x7febac0b7030 2024-04-25T09:01:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.087+0000 7febb305d640 1 -- 172.21.15.55:0/3049616712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac1f1ce0 con 0x7febac0b7030 2024-04-25T09:01:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.088+0000 7febb305d640 1 -- 172.21.15.55:0/3049616712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac0750b0 con 0x7febac0b7030 2024-04-25T09:01:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.088+0000 7feba97fa640 1 -- 172.21.15.55:0/3049616712 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feba0007400 con 0x7febac0b7030 2024-04-25T09:01:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.089+0000 7feba97fa640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb9006b4d0 0x7feb9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.089+0000 7feba97fa640 1 -- 172.21.15.55:0/3049616712 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7feba00896d0 con 0x7febac0b7030 2024-04-25T09:01:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.089+0000 7febabfff640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb9006b4d0 0x7feb9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.089+0000 7febabfff640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb9006b4d0 0x7feb9006d990 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7febac149b40 tx=0x7feb98008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:39.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.093+0000 7feba97fa640 1 -- 172.21.15.55:0/3049616712 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feba0058510 con 0x7febac0b7030 2024-04-25T09:01:39.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.277+0000 7febb305d640 1 -- 172.21.15.55:0/3049616712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7febac0cbcb0 con 0x7febac0b7030 2024-04-25T09:01:39.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.278+0000 7feba97fa640 1 -- 172.21.15.55:0/3049616712 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7feba0057e10 con 0x7febac0b7030 2024-04-25T09:01:39.266 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T09:01:39.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.279+0000 7febb305d640 1 -- 172.21.15.55:0/3049616712 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb9006b4d0 msgr2=0x7feb9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.279+0000 7febb305d640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb9006b4d0 0x7feb9006d990 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7febac149b40 tx=0x7feb98008040 comp rx=0 tx=0).stop 2024-04-25T09:01:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.279+0000 7febb305d640 1 -- 172.21.15.55:0/3049616712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac0b7030 msgr2=0x7febac0b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.279+0000 7febb305d640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac0b7030 0x7febac0b5540 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7feba000c3c0 tx=0x7feba000c880 comp rx=0 tx=0).stop 2024-04-25T09:01:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.280+0000 7febb305d640 1 -- 172.21.15.55:0/3049616712 shutdown_connections 2024-04-25T09:01:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.280+0000 7febb305d640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb9006b4d0 0x7feb9006d990 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.280+0000 7febb305d640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febac15ba70 0x7febac0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.280+0000 7febb305d640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febac0ce230 0x7febac0b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.280+0000 7febb305d640 1 --2- 172.21.15.55:0/3049616712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac0b7030 0x7febac0b5540 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.280+0000 7febb305d640 1 -- 172.21.15.55:0/3049616712 >> 172.21.15.55:0/3049616712 conn(0x7febac06f4a0 msgr2=0x7febac15c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.280+0000 7febb305d640 1 -- 172.21.15.55:0/3049616712 shutdown_connections 2024-04-25T09:01:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.280+0000 7febb305d640 1 -- 172.21.15.55:0/3049616712 wait complete. 2024-04-25T09:01:39.279 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:01:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.395+0000 7fbd960f5640 1 Processor -- start 2024-04-25T09:01:39.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.395+0000 7fbd960f5640 1 -- start start 2024-04-25T09:01:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.396+0000 7fbd960f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd9015dca0 0x7fbd900ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.396+0000 7fbd960f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd900d4090 con 0x7fbd900d1130 2024-04-25T09:01:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.396+0000 7fbd960f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd900d4370 con 0x7fbd900d3b90 2024-04-25T09:01:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.396+0000 7fbd960f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900b6b20 con 0x7fbd9015dca0 2024-04-25T09:01:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.396+0000 7fbd8ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbd900d1130 0x7fbd900b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60630/0 (socket says 172.21.15.55:60630) 2024-04-25T09:01:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.396+0000 7fbd8ffff640 1 -- 172.21.15.55:0/1373826801 learned_addr learned my addr 172.21.15.55:0/1373826801 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.396+0000 7fbd8f7fe640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd9015dca0 0x7fbd900ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.396+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25623628 0 0) 0x7fbd900d4090 con 0x7fbd900d1130 2024-04-25T09:01:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd78003520 con 0x7fbd900d1130 2024-04-25T09:01:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788887495 0 0) 0x7fbd900d4370 con 0x7fbd900d3b90 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd900d4090 con 0x7fbd900d3b90 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 720232771 0 0) 0x7fbd78003520 con 0x7fbd900d1130 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd9015dca0 msgr2=0x7fbd900ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd9015dca0 0x7fbd900ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 >> v1:172.21.15.167:6789/0 conn(0x7fbd900d3b90 legacy=0x7fbd900d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900d4650 con 0x7fbd900d1130 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fbd880019f0 con 0x7fbd900d1130 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 >> v1:172.21.15.55:6789/0 conn(0x7fbd900d1130 legacy=0x7fbd900b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd78003b70 0x7fbd78003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd78004800 0x7fbd78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd9015dca0 0x7fbd780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7800ba70 con 0x7fbd78003b70 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7800bbf0 con 0x7fbd78004800 2024-04-25T09:01:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7800bdf0 con 0x7fbd9015dca0 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8f7fe640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd78003b70 0x7fbd78003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8ffff640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd9015dca0 0x7fbd780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8effd640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd78004800 0x7fbd78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8f7fe640 1 -- 172.21.15.55:0/1373826801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd9015dca0 msgr2=0x7fbd780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8f7fe640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd9015dca0 0x7fbd780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8f7fe640 1 -- 172.21.15.55:0/1373826801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd78004800 msgr2=0x7fbd78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8f7fe640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd78004800 0x7fbd78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.397+0000 7fbd8f7fe640 1 -- 172.21.15.55:0/1373826801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd78003520 con 0x7fbd78003b70 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.398+0000 7fbd8f7fe640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd78003b70 0x7fbd78003f70 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009ac0 tx=0x7fbd78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960719ce804486a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.398+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80036070 con 0x7fbd78003b70 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.398+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd80031400 con 0x7fbd78003b70 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.398+0000 7fbd8e7fc640 1 -- 172.21.15.55:0/1373826801 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80009690 con 0x7fbd78003b70 2024-04-25T09:01:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.399+0000 7fbd960f5640 1 -- 172.21.15.55:0/1373826801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd78003b70 msgr2=0x7fbd78003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.399+0000 7fbd960f5640 1 --2- 172.21.15.55:0/1373826801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd78003b70 0x7fbd78003f70 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009ac0 tx=0x7fbd78005830 comp rx=0 tx=0).stop 2024-04-25T09:01:39.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.399+0000 7fbd8ffff640 1 -- 172.21.15.55:0/1373826801 reap_dead start 2024-04-25T09:01:39.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.399+0000 7fbd960f5640 1 -- 172.21.15.55:0/1373826801 shutdown_connections 2024-04-25T09:01:39.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.399+0000 7fbd960f5640 1 -- 172.21.15.55:0/1373826801 >> 172.21.15.55:0/1373826801 conn(0x7fbd900726c0 msgr2=0x7fbd90072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:39.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.399+0000 7fbd960f5640 1 -- 172.21.15.55:0/1373826801 shutdown_connections 2024-04-25T09:01:39.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.399+0000 7fbd960f5640 1 -- 172.21.15.55:0/1373826801 wait complete. 2024-04-25T09:01:39.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.400+0000 7fbd960f5640 1 Processor -- start 2024-04-25T09:01:39.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.400+0000 7fbd960f5640 1 -- start start 2024-04-25T09:01:39.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.401+0000 7fbd960f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd78003b70 0x7fbd90153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.401+0000 7fbd960f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd901f7a00 0x7fbd901f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.401+0000 7fbd960f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd900cab60 0x7fbd900b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.401+0000 7fbd960f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9015e200 con 0x7fbd901f7a00 2024-04-25T09:01:39.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.401+0000 7fbd960f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9015e080 con 0x7fbd78003b70 2024-04-25T09:01:39.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.401+0000 7fbd960f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900b8280 con 0x7fbd900cab60 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.401+0000 7fbd8effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd901f7a00 0x7fbd901f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.401+0000 7fbd8effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd901f7a00 0x7fbd901f4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52132/0 (socket says 172.21.15.55:52132) 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.401+0000 7fbd8effd640 1 -- 172.21.15.55:0/2311003510 learned_addr learned my addr 172.21.15.55:0/2311003510 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.401+0000 7fbd8f7fe640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd78003b70 0x7fbd90153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.401+0000 7fbd8ffff640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd900cab60 0x7fbd900b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd8effd640 1 -- 172.21.15.55:0/2311003510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd900cab60 msgr2=0x7fbd900b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd8effd640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd900cab60 0x7fbd900b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd8effd640 1 -- 172.21.15.55:0/2311003510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd78003b70 msgr2=0x7fbd90153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd8effd640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd78003b70 0x7fbd90153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd8effd640 1 -- 172.21.15.55:0/2311003510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd901f7e80 con 0x7fbd901f7a00 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd8ffff640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd900cab60 0x7fbd900b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd8effd640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd901f7a00 0x7fbd901f4b60 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400e780 tx=0x7fbd8400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd77fff640 1 -- 172.21.15.55:0/2311003510 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd840050d0 con 0x7fbd901f7a00 2024-04-25T09:01:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd77fff640 1 -- 172.21.15.55:0/2311003510 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd84018070 con 0x7fbd901f7a00 2024-04-25T09:01:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd960f5640 1 -- 172.21.15.55:0/2311003510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd901f52a0 con 0x7fbd901f7a00 2024-04-25T09:01:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd77fff640 1 -- 172.21.15.55:0/2311003510 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84005490 con 0x7fbd901f7a00 2024-04-25T09:01:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.402+0000 7fbd960f5640 1 -- 172.21.15.55:0/2311003510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd901f5860 con 0x7fbd901f7a00 2024-04-25T09:01:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.403+0000 7fbd960f5640 1 -- 172.21.15.55:0/2311003510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd900750b0 con 0x7fbd901f7a00 2024-04-25T09:01:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.403+0000 7fbd77fff640 1 -- 172.21.15.55:0/2311003510 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd8400c6c0 con 0x7fbd901f7a00 2024-04-25T09:01:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.404+0000 7fbd77fff640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd7c06b500 0x7fbd7c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.404+0000 7fbd77fff640 1 -- 172.21.15.55:0/2311003510 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fbd8408a140 con 0x7fbd901f7a00 2024-04-25T09:01:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.404+0000 7fbd8f7fe640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd7c06b500 0x7fbd7c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.404+0000 7fbd8f7fe640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd7c06b500 0x7fbd7c06d9c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbd80033000 tx=0x7fbd80008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:39.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.408+0000 7fbd77fff640 1 -- 172.21.15.55:0/2311003510 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbd84058e70 con 0x7fbd901f7a00 2024-04-25T09:01:39.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.587+0000 7fbd960f5640 1 -- 172.21.15.55:0/2311003510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd90072ce0 con 0x7fbd901f7a00 2024-04-25T09:01:39.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.587+0000 7fbd77fff640 1 -- 172.21.15.55:0/2311003510 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd84058770 con 0x7fbd901f7a00 2024-04-25T09:01:39.576 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T09:01:39.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 -- 172.21.15.55:0/2311003510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd7c06b500 msgr2=0x7fbd7c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd7c06b500 0x7fbd7c06d9c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbd80033000 tx=0x7fbd80008030 comp rx=0 tx=0).stop 2024-04-25T09:01:39.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 -- 172.21.15.55:0/2311003510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd901f7a00 msgr2=0x7fbd901f4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd901f7a00 0x7fbd901f4b60 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400e780 tx=0x7fbd8400ec40 comp rx=0 tx=0).stop 2024-04-25T09:01:39.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 -- 172.21.15.55:0/2311003510 shutdown_connections 2024-04-25T09:01:39.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbd7c06b500 0x7fbd7c06d9c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd900cab60 0x7fbd900b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd901f7a00 0x7fbd901f4b60 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 --2- 172.21.15.55:0/2311003510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd78003b70 0x7fbd90153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 -- 172.21.15.55:0/2311003510 >> 172.21.15.55:0/2311003510 conn(0x7fbd900726c0 msgr2=0x7fbd900b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 -- 172.21.15.55:0/2311003510 shutdown_connections 2024-04-25T09:01:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.589+0000 7fbd960f5640 1 -- 172.21.15.55:0/2311003510 wait complete. 2024-04-25T09:01:39.589 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.702+0000 7f2368170640 1 Processor -- start 2024-04-25T09:01:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.702+0000 7f2368170640 1 -- start start 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.703+0000 7f2368170640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f236015ba10 0x7f2360099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.703+0000 7f2368170640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236006c900 con 0x7f2360099f80 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.703+0000 7f2368170640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236006cbe0 con 0x7f236006c3c0 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.703+0000 7f2368170640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600cbe50 con 0x7f236015ba10 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.703+0000 7f236570b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2360099f80 0x7f236006bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60632/0 (socket says 172.21.15.55:60632) 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.703+0000 7f236570b640 1 -- 172.21.15.55:0/1138224588 learned_addr learned my addr 172.21.15.55:0/1138224588 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2365f0c640 1 --2- 172.21.15.55:0/1138224588 >> v2:172.21.15.167:3300/0 conn(0x7f236015ba10 0x7f2360099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571347822 0 0) 0x7f236006c900 con 0x7f2360099f80 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2348003520 con 0x7f2360099f80 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1828913655 0 0) 0x7f2348003520 con 0x7f2360099f80 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 >> v2:172.21.15.167:3300/0 conn(0x7f236015ba10 msgr2=0x7f2360099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 --2- 172.21.15.55:0/1138224588 >> v2:172.21.15.167:3300/0 conn(0x7f236015ba10 0x7f2360099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 >> v1:172.21.15.167:6789/0 conn(0x7f236006c3c0 legacy=0x7f23600cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236006cec0 con 0x7f2360099f80 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f2354001670 con 0x7f2360099f80 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2365f0c640 1 --2- 172.21.15.55:0/1138224588 >> v2:172.21.15.167:3300/0 conn(0x7f236015ba10 0x7f2360099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 >> v1:172.21.15.55:6789/0 conn(0x7f2360099f80 legacy=0x7f236006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 --2- 172.21.15.55:0/1138224588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480039b0 0x7f2348003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 --2- 172.21.15.55:0/1138224588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2348004800 0x7f2348004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 --2- 172.21.15.55:0/1138224588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480051c0 0x7f234800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234800c030 con 0x7f23480051c0 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234800c1e0 con 0x7f2348004800 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234800c3e0 con 0x7f23480039b0 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f236670d640 1 --2- 172.21.15.55:0/1138224588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480051c0 0x7f234800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f2365f0c640 1 --2- 172.21.15.55:0/1138224588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480039b0 0x7f2348003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f236570b640 1 --2- 172.21.15.55:0/1138224588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2348004800 0x7f2348004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f236670d640 1 -- 172.21.15.55:0/1138224588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480039b0 msgr2=0x7f2348003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f236670d640 1 --2- 172.21.15.55:0/1138224588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480039b0 0x7f2348003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f236670d640 1 -- 172.21.15.55:0/1138224588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2348004800 msgr2=0x7f2348004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f236670d640 1 --2- 172.21.15.55:0/1138224588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2348004800 0x7f2348004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.704+0000 7f236670d640 1 -- 172.21.15.55:0/1138224588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2348003520 con 0x7f23480051c0 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.705+0000 7f236670d640 1 -- 172.21.15.55:0/1138224588 reap_dead start 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.705+0000 7f236670d640 1 --2- 172.21.15.55:0/1138224588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480051c0 0x7f234800b9c0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f2350001e20 tx=0x7f2348005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d627dbc5ccff4565 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.705+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350001a70 con 0x7f23480051c0 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.705+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235002ae40 con 0x7f23480051c0 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.705+0000 7f2364f0a640 1 -- 172.21.15.55:0/1138224588 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350003bb0 con 0x7f23480051c0 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.706+0000 7f2368170640 1 -- 172.21.15.55:0/1138224588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480051c0 msgr2=0x7f234800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.706+0000 7f2368170640 1 --2- 172.21.15.55:0/1138224588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480051c0 0x7f234800b9c0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f2350001e20 tx=0x7f2348005830 comp rx=0 tx=0).stop 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.706+0000 7f2368170640 1 -- 172.21.15.55:0/1138224588 shutdown_connections 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.706+0000 7f2368170640 1 --2- 172.21.15.55:0/1138224588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480051c0 0x7f234800b9c0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.706+0000 7f2368170640 1 -- 172.21.15.55:0/1138224588 >> 172.21.15.55:0/1138224588 conn(0x7f23600b32f0 msgr2=0x7f23600b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.706+0000 7f2368170640 1 -- 172.21.15.55:0/1138224588 shutdown_connections 2024-04-25T09:01:39.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.706+0000 7f2368170640 1 -- 172.21.15.55:0/1138224588 wait complete. 2024-04-25T09:01:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.707+0000 7f2368170640 1 Processor -- start 2024-04-25T09:01:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.707+0000 7f2368170640 1 -- start start 2024-04-25T09:01:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f2368170640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480051c0 0x7f2360154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f2368170640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236015e060 0x7f23600c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f2368170640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23600c5870 0x7f23600c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f2368170640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2360099dd0 con 0x7f236015e060 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f2368170640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2360099c50 con 0x7f23600c5870 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f2368170640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236009a3d0 con 0x7f23480051c0 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f236570b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236015e060 0x7f23600c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f236570b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236015e060 0x7f23600c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52142/0 (socket says 172.21.15.55:52142) 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f236570b640 1 -- 172.21.15.55:0/3700500375 learned_addr learned my addr 172.21.15.55:0/3700500375 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f2365f0c640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480051c0 0x7f2360154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f236570b640 1 -- 172.21.15.55:0/3700500375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480051c0 msgr2=0x7f2360154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f236570b640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480051c0 0x7f2360154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f236570b640 1 -- 172.21.15.55:0/3700500375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23600c5870 msgr2=0x7f23600c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f236670d640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23600c5870 0x7f23600c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f236570b640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23600c5870 0x7f23600c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f236570b640 1 -- 172.21.15.55:0/3700500375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600b6840 con 0x7f236015e060 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f236670d640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23600c5870 0x7f23600c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.708+0000 7f236570b640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236015e060 0x7f23600c5330 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f2354001050 tx=0x7f2354007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.709+0000 7f235e7fc640 1 -- 172.21.15.55:0/3700500375 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400f960 con 0x7f236015e060 2024-04-25T09:01:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.709+0000 7f235e7fc640 1 -- 172.21.15.55:0/3700500375 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354018070 con 0x7f236015e060 2024-04-25T09:01:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.709+0000 7f2368170640 1 -- 172.21.15.55:0/3700500375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236015ed00 con 0x7f236015e060 2024-04-25T09:01:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.709+0000 7f235e7fc640 1 -- 172.21.15.55:0/3700500375 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400fd80 con 0x7f236015e060 2024-04-25T09:01:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.709+0000 7f2368170640 1 -- 172.21.15.55:0/3700500375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23600c78c0 con 0x7f236015e060 2024-04-25T09:01:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.710+0000 7f2368170640 1 -- 172.21.15.55:0/3700500375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23600749b0 con 0x7f236015e060 2024-04-25T09:01:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.710+0000 7f235e7fc640 1 -- 172.21.15.55:0/3700500375 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f235401d460 con 0x7f236015e060 2024-04-25T09:01:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.710+0000 7f235e7fc640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f234c06b500 0x7f234c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.711+0000 7f235e7fc640 1 -- 172.21.15.55:0/3700500375 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f235408a2f0 con 0x7f236015e060 2024-04-25T09:01:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.711+0000 7f2365f0c640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f234c06b500 0x7f234c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.711+0000 7f2365f0c640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f234c06b500 0x7f234c06d9c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2358009af0 tx=0x7f2358008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:39.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.715+0000 7f235e7fc640 1 -- 172.21.15.55:0/3700500375 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f23540590a0 con 0x7f236015e060 2024-04-25T09:01:39.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.935+0000 7f2368170640 1 -- 172.21.15.55:0/3700500375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2360070720 con 0x7f236015e060 2024-04-25T09:01:39.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.936+0000 7f235e7fc640 1 -- 172.21.15.55:0/3700500375 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f23540589a0 con 0x7f236015e060 2024-04-25T09:01:39.925 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:39.925 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T09:01:01.173411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7872":{"gid":7872,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/2841450668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2841450668},{"type":"v1","addr":"172.21.15.55:6837","nonce":2841450668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:01:39.925 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 64 2024-04-25T09:01:39.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 -- 172.21.15.55:0/3700500375 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f234c06b500 msgr2=0x7f234c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f234c06b500 0x7f234c06d9c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2358009af0 tx=0x7f2358008040 comp rx=0 tx=0).stop 2024-04-25T09:01:39.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 -- 172.21.15.55:0/3700500375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236015e060 msgr2=0x7f23600c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:39.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236015e060 0x7f23600c5330 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f2354001050 tx=0x7f2354007720 comp rx=0 tx=0).stop 2024-04-25T09:01:39.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 -- 172.21.15.55:0/3700500375 shutdown_connections 2024-04-25T09:01:39.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f234c06b500 0x7f234c06d9c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23600c5870 0x7f23600c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236015e060 0x7f23600c5330 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 --2- 172.21.15.55:0/3700500375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480051c0 0x7f2360154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:39.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 -- 172.21.15.55:0/3700500375 >> 172.21.15.55:0/3700500375 conn(0x7f23600b32f0 msgr2=0x7f23600b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:39.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 -- 172.21.15.55:0/3700500375 shutdown_connections 2024-04-25T09:01:39.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:39.938+0000 7f2368170640 1 -- 172.21.15.55:0/3700500375 wait complete. 2024-04-25T09:01:39.938 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:40.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.051+0000 7f06e7c7c640 1 Processor -- start 2024-04-25T09:01:40.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.051+0000 7f06e7c7c640 1 -- start start 2024-04-25T09:01:40.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e7c7c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e015dce0 0x7f06e00d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e7c7c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e015e0c0 con 0x7f06e00b5b60 2024-04-25T09:01:40.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e7c7c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e00d2510 con 0x7f06e00d35b0 2024-04-25T09:01:40.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e7c7c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00d27f0 con 0x7f06e015dce0 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e6219640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f06e00b5b60 0x7f06e00b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60638/0 (socket says 172.21.15.55:60638) 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e6219640 1 -- 172.21.15.55:0/1933817642 learned_addr learned my addr 172.21.15.55:0/1933817642 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e5a18640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e015dce0 0x7f06e00d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661027921 0 0) 0x7f06e015e0c0 con 0x7f06e00b5b60 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06cc003520 con 0x7f06e00b5b60 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222523739 0 0) 0x7f06e00d2510 con 0x7f06e00d35b0 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e015e0c0 con 0x7f06e00d35b0 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2333178437 0 0) 0x7f06cc003520 con 0x7f06e00b5b60 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e015dce0 msgr2=0x7f06e00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e4a16640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e015dce0 0x7f06e00d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 >> v1:172.21.15.167:6789/0 conn(0x7f06e00d35b0 legacy=0x7f06e00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e00d2ad0 con 0x7f06e00b5b60 2024-04-25T09:01:40.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f06d80019f0 con 0x7f06e00b5b60 2024-04-25T09:01:40.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.052+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 >> v1:172.21.15.55:6789/0 conn(0x7f06e00b5b60 legacy=0x7f06e00b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e4a16640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 0x7f06cc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e4a16640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e015dce0 0x7f06cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e4a16640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06cc004d40 0x7f06cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00d27f0 con 0x7f06cc003b70 2024-04-25T09:01:40.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc00ba70 con 0x7f06cc004d40 2024-04-25T09:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc00bc20 con 0x7f06e015dce0 2024-04-25T09:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e5a18640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 0x7f06cc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e6219640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06cc004d40 0x7f06cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e5217640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e015dce0 0x7f06cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e5a18640 1 -- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e015dce0 msgr2=0x7f06cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e5a18640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e015dce0 0x7f06cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e5a18640 1 -- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06cc004d40 msgr2=0x7f06cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e5a18640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06cc004d40 0x7f06cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e5a18640 1 -- 172.21.15.55:0/1933817642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc003520 con 0x7f06cc003b70 2024-04-25T09:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.053+0000 7f06e6219640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06cc004d40 0x7f06cc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.054+0000 7f06e5a18640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 0x7f06cc003f70 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009ac0 tx=0x7f06cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1797f2679333e75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.054+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc036070 con 0x7f06cc003b70 2024-04-25T09:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.054+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc031400 con 0x7f06cc003b70 2024-04-25T09:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.054+0000 7f06e4a16640 1 -- 172.21.15.55:0/1933817642 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc009690 con 0x7f06cc003b70 2024-04-25T09:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.054+0000 7f06e7c7c640 1 -- 172.21.15.55:0/1933817642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 msgr2=0x7f06cc003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.054+0000 7f06e7c7c640 1 --2- 172.21.15.55:0/1933817642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 0x7f06cc003f70 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009ac0 tx=0x7f06cc005830 comp rx=0 tx=0).stop 2024-04-25T09:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.054+0000 7f06e6219640 1 -- 172.21.15.55:0/1933817642 reap_dead start 2024-04-25T09:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.054+0000 7f06e7c7c640 1 -- 172.21.15.55:0/1933817642 shutdown_connections 2024-04-25T09:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.054+0000 7f06e7c7c640 1 -- 172.21.15.55:0/1933817642 >> 172.21.15.55:0/1933817642 conn(0x7f06e0072900 msgr2=0x7f06e00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.054+0000 7f06e7c7c640 1 -- 172.21.15.55:0/1933817642 shutdown_connections 2024-04-25T09:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.054+0000 7f06e7c7c640 1 -- 172.21.15.55:0/1933817642 wait complete. 2024-04-25T09:01:40.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.056+0000 7f06e7c7c640 1 Processor -- start 2024-04-25T09:01:40.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.056+0000 7f06e7c7c640 1 -- start start 2024-04-25T09:01:40.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.056+0000 7f06e7c7c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 0x7f06e0158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.056+0000 7f06e7c7c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e01f76c0 0x7f06e01f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.056+0000 7f06e7c7c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06e01f6ff0 0x7f06e01f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.056+0000 7f06e7c7c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00b9820 con 0x7f06cc003b70 2024-04-25T09:01:40.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.056+0000 7f06e7c7c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00d3090 con 0x7f06e01f6ff0 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.056+0000 7f06e7c7c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00b99a0 con 0x7f06e01f76c0 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e5a18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 0x7f06e0158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e5a18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 0x7f06e0158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52164/0 (socket says 172.21.15.55:52164) 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e5a18640 1 -- 172.21.15.55:0/2540545006 learned_addr learned my addr 172.21.15.55:0/2540545006 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e5217640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e01f76c0 0x7f06e01f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e5a18640 1 -- 172.21.15.55:0/2540545006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e01f76c0 msgr2=0x7f06e01f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e5a18640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e01f76c0 0x7f06e01f6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e5a18640 1 -- 172.21.15.55:0/2540545006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06e01f6ff0 msgr2=0x7f06e01f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e5a18640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06e01f6ff0 0x7f06e01f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e5a18640 1 -- 172.21.15.55:0/2540545006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0159630 con 0x7f06cc003b70 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e5a18640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 0x7f06e0158420 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009ac0 tx=0x7f06dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06d67fc640 1 -- 172.21.15.55:0/2540545006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc040020 con 0x7f06cc003b70 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06d67fc640 1 -- 172.21.15.55:0/2540545006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc003bc0 con 0x7f06cc003b70 2024-04-25T09:01:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06d67fc640 1 -- 172.21.15.55:0/2540545006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc036040 con 0x7f06cc003b70 2024-04-25T09:01:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e7c7c640 1 -- 172.21.15.55:0/2540545006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e0158d90 con 0x7f06cc003b70 2024-04-25T09:01:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.057+0000 7f06e7c7c640 1 -- 172.21.15.55:0/2540545006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e0159350 con 0x7f06cc003b70 2024-04-25T09:01:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.058+0000 7f06e7c7c640 1 -- 172.21.15.55:0/2540545006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e00749b0 con 0x7f06cc003b70 2024-04-25T09:01:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.059+0000 7f06d67fc640 1 -- 172.21.15.55:0/2540545006 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f06dc043020 con 0x7f06cc003b70 2024-04-25T09:01:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.059+0000 7f06d67fc640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f06c406b500 0x7f06c406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.059+0000 7f06d67fc640 1 -- 172.21.15.55:0/2540545006 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f06dc0aa3f0 con 0x7f06cc003b70 2024-04-25T09:01:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.059+0000 7f06e5217640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f06c406b500 0x7f06c406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.060+0000 7f06e5217640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f06c406b500 0x7f06c406d9c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f06d0007fd0 tx=0x7f06d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.063+0000 7f06d67fc640 1 -- 172.21.15.55:0/2540545006 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f06dc04a070 con 0x7f06cc003b70 2024-04-25T09:01:40.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.244+0000 7f06e7c7c640 1 -- 172.21.15.55:0/2540545006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06e00b5450 con 0x7f06cc003b70 2024-04-25T09:01:40.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.246+0000 7f06d67fc640 1 -- 172.21.15.55:0/2540545006 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16969 (secure 0 0 0) 0x7f06dc0a7260 con 0x7f06cc003b70 2024-04-25T09:01:40.235 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:40.235 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:00:58.145570+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:31.118316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:31.794522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.26","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3282261214":"2024-04-26T09:00:58.145549+0000","172.21.15.55:6835/3282261214":"2024-04-26T09:00:58.145549+0000","172.21.15.55:6837/3953928431":"2024-04-26T08:59:46.600027+0000","172.21.15.55:6835/3953928431":"2024-04-26T08:59:46.600027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 -- 172.21.15.55:0/2540545006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f06c406b500 msgr2=0x7f06c406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f06c406b500 0x7f06c406d9c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f06d0007fd0 tx=0x7f06d0009040 comp rx=0 tx=0).stop 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 -- 172.21.15.55:0/2540545006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 msgr2=0x7f06e0158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 0x7f06e0158420 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009ac0 tx=0x7f06dc004730 comp rx=0 tx=0).stop 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 -- 172.21.15.55:0/2540545006 shutdown_connections 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f06c406b500 0x7f06c406d9c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06e01f6ff0 0x7f06e01f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06e01f76c0 0x7f06e01f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 --2- 172.21.15.55:0/2540545006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06cc003b70 0x7f06e0158420 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 -- 172.21.15.55:0/2540545006 >> 172.21.15.55:0/2540545006 conn(0x7f06e0072900 msgr2=0x7f06e006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 -- 172.21.15.55:0/2540545006 shutdown_connections 2024-04-25T09:01:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.248+0000 7f06e7c7c640 1 -- 172.21.15.55:0/2540545006 wait complete. 2024-04-25T09:01:40.248 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:01:40.248 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:40.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.360+0000 7f5c57f89640 1 Processor -- start 2024-04-25T09:01:40.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.360+0000 7f5c57f89640 1 -- start start 2024-04-25T09:01:40.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.361+0000 7f5c57f89640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c5015dce0 0x7f5c500d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.361+0000 7f5c57f89640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c500d35b0 0x7f5c500b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.361+0000 7f5c57f89640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5015e0c0 con 0x7f5c500d1f90 2024-04-25T09:01:40.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.361+0000 7f5c57f89640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c500b7b10 con 0x7f5c5015dce0 2024-04-25T09:01:40.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.361+0000 7f5c57f89640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c500d2510 con 0x7f5c500d35b0 2024-04-25T09:01:40.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.361+0000 7f5c55d25640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c5015dce0 0x7f5c500d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.361+0000 7f5c55d25640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c5015dce0 0x7f5c500d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52172/0 (socket says 172.21.15.55:52172) 2024-04-25T09:01:40.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.361+0000 7f5c55d25640 1 -- 172.21.15.55:0/673848166 learned_addr learned my addr 172.21.15.55:0/673848166 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:40.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.362+0000 7f5c55d25640 1 -- 172.21.15.55:0/673848166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c500d35b0 msgr2=0x7f5c500b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:40.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.362+0000 7f5c55524640 1 --2- 172.21.15.55:0/673848166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c500d35b0 0x7f5c500b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.362+0000 7f5c55d25640 1 --2- 172.21.15.55:0/673848166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c500d35b0 0x7f5c500b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.362+0000 7f5c55d25640 1 -- 172.21.15.55:0/673848166 >> v1:172.21.15.167:6789/0 conn(0x7f5c500d1f90 legacy=0x7f5c5006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:40.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.362+0000 7f5c55d25640 1 -- 172.21.15.55:0/673848166 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c500d27f0 con 0x7f5c5015dce0 2024-04-25T09:01:40.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.362+0000 7f5c55d25640 1 --2- 172.21.15.55:0/673848166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5015dce0 0x7f5c500d1a50 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c009870 tx=0x7f5c4c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2e4f914e1e4858 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.362+0000 7f5c54d23640 1 -- 172.21.15.55:0/673848166 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c037070 con 0x7f5c5015dce0 2024-04-25T09:01:40.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.363+0000 7f5c54d23640 1 -- 172.21.15.55:0/673848166 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4c032440 con 0x7f5c5015dce0 2024-04-25T09:01:40.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.363+0000 7f5c54d23640 1 -- 172.21.15.55:0/673848166 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c032810 con 0x7f5c5015dce0 2024-04-25T09:01:40.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.363+0000 7f5c57f89640 1 -- 172.21.15.55:0/673848166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5015dce0 msgr2=0x7f5c500d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.363+0000 7f5c57f89640 1 --2- 172.21.15.55:0/673848166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5015dce0 0x7f5c500d1a50 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c009870 tx=0x7f5c4c02a180 comp rx=0 tx=0).stop 2024-04-25T09:01:40.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.363+0000 7f5c57f89640 1 -- 172.21.15.55:0/673848166 shutdown_connections 2024-04-25T09:01:40.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.363+0000 7f5c57f89640 1 --2- 172.21.15.55:0/673848166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c500d35b0 0x7f5c500b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.363+0000 7f5c57f89640 1 --2- 172.21.15.55:0/673848166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5015dce0 0x7f5c500d1a50 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.363+0000 7f5c57f89640 1 -- 172.21.15.55:0/673848166 >> 172.21.15.55:0/673848166 conn(0x7f5c50072900 msgr2=0x7f5c500d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:40.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.363+0000 7f5c57f89640 1 -- 172.21.15.55:0/673848166 shutdown_connections 2024-04-25T09:01:40.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.363+0000 7f5c57f89640 1 -- 172.21.15.55:0/673848166 wait complete. 2024-04-25T09:01:40.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.364+0000 7f5c57f89640 1 Processor -- start 2024-04-25T09:01:40.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.364+0000 7f5c57f89640 1 -- start start 2024-04-25T09:01:40.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.365+0000 7f5c57f89640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c500d1f90 0x7f5c50152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.365+0000 7f5c57f89640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c500d35b0 0x7f5c500c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.365+0000 7f5c57f89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5015dce0 0x7f5c500c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.365+0000 7f5c57f89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c500d3090 con 0x7f5c5015dce0 2024-04-25T09:01:40.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.365+0000 7f5c57f89640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c500d2db0 con 0x7f5c500d35b0 2024-04-25T09:01:40.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.365+0000 7f5c57f89640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c500b9820 con 0x7f5c500d1f90 2024-04-25T09:01:40.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.365+0000 7f5c56526640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5015dce0 0x7f5c500c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.365+0000 7f5c56526640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5015dce0 0x7f5c500c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52188/0 (socket says 172.21.15.55:52188) 2024-04-25T09:01:40.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.365+0000 7f5c56526640 1 -- 172.21.15.55:0/2374485893 learned_addr learned my addr 172.21.15.55:0/2374485893 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:40.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.365+0000 7f5c55d25640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c500d1f90 0x7f5c50152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.365+0000 7f5c55524640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c500d35b0 0x7f5c500c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c56526640 1 -- 172.21.15.55:0/2374485893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c500d1f90 msgr2=0x7f5c50152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c56526640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c500d1f90 0x7f5c50152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c56526640 1 -- 172.21.15.55:0/2374485893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c500d35b0 msgr2=0x7f5c500c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c56526640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c500d35b0 0x7f5c500c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c56526640 1 -- 172.21.15.55:0/2374485893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c500c9b50 con 0x7f5c5015dce0 2024-04-25T09:01:40.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c55524640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c500d35b0 0x7f5c500c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:40.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c56526640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5015dce0 0x7f5c500c92e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800b970 tx=0x7f5c4800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c467fc640 1 -- 172.21.15.55:0/2374485893 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48019070 con 0x7f5c5015dce0 2024-04-25T09:01:40.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c467fc640 1 -- 172.21.15.55:0/2374485893 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4800cb40 con 0x7f5c5015dce0 2024-04-25T09:01:40.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c57f89640 1 -- 172.21.15.55:0/2374485893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c500c9e30 con 0x7f5c5015dce0 2024-04-25T09:01:40.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c467fc640 1 -- 172.21.15.55:0/2374485893 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48014440 con 0x7f5c5015dce0 2024-04-25T09:01:40.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.366+0000 7f5c57f89640 1 -- 172.21.15.55:0/2374485893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c500c9820 con 0x7f5c5015dce0 2024-04-25T09:01:40.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.367+0000 7f5c57f89640 1 -- 172.21.15.55:0/2374485893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c500ca350 con 0x7f5c5015dce0 2024-04-25T09:01:40.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.367+0000 7f5c467fc640 1 -- 172.21.15.55:0/2374485893 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5c4801c070 con 0x7f5c5015dce0 2024-04-25T09:01:40.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.368+0000 7f5c467fc640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c3406b4d0 0x7f5c3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.368+0000 7f5c467fc640 1 -- 172.21.15.55:0/2374485893 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f5c48089dc0 con 0x7f5c5015dce0 2024-04-25T09:01:40.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.368+0000 7f5c55d25640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c3406b4d0 0x7f5c3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.368+0000 7f5c55d25640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c3406b4d0 0x7f5c3406d990 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c034000 tx=0x7f5c4c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.372+0000 7f5c467fc640 1 -- 172.21.15.55:0/2374485893 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5c480585b0 con 0x7f5c5015dce0 2024-04-25T09:01:40.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.593+0000 7f5c57f89640 1 -- 172.21.15.55:0/2374485893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c500749b0 con 0x7f5c5015dce0 2024-04-25T09:01:40.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.593+0000 7f5c467fc640 1 -- 172.21.15.55:0/2374485893 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f5c4805c650 con 0x7f5c5015dce0 2024-04-25T09:01:40.582 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:40.582 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T09:01:01.173411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7872":{"gid":7872,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/2841450668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2841450668},{"type":"v1","addr":"172.21.15.55:6837","nonce":2841450668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:01:40.583 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 64 2024-04-25T09:01:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.595+0000 7f5c57f89640 1 -- 172.21.15.55:0/2374485893 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c3406b4d0 msgr2=0x7f5c3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.595+0000 7f5c57f89640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c3406b4d0 0x7f5c3406d990 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c034000 tx=0x7f5c4c02e000 comp rx=0 tx=0).stop 2024-04-25T09:01:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.595+0000 7f5c57f89640 1 -- 172.21.15.55:0/2374485893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5015dce0 msgr2=0x7f5c500c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.595+0000 7f5c57f89640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5015dce0 0x7f5c500c92e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800b970 tx=0x7f5c4800be30 comp rx=0 tx=0).stop 2024-04-25T09:01:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.596+0000 7f5c57f89640 1 -- 172.21.15.55:0/2374485893 shutdown_connections 2024-04-25T09:01:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.596+0000 7f5c57f89640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c3406b4d0 0x7f5c3406d990 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.596+0000 7f5c57f89640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5015dce0 0x7f5c500c92e0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.596+0000 7f5c57f89640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c500d35b0 0x7f5c500c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.596+0000 7f5c57f89640 1 --2- 172.21.15.55:0/2374485893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c500d1f90 0x7f5c50152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.596+0000 7f5c57f89640 1 -- 172.21.15.55:0/2374485893 >> 172.21.15.55:0/2374485893 conn(0x7f5c50072900 msgr2=0x7f5c500b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.596+0000 7f5c57f89640 1 -- 172.21.15.55:0/2374485893 shutdown_connections 2024-04-25T09:01:40.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.596+0000 7f5c57f89640 1 -- 172.21.15.55:0/2374485893 wait complete. 2024-04-25T09:01:40.595 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:40.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.708+0000 7f5dd2038640 1 Processor -- start 2024-04-25T09:01:40.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.708+0000 7f5dd2038640 1 -- start start 2024-04-25T09:01:40.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dd2038640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dcc099a40 0x7f5dcc09a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dd2038640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5dcc099e20 0x7f5dcc0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dd2038640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dcc0cfb90 con 0x7f5dcc15bd40 2024-04-25T09:01:40.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dd2038640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dcc15cfd0 con 0x7f5dcc099a40 2024-04-25T09:01:40.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dd2038640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dcc15c210 con 0x7f5dcc099e20 2024-04-25T09:01:40.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dcb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dcc099a40 0x7f5dcc09a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dcb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dcc099a40 0x7f5dcc09a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52194/0 (socket says 172.21.15.55:52194) 2024-04-25T09:01:40.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dcb7fe640 1 -- 172.21.15.55:0/41841977 learned_addr learned my addr 172.21.15.55:0/41841977 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:40.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dcbfff640 1 --2- 172.21.15.55:0/41841977 >> v2:172.21.15.167:3300/0 conn(0x7f5dcc099e20 0x7f5dcc0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dcb7fe640 1 -- 172.21.15.55:0/41841977 >> v2:172.21.15.167:3300/0 conn(0x7f5dcc099e20 msgr2=0x7f5dcc0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:40.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dcb7fe640 1 --2- 172.21.15.55:0/41841977 >> v2:172.21.15.167:3300/0 conn(0x7f5dcc099e20 0x7f5dcc0cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dcb7fe640 1 -- 172.21.15.55:0/41841977 >> v1:172.21.15.167:6789/0 conn(0x7f5dcc15bd40 legacy=0x7f5dcc0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:40.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.709+0000 7f5dcb7fe640 1 -- 172.21.15.55:0/41841977 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc15c4f0 con 0x7f5dcc099a40 2024-04-25T09:01:40.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.710+0000 7f5dcb7fe640 1 --2- 172.21.15.55:0/41841977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dcc099a40 0x7f5dcc09a9c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0b40f0 tx=0x7f5dbc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcdcd14d971726e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.710+0000 7f5dca7fc640 1 -- 172.21.15.55:0/41841977 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc037070 con 0x7f5dcc099a40 2024-04-25T09:01:40.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.710+0000 7f5dca7fc640 1 -- 172.21.15.55:0/41841977 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc032440 con 0x7f5dcc099a40 2024-04-25T09:01:40.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.710+0000 7f5dca7fc640 1 -- 172.21.15.55:0/41841977 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc032810 con 0x7f5dcc099a40 2024-04-25T09:01:40.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.711+0000 7f5dd2038640 1 -- 172.21.15.55:0/41841977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dcc099a40 msgr2=0x7f5dcc09a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.711+0000 7f5dd2038640 1 --2- 172.21.15.55:0/41841977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dcc099a40 0x7f5dcc09a9c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0b40f0 tx=0x7f5dbc02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.711+0000 7f5dd2038640 1 -- 172.21.15.55:0/41841977 shutdown_connections 2024-04-25T09:01:40.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.711+0000 7f5dd2038640 1 --2- 172.21.15.55:0/41841977 >> v2:172.21.15.167:3300/0 conn(0x7f5dcc099e20 0x7f5dcc0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.711+0000 7f5dd2038640 1 --2- 172.21.15.55:0/41841977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dcc099a40 0x7f5dcc09a9c0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.711+0000 7f5dd2038640 1 -- 172.21.15.55:0/41841977 >> 172.21.15.55:0/41841977 conn(0x7f5dcc0b32f0 msgr2=0x7f5dcc0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:40.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.711+0000 7f5dd2038640 1 -- 172.21.15.55:0/41841977 shutdown_connections 2024-04-25T09:01:40.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.711+0000 7f5dd2038640 1 -- 172.21.15.55:0/41841977 wait complete. 2024-04-25T09:01:40.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.712+0000 7f5dd2038640 1 Processor -- start 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.712+0000 7f5dd2038640 1 -- start start 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dd2038640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5dcc099a40 0x7f5dcc0b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dd2038640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dcc099e20 0x7f5dcc0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dd2038640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dcc15bd40 0x7f5dcc153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dd2038640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc09a250 con 0x7f5dcc099e20 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dd2038640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc15cab0 con 0x7f5dcc15bd40 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dd2038640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc09a3d0 con 0x7f5dcc099a40 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dcaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dcc099e20 0x7f5dcc0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dcaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dcc099e20 0x7f5dcc0c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52202/0 (socket says 172.21.15.55:52202) 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dcaffd640 1 -- 172.21.15.55:0/2005508478 learned_addr learned my addr 172.21.15.55:0/2005508478 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dcb7fe640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5dcc099a40 0x7f5dcc0b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dcbfff640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dcc15bd40 0x7f5dcc153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dcaffd640 1 -- 172.21.15.55:0/2005508478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5dcc099a40 msgr2=0x7f5dcc0b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dcaffd640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5dcc099a40 0x7f5dcc0b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dcaffd640 1 -- 172.21.15.55:0/2005508478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dcc15bd40 msgr2=0x7f5dcc153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dcaffd640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dcc15bd40 0x7f5dcc153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dcaffd640 1 -- 172.21.15.55:0/2005508478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc0c6550 con 0x7f5dcc099e20 2024-04-25T09:01:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.713+0000 7f5dcaffd640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dcc099e20 0x7f5dcc0c5d00 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000b410 tx=0x7f5dc000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.714+0000 7f5db3fff640 1 -- 172.21.15.55:0/2005508478 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0015020 con 0x7f5dcc099e20 2024-04-25T09:01:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.714+0000 7f5db3fff640 1 -- 172.21.15.55:0/2005508478 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc0011830 con 0x7f5dcc099e20 2024-04-25T09:01:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.714+0000 7f5dd2038640 1 -- 172.21.15.55:0/2005508478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dcc0c6830 con 0x7f5dcc099e20 2024-04-25T09:01:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.714+0000 7f5db3fff640 1 -- 172.21.15.55:0/2005508478 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0011c20 con 0x7f5dcc099e20 2024-04-25T09:01:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.714+0000 7f5dd2038640 1 -- 172.21.15.55:0/2005508478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dcc0c6df0 con 0x7f5dcc099e20 2024-04-25T09:01:40.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.715+0000 7f5dd2038640 1 -- 172.21.15.55:0/2005508478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dcc0749b0 con 0x7f5dcc099e20 2024-04-25T09:01:40.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.715+0000 7f5db3fff640 1 -- 172.21.15.55:0/2005508478 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5dc0018020 con 0x7f5dcc099e20 2024-04-25T09:01:40.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.715+0000 7f5db3fff640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5db806b4d0 0x7f5db806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.716+0000 7f5db3fff640 1 -- 172.21.15.55:0/2005508478 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f5dc008a270 con 0x7f5dcc099e20 2024-04-25T09:01:40.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.716+0000 7f5dcb7fe640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5db806b4d0 0x7f5db806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.716+0000 7f5dcb7fe640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5db806b4d0 0x7f5db806d990 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc034000 tx=0x7f5dbc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.720+0000 7f5db3fff640 1 -- 172.21.15.55:0/2005508478 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5dc001f020 con 0x7f5dcc099e20 2024-04-25T09:01:40.731 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:40.733 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:40.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.940+0000 7f5dd2038640 1 -- 172.21.15.55:0/2005508478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5dcc09a570 con 0x7f5dcc099e20 2024-04-25T09:01:40.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.940+0000 7f5db3fff640 1 -- 172.21.15.55:0/2005508478 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f5dc00588a0 con 0x7f5dcc099e20 2024-04-25T09:01:40.929 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:40.929 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:59:32.818559+0000","modified":"2024-04-25T09:01:01.173411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7872":{"gid":7872,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/2841450668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2841450668},{"type":"v1","addr":"172.21.15.55:6837","nonce":2841450668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:01:40.929 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 64 2024-04-25T09:01:40.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.942+0000 7f5dd2038640 1 -- 172.21.15.55:0/2005508478 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5db806b4d0 msgr2=0x7f5db806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.942+0000 7f5dd2038640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5db806b4d0 0x7f5db806d990 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc034000 tx=0x7f5dbc02e000 comp rx=0 tx=0).stop 2024-04-25T09:01:40.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.942+0000 7f5dd2038640 1 -- 172.21.15.55:0/2005508478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dcc099e20 msgr2=0x7f5dcc0c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.942+0000 7f5dd2038640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dcc099e20 0x7f5dcc0c5d00 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000b410 tx=0x7f5dc000b8d0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.942+0000 7f5dd2038640 1 -- 172.21.15.55:0/2005508478 shutdown_connections 2024-04-25T09:01:40.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.942+0000 7f5dd2038640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5db806b4d0 0x7f5db806d990 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.942+0000 7f5dd2038640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dcc15bd40 0x7f5dcc153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.942+0000 7f5dd2038640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dcc099e20 0x7f5dcc0c5d00 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.942+0000 7f5dd2038640 1 --2- 172.21.15.55:0/2005508478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5dcc099a40 0x7f5dcc0b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.942+0000 7f5dd2038640 1 -- 172.21.15.55:0/2005508478 >> 172.21.15.55:0/2005508478 conn(0x7f5dcc0b32f0 msgr2=0x7f5dcc06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:40.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.943+0000 7f5dd2038640 1 -- 172.21.15.55:0/2005508478 shutdown_connections 2024-04-25T09:01:40.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:40.943+0000 7f5dd2038640 1 -- 172.21.15.55:0/2005508478 wait complete. 2024-04-25T09:01:40.943 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.055+0000 7f043e1fe640 1 Processor -- start 2024-04-25T09:01:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.055+0000 7f043e1fe640 1 -- start start 2024-04-25T09:01:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f043e1fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f043815ba10 0x7f0438099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f043e1fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0438099f80 0x7f043806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f043e1fe640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043809a3a0 con 0x7f043806c1f0 2024-04-25T09:01:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f043e1fe640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04380cbe50 con 0x7f043815ba10 2024-04-25T09:01:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f043e1fe640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04380cfe80 con 0x7f0438099f80 2024-04-25T09:01:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f04377fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f043815ba10 0x7f0438099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f04377fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f043815ba10 0x7f0438099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52210/0 (socket says 172.21.15.55:52210) 2024-04-25T09:01:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f04377fe640 1 -- 172.21.15.55:0/1285912442 learned_addr learned my addr 172.21.15.55:0/1285912442 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f0436ffd640 1 --2- 172.21.15.55:0/1285912442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0438099f80 0x7f043806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f04377fe640 1 -- 172.21.15.55:0/1285912442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0438099f80 msgr2=0x7f043806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f04377fe640 1 --2- 172.21.15.55:0/1285912442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0438099f80 0x7f043806bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f04377fe640 1 -- 172.21.15.55:0/1285912442 >> v1:172.21.15.167:6789/0 conn(0x7f043806c1f0 legacy=0x7f04380cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.056+0000 7f04377fe640 1 -- 172.21.15.55:0/1285912442 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043806c680 con 0x7f043815ba10 2024-04-25T09:01:41.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.057+0000 7f04377fe640 1 --2- 172.21.15.55:0/1285912442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f043815ba10 0x7f0438099a40 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f0428009870 tx=0x7f042802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb835d806cedf96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.057+0000 7f04367fc640 1 -- 172.21.15.55:0/1285912442 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428037070 con 0x7f043815ba10 2024-04-25T09:01:41.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.057+0000 7f04367fc640 1 -- 172.21.15.55:0/1285912442 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0428032440 con 0x7f043815ba10 2024-04-25T09:01:41.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.057+0000 7f04367fc640 1 -- 172.21.15.55:0/1285912442 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428032810 con 0x7f043815ba10 2024-04-25T09:01:41.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.058+0000 7f043e1fe640 1 -- 172.21.15.55:0/1285912442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f043815ba10 msgr2=0x7f0438099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.058+0000 7f043e1fe640 1 --2- 172.21.15.55:0/1285912442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f043815ba10 0x7f0438099a40 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f0428009870 tx=0x7f042802a270 comp rx=0 tx=0).stop 2024-04-25T09:01:41.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.058+0000 7f043e1fe640 1 -- 172.21.15.55:0/1285912442 shutdown_connections 2024-04-25T09:01:41.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.058+0000 7f043e1fe640 1 --2- 172.21.15.55:0/1285912442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0438099f80 0x7f043806bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.058+0000 7f043e1fe640 1 --2- 172.21.15.55:0/1285912442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f043815ba10 0x7f0438099a40 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.058+0000 7f043e1fe640 1 -- 172.21.15.55:0/1285912442 >> 172.21.15.55:0/1285912442 conn(0x7f04380b32f0 msgr2=0x7f04380b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:41.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.058+0000 7f043e1fe640 1 -- 172.21.15.55:0/1285912442 shutdown_connections 2024-04-25T09:01:41.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.058+0000 7f043e1fe640 1 -- 172.21.15.55:0/1285912442 wait complete. 2024-04-25T09:01:41.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.059+0000 7f043e1fe640 1 Processor -- start 2024-04-25T09:01:41.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.059+0000 7f043e1fe640 1 -- start start 2024-04-25T09:01:41.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f043e1fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f043806c1f0 0x7f043815a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f043e1fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0438099f80 0x7f04380af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f043e1fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043815ba10 0x7f04380b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f043e1fe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043806cec0 con 0x7f043806c1f0 2024-04-25T09:01:41.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f043e1fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043806cbe0 con 0x7f043815ba10 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f043e1fe640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04380cd930 con 0x7f0438099f80 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f04377fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f043806c1f0 0x7f043815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f04377fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f043806c1f0 0x7f043815a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52214/0 (socket says 172.21.15.55:52214) 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f04377fe640 1 -- 172.21.15.55:0/1113212671 learned_addr learned my addr 172.21.15.55:0/1113212671 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f04377fe640 1 -- 172.21.15.55:0/1113212671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0438099f80 msgr2=0x7f04380af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f04377fe640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0438099f80 0x7f04380af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f04377fe640 1 -- 172.21.15.55:0/1113212671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043815ba10 msgr2=0x7f04380b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f0437fff640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043815ba10 0x7f04380b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f04377fe640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043815ba10 0x7f04380b6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f04377fe640 1 -- 172.21.15.55:0/1113212671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04380c53d0 con 0x7f043806c1f0 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f04377fe640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f043806c1f0 0x7f043815a440 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f0428009870 tx=0x7f04280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f041ffff640 1 -- 172.21.15.55:0/1113212671 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428041070 con 0x7f043806c1f0 2024-04-25T09:01:41.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.060+0000 7f041ffff640 1 -- 172.21.15.55:0/1113212671 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042803c870 con 0x7f043806c1f0 2024-04-25T09:01:41.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.061+0000 7f043e1fe640 1 -- 172.21.15.55:0/1113212671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043815a980 con 0x7f043806c1f0 2024-04-25T09:01:41.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.061+0000 7f041ffff640 1 -- 172.21.15.55:0/1113212671 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428037040 con 0x7f043806c1f0 2024-04-25T09:01:41.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.061+0000 7f043e1fe640 1 -- 172.21.15.55:0/1113212671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04380c5670 con 0x7f043806c1f0 2024-04-25T09:01:41.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.062+0000 7f043e1fe640 1 -- 172.21.15.55:0/1113212671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04380749b0 con 0x7f043806c1f0 2024-04-25T09:01:41.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.062+0000 7f041ffff640 1 -- 172.21.15.55:0/1113212671 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0428044070 con 0x7f043806c1f0 2024-04-25T09:01:41.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.063+0000 7f041ffff640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f042406b500 0x7f042406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.063+0000 7f041ffff640 1 -- 172.21.15.55:0/1113212671 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f04280ab000 con 0x7f043806c1f0 2024-04-25T09:01:41.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.063+0000 7f0436ffd640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f042406b500 0x7f042406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.063+0000 7f0436ffd640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f042406b500 0x7f042406d9c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f043815ed20 tx=0x7f042c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.067+0000 7f041ffff640 1 -- 172.21.15.55:0/1113212671 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f043806c680 con 0x7f043806c1f0 2024-04-25T09:01:41.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.249+0000 7f043e1fe640 1 -- 172.21.15.55:0/1113212671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f043809a570 con 0x7f043806c1f0 2024-04-25T09:01:41.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.251+0000 7f041ffff640 1 -- 172.21.15.55:0/1113212671 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16969 (secure 0 0 0) 0x7f0428079f60 con 0x7f043806c1f0 2024-04-25T09:01:41.240 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:41.240 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:00:58.145570+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:59:31.118316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T08:59:31.794522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.26","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3282261214":"2024-04-26T09:00:58.145549+0000","172.21.15.55:6835/3282261214":"2024-04-26T09:00:58.145549+0000","172.21.15.55:6837/3953928431":"2024-04-26T08:59:46.600027+0000","172.21.15.55:6835/3953928431":"2024-04-26T08:59:46.600027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:41.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.252+0000 7f043e1fe640 1 -- 172.21.15.55:0/1113212671 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f042406b500 msgr2=0x7f042406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.252+0000 7f043e1fe640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f042406b500 0x7f042406d9c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f043815ed20 tx=0x7f042c008040 comp rx=0 tx=0).stop 2024-04-25T09:01:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.252+0000 7f043e1fe640 1 -- 172.21.15.55:0/1113212671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f043806c1f0 msgr2=0x7f043815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.252+0000 7f043e1fe640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f043806c1f0 0x7f043815a440 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f0428009870 tx=0x7f04280046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.253+0000 7f043e1fe640 1 -- 172.21.15.55:0/1113212671 shutdown_connections 2024-04-25T09:01:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.253+0000 7f043e1fe640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f042406b500 0x7f042406d9c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.253+0000 7f043e1fe640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043815ba10 0x7f04380b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.253+0000 7f043e1fe640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0438099f80 0x7f04380af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.253+0000 7f043e1fe640 1 --2- 172.21.15.55:0/1113212671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f043806c1f0 0x7f043815a440 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.253+0000 7f043e1fe640 1 -- 172.21.15.55:0/1113212671 >> 172.21.15.55:0/1113212671 conn(0x7f04380b32f0 msgr2=0x7f04380d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.253+0000 7f043e1fe640 1 -- 172.21.15.55:0/1113212671 shutdown_connections 2024-04-25T09:01:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.253+0000 7f043e1fe640 1 -- 172.21.15.55:0/1113212671 wait complete. 2024-04-25T09:01:41.253 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:01:41.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.366+0000 7f3170734640 1 Processor -- start 2024-04-25T09:01:41.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.366+0000 7f3170734640 1 -- start start 2024-04-25T09:01:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.367+0000 7f3170734640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31680d24b0 0x7f31680d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.367+0000 7f3170734640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31680d0990 0x7f31680b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.367+0000 7f3170734640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31680d2a20 con 0x7f316815dec0 2024-04-25T09:01:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.367+0000 7f3170734640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31680d2d00 con 0x7f31680d24b0 2024-04-25T09:01:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.367+0000 7f3170734640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31680d2fe0 con 0x7f31680d0990 2024-04-25T09:01:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.367+0000 7f316dccf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31680d24b0 0x7f31680d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.367+0000 7f316dccf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31680d24b0 0x7f31680d0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52228/0 (socket says 172.21.15.55:52228) 2024-04-25T09:01:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.367+0000 7f316dccf640 1 -- 172.21.15.55:0/2181802812 learned_addr learned my addr 172.21.15.55:0/2181802812 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.368+0000 7f316ecd1640 1 --2- 172.21.15.55:0/2181802812 >> v2:172.21.15.167:3300/0 conn(0x7f31680d0990 0x7f31680b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.368+0000 7f316dccf640 1 -- 172.21.15.55:0/2181802812 >> v2:172.21.15.167:3300/0 conn(0x7f31680d0990 msgr2=0x7f31680b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.368+0000 7f316dccf640 1 --2- 172.21.15.55:0/2181802812 >> v2:172.21.15.167:3300/0 conn(0x7f31680d0990 0x7f31680b6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.368+0000 7f316dccf640 1 -- 172.21.15.55:0/2181802812 >> v1:172.21.15.167:6789/0 conn(0x7f316815dec0 legacy=0x7f31680d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.368+0000 7f316dccf640 1 -- 172.21.15.55:0/2181802812 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31680d32c0 con 0x7f31680d24b0 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.368+0000 7f316dccf640 1 --2- 172.21.15.55:0/2181802812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31680d24b0 0x7f31680d0450 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f315c009870 tx=0x7f315c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c259da3c28a92130 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.368+0000 7f316d4ce640 1 -- 172.21.15.55:0/2181802812 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c037070 con 0x7f31680d24b0 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.368+0000 7f316d4ce640 1 -- 172.21.15.55:0/2181802812 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c032440 con 0x7f31680d24b0 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.368+0000 7f316d4ce640 1 -- 172.21.15.55:0/2181802812 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c032810 con 0x7f31680d24b0 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.369+0000 7f3170734640 1 -- 172.21.15.55:0/2181802812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31680d24b0 msgr2=0x7f31680d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.369+0000 7f3170734640 1 --2- 172.21.15.55:0/2181802812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31680d24b0 0x7f31680d0450 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f315c009870 tx=0x7f315c02a270 comp rx=0 tx=0).stop 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.369+0000 7f3170734640 1 -- 172.21.15.55:0/2181802812 shutdown_connections 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.369+0000 7f3170734640 1 --2- 172.21.15.55:0/2181802812 >> v2:172.21.15.167:3300/0 conn(0x7f31680d0990 0x7f31680b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.369+0000 7f3170734640 1 --2- 172.21.15.55:0/2181802812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31680d24b0 0x7f31680d0450 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.369+0000 7f3170734640 1 -- 172.21.15.55:0/2181802812 >> 172.21.15.55:0/2181802812 conn(0x7f3168072900 msgr2=0x7f31680b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.369+0000 7f3170734640 1 -- 172.21.15.55:0/2181802812 shutdown_connections 2024-04-25T09:01:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.369+0000 7f3170734640 1 -- 172.21.15.55:0/2181802812 wait complete. 2024-04-25T09:01:41.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.370+0000 7f3170734640 1 Processor -- start 2024-04-25T09:01:41.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.370+0000 7f3170734640 1 -- start start 2024-04-25T09:01:41.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f3170734640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31680d0990 0x7f31680cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f3170734640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31680d24b0 0x7f316814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f3170734640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316815dec0 0x7f31680cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f3170734640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31680b73d0 con 0x7f316815dec0 2024-04-25T09:01:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f3170734640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31680d0e20 con 0x7f31680d0990 2024-04-25T09:01:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f3170734640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31680b7550 con 0x7f31680d24b0 2024-04-25T09:01:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f316ecd1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316815dec0 0x7f31680cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f316ecd1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316815dec0 0x7f31680cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52240/0 (socket says 172.21.15.55:52240) 2024-04-25T09:01:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f316ecd1640 1 -- 172.21.15.55:0/844411347 learned_addr learned my addr 172.21.15.55:0/844411347 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f316e4d0640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31680d0990 0x7f31680cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f316dccf640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31680d24b0 0x7f316814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f316ecd1640 1 -- 172.21.15.55:0/844411347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31680d24b0 msgr2=0x7f316814e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f316ecd1640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31680d24b0 0x7f316814e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f316ecd1640 1 -- 172.21.15.55:0/844411347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31680d0990 msgr2=0x7f31680cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f316ecd1640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31680d0990 0x7f31680cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f316ecd1640 1 -- 172.21.15.55:0/844411347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31680cb770 con 0x7f316815dec0 2024-04-25T09:01:41.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.371+0000 7f316e4d0640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31680d0990 0x7f31680cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:41.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.372+0000 7f316ecd1640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316815dec0 0x7f31680cd0c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f316000d800 tx=0x7f316000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.372+0000 7f3166ffd640 1 -- 172.21.15.55:0/844411347 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316000b660 con 0x7f316815dec0 2024-04-25T09:01:41.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.372+0000 7f3166ffd640 1 -- 172.21.15.55:0/844411347 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3160019070 con 0x7f316815dec0 2024-04-25T09:01:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.372+0000 7f3166ffd640 1 -- 172.21.15.55:0/844411347 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316000ba60 con 0x7f316815dec0 2024-04-25T09:01:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.372+0000 7f3170734640 1 -- 172.21.15.55:0/844411347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31680cba50 con 0x7f316815dec0 2024-04-25T09:01:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.372+0000 7f3170734640 1 -- 172.21.15.55:0/844411347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316814f5b0 con 0x7f316815dec0 2024-04-25T09:01:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.373+0000 7f3170734640 1 -- 172.21.15.55:0/844411347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31680750b0 con 0x7f316815dec0 2024-04-25T09:01:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.373+0000 7f3166ffd640 1 -- 172.21.15.55:0/844411347 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f316000bc00 con 0x7f316815dec0 2024-04-25T09:01:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.374+0000 7f3166ffd640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f315406b4d0 0x7f315406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.374+0000 7f3166ffd640 1 -- 172.21.15.55:0/844411347 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f316008a660 con 0x7f316815dec0 2024-04-25T09:01:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.374+0000 7f316e4d0640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f315406b4d0 0x7f315406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.374+0000 7f316e4d0640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f315406b4d0 0x7f315406d990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3158009fc0 tx=0x7f3158009550 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.378+0000 7f3166ffd640 1 -- 172.21.15.55:0/844411347 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f31600594a0 con 0x7f316815dec0 2024-04-25T09:01:41.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.598+0000 7f3170734640 1 -- 172.21.15.55:0/844411347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f31680b8c20 con 0x7f316815dec0 2024-04-25T09:01:41.587 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T09:01:41.598+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:01:41.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.600+0000 7f3166ffd640 1 -- 172.21.15.55:0/844411347 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v65) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3160058da0 con 0x7f316815dec0 2024-04-25T09:01:41.588 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:01:41.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 -- 172.21.15.55:0/844411347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f315406b4d0 msgr2=0x7f315406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f315406b4d0 0x7f315406d990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3158009fc0 tx=0x7f3158009550 comp rx=0 tx=0).stop 2024-04-25T09:01:41.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 -- 172.21.15.55:0/844411347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316815dec0 msgr2=0x7f31680cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316815dec0 0x7f31680cd0c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f316000d800 tx=0x7f316000dcc0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 -- 172.21.15.55:0/844411347 shutdown_connections 2024-04-25T09:01:41.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f315406b4d0 0x7f315406d990 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316815dec0 0x7f31680cd0c0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31680d24b0 0x7f316814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 --2- 172.21.15.55:0/844411347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31680d0990 0x7f31680cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 -- 172.21.15.55:0/844411347 >> 172.21.15.55:0/844411347 conn(0x7f3168072900 msgr2=0x7f316815c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:41.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 -- 172.21.15.55:0/844411347 shutdown_connections 2024-04-25T09:01:41.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.602+0000 7f3170734640 1 -- 172.21.15.55:0/844411347 wait complete. 2024-04-25T09:01:41.592 INFO:tasks.ceph.mds.c.smithi055.stderr: -2304> 2024-04-25T09:01:04.162+0000 7fc02c1b4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:01:41.593 INFO:tasks.ceph.mds.c.smithi055.stderr: -1912> 2024-04-25T09:01:04.872+0000 7fc0281ac640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x5558a337c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:01:41.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:01:41.623 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T09:01:41.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.719+0000 7f35f045d640 1 Processor -- start 2024-04-25T09:01:41.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.719+0000 7f35f045d640 1 -- start start 2024-04-25T09:01:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.720+0000 7f35f045d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e80b98b0 0x7f35e815eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.720+0000 7f35f045d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35e80b5580 0x7f35e80b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.720+0000 7f35f045d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e815f080 con 0x7f35e80b24c0 2024-04-25T09:01:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.720+0000 7f35f045d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e815bb80 con 0x7f35e80b5580 2024-04-25T09:01:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.720+0000 7f35f045d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e806c4b0 con 0x7f35e80b98b0 2024-04-25T09:01:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.720+0000 7f35ee9fa640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35e80b24c0 0x7f35e80b2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60658/0 (socket says 172.21.15.55:60658) 2024-04-25T09:01:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.720+0000 7f35ee9fa640 1 -- 172.21.15.55:0/1092895098 learned_addr learned my addr 172.21.15.55:0/1092895098 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed9f8640 1 --2- 172.21.15.55:0/1092895098 >> v2:172.21.15.167:3300/0 conn(0x7f35e80b5580 0x7f35e80b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ee1f9640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e80b98b0 0x7f35e815eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875006836 0 0) 0x7f35e815f080 con 0x7f35e80b24c0 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d4003520 con 0x7f35e80b24c0 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1585755108 0 0) 0x7f35d4003520 con 0x7f35e80b24c0 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e80b98b0 msgr2=0x7f35e815eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e80b98b0 0x7f35e815eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 >> v2:172.21.15.167:3300/0 conn(0x7f35e80b5580 msgr2=0x7f35e80b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 --2- 172.21.15.55:0/1092895098 >> v2:172.21.15.167:3300/0 conn(0x7f35e80b5580 0x7f35e80b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e806c790 con 0x7f35e80b24c0 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f35e00019f0 con 0x7f35e80b24c0 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 >> v1:172.21.15.55:6789/0 conn(0x7f35e80b24c0 legacy=0x7f35e80b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d40039b0 0x7f35d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d4004800 0x7f35d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4005180 0x7f35d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e815bb80 con 0x7f35d4005180 2024-04-25T09:01:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e806c4b0 con 0x7f35d40039b0 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d400bf00 con 0x7f35d4004800 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ee9fa640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4005180 0x7f35d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ee1f9640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d40039b0 0x7f35d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ed9f8640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d4004800 0x7f35d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ee9fa640 1 -- 172.21.15.55:0/1092895098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d4004800 msgr2=0x7f35d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ee9fa640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d4004800 0x7f35d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ee9fa640 1 -- 172.21.15.55:0/1092895098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d40039b0 msgr2=0x7f35d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ee9fa640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d40039b0 0x7f35d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.721+0000 7f35ee9fa640 1 -- 172.21.15.55:0/1092895098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d4003520 con 0x7f35d4005180 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.722+0000 7f35ee9fa640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4005180 0x7f35d400b9c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f35e000a870 tx=0x7f35d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1b91e859a4f7ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.722+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e000a4c0 con 0x7f35d4005180 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.722+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e002f070 con 0x7f35d4005180 2024-04-25T09:01:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.722+0000 7f35ed1f7640 1 -- 172.21.15.55:0/1092895098 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e002bcc0 con 0x7f35d4005180 2024-04-25T09:01:41.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.723+0000 7f35f045d640 1 -- 172.21.15.55:0/1092895098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4005180 msgr2=0x7f35d400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.723+0000 7f35f045d640 1 --2- 172.21.15.55:0/1092895098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4005180 0x7f35d400b9c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f35e000a870 tx=0x7f35d4005830 comp rx=0 tx=0).stop 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.723+0000 7f35ee9fa640 1 -- 172.21.15.55:0/1092895098 reap_dead start 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.723+0000 7f35f045d640 1 -- 172.21.15.55:0/1092895098 shutdown_connections 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.723+0000 7f35f045d640 1 -- 172.21.15.55:0/1092895098 >> 172.21.15.55:0/1092895098 conn(0x7f35e80d0580 msgr2=0x7f35e80d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.723+0000 7f35f045d640 1 -- 172.21.15.55:0/1092895098 shutdown_connections 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.723+0000 7f35f045d640 1 -- 172.21.15.55:0/1092895098 wait complete. 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.724+0000 7f35f045d640 1 Processor -- start 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.724+0000 7f35f045d640 1 -- start start 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35f045d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d4005180 0x7f35e815e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35f045d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e80c7fc0 0x7f35e80c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35f045d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e814ba10 0x7f35e814be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35f045d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e806c140 con 0x7f35e814ba10 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35f045d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e806cd50 con 0x7f35d4005180 2024-04-25T09:01:41.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35f045d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80cec40 con 0x7f35e80c7fc0 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ee9fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e814ba10 0x7f35e814be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ee9fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e814ba10 0x7f35e814be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52266/0 (socket says 172.21.15.55:52266) 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ee9fa640 1 -- 172.21.15.55:0/3616406756 learned_addr learned my addr 172.21.15.55:0/3616406756 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ee1f9640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d4005180 0x7f35e815e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ed9f8640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e80c7fc0 0x7f35e80c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ee9fa640 1 -- 172.21.15.55:0/3616406756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e80c7fc0 msgr2=0x7f35e80c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ee9fa640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e80c7fc0 0x7f35e80c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ee9fa640 1 -- 172.21.15.55:0/3616406756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d4005180 msgr2=0x7f35e815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ee9fa640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d4005180 0x7f35e815e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ee9fa640 1 -- 172.21.15.55:0/3616406756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80c9010 con 0x7f35e814ba10 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ee1f9640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d4005180 0x7f35e815e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.725+0000 7f35ed9f8640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e80c7fc0 0x7f35e80c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.726+0000 7f35ee9fa640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e814ba10 0x7f35e814be60 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f35e0001cf0 tx=0x7f35e0001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.726+0000 7f35deffd640 1 -- 172.21.15.55:0/3616406756 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e000a4c0 con 0x7f35e814ba10 2024-04-25T09:01:41.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.726+0000 7f35deffd640 1 -- 172.21.15.55:0/3616406756 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e0034470 con 0x7f35e814ba10 2024-04-25T09:01:41.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.726+0000 7f35deffd640 1 -- 172.21.15.55:0/3616406756 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0002030 con 0x7f35e814ba10 2024-04-25T09:01:41.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.726+0000 7f35f045d640 1 -- 172.21.15.55:0/3616406756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e80c8770 con 0x7f35e814ba10 2024-04-25T09:01:41.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.726+0000 7f35f045d640 1 -- 172.21.15.55:0/3616406756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e80c8d30 con 0x7f35e814ba10 2024-04-25T09:01:41.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.727+0000 7f35f045d640 1 -- 172.21.15.55:0/3616406756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e80750b0 con 0x7f35e814ba10 2024-04-25T09:01:41.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.727+0000 7f35deffd640 1 -- 172.21.15.55:0/3616406756 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f35e0034820 con 0x7f35e814ba10 2024-04-25T09:01:41.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.728+0000 7f35deffd640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35cc06b4d0 0x7f35cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.728+0000 7f35ee1f9640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35cc06b4d0 0x7f35cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.728+0000 7f35deffd640 1 -- 172.21.15.55:0/3616406756 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5996+0+0 (secure 0 0 0) 0x7f35e00aa430 con 0x7f35e814ba10 2024-04-25T09:01:41.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.728+0000 7f35ee1f9640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35cc06b4d0 0x7f35cc06d990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009a40 tx=0x7f35e4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.732+0000 7f35deffd640 1 -- 172.21.15.55:0/3616406756 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f35e0046060 con 0x7f35e814ba10 2024-04-25T09:01:41.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:41.953+0000 7f35f045d640 1 -- 172.21.15.55:0/3616406756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f35e81610c0 con 0x7f35e814ba10 2024-04-25T09:01:42.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.605+0000 7f35deffd640 1 -- 172.21.15.55:0/3616406756 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v66) v1 ==== 104+0+0 (secure 0 0 0) 0x7f35e0079220 con 0x7f35e814ba10 2024-04-25T09:01:42.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 -- 172.21.15.55:0/3616406756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35cc06b4d0 msgr2=0x7f35cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35cc06b4d0 0x7f35cc06d990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009a40 tx=0x7f35e4008040 comp rx=0 tx=0).stop 2024-04-25T09:01:42.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 -- 172.21.15.55:0/3616406756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e814ba10 msgr2=0x7f35e814be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e814ba10 0x7f35e814be60 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f35e0001cf0 tx=0x7f35e0001360 comp rx=0 tx=0).stop 2024-04-25T09:01:42.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 -- 172.21.15.55:0/3616406756 shutdown_connections 2024-04-25T09:01:42.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f35cc06b4d0 0x7f35cc06d990 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e814ba10 0x7f35e814be60 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e80c7fc0 0x7f35e80c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 --2- 172.21.15.55:0/3616406756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d4005180 0x7f35e815e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 -- 172.21.15.55:0/3616406756 >> 172.21.15.55:0/3616406756 conn(0x7f35e80d0580 msgr2=0x7f35e80b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:42.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 -- 172.21.15.55:0/3616406756 shutdown_connections 2024-04-25T09:01:42.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.608+0000 7f35f045d640 1 -- 172.21.15.55:0/3616406756 wait complete. 2024-04-25T09:01:42.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:01:42.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.777+0000 7f8e48207640 1 Processor -- start 2024-04-25T09:01:42.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.778+0000 7f8e48207640 1 -- start start 2024-04-25T09:01:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.778+0000 7f8e48207640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e4015dc50 0x7f8e40070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.778+0000 7f8e48207640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8e400cd940 0x7f8e400713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.778+0000 7f8e48207640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4006c220 con 0x7f8e400cf600 2024-04-25T09:01:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.778+0000 7f8e48207640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e400cfe00 con 0x7f8e4015dc50 2024-04-25T09:01:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.778+0000 7f8e48207640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e400cec10 con 0x7f8e400cd940 2024-04-25T09:01:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.779+0000 7f8e45fa3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e4015dc50 0x7f8e40070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.779+0000 7f8e467a4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8e400cf600 0x7f8e40161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60668/0 (socket says 172.21.15.55:60668) 2024-04-25T09:01:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.779+0000 7f8e467a4640 1 -- 172.21.15.55:0/3447328544 learned_addr learned my addr 172.21.15.55:0/3447328544 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.779+0000 7f8e457a2640 1 --2- 172.21.15.55:0/3447328544 >> v2:172.21.15.167:3300/0 conn(0x7f8e400cd940 0x7f8e400713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.779+0000 7f8e45fa3640 1 -- 172.21.15.55:0/3447328544 >> v2:172.21.15.167:3300/0 conn(0x7f8e400cd940 msgr2=0x7f8e400713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.779+0000 7f8e45fa3640 1 --2- 172.21.15.55:0/3447328544 >> v2:172.21.15.167:3300/0 conn(0x7f8e400cd940 0x7f8e400713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.779+0000 7f8e45fa3640 1 -- 172.21.15.55:0/3447328544 >> v1:172.21.15.55:6789/0 conn(0x7f8e400cf600 legacy=0x7f8e40161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.779+0000 7f8e45fa3640 1 -- 172.21.15.55:0/3447328544 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400d0050 con 0x7f8e4015dc50 2024-04-25T09:01:42.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.779+0000 7f8e44fa1640 1 -- 172.21.15.55:0/3447328544 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121646025 0 0) 0x7f8e4006c220 con 0x7f8e400cf600 2024-04-25T09:01:42.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.779+0000 7f8e457a2640 1 --2- 172.21.15.55:0/3447328544 >> v2:172.21.15.167:3300/0 conn(0x7f8e400cd940 0x7f8e400713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.780+0000 7f8e45fa3640 1 --2- 172.21.15.55:0/3447328544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4015dc50 0x7f8e40070e80 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f8e400d2920 tx=0x7f8e3802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b82108b4229897 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.780+0000 7f8e44fa1640 1 -- 172.21.15.55:0/3447328544 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38037070 con 0x7f8e4015dc50 2024-04-25T09:01:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.780+0000 7f8e44fa1640 1 -- 172.21.15.55:0/3447328544 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e38032440 con 0x7f8e4015dc50 2024-04-25T09:01:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.780+0000 7f8e44fa1640 1 -- 172.21.15.55:0/3447328544 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3802ae60 con 0x7f8e4015dc50 2024-04-25T09:01:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.780+0000 7f8e48207640 1 -- 172.21.15.55:0/3447328544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4015dc50 msgr2=0x7f8e40070e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.780+0000 7f8e48207640 1 --2- 172.21.15.55:0/3447328544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4015dc50 0x7f8e40070e80 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f8e400d2920 tx=0x7f8e3802a110 comp rx=0 tx=0).stop 2024-04-25T09:01:42.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.780+0000 7f8e48207640 1 -- 172.21.15.55:0/3447328544 shutdown_connections 2024-04-25T09:01:42.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.780+0000 7f8e48207640 1 --2- 172.21.15.55:0/3447328544 >> v2:172.21.15.167:3300/0 conn(0x7f8e400cd940 0x7f8e400713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.780+0000 7f8e48207640 1 --2- 172.21.15.55:0/3447328544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4015dc50 0x7f8e40070e80 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.780+0000 7f8e48207640 1 -- 172.21.15.55:0/3447328544 >> 172.21.15.55:0/3447328544 conn(0x7f8e4006f430 msgr2=0x7f8e4006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:42.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.780+0000 7f8e48207640 1 -- 172.21.15.55:0/3447328544 shutdown_connections 2024-04-25T09:01:42.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.781+0000 7f8e48207640 1 -- 172.21.15.55:0/3447328544 wait complete. 2024-04-25T09:01:42.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.782+0000 7f8e48207640 1 Processor -- start 2024-04-25T09:01:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.782+0000 7f8e48207640 1 -- start start 2024-04-25T09:01:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.782+0000 7f8e48207640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e400cd940 0x7f8e400b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.782+0000 7f8e48207640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e400cf600 0x7f8e400c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.782+0000 7f8e48207640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4015dc50 0x7f8e400c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.782+0000 7f8e48207640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400ce8a0 con 0x7f8e400cf600 2024-04-25T09:01:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.782+0000 7f8e48207640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400cc0c0 con 0x7f8e4015dc50 2024-04-25T09:01:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.782+0000 7f8e48207640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400cd620 con 0x7f8e400cd940 2024-04-25T09:01:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e457a2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e400cf600 0x7f8e400c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e457a2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e400cf600 0x7f8e400c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52272/0 (socket says 172.21.15.55:52272) 2024-04-25T09:01:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e457a2640 1 -- 172.21.15.55:0/3808478880 learned_addr learned my addr 172.21.15.55:0/3808478880 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e467a4640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4015dc50 0x7f8e400c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e45fa3640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e400cd940 0x7f8e400b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e457a2640 1 -- 172.21.15.55:0/3808478880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e400cd940 msgr2=0x7f8e400b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e457a2640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e400cd940 0x7f8e400b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e457a2640 1 -- 172.21.15.55:0/3808478880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4015dc50 msgr2=0x7f8e400c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e457a2640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4015dc50 0x7f8e400c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e457a2640 1 -- 172.21.15.55:0/3808478880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400c6ff0 con 0x7f8e400cf600 2024-04-25T09:01:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e45fa3640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e400cd940 0x7f8e400b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e467a4640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4015dc50 0x7f8e400c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e457a2640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e400cf600 0x7f8e400c7db0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400e730 tx=0x7f8e3400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e3e7fc640 1 -- 172.21.15.55:0/3808478880 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400f040 con 0x7f8e400cf600 2024-04-25T09:01:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e3e7fc640 1 -- 172.21.15.55:0/3808478880 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e34004230 con 0x7f8e400cf600 2024-04-25T09:01:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e48207640 1 -- 172.21.15.55:0/3808478880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e400c72d0 con 0x7f8e400cf600 2024-04-25T09:01:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e3e7fc640 1 -- 172.21.15.55:0/3808478880 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400ee40 con 0x7f8e400cf600 2024-04-25T09:01:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.783+0000 7f8e48207640 1 -- 172.21.15.55:0/3808478880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e401562c0 con 0x7f8e400cf600 2024-04-25T09:01:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.784+0000 7f8e48207640 1 -- 172.21.15.55:0/3808478880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e400750b0 con 0x7f8e400cf600 2024-04-25T09:01:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.785+0000 7f8e3e7fc640 1 -- 172.21.15.55:0/3808478880 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8e3400c6d0 con 0x7f8e400cf600 2024-04-25T09:01:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.785+0000 7f8e3e7fc640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8e2c06b4d0 0x7f8e2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.785+0000 7f8e3e7fc640 1 -- 172.21.15.55:0/3808478880 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5996+0+0 (secure 0 0 0) 0x7f8e34089fb0 con 0x7f8e400cf600 2024-04-25T09:01:42.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.785+0000 7f8e45fa3640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8e2c06b4d0 0x7f8e2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.786+0000 7f8e45fa3640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8e2c06b4d0 0x7f8e2c06d990 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8e38034000 tx=0x7f8e3802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:42.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.789+0000 7f8e3e7fc640 1 -- 172.21.15.55:0/3808478880 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8e34017020 con 0x7f8e400cf600 2024-04-25T09:01:42.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:42.973+0000 7f8e48207640 1 -- 172.21.15.55:0/3808478880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e4006c220 con 0x7f8e400cf600 2024-04-25T09:01:43.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.619+0000 7f8e3e7fc640 1 -- 172.21.15.55:0/3808478880 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8e34058da0 con 0x7f8e400cf600 2024-04-25T09:01:43.609 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:01:43.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.622+0000 7f8e48207640 1 -- 172.21.15.55:0/3808478880 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8e2c06b4d0 msgr2=0x7f8e2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.622+0000 7f8e48207640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8e2c06b4d0 0x7f8e2c06d990 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8e38034000 tx=0x7f8e3802e000 comp rx=0 tx=0).stop 2024-04-25T09:01:43.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.622+0000 7f8e48207640 1 -- 172.21.15.55:0/3808478880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e400cf600 msgr2=0x7f8e400c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.622+0000 7f8e48207640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e400cf600 0x7f8e400c7db0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400e730 tx=0x7f8e3400ebf0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.622+0000 7f8e48207640 1 -- 172.21.15.55:0/3808478880 shutdown_connections 2024-04-25T09:01:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.622+0000 7f8e48207640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8e2c06b4d0 0x7f8e2c06d990 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.622+0000 7f8e48207640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4015dc50 0x7f8e400c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.622+0000 7f8e48207640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e400cf600 0x7f8e400c7db0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.622+0000 7f8e48207640 1 --2- 172.21.15.55:0/3808478880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e400cd940 0x7f8e400b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.622+0000 7f8e48207640 1 -- 172.21.15.55:0/3808478880 >> 172.21.15.55:0/3808478880 conn(0x7f8e4006f430 msgr2=0x7f8e4006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.623+0000 7f8e48207640 1 -- 172.21.15.55:0/3808478880 shutdown_connections 2024-04-25T09:01:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.623+0000 7f8e48207640 1 -- 172.21.15.55:0/3808478880 wait complete. 2024-04-25T09:01:43.628 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:01:43.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.750+0000 7f0f3a10a640 1 Processor -- start 2024-04-25T09:01:43.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.750+0000 7f0f3a10a640 1 -- start start 2024-04-25T09:01:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f3a10a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f341610b0 0x7f0f340b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f3a10a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0f341618d0 0x7f0f340ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f3a10a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f340ced70 0x7f0f3406c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f3a10a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f340d1ea0 con 0x7f0f341610b0 2024-04-25T09:01:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f3a10a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f34162040 con 0x7f0f341618d0 2024-04-25T09:01:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f3a10a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34162320 con 0x7f0f340ced70 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f337fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f341610b0 0x7f0f340b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f337fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f341610b0 0x7f0f340b9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52276/0 (socket says 172.21.15.55:52276) 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f337fe640 1 -- 172.21.15.55:0/2811410945 learned_addr learned my addr 172.21.15.55:0/2811410945 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f337fe640 1 -- 172.21.15.55:0/2811410945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f340ced70 msgr2=0x7f0f3406c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f337fe640 1 --2- 172.21.15.55:0/2811410945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f340ced70 0x7f0f3406c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f337fe640 1 -- 172.21.15.55:0/2811410945 >> v2:172.21.15.167:3300/0 conn(0x7f0f341618d0 msgr2=0x7f0f340ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f32ffd640 1 --2- 172.21.15.55:0/2811410945 >> v2:172.21.15.167:3300/0 conn(0x7f0f341618d0 0x7f0f340ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f337fe640 1 --2- 172.21.15.55:0/2811410945 >> v2:172.21.15.167:3300/0 conn(0x7f0f341618d0 0x7f0f340ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.751+0000 7f0f337fe640 1 -- 172.21.15.55:0/2811410945 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f34162600 con 0x7f0f341610b0 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.752+0000 7f0f337fe640 1 --2- 172.21.15.55:0/2811410945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f341610b0 0x7f0f340b9580 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f0f3406d320 tx=0x7f0f2402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3dc6e9b2a8adfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.752+0000 7f0f327fc640 1 -- 172.21.15.55:0/2811410945 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24037070 con 0x7f0f341610b0 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.752+0000 7f0f327fc640 1 -- 172.21.15.55:0/2811410945 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24032440 con 0x7f0f341610b0 2024-04-25T09:01:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.752+0000 7f0f327fc640 1 -- 172.21.15.55:0/2811410945 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24032810 con 0x7f0f341610b0 2024-04-25T09:01:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.753+0000 7f0f3a10a640 1 -- 172.21.15.55:0/2811410945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f341610b0 msgr2=0x7f0f340b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.753+0000 7f0f3a10a640 1 --2- 172.21.15.55:0/2811410945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f341610b0 0x7f0f340b9580 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f0f3406d320 tx=0x7f0f2402a140 comp rx=0 tx=0).stop 2024-04-25T09:01:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.753+0000 7f0f3a10a640 1 -- 172.21.15.55:0/2811410945 shutdown_connections 2024-04-25T09:01:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.753+0000 7f0f3a10a640 1 --2- 172.21.15.55:0/2811410945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f340ced70 0x7f0f3406c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.753+0000 7f0f3a10a640 1 --2- 172.21.15.55:0/2811410945 >> v2:172.21.15.167:3300/0 conn(0x7f0f341618d0 0x7f0f340ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.753+0000 7f0f3a10a640 1 --2- 172.21.15.55:0/2811410945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f341610b0 0x7f0f340b9580 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.753+0000 7f0f3a10a640 1 -- 172.21.15.55:0/2811410945 >> 172.21.15.55:0/2811410945 conn(0x7f0f340b5570 msgr2=0x7f0f340b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.753+0000 7f0f3a10a640 1 -- 172.21.15.55:0/2811410945 shutdown_connections 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.753+0000 7f0f3a10a640 1 -- 172.21.15.55:0/2811410945 wait complete. 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.754+0000 7f0f3a10a640 1 Processor -- start 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.754+0000 7f0f3a10a640 1 -- start start 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f3a10a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f340ced70 0x7f0f34157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f3a10a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f341610b0 0x7f0f341f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f3a10a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f341618d0 0x7f0f341f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f3a10a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34161d10 con 0x7f0f341610b0 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f3a10a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340b6c00 con 0x7f0f341618d0 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f3a10a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34161490 con 0x7f0f340ced70 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f32ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f341610b0 0x7f0f341f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f32ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f341610b0 0x7f0f341f3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52278/0 (socket says 172.21.15.55:52278) 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f32ffd640 1 -- 172.21.15.55:0/3404380073 learned_addr learned my addr 172.21.15.55:0/3404380073 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f33fff640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f341618d0 0x7f0f341f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f337fe640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f340ced70 0x7f0f34157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f32ffd640 1 -- 172.21.15.55:0/3404380073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f340ced70 msgr2=0x7f0f34157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f32ffd640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f340ced70 0x7f0f34157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f32ffd640 1 -- 172.21.15.55:0/3404380073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f341618d0 msgr2=0x7f0f341f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f32ffd640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f341618d0 0x7f0f341f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.755+0000 7f0f32ffd640 1 -- 172.21.15.55:0/3404380073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f341f4660 con 0x7f0f341610b0 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.756+0000 7f0f32ffd640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f341610b0 0x7f0f341f3900 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800c820 tx=0x7f0f2800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.756+0000 7f0f1bfff640 1 -- 172.21.15.55:0/3404380073 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28015070 con 0x7f0f341610b0 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.756+0000 7f0f1bfff640 1 -- 172.21.15.55:0/3404380073 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f28004240 con 0x7f0f341610b0 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.756+0000 7f0f1bfff640 1 -- 172.21.15.55:0/3404380073 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2800ce10 con 0x7f0f341610b0 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.756+0000 7f0f3a10a640 1 -- 172.21.15.55:0/3404380073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f34144eb0 con 0x7f0f341610b0 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.756+0000 7f0f3a10a640 1 -- 172.21.15.55:0/3404380073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f341f4380 con 0x7f0f341610b0 2024-04-25T09:01:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.757+0000 7f0f3a10a640 1 -- 172.21.15.55:0/3404380073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f340750b0 con 0x7f0f341610b0 2024-04-25T09:01:43.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.757+0000 7f0f1bfff640 1 -- 172.21.15.55:0/3404380073 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0f28007830 con 0x7f0f341610b0 2024-04-25T09:01:43.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.758+0000 7f0f1bfff640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0f2006b4d0 0x7f0f2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.758+0000 7f0f1bfff640 1 -- 172.21.15.55:0/3404380073 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f0f2808a050 con 0x7f0f341610b0 2024-04-25T09:01:43.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.758+0000 7f0f337fe640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0f2006b4d0 0x7f0f2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.758+0000 7f0f337fe640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0f2006b4d0 0x7f0f2006d990 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0f24034000 tx=0x7f0f2402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:43.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.762+0000 7f0f1bfff640 1 -- 172.21.15.55:0/3404380073 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0f28058f60 con 0x7f0f341610b0 2024-04-25T09:01:43.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:43.945+0000 7f0f3a10a640 1 -- 172.21.15.55:0/3404380073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0f340d1770 con 0x7f0f341610b0 2024-04-25T09:01:44.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.625+0000 7f0f1bfff640 1 -- 172.21.15.55:0/3404380073 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0f28058860 con 0x7f0f341610b0 2024-04-25T09:01:44.614 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-25T09:01:44.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.629+0000 7f0f3a10a640 1 -- 172.21.15.55:0/3404380073 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0f2006b4d0 msgr2=0x7f0f2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.629+0000 7f0f3a10a640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0f2006b4d0 0x7f0f2006d990 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0f24034000 tx=0x7f0f2402e000 comp rx=0 tx=0).stop 2024-04-25T09:01:44.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.629+0000 7f0f3a10a640 1 -- 172.21.15.55:0/3404380073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f341610b0 msgr2=0x7f0f341f3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.629+0000 7f0f3a10a640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f341610b0 0x7f0f341f3900 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800c820 tx=0x7f0f2800cce0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.629+0000 7f0f3a10a640 1 -- 172.21.15.55:0/3404380073 shutdown_connections 2024-04-25T09:01:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.629+0000 7f0f3a10a640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0f2006b4d0 0x7f0f2006d990 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.629+0000 7f0f3a10a640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f341618d0 0x7f0f341f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.629+0000 7f0f3a10a640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f341610b0 0x7f0f341f3900 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.629+0000 7f0f3a10a640 1 --2- 172.21.15.55:0/3404380073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f340ced70 0x7f0f34157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.629+0000 7f0f3a10a640 1 -- 172.21.15.55:0/3404380073 >> 172.21.15.55:0/3404380073 conn(0x7f0f340b5570 msgr2=0x7f0f340d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.630+0000 7f0f3a10a640 1 -- 172.21.15.55:0/3404380073 shutdown_connections 2024-04-25T09:01:44.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.630+0000 7f0f3a10a640 1 -- 172.21.15.55:0/3404380073 wait complete. 2024-04-25T09:01:44.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:01:44.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.750+0000 7f7e06932640 1 Processor -- start 2024-04-25T09:01:44.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.750+0000 7f7e06932640 1 -- start start 2024-04-25T09:01:44.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7e06932640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0015dca0 0x7f7e000ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7e06932640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e000d3b90 0x7f7e000d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7e06932640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e000d4090 con 0x7f7e000cee80 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7e06932640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e000b6b20 con 0x7f7e000d3b90 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7e06932640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000d4370 con 0x7f7e0015dca0 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7dff7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e000d3b90 0x7f7e000d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7e04ecf640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7e000cee80 0x7f7e000b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60676/0 (socket says 172.21.15.55:60676) 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7dff7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e000d3b90 0x7f7e000d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52284/0 (socket says 172.21.15.55:52284) 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7e04ecf640 1 -- 172.21.15.55:0/4047865126 learned_addr learned my addr 172.21.15.55:0/4047865126 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7dfffff640 1 --2- 172.21.15.55:0/4047865126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0015dca0 0x7f7e000ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7dff7fe640 1 -- 172.21.15.55:0/4047865126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0015dca0 msgr2=0x7f7e000ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7dff7fe640 1 --2- 172.21.15.55:0/4047865126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0015dca0 0x7f7e000ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7dff7fe640 1 -- 172.21.15.55:0/4047865126 >> v1:172.21.15.55:6789/0 conn(0x7f7e000cee80 legacy=0x7f7e000b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7dff7fe640 1 -- 172.21.15.55:0/4047865126 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e000d4650 con 0x7f7e000d3b90 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.751+0000 7f7dfeffd640 1 -- 172.21.15.55:0/4047865126 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829176357 0 0) 0x7f7e000d4090 con 0x7f7e000cee80 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.752+0000 7f7dff7fe640 1 --2- 172.21.15.55:0/4047865126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e000d3b90 0x7f7e000d0a20 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f7df00097a0 tx=0x7f7df002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca27ca52cc179d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.752+0000 7f7dfeffd640 1 -- 172.21.15.55:0/4047865126 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0037070 con 0x7f7e000d3b90 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.752+0000 7f7dfeffd640 1 -- 172.21.15.55:0/4047865126 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df0032440 con 0x7f7e000d3b90 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.752+0000 7f7dfeffd640 1 -- 172.21.15.55:0/4047865126 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0032810 con 0x7f7e000d3b90 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.753+0000 7f7e06932640 1 -- 172.21.15.55:0/4047865126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e000d3b90 msgr2=0x7f7e000d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.753+0000 7f7e06932640 1 --2- 172.21.15.55:0/4047865126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e000d3b90 0x7f7e000d0a20 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f7df00097a0 tx=0x7f7df002a180 comp rx=0 tx=0).stop 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.753+0000 7f7e06932640 1 -- 172.21.15.55:0/4047865126 shutdown_connections 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.753+0000 7f7e06932640 1 --2- 172.21.15.55:0/4047865126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e000d3b90 0x7f7e000d0a20 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.753+0000 7f7e06932640 1 --2- 172.21.15.55:0/4047865126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0015dca0 0x7f7e000ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.753+0000 7f7e06932640 1 -- 172.21.15.55:0/4047865126 >> 172.21.15.55:0/4047865126 conn(0x7f7e000726c0 msgr2=0x7f7e00072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:44.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.753+0000 7f7e06932640 1 -- 172.21.15.55:0/4047865126 shutdown_connections 2024-04-25T09:01:44.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.753+0000 7f7e06932640 1 -- 172.21.15.55:0/4047865126 wait complete. 2024-04-25T09:01:44.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.754+0000 7f7e06932640 1 Processor -- start 2024-04-25T09:01:44.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.754+0000 7f7e06932640 1 -- start start 2024-04-25T09:01:44.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7e06932640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e000cee80 0x7f7e000af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7e06932640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e000d3b90 0x7f7e0015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7e06932640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0015dca0 0x7f7e001602f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7e06932640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0015e200 con 0x7f7e000cee80 2024-04-25T09:01:44.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7e06932640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0015e080 con 0x7f7e000d3b90 2024-04-25T09:01:44.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7e06932640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000d0f60 con 0x7f7e0015dca0 2024-04-25T09:01:44.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7dfffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e000cee80 0x7f7e000af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7dfffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e000cee80 0x7f7e000af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52296/0 (socket says 172.21.15.55:52296) 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7dfffff640 1 -- 172.21.15.55:0/905401068 learned_addr learned my addr 172.21.15.55:0/905401068 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7dff7fe640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e000d3b90 0x7f7e0015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7e04ecf640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0015dca0 0x7f7e001602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7dfffff640 1 -- 172.21.15.55:0/905401068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0015dca0 msgr2=0x7f7e001602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7dfffff640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0015dca0 0x7f7e001602f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7dfffff640 1 -- 172.21.15.55:0/905401068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e000d3b90 msgr2=0x7f7e0015bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7dfffff640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e000d3b90 0x7f7e0015bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7dfffff640 1 -- 172.21.15.55:0/905401068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e000aaed0 con 0x7f7e000cee80 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7dff7fe640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e000d3b90 0x7f7e0015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.755+0000 7f7dfffff640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e000cee80 0x7f7e000af740 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f7df400d620 tx=0x7f7df400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.756+0000 7f7dfcff9640 1 -- 172.21.15.55:0/905401068 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400b620 con 0x7f7e000cee80 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.756+0000 7f7dfcff9640 1 -- 172.21.15.55:0/905401068 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df4019070 con 0x7f7e000cee80 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.756+0000 7f7e06932640 1 -- 172.21.15.55:0/905401068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e000ab1b0 con 0x7f7e000cee80 2024-04-25T09:01:44.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.756+0000 7f7dfcff9640 1 -- 172.21.15.55:0/905401068 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400ba00 con 0x7f7e000cee80 2024-04-25T09:01:44.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.756+0000 7f7e06932640 1 -- 172.21.15.55:0/905401068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0015c080 con 0x7f7e000cee80 2024-04-25T09:01:44.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.757+0000 7f7e06932640 1 -- 172.21.15.55:0/905401068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e00075090 con 0x7f7e000cee80 2024-04-25T09:01:44.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.757+0000 7f7dfcff9640 1 -- 172.21.15.55:0/905401068 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7df400bba0 con 0x7f7e000cee80 2024-04-25T09:01:44.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.758+0000 7f7dfcff9640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 0x7f7dec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.758+0000 7f7dff7fe640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 0x7f7dec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.758+0000 7f7dfcff9640 1 -- 172.21.15.55:0/905401068 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f7df408a400 con 0x7f7e000cee80 2024-04-25T09:01:44.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.758+0000 7f7dff7fe640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 0x7f7dec06d990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7df0034000 tx=0x7f7df002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.762+0000 7f7dfcff9640 1 -- 172.21.15.55:0/905401068 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7df40594c0 con 0x7f7e000cee80 2024-04-25T09:01:44.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.945+0000 7f7e06932640 1 -- 172.21.15.55:0/905401068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7e000d2f20 con 0x7f7e000cee80 2024-04-25T09:01:44.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.948+0000 7f7dfcff9640 1 -- 172.21.15.55:0/905401068 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7df4058dc0 con 0x7f7e000cee80 2024-04-25T09:01:44.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 -- 172.21.15.55:0/905401068 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 msgr2=0x7f7dec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 0x7f7dec06d990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7df0034000 tx=0x7f7df002e000 comp rx=0 tx=0).stop 2024-04-25T09:01:44.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 -- 172.21.15.55:0/905401068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e000cee80 msgr2=0x7f7e000af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e000cee80 0x7f7e000af740 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f7df400d620 tx=0x7f7df400dae0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 -- 172.21.15.55:0/905401068 shutdown_connections 2024-04-25T09:01:44.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7dec06b4d0 0x7f7dec06d990 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e0015dca0 0x7f7e001602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e000d3b90 0x7f7e0015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 --2- 172.21.15.55:0/905401068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e000cee80 0x7f7e000af740 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 -- 172.21.15.55:0/905401068 >> 172.21.15.55:0/905401068 conn(0x7f7e000726c0 msgr2=0x7f7e0015d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:44.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 -- 172.21.15.55:0/905401068 shutdown_connections 2024-04-25T09:01:44.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:44.950+0000 7f7e06932640 1 -- 172.21.15.55:0/905401068 wait complete. 2024-04-25T09:01:44.950 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T09:01:45.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.068+0000 7f85f6970640 1 Processor -- start 2024-04-25T09:01:45.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.068+0000 7f85f6970640 1 -- start start 2024-04-25T09:01:45.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85f6970640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85f015ba10 0x7f85f0099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85f6970640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85f0099f80 0x7f85f006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85f6970640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f009a3a0 con 0x7f85f006c1f0 2024-04-25T09:01:45.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85f6970640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f00cbe50 con 0x7f85f015ba10 2024-04-25T09:01:45.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85f6970640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00cfe80 con 0x7f85f0099f80 2024-04-25T09:01:45.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85f015ba10 0x7f85f0099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85f015ba10 0x7f85f0099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52312/0 (socket says 172.21.15.55:52312) 2024-04-25T09:01:45.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85effff640 1 -- 172.21.15.55:0/1961752637 learned_addr learned my addr 172.21.15.55:0/1961752637 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:45.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85ef7fe640 1 --2- 172.21.15.55:0/1961752637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85f0099f80 0x7f85f006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85effff640 1 -- 172.21.15.55:0/1961752637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85f0099f80 msgr2=0x7f85f006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:45.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85effff640 1 --2- 172.21.15.55:0/1961752637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85f0099f80 0x7f85f006bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85effff640 1 -- 172.21.15.55:0/1961752637 >> v1:172.21.15.167:6789/0 conn(0x7f85f006c1f0 legacy=0x7f85f00cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:45.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.069+0000 7f85effff640 1 -- 172.21.15.55:0/1961752637 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f006c680 con 0x7f85f015ba10 2024-04-25T09:01:45.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.070+0000 7f85effff640 1 --2- 172.21.15.55:0/1961752637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f015ba10 0x7f85f0099a40 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009870 tx=0x7f85e002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff72ecef267ae3e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.070+0000 7f85eeffd640 1 -- 172.21.15.55:0/1961752637 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0037070 con 0x7f85f015ba10 2024-04-25T09:01:45.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.070+0000 7f85eeffd640 1 -- 172.21.15.55:0/1961752637 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0032440 con 0x7f85f015ba10 2024-04-25T09:01:45.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.070+0000 7f85eeffd640 1 -- 172.21.15.55:0/1961752637 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0032810 con 0x7f85f015ba10 2024-04-25T09:01:45.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.071+0000 7f85f6970640 1 -- 172.21.15.55:0/1961752637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f015ba10 msgr2=0x7f85f0099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.071+0000 7f85f6970640 1 --2- 172.21.15.55:0/1961752637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f015ba10 0x7f85f0099a40 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009870 tx=0x7f85e002a210 comp rx=0 tx=0).stop 2024-04-25T09:01:45.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.071+0000 7f85f6970640 1 -- 172.21.15.55:0/1961752637 shutdown_connections 2024-04-25T09:01:45.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.071+0000 7f85f6970640 1 --2- 172.21.15.55:0/1961752637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85f0099f80 0x7f85f006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.071+0000 7f85f6970640 1 --2- 172.21.15.55:0/1961752637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f015ba10 0x7f85f0099a40 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.071+0000 7f85f6970640 1 -- 172.21.15.55:0/1961752637 >> 172.21.15.55:0/1961752637 conn(0x7f85f00b32f0 msgr2=0x7f85f00b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:45.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.071+0000 7f85f6970640 1 -- 172.21.15.55:0/1961752637 shutdown_connections 2024-04-25T09:01:45.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.071+0000 7f85f6970640 1 -- 172.21.15.55:0/1961752637 wait complete. 2024-04-25T09:01:45.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.072+0000 7f85f6970640 1 Processor -- start 2024-04-25T09:01:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.072+0000 7f85f6970640 1 -- start start 2024-04-25T09:01:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f6970640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85f006c1f0 0x7f85f01578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f6970640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85f0099f80 0x7f85f0158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f6970640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f015ba10 0x7f85f0158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f6970640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f006cec0 con 0x7f85f015ba10 2024-04-25T09:01:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f6970640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f006cbe0 con 0x7f85f0099f80 2024-04-25T09:01:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f6970640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00cd930 con 0x7f85f006c1f0 2024-04-25T09:01:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f4f0d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f015ba10 0x7f85f0158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f4f0d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f015ba10 0x7f85f0158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52324/0 (socket says 172.21.15.55:52324) 2024-04-25T09:01:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f4f0d640 1 -- 172.21.15.55:0/2224111277 learned_addr learned my addr 172.21.15.55:0/2224111277 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85effff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85f006c1f0 0x7f85f01578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85ef7fe640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85f0099f80 0x7f85f0158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f4f0d640 1 -- 172.21.15.55:0/2224111277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85f006c1f0 msgr2=0x7f85f01578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f4f0d640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85f006c1f0 0x7f85f01578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f4f0d640 1 -- 172.21.15.55:0/2224111277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85f0099f80 msgr2=0x7f85f0158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f4f0d640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85f0099f80 0x7f85f0158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.073+0000 7f85f4f0d640 1 -- 172.21.15.55:0/2224111277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f00c7df0 con 0x7f85f015ba10 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.074+0000 7f85f4f0d640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f015ba10 0x7f85f0158e90 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f85e800c780 tx=0x7f85e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.074+0000 7f85ecff9640 1 -- 172.21.15.55:0/2224111277 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8004b60 con 0x7f85f015ba10 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.074+0000 7f85ecff9640 1 -- 172.21.15.55:0/2224111277 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e8004d00 con 0x7f85f015ba10 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.074+0000 7f85f6970640 1 -- 172.21.15.55:0/2224111277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f015f2b0 con 0x7f85f015ba10 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.074+0000 7f85ecff9640 1 -- 172.21.15.55:0/2224111277 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e800aa90 con 0x7f85f015ba10 2024-04-25T09:01:45.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.074+0000 7f85f6970640 1 -- 172.21.15.55:0/2224111277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f015f870 con 0x7f85f015ba10 2024-04-25T09:01:45.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.075+0000 7f85f6970640 1 -- 172.21.15.55:0/2224111277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f00749b0 con 0x7f85f015ba10 2024-04-25T09:01:45.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.075+0000 7f85ecff9640 1 -- 172.21.15.55:0/2224111277 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f85e800ac30 con 0x7f85f015ba10 2024-04-25T09:01:45.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.076+0000 7f85ecff9640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f85dc06b500 0x7f85dc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.076+0000 7f85ecff9640 1 -- 172.21.15.55:0/2224111277 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f85e808a390 con 0x7f85f015ba10 2024-04-25T09:01:45.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.076+0000 7f85effff640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f85dc06b500 0x7f85dc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.076+0000 7f85effff640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f85dc06b500 0x7f85dc06d9c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f85e0034000 tx=0x7f85e002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.080+0000 7f85ecff9640 1 -- 172.21.15.55:0/2224111277 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f85e8058e10 con 0x7f85f015ba10 2024-04-25T09:01:45.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.329+0000 7f85f6970640 1 -- 172.21.15.55:0/2224111277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f85f009a570 con 0x7f85f015ba10 2024-04-25T09:01:45.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.631+0000 7f85ecff9640 1 -- 172.21.15.55:0/2224111277 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v381) v1 ==== 167+0+0 (secure 0 0 0) 0x7f85e805ceb0 con 0x7f85f015ba10 2024-04-25T09:01:45.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 -- 172.21.15.55:0/2224111277 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f85dc06b500 msgr2=0x7f85dc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f85dc06b500 0x7f85dc06d9c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f85e0034000 tx=0x7f85e002e000 comp rx=0 tx=0).stop 2024-04-25T09:01:45.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 -- 172.21.15.55:0/2224111277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f015ba10 msgr2=0x7f85f0158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f015ba10 0x7f85f0158e90 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f85e800c780 tx=0x7f85e800cc40 comp rx=0 tx=0).stop 2024-04-25T09:01:45.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 -- 172.21.15.55:0/2224111277 shutdown_connections 2024-04-25T09:01:45.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f85dc06b500 0x7f85dc06d9c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f015ba10 0x7f85f0158e90 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85f0099f80 0x7f85f0158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 --2- 172.21.15.55:0/2224111277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85f006c1f0 0x7f85f01578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 -- 172.21.15.55:0/2224111277 >> 172.21.15.55:0/2224111277 conn(0x7f85f00b32f0 msgr2=0x7f85f00706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:45.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 -- 172.21.15.55:0/2224111277 shutdown_connections 2024-04-25T09:01:45.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.633+0000 7f85f6970640 1 -- 172.21.15.55:0/2224111277 wait complete. 2024-04-25T09:01:45.633 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T09:01:45.633 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:01:45.633 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:45.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.746+0000 7ff14319e640 1 Processor -- start 2024-04-25T09:01:45.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.746+0000 7ff14319e640 1 -- start start 2024-04-25T09:01:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.746+0000 7ff14319e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff13c15ba10 0x7ff13c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.746+0000 7ff14319e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c06c900 con 0x7ff13c099f80 2024-04-25T09:01:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.746+0000 7ff14319e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c06cbe0 con 0x7ff13c06c3c0 2024-04-25T09:01:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.746+0000 7ff14319e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c0cbe50 con 0x7ff13c15ba10 2024-04-25T09:01:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.747+0000 7ff140f3a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff13c15ba10 0x7ff13c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.747+0000 7ff13bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff13c099f80 0x7ff13c06bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60686/0 (socket says 172.21.15.55:60686) 2024-04-25T09:01:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.747+0000 7ff140f3a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff13c15ba10 0x7ff13c099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52330/0 (socket says 172.21.15.55:52330) 2024-04-25T09:01:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.747+0000 7ff13bfff640 1 -- 172.21.15.55:0/4199043814 learned_addr learned my addr 172.21.15.55:0/4199043814 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.747+0000 7ff140f3a640 1 -- 172.21.15.55:0/4199043814 >> v1:172.21.15.167:6789/0 conn(0x7ff13c06c3c0 legacy=0x7ff13c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.747+0000 7ff140f3a640 1 -- 172.21.15.55:0/4199043814 >> v1:172.21.15.55:6789/0 conn(0x7ff13c099f80 legacy=0x7ff13c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.747+0000 7ff140f3a640 1 -- 172.21.15.55:0/4199043814 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c06cec0 con 0x7ff13c15ba10 2024-04-25T09:01:45.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.747+0000 7ff13b7fe640 1 -- 172.21.15.55:0/4199043814 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293752802 0 0) 0x7ff13c06c900 con 0x7ff13c099f80 2024-04-25T09:01:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.748+0000 7ff140f3a640 1 --2- 172.21.15.55:0/4199043814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff13c15ba10 0x7ff13c099a40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7ff1300097a0 tx=0x7ff13002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978f41171db9fca7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.748+0000 7ff13b7fe640 1 -- 172.21.15.55:0/4199043814 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130037070 con 0x7ff13c15ba10 2024-04-25T09:01:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.748+0000 7ff13b7fe640 1 -- 172.21.15.55:0/4199043814 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff130032440 con 0x7ff13c15ba10 2024-04-25T09:01:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.748+0000 7ff13b7fe640 1 -- 172.21.15.55:0/4199043814 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130032810 con 0x7ff13c15ba10 2024-04-25T09:01:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.748+0000 7ff14319e640 1 -- 172.21.15.55:0/4199043814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff13c15ba10 msgr2=0x7ff13c099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.748+0000 7ff14319e640 1 --2- 172.21.15.55:0/4199043814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff13c15ba10 0x7ff13c099a40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7ff1300097a0 tx=0x7ff13002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.748+0000 7ff14319e640 1 -- 172.21.15.55:0/4199043814 shutdown_connections 2024-04-25T09:01:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.748+0000 7ff14319e640 1 --2- 172.21.15.55:0/4199043814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff13c15ba10 0x7ff13c099a40 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.748+0000 7ff14319e640 1 -- 172.21.15.55:0/4199043814 >> 172.21.15.55:0/4199043814 conn(0x7ff13c0b32f0 msgr2=0x7ff13c0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.748+0000 7ff14319e640 1 -- 172.21.15.55:0/4199043814 shutdown_connections 2024-04-25T09:01:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.748+0000 7ff14319e640 1 -- 172.21.15.55:0/4199043814 wait complete. 2024-04-25T09:01:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.750+0000 7ff14319e640 1 Processor -- start 2024-04-25T09:01:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.750+0000 7ff14319e640 1 -- start start 2024-04-25T09:01:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.750+0000 7ff14319e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff13c06c3c0 0x7ff13c0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.750+0000 7ff14319e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff13c099f80 0x7ff13c158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.750+0000 7ff14319e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff13c15ba10 0x7ff13c0c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.750+0000 7ff14319e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c09a3d0 con 0x7ff13c15ba10 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.750+0000 7ff14319e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0d1530 con 0x7ff13c099f80 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.750+0000 7ff14319e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0cfe80 con 0x7ff13c06c3c0 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff14173b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff13c15ba10 0x7ff13c0c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff14173b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff13c15ba10 0x7ff13c0c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52346/0 (socket says 172.21.15.55:52346) 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff14173b640 1 -- 172.21.15.55:0/2074705190 learned_addr learned my addr 172.21.15.55:0/2074705190 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff13bfff640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff13c099f80 0x7ff13c158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff14173b640 1 -- 172.21.15.55:0/2074705190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff13c06c3c0 msgr2=0x7ff13c0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff14173b640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff13c06c3c0 0x7ff13c0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff14173b640 1 -- 172.21.15.55:0/2074705190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff13c099f80 msgr2=0x7ff13c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff14173b640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff13c099f80 0x7ff13c158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff14173b640 1 -- 172.21.15.55:0/2074705190 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0c8030 con 0x7ff13c15ba10 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff14173b640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff13c15ba10 0x7ff13c0c7af0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c780 tx=0x7ff13400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff1397fa640 1 -- 172.21.15.55:0/2074705190 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134017070 con 0x7ff13c15ba10 2024-04-25T09:01:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff1397fa640 1 -- 172.21.15.55:0/2074705190 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134003da0 con 0x7ff13c15ba10 2024-04-25T09:01:45.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff1397fa640 1 -- 172.21.15.55:0/2074705190 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340052b0 con 0x7ff13c15ba10 2024-04-25T09:01:45.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff14319e640 1 -- 172.21.15.55:0/2074705190 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c15c040 con 0x7ff13c15ba10 2024-04-25T09:01:45.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.751+0000 7ff14319e640 1 -- 172.21.15.55:0/2074705190 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c15c600 con 0x7ff13c15ba10 2024-04-25T09:01:45.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.752+0000 7ff14319e640 1 -- 172.21.15.55:0/2074705190 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c0749b0 con 0x7ff13c15ba10 2024-04-25T09:01:45.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.753+0000 7ff1397fa640 1 -- 172.21.15.55:0/2074705190 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff13401a070 con 0x7ff13c15ba10 2024-04-25T09:01:45.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.753+0000 7ff1397fa640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12006b4d0 0x7ff12006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.753+0000 7ff140f3a640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12006b4d0 0x7ff12006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.753+0000 7ff1397fa640 1 -- 172.21.15.55:0/2074705190 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7ff134089560 con 0x7ff13c15ba10 2024-04-25T09:01:45.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.754+0000 7ff140f3a640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12006b4d0 0x7ff12006d990 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff130034000 tx=0x7ff13002c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.758+0000 7ff1397fa640 1 -- 172.21.15.55:0/2074705190 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff13c0c8030 con 0x7ff13c15ba10 2024-04-25T09:01:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.937+0000 7ff14319e640 1 -- 172.21.15.55:0/2074705190 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff13c09a570 con 0x7ff13c15ba10 2024-04-25T09:01:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.938+0000 7ff1397fa640 1 -- 172.21.15.55:0/2074705190 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+13281 (secure 0 0 0) 0x7ff1340586c0 con 0x7ff13c15ba10 2024-04-25T09:01:45.927 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:45.927 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":94,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:01:44.620795+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/2841450668":"2024-04-26T09:01:41.599496+0000","172.21.15.55:6835/2841450668":"2024-04-26T09:01:41.599496+0000","172.21.15.55:6837/3282261214":"2024-04-26T09:00:58.145549+0000","172.21.15.55:6835/3282261214":"2024-04-26T09:00:58.145549+0000","172.21.15.55:6837/3953928431":"2024-04-26T08:59:46.600027+0000","172.21.15.55:6835/3953928431":"2024-04-26T08:59:46.600027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 -- 172.21.15.55:0/2074705190 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12006b4d0 msgr2=0x7ff12006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12006b4d0 0x7ff12006d990 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff130034000 tx=0x7ff13002c000 comp rx=0 tx=0).stop 2024-04-25T09:01:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 -- 172.21.15.55:0/2074705190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff13c15ba10 msgr2=0x7ff13c0c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff13c15ba10 0x7ff13c0c7af0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c780 tx=0x7ff13400cc40 comp rx=0 tx=0).stop 2024-04-25T09:01:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 -- 172.21.15.55:0/2074705190 shutdown_connections 2024-04-25T09:01:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12006b4d0 0x7ff12006d990 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff13c15ba10 0x7ff13c0c7af0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff13c099f80 0x7ff13c158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 --2- 172.21.15.55:0/2074705190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff13c06c3c0 0x7ff13c0c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 -- 172.21.15.55:0/2074705190 >> 172.21.15.55:0/2074705190 conn(0x7ff13c0b32f0 msgr2=0x7ff13c15acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:45.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 -- 172.21.15.55:0/2074705190 shutdown_connections 2024-04-25T09:01:45.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:45.940+0000 7ff14319e640 1 -- 172.21.15.55:0/2074705190 wait complete. 2024-04-25T09:01:45.940 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:01:45.940 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:01:46.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.055+0000 7fd35ca4a640 1 Processor -- start 2024-04-25T09:01:46.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.055+0000 7fd35ca4a640 1 -- start start 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.056+0000 7fd35ca4a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3580ce3a0 0x7fd3580b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.056+0000 7fd35ca4a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd35815d450 0x7fd35815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.056+0000 7fd35ca4a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580b1f60 con 0x7fd35806aba0 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.056+0000 7fd35ca4a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580b0130 con 0x7fd35815d450 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.056+0000 7fd35ca4a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580b09d0 con 0x7fd3580ce3a0 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.056+0000 7fd356d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd35815d450 0x7fd35815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.057+0000 7fd35659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd35806aba0 0x7fd35806af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60700/0 (socket says 172.21.15.55:60700) 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.057+0000 7fd356d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd35815d450 0x7fd35815d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52362/0 (socket says 172.21.15.55:52362) 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.057+0000 7fd35659c640 1 -- 172.21.15.55:0/1420013736 learned_addr learned my addr 172.21.15.55:0/1420013736 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.057+0000 7fd356d9d640 1 -- 172.21.15.55:0/1420013736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3580ce3a0 msgr2=0x7fd3580b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.057+0000 7fd356d9d640 1 --2- 172.21.15.55:0/1420013736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3580ce3a0 0x7fd3580b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.057+0000 7fd356d9d640 1 -- 172.21.15.55:0/1420013736 >> v1:172.21.15.55:6789/0 conn(0x7fd35806aba0 legacy=0x7fd35806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.057+0000 7fd35559a640 1 -- 172.21.15.55:0/1420013736 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685687959 0 0) 0x7fd3580b1f60 con 0x7fd35806aba0 2024-04-25T09:01:46.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.057+0000 7fd356d9d640 1 -- 172.21.15.55:0/1420013736 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580b0380 con 0x7fd35815d450 2024-04-25T09:01:46.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd356d9d640 1 --2- 172.21.15.55:0/1420013736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd35815d450 0x7fd35815d8e0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fd348009dc0 tx=0x7fd34802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b719f5ae363c18f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd35559a640 1 -- 172.21.15.55:0/1420013736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34802ae60 con 0x7fd35815d450 2024-04-25T09:01:46.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd35559a640 1 -- 172.21.15.55:0/1420013736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348007740 con 0x7fd35815d450 2024-04-25T09:01:46.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd35559a640 1 -- 172.21.15.55:0/1420013736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348007b10 con 0x7fd35815d450 2024-04-25T09:01:46.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd35ca4a640 1 -- 172.21.15.55:0/1420013736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd35815d450 msgr2=0x7fd35815d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd35ca4a640 1 --2- 172.21.15.55:0/1420013736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd35815d450 0x7fd35815d8e0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fd348009dc0 tx=0x7fd34802a680 comp rx=0 tx=0).stop 2024-04-25T09:01:46.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd35ca4a640 1 -- 172.21.15.55:0/1420013736 shutdown_connections 2024-04-25T09:01:46.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd35ca4a640 1 --2- 172.21.15.55:0/1420013736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3580ce3a0 0x7fd3580b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd35ca4a640 1 --2- 172.21.15.55:0/1420013736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd35815d450 0x7fd35815d8e0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd35ca4a640 1 -- 172.21.15.55:0/1420013736 >> 172.21.15.55:0/1420013736 conn(0x7fd3580d07d0 msgr2=0x7fd3580d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:46.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd35ca4a640 1 -- 172.21.15.55:0/1420013736 shutdown_connections 2024-04-25T09:01:46.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.058+0000 7fd35ca4a640 1 -- 172.21.15.55:0/1420013736 wait complete. 2024-04-25T09:01:46.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.060+0000 7fd35ca4a640 1 Processor -- start 2024-04-25T09:01:46.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.060+0000 7fd35ca4a640 1 -- start start 2024-04-25T09:01:46.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.060+0000 7fd35ca4a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd35806aba0 0x7fd3580ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.060+0000 7fd35ca4a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3580ce3a0 0x7fd3580c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.060+0000 7fd35ca4a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd35815d450 0x7fd3580c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.060+0000 7fd35ca4a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580b0e60 con 0x7fd35815d450 2024-04-25T09:01:46.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.060+0000 7fd35ca4a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35806b880 con 0x7fd35806aba0 2024-04-25T09:01:46.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.060+0000 7fd35ca4a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580b0fe0 con 0x7fd3580ce3a0 2024-04-25T09:01:46.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd356d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd35815d450 0x7fd3580c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd356d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd35815d450 0x7fd3580c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52376/0 (socket says 172.21.15.55:52376) 2024-04-25T09:01:46.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd356d9d640 1 -- 172.21.15.55:0/2625117509 learned_addr learned my addr 172.21.15.55:0/2625117509 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:46.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd355d9b640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3580ce3a0 0x7fd3580c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd35659c640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd35806aba0 0x7fd3580ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd356d9d640 1 -- 172.21.15.55:0/2625117509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3580ce3a0 msgr2=0x7fd3580c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd356d9d640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3580ce3a0 0x7fd3580c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd356d9d640 1 -- 172.21.15.55:0/2625117509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd35806aba0 msgr2=0x7fd3580ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd356d9d640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd35806aba0 0x7fd3580ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd356d9d640 1 -- 172.21.15.55:0/2625117509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580c9180 con 0x7fd35815d450 2024-04-25T09:01:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd35659c640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd35806aba0 0x7fd3580ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd356d9d640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd35815d450 0x7fd3580c8b40 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fd34802ac70 tx=0x7fd348004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd34effd640 1 -- 172.21.15.55:0/2625117509 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348040070 con 0x7fd35815d450 2024-04-25T09:01:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd34effd640 1 -- 172.21.15.55:0/2625117509 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34802ae60 con 0x7fd35815d450 2024-04-25T09:01:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd35ca4a640 1 -- 172.21.15.55:0/2625117509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3580c9460 con 0x7fd35815d450 2024-04-25T09:01:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd34effd640 1 -- 172.21.15.55:0/2625117509 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348031e60 con 0x7fd35815d450 2024-04-25T09:01:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.061+0000 7fd35ca4a640 1 -- 172.21.15.55:0/2625117509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3580c9a20 con 0x7fd35815d450 2024-04-25T09:01:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.062+0000 7fd35ca4a640 1 -- 172.21.15.55:0/2625117509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3580750b0 con 0x7fd35815d450 2024-04-25T09:01:46.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.063+0000 7fd34effd640 1 -- 172.21.15.55:0/2625117509 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd348039040 con 0x7fd35815d450 2024-04-25T09:01:46.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.063+0000 7fd34effd640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 0x7fd33806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.063+0000 7fd34effd640 1 -- 172.21.15.55:0/2625117509 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fd3480ab710 con 0x7fd35815d450 2024-04-25T09:01:46.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.063+0000 7fd35659c640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 0x7fd33806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.064+0000 7fd35659c640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 0x7fd33806d990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd350000f60 tx=0x7fd350007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.067+0000 7fd34effd640 1 -- 172.21.15.55:0/2625117509 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd34807a7d0 con 0x7fd35815d450 2024-04-25T09:01:46.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.251+0000 7fd35ca4a640 1 -- 172.21.15.55:0/2625117509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd358072f40 con 0x7fd35815d450 2024-04-25T09:01:46.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.251+0000 7fd34effd640 1 -- 172.21.15.55:0/2625117509 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd34807a0d0 con 0x7fd35815d450 2024-04-25T09:01:46.240 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:01:46.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 -- 172.21.15.55:0/2625117509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 msgr2=0x7fd33806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 0x7fd33806d990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd350000f60 tx=0x7fd350007c10 comp rx=0 tx=0).stop 2024-04-25T09:01:46.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 -- 172.21.15.55:0/2625117509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd35815d450 msgr2=0x7fd3580c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd35815d450 0x7fd3580c8b40 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fd34802ac70 tx=0x7fd348004a40 comp rx=0 tx=0).stop 2024-04-25T09:01:46.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 -- 172.21.15.55:0/2625117509 shutdown_connections 2024-04-25T09:01:46.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd33806b4d0 0x7fd33806d990 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd35815d450 0x7fd3580c8b40 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3580ce3a0 0x7fd3580c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 --2- 172.21.15.55:0/2625117509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd35806aba0 0x7fd3580ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 -- 172.21.15.55:0/2625117509 >> 172.21.15.55:0/2625117509 conn(0x7fd3580d07d0 msgr2=0x7fd35806ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:46.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 -- 172.21.15.55:0/2625117509 shutdown_connections 2024-04-25T09:01:46.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.253+0000 7fd35ca4a640 1 -- 172.21.15.55:0/2625117509 wait complete. 2024-04-25T09:01:46.253 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T09:01:46.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.366+0000 7f70ecf22640 1 Processor -- start 2024-04-25T09:01:46.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.366+0000 7f70ecf22640 1 -- start start 2024-04-25T09:01:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70ecf22640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70e815dce0 0x7f70e80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70ecf22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e80d35b0 0x7f70e80b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70ecf22640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e815e0c0 con 0x7f70e80d1f90 2024-04-25T09:01:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70ecf22640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e80b7b10 con 0x7f70e815dce0 2024-04-25T09:01:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70ecf22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80d2510 con 0x7f70e80d35b0 2024-04-25T09:01:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70e659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70e815dce0 0x7f70e80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70e659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70e815dce0 0x7f70e80d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52386/0 (socket says 172.21.15.55:52386) 2024-04-25T09:01:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70e659c640 1 -- 172.21.15.55:0/836287646 learned_addr learned my addr 172.21.15.55:0/836287646 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70dffff640 1 --2- 172.21.15.55:0/836287646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e80d35b0 0x7f70e80b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70e659c640 1 -- 172.21.15.55:0/836287646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e80d35b0 msgr2=0x7f70e80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70e659c640 1 --2- 172.21.15.55:0/836287646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e80d35b0 0x7f70e80b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70e659c640 1 -- 172.21.15.55:0/836287646 >> v1:172.21.15.167:6789/0 conn(0x7f70e80d1f90 legacy=0x7f70e806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.367+0000 7f70e659c640 1 -- 172.21.15.55:0/836287646 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e80d27f0 con 0x7f70e815dce0 2024-04-25T09:01:46.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.368+0000 7f70e659c640 1 --2- 172.21.15.55:0/836287646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70e815dce0 0x7f70e80d1a50 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009870 tx=0x7f70d802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b474eef68017fd0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.368+0000 7f70e5d9b640 1 -- 172.21.15.55:0/836287646 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8037070 con 0x7f70e815dce0 2024-04-25T09:01:46.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.368+0000 7f70e5d9b640 1 -- 172.21.15.55:0/836287646 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8032440 con 0x7f70e815dce0 2024-04-25T09:01:46.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.368+0000 7f70e5d9b640 1 -- 172.21.15.55:0/836287646 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8032810 con 0x7f70e815dce0 2024-04-25T09:01:46.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.369+0000 7f70ecf22640 1 -- 172.21.15.55:0/836287646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70e815dce0 msgr2=0x7f70e80d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.369+0000 7f70ecf22640 1 --2- 172.21.15.55:0/836287646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70e815dce0 0x7f70e80d1a50 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009870 tx=0x7f70d802a180 comp rx=0 tx=0).stop 2024-04-25T09:01:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.369+0000 7f70ecf22640 1 -- 172.21.15.55:0/836287646 shutdown_connections 2024-04-25T09:01:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.369+0000 7f70ecf22640 1 --2- 172.21.15.55:0/836287646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e80d35b0 0x7f70e80b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.369+0000 7f70ecf22640 1 --2- 172.21.15.55:0/836287646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70e815dce0 0x7f70e80d1a50 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.369+0000 7f70ecf22640 1 -- 172.21.15.55:0/836287646 >> 172.21.15.55:0/836287646 conn(0x7f70e8072900 msgr2=0x7f70e80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.369+0000 7f70ecf22640 1 -- 172.21.15.55:0/836287646 shutdown_connections 2024-04-25T09:01:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.369+0000 7f70ecf22640 1 -- 172.21.15.55:0/836287646 wait complete. 2024-04-25T09:01:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.370+0000 7f70ecf22640 1 Processor -- start 2024-04-25T09:01:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.370+0000 7f70ecf22640 1 -- start start 2024-04-25T09:01:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70ecf22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70e80d1f90 0x7f70e814a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70ecf22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e80d35b0 0x7f70e8160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70ecf22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e815dce0 0x7f70e815fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70ecf22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80d3090 con 0x7f70e80d1f90 2024-04-25T09:01:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70ecf22640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80d2db0 con 0x7f70e80d35b0 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70ecf22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80b9820 con 0x7f70e815dce0 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70e659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70e80d1f90 0x7f70e814a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70e659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70e80d1f90 0x7f70e814a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52390/0 (socket says 172.21.15.55:52390) 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70e659c640 1 -- 172.21.15.55:0/3537985054 learned_addr learned my addr 172.21.15.55:0/3537985054 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70dffff640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e80d35b0 0x7f70e8160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70e6d9d640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e815dce0 0x7f70e815fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70e659c640 1 -- 172.21.15.55:0/3537985054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e815dce0 msgr2=0x7f70e815fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70e659c640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e815dce0 0x7f70e815fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70e659c640 1 -- 172.21.15.55:0/3537985054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e80d35b0 msgr2=0x7f70e8160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70e659c640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e80d35b0 0x7f70e8160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.371+0000 7f70e659c640 1 -- 172.21.15.55:0/3537985054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e815e9f0 con 0x7f70e80d1f90 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.372+0000 7f70e659c640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70e80d1f90 0x7f70e814a820 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009870 tx=0x7f70d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.372+0000 7f70deffd640 1 -- 172.21.15.55:0/3537985054 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8041020 con 0x7f70e80d1f90 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.372+0000 7f70deffd640 1 -- 172.21.15.55:0/3537985054 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8030970 con 0x7f70e80d1f90 2024-04-25T09:01:46.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.372+0000 7f70ecf22640 1 -- 172.21.15.55:0/3537985054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e815ecd0 con 0x7f70e80d1f90 2024-04-25T09:01:46.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.372+0000 7f70deffd640 1 -- 172.21.15.55:0/3537985054 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8037040 con 0x7f70e80d1f90 2024-04-25T09:01:46.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.372+0000 7f70ecf22640 1 -- 172.21.15.55:0/3537985054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e815f290 con 0x7f70e80d1f90 2024-04-25T09:01:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.373+0000 7f70ecf22640 1 -- 172.21.15.55:0/3537985054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e80749b0 con 0x7f70e80d1f90 2024-04-25T09:01:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.373+0000 7f70deffd640 1 -- 172.21.15.55:0/3537985054 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f70d8044020 con 0x7f70e80d1f90 2024-04-25T09:01:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.374+0000 7f70deffd640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f70c806b4d0 0x7f70c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.374+0000 7f70deffd640 1 -- 172.21.15.55:0/3537985054 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f70d80aa840 con 0x7f70e80d1f90 2024-04-25T09:01:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.374+0000 7f70dffff640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f70c806b4d0 0x7f70c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.374+0000 7f70dffff640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f70c806b4d0 0x7f70c806d990 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f70e814a6f0 tx=0x7f70d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.378+0000 7f70deffd640 1 -- 172.21.15.55:0/3537985054 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f70d804b030 con 0x7f70e80d1f90 2024-04-25T09:01:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.628+0000 7f70ecf22640 1 -- 172.21.15.55:0/3537985054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f70e80d0410 con 0x7f70e80d1f90 2024-04-25T09:01:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.633+0000 7f70deffd640 1 -- 172.21.15.55:0/3537985054 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v382) v1 ==== 149+0+0 (secure 0 0 0) 0x7f70d80792c0 con 0x7f70e80d1f90 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 -- 172.21.15.55:0/3537985054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f70c806b4d0 msgr2=0x7f70c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f70c806b4d0 0x7f70c806d990 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f70e814a6f0 tx=0x7f70d0008040 comp rx=0 tx=0).stop 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 -- 172.21.15.55:0/3537985054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70e80d1f90 msgr2=0x7f70e814a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70e80d1f90 0x7f70e814a820 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009870 tx=0x7f70d80046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 -- 172.21.15.55:0/3537985054 shutdown_connections 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f70c806b4d0 0x7f70c806d990 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70e815dce0 0x7f70e815fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e80d35b0 0x7f70e8160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 --2- 172.21.15.55:0/3537985054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70e80d1f90 0x7f70e814a820 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 -- 172.21.15.55:0/3537985054 >> 172.21.15.55:0/3537985054 conn(0x7f70e8072900 msgr2=0x7f70e80ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 -- 172.21.15.55:0/3537985054 shutdown_connections 2024-04-25T09:01:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.635+0000 7f70ecf22640 1 -- 172.21.15.55:0/3537985054 wait complete. 2024-04-25T09:01:46.638 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:01:46.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.753+0000 7f05ef0fc640 1 Processor -- start 2024-04-25T09:01:46.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.753+0000 7f05ef0fc640 1 -- start start 2024-04-25T09:01:46.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.754+0000 7f05ef0fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f05e815dca0 0x7f05e80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.754+0000 7f05ef0fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05e80d3b90 0x7f05e80d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.754+0000 7f05ef0fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e80d4090 con 0x7f05e80cee80 2024-04-25T09:01:46.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.754+0000 7f05ef0fc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e80b6b20 con 0x7f05e815dca0 2024-04-25T09:01:46.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.754+0000 7f05ef0fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e80d4370 con 0x7f05e80d3b90 2024-04-25T09:01:46.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.754+0000 7f05e7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05e80d3b90 0x7f05e80d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.754+0000 7f05ece98640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f05e815dca0 0x7f05e80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.754+0000 7f05e7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05e80d3b90 0x7f05e80d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:51504/0 (socket says 172.21.15.55:51504) 2024-04-25T09:01:46.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.754+0000 7f05e7fff640 1 -- 172.21.15.55:0/3988272175 learned_addr learned my addr 172.21.15.55:0/3988272175 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:46.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.755+0000 7f05ece98640 1 -- 172.21.15.55:0/3988272175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05e80d3b90 msgr2=0x7f05e80d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:46.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.755+0000 7f05ece98640 1 --2- 172.21.15.55:0/3988272175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05e80d3b90 0x7f05e80d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.755+0000 7f05ece98640 1 -- 172.21.15.55:0/3988272175 >> v1:172.21.15.167:6789/0 conn(0x7f05e80cee80 legacy=0x7f05e80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.755+0000 7f05ece98640 1 -- 172.21.15.55:0/3988272175 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e80d4650 con 0x7f05e815dca0 2024-04-25T09:01:46.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.755+0000 7f05e77fe640 1 -- 172.21.15.55:0/3988272175 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714352286 0 0) 0x7f05e80d4090 con 0x7f05e80cee80 2024-04-25T09:01:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05ece98640 1 --2- 172.21.15.55:0/3988272175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05e815dca0 0x7f05e80ce940 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f05d80097a0 tx=0x7f05d802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b2feae96110c821 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05e77fe640 1 -- 172.21.15.55:0/3988272175 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8037070 con 0x7f05e815dca0 2024-04-25T09:01:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05e77fe640 1 -- 172.21.15.55:0/3988272175 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d8032440 con 0x7f05e815dca0 2024-04-25T09:01:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05e77fe640 1 -- 172.21.15.55:0/3988272175 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8032810 con 0x7f05e815dca0 2024-04-25T09:01:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05ef0fc640 1 -- 172.21.15.55:0/3988272175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05e815dca0 msgr2=0x7f05e80ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05ef0fc640 1 --2- 172.21.15.55:0/3988272175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05e815dca0 0x7f05e80ce940 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f05d80097a0 tx=0x7f05d802a180 comp rx=0 tx=0).stop 2024-04-25T09:01:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05ef0fc640 1 -- 172.21.15.55:0/3988272175 shutdown_connections 2024-04-25T09:01:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05ef0fc640 1 --2- 172.21.15.55:0/3988272175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05e80d3b90 0x7f05e80d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05ef0fc640 1 --2- 172.21.15.55:0/3988272175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05e815dca0 0x7f05e80ce940 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05ef0fc640 1 -- 172.21.15.55:0/3988272175 >> 172.21.15.55:0/3988272175 conn(0x7f05e80726c0 msgr2=0x7f05e8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05ef0fc640 1 -- 172.21.15.55:0/3988272175 shutdown_connections 2024-04-25T09:01:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.756+0000 7f05ef0fc640 1 -- 172.21.15.55:0/3988272175 wait complete. 2024-04-25T09:01:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.758+0000 7f05ef0fc640 1 Processor -- start 2024-04-25T09:01:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.758+0000 7f05ef0fc640 1 -- start start 2024-04-25T09:01:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.758+0000 7f05ef0fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e80cee80 0x7f05e814cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.758+0000 7f05ef0fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05e80d3b90 0x7f05e81607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.758+0000 7f05ef0fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05e815dca0 0x7f05e8160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.758+0000 7f05ef0fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e815e200 con 0x7f05e80cee80 2024-04-25T09:01:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.758+0000 7f05ef0fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e815e080 con 0x7f05e80d3b90 2024-04-25T09:01:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.758+0000 7f05ef0fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e80d0f60 con 0x7f05e815dca0 2024-04-25T09:01:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ece98640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e80cee80 0x7f05e814cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ece98640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e80cee80 0x7f05e814cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52394/0 (socket says 172.21.15.55:52394) 2024-04-25T09:01:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ece98640 1 -- 172.21.15.55:0/507466976 learned_addr learned my addr 172.21.15.55:0/507466976 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05e7fff640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05e80d3b90 0x7f05e81607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ed699640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05e815dca0 0x7f05e8160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ece98640 1 -- 172.21.15.55:0/507466976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05e815dca0 msgr2=0x7f05e8160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ece98640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05e815dca0 0x7f05e8160cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ece98640 1 -- 172.21.15.55:0/507466976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05e80d3b90 msgr2=0x7f05e81607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ece98640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05e80d3b90 0x7f05e81607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ece98640 1 -- 172.21.15.55:0/507466976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e81f7df0 con 0x7f05e80cee80 2024-04-25T09:01:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ece98640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e80cee80 0x7f05e814cec0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f05d80098c0 tx=0x7f05d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05e57fa640 1 -- 172.21.15.55:0/507466976 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8037040 con 0x7f05e80cee80 2024-04-25T09:01:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05e57fa640 1 -- 172.21.15.55:0/507466976 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d8042070 con 0x7f05e80cee80 2024-04-25T09:01:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ef0fc640 1 -- 172.21.15.55:0/507466976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e8150e40 con 0x7f05e80cee80 2024-04-25T09:01:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05e57fa640 1 -- 172.21.15.55:0/507466976 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8030940 con 0x7f05e80cee80 2024-04-25T09:01:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.759+0000 7f05ef0fc640 1 -- 172.21.15.55:0/507466976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e8151400 con 0x7f05e80cee80 2024-04-25T09:01:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.760+0000 7f05ef0fc640 1 -- 172.21.15.55:0/507466976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e80750b0 con 0x7f05e80cee80 2024-04-25T09:01:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.761+0000 7f05e57fa640 1 -- 172.21.15.55:0/507466976 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05d8030ae0 con 0x7f05e80cee80 2024-04-25T09:01:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.761+0000 7f05e57fa640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05d406b4d0 0x7f05d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.761+0000 7f05e57fa640 1 -- 172.21.15.55:0/507466976 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f05d80aa730 con 0x7f05e80cee80 2024-04-25T09:01:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.761+0000 7f05e7fff640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05d406b4d0 0x7f05d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.762+0000 7f05e7fff640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05d406b4d0 0x7f05d406d990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f05e80cdc10 tx=0x7f05dc009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.766+0000 7f05e57fa640 1 -- 172.21.15.55:0/507466976 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05d8079240 con 0x7f05e80cee80 2024-04-25T09:01:46.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.945+0000 7f05ef0fc640 1 -- 172.21.15.55:0/507466976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f05e81536b0 con 0x7f05e80cee80 2024-04-25T09:01:46.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.949+0000 7f05e57fa640 1 -- 172.21.15.55:0/507466976 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f05d807d2e0 con 0x7f05e80cee80 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.951+0000 7f05ef0fc640 1 -- 172.21.15.55:0/507466976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05d406b4d0 msgr2=0x7f05d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.951+0000 7f05ef0fc640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05d406b4d0 0x7f05d406d990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f05e80cdc10 tx=0x7f05dc009240 comp rx=0 tx=0).stop 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.951+0000 7f05ef0fc640 1 -- 172.21.15.55:0/507466976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e80cee80 msgr2=0x7f05e814cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.951+0000 7f05ef0fc640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e80cee80 0x7f05e814cec0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f05d80098c0 tx=0x7f05d80046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.952+0000 7f05ef0fc640 1 -- 172.21.15.55:0/507466976 shutdown_connections 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.952+0000 7f05ef0fc640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f05d406b4d0 0x7f05d406d990 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.952+0000 7f05ef0fc640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05e815dca0 0x7f05e8160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.952+0000 7f05ef0fc640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05e80d3b90 0x7f05e81607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.952+0000 7f05ef0fc640 1 --2- 172.21.15.55:0/507466976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e80cee80 0x7f05e814cec0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.952+0000 7f05ef0fc640 1 -- 172.21.15.55:0/507466976 >> 172.21.15.55:0/507466976 conn(0x7f05e80726c0 msgr2=0x7f05e80b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.952+0000 7f05ef0fc640 1 -- 172.21.15.55:0/507466976 shutdown_connections 2024-04-25T09:01:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:46.952+0000 7f05ef0fc640 1 -- 172.21.15.55:0/507466976 wait complete. 2024-04-25T09:01:46.951 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:01:46.952 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:01:47.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:01:47.053 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:01:47.053 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:01:47.053 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:47.069 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:01:47.069 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:01:47.069 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:47.087 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:01:47.087 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:01:47.087 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:47.125 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:01:47.126 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:01:47.126 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:47.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:01:47.144 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:01:47.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:47.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.278+0000 7f8068109640 1 Processor -- start 2024-04-25T09:01:47.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.278+0000 7f8068109640 1 -- start start 2024-04-25T09:01:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f8068109640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f806015ba10 0x7f8060099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f8068109640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f806006c3c0 0x7f80600cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f8068109640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806006c900 con 0x7f8060099f80 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f8068109640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80600cbe50 con 0x7f806006c3c0 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f8068109640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806009a3d0 con 0x7f806015ba10 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f80666a6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f806006c3c0 0x7f80600cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f80656a4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8060099f80 0x7f806006bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60710/0 (socket says 172.21.15.55:60710) 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f80666a6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f806006c3c0 0x7f80600cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52408/0 (socket says 172.21.15.55:52408) 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f80656a4640 1 -- 172.21.15.55:0/2373656335 learned_addr learned my addr 172.21.15.55:0/2373656335 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f8065ea5640 1 --2- 172.21.15.55:0/2373656335 >> v2:172.21.15.167:3300/0 conn(0x7f806015ba10 0x7f8060099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f80666a6640 1 -- 172.21.15.55:0/2373656335 >> v2:172.21.15.167:3300/0 conn(0x7f806015ba10 msgr2=0x7f8060099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f80666a6640 1 --2- 172.21.15.55:0/2373656335 >> v2:172.21.15.167:3300/0 conn(0x7f806015ba10 0x7f8060099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f80666a6640 1 -- 172.21.15.55:0/2373656335 >> v1:172.21.15.55:6789/0 conn(0x7f8060099f80 legacy=0x7f806006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f8064ea3640 1 -- 172.21.15.55:0/2373656335 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840521739 0 0) 0x7f806006c900 con 0x7f8060099f80 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f80666a6640 1 -- 172.21.15.55:0/2373656335 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806006cbe0 con 0x7f806006c3c0 2024-04-25T09:01:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.279+0000 7f8065ea5640 1 --2- 172.21.15.55:0/2373656335 >> v2:172.21.15.167:3300/0 conn(0x7f806015ba10 0x7f8060099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:47.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.280+0000 7f80666a6640 1 --2- 172.21.15.55:0/2373656335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f806006c3c0 0x7f80600cd220 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f806009b2f0 tx=0x7f805802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13dea7deae7056b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.280+0000 7f8064ea3640 1 -- 172.21.15.55:0/2373656335 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058007740 con 0x7f806006c3c0 2024-04-25T09:01:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.280+0000 7f8064ea3640 1 -- 172.21.15.55:0/2373656335 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80580078e0 con 0x7f806006c3c0 2024-04-25T09:01:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.280+0000 7f8064ea3640 1 -- 172.21.15.55:0/2373656335 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058007cb0 con 0x7f806006c3c0 2024-04-25T09:01:47.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.281+0000 7f8068109640 1 -- 172.21.15.55:0/2373656335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f806006c3c0 msgr2=0x7f80600cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.281+0000 7f8068109640 1 --2- 172.21.15.55:0/2373656335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f806006c3c0 0x7f80600cd220 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f806009b2f0 tx=0x7f805802a680 comp rx=0 tx=0).stop 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.281+0000 7f8068109640 1 -- 172.21.15.55:0/2373656335 shutdown_connections 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.281+0000 7f8068109640 1 --2- 172.21.15.55:0/2373656335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f806006c3c0 0x7f80600cd220 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.281+0000 7f8068109640 1 --2- 172.21.15.55:0/2373656335 >> v2:172.21.15.167:3300/0 conn(0x7f806015ba10 0x7f8060099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.281+0000 7f8068109640 1 -- 172.21.15.55:0/2373656335 >> 172.21.15.55:0/2373656335 conn(0x7f80600b32f0 msgr2=0x7f80600b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.281+0000 7f8068109640 1 -- 172.21.15.55:0/2373656335 shutdown_connections 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.281+0000 7f8068109640 1 -- 172.21.15.55:0/2373656335 wait complete. 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.282+0000 7f8068109640 1 Processor -- start 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.282+0000 7f8068109640 1 -- start start 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f8068109640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f806006c3c0 0x7f80600c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f8068109640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8060099f80 0x7f80600b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f8068109640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f806015ba10 0x7f80600af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f8068109640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80600cd760 con 0x7f8060099f80 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f8068109640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80600cfe80 con 0x7f806006c3c0 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f8068109640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80600cd8e0 con 0x7f806015ba10 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80656a4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8060099f80 0x7f80600b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80656a4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8060099f80 0x7f80600b6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52418/0 (socket says 172.21.15.55:52418) 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80656a4640 1 -- 172.21.15.55:0/1070991916 learned_addr learned my addr 172.21.15.55:0/1070991916 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f8065ea5640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f806006c3c0 0x7f80600c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80656a4640 1 -- 172.21.15.55:0/1070991916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f806015ba10 msgr2=0x7f80600af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80656a4640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f806015ba10 0x7f80600af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80656a4640 1 -- 172.21.15.55:0/1070991916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f806006c3c0 msgr2=0x7f80600c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80656a4640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f806006c3c0 0x7f80600c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80656a4640 1 -- 172.21.15.55:0/1070991916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80600aef60 con 0x7f8060099f80 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80656a4640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8060099f80 0x7f80600b6a00 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f805000c500 tx=0x7f805000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80567fc640 1 -- 172.21.15.55:0/1070991916 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050018070 con 0x7f8060099f80 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80567fc640 1 -- 172.21.15.55:0/1070991916 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8050007580 con 0x7f8060099f80 2024-04-25T09:01:47.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f8068109640 1 -- 172.21.15.55:0/1070991916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80600c5330 con 0x7f8060099f80 2024-04-25T09:01:47.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f80567fc640 1 -- 172.21.15.55:0/1070991916 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050004a20 con 0x7f8060099f80 2024-04-25T09:01:47.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.283+0000 7f8068109640 1 -- 172.21.15.55:0/1070991916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80600af200 con 0x7f8060099f80 2024-04-25T09:01:47.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.284+0000 7f8068109640 1 -- 172.21.15.55:0/1070991916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80600749b0 con 0x7f8060099f80 2024-04-25T09:01:47.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.285+0000 7f80567fc640 1 -- 172.21.15.55:0/1070991916 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f805001b070 con 0x7f8060099f80 2024-04-25T09:01:47.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.285+0000 7f80567fc640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f804406b4d0 0x7f804406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.285+0000 7f80567fc640 1 -- 172.21.15.55:0/1070991916 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f8050089360 con 0x7f8060099f80 2024-04-25T09:01:47.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.285+0000 7f8065ea5640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f804406b4d0 0x7f804406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.286+0000 7f8065ea5640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f804406b4d0 0x7f804406d990 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f805c006fd0 tx=0x7f805c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.289+0000 7f80567fc640 1 -- 172.21.15.55:0/1070991916 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8050058390 con 0x7f8060099f80 2024-04-25T09:01:47.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.510+0000 7f8068109640 1 -- 172.21.15.55:0/1070991916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f806009a570 con 0x7f8060099f80 2024-04-25T09:01:47.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.511+0000 7f80567fc640 1 -- 172.21.15.55:0/1070991916 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f8050057c90 con 0x7f8060099f80 2024-04-25T09:01:47.500 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:47.500 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6032,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/945538714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":945538714},{"type":"v1","addr":"172.21.15.167:6834","nonce":945538714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3092505546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":3092505546},{"type":"v1","addr":"172.21.15.167:6835","nonce":3092505546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2106418955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2106418955},{"type":"v1","addr":"172.21.15.55:6836","nonce":2106418955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47},{"gid":8160,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/57983290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":57983290},{"type":"v1","addr":"172.21.15.55:6837","nonce":57983290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":66}],"filesystems":[]} 2024-04-25T09:01:47.500 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 66 2024-04-25T09:01:47.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.512+0000 7f8068109640 1 -- 172.21.15.55:0/1070991916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f804406b4d0 msgr2=0x7f804406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.512+0000 7f8068109640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f804406b4d0 0x7f804406d990 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f805c006fd0 tx=0x7f805c008040 comp rx=0 tx=0).stop 2024-04-25T09:01:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.512+0000 7f8068109640 1 -- 172.21.15.55:0/1070991916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8060099f80 msgr2=0x7f80600b6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.512+0000 7f8068109640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8060099f80 0x7f80600b6a00 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f805000c500 tx=0x7f805000c9c0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.512+0000 7f8068109640 1 -- 172.21.15.55:0/1070991916 shutdown_connections 2024-04-25T09:01:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.512+0000 7f8068109640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f804406b4d0 0x7f804406d990 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.512+0000 7f8068109640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f806015ba10 0x7f80600af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.512+0000 7f8068109640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8060099f80 0x7f80600b6a00 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.512+0000 7f8068109640 1 --2- 172.21.15.55:0/1070991916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f806006c3c0 0x7f80600c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.512+0000 7f8068109640 1 -- 172.21.15.55:0/1070991916 >> 172.21.15.55:0/1070991916 conn(0x7f80600b32f0 msgr2=0x7f80600d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.513+0000 7f8068109640 1 -- 172.21.15.55:0/1070991916 shutdown_connections 2024-04-25T09:01:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.513+0000 7f8068109640 1 -- 172.21.15.55:0/1070991916 wait complete. 2024-04-25T09:01:47.512 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:01:47.513 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:01:47.513 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:01:47.513 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:01:47.513 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:01:47.513 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:01:47.514 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:01:47.514 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:01:47.514 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:01:47.514 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:01:47.514 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:01:47.514 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:01:47.514 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:01:47.514 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:01:47.515 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:01:47.515 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:01:47.522 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:01:47.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:01:47.523 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:01:47.523 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:01:47.526 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:01:47.526 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:01:47.527 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:01:47.527 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:01:47.565 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:01:47.565 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:47.566 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:01:47.566 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:47.568 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:01:47.568 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:47.569 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:01:47.569 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:47.569 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:01:47.640 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T09:01:47.641 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-25T09:01:47.649 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T09:01:47.649 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T09:01:47.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.688+0000 7ff2b5bc8640 1 Processor -- start 2024-04-25T09:01:47.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.688+0000 7ff2b5bc8640 1 -- start start 2024-04-25T09:01:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2b5bc8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00b0740 0x7ff2b00b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2b5bc8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b015f660 con 0x7ff2b00cfd60 2024-04-25T09:01:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2b5bc8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b015f940 con 0x7ff2b015ef60 2024-04-25T09:01:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2b5bc8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b015fc20 con 0x7ff2b00b0740 2024-04-25T09:01:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2affff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff2b00cfd60 0x7ff2b00d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60720/0 (socket says 172.21.15.55:60720) 2024-04-25T09:01:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2affff640 1 -- 172.21.15.55:0/1816119904 learned_addr learned my addr 172.21.15.55:0/1816119904 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2aeffd640 1 --2- 172.21.15.55:0/1816119904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00b0740 0x7ff2b00b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2ae7fc640 1 -- 172.21.15.55:0/1816119904 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065149383 0 0) 0x7ff2b015f660 con 0x7ff2b00cfd60 2024-04-25T09:01:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2ae7fc640 1 -- 172.21.15.55:0/1816119904 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff298003520 con 0x7ff2b00cfd60 2024-04-25T09:01:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2aeffd640 1 -- 172.21.15.55:0/1816119904 >> v1:172.21.15.167:6789/0 conn(0x7ff2b015ef60 legacy=0x7ff2b00ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2aeffd640 1 -- 172.21.15.55:0/1816119904 >> v1:172.21.15.55:6789/0 conn(0x7ff2b00cfd60 legacy=0x7ff2b00d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.689+0000 7ff2aeffd640 1 -- 172.21.15.55:0/1816119904 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b015ff00 con 0x7ff2b00b0740 2024-04-25T09:01:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.690+0000 7ff2aeffd640 1 --2- 172.21.15.55:0/1816119904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00b0740 0x7ff2b00b0bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40097d0 tx=0x7ff2a402a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f7e7654711c25f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.690+0000 7ff2ae7fc640 1 -- 172.21.15.55:0/1816119904 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4037070 con 0x7ff2b00b0740 2024-04-25T09:01:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.690+0000 7ff2ae7fc640 1 -- 172.21.15.55:0/1816119904 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a4032440 con 0x7ff2b00b0740 2024-04-25T09:01:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.690+0000 7ff2ae7fc640 1 -- 172.21.15.55:0/1816119904 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40327f0 con 0x7ff2b00b0740 2024-04-25T09:01:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.691+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/1816119904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00b0740 msgr2=0x7ff2b00b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.691+0000 7ff2b5bc8640 1 --2- 172.21.15.55:0/1816119904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00b0740 0x7ff2b00b0bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40097d0 tx=0x7ff2a402a2a0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.691+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/1816119904 shutdown_connections 2024-04-25T09:01:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.691+0000 7ff2b5bc8640 1 --2- 172.21.15.55:0/1816119904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00b0740 0x7ff2b00b0bd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.691+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/1816119904 >> 172.21.15.55:0/1816119904 conn(0x7ff2b006f4c0 msgr2=0x7ff2b006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:47.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.691+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/1816119904 shutdown_connections 2024-04-25T09:01:47.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.691+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/1816119904 wait complete. 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.692+0000 7ff2b5bc8640 1 Processor -- start 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.692+0000 7ff2b5bc8640 1 -- start start 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2b5bc8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b00b0740 0x7ff2b015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2b5bc8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00cfd60 0x7ff2b0151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2b5bc8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2b015ef60 0x7ff2b00b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2b5bc8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b015f340 con 0x7ff2b00b0740 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2b5bc8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b01604c0 con 0x7ff2b015ef60 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2b5bc8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b00cebd0 con 0x7ff2b00cfd60 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2af7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b00b0740 0x7ff2b015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2af7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b00b0740 0x7ff2b015c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52460/0 (socket says 172.21.15.55:52460) 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2affff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2b015ef60 0x7ff2b00b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2aeffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00cfd60 0x7ff2b0151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2af7fe640 1 -- 172.21.15.55:0/3592956792 learned_addr learned my addr 172.21.15.55:0/3592956792 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2aeffd640 1 -- 172.21.15.55:0/3592956792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2b015ef60 msgr2=0x7ff2b00b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2aeffd640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2b015ef60 0x7ff2b00b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2aeffd640 1 -- 172.21.15.55:0/3592956792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b00b0740 msgr2=0x7ff2b015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2aeffd640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b00b0740 0x7ff2b015c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.693+0000 7ff2aeffd640 1 -- 172.21.15.55:0/3592956792 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b00b21e0 con 0x7ff2b00cfd60 2024-04-25T09:01:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.694+0000 7ff2aeffd640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00cfd60 0x7ff2b0151d20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4031000 tx=0x7ff2a40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.694+0000 7ff297fff640 1 -- 172.21.15.55:0/3592956792 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4042020 con 0x7ff2b00cfd60 2024-04-25T09:01:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.694+0000 7ff297fff640 1 -- 172.21.15.55:0/3592956792 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a4038040 con 0x7ff2b00cfd60 2024-04-25T09:01:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.694+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/3592956792 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b00b24c0 con 0x7ff2b00cfd60 2024-04-25T09:01:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.694+0000 7ff297fff640 1 -- 172.21.15.55:0/3592956792 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4037050 con 0x7ff2b00cfd60 2024-04-25T09:01:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.694+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/3592956792 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b00b2a80 con 0x7ff2b00cfd60 2024-04-25T09:01:47.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.695+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/3592956792 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b00750b0 con 0x7ff2b00cfd60 2024-04-25T09:01:47.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.695+0000 7ff297fff640 1 -- 172.21.15.55:0/3592956792 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff2a403c610 con 0x7ff2b00cfd60 2024-04-25T09:01:47.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.696+0000 7ff297fff640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff29c06b4d0 0x7ff29c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.696+0000 7ff297fff640 1 -- 172.21.15.55:0/3592956792 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7ff2a40aa370 con 0x7ff2b00cfd60 2024-04-25T09:01:47.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.696+0000 7ff2af7fe640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff29c06b4d0 0x7ff29c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.696+0000 7ff2af7fe640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff29c06b4d0 0x7ff29c06d990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0007fd0 tx=0x7ff2a0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.701+0000 7ff297fff640 1 -- 172.21.15.55:0/3592956792 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff2a404c020 con 0x7ff2b00cfd60 2024-04-25T09:01:47.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:47.894+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/3592956792 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff2b00ce880 con 0x7ff2b00cfd60 2024-04-25T09:01:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.666+0000 7ff297fff640 1 -- 172.21.15.55:0/3592956792 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v96) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff2a407de20 con 0x7ff2b00cfd60 2024-04-25T09:01:48.655 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-25T09:01:48.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.669+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/3592956792 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff29c06b4d0 msgr2=0x7ff29c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.669+0000 7ff2b5bc8640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff29c06b4d0 0x7ff29c06d990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0007fd0 tx=0x7ff2a0009040 comp rx=0 tx=0).stop 2024-04-25T09:01:48.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.669+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/3592956792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00cfd60 msgr2=0x7ff2b0151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.669+0000 7ff2b5bc8640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00cfd60 0x7ff2b0151d20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4031000 tx=0x7ff2a40046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.670+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/3592956792 shutdown_connections 2024-04-25T09:01:48.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.670+0000 7ff2b5bc8640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff29c06b4d0 0x7ff29c06d990 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.670+0000 7ff2b5bc8640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2b015ef60 0x7ff2b00b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.670+0000 7ff2b5bc8640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2b00cfd60 0x7ff2b0151d20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.670+0000 7ff2b5bc8640 1 --2- 172.21.15.55:0/3592956792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b00b0740 0x7ff2b015c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.670+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/3592956792 >> 172.21.15.55:0/3592956792 conn(0x7ff2b006f4c0 msgr2=0x7ff2b00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:48.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.670+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/3592956792 shutdown_connections 2024-04-25T09:01:48.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.670+0000 7ff2b5bc8640 1 -- 172.21.15.55:0/3592956792 wait complete. 2024-04-25T09:01:48.673 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:01:48.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.791+0000 7efc2bfd5640 1 Processor -- start 2024-04-25T09:01:48.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.792+0000 7efc2bfd5640 1 -- start start 2024-04-25T09:01:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.792+0000 7efc2bfd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efc24160f00 0x7efc240ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.792+0000 7efc2bfd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc2406aba0 0x7efc2406b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.792+0000 7efc2bfd5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc24161bf0 con 0x7efc241616f0 2024-04-25T09:01:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.792+0000 7efc2bfd5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2406b550 con 0x7efc24160f00 2024-04-25T09:01:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.792+0000 7efc2bfd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2406fab0 con 0x7efc2406aba0 2024-04-25T09:01:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.793+0000 7efc29d71640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efc24160f00 0x7efc240ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.793+0000 7efc29d71640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efc24160f00 0x7efc240ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50412/0 (socket says 172.21.15.55:50412) 2024-04-25T09:01:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.793+0000 7efc29d71640 1 -- 172.21.15.55:0/3561617447 learned_addr learned my addr 172.21.15.55:0/3561617447 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.793+0000 7efc2a572640 1 --2- 172.21.15.55:0/3561617447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc2406aba0 0x7efc2406b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.793+0000 7efc29d71640 1 -- 172.21.15.55:0/3561617447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc2406aba0 msgr2=0x7efc2406b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.793+0000 7efc29d71640 1 --2- 172.21.15.55:0/3561617447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc2406aba0 0x7efc2406b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.793+0000 7efc29d71640 1 -- 172.21.15.55:0/3561617447 >> v1:172.21.15.167:6789/0 conn(0x7efc241616f0 legacy=0x7efc24072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.793+0000 7efc29d71640 1 -- 172.21.15.55:0/3561617447 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24161ed0 con 0x7efc24160f00 2024-04-25T09:01:48.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.793+0000 7efc2a572640 1 --2- 172.21.15.55:0/3561617447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc2406aba0 0x7efc2406b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:48.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.794+0000 7efc29d71640 1 --2- 172.21.15.55:0/3561617447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc24160f00 0x7efc240ce640 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7efc1c009870 tx=0x7efc1c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabfcc38c0f5524a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.794+0000 7efc28d6f640 1 -- 172.21.15.55:0/3561617447 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c037070 con 0x7efc24160f00 2024-04-25T09:01:48.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.794+0000 7efc28d6f640 1 -- 172.21.15.55:0/3561617447 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c032440 con 0x7efc24160f00 2024-04-25T09:01:48.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.794+0000 7efc28d6f640 1 -- 172.21.15.55:0/3561617447 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c032810 con 0x7efc24160f00 2024-04-25T09:01:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.794+0000 7efc2bfd5640 1 -- 172.21.15.55:0/3561617447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc24160f00 msgr2=0x7efc240ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.794+0000 7efc2bfd5640 1 --2- 172.21.15.55:0/3561617447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc24160f00 0x7efc240ce640 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7efc1c009870 tx=0x7efc1c02a210 comp rx=0 tx=0).stop 2024-04-25T09:01:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.794+0000 7efc2bfd5640 1 -- 172.21.15.55:0/3561617447 shutdown_connections 2024-04-25T09:01:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.794+0000 7efc2bfd5640 1 --2- 172.21.15.55:0/3561617447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc2406aba0 0x7efc2406b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.794+0000 7efc2bfd5640 1 --2- 172.21.15.55:0/3561617447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc24160f00 0x7efc240ce640 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.794+0000 7efc2bfd5640 1 -- 172.21.15.55:0/3561617447 >> 172.21.15.55:0/3561617447 conn(0x7efc240b2370 msgr2=0x7efc240b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.795+0000 7efc2bfd5640 1 -- 172.21.15.55:0/3561617447 shutdown_connections 2024-04-25T09:01:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.795+0000 7efc2bfd5640 1 -- 172.21.15.55:0/3561617447 wait complete. 2024-04-25T09:01:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.796+0000 7efc2bfd5640 1 Processor -- start 2024-04-25T09:01:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.796+0000 7efc2bfd5640 1 -- start start 2024-04-25T09:01:48.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.796+0000 7efc2bfd5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc2406aba0 0x7efc240cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.796+0000 7efc2bfd5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc24160f00 0x7efc240aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2bfd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc241616f0 0x7efc2415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2bfd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc241612e0 con 0x7efc241616f0 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2bfd5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc24162490 con 0x7efc2406aba0 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2bfd5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc24161460 con 0x7efc24160f00 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2a572640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc241616f0 0x7efc2415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2a572640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc241616f0 0x7efc2415ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50422/0 (socket says 172.21.15.55:50422) 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2a572640 1 -- 172.21.15.55:0/2763058604 learned_addr learned my addr 172.21.15.55:0/2763058604 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc29d71640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc2406aba0 0x7efc240cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc29570640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc24160f00 0x7efc240aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2a572640 1 -- 172.21.15.55:0/2763058604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc24160f00 msgr2=0x7efc240aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2a572640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc24160f00 0x7efc240aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2a572640 1 -- 172.21.15.55:0/2763058604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc2406aba0 msgr2=0x7efc240cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2a572640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc2406aba0 0x7efc240cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2a572640 1 -- 172.21.15.55:0/2763058604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc240adb70 con 0x7efc241616f0 2024-04-25T09:01:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2a572640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc241616f0 0x7efc2415ce70 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7efc1400cd50 tx=0x7efc1400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc227fc640 1 -- 172.21.15.55:0/2763058604 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1400f680 con 0x7efc241616f0 2024-04-25T09:01:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc227fc640 1 -- 172.21.15.55:0/2763058604 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1400f840 con 0x7efc241616f0 2024-04-25T09:01:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2bfd5640 1 -- 172.21.15.55:0/2763058604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc240ade50 con 0x7efc241616f0 2024-04-25T09:01:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc227fc640 1 -- 172.21.15.55:0/2763058604 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1400fc30 con 0x7efc241616f0 2024-04-25T09:01:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.797+0000 7efc2bfd5640 1 -- 172.21.15.55:0/2763058604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc240ae6f0 con 0x7efc241616f0 2024-04-25T09:01:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.798+0000 7efc2bfd5640 1 -- 172.21.15.55:0/2763058604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc240749b0 con 0x7efc241616f0 2024-04-25T09:01:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.799+0000 7efc227fc640 1 -- 172.21.15.55:0/2763058604 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc140213f0 con 0x7efc241616f0 2024-04-25T09:01:48.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.799+0000 7efc227fc640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1006b4d0 0x7efc1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.799+0000 7efc227fc640 1 -- 172.21.15.55:0/2763058604 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efc1408ab60 con 0x7efc241616f0 2024-04-25T09:01:48.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.800+0000 7efc29d71640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1006b4d0 0x7efc1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.800+0000 7efc29d71640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1006b4d0 0x7efc1006d990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efc1c034000 tx=0x7efc1c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:48.804+0000 7efc227fc640 1 -- 172.21.15.55:0/2763058604 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc14014030 con 0x7efc241616f0 2024-04-25T09:01:49.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.053+0000 7efc2bfd5640 1 -- 172.21.15.55:0/2763058604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efc240cc690 con 0x7efc241616f0 2024-04-25T09:01:49.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.054+0000 7efc227fc640 1 -- 172.21.15.55:0/2763058604 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7efc140596e0 con 0x7efc241616f0 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm4IxeGBAAwuzfw8fkgBWLS/OHkVRPdA==", 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.043 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmz17MIxAAOjfHLP2pVtyOH1KkaFBdpw==", 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-25T09:01:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcJlOHxAAWRBqx21VaZdp7n+bG6QdjA==", 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmbKyTKhAARg7pgR8TeZKNHV38FuAv+g==", 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T09:01:49.045 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDgGSpmMDqwHRAAte7ZpF14thK4VEsC4getWg==", 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-25T09:01:49.046 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDjGSpm7bEhHRAALQKewGfpKljGFsW75+h/Dg==", 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDmGSpmjg2RHBAA+DxXqJHuPIGUsVvwUirEwg==", 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.047 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDpGSpmxft1HBAAsIYtKh97QF4WhdL9kI2QeA==", 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDvGSpm4QDFIRAAlMSvRI/gNR4p8BgQdRUcBA==", 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.048 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:01:49.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:01:49.049 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.049 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.049 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.049 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.049 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-25T09:01:49.049 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyGSpmARfiHxAABn3CWZTkyRxXpTUxKGi71A==", 2024-04-25T09:01:49.049 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:01:49.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:01:49.049 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.050 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.050 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.050 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.050 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-25T09:01:49.050 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1GSpmLHBmHRAA4xXuyYK95pq8g+DAXREvKQ==", 2024-04-25T09:01:49.050 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4GSpmMbpPGxAAP7YWBUzcafaowcZG1ZWhDA==", 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.051 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw==", 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcP0TNxAA02w2xuYx7fMlMbZpgy53hQ==", 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.052 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmpD8INBAA29l06IV/RnM5qxOD6VL3MA==", 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.053 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDaGSpm8xftABAADCQqbD2gknLM2w+MV/H29A==", 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-25T09:01:49.054 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDYGSpmHI4oORAAQoQL0ylKsbBRG+EldcMd4g==", 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmk2Q/FRAAwGHbq7UsFI+OdwcBOqLnlA==", 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T09:01:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm6NfaERAAtb5ZheEavSDdOCOxeM0a2Q==", 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-25T09:01:49.056 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:01:49.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 -- 172.21.15.55:0/2763058604 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1006b4d0 msgr2=0x7efc1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1006b4d0 0x7efc1006d990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efc1c034000 tx=0x7efc1c02e000 comp rx=0 tx=0).stop 2024-04-25T09:01:49.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 -- 172.21.15.55:0/2763058604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc241616f0 msgr2=0x7efc2415ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc241616f0 0x7efc2415ce70 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7efc1400cd50 tx=0x7efc1400a650 comp rx=0 tx=0).stop 2024-04-25T09:01:49.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 -- 172.21.15.55:0/2763058604 shutdown_connections 2024-04-25T09:01:49.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1006b4d0 0x7efc1006d990 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc241616f0 0x7efc2415ce70 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc24160f00 0x7efc240aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 --2- 172.21.15.55:0/2763058604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc2406aba0 0x7efc240cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 -- 172.21.15.55:0/2763058604 >> 172.21.15.55:0/2763058604 conn(0x7efc240b2370 msgr2=0x7efc240b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 -- 172.21.15.55:0/2763058604 shutdown_connections 2024-04-25T09:01:49.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.056+0000 7efc2bfd5640 1 -- 172.21.15.55:0/2763058604 wait complete. 2024-04-25T09:01:49.059 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:49.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.171+0000 7f067525d640 1 Processor -- start 2024-04-25T09:01:49.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.171+0000 7f067525d640 1 -- start start 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f067525d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06700d35b0 0x7f06700b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f067525d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700b5990 0x7f06700b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f067525d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067015e0c0 con 0x7f067015dce0 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f067525d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06700d2510 con 0x7f06700d35b0 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f067525d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06700d27f0 con 0x7f06700b5990 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f066e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06700d35b0 0x7f06700b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f066e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06700d35b0 0x7f06700b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50424/0 (socket says 172.21.15.55:50424) 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f066e59c640 1 -- 172.21.15.55:0/3694209169 learned_addr learned my addr 172.21.15.55:0/3694209169 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f066e59c640 1 -- 172.21.15.55:0/3694209169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700b5990 msgr2=0x7f06700b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f066f59e640 1 --2- 172.21.15.55:0/3694209169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700b5990 0x7f06700b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f066e59c640 1 --2- 172.21.15.55:0/3694209169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700b5990 0x7f06700b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f066e59c640 1 -- 172.21.15.55:0/3694209169 >> v1:172.21.15.167:6789/0 conn(0x7f067015dce0 legacy=0x7f06700d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f066e59c640 1 -- 172.21.15.55:0/3694209169 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06700d2ad0 con 0x7f06700d35b0 2024-04-25T09:01:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.172+0000 7f066f59e640 1 --2- 172.21.15.55:0/3694209169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700b5990 0x7f06700b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.173+0000 7f066e59c640 1 --2- 172.21.15.55:0/3694209169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06700d35b0 0x7f06700b5450 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f0664009870 tx=0x7f066402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1831fdfa136ab2bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.173+0000 7f066dd9b640 1 -- 172.21.15.55:0/3694209169 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0664037070 con 0x7f06700d35b0 2024-04-25T09:01:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.173+0000 7f066dd9b640 1 -- 172.21.15.55:0/3694209169 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0664032440 con 0x7f06700d35b0 2024-04-25T09:01:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.173+0000 7f066dd9b640 1 -- 172.21.15.55:0/3694209169 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0664032810 con 0x7f06700d35b0 2024-04-25T09:01:49.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.174+0000 7f067525d640 1 -- 172.21.15.55:0/3694209169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06700d35b0 msgr2=0x7f06700b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.174+0000 7f067525d640 1 --2- 172.21.15.55:0/3694209169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06700d35b0 0x7f06700b5450 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f0664009870 tx=0x7f066402a210 comp rx=0 tx=0).stop 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.174+0000 7f067525d640 1 -- 172.21.15.55:0/3694209169 shutdown_connections 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.174+0000 7f067525d640 1 --2- 172.21.15.55:0/3694209169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700b5990 0x7f06700b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.174+0000 7f067525d640 1 --2- 172.21.15.55:0/3694209169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06700d35b0 0x7f06700b5450 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.174+0000 7f067525d640 1 -- 172.21.15.55:0/3694209169 >> 172.21.15.55:0/3694209169 conn(0x7f0670072900 msgr2=0x7f06700d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.174+0000 7f067525d640 1 -- 172.21.15.55:0/3694209169 shutdown_connections 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.174+0000 7f067525d640 1 -- 172.21.15.55:0/3694209169 wait complete. 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.175+0000 7f067525d640 1 Processor -- start 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.175+0000 7f067525d640 1 -- start start 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f067525d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700b5990 0x7f0670160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f067525d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06700d35b0 0x7f06700caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f067525d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067015dce0 0x7f06701547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f067525d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06700d2160 con 0x7f067015dce0 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f067525d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06700d3090 con 0x7f06700d35b0 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f067525d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06700cafe0 con 0x7f06700b5990 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f066f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067015dce0 0x7f06701547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f066f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067015dce0 0x7f06701547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50426/0 (socket says 172.21.15.55:50426) 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f066f59e640 1 -- 172.21.15.55:0/662296416 learned_addr learned my addr 172.21.15.55:0/662296416 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f066ed9d640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700b5990 0x7f0670160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f066e59c640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06700d35b0 0x7f06700caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f066f59e640 1 -- 172.21.15.55:0/662296416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700b5990 msgr2=0x7f0670160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f066f59e640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700b5990 0x7f0670160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f066f59e640 1 -- 172.21.15.55:0/662296416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06700d35b0 msgr2=0x7f06700caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f066f59e640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06700d35b0 0x7f06700caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.176+0000 7f066f59e640 1 -- 172.21.15.55:0/662296416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06700c8400 con 0x7f067015dce0 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.177+0000 7f066f59e640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067015dce0 0x7f06701547c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f066800cef0 tx=0x7f066800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.177+0000 7f06577fe640 1 -- 172.21.15.55:0/662296416 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066801a070 con 0x7f067015dce0 2024-04-25T09:01:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.177+0000 7f06577fe640 1 -- 172.21.15.55:0/662296416 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066800d860 con 0x7f067015dce0 2024-04-25T09:01:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.177+0000 7f06577fe640 1 -- 172.21.15.55:0/662296416 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800dc50 con 0x7f067015dce0 2024-04-25T09:01:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.177+0000 7f067525d640 1 -- 172.21.15.55:0/662296416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06700cb270 con 0x7f067015dce0 2024-04-25T09:01:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.177+0000 7f067525d640 1 -- 172.21.15.55:0/662296416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06700cbab0 con 0x7f067015dce0 2024-04-25T09:01:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.178+0000 7f067525d640 1 -- 172.21.15.55:0/662296416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06700749b0 con 0x7f067015dce0 2024-04-25T09:01:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.178+0000 7f06577fe640 1 -- 172.21.15.55:0/662296416 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f066801d070 con 0x7f067015dce0 2024-04-25T09:01:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.179+0000 7f06577fe640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065c06b4d0 0x7f065c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.179+0000 7f06577fe640 1 -- 172.21.15.55:0/662296416 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f066808a6d0 con 0x7f067015dce0 2024-04-25T09:01:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.179+0000 7f066ed9d640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065c06b4d0 0x7f065c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.179+0000 7f066ed9d640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065c06b4d0 0x7f065c06d990 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f06700ca1b0 tx=0x7f0660009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.183+0000 7f06577fe640 1 -- 172.21.15.55:0/662296416 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f06700cb270 con 0x7f067015dce0 2024-04-25T09:01:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.363+0000 7f067525d640 1 -- 172.21.15.55:0/662296416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06701611a0 con 0x7f067015dce0 2024-04-25T09:01:49.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.364+0000 7f06577fe640 1 -- 172.21.15.55:0/662296416 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+12892 (secure 0 0 0) 0x7f0668059310 con 0x7f067015dce0 2024-04-25T09:01:49.353 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:49.353 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":98,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:01:48.671680+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:49.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 -- 172.21.15.55:0/662296416 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065c06b4d0 msgr2=0x7f065c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065c06b4d0 0x7f065c06d990 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f06700ca1b0 tx=0x7f0660009060 comp rx=0 tx=0).stop 2024-04-25T09:01:49.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 -- 172.21.15.55:0/662296416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067015dce0 msgr2=0x7f06701547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067015dce0 0x7f06701547c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f066800cef0 tx=0x7f066800a710 comp rx=0 tx=0).stop 2024-04-25T09:01:49.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 -- 172.21.15.55:0/662296416 shutdown_connections 2024-04-25T09:01:49.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f065c06b4d0 0x7f065c06d990 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067015dce0 0x7f06701547c0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06700d35b0 0x7f06700caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 --2- 172.21.15.55:0/662296416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06700b5990 0x7f0670160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 -- 172.21.15.55:0/662296416 >> 172.21.15.55:0/662296416 conn(0x7f0670072900 msgr2=0x7f06700b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 -- 172.21.15.55:0/662296416 shutdown_connections 2024-04-25T09:01:49.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.366+0000 7f067525d640 1 -- 172.21.15.55:0/662296416 wait complete. 2024-04-25T09:01:49.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:01:49.367 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:01:49.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.482+0000 7fac5136a640 1 Processor -- start 2024-04-25T09:01:49.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.482+0000 7fac5136a640 1 -- start start 2024-04-25T09:01:49.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.483+0000 7fac5136a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac4c06aba0 0x7fac4c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.483+0000 7fac5136a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac4c0ce3a0 0x7fac4c06af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.483+0000 7fac5136a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4c06b4c0 con 0x7fac4c161930 2024-04-25T09:01:49.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.483+0000 7fac5136a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c0b0130 con 0x7fac4c0ce3a0 2024-04-25T09:01:49.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.483+0000 7fac5136a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0b09d0 con 0x7fac4c06aba0 2024-04-25T09:01:49.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.483+0000 7fac4a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac4c0ce3a0 0x7fac4c06af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.483+0000 7fac4b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fac4c161930 0x7fac4c161dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39426/0 (socket says 172.21.15.55:39426) 2024-04-25T09:01:49.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.483+0000 7fac4b7fe640 1 -- 172.21.15.55:0/590789275 learned_addr learned my addr 172.21.15.55:0/590789275 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:49.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.483+0000 7fac4a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac4c0ce3a0 0x7fac4c06af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50434/0 (socket says 172.21.15.55:50434) 2024-04-25T09:01:49.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.483+0000 7fac4affd640 1 --2- 172.21.15.55:0/590789275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac4c06aba0 0x7fac4c0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.484+0000 7fac4a7fc640 1 -- 172.21.15.55:0/590789275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac4c06aba0 msgr2=0x7fac4c0b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.484+0000 7fac4a7fc640 1 --2- 172.21.15.55:0/590789275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac4c06aba0 0x7fac4c0b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.484+0000 7fac4a7fc640 1 -- 172.21.15.55:0/590789275 >> v1:172.21.15.55:6789/0 conn(0x7fac4c161930 legacy=0x7fac4c161dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.484+0000 7fac4a7fc640 1 -- 172.21.15.55:0/590789275 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c0b1f60 con 0x7fac4c0ce3a0 2024-04-25T09:01:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.484+0000 7fac49ffb640 1 -- 172.21.15.55:0/590789275 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141679858 0 0) 0x7fac4c06b4c0 con 0x7fac4c161930 2024-04-25T09:01:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.484+0000 7fac4a7fc640 1 --2- 172.21.15.55:0/590789275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac4c0ce3a0 0x7fac4c06af80 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fac400097d0 tx=0x7fac4002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f84110b11102fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.484+0000 7fac49ffb640 1 -- 172.21.15.55:0/590789275 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40037070 con 0x7fac4c0ce3a0 2024-04-25T09:01:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.484+0000 7fac49ffb640 1 -- 172.21.15.55:0/590789275 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40032440 con 0x7fac4c0ce3a0 2024-04-25T09:01:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.484+0000 7fac49ffb640 1 -- 172.21.15.55:0/590789275 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40032810 con 0x7fac4c0ce3a0 2024-04-25T09:01:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.485+0000 7fac5136a640 1 -- 172.21.15.55:0/590789275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac4c0ce3a0 msgr2=0x7fac4c06af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.485+0000 7fac5136a640 1 --2- 172.21.15.55:0/590789275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac4c0ce3a0 0x7fac4c06af80 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fac400097d0 tx=0x7fac4002a1c0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.485+0000 7fac5136a640 1 -- 172.21.15.55:0/590789275 shutdown_connections 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.485+0000 7fac5136a640 1 --2- 172.21.15.55:0/590789275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac4c0ce3a0 0x7fac4c06af80 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.485+0000 7fac5136a640 1 --2- 172.21.15.55:0/590789275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac4c06aba0 0x7fac4c0b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.485+0000 7fac5136a640 1 -- 172.21.15.55:0/590789275 >> 172.21.15.55:0/590789275 conn(0x7fac4c0d07d0 msgr2=0x7fac4c0d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.485+0000 7fac5136a640 1 -- 172.21.15.55:0/590789275 shutdown_connections 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.485+0000 7fac5136a640 1 -- 172.21.15.55:0/590789275 wait complete. 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.486+0000 7fac5136a640 1 Processor -- start 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.486+0000 7fac5136a640 1 -- start start 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.487+0000 7fac5136a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac4c06aba0 0x7fac4c0b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.487+0000 7fac5136a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac4c0ce3a0 0x7fac4c0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.487+0000 7fac5136a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac4c161930 0x7fac4c14fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.487+0000 7fac5136a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c06b880 con 0x7fac4c161930 2024-04-25T09:01:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.487+0000 7fac5136a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0b0660 con 0x7fac4c06aba0 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.487+0000 7fac5136a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0b0e60 con 0x7fac4c0ce3a0 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.487+0000 7fac4b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac4c161930 0x7fac4c14fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.487+0000 7fac4b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac4c161930 0x7fac4c14fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50450/0 (socket says 172.21.15.55:50450) 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.487+0000 7fac4b7fe640 1 -- 172.21.15.55:0/2044647443 learned_addr learned my addr 172.21.15.55:0/2044647443 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac4a7fc640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac4c0ce3a0 0x7fac4c0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac4affd640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac4c06aba0 0x7fac4c0b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac4b7fe640 1 -- 172.21.15.55:0/2044647443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac4c0ce3a0 msgr2=0x7fac4c0c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac4b7fe640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac4c0ce3a0 0x7fac4c0c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac4b7fe640 1 -- 172.21.15.55:0/2044647443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac4c06aba0 msgr2=0x7fac4c0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac4b7fe640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac4c06aba0 0x7fac4c0b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac4b7fe640 1 -- 172.21.15.55:0/2044647443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c0b3aa0 con 0x7fac4c161930 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac4b7fe640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac4c161930 0x7fac4c14fcf0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fac4400c440 tx=0x7fac4400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac337fe640 1 -- 172.21.15.55:0/2044647443 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac440074e0 con 0x7fac4c161930 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac337fe640 1 -- 172.21.15.55:0/2044647443 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac440047e0 con 0x7fac4c161930 2024-04-25T09:01:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac5136a640 1 -- 172.21.15.55:0/2044647443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c0b3d80 con 0x7fac4c161930 2024-04-25T09:01:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac337fe640 1 -- 172.21.15.55:0/2044647443 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44004bd0 con 0x7fac4c161930 2024-04-25T09:01:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.488+0000 7fac5136a640 1 -- 172.21.15.55:0/2044647443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c0b4340 con 0x7fac4c161930 2024-04-25T09:01:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.489+0000 7fac5136a640 1 -- 172.21.15.55:0/2044647443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4c0750b0 con 0x7fac4c161930 2024-04-25T09:01:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.490+0000 7fac337fe640 1 -- 172.21.15.55:0/2044647443 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac44011070 con 0x7fac4c161930 2024-04-25T09:01:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.490+0000 7fac337fe640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3806b500 0x7fac3806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.490+0000 7fac337fe640 1 -- 172.21.15.55:0/2044647443 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac44089a10 con 0x7fac4c161930 2024-04-25T09:01:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.490+0000 7fac4affd640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3806b500 0x7fac3806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.490+0000 7fac4affd640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3806b500 0x7fac3806d9c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0074a0 tx=0x7fac3c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.494+0000 7fac337fe640 1 -- 172.21.15.55:0/2044647443 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac44058be0 con 0x7fac4c161930 2024-04-25T09:01:49.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.677+0000 7fac5136a640 1 -- 172.21.15.55:0/2044647443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac4c0cbca0 con 0x7fac4c161930 2024-04-25T09:01:49.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.677+0000 7fac337fe640 1 -- 172.21.15.55:0/2044647443 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac440584e0 con 0x7fac4c161930 2024-04-25T09:01:49.666 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:01:49.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 -- 172.21.15.55:0/2044647443 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3806b500 msgr2=0x7fac3806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3806b500 0x7fac3806d9c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0074a0 tx=0x7fac3c00b040 comp rx=0 tx=0).stop 2024-04-25T09:01:49.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 -- 172.21.15.55:0/2044647443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac4c161930 msgr2=0x7fac4c14fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac4c161930 0x7fac4c14fcf0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fac4400c440 tx=0x7fac4400c900 comp rx=0 tx=0).stop 2024-04-25T09:01:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 -- 172.21.15.55:0/2044647443 shutdown_connections 2024-04-25T09:01:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3806b500 0x7fac3806d9c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac4c161930 0x7fac4c14fcf0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac4c0ce3a0 0x7fac4c0c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 --2- 172.21.15.55:0/2044647443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac4c06aba0 0x7fac4c0b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 -- 172.21.15.55:0/2044647443 >> 172.21.15.55:0/2044647443 conn(0x7fac4c0d07d0 msgr2=0x7fac4c0ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 -- 172.21.15.55:0/2044647443 shutdown_connections 2024-04-25T09:01:49.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.679+0000 7fac5136a640 1 -- 172.21.15.55:0/2044647443 wait complete. 2024-04-25T09:01:49.681 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:01:49.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.793+0000 7f01f9734640 1 Processor -- start 2024-04-25T09:01:49.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.793+0000 7f01f9734640 1 -- start start 2024-04-25T09:01:49.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f9734640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f415dce0 0x7f01f40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f9734640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01f40b5b60 0x7f01f40b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f9734640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f415e0c0 con 0x7f01f40d35b0 2024-04-25T09:01:49.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f9734640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40d2510 con 0x7f01f40b5b60 2024-04-25T09:01:49.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f9734640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40d27f0 con 0x7f01f415dce0 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01f40b5b60 0x7f01f40b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01f40b5b60 0x7f01f40b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50456/0 (socket says 172.21.15.55:50456) 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f37fe640 1 -- 172.21.15.55:0/2926890012 learned_addr learned my addr 172.21.15.55:0/2926890012 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f2ffd640 1 --2- 172.21.15.55:0/2926890012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f415dce0 0x7f01f40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f37fe640 1 -- 172.21.15.55:0/2926890012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f415dce0 msgr2=0x7f01f40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f37fe640 1 --2- 172.21.15.55:0/2926890012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f415dce0 0x7f01f40d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f37fe640 1 -- 172.21.15.55:0/2926890012 >> v1:172.21.15.167:6789/0 conn(0x7f01f40d35b0 legacy=0x7f01f40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.794+0000 7f01f37fe640 1 -- 172.21.15.55:0/2926890012 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40d2ad0 con 0x7f01f40b5b60 2024-04-25T09:01:49.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.795+0000 7f01f37fe640 1 --2- 172.21.15.55:0/2926890012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01f40b5b60 0x7f01f40b6b00 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009870 tx=0x7f01e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1999c5c3180a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.795+0000 7f01f1ffb640 1 -- 172.21.15.55:0/2926890012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4037070 con 0x7f01f40b5b60 2024-04-25T09:01:49.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.795+0000 7f01f1ffb640 1 -- 172.21.15.55:0/2926890012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e4032440 con 0x7f01f40b5b60 2024-04-25T09:01:49.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.795+0000 7f01f1ffb640 1 -- 172.21.15.55:0/2926890012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4032810 con 0x7f01f40b5b60 2024-04-25T09:01:49.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.796+0000 7f01f9734640 1 -- 172.21.15.55:0/2926890012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01f40b5b60 msgr2=0x7f01f40b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.796+0000 7f01f9734640 1 --2- 172.21.15.55:0/2926890012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01f40b5b60 0x7f01f40b6b00 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009870 tx=0x7f01e402a270 comp rx=0 tx=0).stop 2024-04-25T09:01:49.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.796+0000 7f01f9734640 1 -- 172.21.15.55:0/2926890012 shutdown_connections 2024-04-25T09:01:49.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.796+0000 7f01f9734640 1 --2- 172.21.15.55:0/2926890012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01f40b5b60 0x7f01f40b6b00 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.796+0000 7f01f9734640 1 --2- 172.21.15.55:0/2926890012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f415dce0 0x7f01f40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.796+0000 7f01f9734640 1 -- 172.21.15.55:0/2926890012 >> 172.21.15.55:0/2926890012 conn(0x7f01f4072900 msgr2=0x7f01f40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.796+0000 7f01f9734640 1 -- 172.21.15.55:0/2926890012 shutdown_connections 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.796+0000 7f01f9734640 1 -- 172.21.15.55:0/2926890012 wait complete. 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.797+0000 7f01f9734640 1 Processor -- start 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.797+0000 7f01f9734640 1 -- start start 2024-04-25T09:01:49.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f9734640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f40b5b60 0x7f01f414d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f9734640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01f40d35b0 0x7f01f41f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f9734640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01f415dce0 0x7f01f4149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f9734640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40b9820 con 0x7f01f40d35b0 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f9734640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40d3090 con 0x7f01f415dce0 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f9734640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40b99a0 con 0x7f01f40b5b60 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01f40d35b0 0x7f01f41f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01f40d35b0 0x7f01f41f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50464/0 (socket says 172.21.15.55:50464) 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f27fc640 1 -- 172.21.15.55:0/3273330694 learned_addr learned my addr 172.21.15.55:0/3273330694 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f2ffd640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f40b5b60 0x7f01f414d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f37fe640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01f415dce0 0x7f01f4149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f27fc640 1 -- 172.21.15.55:0/3273330694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f40b5b60 msgr2=0x7f01f414d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f27fc640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f40b5b60 0x7f01f414d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.798+0000 7f01f27fc640 1 -- 172.21.15.55:0/3273330694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01f415dce0 msgr2=0x7f01f4149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.799+0000 7f01f27fc640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01f415dce0 0x7f01f4149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.799+0000 7f01f27fc640 1 -- 172.21.15.55:0/3273330694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f41f6ed0 con 0x7f01f40d35b0 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.799+0000 7f01f27fc640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01f40d35b0 0x7f01f41f6990 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f01e800c400 tx=0x7f01e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.799+0000 7f01db7fe640 1 -- 172.21.15.55:0/3273330694 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e80052d0 con 0x7f01f40d35b0 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.799+0000 7f01db7fe640 1 -- 172.21.15.55:0/3273330694 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e8005490 con 0x7f01f40d35b0 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.799+0000 7f01f9734640 1 -- 172.21.15.55:0/3273330694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f41f7170 con 0x7f01f40d35b0 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.799+0000 7f01db7fe640 1 -- 172.21.15.55:0/3273330694 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e8007260 con 0x7f01f40d35b0 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.799+0000 7f01f9734640 1 -- 172.21.15.55:0/3273330694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f41f7730 con 0x7f01f40d35b0 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.800+0000 7f01f9734640 1 -- 172.21.15.55:0/3273330694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f40749b0 con 0x7f01f40d35b0 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.801+0000 7f01db7fe640 1 -- 172.21.15.55:0/3273330694 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f01e8007400 con 0x7f01f40d35b0 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.801+0000 7f01db7fe640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01e006b4d0 0x7f01e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.801+0000 7f01db7fe640 1 -- 172.21.15.55:0/3273330694 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f01e8089350 con 0x7f01f40d35b0 2024-04-25T09:01:49.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.801+0000 7f01f2ffd640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01e006b4d0 0x7f01e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.801+0000 7f01f2ffd640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01e006b4d0 0x7f01e006d990 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009fd0 tx=0x7f01ec009800 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.805+0000 7f01db7fe640 1 -- 172.21.15.55:0/3273330694 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f01e8057ed0 con 0x7f01f40d35b0 2024-04-25T09:01:49.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.987+0000 7f01f9734640 1 -- 172.21.15.55:0/3273330694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f01f40cd4d0 con 0x7f01f40d35b0 2024-04-25T09:01:49.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.988+0000 7f01db7fe640 1 -- 172.21.15.55:0/3273330694 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v98) v1 ==== 84+0+65 (secure 0 0 0) 0x7f01e805bf70 con 0x7f01f40d35b0 2024-04-25T09:01:49.977 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:49.977 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T09:01:49.977 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:01:49.977 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-25T09:01:49.977 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-25T09:01:49.977 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:01:49.977 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 -- 172.21.15.55:0/3273330694 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01e006b4d0 msgr2=0x7f01e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01e006b4d0 0x7f01e006d990 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009fd0 tx=0x7f01ec009800 comp rx=0 tx=0).stop 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 -- 172.21.15.55:0/3273330694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01f40d35b0 msgr2=0x7f01f41f6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01f40d35b0 0x7f01f41f6990 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f01e800c400 tx=0x7f01e800c8c0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 -- 172.21.15.55:0/3273330694 shutdown_connections 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f01e006b4d0 0x7f01e006d990 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01f415dce0 0x7f01f4149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01f40d35b0 0x7f01f41f6990 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 --2- 172.21.15.55:0/3273330694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01f40b5b60 0x7f01f414d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 -- 172.21.15.55:0/3273330694 >> 172.21.15.55:0/3273330694 conn(0x7f01f4072900 msgr2=0x7f01f40b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 -- 172.21.15.55:0/3273330694 shutdown_connections 2024-04-25T09:01:49.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:49.990+0000 7f01f9734640 1 -- 172.21.15.55:0/3273330694 wait complete. 2024-04-25T09:01:49.990 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:01:49.990 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:01:50.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.105+0000 7fc50f1e7640 1 Processor -- start 2024-04-25T09:01:50.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.106+0000 7fc50f1e7640 1 -- start start 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.106+0000 7fc50f1e7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5080cce80 0x7fc5080d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.106+0000 7fc50f1e7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5080d15f0 con 0x7fc5080cb250 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.106+0000 7fc50f1e7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50815b0e0 con 0x7fc5080ce5e0 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.106+0000 7fc50f1e7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50815bea0 con 0x7fc5080cce80 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.106+0000 7fc50d784640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc5080cb250 0x7fc5080cb6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39434/0 (socket says 172.21.15.55:39434) 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.107+0000 7fc50d784640 1 -- 172.21.15.55:0/620480859 learned_addr learned my addr 172.21.15.55:0/620480859 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.107+0000 7fc50cf83640 1 --2- 172.21.15.55:0/620480859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5080cce80 0x7fc5080d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.107+0000 7fc5077fe640 1 -- 172.21.15.55:0/620480859 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716279376 0 0) 0x7fc5080d15f0 con 0x7fc5080cb250 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.107+0000 7fc5077fe640 1 -- 172.21.15.55:0/620480859 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f8003520 con 0x7fc5080cb250 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.107+0000 7fc50cf83640 1 -- 172.21.15.55:0/620480859 >> v1:172.21.15.167:6789/0 conn(0x7fc5080ce5e0 legacy=0x7fc5080cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.107+0000 7fc5077fe640 1 -- 172.21.15.55:0/620480859 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639197200 0 0) 0x7fc50815b0e0 con 0x7fc5080ce5e0 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.107+0000 7fc50cf83640 1 -- 172.21.15.55:0/620480859 >> v1:172.21.15.55:6789/0 conn(0x7fc5080cb250 legacy=0x7fc5080cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.107+0000 7fc50cf83640 1 -- 172.21.15.55:0/620480859 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50815b3c0 con 0x7fc5080cce80 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.108+0000 7fc50cf83640 1 --2- 172.21.15.55:0/620480859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5080cce80 0x7fc5080d0ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0097d0 tx=0x7fc4fc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5fb9952da339972 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.108+0000 7fc5077fe640 1 -- 172.21.15.55:0/620480859 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc037070 con 0x7fc5080cce80 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.108+0000 7fc5077fe640 1 -- 172.21.15.55:0/620480859 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc032440 con 0x7fc5080cce80 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.108+0000 7fc5077fe640 1 -- 172.21.15.55:0/620480859 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0327f0 con 0x7fc5080cce80 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.109+0000 7fc50f1e7640 1 -- 172.21.15.55:0/620480859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5080cce80 msgr2=0x7fc5080d0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.109+0000 7fc50f1e7640 1 --2- 172.21.15.55:0/620480859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5080cce80 0x7fc5080d0ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0097d0 tx=0x7fc4fc02a210 comp rx=0 tx=0).stop 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.109+0000 7fc50f1e7640 1 -- 172.21.15.55:0/620480859 shutdown_connections 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.109+0000 7fc50f1e7640 1 --2- 172.21.15.55:0/620480859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5080cce80 0x7fc5080d0ef0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.109+0000 7fc50f1e7640 1 -- 172.21.15.55:0/620480859 >> 172.21.15.55:0/620480859 conn(0x7fc508099a40 msgr2=0x7fc5080d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.109+0000 7fc50f1e7640 1 -- 172.21.15.55:0/620480859 shutdown_connections 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.109+0000 7fc50f1e7640 1 -- 172.21.15.55:0/620480859 wait complete. 2024-04-25T09:01:50.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.110+0000 7fc50f1e7640 1 Processor -- start 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.110+0000 7fc50f1e7640 1 -- start start 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50f1e7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5080cb250 0x7fc5081457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50f1e7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5080cce80 0x7fc508143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50f1e7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5080ce5e0 0x7fc5080c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50f1e7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5080cea20 con 0x7fc5080cb250 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50f1e7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50815b980 con 0x7fc5080cce80 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50f1e7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5080cbdf0 con 0x7fc5080ce5e0 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50cf83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5080cb250 0x7fc5081457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50cf83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5080cb250 0x7fc5081457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50468/0 (socket says 172.21.15.55:50468) 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50cf83640 1 -- 172.21.15.55:0/3966217733 learned_addr learned my addr 172.21.15.55:0/3966217733 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50d784640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5080ce5e0 0x7fc5080c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc507fff640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5080cce80 0x7fc508143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50cf83640 1 -- 172.21.15.55:0/3966217733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5080ce5e0 msgr2=0x7fc5080c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50cf83640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5080ce5e0 0x7fc5080c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50cf83640 1 -- 172.21.15.55:0/3966217733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5080cce80 msgr2=0x7fc508143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50cf83640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5080cce80 0x7fc508143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50cf83640 1 -- 172.21.15.55:0/3966217733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508144720 con 0x7fc5080cb250 2024-04-25T09:01:50.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.111+0000 7fc50cf83640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5080cb250 0x7fc5081457c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc02a250 tx=0x7fc4fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.112+0000 7fc5057fa640 1 -- 172.21.15.55:0/3966217733 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc037040 con 0x7fc5080cb250 2024-04-25T09:01:50.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.112+0000 7fc5057fa640 1 -- 172.21.15.55:0/3966217733 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc0044c0 con 0x7fc5080cb250 2024-04-25T09:01:50.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.112+0000 7fc5057fa640 1 -- 172.21.15.55:0/3966217733 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0325f0 con 0x7fc5080cb250 2024-04-25T09:01:50.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.112+0000 7fc50f1e7640 1 -- 172.21.15.55:0/3966217733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc508144a00 con 0x7fc5080cb250 2024-04-25T09:01:50.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.112+0000 7fc50f1e7640 1 -- 172.21.15.55:0/3966217733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc508144fc0 con 0x7fc5080cb250 2024-04-25T09:01:50.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.113+0000 7fc50f1e7640 1 -- 172.21.15.55:0/3966217733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5080750b0 con 0x7fc5080cb250 2024-04-25T09:01:50.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.113+0000 7fc5057fa640 1 -- 172.21.15.55:0/3966217733 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc4fc044020 con 0x7fc5080cb250 2024-04-25T09:01:50.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.114+0000 7fc5057fa640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc4ec06b500 0x7fc4ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.114+0000 7fc5057fa640 1 -- 172.21.15.55:0/3966217733 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc4fc0a9da0 con 0x7fc5080cb250 2024-04-25T09:01:50.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.114+0000 7fc507fff640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc4ec06b500 0x7fc4ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.114+0000 7fc507fff640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc4ec06b500 0x7fc4ec06d9c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc5080af750 tx=0x7fc4f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.118+0000 7fc5057fa640 1 -- 172.21.15.55:0/3966217733 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc4fc04b020 con 0x7fc5080cb250 2024-04-25T09:01:50.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.298+0000 7fc50f1e7640 1 -- 172.21.15.55:0/3966217733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc50809a060 con 0x7fc5080cb250 2024-04-25T09:01:50.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.663+0000 7fc5057fa640 1 -- 172.21.15.55:0/3966217733 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v99) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc4fc078920 con 0x7fc5080cb250 2024-04-25T09:01:50.652 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-25T09:01:50.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.665+0000 7fc50f1e7640 1 -- 172.21.15.55:0/3966217733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc4ec06b500 msgr2=0x7fc4ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.665+0000 7fc50f1e7640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc4ec06b500 0x7fc4ec06d9c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc5080af750 tx=0x7fc4f4009040 comp rx=0 tx=0).stop 2024-04-25T09:01:50.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.665+0000 7fc50f1e7640 1 -- 172.21.15.55:0/3966217733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5080cb250 msgr2=0x7fc5081457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.665+0000 7fc50f1e7640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5080cb250 0x7fc5081457c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc02a250 tx=0x7fc4fc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.665+0000 7fc50f1e7640 1 -- 172.21.15.55:0/3966217733 shutdown_connections 2024-04-25T09:01:50.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.665+0000 7fc50f1e7640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc4ec06b500 0x7fc4ec06d9c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.665+0000 7fc50f1e7640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5080ce5e0 0x7fc5080c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.666+0000 7fc50f1e7640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5080cce80 0x7fc508143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.666+0000 7fc50f1e7640 1 --2- 172.21.15.55:0/3966217733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5080cb250 0x7fc5081457c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.666+0000 7fc50f1e7640 1 -- 172.21.15.55:0/3966217733 >> 172.21.15.55:0/3966217733 conn(0x7fc508099a40 msgr2=0x7fc50806aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.666+0000 7fc50f1e7640 1 -- 172.21.15.55:0/3966217733 shutdown_connections 2024-04-25T09:01:50.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.666+0000 7fc50f1e7640 1 -- 172.21.15.55:0/3966217733 wait complete. 2024-04-25T09:01:50.671 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:01:50.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.792+0000 7f7c5b129640 1 Processor -- start 2024-04-25T09:01:50.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.792+0000 7f7c5b129640 1 -- start start 2024-04-25T09:01:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c5b129640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 0x7f7c5406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c5b129640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c54144d00 0x7f7c5415f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c5b129640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5415fdd0 con 0x7f7c540cf620 2024-04-25T09:01:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c5b129640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c541600b0 con 0x7f7c54144d00 2024-04-25T09:01:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c5b129640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54160390 con 0x7f7c54144550 2024-04-25T09:01:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c53fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c54144d00 0x7f7c5415f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c53fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c54144d00 0x7f7c5415f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50476/0 (socket says 172.21.15.55:50476) 2024-04-25T09:01:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c53fff640 1 -- 172.21.15.55:0/3131529634 learned_addr learned my addr 172.21.15.55:0/3131529634 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c58ec5640 1 --2- 172.21.15.55:0/3131529634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 0x7f7c5406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c53fff640 1 -- 172.21.15.55:0/3131529634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 msgr2=0x7f7c5406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c53fff640 1 --2- 172.21.15.55:0/3131529634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 0x7f7c5406d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c53fff640 1 -- 172.21.15.55:0/3131529634 >> v1:172.21.15.167:6789/0 conn(0x7f7c540cf620 legacy=0x7f7c540cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c53fff640 1 -- 172.21.15.55:0/3131529634 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540cbeb0 con 0x7f7c54144d00 2024-04-25T09:01:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.793+0000 7f7c58ec5640 1 --2- 172.21.15.55:0/3131529634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 0x7f7c5406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:50.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.794+0000 7f7c53fff640 1 --2- 172.21.15.55:0/3131529634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c54144d00 0x7f7c5415f5a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009870 tx=0x7f7c4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6631cdd206b9a5c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.794+0000 7f7c537fe640 1 -- 172.21.15.55:0/3131529634 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44037070 con 0x7f7c54144d00 2024-04-25T09:01:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.794+0000 7f7c537fe640 1 -- 172.21.15.55:0/3131529634 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c44032440 con 0x7f7c54144d00 2024-04-25T09:01:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.794+0000 7f7c537fe640 1 -- 172.21.15.55:0/3131529634 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44032810 con 0x7f7c54144d00 2024-04-25T09:01:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.795+0000 7f7c5b129640 1 -- 172.21.15.55:0/3131529634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c54144d00 msgr2=0x7f7c5415f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.795+0000 7f7c5b129640 1 --2- 172.21.15.55:0/3131529634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c54144d00 0x7f7c5415f5a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009870 tx=0x7f7c4402a270 comp rx=0 tx=0).stop 2024-04-25T09:01:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.795+0000 7f7c5b129640 1 -- 172.21.15.55:0/3131529634 shutdown_connections 2024-04-25T09:01:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.795+0000 7f7c5b129640 1 --2- 172.21.15.55:0/3131529634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c54144d00 0x7f7c5415f5a0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.795+0000 7f7c5b129640 1 --2- 172.21.15.55:0/3131529634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 0x7f7c5406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.795+0000 7f7c5b129640 1 -- 172.21.15.55:0/3131529634 >> 172.21.15.55:0/3131529634 conn(0x7f7c5406aba0 msgr2=0x7f7c5406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.795+0000 7f7c5b129640 1 -- 172.21.15.55:0/3131529634 shutdown_connections 2024-04-25T09:01:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.795+0000 7f7c5b129640 1 -- 172.21.15.55:0/3131529634 wait complete. 2024-04-25T09:01:50.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.796+0000 7f7c5b129640 1 Processor -- start 2024-04-25T09:01:50.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.796+0000 7f7c5b129640 1 -- start start 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c5b129640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540cf620 0x7f7c540a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c5b129640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 0x7f7c540b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c5b129640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c54144d00 0x7f7c540a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c5b129640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54144930 con 0x7f7c540cf620 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c5b129640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5415fae0 con 0x7f7c54144d00 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c5b129640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54144ab0 con 0x7f7c54144550 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c58ec5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540cf620 0x7f7c540a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c58ec5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540cf620 0x7f7c540a9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50490/0 (socket says 172.21.15.55:50490) 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c58ec5640 1 -- 172.21.15.55:0/1611054983 learned_addr learned my addr 172.21.15.55:0/1611054983 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c596c6640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c54144d00 0x7f7c540a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c53fff640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 0x7f7c540b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c58ec5640 1 -- 172.21.15.55:0/1611054983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 msgr2=0x7f7c540b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c58ec5640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 0x7f7c540b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c58ec5640 1 -- 172.21.15.55:0/1611054983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c54144d00 msgr2=0x7f7c540a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c58ec5640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c54144d00 0x7f7c540a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c58ec5640 1 -- 172.21.15.55:0/1611054983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540a8c10 con 0x7f7c540cf620 2024-04-25T09:01:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.797+0000 7f7c53fff640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 0x7f7c540b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.798+0000 7f7c58ec5640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540cf620 0x7f7c540a9cb0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00d100 tx=0x7f7c4c00d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.798+0000 7f7c517fa640 1 -- 172.21.15.55:0/1611054983 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c01a070 con 0x7f7c540cf620 2024-04-25T09:01:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.798+0000 7f7c517fa640 1 -- 172.21.15.55:0/1611054983 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c003b90 con 0x7f7c540cf620 2024-04-25T09:01:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.798+0000 7f7c5b129640 1 -- 172.21.15.55:0/1611054983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c540a8ef0 con 0x7f7c540cf620 2024-04-25T09:01:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.798+0000 7f7c517fa640 1 -- 172.21.15.55:0/1611054983 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c004030 con 0x7f7c540cf620 2024-04-25T09:01:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.798+0000 7f7c5b129640 1 -- 172.21.15.55:0/1611054983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c540a94b0 con 0x7f7c540cf620 2024-04-25T09:01:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.799+0000 7f7c5b129640 1 -- 172.21.15.55:0/1611054983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c540749b0 con 0x7f7c540cf620 2024-04-25T09:01:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.799+0000 7f7c517fa640 1 -- 172.21.15.55:0/1611054983 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c4c01d070 con 0x7f7c540cf620 2024-04-25T09:01:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.800+0000 7f7c517fa640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 0x7f7c3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.800+0000 7f7c517fa640 1 -- 172.21.15.55:0/1611054983 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7c4c08a270 con 0x7f7c540cf620 2024-04-25T09:01:50.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.800+0000 7f7c53fff640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 0x7f7c3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.800+0000 7f7c53fff640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 0x7f7c3406d990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7c44034000 tx=0x7f7c4402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.804+0000 7f7c517fa640 1 -- 172.21.15.55:0/1611054983 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c4c010070 con 0x7f7c540cf620 2024-04-25T09:01:50.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:50.987+0000 7f7c5b129640 1 -- 172.21.15.55:0/1611054983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7c5406ebd0 con 0x7f7c540cf620 2024-04-25T09:01:51.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.666+0000 7f7c517fa640 1 -- 172.21.15.55:0/1611054983 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v100) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7c4c058c80 con 0x7f7c540cf620 2024-04-25T09:01:51.655 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-25T09:01:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.670+0000 7f7c5b129640 1 -- 172.21.15.55:0/1611054983 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 msgr2=0x7f7c3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.670+0000 7f7c5b129640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 0x7f7c3406d990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7c44034000 tx=0x7f7c4402e000 comp rx=0 tx=0).stop 2024-04-25T09:01:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.670+0000 7f7c5b129640 1 -- 172.21.15.55:0/1611054983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540cf620 msgr2=0x7f7c540a9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.670+0000 7f7c5b129640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540cf620 0x7f7c540a9cb0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00d100 tx=0x7f7c4c00d5c0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.674+0000 7f7c5b129640 1 -- 172.21.15.55:0/1611054983 shutdown_connections 2024-04-25T09:01:51.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.674+0000 7f7c5b129640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c3406b4d0 0x7f7c3406d990 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.674+0000 7f7c5b129640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c54144d00 0x7f7c540a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.674+0000 7f7c5b129640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c54144550 0x7f7c540b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.674+0000 7f7c5b129640 1 --2- 172.21.15.55:0/1611054983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c540cf620 0x7f7c540a9cb0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.674+0000 7f7c5b129640 1 -- 172.21.15.55:0/1611054983 >> 172.21.15.55:0/1611054983 conn(0x7f7c5406aba0 msgr2=0x7f7c5406dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:51.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.676+0000 7f7c5b129640 1 -- 172.21.15.55:0/1611054983 shutdown_connections 2024-04-25T09:01:51.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.680+0000 7f7c5b129640 1 -- 172.21.15.55:0/1611054983 wait complete. 2024-04-25T09:01:51.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:01:51.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.811+0000 7f5d704db640 1 Processor -- start 2024-04-25T09:01:51.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.811+0000 7f5d704db640 1 -- start start 2024-04-25T09:01:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d704db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d6815dbb0 0x7f5d680b9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d704db640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d680d1e20 0x7f5d680b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d704db640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d680b7b80 con 0x7f5d680b5aa0 2024-04-25T09:01:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d704db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d680d2670 con 0x7f5d6815dbb0 2024-04-25T09:01:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d704db640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d680d2950 con 0x7f5d680d1e20 2024-04-25T09:01:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d6e277640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d6815dbb0 0x7f5d680b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d6ea78640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5d680b5aa0 0x7f5d6806c140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39448/0 (socket says 172.21.15.55:39448) 2024-04-25T09:01:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d6ea78640 1 -- 172.21.15.55:0/4050464690 learned_addr learned my addr 172.21.15.55:0/4050464690 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d6da76640 1 --2- 172.21.15.55:0/4050464690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d680d1e20 0x7f5d680b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d6e277640 1 -- 172.21.15.55:0/4050464690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d680d1e20 msgr2=0x7f5d680b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d6e277640 1 --2- 172.21.15.55:0/4050464690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d680d1e20 0x7f5d680b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d6e277640 1 -- 172.21.15.55:0/4050464690 >> v1:172.21.15.55:6789/0 conn(0x7f5d680b5aa0 legacy=0x7f5d6806c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d6e277640 1 -- 172.21.15.55:0/4050464690 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d680d2c30 con 0x7f5d6815dbb0 2024-04-25T09:01:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d6d275640 1 -- 172.21.15.55:0/4050464690 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613425480 0 0) 0x7f5d680b7b80 con 0x7f5d680b5aa0 2024-04-25T09:01:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.812+0000 7f5d6da76640 1 --2- 172.21.15.55:0/4050464690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d680d1e20 0x7f5d680b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.813+0000 7f5d6e277640 1 --2- 172.21.15.55:0/4050464690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6815dbb0 0x7f5d680b9720 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009d90 tx=0x7f5d6402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bde952554b0461 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.813+0000 7f5d6d275640 1 -- 172.21.15.55:0/4050464690 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64007740 con 0x7f5d6815dbb0 2024-04-25T09:01:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.813+0000 7f5d6d275640 1 -- 172.21.15.55:0/4050464690 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d640078e0 con 0x7f5d6815dbb0 2024-04-25T09:01:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.813+0000 7f5d6d275640 1 -- 172.21.15.55:0/4050464690 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64007cb0 con 0x7f5d6815dbb0 2024-04-25T09:01:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.814+0000 7f5d704db640 1 -- 172.21.15.55:0/4050464690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6815dbb0 msgr2=0x7f5d680b9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.814+0000 7f5d704db640 1 --2- 172.21.15.55:0/4050464690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6815dbb0 0x7f5d680b9720 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009d90 tx=0x7f5d6402a660 comp rx=0 tx=0).stop 2024-04-25T09:01:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.814+0000 7f5d704db640 1 -- 172.21.15.55:0/4050464690 shutdown_connections 2024-04-25T09:01:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.814+0000 7f5d704db640 1 --2- 172.21.15.55:0/4050464690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d680d1e20 0x7f5d680b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.814+0000 7f5d704db640 1 --2- 172.21.15.55:0/4050464690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6815dbb0 0x7f5d680b9720 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.814+0000 7f5d704db640 1 -- 172.21.15.55:0/4050464690 >> 172.21.15.55:0/4050464690 conn(0x7f5d680d0560 msgr2=0x7f5d680d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.814+0000 7f5d704db640 1 -- 172.21.15.55:0/4050464690 shutdown_connections 2024-04-25T09:01:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.814+0000 7f5d704db640 1 -- 172.21.15.55:0/4050464690 wait complete. 2024-04-25T09:01:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.815+0000 7f5d704db640 1 Processor -- start 2024-04-25T09:01:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.815+0000 7f5d704db640 1 -- start start 2024-04-25T09:01:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d704db640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d680b5aa0 0x7f5d680af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d704db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d680d1e20 0x7f5d680acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d704db640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d6815dbb0 0x7f5d680b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d704db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6815df90 con 0x7f5d680d1e20 2024-04-25T09:01:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d704db640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d680d31f0 con 0x7f5d680b5aa0 2024-04-25T09:01:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d704db640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6815e110 con 0x7f5d6815dbb0 2024-04-25T09:01:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6da76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d680d1e20 0x7f5d680acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6da76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d680d1e20 0x7f5d680acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50506/0 (socket says 172.21.15.55:50506) 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6da76640 1 -- 172.21.15.55:0/2275884956 learned_addr learned my addr 172.21.15.55:0/2275884956 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6e277640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d680b5aa0 0x7f5d680af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6ea78640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d6815dbb0 0x7f5d680b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6da76640 1 -- 172.21.15.55:0/2275884956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d6815dbb0 msgr2=0x7f5d680b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6da76640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d6815dbb0 0x7f5d680b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6da76640 1 -- 172.21.15.55:0/2275884956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d680b5aa0 msgr2=0x7f5d680af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6da76640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d680b5aa0 0x7f5d680af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6da76640 1 -- 172.21.15.55:0/2275884956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d680ad2d0 con 0x7f5d680d1e20 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6ea78640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d6815dbb0 0x7f5d680b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.816+0000 7f5d6e277640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d680b5aa0 0x7f5d680af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.817+0000 7f5d6da76640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d680d1e20 0x7f5d680acb30 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800c7f0 tx=0x7f5d5800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.817+0000 7f5d5effd640 1 -- 172.21.15.55:0/2275884956 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58015070 con 0x7f5d680d1e20 2024-04-25T09:01:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.817+0000 7f5d5effd640 1 -- 172.21.15.55:0/2275884956 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d58007a30 con 0x7f5d680d1e20 2024-04-25T09:01:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.817+0000 7f5d5effd640 1 -- 172.21.15.55:0/2275884956 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58007e00 con 0x7f5d680d1e20 2024-04-25T09:01:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.817+0000 7f5d704db640 1 -- 172.21.15.55:0/2275884956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d680ad5b0 con 0x7f5d680d1e20 2024-04-25T09:01:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.817+0000 7f5d704db640 1 -- 172.21.15.55:0/2275884956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d680adb70 con 0x7f5d680d1e20 2024-04-25T09:01:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.818+0000 7f5d704db640 1 -- 172.21.15.55:0/2275884956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d680750b0 con 0x7f5d680d1e20 2024-04-25T09:01:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.818+0000 7f5d5effd640 1 -- 172.21.15.55:0/2275884956 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d58018070 con 0x7f5d680d1e20 2024-04-25T09:01:51.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.819+0000 7f5d5effd640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d4c06b4d0 0x7f5d4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.819+0000 7f5d5effd640 1 -- 172.21.15.55:0/2275884956 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5d5808a0c0 con 0x7f5d680d1e20 2024-04-25T09:01:51.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.819+0000 7f5d6e277640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d4c06b4d0 0x7f5d4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.819+0000 7f5d6e277640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d4c06b4d0 0x7f5d4c06d990 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5d64034000 tx=0x7f5d6402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:51.824+0000 7f5d5effd640 1 -- 172.21.15.55:0/2275884956 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d58059030 con 0x7f5d680d1e20 2024-04-25T09:01:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.041+0000 7f5d704db640 1 -- 172.21.15.55:0/2275884956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5d680b7020 con 0x7f5d680d1e20 2024-04-25T09:01:52.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.684+0000 7f5d5effd640 1 -- 172.21.15.55:0/2275884956 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v69) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5d58058930 con 0x7f5d680d1e20 2024-04-25T09:01:52.673 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 14 and data pool 15 2024-04-25T09:01:52.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.694+0000 7f5d704db640 1 -- 172.21.15.55:0/2275884956 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d4c06b4d0 msgr2=0x7f5d4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.694+0000 7f5d704db640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d4c06b4d0 0x7f5d4c06d990 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5d64034000 tx=0x7f5d6402f000 comp rx=0 tx=0).stop 2024-04-25T09:01:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.694+0000 7f5d704db640 1 -- 172.21.15.55:0/2275884956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d680d1e20 msgr2=0x7f5d680acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.694+0000 7f5d704db640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d680d1e20 0x7f5d680acb30 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800c7f0 tx=0x7f5d5800cbf0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.695+0000 7f5d704db640 1 -- 172.21.15.55:0/2275884956 shutdown_connections 2024-04-25T09:01:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.695+0000 7f5d704db640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5d4c06b4d0 0x7f5d4c06d990 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.695+0000 7f5d704db640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d6815dbb0 0x7f5d680b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.695+0000 7f5d704db640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d680d1e20 0x7f5d680acb30 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.695+0000 7f5d704db640 1 --2- 172.21.15.55:0/2275884956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d680b5aa0 0x7f5d680af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.695+0000 7f5d704db640 1 -- 172.21.15.55:0/2275884956 >> 172.21.15.55:0/2275884956 conn(0x7f5d680d0560 msgr2=0x7f5d680b7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.697+0000 7f5d704db640 1 -- 172.21.15.55:0/2275884956 shutdown_connections 2024-04-25T09:01:52.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.697+0000 7f5d704db640 1 -- 172.21.15.55:0/2275884956 wait complete. 2024-04-25T09:01:52.709 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:52.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.827+0000 7f86e9e93640 1 Processor -- start 2024-04-25T09:01:52.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.827+0000 7f86e9e93640 1 -- start start 2024-04-25T09:01:52.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.827+0000 7f86e9e93640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86e40b5b60 0x7f86e41687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.827+0000 7f86e9e93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e415e0c0 con 0x7f86e415dce0 2024-04-25T09:01:52.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.827+0000 7f86e9e93640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40d2510 con 0x7f86e40d35b0 2024-04-25T09:01:52.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.827+0000 7f86e9e93640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40b7b10 con 0x7f86e40b5b60 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.828+0000 7f86e37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f86e415dce0 0x7f86e40d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39464/0 (socket says 172.21.15.55:39464) 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.828+0000 7f86e37fe640 1 -- 172.21.15.55:0/4040253456 learned_addr learned my addr 172.21.15.55:0/4040253456 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.828+0000 7f86e3fff640 1 --2- 172.21.15.55:0/4040253456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86e40b5b60 0x7f86e41687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.828+0000 7f86e27fc640 1 -- 172.21.15.55:0/4040253456 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069209761 0 0) 0x7f86e415e0c0 con 0x7f86e415dce0 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.828+0000 7f86e27fc640 1 -- 172.21.15.55:0/4040253456 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d0003520 con 0x7f86e415dce0 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.828+0000 7f86e27fc640 1 -- 172.21.15.55:0/4040253456 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408786168 0 0) 0x7f86e40d2510 con 0x7f86e40d35b0 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.828+0000 7f86e27fc640 1 -- 172.21.15.55:0/4040253456 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86e415e0c0 con 0x7f86e40d35b0 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.828+0000 7f86e3fff640 1 -- 172.21.15.55:0/4040253456 >> v1:172.21.15.167:6789/0 conn(0x7f86e40d35b0 legacy=0x7f86e40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.828+0000 7f86e3fff640 1 -- 172.21.15.55:0/4040253456 >> v1:172.21.15.55:6789/0 conn(0x7f86e415dce0 legacy=0x7f86e40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.828+0000 7f86e27fc640 1 -- 172.21.15.55:0/4040253456 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3261473178 0 0) 0x7f86d0003520 con 0x7f86e415dce0 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.828+0000 7f86e3fff640 1 -- 172.21.15.55:0/4040253456 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40d27f0 con 0x7f86e40b5b60 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.829+0000 7f86e3fff640 1 --2- 172.21.15.55:0/4040253456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86e40b5b60 0x7f86e41687f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009dc0 tx=0x7f86dc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf7a4ebb0fa7d85d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.829+0000 7f86e27fc640 1 -- 172.21.15.55:0/4040253456 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4001670 con 0x7f86e40b5b60 2024-04-25T09:01:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.829+0000 7f86e27fc640 1 -- 172.21.15.55:0/4040253456 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc007540 con 0x7f86e40b5b60 2024-04-25T09:01:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.829+0000 7f86e27fc640 1 -- 172.21.15.55:0/4040253456 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0078f0 con 0x7f86e40b5b60 2024-04-25T09:01:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.830+0000 7f86e9e93640 1 -- 172.21.15.55:0/4040253456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86e40b5b60 msgr2=0x7f86e41687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.830+0000 7f86e9e93640 1 --2- 172.21.15.55:0/4040253456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86e40b5b60 0x7f86e41687f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009dc0 tx=0x7f86dc02a660 comp rx=0 tx=0).stop 2024-04-25T09:01:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.830+0000 7f86e9e93640 1 -- 172.21.15.55:0/4040253456 shutdown_connections 2024-04-25T09:01:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.830+0000 7f86e9e93640 1 --2- 172.21.15.55:0/4040253456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86e40b5b60 0x7f86e41687f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.830+0000 7f86e9e93640 1 -- 172.21.15.55:0/4040253456 >> 172.21.15.55:0/4040253456 conn(0x7f86e4072900 msgr2=0x7f86e40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.830+0000 7f86e9e93640 1 -- 172.21.15.55:0/4040253456 shutdown_connections 2024-04-25T09:01:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.830+0000 7f86e9e93640 1 -- 172.21.15.55:0/4040253456 wait complete. 2024-04-25T09:01:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.831+0000 7f86e9e93640 1 Processor -- start 2024-04-25T09:01:52.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.831+0000 7f86e9e93640 1 -- start start 2024-04-25T09:01:52.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e9e93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e40b5b60 0x7f86e415c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e9e93640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e40d35b0 0x7f86e40ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e9e93640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86e415dce0 0x7f86e40acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e9e93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40d3090 con 0x7f86e40b5b60 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e9e93640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40d2db0 con 0x7f86e40d35b0 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e9e93640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40d2160 con 0x7f86e415dce0 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e40b5b60 0x7f86e415c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e40b5b60 0x7f86e415c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50510/0 (socket says 172.21.15.55:50510) 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e37fe640 1 -- 172.21.15.55:0/2370092955 learned_addr learned my addr 172.21.15.55:0/2370092955 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e3fff640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86e415dce0 0x7f86e40acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e2ffd640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e40d35b0 0x7f86e40ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e37fe640 1 -- 172.21.15.55:0/2370092955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86e415dce0 msgr2=0x7f86e40acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e37fe640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86e415dce0 0x7f86e40acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e37fe640 1 -- 172.21.15.55:0/2370092955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e40d35b0 msgr2=0x7f86e40ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e37fe640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e40d35b0 0x7f86e40ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.832+0000 7f86e37fe640 1 -- 172.21.15.55:0/2370092955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40aabb0 con 0x7f86e40b5b60 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.833+0000 7f86e37fe640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e40b5b60 0x7f86e415c040 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c4f0 tx=0x7f86d400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.833+0000 7f86dbfff640 1 -- 172.21.15.55:0/2370092955 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4017070 con 0x7f86e40b5b60 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.833+0000 7f86dbfff640 1 -- 172.21.15.55:0/2370092955 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d4005ce0 con 0x7f86e40b5b60 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.833+0000 7f86e9e93640 1 -- 172.21.15.55:0/2370092955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e40aae90 con 0x7f86e40b5b60 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.833+0000 7f86dbfff640 1 -- 172.21.15.55:0/2370092955 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4007290 con 0x7f86e40b5b60 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.833+0000 7f86e9e93640 1 -- 172.21.15.55:0/2370092955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e40ab450 con 0x7f86e40b5b60 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.834+0000 7f86e9e93640 1 -- 172.21.15.55:0/2370092955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e40749b0 con 0x7f86e40b5b60 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.834+0000 7f86dbfff640 1 -- 172.21.15.55:0/2370092955 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f86d401a070 con 0x7f86e40b5b60 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.835+0000 7f86dbfff640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f86c406b4d0 0x7f86c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.835+0000 7f86e2ffd640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f86c406b4d0 0x7f86c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.835+0000 7f86dbfff640 1 -- 172.21.15.55:0/2370092955 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86d4089610 con 0x7f86e40b5b60 2024-04-25T09:01:52.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.835+0000 7f86e2ffd640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f86c406b4d0 0x7f86c406d990 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f86e40b3340 tx=0x7f86cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:52.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:52.839+0000 7f86dbfff640 1 -- 172.21.15.55:0/2370092955 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f86d4058520 con 0x7f86e40b5b60 2024-04-25T09:01:53.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.023+0000 7f86e9e93640 1 -- 172.21.15.55:0/2370092955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86e415d230 con 0x7f86e40b5b60 2024-04-25T09:01:53.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.024+0000 7f86dbfff640 1 -- 172.21.15.55:0/2370092955 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16632 (secure 0 0 0) 0x7f86d4057e20 con 0x7f86e40b5b60 2024-04-25T09:01:53.013 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:53.013 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":101,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:01:52.042597+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:50.330313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:51.020096+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:53.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 -- 172.21.15.55:0/2370092955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f86c406b4d0 msgr2=0x7f86c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f86c406b4d0 0x7f86c406d990 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f86e40b3340 tx=0x7f86cc009040 comp rx=0 tx=0).stop 2024-04-25T09:01:53.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 -- 172.21.15.55:0/2370092955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e40b5b60 msgr2=0x7f86e415c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e40b5b60 0x7f86e415c040 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c4f0 tx=0x7f86d400c9b0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 -- 172.21.15.55:0/2370092955 shutdown_connections 2024-04-25T09:01:53.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f86c406b4d0 0x7f86c406d990 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86e415dce0 0x7f86e40acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e40d35b0 0x7f86e40ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 --2- 172.21.15.55:0/2370092955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e40b5b60 0x7f86e415c040 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 -- 172.21.15.55:0/2370092955 >> 172.21.15.55:0/2370092955 conn(0x7f86e4072900 msgr2=0x7f86e40d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:53.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 -- 172.21.15.55:0/2370092955 shutdown_connections 2024-04-25T09:01:53.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.026+0000 7f86e9e93640 1 -- 172.21.15.55:0/2370092955 wait complete. 2024-04-25T09:01:53.027 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:53.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.141+0000 7fa8f8a5a640 1 Processor -- start 2024-04-25T09:01:53.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.141+0000 7fa8f8a5a640 1 -- start start 2024-04-25T09:01:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f8a5a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8f415dce0 0x7fa8f40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f8a5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8f40d35b0 0x7fa8f40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f8a5a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f415e0c0 con 0x7fa8f40d1f90 2024-04-25T09:01:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f8a5a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40b7b10 con 0x7fa8f415dce0 2024-04-25T09:01:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f8a5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40d2510 con 0x7fa8f40d35b0 2024-04-25T09:01:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8f415dce0 0x7fa8f40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f2d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa8f40d1f90 0x7fa8f406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39470/0 (socket says 172.21.15.55:39470) 2024-04-25T09:01:53.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f2d9d640 1 -- 172.21.15.55:0/162056197 learned_addr learned my addr 172.21.15.55:0/162056197 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:53.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8ebfff640 1 --2- 172.21.15.55:0/162056197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8f40d35b0 0x7fa8f40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f259c640 1 -- 172.21.15.55:0/162056197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8f40d35b0 msgr2=0x7fa8f40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:53.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f259c640 1 --2- 172.21.15.55:0/162056197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8f40d35b0 0x7fa8f40b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f259c640 1 -- 172.21.15.55:0/162056197 >> v1:172.21.15.55:6789/0 conn(0x7fa8f40d1f90 legacy=0x7fa8f406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.142+0000 7fa8f259c640 1 -- 172.21.15.55:0/162056197 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f40d27f0 con 0x7fa8f415dce0 2024-04-25T09:01:53.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.143+0000 7fa8f259c640 1 --2- 172.21.15.55:0/162056197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f415dce0 0x7fa8f40d1a50 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40097a0 tx=0x7fa8e402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1442874fe85b3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.143+0000 7fa8f1d9b640 1 -- 172.21.15.55:0/162056197 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4037070 con 0x7fa8f415dce0 2024-04-25T09:01:53.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.143+0000 7fa8f1d9b640 1 -- 172.21.15.55:0/162056197 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e402ae50 con 0x7fa8f415dce0 2024-04-25T09:01:53.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.143+0000 7fa8f1d9b640 1 -- 172.21.15.55:0/162056197 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4032660 con 0x7fa8f415dce0 2024-04-25T09:01:53.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.144+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/162056197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f415dce0 msgr2=0x7fa8f40d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.144+0000 7fa8f8a5a640 1 --2- 172.21.15.55:0/162056197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f415dce0 0x7fa8f40d1a50 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40097a0 tx=0x7fa8e402a100 comp rx=0 tx=0).stop 2024-04-25T09:01:53.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.144+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/162056197 shutdown_connections 2024-04-25T09:01:53.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.144+0000 7fa8f8a5a640 1 --2- 172.21.15.55:0/162056197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8f40d35b0 0x7fa8f40b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.144+0000 7fa8f8a5a640 1 --2- 172.21.15.55:0/162056197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f415dce0 0x7fa8f40d1a50 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.144+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/162056197 >> 172.21.15.55:0/162056197 conn(0x7fa8f4072900 msgr2=0x7fa8f40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:53.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.144+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/162056197 shutdown_connections 2024-04-25T09:01:53.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.144+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/162056197 wait complete. 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.145+0000 7fa8f8a5a640 1 Processor -- start 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.145+0000 7fa8f8a5a640 1 -- start start 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8f8a5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8f40d1f90 0x7fa8f4153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8f8a5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f40d35b0 0x7fa8f4152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8f8a5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f415dce0 0x7fa8f40c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8f8a5a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40d3090 con 0x7fa8f40d35b0 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8f8a5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40d2db0 con 0x7fa8f415dce0 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8f8a5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40b9820 con 0x7fa8f40d1f90 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f40d35b0 0x7fa8f4152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f40d35b0 0x7fa8f4152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50524/0 (socket says 172.21.15.55:50524) 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8ebfff640 1 -- 172.21.15.55:0/2464106236 learned_addr learned my addr 172.21.15.55:0/2464106236 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:53.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8f259c640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8f40d1f90 0x7fa8f4153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8f2d9d640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f415dce0 0x7fa8f40c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8ebfff640 1 -- 172.21.15.55:0/2464106236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8f40d1f90 msgr2=0x7fa8f4153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8ebfff640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8f40d1f90 0x7fa8f4153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8ebfff640 1 -- 172.21.15.55:0/2464106236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f415dce0 msgr2=0x7fa8f40c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8ebfff640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f415dce0 0x7fa8f40c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8ebfff640 1 -- 172.21.15.55:0/2464106236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f40cb970 con 0x7fa8f40d35b0 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8f2d9d640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f415dce0 0x7fa8f40c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.146+0000 7fa8ebfff640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f40d35b0 0x7fa8f4152f60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00d830 tx=0x7fa8dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.147+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2464106236 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00b6c0 con 0x7fa8f40d35b0 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.147+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2464106236 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc019070 con 0x7fa8f40d35b0 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.147+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/2464106236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f40cbc50 con 0x7fa8f40d35b0 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.147+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2464106236 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00ba80 con 0x7fa8f40d35b0 2024-04-25T09:01:53.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.147+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/2464106236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f40cc210 con 0x7fa8f40d35b0 2024-04-25T09:01:53.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.148+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/2464106236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f40749b0 con 0x7fa8f40d35b0 2024-04-25T09:01:53.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.148+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2464106236 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa8dc01e460 con 0x7fa8f40d35b0 2024-04-25T09:01:53.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.149+0000 7fa8eaffd640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8d406b4d0 0x7fa8d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.149+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2464106236 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8dc08a780 con 0x7fa8f40d35b0 2024-04-25T09:01:53.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.149+0000 7fa8f259c640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8d406b4d0 0x7fa8d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.149+0000 7fa8f259c640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8d406b4d0 0x7fa8d406d990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4034000 tx=0x7fa8e402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.153+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2464106236 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8dc059690 con 0x7fa8f40d35b0 2024-04-25T09:01:53.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.335+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/2464106236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8f40b5dd0 con 0x7fa8f40d35b0 2024-04-25T09:01:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.336+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2464106236 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16632 (secure 0 0 0) 0x7fa8dc058f90 con 0x7fa8f40d35b0 2024-04-25T09:01:53.327 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:53.327 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":101,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:01:52.042597+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:50.330313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:51.020096+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:53.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/2464106236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8d406b4d0 msgr2=0x7fa8d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8d406b4d0 0x7fa8d406d990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4034000 tx=0x7fa8e402e000 comp rx=0 tx=0).stop 2024-04-25T09:01:53.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/2464106236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f40d35b0 msgr2=0x7fa8f4152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f40d35b0 0x7fa8f4152f60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00d830 tx=0x7fa8dc00dcf0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/2464106236 shutdown_connections 2024-04-25T09:01:53.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa8d406b4d0 0x7fa8d406d990 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f415dce0 0x7fa8f40c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f40d35b0 0x7fa8f4152f60 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 --2- 172.21.15.55:0/2464106236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8f40d1f90 0x7fa8f4153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/2464106236 >> 172.21.15.55:0/2464106236 conn(0x7fa8f4072900 msgr2=0x7fa8f40b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:53.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/2464106236 shutdown_connections 2024-04-25T09:01:53.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.338+0000 7fa8f8a5a640 1 -- 172.21.15.55:0/2464106236 wait complete. 2024-04-25T09:01:53.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:01:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.453+0000 7f1630d70640 1 Processor -- start 2024-04-25T09:01:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.453+0000 7f1630d70640 1 -- start start 2024-04-25T09:01:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.454+0000 7f1630d70640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f162c15dc80 0x7f162c161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.454+0000 7f1630d70640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c1627a0 con 0x7f162c0b97c0 2024-04-25T09:01:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.454+0000 7f1630d70640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c1621e0 con 0x7f162c0b5c00 2024-04-25T09:01:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.454+0000 7f1630d70640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162c1624c0 con 0x7f162c15dc80 2024-04-25T09:01:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.454+0000 7f162a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f162c15dc80 0x7f162c161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.454+0000 7f1629d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f162c0b97c0 0x7f162c0b54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39472/0 (socket says 172.21.15.55:39472) 2024-04-25T09:01:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.454+0000 7f1629d9b640 1 -- 172.21.15.55:0/4069118378 learned_addr learned my addr 172.21.15.55:0/4069118378 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.455+0000 7f162a59c640 1 -- 172.21.15.55:0/4069118378 >> v1:172.21.15.167:6789/0 conn(0x7f162c0b5c00 legacy=0x7f162c0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.455+0000 7f162a59c640 1 -- 172.21.15.55:0/4069118378 >> v1:172.21.15.55:6789/0 conn(0x7f162c0b97c0 legacy=0x7f162c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.455+0000 7f162a59c640 1 -- 172.21.15.55:0/4069118378 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0d1c70 con 0x7f162c15dc80 2024-04-25T09:01:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.455+0000 7f162959a640 1 -- 172.21.15.55:0/4069118378 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956146559 0 0) 0x7f162c1627a0 con 0x7f162c0b97c0 2024-04-25T09:01:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.455+0000 7f162a59c640 1 --2- 172.21.15.55:0/4069118378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f162c15dc80 0x7f162c161870 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f16240097a0 tx=0x7f162402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4689ad06575764af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.456+0000 7f162959a640 1 -- 172.21.15.55:0/4069118378 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624037070 con 0x7f162c15dc80 2024-04-25T09:01:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.456+0000 7f162959a640 1 -- 172.21.15.55:0/4069118378 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1624032440 con 0x7f162c15dc80 2024-04-25T09:01:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.456+0000 7f162959a640 1 -- 172.21.15.55:0/4069118378 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624032810 con 0x7f162c15dc80 2024-04-25T09:01:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.456+0000 7f1630d70640 1 -- 172.21.15.55:0/4069118378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f162c15dc80 msgr2=0x7f162c161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.456+0000 7f1630d70640 1 --2- 172.21.15.55:0/4069118378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f162c15dc80 0x7f162c161870 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f16240097a0 tx=0x7f162402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.456+0000 7f1630d70640 1 -- 172.21.15.55:0/4069118378 shutdown_connections 2024-04-25T09:01:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.456+0000 7f1630d70640 1 --2- 172.21.15.55:0/4069118378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f162c15dc80 0x7f162c161870 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.456+0000 7f1630d70640 1 -- 172.21.15.55:0/4069118378 >> 172.21.15.55:0/4069118378 conn(0x7f162c0d04f0 msgr2=0x7f162c0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.456+0000 7f1630d70640 1 -- 172.21.15.55:0/4069118378 shutdown_connections 2024-04-25T09:01:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.456+0000 7f1630d70640 1 -- 172.21.15.55:0/4069118378 wait complete. 2024-04-25T09:01:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.457+0000 7f1630d70640 1 Processor -- start 2024-04-25T09:01:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.458+0000 7f1630d70640 1 -- start start 2024-04-25T09:01:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.458+0000 7f1630d70640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f162c0b5c00 0x7f162c1497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.458+0000 7f1630d70640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f162c0b97c0 0x7f162c0b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.458+0000 7f1630d70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f162c15dc80 0x7f162c0b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.458+0000 7f1630d70640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c161f30 con 0x7f162c15dc80 2024-04-25T09:01:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.458+0000 7f1630d70640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c161db0 con 0x7f162c0b5c00 2024-04-25T09:01:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.458+0000 7f1630d70640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0d2b80 con 0x7f162c0b97c0 2024-04-25T09:01:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.458+0000 7f162ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f162c15dc80 0x7f162c0b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.458+0000 7f162ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f162c15dc80 0x7f162c0b86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50544/0 (socket says 172.21.15.55:50544) 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.458+0000 7f162ad9d640 1 -- 172.21.15.55:0/77308804 learned_addr learned my addr 172.21.15.55:0/77308804 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f162a59c640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f162c0b5c00 0x7f162c1497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f1629d9b640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f162c0b97c0 0x7f162c0b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f162ad9d640 1 -- 172.21.15.55:0/77308804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f162c0b97c0 msgr2=0x7f162c0b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f162ad9d640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f162c0b97c0 0x7f162c0b81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f162ad9d640 1 -- 172.21.15.55:0/77308804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f162c0b5c00 msgr2=0x7f162c1497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f162ad9d640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f162c0b5c00 0x7f162c1497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f162ad9d640 1 -- 172.21.15.55:0/77308804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c1f3a90 con 0x7f162c15dc80 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f1629d9b640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f162c0b97c0 0x7f162c0b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f162ad9d640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f162c15dc80 0x7f162c0b86f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f161c00c780 tx=0x7f161c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f1622ffd640 1 -- 172.21.15.55:0/77308804 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c004b60 con 0x7f162c15dc80 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f1622ffd640 1 -- 172.21.15.55:0/77308804 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c004d00 con 0x7f162c15dc80 2024-04-25T09:01:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f1622ffd640 1 -- 172.21.15.55:0/77308804 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c00aa90 con 0x7f162c15dc80 2024-04-25T09:01:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f1630d70640 1 -- 172.21.15.55:0/77308804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c1f3d70 con 0x7f162c15dc80 2024-04-25T09:01:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.459+0000 7f1630d70640 1 -- 172.21.15.55:0/77308804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c1f4330 con 0x7f162c15dc80 2024-04-25T09:01:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.460+0000 7f1630d70640 1 -- 172.21.15.55:0/77308804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c0750b0 con 0x7f162c15dc80 2024-04-25T09:01:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.461+0000 7f1622ffd640 1 -- 172.21.15.55:0/77308804 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f161c00ac30 con 0x7f162c15dc80 2024-04-25T09:01:53.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.461+0000 7f1622ffd640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f160c06b4d0 0x7f160c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.461+0000 7f1622ffd640 1 -- 172.21.15.55:0/77308804 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f161c08a430 con 0x7f162c15dc80 2024-04-25T09:01:53.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.461+0000 7f162a59c640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f160c06b4d0 0x7f160c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.462+0000 7f162a59c640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f160c06b4d0 0x7f160c06d990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1624034000 tx=0x7f162402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.465+0000 7f1622ffd640 1 -- 172.21.15.55:0/77308804 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f161c020070 con 0x7f162c15dc80 2024-04-25T09:01:53.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:53.684+0000 7f1630d70640 1 -- 172.21.15.55:0/77308804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f162c0ca070 con 0x7f162c15dc80 2024-04-25T09:01:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.114+0000 7f1622ffd640 1 -- 172.21.15.55:0/77308804 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) v1 ==== 118+0+0 (secure 0 0 0) 0x7f161c0592b0 con 0x7f162c15dc80 2024-04-25T09:01:54.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.116+0000 7f1630d70640 1 -- 172.21.15.55:0/77308804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f160c06b4d0 msgr2=0x7f160c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.116+0000 7f1630d70640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f160c06b4d0 0x7f160c06d990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1624034000 tx=0x7f162402e000 comp rx=0 tx=0).stop 2024-04-25T09:01:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.116+0000 7f1630d70640 1 -- 172.21.15.55:0/77308804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f162c15dc80 msgr2=0x7f162c0b86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.116+0000 7f1630d70640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f162c15dc80 0x7f162c0b86f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f161c00c780 tx=0x7f161c00cc40 comp rx=0 tx=0).stop 2024-04-25T09:01:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.116+0000 7f1630d70640 1 -- 172.21.15.55:0/77308804 shutdown_connections 2024-04-25T09:01:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.116+0000 7f1630d70640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f160c06b4d0 0x7f160c06d990 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.116+0000 7f1630d70640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f162c15dc80 0x7f162c0b86f0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.116+0000 7f1630d70640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f162c0b97c0 0x7f162c0b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.116+0000 7f1630d70640 1 --2- 172.21.15.55:0/77308804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f162c0b5c00 0x7f162c1497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.116+0000 7f1630d70640 1 -- 172.21.15.55:0/77308804 >> 172.21.15.55:0/77308804 conn(0x7f162c0d04f0 msgr2=0x7f162c0b6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.117+0000 7f1630d70640 1 -- 172.21.15.55:0/77308804 shutdown_connections 2024-04-25T09:01:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.117+0000 7f1630d70640 1 -- 172.21.15.55:0/77308804 wait complete. 2024-04-25T09:01:54.117 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:01:54.118 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:01:54.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.236+0000 7f23503ed640 1 Processor -- start 2024-04-25T09:01:54.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.236+0000 7f23503ed640 1 -- start start 2024-04-25T09:01:54.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.237+0000 7f23503ed640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f23480d3b90 0x7f23480d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.237+0000 7f23503ed640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23480d0f60 0x7f23480b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.237+0000 7f23503ed640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23480d4090 con 0x7f234815dca0 2024-04-25T09:01:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.237+0000 7f23503ed640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23480b6b20 con 0x7f23480d0f60 2024-04-25T09:01:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.237+0000 7f23503ed640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23480d1390 con 0x7f23480d3b90 2024-04-25T09:01:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.237+0000 7f234e98a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23480d0f60 0x7f23480b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.237+0000 7f234e98a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23480d0f60 0x7f23480b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50554/0 (socket says 172.21.15.55:50554) 2024-04-25T09:01:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.237+0000 7f234e98a640 1 -- 172.21.15.55:0/1148620851 learned_addr learned my addr 172.21.15.55:0/1148620851 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.238+0000 7f234d988640 1 --2- 172.21.15.55:0/1148620851 >> v2:172.21.15.167:3300/0 conn(0x7f23480d3b90 0x7f23480d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.238+0000 7f234e98a640 1 -- 172.21.15.55:0/1148620851 >> v2:172.21.15.167:3300/0 conn(0x7f23480d3b90 msgr2=0x7f23480d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.238+0000 7f234e98a640 1 --2- 172.21.15.55:0/1148620851 >> v2:172.21.15.167:3300/0 conn(0x7f23480d3b90 0x7f23480d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.238+0000 7f234e98a640 1 -- 172.21.15.55:0/1148620851 >> v1:172.21.15.167:6789/0 conn(0x7f234815dca0 legacy=0x7f23480ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.238+0000 7f234e98a640 1 -- 172.21.15.55:0/1148620851 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480d4370 con 0x7f23480d0f60 2024-04-25T09:01:54.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.238+0000 7f234e98a640 1 --2- 172.21.15.55:0/1148620851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480d0f60 0x7f23480b2500 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f23480b6560 tx=0x7f233802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80230a95f88ddeb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:54.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.239+0000 7f234d187640 1 -- 172.21.15.55:0/1148620851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338036070 con 0x7f23480d0f60 2024-04-25T09:01:54.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.239+0000 7f234d187640 1 -- 172.21.15.55:0/1148620851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2338031600 con 0x7f23480d0f60 2024-04-25T09:01:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.239+0000 7f234d187640 1 -- 172.21.15.55:0/1148620851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23380319d0 con 0x7f23480d0f60 2024-04-25T09:01:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.239+0000 7f23503ed640 1 -- 172.21.15.55:0/1148620851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480d0f60 msgr2=0x7f23480b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.239+0000 7f23503ed640 1 --2- 172.21.15.55:0/1148620851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480d0f60 0x7f23480b2500 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f23480b6560 tx=0x7f233802a760 comp rx=0 tx=0).stop 2024-04-25T09:01:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.239+0000 7f23503ed640 1 -- 172.21.15.55:0/1148620851 shutdown_connections 2024-04-25T09:01:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.239+0000 7f23503ed640 1 --2- 172.21.15.55:0/1148620851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480d0f60 0x7f23480b2500 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.239+0000 7f23503ed640 1 --2- 172.21.15.55:0/1148620851 >> v2:172.21.15.167:3300/0 conn(0x7f23480d3b90 0x7f23480d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.239+0000 7f23503ed640 1 -- 172.21.15.55:0/1148620851 >> 172.21.15.55:0/1148620851 conn(0x7f23480726c0 msgr2=0x7f2348072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.239+0000 7f23503ed640 1 -- 172.21.15.55:0/1148620851 shutdown_connections 2024-04-25T09:01:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.239+0000 7f23503ed640 1 -- 172.21.15.55:0/1148620851 wait complete. 2024-04-25T09:01:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.240+0000 7f23503ed640 1 Processor -- start 2024-04-25T09:01:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.241+0000 7f23503ed640 1 -- start start 2024-04-25T09:01:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.241+0000 7f23503ed640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480d0f60 0x7f23480cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.241+0000 7f23503ed640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480d3b90 0x7f23480aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.241+0000 7f23503ed640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f234815dca0 0x7f23480aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.241+0000 7f23503ed640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480cf050 con 0x7f23480d3b90 2024-04-25T09:01:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.241+0000 7f23503ed640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480b6d50 con 0x7f234815dca0 2024-04-25T09:01:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.241+0000 7f23503ed640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234815e080 con 0x7f23480d0f60 2024-04-25T09:01:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.241+0000 7f234d988640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480d3b90 0x7f23480aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.241+0000 7f234d988640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480d3b90 0x7f23480aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50562/0 (socket says 172.21.15.55:50562) 2024-04-25T09:01:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.241+0000 7f234d988640 1 -- 172.21.15.55:0/4102877041 learned_addr learned my addr 172.21.15.55:0/4102877041 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f234e98a640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f234815dca0 0x7f23480aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f234e189640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480d0f60 0x7f23480cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f234d988640 1 -- 172.21.15.55:0/4102877041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480d0f60 msgr2=0x7f23480cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f234d988640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480d0f60 0x7f23480cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f234d988640 1 -- 172.21.15.55:0/4102877041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f234815dca0 msgr2=0x7f23480aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f234d988640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f234815dca0 0x7f23480aa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f234d988640 1 -- 172.21.15.55:0/4102877041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480c8570 con 0x7f23480d3b90 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f234e98a640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f234815dca0 0x7f23480aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f234e189640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480d0f60 0x7f23480cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f234d988640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480d3b90 0x7f23480aa480 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f233c00d7d0 tx=0x7f233c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f2346ffd640 1 -- 172.21.15.55:0/4102877041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00b6c0 con 0x7f23480d3b90 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f2346ffd640 1 -- 172.21.15.55:0/4102877041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c019070 con 0x7f23480d3b90 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f23503ed640 1 -- 172.21.15.55:0/4102877041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23480c8850 con 0x7f23480d3b90 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f2346ffd640 1 -- 172.21.15.55:0/4102877041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00ba80 con 0x7f23480d3b90 2024-04-25T09:01:54.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.242+0000 7f23503ed640 1 -- 172.21.15.55:0/4102877041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23480c8e10 con 0x7f23480d3b90 2024-04-25T09:01:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.243+0000 7f23503ed640 1 -- 172.21.15.55:0/4102877041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23480750b0 con 0x7f23480d3b90 2024-04-25T09:01:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.243+0000 7f2346ffd640 1 -- 172.21.15.55:0/4102877041 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f233c00bc20 con 0x7f23480d3b90 2024-04-25T09:01:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.244+0000 7f2346ffd640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f233406b500 0x7f233406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.244+0000 7f234e189640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f233406b500 0x7f233406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.244+0000 7f2346ffd640 1 -- 172.21.15.55:0/4102877041 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f233c08a640 con 0x7f23480d3b90 2024-04-25T09:01:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.244+0000 7f234e189640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f233406b500 0x7f233406d9c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f23400015e0 tx=0x7f2340009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:54.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.248+0000 7f2346ffd640 1 -- 172.21.15.55:0/4102877041 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f233c01c360 con 0x7f23480d3b90 2024-04-25T09:01:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:54.468+0000 7f23503ed640 1 -- 172.21.15.55:0/4102877041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f23480b2c30 con 0x7f23480d3b90 2024-04-25T09:01:54.647 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T09:01:54.657+0000 7f9d9e108640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:01:55.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.122+0000 7f2346ffd640 1 -- 172.21.15.55:0/4102877041 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) v1 ==== 122+0+0 (secure 0 0 0) 0x7f233c0594c0 con 0x7f23480d3b90 2024-04-25T09:01:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 -- 172.21.15.55:0/4102877041 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f233406b500 msgr2=0x7f233406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f233406b500 0x7f233406d9c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f23400015e0 tx=0x7f2340009040 comp rx=0 tx=0).stop 2024-04-25T09:01:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 -- 172.21.15.55:0/4102877041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480d3b90 msgr2=0x7f23480aa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480d3b90 0x7f23480aa480 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f233c00d7d0 tx=0x7f233c00dc90 comp rx=0 tx=0).stop 2024-04-25T09:01:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 -- 172.21.15.55:0/4102877041 shutdown_connections 2024-04-25T09:01:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f233406b500 0x7f233406d9c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f234815dca0 0x7f23480aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23480d3b90 0x7f23480aa480 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 --2- 172.21.15.55:0/4102877041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23480d0f60 0x7f23480cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 -- 172.21.15.55:0/4102877041 >> 172.21.15.55:0/4102877041 conn(0x7f23480726c0 msgr2=0x7f23480b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 -- 172.21.15.55:0/4102877041 shutdown_connections 2024-04-25T09:01:55.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.125+0000 7f23503ed640 1 -- 172.21.15.55:0/4102877041 wait complete. 2024-04-25T09:01:55.128 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:01:55.128 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:55.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.245+0000 7f94205d5640 1 Processor -- start 2024-04-25T09:01:55.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.245+0000 7f94205d5640 1 -- start start 2024-04-25T09:01:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f94205d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f941815a730 0x7f94180ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f94205d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941806dfd0 con 0x7f94180cebc0 2024-04-25T09:01:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f94205d5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94180cc020 con 0x7f94180b4020 2024-04-25T09:01:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f94205d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94180b32b0 con 0x7f941815a730 2024-04-25T09:01:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f941e371640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f941815a730 0x7f94180ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f941eb72640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f94180cebc0 0x7f941806d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39482/0 (socket says 172.21.15.55:39482) 2024-04-25T09:01:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f941e371640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f941815a730 0x7f94180ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50576/0 (socket says 172.21.15.55:50576) 2024-04-25T09:01:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f941eb72640 1 -- 172.21.15.55:0/4016448329 learned_addr learned my addr 172.21.15.55:0/4016448329 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:55.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f941e371640 1 -- 172.21.15.55:0/4016448329 >> v1:172.21.15.167:6789/0 conn(0x7f94180b4020 legacy=0x7f941806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f941e371640 1 -- 172.21.15.55:0/4016448329 >> v1:172.21.15.55:6789/0 conn(0x7f94180cebc0 legacy=0x7f941806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f941d36f640 1 -- 172.21.15.55:0/4016448329 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187617832 0 0) 0x7f941806dfd0 con 0x7f94180cebc0 2024-04-25T09:01:55.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.246+0000 7f941e371640 1 -- 172.21.15.55:0/4016448329 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94180b3590 con 0x7f941815a730 2024-04-25T09:01:55.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.247+0000 7f941e371640 1 --2- 172.21.15.55:0/4016448329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941815a730 0x7f94180ae9b0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f94140097a0 tx=0x7f941402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745ee64bb3493595 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.247+0000 7f941d36f640 1 -- 172.21.15.55:0/4016448329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414037070 con 0x7f941815a730 2024-04-25T09:01:55.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.247+0000 7f941d36f640 1 -- 172.21.15.55:0/4016448329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9414032440 con 0x7f941815a730 2024-04-25T09:01:55.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.247+0000 7f941d36f640 1 -- 172.21.15.55:0/4016448329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414032810 con 0x7f941815a730 2024-04-25T09:01:55.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.248+0000 7f94205d5640 1 -- 172.21.15.55:0/4016448329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941815a730 msgr2=0x7f94180ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.248+0000 7f94205d5640 1 --2- 172.21.15.55:0/4016448329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941815a730 0x7f94180ae9b0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f94140097a0 tx=0x7f941402a230 comp rx=0 tx=0).stop 2024-04-25T09:01:55.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.248+0000 7f94205d5640 1 -- 172.21.15.55:0/4016448329 shutdown_connections 2024-04-25T09:01:55.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.248+0000 7f94205d5640 1 --2- 172.21.15.55:0/4016448329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941815a730 0x7f94180ae9b0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.248+0000 7f94205d5640 1 -- 172.21.15.55:0/4016448329 >> 172.21.15.55:0/4016448329 conn(0x7f941806aba0 msgr2=0x7f941806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.248+0000 7f94205d5640 1 -- 172.21.15.55:0/4016448329 shutdown_connections 2024-04-25T09:01:55.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.248+0000 7f94205d5640 1 -- 172.21.15.55:0/4016448329 wait complete. 2024-04-25T09:01:55.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f94205d5640 1 Processor -- start 2024-04-25T09:01:55.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f94205d5640 1 -- start start 2024-04-25T09:01:55.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f94205d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94180b4020 0x7f9418159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f94205d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94180cebc0 0x7f941814cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f94205d5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f941815a730 0x7f941814a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f94205d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94180cd620 con 0x7f94180b4020 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f94205d5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94180b3b50 con 0x7f941815a730 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f94205d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94180aeef0 con 0x7f94180cebc0 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f941e371640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94180b4020 0x7f9418159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f941e371640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94180b4020 0x7f9418159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50582/0 (socket says 172.21.15.55:50582) 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f941e371640 1 -- 172.21.15.55:0/3535797374 learned_addr learned my addr 172.21.15.55:0/3535797374 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f941db70640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94180cebc0 0x7f941814cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f941eb72640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f941815a730 0x7f941814a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f941e371640 1 -- 172.21.15.55:0/3535797374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94180cebc0 msgr2=0x7f941814cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f941e371640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94180cebc0 0x7f941814cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f941e371640 1 -- 172.21.15.55:0/3535797374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f941815a730 msgr2=0x7f941814a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f941e371640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f941815a730 0x7f941814a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f941e371640 1 -- 172.21.15.55:0/3535797374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9418157fe0 con 0x7f94180b4020 2024-04-25T09:01:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.250+0000 7f941eb72640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f941815a730 0x7f941814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.251+0000 7f941e371640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94180b4020 0x7f9418159080 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f94140098c0 tx=0x7f94140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.251+0000 7f940effd640 1 -- 172.21.15.55:0/3535797374 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414037040 con 0x7f94180b4020 2024-04-25T09:01:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.251+0000 7f940effd640 1 -- 172.21.15.55:0/3535797374 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9414042070 con 0x7f94180b4020 2024-04-25T09:01:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.251+0000 7f94205d5640 1 -- 172.21.15.55:0/3535797374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94181582c0 con 0x7f94180b4020 2024-04-25T09:01:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.251+0000 7f940effd640 1 -- 172.21.15.55:0/3535797374 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414030a70 con 0x7f94180b4020 2024-04-25T09:01:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.251+0000 7f94205d5640 1 -- 172.21.15.55:0/3535797374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9418158880 con 0x7f94180b4020 2024-04-25T09:01:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.252+0000 7f94205d5640 1 -- 172.21.15.55:0/3535797374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94180749b0 con 0x7f94180b4020 2024-04-25T09:01:55.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.252+0000 7f940effd640 1 -- 172.21.15.55:0/3535797374 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9414030c10 con 0x7f94180b4020 2024-04-25T09:01:55.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.253+0000 7f940effd640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f93fc06b4d0 0x7f93fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.253+0000 7f940effd640 1 -- 172.21.15.55:0/3535797374 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94140aad90 con 0x7f94180b4020 2024-04-25T09:01:55.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.253+0000 7f941db70640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f93fc06b4d0 0x7f93fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.253+0000 7f941db70640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f93fc06b4d0 0x7f93fc06d990 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f94181512f0 tx=0x7f9408009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.258+0000 7f940effd640 1 -- 172.21.15.55:0/3535797374 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9414045360 con 0x7f94180b4020 2024-04-25T09:01:55.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.474+0000 7f94205d5640 1 -- 172.21.15.55:0/3535797374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9418151df0 con 0x7f94180b4020 2024-04-25T09:01:55.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.475+0000 7f940effd640 1 -- 172.21.15.55:0/3535797374 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f9414079b70 con 0x7f94180b4020 2024-04-25T09:01:55.465 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:55.465 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:01:54.470378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/538888347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":538888347},{"type":"v1","addr":"172.21.15.55:6837","nonce":538888347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:01:55.465 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 72 2024-04-25T09:01:55.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.476+0000 7f94205d5640 1 -- 172.21.15.55:0/3535797374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f93fc06b4d0 msgr2=0x7f93fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.476+0000 7f94205d5640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f93fc06b4d0 0x7f93fc06d990 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f94181512f0 tx=0x7f9408009040 comp rx=0 tx=0).stop 2024-04-25T09:01:55.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.476+0000 7f94205d5640 1 -- 172.21.15.55:0/3535797374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94180b4020 msgr2=0x7f9418159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.476+0000 7f94205d5640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94180b4020 0x7f9418159080 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f94140098c0 tx=0x7f94140046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.477+0000 7f94205d5640 1 -- 172.21.15.55:0/3535797374 shutdown_connections 2024-04-25T09:01:55.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.477+0000 7f94205d5640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f93fc06b4d0 0x7f93fc06d990 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.477+0000 7f94205d5640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f941815a730 0x7f941814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.477+0000 7f94205d5640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94180cebc0 0x7f941814cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.477+0000 7f94205d5640 1 --2- 172.21.15.55:0/3535797374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94180b4020 0x7f9418159080 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.477+0000 7f94205d5640 1 -- 172.21.15.55:0/3535797374 >> 172.21.15.55:0/3535797374 conn(0x7f941806aba0 msgr2=0x7f94180cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.477+0000 7f94205d5640 1 -- 172.21.15.55:0/3535797374 shutdown_connections 2024-04-25T09:01:55.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.477+0000 7f94205d5640 1 -- 172.21.15.55:0/3535797374 wait complete. 2024-04-25T09:01:55.478 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:55.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee21734640 1 Processor -- start 2024-04-25T09:01:55.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee21734640 1 -- start start 2024-04-25T09:01:55.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee21734640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fee1c0d35b0 0x7fee1c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee21734640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c15e0c0 con 0x7fee1c15dce0 2024-04-25T09:01:55.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee21734640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c0d2510 con 0x7fee1c0b5990 2024-04-25T09:01:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee21734640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c0d27f0 con 0x7fee1c0d35b0 2024-04-25T09:01:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee1a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fee1c0d35b0 0x7fee1c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee1affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fee1c15dce0 0x7fee1c0d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39490/0 (socket says 172.21.15.55:39490) 2024-04-25T09:01:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee1affd640 1 -- 172.21.15.55:0/1189208818 learned_addr learned my addr 172.21.15.55:0/1189208818 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee1a7fc640 1 -- 172.21.15.55:0/1189208818 >> v1:172.21.15.167:6789/0 conn(0x7fee1c0b5990 legacy=0x7fee1c0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee1a7fc640 1 -- 172.21.15.55:0/1189208818 >> v1:172.21.15.55:6789/0 conn(0x7fee1c15dce0 legacy=0x7fee1c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee1a7fc640 1 -- 172.21.15.55:0/1189208818 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c0d2ad0 con 0x7fee1c0d35b0 2024-04-25T09:01:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.590+0000 7fee19ffb640 1 -- 172.21.15.55:0/1189208818 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911407081 0 0) 0x7fee1c15e0c0 con 0x7fee1c15dce0 2024-04-25T09:01:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.592+0000 7fee1a7fc640 1 --2- 172.21.15.55:0/1189208818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1c0d35b0 0x7fee1c0b5450 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fee040097a0 tx=0x7fee0402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52753f2fd576ad8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.592+0000 7fee19ffb640 1 -- 172.21.15.55:0/1189208818 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04037070 con 0x7fee1c0d35b0 2024-04-25T09:01:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.592+0000 7fee19ffb640 1 -- 172.21.15.55:0/1189208818 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04032440 con 0x7fee1c0d35b0 2024-04-25T09:01:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.592+0000 7fee19ffb640 1 -- 172.21.15.55:0/1189208818 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04032810 con 0x7fee1c0d35b0 2024-04-25T09:01:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.593+0000 7fee21734640 1 -- 172.21.15.55:0/1189208818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1c0d35b0 msgr2=0x7fee1c0b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.593+0000 7fee21734640 1 --2- 172.21.15.55:0/1189208818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1c0d35b0 0x7fee1c0b5450 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fee040097a0 tx=0x7fee0402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.593+0000 7fee21734640 1 -- 172.21.15.55:0/1189208818 shutdown_connections 2024-04-25T09:01:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.593+0000 7fee21734640 1 --2- 172.21.15.55:0/1189208818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1c0d35b0 0x7fee1c0b5450 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.593+0000 7fee21734640 1 -- 172.21.15.55:0/1189208818 >> 172.21.15.55:0/1189208818 conn(0x7fee1c072900 msgr2=0x7fee1c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.593+0000 7fee21734640 1 -- 172.21.15.55:0/1189208818 shutdown_connections 2024-04-25T09:01:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.593+0000 7fee21734640 1 -- 172.21.15.55:0/1189208818 wait complete. 2024-04-25T09:01:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.593+0000 7fee21734640 1 Processor -- start 2024-04-25T09:01:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.593+0000 7fee21734640 1 -- start start 2024-04-25T09:01:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee21734640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1c0b5990 0x7fee1c159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee21734640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1c0d35b0 0x7fee1c15e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee21734640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee1c15dce0 0x7fee1c1f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee21734640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0d2160 con 0x7fee1c0d35b0 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee21734640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0d3090 con 0x7fee1c0b5990 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee21734640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c1f6c50 con 0x7fee1c15dce0 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee1a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1c0d35b0 0x7fee1c15e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee1a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1c0d35b0 0x7fee1c15e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50602/0 (socket says 172.21.15.55:50602) 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee1a7fc640 1 -- 172.21.15.55:0/443390094 learned_addr learned my addr 172.21.15.55:0/443390094 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee1affd640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1c0b5990 0x7fee1c159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee1b7fe640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee1c15dce0 0x7fee1c1f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee1a7fc640 1 -- 172.21.15.55:0/443390094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee1c15dce0 msgr2=0x7fee1c1f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.595+0000 7fee1a7fc640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee1c15dce0 0x7fee1c1f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.596+0000 7fee1a7fc640 1 -- 172.21.15.55:0/443390094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1c0b5990 msgr2=0x7fee1c159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.596+0000 7fee1a7fc640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1c0b5990 0x7fee1c159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.596+0000 7fee1a7fc640 1 -- 172.21.15.55:0/443390094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c15e600 con 0x7fee1c0d35b0 2024-04-25T09:01:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.596+0000 7fee1affd640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1c0b5990 0x7fee1c159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.596+0000 7fee1b7fe640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee1c15dce0 0x7fee1c1f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.596+0000 7fee1a7fc640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1c0d35b0 0x7fee1c15e0c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fee040098c0 tx=0x7fee040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.596+0000 7fee137fe640 1 -- 172.21.15.55:0/443390094 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04041070 con 0x7fee1c0d35b0 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.596+0000 7fee137fe640 1 -- 172.21.15.55:0/443390094 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0403c870 con 0x7fee1c0d35b0 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.596+0000 7fee21734640 1 -- 172.21.15.55:0/443390094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c15e8a0 con 0x7fee1c0d35b0 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.596+0000 7fee137fe640 1 -- 172.21.15.55:0/443390094 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04037040 con 0x7fee1c0d35b0 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.596+0000 7fee21734640 1 -- 172.21.15.55:0/443390094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c15ee60 con 0x7fee1c0d35b0 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.597+0000 7fee21734640 1 -- 172.21.15.55:0/443390094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c0749b0 con 0x7fee1c0d35b0 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.597+0000 7fee137fe640 1 -- 172.21.15.55:0/443390094 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fee04044070 con 0x7fee1c0d35b0 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.598+0000 7fee137fe640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedfc06b4d0 0x7fedfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.598+0000 7fee1affd640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedfc06b4d0 0x7fedfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.598+0000 7fee137fe640 1 -- 172.21.15.55:0/443390094 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee040aaec0 con 0x7fee1c0d35b0 2024-04-25T09:01:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.598+0000 7fee1affd640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedfc06b4d0 0x7fedfc06d990 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fee14000f60 tx=0x7fee14007ca0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.602+0000 7fee137fe640 1 -- 172.21.15.55:0/443390094 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee04079e60 con 0x7fee1c0d35b0 2024-04-25T09:01:55.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.784+0000 7fee21734640 1 -- 172.21.15.55:0/443390094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee1c1f3da0 con 0x7fee1c0d35b0 2024-04-25T09:01:55.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.785+0000 7fee137fe640 1 -- 172.21.15.55:0/443390094 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16619 (secure 0 0 0) 0x7fee04079760 con 0x7fee1c0d35b0 2024-04-25T09:01:55.774 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:55.774 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:01:53.683789+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:50.330313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:51.020096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:55.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 -- 172.21.15.55:0/443390094 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedfc06b4d0 msgr2=0x7fedfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedfc06b4d0 0x7fedfc06d990 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fee14000f60 tx=0x7fee14007ca0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 -- 172.21.15.55:0/443390094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1c0d35b0 msgr2=0x7fee1c15e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1c0d35b0 0x7fee1c15e0c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fee040098c0 tx=0x7fee040046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 -- 172.21.15.55:0/443390094 shutdown_connections 2024-04-25T09:01:55.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fedfc06b4d0 0x7fedfc06d990 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee1c15dce0 0x7fee1c1f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1c0d35b0 0x7fee1c15e0c0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 --2- 172.21.15.55:0/443390094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1c0b5990 0x7fee1c159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 -- 172.21.15.55:0/443390094 >> 172.21.15.55:0/443390094 conn(0x7fee1c072900 msgr2=0x7fee1c0b8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 -- 172.21.15.55:0/443390094 shutdown_connections 2024-04-25T09:01:55.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.787+0000 7fee21734640 1 -- 172.21.15.55:0/443390094 wait complete. 2024-04-25T09:01:55.787 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:01:55.787 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:55.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.899+0000 7f6d61fe2640 1 Processor -- start 2024-04-25T09:01:55.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.900+0000 7f6d61fe2640 1 -- start start 2024-04-25T09:01:55.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.900+0000 7f6d61fe2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6d5c15dc30 0x7f6d5c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.900+0000 7f6d61fe2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c06c1f0 con 0x7f6d5c0b1b30 2024-04-25T09:01:55.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.900+0000 7f6d61fe2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c0cfb40 con 0x7f6d5c06cc00 2024-04-25T09:01:55.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.900+0000 7f6d61fe2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5c0b2060 con 0x7f6d5c15dc30 2024-04-25T09:01:55.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.900+0000 7f6d5bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6d5c0b1b30 0x7f6d5c0d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39500/0 (socket says 172.21.15.55:39500) 2024-04-25T09:01:55.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5bfff640 1 -- 172.21.15.55:0/695178169 learned_addr learned my addr 172.21.15.55:0/695178169 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:55.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5b7fe640 1 --2- 172.21.15.55:0/695178169 >> v2:172.21.15.167:3300/0 conn(0x7f6d5c15dc30 0x7f6d5c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305049928 0 0) 0x7f6d54001490 con 0x7f6d5c0b1b30 2024-04-25T09:01:55.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d44003520 con 0x7f6d5c0b1b30 2024-04-25T09:01:55.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4201331491 0 0) 0x7f6d44003520 con 0x7f6d5c0b1b30 2024-04-25T09:01:55.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 >> v2:172.21.15.167:3300/0 conn(0x7f6d5c15dc30 msgr2=0x7f6d5c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:55.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 --2- 172.21.15.55:0/695178169 >> v2:172.21.15.167:3300/0 conn(0x7f6d5c15dc30 0x7f6d5c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 >> v1:172.21.15.167:6789/0 conn(0x7f6d5c06cc00 legacy=0x7f6d5c0b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0b2340 con 0x7f6d5c0b1b30 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f6d54001bc0 con 0x7f6d5c0b1b30 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5b7fe640 1 --2- 172.21.15.55:0/695178169 >> v2:172.21.15.167:3300/0 conn(0x7f6d5c15dc30 0x7f6d5c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 >> v1:172.21.15.55:6789/0 conn(0x7f6d5c0b1b30 legacy=0x7f6d5c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 --2- 172.21.15.55:0/695178169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d440039b0 0x7f6d44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 --2- 172.21.15.55:0/695178169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d440043b0 0x7f6d44004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 --2- 172.21.15.55:0/695178169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 0x7f6d4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0b2060 con 0x7f6d44005080 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4400bfe0 con 0x7f6d440039b0 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4400c1e0 con 0x7f6d440043b0 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5bfff640 1 --2- 172.21.15.55:0/695178169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 0x7f6d4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.901+0000 7f6d5b7fe640 1 --2- 172.21.15.55:0/695178169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d440039b0 0x7f6d44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.902+0000 7f6d5affd640 1 --2- 172.21.15.55:0/695178169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d440043b0 0x7f6d44004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.902+0000 7f6d5bfff640 1 -- 172.21.15.55:0/695178169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d440043b0 msgr2=0x7f6d44004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.902+0000 7f6d5bfff640 1 --2- 172.21.15.55:0/695178169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d440043b0 0x7f6d44004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.902+0000 7f6d5bfff640 1 -- 172.21.15.55:0/695178169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d440039b0 msgr2=0x7f6d44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.902+0000 7f6d5bfff640 1 --2- 172.21.15.55:0/695178169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d440039b0 0x7f6d44003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.902+0000 7f6d5bfff640 1 -- 172.21.15.55:0/695178169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44003520 con 0x7f6d44005080 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.902+0000 7f6d5bfff640 1 -- 172.21.15.55:0/695178169 reap_dead start 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.902+0000 7f6d5bfff640 1 --2- 172.21.15.55:0/695178169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 0x7f6d4400b9c0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400aa50 tx=0x7f6d44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32806c1e5073936b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.903+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400a670 con 0x7f6d44005080 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.903+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5402f070 con 0x7f6d44005080 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.903+0000 7f6d5a7fc640 1 -- 172.21.15.55:0/695178169 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54034470 con 0x7f6d44005080 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.903+0000 7f6d61fe2640 1 -- 172.21.15.55:0/695178169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 msgr2=0x7f6d4400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.903+0000 7f6d61fe2640 1 --2- 172.21.15.55:0/695178169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 0x7f6d4400b9c0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400aa50 tx=0x7f6d44005830 comp rx=0 tx=0).stop 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.903+0000 7f6d61fe2640 1 -- 172.21.15.55:0/695178169 shutdown_connections 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.903+0000 7f6d61fe2640 1 --2- 172.21.15.55:0/695178169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 0x7f6d4400b9c0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.903+0000 7f6d61fe2640 1 -- 172.21.15.55:0/695178169 >> 172.21.15.55:0/695178169 conn(0x7f6d5c0d1900 msgr2=0x7f6d5c0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.903+0000 7f6d61fe2640 1 -- 172.21.15.55:0/695178169 shutdown_connections 2024-04-25T09:01:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.903+0000 7f6d61fe2640 1 -- 172.21.15.55:0/695178169 wait complete. 2024-04-25T09:01:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.904+0000 7f6d61fe2640 1 Processor -- start 2024-04-25T09:01:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.905+0000 7f6d61fe2640 1 -- start start 2024-04-25T09:01:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.905+0000 7f6d61fe2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 0x7f6d5c160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.905+0000 7f6d61fe2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d5c157d70 0x7f6d5c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.905+0000 7f6d61fe2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d5c0c52e0 0x7f6d5c0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.905+0000 7f6d61fe2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c15e010 con 0x7f6d44005080 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.905+0000 7f6d61fe2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0cfde0 con 0x7f6d5c0c52e0 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.905+0000 7f6d61fe2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c06c6c0 con 0x7f6d5c157d70 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.905+0000 7f6d5b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 0x7f6d5c160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.905+0000 7f6d5b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 0x7f6d5c160c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50608/0 (socket says 172.21.15.55:50608) 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.905+0000 7f6d5b7fe640 1 -- 172.21.15.55:0/3467311937 learned_addr learned my addr 172.21.15.55:0/3467311937 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d5affd640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d5c157d70 0x7f6d5c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d5bfff640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d5c0c52e0 0x7f6d5c0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d5b7fe640 1 -- 172.21.15.55:0/3467311937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d5c157d70 msgr2=0x7f6d5c0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d5b7fe640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d5c157d70 0x7f6d5c0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d5b7fe640 1 -- 172.21.15.55:0/3467311937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d5c0c52e0 msgr2=0x7f6d5c0c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d5b7fe640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d5c0c52e0 0x7f6d5c0c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d5b7fe640 1 -- 172.21.15.55:0/3467311937 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0c7420 con 0x7f6d44005080 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d5b7fe640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 0x7f6d5c160c40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c011ac0 tx=0x7f6d4c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d43fff640 1 -- 172.21.15.55:0/3467311937 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c00fc10 con 0x7f6d44005080 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d43fff640 1 -- 172.21.15.55:0/3467311937 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c00fdb0 con 0x7f6d44005080 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d61fe2640 1 -- 172.21.15.55:0/3467311937 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c0c76d0 con 0x7f6d44005080 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d43fff640 1 -- 172.21.15.55:0/3467311937 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c004260 con 0x7f6d44005080 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.906+0000 7f6d61fe2640 1 -- 172.21.15.55:0/3467311937 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c0c99f0 con 0x7f6d44005080 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.907+0000 7f6d61fe2640 1 -- 172.21.15.55:0/3467311937 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c067850 con 0x7f6d44005080 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.908+0000 7f6d43fff640 1 -- 172.21.15.55:0/3467311937 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6d4c012040 con 0x7f6d44005080 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.908+0000 7f6d43fff640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d4806b4d0 0x7f6d4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.908+0000 7f6d5affd640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d4806b4d0 0x7f6d4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.908+0000 7f6d43fff640 1 -- 172.21.15.55:0/3467311937 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d4c08a730 con 0x7f6d44005080 2024-04-25T09:01:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.909+0000 7f6d5affd640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d4806b4d0 0x7f6d4806d990 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0c62c0 tx=0x7f6d50009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:55.913+0000 7f6d43fff640 1 -- 172.21.15.55:0/3467311937 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6d4c019030 con 0x7f6d44005080 2024-04-25T09:01:56.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.093+0000 7f6d61fe2640 1 -- 172.21.15.55:0/3467311937 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d5c0749b0 con 0x7f6d4806b4d0 2024-04-25T09:01:56.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.098+0000 7f6d43fff640 1 -- 172.21.15.55:0/3467311937 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+239327 (secure 0 0 0) 0x7f6d5c0749b0 con 0x7f6d4806b4d0 2024-04-25T09:01:56.090 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:01:56.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 -- 172.21.15.55:0/3467311937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d4806b4d0 msgr2=0x7f6d4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d4806b4d0 0x7f6d4806d990 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0c62c0 tx=0x7f6d50009040 comp rx=0 tx=0).stop 2024-04-25T09:01:56.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 -- 172.21.15.55:0/3467311937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 msgr2=0x7f6d5c160c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 0x7f6d5c160c40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c011ac0 tx=0x7f6d4c011f80 comp rx=0 tx=0).stop 2024-04-25T09:01:56.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 -- 172.21.15.55:0/3467311937 shutdown_connections 2024-04-25T09:01:56.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6d4806b4d0 0x7f6d4806d990 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d5c0c52e0 0x7f6d5c0c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d5c157d70 0x7f6d5c0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 --2- 172.21.15.55:0/3467311937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d44005080 0x7f6d5c160c40 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 -- 172.21.15.55:0/3467311937 >> 172.21.15.55:0/3467311937 conn(0x7f6d5c0d1900 msgr2=0x7f6d5c0b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 -- 172.21.15.55:0/3467311937 shutdown_connections 2024-04-25T09:01:56.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.101+0000 7f6d61fe2640 1 -- 172.21.15.55:0/3467311937 wait complete. 2024-04-25T09:01:56.101 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-04-25T09:01:54.663701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":264264,"kb_used_data":10632,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754710456,"statfs":{"total":773094113280,"available":772823506944,"internally_reserved":0,"allocated":10887168,"data_stored":5323886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000778"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.706107+0000","last_change":"2024-04-25T09:01:52.703003+0000","last_active":"2024-04-25T09:01:52.706107+0000","last_peered":"2024-04-25T09:01:52.706107+0000","last_clean":"2024-04-25T09:01:52.706107+0000","last_became_active":"2024-04-25T09:01:52.702715+0000","last_became_peered":"2024-04-25T09:01:52.702715+0000","last_unstale":"2024-04-25T09:01:52.706107+0000","last_undegraded":"2024-04-25T09:01:52.706107+0000","last_fullsized":"2024-04-25T09:01:52.706107+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696269+0000","last_change":"2024-04-25T09:01:52.694341+0000","last_active":"2024-04-25T09:01:52.696269+0000","last_peered":"2024-04-25T09:01:52.696269+0000","last_clean":"2024-04-25T09:01:52.696269+0000","last_became_active":"2024-04-25T09:01:52.694029+0000","last_became_peered":"2024-04-25T09:01:52.694029+0000","last_unstale":"2024-04-25T09:01:52.696269+0000","last_undegraded":"2024-04-25T09:01:52.696269+0000","last_fullsized":"2024-04-25T09:01:52.696269+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.704780+0000","last_change":"2024-04-25T09:01:52.700645+0000","last_active":"2024-04-25T09:01:52.704780+0000","last_peered":"2024-04-25T09:01:52.704780+0000","last_clean":"2024-04-25T09:01:52.704780+0000","last_became_active":"2024-04-25T09:01:52.700098+0000","last_became_peered":"2024-04-25T09:01:52.700098+0000","last_unstale":"2024-04-25T09:01:52.704780+0000","last_undegraded":"2024-04-25T09:01:52.704780+0000","last_fullsized":"2024-04-25T09:01:52.704780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.706341+0000","last_change":"2024-04-25T09:01:52.703474+0000","last_active":"2024-04-25T09:01:52.706341+0000","last_peered":"2024-04-25T09:01:52.706341+0000","last_clean":"2024-04-25T09:01:52.706341+0000","last_became_active":"2024-04-25T09:01:52.703179+0000","last_became_peered":"2024-04-25T09:01:52.703179+0000","last_unstale":"2024-04-25T09:01:52.706341+0000","last_undegraded":"2024-04-25T09:01:52.706341+0000","last_fullsized":"2024-04-25T09:01:52.706341+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696017+0000","last_change":"2024-04-25T09:01:52.688618+0000","last_active":"2024-04-25T09:01:52.696017+0000","last_peered":"2024-04-25T09:01:52.696017+0000","last_clean":"2024-04-25T09:01:52.696017+0000","last_became_active":"2024-04-25T09:01:52.688240+0000","last_became_peered":"2024-04-25T09:01:52.688240+0000","last_unstale":"2024-04-25T09:01:52.696017+0000","last_undegraded":"2024-04-25T09:01:52.696017+0000","last_fullsized":"2024-04-25T09:01:52.696017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:39.551479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696317+0000","last_change":"2024-04-25T09:01:52.691603+0000","last_active":"2024-04-25T09:01:52.696317+0000","last_peered":"2024-04-25T09:01:52.696317+0000","last_clean":"2024-04-25T09:01:52.696317+0000","last_became_active":"2024-04-25T09:01:52.691238+0000","last_became_peered":"2024-04-25T09:01:52.691238+0000","last_unstale":"2024-04-25T09:01:52.696317+0000","last_undegraded":"2024-04-25T09:01:52.696317+0000","last_fullsized":"2024-04-25T09:01:52.696317+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:36.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669518+0000","last_change":"2024-04-25T09:01:50.669518+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669518+0000","last_undegraded":"2024-04-25T09:01:50.669518+0000","last_fullsized":"2024-04-25T09:01:50.669518+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.702683+0000","last_change":"2024-04-25T09:01:52.696412+0000","last_active":"2024-04-25T09:01:52.702683+0000","last_peered":"2024-04-25T09:01:52.702683+0000","last_clean":"2024-04-25T09:01:52.702683+0000","last_became_active":"2024-04-25T09:01:52.695363+0000","last_became_peered":"2024-04-25T09:01:52.695363+0000","last_unstale":"2024-04-25T09:01:52.702683+0000","last_undegraded":"2024-04-25T09:01:52.702683+0000","last_fullsized":"2024-04-25T09:01:52.702683+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.670967+0000","last_change":"2024-04-25T09:01:50.670967+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.670967+0000","last_undegraded":"2024-04-25T09:01:50.670967+0000","last_fullsized":"2024-04-25T09:01:50.670967+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669543+0000","last_change":"2024-04-25T09:01:50.669543+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669543+0000","last_undegraded":"2024-04-25T09:01:50.669543+0000","last_fullsized":"2024-04-25T09:01:50.669543+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.680625+0000","last_change":"2024-04-25T09:01:51.694493+0000","last_active":"2024-04-25T09:01:52.680625+0000","last_peered":"2024-04-25T09:01:52.680625+0000","last_clean":"2024-04-25T09:01:52.680625+0000","last_became_active":"2024-04-25T09:01:51.693830+0000","last_became_peered":"2024-04-25T09:01:51.693830+0000","last_unstale":"2024-04-25T09:01:52.680625+0000","last_undegraded":"2024-04-25T09:01:52.680625+0000","last_fullsized":"2024-04-25T09:01:52.680625+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:54.059043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.693220+0000","last_change":"2024-04-25T09:01:52.684908+0000","last_active":"2024-04-25T09:01:52.693220+0000","last_peered":"2024-04-25T09:01:52.693220+0000","last_clean":"2024-04-25T09:01:52.693220+0000","last_became_active":"2024-04-25T09:01:52.684605+0000","last_became_peered":"2024-04-25T09:01:52.684605+0000","last_unstale":"2024-04-25T09:01:52.693220+0000","last_undegraded":"2024-04-25T09:01:52.693220+0000","last_fullsized":"2024-04-25T09:01:52.693220+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:28.487975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669500+0000","last_change":"2024-04-25T09:01:50.669500+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669500+0000","last_undegraded":"2024-04-25T09:01:50.669500+0000","last_fullsized":"2024-04-25T09:01:50.669500+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.680484+0000","last_change":"2024-04-25T09:01:51.677381+0000","last_active":"2024-04-25T09:01:52.680484+0000","last_peered":"2024-04-25T09:01:52.680484+0000","last_clean":"2024-04-25T09:01:52.680484+0000","last_became_active":"2024-04-25T09:01:51.677062+0000","last_became_peered":"2024-04-25T09:01:51.677062+0000","last_unstale":"2024-04-25T09:01:52.680484+0000","last_undegraded":"2024-04-25T09:01:52.680484+0000","last_fullsized":"2024-04-25T09:01:52.680484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":309,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:01:48.903095+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T09:01:48.903095+0000","last_peered":"2024-04-25T09:01:48.903095+0000","last_clean":"2024-04-25T09:01:48.903095+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:01:48.903095+0000","last_undegraded":"2024-04-25T09:01:48.903095+0000","last_fullsized":"2024-04-25T09:01:48.903095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509544,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1798144,"data_stored":1104972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32368,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1204224,"data_stored":514604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32356,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1204224,"data_stored":514604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":514604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":535105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":514604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37100,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334740,"statfs":{"total":96636764160,"available":96598773760,"internally_reserved":0,"allocated":1798144,"data_stored":1104972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1216512,"data_stored":520421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:56.106 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:56.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.254+0000 7f0a112ee640 1 Processor -- start 2024-04-25T09:01:56.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.254+0000 7f0a112ee640 1 -- start start 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a112ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a0c09a150 0x7f0a0c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a112ee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a0c06c1f0 0x7f0a0c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a112ee640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c06c680 con 0x7f0a0c15ba10 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a112ee640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c0cbe50 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a112ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0cfe80 con 0x7f0a0c09a150 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a0b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a0c06c1f0 0x7f0a0c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a0b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a0c06c1f0 0x7f0a0c0cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50614/0 (socket says 172.21.15.55:50614) 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a0b7fe640 1 -- 172.21.15.55:0/2982448377 learned_addr learned my addr 172.21.15.55:0/2982448377 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a0b7fe640 1 -- 172.21.15.55:0/2982448377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a0c09a150 msgr2=0x7f0a0c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a0b7fe640 1 --2- 172.21.15.55:0/2982448377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a0c09a150 0x7f0a0c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a0b7fe640 1 -- 172.21.15.55:0/2982448377 >> v1:172.21.15.167:6789/0 conn(0x7f0a0c15ba10 legacy=0x7f0a0c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.255+0000 7f0a0b7fe640 1 -- 172.21.15.55:0/2982448377 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c06c900 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.256+0000 7f0a0b7fe640 1 --2- 172.21.15.55:0/2982448377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c06c1f0 0x7f0a0c0cd220 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009e50 tx=0x7f0a0402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c8ccf6eef16f92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.256+0000 7f0a0a7fc640 1 -- 172.21.15.55:0/2982448377 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04036070 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.256+0000 7f0a0a7fc640 1 -- 172.21.15.55:0/2982448377 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a04031600 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.256+0000 7f0a0a7fc640 1 -- 172.21.15.55:0/2982448377 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a040319d0 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.256+0000 7f0a112ee640 1 -- 172.21.15.55:0/2982448377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c06c1f0 msgr2=0x7f0a0c0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.256+0000 7f0a112ee640 1 --2- 172.21.15.55:0/2982448377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c06c1f0 0x7f0a0c0cd220 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009e50 tx=0x7f0a0402a6c0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.257+0000 7f0a112ee640 1 -- 172.21.15.55:0/2982448377 shutdown_connections 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.257+0000 7f0a112ee640 1 --2- 172.21.15.55:0/2982448377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c06c1f0 0x7f0a0c0cd220 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.257+0000 7f0a112ee640 1 --2- 172.21.15.55:0/2982448377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a0c09a150 0x7f0a0c06bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.257+0000 7f0a112ee640 1 -- 172.21.15.55:0/2982448377 >> 172.21.15.55:0/2982448377 conn(0x7f0a0c0b32f0 msgr2=0x7f0a0c0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.257+0000 7f0a112ee640 1 -- 172.21.15.55:0/2982448377 shutdown_connections 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.257+0000 7f0a112ee640 1 -- 172.21.15.55:0/2982448377 wait complete. 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.258+0000 7f0a112ee640 1 Processor -- start 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.258+0000 7f0a112ee640 1 -- start start 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.258+0000 7f0a112ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c06c1f0 0x7f0a0c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.258+0000 7f0a112ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a0c09a150 0x7f0a0c159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a112ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a0c15ba10 0x7f0a0c0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a112ee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0cd760 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a112ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c06cec0 con 0x7f0a0c15ba10 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a112ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0cd8e0 con 0x7f0a0c09a150 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a0affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c06c1f0 0x7f0a0c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a0affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c06c1f0 0x7f0a0c0b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50624/0 (socket says 172.21.15.55:50624) 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a0affd640 1 -- 172.21.15.55:0/30970961 learned_addr learned my addr 172.21.15.55:0/30970961 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a03fff640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a0c09a150 0x7f0a0c159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a0b7fe640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a0c15ba10 0x7f0a0c0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a0affd640 1 -- 172.21.15.55:0/30970961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a0c09a150 msgr2=0x7f0a0c159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a0affd640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a0c09a150 0x7f0a0c159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a0affd640 1 -- 172.21.15.55:0/30970961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a0c15ba10 msgr2=0x7f0a0c0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a0affd640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a0c15ba10 0x7f0a0c0c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a0affd640 1 -- 172.21.15.55:0/30970961 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c0ae8e0 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a0affd640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c06c1f0 0x7f0a0c0b0350 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00b3f0 tx=0x7f09fc00b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a037fe640 1 -- 172.21.15.55:0/30970961 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc015020 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a037fe640 1 -- 172.21.15.55:0/30970961 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc011830 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a112ee640 1 -- 172.21.15.55:0/30970961 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c0c7710 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a037fe640 1 -- 172.21.15.55:0/30970961 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc011c20 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.259+0000 7f0a112ee640 1 -- 172.21.15.55:0/30970961 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c0c7cd0 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.260+0000 7f0a112ee640 1 -- 172.21.15.55:0/30970961 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c0749b0 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.261+0000 7f0a037fe640 1 -- 172.21.15.55:0/30970961 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f09fc018020 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.261+0000 7f0a037fe640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09ec06b4d0 0x7f09ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.261+0000 7f0a037fe640 1 -- 172.21.15.55:0/30970961 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09fc089c80 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.262+0000 7f0a03fff640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09ec06b4d0 0x7f09ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.262+0000 7f0a03fff640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09ec06b4d0 0x7f09ec06d990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0cd510 tx=0x7f09f4009110 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.266+0000 7f0a037fe640 1 -- 172.21.15.55:0/30970961 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09fc01f030 con 0x7f0a0c06c1f0 2024-04-25T09:01:56.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.444+0000 7f0a112ee640 1 -- 172.21.15.55:0/30970961 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a0c09a570 con 0x7f09ec06b4d0 2024-04-25T09:01:56.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.449+0000 7f0a037fe640 1 -- 172.21.15.55:0/30970961 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+239327 (secure 0 0 0) 0x7f0a0c09a570 con 0x7f09ec06b4d0 2024-04-25T09:01:56.441 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:56.442 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 -- 172.21.15.55:0/30970961 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09ec06b4d0 msgr2=0x7f09ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09ec06b4d0 0x7f09ec06d990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0cd510 tx=0x7f09f4009110 comp rx=0 tx=0).stop 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 -- 172.21.15.55:0/30970961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c06c1f0 msgr2=0x7f0a0c0b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c06c1f0 0x7f0a0c0b0350 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00b3f0 tx=0x7f09fc00b7f0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 -- 172.21.15.55:0/30970961 shutdown_connections 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f09ec06b4d0 0x7f09ec06d990 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a0c15ba10 0x7f0a0c0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a0c09a150 0x7f0a0c159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 --2- 172.21.15.55:0/30970961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c06c1f0 0x7f0a0c0b0350 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 -- 172.21.15.55:0/30970961 >> 172.21.15.55:0/30970961 conn(0x7f0a0c0b32f0 msgr2=0x7f0a0c0d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 -- 172.21.15.55:0/30970961 shutdown_connections 2024-04-25T09:01:56.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.453+0000 7f0a112ee640 1 -- 172.21.15.55:0/30970961 wait complete. 2024-04-25T09:01:56.452 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-04-25T09:01:54.663701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":264264,"kb_used_data":10632,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754710456,"statfs":{"total":773094113280,"available":772823506944,"internally_reserved":0,"allocated":10887168,"data_stored":5323886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000778"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.706107+0000","last_change":"2024-04-25T09:01:52.703003+0000","last_active":"2024-04-25T09:01:52.706107+0000","last_peered":"2024-04-25T09:01:52.706107+0000","last_clean":"2024-04-25T09:01:52.706107+0000","last_became_active":"2024-04-25T09:01:52.702715+0000","last_became_peered":"2024-04-25T09:01:52.702715+0000","last_unstale":"2024-04-25T09:01:52.706107+0000","last_undegraded":"2024-04-25T09:01:52.706107+0000","last_fullsized":"2024-04-25T09:01:52.706107+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696269+0000","last_change":"2024-04-25T09:01:52.694341+0000","last_active":"2024-04-25T09:01:52.696269+0000","last_peered":"2024-04-25T09:01:52.696269+0000","last_clean":"2024-04-25T09:01:52.696269+0000","last_became_active":"2024-04-25T09:01:52.694029+0000","last_became_peered":"2024-04-25T09:01:52.694029+0000","last_unstale":"2024-04-25T09:01:52.696269+0000","last_undegraded":"2024-04-25T09:01:52.696269+0000","last_fullsized":"2024-04-25T09:01:52.696269+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.704780+0000","last_change":"2024-04-25T09:01:52.700645+0000","last_active":"2024-04-25T09:01:52.704780+0000","last_peered":"2024-04-25T09:01:52.704780+0000","last_clean":"2024-04-25T09:01:52.704780+0000","last_became_active":"2024-04-25T09:01:52.700098+0000","last_became_peered":"2024-04-25T09:01:52.700098+0000","last_unstale":"2024-04-25T09:01:52.704780+0000","last_undegraded":"2024-04-25T09:01:52.704780+0000","last_fullsized":"2024-04-25T09:01:52.704780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.706341+0000","last_change":"2024-04-25T09:01:52.703474+0000","last_active":"2024-04-25T09:01:52.706341+0000","last_peered":"2024-04-25T09:01:52.706341+0000","last_clean":"2024-04-25T09:01:52.706341+0000","last_became_active":"2024-04-25T09:01:52.703179+0000","last_became_peered":"2024-04-25T09:01:52.703179+0000","last_unstale":"2024-04-25T09:01:52.706341+0000","last_undegraded":"2024-04-25T09:01:52.706341+0000","last_fullsized":"2024-04-25T09:01:52.706341+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696017+0000","last_change":"2024-04-25T09:01:52.688618+0000","last_active":"2024-04-25T09:01:52.696017+0000","last_peered":"2024-04-25T09:01:52.696017+0000","last_clean":"2024-04-25T09:01:52.696017+0000","last_became_active":"2024-04-25T09:01:52.688240+0000","last_became_peered":"2024-04-25T09:01:52.688240+0000","last_unstale":"2024-04-25T09:01:52.696017+0000","last_undegraded":"2024-04-25T09:01:52.696017+0000","last_fullsized":"2024-04-25T09:01:52.696017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:39.551479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696317+0000","last_change":"2024-04-25T09:01:52.691603+0000","last_active":"2024-04-25T09:01:52.696317+0000","last_peered":"2024-04-25T09:01:52.696317+0000","last_clean":"2024-04-25T09:01:52.696317+0000","last_became_active":"2024-04-25T09:01:52.691238+0000","last_became_peered":"2024-04-25T09:01:52.691238+0000","last_unstale":"2024-04-25T09:01:52.696317+0000","last_undegraded":"2024-04-25T09:01:52.696317+0000","last_fullsized":"2024-04-25T09:01:52.696317+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:36.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669518+0000","last_change":"2024-04-25T09:01:50.669518+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669518+0000","last_undegraded":"2024-04-25T09:01:50.669518+0000","last_fullsized":"2024-04-25T09:01:50.669518+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.702683+0000","last_change":"2024-04-25T09:01:52.696412+0000","last_active":"2024-04-25T09:01:52.702683+0000","last_peered":"2024-04-25T09:01:52.702683+0000","last_clean":"2024-04-25T09:01:52.702683+0000","last_became_active":"2024-04-25T09:01:52.695363+0000","last_became_peered":"2024-04-25T09:01:52.695363+0000","last_unstale":"2024-04-25T09:01:52.702683+0000","last_undegraded":"2024-04-25T09:01:52.702683+0000","last_fullsized":"2024-04-25T09:01:52.702683+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.670967+0000","last_change":"2024-04-25T09:01:50.670967+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.670967+0000","last_undegraded":"2024-04-25T09:01:50.670967+0000","last_fullsized":"2024-04-25T09:01:50.670967+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669543+0000","last_change":"2024-04-25T09:01:50.669543+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669543+0000","last_undegraded":"2024-04-25T09:01:50.669543+0000","last_fullsized":"2024-04-25T09:01:50.669543+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.680625+0000","last_change":"2024-04-25T09:01:51.694493+0000","last_active":"2024-04-25T09:01:52.680625+0000","last_peered":"2024-04-25T09:01:52.680625+0000","last_clean":"2024-04-25T09:01:52.680625+0000","last_became_active":"2024-04-25T09:01:51.693830+0000","last_became_peered":"2024-04-25T09:01:51.693830+0000","last_unstale":"2024-04-25T09:01:52.680625+0000","last_undegraded":"2024-04-25T09:01:52.680625+0000","last_fullsized":"2024-04-25T09:01:52.680625+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:54.059043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.693220+0000","last_change":"2024-04-25T09:01:52.684908+0000","last_active":"2024-04-25T09:01:52.693220+0000","last_peered":"2024-04-25T09:01:52.693220+0000","last_clean":"2024-04-25T09:01:52.693220+0000","last_became_active":"2024-04-25T09:01:52.684605+0000","last_became_peered":"2024-04-25T09:01:52.684605+0000","last_unstale":"2024-04-25T09:01:52.693220+0000","last_undegraded":"2024-04-25T09:01:52.693220+0000","last_fullsized":"2024-04-25T09:01:52.693220+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:28.487975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669500+0000","last_change":"2024-04-25T09:01:50.669500+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669500+0000","last_undegraded":"2024-04-25T09:01:50.669500+0000","last_fullsized":"2024-04-25T09:01:50.669500+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.680484+0000","last_change":"2024-04-25T09:01:51.677381+0000","last_active":"2024-04-25T09:01:52.680484+0000","last_peered":"2024-04-25T09:01:52.680484+0000","last_clean":"2024-04-25T09:01:52.680484+0000","last_became_active":"2024-04-25T09:01:51.677062+0000","last_became_peered":"2024-04-25T09:01:51.677062+0000","last_unstale":"2024-04-25T09:01:52.680484+0000","last_undegraded":"2024-04-25T09:01:52.680484+0000","last_fullsized":"2024-04-25T09:01:52.680484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:50.662241+0000","last_change":"2024-04-25T09:01:50.662241+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.662241+0000","last_undegraded":"2024-04-25T09:01:50.662241+0000","last_fullsized":"2024-04-25T09:01:50.662241+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":309,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:01:48.903095+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T09:01:48.903095+0000","last_peered":"2024-04-25T09:01:48.903095+0000","last_clean":"2024-04-25T09:01:48.903095+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:01:48.903095+0000","last_undegraded":"2024-04-25T09:01:48.903095+0000","last_fullsized":"2024-04-25T09:01:48.903095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509544,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1798144,"data_stored":1104972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32368,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1204224,"data_stored":514604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32356,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1204224,"data_stored":514604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":514604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":535105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":514604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37100,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334740,"statfs":{"total":96636764160,"available":96598773760,"internally_reserved":0,"allocated":1798144,"data_stored":1104972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1216512,"data_stored":520421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:56.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:56.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.607+0000 7f80a3d5c640 1 Processor -- start 2024-04-25T09:01:56.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.607+0000 7f80a3d5c640 1 -- start start 2024-04-25T09:01:56.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.608+0000 7f80a3d5c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f809c15f120 0x7f809c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.608+0000 7f80a3d5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f809c0ce830 0x7f809c0cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.608+0000 7f80a3d5c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f809c0cfbe0 0x7f809c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.608+0000 7f80a3d5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c0d09f0 con 0x7f809c0ce830 2024-04-25T09:01:56.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.608+0000 7f80a3d5c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c0cec70 con 0x7f809c0cfbe0 2024-04-25T09:01:56.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.608+0000 7f80a3d5c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c0d0430 con 0x7f809c15f120 2024-04-25T09:01:56.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.608+0000 7f80a12f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f809c0ce830 0x7f809c0cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.608+0000 7f80a12f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f809c0ce830 0x7f809c0cf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50640/0 (socket says 172.21.15.55:50640) 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.608+0000 7f80a12f7640 1 -- 172.21.15.55:0/3024957165 learned_addr learned my addr 172.21.15.55:0/3024957165 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.609+0000 7f80a22f9640 1 --2- 172.21.15.55:0/3024957165 >> v2:172.21.15.167:3300/0 conn(0x7f809c0cfbe0 0x7f809c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.609+0000 7f80a1af8640 1 --2- 172.21.15.55:0/3024957165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f809c15f120 0x7f809c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.609+0000 7f80a12f7640 1 -- 172.21.15.55:0/3024957165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f809c15f120 msgr2=0x7f809c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.609+0000 7f80a12f7640 1 --2- 172.21.15.55:0/3024957165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f809c15f120 0x7f809c0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.609+0000 7f80a12f7640 1 -- 172.21.15.55:0/3024957165 >> v2:172.21.15.167:3300/0 conn(0x7f809c0cfbe0 msgr2=0x7f809c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.609+0000 7f80a12f7640 1 --2- 172.21.15.55:0/3024957165 >> v2:172.21.15.167:3300/0 conn(0x7f809c0cfbe0 0x7f809c099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.609+0000 7f80a12f7640 1 -- 172.21.15.55:0/3024957165 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0d0710 con 0x7f809c0ce830 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.609+0000 7f80a22f9640 1 --2- 172.21.15.55:0/3024957165 >> v2:172.21.15.167:3300/0 conn(0x7f809c0cfbe0 0x7f809c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.609+0000 7f80a1af8640 1 --2- 172.21.15.55:0/3024957165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f809c15f120 0x7f809c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.609+0000 7f80a12f7640 1 --2- 172.21.15.55:0/3024957165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f809c0ce830 0x7f809c0cf6a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f809c0d18a0 tx=0x7f808c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4626571be7a48a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a0af6640 1 -- 172.21.15.55:0/3024957165 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c037070 con 0x7f809c0ce830 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a0af6640 1 -- 172.21.15.55:0/3024957165 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c032440 con 0x7f809c0ce830 2024-04-25T09:01:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a0af6640 1 -- 172.21.15.55:0/3024957165 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c032810 con 0x7f809c0ce830 2024-04-25T09:01:56.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a3d5c640 1 -- 172.21.15.55:0/3024957165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f809c0ce830 msgr2=0x7f809c0cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a3d5c640 1 --2- 172.21.15.55:0/3024957165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f809c0ce830 0x7f809c0cf6a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f809c0d18a0 tx=0x7f808c02a270 comp rx=0 tx=0).stop 2024-04-25T09:01:56.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a3d5c640 1 -- 172.21.15.55:0/3024957165 shutdown_connections 2024-04-25T09:01:56.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a3d5c640 1 --2- 172.21.15.55:0/3024957165 >> v2:172.21.15.167:3300/0 conn(0x7f809c0cfbe0 0x7f809c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a3d5c640 1 --2- 172.21.15.55:0/3024957165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f809c0ce830 0x7f809c0cf6a0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a3d5c640 1 --2- 172.21.15.55:0/3024957165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f809c15f120 0x7f809c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a3d5c640 1 -- 172.21.15.55:0/3024957165 >> 172.21.15.55:0/3024957165 conn(0x7f809c0d1900 msgr2=0x7f809c0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a3d5c640 1 -- 172.21.15.55:0/3024957165 shutdown_connections 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.610+0000 7f80a3d5c640 1 -- 172.21.15.55:0/3024957165 wait complete. 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.611+0000 7f80a3d5c640 1 Processor -- start 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.611+0000 7f80a3d5c640 1 -- start start 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.612+0000 7f80a3d5c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f809c0ce830 0x7f809c150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.612+0000 7f80a3d5c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f809c0cfbe0 0x7f809c0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.612+0000 7f80a3d5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f809c15f120 0x7f809c0c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.612+0000 7f80a3d5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c0cc480 con 0x7f809c15f120 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.612+0000 7f80a3d5c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c0ccab0 con 0x7f809c0ce830 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.612+0000 7f80a3d5c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c0c5450 con 0x7f809c0cfbe0 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.612+0000 7f80a22f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f809c15f120 0x7f809c0c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.612+0000 7f80a22f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f809c15f120 0x7f809c0c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50656/0 (socket says 172.21.15.55:50656) 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.612+0000 7f80a22f9640 1 -- 172.21.15.55:0/2092380824 learned_addr learned my addr 172.21.15.55:0/2092380824 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.612+0000 7f80a1af8640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f809c0ce830 0x7f809c150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80a12f7640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f809c0cfbe0 0x7f809c0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80a22f9640 1 -- 172.21.15.55:0/2092380824 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f809c0cfbe0 msgr2=0x7f809c0c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80a22f9640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f809c0cfbe0 0x7f809c0c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80a22f9640 1 -- 172.21.15.55:0/2092380824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f809c0ce830 msgr2=0x7f809c150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80a22f9640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f809c0ce830 0x7f809c150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80a22f9640 1 -- 172.21.15.55:0/2092380824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0b38c0 con 0x7f809c15f120 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80a22f9640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f809c15f120 0x7f809c0c5710 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f809800cef0 tx=0x7f809800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80927fc640 1 -- 172.21.15.55:0/2092380824 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809801a070 con 0x7f809c15f120 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80927fc640 1 -- 172.21.15.55:0/2092380824 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800d840 con 0x7f809c15f120 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80927fc640 1 -- 172.21.15.55:0/2092380824 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800dc30 con 0x7f809c15f120 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80a3d5c640 1 -- 172.21.15.55:0/2092380824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c0ca970 con 0x7f809c15f120 2024-04-25T09:01:56.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.613+0000 7f80a3d5c640 1 -- 172.21.15.55:0/2092380824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c0cb450 con 0x7f809c15f120 2024-04-25T09:01:56.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.614+0000 7f80a3d5c640 1 -- 172.21.15.55:0/2092380824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c067850 con 0x7f809c15f120 2024-04-25T09:01:56.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.614+0000 7f80927fc640 1 -- 172.21.15.55:0/2092380824 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f809801d070 con 0x7f809c15f120 2024-04-25T09:01:56.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.615+0000 7f80927fc640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f808006b4d0 0x7f808006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.615+0000 7f80927fc640 1 -- 172.21.15.55:0/2092380824 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f809808aa10 con 0x7f809c15f120 2024-04-25T09:01:56.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.615+0000 7f80a1af8640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f808006b4d0 0x7f808006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.615+0000 7f80a1af8640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f808006b4d0 0x7f808006d990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f809c0b25e0 tx=0x7f8094008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.619+0000 7f80927fc640 1 -- 172.21.15.55:0/2092380824 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8098059890 con 0x7f809c15f120 2024-04-25T09:01:56.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.798+0000 7f80a3d5c640 1 -- 172.21.15.55:0/2092380824 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f809c0c8790 con 0x7f808006b4d0 2024-04-25T09:01:56.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.803+0000 7f80927fc640 1 -- 172.21.15.55:0/2092380824 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251005 (secure 0 0 0) 0x7f809c0c8790 con 0x7f808006b4d0 2024-04-25T09:01:56.795 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:01:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 -- 172.21.15.55:0/2092380824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f808006b4d0 msgr2=0x7f808006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f808006b4d0 0x7f808006d990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f809c0b25e0 tx=0x7f8094008040 comp rx=0 tx=0).stop 2024-04-25T09:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 -- 172.21.15.55:0/2092380824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f809c15f120 msgr2=0x7f809c0c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f809c15f120 0x7f809c0c5710 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f809800cef0 tx=0x7f809800a710 comp rx=0 tx=0).stop 2024-04-25T09:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 -- 172.21.15.55:0/2092380824 shutdown_connections 2024-04-25T09:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f808006b4d0 0x7f808006d990 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f809c15f120 0x7f809c0c5710 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f809c0cfbe0 0x7f809c0c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 --2- 172.21.15.55:0/2092380824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f809c0ce830 0x7f809c150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 -- 172.21.15.55:0/2092380824 >> 172.21.15.55:0/2092380824 conn(0x7f809c0d1900 msgr2=0x7f809c0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 -- 172.21.15.55:0/2092380824 shutdown_connections 2024-04-25T09:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.806+0000 7f80a3d5c640 1 -- 172.21.15.55:0/2092380824 wait complete. 2024-04-25T09:01:56.806 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-04-25T09:01:56.664015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264556,"kb_used_data":10932,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754710164,"statfs":{"total":773094113280,"available":772823207936,"internally_reserved":0,"allocated":11194368,"data_stored":5459174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.999143"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605006+0000","last_change":"2024-04-25T09:01:52.711487+0000","last_active":"2024-04-25T09:01:54.605006+0000","last_peered":"2024-04-25T09:01:54.605006+0000","last_clean":"2024-04-25T09:01:54.605006+0000","last_became_active":"2024-04-25T09:01:52.711106+0000","last_became_peered":"2024-04-25T09:01:52.711106+0000","last_unstale":"2024-04-25T09:01:54.605006+0000","last_undegraded":"2024-04-25T09:01:54.605006+0000","last_fullsized":"2024-04-25T09:01:54.605006+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:32.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.706107+0000","last_change":"2024-04-25T09:01:52.703003+0000","last_active":"2024-04-25T09:01:52.706107+0000","last_peered":"2024-04-25T09:01:52.706107+0000","last_clean":"2024-04-25T09:01:52.706107+0000","last_became_active":"2024-04-25T09:01:52.702715+0000","last_became_peered":"2024-04-25T09:01:52.702715+0000","last_unstale":"2024-04-25T09:01:52.706107+0000","last_undegraded":"2024-04-25T09:01:52.706107+0000","last_fullsized":"2024-04-25T09:01:52.706107+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693556+0000","last_change":"2024-04-25T09:01:52.688278+0000","last_active":"2024-04-25T09:01:53.693556+0000","last_peered":"2024-04-25T09:01:53.693556+0000","last_clean":"2024-04-25T09:01:53.693556+0000","last_became_active":"2024-04-25T09:01:52.687945+0000","last_became_peered":"2024-04-25T09:01:52.687945+0000","last_unstale":"2024-04-25T09:01:53.693556+0000","last_undegraded":"2024-04-25T09:01:53.693556+0000","last_fullsized":"2024-04-25T09:01:53.693556+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.701481+0000","last_change":"2024-04-25T09:01:52.698724+0000","last_active":"2024-04-25T09:01:52.701481+0000","last_peered":"2024-04-25T09:01:52.701481+0000","last_clean":"2024-04-25T09:01:52.701481+0000","last_became_active":"2024-04-25T09:01:52.698461+0000","last_became_peered":"2024-04-25T09:01:52.698461+0000","last_unstale":"2024-04-25T09:01:52.701481+0000","last_undegraded":"2024-04-25T09:01:52.701481+0000","last_fullsized":"2024-04-25T09:01:52.701481+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.701179+0000","last_change":"2024-04-25T09:01:52.697957+0000","last_active":"2024-04-25T09:01:52.701179+0000","last_peered":"2024-04-25T09:01:52.701179+0000","last_clean":"2024-04-25T09:01:52.701179+0000","last_became_active":"2024-04-25T09:01:52.697697+0000","last_became_peered":"2024-04-25T09:01:52.697697+0000","last_unstale":"2024-04-25T09:01:52.701179+0000","last_undegraded":"2024-04-25T09:01:52.701179+0000","last_fullsized":"2024-04-25T09:01:52.701179+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604905+0000","last_change":"2024-04-25T09:01:52.710111+0000","last_active":"2024-04-25T09:01:54.604905+0000","last_peered":"2024-04-25T09:01:54.604905+0000","last_clean":"2024-04-25T09:01:54.604905+0000","last_became_active":"2024-04-25T09:01:52.709135+0000","last_became_peered":"2024-04-25T09:01:52.709135+0000","last_unstale":"2024-04-25T09:01:54.604905+0000","last_undegraded":"2024-04-25T09:01:54.604905+0000","last_fullsized":"2024-04-25T09:01:54.604905+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:05.158708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693398+0000","last_change":"2024-04-25T09:01:52.696335+0000","last_active":"2024-04-25T09:01:53.693398+0000","last_peered":"2024-04-25T09:01:53.693398+0000","last_clean":"2024-04-25T09:01:53.693398+0000","last_became_active":"2024-04-25T09:01:52.695444+0000","last_became_peered":"2024-04-25T09:01:52.695444+0000","last_unstale":"2024-04-25T09:01:53.693398+0000","last_undegraded":"2024-04-25T09:01:53.693398+0000","last_fullsized":"2024-04-25T09:01:53.693398+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:49.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692801+0000","last_change":"2024-04-25T09:01:52.700383+0000","last_active":"2024-04-25T09:01:53.692801+0000","last_peered":"2024-04-25T09:01:53.692801+0000","last_clean":"2024-04-25T09:01:53.692801+0000","last_became_active":"2024-04-25T09:01:52.700110+0000","last_became_peered":"2024-04-25T09:01:52.700110+0000","last_unstale":"2024-04-25T09:01:53.692801+0000","last_undegraded":"2024-04-25T09:01:53.692801+0000","last_fullsized":"2024-04-25T09:01:53.692801+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.700399+0000","last_change":"2024-04-25T09:01:52.694747+0000","last_active":"2024-04-25T09:01:52.700399+0000","last_peered":"2024-04-25T09:01:52.700399+0000","last_clean":"2024-04-25T09:01:52.700399+0000","last_became_active":"2024-04-25T09:01:52.694333+0000","last_became_peered":"2024-04-25T09:01:52.694333+0000","last_unstale":"2024-04-25T09:01:52.700399+0000","last_undegraded":"2024-04-25T09:01:52.700399+0000","last_fullsized":"2024-04-25T09:01:52.700399+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:28.487975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692551+0000","last_change":"2024-04-25T09:01:52.703084+0000","last_active":"2024-04-25T09:01:53.692551+0000","last_peered":"2024-04-25T09:01:53.692551+0000","last_clean":"2024-04-25T09:01:53.692551+0000","last_became_active":"2024-04-25T09:01:52.702483+0000","last_became_peered":"2024-04-25T09:01:52.702483+0000","last_unstale":"2024-04-25T09:01:53.692551+0000","last_undegraded":"2024-04-25T09:01:53.692551+0000","last_fullsized":"2024-04-25T09:01:53.692551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696269+0000","last_change":"2024-04-25T09:01:52.694341+0000","last_active":"2024-04-25T09:01:52.696269+0000","last_peered":"2024-04-25T09:01:52.696269+0000","last_clean":"2024-04-25T09:01:52.696269+0000","last_became_active":"2024-04-25T09:01:52.694029+0000","last_became_peered":"2024-04-25T09:01:52.694029+0000","last_unstale":"2024-04-25T09:01:52.696269+0000","last_undegraded":"2024-04-25T09:01:52.696269+0000","last_fullsized":"2024-04-25T09:01:52.696269+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096514+0000","last_change":"2024-04-25T09:01:52.706665+0000","last_active":"2024-04-25T09:01:54.096514+0000","last_peered":"2024-04-25T09:01:54.096514+0000","last_clean":"2024-04-25T09:01:54.096514+0000","last_became_active":"2024-04-25T09:01:52.705279+0000","last_became_peered":"2024-04-25T09:01:52.705279+0000","last_unstale":"2024-04-25T09:01:54.096514+0000","last_undegraded":"2024-04-25T09:01:54.096514+0000","last_fullsized":"2024-04-25T09:01:54.096514+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:36.665698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.704780+0000","last_change":"2024-04-25T09:01:52.700645+0000","last_active":"2024-04-25T09:01:52.704780+0000","last_peered":"2024-04-25T09:01:52.704780+0000","last_clean":"2024-04-25T09:01:52.704780+0000","last_became_active":"2024-04-25T09:01:52.700098+0000","last_became_peered":"2024-04-25T09:01:52.700098+0000","last_unstale":"2024-04-25T09:01:52.704780+0000","last_undegraded":"2024-04-25T09:01:52.704780+0000","last_fullsized":"2024-04-25T09:01:52.704780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.714559+0000","last_change":"2024-04-25T09:01:52.710044+0000","last_active":"2024-04-25T09:01:52.714559+0000","last_peered":"2024-04-25T09:01:52.714559+0000","last_clean":"2024-04-25T09:01:52.714559+0000","last_became_active":"2024-04-25T09:01:52.709788+0000","last_became_peered":"2024-04-25T09:01:52.709788+0000","last_unstale":"2024-04-25T09:01:52.714559+0000","last_undegraded":"2024-04-25T09:01:52.714559+0000","last_fullsized":"2024-04-25T09:01:52.714559+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605210+0000","last_change":"2024-04-25T09:01:52.710102+0000","last_active":"2024-04-25T09:01:54.605210+0000","last_peered":"2024-04-25T09:01:54.605210+0000","last_clean":"2024-04-25T09:01:54.605210+0000","last_became_active":"2024-04-25T09:01:52.709465+0000","last_became_peered":"2024-04-25T09:01:52.709465+0000","last_unstale":"2024-04-25T09:01:54.605210+0000","last_undegraded":"2024-04-25T09:01:54.605210+0000","last_fullsized":"2024-04-25T09:01:54.605210+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:52.724558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.706341+0000","last_change":"2024-04-25T09:01:52.703474+0000","last_active":"2024-04-25T09:01:52.706341+0000","last_peered":"2024-04-25T09:01:52.706341+0000","last_clean":"2024-04-25T09:01:52.706341+0000","last_became_active":"2024-04-25T09:01:52.703179+0000","last_became_peered":"2024-04-25T09:01:52.703179+0000","last_unstale":"2024-04-25T09:01:52.706341+0000","last_undegraded":"2024-04-25T09:01:52.706341+0000","last_fullsized":"2024-04-25T09:01:52.706341+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096859+0000","last_change":"2024-04-25T09:01:52.706050+0000","last_active":"2024-04-25T09:01:54.096859+0000","last_peered":"2024-04-25T09:01:54.096859+0000","last_clean":"2024-04-25T09:01:54.096859+0000","last_became_active":"2024-04-25T09:01:52.704879+0000","last_became_peered":"2024-04-25T09:01:52.704879+0000","last_unstale":"2024-04-25T09:01:54.096859+0000","last_undegraded":"2024-04-25T09:01:54.096859+0000","last_fullsized":"2024-04-25T09:01:54.096859+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:33.129014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692717+0000","last_change":"2024-04-25T09:01:52.697576+0000","last_active":"2024-04-25T09:01:53.692717+0000","last_peered":"2024-04-25T09:01:53.692717+0000","last_clean":"2024-04-25T09:01:53.692717+0000","last_became_active":"2024-04-25T09:01:52.697260+0000","last_became_peered":"2024-04-25T09:01:52.697260+0000","last_unstale":"2024-04-25T09:01:53.692717+0000","last_undegraded":"2024-04-25T09:01:53.692717+0000","last_fullsized":"2024-04-25T09:01:53.692717+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096580+0000","last_change":"2024-04-25T09:01:52.702251+0000","last_active":"2024-04-25T09:01:54.096580+0000","last_peered":"2024-04-25T09:01:54.096580+0000","last_clean":"2024-04-25T09:01:54.096580+0000","last_became_active":"2024-04-25T09:01:52.701967+0000","last_became_peered":"2024-04-25T09:01:52.701967+0000","last_unstale":"2024-04-25T09:01:54.096580+0000","last_undegraded":"2024-04-25T09:01:54.096580+0000","last_fullsized":"2024-04-25T09:01:54.096580+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:53.310405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604901+0000","last_change":"2024-04-25T09:01:52.708781+0000","last_active":"2024-04-25T09:01:54.604901+0000","last_peered":"2024-04-25T09:01:54.604901+0000","last_clean":"2024-04-25T09:01:54.604901+0000","last_became_active":"2024-04-25T09:01:52.708504+0000","last_became_peered":"2024-04-25T09:01:52.708504+0000","last_unstale":"2024-04-25T09:01:54.604901+0000","last_undegraded":"2024-04-25T09:01:54.604901+0000","last_fullsized":"2024-04-25T09:01:54.604901+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:17.745375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604880+0000","last_change":"2024-04-25T09:01:52.708786+0000","last_active":"2024-04-25T09:01:54.604880+0000","last_peered":"2024-04-25T09:01:54.604880+0000","last_clean":"2024-04-25T09:01:54.604880+0000","last_became_active":"2024-04-25T09:01:52.708444+0000","last_became_peered":"2024-04-25T09:01:52.708444+0000","last_unstale":"2024-04-25T09:01:54.604880+0000","last_undegraded":"2024-04-25T09:01:54.604880+0000","last_fullsized":"2024-04-25T09:01:54.604880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:55.403342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.701785+0000","last_change":"2024-04-25T09:01:52.696131+0000","last_active":"2024-04-25T09:01:52.701785+0000","last_peered":"2024-04-25T09:01:52.701785+0000","last_clean":"2024-04-25T09:01:52.701785+0000","last_became_active":"2024-04-25T09:01:52.695841+0000","last_became_peered":"2024-04-25T09:01:52.695841+0000","last_unstale":"2024-04-25T09:01:52.701785+0000","last_undegraded":"2024-04-25T09:01:52.701785+0000","last_fullsized":"2024-04-25T09:01:52.701785+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:36.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693641+0000","last_change":"2024-04-25T09:01:52.712343+0000","last_active":"2024-04-25T09:01:53.693641+0000","last_peered":"2024-04-25T09:01:53.693641+0000","last_clean":"2024-04-25T09:01:53.693641+0000","last_became_active":"2024-04-25T09:01:52.712042+0000","last_became_peered":"2024-04-25T09:01:52.712042+0000","last_unstale":"2024-04-25T09:01:53.693641+0000","last_undegraded":"2024-04-25T09:01:53.693641+0000","last_fullsized":"2024-04-25T09:01:53.693641+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:08.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605249+0000","last_change":"2024-04-25T09:01:52.713137+0000","last_active":"2024-04-25T09:01:54.605249+0000","last_peered":"2024-04-25T09:01:54.605249+0000","last_clean":"2024-04-25T09:01:54.605249+0000","last_became_active":"2024-04-25T09:01:52.711889+0000","last_became_peered":"2024-04-25T09:01:52.711889+0000","last_unstale":"2024-04-25T09:01:54.605249+0000","last_undegraded":"2024-04-25T09:01:54.605249+0000","last_fullsized":"2024-04-25T09:01:54.605249+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:00.395210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.708388+0000","last_change":"2024-04-25T09:01:52.703603+0000","last_active":"2024-04-25T09:01:52.708388+0000","last_peered":"2024-04-25T09:01:52.708388+0000","last_clean":"2024-04-25T09:01:52.708388+0000","last_became_active":"2024-04-25T09:01:52.702267+0000","last_became_peered":"2024-04-25T09:01:52.702267+0000","last_unstale":"2024-04-25T09:01:52.708388+0000","last_undegraded":"2024-04-25T09:01:52.708388+0000","last_fullsized":"2024-04-25T09:01:52.708388+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693635+0000","last_change":"2024-04-25T09:01:52.691453+0000","last_active":"2024-04-25T09:01:53.693635+0000","last_peered":"2024-04-25T09:01:53.693635+0000","last_clean":"2024-04-25T09:01:53.693635+0000","last_became_active":"2024-04-25T09:01:52.691156+0000","last_became_peered":"2024-04-25T09:01:52.691156+0000","last_unstale":"2024-04-25T09:01:53.693635+0000","last_undegraded":"2024-04-25T09:01:53.693635+0000","last_fullsized":"2024-04-25T09:01:53.693635+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:49.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604880+0000","last_change":"2024-04-25T09:01:52.711904+0000","last_active":"2024-04-25T09:01:54.604880+0000","last_peered":"2024-04-25T09:01:54.604880+0000","last_clean":"2024-04-25T09:01:54.604880+0000","last_became_active":"2024-04-25T09:01:52.711585+0000","last_became_peered":"2024-04-25T09:01:52.711585+0000","last_unstale":"2024-04-25T09:01:54.604880+0000","last_undegraded":"2024-04-25T09:01:54.604880+0000","last_fullsized":"2024-04-25T09:01:54.604880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:33.292042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096430+0000","last_change":"2024-04-25T09:01:52.706947+0000","last_active":"2024-04-25T09:01:54.096430+0000","last_peered":"2024-04-25T09:01:54.096430+0000","last_clean":"2024-04-25T09:01:54.096430+0000","last_became_active":"2024-04-25T09:01:52.706404+0000","last_became_peered":"2024-04-25T09:01:52.706404+0000","last_unstale":"2024-04-25T09:01:54.096430+0000","last_undegraded":"2024-04-25T09:01:54.096430+0000","last_fullsized":"2024-04-25T09:01:54.096430+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:29.478809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696017+0000","last_change":"2024-04-25T09:01:52.688618+0000","last_active":"2024-04-25T09:01:52.696017+0000","last_peered":"2024-04-25T09:01:52.696017+0000","last_clean":"2024-04-25T09:01:52.696017+0000","last_became_active":"2024-04-25T09:01:52.688240+0000","last_became_peered":"2024-04-25T09:01:52.688240+0000","last_unstale":"2024-04-25T09:01:52.696017+0000","last_undegraded":"2024-04-25T09:01:52.696017+0000","last_fullsized":"2024-04-25T09:01:52.696017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:39.551479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096874+0000","last_change":"2024-04-25T09:01:52.704798+0000","last_active":"2024-04-25T09:01:54.096874+0000","last_peered":"2024-04-25T09:01:54.096874+0000","last_clean":"2024-04-25T09:01:54.096874+0000","last_became_active":"2024-04-25T09:01:52.702861+0000","last_became_peered":"2024-04-25T09:01:52.702861+0000","last_unstale":"2024-04-25T09:01:54.096874+0000","last_undegraded":"2024-04-25T09:01:54.096874+0000","last_fullsized":"2024-04-25T09:01:54.096874+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:55.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"101'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605302+0000","last_change":"2024-04-25T09:01:51.692270+0000","last_active":"2024-04-25T09:01:54.605302+0000","last_peered":"2024-04-25T09:01:54.605302+0000","last_clean":"2024-04-25T09:01:54.605302+0000","last_became_active":"2024-04-25T09:01:51.691955+0000","last_became_peered":"2024-04-25T09:01:51.691955+0000","last_unstale":"2024-04-25T09:01:54.605302+0000","last_undegraded":"2024-04-25T09:01:54.605302+0000","last_fullsized":"2024-04-25T09:01:54.605302+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:54.059043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696317+0000","last_change":"2024-04-25T09:01:52.691603+0000","last_active":"2024-04-25T09:01:52.696317+0000","last_peered":"2024-04-25T09:01:52.696317+0000","last_clean":"2024-04-25T09:01:52.696317+0000","last_became_active":"2024-04-25T09:01:52.691238+0000","last_became_peered":"2024-04-25T09:01:52.691238+0000","last_unstale":"2024-04-25T09:01:52.696317+0000","last_undegraded":"2024-04-25T09:01:52.696317+0000","last_fullsized":"2024-04-25T09:01:52.696317+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:36.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"101'1","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.713225+0000","last_change":"2024-04-25T09:01:51.689370+0000","last_active":"2024-04-25T09:01:52.713225+0000","last_peered":"2024-04-25T09:01:52.713225+0000","last_clean":"2024-04-25T09:01:52.713225+0000","last_became_active":"2024-04-25T09:01:51.689015+0000","last_became_peered":"2024-04-25T09:01:51.689015+0000","last_unstale":"2024-04-25T09:01:52.713225+0000","last_undegraded":"2024-04-25T09:01:52.713225+0000","last_fullsized":"2024-04-25T09:01:52.713225+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:53.114164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605116+0000","last_change":"2024-04-25T09:01:51.688848+0000","last_active":"2024-04-25T09:01:54.605116+0000","last_peered":"2024-04-25T09:01:54.605116+0000","last_clean":"2024-04-25T09:01:54.605116+0000","last_became_active":"2024-04-25T09:01:51.687975+0000","last_became_peered":"2024-04-25T09:01:51.687975+0000","last_unstale":"2024-04-25T09:01:54.605116+0000","last_undegraded":"2024-04-25T09:01:54.605116+0000","last_fullsized":"2024-04-25T09:01:54.605116+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:38.549589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693222+0000","last_change":"2024-04-25T09:01:52.701156+0000","last_active":"2024-04-25T09:01:53.693222+0000","last_peered":"2024-04-25T09:01:53.693222+0000","last_clean":"2024-04-25T09:01:53.693222+0000","last_became_active":"2024-04-25T09:01:52.700622+0000","last_became_peered":"2024-04-25T09:01:52.700622+0000","last_unstale":"2024-04-25T09:01:53.693222+0000","last_undegraded":"2024-04-25T09:01:53.693222+0000","last_fullsized":"2024-04-25T09:01:53.693222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604953+0000","last_change":"2024-04-25T09:01:51.692632+0000","last_active":"2024-04-25T09:01:54.604953+0000","last_peered":"2024-04-25T09:01:54.604953+0000","last_clean":"2024-04-25T09:01:54.604953+0000","last_became_active":"2024-04-25T09:01:51.691884+0000","last_became_peered":"2024-04-25T09:01:51.691884+0000","last_unstale":"2024-04-25T09:01:54.604953+0000","last_undegraded":"2024-04-25T09:01:54.604953+0000","last_fullsized":"2024-04-25T09:01:54.604953+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:31.350305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.705807+0000","last_change":"2024-04-25T09:01:52.703085+0000","last_active":"2024-04-25T09:01:52.705807+0000","last_peered":"2024-04-25T09:01:52.705807+0000","last_clean":"2024-04-25T09:01:52.705807+0000","last_became_active":"2024-04-25T09:01:52.702124+0000","last_became_peered":"2024-04-25T09:01:52.702124+0000","last_unstale":"2024-04-25T09:01:52.705807+0000","last_undegraded":"2024-04-25T09:01:52.705807+0000","last_fullsized":"2024-04-25T09:01:52.705807+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:46.900633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669518+0000","last_change":"2024-04-25T09:01:50.669518+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669518+0000","last_undegraded":"2024-04-25T09:01:50.669518+0000","last_fullsized":"2024-04-25T09:01:50.669518+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.691771+0000","last_change":"2024-04-25T09:01:52.688524+0000","last_active":"2024-04-25T09:01:52.691771+0000","last_peered":"2024-04-25T09:01:52.691771+0000","last_clean":"2024-04-25T09:01:52.691771+0000","last_became_active":"2024-04-25T09:01:52.688222+0000","last_became_peered":"2024-04-25T09:01:52.688222+0000","last_unstale":"2024-04-25T09:01:52.691771+0000","last_undegraded":"2024-04-25T09:01:52.691771+0000","last_fullsized":"2024-04-25T09:01:52.691771+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:55.060933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604965+0000","last_change":"2024-04-25T09:01:51.689748+0000","last_active":"2024-04-25T09:01:54.604965+0000","last_peered":"2024-04-25T09:01:54.604965+0000","last_clean":"2024-04-25T09:01:54.604965+0000","last_became_active":"2024-04-25T09:01:51.689480+0000","last_became_peered":"2024-04-25T09:01:51.689480+0000","last_unstale":"2024-04-25T09:01:54.604965+0000","last_undegraded":"2024-04-25T09:01:54.604965+0000","last_fullsized":"2024-04-25T09:01:54.604965+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.251208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.702683+0000","last_change":"2024-04-25T09:01:52.696412+0000","last_active":"2024-04-25T09:01:52.702683+0000","last_peered":"2024-04-25T09:01:52.702683+0000","last_clean":"2024-04-25T09:01:52.702683+0000","last_became_active":"2024-04-25T09:01:52.695363+0000","last_became_peered":"2024-04-25T09:01:52.695363+0000","last_unstale":"2024-04-25T09:01:52.702683+0000","last_undegraded":"2024-04-25T09:01:52.702683+0000","last_fullsized":"2024-04-25T09:01:52.702683+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692595+0000","last_change":"2024-04-25T09:01:51.692656+0000","last_active":"2024-04-25T09:01:53.692595+0000","last_peered":"2024-04-25T09:01:53.692595+0000","last_clean":"2024-04-25T09:01:53.692595+0000","last_became_active":"2024-04-25T09:01:51.692312+0000","last_became_peered":"2024-04-25T09:01:51.692312+0000","last_unstale":"2024-04-25T09:01:53.692595+0000","last_undegraded":"2024-04-25T09:01:53.692595+0000","last_fullsized":"2024-04-25T09:01:53.692595+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:25.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692262+0000","last_change":"2024-04-25T09:01:52.699187+0000","last_active":"2024-04-25T09:01:53.692262+0000","last_peered":"2024-04-25T09:01:53.692262+0000","last_clean":"2024-04-25T09:01:53.692262+0000","last_became_active":"2024-04-25T09:01:52.698861+0000","last_became_peered":"2024-04-25T09:01:52.698861+0000","last_unstale":"2024-04-25T09:01:53.692262+0000","last_undegraded":"2024-04-25T09:01:53.692262+0000","last_fullsized":"2024-04-25T09:01:53.692262+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.670967+0000","last_change":"2024-04-25T09:01:50.670967+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.670967+0000","last_undegraded":"2024-04-25T09:01:50.670967+0000","last_fullsized":"2024-04-25T09:01:50.670967+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605258+0000","last_change":"2024-04-25T09:01:52.712317+0000","last_active":"2024-04-25T09:01:54.605258+0000","last_peered":"2024-04-25T09:01:54.605258+0000","last_clean":"2024-04-25T09:01:54.605258+0000","last_became_active":"2024-04-25T09:01:52.710876+0000","last_became_peered":"2024-04-25T09:01:52.710876+0000","last_unstale":"2024-04-25T09:01:54.605258+0000","last_undegraded":"2024-04-25T09:01:54.605258+0000","last_fullsized":"2024-04-25T09:01:54.605258+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:57.067729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669543+0000","last_change":"2024-04-25T09:01:50.669543+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669543+0000","last_undegraded":"2024-04-25T09:01:50.669543+0000","last_fullsized":"2024-04-25T09:01:50.669543+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693570+0000","last_change":"2024-04-25T09:01:52.700066+0000","last_active":"2024-04-25T09:01:53.693570+0000","last_peered":"2024-04-25T09:01:53.693570+0000","last_clean":"2024-04-25T09:01:53.693570+0000","last_became_active":"2024-04-25T09:01:52.699737+0000","last_became_peered":"2024-04-25T09:01:52.699737+0000","last_unstale":"2024-04-25T09:01:53.693570+0000","last_undegraded":"2024-04-25T09:01:53.693570+0000","last_fullsized":"2024-04-25T09:01:53.693570+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:08.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.680625+0000","last_change":"2024-04-25T09:01:51.694493+0000","last_active":"2024-04-25T09:01:52.680625+0000","last_peered":"2024-04-25T09:01:52.680625+0000","last_clean":"2024-04-25T09:01:52.680625+0000","last_became_active":"2024-04-25T09:01:51.693830+0000","last_became_peered":"2024-04-25T09:01:51.693830+0000","last_unstale":"2024-04-25T09:01:52.680625+0000","last_undegraded":"2024-04-25T09:01:52.680625+0000","last_fullsized":"2024-04-25T09:01:52.680625+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:54.059043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693750+0000","last_change":"2024-04-25T09:01:52.712409+0000","last_active":"2024-04-25T09:01:53.693750+0000","last_peered":"2024-04-25T09:01:53.693750+0000","last_clean":"2024-04-25T09:01:53.693750+0000","last_became_active":"2024-04-25T09:01:52.712046+0000","last_became_peered":"2024-04-25T09:01:52.712046+0000","last_unstale":"2024-04-25T09:01:53.693750+0000","last_undegraded":"2024-04-25T09:01:53.693750+0000","last_fullsized":"2024-04-25T09:01:53.693750+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:27.972277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"101'3","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.714530+0000","last_change":"2024-04-25T09:01:51.686596+0000","last_active":"2024-04-25T09:01:52.714530+0000","last_peered":"2024-04-25T09:01:52.714530+0000","last_clean":"2024-04-25T09:01:52.714530+0000","last_became_active":"2024-04-25T09:01:51.686313+0000","last_became_peered":"2024-04-25T09:01:51.686313+0000","last_unstale":"2024-04-25T09:01:52.714530+0000","last_undegraded":"2024-04-25T09:01:52.714530+0000","last_fullsized":"2024-04-25T09:01:52.714530+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.714583+0000","last_change":"2024-04-25T09:01:52.709769+0000","last_active":"2024-04-25T09:01:52.714583+0000","last_peered":"2024-04-25T09:01:52.714583+0000","last_clean":"2024-04-25T09:01:52.714583+0000","last_became_active":"2024-04-25T09:01:52.709498+0000","last_became_peered":"2024-04-25T09:01:52.709498+0000","last_unstale":"2024-04-25T09:01:52.714583+0000","last_undegraded":"2024-04-25T09:01:52.714583+0000","last_fullsized":"2024-04-25T09:01:52.714583+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"101'6","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692814+0000","last_change":"2024-04-25T09:01:51.682536+0000","last_active":"2024-04-25T09:01:53.692814+0000","last_peered":"2024-04-25T09:01:53.692814+0000","last_clean":"2024-04-25T09:01:53.692814+0000","last_became_active":"2024-04-25T09:01:51.682287+0000","last_became_peered":"2024-04-25T09:01:51.682287+0000","last_unstale":"2024-04-25T09:01:53.692814+0000","last_undegraded":"2024-04-25T09:01:53.692814+0000","last_fullsized":"2024-04-25T09:01:53.692814+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:45.898743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.693220+0000","last_change":"2024-04-25T09:01:52.684908+0000","last_active":"2024-04-25T09:01:52.693220+0000","last_peered":"2024-04-25T09:01:52.693220+0000","last_clean":"2024-04-25T09:01:52.693220+0000","last_became_active":"2024-04-25T09:01:52.684605+0000","last_became_peered":"2024-04-25T09:01:52.684605+0000","last_unstale":"2024-04-25T09:01:52.693220+0000","last_undegraded":"2024-04-25T09:01:52.693220+0000","last_fullsized":"2024-04-25T09:01:52.693220+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:28.487975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096731+0000","last_change":"2024-04-25T09:01:51.680248+0000","last_active":"2024-04-25T09:01:54.096731+0000","last_peered":"2024-04-25T09:01:54.096731+0000","last_clean":"2024-04-25T09:01:54.096731+0000","last_became_active":"2024-04-25T09:01:51.679942+0000","last_became_peered":"2024-04-25T09:01:51.679942+0000","last_unstale":"2024-04-25T09:01:54.096731+0000","last_undegraded":"2024-04-25T09:01:54.096731+0000","last_fullsized":"2024-04-25T09:01:54.096731+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:09.184803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096810+0000","last_change":"2024-04-25T09:01:51.684580+0000","last_active":"2024-04-25T09:01:54.096810+0000","last_peered":"2024-04-25T09:01:54.096810+0000","last_clean":"2024-04-25T09:01:54.096810+0000","last_became_active":"2024-04-25T09:01:51.684288+0000","last_became_peered":"2024-04-25T09:01:51.684288+0000","last_unstale":"2024-04-25T09:01:54.096810+0000","last_undegraded":"2024-04-25T09:01:54.096810+0000","last_fullsized":"2024-04-25T09:01:54.096810+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:02.377887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692176+0000","last_change":"2024-04-25T09:01:52.696616+0000","last_active":"2024-04-25T09:01:53.692176+0000","last_peered":"2024-04-25T09:01:53.692176+0000","last_clean":"2024-04-25T09:01:53.692176+0000","last_became_active":"2024-04-25T09:01:52.695066+0000","last_became_peered":"2024-04-25T09:01:52.695066+0000","last_unstale":"2024-04-25T09:01:53.692176+0000","last_undegraded":"2024-04-25T09:01:53.692176+0000","last_fullsized":"2024-04-25T09:01:53.692176+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:36.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692682+0000","last_change":"2024-04-25T09:01:51.679465+0000","last_active":"2024-04-25T09:01:53.692682+0000","last_peered":"2024-04-25T09:01:53.692682+0000","last_clean":"2024-04-25T09:01:53.692682+0000","last_became_active":"2024-04-25T09:01:51.679186+0000","last_became_peered":"2024-04-25T09:01:51.679186+0000","last_unstale":"2024-04-25T09:01:53.692682+0000","last_undegraded":"2024-04-25T09:01:53.692682+0000","last_fullsized":"2024-04-25T09:01:53.692682+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:25.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096427+0000","last_change":"2024-04-25T09:01:52.696205+0000","last_active":"2024-04-25T09:01:54.096427+0000","last_peered":"2024-04-25T09:01:54.096427+0000","last_clean":"2024-04-25T09:01:54.096427+0000","last_became_active":"2024-04-25T09:01:52.695777+0000","last_became_peered":"2024-04-25T09:01:52.695777+0000","last_unstale":"2024-04-25T09:01:54.096427+0000","last_undegraded":"2024-04-25T09:01:54.096427+0000","last_fullsized":"2024-04-25T09:01:54.096427+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:21.504958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669500+0000","last_change":"2024-04-25T09:01:50.669500+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669500+0000","last_undegraded":"2024-04-25T09:01:50.669500+0000","last_fullsized":"2024-04-25T09:01:50.669500+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693702+0000","last_change":"2024-04-25T09:01:52.696401+0000","last_active":"2024-04-25T09:01:53.693702+0000","last_peered":"2024-04-25T09:01:53.693702+0000","last_clean":"2024-04-25T09:01:53.693702+0000","last_became_active":"2024-04-25T09:01:52.696116+0000","last_became_peered":"2024-04-25T09:01:52.696116+0000","last_unstale":"2024-04-25T09:01:53.693702+0000","last_undegraded":"2024-04-25T09:01:53.693702+0000","last_fullsized":"2024-04-25T09:01:53.693702+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:43.173439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692960+0000","last_change":"2024-04-25T09:01:51.684399+0000","last_active":"2024-04-25T09:01:53.692960+0000","last_peered":"2024-04-25T09:01:53.692960+0000","last_clean":"2024-04-25T09:01:53.692960+0000","last_became_active":"2024-04-25T09:01:51.684099+0000","last_became_peered":"2024-04-25T09:01:51.684099+0000","last_unstale":"2024-04-25T09:01:53.692960+0000","last_undegraded":"2024-04-25T09:01:53.692960+0000","last_fullsized":"2024-04-25T09:01:53.692960+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:15.299506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.711488+0000","last_change":"2024-04-25T09:01:52.703565+0000","last_active":"2024-04-25T09:01:52.711488+0000","last_peered":"2024-04-25T09:01:52.711488+0000","last_clean":"2024-04-25T09:01:52.711488+0000","last_became_active":"2024-04-25T09:01:52.703291+0000","last_became_peered":"2024-04-25T09:01:52.703291+0000","last_unstale":"2024-04-25T09:01:52.711488+0000","last_undegraded":"2024-04-25T09:01:52.711488+0000","last_fullsized":"2024-04-25T09:01:52.711488+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:16.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693116+0000","last_change":"2024-04-25T09:01:51.683022+0000","last_active":"2024-04-25T09:01:53.693116+0000","last_peered":"2024-04-25T09:01:53.693116+0000","last_clean":"2024-04-25T09:01:53.693116+0000","last_became_active":"2024-04-25T09:01:51.682744+0000","last_became_peered":"2024-04-25T09:01:51.682744+0000","last_unstale":"2024-04-25T09:01:53.693116+0000","last_undegraded":"2024-04-25T09:01:53.693116+0000","last_fullsized":"2024-04-25T09:01:53.693116+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:45.898743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.700594+0000","last_change":"2024-04-25T09:01:52.695302+0000","last_active":"2024-04-25T09:01:52.700594+0000","last_peered":"2024-04-25T09:01:52.700594+0000","last_clean":"2024-04-25T09:01:52.700594+0000","last_became_active":"2024-04-25T09:01:52.694964+0000","last_became_peered":"2024-04-25T09:01:52.694964+0000","last_unstale":"2024-04-25T09:01:52.700594+0000","last_undegraded":"2024-04-25T09:01:52.700594+0000","last_fullsized":"2024-04-25T09:01:52.700594+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:39.551479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604993+0000","last_change":"2024-04-25T09:01:51.693495+0000","last_active":"2024-04-25T09:01:54.604993+0000","last_peered":"2024-04-25T09:01:54.604993+0000","last_clean":"2024-04-25T09:01:54.604993+0000","last_became_active":"2024-04-25T09:01:51.692315+0000","last_became_peered":"2024-04-25T09:01:51.692315+0000","last_unstale":"2024-04-25T09:01:54.604993+0000","last_undegraded":"2024-04-25T09:01:54.604993+0000","last_fullsized":"2024-04-25T09:01:54.604993+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:28.649670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096711+0000","last_change":"2024-04-25T09:01:52.700272+0000","last_active":"2024-04-25T09:01:54.096711+0000","last_peered":"2024-04-25T09:01:54.096711+0000","last_clean":"2024-04-25T09:01:54.096711+0000","last_became_active":"2024-04-25T09:01:52.699838+0000","last_became_peered":"2024-04-25T09:01:52.699838+0000","last_unstale":"2024-04-25T09:01:54.096711+0000","last_undegraded":"2024-04-25T09:01:54.096711+0000","last_fullsized":"2024-04-25T09:01:54.096711+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:12.827897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605005+0000","last_change":"2024-04-25T09:01:51.693512+0000","last_active":"2024-04-25T09:01:54.605005+0000","last_peered":"2024-04-25T09:01:54.605005+0000","last_clean":"2024-04-25T09:01:54.605005+0000","last_became_active":"2024-04-25T09:01:51.693189+0000","last_became_peered":"2024-04-25T09:01:51.693189+0000","last_unstale":"2024-04-25T09:01:54.605005+0000","last_undegraded":"2024-04-25T09:01:54.605005+0000","last_fullsized":"2024-04-25T09:01:54.605005+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:55.700281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096658+0000","last_change":"2024-04-25T09:01:52.712476+0000","last_active":"2024-04-25T09:01:54.096658+0000","last_peered":"2024-04-25T09:01:54.096658+0000","last_clean":"2024-04-25T09:01:54.096658+0000","last_became_active":"2024-04-25T09:01:52.712176+0000","last_became_peered":"2024-04-25T09:01:52.712176+0000","last_unstale":"2024-04-25T09:01:54.096658+0000","last_undegraded":"2024-04-25T09:01:54.096658+0000","last_fullsized":"2024-04-25T09:01:54.096658+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:52.609031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.697301+0000","last_change":"2024-04-25T09:01:51.689051+0000","last_active":"2024-04-25T09:01:52.697301+0000","last_peered":"2024-04-25T09:01:52.697301+0000","last_clean":"2024-04-25T09:01:52.697301+0000","last_became_active":"2024-04-25T09:01:51.688768+0000","last_became_peered":"2024-04-25T09:01:51.688768+0000","last_unstale":"2024-04-25T09:01:52.697301+0000","last_undegraded":"2024-04-25T09:01:52.697301+0000","last_fullsized":"2024-04-25T09:01:52.697301+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:49.800683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096382+0000","last_change":"2024-04-25T09:01:52.701436+0000","last_active":"2024-04-25T09:01:54.096382+0000","last_peered":"2024-04-25T09:01:54.096382+0000","last_clean":"2024-04-25T09:01:54.096382+0000","last_became_active":"2024-04-25T09:01:52.701096+0000","last_became_peered":"2024-04-25T09:01:52.701096+0000","last_unstale":"2024-04-25T09:01:54.096382+0000","last_undegraded":"2024-04-25T09:01:54.096382+0000","last_fullsized":"2024-04-25T09:01:54.096382+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:00.272347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696965+0000","last_change":"2024-04-25T09:01:51.685224+0000","last_active":"2024-04-25T09:01:52.696965+0000","last_peered":"2024-04-25T09:01:52.696965+0000","last_clean":"2024-04-25T09:01:52.696965+0000","last_became_active":"2024-04-25T09:01:51.684874+0000","last_became_peered":"2024-04-25T09:01:51.684874+0000","last_unstale":"2024-04-25T09:01:52.696965+0000","last_undegraded":"2024-04-25T09:01:52.696965+0000","last_fullsized":"2024-04-25T09:01:52.696965+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:00.417608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692485+0000","last_change":"2024-04-25T09:01:52.703105+0000","last_active":"2024-04-25T09:01:53.692485+0000","last_peered":"2024-04-25T09:01:53.692485+0000","last_clean":"2024-04-25T09:01:53.692485+0000","last_became_active":"2024-04-25T09:01:52.702819+0000","last_became_peered":"2024-04-25T09:01:52.702819+0000","last_unstale":"2024-04-25T09:01:53.692485+0000","last_undegraded":"2024-04-25T09:01:53.692485+0000","last_fullsized":"2024-04-25T09:01:53.692485+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605058+0000","last_change":"2024-04-25T09:01:51.692356+0000","last_active":"2024-04-25T09:01:54.605058+0000","last_peered":"2024-04-25T09:01:54.605058+0000","last_clean":"2024-04-25T09:01:54.605058+0000","last_became_active":"2024-04-25T09:01:51.691925+0000","last_became_peered":"2024-04-25T09:01:51.691925+0000","last_unstale":"2024-04-25T09:01:54.605058+0000","last_undegraded":"2024-04-25T09:01:54.605058+0000","last_fullsized":"2024-04-25T09:01:54.605058+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605395+0000","last_change":"2024-04-25T09:01:52.711183+0000","last_active":"2024-04-25T09:01:54.605395+0000","last_peered":"2024-04-25T09:01:54.605395+0000","last_clean":"2024-04-25T09:01:54.605395+0000","last_became_active":"2024-04-25T09:01:52.710711+0000","last_became_peered":"2024-04-25T09:01:52.710711+0000","last_unstale":"2024-04-25T09:01:54.605395+0000","last_undegraded":"2024-04-25T09:01:54.605395+0000","last_fullsized":"2024-04-25T09:01:54.605395+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:36.311937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"101'2","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.712005+0000","last_change":"2024-04-25T09:01:51.686947+0000","last_active":"2024-04-25T09:01:52.712005+0000","last_peered":"2024-04-25T09:01:52.712005+0000","last_clean":"2024-04-25T09:01:52.712005+0000","last_became_active":"2024-04-25T09:01:51.686297+0000","last_became_peered":"2024-04-25T09:01:51.686297+0000","last_unstale":"2024-04-25T09:01:52.712005+0000","last_undegraded":"2024-04-25T09:01:52.712005+0000","last_fullsized":"2024-04-25T09:01:52.712005+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:25.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605390+0000","last_change":"2024-04-25T09:01:51.688454+0000","last_active":"2024-04-25T09:01:54.605390+0000","last_peered":"2024-04-25T09:01:54.605390+0000","last_clean":"2024-04-25T09:01:54.605390+0000","last_became_active":"2024-04-25T09:01:51.688046+0000","last_became_peered":"2024-04-25T09:01:51.688046+0000","last_unstale":"2024-04-25T09:01:54.605390+0000","last_undegraded":"2024-04-25T09:01:54.605390+0000","last_fullsized":"2024-04-25T09:01:54.605390+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:35.523946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605090+0000","last_change":"2024-04-25T09:01:51.688326+0000","last_active":"2024-04-25T09:01:54.605090+0000","last_peered":"2024-04-25T09:01:54.605090+0000","last_clean":"2024-04-25T09:01:54.605090+0000","last_became_active":"2024-04-25T09:01:51.688018+0000","last_became_peered":"2024-04-25T09:01:51.688018+0000","last_unstale":"2024-04-25T09:01:54.605090+0000","last_undegraded":"2024-04-25T09:01:54.605090+0000","last_fullsized":"2024-04-25T09:01:54.605090+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:27.486085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692993+0000","last_change":"2024-04-25T09:01:52.691237+0000","last_active":"2024-04-25T09:01:53.692993+0000","last_peered":"2024-04-25T09:01:53.692993+0000","last_clean":"2024-04-25T09:01:53.692993+0000","last_became_active":"2024-04-25T09:01:52.690961+0000","last_became_peered":"2024-04-25T09:01:52.690961+0000","last_unstale":"2024-04-25T09:01:53.692993+0000","last_undegraded":"2024-04-25T09:01:53.692993+0000","last_fullsized":"2024-04-25T09:01:53.692993+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693713+0000","last_change":"2024-04-25T09:01:51.679451+0000","last_active":"2024-04-25T09:01:53.693713+0000","last_peered":"2024-04-25T09:01:53.693713+0000","last_clean":"2024-04-25T09:01:53.693713+0000","last_became_active":"2024-04-25T09:01:51.679204+0000","last_became_peered":"2024-04-25T09:01:51.679204+0000","last_unstale":"2024-04-25T09:01:53.693713+0000","last_undegraded":"2024-04-25T09:01:53.693713+0000","last_fullsized":"2024-04-25T09:01:53.693713+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:15.299506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096694+0000","last_change":"2024-04-25T09:01:52.698600+0000","last_active":"2024-04-25T09:01:54.096694+0000","last_peered":"2024-04-25T09:01:54.096694+0000","last_clean":"2024-04-25T09:01:54.096694+0000","last_became_active":"2024-04-25T09:01:52.698186+0000","last_became_peered":"2024-04-25T09:01:52.698186+0000","last_unstale":"2024-04-25T09:01:54.096694+0000","last_undegraded":"2024-04-25T09:01:54.096694+0000","last_fullsized":"2024-04-25T09:01:54.096694+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:59.899028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605178+0000","last_change":"2024-04-25T09:01:51.694307+0000","last_active":"2024-04-25T09:01:54.605178+0000","last_peered":"2024-04-25T09:01:54.605178+0000","last_clean":"2024-04-25T09:01:54.605178+0000","last_became_active":"2024-04-25T09:01:51.693908+0000","last_became_peered":"2024-04-25T09:01:51.693908+0000","last_unstale":"2024-04-25T09:01:54.605178+0000","last_undegraded":"2024-04-25T09:01:54.605178+0000","last_fullsized":"2024-04-25T09:01:54.605178+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:43.448108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693143+0000","last_change":"2024-04-25T09:01:52.694122+0000","last_active":"2024-04-25T09:01:53.693143+0000","last_peered":"2024-04-25T09:01:53.693143+0000","last_clean":"2024-04-25T09:01:53.693143+0000","last_became_active":"2024-04-25T09:01:52.693842+0000","last_became_peered":"2024-04-25T09:01:52.693842+0000","last_unstale":"2024-04-25T09:01:53.693143+0000","last_undegraded":"2024-04-25T09:01:53.693143+0000","last_fullsized":"2024-04-25T09:01:53.693143+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692610+0000","last_change":"2024-04-25T09:01:51.677502+0000","last_active":"2024-04-25T09:01:53.692610+0000","last_peered":"2024-04-25T09:01:53.692610+0000","last_clean":"2024-04-25T09:01:53.692610+0000","last_became_active":"2024-04-25T09:01:51.677227+0000","last_became_peered":"2024-04-25T09:01:51.677227+0000","last_unstale":"2024-04-25T09:01:53.692610+0000","last_undegraded":"2024-04-25T09:01:53.692610+0000","last_fullsized":"2024-04-25T09:01:53.692610+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:49.800683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096380+0000","last_change":"2024-04-25T09:01:52.697387+0000","last_active":"2024-04-25T09:01:54.096380+0000","last_peered":"2024-04-25T09:01:54.096380+0000","last_clean":"2024-04-25T09:01:54.096380+0000","last_became_active":"2024-04-25T09:01:52.697042+0000","last_became_peered":"2024-04-25T09:01:52.697042+0000","last_unstale":"2024-04-25T09:01:54.096380+0000","last_undegraded":"2024-04-25T09:01:54.096380+0000","last_fullsized":"2024-04-25T09:01:54.096380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:17.162954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.680484+0000","last_change":"2024-04-25T09:01:51.677381+0000","last_active":"2024-04-25T09:01:52.680484+0000","last_peered":"2024-04-25T09:01:52.680484+0000","last_clean":"2024-04-25T09:01:52.680484+0000","last_became_active":"2024-04-25T09:01:51.677062+0000","last_became_peered":"2024-04-25T09:01:51.677062+0000","last_unstale":"2024-04-25T09:01:52.680484+0000","last_undegraded":"2024-04-25T09:01:52.680484+0000","last_fullsized":"2024-04-25T09:01:52.680484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692553+0000","last_change":"2024-04-25T09:01:52.691546+0000","last_active":"2024-04-25T09:01:53.692553+0000","last_peered":"2024-04-25T09:01:53.692553+0000","last_clean":"2024-04-25T09:01:53.692553+0000","last_became_active":"2024-04-25T09:01:52.691230+0000","last_became_peered":"2024-04-25T09:01:52.691230+0000","last_unstale":"2024-04-25T09:01:53.692553+0000","last_undegraded":"2024-04-25T09:01:53.692553+0000","last_fullsized":"2024-04-25T09:01:53.692553+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096518+0000","last_change":"2024-04-25T09:01:51.692499+0000","last_active":"2024-04-25T09:01:54.096518+0000","last_peered":"2024-04-25T09:01:54.096518+0000","last_clean":"2024-04-25T09:01:54.096518+0000","last_became_active":"2024-04-25T09:01:51.692119+0000","last_became_peered":"2024-04-25T09:01:51.692119+0000","last_unstale":"2024-04-25T09:01:54.096518+0000","last_undegraded":"2024-04-25T09:01:54.096518+0000","last_fullsized":"2024-04-25T09:01:54.096518+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.202286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096881+0000","last_change":"2024-04-25T09:01:52.701340+0000","last_active":"2024-04-25T09:01:54.096881+0000","last_peered":"2024-04-25T09:01:54.096881+0000","last_clean":"2024-04-25T09:01:54.096881+0000","last_became_active":"2024-04-25T09:01:52.701041+0000","last_became_peered":"2024-04-25T09:01:52.701041+0000","last_unstale":"2024-04-25T09:01:54.096881+0000","last_undegraded":"2024-04-25T09:01:54.096881+0000","last_fullsized":"2024-04-25T09:01:54.096881+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:41.764193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"101'1","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.711941+0000","last_change":"2024-04-25T09:01:51.688495+0000","last_active":"2024-04-25T09:01:52.711941+0000","last_peered":"2024-04-25T09:01:52.711941+0000","last_clean":"2024-04-25T09:01:52.711941+0000","last_became_active":"2024-04-25T09:01:51.688257+0000","last_became_peered":"2024-04-25T09:01:51.688257+0000","last_unstale":"2024-04-25T09:01:52.711941+0000","last_undegraded":"2024-04-25T09:01:52.711941+0000","last_fullsized":"2024-04-25T09:01:52.711941+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.251208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":315,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.681527+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T09:01:52.681527+0000","last_peered":"2024-04-25T09:01:52.681527+0000","last_clean":"2024-04-25T09:01:52.681527+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:01:52.681527+0000","last_undegraded":"2024-04-25T09:01:52.681527+0000","last_fullsized":"2024-04-25T09:01:52.681527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509545,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1843200,"data_stored":1123951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509543,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1261568,"data_stored":540423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509545,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1245184,"data_stored":533541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":541507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":535105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509546,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1257472,"data_stored":539805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509544,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37140,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334700,"statfs":{"total":96636764160,"available":96598732800,"internally_reserved":0,"allocated":1839104,"data_stored":1124421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1216512,"data_stored":520421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:56.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2024-04-25T09:01:56.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:01:51.664131+0000', 'last_change': '2024-04-25T09:01:51.664131+0000', 'last_active': '2024-04-25T09:01:51.664131+0000', 'last_peered': '2024-04-25T09:01:51.664131+0000', 'last_clean': '2024-04-25T09:01:51.664131+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:51.664131+0000', 'last_undegraded': '2024-04-25T09:01:51.664131+0000', 'last_fullsized': '2024-04-25T09:01:51.664131+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:01:56.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2024-04-25T09:01:56.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:01:51.664131+0000', 'last_change': '2024-04-25T09:01:51.664131+0000', 'last_active': '2024-04-25T09:01:51.664131+0000', 'last_peered': '2024-04-25T09:01:51.664131+0000', 'last_clean': '2024-04-25T09:01:51.664131+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:51.664131+0000', 'last_undegraded': '2024-04-25T09:01:51.664131+0000', 'last_fullsized': '2024-04-25T09:01:51.664131+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:01:56.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2024-04-25T09:01:56.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:01:51.664131+0000', 'last_change': '2024-04-25T09:01:51.664131+0000', 'last_active': '2024-04-25T09:01:51.664131+0000', 'last_peered': '2024-04-25T09:01:51.664131+0000', 'last_clean': '2024-04-25T09:01:51.664131+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:51.664131+0000', 'last_undegraded': '2024-04-25T09:01:51.664131+0000', 'last_fullsized': '2024-04-25T09:01:51.664131+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:01:56.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2024-04-25T09:01:56.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:01:51.664131+0000', 'last_change': '2024-04-25T09:01:51.664131+0000', 'last_active': '2024-04-25T09:01:51.664131+0000', 'last_peered': '2024-04-25T09:01:51.664131+0000', 'last_clean': '2024-04-25T09:01:51.664131+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:51.664131+0000', 'last_undegraded': '2024-04-25T09:01:51.664131+0000', 'last_fullsized': '2024-04-25T09:01:51.664131+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:01:56.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2024-04-25T09:01:56.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:50.669518+0000', 'last_change': '2024-04-25T09:01:50.669518+0000', 'last_active': '2024-04-25T09:01:50.662241+0000', 'last_peered': '2024-04-25T09:01:50.662241+0000', 'last_clean': '2024-04-25T09:01:50.662241+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:50.669518+0000', 'last_undegraded': '2024-04-25T09:01:50.669518+0000', 'last_fullsized': '2024-04-25T09:01:50.669518+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:01:56.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2024-04-25T09:01:56.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:50.670967+0000', 'last_change': '2024-04-25T09:01:50.670967+0000', 'last_active': '2024-04-25T09:01:50.662241+0000', 'last_peered': '2024-04-25T09:01:50.662241+0000', 'last_clean': '2024-04-25T09:01:50.662241+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:50.670967+0000', 'last_undegraded': '2024-04-25T09:01:50.670967+0000', 'last_fullsized': '2024-04-25T09:01:50.670967+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:01:56.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2024-04-25T09:01:56.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:50.669543+0000', 'last_change': '2024-04-25T09:01:50.669543+0000', 'last_active': '2024-04-25T09:01:50.662241+0000', 'last_peered': '2024-04-25T09:01:50.662241+0000', 'last_clean': '2024-04-25T09:01:50.662241+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:50.669543+0000', 'last_undegraded': '2024-04-25T09:01:50.669543+0000', 'last_fullsized': '2024-04-25T09:01:50.669543+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:01:56.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2024-04-25T09:01:56.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:01:51.664131+0000', 'last_change': '2024-04-25T09:01:51.664131+0000', 'last_active': '2024-04-25T09:01:51.664131+0000', 'last_peered': '2024-04-25T09:01:51.664131+0000', 'last_clean': '2024-04-25T09:01:51.664131+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:51.664131+0000', 'last_undegraded': '2024-04-25T09:01:51.664131+0000', 'last_fullsized': '2024-04-25T09:01:51.664131+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:01:56.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2024-04-25T09:01:56.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 99, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:01:50.669500+0000', 'last_change': '2024-04-25T09:01:50.669500+0000', 'last_active': '2024-04-25T09:01:50.662241+0000', 'last_peered': '2024-04-25T09:01:50.662241+0000', 'last_clean': '2024-04-25T09:01:50.662241+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:50.669500+0000', 'last_undegraded': '2024-04-25T09:01:50.669500+0000', 'last_fullsized': '2024-04-25T09:01:50.669500+0000', 'mapping_epoch': 99, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 99, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:50.662241+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:01:56.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2024-04-25T09:01:56.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:01:51.664131+0000', 'last_change': '2024-04-25T09:01:51.664131+0000', 'last_active': '2024-04-25T09:01:51.664131+0000', 'last_peered': '2024-04-25T09:01:51.664131+0000', 'last_clean': '2024-04-25T09:01:51.664131+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:51.664131+0000', 'last_undegraded': '2024-04-25T09:01:51.664131+0000', 'last_fullsized': '2024-04-25T09:01:51.664131+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:01:56.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2024-04-25T09:01:56.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:01:51.664131+0000', 'last_change': '2024-04-25T09:01:51.664131+0000', 'last_active': '2024-04-25T09:01:51.664131+0000', 'last_peered': '2024-04-25T09:01:51.664131+0000', 'last_clean': '2024-04-25T09:01:51.664131+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:01:51.664131+0000', 'last_undegraded': '2024-04-25T09:01:51.664131+0000', 'last_fullsized': '2024-04-25T09:01:51.664131+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'last_clean_scrub_stamp': '2024-04-25T09:01:51.664131+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:01:56.813 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:01:56.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.958+0000 7fdc509fe640 1 Processor -- start 2024-04-25T09:01:56.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.958+0000 7fdc509fe640 1 -- start start 2024-04-25T09:01:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc509fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdc4c15dce0 0x7fdc4c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc509fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc4c0d35b0 0x7fdc4c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc509fe640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c15e0c0 con 0x7fdc4c0d1f90 2024-04-25T09:01:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc509fe640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c0b7b10 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc509fe640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c0d2510 con 0x7fdc4c15dce0 2024-04-25T09:01:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc49d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc4c0d35b0 0x7fdc4c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc4ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc4c0d1f90 0x7fdc4c06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39512/0 (socket says 172.21.15.55:39512) 2024-04-25T09:01:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc4ad9d640 1 -- 172.21.15.55:0/1512154012 learned_addr learned my addr 172.21.15.55:0/1512154012 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc4a59c640 1 --2- 172.21.15.55:0/1512154012 >> v2:172.21.15.167:3300/0 conn(0x7fdc4c15dce0 0x7fdc4c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc49d9b640 1 -- 172.21.15.55:0/1512154012 >> v2:172.21.15.167:3300/0 conn(0x7fdc4c15dce0 msgr2=0x7fdc4c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc49d9b640 1 --2- 172.21.15.55:0/1512154012 >> v2:172.21.15.167:3300/0 conn(0x7fdc4c15dce0 0x7fdc4c0d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc49d9b640 1 -- 172.21.15.55:0/1512154012 >> v1:172.21.15.55:6789/0 conn(0x7fdc4c0d1f90 legacy=0x7fdc4c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc4959a640 1 -- 172.21.15.55:0/1512154012 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329906582 0 0) 0x7fdc4c15e0c0 con 0x7fdc4c0d1f90 2024-04-25T09:01:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.959+0000 7fdc49d9b640 1 -- 172.21.15.55:0/1512154012 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c0d27f0 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.960+0000 7fdc49d9b640 1 --2- 172.21.15.55:0/1512154012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0d35b0 0x7fdc4c0b5450 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0ce220 tx=0x7fdc4002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66ff3faa63911f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.960+0000 7fdc4959a640 1 -- 172.21.15.55:0/1512154012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40037070 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.960+0000 7fdc4959a640 1 -- 172.21.15.55:0/1512154012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40032440 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.960+0000 7fdc4959a640 1 -- 172.21.15.55:0/1512154012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40032810 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.961+0000 7fdc509fe640 1 -- 172.21.15.55:0/1512154012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0d35b0 msgr2=0x7fdc4c0b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.961+0000 7fdc509fe640 1 --2- 172.21.15.55:0/1512154012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0d35b0 0x7fdc4c0b5450 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0ce220 tx=0x7fdc4002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.961+0000 7fdc509fe640 1 -- 172.21.15.55:0/1512154012 shutdown_connections 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.961+0000 7fdc509fe640 1 --2- 172.21.15.55:0/1512154012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0d35b0 0x7fdc4c0b5450 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.961+0000 7fdc509fe640 1 --2- 172.21.15.55:0/1512154012 >> v2:172.21.15.167:3300/0 conn(0x7fdc4c15dce0 0x7fdc4c0d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.961+0000 7fdc509fe640 1 -- 172.21.15.55:0/1512154012 >> 172.21.15.55:0/1512154012 conn(0x7fdc4c072900 msgr2=0x7fdc4c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.961+0000 7fdc509fe640 1 -- 172.21.15.55:0/1512154012 shutdown_connections 2024-04-25T09:01:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.961+0000 7fdc509fe640 1 -- 172.21.15.55:0/1512154012 wait complete. 2024-04-25T09:01:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.962+0000 7fdc509fe640 1 Processor -- start 2024-04-25T09:01:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.962+0000 7fdc509fe640 1 -- start start 2024-04-25T09:01:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc509fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc4c0d1f90 0x7fdc4c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc509fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0d35b0 0x7fdc4c156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc509fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc4c15dce0 0x7fdc4c1f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc509fe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0d3090 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc509fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0d2db0 con 0x7fdc4c15dce0 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc509fe640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0b9820 con 0x7fdc4c0d1f90 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc49d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0d35b0 0x7fdc4c156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc49d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0d35b0 0x7fdc4c156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50670/0 (socket says 172.21.15.55:50670) 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc49d9b640 1 -- 172.21.15.55:0/2006955533 learned_addr learned my addr 172.21.15.55:0/2006955533 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc4ad9d640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc4c15dce0 0x7fdc4c1f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc4a59c640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc4c0d1f90 0x7fdc4c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc49d9b640 1 -- 172.21.15.55:0/2006955533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc4c0d1f90 msgr2=0x7fdc4c1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc49d9b640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc4c0d1f90 0x7fdc4c1540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc49d9b640 1 -- 172.21.15.55:0/2006955533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc4c15dce0 msgr2=0x7fdc4c1f04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc49d9b640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc4c15dce0 0x7fdc4c1f04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc49d9b640 1 -- 172.21.15.55:0/2006955533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c0cc970 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc4a59c640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc4c0d1f90 0x7fdc4c1540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.963+0000 7fdc4ad9d640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc4c15dce0 0x7fdc4c1f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.964+0000 7fdc49d9b640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0d35b0 0x7fdc4c156500 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fdc40035040 tx=0x7fdc400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.964+0000 7fdc3affd640 1 -- 172.21.15.55:0/2006955533 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40037050 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.964+0000 7fdc3affd640 1 -- 172.21.15.55:0/2006955533 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40038040 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.964+0000 7fdc509fe640 1 -- 172.21.15.55:0/2006955533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c0ccc50 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.964+0000 7fdc3affd640 1 -- 172.21.15.55:0/2006955533 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40004470 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.964+0000 7fdc509fe640 1 -- 172.21.15.55:0/2006955533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c0cd210 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.965+0000 7fdc509fe640 1 -- 172.21.15.55:0/2006955533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4c0749b0 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.965+0000 7fdc3affd640 1 -- 172.21.15.55:0/2006955533 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdc40030900 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.966+0000 7fdc3affd640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b4d0 0x7fdc2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.966+0000 7fdc3affd640 1 -- 172.21.15.55:0/2006955533 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc400aace0 con 0x7fdc4c0d35b0 2024-04-25T09:01:56.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.966+0000 7fdc4a59c640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b4d0 0x7fdc2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.966+0000 7fdc4a59c640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b4d0 0x7fdc2c06d990 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c006fd0 tx=0x7fdc3c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:56.970+0000 7fdc3affd640 1 -- 172.21.15.55:0/2006955533 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdc40079b60 con 0x7fdc4c0d35b0 2024-04-25T09:01:57.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.228+0000 7fdc509fe640 1 -- 172.21.15.55:0/2006955533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdc4c06b080 con 0x7fdc4c0d35b0 2024-04-25T09:01:57.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.228+0000 7fdc3affd640 1 -- 172.21.15.55:0/2006955533 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1338 (secure 0 0 0) 0x7fdc40079460 con 0x7fdc4c0d35b0 2024-04-25T09:01:57.217 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:57.217 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":518,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":102,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035209,"num_in_osds":8,"osd_in_since":1714035200,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":86},{"state_name":"unknown","count":7},{"state_name":"creating+peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592778,"bytes_used":270905344,"bytes_avail":772823207936,"bytes_total":773094113280,"unknown_pgs_ratio":0.072164945304393768,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":2389,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":72,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8244}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-04-25T09:01:20.656400+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:01:57.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 -- 172.21.15.55:0/2006955533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b4d0 msgr2=0x7fdc2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b4d0 0x7fdc2c06d990 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c006fd0 tx=0x7fdc3c008040 comp rx=0 tx=0).stop 2024-04-25T09:01:57.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 -- 172.21.15.55:0/2006955533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0d35b0 msgr2=0x7fdc4c156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0d35b0 0x7fdc4c156500 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fdc40035040 tx=0x7fdc400046c0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 -- 172.21.15.55:0/2006955533 shutdown_connections 2024-04-25T09:01:57.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2c06b4d0 0x7fdc2c06d990 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc4c15dce0 0x7fdc4c1f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0d35b0 0x7fdc4c156500 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 --2- 172.21.15.55:0/2006955533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc4c0d1f90 0x7fdc4c1540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 -- 172.21.15.55:0/2006955533 >> 172.21.15.55:0/2006955533 conn(0x7fdc4c072900 msgr2=0x7fdc4c0b8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:57.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 -- 172.21.15.55:0/2006955533 shutdown_connections 2024-04-25T09:01:57.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.230+0000 7fdc509fe640 1 -- 172.21.15.55:0/2006955533 wait complete. 2024-04-25T09:01:57.230 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:01:57.231 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:57.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.343+0000 7f74cc5c8640 1 Processor -- start 2024-04-25T09:01:57.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.343+0000 7f74cc5c8640 1 -- start start 2024-04-25T09:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.344+0000 7f74cc5c8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f74c415dce0 0x7f74c40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.344+0000 7f74cc5c8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c415e0c0 con 0x7f74c40b5b60 2024-04-25T09:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.344+0000 7f74cc5c8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c40d2510 con 0x7f74c40d35b0 2024-04-25T09:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.344+0000 7f74cc5c8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c40d27f0 con 0x7f74c415dce0 2024-04-25T09:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.344+0000 7f74ca364640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f74c415dce0 0x7f74c40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.344+0000 7f74cab65640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f74c40b5b60 0x7f74c40b6b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39520/0 (socket says 172.21.15.55:39520) 2024-04-25T09:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.344+0000 7f74cab65640 1 -- 172.21.15.55:0/3419625815 learned_addr learned my addr 172.21.15.55:0/3419625815 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.344+0000 7f74ca364640 1 -- 172.21.15.55:0/3419625815 >> v1:172.21.15.167:6789/0 conn(0x7f74c40d35b0 legacy=0x7f74c40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.344+0000 7f74ca364640 1 -- 172.21.15.55:0/3419625815 >> v1:172.21.15.55:6789/0 conn(0x7f74c40b5b60 legacy=0x7f74c40b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.344+0000 7f74ca364640 1 -- 172.21.15.55:0/3419625815 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c40d2ad0 con 0x7f74c415dce0 2024-04-25T09:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.345+0000 7f74ca364640 1 --2- 172.21.15.55:0/3419625815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c415dce0 0x7f74c40d1a50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f74c00097a0 tx=0x7f74c002a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ee6c081636b0e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.345+0000 7f74c9362640 1 -- 172.21.15.55:0/3419625815 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0037070 con 0x7f74c415dce0 2024-04-25T09:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.345+0000 7f74c9362640 1 -- 172.21.15.55:0/3419625815 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c002ad60 con 0x7f74c415dce0 2024-04-25T09:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.345+0000 7f74c9362640 1 -- 172.21.15.55:0/3419625815 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0032660 con 0x7f74c415dce0 2024-04-25T09:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.345+0000 7f74cc5c8640 1 -- 172.21.15.55:0/3419625815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c415dce0 msgr2=0x7f74c40d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.346+0000 7f74cc5c8640 1 --2- 172.21.15.55:0/3419625815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c415dce0 0x7f74c40d1a50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f74c00097a0 tx=0x7f74c002a0d0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.346+0000 7f74cc5c8640 1 -- 172.21.15.55:0/3419625815 shutdown_connections 2024-04-25T09:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.346+0000 7f74cc5c8640 1 --2- 172.21.15.55:0/3419625815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c415dce0 0x7f74c40d1a50 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.346+0000 7f74cc5c8640 1 -- 172.21.15.55:0/3419625815 >> 172.21.15.55:0/3419625815 conn(0x7f74c4072900 msgr2=0x7f74c40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.346+0000 7f74cc5c8640 1 -- 172.21.15.55:0/3419625815 shutdown_connections 2024-04-25T09:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.346+0000 7f74cc5c8640 1 -- 172.21.15.55:0/3419625815 wait complete. 2024-04-25T09:01:57.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.347+0000 7f74cc5c8640 1 Processor -- start 2024-04-25T09:01:57.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.347+0000 7f74cc5c8640 1 -- start start 2024-04-25T09:01:57.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cc5c8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74c40b5b60 0x7f74c414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cc5c8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74c40d35b0 0x7f74c41552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cc5c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c415dce0 0x7f74c40c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cc5c8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40b9820 con 0x7f74c415dce0 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cc5c8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40d3090 con 0x7f74c40d35b0 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cc5c8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40b99a0 con 0x7f74c40b5b60 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cab65640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c415dce0 0x7f74c40c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cab65640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c415dce0 0x7f74c40c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50700/0 (socket says 172.21.15.55:50700) 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cab65640 1 -- 172.21.15.55:0/2249877419 learned_addr learned my addr 172.21.15.55:0/2249877419 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74ca364640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74c40b5b60 0x7f74c414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74c9b63640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74c40d35b0 0x7f74c41552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cab65640 1 -- 172.21.15.55:0/2249877419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74c40b5b60 msgr2=0x7f74c414dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cab65640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74c40b5b60 0x7f74c414dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cab65640 1 -- 172.21.15.55:0/2249877419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74c40d35b0 msgr2=0x7f74c41552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cab65640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74c40d35b0 0x7f74c41552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cab65640 1 -- 172.21.15.55:0/2249877419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c4155bd0 con 0x7f74c415dce0 2024-04-25T09:01:57.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74cab65640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c415dce0 0x7f74c40c7500 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00caf0 tx=0x7f74bc0020b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.348+0000 7f74baffd640 1 -- 172.21.15.55:0/2249877419 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc018070 con 0x7f74c415dce0 2024-04-25T09:01:57.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.349+0000 7f74baffd640 1 -- 172.21.15.55:0/2249877419 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc00a6e0 con 0x7f74c415dce0 2024-04-25T09:01:57.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.349+0000 7f74baffd640 1 -- 172.21.15.55:0/2249877419 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc00ab10 con 0x7f74c415dce0 2024-04-25T09:01:57.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.349+0000 7f74cc5c8640 1 -- 172.21.15.55:0/2249877419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c4155eb0 con 0x7f74c415dce0 2024-04-25T09:01:57.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.349+0000 7f74cc5c8640 1 -- 172.21.15.55:0/2249877419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c4156750 con 0x7f74c415dce0 2024-04-25T09:01:57.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.350+0000 7f74cc5c8640 1 -- 172.21.15.55:0/2249877419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c40749b0 con 0x7f74c415dce0 2024-04-25T09:01:57.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.350+0000 7f74baffd640 1 -- 172.21.15.55:0/2249877419 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f74bc01b070 con 0x7f74c415dce0 2024-04-25T09:01:57.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.350+0000 7f74baffd640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f74a806b4d0 0x7f74a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.350+0000 7f74baffd640 1 -- 172.21.15.55:0/2249877419 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74bc0898f0 con 0x7f74c415dce0 2024-04-25T09:01:57.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.350+0000 7f74ca364640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f74a806b4d0 0x7f74a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.351+0000 7f74ca364640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f74a806b4d0 0x7f74a806d990 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f74c0034000 tx=0x7f74c002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.355+0000 7f74baffd640 1 -- 172.21.15.55:0/2249877419 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74bc0581b0 con 0x7f74c415dce0 2024-04-25T09:01:57.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.531+0000 7f74cc5c8640 1 -- 172.21.15.55:0/2249877419 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74c4156920 con 0x7f74a806b4d0 2024-04-25T09:01:57.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.537+0000 7f74baffd640 1 -- 172.21.15.55:0/2249877419 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251005 (secure 0 0 0) 0x7f74c4156920 con 0x7f74a806b4d0 2024-04-25T09:01:57.528 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:01:57.529 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 -- 172.21.15.55:0/2249877419 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f74a806b4d0 msgr2=0x7f74a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f74a806b4d0 0x7f74a806d990 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f74c0034000 tx=0x7f74c002e000 comp rx=0 tx=0).stop 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 -- 172.21.15.55:0/2249877419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c415dce0 msgr2=0x7f74c40c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c415dce0 0x7f74c40c7500 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00caf0 tx=0x7f74bc0020b0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 -- 172.21.15.55:0/2249877419 shutdown_connections 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f74a806b4d0 0x7f74a806d990 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c415dce0 0x7f74c40c7500 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74c40d35b0 0x7f74c41552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 --2- 172.21.15.55:0/2249877419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74c40b5b60 0x7f74c414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 -- 172.21.15.55:0/2249877419 >> 172.21.15.55:0/2249877419 conn(0x7f74c4072900 msgr2=0x7f74c40ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 -- 172.21.15.55:0/2249877419 shutdown_connections 2024-04-25T09:01:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:01:57.540+0000 7f74cc5c8640 1 -- 172.21.15.55:0/2249877419 wait complete. 2024-04-25T09:01:57.539 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-04-25T09:01:56.664015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264556,"kb_used_data":10932,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754710164,"statfs":{"total":773094113280,"available":772823207936,"internally_reserved":0,"allocated":11194368,"data_stored":5459174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.999143"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605006+0000","last_change":"2024-04-25T09:01:52.711487+0000","last_active":"2024-04-25T09:01:54.605006+0000","last_peered":"2024-04-25T09:01:54.605006+0000","last_clean":"2024-04-25T09:01:54.605006+0000","last_became_active":"2024-04-25T09:01:52.711106+0000","last_became_peered":"2024-04-25T09:01:52.711106+0000","last_unstale":"2024-04-25T09:01:54.605006+0000","last_undegraded":"2024-04-25T09:01:54.605006+0000","last_fullsized":"2024-04-25T09:01:54.605006+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:32.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.706107+0000","last_change":"2024-04-25T09:01:52.703003+0000","last_active":"2024-04-25T09:01:52.706107+0000","last_peered":"2024-04-25T09:01:52.706107+0000","last_clean":"2024-04-25T09:01:52.706107+0000","last_became_active":"2024-04-25T09:01:52.702715+0000","last_became_peered":"2024-04-25T09:01:52.702715+0000","last_unstale":"2024-04-25T09:01:52.706107+0000","last_undegraded":"2024-04-25T09:01:52.706107+0000","last_fullsized":"2024-04-25T09:01:52.706107+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693556+0000","last_change":"2024-04-25T09:01:52.688278+0000","last_active":"2024-04-25T09:01:53.693556+0000","last_peered":"2024-04-25T09:01:53.693556+0000","last_clean":"2024-04-25T09:01:53.693556+0000","last_became_active":"2024-04-25T09:01:52.687945+0000","last_became_peered":"2024-04-25T09:01:52.687945+0000","last_unstale":"2024-04-25T09:01:53.693556+0000","last_undegraded":"2024-04-25T09:01:53.693556+0000","last_fullsized":"2024-04-25T09:01:53.693556+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.701481+0000","last_change":"2024-04-25T09:01:52.698724+0000","last_active":"2024-04-25T09:01:52.701481+0000","last_peered":"2024-04-25T09:01:52.701481+0000","last_clean":"2024-04-25T09:01:52.701481+0000","last_became_active":"2024-04-25T09:01:52.698461+0000","last_became_peered":"2024-04-25T09:01:52.698461+0000","last_unstale":"2024-04-25T09:01:52.701481+0000","last_undegraded":"2024-04-25T09:01:52.701481+0000","last_fullsized":"2024-04-25T09:01:52.701481+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.701179+0000","last_change":"2024-04-25T09:01:52.697957+0000","last_active":"2024-04-25T09:01:52.701179+0000","last_peered":"2024-04-25T09:01:52.701179+0000","last_clean":"2024-04-25T09:01:52.701179+0000","last_became_active":"2024-04-25T09:01:52.697697+0000","last_became_peered":"2024-04-25T09:01:52.697697+0000","last_unstale":"2024-04-25T09:01:52.701179+0000","last_undegraded":"2024-04-25T09:01:52.701179+0000","last_fullsized":"2024-04-25T09:01:52.701179+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604905+0000","last_change":"2024-04-25T09:01:52.710111+0000","last_active":"2024-04-25T09:01:54.604905+0000","last_peered":"2024-04-25T09:01:54.604905+0000","last_clean":"2024-04-25T09:01:54.604905+0000","last_became_active":"2024-04-25T09:01:52.709135+0000","last_became_peered":"2024-04-25T09:01:52.709135+0000","last_unstale":"2024-04-25T09:01:54.604905+0000","last_undegraded":"2024-04-25T09:01:54.604905+0000","last_fullsized":"2024-04-25T09:01:54.604905+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:05.158708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693398+0000","last_change":"2024-04-25T09:01:52.696335+0000","last_active":"2024-04-25T09:01:53.693398+0000","last_peered":"2024-04-25T09:01:53.693398+0000","last_clean":"2024-04-25T09:01:53.693398+0000","last_became_active":"2024-04-25T09:01:52.695444+0000","last_became_peered":"2024-04-25T09:01:52.695444+0000","last_unstale":"2024-04-25T09:01:53.693398+0000","last_undegraded":"2024-04-25T09:01:53.693398+0000","last_fullsized":"2024-04-25T09:01:53.693398+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:49.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692801+0000","last_change":"2024-04-25T09:01:52.700383+0000","last_active":"2024-04-25T09:01:53.692801+0000","last_peered":"2024-04-25T09:01:53.692801+0000","last_clean":"2024-04-25T09:01:53.692801+0000","last_became_active":"2024-04-25T09:01:52.700110+0000","last_became_peered":"2024-04-25T09:01:52.700110+0000","last_unstale":"2024-04-25T09:01:53.692801+0000","last_undegraded":"2024-04-25T09:01:53.692801+0000","last_fullsized":"2024-04-25T09:01:53.692801+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.700399+0000","last_change":"2024-04-25T09:01:52.694747+0000","last_active":"2024-04-25T09:01:52.700399+0000","last_peered":"2024-04-25T09:01:52.700399+0000","last_clean":"2024-04-25T09:01:52.700399+0000","last_became_active":"2024-04-25T09:01:52.694333+0000","last_became_peered":"2024-04-25T09:01:52.694333+0000","last_unstale":"2024-04-25T09:01:52.700399+0000","last_undegraded":"2024-04-25T09:01:52.700399+0000","last_fullsized":"2024-04-25T09:01:52.700399+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:28.487975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692551+0000","last_change":"2024-04-25T09:01:52.703084+0000","last_active":"2024-04-25T09:01:53.692551+0000","last_peered":"2024-04-25T09:01:53.692551+0000","last_clean":"2024-04-25T09:01:53.692551+0000","last_became_active":"2024-04-25T09:01:52.702483+0000","last_became_peered":"2024-04-25T09:01:52.702483+0000","last_unstale":"2024-04-25T09:01:53.692551+0000","last_undegraded":"2024-04-25T09:01:53.692551+0000","last_fullsized":"2024-04-25T09:01:53.692551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696269+0000","last_change":"2024-04-25T09:01:52.694341+0000","last_active":"2024-04-25T09:01:52.696269+0000","last_peered":"2024-04-25T09:01:52.696269+0000","last_clean":"2024-04-25T09:01:52.696269+0000","last_became_active":"2024-04-25T09:01:52.694029+0000","last_became_peered":"2024-04-25T09:01:52.694029+0000","last_unstale":"2024-04-25T09:01:52.696269+0000","last_undegraded":"2024-04-25T09:01:52.696269+0000","last_fullsized":"2024-04-25T09:01:52.696269+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096514+0000","last_change":"2024-04-25T09:01:52.706665+0000","last_active":"2024-04-25T09:01:54.096514+0000","last_peered":"2024-04-25T09:01:54.096514+0000","last_clean":"2024-04-25T09:01:54.096514+0000","last_became_active":"2024-04-25T09:01:52.705279+0000","last_became_peered":"2024-04-25T09:01:52.705279+0000","last_unstale":"2024-04-25T09:01:54.096514+0000","last_undegraded":"2024-04-25T09:01:54.096514+0000","last_fullsized":"2024-04-25T09:01:54.096514+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:36.665698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.704780+0000","last_change":"2024-04-25T09:01:52.700645+0000","last_active":"2024-04-25T09:01:52.704780+0000","last_peered":"2024-04-25T09:01:52.704780+0000","last_clean":"2024-04-25T09:01:52.704780+0000","last_became_active":"2024-04-25T09:01:52.700098+0000","last_became_peered":"2024-04-25T09:01:52.700098+0000","last_unstale":"2024-04-25T09:01:52.704780+0000","last_undegraded":"2024-04-25T09:01:52.704780+0000","last_fullsized":"2024-04-25T09:01:52.704780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.714559+0000","last_change":"2024-04-25T09:01:52.710044+0000","last_active":"2024-04-25T09:01:52.714559+0000","last_peered":"2024-04-25T09:01:52.714559+0000","last_clean":"2024-04-25T09:01:52.714559+0000","last_became_active":"2024-04-25T09:01:52.709788+0000","last_became_peered":"2024-04-25T09:01:52.709788+0000","last_unstale":"2024-04-25T09:01:52.714559+0000","last_undegraded":"2024-04-25T09:01:52.714559+0000","last_fullsized":"2024-04-25T09:01:52.714559+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605210+0000","last_change":"2024-04-25T09:01:52.710102+0000","last_active":"2024-04-25T09:01:54.605210+0000","last_peered":"2024-04-25T09:01:54.605210+0000","last_clean":"2024-04-25T09:01:54.605210+0000","last_became_active":"2024-04-25T09:01:52.709465+0000","last_became_peered":"2024-04-25T09:01:52.709465+0000","last_unstale":"2024-04-25T09:01:54.605210+0000","last_undegraded":"2024-04-25T09:01:54.605210+0000","last_fullsized":"2024-04-25T09:01:54.605210+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:52.724558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.706341+0000","last_change":"2024-04-25T09:01:52.703474+0000","last_active":"2024-04-25T09:01:52.706341+0000","last_peered":"2024-04-25T09:01:52.706341+0000","last_clean":"2024-04-25T09:01:52.706341+0000","last_became_active":"2024-04-25T09:01:52.703179+0000","last_became_peered":"2024-04-25T09:01:52.703179+0000","last_unstale":"2024-04-25T09:01:52.706341+0000","last_undegraded":"2024-04-25T09:01:52.706341+0000","last_fullsized":"2024-04-25T09:01:52.706341+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096859+0000","last_change":"2024-04-25T09:01:52.706050+0000","last_active":"2024-04-25T09:01:54.096859+0000","last_peered":"2024-04-25T09:01:54.096859+0000","last_clean":"2024-04-25T09:01:54.096859+0000","last_became_active":"2024-04-25T09:01:52.704879+0000","last_became_peered":"2024-04-25T09:01:52.704879+0000","last_unstale":"2024-04-25T09:01:54.096859+0000","last_undegraded":"2024-04-25T09:01:54.096859+0000","last_fullsized":"2024-04-25T09:01:54.096859+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:33.129014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692717+0000","last_change":"2024-04-25T09:01:52.697576+0000","last_active":"2024-04-25T09:01:53.692717+0000","last_peered":"2024-04-25T09:01:53.692717+0000","last_clean":"2024-04-25T09:01:53.692717+0000","last_became_active":"2024-04-25T09:01:52.697260+0000","last_became_peered":"2024-04-25T09:01:52.697260+0000","last_unstale":"2024-04-25T09:01:53.692717+0000","last_undegraded":"2024-04-25T09:01:53.692717+0000","last_fullsized":"2024-04-25T09:01:53.692717+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096580+0000","last_change":"2024-04-25T09:01:52.702251+0000","last_active":"2024-04-25T09:01:54.096580+0000","last_peered":"2024-04-25T09:01:54.096580+0000","last_clean":"2024-04-25T09:01:54.096580+0000","last_became_active":"2024-04-25T09:01:52.701967+0000","last_became_peered":"2024-04-25T09:01:52.701967+0000","last_unstale":"2024-04-25T09:01:54.096580+0000","last_undegraded":"2024-04-25T09:01:54.096580+0000","last_fullsized":"2024-04-25T09:01:54.096580+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:53.310405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604901+0000","last_change":"2024-04-25T09:01:52.708781+0000","last_active":"2024-04-25T09:01:54.604901+0000","last_peered":"2024-04-25T09:01:54.604901+0000","last_clean":"2024-04-25T09:01:54.604901+0000","last_became_active":"2024-04-25T09:01:52.708504+0000","last_became_peered":"2024-04-25T09:01:52.708504+0000","last_unstale":"2024-04-25T09:01:54.604901+0000","last_undegraded":"2024-04-25T09:01:54.604901+0000","last_fullsized":"2024-04-25T09:01:54.604901+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:17.745375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604880+0000","last_change":"2024-04-25T09:01:52.708786+0000","last_active":"2024-04-25T09:01:54.604880+0000","last_peered":"2024-04-25T09:01:54.604880+0000","last_clean":"2024-04-25T09:01:54.604880+0000","last_became_active":"2024-04-25T09:01:52.708444+0000","last_became_peered":"2024-04-25T09:01:52.708444+0000","last_unstale":"2024-04-25T09:01:54.604880+0000","last_undegraded":"2024-04-25T09:01:54.604880+0000","last_fullsized":"2024-04-25T09:01:54.604880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:55.403342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.701785+0000","last_change":"2024-04-25T09:01:52.696131+0000","last_active":"2024-04-25T09:01:52.701785+0000","last_peered":"2024-04-25T09:01:52.701785+0000","last_clean":"2024-04-25T09:01:52.701785+0000","last_became_active":"2024-04-25T09:01:52.695841+0000","last_became_peered":"2024-04-25T09:01:52.695841+0000","last_unstale":"2024-04-25T09:01:52.701785+0000","last_undegraded":"2024-04-25T09:01:52.701785+0000","last_fullsized":"2024-04-25T09:01:52.701785+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:36.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693641+0000","last_change":"2024-04-25T09:01:52.712343+0000","last_active":"2024-04-25T09:01:53.693641+0000","last_peered":"2024-04-25T09:01:53.693641+0000","last_clean":"2024-04-25T09:01:53.693641+0000","last_became_active":"2024-04-25T09:01:52.712042+0000","last_became_peered":"2024-04-25T09:01:52.712042+0000","last_unstale":"2024-04-25T09:01:53.693641+0000","last_undegraded":"2024-04-25T09:01:53.693641+0000","last_fullsized":"2024-04-25T09:01:53.693641+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:08.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605249+0000","last_change":"2024-04-25T09:01:52.713137+0000","last_active":"2024-04-25T09:01:54.605249+0000","last_peered":"2024-04-25T09:01:54.605249+0000","last_clean":"2024-04-25T09:01:54.605249+0000","last_became_active":"2024-04-25T09:01:52.711889+0000","last_became_peered":"2024-04-25T09:01:52.711889+0000","last_unstale":"2024-04-25T09:01:54.605249+0000","last_undegraded":"2024-04-25T09:01:54.605249+0000","last_fullsized":"2024-04-25T09:01:54.605249+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:00.395210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.708388+0000","last_change":"2024-04-25T09:01:52.703603+0000","last_active":"2024-04-25T09:01:52.708388+0000","last_peered":"2024-04-25T09:01:52.708388+0000","last_clean":"2024-04-25T09:01:52.708388+0000","last_became_active":"2024-04-25T09:01:52.702267+0000","last_became_peered":"2024-04-25T09:01:52.702267+0000","last_unstale":"2024-04-25T09:01:52.708388+0000","last_undegraded":"2024-04-25T09:01:52.708388+0000","last_fullsized":"2024-04-25T09:01:52.708388+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693635+0000","last_change":"2024-04-25T09:01:52.691453+0000","last_active":"2024-04-25T09:01:53.693635+0000","last_peered":"2024-04-25T09:01:53.693635+0000","last_clean":"2024-04-25T09:01:53.693635+0000","last_became_active":"2024-04-25T09:01:52.691156+0000","last_became_peered":"2024-04-25T09:01:52.691156+0000","last_unstale":"2024-04-25T09:01:53.693635+0000","last_undegraded":"2024-04-25T09:01:53.693635+0000","last_fullsized":"2024-04-25T09:01:53.693635+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:49.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604880+0000","last_change":"2024-04-25T09:01:52.711904+0000","last_active":"2024-04-25T09:01:54.604880+0000","last_peered":"2024-04-25T09:01:54.604880+0000","last_clean":"2024-04-25T09:01:54.604880+0000","last_became_active":"2024-04-25T09:01:52.711585+0000","last_became_peered":"2024-04-25T09:01:52.711585+0000","last_unstale":"2024-04-25T09:01:54.604880+0000","last_undegraded":"2024-04-25T09:01:54.604880+0000","last_fullsized":"2024-04-25T09:01:54.604880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:33.292042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096430+0000","last_change":"2024-04-25T09:01:52.706947+0000","last_active":"2024-04-25T09:01:54.096430+0000","last_peered":"2024-04-25T09:01:54.096430+0000","last_clean":"2024-04-25T09:01:54.096430+0000","last_became_active":"2024-04-25T09:01:52.706404+0000","last_became_peered":"2024-04-25T09:01:52.706404+0000","last_unstale":"2024-04-25T09:01:54.096430+0000","last_undegraded":"2024-04-25T09:01:54.096430+0000","last_fullsized":"2024-04-25T09:01:54.096430+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:29.478809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696017+0000","last_change":"2024-04-25T09:01:52.688618+0000","last_active":"2024-04-25T09:01:52.696017+0000","last_peered":"2024-04-25T09:01:52.696017+0000","last_clean":"2024-04-25T09:01:52.696017+0000","last_became_active":"2024-04-25T09:01:52.688240+0000","last_became_peered":"2024-04-25T09:01:52.688240+0000","last_unstale":"2024-04-25T09:01:52.696017+0000","last_undegraded":"2024-04-25T09:01:52.696017+0000","last_fullsized":"2024-04-25T09:01:52.696017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:39.551479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096874+0000","last_change":"2024-04-25T09:01:52.704798+0000","last_active":"2024-04-25T09:01:54.096874+0000","last_peered":"2024-04-25T09:01:54.096874+0000","last_clean":"2024-04-25T09:01:54.096874+0000","last_became_active":"2024-04-25T09:01:52.702861+0000","last_became_peered":"2024-04-25T09:01:52.702861+0000","last_unstale":"2024-04-25T09:01:54.096874+0000","last_undegraded":"2024-04-25T09:01:54.096874+0000","last_fullsized":"2024-04-25T09:01:54.096874+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:55.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"101'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605302+0000","last_change":"2024-04-25T09:01:51.692270+0000","last_active":"2024-04-25T09:01:54.605302+0000","last_peered":"2024-04-25T09:01:54.605302+0000","last_clean":"2024-04-25T09:01:54.605302+0000","last_became_active":"2024-04-25T09:01:51.691955+0000","last_became_peered":"2024-04-25T09:01:51.691955+0000","last_unstale":"2024-04-25T09:01:54.605302+0000","last_undegraded":"2024-04-25T09:01:54.605302+0000","last_fullsized":"2024-04-25T09:01:54.605302+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:54.059043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696317+0000","last_change":"2024-04-25T09:01:52.691603+0000","last_active":"2024-04-25T09:01:52.696317+0000","last_peered":"2024-04-25T09:01:52.696317+0000","last_clean":"2024-04-25T09:01:52.696317+0000","last_became_active":"2024-04-25T09:01:52.691238+0000","last_became_peered":"2024-04-25T09:01:52.691238+0000","last_unstale":"2024-04-25T09:01:52.696317+0000","last_undegraded":"2024-04-25T09:01:52.696317+0000","last_fullsized":"2024-04-25T09:01:52.696317+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:36.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"101'1","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.713225+0000","last_change":"2024-04-25T09:01:51.689370+0000","last_active":"2024-04-25T09:01:52.713225+0000","last_peered":"2024-04-25T09:01:52.713225+0000","last_clean":"2024-04-25T09:01:52.713225+0000","last_became_active":"2024-04-25T09:01:51.689015+0000","last_became_peered":"2024-04-25T09:01:51.689015+0000","last_unstale":"2024-04-25T09:01:52.713225+0000","last_undegraded":"2024-04-25T09:01:52.713225+0000","last_fullsized":"2024-04-25T09:01:52.713225+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:53.114164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605116+0000","last_change":"2024-04-25T09:01:51.688848+0000","last_active":"2024-04-25T09:01:54.605116+0000","last_peered":"2024-04-25T09:01:54.605116+0000","last_clean":"2024-04-25T09:01:54.605116+0000","last_became_active":"2024-04-25T09:01:51.687975+0000","last_became_peered":"2024-04-25T09:01:51.687975+0000","last_unstale":"2024-04-25T09:01:54.605116+0000","last_undegraded":"2024-04-25T09:01:54.605116+0000","last_fullsized":"2024-04-25T09:01:54.605116+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:38.549589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693222+0000","last_change":"2024-04-25T09:01:52.701156+0000","last_active":"2024-04-25T09:01:53.693222+0000","last_peered":"2024-04-25T09:01:53.693222+0000","last_clean":"2024-04-25T09:01:53.693222+0000","last_became_active":"2024-04-25T09:01:52.700622+0000","last_became_peered":"2024-04-25T09:01:52.700622+0000","last_unstale":"2024-04-25T09:01:53.693222+0000","last_undegraded":"2024-04-25T09:01:53.693222+0000","last_fullsized":"2024-04-25T09:01:53.693222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604953+0000","last_change":"2024-04-25T09:01:51.692632+0000","last_active":"2024-04-25T09:01:54.604953+0000","last_peered":"2024-04-25T09:01:54.604953+0000","last_clean":"2024-04-25T09:01:54.604953+0000","last_became_active":"2024-04-25T09:01:51.691884+0000","last_became_peered":"2024-04-25T09:01:51.691884+0000","last_unstale":"2024-04-25T09:01:54.604953+0000","last_undegraded":"2024-04-25T09:01:54.604953+0000","last_fullsized":"2024-04-25T09:01:54.604953+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:31.350305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.705807+0000","last_change":"2024-04-25T09:01:52.703085+0000","last_active":"2024-04-25T09:01:52.705807+0000","last_peered":"2024-04-25T09:01:52.705807+0000","last_clean":"2024-04-25T09:01:52.705807+0000","last_became_active":"2024-04-25T09:01:52.702124+0000","last_became_peered":"2024-04-25T09:01:52.702124+0000","last_unstale":"2024-04-25T09:01:52.705807+0000","last_undegraded":"2024-04-25T09:01:52.705807+0000","last_fullsized":"2024-04-25T09:01:52.705807+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:46.900633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669518+0000","last_change":"2024-04-25T09:01:50.669518+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669518+0000","last_undegraded":"2024-04-25T09:01:50.669518+0000","last_fullsized":"2024-04-25T09:01:50.669518+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.691771+0000","last_change":"2024-04-25T09:01:52.688524+0000","last_active":"2024-04-25T09:01:52.691771+0000","last_peered":"2024-04-25T09:01:52.691771+0000","last_clean":"2024-04-25T09:01:52.691771+0000","last_became_active":"2024-04-25T09:01:52.688222+0000","last_became_peered":"2024-04-25T09:01:52.688222+0000","last_unstale":"2024-04-25T09:01:52.691771+0000","last_undegraded":"2024-04-25T09:01:52.691771+0000","last_fullsized":"2024-04-25T09:01:52.691771+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:55.060933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604965+0000","last_change":"2024-04-25T09:01:51.689748+0000","last_active":"2024-04-25T09:01:54.604965+0000","last_peered":"2024-04-25T09:01:54.604965+0000","last_clean":"2024-04-25T09:01:54.604965+0000","last_became_active":"2024-04-25T09:01:51.689480+0000","last_became_peered":"2024-04-25T09:01:51.689480+0000","last_unstale":"2024-04-25T09:01:54.604965+0000","last_undegraded":"2024-04-25T09:01:54.604965+0000","last_fullsized":"2024-04-25T09:01:54.604965+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.251208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.702683+0000","last_change":"2024-04-25T09:01:52.696412+0000","last_active":"2024-04-25T09:01:52.702683+0000","last_peered":"2024-04-25T09:01:52.702683+0000","last_clean":"2024-04-25T09:01:52.702683+0000","last_became_active":"2024-04-25T09:01:52.695363+0000","last_became_peered":"2024-04-25T09:01:52.695363+0000","last_unstale":"2024-04-25T09:01:52.702683+0000","last_undegraded":"2024-04-25T09:01:52.702683+0000","last_fullsized":"2024-04-25T09:01:52.702683+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692595+0000","last_change":"2024-04-25T09:01:51.692656+0000","last_active":"2024-04-25T09:01:53.692595+0000","last_peered":"2024-04-25T09:01:53.692595+0000","last_clean":"2024-04-25T09:01:53.692595+0000","last_became_active":"2024-04-25T09:01:51.692312+0000","last_became_peered":"2024-04-25T09:01:51.692312+0000","last_unstale":"2024-04-25T09:01:53.692595+0000","last_undegraded":"2024-04-25T09:01:53.692595+0000","last_fullsized":"2024-04-25T09:01:53.692595+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:25.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692262+0000","last_change":"2024-04-25T09:01:52.699187+0000","last_active":"2024-04-25T09:01:53.692262+0000","last_peered":"2024-04-25T09:01:53.692262+0000","last_clean":"2024-04-25T09:01:53.692262+0000","last_became_active":"2024-04-25T09:01:52.698861+0000","last_became_peered":"2024-04-25T09:01:52.698861+0000","last_unstale":"2024-04-25T09:01:53.692262+0000","last_undegraded":"2024-04-25T09:01:53.692262+0000","last_fullsized":"2024-04-25T09:01:53.692262+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.670967+0000","last_change":"2024-04-25T09:01:50.670967+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.670967+0000","last_undegraded":"2024-04-25T09:01:50.670967+0000","last_fullsized":"2024-04-25T09:01:50.670967+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605258+0000","last_change":"2024-04-25T09:01:52.712317+0000","last_active":"2024-04-25T09:01:54.605258+0000","last_peered":"2024-04-25T09:01:54.605258+0000","last_clean":"2024-04-25T09:01:54.605258+0000","last_became_active":"2024-04-25T09:01:52.710876+0000","last_became_peered":"2024-04-25T09:01:52.710876+0000","last_unstale":"2024-04-25T09:01:54.605258+0000","last_undegraded":"2024-04-25T09:01:54.605258+0000","last_fullsized":"2024-04-25T09:01:54.605258+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:57.067729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669543+0000","last_change":"2024-04-25T09:01:50.669543+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669543+0000","last_undegraded":"2024-04-25T09:01:50.669543+0000","last_fullsized":"2024-04-25T09:01:50.669543+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693570+0000","last_change":"2024-04-25T09:01:52.700066+0000","last_active":"2024-04-25T09:01:53.693570+0000","last_peered":"2024-04-25T09:01:53.693570+0000","last_clean":"2024-04-25T09:01:53.693570+0000","last_became_active":"2024-04-25T09:01:52.699737+0000","last_became_peered":"2024-04-25T09:01:52.699737+0000","last_unstale":"2024-04-25T09:01:53.693570+0000","last_undegraded":"2024-04-25T09:01:53.693570+0000","last_fullsized":"2024-04-25T09:01:53.693570+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:08.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.680625+0000","last_change":"2024-04-25T09:01:51.694493+0000","last_active":"2024-04-25T09:01:52.680625+0000","last_peered":"2024-04-25T09:01:52.680625+0000","last_clean":"2024-04-25T09:01:52.680625+0000","last_became_active":"2024-04-25T09:01:51.693830+0000","last_became_peered":"2024-04-25T09:01:51.693830+0000","last_unstale":"2024-04-25T09:01:52.680625+0000","last_undegraded":"2024-04-25T09:01:52.680625+0000","last_fullsized":"2024-04-25T09:01:52.680625+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:54.059043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693750+0000","last_change":"2024-04-25T09:01:52.712409+0000","last_active":"2024-04-25T09:01:53.693750+0000","last_peered":"2024-04-25T09:01:53.693750+0000","last_clean":"2024-04-25T09:01:53.693750+0000","last_became_active":"2024-04-25T09:01:52.712046+0000","last_became_peered":"2024-04-25T09:01:52.712046+0000","last_unstale":"2024-04-25T09:01:53.693750+0000","last_undegraded":"2024-04-25T09:01:53.693750+0000","last_fullsized":"2024-04-25T09:01:53.693750+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:27.972277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"101'3","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.714530+0000","last_change":"2024-04-25T09:01:51.686596+0000","last_active":"2024-04-25T09:01:52.714530+0000","last_peered":"2024-04-25T09:01:52.714530+0000","last_clean":"2024-04-25T09:01:52.714530+0000","last_became_active":"2024-04-25T09:01:51.686313+0000","last_became_peered":"2024-04-25T09:01:51.686313+0000","last_unstale":"2024-04-25T09:01:52.714530+0000","last_undegraded":"2024-04-25T09:01:52.714530+0000","last_fullsized":"2024-04-25T09:01:52.714530+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.714583+0000","last_change":"2024-04-25T09:01:52.709769+0000","last_active":"2024-04-25T09:01:52.714583+0000","last_peered":"2024-04-25T09:01:52.714583+0000","last_clean":"2024-04-25T09:01:52.714583+0000","last_became_active":"2024-04-25T09:01:52.709498+0000","last_became_peered":"2024-04-25T09:01:52.709498+0000","last_unstale":"2024-04-25T09:01:52.714583+0000","last_undegraded":"2024-04-25T09:01:52.714583+0000","last_fullsized":"2024-04-25T09:01:52.714583+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"101'6","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692814+0000","last_change":"2024-04-25T09:01:51.682536+0000","last_active":"2024-04-25T09:01:53.692814+0000","last_peered":"2024-04-25T09:01:53.692814+0000","last_clean":"2024-04-25T09:01:53.692814+0000","last_became_active":"2024-04-25T09:01:51.682287+0000","last_became_peered":"2024-04-25T09:01:51.682287+0000","last_unstale":"2024-04-25T09:01:53.692814+0000","last_undegraded":"2024-04-25T09:01:53.692814+0000","last_fullsized":"2024-04-25T09:01:53.692814+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:45.898743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.693220+0000","last_change":"2024-04-25T09:01:52.684908+0000","last_active":"2024-04-25T09:01:52.693220+0000","last_peered":"2024-04-25T09:01:52.693220+0000","last_clean":"2024-04-25T09:01:52.693220+0000","last_became_active":"2024-04-25T09:01:52.684605+0000","last_became_peered":"2024-04-25T09:01:52.684605+0000","last_unstale":"2024-04-25T09:01:52.693220+0000","last_undegraded":"2024-04-25T09:01:52.693220+0000","last_fullsized":"2024-04-25T09:01:52.693220+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:28.487975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096731+0000","last_change":"2024-04-25T09:01:51.680248+0000","last_active":"2024-04-25T09:01:54.096731+0000","last_peered":"2024-04-25T09:01:54.096731+0000","last_clean":"2024-04-25T09:01:54.096731+0000","last_became_active":"2024-04-25T09:01:51.679942+0000","last_became_peered":"2024-04-25T09:01:51.679942+0000","last_unstale":"2024-04-25T09:01:54.096731+0000","last_undegraded":"2024-04-25T09:01:54.096731+0000","last_fullsized":"2024-04-25T09:01:54.096731+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:09.184803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096810+0000","last_change":"2024-04-25T09:01:51.684580+0000","last_active":"2024-04-25T09:01:54.096810+0000","last_peered":"2024-04-25T09:01:54.096810+0000","last_clean":"2024-04-25T09:01:54.096810+0000","last_became_active":"2024-04-25T09:01:51.684288+0000","last_became_peered":"2024-04-25T09:01:51.684288+0000","last_unstale":"2024-04-25T09:01:54.096810+0000","last_undegraded":"2024-04-25T09:01:54.096810+0000","last_fullsized":"2024-04-25T09:01:54.096810+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:02.377887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692176+0000","last_change":"2024-04-25T09:01:52.696616+0000","last_active":"2024-04-25T09:01:53.692176+0000","last_peered":"2024-04-25T09:01:53.692176+0000","last_clean":"2024-04-25T09:01:53.692176+0000","last_became_active":"2024-04-25T09:01:52.695066+0000","last_became_peered":"2024-04-25T09:01:52.695066+0000","last_unstale":"2024-04-25T09:01:53.692176+0000","last_undegraded":"2024-04-25T09:01:53.692176+0000","last_fullsized":"2024-04-25T09:01:53.692176+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:36.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692682+0000","last_change":"2024-04-25T09:01:51.679465+0000","last_active":"2024-04-25T09:01:53.692682+0000","last_peered":"2024-04-25T09:01:53.692682+0000","last_clean":"2024-04-25T09:01:53.692682+0000","last_became_active":"2024-04-25T09:01:51.679186+0000","last_became_peered":"2024-04-25T09:01:51.679186+0000","last_unstale":"2024-04-25T09:01:53.692682+0000","last_undegraded":"2024-04-25T09:01:53.692682+0000","last_fullsized":"2024-04-25T09:01:53.692682+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:25.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096427+0000","last_change":"2024-04-25T09:01:52.696205+0000","last_active":"2024-04-25T09:01:54.096427+0000","last_peered":"2024-04-25T09:01:54.096427+0000","last_clean":"2024-04-25T09:01:54.096427+0000","last_became_active":"2024-04-25T09:01:52.695777+0000","last_became_peered":"2024-04-25T09:01:52.695777+0000","last_unstale":"2024-04-25T09:01:54.096427+0000","last_undegraded":"2024-04-25T09:01:54.096427+0000","last_fullsized":"2024-04-25T09:01:54.096427+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:21.504958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":99,"state":"creating+peering","last_fresh":"2024-04-25T09:01:50.669500+0000","last_change":"2024-04-25T09:01:50.669500+0000","last_active":"2024-04-25T09:01:50.662241+0000","last_peered":"2024-04-25T09:01:50.662241+0000","last_clean":"2024-04-25T09:01:50.662241+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:50.669500+0000","last_undegraded":"2024-04-25T09:01:50.669500+0000","last_fullsized":"2024-04-25T09:01:50.669500+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693702+0000","last_change":"2024-04-25T09:01:52.696401+0000","last_active":"2024-04-25T09:01:53.693702+0000","last_peered":"2024-04-25T09:01:53.693702+0000","last_clean":"2024-04-25T09:01:53.693702+0000","last_became_active":"2024-04-25T09:01:52.696116+0000","last_became_peered":"2024-04-25T09:01:52.696116+0000","last_unstale":"2024-04-25T09:01:53.693702+0000","last_undegraded":"2024-04-25T09:01:53.693702+0000","last_fullsized":"2024-04-25T09:01:53.693702+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:43.173439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692960+0000","last_change":"2024-04-25T09:01:51.684399+0000","last_active":"2024-04-25T09:01:53.692960+0000","last_peered":"2024-04-25T09:01:53.692960+0000","last_clean":"2024-04-25T09:01:53.692960+0000","last_became_active":"2024-04-25T09:01:51.684099+0000","last_became_peered":"2024-04-25T09:01:51.684099+0000","last_unstale":"2024-04-25T09:01:53.692960+0000","last_undegraded":"2024-04-25T09:01:53.692960+0000","last_fullsized":"2024-04-25T09:01:53.692960+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:15.299506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.711488+0000","last_change":"2024-04-25T09:01:52.703565+0000","last_active":"2024-04-25T09:01:52.711488+0000","last_peered":"2024-04-25T09:01:52.711488+0000","last_clean":"2024-04-25T09:01:52.711488+0000","last_became_active":"2024-04-25T09:01:52.703291+0000","last_became_peered":"2024-04-25T09:01:52.703291+0000","last_unstale":"2024-04-25T09:01:52.711488+0000","last_undegraded":"2024-04-25T09:01:52.711488+0000","last_fullsized":"2024-04-25T09:01:52.711488+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:16.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693116+0000","last_change":"2024-04-25T09:01:51.683022+0000","last_active":"2024-04-25T09:01:53.693116+0000","last_peered":"2024-04-25T09:01:53.693116+0000","last_clean":"2024-04-25T09:01:53.693116+0000","last_became_active":"2024-04-25T09:01:51.682744+0000","last_became_peered":"2024-04-25T09:01:51.682744+0000","last_unstale":"2024-04-25T09:01:53.693116+0000","last_undegraded":"2024-04-25T09:01:53.693116+0000","last_fullsized":"2024-04-25T09:01:53.693116+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:45.898743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.700594+0000","last_change":"2024-04-25T09:01:52.695302+0000","last_active":"2024-04-25T09:01:52.700594+0000","last_peered":"2024-04-25T09:01:52.700594+0000","last_clean":"2024-04-25T09:01:52.700594+0000","last_became_active":"2024-04-25T09:01:52.694964+0000","last_became_peered":"2024-04-25T09:01:52.694964+0000","last_unstale":"2024-04-25T09:01:52.700594+0000","last_undegraded":"2024-04-25T09:01:52.700594+0000","last_fullsized":"2024-04-25T09:01:52.700594+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:39.551479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604993+0000","last_change":"2024-04-25T09:01:51.693495+0000","last_active":"2024-04-25T09:01:54.604993+0000","last_peered":"2024-04-25T09:01:54.604993+0000","last_clean":"2024-04-25T09:01:54.604993+0000","last_became_active":"2024-04-25T09:01:51.692315+0000","last_became_peered":"2024-04-25T09:01:51.692315+0000","last_unstale":"2024-04-25T09:01:54.604993+0000","last_undegraded":"2024-04-25T09:01:54.604993+0000","last_fullsized":"2024-04-25T09:01:54.604993+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:28.649670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096711+0000","last_change":"2024-04-25T09:01:52.700272+0000","last_active":"2024-04-25T09:01:54.096711+0000","last_peered":"2024-04-25T09:01:54.096711+0000","last_clean":"2024-04-25T09:01:54.096711+0000","last_became_active":"2024-04-25T09:01:52.699838+0000","last_became_peered":"2024-04-25T09:01:52.699838+0000","last_unstale":"2024-04-25T09:01:54.096711+0000","last_undegraded":"2024-04-25T09:01:54.096711+0000","last_fullsized":"2024-04-25T09:01:54.096711+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:12.827897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605005+0000","last_change":"2024-04-25T09:01:51.693512+0000","last_active":"2024-04-25T09:01:54.605005+0000","last_peered":"2024-04-25T09:01:54.605005+0000","last_clean":"2024-04-25T09:01:54.605005+0000","last_became_active":"2024-04-25T09:01:51.693189+0000","last_became_peered":"2024-04-25T09:01:51.693189+0000","last_unstale":"2024-04-25T09:01:54.605005+0000","last_undegraded":"2024-04-25T09:01:54.605005+0000","last_fullsized":"2024-04-25T09:01:54.605005+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:55.700281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096658+0000","last_change":"2024-04-25T09:01:52.712476+0000","last_active":"2024-04-25T09:01:54.096658+0000","last_peered":"2024-04-25T09:01:54.096658+0000","last_clean":"2024-04-25T09:01:54.096658+0000","last_became_active":"2024-04-25T09:01:52.712176+0000","last_became_peered":"2024-04-25T09:01:52.712176+0000","last_unstale":"2024-04-25T09:01:54.096658+0000","last_undegraded":"2024-04-25T09:01:54.096658+0000","last_fullsized":"2024-04-25T09:01:54.096658+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:52.609031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.697301+0000","last_change":"2024-04-25T09:01:51.689051+0000","last_active":"2024-04-25T09:01:52.697301+0000","last_peered":"2024-04-25T09:01:52.697301+0000","last_clean":"2024-04-25T09:01:52.697301+0000","last_became_active":"2024-04-25T09:01:51.688768+0000","last_became_peered":"2024-04-25T09:01:51.688768+0000","last_unstale":"2024-04-25T09:01:52.697301+0000","last_undegraded":"2024-04-25T09:01:52.697301+0000","last_fullsized":"2024-04-25T09:01:52.697301+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:49.800683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096382+0000","last_change":"2024-04-25T09:01:52.701436+0000","last_active":"2024-04-25T09:01:54.096382+0000","last_peered":"2024-04-25T09:01:54.096382+0000","last_clean":"2024-04-25T09:01:54.096382+0000","last_became_active":"2024-04-25T09:01:52.701096+0000","last_became_peered":"2024-04-25T09:01:52.701096+0000","last_unstale":"2024-04-25T09:01:54.096382+0000","last_undegraded":"2024-04-25T09:01:54.096382+0000","last_fullsized":"2024-04-25T09:01:54.096382+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:00.272347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.696965+0000","last_change":"2024-04-25T09:01:51.685224+0000","last_active":"2024-04-25T09:01:52.696965+0000","last_peered":"2024-04-25T09:01:52.696965+0000","last_clean":"2024-04-25T09:01:52.696965+0000","last_became_active":"2024-04-25T09:01:51.684874+0000","last_became_peered":"2024-04-25T09:01:51.684874+0000","last_unstale":"2024-04-25T09:01:52.696965+0000","last_undegraded":"2024-04-25T09:01:52.696965+0000","last_fullsized":"2024-04-25T09:01:52.696965+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:00.417608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692485+0000","last_change":"2024-04-25T09:01:52.703105+0000","last_active":"2024-04-25T09:01:53.692485+0000","last_peered":"2024-04-25T09:01:53.692485+0000","last_clean":"2024-04-25T09:01:53.692485+0000","last_became_active":"2024-04-25T09:01:52.702819+0000","last_became_peered":"2024-04-25T09:01:52.702819+0000","last_unstale":"2024-04-25T09:01:53.692485+0000","last_undegraded":"2024-04-25T09:01:53.692485+0000","last_fullsized":"2024-04-25T09:01:53.692485+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605058+0000","last_change":"2024-04-25T09:01:51.692356+0000","last_active":"2024-04-25T09:01:54.605058+0000","last_peered":"2024-04-25T09:01:54.605058+0000","last_clean":"2024-04-25T09:01:54.605058+0000","last_became_active":"2024-04-25T09:01:51.691925+0000","last_became_peered":"2024-04-25T09:01:51.691925+0000","last_unstale":"2024-04-25T09:01:54.605058+0000","last_undegraded":"2024-04-25T09:01:54.605058+0000","last_fullsized":"2024-04-25T09:01:54.605058+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605395+0000","last_change":"2024-04-25T09:01:52.711183+0000","last_active":"2024-04-25T09:01:54.605395+0000","last_peered":"2024-04-25T09:01:54.605395+0000","last_clean":"2024-04-25T09:01:54.605395+0000","last_became_active":"2024-04-25T09:01:52.710711+0000","last_became_peered":"2024-04-25T09:01:52.710711+0000","last_unstale":"2024-04-25T09:01:54.605395+0000","last_undegraded":"2024-04-25T09:01:54.605395+0000","last_fullsized":"2024-04-25T09:01:54.605395+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:36.311937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"101'2","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.712005+0000","last_change":"2024-04-25T09:01:51.686947+0000","last_active":"2024-04-25T09:01:52.712005+0000","last_peered":"2024-04-25T09:01:52.712005+0000","last_clean":"2024-04-25T09:01:52.712005+0000","last_became_active":"2024-04-25T09:01:51.686297+0000","last_became_peered":"2024-04-25T09:01:51.686297+0000","last_unstale":"2024-04-25T09:01:52.712005+0000","last_undegraded":"2024-04-25T09:01:52.712005+0000","last_fullsized":"2024-04-25T09:01:52.712005+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:25.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605390+0000","last_change":"2024-04-25T09:01:51.688454+0000","last_active":"2024-04-25T09:01:54.605390+0000","last_peered":"2024-04-25T09:01:54.605390+0000","last_clean":"2024-04-25T09:01:54.605390+0000","last_became_active":"2024-04-25T09:01:51.688046+0000","last_became_peered":"2024-04-25T09:01:51.688046+0000","last_unstale":"2024-04-25T09:01:54.605390+0000","last_undegraded":"2024-04-25T09:01:54.605390+0000","last_fullsized":"2024-04-25T09:01:54.605390+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:35.523946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:01:51.664131+0000","last_change":"2024-04-25T09:01:51.664131+0000","last_active":"2024-04-25T09:01:51.664131+0000","last_peered":"2024-04-25T09:01:51.664131+0000","last_clean":"2024-04-25T09:01:51.664131+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:01:51.664131+0000","last_undegraded":"2024-04-25T09:01:51.664131+0000","last_fullsized":"2024-04-25T09:01:51.664131+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605090+0000","last_change":"2024-04-25T09:01:51.688326+0000","last_active":"2024-04-25T09:01:54.605090+0000","last_peered":"2024-04-25T09:01:54.605090+0000","last_clean":"2024-04-25T09:01:54.605090+0000","last_became_active":"2024-04-25T09:01:51.688018+0000","last_became_peered":"2024-04-25T09:01:51.688018+0000","last_unstale":"2024-04-25T09:01:54.605090+0000","last_undegraded":"2024-04-25T09:01:54.605090+0000","last_fullsized":"2024-04-25T09:01:54.605090+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:27.486085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692993+0000","last_change":"2024-04-25T09:01:52.691237+0000","last_active":"2024-04-25T09:01:53.692993+0000","last_peered":"2024-04-25T09:01:53.692993+0000","last_clean":"2024-04-25T09:01:53.692993+0000","last_became_active":"2024-04-25T09:01:52.690961+0000","last_became_peered":"2024-04-25T09:01:52.690961+0000","last_unstale":"2024-04-25T09:01:53.692993+0000","last_undegraded":"2024-04-25T09:01:53.692993+0000","last_fullsized":"2024-04-25T09:01:53.692993+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693713+0000","last_change":"2024-04-25T09:01:51.679451+0000","last_active":"2024-04-25T09:01:53.693713+0000","last_peered":"2024-04-25T09:01:53.693713+0000","last_clean":"2024-04-25T09:01:53.693713+0000","last_became_active":"2024-04-25T09:01:51.679204+0000","last_became_peered":"2024-04-25T09:01:51.679204+0000","last_unstale":"2024-04-25T09:01:53.693713+0000","last_undegraded":"2024-04-25T09:01:53.693713+0000","last_fullsized":"2024-04-25T09:01:53.693713+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:15.299506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096694+0000","last_change":"2024-04-25T09:01:52.698600+0000","last_active":"2024-04-25T09:01:54.096694+0000","last_peered":"2024-04-25T09:01:54.096694+0000","last_clean":"2024-04-25T09:01:54.096694+0000","last_became_active":"2024-04-25T09:01:52.698186+0000","last_became_peered":"2024-04-25T09:01:52.698186+0000","last_unstale":"2024-04-25T09:01:54.096694+0000","last_undegraded":"2024-04-25T09:01:54.096694+0000","last_fullsized":"2024-04-25T09:01:54.096694+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:59.899028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605178+0000","last_change":"2024-04-25T09:01:51.694307+0000","last_active":"2024-04-25T09:01:54.605178+0000","last_peered":"2024-04-25T09:01:54.605178+0000","last_clean":"2024-04-25T09:01:54.605178+0000","last_became_active":"2024-04-25T09:01:51.693908+0000","last_became_peered":"2024-04-25T09:01:51.693908+0000","last_unstale":"2024-04-25T09:01:54.605178+0000","last_undegraded":"2024-04-25T09:01:54.605178+0000","last_fullsized":"2024-04-25T09:01:54.605178+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:43.448108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693143+0000","last_change":"2024-04-25T09:01:52.694122+0000","last_active":"2024-04-25T09:01:53.693143+0000","last_peered":"2024-04-25T09:01:53.693143+0000","last_clean":"2024-04-25T09:01:53.693143+0000","last_became_active":"2024-04-25T09:01:52.693842+0000","last_became_peered":"2024-04-25T09:01:52.693842+0000","last_unstale":"2024-04-25T09:01:53.693143+0000","last_undegraded":"2024-04-25T09:01:53.693143+0000","last_fullsized":"2024-04-25T09:01:53.693143+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692610+0000","last_change":"2024-04-25T09:01:51.677502+0000","last_active":"2024-04-25T09:01:53.692610+0000","last_peered":"2024-04-25T09:01:53.692610+0000","last_clean":"2024-04-25T09:01:53.692610+0000","last_became_active":"2024-04-25T09:01:51.677227+0000","last_became_peered":"2024-04-25T09:01:51.677227+0000","last_unstale":"2024-04-25T09:01:53.692610+0000","last_undegraded":"2024-04-25T09:01:53.692610+0000","last_fullsized":"2024-04-25T09:01:53.692610+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:49.800683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096380+0000","last_change":"2024-04-25T09:01:52.697387+0000","last_active":"2024-04-25T09:01:54.096380+0000","last_peered":"2024-04-25T09:01:54.096380+0000","last_clean":"2024-04-25T09:01:54.096380+0000","last_became_active":"2024-04-25T09:01:52.697042+0000","last_became_peered":"2024-04-25T09:01:52.697042+0000","last_unstale":"2024-04-25T09:01:54.096380+0000","last_undegraded":"2024-04-25T09:01:54.096380+0000","last_fullsized":"2024-04-25T09:01:54.096380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:17.162954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.680484+0000","last_change":"2024-04-25T09:01:51.677381+0000","last_active":"2024-04-25T09:01:52.680484+0000","last_peered":"2024-04-25T09:01:52.680484+0000","last_clean":"2024-04-25T09:01:52.680484+0000","last_became_active":"2024-04-25T09:01:51.677062+0000","last_became_peered":"2024-04-25T09:01:51.677062+0000","last_unstale":"2024-04-25T09:01:52.680484+0000","last_undegraded":"2024-04-25T09:01:52.680484+0000","last_fullsized":"2024-04-25T09:01:52.680484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692553+0000","last_change":"2024-04-25T09:01:52.691546+0000","last_active":"2024-04-25T09:01:53.692553+0000","last_peered":"2024-04-25T09:01:53.692553+0000","last_clean":"2024-04-25T09:01:53.692553+0000","last_became_active":"2024-04-25T09:01:52.691230+0000","last_became_peered":"2024-04-25T09:01:52.691230+0000","last_unstale":"2024-04-25T09:01:53.692553+0000","last_undegraded":"2024-04-25T09:01:53.692553+0000","last_fullsized":"2024-04-25T09:01:53.692553+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096518+0000","last_change":"2024-04-25T09:01:51.692499+0000","last_active":"2024-04-25T09:01:54.096518+0000","last_peered":"2024-04-25T09:01:54.096518+0000","last_clean":"2024-04-25T09:01:54.096518+0000","last_became_active":"2024-04-25T09:01:51.692119+0000","last_became_peered":"2024-04-25T09:01:51.692119+0000","last_unstale":"2024-04-25T09:01:54.096518+0000","last_undegraded":"2024-04-25T09:01:54.096518+0000","last_fullsized":"2024-04-25T09:01:54.096518+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.202286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096881+0000","last_change":"2024-04-25T09:01:52.701340+0000","last_active":"2024-04-25T09:01:54.096881+0000","last_peered":"2024-04-25T09:01:54.096881+0000","last_clean":"2024-04-25T09:01:54.096881+0000","last_became_active":"2024-04-25T09:01:52.701041+0000","last_became_peered":"2024-04-25T09:01:52.701041+0000","last_unstale":"2024-04-25T09:01:54.096881+0000","last_undegraded":"2024-04-25T09:01:54.096881+0000","last_fullsized":"2024-04-25T09:01:54.096881+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:41.764193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"101'1","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.711941+0000","last_change":"2024-04-25T09:01:51.688495+0000","last_active":"2024-04-25T09:01:52.711941+0000","last_peered":"2024-04-25T09:01:52.711941+0000","last_clean":"2024-04-25T09:01:52.711941+0000","last_became_active":"2024-04-25T09:01:51.688257+0000","last_became_peered":"2024-04-25T09:01:51.688257+0000","last_unstale":"2024-04-25T09:01:52.711941+0000","last_undegraded":"2024-04-25T09:01:52.711941+0000","last_fullsized":"2024-04-25T09:01:52.711941+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.251208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":315,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T09:01:52.681527+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T09:01:52.681527+0000","last_peered":"2024-04-25T09:01:52.681527+0000","last_clean":"2024-04-25T09:01:52.681527+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:01:52.681527+0000","last_undegraded":"2024-04-25T09:01:52.681527+0000","last_fullsized":"2024-04-25T09:01:52.681527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509545,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1843200,"data_stored":1123951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509543,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1261568,"data_stored":540423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509545,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1245184,"data_stored":533541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":541507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":535105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509546,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1257472,"data_stored":539805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509544,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37140,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334700,"statfs":{"total":96636764160,"available":96598732800,"internally_reserved":0,"allocated":1839104,"data_stored":1124421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1216512,"data_stored":520421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:00.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:02:00.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.669+0000 7efddcd7e640 1 Processor -- start 2024-04-25T09:02:00.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.669+0000 7efddcd7e640 1 -- start start 2024-04-25T09:02:00.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.670+0000 7efddcd7e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efdd80cea00 0x7efdd80cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:00.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.670+0000 7efddcd7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efdd80cfbe0 0x7efdd80ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:00.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.670+0000 7efddcd7e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd80d0430 con 0x7efdd815f120 2024-04-25T09:02:00.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.670+0000 7efddcd7e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd80d09f0 con 0x7efdd80cfbe0 2024-04-25T09:02:00.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.670+0000 7efddcd7e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd80d0710 con 0x7efdd80cea00 2024-04-25T09:02:00.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.671+0000 7efdd6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efdd80cfbe0 0x7efdd80ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:00.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.671+0000 7efdd6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efdd80cfbe0 0x7efdd80ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39708/0 (socket says 172.21.15.55:39708) 2024-04-25T09:02:00.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.671+0000 7efdd6d9d640 1 -- 172.21.15.55:0/1860176874 learned_addr learned my addr 172.21.15.55:0/1860176874 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:00.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.671+0000 7efdd5d9b640 1 --2- 172.21.15.55:0/1860176874 >> v2:172.21.15.167:3300/0 conn(0x7efdd80cea00 0x7efdd80cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:00.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.671+0000 7efdd6d9d640 1 -- 172.21.15.55:0/1860176874 >> v2:172.21.15.167:3300/0 conn(0x7efdd80cea00 msgr2=0x7efdd80cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:00.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.671+0000 7efdd6d9d640 1 --2- 172.21.15.55:0/1860176874 >> v2:172.21.15.167:3300/0 conn(0x7efdd80cea00 0x7efdd80cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:00.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.671+0000 7efdd6d9d640 1 -- 172.21.15.55:0/1860176874 >> v1:172.21.15.167:6789/0 conn(0x7efdd815f120 legacy=0x7efdd80ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:00.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.671+0000 7efdd6d9d640 1 -- 172.21.15.55:0/1860176874 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd80cc7d0 con 0x7efdd80cfbe0 2024-04-25T09:02:00.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.672+0000 7efdd6d9d640 1 --2- 172.21.15.55:0/1860176874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd80cfbe0 0x7efdd80ccfd0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7efdd8071d90 tx=0x7efdc802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0ecf3ca657f24b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:00.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.672+0000 7efdd559a640 1 -- 172.21.15.55:0/1860176874 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8036070 con 0x7efdd80cfbe0 2024-04-25T09:02:00.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.672+0000 7efdd559a640 1 -- 172.21.15.55:0/1860176874 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc8031600 con 0x7efdd80cfbe0 2024-04-25T09:02:00.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.672+0000 7efdd559a640 1 -- 172.21.15.55:0/1860176874 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc80319f0 con 0x7efdd80cfbe0 2024-04-25T09:02:00.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.672+0000 7efddcd7e640 1 -- 172.21.15.55:0/1860176874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd80cfbe0 msgr2=0x7efdd80ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:00.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.672+0000 7efddcd7e640 1 --2- 172.21.15.55:0/1860176874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd80cfbe0 0x7efdd80ccfd0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7efdd8071d90 tx=0x7efdc802a7c0 comp rx=0 tx=0).stop 2024-04-25T09:02:00.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.673+0000 7efddcd7e640 1 -- 172.21.15.55:0/1860176874 shutdown_connections 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.673+0000 7efddcd7e640 1 --2- 172.21.15.55:0/1860176874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd80cfbe0 0x7efdd80ccfd0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.673+0000 7efddcd7e640 1 --2- 172.21.15.55:0/1860176874 >> v2:172.21.15.167:3300/0 conn(0x7efdd80cea00 0x7efdd80cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.673+0000 7efddcd7e640 1 -- 172.21.15.55:0/1860176874 >> 172.21.15.55:0/1860176874 conn(0x7efdd80d1900 msgr2=0x7efdd80d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.673+0000 7efddcd7e640 1 -- 172.21.15.55:0/1860176874 shutdown_connections 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.673+0000 7efddcd7e640 1 -- 172.21.15.55:0/1860176874 wait complete. 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.674+0000 7efddcd7e640 1 Processor -- start 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.674+0000 7efddcd7e640 1 -- start start 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efddcd7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd80cea00 0x7efdd80cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efddcd7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdd80cfbe0 0x7efdd80b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efddcd7e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efdd815f120 0x7efdd80aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efddcd7e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80c5450 con 0x7efdd80cea00 2024-04-25T09:02:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efddcd7e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80cc480 con 0x7efdd80cfbe0 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efddcd7e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80d0070 con 0x7efdd815f120 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efdd659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd80cea00 0x7efdd80cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efdd659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd80cea00 0x7efdd80cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39712/0 (socket says 172.21.15.55:39712) 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efdd659c640 1 -- 172.21.15.55:0/1995618917 learned_addr learned my addr 172.21.15.55:0/1995618917 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efdd5d9b640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdd80cfbe0 0x7efdd80b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efdd6d9d640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efdd815f120 0x7efdd80aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efdd659c640 1 -- 172.21.15.55:0/1995618917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efdd815f120 msgr2=0x7efdd80aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efdd659c640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efdd815f120 0x7efdd80aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efdd659c640 1 -- 172.21.15.55:0/1995618917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdd80cfbe0 msgr2=0x7efdd80b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efdd659c640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdd80cfbe0 0x7efdd80b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efdd659c640 1 -- 172.21.15.55:0/1995618917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd80b66d0 con 0x7efdd80cea00 2024-04-25T09:02:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.675+0000 7efdd659c640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd80cea00 0x7efdd80cb310 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c370 tx=0x7efdd000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.676+0000 7efdceffd640 1 -- 172.21.15.55:0/1995618917 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0017070 con 0x7efdd80cea00 2024-04-25T09:02:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.676+0000 7efdceffd640 1 -- 172.21.15.55:0/1995618917 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd00052d0 con 0x7efdd80cea00 2024-04-25T09:02:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.676+0000 7efddcd7e640 1 -- 172.21.15.55:0/1995618917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd80b56c0 con 0x7efdd80cea00 2024-04-25T09:02:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.676+0000 7efdceffd640 1 -- 172.21.15.55:0/1995618917 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0003850 con 0x7efdd80cea00 2024-04-25T09:02:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.676+0000 7efddcd7e640 1 -- 172.21.15.55:0/1995618917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd80b6990 con 0x7efdd80cea00 2024-04-25T09:02:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.677+0000 7efddcd7e640 1 -- 172.21.15.55:0/1995618917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd8067850 con 0x7efdd80cea00 2024-04-25T09:02:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.677+0000 7efdceffd640 1 -- 172.21.15.55:0/1995618917 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efdd001a070 con 0x7efdd80cea00 2024-04-25T09:02:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.678+0000 7efdceffd640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efdb806b4d0 0x7efdb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.678+0000 7efdceffd640 1 -- 172.21.15.55:0/1995618917 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdd0089440 con 0x7efdd80cea00 2024-04-25T09:02:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.678+0000 7efdd5d9b640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efdb806b4d0 0x7efdb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.678+0000 7efdd5d9b640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efdb806b4d0 0x7efdb806d990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efdd809f7d0 tx=0x7efdc0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.682+0000 7efdceffd640 1 -- 172.21.15.55:0/1995618917 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efdd0058350 con 0x7efdd80cea00 2024-04-25T09:02:00.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.860+0000 7efddcd7e640 1 -- 172.21.15.55:0/1995618917 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efdd80b1d30 con 0x7efdb806b4d0 2024-04-25T09:02:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.866+0000 7efdceffd640 1 -- 172.21.15.55:0/1995618917 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252347 (secure 0 0 0) 0x7efdd80b1d30 con 0x7efdb806b4d0 2024-04-25T09:02:00.857 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:00.858 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:02:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 -- 172.21.15.55:0/1995618917 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efdb806b4d0 msgr2=0x7efdb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efdb806b4d0 0x7efdb806d990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efdd809f7d0 tx=0x7efdc0008040 comp rx=0 tx=0).stop 2024-04-25T09:02:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 -- 172.21.15.55:0/1995618917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd80cea00 msgr2=0x7efdd80cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd80cea00 0x7efdd80cb310 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c370 tx=0x7efdd000c830 comp rx=0 tx=0).stop 2024-04-25T09:02:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 -- 172.21.15.55:0/1995618917 shutdown_connections 2024-04-25T09:02:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efdb806b4d0 0x7efdb806d990 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efdd815f120 0x7efdd80aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:00.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdd80cfbe0 0x7efdd80b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:00.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 --2- 172.21.15.55:0/1995618917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd80cea00 0x7efdd80cb310 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:00.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 -- 172.21.15.55:0/1995618917 >> 172.21.15.55:0/1995618917 conn(0x7efdd80d1900 msgr2=0x7efdd80d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:00.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 -- 172.21.15.55:0/1995618917 shutdown_connections 2024-04-25T09:02:00.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:00.869+0000 7efddcd7e640 1 -- 172.21.15.55:0/1995618917 wait complete. 2024-04-25T09:02:00.869 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2024-04-25T09:02:00.664904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264620,"kb_used_data":11016,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754710100,"statfs":{"total":773094113280,"available":772823142400,"internally_reserved":0,"allocated":11280384,"data_stored":5503724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001607"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.695996+0000","last_change":"2024-04-25T09:01:52.698750+0000","last_active":"2024-04-25T09:01:53.695996+0000","last_peered":"2024-04-25T09:01:53.695996+0000","last_clean":"2024-04-25T09:01:53.695996+0000","last_became_active":"2024-04-25T09:01:52.698473+0000","last_became_peered":"2024-04-25T09:01:52.698473+0000","last_unstale":"2024-04-25T09:01:53.695996+0000","last_undegraded":"2024-04-25T09:01:53.695996+0000","last_fullsized":"2024-04-25T09:01:53.695996+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:35.544104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605006+0000","last_change":"2024-04-25T09:01:52.711487+0000","last_active":"2024-04-25T09:01:54.605006+0000","last_peered":"2024-04-25T09:01:54.605006+0000","last_clean":"2024-04-25T09:01:54.605006+0000","last_became_active":"2024-04-25T09:01:52.711106+0000","last_became_peered":"2024-04-25T09:01:52.711106+0000","last_unstale":"2024-04-25T09:01:54.605006+0000","last_undegraded":"2024-04-25T09:01:54.605006+0000","last_fullsized":"2024-04-25T09:01:54.605006+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:32.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.695725+0000","last_change":"2024-04-25T09:01:52.697974+0000","last_active":"2024-04-25T09:01:53.695725+0000","last_peered":"2024-04-25T09:01:53.695725+0000","last_clean":"2024-04-25T09:01:53.695725+0000","last_became_active":"2024-04-25T09:01:52.697694+0000","last_became_peered":"2024-04-25T09:01:52.697694+0000","last_unstale":"2024-04-25T09:01:53.695725+0000","last_undegraded":"2024-04-25T09:01:53.695725+0000","last_fullsized":"2024-04-25T09:01:53.695725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:11.883311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000782+0000","last_change":"2024-04-25T09:01:52.703003+0000","last_active":"2024-04-25T09:01:55.000782+0000","last_peered":"2024-04-25T09:01:55.000782+0000","last_clean":"2024-04-25T09:01:55.000782+0000","last_became_active":"2024-04-25T09:01:52.702715+0000","last_became_peered":"2024-04-25T09:01:52.702715+0000","last_unstale":"2024-04-25T09:01:55.000782+0000","last_undegraded":"2024-04-25T09:01:55.000782+0000","last_fullsized":"2024-04-25T09:01:55.000782+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:11.879187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693556+0000","last_change":"2024-04-25T09:01:52.688278+0000","last_active":"2024-04-25T09:01:53.693556+0000","last_peered":"2024-04-25T09:01:53.693556+0000","last_clean":"2024-04-25T09:01:53.693556+0000","last_became_active":"2024-04-25T09:01:52.687945+0000","last_became_peered":"2024-04-25T09:01:52.687945+0000","last_unstale":"2024-04-25T09:01:53.693556+0000","last_undegraded":"2024-04-25T09:01:53.693556+0000","last_fullsized":"2024-04-25T09:01:53.693556+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000786+0000","last_change":"2024-04-25T09:01:52.698724+0000","last_active":"2024-04-25T09:01:55.000786+0000","last_peered":"2024-04-25T09:01:55.000786+0000","last_clean":"2024-04-25T09:01:55.000786+0000","last_became_active":"2024-04-25T09:01:52.698461+0000","last_became_peered":"2024-04-25T09:01:52.698461+0000","last_unstale":"2024-04-25T09:01:55.000786+0000","last_undegraded":"2024-04-25T09:01:55.000786+0000","last_fullsized":"2024-04-25T09:01:55.000786+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:08.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000989+0000","last_change":"2024-04-25T09:01:52.697957+0000","last_active":"2024-04-25T09:01:55.000989+0000","last_peered":"2024-04-25T09:01:55.000989+0000","last_clean":"2024-04-25T09:01:55.000989+0000","last_became_active":"2024-04-25T09:01:52.697697+0000","last_became_peered":"2024-04-25T09:01:52.697697+0000","last_unstale":"2024-04-25T09:01:55.000989+0000","last_undegraded":"2024-04-25T09:01:55.000989+0000","last_fullsized":"2024-04-25T09:01:55.000989+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:12.941971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604905+0000","last_change":"2024-04-25T09:01:52.710111+0000","last_active":"2024-04-25T09:01:54.604905+0000","last_peered":"2024-04-25T09:01:54.604905+0000","last_clean":"2024-04-25T09:01:54.604905+0000","last_became_active":"2024-04-25T09:01:52.709135+0000","last_became_peered":"2024-04-25T09:01:52.709135+0000","last_unstale":"2024-04-25T09:01:54.604905+0000","last_undegraded":"2024-04-25T09:01:54.604905+0000","last_fullsized":"2024-04-25T09:01:54.604905+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:05.158708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693398+0000","last_change":"2024-04-25T09:01:52.696335+0000","last_active":"2024-04-25T09:01:53.693398+0000","last_peered":"2024-04-25T09:01:53.693398+0000","last_clean":"2024-04-25T09:01:53.693398+0000","last_became_active":"2024-04-25T09:01:52.695444+0000","last_became_peered":"2024-04-25T09:01:52.695444+0000","last_unstale":"2024-04-25T09:01:53.693398+0000","last_undegraded":"2024-04-25T09:01:53.693398+0000","last_fullsized":"2024-04-25T09:01:53.693398+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:49.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692801+0000","last_change":"2024-04-25T09:01:52.700383+0000","last_active":"2024-04-25T09:01:53.692801+0000","last_peered":"2024-04-25T09:01:53.692801+0000","last_clean":"2024-04-25T09:01:53.692801+0000","last_became_active":"2024-04-25T09:01:52.700110+0000","last_became_peered":"2024-04-25T09:01:52.700110+0000","last_unstale":"2024-04-25T09:01:53.692801+0000","last_undegraded":"2024-04-25T09:01:53.692801+0000","last_fullsized":"2024-04-25T09:01:53.692801+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.001068+0000","last_change":"2024-04-25T09:01:52.694747+0000","last_active":"2024-04-25T09:01:55.001068+0000","last_peered":"2024-04-25T09:01:55.001068+0000","last_clean":"2024-04-25T09:01:55.001068+0000","last_became_active":"2024-04-25T09:01:52.694333+0000","last_became_peered":"2024-04-25T09:01:52.694333+0000","last_unstale":"2024-04-25T09:01:55.001068+0000","last_undegraded":"2024-04-25T09:01:55.001068+0000","last_fullsized":"2024-04-25T09:01:55.001068+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:11.879187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692551+0000","last_change":"2024-04-25T09:01:52.703084+0000","last_active":"2024-04-25T09:01:53.692551+0000","last_peered":"2024-04-25T09:01:53.692551+0000","last_clean":"2024-04-25T09:01:53.692551+0000","last_became_active":"2024-04-25T09:01:52.702483+0000","last_became_peered":"2024-04-25T09:01:52.702483+0000","last_unstale":"2024-04-25T09:01:53.692551+0000","last_undegraded":"2024-04-25T09:01:53.692551+0000","last_fullsized":"2024-04-25T09:01:53.692551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000557+0000","last_change":"2024-04-25T09:01:52.694341+0000","last_active":"2024-04-25T09:01:55.000557+0000","last_peered":"2024-04-25T09:01:55.000557+0000","last_clean":"2024-04-25T09:01:55.000557+0000","last_became_active":"2024-04-25T09:01:52.694029+0000","last_became_peered":"2024-04-25T09:01:52.694029+0000","last_unstale":"2024-04-25T09:01:55.000557+0000","last_undegraded":"2024-04-25T09:01:55.000557+0000","last_fullsized":"2024-04-25T09:01:55.000557+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:15.721652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096514+0000","last_change":"2024-04-25T09:01:52.706665+0000","last_active":"2024-04-25T09:01:54.096514+0000","last_peered":"2024-04-25T09:01:54.096514+0000","last_clean":"2024-04-25T09:01:54.096514+0000","last_became_active":"2024-04-25T09:01:52.705279+0000","last_became_peered":"2024-04-25T09:01:52.705279+0000","last_unstale":"2024-04-25T09:01:54.096514+0000","last_undegraded":"2024-04-25T09:01:54.096514+0000","last_fullsized":"2024-04-25T09:01:54.096514+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:36.665698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000487+0000","last_change":"2024-04-25T09:01:52.700645+0000","last_active":"2024-04-25T09:01:55.000487+0000","last_peered":"2024-04-25T09:01:55.000487+0000","last_clean":"2024-04-25T09:01:55.000487+0000","last_became_active":"2024-04-25T09:01:52.700098+0000","last_became_peered":"2024-04-25T09:01:52.700098+0000","last_unstale":"2024-04-25T09:01:55.000487+0000","last_undegraded":"2024-04-25T09:01:55.000487+0000","last_fullsized":"2024-04-25T09:01:55.000487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:43.173439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000608+0000","last_change":"2024-04-25T09:01:52.710044+0000","last_active":"2024-04-25T09:01:55.000608+0000","last_peered":"2024-04-25T09:01:55.000608+0000","last_clean":"2024-04-25T09:01:55.000608+0000","last_became_active":"2024-04-25T09:01:52.709788+0000","last_became_peered":"2024-04-25T09:01:52.709788+0000","last_unstale":"2024-04-25T09:01:55.000608+0000","last_undegraded":"2024-04-25T09:01:55.000608+0000","last_fullsized":"2024-04-25T09:01:55.000608+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:27.972277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605210+0000","last_change":"2024-04-25T09:01:52.710102+0000","last_active":"2024-04-25T09:01:54.605210+0000","last_peered":"2024-04-25T09:01:54.605210+0000","last_clean":"2024-04-25T09:01:54.605210+0000","last_became_active":"2024-04-25T09:01:52.709465+0000","last_became_peered":"2024-04-25T09:01:52.709465+0000","last_unstale":"2024-04-25T09:01:54.605210+0000","last_undegraded":"2024-04-25T09:01:54.605210+0000","last_fullsized":"2024-04-25T09:01:54.605210+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:52.724558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000861+0000","last_change":"2024-04-25T09:01:52.703474+0000","last_active":"2024-04-25T09:01:55.000861+0000","last_peered":"2024-04-25T09:01:55.000861+0000","last_clean":"2024-04-25T09:01:55.000861+0000","last_became_active":"2024-04-25T09:01:52.703179+0000","last_became_peered":"2024-04-25T09:01:52.703179+0000","last_unstale":"2024-04-25T09:01:55.000861+0000","last_undegraded":"2024-04-25T09:01:55.000861+0000","last_fullsized":"2024-04-25T09:01:55.000861+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:30.567705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096859+0000","last_change":"2024-04-25T09:01:52.706050+0000","last_active":"2024-04-25T09:01:54.096859+0000","last_peered":"2024-04-25T09:01:54.096859+0000","last_clean":"2024-04-25T09:01:54.096859+0000","last_became_active":"2024-04-25T09:01:52.704879+0000","last_became_peered":"2024-04-25T09:01:52.704879+0000","last_unstale":"2024-04-25T09:01:54.096859+0000","last_undegraded":"2024-04-25T09:01:54.096859+0000","last_fullsized":"2024-04-25T09:01:54.096859+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:33.129014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692717+0000","last_change":"2024-04-25T09:01:52.697576+0000","last_active":"2024-04-25T09:01:53.692717+0000","last_peered":"2024-04-25T09:01:53.692717+0000","last_clean":"2024-04-25T09:01:53.692717+0000","last_became_active":"2024-04-25T09:01:52.697260+0000","last_became_peered":"2024-04-25T09:01:52.697260+0000","last_unstale":"2024-04-25T09:01:53.692717+0000","last_undegraded":"2024-04-25T09:01:53.692717+0000","last_fullsized":"2024-04-25T09:01:53.692717+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:56.702171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096580+0000","last_change":"2024-04-25T09:01:52.702251+0000","last_active":"2024-04-25T09:01:54.096580+0000","last_peered":"2024-04-25T09:01:54.096580+0000","last_clean":"2024-04-25T09:01:54.096580+0000","last_became_active":"2024-04-25T09:01:52.701967+0000","last_became_peered":"2024-04-25T09:01:52.701967+0000","last_unstale":"2024-04-25T09:01:54.096580+0000","last_undegraded":"2024-04-25T09:01:54.096580+0000","last_fullsized":"2024-04-25T09:01:54.096580+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:53.310405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604901+0000","last_change":"2024-04-25T09:01:52.708781+0000","last_active":"2024-04-25T09:01:54.604901+0000","last_peered":"2024-04-25T09:01:54.604901+0000","last_clean":"2024-04-25T09:01:54.604901+0000","last_became_active":"2024-04-25T09:01:52.708504+0000","last_became_peered":"2024-04-25T09:01:52.708504+0000","last_unstale":"2024-04-25T09:01:54.604901+0000","last_undegraded":"2024-04-25T09:01:54.604901+0000","last_fullsized":"2024-04-25T09:01:54.604901+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:17.745375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604880+0000","last_change":"2024-04-25T09:01:52.708786+0000","last_active":"2024-04-25T09:01:54.604880+0000","last_peered":"2024-04-25T09:01:54.604880+0000","last_clean":"2024-04-25T09:01:54.604880+0000","last_became_active":"2024-04-25T09:01:52.708444+0000","last_became_peered":"2024-04-25T09:01:52.708444+0000","last_unstale":"2024-04-25T09:01:54.604880+0000","last_undegraded":"2024-04-25T09:01:54.604880+0000","last_fullsized":"2024-04-25T09:01:54.604880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:55.403342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000987+0000","last_change":"2024-04-25T09:01:52.696131+0000","last_active":"2024-04-25T09:01:55.000987+0000","last_peered":"2024-04-25T09:01:55.000987+0000","last_clean":"2024-04-25T09:01:55.000987+0000","last_became_active":"2024-04-25T09:01:52.695841+0000","last_became_peered":"2024-04-25T09:01:52.695841+0000","last_unstale":"2024-04-25T09:01:55.000987+0000","last_undegraded":"2024-04-25T09:01:55.000987+0000","last_fullsized":"2024-04-25T09:01:55.000987+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:15.721652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693641+0000","last_change":"2024-04-25T09:01:52.712343+0000","last_active":"2024-04-25T09:01:53.693641+0000","last_peered":"2024-04-25T09:01:53.693641+0000","last_clean":"2024-04-25T09:01:53.693641+0000","last_became_active":"2024-04-25T09:01:52.712042+0000","last_became_peered":"2024-04-25T09:01:52.712042+0000","last_unstale":"2024-04-25T09:01:53.693641+0000","last_undegraded":"2024-04-25T09:01:53.693641+0000","last_fullsized":"2024-04-25T09:01:53.693641+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:08.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605249+0000","last_change":"2024-04-25T09:01:52.713137+0000","last_active":"2024-04-25T09:01:54.605249+0000","last_peered":"2024-04-25T09:01:54.605249+0000","last_clean":"2024-04-25T09:01:54.605249+0000","last_became_active":"2024-04-25T09:01:52.711889+0000","last_became_peered":"2024-04-25T09:01:52.711889+0000","last_unstale":"2024-04-25T09:01:54.605249+0000","last_undegraded":"2024-04-25T09:01:54.605249+0000","last_fullsized":"2024-04-25T09:01:54.605249+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:00.395210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.001231+0000","last_change":"2024-04-25T09:01:52.703603+0000","last_active":"2024-04-25T09:01:55.001231+0000","last_peered":"2024-04-25T09:01:55.001231+0000","last_clean":"2024-04-25T09:01:55.001231+0000","last_became_active":"2024-04-25T09:01:52.702267+0000","last_became_peered":"2024-04-25T09:01:52.702267+0000","last_unstale":"2024-04-25T09:01:55.001231+0000","last_undegraded":"2024-04-25T09:01:55.001231+0000","last_fullsized":"2024-04-25T09:01:55.001231+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:30.567705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693635+0000","last_change":"2024-04-25T09:01:52.691453+0000","last_active":"2024-04-25T09:01:53.693635+0000","last_peered":"2024-04-25T09:01:53.693635+0000","last_clean":"2024-04-25T09:01:53.693635+0000","last_became_active":"2024-04-25T09:01:52.691156+0000","last_became_peered":"2024-04-25T09:01:52.691156+0000","last_unstale":"2024-04-25T09:01:53.693635+0000","last_undegraded":"2024-04-25T09:01:53.693635+0000","last_fullsized":"2024-04-25T09:01:53.693635+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:49.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604880+0000","last_change":"2024-04-25T09:01:52.711904+0000","last_active":"2024-04-25T09:01:54.604880+0000","last_peered":"2024-04-25T09:01:54.604880+0000","last_clean":"2024-04-25T09:01:54.604880+0000","last_became_active":"2024-04-25T09:01:52.711585+0000","last_became_peered":"2024-04-25T09:01:52.711585+0000","last_unstale":"2024-04-25T09:01:54.604880+0000","last_undegraded":"2024-04-25T09:01:54.604880+0000","last_fullsized":"2024-04-25T09:01:54.604880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:33.292042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096430+0000","last_change":"2024-04-25T09:01:52.706947+0000","last_active":"2024-04-25T09:01:54.096430+0000","last_peered":"2024-04-25T09:01:54.096430+0000","last_clean":"2024-04-25T09:01:54.096430+0000","last_became_active":"2024-04-25T09:01:52.706404+0000","last_became_peered":"2024-04-25T09:01:52.706404+0000","last_unstale":"2024-04-25T09:01:54.096430+0000","last_undegraded":"2024-04-25T09:01:54.096430+0000","last_fullsized":"2024-04-25T09:01:54.096430+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:29.478809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000613+0000","last_change":"2024-04-25T09:01:52.688618+0000","last_active":"2024-04-25T09:01:55.000613+0000","last_peered":"2024-04-25T09:01:55.000613+0000","last_clean":"2024-04-25T09:01:55.000613+0000","last_became_active":"2024-04-25T09:01:52.688240+0000","last_became_peered":"2024-04-25T09:01:52.688240+0000","last_unstale":"2024-04-25T09:01:55.000613+0000","last_undegraded":"2024-04-25T09:01:55.000613+0000","last_fullsized":"2024-04-25T09:01:55.000613+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:12.941971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.696060+0000","last_change":"2024-04-25T09:01:52.712857+0000","last_active":"2024-04-25T09:01:53.696060+0000","last_peered":"2024-04-25T09:01:53.696060+0000","last_clean":"2024-04-25T09:01:53.696060+0000","last_became_active":"2024-04-25T09:01:52.712437+0000","last_became_peered":"2024-04-25T09:01:52.712437+0000","last_unstale":"2024-04-25T09:01:53.696060+0000","last_undegraded":"2024-04-25T09:01:53.696060+0000","last_fullsized":"2024-04-25T09:01:53.696060+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:53.304650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096874+0000","last_change":"2024-04-25T09:01:52.704798+0000","last_active":"2024-04-25T09:01:54.096874+0000","last_peered":"2024-04-25T09:01:54.096874+0000","last_clean":"2024-04-25T09:01:54.096874+0000","last_became_active":"2024-04-25T09:01:52.702861+0000","last_became_peered":"2024-04-25T09:01:52.702861+0000","last_unstale":"2024-04-25T09:01:54.096874+0000","last_undegraded":"2024-04-25T09:01:54.096874+0000","last_fullsized":"2024-04-25T09:01:54.096874+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:55.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"101'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605302+0000","last_change":"2024-04-25T09:01:51.692270+0000","last_active":"2024-04-25T09:01:54.605302+0000","last_peered":"2024-04-25T09:01:54.605302+0000","last_clean":"2024-04-25T09:01:54.605302+0000","last_became_active":"2024-04-25T09:01:51.691955+0000","last_became_peered":"2024-04-25T09:01:51.691955+0000","last_unstale":"2024-04-25T09:01:54.605302+0000","last_undegraded":"2024-04-25T09:01:54.605302+0000","last_fullsized":"2024-04-25T09:01:54.605302+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:54.059043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000941+0000","last_change":"2024-04-25T09:01:52.691603+0000","last_active":"2024-04-25T09:01:55.000941+0000","last_peered":"2024-04-25T09:01:55.000941+0000","last_clean":"2024-04-25T09:01:55.000941+0000","last_became_active":"2024-04-25T09:01:52.691238+0000","last_became_peered":"2024-04-25T09:01:52.691238+0000","last_unstale":"2024-04-25T09:01:55.000941+0000","last_undegraded":"2024-04-25T09:01:55.000941+0000","last_fullsized":"2024-04-25T09:01:55.000941+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:06.105507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.001194+0000","last_change":"2024-04-25T09:01:51.689370+0000","last_active":"2024-04-25T09:01:55.001194+0000","last_peered":"2024-04-25T09:01:55.001194+0000","last_clean":"2024-04-25T09:01:55.001194+0000","last_became_active":"2024-04-25T09:01:51.689015+0000","last_became_peered":"2024-04-25T09:01:51.689015+0000","last_unstale":"2024-04-25T09:01:55.001194+0000","last_undegraded":"2024-04-25T09:01:55.001194+0000","last_fullsized":"2024-04-25T09:01:55.001194+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:53.114164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.695550+0000","last_change":"2024-04-25T09:01:52.702443+0000","last_active":"2024-04-25T09:01:53.695550+0000","last_peered":"2024-04-25T09:01:53.695550+0000","last_clean":"2024-04-25T09:01:53.695550+0000","last_became_active":"2024-04-25T09:01:52.702144+0000","last_became_peered":"2024-04-25T09:01:52.702144+0000","last_unstale":"2024-04-25T09:01:53.695550+0000","last_undegraded":"2024-04-25T09:01:53.695550+0000","last_fullsized":"2024-04-25T09:01:53.695550+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:35.175322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605116+0000","last_change":"2024-04-25T09:01:51.688848+0000","last_active":"2024-04-25T09:01:54.605116+0000","last_peered":"2024-04-25T09:01:54.605116+0000","last_clean":"2024-04-25T09:01:54.605116+0000","last_became_active":"2024-04-25T09:01:51.687975+0000","last_became_peered":"2024-04-25T09:01:51.687975+0000","last_unstale":"2024-04-25T09:01:54.605116+0000","last_undegraded":"2024-04-25T09:01:54.605116+0000","last_fullsized":"2024-04-25T09:01:54.605116+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:38.549589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693222+0000","last_change":"2024-04-25T09:01:52.701156+0000","last_active":"2024-04-25T09:01:53.693222+0000","last_peered":"2024-04-25T09:01:53.693222+0000","last_clean":"2024-04-25T09:01:53.693222+0000","last_became_active":"2024-04-25T09:01:52.700622+0000","last_became_peered":"2024-04-25T09:01:52.700622+0000","last_unstale":"2024-04-25T09:01:53.693222+0000","last_undegraded":"2024-04-25T09:01:53.693222+0000","last_fullsized":"2024-04-25T09:01:53.693222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:57.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604953+0000","last_change":"2024-04-25T09:01:51.692632+0000","last_active":"2024-04-25T09:01:54.604953+0000","last_peered":"2024-04-25T09:01:54.604953+0000","last_clean":"2024-04-25T09:01:54.604953+0000","last_became_active":"2024-04-25T09:01:51.691884+0000","last_became_peered":"2024-04-25T09:01:51.691884+0000","last_unstale":"2024-04-25T09:01:54.604953+0000","last_undegraded":"2024-04-25T09:01:54.604953+0000","last_fullsized":"2024-04-25T09:01:54.604953+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:31.350305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.001339+0000","last_change":"2024-04-25T09:01:52.703085+0000","last_active":"2024-04-25T09:01:55.001339+0000","last_peered":"2024-04-25T09:01:55.001339+0000","last_clean":"2024-04-25T09:01:55.001339+0000","last_became_active":"2024-04-25T09:01:52.702124+0000","last_became_peered":"2024-04-25T09:01:52.702124+0000","last_unstale":"2024-04-25T09:01:55.001339+0000","last_undegraded":"2024-04-25T09:01:55.001339+0000","last_fullsized":"2024-04-25T09:01:55.001339+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:54.116053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.695480+0000","last_change":"2024-04-25T09:01:51.683563+0000","last_active":"2024-04-25T09:01:53.695480+0000","last_peered":"2024-04-25T09:01:53.695480+0000","last_clean":"2024-04-25T09:01:53.695480+0000","last_became_active":"2024-04-25T09:01:51.683187+0000","last_became_peered":"2024-04-25T09:01:51.683187+0000","last_unstale":"2024-04-25T09:01:53.695480+0000","last_undegraded":"2024-04-25T09:01:53.695480+0000","last_fullsized":"2024-04-25T09:01:53.695480+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:47.546514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000825+0000","last_change":"2024-04-25T09:01:52.688524+0000","last_active":"2024-04-25T09:01:55.000825+0000","last_peered":"2024-04-25T09:01:55.000825+0000","last_clean":"2024-04-25T09:01:55.000825+0000","last_became_active":"2024-04-25T09:01:52.688222+0000","last_became_peered":"2024-04-25T09:01:52.688222+0000","last_unstale":"2024-04-25T09:01:55.000825+0000","last_undegraded":"2024-04-25T09:01:55.000825+0000","last_fullsized":"2024-04-25T09:01:55.000825+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:43.173439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604965+0000","last_change":"2024-04-25T09:01:51.689748+0000","last_active":"2024-04-25T09:01:54.604965+0000","last_peered":"2024-04-25T09:01:54.604965+0000","last_clean":"2024-04-25T09:01:54.604965+0000","last_became_active":"2024-04-25T09:01:51.689480+0000","last_became_peered":"2024-04-25T09:01:51.689480+0000","last_unstale":"2024-04-25T09:01:54.604965+0000","last_undegraded":"2024-04-25T09:01:54.604965+0000","last_fullsized":"2024-04-25T09:01:54.604965+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.251208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000432+0000","last_change":"2024-04-25T09:01:52.696412+0000","last_active":"2024-04-25T09:01:55.000432+0000","last_peered":"2024-04-25T09:01:55.000432+0000","last_clean":"2024-04-25T09:01:55.000432+0000","last_became_active":"2024-04-25T09:01:52.695363+0000","last_became_peered":"2024-04-25T09:01:52.695363+0000","last_unstale":"2024-04-25T09:01:55.000432+0000","last_undegraded":"2024-04-25T09:01:55.000432+0000","last_fullsized":"2024-04-25T09:01:55.000432+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:08.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692595+0000","last_change":"2024-04-25T09:01:51.692656+0000","last_active":"2024-04-25T09:01:53.692595+0000","last_peered":"2024-04-25T09:01:53.692595+0000","last_clean":"2024-04-25T09:01:53.692595+0000","last_became_active":"2024-04-25T09:01:51.692312+0000","last_became_peered":"2024-04-25T09:01:51.692312+0000","last_unstale":"2024-04-25T09:01:53.692595+0000","last_undegraded":"2024-04-25T09:01:53.692595+0000","last_fullsized":"2024-04-25T09:01:53.692595+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:25.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692262+0000","last_change":"2024-04-25T09:01:52.699187+0000","last_active":"2024-04-25T09:01:53.692262+0000","last_peered":"2024-04-25T09:01:53.692262+0000","last_clean":"2024-04-25T09:01:53.692262+0000","last_became_active":"2024-04-25T09:01:52.698861+0000","last_became_peered":"2024-04-25T09:01:52.698861+0000","last_unstale":"2024-04-25T09:01:53.692262+0000","last_undegraded":"2024-04-25T09:01:53.692262+0000","last_fullsized":"2024-04-25T09:01:53.692262+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.695387+0000","last_change":"2024-04-25T09:01:51.684624+0000","last_active":"2024-04-25T09:01:53.695387+0000","last_peered":"2024-04-25T09:01:53.695387+0000","last_clean":"2024-04-25T09:01:53.695387+0000","last_became_active":"2024-04-25T09:01:51.684347+0000","last_became_peered":"2024-04-25T09:01:51.684347+0000","last_unstale":"2024-04-25T09:01:53.695387+0000","last_undegraded":"2024-04-25T09:01:53.695387+0000","last_fullsized":"2024-04-25T09:01:53.695387+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:46.273338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605258+0000","last_change":"2024-04-25T09:01:52.712317+0000","last_active":"2024-04-25T09:01:54.605258+0000","last_peered":"2024-04-25T09:01:54.605258+0000","last_clean":"2024-04-25T09:01:54.605258+0000","last_became_active":"2024-04-25T09:01:52.710876+0000","last_became_peered":"2024-04-25T09:01:52.710876+0000","last_unstale":"2024-04-25T09:01:54.605258+0000","last_undegraded":"2024-04-25T09:01:54.605258+0000","last_fullsized":"2024-04-25T09:01:54.605258+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:57.067729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.695811+0000","last_change":"2024-04-25T09:01:51.683968+0000","last_active":"2024-04-25T09:01:53.695811+0000","last_peered":"2024-04-25T09:01:53.695811+0000","last_clean":"2024-04-25T09:01:53.695811+0000","last_became_active":"2024-04-25T09:01:51.683415+0000","last_became_peered":"2024-04-25T09:01:51.683415+0000","last_unstale":"2024-04-25T09:01:53.695811+0000","last_undegraded":"2024-04-25T09:01:53.695811+0000","last_fullsized":"2024-04-25T09:01:53.695811+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:48.039316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693570+0000","last_change":"2024-04-25T09:01:52.700066+0000","last_active":"2024-04-25T09:01:53.693570+0000","last_peered":"2024-04-25T09:01:53.693570+0000","last_clean":"2024-04-25T09:01:53.693570+0000","last_became_active":"2024-04-25T09:01:52.699737+0000","last_became_peered":"2024-04-25T09:01:52.699737+0000","last_unstale":"2024-04-25T09:01:53.693570+0000","last_undegraded":"2024-04-25T09:01:53.693570+0000","last_fullsized":"2024-04-25T09:01:53.693570+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:08.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000855+0000","last_change":"2024-04-25T09:01:51.694493+0000","last_active":"2024-04-25T09:01:55.000855+0000","last_peered":"2024-04-25T09:01:55.000855+0000","last_clean":"2024-04-25T09:01:55.000855+0000","last_became_active":"2024-04-25T09:01:51.693830+0000","last_became_peered":"2024-04-25T09:01:51.693830+0000","last_unstale":"2024-04-25T09:01:55.000855+0000","last_undegraded":"2024-04-25T09:01:55.000855+0000","last_fullsized":"2024-04-25T09:01:55.000855+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:54.059043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693750+0000","last_change":"2024-04-25T09:01:52.712409+0000","last_active":"2024-04-25T09:01:53.693750+0000","last_peered":"2024-04-25T09:01:53.693750+0000","last_clean":"2024-04-25T09:01:53.693750+0000","last_became_active":"2024-04-25T09:01:52.712046+0000","last_became_peered":"2024-04-25T09:01:52.712046+0000","last_unstale":"2024-04-25T09:01:53.693750+0000","last_undegraded":"2024-04-25T09:01:53.693750+0000","last_fullsized":"2024-04-25T09:01:53.693750+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:27.972277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"101'3","reported_seq":17,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.001440+0000","last_change":"2024-04-25T09:01:51.686596+0000","last_active":"2024-04-25T09:01:55.001440+0000","last_peered":"2024-04-25T09:01:55.001440+0000","last_clean":"2024-04-25T09:01:55.001440+0000","last_became_active":"2024-04-25T09:01:51.686313+0000","last_became_peered":"2024-04-25T09:01:51.686313+0000","last_unstale":"2024-04-25T09:01:55.001440+0000","last_undegraded":"2024-04-25T09:01:55.001440+0000","last_fullsized":"2024-04-25T09:01:55.001440+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.001268+0000","last_change":"2024-04-25T09:01:52.709769+0000","last_active":"2024-04-25T09:01:55.001268+0000","last_peered":"2024-04-25T09:01:55.001268+0000","last_clean":"2024-04-25T09:01:55.001268+0000","last_became_active":"2024-04-25T09:01:52.709498+0000","last_became_peered":"2024-04-25T09:01:52.709498+0000","last_unstale":"2024-04-25T09:01:55.001268+0000","last_undegraded":"2024-04-25T09:01:55.001268+0000","last_fullsized":"2024-04-25T09:01:55.001268+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:06.105507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"101'6","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692814+0000","last_change":"2024-04-25T09:01:51.682536+0000","last_active":"2024-04-25T09:01:53.692814+0000","last_peered":"2024-04-25T09:01:53.692814+0000","last_clean":"2024-04-25T09:01:53.692814+0000","last_became_active":"2024-04-25T09:01:51.682287+0000","last_became_peered":"2024-04-25T09:01:51.682287+0000","last_unstale":"2024-04-25T09:01:53.692814+0000","last_undegraded":"2024-04-25T09:01:53.692814+0000","last_fullsized":"2024-04-25T09:01:53.692814+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:45.898743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000566+0000","last_change":"2024-04-25T09:01:52.684908+0000","last_active":"2024-04-25T09:01:55.000566+0000","last_peered":"2024-04-25T09:01:55.000566+0000","last_clean":"2024-04-25T09:01:55.000566+0000","last_became_active":"2024-04-25T09:01:52.684605+0000","last_became_peered":"2024-04-25T09:01:52.684605+0000","last_unstale":"2024-04-25T09:01:55.000566+0000","last_undegraded":"2024-04-25T09:01:55.000566+0000","last_fullsized":"2024-04-25T09:01:55.000566+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:27.972277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096731+0000","last_change":"2024-04-25T09:01:51.680248+0000","last_active":"2024-04-25T09:01:54.096731+0000","last_peered":"2024-04-25T09:01:54.096731+0000","last_clean":"2024-04-25T09:01:54.096731+0000","last_became_active":"2024-04-25T09:01:51.679942+0000","last_became_peered":"2024-04-25T09:01:51.679942+0000","last_unstale":"2024-04-25T09:01:54.096731+0000","last_undegraded":"2024-04-25T09:01:54.096731+0000","last_fullsized":"2024-04-25T09:01:54.096731+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:09.184803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.695584+0000","last_change":"2024-04-25T09:01:52.707168+0000","last_active":"2024-04-25T09:01:53.695584+0000","last_peered":"2024-04-25T09:01:53.695584+0000","last_clean":"2024-04-25T09:01:53.695584+0000","last_became_active":"2024-04-25T09:01:52.702469+0000","last_became_peered":"2024-04-25T09:01:52.702469+0000","last_unstale":"2024-04-25T09:01:53.695584+0000","last_undegraded":"2024-04-25T09:01:53.695584+0000","last_fullsized":"2024-04-25T09:01:53.695584+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:46.383685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096810+0000","last_change":"2024-04-25T09:01:51.684580+0000","last_active":"2024-04-25T09:01:54.096810+0000","last_peered":"2024-04-25T09:01:54.096810+0000","last_clean":"2024-04-25T09:01:54.096810+0000","last_became_active":"2024-04-25T09:01:51.684288+0000","last_became_peered":"2024-04-25T09:01:51.684288+0000","last_unstale":"2024-04-25T09:01:54.096810+0000","last_undegraded":"2024-04-25T09:01:54.096810+0000","last_fullsized":"2024-04-25T09:01:54.096810+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:02.377887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692176+0000","last_change":"2024-04-25T09:01:52.696616+0000","last_active":"2024-04-25T09:01:53.692176+0000","last_peered":"2024-04-25T09:01:53.692176+0000","last_clean":"2024-04-25T09:01:53.692176+0000","last_became_active":"2024-04-25T09:01:52.695066+0000","last_became_peered":"2024-04-25T09:01:52.695066+0000","last_unstale":"2024-04-25T09:01:53.692176+0000","last_undegraded":"2024-04-25T09:01:53.692176+0000","last_fullsized":"2024-04-25T09:01:53.692176+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:36.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692682+0000","last_change":"2024-04-25T09:01:51.679465+0000","last_active":"2024-04-25T09:01:53.692682+0000","last_peered":"2024-04-25T09:01:53.692682+0000","last_clean":"2024-04-25T09:01:53.692682+0000","last_became_active":"2024-04-25T09:01:51.679186+0000","last_became_peered":"2024-04-25T09:01:51.679186+0000","last_unstale":"2024-04-25T09:01:53.692682+0000","last_undegraded":"2024-04-25T09:01:53.692682+0000","last_fullsized":"2024-04-25T09:01:53.692682+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:25.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096427+0000","last_change":"2024-04-25T09:01:52.696205+0000","last_active":"2024-04-25T09:01:54.096427+0000","last_peered":"2024-04-25T09:01:54.096427+0000","last_clean":"2024-04-25T09:01:54.096427+0000","last_became_active":"2024-04-25T09:01:52.695777+0000","last_became_peered":"2024-04-25T09:01:52.695777+0000","last_unstale":"2024-04-25T09:01:54.096427+0000","last_undegraded":"2024-04-25T09:01:54.096427+0000","last_fullsized":"2024-04-25T09:01:54.096427+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:21.504958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"101'8","reported_seq":22,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.695490+0000","last_change":"2024-04-25T09:01:51.686009+0000","last_active":"2024-04-25T09:01:53.695490+0000","last_peered":"2024-04-25T09:01:53.695490+0000","last_clean":"2024-04-25T09:01:53.695490+0000","last_became_active":"2024-04-25T09:01:51.685691+0000","last_became_peered":"2024-04-25T09:01:51.685691+0000","last_unstale":"2024-04-25T09:01:53.695490+0000","last_undegraded":"2024-04-25T09:01:53.695490+0000","last_fullsized":"2024-04-25T09:01:53.695490+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:41.119991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693702+0000","last_change":"2024-04-25T09:01:52.696401+0000","last_active":"2024-04-25T09:01:53.693702+0000","last_peered":"2024-04-25T09:01:53.693702+0000","last_clean":"2024-04-25T09:01:53.693702+0000","last_became_active":"2024-04-25T09:01:52.696116+0000","last_became_peered":"2024-04-25T09:01:52.696116+0000","last_unstale":"2024-04-25T09:01:53.693702+0000","last_undegraded":"2024-04-25T09:01:53.693702+0000","last_fullsized":"2024-04-25T09:01:53.693702+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:43.173439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692960+0000","last_change":"2024-04-25T09:01:51.684399+0000","last_active":"2024-04-25T09:01:53.692960+0000","last_peered":"2024-04-25T09:01:53.692960+0000","last_clean":"2024-04-25T09:01:53.692960+0000","last_became_active":"2024-04-25T09:01:51.684099+0000","last_became_peered":"2024-04-25T09:01:51.684099+0000","last_unstale":"2024-04-25T09:01:53.692960+0000","last_undegraded":"2024-04-25T09:01:53.692960+0000","last_fullsized":"2024-04-25T09:01:53.692960+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:15.299506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000766+0000","last_change":"2024-04-25T09:01:52.703565+0000","last_active":"2024-04-25T09:01:55.000766+0000","last_peered":"2024-04-25T09:01:55.000766+0000","last_clean":"2024-04-25T09:01:55.000766+0000","last_became_active":"2024-04-25T09:01:52.703291+0000","last_became_peered":"2024-04-25T09:01:52.703291+0000","last_unstale":"2024-04-25T09:01:55.000766+0000","last_undegraded":"2024-04-25T09:01:55.000766+0000","last_fullsized":"2024-04-25T09:01:55.000766+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:16.741440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693116+0000","last_change":"2024-04-25T09:01:51.683022+0000","last_active":"2024-04-25T09:01:53.693116+0000","last_peered":"2024-04-25T09:01:53.693116+0000","last_clean":"2024-04-25T09:01:53.693116+0000","last_became_active":"2024-04-25T09:01:51.682744+0000","last_became_peered":"2024-04-25T09:01:51.682744+0000","last_unstale":"2024-04-25T09:01:53.693116+0000","last_undegraded":"2024-04-25T09:01:53.693116+0000","last_fullsized":"2024-04-25T09:01:53.693116+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:45.898743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.001407+0000","last_change":"2024-04-25T09:01:52.695302+0000","last_active":"2024-04-25T09:01:55.001407+0000","last_peered":"2024-04-25T09:01:55.001407+0000","last_clean":"2024-04-25T09:01:55.001407+0000","last_became_active":"2024-04-25T09:01:52.694964+0000","last_became_peered":"2024-04-25T09:01:52.694964+0000","last_unstale":"2024-04-25T09:01:55.001407+0000","last_undegraded":"2024-04-25T09:01:55.001407+0000","last_fullsized":"2024-04-25T09:01:55.001407+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:55.403342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.604993+0000","last_change":"2024-04-25T09:01:51.693495+0000","last_active":"2024-04-25T09:01:54.604993+0000","last_peered":"2024-04-25T09:01:54.604993+0000","last_clean":"2024-04-25T09:01:54.604993+0000","last_became_active":"2024-04-25T09:01:51.692315+0000","last_became_peered":"2024-04-25T09:01:51.692315+0000","last_unstale":"2024-04-25T09:01:54.604993+0000","last_undegraded":"2024-04-25T09:01:54.604993+0000","last_fullsized":"2024-04-25T09:01:54.604993+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:28.649670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096711+0000","last_change":"2024-04-25T09:01:52.700272+0000","last_active":"2024-04-25T09:01:54.096711+0000","last_peered":"2024-04-25T09:01:54.096711+0000","last_clean":"2024-04-25T09:01:54.096711+0000","last_became_active":"2024-04-25T09:01:52.699838+0000","last_became_peered":"2024-04-25T09:01:52.699838+0000","last_unstale":"2024-04-25T09:01:54.096711+0000","last_undegraded":"2024-04-25T09:01:54.096711+0000","last_fullsized":"2024-04-25T09:01:54.096711+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:12.827897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605005+0000","last_change":"2024-04-25T09:01:51.693512+0000","last_active":"2024-04-25T09:01:54.605005+0000","last_peered":"2024-04-25T09:01:54.605005+0000","last_clean":"2024-04-25T09:01:54.605005+0000","last_became_active":"2024-04-25T09:01:51.693189+0000","last_became_peered":"2024-04-25T09:01:51.693189+0000","last_unstale":"2024-04-25T09:01:54.605005+0000","last_undegraded":"2024-04-25T09:01:54.605005+0000","last_fullsized":"2024-04-25T09:01:54.605005+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:55.700281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096658+0000","last_change":"2024-04-25T09:01:52.712476+0000","last_active":"2024-04-25T09:01:54.096658+0000","last_peered":"2024-04-25T09:01:54.096658+0000","last_clean":"2024-04-25T09:01:54.096658+0000","last_became_active":"2024-04-25T09:01:52.712176+0000","last_became_peered":"2024-04-25T09:01:52.712176+0000","last_unstale":"2024-04-25T09:01:54.096658+0000","last_undegraded":"2024-04-25T09:01:54.096658+0000","last_fullsized":"2024-04-25T09:01:54.096658+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:52.609031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000813+0000","last_change":"2024-04-25T09:01:51.689051+0000","last_active":"2024-04-25T09:01:55.000813+0000","last_peered":"2024-04-25T09:01:55.000813+0000","last_clean":"2024-04-25T09:01:55.000813+0000","last_became_active":"2024-04-25T09:01:51.688768+0000","last_became_peered":"2024-04-25T09:01:51.688768+0000","last_unstale":"2024-04-25T09:01:55.000813+0000","last_undegraded":"2024-04-25T09:01:55.000813+0000","last_fullsized":"2024-04-25T09:01:55.000813+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:49.800683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096382+0000","last_change":"2024-04-25T09:01:52.701436+0000","last_active":"2024-04-25T09:01:54.096382+0000","last_peered":"2024-04-25T09:01:54.096382+0000","last_clean":"2024-04-25T09:01:54.096382+0000","last_became_active":"2024-04-25T09:01:52.701096+0000","last_became_peered":"2024-04-25T09:01:52.701096+0000","last_unstale":"2024-04-25T09:01:54.096382+0000","last_undegraded":"2024-04-25T09:01:54.096382+0000","last_fullsized":"2024-04-25T09:01:54.096382+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:00.272347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000596+0000","last_change":"2024-04-25T09:01:51.685224+0000","last_active":"2024-04-25T09:01:55.000596+0000","last_peered":"2024-04-25T09:01:55.000596+0000","last_clean":"2024-04-25T09:01:55.000596+0000","last_became_active":"2024-04-25T09:01:51.684874+0000","last_became_peered":"2024-04-25T09:01:51.684874+0000","last_unstale":"2024-04-25T09:01:55.000596+0000","last_undegraded":"2024-04-25T09:01:55.000596+0000","last_fullsized":"2024-04-25T09:01:55.000596+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:00.417608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692485+0000","last_change":"2024-04-25T09:01:52.703105+0000","last_active":"2024-04-25T09:01:53.692485+0000","last_peered":"2024-04-25T09:01:53.692485+0000","last_clean":"2024-04-25T09:01:53.692485+0000","last_became_active":"2024-04-25T09:01:52.702819+0000","last_became_peered":"2024-04-25T09:01:52.702819+0000","last_unstale":"2024-04-25T09:01:53.692485+0000","last_undegraded":"2024-04-25T09:01:53.692485+0000","last_fullsized":"2024-04-25T09:01:53.692485+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:32.352195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605058+0000","last_change":"2024-04-25T09:01:51.692356+0000","last_active":"2024-04-25T09:01:54.605058+0000","last_peered":"2024-04-25T09:01:54.605058+0000","last_clean":"2024-04-25T09:01:54.605058+0000","last_became_active":"2024-04-25T09:01:51.691925+0000","last_became_peered":"2024-04-25T09:01:51.691925+0000","last_unstale":"2024-04-25T09:01:54.605058+0000","last_undegraded":"2024-04-25T09:01:54.605058+0000","last_fullsized":"2024-04-25T09:01:54.605058+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605395+0000","last_change":"2024-04-25T09:01:52.711183+0000","last_active":"2024-04-25T09:01:54.605395+0000","last_peered":"2024-04-25T09:01:54.605395+0000","last_clean":"2024-04-25T09:01:54.605395+0000","last_became_active":"2024-04-25T09:01:52.710711+0000","last_became_peered":"2024-04-25T09:01:52.710711+0000","last_unstale":"2024-04-25T09:01:54.605395+0000","last_undegraded":"2024-04-25T09:01:54.605395+0000","last_fullsized":"2024-04-25T09:01:54.605395+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:36.311937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.001196+0000","last_change":"2024-04-25T09:01:51.686947+0000","last_active":"2024-04-25T09:01:55.001196+0000","last_peered":"2024-04-25T09:01:55.001196+0000","last_clean":"2024-04-25T09:01:55.001196+0000","last_became_active":"2024-04-25T09:01:51.686297+0000","last_became_peered":"2024-04-25T09:01:51.686297+0000","last_unstale":"2024-04-25T09:01:55.001196+0000","last_undegraded":"2024-04-25T09:01:55.001196+0000","last_fullsized":"2024-04-25T09:01:55.001196+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:25.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.695764+0000","last_change":"2024-04-25T09:01:52.696175+0000","last_active":"2024-04-25T09:01:53.695764+0000","last_peered":"2024-04-25T09:01:53.695764+0000","last_clean":"2024-04-25T09:01:53.695764+0000","last_became_active":"2024-04-25T09:01:52.695877+0000","last_became_peered":"2024-04-25T09:01:52.695877+0000","last_unstale":"2024-04-25T09:01:53.695764+0000","last_undegraded":"2024-04-25T09:01:53.695764+0000","last_fullsized":"2024-04-25T09:01:53.695764+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:37.972017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605390+0000","last_change":"2024-04-25T09:01:51.688454+0000","last_active":"2024-04-25T09:01:54.605390+0000","last_peered":"2024-04-25T09:01:54.605390+0000","last_clean":"2024-04-25T09:01:54.605390+0000","last_became_active":"2024-04-25T09:01:51.688046+0000","last_became_peered":"2024-04-25T09:01:51.688046+0000","last_unstale":"2024-04-25T09:01:54.605390+0000","last_undegraded":"2024-04-25T09:01:54.605390+0000","last_fullsized":"2024-04-25T09:01:54.605390+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:35.523946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.695706+0000","last_change":"2024-04-25T09:01:52.701378+0000","last_active":"2024-04-25T09:01:53.695706+0000","last_peered":"2024-04-25T09:01:53.695706+0000","last_clean":"2024-04-25T09:01:53.695706+0000","last_became_active":"2024-04-25T09:01:52.701112+0000","last_became_peered":"2024-04-25T09:01:52.701112+0000","last_unstale":"2024-04-25T09:01:53.695706+0000","last_undegraded":"2024-04-25T09:01:53.695706+0000","last_fullsized":"2024-04-25T09:01:53.695706+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:18.760666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605090+0000","last_change":"2024-04-25T09:01:51.688326+0000","last_active":"2024-04-25T09:01:54.605090+0000","last_peered":"2024-04-25T09:01:54.605090+0000","last_clean":"2024-04-25T09:01:54.605090+0000","last_became_active":"2024-04-25T09:01:51.688018+0000","last_became_peered":"2024-04-25T09:01:51.688018+0000","last_unstale":"2024-04-25T09:01:54.605090+0000","last_undegraded":"2024-04-25T09:01:54.605090+0000","last_fullsized":"2024-04-25T09:01:54.605090+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:27.486085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692993+0000","last_change":"2024-04-25T09:01:52.691237+0000","last_active":"2024-04-25T09:01:53.692993+0000","last_peered":"2024-04-25T09:01:53.692993+0000","last_clean":"2024-04-25T09:01:53.692993+0000","last_became_active":"2024-04-25T09:01:52.690961+0000","last_became_peered":"2024-04-25T09:01:52.690961+0000","last_unstale":"2024-04-25T09:01:53.692993+0000","last_undegraded":"2024-04-25T09:01:53.692993+0000","last_fullsized":"2024-04-25T09:01:53.692993+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693713+0000","last_change":"2024-04-25T09:01:51.679451+0000","last_active":"2024-04-25T09:01:53.693713+0000","last_peered":"2024-04-25T09:01:53.693713+0000","last_clean":"2024-04-25T09:01:53.693713+0000","last_became_active":"2024-04-25T09:01:51.679204+0000","last_became_peered":"2024-04-25T09:01:51.679204+0000","last_unstale":"2024-04-25T09:01:53.693713+0000","last_undegraded":"2024-04-25T09:01:53.693713+0000","last_fullsized":"2024-04-25T09:01:53.693713+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:15.299506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096694+0000","last_change":"2024-04-25T09:01:52.698600+0000","last_active":"2024-04-25T09:01:54.096694+0000","last_peered":"2024-04-25T09:01:54.096694+0000","last_clean":"2024-04-25T09:01:54.096694+0000","last_became_active":"2024-04-25T09:01:52.698186+0000","last_became_peered":"2024-04-25T09:01:52.698186+0000","last_unstale":"2024-04-25T09:01:54.096694+0000","last_undegraded":"2024-04-25T09:01:54.096694+0000","last_fullsized":"2024-04-25T09:01:54.096694+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:59.899028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.605178+0000","last_change":"2024-04-25T09:01:51.694307+0000","last_active":"2024-04-25T09:01:54.605178+0000","last_peered":"2024-04-25T09:01:54.605178+0000","last_clean":"2024-04-25T09:01:54.605178+0000","last_became_active":"2024-04-25T09:01:51.693908+0000","last_became_peered":"2024-04-25T09:01:51.693908+0000","last_unstale":"2024-04-25T09:01:54.605178+0000","last_undegraded":"2024-04-25T09:01:54.605178+0000","last_fullsized":"2024-04-25T09:01:54.605178+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:43.448108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.693143+0000","last_change":"2024-04-25T09:01:52.694122+0000","last_active":"2024-04-25T09:01:53.693143+0000","last_peered":"2024-04-25T09:01:53.693143+0000","last_clean":"2024-04-25T09:01:53.693143+0000","last_became_active":"2024-04-25T09:01:52.693842+0000","last_became_peered":"2024-04-25T09:01:52.693842+0000","last_unstale":"2024-04-25T09:01:53.693143+0000","last_undegraded":"2024-04-25T09:01:53.693143+0000","last_fullsized":"2024-04-25T09:01:53.693143+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.449998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692610+0000","last_change":"2024-04-25T09:01:51.677502+0000","last_active":"2024-04-25T09:01:53.692610+0000","last_peered":"2024-04-25T09:01:53.692610+0000","last_clean":"2024-04-25T09:01:53.692610+0000","last_became_active":"2024-04-25T09:01:51.677227+0000","last_became_peered":"2024-04-25T09:01:51.677227+0000","last_unstale":"2024-04-25T09:01:53.692610+0000","last_undegraded":"2024-04-25T09:01:53.692610+0000","last_fullsized":"2024-04-25T09:01:53.692610+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:49.800683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096380+0000","last_change":"2024-04-25T09:01:52.697387+0000","last_active":"2024-04-25T09:01:54.096380+0000","last_peered":"2024-04-25T09:01:54.096380+0000","last_clean":"2024-04-25T09:01:54.096380+0000","last_became_active":"2024-04-25T09:01:52.697042+0000","last_became_peered":"2024-04-25T09:01:52.697042+0000","last_unstale":"2024-04-25T09:01:54.096380+0000","last_undegraded":"2024-04-25T09:01:54.096380+0000","last_fullsized":"2024-04-25T09:01:54.096380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:17.162954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000599+0000","last_change":"2024-04-25T09:01:51.677381+0000","last_active":"2024-04-25T09:01:55.000599+0000","last_peered":"2024-04-25T09:01:55.000599+0000","last_clean":"2024-04-25T09:01:55.000599+0000","last_became_active":"2024-04-25T09:01:51.677062+0000","last_became_peered":"2024-04-25T09:01:51.677062+0000","last_unstale":"2024-04-25T09:01:55.000599+0000","last_undegraded":"2024-04-25T09:01:55.000599+0000","last_fullsized":"2024-04-25T09:01:55.000599+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:53.692553+0000","last_change":"2024-04-25T09:01:52.691546+0000","last_active":"2024-04-25T09:01:53.692553+0000","last_peered":"2024-04-25T09:01:53.692553+0000","last_clean":"2024-04-25T09:01:53.692553+0000","last_became_active":"2024-04-25T09:01:52.691230+0000","last_became_peered":"2024-04-25T09:01:52.691230+0000","last_unstale":"2024-04-25T09:01:53.692553+0000","last_undegraded":"2024-04-25T09:01:53.692553+0000","last_fullsized":"2024-04-25T09:01:53.692553+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:29.651560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096518+0000","last_change":"2024-04-25T09:01:51.692499+0000","last_active":"2024-04-25T09:01:54.096518+0000","last_peered":"2024-04-25T09:01:54.096518+0000","last_clean":"2024-04-25T09:01:54.096518+0000","last_became_active":"2024-04-25T09:01:51.692119+0000","last_became_peered":"2024-04-25T09:01:51.692119+0000","last_unstale":"2024-04-25T09:01:54.096518+0000","last_undegraded":"2024-04-25T09:01:54.096518+0000","last_fullsized":"2024-04-25T09:01:54.096518+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.202286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:54.096881+0000","last_change":"2024-04-25T09:01:52.701340+0000","last_active":"2024-04-25T09:01:54.096881+0000","last_peered":"2024-04-25T09:01:54.096881+0000","last_clean":"2024-04-25T09:01:54.096881+0000","last_became_active":"2024-04-25T09:01:52.701041+0000","last_became_peered":"2024-04-25T09:01:52.701041+0000","last_unstale":"2024-04-25T09:01:54.096881+0000","last_undegraded":"2024-04-25T09:01:54.096881+0000","last_fullsized":"2024-04-25T09:01:54.096881+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:51.664131+0000","last_clean_scrub_stamp":"2024-04-25T09:01:51.664131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:41.764193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.000589+0000","last_change":"2024-04-25T09:01:51.688495+0000","last_active":"2024-04-25T09:01:55.000589+0000","last_peered":"2024-04-25T09:01:55.000589+0000","last_clean":"2024-04-25T09:01:55.000589+0000","last_became_active":"2024-04-25T09:01:51.688257+0000","last_became_peered":"2024-04-25T09:01:51.688257+0000","last_unstale":"2024-04-25T09:01:55.000589+0000","last_undegraded":"2024-04-25T09:01:55.000589+0000","last_fullsized":"2024-04-25T09:01:55.000589+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:50.662241+0000","last_clean_scrub_stamp":"2024-04-25T09:01:50.662241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.251208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":317,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T09:01:55.001093+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T09:01:55.001093+0000","last_peered":"2024-04-25T09:01:55.001093+0000","last_clean":"2024-04-25T09:01:55.001093+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:01:55.001093+0000","last_undegraded":"2024-04-25T09:01:55.001093+0000","last_fullsized":"2024-04-25T09:01:55.001093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509546,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32992,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338848,"statfs":{"total":96636764160,"available":96602980352,"internally_reserved":0,"allocated":1855488,"data_stored":1130251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509544,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1261568,"data_stored":540423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509546,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1257472,"data_stored":539841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509545,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":541507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509545,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1269760,"data_stored":541405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509547,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1257472,"data_stored":539805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509545,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37148,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334692,"statfs":{"total":96636764160,"available":96598724608,"internally_reserved":0,"allocated":1851392,"data_stored":1130721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":539771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:00.873 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:02:00.873 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:02:01.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.029+0000 7fe3a4570640 1 Processor -- start 2024-04-25T09:02:01.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.030+0000 7fe3a4570640 1 -- start start 2024-04-25T09:02:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.030+0000 7fe3a4570640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe39c0b4220 0x7fe39c0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.030+0000 7fe3a4570640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0ae500 0x7fe39c0ae990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.030+0000 7fe3a4570640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c0b2d60 con 0x7fe39c155080 2024-04-25T09:02:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a4570640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c0b3030 con 0x7fe39c0b4220 2024-04-25T09:02:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a4570640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0b3310 con 0x7fe39c0ae500 2024-04-25T09:02:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a1b0b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe39c0b4220 0x7fe39c0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a2b0d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0ae500 0x7fe39c0ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a2b0d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0ae500 0x7fe39c0ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:51248/0 (socket says 172.21.15.55:51248) 2024-04-25T09:02:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a230c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe39c155080 0x7fe39c0b2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:60444/0 (socket says 172.21.15.55:60444) 2024-04-25T09:02:01.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a2b0d640 1 -- 172.21.15.55:0/1836916889 learned_addr learned my addr 172.21.15.55:0/1836916889 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:01.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a1b0b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe39c0b4220 0x7fe39c0b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:55500/0 (socket says 172.21.15.55:55500) 2024-04-25T09:02:01.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a2b0d640 1 -- 172.21.15.55:0/1836916889 >> v2:172.21.15.167:3300/0 conn(0x7fe39c0b4220 msgr2=0x7fe39c0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:01.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a2b0d640 1 --2- 172.21.15.55:0/1836916889 >> v2:172.21.15.167:3300/0 conn(0x7fe39c0b4220 0x7fe39c0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a2b0d640 1 -- 172.21.15.55:0/1836916889 >> v1:172.21.15.167:6789/0 conn(0x7fe39c155080 legacy=0x7fe39c0b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.031+0000 7fe3a2b0d640 1 -- 172.21.15.55:0/1836916889 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c15c100 con 0x7fe39c0ae500 2024-04-25T09:02:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.032+0000 7fe3a2b0d640 1 --2- 172.21.15.55:0/1836916889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0ae500 0x7fe39c0ae990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe394009e50 tx=0x7fe39402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e189399b6a28b148 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.032+0000 7fe3a130a640 1 -- 172.21.15.55:0/1836916889 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394036070 con 0x7fe39c0ae500 2024-04-25T09:02:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.032+0000 7fe3a130a640 1 -- 172.21.15.55:0/1836916889 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe394031600 con 0x7fe39c0ae500 2024-04-25T09:02:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.032+0000 7fe3a130a640 1 -- 172.21.15.55:0/1836916889 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3940319d0 con 0x7fe39c0ae500 2024-04-25T09:02:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.033+0000 7fe3a4570640 1 -- 172.21.15.55:0/1836916889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0ae500 msgr2=0x7fe39c0ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.033+0000 7fe3a4570640 1 --2- 172.21.15.55:0/1836916889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0ae500 0x7fe39c0ae990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe394009e50 tx=0x7fe39402a710 comp rx=0 tx=0).stop 2024-04-25T09:02:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.033+0000 7fe3a4570640 1 -- 172.21.15.55:0/1836916889 shutdown_connections 2024-04-25T09:02:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.033+0000 7fe3a4570640 1 --2- 172.21.15.55:0/1836916889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0ae500 0x7fe39c0ae990 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.033+0000 7fe3a4570640 1 --2- 172.21.15.55:0/1836916889 >> v2:172.21.15.167:3300/0 conn(0x7fe39c0b4220 0x7fe39c0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.033+0000 7fe3a4570640 1 -- 172.21.15.55:0/1836916889 >> 172.21.15.55:0/1836916889 conn(0x7fe39c06aba0 msgr2=0x7fe39c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.033+0000 7fe3a4570640 1 -- 172.21.15.55:0/1836916889 shutdown_connections 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.033+0000 7fe3a4570640 1 -- 172.21.15.55:0/1836916889 wait complete. 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.034+0000 7fe3a4570640 1 Processor -- start 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.034+0000 7fe3a4570640 1 -- start start 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a4570640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe39c0ae500 0x7fe39c153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a4570640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0b4220 0x7fe39c0c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a4570640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe39c155080 0x7fe39c0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a4570640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c15b060 con 0x7fe39c0ae500 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a4570640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0b35f0 con 0x7fe39c155080 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a4570640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c15b1e0 con 0x7fe39c0b4220 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a230c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe39c0ae500 0x7fe39c153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a230c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe39c0ae500 0x7fe39c153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39716/0 (socket says 172.21.15.55:39716) 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a230c640 1 -- 172.21.15.55:0/1055546462 learned_addr learned my addr 172.21.15.55:0/1055546462 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:01.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a1b0b640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0b4220 0x7fe39c0c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a2b0d640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe39c155080 0x7fe39c0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a230c640 1 -- 172.21.15.55:0/1055546462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0b4220 msgr2=0x7fe39c0c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a230c640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0b4220 0x7fe39c0c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a230c640 1 -- 172.21.15.55:0/1055546462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe39c155080 msgr2=0x7fe39c0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a230c640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe39c155080 0x7fe39c0c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a230c640 1 -- 172.21.15.55:0/1055546462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c0ae220 con 0x7fe39c0ae500 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.035+0000 7fe3a230c640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe39c0ae500 0x7fe39c153190 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fe39800c3f0 tx=0x7fe39800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.036+0000 7fe392ffd640 1 -- 172.21.15.55:0/1055546462 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3980074e0 con 0x7fe39c0ae500 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.036+0000 7fe392ffd640 1 -- 172.21.15.55:0/1055546462 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398007680 con 0x7fe39c0ae500 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.036+0000 7fe392ffd640 1 -- 172.21.15.55:0/1055546462 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398004a00 con 0x7fe39c0ae500 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.036+0000 7fe3a4570640 1 -- 172.21.15.55:0/1055546462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c0adf40 con 0x7fe39c0ae500 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.036+0000 7fe3a4570640 1 -- 172.21.15.55:0/1055546462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c156870 con 0x7fe39c0ae500 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.037+0000 7fe3a4570640 1 -- 172.21.15.55:0/1055546462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c0749b0 con 0x7fe39c0ae500 2024-04-25T09:02:01.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.037+0000 7fe392ffd640 1 -- 172.21.15.55:0/1055546462 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe39801a020 con 0x7fe39c0ae500 2024-04-25T09:02:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.037+0000 7fe392ffd640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe38006b4d0 0x7fe38006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.038+0000 7fe392ffd640 1 -- 172.21.15.55:0/1055546462 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe398089810 con 0x7fe39c0ae500 2024-04-25T09:02:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.038+0000 7fe3a1b0b640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe38006b4d0 0x7fe38006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.038+0000 7fe3a1b0b640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe38006b4d0 0x7fe38006d990 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe39c158560 tx=0x7fe38c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:01.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.042+0000 7fe392ffd640 1 -- 172.21.15.55:0/1055546462 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe398058040 con 0x7fe39c0ae500 2024-04-25T09:02:01.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.289+0000 7fe3a4570640 1 -- 172.21.15.55:0/1055546462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe39c06ef70 con 0x7fe39c0ae500 2024-04-25T09:02:01.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.295+0000 7fe392ffd640 1 -- 172.21.15.55:0/1055546462 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe39805c0e0 con 0x7fe39c0ae500 2024-04-25T09:02:01.284 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-04-25T09:02:01.284 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw== 2024-04-25T09:02:01.284 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2024-04-25T09:02:01.284 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2024-04-25T09:02:01.284 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:02:01.284 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-25T09:02:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 -- 172.21.15.55:0/1055546462 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe38006b4d0 msgr2=0x7fe38006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe38006b4d0 0x7fe38006d990 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe39c158560 tx=0x7fe38c009190 comp rx=0 tx=0).stop 2024-04-25T09:02:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 -- 172.21.15.55:0/1055546462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe39c0ae500 msgr2=0x7fe39c153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe39c0ae500 0x7fe39c153190 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fe39800c3f0 tx=0x7fe39800c8b0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 -- 172.21.15.55:0/1055546462 shutdown_connections 2024-04-25T09:02:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe38006b4d0 0x7fe38006d990 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe39c155080 0x7fe39c0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe39c0b4220 0x7fe39c0c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 --2- 172.21.15.55:0/1055546462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe39c0ae500 0x7fe39c153190 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 -- 172.21.15.55:0/1055546462 >> 172.21.15.55:0/1055546462 conn(0x7fe39c06aba0 msgr2=0x7fe39c1541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 -- 172.21.15.55:0/1055546462 shutdown_connections 2024-04-25T09:02:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.297+0000 7fe3a4570640 1 -- 172.21.15.55:0/1055546462 wait complete. 2024-04-25T09:02:01.297 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.410+0000 7fe6d2a1f640 1 Processor -- start 2024-04-25T09:02:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.410+0000 7fe6d2a1f640 1 -- start start 2024-04-25T09:02:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.411+0000 7fe6d2a1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6cc15dce0 0x7fe6cc0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.411+0000 7fe6d2a1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6cc0b5b60 0x7fe6cc0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.411+0000 7fe6d2a1f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc15e0c0 con 0x7fe6cc0d35b0 2024-04-25T09:02:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.411+0000 7fe6d2a1f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6cc0d2510 con 0x7fe6cc15dce0 2024-04-25T09:02:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.411+0000 7fe6d2a1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0d27f0 con 0x7fe6cc0b5b60 2024-04-25T09:02:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.411+0000 7fe6cbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6cc15dce0 0x7fe6cc0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.411+0000 7fe6cbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6cc15dce0 0x7fe6cc0d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39732/0 (socket says 172.21.15.55:39732) 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.411+0000 7fe6cbfff640 1 -- 172.21.15.55:0/2631148456 learned_addr learned my addr 172.21.15.55:0/2631148456 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.411+0000 7fe6d0fbc640 1 --2- 172.21.15.55:0/2631148456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6cc0b5b60 0x7fe6cc0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.411+0000 7fe6cbfff640 1 -- 172.21.15.55:0/2631148456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6cc0b5b60 msgr2=0x7fe6cc0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.411+0000 7fe6cbfff640 1 --2- 172.21.15.55:0/2631148456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6cc0b5b60 0x7fe6cc0b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.412+0000 7fe6cbfff640 1 -- 172.21.15.55:0/2631148456 >> v1:172.21.15.167:6789/0 conn(0x7fe6cc0d35b0 legacy=0x7fe6cc0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.412+0000 7fe6cbfff640 1 -- 172.21.15.55:0/2631148456 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc0d2ad0 con 0x7fe6cc15dce0 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.412+0000 7fe6cbfff640 1 --2- 172.21.15.55:0/2631148456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6cc15dce0 0x7fe6cc0d1a50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009870 tx=0x7fe6c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03615c8bccb3b1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.412+0000 7fe6caffd640 1 -- 172.21.15.55:0/2631148456 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0037070 con 0x7fe6cc15dce0 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.412+0000 7fe6caffd640 1 -- 172.21.15.55:0/2631148456 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c0032440 con 0x7fe6cc15dce0 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.412+0000 7fe6caffd640 1 -- 172.21.15.55:0/2631148456 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0032810 con 0x7fe6cc15dce0 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.413+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/2631148456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6cc15dce0 msgr2=0x7fe6cc0d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.413+0000 7fe6d2a1f640 1 --2- 172.21.15.55:0/2631148456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6cc15dce0 0x7fe6cc0d1a50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009870 tx=0x7fe6c002a270 comp rx=0 tx=0).stop 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.413+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/2631148456 shutdown_connections 2024-04-25T09:02:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.413+0000 7fe6d2a1f640 1 --2- 172.21.15.55:0/2631148456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6cc0b5b60 0x7fe6cc0b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.413+0000 7fe6d2a1f640 1 --2- 172.21.15.55:0/2631148456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6cc15dce0 0x7fe6cc0d1a50 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.413+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/2631148456 >> 172.21.15.55:0/2631148456 conn(0x7fe6cc072900 msgr2=0x7fe6cc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:01.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.413+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/2631148456 shutdown_connections 2024-04-25T09:02:01.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.413+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/2631148456 wait complete. 2024-04-25T09:02:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.414+0000 7fe6d2a1f640 1 Processor -- start 2024-04-25T09:02:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.414+0000 7fe6d2a1f640 1 -- start start 2024-04-25T09:02:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.415+0000 7fe6d2a1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6cc0b5b60 0x7fe6cc0c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.415+0000 7fe6d2a1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6cc0d35b0 0x7fe6cc14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.415+0000 7fe6d2a1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6cc15dce0 0x7fe6cc15f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.415+0000 7fe6d2a1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0b9820 con 0x7fe6cc15dce0 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.415+0000 7fe6d2a1f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0d3090 con 0x7fe6cc0b5b60 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.415+0000 7fe6d2a1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0b99a0 con 0x7fe6cc0d35b0 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.415+0000 7fe6d0fbc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6cc15dce0 0x7fe6cc15f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.415+0000 7fe6d0fbc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6cc15dce0 0x7fe6cc15f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39734/0 (socket says 172.21.15.55:39734) 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.415+0000 7fe6d0fbc640 1 -- 172.21.15.55:0/3375904949 learned_addr learned my addr 172.21.15.55:0/3375904949 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.415+0000 7fe6cbfff640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6cc0b5b60 0x7fe6cc0c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.415+0000 7fe6cb7fe640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6cc0d35b0 0x7fe6cc14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.416+0000 7fe6d0fbc640 1 -- 172.21.15.55:0/3375904949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6cc0d35b0 msgr2=0x7fe6cc14a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.416+0000 7fe6d0fbc640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6cc0d35b0 0x7fe6cc14a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.416+0000 7fe6d0fbc640 1 -- 172.21.15.55:0/3375904949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6cc0b5b60 msgr2=0x7fe6cc0c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.416+0000 7fe6d0fbc640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6cc0b5b60 0x7fe6cc0c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.416+0000 7fe6d0fbc640 1 -- 172.21.15.55:0/3375904949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc14b480 con 0x7fe6cc15dce0 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.416+0000 7fe6d0fbc640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6cc15dce0 0x7fe6cc15f540 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4007e40 tx=0x7fe6c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.416+0000 7fe6c8ff9640 1 -- 172.21.15.55:0/3375904949 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4014620 con 0x7fe6cc15dce0 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.416+0000 7fe6c8ff9640 1 -- 172.21.15.55:0/3375904949 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c4019070 con 0x7fe6cc15dce0 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.416+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/3375904949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6cc14a900 con 0x7fe6cc15dce0 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.416+0000 7fe6c8ff9640 1 -- 172.21.15.55:0/3375904949 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4014a20 con 0x7fe6cc15dce0 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.416+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/3375904949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6cc14aec0 con 0x7fe6cc15dce0 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.417+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/3375904949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6cc0749b0 con 0x7fe6cc15dce0 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.417+0000 7fe6c8ff9640 1 -- 172.21.15.55:0/3375904949 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe6c4014bc0 con 0x7fe6cc15dce0 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.418+0000 7fe6c8ff9640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6b806b4d0 0x7fe6b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.418+0000 7fe6c8ff9640 1 -- 172.21.15.55:0/3375904949 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6c408a970 con 0x7fe6cc15dce0 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.418+0000 7fe6cbfff640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6b806b4d0 0x7fe6b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.418+0000 7fe6cbfff640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6b806b4d0 0x7fe6b806d990 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0034000 tx=0x7fe6c002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.422+0000 7fe6c8ff9640 1 -- 172.21.15.55:0/3375904949 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe6c40591a0 con 0x7fe6cc15dce0 2024-04-25T09:02:01.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.642+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/3375904949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6cc15d320 con 0x7fe6cc15dce0 2024-04-25T09:02:01.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.643+0000 7fe6c8ff9640 1 -- 172.21.15.55:0/3375904949 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fe6c405d240 con 0x7fe6cc15dce0 2024-04-25T09:02:01.631 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:01.631 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:01:54.470378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/538888347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":538888347},{"type":"v1","addr":"172.21.15.55:6837","nonce":538888347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:02:01.632 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 72 2024-04-25T09:02:01.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/3375904949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6b806b4d0 msgr2=0x7fe6b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6b806b4d0 0x7fe6b806d990 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0034000 tx=0x7fe6c002e000 comp rx=0 tx=0).stop 2024-04-25T09:02:01.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/3375904949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6cc15dce0 msgr2=0x7fe6cc15f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6cc15dce0 0x7fe6cc15f540 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4007e40 tx=0x7fe6c400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/3375904949 shutdown_connections 2024-04-25T09:02:01.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe6b806b4d0 0x7fe6b806d990 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6cc15dce0 0x7fe6cc15f540 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6cc0d35b0 0x7fe6cc14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 --2- 172.21.15.55:0/3375904949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6cc0b5b60 0x7fe6cc0c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/3375904949 >> 172.21.15.55:0/3375904949 conn(0x7fe6cc072900 msgr2=0x7fe6cc0b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:01.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/3375904949 shutdown_connections 2024-04-25T09:02:01.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:01.645+0000 7fe6d2a1f640 1 -- 172.21.15.55:0/3375904949 wait complete. 2024-04-25T09:02:02.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:01:52.042907+0000', 'modified': '2024-04-25T09:01:54.470378+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8244}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8244': {'gid': 8244, 'name': 'c', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/538888347', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 538888347}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 538888347}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:02:02.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:02:02.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.164+0000 7f2f32a22640 1 Processor -- start 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.165+0000 7f2f32a22640 1 -- start start 2024-04-25T09:02:02.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.165+0000 7f2f32a22640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f2c15ef60 0x7f2f2c0ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.165+0000 7f2f32a22640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f2c0cea00 0x7f2f2c0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.165+0000 7f2f32a22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f2c0b0c80 0x7f2f2c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.165+0000 7f2f32a22640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c0b1090 con 0x7f2f2c15ef60 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.165+0000 7f2f32a22640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c15f660 con 0x7f2f2c0cea00 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.165+0000 7f2f32a22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c15f940 con 0x7f2f2c0b0c80 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.165+0000 7f2f2bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f2c15ef60 0x7f2f2c0ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.165+0000 7f2f2bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f2c15ef60 0x7f2f2c0ce4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39742/0 (socket says 172.21.15.55:39742) 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.165+0000 7f2f2bfff640 1 -- 172.21.15.55:0/3359404814 learned_addr learned my addr 172.21.15.55:0/3359404814 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.166+0000 7f2f30fbf640 1 --2- 172.21.15.55:0/3359404814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f2c0b0c80 0x7f2f2c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.166+0000 7f2f2b7fe640 1 --2- 172.21.15.55:0/3359404814 >> v2:172.21.15.167:3300/0 conn(0x7f2f2c0cea00 0x7f2f2c0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.166+0000 7f2f2bfff640 1 -- 172.21.15.55:0/3359404814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f2c0b0c80 msgr2=0x7f2f2c0b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.166+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/3359404814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f2c0b0c80 0x7f2f2c0b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.166+0000 7f2f2bfff640 1 -- 172.21.15.55:0/3359404814 >> v2:172.21.15.167:3300/0 conn(0x7f2f2c0cea00 msgr2=0x7f2f2c0b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.166+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/3359404814 >> v2:172.21.15.167:3300/0 conn(0x7f2f2c0cea00 0x7f2f2c0b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.166+0000 7f2f2bfff640 1 -- 172.21.15.55:0/3359404814 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c15fc20 con 0x7f2f2c15ef60 2024-04-25T09:02:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/3359404814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c15ef60 0x7f2f2c0ce4c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0d17b0 tx=0x7f2f1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee312404ffa6bee8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f2affd640 1 -- 172.21.15.55:0/3359404814 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14037070 con 0x7f2f2c15ef60 2024-04-25T09:02:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f2affd640 1 -- 172.21.15.55:0/3359404814 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f14032440 con 0x7f2f2c15ef60 2024-04-25T09:02:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f2affd640 1 -- 172.21.15.55:0/3359404814 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14032810 con 0x7f2f2c15ef60 2024-04-25T09:02:02.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f32a22640 1 -- 172.21.15.55:0/3359404814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c15ef60 msgr2=0x7f2f2c0ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f32a22640 1 --2- 172.21.15.55:0/3359404814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c15ef60 0x7f2f2c0ce4c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0d17b0 tx=0x7f2f1402a270 comp rx=0 tx=0).stop 2024-04-25T09:02:02.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f32a22640 1 -- 172.21.15.55:0/3359404814 shutdown_connections 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f32a22640 1 --2- 172.21.15.55:0/3359404814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f2c0b0c80 0x7f2f2c0b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f32a22640 1 --2- 172.21.15.55:0/3359404814 >> v2:172.21.15.167:3300/0 conn(0x7f2f2c0cea00 0x7f2f2c0b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f32a22640 1 --2- 172.21.15.55:0/3359404814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c15ef60 0x7f2f2c0ce4c0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f32a22640 1 -- 172.21.15.55:0/3359404814 >> 172.21.15.55:0/3359404814 conn(0x7f2f2c06f4c0 msgr2=0x7f2f2c06f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f32a22640 1 -- 172.21.15.55:0/3359404814 shutdown_connections 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.167+0000 7f2f32a22640 1 -- 172.21.15.55:0/3359404814 wait complete. 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.168+0000 7f2f32a22640 1 Processor -- start 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.169+0000 7f2f32a22640 1 -- start start 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.169+0000 7f2f32a22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f2c0b0c80 0x7f2f2c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.169+0000 7f2f32a22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2c0cea00 0x7f2f2c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.169+0000 7f2f32a22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c15ef60 0x7f2f2c0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.169+0000 7f2f32a22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1604c0 con 0x7f2f2c15ef60 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.169+0000 7f2f32a22640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1601e0 con 0x7f2f2c0cea00 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.169+0000 7f2f32a22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c15f340 con 0x7f2f2c0b0c80 2024-04-25T09:02:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.169+0000 7f2f30fbf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c15ef60 0x7f2f2c0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.169+0000 7f2f30fbf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c15ef60 0x7f2f2c0cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39748/0 (socket says 172.21.15.55:39748) 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.169+0000 7f2f30fbf640 1 -- 172.21.15.55:0/1142323525 learned_addr learned my addr 172.21.15.55:0/1142323525 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f2b7fe640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2c0cea00 0x7f2f2c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f2c0b0c80 0x7f2f2c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f30fbf640 1 -- 172.21.15.55:0/1142323525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f2c0b0c80 msgr2=0x7f2f2c15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f30fbf640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f2c0b0c80 0x7f2f2c15a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f30fbf640 1 -- 172.21.15.55:0/1142323525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2c0cea00 msgr2=0x7f2f2c0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f30fbf640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2c0cea00 0x7f2f2c0ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f30fbf640 1 -- 172.21.15.55:0/1142323525 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c0b28c0 con 0x7f2f2c15ef60 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f30fbf640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c15ef60 0x7f2f2c0cacd0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f2f24007e60 tx=0x7f2f2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f28ff9640 1 -- 172.21.15.55:0/1142323525 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24014620 con 0x7f2f2c15ef60 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f28ff9640 1 -- 172.21.15.55:0/1142323525 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f24019070 con 0x7f2f2c15ef60 2024-04-25T09:02:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f32a22640 1 -- 172.21.15.55:0/1142323525 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c14e8a0 con 0x7f2f2c15ef60 2024-04-25T09:02:02.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f28ff9640 1 -- 172.21.15.55:0/1142323525 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24014a20 con 0x7f2f2c15ef60 2024-04-25T09:02:02.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.170+0000 7f2f32a22640 1 -- 172.21.15.55:0/1142323525 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c0c80b0 con 0x7f2f2c15ef60 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.172+0000 7f2f28ff9640 1 -- 172.21.15.55:0/1142323525 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f24014bc0 con 0x7f2f2c15ef60 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.172+0000 7f2f28ff9640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2f0c06b4d0 0x7f2f0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.172+0000 7f2f28ff9640 1 -- 172.21.15.55:0/1142323525 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f2408aa50 con 0x7f2f2c15ef60 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.172+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2f0c06b4d0 0x7f2f0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.173+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2f0c06b4d0 0x7f2f0c06d990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2f14034000 tx=0x7f2f1402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.173+0000 7f2f357fd740 1 Processor -- start 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.173+0000 7f2f357fd740 1 -- start start 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a05230 0x55ea33a05610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a23020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea339daf10 0x55ea33a21190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f357fd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3393da10 con 0x55ea339daf10 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f357fd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea338e6b30 con 0x55ea33a05230 2024-04-25T09:02:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f357fd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea33939c50 con 0x55ea33a22ad0 2024-04-25T09:02:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f30fbf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea339daf10 0x55ea33a21190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f30fbf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea339daf10 0x55ea33a21190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39756/0 (socket says 172.21.15.55:39756) 2024-04-25T09:02:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f30fbf640 1 -- 172.21.15.55:0/2901428485 learned_addr learned my addr 172.21.15.55:0/2901428485 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f2b7fe640 1 --2- 172.21.15.55:0/2901428485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a23020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/2901428485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a05230 0x55ea33a05610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f30fbf640 1 -- 172.21.15.55:0/2901428485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 msgr2=0x55ea33a23020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f30fbf640 1 --2- 172.21.15.55:0/2901428485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a23020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f30fbf640 1 -- 172.21.15.55:0/2901428485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a05230 msgr2=0x55ea33a05610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f30fbf640 1 --2- 172.21.15.55:0/2901428485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a05230 0x55ea33a05610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f30fbf640 1 -- 172.21.15.55:0/2901428485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea338fbe10 con 0x55ea339daf10 2024-04-25T09:02:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f30fbf640 1 --2- 172.21.15.55:0/2901428485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea339daf10 0x55ea33a21190 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f2f24089010 tx=0x7f2f24059940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a685b7ca8fb67809 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f21ffb640 1 -- 172.21.15.55:0/2901428485 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2405d170 con 0x55ea339daf10 2024-04-25T09:02:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f21ffb640 1 -- 172.21.15.55:0/2901428485 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f24061950 con 0x55ea339daf10 2024-04-25T09:02:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.174+0000 7f2f21ffb640 1 -- 172.21.15.55:0/2901428485 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240558b0 con 0x55ea339daf10 2024-04-25T09:02:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.175+0000 7f2f357fd740 1 -- 172.21.15.55:0/2901428485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea339daf10 msgr2=0x55ea33a21190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.175+0000 7f2f357fd740 1 --2- 172.21.15.55:0/2901428485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea339daf10 0x55ea33a21190 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f2f24089010 tx=0x7f2f24059940 comp rx=0 tx=0).stop 2024-04-25T09:02:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.175+0000 7f2f357fd740 1 -- 172.21.15.55:0/2901428485 shutdown_connections 2024-04-25T09:02:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.175+0000 7f2f357fd740 1 --2- 172.21.15.55:0/2901428485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea339daf10 0x55ea33a21190 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.175+0000 7f2f357fd740 1 --2- 172.21.15.55:0/2901428485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a23020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.175+0000 7f2f357fd740 1 --2- 172.21.15.55:0/2901428485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a05230 0x55ea33a05610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.175+0000 7f2f357fd740 1 -- 172.21.15.55:0/2901428485 >> 172.21.15.55:0/2901428485 conn(0x55ea339d7840 msgr2=0x55ea33a20040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.175+0000 7f2f357fd740 1 -- 172.21.15.55:0/2901428485 shutdown_connections 2024-04-25T09:02:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.175+0000 7f2f357fd740 1 -- 172.21.15.55:0/2901428485 wait complete. 2024-04-25T09:02:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.175+0000 7f2f357fd740 1 -- start start 2024-04-25T09:02:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.176+0000 7f2f357fd740 1 Processor -- start 2024-04-25T09:02:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.176+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a05230 0x55ea33a018f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.176+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a08900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.176+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a01e30 0x55ea33a259e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.176+0000 7f2f357fd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea339dbcb0 con 0x55ea33a01e30 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.176+0000 7f2f357fd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea338fa0c0 con 0x55ea33a05230 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.176+0000 7f2f357fd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea339d5770 con 0x55ea33a22ad0 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f357fd740 10 client.0 _ll_register_callbacks cb 0x55ea338edec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f30fbf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a01e30 0x55ea33a259e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f30fbf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a01e30 0x55ea33a259e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39764/0 (socket says 172.21.15.55:39764) 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f30fbf640 1 -- 172.21.15.55:0/3700246380 learned_addr learned my addr 172.21.15.55:0/3700246380 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f2b7fe640 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a08900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a05230 0x55ea33a018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f30fbf640 1 -- 172.21.15.55:0/3700246380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 msgr2=0x55ea33a08900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f30fbf640 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a08900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f30fbf640 1 -- 172.21.15.55:0/3700246380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a05230 msgr2=0x55ea33a018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f30fbf640 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a05230 0x55ea33a018f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f30fbf640 1 -- 172.21.15.55:0/3700246380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea336522d0 con 0x55ea33a01e30 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f30fbf640 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a01e30 0x55ea33a259e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f2f24059af0 tx=0x7f2f24007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e6f1183623b25a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f0affd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f0affd640 1 -- 172.21.15.55:0/3700246380 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24074030 con 0x55ea33a01e30 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f0affd640 1 -- 172.21.15.55:0/3700246380 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f24087040 con 0x55ea33a01e30 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f357fd740 1 -- 172.21.15.55:0/3700246380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f24061950 con 0x55ea33a01e30 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f0affd640 1 -- 172.21.15.55:0/3700246380 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f24081050 con 0x55ea33a01e30 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f357fd740 10 client.8421 fetch_fsmap learned FSMap version 72 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f357fd740 1 -- 172.21.15.55:0/3700246380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55ea3371c6b0 con 0x55ea33a01e30 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.177+0000 7f2f0affd640 1 -- 172.21.15.55:0/3700246380 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f24061950 con 0x55ea33a01e30 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.178+0000 7f2f0affd640 1 -- 172.21.15.55:0/3700246380 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2f24070030 con 0x55ea33a01e30 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.178+0000 7f2f357fd740 10 client.8421 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.178+0000 7f2f357fd740 10 client.8421 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.178+0000 7f2f357fd740 20 client.8421 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.178+0000 7f2f357fd740 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55ea33a063c0 0x55ea33a3df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.178+0000 7f2f357fd740 4 client.8421 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.178+0000 7f2f357fd740 1 -- 172.21.15.55:0/3700246380 --> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea3399c920 con 0x55ea33a063c0 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.178+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55ea33a063c0 0x55ea33a3df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.178+0000 7f2f0affd640 10 client.8421 ms_handle_connect on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.178+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55ea33a063c0 0x55ea33a3df90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=217b9a836dcc5882 server_cookie=2b8979dcef1a00d7 in_seq=0 out_seq=0 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f0affd640 1 -- 172.21.15.55:0/3700246380 <== mds.0 v2:172.21.15.55:6834/538888347 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ea3399c920 con 0x55ea33a063c0 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f0affd640 10 client.8421 handle_command_reply: tid=0 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 1 client.8421 shutdown 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 1 -- 172.21.15.55:0/3700246380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a01e30 msgr2=0x55ea33a259e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a01e30 0x55ea33a259e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f2f24059af0 tx=0x7f2f24007f50 comp rx=0 tx=0).stop 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 1 -- 172.21.15.55:0/3700246380 shutdown_connections 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55ea33a063c0 0x55ea33a3df90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a01e30 0x55ea33a259e0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a08900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f0affd640 0 client.8421 ms_handle_reset on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 1 --2- 172.21.15.55:0/3700246380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a05230 0x55ea33a018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 1 -- 172.21.15.55:0/3700246380 >> 172.21.15.55:0/3700246380 conn(0x55ea339daf10 msgr2=0x55ea33a235c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 1 -- 172.21.15.55:0/3700246380 shutdown_connections 2024-04-25T09:02:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 1 -- 172.21.15.55:0/3700246380 wait complete. 2024-04-25T09:02:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.179+0000 7f2f357fd740 20 client.8421 trim_cache size 0 max 16384 2024-04-25T09:02:02.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.195+0000 7f2f357fd740 1 Processor -- start 2024-04-25T09:02:02.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.195+0000 7f2f357fd740 1 -- start start 2024-04-25T09:02:02.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a173d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a22ad0 0x55ea33a046f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a04c30 0x55ea33a1f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f357fd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1ff060 con 0x55ea33a05230 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f357fd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0b3700 con 0x55ea33a22ad0 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f357fd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0b3cd0 con 0x55ea33a04c30 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f2bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f2bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a173d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39774/0 (socket says 172.21.15.55:39774) 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f2bfff640 1 -- 172.21.15.55:0/3490672752 learned_addr learned my addr 172.21.15.55:0/3490672752 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f2bfff640 1 -- 172.21.15.55:0/3490672752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a04c30 msgr2=0x55ea33a1f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/3490672752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a04c30 0x55ea33a1f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f2bfff640 1 -- 172.21.15.55:0/3490672752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a22ad0 msgr2=0x55ea33a046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/3490672752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a22ad0 0x55ea33a046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f2bfff640 1 -- 172.21.15.55:0/3490672752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea33a17ec0 con 0x55ea33a05230 2024-04-25T09:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/3490672752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a173d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009960 tx=0x7f2f1402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e0e880be0108b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f217fa640 1 -- 172.21.15.55:0/3490672752 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14037040 con 0x55ea33a05230 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f217fa640 1 -- 172.21.15.55:0/3490672752 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1404e440 con 0x55ea33a05230 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.196+0000 7f2f217fa640 1 -- 172.21.15.55:0/3490672752 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1404e810 con 0x55ea33a05230 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.197+0000 7f2f357fd740 1 -- 172.21.15.55:0/3490672752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 msgr2=0x55ea33a173d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.197+0000 7f2f357fd740 1 --2- 172.21.15.55:0/3490672752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a173d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009960 tx=0x7f2f1402c000 comp rx=0 tx=0).stop 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.197+0000 7f2f357fd740 1 -- 172.21.15.55:0/3490672752 shutdown_connections 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.197+0000 7f2f357fd740 1 --2- 172.21.15.55:0/3490672752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a04c30 0x55ea33a1f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.197+0000 7f2f357fd740 1 --2- 172.21.15.55:0/3490672752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a22ad0 0x55ea33a046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.197+0000 7f2f357fd740 1 --2- 172.21.15.55:0/3490672752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a173d0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.197+0000 7f2f357fd740 1 -- 172.21.15.55:0/3490672752 >> 172.21.15.55:0/3490672752 conn(0x55ea339daf10 msgr2=0x55ea339da7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.197+0000 7f2f357fd740 1 -- 172.21.15.55:0/3490672752 shutdown_connections 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.197+0000 7f2f357fd740 1 -- 172.21.15.55:0/3490672752 wait complete. 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.197+0000 7f2f357fd740 1 -- start start 2024-04-25T09:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.198+0000 7f2f357fd740 1 Processor -- start 2024-04-25T09:02:02.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.198+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a04c30 0x55ea33a73bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.198+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a42480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.198+0000 7f2f357fd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a8b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.198+0000 7f2f357fd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea339dbcb0 con 0x55ea33a05230 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.198+0000 7f2f357fd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea338fa0c0 con 0x55ea33a04c30 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.198+0000 7f2f357fd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea339d44a0 con 0x55ea33a22ad0 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.198+0000 7f2f357fd740 10 client.0 _ll_register_callbacks cb 0x55ea339d5c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f2b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a42480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f2b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a42480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39778/0 (socket says 172.21.15.55:39778) 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f2b7fe640 1 -- 172.21.15.55:0/1973003572 learned_addr learned my addr 172.21.15.55:0/1973003572 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f30fbf640 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a8b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a04c30 0x55ea33a73bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f2b7fe640 1 -- 172.21.15.55:0/1973003572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 msgr2=0x55ea33a8b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f2b7fe640 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a8b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f2b7fe640 1 -- 172.21.15.55:0/1973003572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a04c30 msgr2=0x55ea33a73bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f2b7fe640 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a04c30 0x55ea33a73bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f2b7fe640 1 -- 172.21.15.55:0/1973003572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea33a24680 con 0x55ea33a05230 2024-04-25T09:02:02.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f2b7fe640 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a42480 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c006fd0 tx=0x7f2f1c0132e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e57ca92b20c3575 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f0affd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f0affd640 1 -- 172.21.15.55:0/1973003572 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c01a030 con 0x55ea33a05230 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f0affd640 1 -- 172.21.15.55:0/1973003572 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f1c013ca0 con 0x55ea33a05230 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f357fd740 1 -- 172.21.15.55:0/1973003572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f1404e440 con 0x55ea33a05230 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f0affd640 1 -- 172.21.15.55:0/1973003572 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f1c026050 con 0x55ea33a05230 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f357fd740 10 client.8427 fetch_fsmap learned FSMap version 72 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.199+0000 7f2f357fd740 1 -- 172.21.15.55:0/1973003572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55ea33a15ce0 con 0x55ea33a05230 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f0affd640 1 -- 172.21.15.55:0/1973003572 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1404e440 con 0x55ea33a05230 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f0affd640 1 -- 172.21.15.55:0/1973003572 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2f1c029020 con 0x55ea33a05230 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f357fd740 10 client.8427 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f357fd740 10 client.8427 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f357fd740 20 client.8427 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f357fd740 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55ea33a1ee80 0x55ea33a009b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f357fd740 4 client.8427 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:02:02.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f357fd740 1 -- 172.21.15.55:0/1973003572 --> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ea3394af50 con 0x55ea33a1ee80 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55ea33a1ee80 0x55ea33a009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f2bfff640 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55ea33a1ee80 0x55ea33a009b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0ea97e32f8bd347 server_cookie=c40109e5306064bc in_seq=0 out_seq=0 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f0affd640 10 client.8427 ms_handle_connect on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f0affd640 1 -- 172.21.15.55:0/1973003572 <== mds.0 v2:172.21.15.55:6834/538888347 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55ea3394af50 con 0x55ea33a1ee80 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f0affd640 10 client.8427 handle_command_reply: tid=0 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f357fd740 1 client.8427 shutdown 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f357fd740 1 -- 172.21.15.55:0/1973003572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 msgr2=0x55ea33a42480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.200+0000 7f2f357fd740 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a42480 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c006fd0 tx=0x7f2f1c0132e0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f357fd740 1 -- 172.21.15.55:0/1973003572 shutdown_connections 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f357fd740 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea33a22ad0 0x55ea33a8b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f357fd740 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55ea33a1ee80 0x55ea33a009b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f357fd740 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea33a05230 0x55ea33a42480 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f357fd740 1 --2- 172.21.15.55:0/1973003572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea33a04c30 0x55ea33a73bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f0affd640 0 client.8427 ms_handle_reset on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:02.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f357fd740 1 -- 172.21.15.55:0/1973003572 >> 172.21.15.55:0/1973003572 conn(0x55ea339daf10 msgr2=0x55ea339da7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:02.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f357fd740 1 -- 172.21.15.55:0/1973003572 shutdown_connections 2024-04-25T09:02:02.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f357fd740 1 -- 172.21.15.55:0/1973003572 wait complete. 2024-04-25T09:02:02.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f357fd740 20 client.8427 trim_cache size 0 max 16384 2024-04-25T09:02:02.197 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:02:02.197 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T09:02:02.197 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T09:02:02.197 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8244, 2024-04-25T09:02:02.197 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T09:02:02.197 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T09:02:02.197 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T09:02:02.198 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 9.5151491260000007, 2024-04-25T09:02:02.198 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 72, 2024-04-25T09:02:02.198 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 102, 2024-04-25T09:02:02.198 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 102, 2024-04-25T09:02:02.198 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 14.546699483999999 2024-04-25T09:02:02.198 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:02:02.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 -- 172.21.15.55:0/1142323525 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2f0c06b4d0 msgr2=0x7f2f0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2f0c06b4d0 0x7f2f0c06d990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2f14034000 tx=0x7f2f1402e000 comp rx=0 tx=0).stop 2024-04-25T09:02:02.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 -- 172.21.15.55:0/1142323525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c15ef60 msgr2=0x7f2f2c0cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c15ef60 0x7f2f2c0cacd0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f2f24007e60 tx=0x7f2f2400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 -- 172.21.15.55:0/1142323525 shutdown_connections 2024-04-25T09:02:02.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2f0c06b4d0 0x7f2f0c06d990 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c15ef60 0x7f2f2c0cacd0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2c0cea00 0x7f2f2c0ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 --2- 172.21.15.55:0/1142323525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f2c0b0c80 0x7f2f2c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 -- 172.21.15.55:0/1142323525 >> 172.21.15.55:0/1142323525 conn(0x7f2f2c06f4c0 msgr2=0x7f2f2c0cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:02.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 -- 172.21.15.55:0/1142323525 shutdown_connections 2024-04-25T09:02:02.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.201+0000 7f2f32a22640 1 -- 172.21.15.55:0/1142323525 wait complete. 2024-04-25T09:02:02.203 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:02:02.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.315+0000 7f1764c83640 1 Processor -- start 2024-04-25T09:02:02.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.315+0000 7f1764c83640 1 -- start start 2024-04-25T09:02:02.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.316+0000 7f1764c83640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f176015f120 0x7f17600ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.316+0000 7f1764c83640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17600d0430 con 0x7f17600cfdb0 2024-04-25T09:02:02.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.316+0000 7f1764c83640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17600d0710 con 0x7f17600ce830 2024-04-25T09:02:02.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.316+0000 7f1764c83640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17600d09f0 con 0x7f176015f120 2024-04-25T09:02:02.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.316+0000 7f175ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f17600cfdb0 0x7f17600ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56742/0 (socket says 172.21.15.55:56742) 2024-04-25T09:02:02.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.316+0000 7f175ed9d640 1 -- 172.21.15.55:0/2249717440 learned_addr learned my addr 172.21.15.55:0/2249717440 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:02.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.317+0000 7f175e59c640 1 --2- 172.21.15.55:0/2249717440 >> v2:172.21.15.167:3300/0 conn(0x7f176015f120 0x7f17600ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.317+0000 7f175d59a640 1 -- 172.21.15.55:0/2249717440 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128338505 0 0) 0x7f17600d0430 con 0x7f17600cfdb0 2024-04-25T09:02:02.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.317+0000 7f175d59a640 1 -- 172.21.15.55:0/2249717440 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f174c003520 con 0x7f17600cfdb0 2024-04-25T09:02:02.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.317+0000 7f175e59c640 1 -- 172.21.15.55:0/2249717440 >> v1:172.21.15.167:6789/0 conn(0x7f17600ce830 legacy=0x7f17600cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.317+0000 7f175d59a640 1 -- 172.21.15.55:0/2249717440 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1638071962 0 0) 0x7f174c003520 con 0x7f17600cfdb0 2024-04-25T09:02:02.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.317+0000 7f175e59c640 1 -- 172.21.15.55:0/2249717440 >> v1:172.21.15.55:6789/0 conn(0x7f17600cfdb0 legacy=0x7f17600ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.317+0000 7f175e59c640 1 -- 172.21.15.55:0/2249717440 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17600cc7d0 con 0x7f176015f120 2024-04-25T09:02:02.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.318+0000 7f175e59c640 1 --2- 172.21.15.55:0/2249717440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f176015f120 0x7f17600ce2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f17580097a0 tx=0x7f175802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ca66f763327a3dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:02.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.318+0000 7f175d59a640 1 -- 172.21.15.55:0/2249717440 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758037070 con 0x7f176015f120 2024-04-25T09:02:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.318+0000 7f175d59a640 1 -- 172.21.15.55:0/2249717440 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175802ace0 con 0x7f176015f120 2024-04-25T09:02:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.318+0000 7f175d59a640 1 -- 172.21.15.55:0/2249717440 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750001a10 con 0x7f176015f120 2024-04-25T09:02:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.318+0000 7f1764c83640 1 -- 172.21.15.55:0/2249717440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f176015f120 msgr2=0x7f17600ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.318+0000 7f1764c83640 1 --2- 172.21.15.55:0/2249717440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f176015f120 0x7f17600ce2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f17580097a0 tx=0x7f175802a250 comp rx=0 tx=0).stop 2024-04-25T09:02:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.319+0000 7f1764c83640 1 -- 172.21.15.55:0/2249717440 shutdown_connections 2024-04-25T09:02:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.319+0000 7f1764c83640 1 --2- 172.21.15.55:0/2249717440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f176015f120 0x7f17600ce2f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.319+0000 7f1764c83640 1 -- 172.21.15.55:0/2249717440 >> 172.21.15.55:0/2249717440 conn(0x7f17600d1900 msgr2=0x7f17600d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.319+0000 7f1764c83640 1 -- 172.21.15.55:0/2249717440 shutdown_connections 2024-04-25T09:02:02.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.319+0000 7f1764c83640 1 -- 172.21.15.55:0/2249717440 wait complete. 2024-04-25T09:02:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.320+0000 7f1764c83640 1 Processor -- start 2024-04-25T09:02:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.320+0000 7f1764c83640 1 -- start start 2024-04-25T09:02:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f1764c83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17600ce830 0x7f17600b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f1764c83640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17600cfdb0 0x7f1760156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f1764c83640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f176015f120 0x7f17600c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f1764c83640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17600cc480 con 0x7f17600ce830 2024-04-25T09:02:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f1764c83640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17600cec70 con 0x7f17600cfdb0 2024-04-25T09:02:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f1764c83640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17600c5450 con 0x7f176015f120 2024-04-25T09:02:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17600ce830 0x7f17600b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17600ce830 0x7f17600b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39788/0 (socket says 172.21.15.55:39788) 2024-04-25T09:02:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175e59c640 1 -- 172.21.15.55:0/1865037696 learned_addr learned my addr 172.21.15.55:0/1865037696 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175ed9d640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f176015f120 0x7f17600c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175dd9b640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17600cfdb0 0x7f1760156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175e59c640 1 -- 172.21.15.55:0/1865037696 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f176015f120 msgr2=0x7f17600c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175e59c640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f176015f120 0x7f17600c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175e59c640 1 -- 172.21.15.55:0/1865037696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17600cfdb0 msgr2=0x7f1760156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175e59c640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17600cfdb0 0x7f1760156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175e59c640 1 -- 172.21.15.55:0/1865037696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17600b6ea0 con 0x7f17600ce830 2024-04-25T09:02:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175ed9d640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f176015f120 0x7f17600c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:02.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175dd9b640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17600cfdb0 0x7f1760156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:02.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.321+0000 7f175e59c640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17600ce830 0x7f17600b50a0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f1758035040 tx=0x7f17580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:02.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.322+0000 7f1756ffd640 1 -- 172.21.15.55:0/1865037696 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758042020 con 0x7f17600ce830 2024-04-25T09:02:02.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.322+0000 7f1756ffd640 1 -- 172.21.15.55:0/1865037696 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175803d670 con 0x7f17600ce830 2024-04-25T09:02:02.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.322+0000 7f1756ffd640 1 -- 172.21.15.55:0/1865037696 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758037040 con 0x7f17600ce830 2024-04-25T09:02:02.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.322+0000 7f1764c83640 1 -- 172.21.15.55:0/1865037696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1760156740 con 0x7f17600ce830 2024-04-25T09:02:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.322+0000 7f1764c83640 1 -- 172.21.15.55:0/1865037696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176006d690 con 0x7f17600ce830 2024-04-25T09:02:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.323+0000 7f1764c83640 1 -- 172.21.15.55:0/1865037696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1760068690 con 0x7f17600ce830 2024-04-25T09:02:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.323+0000 7f1756ffd640 1 -- 172.21.15.55:0/1865037696 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1758045020 con 0x7f17600ce830 2024-04-25T09:02:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.324+0000 7f1756ffd640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f174006b4d0 0x7f174006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.324+0000 7f1756ffd640 1 -- 172.21.15.55:0/1865037696 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17580aa860 con 0x7f17600ce830 2024-04-25T09:02:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.324+0000 7f175dd9b640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f174006b4d0 0x7f174006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:02.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.324+0000 7f175dd9b640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f174006b4d0 0x7f174006d990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1760070c10 tx=0x7f1748009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:02.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.328+0000 7f1756ffd640 1 -- 172.21.15.55:0/1865037696 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1760068690 con 0x7f17600ce830 2024-04-25T09:02:02.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.553+0000 7f1764c83640 1 -- 172.21.15.55:0/1865037696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f176015b980 con 0x7f17600ce830 2024-04-25T09:02:02.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.553+0000 7f1756ffd640 1 -- 172.21.15.55:0/1865037696 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7f17580aa030 con 0x7f17600ce830 2024-04-25T09:02:02.542 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:02:02.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 -- 172.21.15.55:0/1865037696 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f174006b4d0 msgr2=0x7f174006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f174006b4d0 0x7f174006d990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1760070c10 tx=0x7f1748009040 comp rx=0 tx=0).stop 2024-04-25T09:02:02.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 -- 172.21.15.55:0/1865037696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17600ce830 msgr2=0x7f17600b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17600ce830 0x7f17600b50a0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f1758035040 tx=0x7f17580046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 -- 172.21.15.55:0/1865037696 shutdown_connections 2024-04-25T09:02:02.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f174006b4d0 0x7f174006d990 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f176015f120 0x7f17600c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17600cfdb0 0x7f1760156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 --2- 172.21.15.55:0/1865037696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17600ce830 0x7f17600b50a0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 -- 172.21.15.55:0/1865037696 >> 172.21.15.55:0/1865037696 conn(0x7f17600d1900 msgr2=0x7f17600d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:02.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 -- 172.21.15.55:0/1865037696 shutdown_connections 2024-04-25T09:02:02.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:02.555+0000 7f1764c83640 1 -- 172.21.15.55:0/1865037696 wait complete. 2024-04-25T09:02:02.555 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:02:02.555 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:02:02.555 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T09:02:02.555 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:02:02.555 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:02.555 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:02:02.555 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:02:02.555 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:02:02.555 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:02:02.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.556 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T09:02:02.571 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:02:02.571 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:02:02.571 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T09:02:02.572 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42235sec preferred_lft 42235sec 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:02:02.573 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:02:02.574 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T09:02:02.574 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.574 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:02:02.574 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:02:02.574 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T09:02:02.574 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.577 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:02:02.634 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:02:02.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.636 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T09:02:02.693 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T09:02:02.693 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:02:02.693 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:02:02.693 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:02:02.694 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:02:02.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.694 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:02:02.695 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:02:02.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:02:02.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:02:02.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:02:02.695 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:02:02.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.779 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:02:02.794 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:02:02.794 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:02:02.794 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:02:02.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.794 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T09:02:02.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:02.859 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:02.914 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:02:02.915 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:02.915 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:02.969 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:02:02.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.969 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:03.053 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:03.053 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:02:03.053 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:02:03.061 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:03.061 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:02:03.061 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:02:03.062 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:02:03.062 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:03.067 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:03.067 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:02:03.067 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:02:03.067 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:02:03.067 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:03.067 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T09:02:03.067 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T09:02:03.068 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T09:02:03.068 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:02:03.068 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:02:03.068 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:02:03.068 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:02:03.068 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:02:03.070 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:02:03.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.070 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:03.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.136 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:03.197 INFO:teuthology.orchestra.run.smithi055.stdout:client8436 2024-04-25T09:02:03.197 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:02:03.197 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:03.253 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:02:03.253 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:03.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.310 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T09:02:03.406 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records in 2024-04-25T09:02:03.406 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records out 2024-04-25T09:02:03.406 INFO:teuthology.orchestra.run.smithi055.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0365019 s, 172 MB/s 2024-04-25T09:02:03.406 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:02:03.406 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:03.422 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:02:03.422 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:03.477 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.630+0000 7ff147153640 1 Processor -- start 2024-04-25T09:02:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.630+0000 7ff147153640 1 -- start start 2024-04-25T09:02:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.630+0000 7ff147153640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 0x7ff140099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.630+0000 7ff147153640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff140099f80 0x7ff14006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.630+0000 7ff147153640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14009a3a0 con 0x7ff14006c1f0 2024-04-25T09:02:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.630+0000 7ff147153640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1400cbe50 con 0x7ff140099f80 2024-04-25T09:02:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.630+0000 7ff147153640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400cfe80 con 0x7ff14015ba10 2024-04-25T09:02:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.631+0000 7ff13ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff140099f80 0x7ff14006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.631+0000 7ff144eef640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 0x7ff140099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.631+0000 7ff1456f0640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff14006c1f0 0x7ff1400cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:60474/0 (socket says 172.21.15.55:60474) 2024-04-25T09:02:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.631+0000 7ff1456f0640 1 -- 172.21.15.55:0/2732883927 learned_addr learned my addr 172.21.15.55:0/2732883927 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.631+0000 7ff13f7fe640 1 -- 172.21.15.55:0/2732883927 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732604534 0 0) 0x7ff14009a3a0 con 0x7ff14006c1f0 2024-04-25T09:02:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.631+0000 7ff144eef640 1 -- 172.21.15.55:0/2732883927 >> v2:172.21.15.167:3300/0 conn(0x7ff140099f80 msgr2=0x7ff14006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.631+0000 7ff144eef640 1 --2- 172.21.15.55:0/2732883927 >> v2:172.21.15.167:3300/0 conn(0x7ff140099f80 0x7ff14006bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.631+0000 7ff144eef640 1 -- 172.21.15.55:0/2732883927 >> v1:172.21.15.167:6789/0 conn(0x7ff14006c1f0 legacy=0x7ff1400cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.631+0000 7ff144eef640 1 -- 172.21.15.55:0/2732883927 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14006c680 con 0x7ff14015ba10 2024-04-25T09:02:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.631+0000 7ff13ffff640 1 --2- 172.21.15.55:0/2732883927 >> v2:172.21.15.167:3300/0 conn(0x7ff140099f80 0x7ff14006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.632+0000 7ff144eef640 1 --2- 172.21.15.55:0/2732883927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 0x7ff140099a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff1340097a0 tx=0x7ff13402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89bd7fe6493c0350 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.632+0000 7ff13f7fe640 1 -- 172.21.15.55:0/2732883927 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134037070 con 0x7ff14015ba10 2024-04-25T09:02:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.632+0000 7ff13f7fe640 1 -- 172.21.15.55:0/2732883927 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134032440 con 0x7ff14015ba10 2024-04-25T09:02:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.632+0000 7ff13f7fe640 1 -- 172.21.15.55:0/2732883927 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134032810 con 0x7ff14015ba10 2024-04-25T09:02:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.633+0000 7ff147153640 1 -- 172.21.15.55:0/2732883927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 msgr2=0x7ff140099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.633+0000 7ff147153640 1 --2- 172.21.15.55:0/2732883927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 0x7ff140099a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff1340097a0 tx=0x7ff13402a180 comp rx=0 tx=0).stop 2024-04-25T09:02:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.633+0000 7ff147153640 1 -- 172.21.15.55:0/2732883927 shutdown_connections 2024-04-25T09:02:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.633+0000 7ff147153640 1 --2- 172.21.15.55:0/2732883927 >> v2:172.21.15.167:3300/0 conn(0x7ff140099f80 0x7ff14006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.633+0000 7ff147153640 1 --2- 172.21.15.55:0/2732883927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 0x7ff140099a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.633+0000 7ff147153640 1 -- 172.21.15.55:0/2732883927 >> 172.21.15.55:0/2732883927 conn(0x7ff1400b32f0 msgr2=0x7ff1400b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.633+0000 7ff147153640 1 -- 172.21.15.55:0/2732883927 shutdown_connections 2024-04-25T09:02:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.633+0000 7ff147153640 1 -- 172.21.15.55:0/2732883927 wait complete. 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.634+0000 7ff147153640 1 Processor -- start 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.634+0000 7ff147153640 1 -- start start 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff147153640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff14006c1f0 0x7ff1400b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff147153640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff140099f80 0x7ff1400c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff147153640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 0x7ff1400c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff147153640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14006cec0 con 0x7ff140099f80 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff147153640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14006cbe0 con 0x7ff14006c1f0 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff147153640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400cd930 con 0x7ff14015ba10 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff13ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff140099f80 0x7ff1400c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff13ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff140099f80 0x7ff1400c6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39800/0 (socket says 172.21.15.55:39800) 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff13ffff640 1 -- 172.21.15.55:0/3444538344 learned_addr learned my addr 172.21.15.55:0/3444538344 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff144eef640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff14006c1f0 0x7ff1400b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff1456f0640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 0x7ff1400c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff13ffff640 1 -- 172.21.15.55:0/3444538344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 msgr2=0x7ff1400c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff13ffff640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 0x7ff1400c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff13ffff640 1 -- 172.21.15.55:0/3444538344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff14006c1f0 msgr2=0x7ff1400b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff13ffff640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff14006c1f0 0x7ff1400b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff13ffff640 1 -- 172.21.15.55:0/3444538344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400b5880 con 0x7ff140099f80 2024-04-25T09:02:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.635+0000 7ff1456f0640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 0x7ff1400c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.636+0000 7ff13ffff640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff140099f80 0x7ff1400c6de0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00ebe0 tx=0x7ff12c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.636+0000 7ff13d7fa640 1 -- 172.21.15.55:0/3444538344 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c017070 con 0x7ff140099f80 2024-04-25T09:02:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.636+0000 7ff13d7fa640 1 -- 172.21.15.55:0/3444538344 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c00cc30 con 0x7ff140099f80 2024-04-25T09:02:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.636+0000 7ff147153640 1 -- 172.21.15.55:0/3444538344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1400b5b60 con 0x7ff140099f80 2024-04-25T09:02:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.636+0000 7ff13d7fa640 1 -- 172.21.15.55:0/3444538344 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c013470 con 0x7ff140099f80 2024-04-25T09:02:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.636+0000 7ff147153640 1 -- 172.21.15.55:0/3444538344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1400b6120 con 0x7ff140099f80 2024-04-25T09:02:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.637+0000 7ff147153640 1 -- 172.21.15.55:0/3444538344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1400749b0 con 0x7ff140099f80 2024-04-25T09:02:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.637+0000 7ff13d7fa640 1 -- 172.21.15.55:0/3444538344 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff12c01a070 con 0x7ff140099f80 2024-04-25T09:02:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.638+0000 7ff13d7fa640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12406b4d0 0x7ff12406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.638+0000 7ff13d7fa640 1 -- 172.21.15.55:0/3444538344 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff12c08a450 con 0x7ff140099f80 2024-04-25T09:02:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.638+0000 7ff144eef640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12406b4d0 0x7ff12406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.638+0000 7ff144eef640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12406b4d0 0x7ff12406d990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff134034000 tx=0x7ff13402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:03.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.642+0000 7ff13d7fa640 1 -- 172.21.15.55:0/3444538344 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff12c058c80 con 0x7ff140099f80 2024-04-25T09:02:03.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.822+0000 7ff147153640 1 -- 172.21.15.55:0/3444538344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1400b4120 con 0x7ff140099f80 2024-04-25T09:02:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.823+0000 7ff13d7fa640 1 -- 172.21.15.55:0/3444538344 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16619 (secure 0 0 0) 0x7ff12c05cd20 con 0x7ff140099f80 2024-04-25T09:02:03.812 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:03.813 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:01:53.683789+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:50.330313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:51.020096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:03.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 -- 172.21.15.55:0/3444538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12406b4d0 msgr2=0x7ff12406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12406b4d0 0x7ff12406d990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff134034000 tx=0x7ff13402e000 comp rx=0 tx=0).stop 2024-04-25T09:02:03.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 -- 172.21.15.55:0/3444538344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff140099f80 msgr2=0x7ff1400c6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff140099f80 0x7ff1400c6de0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00ebe0 tx=0x7ff12c00c520 comp rx=0 tx=0).stop 2024-04-25T09:02:03.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 -- 172.21.15.55:0/3444538344 shutdown_connections 2024-04-25T09:02:03.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff12406b4d0 0x7ff12406d990 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff14015ba10 0x7ff1400c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff140099f80 0x7ff1400c6de0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 --2- 172.21.15.55:0/3444538344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff14006c1f0 0x7ff1400b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 -- 172.21.15.55:0/3444538344 >> 172.21.15.55:0/3444538344 conn(0x7ff1400b32f0 msgr2=0x7ff1400706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:03.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 -- 172.21.15.55:0/3444538344 shutdown_connections 2024-04-25T09:02:03.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.825+0000 7ff147153640 1 -- 172.21.15.55:0/3444538344 wait complete. 2024-04-25T09:02:03.825 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:50.330313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:51.020096+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:02:03.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:03.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.941+0000 7f0af8910640 1 Processor -- start 2024-04-25T09:02:03.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.941+0000 7f0af8910640 1 -- start start 2024-04-25T09:02:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af8910640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0af415dca0 0x7f0af40ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af8910640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af40d1130 0x7f0af40b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af8910640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af40d4090 con 0x7f0af40d3b90 2024-04-25T09:02:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af8910640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af40b6b20 con 0x7f0af415dca0 2024-04-25T09:02:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af8910640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40d4370 con 0x7f0af40d1130 2024-04-25T09:02:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af1d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0af40d3b90 0x7f0af40d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56750/0 (socket says 172.21.15.55:56750) 2024-04-25T09:02:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af1d9b640 1 -- 172.21.15.55:0/1943697870 learned_addr learned my addr 172.21.15.55:0/1943697870 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af2d9d640 1 --2- 172.21.15.55:0/1943697870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af40d1130 0x7f0af40b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af259c640 1 --2- 172.21.15.55:0/1943697870 >> v2:172.21.15.167:3300/0 conn(0x7f0af415dca0 0x7f0af40ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af159a640 1 -- 172.21.15.55:0/1943697870 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607996188 0 0) 0x7f0af40d4090 con 0x7f0af40d3b90 2024-04-25T09:02:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af159a640 1 -- 172.21.15.55:0/1943697870 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0adc003520 con 0x7f0af40d3b90 2024-04-25T09:02:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af259c640 1 -- 172.21.15.55:0/1943697870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af40d1130 msgr2=0x7f0af40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af259c640 1 --2- 172.21.15.55:0/1943697870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af40d1130 0x7f0af40b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af259c640 1 -- 172.21.15.55:0/1943697870 >> v1:172.21.15.55:6789/0 conn(0x7f0af40d3b90 legacy=0x7f0af40d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.942+0000 7f0af259c640 1 -- 172.21.15.55:0/1943697870 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40d4650 con 0x7f0af415dca0 2024-04-25T09:02:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.943+0000 7f0af259c640 1 --2- 172.21.15.55:0/1943697870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af415dca0 0x7f0af40ce940 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40097a0 tx=0x7f0ae402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcf6f485fe871659 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.943+0000 7f0af159a640 1 -- 172.21.15.55:0/1943697870 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4037070 con 0x7f0af415dca0 2024-04-25T09:02:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.943+0000 7f0af159a640 1 -- 172.21.15.55:0/1943697870 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae4032440 con 0x7f0af415dca0 2024-04-25T09:02:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.943+0000 7f0af159a640 1 -- 172.21.15.55:0/1943697870 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40327f0 con 0x7f0af415dca0 2024-04-25T09:02:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.944+0000 7f0af8910640 1 -- 172.21.15.55:0/1943697870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af415dca0 msgr2=0x7f0af40ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.944+0000 7f0af8910640 1 --2- 172.21.15.55:0/1943697870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af415dca0 0x7f0af40ce940 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40097a0 tx=0x7f0ae402a180 comp rx=0 tx=0).stop 2024-04-25T09:02:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.944+0000 7f0af8910640 1 -- 172.21.15.55:0/1943697870 shutdown_connections 2024-04-25T09:02:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.944+0000 7f0af8910640 1 --2- 172.21.15.55:0/1943697870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af40d1130 0x7f0af40b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.944+0000 7f0af8910640 1 --2- 172.21.15.55:0/1943697870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af415dca0 0x7f0af40ce940 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.944+0000 7f0af8910640 1 -- 172.21.15.55:0/1943697870 >> 172.21.15.55:0/1943697870 conn(0x7f0af40726c0 msgr2=0x7f0af4072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.944+0000 7f0af8910640 1 -- 172.21.15.55:0/1943697870 shutdown_connections 2024-04-25T09:02:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.944+0000 7f0af8910640 1 -- 172.21.15.55:0/1943697870 wait complete. 2024-04-25T09:02:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.945+0000 7f0af8910640 1 Processor -- start 2024-04-25T09:02:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.945+0000 7f0af8910640 1 -- start start 2024-04-25T09:02:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.946+0000 7f0af8910640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40d1130 0x7f0af40b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.946+0000 7f0af8910640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af40d3b90 0x7f0af40cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.946+0000 7f0af8910640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af415dca0 0x7f0af41f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.946+0000 7f0af8910640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af415e200 con 0x7f0af40d1130 2024-04-25T09:02:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.946+0000 7f0af8910640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af415e080 con 0x7f0af40d3b90 2024-04-25T09:02:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.946+0000 7f0af8910640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40cee80 con 0x7f0af415dca0 2024-04-25T09:02:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.946+0000 7f0af259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40d1130 0x7f0af40b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.946+0000 7f0af259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40d1130 0x7f0af40b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39810/0 (socket says 172.21.15.55:39810) 2024-04-25T09:02:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.946+0000 7f0af259c640 1 -- 172.21.15.55:0/1070054925 learned_addr learned my addr 172.21.15.55:0/1070054925 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0af2d9d640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af415dca0 0x7f0af41f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0af1d9b640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af40d3b90 0x7f0af40cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0af259c640 1 -- 172.21.15.55:0/1070054925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af415dca0 msgr2=0x7f0af41f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0af259c640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af415dca0 0x7f0af41f36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0af259c640 1 -- 172.21.15.55:0/1070054925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af40d3b90 msgr2=0x7f0af40cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0af259c640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af40d3b90 0x7f0af40cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0af259c640 1 -- 172.21.15.55:0/1070054925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40b31a0 con 0x7f0af40d1130 2024-04-25T09:02:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0af1d9b640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af40d3b90 0x7f0af40cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0af259c640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40d1130 0x7f0af40b2c60 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f0ae402a1c0 tx=0x7f0ae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0ae2ffd640 1 -- 172.21.15.55:0/1070054925 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4037040 con 0x7f0af40d1130 2024-04-25T09:02:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0ae2ffd640 1 -- 172.21.15.55:0/1070054925 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae4042070 con 0x7f0af40d1130 2024-04-25T09:02:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0af8910640 1 -- 172.21.15.55:0/1070054925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af41f4250 con 0x7f0af40d1130 2024-04-25T09:02:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0ae2ffd640 1 -- 172.21.15.55:0/1070054925 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae403b930 con 0x7f0af40d1130 2024-04-25T09:02:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.947+0000 7f0af8910640 1 -- 172.21.15.55:0/1070054925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af40ccb80 con 0x7f0af40d1130 2024-04-25T09:02:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.948+0000 7f0af8910640 1 -- 172.21.15.55:0/1070054925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af40cc970 con 0x7f0af40d1130 2024-04-25T09:02:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.949+0000 7f0ae2ffd640 1 -- 172.21.15.55:0/1070054925 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0ae403bad0 con 0x7f0af40d1130 2024-04-25T09:02:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.949+0000 7f0ae2ffd640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ad406b4d0 0x7f0ad406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.949+0000 7f0ae2ffd640 1 -- 172.21.15.55:0/1070054925 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ae40aaac0 con 0x7f0af40d1130 2024-04-25T09:02:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.949+0000 7f0af1d9b640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ad406b4d0 0x7f0ad406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.950+0000 7f0af1d9b640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ad406b4d0 0x7f0ad406d990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0af40cc100 tx=0x7f0ae8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:03.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:03.953+0000 7f0ae2ffd640 1 -- 172.21.15.55:0/1070054925 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ae4079a60 con 0x7f0af40d1130 2024-04-25T09:02:04.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.132+0000 7f0af8910640 1 -- 172.21.15.55:0/1070054925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0af40b84b0 con 0x7f0af40d1130 2024-04-25T09:02:04.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.133+0000 7f0ae2ffd640 1 -- 172.21.15.55:0/1070054925 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ae4079360 con 0x7f0af40d1130 2024-04-25T09:02:04.121 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:02:04.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.134+0000 7f0af8910640 1 -- 172.21.15.55:0/1070054925 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ad406b4d0 msgr2=0x7f0ad406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.134+0000 7f0af8910640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ad406b4d0 0x7f0ad406d990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0af40cc100 tx=0x7f0ae8009040 comp rx=0 tx=0).stop 2024-04-25T09:02:04.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.135+0000 7f0af8910640 1 -- 172.21.15.55:0/1070054925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40d1130 msgr2=0x7f0af40b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.135+0000 7f0af8910640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40d1130 0x7f0af40b2c60 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f0ae402a1c0 tx=0x7f0ae40046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.135+0000 7f0af8910640 1 -- 172.21.15.55:0/1070054925 shutdown_connections 2024-04-25T09:02:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.135+0000 7f0af8910640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0ad406b4d0 0x7f0ad406d990 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.135+0000 7f0af8910640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0af415dca0 0x7f0af41f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.135+0000 7f0af8910640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0af40d3b90 0x7f0af40cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.135+0000 7f0af8910640 1 --2- 172.21.15.55:0/1070054925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40d1130 0x7f0af40b2c60 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.135+0000 7f0af8910640 1 -- 172.21.15.55:0/1070054925 >> 172.21.15.55:0/1070054925 conn(0x7f0af40726c0 msgr2=0x7f0af40b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.135+0000 7f0af8910640 1 -- 172.21.15.55:0/1070054925 shutdown_connections 2024-04-25T09:02:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.135+0000 7f0af8910640 1 -- 172.21.15.55:0/1070054925 wait complete. 2024-04-25T09:02:04.135 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.250+0000 7f946dc6b640 1 Processor -- start 2024-04-25T09:02:04.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.250+0000 7f946dc6b640 1 -- start start 2024-04-25T09:02:04.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.250+0000 7f946dc6b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f946815dca0 0x7f94680ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f946dc6b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94680d4090 con 0x7f94680d1130 2024-04-25T09:02:04.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f946dc6b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94680d4370 con 0x7f94680d3b90 2024-04-25T09:02:04.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f946dc6b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94680b6b20 con 0x7f946815dca0 2024-04-25T09:02:04.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f9467fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f94680d1130 0x7f94680b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56762/0 (socket says 172.21.15.55:56762) 2024-04-25T09:02:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f9467fff640 1 -- 172.21.15.55:0/642706963 learned_addr learned my addr 172.21.15.55:0/642706963 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770736182 0 0) 0x7f94680d4090 con 0x7f94680d1130 2024-04-25T09:02:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94677fe640 1 --2- 172.21.15.55:0/642706963 >> v2:172.21.15.167:3300/0 conn(0x7f946815dca0 0x7f94680ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9450003520 con 0x7f94680d1130 2024-04-25T09:02:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3450954363 0 0) 0x7f9450003520 con 0x7f94680d1130 2024-04-25T09:02:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 >> v2:172.21.15.167:3300/0 conn(0x7f946815dca0 msgr2=0x7f94680ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 --2- 172.21.15.55:0/642706963 >> v2:172.21.15.167:3300/0 conn(0x7f946815dca0 0x7f94680ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 >> v1:172.21.15.167:6789/0 conn(0x7f94680d3b90 legacy=0x7f94680d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680d4650 con 0x7f94680d1130 2024-04-25T09:02:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f94600019f0 con 0x7f94680d1130 2024-04-25T09:02:04.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 >> v1:172.21.15.55:6789/0 conn(0x7f94680d1130 legacy=0x7f94680b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 --2- 172.21.15.55:0/642706963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 0x7f9450003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 --2- 172.21.15.55:0/642706963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9450004800 0x7f9450004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 --2- 172.21.15.55:0/642706963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94500051c0 0x7f945000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945000c030 con 0x7f94500039b0 2024-04-25T09:02:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945000c1e0 con 0x7f94500051c0 2024-04-25T09:02:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945000c3e0 con 0x7f9450004800 2024-04-25T09:02:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.251+0000 7f94677fe640 1 --2- 172.21.15.55:0/642706963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 0x7f9450003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.252+0000 7f9467fff640 1 --2- 172.21.15.55:0/642706963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94500051c0 0x7f945000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.252+0000 7f9466ffd640 1 --2- 172.21.15.55:0/642706963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9450004800 0x7f9450004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.252+0000 7f94677fe640 1 -- 172.21.15.55:0/642706963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9450004800 msgr2=0x7f9450004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.252+0000 7f94677fe640 1 --2- 172.21.15.55:0/642706963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9450004800 0x7f9450004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.252+0000 7f94677fe640 1 -- 172.21.15.55:0/642706963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94500051c0 msgr2=0x7f945000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.252+0000 7f94677fe640 1 --2- 172.21.15.55:0/642706963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94500051c0 0x7f945000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.252+0000 7f94677fe640 1 -- 172.21.15.55:0/642706963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9450003520 con 0x7f94500039b0 2024-04-25T09:02:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.252+0000 7f9467fff640 1 -- 172.21.15.55:0/642706963 reap_dead start 2024-04-25T09:02:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.252+0000 7f94677fe640 1 --2- 172.21.15.55:0/642706963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 0x7f9450003dd0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f9458009ac0 tx=0x7f9450005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae85dad6f1b0075b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.253+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458036070 con 0x7f94500039b0 2024-04-25T09:02:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.253+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9458031400 con 0x7f94500039b0 2024-04-25T09:02:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.253+0000 7f94667fc640 1 -- 172.21.15.55:0/642706963 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458009690 con 0x7f94500039b0 2024-04-25T09:02:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.253+0000 7f946dc6b640 1 -- 172.21.15.55:0/642706963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 msgr2=0x7f9450003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.253+0000 7f946dc6b640 1 --2- 172.21.15.55:0/642706963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 0x7f9450003dd0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f9458009ac0 tx=0x7f9450005830 comp rx=0 tx=0).stop 2024-04-25T09:02:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.253+0000 7f946dc6b640 1 -- 172.21.15.55:0/642706963 shutdown_connections 2024-04-25T09:02:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.253+0000 7f946dc6b640 1 --2- 172.21.15.55:0/642706963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 0x7f9450003dd0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.253+0000 7f946dc6b640 1 -- 172.21.15.55:0/642706963 >> 172.21.15.55:0/642706963 conn(0x7f94680726c0 msgr2=0x7f9468072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.253+0000 7f946dc6b640 1 -- 172.21.15.55:0/642706963 shutdown_connections 2024-04-25T09:02:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.253+0000 7f946dc6b640 1 -- 172.21.15.55:0/642706963 wait complete. 2024-04-25T09:02:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.254+0000 7f946dc6b640 1 Processor -- start 2024-04-25T09:02:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.255+0000 7f946dc6b640 1 -- start start 2024-04-25T09:02:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.255+0000 7f946dc6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 0x7f9468154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.255+0000 7f946dc6b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9468156100 0x7f94680cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.255+0000 7f946dc6b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94680cd760 0x7f946815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.255+0000 7f946dc6b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946815e200 con 0x7f94500039b0 2024-04-25T09:02:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.255+0000 7f946dc6b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946815e080 con 0x7f94680cd760 2024-04-25T09:02:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.255+0000 7f946dc6b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94680d0a20 con 0x7f9468156100 2024-04-25T09:02:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.255+0000 7f94677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 0x7f9468154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.255+0000 7f94677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 0x7f9468154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39832/0 (socket says 172.21.15.55:39832) 2024-04-25T09:02:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.255+0000 7f94677fe640 1 -- 172.21.15.55:0/164453638 learned_addr learned my addr 172.21.15.55:0/164453638 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f9467fff640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94680cd760 0x7f946815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f9466ffd640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9468156100 0x7f94680cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f94677fe640 1 -- 172.21.15.55:0/164453638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9468156100 msgr2=0x7f94680cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f94677fe640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9468156100 0x7f94680cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f94677fe640 1 -- 172.21.15.55:0/164453638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94680cd760 msgr2=0x7f946815bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f94677fe640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94680cd760 0x7f946815bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f94677fe640 1 -- 172.21.15.55:0/164453638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9468153d50 con 0x7f94500039b0 2024-04-25T09:02:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f94677fe640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 0x7f9468154df0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f9458034040 tx=0x7f9458004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f944ffff640 1 -- 172.21.15.55:0/164453638 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945803f020 con 0x7f94500039b0 2024-04-25T09:02:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f944ffff640 1 -- 172.21.15.55:0/164453638 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9458037040 con 0x7f94500039b0 2024-04-25T09:02:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f946dc6b640 1 -- 172.21.15.55:0/164453638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9468154030 con 0x7f94500039b0 2024-04-25T09:02:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f944ffff640 1 -- 172.21.15.55:0/164453638 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458036070 con 0x7f94500039b0 2024-04-25T09:02:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.256+0000 7f946dc6b640 1 -- 172.21.15.55:0/164453638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94681545f0 con 0x7f94500039b0 2024-04-25T09:02:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.257+0000 7f946dc6b640 1 -- 172.21.15.55:0/164453638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94680750b0 con 0x7f94500039b0 2024-04-25T09:02:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.258+0000 7f944ffff640 1 -- 172.21.15.55:0/164453638 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9458042020 con 0x7f94500039b0 2024-04-25T09:02:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.258+0000 7f944ffff640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f945406b4d0 0x7f945406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.258+0000 7f944ffff640 1 -- 172.21.15.55:0/164453638 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94580aa1b0 con 0x7f94500039b0 2024-04-25T09:02:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.258+0000 7f9466ffd640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f945406b4d0 0x7f945406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.259+0000 7f9466ffd640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f945406b4d0 0x7f945406d990 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f945c000c00 tx=0x7f945c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.262+0000 7f944ffff640 1 -- 172.21.15.55:0/164453638 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9458049030 con 0x7f94500039b0 2024-04-25T09:02:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.443+0000 7f946dc6b640 1 -- 172.21.15.55:0/164453638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94680b8970 con 0x7f94500039b0 2024-04-25T09:02:04.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.443+0000 7f944ffff640 1 -- 172.21.15.55:0/164453638 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9458079180 con 0x7f94500039b0 2024-04-25T09:02:04.432 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T09:02:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 -- 172.21.15.55:0/164453638 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f945406b4d0 msgr2=0x7f945406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f945406b4d0 0x7f945406d990 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f945c000c00 tx=0x7f945c009040 comp rx=0 tx=0).stop 2024-04-25T09:02:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 -- 172.21.15.55:0/164453638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 msgr2=0x7f9468154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 0x7f9468154df0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f9458034040 tx=0x7f9458004730 comp rx=0 tx=0).stop 2024-04-25T09:02:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 -- 172.21.15.55:0/164453638 shutdown_connections 2024-04-25T09:02:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f945406b4d0 0x7f945406d990 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94680cd760 0x7f946815bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9468156100 0x7f94680cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 --2- 172.21.15.55:0/164453638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94500039b0 0x7f9468154df0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 -- 172.21.15.55:0/164453638 >> 172.21.15.55:0/164453638 conn(0x7f94680726c0 msgr2=0x7f94680d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 -- 172.21.15.55:0/164453638 shutdown_connections 2024-04-25T09:02:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.445+0000 7f946dc6b640 1 -- 172.21.15.55:0/164453638 wait complete. 2024-04-25T09:02:04.444 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:04.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.559+0000 7f8a6f569640 1 Processor -- start 2024-04-25T09:02:04.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.559+0000 7f8a6f569640 1 -- start start 2024-04-25T09:02:04.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.560+0000 7f8a6f569640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a6815dc80 0x7f8a68161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.560+0000 7f8a6f569640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a680b5c00 0x7f8a680d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.560+0000 7f8a6f569640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a681627a0 con 0x7f8a680b97c0 2024-04-25T09:02:04.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.560+0000 7f8a6f569640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a681621e0 con 0x7f8a6815dc80 2024-04-25T09:02:04.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.560+0000 7f8a6f569640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a681624c0 con 0x7f8a680b5c00 2024-04-25T09:02:04.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.560+0000 7f8a6d305640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a6815dc80 0x7f8a68161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.560+0000 7f8a6d305640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a6815dc80 0x7f8a68161870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39838/0 (socket says 172.21.15.55:39838) 2024-04-25T09:02:04.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.560+0000 7f8a6d305640 1 -- 172.21.15.55:0/1740654680 learned_addr learned my addr 172.21.15.55:0/1740654680 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:04.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.560+0000 7f8a6db06640 1 --2- 172.21.15.55:0/1740654680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a680b5c00 0x7f8a680d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.560+0000 7f8a6d305640 1 -- 172.21.15.55:0/1740654680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a680b5c00 msgr2=0x7f8a680d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:04.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.561+0000 7f8a6d305640 1 --2- 172.21.15.55:0/1740654680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a680b5c00 0x7f8a680d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.561+0000 7f8a6d305640 1 -- 172.21.15.55:0/1740654680 >> v1:172.21.15.167:6789/0 conn(0x7f8a680b97c0 legacy=0x7f8a680b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:04.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.561+0000 7f8a6d305640 1 -- 172.21.15.55:0/1740654680 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a680d1c70 con 0x7f8a6815dc80 2024-04-25T09:02:04.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.561+0000 7f8a6db06640 1 --2- 172.21.15.55:0/1740654680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a680b5c00 0x7f8a680d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:04.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.561+0000 7f8a6d305640 1 --2- 172.21.15.55:0/1740654680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6815dc80 0x7f8a68161870 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009e50 tx=0x7f8a5802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b70608defe5f770 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:04.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.561+0000 7f8a67fff640 1 -- 172.21.15.55:0/1740654680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58036070 con 0x7f8a6815dc80 2024-04-25T09:02:04.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.561+0000 7f8a67fff640 1 -- 172.21.15.55:0/1740654680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a58031600 con 0x7f8a6815dc80 2024-04-25T09:02:04.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.561+0000 7f8a67fff640 1 -- 172.21.15.55:0/1740654680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a580319d0 con 0x7f8a6815dc80 2024-04-25T09:02:04.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.562+0000 7f8a6f569640 1 -- 172.21.15.55:0/1740654680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6815dc80 msgr2=0x7f8a68161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.562+0000 7f8a6f569640 1 --2- 172.21.15.55:0/1740654680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6815dc80 0x7f8a68161870 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009e50 tx=0x7f8a5802a6c0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.562+0000 7f8a6f569640 1 -- 172.21.15.55:0/1740654680 shutdown_connections 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.562+0000 7f8a6f569640 1 --2- 172.21.15.55:0/1740654680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a680b5c00 0x7f8a680d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.562+0000 7f8a6f569640 1 --2- 172.21.15.55:0/1740654680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6815dc80 0x7f8a68161870 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.562+0000 7f8a6f569640 1 -- 172.21.15.55:0/1740654680 >> 172.21.15.55:0/1740654680 conn(0x7f8a680d04f0 msgr2=0x7f8a680d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.562+0000 7f8a6f569640 1 -- 172.21.15.55:0/1740654680 shutdown_connections 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.562+0000 7f8a6f569640 1 -- 172.21.15.55:0/1740654680 wait complete. 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.563+0000 7f8a6f569640 1 Processor -- start 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.563+0000 7f8a6f569640 1 -- start start 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6f569640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a680b5c00 0x7f8a680aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6f569640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a680b97c0 0x7f8a680aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6f569640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6815dc80 0x7f8a6814eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6f569640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68161f30 con 0x7f8a6815dc80 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6f569640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68161db0 con 0x7f8a680b5c00 2024-04-25T09:02:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6f569640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a680d29b0 con 0x7f8a680b97c0 2024-04-25T09:02:04.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6db06640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6815dc80 0x7f8a6814eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6db06640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6815dc80 0x7f8a6814eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39850/0 (socket says 172.21.15.55:39850) 2024-04-25T09:02:04.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6db06640 1 -- 172.21.15.55:0/1622722916 learned_addr learned my addr 172.21.15.55:0/1622722916 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:04.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6d305640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a680b5c00 0x7f8a680aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6cb04640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a680b97c0 0x7f8a680aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6db06640 1 -- 172.21.15.55:0/1622722916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a680b97c0 msgr2=0x7f8a680aa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.564+0000 7f8a6db06640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a680b97c0 0x7f8a680aa990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.565+0000 7f8a6db06640 1 -- 172.21.15.55:0/1622722916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a680b5c00 msgr2=0x7f8a680aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.565+0000 7f8a6db06640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a680b5c00 0x7f8a680aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.565+0000 7f8a6db06640 1 -- 172.21.15.55:0/1622722916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a680cd620 con 0x7f8a6815dc80 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.565+0000 7f8a6db06640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6815dc80 0x7f8a6814eb40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000c820 tx=0x7f8a6000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.565+0000 7f8a65ffb640 1 -- 172.21.15.55:0/1622722916 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60015070 con 0x7f8a6815dc80 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.565+0000 7f8a65ffb640 1 -- 172.21.15.55:0/1622722916 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a60004240 con 0x7f8a6815dc80 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.565+0000 7f8a65ffb640 1 -- 172.21.15.55:0/1622722916 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000ce10 con 0x7f8a6815dc80 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.565+0000 7f8a6f569640 1 -- 172.21.15.55:0/1622722916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a680cd340 con 0x7f8a6815dc80 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.565+0000 7f8a6f569640 1 -- 172.21.15.55:0/1622722916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6814cf10 con 0x7f8a6815dc80 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.566+0000 7f8a6f569640 1 -- 172.21.15.55:0/1622722916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a680750b0 con 0x7f8a6815dc80 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.566+0000 7f8a65ffb640 1 -- 172.21.15.55:0/1622722916 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a60007830 con 0x7f8a6815dc80 2024-04-25T09:02:04.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.567+0000 7f8a65ffb640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a5406b4d0 0x7f8a5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.567+0000 7f8a6d305640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a5406b4d0 0x7f8a5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.567+0000 7f8a65ffb640 1 -- 172.21.15.55:0/1622722916 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a6008a3e0 con 0x7f8a6815dc80 2024-04-25T09:02:04.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.567+0000 7f8a6d305640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a5406b4d0 0x7f8a5406d990 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8a58033000 tx=0x7f8a58009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.571+0000 7f8a65ffb640 1 -- 172.21.15.55:0/1622722916 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8a60058c10 con 0x7f8a6815dc80 2024-04-25T09:02:04.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.753+0000 7f8a6f569640 1 -- 172.21.15.55:0/1622722916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a680d1780 con 0x7f8a6815dc80 2024-04-25T09:02:04.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.754+0000 7f8a65ffb640 1 -- 172.21.15.55:0/1622722916 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a6005ccb0 con 0x7f8a6815dc80 2024-04-25T09:02:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T09:02:04.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 -- 172.21.15.55:0/1622722916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a5406b4d0 msgr2=0x7f8a5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a5406b4d0 0x7f8a5406d990 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8a58033000 tx=0x7f8a58009000 comp rx=0 tx=0).stop 2024-04-25T09:02:04.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 -- 172.21.15.55:0/1622722916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6815dc80 msgr2=0x7f8a6814eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6815dc80 0x7f8a6814eb40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000c820 tx=0x7f8a6000cce0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 -- 172.21.15.55:0/1622722916 shutdown_connections 2024-04-25T09:02:04.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a5406b4d0 0x7f8a5406d990 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6815dc80 0x7f8a6814eb40 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a680b97c0 0x7f8a680aa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 --2- 172.21.15.55:0/1622722916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a680b5c00 0x7f8a680aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 -- 172.21.15.55:0/1622722916 >> 172.21.15.55:0/1622722916 conn(0x7f8a680d04f0 msgr2=0x7f8a680c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:04.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 -- 172.21.15.55:0/1622722916 shutdown_connections 2024-04-25T09:02:04.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.756+0000 7f8a6f569640 1 -- 172.21.15.55:0/1622722916 wait complete. 2024-04-25T09:02:04.756 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:02:04.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.868+0000 7f0ce12e2640 1 Processor -- start 2024-04-25T09:02:04.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.868+0000 7f0ce12e2640 1 -- start start 2024-04-25T09:02:04.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.869+0000 7f0ce12e2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc161090 0x7f0cdc161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.869+0000 7f0ce12e2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc161f80 con 0x7f0cdc0ceeb0 2024-04-25T09:02:04.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.869+0000 7f0ce12e2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc162260 con 0x7f0cdc0b9720 2024-04-25T09:02:04.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.869+0000 7f0ce12e2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc0d21a0 con 0x7f0cdc161090 2024-04-25T09:02:04.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.869+0000 7f0cdb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0cdc0ceeb0 0x7f0cdc0d2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56774/0 (socket says 172.21.15.55:56774) 2024-04-25T09:02:04.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.869+0000 7f0cdb7fe640 1 -- 172.21.15.55:0/4135478902 learned_addr learned my addr 172.21.15.55:0/4135478902 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cdaffd640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc161090 0x7f0cdc161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459582210 0 0) 0x7f0cdc161f80 con 0x7f0cdc0ceeb0 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc8003520 con 0x7f0cdc0ceeb0 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358915515 0 0) 0x7f0cdc162260 con 0x7f0cdc0b9720 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cdc161f80 con 0x7f0cdc0b9720 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2863551317 0 0) 0x7f0cc8003520 con 0x7f0cdc0ceeb0 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc161090 msgr2=0x7f0cdc161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc161090 0x7f0cdc161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 >> v1:172.21.15.167:6789/0 conn(0x7f0cdc0b9720 legacy=0x7f0cdc0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc162540 con 0x7f0cdc0ceeb0 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f0ccc001970 con 0x7f0cdc0ceeb0 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 >> v1:172.21.15.55:6789/0 conn(0x7f0cdc0ceeb0 legacy=0x7f0cdc0d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc8003b70 0x7f0cc8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc8004800 0x7f0cc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc161090 0x7f0cc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc0d21a0 con 0x7f0cc8003b70 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc800baa0 con 0x7f0cc8004800 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc800bca0 con 0x7f0cdc161090 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cdaffd640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc8003b70 0x7f0cc8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cdb7fe640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc161090 0x7f0cc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cda7fc640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc8004800 0x7f0cc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cdaffd640 1 -- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc161090 msgr2=0x7f0cc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cdaffd640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc161090 0x7f0cc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cdaffd640 1 -- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc8004800 msgr2=0x7f0cc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cdaffd640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc8004800 0x7f0cc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cdaffd640 1 -- 172.21.15.55:0/4135478902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8003520 con 0x7f0cc8003b70 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.870+0000 7f0cda7fc640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc8004800 0x7f0cc8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.871+0000 7f0cdaffd640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc8003b70 0x7f0cc8003f90 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009a90 tx=0x7f0cc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcfdc7b8fea98b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.871+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4036070 con 0x7f0cc8003b70 2024-04-25T09:02:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.871+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd4031400 con 0x7f0cc8003b70 2024-04-25T09:02:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.871+0000 7f0cd9ffb640 1 -- 172.21.15.55:0/4135478902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4009690 con 0x7f0cc8003b70 2024-04-25T09:02:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.872+0000 7f0ce12e2640 1 -- 172.21.15.55:0/4135478902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc8003b70 msgr2=0x7f0cc8003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.872+0000 7f0ce12e2640 1 --2- 172.21.15.55:0/4135478902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc8003b70 0x7f0cc8003f90 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009a90 tx=0x7f0cc8005830 comp rx=0 tx=0).stop 2024-04-25T09:02:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.872+0000 7f0cdb7fe640 1 -- 172.21.15.55:0/4135478902 reap_dead start 2024-04-25T09:02:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.872+0000 7f0ce12e2640 1 -- 172.21.15.55:0/4135478902 shutdown_connections 2024-04-25T09:02:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.872+0000 7f0ce12e2640 1 -- 172.21.15.55:0/4135478902 >> 172.21.15.55:0/4135478902 conn(0x7f0cdc0b55e0 msgr2=0x7f0cdc0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.872+0000 7f0ce12e2640 1 -- 172.21.15.55:0/4135478902 shutdown_connections 2024-04-25T09:02:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.872+0000 7f0ce12e2640 1 -- 172.21.15.55:0/4135478902 wait complete. 2024-04-25T09:02:04.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.873+0000 7f0ce12e2640 1 Processor -- start 2024-04-25T09:02:04.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.873+0000 7f0ce12e2640 1 -- start start 2024-04-25T09:02:04.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0ce12e2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cc8003b70 0x7f0cdc14de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0ce12e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc15b010 0x7f0cdc0cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0ce12e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cdc1e8f50 0x7f0cdc1e93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0ce12e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc161730 con 0x7f0cdc1e8f50 2024-04-25T09:02:04.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0ce12e2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc161470 con 0x7f0cdc15b010 2024-04-25T09:02:04.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0ce12e2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc1618b0 con 0x7f0cc8003b70 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0cdb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cdc1e8f50 0x7f0cdc1e93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0cdb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cdc1e8f50 0x7f0cdc1e93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39866/0 (socket says 172.21.15.55:39866) 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0cdb7fe640 1 -- 172.21.15.55:0/1284190358 learned_addr learned my addr 172.21.15.55:0/1284190358 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0cdaffd640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cc8003b70 0x7f0cdc14de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0cda7fc640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc15b010 0x7f0cdc0cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0cdb7fe640 1 -- 172.21.15.55:0/1284190358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cc8003b70 msgr2=0x7f0cdc14de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0cdb7fe640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cc8003b70 0x7f0cdc14de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0cdb7fe640 1 -- 172.21.15.55:0/1284190358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc15b010 msgr2=0x7f0cdc0cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0cdb7fe640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc15b010 0x7f0cdc0cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.874+0000 7f0cdb7fe640 1 -- 172.21.15.55:0/1284190358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc0cc420 con 0x7f0cdc1e8f50 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.875+0000 7f0cdb7fe640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cdc1e8f50 0x7f0cdc1e93d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0c7420 tx=0x7f0ccc00a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.875+0000 7f0cd37fe640 1 -- 172.21.15.55:0/1284190358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc00ac00 con 0x7f0cdc1e8f50 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.875+0000 7f0cd37fe640 1 -- 172.21.15.55:0/1284190358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc018070 con 0x7f0cdc1e8f50 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.875+0000 7f0cd37fe640 1 -- 172.21.15.55:0/1284190358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0133f0 con 0x7f0cdc1e8f50 2024-04-25T09:02:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.875+0000 7f0ce12e2640 1 -- 172.21.15.55:0/1284190358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc0cc700 con 0x7f0cdc1e8f50 2024-04-25T09:02:04.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.875+0000 7f0ce12e2640 1 -- 172.21.15.55:0/1284190358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc0cccc0 con 0x7f0cdc1e8f50 2024-04-25T09:02:04.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.876+0000 7f0ce12e2640 1 -- 172.21.15.55:0/1284190358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc0750b0 con 0x7f0cdc1e8f50 2024-04-25T09:02:04.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.876+0000 7f0cd37fe640 1 -- 172.21.15.55:0/1284190358 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0ccc013590 con 0x7f0cdc1e8f50 2024-04-25T09:02:04.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.877+0000 7f0cd37fe640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0cbc06b4d0 0x7f0cbc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:04.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.877+0000 7f0cdaffd640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0cbc06b4d0 0x7f0cbc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:04.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.877+0000 7f0cd37fe640 1 -- 172.21.15.55:0/1284190358 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ccc08a660 con 0x7f0cdc1e8f50 2024-04-25T09:02:04.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.877+0000 7f0cdaffd640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0cbc06b4d0 0x7f0cbc06d990 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4033000 tx=0x7f0cd4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:04.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:04.881+0000 7f0cd37fe640 1 -- 172.21.15.55:0/1284190358 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ccc058e80 con 0x7f0cdc1e8f50 2024-04-25T09:02:05.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.080+0000 7f0ce12e2640 1 -- 172.21.15.55:0/1284190358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0cdc0b78f0 con 0x7f0cdc1e8f50 2024-04-25T09:02:05.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.080+0000 7f0cd37fe640 1 -- 172.21.15.55:0/1284190358 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v102) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0ccc05cf20 con 0x7f0cdc1e8f50 2024-04-25T09:02:05.069 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T09:02:05.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.082+0000 7f0ce12e2640 1 -- 172.21.15.55:0/1284190358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0cbc06b4d0 msgr2=0x7f0cbc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.082+0000 7f0ce12e2640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0cbc06b4d0 0x7f0cbc06d990 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4033000 tx=0x7f0cd4008030 comp rx=0 tx=0).stop 2024-04-25T09:02:05.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.082+0000 7f0ce12e2640 1 -- 172.21.15.55:0/1284190358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cdc1e8f50 msgr2=0x7f0cdc1e93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.082+0000 7f0ce12e2640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cdc1e8f50 0x7f0cdc1e93d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0c7420 tx=0x7f0ccc00a600 comp rx=0 tx=0).stop 2024-04-25T09:02:05.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.083+0000 7f0ce12e2640 1 -- 172.21.15.55:0/1284190358 shutdown_connections 2024-04-25T09:02:05.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.083+0000 7f0ce12e2640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0cbc06b4d0 0x7f0cbc06d990 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.083+0000 7f0ce12e2640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cdc1e8f50 0x7f0cdc1e93d0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.083+0000 7f0ce12e2640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc15b010 0x7f0cdc0cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.083+0000 7f0ce12e2640 1 --2- 172.21.15.55:0/1284190358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cc8003b70 0x7f0cdc14de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.083+0000 7f0ce12e2640 1 -- 172.21.15.55:0/1284190358 >> 172.21.15.55:0/1284190358 conn(0x7f0cdc0b55e0 msgr2=0x7f0cdc0d3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:05.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.083+0000 7f0ce12e2640 1 -- 172.21.15.55:0/1284190358 shutdown_connections 2024-04-25T09:02:05.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.083+0000 7f0ce12e2640 1 -- 172.21.15.55:0/1284190358 wait complete. 2024-04-25T09:02:05.082 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:02:05.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:05.082 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:05.112 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:02:05.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:05.113 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:02:05.168 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:05.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.321+0000 7f208dc07640 1 Processor -- start 2024-04-25T09:02:05.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.321+0000 7f208dc07640 1 -- start start 2024-04-25T09:02:05.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f208dc07640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f208815dce0 0x7f20880d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f208dc07640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20880d35b0 0x7f20880b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f208dc07640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208815e0c0 con 0x7f20880d1f90 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f208dc07640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20880b7b10 con 0x7f208815dce0 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f208dc07640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20880d2510 con 0x7f20880d35b0 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f20877fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f208815dce0 0x7f20880d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f20877fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f208815dce0 0x7f20880d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39878/0 (socket says 172.21.15.55:39878) 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f20877fe640 1 -- 172.21.15.55:0/4145358687 learned_addr learned my addr 172.21.15.55:0/4145358687 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f2086ffd640 1 --2- 172.21.15.55:0/4145358687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20880d35b0 0x7f20880b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f20877fe640 1 -- 172.21.15.55:0/4145358687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20880d35b0 msgr2=0x7f20880b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f20877fe640 1 --2- 172.21.15.55:0/4145358687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20880d35b0 0x7f20880b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f20877fe640 1 -- 172.21.15.55:0/4145358687 >> v1:172.21.15.167:6789/0 conn(0x7f20880d1f90 legacy=0x7f208806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.322+0000 7f20877fe640 1 -- 172.21.15.55:0/4145358687 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880d27f0 con 0x7f208815dce0 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.323+0000 7f20877fe640 1 --2- 172.21.15.55:0/4145358687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f208815dce0 0x7f20880d1a50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f2078009870 tx=0x7f207802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc203e4161693f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.323+0000 7f20867fc640 1 -- 172.21.15.55:0/4145358687 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078037070 con 0x7f208815dce0 2024-04-25T09:02:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.323+0000 7f20867fc640 1 -- 172.21.15.55:0/4145358687 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2078032440 con 0x7f208815dce0 2024-04-25T09:02:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.323+0000 7f20867fc640 1 -- 172.21.15.55:0/4145358687 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078032810 con 0x7f208815dce0 2024-04-25T09:02:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.323+0000 7f208dc07640 1 -- 172.21.15.55:0/4145358687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f208815dce0 msgr2=0x7f20880d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.323+0000 7f208dc07640 1 --2- 172.21.15.55:0/4145358687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f208815dce0 0x7f20880d1a50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f2078009870 tx=0x7f207802a1c0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.323+0000 7f208dc07640 1 -- 172.21.15.55:0/4145358687 shutdown_connections 2024-04-25T09:02:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.324+0000 7f208dc07640 1 --2- 172.21.15.55:0/4145358687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20880d35b0 0x7f20880b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.324+0000 7f208dc07640 1 --2- 172.21.15.55:0/4145358687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f208815dce0 0x7f20880d1a50 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.324+0000 7f208dc07640 1 -- 172.21.15.55:0/4145358687 >> 172.21.15.55:0/4145358687 conn(0x7f2088072900 msgr2=0x7f20880d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.324+0000 7f208dc07640 1 -- 172.21.15.55:0/4145358687 shutdown_connections 2024-04-25T09:02:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.324+0000 7f208dc07640 1 -- 172.21.15.55:0/4145358687 wait complete. 2024-04-25T09:02:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.325+0000 7f208dc07640 1 Processor -- start 2024-04-25T09:02:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.325+0000 7f208dc07640 1 -- start start 2024-04-25T09:02:05.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f208dc07640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20880d1f90 0x7f20881530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f208dc07640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20880d35b0 0x7f20880cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f208dc07640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f208815dce0 0x7f20880c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f208dc07640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880d3090 con 0x7f20880d35b0 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f208dc07640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880d2db0 con 0x7f20880d1f90 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f208dc07640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20880b9820 con 0x7f208815dce0 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f2086ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20880d35b0 0x7f20880cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f2086ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20880d35b0 0x7f20880cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39880/0 (socket says 172.21.15.55:39880) 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f2086ffd640 1 -- 172.21.15.55:0/2084208189 learned_addr learned my addr 172.21.15.55:0/2084208189 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f20877fe640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20880d1f90 0x7f20881530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f2087fff640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f208815dce0 0x7f20880c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f2086ffd640 1 -- 172.21.15.55:0/2084208189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f208815dce0 msgr2=0x7f20880c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f2086ffd640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f208815dce0 0x7f20880c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f2086ffd640 1 -- 172.21.15.55:0/2084208189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20880d1f90 msgr2=0x7f20881530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f2086ffd640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20880d1f90 0x7f20881530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f2086ffd640 1 -- 172.21.15.55:0/2084208189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880ccc70 con 0x7f20880d35b0 2024-04-25T09:02:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f2086ffd640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20880d35b0 0x7f20880cc500 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f207c00d830 tx=0x7f207c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.326+0000 7f206ffff640 1 -- 172.21.15.55:0/2084208189 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c00b6c0 con 0x7f20880d35b0 2024-04-25T09:02:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.327+0000 7f206ffff640 1 -- 172.21.15.55:0/2084208189 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c019070 con 0x7f20880d35b0 2024-04-25T09:02:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.327+0000 7f206ffff640 1 -- 172.21.15.55:0/2084208189 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c00ba80 con 0x7f20880d35b0 2024-04-25T09:02:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.327+0000 7f208dc07640 1 -- 172.21.15.55:0/2084208189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20880ccf50 con 0x7f20880d35b0 2024-04-25T09:02:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.327+0000 7f208dc07640 1 -- 172.21.15.55:0/2084208189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20880c9bf0 con 0x7f20880d35b0 2024-04-25T09:02:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.328+0000 7f208dc07640 1 -- 172.21.15.55:0/2084208189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20881610c0 con 0x7f20880d35b0 2024-04-25T09:02:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.328+0000 7f206ffff640 1 -- 172.21.15.55:0/2084208189 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f207c01e460 con 0x7f20880d35b0 2024-04-25T09:02:05.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.329+0000 7f206ffff640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f207406b4d0 0x7f207406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.329+0000 7f206ffff640 1 -- 172.21.15.55:0/2084208189 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f207c08a830 con 0x7f20880d35b0 2024-04-25T09:02:05.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.329+0000 7f20877fe640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f207406b4d0 0x7f207406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.329+0000 7f20877fe640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f207406b4d0 0x7f207406d990 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2078034000 tx=0x7f207802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:05.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.333+0000 7f206ffff640 1 -- 172.21.15.55:0/2084208189 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f207c058fc0 con 0x7f20880d35b0 2024-04-25T09:02:05.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.551+0000 7f208dc07640 1 -- 172.21.15.55:0/2084208189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f208815ef80 con 0x7f20880d35b0 2024-04-25T09:02:05.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.551+0000 7f206ffff640 1 -- 172.21.15.55:0/2084208189 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f207c05d060 con 0x7f20880d35b0 2024-04-25T09:02:05.540 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:05.540 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:01:54.470378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/538888347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":538888347},{"type":"v1","addr":"172.21.15.55:6837","nonce":538888347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:02:05.540 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 72 2024-04-25T09:02:05.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 -- 172.21.15.55:0/2084208189 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f207406b4d0 msgr2=0x7f207406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f207406b4d0 0x7f207406d990 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2078034000 tx=0x7f207802e000 comp rx=0 tx=0).stop 2024-04-25T09:02:05.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 -- 172.21.15.55:0/2084208189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20880d35b0 msgr2=0x7f20880cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20880d35b0 0x7f20880cc500 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f207c00d830 tx=0x7f207c00dcf0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 -- 172.21.15.55:0/2084208189 shutdown_connections 2024-04-25T09:02:05.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f207406b4d0 0x7f207406d990 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f208815dce0 0x7f20880c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20880d35b0 0x7f20880cc500 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 --2- 172.21.15.55:0/2084208189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20880d1f90 0x7f20881530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 -- 172.21.15.55:0/2084208189 >> 172.21.15.55:0/2084208189 conn(0x7f2088072900 msgr2=0x7f20880b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:05.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 -- 172.21.15.55:0/2084208189 shutdown_connections 2024-04-25T09:02:05.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.553+0000 7f208dc07640 1 -- 172.21.15.55:0/2084208189 wait complete. 2024-04-25T09:02:05.553 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T09:02:05.677 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-25T09:02:05.678 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:02:05.678 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.790+0000 7f3139170640 1 Processor -- start 2024-04-25T09:02:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.790+0000 7f3139170640 1 -- start start 2024-04-25T09:02:05.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f3139170640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415dce0 0x7f31340d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f3139170640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31340d35b0 0x7f31340b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f3139170640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313415e0c0 con 0x7f31340d1f90 2024-04-25T09:02:05.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f3139170640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31340b7b10 con 0x7f31340d35b0 2024-04-25T09:02:05.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f3139170640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31340d2510 con 0x7f313415dce0 2024-04-25T09:02:05.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313359e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f31340d1f90 0x7f313406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56780/0 (socket says 172.21.15.55:56780) 2024-04-25T09:02:05.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313359e640 1 -- 172.21.15.55:0/167161476 learned_addr learned my addr 172.21.15.55:0/167161476 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:05.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f312a59c640 1 --2- 172.21.15.55:0/167161476 >> v2:172.21.15.167:3300/0 conn(0x7f31340d35b0 0x7f31340b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f3132d9d640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415dce0 0x7f31340d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139053139 0 0) 0x7f313415e0c0 con 0x7f31340d1f90 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3120003520 con 0x7f31340d1f90 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4221462487 0 0) 0x7f3120003520 con 0x7f31340d1f90 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415dce0 msgr2=0x7f31340d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415dce0 0x7f31340d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 >> v2:172.21.15.167:3300/0 conn(0x7f31340d35b0 msgr2=0x7f31340b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 --2- 172.21.15.55:0/167161476 >> v2:172.21.15.167:3300/0 conn(0x7f31340d35b0 0x7f31340b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31340d27f0 con 0x7f31340d1f90 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f312c0019f0 con 0x7f31340d1f90 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 >> v1:172.21.15.55:6789/0 conn(0x7f31340d1f90 legacy=0x7f313406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31200039b0 0x7f3120003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 0x7f3120004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415dce0 0x7f31200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.791+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31340b7b10 con 0x7f3120004800 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.792+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31340d2510 con 0x7f31200039b0 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.792+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312000b9c0 con 0x7f313415dce0 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.792+0000 7f312a59c640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 0x7f3120004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.792+0000 7f3132d9d640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31200039b0 0x7f3120003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.792+0000 7f313359e640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415dce0 0x7f31200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.792+0000 7f312a59c640 1 -- 172.21.15.55:0/167161476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415dce0 msgr2=0x7f31200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.792+0000 7f312a59c640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415dce0 0x7f31200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.792+0000 7f312a59c640 1 -- 172.21.15.55:0/167161476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31200039b0 msgr2=0x7f3120003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.792+0000 7f312a59c640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31200039b0 0x7f3120003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.792+0000 7f312a59c640 1 -- 172.21.15.55:0/167161476 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3120003520 con 0x7f3120004800 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.793+0000 7f312a59c640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 0x7f3120004c80 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f311c009af0 tx=0x7f3120005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e73f52743f88538 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.793+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c036070 con 0x7f3120004800 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.793+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311c031400 con 0x7f3120004800 2024-04-25T09:02:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.793+0000 7f313259c640 1 -- 172.21.15.55:0/167161476 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c009690 con 0x7f3120004800 2024-04-25T09:02:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.793+0000 7f3139170640 1 -- 172.21.15.55:0/167161476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 msgr2=0x7f3120004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.793+0000 7f3139170640 1 --2- 172.21.15.55:0/167161476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 0x7f3120004c80 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f311c009af0 tx=0x7f3120005830 comp rx=0 tx=0).stop 2024-04-25T09:02:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.793+0000 7f313359e640 1 -- 172.21.15.55:0/167161476 reap_dead start 2024-04-25T09:02:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.793+0000 7f3139170640 1 -- 172.21.15.55:0/167161476 shutdown_connections 2024-04-25T09:02:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.793+0000 7f3139170640 1 -- 172.21.15.55:0/167161476 >> 172.21.15.55:0/167161476 conn(0x7f3134072900 msgr2=0x7f31340d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.793+0000 7f3139170640 1 -- 172.21.15.55:0/167161476 shutdown_connections 2024-04-25T09:02:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.793+0000 7f3139170640 1 -- 172.21.15.55:0/167161476 wait complete. 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.795+0000 7f3139170640 1 Processor -- start 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.795+0000 7f3139170640 1 -- start start 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3139170640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 0x7f31340ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3139170640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31341f4660 0x7f31340aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3139170640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415ece0 0x7f313415f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3139170640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31340d3090 con 0x7f3120004800 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3139170640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31340d2db0 con 0x7f31341f4660 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3139170640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31340b9820 con 0x7f313415ece0 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3132d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 0x7f31340ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3132d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 0x7f31340ac500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39902/0 (socket says 172.21.15.55:39902) 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3132d9d640 1 -- 172.21.15.55:0/3002064847 learned_addr learned my addr 172.21.15.55:0/3002064847 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f312a59c640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31341f4660 0x7f31340aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f313359e640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415ece0 0x7f313415f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3132d9d640 1 -- 172.21.15.55:0/3002064847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415ece0 msgr2=0x7f313415f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3132d9d640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415ece0 0x7f313415f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3132d9d640 1 -- 172.21.15.55:0/3002064847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31341f4660 msgr2=0x7f31340aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3132d9d640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31341f4660 0x7f31340aca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3132d9d640 1 -- 172.21.15.55:0/3002064847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313415fa80 con 0x7f3120004800 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f312a59c640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31341f4660 0x7f31340aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f3132d9d640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 0x7f31340ac500 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f31240118e0 tx=0x7f3124011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f312bfff640 1 -- 172.21.15.55:0/3002064847 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312400fa30 con 0x7f3120004800 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.796+0000 7f312bfff640 1 -- 172.21.15.55:0/3002064847 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312400fbd0 con 0x7f3120004800 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.797+0000 7f312bfff640 1 -- 172.21.15.55:0/3002064847 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124014440 con 0x7f3120004800 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.797+0000 7f3139170640 1 -- 172.21.15.55:0/3002064847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31340aa600 con 0x7f3120004800 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.797+0000 7f3139170640 1 -- 172.21.15.55:0/3002064847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31340aabc0 con 0x7f3120004800 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.798+0000 7f3139170640 1 -- 172.21.15.55:0/3002064847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31340749b0 con 0x7f3120004800 2024-04-25T09:02:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.798+0000 7f312bfff640 1 -- 172.21.15.55:0/3002064847 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3124012040 con 0x7f3120004800 2024-04-25T09:02:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.798+0000 7f312bfff640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f311406b4d0 0x7f311406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.799+0000 7f312bfff640 1 -- 172.21.15.55:0/3002064847 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f312408a6f0 con 0x7f3120004800 2024-04-25T09:02:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.799+0000 7f312a59c640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f311406b4d0 0x7f311406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.799+0000 7f312a59c640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f311406b4d0 0x7f311406d990 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f311c033000 tx=0x7f311c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:05.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:05.803+0000 7f312bfff640 1 -- 172.21.15.55:0/3002064847 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3124019030 con 0x7f3120004800 2024-04-25T09:02:06.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.025+0000 7f3139170640 1 -- 172.21.15.55:0/3002064847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31340d1ae0 con 0x7f3120004800 2024-04-25T09:02:06.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.026+0000 7f312bfff640 1 -- 172.21.15.55:0/3002064847 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f3124058fb0 con 0x7f3120004800 2024-04-25T09:02:06.014 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:06.014 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:01:54.470378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/538888347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":538888347},{"type":"v1","addr":"172.21.15.55:6837","nonce":538888347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:02:06.015 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 72 2024-04-25T09:02:06.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 -- 172.21.15.55:0/3002064847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f311406b4d0 msgr2=0x7f311406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f311406b4d0 0x7f311406d990 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f311c033000 tx=0x7f311c008030 comp rx=0 tx=0).stop 2024-04-25T09:02:06.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 -- 172.21.15.55:0/3002064847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 msgr2=0x7f31340ac500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 0x7f31340ac500 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f31240118e0 tx=0x7f3124011ce0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 -- 172.21.15.55:0/3002064847 shutdown_connections 2024-04-25T09:02:06.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f311406b4d0 0x7f311406d990 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f313415ece0 0x7f313415f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31341f4660 0x7f31340aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 --2- 172.21.15.55:0/3002064847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3120004800 0x7f31340ac500 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 -- 172.21.15.55:0/3002064847 >> 172.21.15.55:0/3002064847 conn(0x7f3134072900 msgr2=0x7f31340d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:06.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 -- 172.21.15.55:0/3002064847 shutdown_connections 2024-04-25T09:02:06.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.028+0000 7f3139170640 1 -- 172.21.15.55:0/3002064847 wait complete. 2024-04-25T09:02:06.028 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-04-25T09:02:06.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.082+0000 7f3046366f40 1 Processor -- start 2024-04-25T09:02:06.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.082+0000 7f3046366f40 1 -- start start 2024-04-25T09:02:06.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.082+0000 7f3046366f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9ef182470 0x55e9ef20d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.082+0000 7f3046366f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 0x55e9ef1f3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.082+0000 7f3046366f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e9ef1f5270 0x55e9ef1f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.082+0000 7f3046366f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ef184ea0 con 0x55e9ef184690 2024-04-25T09:02:06.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.082+0000 7f3046366f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ef0e1df0 con 0x55e9ef182470 2024-04-25T09:02:06.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.082+0000 7f3046366f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9ef185140 con 0x55e9ef1f5270 2024-04-25T09:02:06.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3043668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 0x55e9ef1f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3043668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 0x55e9ef1f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39916/0 (socket says 172.21.15.55:39916) 2024-04-25T09:02:06.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3043668640 1 -- 172.21.15.55:0/2703528149 learned_addr learned my addr 172.21.15.55:0/2703528149 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:06.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f304466a640 1 --2- 172.21.15.55:0/2703528149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e9ef1f5270 0x55e9ef1f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3043e69640 1 --2- 172.21.15.55:0/2703528149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9ef182470 0x55e9ef20d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3043668640 1 -- 172.21.15.55:0/2703528149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e9ef1f5270 msgr2=0x55e9ef1f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:06.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3043668640 1 --2- 172.21.15.55:0/2703528149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e9ef1f5270 0x55e9ef1f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3043668640 1 -- 172.21.15.55:0/2703528149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9ef182470 msgr2=0x55e9ef20d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:06.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3043668640 1 --2- 172.21.15.55:0/2703528149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9ef182470 0x55e9ef20d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3043668640 1 -- 172.21.15.55:0/2703528149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9ef067c50 con 0x55e9ef184690 2024-04-25T09:02:06.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f304466a640 1 --2- 172.21.15.55:0/2703528149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e9ef1f5270 0x55e9ef1f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:06.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3043668640 1 --2- 172.21.15.55:0/2703528149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 0x55e9ef1f3860 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f302c00a770 tx=0x7f302c00a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b51559ba48a6be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:06.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3042666640 1 -- 172.21.15.55:0/2703528149 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c019070 con 0x55e9ef184690 2024-04-25T09:02:06.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3042666640 1 -- 172.21.15.55:0/2703528149 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c007600 con 0x55e9ef184690 2024-04-25T09:02:06.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.083+0000 7f3042666640 1 -- 172.21.15.55:0/2703528149 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0079d0 con 0x55e9ef184690 2024-04-25T09:02:06.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.084+0000 7f3046366f40 1 -- 172.21.15.55:0/2703528149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 msgr2=0x55e9ef1f3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.084+0000 7f3046366f40 1 --2- 172.21.15.55:0/2703528149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 0x55e9ef1f3860 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f302c00a770 tx=0x7f302c00a860 comp rx=0 tx=0).stop 2024-04-25T09:02:06.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.084+0000 7f3046366f40 1 -- 172.21.15.55:0/2703528149 shutdown_connections 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.084+0000 7f3046366f40 1 --2- 172.21.15.55:0/2703528149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e9ef1f5270 0x55e9ef1f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.084+0000 7f3046366f40 1 --2- 172.21.15.55:0/2703528149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 0x55e9ef1f3860 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.084+0000 7f3046366f40 1 --2- 172.21.15.55:0/2703528149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9ef182470 0x55e9ef20d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.084+0000 7f3046366f40 1 -- 172.21.15.55:0/2703528149 >> 172.21.15.55:0/2703528149 conn(0x55e9ef1653d0 msgr2=0x55e9ef13b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.084+0000 7f3046366f40 1 -- 172.21.15.55:0/2703528149 shutdown_connections 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.084+0000 7f3046366f40 1 -- 172.21.15.55:0/2703528149 wait complete. 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.084+0000 7f3046366f40 1 Processor -- start 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.084+0000 7f3046366f40 1 -- start start 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3046366f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e9ef182470 0x55e9ef211ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3046366f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 0x55e9ef1ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3046366f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9ef1f5270 0x55e9ef17f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3046366f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ef1ecb20 con 0x55e9ef184690 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3046366f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ef17e8f0 con 0x55e9ef1f5270 2024-04-25T09:02:06.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3046366f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9ef20dbd0 con 0x55e9ef182470 2024-04-25T09:02:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3043668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 0x55e9ef1ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3043668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 0x55e9ef1ed960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39926/0 (socket says 172.21.15.55:39926) 2024-04-25T09:02:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3043668640 1 -- 172.21.15.55:0/3387174752 learned_addr learned my addr 172.21.15.55:0/3387174752 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3043e69640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e9ef182470 0x55e9ef211ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f304466a640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9ef1f5270 0x55e9ef17f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3043668640 1 -- 172.21.15.55:0/3387174752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e9ef182470 msgr2=0x55e9ef211ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3043668640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e9ef182470 0x55e9ef211ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.085+0000 7f3043668640 1 -- 172.21.15.55:0/3387174752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9ef1f5270 msgr2=0x55e9ef17f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.086+0000 7f3043668640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9ef1f5270 0x55e9ef17f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.086+0000 7f3043668640 1 -- 172.21.15.55:0/3387174752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9ef138b20 con 0x55e9ef184690 2024-04-25T09:02:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.086+0000 7f3043e69640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e9ef182470 0x55e9ef211ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:06.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.086+0000 7f304466a640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9ef1f5270 0x55e9ef17f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:06.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.086+0000 7f3043668640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 0x55e9ef1ed960 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f302c017040 tx=0x7f302c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:06.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.086+0000 7f3041664640 1 -- 172.21.15.55:0/3387174752 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c019040 con 0x55e9ef184690 2024-04-25T09:02:06.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.086+0000 7f3041664640 1 -- 172.21.15.55:0/3387174752 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c022070 con 0x55e9ef184690 2024-04-25T09:02:06.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.086+0000 7f3046366f40 1 -- 172.21.15.55:0/3387174752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e9ef1ed330 con 0x55e9ef184690 2024-04-25T09:02:06.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.086+0000 7f3041664640 1 -- 172.21.15.55:0/3387174752 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c014690 con 0x55e9ef184690 2024-04-25T09:02:06.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.086+0000 7f3046366f40 1 -- 172.21.15.55:0/3387174752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9ef1efb30 con 0x55e9ef184690 2024-04-25T09:02:06.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.087+0000 7f3041664640 1 -- 172.21.15.55:0/3387174752 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f302c014830 con 0x55e9ef184690 2024-04-25T09:02:06.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.088+0000 7f3041664640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3024069eb0 0x7f302406c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.088+0000 7f3041664640 1 -- 172.21.15.55:0/3387174752 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f302c089a50 con 0x55e9ef184690 2024-04-25T09:02:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.088+0000 7f3043e69640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3024069eb0 0x7f302406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.088+0000 7f3046366f40 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55e9ef20ce30 0x55e9ef2ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.088+0000 7f3046366f40 1 -- 172.21.15.55:0/3387174752 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102) v9 -- 0x55e9ef1edea0 con 0x55e9ef20ce30 2024-04-25T09:02:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.088+0000 7f304466a640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55e9ef20ce30 0x55e9ef2ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.088+0000 7f3043e69640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3024069eb0 0x7f302406c370 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55e9ef2a3d00 tx=0x7f303c001680 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.088+0000 7f304466a640 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55e9ef20ce30 0x55e9ef2ac0b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f304466a640 1 -- 172.21.15.55:0/3387174752 <== osd.2 v2:172.21.15.55:6824/2942240833 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x7f3034053900 con 0x55e9ef20ce30 2024-04-25T09:02:06.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f3046366f40 1 -- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55e9ef20ce30 msgr2=0x55e9ef2ac0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f3046366f40 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55e9ef20ce30 0x55e9ef2ac0b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f3046366f40 1 -- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3024069eb0 msgr2=0x7f302406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f3046366f40 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3024069eb0 0x7f302406c370 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55e9ef2a3d00 tx=0x7f303c001680 comp rx=0 tx=0).stop 2024-04-25T09:02:06.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f3046366f40 1 -- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 msgr2=0x55e9ef1ed960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f3046366f40 1 --2- 172.21.15.55:0/3387174752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e9ef184690 0x55e9ef1ed960 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f302c017040 tx=0x7f302c003020 comp rx=0 tx=0).stop 2024-04-25T09:02:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f304466a640 1 -- 172.21.15.55:0/3387174752 reap_dead start 2024-04-25T09:02:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f3046366f40 1 -- 172.21.15.55:0/3387174752 shutdown_connections 2024-04-25T09:02:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f3046366f40 1 -- 172.21.15.55:0/3387174752 >> 172.21.15.55:0/3387174752 conn(0x55e9ef1653d0 msgr2=0x55e9ef13b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f3046366f40 1 -- 172.21.15.55:0/3387174752 shutdown_connections 2024-04-25T09:02:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.089+0000 7f3046366f40 1 -- 172.21.15.55:0/3387174752 wait complete. 2024-04-25T09:02:06.085 INFO:teuthology.orchestra.run.smithi055.stdout:����� 2024-04-25T09:02:06.085 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:02:06.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.237+0000 7f1ed6170640 1 Processor -- start 2024-04-25T09:02:06.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.237+0000 7f1ed6170640 1 -- start start 2024-04-25T09:02:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.238+0000 7f1ed6170640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed015dce0 0x7f1ed00d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.238+0000 7f1ed6170640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1ed00b5b60 0x7f1ed00b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.238+0000 7f1ed6170640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed015e0c0 con 0x7f1ed00d35b0 2024-04-25T09:02:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.238+0000 7f1ed6170640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed00d2510 con 0x7f1ed00b5b60 2024-04-25T09:02:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.238+0000 7f1ed6170640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00d27f0 con 0x7f1ed015dce0 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.238+0000 7f1ecffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1ed00b5b60 0x7f1ed00b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.238+0000 7f1ecf7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed015dce0 0x7f1ed00d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.238+0000 7f1ecf7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed015dce0 0x7f1ed00d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:51540/0 (socket says 172.21.15.55:51540) 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.238+0000 7f1ecffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1ed00b5b60 0x7f1ed00b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:55744/0 (socket says 172.21.15.55:55744) 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.238+0000 7f1ecf7fe640 1 -- 172.21.15.55:0/2402862984 learned_addr learned my addr 172.21.15.55:0/2402862984 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.238+0000 7f1eceffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1ed00d35b0 0x7f1ed00b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:60532/0 (socket says 172.21.15.55:60532) 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.239+0000 7f1ecffff640 1 -- 172.21.15.55:0/2402862984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed015dce0 msgr2=0x7f1ed00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.239+0000 7f1ecffff640 1 --2- 172.21.15.55:0/2402862984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed015dce0 0x7f1ed00d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.239+0000 7f1ecffff640 1 -- 172.21.15.55:0/2402862984 >> v1:172.21.15.167:6789/0 conn(0x7f1ed00d35b0 legacy=0x7f1ed00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.239+0000 7f1ece7fc640 1 -- 172.21.15.55:0/2402862984 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544366615 0 0) 0x7f1ed015e0c0 con 0x7f1ed00d35b0 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.239+0000 7f1ecffff640 1 -- 172.21.15.55:0/2402862984 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00d2ad0 con 0x7f1ed00b5b60 2024-04-25T09:02:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.239+0000 7f1ecf7fe640 1 --2- 172.21.15.55:0/2402862984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed015dce0 0x7f1ed00d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:06.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.239+0000 7f1ecffff640 1 --2- 172.21.15.55:0/2402862984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed00b5b60 0x7f1ed00b6b00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009d90 tx=0x7f1ec802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86881dbc8a926387 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:06.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.240+0000 7f1ece7fc640 1 -- 172.21.15.55:0/2402862984 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8007740 con 0x7f1ed00b5b60 2024-04-25T09:02:06.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.240+0000 7f1ece7fc640 1 -- 172.21.15.55:0/2402862984 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec80078e0 con 0x7f1ed00b5b60 2024-04-25T09:02:06.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.240+0000 7f1ece7fc640 1 -- 172.21.15.55:0/2402862984 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8007cb0 con 0x7f1ed00b5b60 2024-04-25T09:02:06.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.240+0000 7f1ed6170640 1 -- 172.21.15.55:0/2402862984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed00b5b60 msgr2=0x7f1ed00b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.240+0000 7f1ed6170640 1 --2- 172.21.15.55:0/2402862984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed00b5b60 0x7f1ed00b6b00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009d90 tx=0x7f1ec802a660 comp rx=0 tx=0).stop 2024-04-25T09:02:06.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.240+0000 7f1ed6170640 1 -- 172.21.15.55:0/2402862984 shutdown_connections 2024-04-25T09:02:06.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.240+0000 7f1ed6170640 1 --2- 172.21.15.55:0/2402862984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed00b5b60 0x7f1ed00b6b00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.240+0000 7f1ed6170640 1 --2- 172.21.15.55:0/2402862984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed015dce0 0x7f1ed00d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.240+0000 7f1ed6170640 1 -- 172.21.15.55:0/2402862984 >> 172.21.15.55:0/2402862984 conn(0x7f1ed0072900 msgr2=0x7f1ed00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:06.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.240+0000 7f1ed6170640 1 -- 172.21.15.55:0/2402862984 shutdown_connections 2024-04-25T09:02:06.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.240+0000 7f1ed6170640 1 -- 172.21.15.55:0/2402862984 wait complete. 2024-04-25T09:02:06.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.241+0000 7f1ed6170640 1 Processor -- start 2024-04-25T09:02:06.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.241+0000 7f1ed6170640 1 -- start start 2024-04-25T09:02:06.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.242+0000 7f1ed6170640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed00b5b60 0x7f1ed0160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.242+0000 7f1ed6170640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed00d35b0 0x7f1ed01f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.242+0000 7f1ed6170640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed015dce0 0x7f1ed01f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.242+0000 7f1ed6170640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00b9820 con 0x7f1ed015dce0 2024-04-25T09:02:06.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.242+0000 7f1ed6170640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00d3090 con 0x7f1ed00d35b0 2024-04-25T09:02:06.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.242+0000 7f1ed6170640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00b99a0 con 0x7f1ed00b5b60 2024-04-25T09:02:06.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.242+0000 7f1ecffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed015dce0 0x7f1ed01f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.242+0000 7f1ecffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed015dce0 0x7f1ed01f3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39934/0 (socket says 172.21.15.55:39934) 2024-04-25T09:02:06.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.242+0000 7f1ecffff640 1 -- 172.21.15.55:0/2662128729 learned_addr learned my addr 172.21.15.55:0/2662128729 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:06.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.242+0000 7f1ecf7fe640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed00b5b60 0x7f1ed0160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.242+0000 7f1eceffd640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed00d35b0 0x7f1ed01f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.243+0000 7f1ecffff640 1 -- 172.21.15.55:0/2662128729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed00b5b60 msgr2=0x7f1ed0160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.243+0000 7f1ecffff640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed00b5b60 0x7f1ed0160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.243+0000 7f1ecffff640 1 -- 172.21.15.55:0/2662128729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed00d35b0 msgr2=0x7f1ed01f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.243+0000 7f1ecffff640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed00d35b0 0x7f1ed01f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.243+0000 7f1ecffff640 1 -- 172.21.15.55:0/2662128729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed0161200 con 0x7f1ed015dce0 2024-04-25T09:02:06.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.243+0000 7f1ecffff640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed015dce0 0x7f1ed01f3b50 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009d90 tx=0x7f1ec8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:06.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.243+0000 7f1eb7fff640 1 -- 172.21.15.55:0/2662128729 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8040070 con 0x7f1ed015dce0 2024-04-25T09:02:06.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.243+0000 7f1eb7fff640 1 -- 172.21.15.55:0/2662128729 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec8031c40 con 0x7f1ed015dce0 2024-04-25T09:02:06.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.243+0000 7f1ed6170640 1 -- 172.21.15.55:0/2662128729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed01f4290 con 0x7f1ed015dce0 2024-04-25T09:02:06.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.243+0000 7f1eb7fff640 1 -- 172.21.15.55:0/2662128729 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8009450 con 0x7f1ed015dce0 2024-04-25T09:02:06.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.243+0000 7f1ed6170640 1 -- 172.21.15.55:0/2662128729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed01604c0 con 0x7f1ed015dce0 2024-04-25T09:02:06.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.244+0000 7f1ed6170640 1 -- 172.21.15.55:0/2662128729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed00749b0 con 0x7f1ed015dce0 2024-04-25T09:02:06.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.245+0000 7f1eb7fff640 1 -- 172.21.15.55:0/2662128729 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ec8039040 con 0x7f1ed015dce0 2024-04-25T09:02:06.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.245+0000 7f1eb7fff640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1ebc06b4d0 0x7f1ebc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.245+0000 7f1eb7fff640 1 -- 172.21.15.55:0/2662128729 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ec80aafa0 con 0x7f1ed015dce0 2024-04-25T09:02:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.245+0000 7f1ecf7fe640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1ebc06b4d0 0x7f1ebc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.246+0000 7f1ecf7fe640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1ebc06b4d0 0x7f1ebc06d990 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009630 tx=0x7f1ec0009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:06.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.249+0000 7f1eb7fff640 1 -- 172.21.15.55:0/2662128729 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1ed0161200 con 0x7f1ed015dce0 2024-04-25T09:02:06.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.467+0000 7f1ed6170640 1 -- 172.21.15.55:0/2662128729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ed00c72a0 con 0x7f1ed015dce0 2024-04-25T09:02:06.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.468+0000 7f1eb7fff640 1 -- 172.21.15.55:0/2662128729 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1ec80797d0 con 0x7f1ed015dce0 2024-04-25T09:02:06.458 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:02:06.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.469+0000 7f1ed6170640 1 -- 172.21.15.55:0/2662128729 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1ebc06b4d0 msgr2=0x7f1ebc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.469+0000 7f1ed6170640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1ebc06b4d0 0x7f1ebc06d990 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009630 tx=0x7f1ec0009240 comp rx=0 tx=0).stop 2024-04-25T09:02:06.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.469+0000 7f1ed6170640 1 -- 172.21.15.55:0/2662128729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed015dce0 msgr2=0x7f1ed01f3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:06.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.469+0000 7f1ed6170640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed015dce0 0x7f1ed01f3b50 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009d90 tx=0x7f1ec8004a40 comp rx=0 tx=0).stop 2024-04-25T09:02:06.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.470+0000 7f1ed6170640 1 -- 172.21.15.55:0/2662128729 shutdown_connections 2024-04-25T09:02:06.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.470+0000 7f1ed6170640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1ebc06b4d0 0x7f1ebc06d990 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.470+0000 7f1ed6170640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed015dce0 0x7f1ed01f3b50 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.470+0000 7f1ed6170640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed00d35b0 0x7f1ed01f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.470+0000 7f1ed6170640 1 --2- 172.21.15.55:0/2662128729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ed00b5b60 0x7f1ed0160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:06.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.470+0000 7f1ed6170640 1 -- 172.21.15.55:0/2662128729 >> 172.21.15.55:0/2662128729 conn(0x7f1ed0072900 msgr2=0x7f1ed00b6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:06.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.470+0000 7f1ed6170640 1 -- 172.21.15.55:0/2662128729 shutdown_connections 2024-04-25T09:02:06.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:06.470+0000 7f1ed6170640 1 -- 172.21.15.55:0/2662128729 wait complete. 2024-04-25T09:02:06.469 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:02:06.469 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:02:06.469 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T09:02:06.469 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:02:06.469 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:06.469 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:02:06.469 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:02:06.469 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:02:06.469 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:02:06.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.470 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T09:02:06.486 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:02:06.486 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:02:06.486 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:02:06.486 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.486 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T09:02:06.486 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.486 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:02:06.486 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:06.487 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42231sec preferred_lft 42231sec 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:06.488 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T09:02:06.489 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.490 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:02:06.549 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:02:06.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.551 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T09:02:06.608 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T09:02:06.608 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:02:06.608 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:02:06.608 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:02:06.608 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:02:06.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.608 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:02:06.608 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:02:06.609 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:02:06.609 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:02:06.609 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:02:06.609 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:02:06.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.695 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:02:06.710 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:02:06.710 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:02:06.710 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:02:06.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.710 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T09:02:06.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:06.775 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:06.830 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:02:06.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:06.831 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:06.885 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:02:07.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:07.008 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:07.051 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:07.051 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:02:07.051 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:02:07.060 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:07.060 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:02:07.060 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:02:07.060 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:02:07.060 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:07.071 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:07.071 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:02:07.071 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:02:07.071 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:02:07.071 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:07.071 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T09:02:07.071 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T09:02:07.071 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T09:02:07.072 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:02:07.072 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:02:07.072 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:02:07.072 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:02:07.072 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:02:07.073 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:02:07.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:07.073 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:07.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:07.138 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:07.195 INFO:teuthology.orchestra.run.smithi055.stdout:client7459 2024-04-25T09:02:07.195 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:02:07.195 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:07.251 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:02:07.251 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:07.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:07.306 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T09:02:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records in 2024-04-25T09:02:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records out 2024-04-25T09:02:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0308932 s, 204 MB/s 2024-04-25T09:02:07.395 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:02:07.396 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:07.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:07.411 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T09:02:07.501 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records in 2024-04-25T09:02:07.501 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records out 2024-04-25T09:02:07.501 INFO:teuthology.orchestra.run.smithi055.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.033057 s, 190 MB/s 2024-04-25T09:02:07.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:07.501 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:02:07.517 INFO:teuthology.orchestra.run.smithi055.stdout:./ 2024-04-25T09:02:07.517 INFO:teuthology.orchestra.run.smithi055.stdout:./file2_sixmegs 2024-04-25T09:02:07.517 INFO:teuthology.orchestra.run.smithi055.stdout:./file3_sixmegs 2024-04-25T09:02:07.517 INFO:teuthology.orchestra.run.smithi055.stdout:./file1_sixmegs 2024-04-25T09:02:07.518 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:02:07.518 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:02:07.518 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:02:07.518 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:02:07.518 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:02:07.519 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:02:07.626 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:02:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:02:07.635 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:02:07.635 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:02:07.635 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:02:07.635 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:02:07.635 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-04-25T09:02:07.635 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:02:07.742 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-25T09:02:07.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:02:07.751 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:02:07.751 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:02:07.751 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:02:07.751 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:02:07.751 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-04-25T09:02:07.751 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:02:07.858 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627778 2024-04-25T09:02:07.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:02:07.867 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:02:07.867 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:02:07.867 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:02:07.867 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:02:07.868 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-04-25T09:02:07.868 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:02:07.975 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-25T09:02:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:02:07.984 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:02:07.984 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:08.039 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:02:08.040 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:08.095 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.248+0000 7f89fddf4640 1 Processor -- start 2024-04-25T09:02:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.248+0000 7f89fddf4640 1 -- start start 2024-04-25T09:02:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.248+0000 7f89fddf4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89f815dce0 0x7f89f80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.248+0000 7f89fddf4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89f80d35b0 0x7f89f80b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.248+0000 7f89fddf4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f815e0c0 con 0x7f89f80d1f90 2024-04-25T09:02:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.248+0000 7f89fddf4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f80b7b10 con 0x7f89f80d35b0 2024-04-25T09:02:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.248+0000 7f89fddf4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80d2510 con 0x7f89f815dce0 2024-04-25T09:02:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.249+0000 7f89f6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89f80d35b0 0x7f89f80b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.249+0000 7f89f7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f89f80d1f90 0x7f89f806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56800/0 (socket says 172.21.15.55:56800) 2024-04-25T09:02:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.249+0000 7f89f7fff640 1 -- 172.21.15.55:0/215454073 learned_addr learned my addr 172.21.15.55:0/215454073 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.249+0000 7f89f77fe640 1 --2- 172.21.15.55:0/215454073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89f815dce0 0x7f89f80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.249+0000 7f89f6ffd640 1 -- 172.21.15.55:0/215454073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89f815dce0 msgr2=0x7f89f80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.249+0000 7f89f6ffd640 1 --2- 172.21.15.55:0/215454073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89f815dce0 0x7f89f80d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.249+0000 7f89f6ffd640 1 -- 172.21.15.55:0/215454073 >> v1:172.21.15.55:6789/0 conn(0x7f89f80d1f90 legacy=0x7f89f806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.249+0000 7f89f6ffd640 1 -- 172.21.15.55:0/215454073 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f80d27f0 con 0x7f89f80d35b0 2024-04-25T09:02:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.249+0000 7f89f67fc640 1 -- 172.21.15.55:0/215454073 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855171809 0 0) 0x7f89f815e0c0 con 0x7f89f80d1f90 2024-04-25T09:02:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89f6ffd640 1 --2- 172.21.15.55:0/215454073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f80d35b0 0x7f89f80b5450 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0097a0 tx=0x7f89ec02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d414d095f4c47764 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89f67fc640 1 -- 172.21.15.55:0/215454073 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec037070 con 0x7f89f80d35b0 2024-04-25T09:02:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89f67fc640 1 -- 172.21.15.55:0/215454073 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec02ae50 con 0x7f89f80d35b0 2024-04-25T09:02:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89f67fc640 1 -- 172.21.15.55:0/215454073 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec032660 con 0x7f89f80d35b0 2024-04-25T09:02:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89fddf4640 1 -- 172.21.15.55:0/215454073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f80d35b0 msgr2=0x7f89f80b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89fddf4640 1 --2- 172.21.15.55:0/215454073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f80d35b0 0x7f89f80b5450 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0097a0 tx=0x7f89ec02a100 comp rx=0 tx=0).stop 2024-04-25T09:02:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89fddf4640 1 -- 172.21.15.55:0/215454073 shutdown_connections 2024-04-25T09:02:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89fddf4640 1 --2- 172.21.15.55:0/215454073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f80d35b0 0x7f89f80b5450 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89fddf4640 1 --2- 172.21.15.55:0/215454073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89f815dce0 0x7f89f80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89fddf4640 1 -- 172.21.15.55:0/215454073 >> 172.21.15.55:0/215454073 conn(0x7f89f8072900 msgr2=0x7f89f80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89fddf4640 1 -- 172.21.15.55:0/215454073 shutdown_connections 2024-04-25T09:02:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.250+0000 7f89fddf4640 1 -- 172.21.15.55:0/215454073 wait complete. 2024-04-25T09:02:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.252+0000 7f89fddf4640 1 Processor -- start 2024-04-25T09:02:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.252+0000 7f89fddf4640 1 -- start start 2024-04-25T09:02:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.252+0000 7f89fddf4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f80d1f90 0x7f89f81f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.252+0000 7f89fddf4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89f80d35b0 0x7f89f8156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.252+0000 7f89fddf4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f815dce0 0x7f89f80ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.252+0000 7f89fddf4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80d3090 con 0x7f89f80d1f90 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.252+0000 7f89fddf4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80d2db0 con 0x7f89f815dce0 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.252+0000 7f89fddf4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80b9820 con 0x7f89f80d35b0 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f80d1f90 0x7f89f81f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f80d1f90 0x7f89f81f41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39948/0 (socket says 172.21.15.55:39948) 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f77fe640 1 -- 172.21.15.55:0/959816347 learned_addr learned my addr 172.21.15.55:0/959816347 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f7fff640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f815dce0 0x7f89f80ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f6ffd640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89f80d35b0 0x7f89f8156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f77fe640 1 -- 172.21.15.55:0/959816347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89f80d35b0 msgr2=0x7f89f8156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f77fe640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89f80d35b0 0x7f89f8156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f77fe640 1 -- 172.21.15.55:0/959816347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f815dce0 msgr2=0x7f89f80ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f77fe640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f815dce0 0x7f89f80ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f77fe640 1 -- 172.21.15.55:0/959816347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f81f4720 con 0x7f89f80d1f90 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f6ffd640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89f80d35b0 0x7f89f8156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89f77fe640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f80d1f90 0x7f89f81f41e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f89e800d800 tx=0x7f89e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89dffff640 1 -- 172.21.15.55:0/959816347 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e800b6c0 con 0x7f89f80d1f90 2024-04-25T09:02:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89dffff640 1 -- 172.21.15.55:0/959816347 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8019070 con 0x7f89f80d1f90 2024-04-25T09:02:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89dffff640 1 -- 172.21.15.55:0/959816347 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e800ba80 con 0x7f89f80d1f90 2024-04-25T09:02:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89fddf4640 1 -- 172.21.15.55:0/959816347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f815e2b0 con 0x7f89f80d1f90 2024-04-25T09:02:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.253+0000 7f89fddf4640 1 -- 172.21.15.55:0/959816347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f815e550 con 0x7f89f80d1f90 2024-04-25T09:02:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.254+0000 7f89fddf4640 1 -- 172.21.15.55:0/959816347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f80749b0 con 0x7f89f80d1f90 2024-04-25T09:02:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.255+0000 7f89dffff640 1 -- 172.21.15.55:0/959816347 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f89e800bc20 con 0x7f89f80d1f90 2024-04-25T09:02:08.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.255+0000 7f89dffff640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89e406b4d0 0x7f89e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.255+0000 7f89dffff640 1 -- 172.21.15.55:0/959816347 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89e808a6b0 con 0x7f89f80d1f90 2024-04-25T09:02:08.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.255+0000 7f89f6ffd640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89e406b4d0 0x7f89e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.256+0000 7f89f6ffd640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89e406b4d0 0x7f89e406d990 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f89ec034000 tx=0x7f89ec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.260+0000 7f89dffff640 1 -- 172.21.15.55:0/959816347 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f89f81f4720 con 0x7f89f80d1f90 2024-04-25T09:02:08.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.441+0000 7f89fddf4640 1 -- 172.21.15.55:0/959816347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89f80b8840 con 0x7f89f80d1f90 2024-04-25T09:02:08.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.442+0000 7f89dffff640 1 -- 172.21.15.55:0/959816347 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16619 (secure 0 0 0) 0x7f89e8059490 con 0x7f89f80d1f90 2024-04-25T09:02:08.431 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:08.431 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:01:53.683789+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:50.330313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:51.020096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 -- 172.21.15.55:0/959816347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89e406b4d0 msgr2=0x7f89e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89e406b4d0 0x7f89e406d990 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f89ec034000 tx=0x7f89ec02e000 comp rx=0 tx=0).stop 2024-04-25T09:02:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 -- 172.21.15.55:0/959816347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f80d1f90 msgr2=0x7f89f81f41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f80d1f90 0x7f89f81f41e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f89e800d800 tx=0x7f89e800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 -- 172.21.15.55:0/959816347 shutdown_connections 2024-04-25T09:02:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f89e406b4d0 0x7f89e406d990 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f815dce0 0x7f89f80ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89f80d35b0 0x7f89f8156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 --2- 172.21.15.55:0/959816347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f80d1f90 0x7f89f81f41e0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 -- 172.21.15.55:0/959816347 >> 172.21.15.55:0/959816347 conn(0x7f89f8072900 msgr2=0x7f89f80ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 -- 172.21.15.55:0/959816347 shutdown_connections 2024-04-25T09:02:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.444+0000 7f89fddf4640 1 -- 172.21.15.55:0/959816347 wait complete. 2024-04-25T09:02:08.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:50.330313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:51.020096+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:02:08.444 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.559+0000 7fcd398b5640 1 Processor -- start 2024-04-25T09:02:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.559+0000 7fcd398b5640 1 -- start start 2024-04-25T09:02:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd398b5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd340d0490 0x7fcd3415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd398b5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd340b2740 0x7fcd340d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd398b5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd340d0db0 con 0x7fcd341617b0 2024-04-25T09:02:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd398b5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd340d2000 con 0x7fcd340d0490 2024-04-25T09:02:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd398b5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3406cd60 con 0x7fcd340b2740 2024-04-25T09:02:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd32ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd340d0490 0x7fcd3415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd337fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcd341617b0 0x7fcd34161c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56812/0 (socket says 172.21.15.55:56812) 2024-04-25T09:02:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd337fe640 1 -- 172.21.15.55:0/3757335436 learned_addr learned my addr 172.21.15.55:0/3757335436 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd32ffd640 1 -- 172.21.15.55:0/3757335436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd340b2740 msgr2=0x7fcd340d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd327fc640 1 --2- 172.21.15.55:0/3757335436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd340b2740 0x7fcd340d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd31ffb640 1 -- 172.21.15.55:0/3757335436 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978247931 0 0) 0x7fcd340d0db0 con 0x7fcd341617b0 2024-04-25T09:02:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd32ffd640 1 --2- 172.21.15.55:0/3757335436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd340b2740 0x7fcd340d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd32ffd640 1 -- 172.21.15.55:0/3757335436 >> v1:172.21.15.55:6789/0 conn(0x7fcd341617b0 legacy=0x7fcd34161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd32ffd640 1 -- 172.21.15.55:0/3757335436 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3406c150 con 0x7fcd340d0490 2024-04-25T09:02:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.560+0000 7fcd327fc640 1 --2- 172.21.15.55:0/3757335436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd340b2740 0x7fcd340d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:08.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.561+0000 7fcd32ffd640 1 --2- 172.21.15.55:0/3757335436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd340d0490 0x7fcd3415ec90 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009800 tx=0x7fcd2c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352058e068d54c30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.561+0000 7fcd31ffb640 1 -- 172.21.15.55:0/3757335436 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c037070 con 0x7fcd340d0490 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.561+0000 7fcd31ffb640 1 -- 172.21.15.55:0/3757335436 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c032440 con 0x7fcd340d0490 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.561+0000 7fcd31ffb640 1 -- 172.21.15.55:0/3757335436 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c02ae60 con 0x7fcd340d0490 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.562+0000 7fcd398b5640 1 -- 172.21.15.55:0/3757335436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd340d0490 msgr2=0x7fcd3415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.562+0000 7fcd398b5640 1 --2- 172.21.15.55:0/3757335436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd340d0490 0x7fcd3415ec90 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009800 tx=0x7fcd2c02a150 comp rx=0 tx=0).stop 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.562+0000 7fcd398b5640 1 -- 172.21.15.55:0/3757335436 shutdown_connections 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.562+0000 7fcd398b5640 1 --2- 172.21.15.55:0/3757335436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd340b2740 0x7fcd340d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.562+0000 7fcd398b5640 1 --2- 172.21.15.55:0/3757335436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd340d0490 0x7fcd3415ec90 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.562+0000 7fcd398b5640 1 -- 172.21.15.55:0/3757335436 >> 172.21.15.55:0/3757335436 conn(0x7fcd340b5660 msgr2=0x7fcd340b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.562+0000 7fcd398b5640 1 -- 172.21.15.55:0/3757335436 shutdown_connections 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.562+0000 7fcd398b5640 1 -- 172.21.15.55:0/3757335436 wait complete. 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.563+0000 7fcd398b5640 1 Processor -- start 2024-04-25T09:02:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.563+0000 7fcd398b5640 1 -- start start 2024-04-25T09:02:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd398b5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd340b2740 0x7fcd340cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd398b5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd340d0490 0x7fcd340cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd398b5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd341617b0 0x7fcd3415d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd398b5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3406c710 con 0x7fcd341617b0 2024-04-25T09:02:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd398b5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3415f1d0 con 0x7fcd340b2740 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd398b5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3406c9f0 con 0x7fcd340d0490 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd341617b0 0x7fcd3415d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd341617b0 0x7fcd3415d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39964/0 (socket says 172.21.15.55:39964) 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd337fe640 1 -- 172.21.15.55:0/3631769282 learned_addr learned my addr 172.21.15.55:0/3631769282 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd327fc640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd340d0490 0x7fcd340cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd32ffd640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd340b2740 0x7fcd340cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd337fe640 1 -- 172.21.15.55:0/3631769282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd340d0490 msgr2=0x7fcd340cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd337fe640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd340d0490 0x7fcd340cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd337fe640 1 -- 172.21.15.55:0/3631769282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd340b2740 msgr2=0x7fcd340cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd337fe640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd340b2740 0x7fcd340cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.564+0000 7fcd337fe640 1 -- 172.21.15.55:0/3631769282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3415d630 con 0x7fcd341617b0 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.565+0000 7fcd337fe640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd341617b0 0x7fcd3415d0f0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400c700 tx=0x7fcd2400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.565+0000 7fcd2bfff640 1 -- 172.21.15.55:0/3631769282 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24018070 con 0x7fcd341617b0 2024-04-25T09:02:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.565+0000 7fcd2bfff640 1 -- 172.21.15.55:0/3631769282 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2400ce10 con 0x7fcd341617b0 2024-04-25T09:02:08.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.565+0000 7fcd398b5640 1 -- 172.21.15.55:0/3631769282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd340ce760 con 0x7fcd341617b0 2024-04-25T09:02:08.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.565+0000 7fcd2bfff640 1 -- 172.21.15.55:0/3631769282 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2400a860 con 0x7fcd341617b0 2024-04-25T09:02:08.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.565+0000 7fcd398b5640 1 -- 172.21.15.55:0/3631769282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd340cc3b0 con 0x7fcd341617b0 2024-04-25T09:02:08.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.566+0000 7fcd398b5640 1 -- 172.21.15.55:0/3631769282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd340750b0 con 0x7fcd341617b0 2024-04-25T09:02:08.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.566+0000 7fcd2bfff640 1 -- 172.21.15.55:0/3631769282 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd2401b070 con 0x7fcd341617b0 2024-04-25T09:02:08.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.567+0000 7fcd2bfff640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd1406b4d0 0x7fcd1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.567+0000 7fcd2bfff640 1 -- 172.21.15.55:0/3631769282 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd240896c0 con 0x7fcd341617b0 2024-04-25T09:02:08.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.567+0000 7fcd32ffd640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd1406b4d0 0x7fcd1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.567+0000 7fcd32ffd640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd1406b4d0 0x7fcd1406d990 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c034000 tx=0x7fcd2c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.571+0000 7fcd2bfff640 1 -- 172.21.15.55:0/3631769282 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd3415d630 con 0x7fcd341617b0 2024-04-25T09:02:08.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.754+0000 7fcd398b5640 1 -- 172.21.15.55:0/3631769282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd340d18d0 con 0x7fcd341617b0 2024-04-25T09:02:08.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.755+0000 7fcd2bfff640 1 -- 172.21.15.55:0/3631769282 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd24057ee0 con 0x7fcd341617b0 2024-04-25T09:02:08.744 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:02:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.756+0000 7fcd398b5640 1 -- 172.21.15.55:0/3631769282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd1406b4d0 msgr2=0x7fcd1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.756+0000 7fcd398b5640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd1406b4d0 0x7fcd1406d990 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c034000 tx=0x7fcd2c02e000 comp rx=0 tx=0).stop 2024-04-25T09:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.756+0000 7fcd398b5640 1 -- 172.21.15.55:0/3631769282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd341617b0 msgr2=0x7fcd3415d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.756+0000 7fcd398b5640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd341617b0 0x7fcd3415d0f0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400c700 tx=0x7fcd2400cbc0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.757+0000 7fcd398b5640 1 -- 172.21.15.55:0/3631769282 shutdown_connections 2024-04-25T09:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.757+0000 7fcd398b5640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcd1406b4d0 0x7fcd1406d990 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.757+0000 7fcd398b5640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd341617b0 0x7fcd3415d0f0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.757+0000 7fcd398b5640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd340d0490 0x7fcd340cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.757+0000 7fcd398b5640 1 --2- 172.21.15.55:0/3631769282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd340b2740 0x7fcd340cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.757+0000 7fcd398b5640 1 -- 172.21.15.55:0/3631769282 >> 172.21.15.55:0/3631769282 conn(0x7fcd340b5660 msgr2=0x7fcd3415f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.757+0000 7fcd398b5640 1 -- 172.21.15.55:0/3631769282 shutdown_connections 2024-04-25T09:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.757+0000 7fcd398b5640 1 -- 172.21.15.55:0/3631769282 wait complete. 2024-04-25T09:02:08.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.872+0000 7f2cc116a640 1 Processor -- start 2024-04-25T09:02:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.872+0000 7f2cc116a640 1 -- start start 2024-04-25T09:02:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cc116a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cbc0ce3a0 0x7f2cbc0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cc116a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cbc15d450 0x7f2cbc15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cc116a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cbc0b1f60 con 0x7f2cbc06aba0 2024-04-25T09:02:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cc116a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cbc0b0130 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cc116a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc0b09d0 con 0x7f2cbc15d450 2024-04-25T09:02:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cba59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cbc0ce3a0 0x7f2cbc0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cba59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cbc0ce3a0 0x7f2cbc0b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45808/0 (socket says 172.21.15.55:45808) 2024-04-25T09:02:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cba59c640 1 -- 172.21.15.55:0/960954613 learned_addr learned my addr 172.21.15.55:0/960954613 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cbb59e640 1 --2- 172.21.15.55:0/960954613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cbc15d450 0x7f2cbc15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cba59c640 1 -- 172.21.15.55:0/960954613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cbc15d450 msgr2=0x7f2cbc15d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cba59c640 1 --2- 172.21.15.55:0/960954613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cbc15d450 0x7f2cbc15d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cba59c640 1 -- 172.21.15.55:0/960954613 >> v1:172.21.15.167:6789/0 conn(0x7f2cbc06aba0 legacy=0x7f2cbc06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.873+0000 7f2cba59c640 1 -- 172.21.15.55:0/960954613 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc0b0380 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.874+0000 7f2cba59c640 1 --2- 172.21.15.55:0/960954613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cbc0ce3a0 0x7f2cbc0b1980 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009870 tx=0x7f2cb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fffe82d53ca20c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.874+0000 7f2cb9d9b640 1 -- 172.21.15.55:0/960954613 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0037070 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.874+0000 7f2cb9d9b640 1 -- 172.21.15.55:0/960954613 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb0032440 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.874+0000 7f2cb9d9b640 1 -- 172.21.15.55:0/960954613 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0032810 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.875+0000 7f2cc116a640 1 -- 172.21.15.55:0/960954613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cbc0ce3a0 msgr2=0x7f2cbc0b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.875+0000 7f2cc116a640 1 --2- 172.21.15.55:0/960954613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cbc0ce3a0 0x7f2cbc0b1980 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009870 tx=0x7f2cb002a270 comp rx=0 tx=0).stop 2024-04-25T09:02:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.875+0000 7f2cc116a640 1 -- 172.21.15.55:0/960954613 shutdown_connections 2024-04-25T09:02:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.875+0000 7f2cc116a640 1 --2- 172.21.15.55:0/960954613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cbc15d450 0x7f2cbc15d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.875+0000 7f2cc116a640 1 --2- 172.21.15.55:0/960954613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cbc0ce3a0 0x7f2cbc0b1980 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.875+0000 7f2cc116a640 1 -- 172.21.15.55:0/960954613 >> 172.21.15.55:0/960954613 conn(0x7f2cbc0d07d0 msgr2=0x7f2cbc0d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.875+0000 7f2cc116a640 1 -- 172.21.15.55:0/960954613 shutdown_connections 2024-04-25T09:02:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.875+0000 7f2cc116a640 1 -- 172.21.15.55:0/960954613 wait complete. 2024-04-25T09:02:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.876+0000 7f2cc116a640 1 Processor -- start 2024-04-25T09:02:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.876+0000 7f2cc116a640 1 -- start start 2024-04-25T09:02:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cc116a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cbc06aba0 0x7f2cbc153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cc116a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cbc0ce3a0 0x7f2cbc0c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cc116a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cbc15d450 0x7f2cbc0c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cc116a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc0b0e60 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cc116a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc06b880 con 0x7f2cbc06aba0 2024-04-25T09:02:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cc116a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc0b0fe0 con 0x7f2cbc15d450 2024-04-25T09:02:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cba59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cbc0ce3a0 0x7f2cbc0c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cba59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cbc0ce3a0 0x7f2cbc0c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45824/0 (socket says 172.21.15.55:45824) 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cba59c640 1 -- 172.21.15.55:0/3514547336 learned_addr learned my addr 172.21.15.55:0/3514547336 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cbb59e640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cbc15d450 0x7f2cbc0c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cbad9d640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cbc06aba0 0x7f2cbc153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cba59c640 1 -- 172.21.15.55:0/3514547336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cbc15d450 msgr2=0x7f2cbc0c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.877+0000 7f2cba59c640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cbc15d450 0x7f2cbc0c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.878+0000 7f2cba59c640 1 -- 172.21.15.55:0/3514547336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cbc06aba0 msgr2=0x7f2cbc153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.878+0000 7f2cba59c640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cbc06aba0 0x7f2cbc153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.878+0000 7f2cba59c640 1 -- 172.21.15.55:0/3514547336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc0c5dc0 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.878+0000 7f2cba59c640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cbc0ce3a0 0x7f2cbc0c6580 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00097c0 tx=0x7f2cb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.878+0000 7f2ca37fe640 1 -- 172.21.15.55:0/3514547336 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0037040 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.878+0000 7f2ca37fe640 1 -- 172.21.15.55:0/3514547336 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb0042070 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.878+0000 7f2ca37fe640 1 -- 172.21.15.55:0/3514547336 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0030900 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.878+0000 7f2cc116a640 1 -- 172.21.15.55:0/3514547336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cbc154490 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.878+0000 7f2cc116a640 1 -- 172.21.15.55:0/3514547336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cbc0c7d20 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.879+0000 7f2cc116a640 1 -- 172.21.15.55:0/3514547336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cbc1610d0 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.879+0000 7f2ca37fe640 1 -- 172.21.15.55:0/3514547336 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2cb0030aa0 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.880+0000 7f2ca37fe640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ca806b4d0 0x7f2ca806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.880+0000 7f2ca37fe640 1 -- 172.21.15.55:0/3514547336 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cb00aa900 con 0x7f2cbc0ce3a0 2024-04-25T09:02:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.880+0000 7f2cbad9d640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ca806b4d0 0x7f2ca806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.880+0000 7f2cbad9d640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ca806b4d0 0x7f2ca806d990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2cac001780 tx=0x7f2cac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:08.884+0000 7f2ca37fe640 1 -- 172.21.15.55:0/3514547336 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2cbc1610d0 con 0x7f2cbc0ce3a0 2024-04-25T09:02:09.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.067+0000 7f2cc116a640 1 -- 172.21.15.55:0/3514547336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2cbc0b1980 con 0x7f2cbc0ce3a0 2024-04-25T09:02:09.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.067+0000 7f2ca37fe640 1 -- 172.21.15.55:0/3514547336 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2cbc0b1980 con 0x7f2cbc0ce3a0 2024-04-25T09:02:09.056 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T09:02:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 -- 172.21.15.55:0/3514547336 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ca806b4d0 msgr2=0x7f2ca806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ca806b4d0 0x7f2ca806d990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2cac001780 tx=0x7f2cac009040 comp rx=0 tx=0).stop 2024-04-25T09:02:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 -- 172.21.15.55:0/3514547336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cbc0ce3a0 msgr2=0x7f2cbc0c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cbc0ce3a0 0x7f2cbc0c6580 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00097c0 tx=0x7f2cb00046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 -- 172.21.15.55:0/3514547336 shutdown_connections 2024-04-25T09:02:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ca806b4d0 0x7f2ca806d990 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cbc15d450 0x7f2cbc0c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cbc0ce3a0 0x7f2cbc0c6580 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 --2- 172.21.15.55:0/3514547336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cbc06aba0 0x7f2cbc153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 -- 172.21.15.55:0/3514547336 >> 172.21.15.55:0/3514547336 conn(0x7f2cbc0d07d0 msgr2=0x7f2cbc0cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 -- 172.21.15.55:0/3514547336 shutdown_connections 2024-04-25T09:02:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.069+0000 7f2cc116a640 1 -- 172.21.15.55:0/3514547336 wait complete. 2024-04-25T09:02:09.069 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:09.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.184+0000 7facf7458640 1 Processor -- start 2024-04-25T09:02:09.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.185+0000 7facf7458640 1 -- start start 2024-04-25T09:02:09.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.185+0000 7facf7458640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7facf00b97c0 0x7facf00b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.185+0000 7facf7458640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 0x7facf00d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.185+0000 7facf7458640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf01627a0 con 0x7facf015dc80 2024-04-25T09:02:09.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.185+0000 7facf7458640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf0161f80 con 0x7facf00b97c0 2024-04-25T09:02:09.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.185+0000 7facf7458640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf00b5e60 con 0x7facf00b5a30 2024-04-25T09:02:09.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.186+0000 7facf49f3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7facf00b97c0 0x7facf00b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.186+0000 7facf59f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 0x7facf00d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.186+0000 7facf49f3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7facf00b97c0 0x7facf00b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:36410/0 (socket says 172.21.15.55:36410) 2024-04-25T09:02:09.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.186+0000 7facf49f3640 1 -- 172.21.15.55:0/3494867546 learned_addr learned my addr 172.21.15.55:0/3494867546 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:09.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.186+0000 7facf51f4640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7facf015dc80 0x7facf0161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:36364/0 (socket says 172.21.15.55:36364) 2024-04-25T09:02:09.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.186+0000 7facf49f3640 1 -- 172.21.15.55:0/3494867546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 msgr2=0x7facf00d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:09.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.186+0000 7facf49f3640 1 --2- 172.21.15.55:0/3494867546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 0x7facf00d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.186+0000 7facf49f3640 1 -- 172.21.15.55:0/3494867546 >> v1:172.21.15.167:6789/0 conn(0x7facf015dc80 legacy=0x7facf0161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.186+0000 7facf49f3640 1 -- 172.21.15.55:0/3494867546 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf01621e0 con 0x7facf00b97c0 2024-04-25T09:02:09.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.186+0000 7face7fff640 1 -- 172.21.15.55:0/3494867546 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418956539 0 0) 0x7facf01627a0 con 0x7facf015dc80 2024-04-25T09:02:09.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.186+0000 7facf59f5640 1 --2- 172.21.15.55:0/3494867546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 0x7facf00d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:09.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.187+0000 7facf49f3640 1 --2- 172.21.15.55:0/3494867546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf00b97c0 0x7facf00b54f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7face00098a0 tx=0x7face002a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa1390c54cc0bc3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.187+0000 7face7fff640 1 -- 172.21.15.55:0/3494867546 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0037070 con 0x7facf00b97c0 2024-04-25T09:02:09.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.187+0000 7face7fff640 1 -- 172.21.15.55:0/3494867546 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face0032440 con 0x7facf00b97c0 2024-04-25T09:02:09.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.187+0000 7face7fff640 1 -- 172.21.15.55:0/3494867546 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0032810 con 0x7facf00b97c0 2024-04-25T09:02:09.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.187+0000 7facf7458640 1 -- 172.21.15.55:0/3494867546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf00b97c0 msgr2=0x7facf00b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.187+0000 7facf7458640 1 --2- 172.21.15.55:0/3494867546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf00b97c0 0x7facf00b54f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7face00098a0 tx=0x7face002a290 comp rx=0 tx=0).stop 2024-04-25T09:02:09.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.188+0000 7facf7458640 1 -- 172.21.15.55:0/3494867546 shutdown_connections 2024-04-25T09:02:09.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.188+0000 7facf7458640 1 --2- 172.21.15.55:0/3494867546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 0x7facf00d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.188+0000 7facf7458640 1 --2- 172.21.15.55:0/3494867546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf00b97c0 0x7facf00b54f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.188+0000 7facf7458640 1 -- 172.21.15.55:0/3494867546 >> 172.21.15.55:0/3494867546 conn(0x7facf00d04f0 msgr2=0x7facf00d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:09.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.188+0000 7facf7458640 1 -- 172.21.15.55:0/3494867546 shutdown_connections 2024-04-25T09:02:09.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.188+0000 7facf7458640 1 -- 172.21.15.55:0/3494867546 wait complete. 2024-04-25T09:02:09.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.189+0000 7facf7458640 1 Processor -- start 2024-04-25T09:02:09.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.189+0000 7facf7458640 1 -- start start 2024-04-25T09:02:09.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf7458640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 0x7facf0160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf7458640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf00b97c0 0x7facf015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf7458640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf015dc80 0x7facf00b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf7458640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf015e060 con 0x7facf00b97c0 2024-04-25T09:02:09.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf7458640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf00d1c70 con 0x7facf015dc80 2024-04-25T09:02:09.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf7458640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf00d29b0 con 0x7facf00b5a30 2024-04-25T09:02:09.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf49f3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf00b97c0 0x7facf015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf49f3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf00b97c0 0x7facf015ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45830/0 (socket says 172.21.15.55:45830) 2024-04-25T09:02:09.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf49f3640 1 -- 172.21.15.55:0/1172140821 learned_addr learned my addr 172.21.15.55:0/1172140821 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:09.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf59f5640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf015dc80 0x7facf00b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf51f4640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 0x7facf0160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf49f3640 1 -- 172.21.15.55:0/1172140821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 msgr2=0x7facf0160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf49f3640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 0x7facf0160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf49f3640 1 -- 172.21.15.55:0/1172140821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf015dc80 msgr2=0x7facf00b6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf49f3640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf015dc80 0x7facf00b6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf49f3640 1 -- 172.21.15.55:0/1172140821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0161320 con 0x7facf00b97c0 2024-04-25T09:02:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf59f5640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf015dc80 0x7facf00b6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf51f4640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 0x7facf0160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf49f3640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf00b97c0 0x7facf015ae80 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7face00098a0 tx=0x7face00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7face5ffb640 1 -- 172.21.15.55:0/1172140821 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0037040 con 0x7facf00b97c0 2024-04-25T09:02:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7face5ffb640 1 -- 172.21.15.55:0/1172140821 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face0030440 con 0x7facf00b97c0 2024-04-25T09:02:09.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7facf7458640 1 -- 172.21.15.55:0/1172140821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf01f46d0 con 0x7facf00b97c0 2024-04-25T09:02:09.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.190+0000 7face5ffb640 1 -- 172.21.15.55:0/1172140821 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0030830 con 0x7facf00b97c0 2024-04-25T09:02:09.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.191+0000 7facf7458640 1 -- 172.21.15.55:0/1172140821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf01f3bf0 con 0x7facf00b97c0 2024-04-25T09:02:09.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.192+0000 7facf7458640 1 -- 172.21.15.55:0/1172140821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf00750b0 con 0x7facf00b97c0 2024-04-25T09:02:09.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.192+0000 7face5ffb640 1 -- 172.21.15.55:0/1172140821 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7face0044030 con 0x7facf00b97c0 2024-04-25T09:02:09.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.192+0000 7face5ffb640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7facd406b500 0x7facd406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.192+0000 7face5ffb640 1 -- 172.21.15.55:0/1172140821 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7face00aa050 con 0x7facf00b97c0 2024-04-25T09:02:09.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.193+0000 7facf51f4640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7facd406b500 0x7facd406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.193+0000 7facf51f4640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7facd406b500 0x7facd406d9c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7facec000f60 tx=0x7facec007cc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.197+0000 7face5ffb640 1 -- 172.21.15.55:0/1172140821 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7face004b060 con 0x7facf00b97c0 2024-04-25T09:02:09.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.377+0000 7facf7458640 1 -- 172.21.15.55:0/1172140821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7facf00d1780 con 0x7facf00b97c0 2024-04-25T09:02:09.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.377+0000 7face5ffb640 1 -- 172.21.15.55:0/1172140821 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+11 (secure 0 0 0) 0x7face0078f60 con 0x7facf00b97c0 2024-04-25T09:02:09.366 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T09:02:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 -- 172.21.15.55:0/1172140821 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7facd406b500 msgr2=0x7facd406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7facd406b500 0x7facd406d9c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7facec000f60 tx=0x7facec007cc0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 -- 172.21.15.55:0/1172140821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf00b97c0 msgr2=0x7facf015ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf00b97c0 0x7facf015ae80 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7face00098a0 tx=0x7face00046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 -- 172.21.15.55:0/1172140821 shutdown_connections 2024-04-25T09:02:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7facd406b500 0x7facd406d9c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facf015dc80 0x7facf00b6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facf00b97c0 0x7facf015ae80 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 --2- 172.21.15.55:0/1172140821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facf00b5a30 0x7facf0160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 -- 172.21.15.55:0/1172140821 >> 172.21.15.55:0/1172140821 conn(0x7facf00d04f0 msgr2=0x7facf015cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 -- 172.21.15.55:0/1172140821 shutdown_connections 2024-04-25T09:02:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.379+0000 7facf7458640 1 -- 172.21.15.55:0/1172140821 wait complete. 2024-04-25T09:02:09.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:02:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.492+0000 7f3c34f9b640 1 Processor -- start 2024-04-25T09:02:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.492+0000 7f3c34f9b640 1 -- start start 2024-04-25T09:02:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c34f9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3015f0b0 0x7f3c300d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c34f9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3c300ce1e0 0x7f3c300ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c34f9b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c300ceb80 con 0x7f3c300cc240 2024-04-25T09:02:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c34f9b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3015f490 con 0x7f3c300ce1e0 2024-04-25T09:02:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c34f9b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300cf8f0 con 0x7f3c3015f0b0 2024-04-25T09:02:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c2ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3c300cc240 0x7f3c300cc6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45716/0 (socket says 172.21.15.55:45716) 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c2ed9d640 1 -- 172.21.15.55:0/3119230788 learned_addr learned my addr 172.21.15.55:0/3119230788 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c27fff640 1 --2- 172.21.15.55:0/3119230788 >> v2:172.21.15.167:3300/0 conn(0x7f3c300ce1e0 0x7f3c300ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c2e59c640 1 --2- 172.21.15.55:0/3119230788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3015f0b0 0x7f3c300d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c2dd9b640 1 -- 172.21.15.55:0/3119230788 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274353477 0 0) 0x7f3c28001490 con 0x7f3c300cc240 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c2dd9b640 1 -- 172.21.15.55:0/3119230788 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c1c003520 con 0x7f3c300cc240 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c27fff640 1 -- 172.21.15.55:0/3119230788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3015f0b0 msgr2=0x7f3c300d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c27fff640 1 --2- 172.21.15.55:0/3119230788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3015f0b0 0x7f3c300d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c27fff640 1 -- 172.21.15.55:0/3119230788 >> v1:172.21.15.55:6789/0 conn(0x7f3c300cc240 legacy=0x7f3c300cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.493+0000 7f3c27fff640 1 -- 172.21.15.55:0/3119230788 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c300cfbd0 con 0x7f3c300ce1e0 2024-04-25T09:02:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.494+0000 7f3c27fff640 1 --2- 172.21.15.55:0/3119230788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c300ce1e0 0x7f3c300ce640 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3c180097a0 tx=0x7f3c1802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53fcce7da4bf4586 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.494+0000 7f3c2dd9b640 1 -- 172.21.15.55:0/3119230788 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18037070 con 0x7f3c300ce1e0 2024-04-25T09:02:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.494+0000 7f3c2dd9b640 1 -- 172.21.15.55:0/3119230788 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18032440 con 0x7f3c300ce1e0 2024-04-25T09:02:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.494+0000 7f3c2dd9b640 1 -- 172.21.15.55:0/3119230788 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180327f0 con 0x7f3c300ce1e0 2024-04-25T09:02:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.495+0000 7f3c34f9b640 1 -- 172.21.15.55:0/3119230788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c300ce1e0 msgr2=0x7f3c300ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.495+0000 7f3c34f9b640 1 --2- 172.21.15.55:0/3119230788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c300ce1e0 0x7f3c300ce640 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3c180097a0 tx=0x7f3c1802a210 comp rx=0 tx=0).stop 2024-04-25T09:02:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.495+0000 7f3c34f9b640 1 -- 172.21.15.55:0/3119230788 shutdown_connections 2024-04-25T09:02:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.495+0000 7f3c34f9b640 1 --2- 172.21.15.55:0/3119230788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c300ce1e0 0x7f3c300ce640 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.495+0000 7f3c34f9b640 1 --2- 172.21.15.55:0/3119230788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c3015f0b0 0x7f3c300d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.495+0000 7f3c34f9b640 1 -- 172.21.15.55:0/3119230788 >> 172.21.15.55:0/3119230788 conn(0x7f3c3006f430 msgr2=0x7f3c3006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.495+0000 7f3c34f9b640 1 -- 172.21.15.55:0/3119230788 shutdown_connections 2024-04-25T09:02:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.495+0000 7f3c34f9b640 1 -- 172.21.15.55:0/3119230788 wait complete. 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.496+0000 7f3c34f9b640 1 Processor -- start 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.496+0000 7f3c34f9b640 1 -- start start 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c34f9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c300cc240 0x7f3c3014d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c34f9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c300ce1e0 0x7f3c300cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c34f9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3015f0b0 0x7f3c300c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c34f9b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300d0470 con 0x7f3c3015f0b0 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c34f9b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300d0190 con 0x7f3c300cc240 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c34f9b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300d0ed0 con 0x7f3c300ce1e0 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c2ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3015f0b0 0x7f3c300c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c2ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3015f0b0 0x7f3c300c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45838/0 (socket says 172.21.15.55:45838) 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c2ed9d640 1 -- 172.21.15.55:0/2823946055 learned_addr learned my addr 172.21.15.55:0/2823946055 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c2e59c640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c300cc240 0x7f3c3014d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c27fff640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c300ce1e0 0x7f3c300cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c2ed9d640 1 -- 172.21.15.55:0/2823946055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c300ce1e0 msgr2=0x7f3c300cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c2ed9d640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c300ce1e0 0x7f3c300cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c2ed9d640 1 -- 172.21.15.55:0/2823946055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c300cc240 msgr2=0x7f3c3014d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c2ed9d640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c300cc240 0x7f3c3014d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c2ed9d640 1 -- 172.21.15.55:0/2823946055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c300c94a0 con 0x7f3c3015f0b0 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.497+0000 7f3c27fff640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c300ce1e0 0x7f3c300cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.498+0000 7f3c2ed9d640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3015f0b0 0x7f3c300c6ee0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800cb40 tx=0x7f3c2800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.498+0000 7f3c26ffd640 1 -- 172.21.15.55:0/2823946055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28017070 con 0x7f3c3015f0b0 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.498+0000 7f3c26ffd640 1 -- 172.21.15.55:0/2823946055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2800ac40 con 0x7f3c3015f0b0 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.498+0000 7f3c34f9b640 1 -- 172.21.15.55:0/2823946055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c300ca220 con 0x7f3c3015f0b0 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.498+0000 7f3c26ffd640 1 -- 172.21.15.55:0/2823946055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28012400 con 0x7f3c3015f0b0 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.498+0000 7f3c34f9b640 1 -- 172.21.15.55:0/2823946055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c300c9a20 con 0x7f3c3015f0b0 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.499+0000 7f3c34f9b640 1 -- 172.21.15.55:0/2823946055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c300750b0 con 0x7f3c3015f0b0 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.499+0000 7f3c26ffd640 1 -- 172.21.15.55:0/2823946055 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3c2801a070 con 0x7f3c3015f0b0 2024-04-25T09:02:09.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.500+0000 7f3c26ffd640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1006b4d0 0x7f3c1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.500+0000 7f3c26ffd640 1 -- 172.21.15.55:0/2823946055 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c28089f50 con 0x7f3c3015f0b0 2024-04-25T09:02:09.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.500+0000 7f3c2e59c640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1006b4d0 0x7f3c1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.500+0000 7f3c2e59c640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1006b4d0 0x7f3c1006d990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009b40 tx=0x7f3c20009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.504+0000 7f3c26ffd640 1 -- 172.21.15.55:0/2823946055 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3c300ceb80 con 0x7f3c3015f0b0 2024-04-25T09:02:09.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.696+0000 7f3c34f9b640 1 -- 172.21.15.55:0/2823946055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3c300b0530 con 0x7f3c3015f0b0 2024-04-25T09:02:09.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.697+0000 7f3c26ffd640 1 -- 172.21.15.55:0/2823946055 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v102) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3c28058760 con 0x7f3c3015f0b0 2024-04-25T09:02:09.686 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 -- 172.21.15.55:0/2823946055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1006b4d0 msgr2=0x7f3c1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1006b4d0 0x7f3c1006d990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009b40 tx=0x7f3c20009190 comp rx=0 tx=0).stop 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 -- 172.21.15.55:0/2823946055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3015f0b0 msgr2=0x7f3c300c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3015f0b0 0x7f3c300c6ee0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800cb40 tx=0x7f3c2800a060 comp rx=0 tx=0).stop 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 -- 172.21.15.55:0/2823946055 shutdown_connections 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3c1006b4d0 0x7f3c1006d990 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c3015f0b0 0x7f3c300c6ee0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c300ce1e0 0x7f3c300cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 --2- 172.21.15.55:0/2823946055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c300cc240 0x7f3c3014d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 -- 172.21.15.55:0/2823946055 >> 172.21.15.55:0/2823946055 conn(0x7f3c3006f430 msgr2=0x7f3c300b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 -- 172.21.15.55:0/2823946055 shutdown_connections 2024-04-25T09:02:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.699+0000 7f3c34f9b640 1 -- 172.21.15.55:0/2823946055 wait complete. 2024-04-25T09:02:09.699 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:02:09.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:09.699 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:09.740 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:02:09.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:09.740 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:02:09.796 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.949+0000 7f7c7f9c1640 1 Processor -- start 2024-04-25T09:02:09.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.949+0000 7f7c7f9c1640 1 -- start start 2024-04-25T09:02:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.950+0000 7f7c7f9c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7815ded0 0x7f7c780cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.950+0000 7f7c7f9c1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c780c6540 con 0x7f7c7806fab0 2024-04-25T09:02:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.950+0000 7f7c7f9c1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c78072e10 con 0x7f7c7806ff10 2024-04-25T09:02:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.950+0000 7f7c7f9c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78072bc0 con 0x7f7c7815ded0 2024-04-25T09:02:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.950+0000 7f7c7cf5c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7c7806fab0 0x7f7c78070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45724/0 (socket says 172.21.15.55:45724) 2024-04-25T09:02:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.950+0000 7f7c7cf5c640 1 -- 172.21.15.55:0/4023672866 learned_addr learned my addr 172.21.15.55:0/4023672866 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c7d75d640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7815ded0 0x7f7c780cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209041545 0 0) 0x7f7c780c6540 con 0x7f7c7806fab0 2024-04-25T09:02:09.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c60003520 con 0x7f7c7806fab0 2024-04-25T09:02:09.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1744274049 0 0) 0x7f7c60003520 con 0x7f7c7806fab0 2024-04-25T09:02:09.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7815ded0 msgr2=0x7f7c780cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:09.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7815ded0 0x7f7c780cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 >> v1:172.21.15.167:6789/0 conn(0x7f7c7806ff10 legacy=0x7f7c780cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c780730f0 con 0x7f7c7806fab0 2024-04-25T09:02:09.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f7c6c001670 con 0x7f7c7806fab0 2024-04-25T09:02:09.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 >> v1:172.21.15.55:6789/0 conn(0x7f7c7806fab0 legacy=0x7f7c78070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c600039e0 0x7f7c60003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7815ded0 0x7f7c60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 0x7f7c600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78072bc0 con 0x7f7c60004d40 2024-04-25T09:02:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6000bb00 con 0x7f7c600039e0 2024-04-25T09:02:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6000bd00 con 0x7f7c7815ded0 2024-04-25T09:02:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c7d75d640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c600039e0 0x7f7c60003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c7df5e640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 0x7f7c600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c7cf5c640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7815ded0 0x7f7c60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c7df5e640 1 -- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7815ded0 msgr2=0x7f7c60004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.951+0000 7f7c7df5e640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7815ded0 0x7f7c60004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.952+0000 7f7c7df5e640 1 -- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c600039e0 msgr2=0x7f7c60003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.952+0000 7f7c7df5e640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c600039e0 0x7f7c60003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.952+0000 7f7c7df5e640 1 -- 172.21.15.55:0/4023672866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60003520 con 0x7f7c60004d40 2024-04-25T09:02:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.952+0000 7f7c7d75d640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c600039e0 0x7f7c60003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.952+0000 7f7c7df5e640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 0x7f7c600051c0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f7c780d0710 tx=0x7f7c60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e17dbaa086792f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.952+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68001a70 con 0x7f7c60004d40 2024-04-25T09:02:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.952+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6802add0 con 0x7f7c60004d40 2024-04-25T09:02:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.952+0000 7f7c77fff640 1 -- 172.21.15.55:0/4023672866 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68003bb0 con 0x7f7c60004d40 2024-04-25T09:02:09.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.953+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/4023672866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 msgr2=0x7f7c600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.953+0000 7f7c7f9c1640 1 --2- 172.21.15.55:0/4023672866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 0x7f7c600051c0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f7c780d0710 tx=0x7f7c60005830 comp rx=0 tx=0).stop 2024-04-25T09:02:09.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.953+0000 7f7c7df5e640 1 -- 172.21.15.55:0/4023672866 reap_dead start 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.953+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/4023672866 shutdown_connections 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.953+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/4023672866 >> 172.21.15.55:0/4023672866 conn(0x7f7c780b2370 msgr2=0x7f7c780b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.953+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/4023672866 shutdown_connections 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.953+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/4023672866 wait complete. 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.954+0000 7f7c7f9c1640 1 Processor -- start 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.954+0000 7f7c7f9c1640 1 -- start start 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7f9c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 0x7f7c78160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7f9c1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c780cf810 0x7f7c7815ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7f9c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c780b4b50 0x7f7c780b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7f9c1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780cd4f0 con 0x7f7c60004d40 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7f9c1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780ccfc0 con 0x7f7c780cf810 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7f9c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78070a30 con 0x7f7c780b4b50 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7d75d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 0x7f7c78160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7d75d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 0x7f7c78160d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45862/0 (socket says 172.21.15.55:45862) 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7d75d640 1 -- 172.21.15.55:0/2264579039 learned_addr learned my addr 172.21.15.55:0/2264579039 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7df5e640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c780b4b50 0x7f7c780b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7cf5c640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c780cf810 0x7f7c7815ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7d75d640 1 -- 172.21.15.55:0/2264579039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c780b4b50 msgr2=0x7f7c780b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7d75d640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c780b4b50 0x7f7c780b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7d75d640 1 -- 172.21.15.55:0/2264579039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c780cf810 msgr2=0x7f7c7815ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7d75d640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c780cf810 0x7f7c7815ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7d75d640 1 -- 172.21.15.55:0/2264579039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c780ce770 con 0x7f7c60004d40 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.955+0000 7f7c7cf5c640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c780cf810 0x7f7c7815ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.956+0000 7f7c7d75d640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 0x7f7c78160d80 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f7c70011ca0 tx=0x7f7c7000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.956+0000 7f7c75ffb640 1 -- 172.21.15.55:0/2264579039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000fd20 con 0x7f7c60004d40 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.956+0000 7f7c75ffb640 1 -- 172.21.15.55:0/2264579039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c70014440 con 0x7f7c60004d40 2024-04-25T09:02:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.956+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/2264579039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c780cea50 con 0x7f7c60004d40 2024-04-25T09:02:09.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.956+0000 7f7c75ffb640 1 -- 172.21.15.55:0/2264579039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70014830 con 0x7f7c60004d40 2024-04-25T09:02:09.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.956+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/2264579039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c780cf010 con 0x7f7c60004d40 2024-04-25T09:02:09.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.957+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/2264579039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c780749b0 con 0x7f7c60004d40 2024-04-25T09:02:09.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.957+0000 7f7c75ffb640 1 -- 172.21.15.55:0/2264579039 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c70012040 con 0x7f7c60004d40 2024-04-25T09:02:09.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.958+0000 7f7c75ffb640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c6406b500 0x7f7c6406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.958+0000 7f7c7cf5c640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c6406b500 0x7f7c6406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.958+0000 7f7c75ffb640 1 -- 172.21.15.55:0/2264579039 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c7008a9f0 con 0x7f7c60004d40 2024-04-25T09:02:09.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.959+0000 7f7c7cf5c640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c6406b500 0x7f7c6406d9c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7c780d1720 tx=0x7f7c6c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:09.962+0000 7f7c75ffb640 1 -- 172.21.15.55:0/2264579039 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c70019030 con 0x7f7c60004d40 2024-04-25T09:02:10.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.182+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/2264579039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c7814f850 con 0x7f7c60004d40 2024-04-25T09:02:10.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.182+0000 7f7c75ffb640 1 -- 172.21.15.55:0/2264579039 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f7c70059870 con 0x7f7c60004d40 2024-04-25T09:02:10.171 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:10.171 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:01:54.470378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/538888347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":538888347},{"type":"v1","addr":"172.21.15.55:6837","nonce":538888347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:02:10.172 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 72 2024-04-25T09:02:10.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.184+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/2264579039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c6406b500 msgr2=0x7f7c6406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.184+0000 7f7c7f9c1640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c6406b500 0x7f7c6406d9c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7c780d1720 tx=0x7f7c6c009040 comp rx=0 tx=0).stop 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.185+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/2264579039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 msgr2=0x7f7c78160d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.185+0000 7f7c7f9c1640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 0x7f7c78160d80 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f7c70011ca0 tx=0x7f7c7000f610 comp rx=0 tx=0).stop 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.185+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/2264579039 shutdown_connections 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.185+0000 7f7c7f9c1640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f7c6406b500 0x7f7c6406d9c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.185+0000 7f7c7f9c1640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c780b4b50 0x7f7c780b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.185+0000 7f7c7f9c1640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c780cf810 0x7f7c7815ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.185+0000 7f7c7f9c1640 1 --2- 172.21.15.55:0/2264579039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c60004d40 0x7f7c78160d80 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.185+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/2264579039 >> 172.21.15.55:0/2264579039 conn(0x7f7c780b2370 msgr2=0x7f7c780b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.185+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/2264579039 shutdown_connections 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.185+0000 7f7c7f9c1640 1 -- 172.21.15.55:0/2264579039 wait complete. 2024-04-25T09:02:10.184 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T09:02:10.316 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-25T09:02:10.316 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:02:10.317 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:02:10.317 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:10.332 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:02:10.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:02:10.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:10.333 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:02:10.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:02:10.387 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T09:02:10.388 DEBUG:teuthology.orchestra.run.smithi055:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T09:02:10.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:10.433 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T09:02:10.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.551+0000 7f8a4d2e1640 1 Processor -- start 2024-04-25T09:02:10.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.552+0000 7f8a4d2e1640 1 -- start start 2024-04-25T09:02:10.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.552+0000 7f8a4d2e1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a480cce80 0x7f8a4815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.552+0000 7f8a4d2e1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8a480ce350 0x7f8a480ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.552+0000 7f8a4d2e1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a480cb3f0 con 0x7f8a480b29a0 2024-04-25T09:02:10.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.552+0000 7f8a4d2e1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4815bfb0 con 0x7f8a480ce350 2024-04-25T09:02:10.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.552+0000 7f8a4d2e1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480cc000 con 0x7f8a480cce80 2024-04-25T09:02:10.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.553+0000 7f8a477fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8a480ce350 0x7f8a480ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.553+0000 7f8a467fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f8a480b29a0 0x7f8a480cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:36376/0 (socket says 172.21.15.55:36376) 2024-04-25T09:02:10.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.553+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a480cce80 0x7f8a4815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.553+0000 7f8a467fc640 1 -- 172.21.15.55:0/2471465133 learned_addr learned my addr 172.21.15.55:0/2471465133 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:10.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.553+0000 7f8a46ffd640 1 -- 172.21.15.55:0/2471465133 >> v2:172.21.15.167:3300/0 conn(0x7f8a480ce350 msgr2=0x7f8a480ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.553+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/2471465133 >> v2:172.21.15.167:3300/0 conn(0x7f8a480ce350 0x7f8a480ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.553+0000 7f8a46ffd640 1 -- 172.21.15.55:0/2471465133 >> v1:172.21.15.167:6789/0 conn(0x7f8a480b29a0 legacy=0x7f8a480cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.553+0000 7f8a46ffd640 1 -- 172.21.15.55:0/2471465133 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a480cb6d0 con 0x7f8a480cce80 2024-04-25T09:02:10.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.553+0000 7f8a45ffb640 1 -- 172.21.15.55:0/2471465133 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550582749 0 0) 0x7f8a480cb3f0 con 0x7f8a480b29a0 2024-04-25T09:02:10.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.553+0000 7f8a477fe640 1 --2- 172.21.15.55:0/2471465133 >> v2:172.21.15.167:3300/0 conn(0x7f8a480ce350 0x7f8a480ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:10.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.554+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/2471465133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a480cce80 0x7f8a4815ba70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009d90 tx=0x7f8a4002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65c3ac140b9faa69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.554+0000 7f8a45ffb640 1 -- 172.21.15.55:0/2471465133 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40007740 con 0x7f8a480cce80 2024-04-25T09:02:10.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.554+0000 7f8a45ffb640 1 -- 172.21.15.55:0/2471465133 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a400078e0 con 0x7f8a480cce80 2024-04-25T09:02:10.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.554+0000 7f8a45ffb640 1 -- 172.21.15.55:0/2471465133 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40007cb0 con 0x7f8a480cce80 2024-04-25T09:02:10.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.555+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/2471465133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a480cce80 msgr2=0x7f8a4815ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.555+0000 7f8a4d2e1640 1 --2- 172.21.15.55:0/2471465133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a480cce80 0x7f8a4815ba70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009d90 tx=0x7f8a4002a660 comp rx=0 tx=0).stop 2024-04-25T09:02:10.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.555+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/2471465133 shutdown_connections 2024-04-25T09:02:10.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.555+0000 7f8a4d2e1640 1 --2- 172.21.15.55:0/2471465133 >> v2:172.21.15.167:3300/0 conn(0x7f8a480ce350 0x7f8a480ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.555+0000 7f8a4d2e1640 1 --2- 172.21.15.55:0/2471465133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a480cce80 0x7f8a4815ba70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.555+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/2471465133 >> 172.21.15.55:0/2471465133 conn(0x7f8a48099a40 msgr2=0x7f8a480b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.555+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/2471465133 shutdown_connections 2024-04-25T09:02:10.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.555+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/2471465133 wait complete. 2024-04-25T09:02:10.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.556+0000 7f8a4d2e1640 1 Processor -- start 2024-04-25T09:02:10.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.556+0000 7f8a4d2e1640 1 -- start start 2024-04-25T09:02:10.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a4d2e1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a480b29a0 0x7f8a480c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a4d2e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a480cce80 0x7f8a48152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a4d2e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a480ce350 0x7f8a480adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a4d2e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480cc490 con 0x7f8a480cce80 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a4d2e1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480cbc90 con 0x7f8a480ce350 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a4d2e1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480af0e0 con 0x7f8a480b29a0 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a467fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a480cce80 0x7f8a48152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a467fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a480cce80 0x7f8a48152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45866/0 (socket says 172.21.15.55:45866) 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a467fc640 1 -- 172.21.15.55:0/1150581230 learned_addr learned my addr 172.21.15.55:0/1150581230 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a480b29a0 0x7f8a480c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a477fe640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a480ce350 0x7f8a480adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a467fc640 1 -- 172.21.15.55:0/1150581230 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a480b29a0 msgr2=0x7f8a480c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a467fc640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a480b29a0 0x7f8a480c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a467fc640 1 -- 172.21.15.55:0/1150581230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a480ce350 msgr2=0x7f8a480adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a467fc640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a480ce350 0x7f8a480adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a467fc640 1 -- 172.21.15.55:0/1150581230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a48153300 con 0x7f8a480cce80 2024-04-25T09:02:10.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.557+0000 7f8a467fc640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a480cce80 0x7f8a48152dc0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c4d0 tx=0x7f8a3000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.558+0000 7f8a3f7fe640 1 -- 172.21.15.55:0/1150581230 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300074e0 con 0x7f8a480cce80 2024-04-25T09:02:10.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.558+0000 7f8a3f7fe640 1 -- 172.21.15.55:0/1150581230 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a300047e0 con 0x7f8a480cce80 2024-04-25T09:02:10.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.558+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/1150581230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a480ae230 con 0x7f8a480cce80 2024-04-25T09:02:10.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.558+0000 7f8a3f7fe640 1 -- 172.21.15.55:0/1150581230 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30004bd0 con 0x7f8a480cce80 2024-04-25T09:02:10.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.558+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/1150581230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a480ae7b0 con 0x7f8a480cce80 2024-04-25T09:02:10.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.559+0000 7f8a3f7fe640 1 -- 172.21.15.55:0/1150581230 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a30011070 con 0x7f8a480cce80 2024-04-25T09:02:10.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.560+0000 7f8a3f7fe640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 0x7f8a2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.560+0000 7f8a3f7fe640 1 -- 172.21.15.55:0/1150581230 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a30089d40 con 0x7f8a480cce80 2024-04-25T09:02:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.560+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 0x7f8a2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.560+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 0x7f8a2806d990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8a40034000 tx=0x7f8a4002f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.561+0000 7f8a4ffe6740 1 Processor -- start 2024-04-25T09:02:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.561+0000 7f8a4ffe6740 1 -- start start 2024-04-25T09:02:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad66ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad669830 0x55f8ad66d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad66e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ad5d2ac0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ad57bd80 con 0x55f8ad669830 2024-04-25T09:02:10.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8ad5ceb60 con 0x55f8ad66ebb0 2024-04-25T09:02:10.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad66e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad66e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45870/0 (socket says 172.21.15.55:45870) 2024-04-25T09:02:10.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a477fe640 1 -- 172.21.15.55:0/2369883320 learned_addr learned my addr 172.21.15.55:0/2369883320 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:10.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/2369883320 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad66ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a467fc640 1 --2- 172.21.15.55:0/2369883320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad669830 0x55f8ad66d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a477fe640 1 -- 172.21.15.55:0/2369883320 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 msgr2=0x55f8ad66ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a477fe640 1 --2- 172.21.15.55:0/2369883320 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad66ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a477fe640 1 -- 172.21.15.55:0/2369883320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad669830 msgr2=0x55f8ad66d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a477fe640 1 --2- 172.21.15.55:0/2369883320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad669830 0x55f8ad66d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a477fe640 1 -- 172.21.15.55:0/2369883320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8ad3af7e0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a467fc640 1 --2- 172.21.15.55:0/2369883320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad669830 0x55f8ad66d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/2369883320 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad66ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a477fe640 1 --2- 172.21.15.55:0/2369883320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad66e130 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009b00 tx=0x7f8a380112c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aacd40a26780e25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a3cff9640 1 -- 172.21.15.55:0/2369883320 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38011dc0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a3cff9640 1 -- 172.21.15.55:0/2369883320 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a38004020 con 0x55f8ad66dcf0 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.562+0000 7f8a3cff9640 1 -- 172.21.15.55:0/2369883320 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a380043d0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.563+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/2369883320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 msgr2=0x55f8ad66e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.563+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/2369883320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad66e130 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009b00 tx=0x7f8a380112c0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.563+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/2369883320 shutdown_connections 2024-04-25T09:02:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.563+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/2369883320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad66e130 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.563+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/2369883320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad669830 0x55f8ad66d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.563+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/2369883320 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad66ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.563+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/2369883320 >> 172.21.15.55:0/2369883320 conn(0x55f8ad66bcb0 msgr2=0x55f8ad6b4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.563+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/2369883320 shutdown_connections 2024-04-25T09:02:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.563+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/2369883320 wait complete. 2024-04-25T09:02:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.564+0000 7f8a4ffe6740 1 -- start start 2024-04-25T09:02:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.564+0000 7f8a4ffe6740 1 Processor -- start 2024-04-25T09:02:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad6bac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad6b5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad6b8e40 0x55f8ad6b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ad69a740 con 0x55f8ad66dcf0 2024-04-25T09:02:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ad571530 con 0x55f8ad6b8e40 2024-04-25T09:02:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8ad699bc0 con 0x55f8ad66ebb0 2024-04-25T09:02:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a4ffe6740 10 client.0 _ll_register_callbacks cb 0x55f8ad5c9130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad6bac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad6bac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45878/0 (socket says 172.21.15.55:45878) 2024-04-25T09:02:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a46ffd640 1 -- 172.21.15.55:0/124355257 learned_addr learned my addr 172.21.15.55:0/124355257 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a477fe640 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad6b8e40 0x55f8ad6b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a467fc640 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad6b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a46ffd640 1 -- 172.21.15.55:0/124355257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 msgr2=0x55f8ad6b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad6b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a46ffd640 1 -- 172.21.15.55:0/124355257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad6b8e40 msgr2=0x55f8ad6b92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad6b8e40 0x55f8ad6b92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a46ffd640 1 -- 172.21.15.55:0/124355257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8ad40ff70 con 0x55f8ad66dcf0 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad6bac70 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009e80 tx=0x7f8a40004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4a7a0989fcf193 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a25ffb640 1 -- 172.21.15.55:0/124355257 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40007810 con 0x55f8ad66dcf0 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a25ffb640 1 -- 172.21.15.55:0/124355257 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a40052ad0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.565+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/124355257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a38004020 con 0x55f8ad66dcf0 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a25ffb640 1 -- 172.21.15.55:0/124355257 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a40052cd0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a4ffe6740 10 client.8538 fetch_fsmap learned FSMap version 72 2024-04-25T09:02:10.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/124355257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55f8ad2a7170 con 0x55f8ad66dcf0 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a25ffb640 1 -- 172.21.15.55:0/124355257 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a38004020 con 0x55f8ad66dcf0 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a25ffb640 1 -- 172.21.15.55:0/124355257 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8a40044040 con 0x55f8ad66dcf0 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a4ffe6740 10 client.8538 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a4ffe6740 10 client.8538 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a4ffe6740 20 client.8538 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55f8ad6c8710 0x55f8ad6c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a4ffe6740 4 client.8538 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/124355257 --> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8ad5e0000 con 0x55f8ad6c8710 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a467fc640 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55f8ad6c8710 0x55f8ad6c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a467fc640 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55f8ad6c8710 0x55f8ad6c8b20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c76151edef11d5cd server_cookie=1eaa8f42249f626 in_seq=0 out_seq=0 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.566+0000 7f8a25ffb640 10 client.8538 ms_handle_connect on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:10.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a25ffb640 1 -- 172.21.15.55:0/124355257 <== mds.0 v2:172.21.15.55:6834/538888347 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f8ad5e0000 con 0x55f8ad6c8710 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a25ffb640 10 client.8538 handle_command_reply: tid=0 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 1 client.8538 shutdown 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/124355257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 msgr2=0x55f8ad6bac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad6bac70 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009e80 tx=0x7f8a40004ab0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/124355257 shutdown_connections 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad6b8e40 0x55f8ad6b92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad6b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55f8ad6c8710 0x55f8ad6c8b20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/124355257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad6bac70 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a25ffb640 0 client.8538 ms_handle_reset on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/124355257 >> 172.21.15.55:0/124355257 conn(0x55f8ad669830 msgr2=0x55f8ad668f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/124355257 shutdown_connections 2024-04-25T09:02:10.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/124355257 wait complete. 2024-04-25T09:02:10.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.567+0000 7f8a4ffe6740 20 client.8538 trim_cache size 0 max 16384 2024-04-25T09:02:10.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.568+0000 7ffa1ce1f640 1 Processor -- start 2024-04-25T09:02:10.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.568+0000 7ffa1ce1f640 1 -- start start 2024-04-25T09:02:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.569+0000 7ffa1ce1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1815dca0 0x7ffa180cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.569+0000 7ffa1ce1f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffa18162200 0x7ffa1806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.569+0000 7ffa1ce1f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1815f090 con 0x7ffa180b54a0 2024-04-25T09:02:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.569+0000 7ffa1ce1f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1806d1c0 con 0x7ffa18162200 2024-04-25T09:02:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.569+0000 7ffa1ce1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa180cf340 con 0x7ffa1815dca0 2024-04-25T09:02:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.569+0000 7ffa16d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffa180b54a0 0x7ffa180d1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45734/0 (socket says 172.21.15.55:45734) 2024-04-25T09:02:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.569+0000 7ffa16d9d640 1 -- 172.21.15.55:0/3785563840 learned_addr learned my addr 172.21.15.55:0/3785563840 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1659c640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1815dca0 0x7ffa180cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa15d9b640 1 --2- 172.21.15.55:0/3785563840 >> v2:172.21.15.167:3300/0 conn(0x7ffa18162200 0x7ffa1806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723301489 0 0) 0x7ffa1815f090 con 0x7ffa180b54a0 2024-04-25T09:02:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa00003520 con 0x7ffa180b54a0 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3240993775 0 0) 0x7ffa00003520 con 0x7ffa180b54a0 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1815dca0 msgr2=0x7ffa180cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1815dca0 0x7ffa180cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 >> v2:172.21.15.167:3300/0 conn(0x7ffa18162200 msgr2=0x7ffa1806cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 --2- 172.21.15.55:0/3785563840 >> v2:172.21.15.167:3300/0 conn(0x7ffa18162200 0x7ffa1806cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa180cf060 con 0x7ffa180b54a0 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7ffa100019f0 con 0x7ffa180b54a0 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa15d9b640 1 --2- 172.21.15.55:0/3785563840 >> v2:172.21.15.167:3300/0 conn(0x7ffa18162200 0x7ffa1806cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 >> v1:172.21.15.55:6789/0 conn(0x7ffa180b54a0 legacy=0x7ffa180d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000039b0 0x7ffa00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa00004800 0x7ffa00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1815dca0 0x7ffa000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1806d1c0 con 0x7ffa000039b0 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa180cf340 con 0x7ffa00004800 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0000b9c0 con 0x7ffa1815dca0 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1659c640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000039b0 0x7ffa00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa15d9b640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa00004800 0x7ffa00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa16d9d640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1815dca0 0x7ffa000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1659c640 1 -- 172.21.15.55:0/3785563840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1815dca0 msgr2=0x7ffa000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.570+0000 7ffa1659c640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1815dca0 0x7ffa000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.571+0000 7ffa1659c640 1 -- 172.21.15.55:0/3785563840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa00004800 msgr2=0x7ffa00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.571+0000 7ffa1659c640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa00004800 0x7ffa00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.571+0000 7ffa1659c640 1 -- 172.21.15.55:0/3785563840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00003520 con 0x7ffa000039b0 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.571+0000 7ffa1659c640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000039b0 0x7ffa00003dd0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009af0 tx=0x7ffa00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614e2e6b225bd7fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.571+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08036070 con 0x7ffa000039b0 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.571+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa08031400 con 0x7ffa000039b0 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.571+0000 7ffa1559a640 1 -- 172.21.15.55:0/3785563840 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08009690 con 0x7ffa000039b0 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.572+0000 7ffa1ce1f640 1 -- 172.21.15.55:0/3785563840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000039b0 msgr2=0x7ffa00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.572+0000 7ffa1ce1f640 1 --2- 172.21.15.55:0/3785563840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000039b0 0x7ffa00003dd0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009af0 tx=0x7ffa00005830 comp rx=0 tx=0).stop 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.572+0000 7ffa16d9d640 1 -- 172.21.15.55:0/3785563840 reap_dead start 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.572+0000 7ffa1ce1f640 1 -- 172.21.15.55:0/3785563840 shutdown_connections 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.572+0000 7ffa1ce1f640 1 -- 172.21.15.55:0/3785563840 >> 172.21.15.55:0/3785563840 conn(0x7ffa180d04a0 msgr2=0x7ffa180d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.572+0000 7ffa1ce1f640 1 -- 172.21.15.55:0/3785563840 shutdown_connections 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.572+0000 7ffa1ce1f640 1 -- 172.21.15.55:0/3785563840 wait complete. 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.573+0000 7ffa1ce1f640 1 Processor -- start 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.573+0000 7ffa1ce1f640 1 -- start start 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.574+0000 7ffa1ce1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000039b0 0x7ffa1814cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.574+0000 7ffa1ce1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa1815a000 0x7ffa180caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.574+0000 7ffa1ce1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cb030 0x7ffa1814b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.574+0000 7ffa1ce1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1806c480 con 0x7ffa000039b0 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.574+0000 7ffa1ce1f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1806c1a0 con 0x7ffa1815a000 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.574+0000 7ffa1ce1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1806c760 con 0x7ffa180cb030 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.574+0000 7ffa1659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000039b0 0x7ffa1814cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.574+0000 7ffa1659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000039b0 0x7ffa1814cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45902/0 (socket says 172.21.15.55:45902) 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.574+0000 7ffa1659c640 1 -- 172.21.15.55:0/3177063072 learned_addr learned my addr 172.21.15.55:0/3177063072 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.575+0000 7ffa1659c640 1 -- 172.21.15.55:0/3177063072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cb030 msgr2=0x7ffa1814b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.575+0000 7ffa1659c640 1 --2- 172.21.15.55:0/3177063072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cb030 0x7ffa1814b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.575+0000 7ffa1659c640 1 -- 172.21.15.55:0/3177063072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa1815a000 msgr2=0x7ffa180caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.575+0000 7ffa1659c640 1 --2- 172.21.15.55:0/3177063072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa1815a000 0x7ffa180caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.575+0000 7ffa1659c640 1 -- 172.21.15.55:0/3177063072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1814d160 con 0x7ffa000039b0 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.575+0000 7ffa1659c640 1 --2- 172.21.15.55:0/3177063072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000039b0 0x7ffa1814cc20 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009a90 tx=0x7ffa08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.575+0000 7ffa06ffd640 1 -- 172.21.15.55:0/3177063072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08041020 con 0x7ffa000039b0 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.575+0000 7ffa06ffd640 1 -- 172.21.15.55:0/3177063072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0803c470 con 0x7ffa000039b0 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.575+0000 7ffa1ce1f640 1 -- 172.21.15.55:0/3177063072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa180aa640 con 0x7ffa000039b0 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.575+0000 7ffa06ffd640 1 -- 172.21.15.55:0/3177063072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08036040 con 0x7ffa000039b0 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.575+0000 7ffa1ce1f640 1 -- 172.21.15.55:0/3177063072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1814a8b0 con 0x7ffa000039b0 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.576+0000 7ffa1ce1f640 1 -- 172.21.15.55:0/3177063072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ffa180749b0 con 0x7ffa000039b0 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.576+0000 7ffa06ffd640 1 -- 172.21.15.55:0/3177063072 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffa08044020 con 0x7ffa000039b0 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.577+0000 7ffa06ffd640 1 --2- 172.21.15.55:0/3177063072 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff9f806b500 0x7ff9f806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.577+0000 7ffa06ffd640 1 -- 172.21.15.55:0/3177063072 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa080aa770 con 0x7ffa000039b0 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.577+0000 7ffa15d9b640 1 --2- 172.21.15.55:0/3177063072 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff9f806b500 0x7ff9f806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.577+0000 7ffa06ffd640 1 -- 172.21.15.55:0/3177063072 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+501 (secure 0 0 0) 0x7ffa0804e070 con 0x7ffa000039b0 2024-04-25T09:02:10.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.577+0000 7ffa1ce1f640 1 -- 172.21.15.55:0/3177063072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7ffa180ce860 con 0x7ffa000039b0 2024-04-25T09:02:10.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.577+0000 7ffa15d9b640 1 --2- 172.21.15.55:0/3177063072 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff9f806b500 0x7ff9f806d9c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c006d40 tx=0x7ffa0c006cb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.584+0000 7f8a4ffe6740 1 Processor -- start 2024-04-25T09:02:10.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.584+0000 7f8a4ffe6740 1 -- start start 2024-04-25T09:02:10.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66dcf0 0x55f8ad66e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad66ebb0 0x55f8ad6b9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad6b8e40 0x55f8ad71eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ad6b5be0 con 0x55f8ad6b8e40 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a481ffce0 con 0x55f8ad66ebb0 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480b3fa0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad6b8e40 0x55f8ad71eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad6b8e40 0x55f8ad71eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45912/0 (socket says 172.21.15.55:45912) 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a477fe640 1 -- 172.21.15.55:0/545685367 learned_addr learned my addr 172.21.15.55:0/545685367 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/545685367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66dcf0 0x55f8ad66e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a467fc640 1 --2- 172.21.15.55:0/545685367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad66ebb0 0x55f8ad6b9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a477fe640 1 -- 172.21.15.55:0/545685367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66dcf0 msgr2=0x55f8ad66e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a477fe640 1 --2- 172.21.15.55:0/545685367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66dcf0 0x55f8ad66e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a477fe640 1 -- 172.21.15.55:0/545685367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad66ebb0 msgr2=0x55f8ad6b9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a477fe640 1 --2- 172.21.15.55:0/545685367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad66ebb0 0x55f8ad6b9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a477fe640 1 -- 172.21.15.55:0/545685367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8ad6b9630 con 0x55f8ad6b8e40 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a467fc640 1 --2- 172.21.15.55:0/545685367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad66ebb0 0x55f8ad6b9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a477fe640 1 --2- 172.21.15.55:0/545685367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad6b8e40 0x55f8ad71eb10 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f8a380117c0 tx=0x7f8a38016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9faeccb09ef384 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.585+0000 7f8a27fff640 1 -- 172.21.15.55:0/545685367 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38004330 con 0x55f8ad6b8e40 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.586+0000 7f8a27fff640 1 -- 172.21.15.55:0/545685367 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a380044d0 con 0x55f8ad6b8e40 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.586+0000 7f8a27fff640 1 -- 172.21.15.55:0/545685367 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38003850 con 0x55f8ad6b8e40 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.586+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/545685367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad6b8e40 msgr2=0x55f8ad71eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.586+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/545685367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad6b8e40 0x55f8ad71eb10 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f8a380117c0 tx=0x7f8a38016000 comp rx=0 tx=0).stop 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.586+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/545685367 shutdown_connections 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.586+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/545685367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad6b8e40 0x55f8ad71eb10 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.586+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/545685367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad66ebb0 0x55f8ad6b9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.586+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/545685367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66dcf0 0x55f8ad66e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.586+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/545685367 >> 172.21.15.55:0/545685367 conn(0x55f8ad669830 msgr2=0x55f8ad69a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.586+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/545685367 shutdown_connections 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.586+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/545685367 wait complete. 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.587+0000 7f8a4ffe6740 1 -- start start 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.587+0000 7f8a4ffe6740 1 Processor -- start 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad695f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad6964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a4ffe6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad6b8e40 0x55f8ad6baa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480b39a0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480b33a0 con 0x55f8ad6b8e40 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a4ffe6740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8ad6b94b0 con 0x55f8ad66ebb0 2024-04-25T09:02:10.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a4ffe6740 10 client.0 _ll_register_callbacks cb 0x7f8a380094e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad695f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad695f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45914/0 (socket says 172.21.15.55:45914) 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a46ffd640 1 -- 172.21.15.55:0/1704124122 learned_addr learned my addr 172.21.15.55:0/1704124122 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a467fc640 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad6964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a477fe640 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad6b8e40 0x55f8ad6baa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a46ffd640 1 -- 172.21.15.55:0/1704124122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 msgr2=0x55f8ad6964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad6964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a46ffd640 1 -- 172.21.15.55:0/1704124122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad6b8e40 msgr2=0x55f8ad6baa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad6b8e40 0x55f8ad6baa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a46ffd640 1 -- 172.21.15.55:0/1704124122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8ad71efa0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a46ffd640 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad695f60 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009eb0 tx=0x7f8a40009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79eb0ed886c1ad0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:10.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a25ffb640 1 -- 172.21.15.55:0/1704124122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40062060 con 0x55f8ad66dcf0 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a25ffb640 1 -- 172.21.15.55:0/1704124122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a40048b60 con 0x55f8ad66dcf0 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.588+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/1704124122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a380044d0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a25ffb640 1 -- 172.21.15.55:0/1704124122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a40068050 con 0x55f8ad66dcf0 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a4ffe6740 10 client.8550 fetch_fsmap learned FSMap version 72 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/1704124122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55f8ad7221d0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a25ffb640 1 -- 172.21.15.55:0/1704124122 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a380044d0 con 0x55f8ad66dcf0 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a25ffb640 1 -- 172.21.15.55:0/1704124122 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8a4006b020 con 0x55f8ad66dcf0 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a4ffe6740 10 client.8550 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a4ffe6740 10 client.8550 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a4ffe6740 20 client.8550 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55f8ad6686c0 0x55f8ad6bafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a4ffe6740 4 client.8550 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:02:10.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/1704124122 --> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x55f8ad6bca40 con 0x55f8ad6686c0 2024-04-25T09:02:10.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.589+0000 7f8a467fc640 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55f8ad6686c0 0x55f8ad6bafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.590+0000 7f8a25ffb640 10 client.8550 ms_handle_connect on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:10.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.590+0000 7f8a467fc640 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55f8ad6686c0 0x55f8ad6bafc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=362a00d626927ab7 server_cookie=c1c27bf887ab5692 in_seq=0 out_seq=0 2024-04-25T09:02:10.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.590+0000 7f8a25ffb640 1 -- 172.21.15.55:0/1704124122 <== mds.0 v2:172.21.15.55:6834/538888347 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f8ad6bca40 con 0x55f8ad6686c0 2024-04-25T09:02:10.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.590+0000 7f8a25ffb640 10 client.8550 handle_command_reply: tid=0 2024-04-25T09:02:10.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.590+0000 7f8a4ffe6740 1 client.8550 shutdown 2024-04-25T09:02:10.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/1704124122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 msgr2=0x55f8ad695f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad695f60 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009eb0 tx=0x7f8a40009750 comp rx=0 tx=0).stop 2024-04-25T09:02:10.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/1704124122 shutdown_connections 2024-04-25T09:02:10.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8ad6b8e40 0x55f8ad6baa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f8ad66ebb0 0x55f8ad6964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x55f8ad6686c0 0x55f8ad6bafc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4ffe6740 1 --2- 172.21.15.55:0/1704124122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8ad66dcf0 0x55f8ad695f60 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/1704124122 >> 172.21.15.55:0/1704124122 conn(0x55f8ad669830 msgr2=0x55f8ad699f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a25ffb640 0 client.8550 ms_handle_reset on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:10.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/1704124122 shutdown_connections 2024-04-25T09:02:10.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4ffe6740 1 -- 172.21.15.55:0/1704124122 wait complete. 2024-04-25T09:02:10.591 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:02:10.592 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-25T09:02:10.592 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "e4e847da-9b66-4c50-82a3-87d0ce43ad88", 2024-04-25T09:02:10.592 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-25T09:02:10.592 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:02:10.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4ffe6740 20 client.8550 trim_cache size 0 max 16384 2024-04-25T09:02:10.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/1150581230 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 msgr2=0x7f8a2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4d2e1640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 0x7f8a2806d990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8a40034000 tx=0x7f8a4002f000 comp rx=0 tx=0).stop 2024-04-25T09:02:10.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/1150581230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a480cce80 msgr2=0x7f8a48152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4d2e1640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a480cce80 0x7f8a48152dc0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c4d0 tx=0x7f8a3000c8d0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/1150581230 shutdown_connections 2024-04-25T09:02:10.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4d2e1640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 0x7f8a2806d990 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4d2e1640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a480ce350 0x7f8a480adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4d2e1640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a480cce80 0x7f8a48152dc0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4d2e1640 1 --2- 172.21.15.55:0/1150581230 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a480b29a0 0x7f8a480c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.591+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/1150581230 >> 172.21.15.55:0/1150581230 conn(0x7f8a48099a40 msgr2=0x7f8a4815c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.592+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/1150581230 shutdown_connections 2024-04-25T09:02:10.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.592+0000 7f8a4d2e1640 1 -- 172.21.15.55:0/1150581230 wait complete. 2024-04-25T09:02:10.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:10.595 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:02:10.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.709+0000 7f380cf77640 1 Processor -- start 2024-04-25T09:02:10.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.709+0000 7f380cf77640 1 -- start start 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.710+0000 7f380cf77640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38080d3b90 0x7f38080d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.710+0000 7f380cf77640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38080d0f60 0x7f38080b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.710+0000 7f380cf77640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38080d4090 con 0x7f380815dca0 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.710+0000 7f380cf77640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38080b6b20 con 0x7f38080d0f60 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.710+0000 7f380cf77640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38080d4370 con 0x7f38080d3b90 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.711+0000 7f3806d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38080d0f60 0x7f38080b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.711+0000 7f3805d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38080d3b90 0x7f38080d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.711+0000 7f380659c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f380815dca0 0x7f38080ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:36380/0 (socket says 172.21.15.55:36380) 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.711+0000 7f380659c640 1 -- 172.21.15.55:0/2341196150 learned_addr learned my addr 172.21.15.55:0/2341196150 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:10.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.711+0000 7f3805d9b640 1 -- 172.21.15.55:0/2341196150 >> v2:172.21.15.167:3300/0 conn(0x7f38080d0f60 msgr2=0x7f38080b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.711+0000 7f3805d9b640 1 --2- 172.21.15.55:0/2341196150 >> v2:172.21.15.167:3300/0 conn(0x7f38080d0f60 0x7f38080b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.711+0000 7f3805d9b640 1 -- 172.21.15.55:0/2341196150 >> v1:172.21.15.167:6789/0 conn(0x7f380815dca0 legacy=0x7f38080ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.711+0000 7f3805d9b640 1 -- 172.21.15.55:0/2341196150 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080d4650 con 0x7f38080d3b90 2024-04-25T09:02:10.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.711+0000 7f3806d9d640 1 --2- 172.21.15.55:0/2341196150 >> v2:172.21.15.167:3300/0 conn(0x7f38080d0f60 0x7f38080b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.712+0000 7f3805d9b640 1 --2- 172.21.15.55:0/2341196150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38080d3b90 0x7f38080d0a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097a0 tx=0x7f37f002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f3a4c981c0cf1bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.712+0000 7f380559a640 1 -- 172.21.15.55:0/2341196150 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0037070 con 0x7f38080d3b90 2024-04-25T09:02:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.712+0000 7f380559a640 1 -- 172.21.15.55:0/2341196150 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f0032440 con 0x7f38080d3b90 2024-04-25T09:02:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.712+0000 7f380559a640 1 -- 172.21.15.55:0/2341196150 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0032810 con 0x7f38080d3b90 2024-04-25T09:02:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.713+0000 7f380cf77640 1 -- 172.21.15.55:0/2341196150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38080d3b90 msgr2=0x7f38080d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.713+0000 7f380cf77640 1 --2- 172.21.15.55:0/2341196150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38080d3b90 0x7f38080d0a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097a0 tx=0x7f37f002a180 comp rx=0 tx=0).stop 2024-04-25T09:02:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.713+0000 7f380cf77640 1 -- 172.21.15.55:0/2341196150 shutdown_connections 2024-04-25T09:02:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.713+0000 7f380cf77640 1 --2- 172.21.15.55:0/2341196150 >> v2:172.21.15.167:3300/0 conn(0x7f38080d0f60 0x7f38080b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.713+0000 7f380cf77640 1 --2- 172.21.15.55:0/2341196150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38080d3b90 0x7f38080d0a20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.713+0000 7f380cf77640 1 -- 172.21.15.55:0/2341196150 >> 172.21.15.55:0/2341196150 conn(0x7f38080726c0 msgr2=0x7f3808072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.713+0000 7f380cf77640 1 -- 172.21.15.55:0/2341196150 shutdown_connections 2024-04-25T09:02:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.713+0000 7f380cf77640 1 -- 172.21.15.55:0/2341196150 wait complete. 2024-04-25T09:02:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.714+0000 7f380cf77640 1 Processor -- start 2024-04-25T09:02:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.714+0000 7f380cf77640 1 -- start start 2024-04-25T09:02:10.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.715+0000 7f380cf77640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38080d0f60 0x7f3808153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.715+0000 7f380cf77640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38080d3b90 0x7f3808157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.715+0000 7f380cf77640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f380815dca0 0x7f3808160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.715+0000 7f380cf77640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380815e080 con 0x7f38080d0f60 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.715+0000 7f380cf77640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38080cf050 con 0x7f380815dca0 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.715+0000 7f380cf77640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380815e200 con 0x7f38080d3b90 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.715+0000 7f380659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38080d0f60 0x7f3808153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.715+0000 7f380659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38080d0f60 0x7f3808153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45926/0 (socket says 172.21.15.55:45926) 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.715+0000 7f380659c640 1 -- 172.21.15.55:0/3573513358 learned_addr learned my addr 172.21.15.55:0/3573513358 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.715+0000 7f3805d9b640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38080d3b90 0x7f3808157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.715+0000 7f3806d9d640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f380815dca0 0x7f3808160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.716+0000 7f380659c640 1 -- 172.21.15.55:0/3573513358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38080d3b90 msgr2=0x7f3808157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.716+0000 7f380659c640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38080d3b90 0x7f3808157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.716+0000 7f380659c640 1 -- 172.21.15.55:0/3573513358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f380815dca0 msgr2=0x7f3808160950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.716+0000 7f380659c640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f380815dca0 0x7f3808160950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.716+0000 7f380659c640 1 -- 172.21.15.55:0/3573513358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080b2de0 con 0x7f38080d0f60 2024-04-25T09:02:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.716+0000 7f380659c640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38080d0f60 0x7f3808153020 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f380000caa0 tx=0x7f380000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.716+0000 7f37feffd640 1 -- 172.21.15.55:0/3573513358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800017070 con 0x7f38080d0f60 2024-04-25T09:02:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.716+0000 7f37feffd640 1 -- 172.21.15.55:0/3573513358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380000ab40 con 0x7f38080d0f60 2024-04-25T09:02:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.716+0000 7f380cf77640 1 -- 172.21.15.55:0/3573513358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38080cd970 con 0x7f38080d0f60 2024-04-25T09:02:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.716+0000 7f37feffd640 1 -- 172.21.15.55:0/3573513358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800012400 con 0x7f38080d0f60 2024-04-25T09:02:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.716+0000 7f380cf77640 1 -- 172.21.15.55:0/3573513358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3808154080 con 0x7f38080d0f60 2024-04-25T09:02:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.717+0000 7f37feffd640 1 -- 172.21.15.55:0/3573513358 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f380001a070 con 0x7f38080d0f60 2024-04-25T09:02:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.718+0000 7f37feffd640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f37e806b4d0 0x7f37e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.718+0000 7f37feffd640 1 -- 172.21.15.55:0/3573513358 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3800089ec0 con 0x7f38080d0f60 2024-04-25T09:02:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.718+0000 7f3805d9b640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f37e806b4d0 0x7f37e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.718+0000 7f3805d9b640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f37e806b4d0 0x7f37e806d990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f37f0034000 tx=0x7f37f002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.719+0000 7f380fc7e740 1 Processor -- start 2024-04-25T09:02:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.719+0000 7f380fc7e740 1 -- start start 2024-04-25T09:02:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3b10 0x5560df5b6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3ef0 0x5560df5b6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df586770 0x5560df589f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380fc7e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560df4efda0 con 0x5560df5b3b10 2024-04-25T09:02:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380fc7e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560df498b80 con 0x5560df5b3ef0 2024-04-25T09:02:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380fc7e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560df4ebe40 con 0x5560df586770 2024-04-25T09:02:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3b10 0x5560df5b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3b10 0x5560df5b6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45938/0 (socket says 172.21.15.55:45938) 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380659c640 1 -- 172.21.15.55:0/1336104217 learned_addr learned my addr 172.21.15.55:0/1336104217 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f3805d9b640 1 --2- 172.21.15.55:0/1336104217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3ef0 0x5560df5b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f3806d9d640 1 --2- 172.21.15.55:0/1336104217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df586770 0x5560df589f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380659c640 1 -- 172.21.15.55:0/1336104217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df586770 msgr2=0x5560df589f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380659c640 1 --2- 172.21.15.55:0/1336104217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df586770 0x5560df589f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380659c640 1 -- 172.21.15.55:0/1336104217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3ef0 msgr2=0x5560df5b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380659c640 1 --2- 172.21.15.55:0/1336104217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3ef0 0x5560df5b6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380659c640 1 -- 172.21.15.55:0/1336104217 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560df4a2f10 con 0x5560df5b3b10 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f3805d9b640 1 --2- 172.21.15.55:0/1336104217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3ef0 0x5560df5b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f380659c640 1 --2- 172.21.15.55:0/1336104217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3b10 0x5560df5b6320 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f3800060700 tx=0x7f3800058710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391e0098dcfb351d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f37e7fff640 1 -- 172.21.15.55:0/1336104217 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38000568d0 con 0x5560df5b3b10 2024-04-25T09:02:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f37e7fff640 1 -- 172.21.15.55:0/1336104217 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3800077070 con 0x5560df5b3b10 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.720+0000 7f37e7fff640 1 -- 172.21.15.55:0/1336104217 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38000607a0 con 0x5560df5b3b10 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.721+0000 7f380fc7e740 1 -- 172.21.15.55:0/1336104217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3b10 msgr2=0x5560df5b6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.721+0000 7f380fc7e740 1 --2- 172.21.15.55:0/1336104217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3b10 0x5560df5b6320 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f3800060700 tx=0x7f3800058710 comp rx=0 tx=0).stop 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.721+0000 7f380fc7e740 1 -- 172.21.15.55:0/1336104217 shutdown_connections 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.721+0000 7f380fc7e740 1 --2- 172.21.15.55:0/1336104217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df586770 0x5560df589f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.721+0000 7f380fc7e740 1 --2- 172.21.15.55:0/1336104217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3ef0 0x5560df5b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.721+0000 7f380fc7e740 1 --2- 172.21.15.55:0/1336104217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3b10 0x5560df5b6320 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.721+0000 7f380fc7e740 1 -- 172.21.15.55:0/1336104217 >> 172.21.15.55:0/1336104217 conn(0x5560df5889e0 msgr2=0x5560df5d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.721+0000 7f380fc7e740 1 -- 172.21.15.55:0/1336104217 shutdown_connections 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.721+0000 7f380fc7e740 1 -- 172.21.15.55:0/1336104217 wait complete. 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.722+0000 7f380fc7e740 1 -- start start 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.722+0000 7f380fc7e740 1 Processor -- start 2024-04-25T09:02:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3b10 0x5560df5c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3ef0 0x5560df5aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5cc610 0x5560df5cca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f380fc7e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560df58bb90 con 0x5560df5b3ef0 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f380fc7e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560df48e4b0 con 0x5560df5cc610 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f380fc7e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560df58be70 con 0x5560df5b3b10 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f380fc7e740 10 client.0 _ll_register_callbacks cb 0x5560df4ce180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f3805d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3ef0 0x5560df5aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f3805d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3ef0 0x5560df5aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45950/0 (socket says 172.21.15.55:45950) 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f3805d9b640 1 -- 172.21.15.55:0/2229834834 learned_addr learned my addr 172.21.15.55:0/2229834834 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f380659c640 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3b10 0x5560df5c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f3806d9d640 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5cc610 0x5560df5cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f3805d9b640 1 -- 172.21.15.55:0/2229834834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3b10 msgr2=0x5560df5c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f3805d9b640 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3b10 0x5560df5c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f3805d9b640 1 -- 172.21.15.55:0/2229834834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5cc610 msgr2=0x5560df5cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f3805d9b640 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5cc610 0x5560df5cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f3805d9b640 1 -- 172.21.15.55:0/2229834834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560df2ce7d0 con 0x5560df5b3ef0 2024-04-25T09:02:10.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f3805d9b640 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3ef0 0x5560df5aa730 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f37f0032c10 tx=0x7f37f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fa0628636d37c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f37e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:10.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.723+0000 7f37e57fa640 1 -- 172.21.15.55:0/2229834834 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0037040 con 0x5560df5b3ef0 2024-04-25T09:02:10.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f37e57fa640 1 -- 172.21.15.55:0/2229834834 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37f003c850 con 0x5560df5b3ef0 2024-04-25T09:02:10.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f380fc7e740 1 -- 172.21.15.55:0/2229834834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3800077070 con 0x5560df5b3ef0 2024-04-25T09:02:10.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f37e57fa640 1 -- 172.21.15.55:0/2229834834 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37f003ca50 con 0x5560df5b3ef0 2024-04-25T09:02:10.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f380fc7e740 10 client.8559 fetch_fsmap learned FSMap version 72 2024-04-25T09:02:10.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f380fc7e740 1 -- 172.21.15.55:0/2229834834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5560df2043f0 con 0x5560df5b3ef0 2024-04-25T09:02:10.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f37e57fa640 1 -- 172.21.15.55:0/2229834834 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3800077070 con 0x5560df5b3ef0 2024-04-25T09:02:10.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f37e57fa640 1 -- 172.21.15.55:0/2229834834 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f37f003cbf0 con 0x5560df5b3ef0 2024-04-25T09:02:10.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f380fc7e740 10 client.8559 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:02:10.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f380fc7e740 10 client.8559 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:02:10.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f380fc7e740 20 client.8559 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:10.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x5560df5d4d80 0x5560df5d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f380fc7e740 4 client.8559 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:02:10.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f380fc7e740 1 -- 172.21.15.55:0/2229834834 --> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560df4fd2e0 con 0x5560df5d4d80 2024-04-25T09:02:10.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f380659c640 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x5560df5d4d80 0x5560df5d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f37e57fa640 10 client.8559 ms_handle_connect on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:10.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.724+0000 7f380659c640 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x5560df5d4d80 0x5560df5d2450 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d413ab36de500ced server_cookie=6dc7d2907c84881f in_seq=0 out_seq=0 2024-04-25T09:02:10.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f37e57fa640 1 -- 172.21.15.55:0/2229834834 <== mds.0 v2:172.21.15.55:6834/538888347 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5560df4fd2e0 con 0x5560df5d4d80 2024-04-25T09:02:10.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f37e57fa640 10 client.8559 handle_command_reply: tid=0 2024-04-25T09:02:10.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 1 client.8559 shutdown 2024-04-25T09:02:10.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 1 -- 172.21.15.55:0/2229834834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3ef0 msgr2=0x5560df5aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3ef0 0x5560df5aa730 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f37f0032c10 tx=0x7f37f0004730 comp rx=0 tx=0).stop 2024-04-25T09:02:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 1 -- 172.21.15.55:0/2229834834 shutdown_connections 2024-04-25T09:02:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5cc610 0x5560df5cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x5560df5d4d80 0x5560df5d2450 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5b3ef0 0x5560df5aa730 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2229834834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3b10 0x5560df5c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f37e57fa640 0 client.8559 ms_handle_reset on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 1 -- 172.21.15.55:0/2229834834 >> 172.21.15.55:0/2229834834 conn(0x5560df586770 msgr2=0x5560df58b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 1 -- 172.21.15.55:0/2229834834 shutdown_connections 2024-04-25T09:02:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 1 -- 172.21.15.55:0/2229834834 wait complete. 2024-04-25T09:02:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.725+0000 7f380fc7e740 20 client.8559 trim_cache size 0 max 16384 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.741+0000 7f380fc7e740 1 Processor -- start 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.741+0000 7f380fc7e740 1 -- start start 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.741+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3b10 0x5560df5d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.741+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3ef0 0x5560df587200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.741+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.741+0000 7f380fc7e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38081ffe80 con 0x5560df5cc610 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.741+0000 7f380fc7e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38081ff040 con 0x5560df5b3b10 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.741+0000 7f380fc7e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38080cd630 con 0x5560df5b3ef0 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.741+0000 7f3806d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.741+0000 7f3806d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45966/0 (socket says 172.21.15.55:45966) 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.741+0000 7f3806d9d640 1 -- 172.21.15.55:0/1974530619 learned_addr learned my addr 172.21.15.55:0/1974530619 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f3805d9b640 1 --2- 172.21.15.55:0/1974530619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3ef0 0x5560df587200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f380659c640 1 --2- 172.21.15.55:0/1974530619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3b10 0x5560df5d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f3806d9d640 1 -- 172.21.15.55:0/1974530619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3ef0 msgr2=0x5560df587200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f3806d9d640 1 --2- 172.21.15.55:0/1974530619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3ef0 0x5560df587200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f3806d9d640 1 -- 172.21.15.55:0/1974530619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3b10 msgr2=0x5560df5d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f3806d9d640 1 --2- 172.21.15.55:0/1974530619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3b10 0x5560df5d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f3806d9d640 1 -- 172.21.15.55:0/1974530619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560df5cce00 con 0x5560df5cc610 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f3805d9b640 1 --2- 172.21.15.55:0/1974530619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3ef0 0x5560df587200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f3806d9d640 1 --2- 172.21.15.55:0/1974530619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a1d0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009cb0 tx=0x7f37f8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a96d279bd4e56ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f37e77fe640 1 -- 172.21.15.55:0/1974530619 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8009e60 con 0x5560df5cc610 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f37e77fe640 1 -- 172.21.15.55:0/1974530619 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f8017440 con 0x5560df5cc610 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.742+0000 7f37e77fe640 1 -- 172.21.15.55:0/1974530619 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8017830 con 0x5560df5cc610 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.743+0000 7f380fc7e740 1 -- 172.21.15.55:0/1974530619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 msgr2=0x5560df58a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.743+0000 7f380fc7e740 1 --2- 172.21.15.55:0/1974530619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a1d0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009cb0 tx=0x7f37f8009190 comp rx=0 tx=0).stop 2024-04-25T09:02:10.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.743+0000 7f380fc7e740 1 -- 172.21.15.55:0/1974530619 shutdown_connections 2024-04-25T09:02:10.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.743+0000 7f380fc7e740 1 --2- 172.21.15.55:0/1974530619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a1d0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.743+0000 7f380fc7e740 1 --2- 172.21.15.55:0/1974530619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3ef0 0x5560df587200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.743+0000 7f380fc7e740 1 --2- 172.21.15.55:0/1974530619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3b10 0x5560df5d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.743+0000 7f380fc7e740 1 -- 172.21.15.55:0/1974530619 >> 172.21.15.55:0/1974530619 conn(0x5560df586770 msgr2=0x5560df5b65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.743+0000 7f380fc7e740 1 -- 172.21.15.55:0/1974530619 shutdown_connections 2024-04-25T09:02:10.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.743+0000 7f380fc7e740 1 -- 172.21.15.55:0/1974530619 wait complete. 2024-04-25T09:02:10.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.743+0000 7f380fc7e740 1 -- start start 2024-04-25T09:02:10.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.743+0000 7f380fc7e740 1 Processor -- start 2024-04-25T09:02:10.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3b10 0x5560df5dfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3ef0 0x5560df589f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f380fc7e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f380fc7e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560df5ca700 con 0x5560df5cc610 2024-04-25T09:02:10.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f380fc7e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38080cb6a0 con 0x5560df5b3b10 2024-04-25T09:02:10.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f380fc7e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560df4a6d90 con 0x5560df5b3ef0 2024-04-25T09:02:10.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f380fc7e740 10 client.0 _ll_register_callbacks cb 0x7f3800054870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:10.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f3806d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f3806d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45978/0 (socket says 172.21.15.55:45978) 2024-04-25T09:02:10.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f3806d9d640 1 -- 172.21.15.55:0/2666734153 learned_addr learned my addr 172.21.15.55:0/2666734153 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:10.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f3805d9b640 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3ef0 0x5560df589f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.744+0000 7f380659c640 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3b10 0x5560df5dfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f3806d9d640 1 -- 172.21.15.55:0/2666734153 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3ef0 msgr2=0x5560df589f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f3806d9d640 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3ef0 0x5560df589f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f3806d9d640 1 -- 172.21.15.55:0/2666734153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3b10 msgr2=0x5560df5dfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f3806d9d640 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3b10 0x5560df5dfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f3806d9d640 1 -- 172.21.15.55:0/2666734153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560df1c40f0 con 0x5560df5cc610 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f3806d9d640 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a4c0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f37f8000c00 tx=0x7f37f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64b980ee0ad701c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f37e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f37e57fa640 1 -- 172.21.15.55:0/2666734153 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f802f060 con 0x5560df5cc610 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f37e57fa640 1 -- 172.21.15.55:0/2666734153 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37f8003810 con 0x5560df5cc610 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f380fc7e740 1 -- 172.21.15.55:0/2666734153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37f8017440 con 0x5560df5cc610 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f37e57fa640 1 -- 172.21.15.55:0/2666734153 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37f8035050 con 0x5560df5cc610 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f380fc7e740 10 client.8565 fetch_fsmap learned FSMap version 72 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f380fc7e740 1 -- 172.21.15.55:0/2666734153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5560df5d1f80 con 0x5560df5cc610 2024-04-25T09:02:10.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f37e57fa640 1 -- 172.21.15.55:0/2666734153 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f8017440 con 0x5560df5cc610 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f37e57fa640 1 -- 172.21.15.55:0/2666734153 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f37f8038020 con 0x5560df5cc610 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f380fc7e740 10 client.8565 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f380fc7e740 10 client.8565 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f380fc7e740 20 client.8565 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x5560df5c6cb0 0x5560df5ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f380fc7e740 4 client.8565 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.745+0000 7f380fc7e740 1 -- 172.21.15.55:0/2666734153 --> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5560df4f7630 con 0x5560df5c6cb0 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380659c640 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x5560df5c6cb0 0x5560df5ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f37e57fa640 10 client.8565 ms_handle_connect on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380659c640 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x5560df5c6cb0 0x5560df5ceaf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f10687b70359a944 server_cookie=89e4a872de4de33b in_seq=0 out_seq=0 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f37e57fa640 1 -- 172.21.15.55:0/2666734153 <== mds.0 v2:172.21.15.55:6834/538888347 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x5560df4f7630 con 0x5560df5c6cb0 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f37e57fa640 10 client.8565 handle_command_reply: tid=0 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 1 client.8565 shutdown 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 1 -- 172.21.15.55:0/2666734153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 msgr2=0x5560df58a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a4c0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f37f8000c00 tx=0x7f37f8004730 comp rx=0 tx=0).stop 2024-04-25T09:02:10.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 1 -- 172.21.15.55:0/2666734153 shutdown_connections 2024-04-25T09:02:10.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x5560df5c6cb0 0x5560df5ceaf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5560df5cc610 0x5560df58a4c0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5560df5b3ef0 0x5560df589f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 1 --2- 172.21.15.55:0/2666734153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560df5b3b10 0x5560df5dfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f37e57fa640 0 client.8565 ms_handle_reset on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:10.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 1 -- 172.21.15.55:0/2666734153 >> 172.21.15.55:0/2666734153 conn(0x5560df586770 msgr2=0x5560df5cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 1 -- 172.21.15.55:0/2666734153 shutdown_connections 2024-04-25T09:02:10.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 1 -- 172.21.15.55:0/2666734153 wait complete. 2024-04-25T09:02:10.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.746+0000 7f380fc7e740 20 client.8565 trim_cache size 0 max 16384 2024-04-25T09:02:10.747 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:02:10.747 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:02:10.749 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-25T09:02:10.749 INFO:teuthology.orchestra.run.smithi055.stdout: "e4e847da-9b66-4c50-82a3-87d0ce43ad88": { 2024-04-25T09:02:10.749 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-04-25T09:02:10.749 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "e4e847da-9b66-4c50-82a3-87d0ce43ad88", 2024-04-25T09:02:10.749 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-25T09:02:10.749 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:02:10.749 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:02:10.749 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:02:10.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 -- 172.21.15.55:0/3573513358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f37e806b4d0 msgr2=0x7f37e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f37e806b4d0 0x7f37e806d990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f37f0034000 tx=0x7f37f002e000 comp rx=0 tx=0).stop 2024-04-25T09:02:10.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 -- 172.21.15.55:0/3573513358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38080d0f60 msgr2=0x7f3808153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38080d0f60 0x7f3808153020 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f380000caa0 tx=0x7f380000cea0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 -- 172.21.15.55:0/3573513358 shutdown_connections 2024-04-25T09:02:10.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f37e806b4d0 0x7f37e806d990 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f380815dca0 0x7f3808160950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38080d3b90 0x7f3808157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 --2- 172.21.15.55:0/3573513358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38080d0f60 0x7f3808153020 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 -- 172.21.15.55:0/3573513358 >> 172.21.15.55:0/3573513358 conn(0x7f38080726c0 msgr2=0x7f38080b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 -- 172.21.15.55:0/3573513358 shutdown_connections 2024-04-25T09:02:10.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:10.747+0000 7f380cf77640 1 -- 172.21.15.55:0/3573513358 wait complete. 2024-04-25T09:02:10.752 INFO:tasks.cephfs.filesystem:scrub status for tag:e4e847da-9b66-4c50-82a3-87d0ce43ad88 - {'path': '/', 'tag': 'e4e847da-9b66-4c50-82a3-87d0ce43ad88', 'options': 'recursive,repair'} 2024-04-25T09:02:10.853 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:10.856 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:11.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:11.175+0000 7ffa06ffd640 1 -- 172.21.15.55:0/3177063072 <== mon.0 v2:172.21.15.55:3300/0 7 ==== log(4 entries from seq 1 at 2024-04-25T09:02:10.591305+0000) v1 ==== 695+0+0 (secure 0 0 0) 0x7ffa080a8db0 con 0x7ffa000039b0 2024-04-25T09:02:11.165 INFO:teuthology.orchestra.run.smithi055.stdout: cluster: 2024-04-25T09:02:11.165 INFO:teuthology.orchestra.run.smithi055.stdout: id: c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T09:02:11.165 INFO:teuthology.orchestra.run.smithi055.stdout: health: HEALTH_OK 2024-04-25T09:02:11.165 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:11.165 INFO:teuthology.orchestra.run.smithi055.stdout: services: 2024-04-25T09:02:11.165 INFO:teuthology.orchestra.run.smithi055.stdout: mon: 3 daemons, quorum a,b,c (age 8m) 2024-04-25T09:02:11.165 INFO:teuthology.orchestra.run.smithi055.stdout: mgr: y(active, since 8m), standbys: x 2024-04-25T09:02:11.165 INFO:teuthology.orchestra.run.smithi055.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T09:02:11.165 INFO:teuthology.orchestra.run.smithi055.stdout: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: data: 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: volumes: 1/1 healthy 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: pools: 3 pools, 97 pgs 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: objects: 26 objects, 6.6 MiB 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: usage: 270 MiB used, 720 GiB / 720 GiB avail 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: pgs: 97 active+clean 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: io: 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: client: 513 KiB/s wr, 0 op/s rd, 1 op/s wr 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:10.591305+0000 mds.c [INF] scrub queued for path: / 2024-04-25T09:02:11.166 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:10.591309+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:02:11.167 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:10.591314+0000 mds.c [INF] scrub summary: active paths [/] 2024-04-25T09:02:11.167 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:10.592526+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:02:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:13.179+0000 7ffa06ffd640 1 -- 172.21.15.55:0/3177063072 <== mon.0 v2:172.21.15.55:3300/0 8 ==== log(1 entries from seq 5 at 2024-04-25T09:02:12.657496+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7ffa08076f90 con 0x7ffa000039b0 2024-04-25T09:02:13.168 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:12.657496+0000 mds.c [INF] scrub summary: idle 2024-04-25T09:02:40.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:40.753 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:02:40.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.881+0000 7fca5bcf5640 1 Processor -- start 2024-04-25T09:02:40.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.881+0000 7fca5bcf5640 1 -- start start 2024-04-25T09:02:40.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca5bcf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca5415dca0 0x7fca540ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca5bcf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca540d1130 0x7fca540b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca5bcf5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca540d4090 con 0x7fca540d3b90 2024-04-25T09:02:40.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca5bcf5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca540b6b20 con 0x7fca5415dca0 2024-04-25T09:02:40.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca5bcf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca540d4370 con 0x7fca540d1130 2024-04-25T09:02:40.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca59a91640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca5415dca0 0x7fca540ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca59290640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fca540d3b90 0x7fca540d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45396/0 (socket says 172.21.15.55:45396) 2024-04-25T09:02:40.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca59290640 1 -- 172.21.15.55:0/3143673960 learned_addr learned my addr 172.21.15.55:0/3143673960 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:40.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca5a292640 1 --2- 172.21.15.55:0/3143673960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca540d1130 0x7fca540b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca59a91640 1 -- 172.21.15.55:0/3143673960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca540d1130 msgr2=0x7fca540b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:40.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca59a91640 1 --2- 172.21.15.55:0/3143673960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca540d1130 0x7fca540b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca59a91640 1 -- 172.21.15.55:0/3143673960 >> v1:172.21.15.55:6789/0 conn(0x7fca540d3b90 legacy=0x7fca540d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:40.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.882+0000 7fca59a91640 1 -- 172.21.15.55:0/3143673960 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540d4650 con 0x7fca5415dca0 2024-04-25T09:02:40.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.883+0000 7fca59a91640 1 --2- 172.21.15.55:0/3143673960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca5415dca0 0x7fca540ce940 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fca500097a0 tx=0x7fca5002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3961941f05016c1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:40.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.883+0000 7fca58a8f640 1 -- 172.21.15.55:0/3143673960 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50037070 con 0x7fca5415dca0 2024-04-25T09:02:40.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.883+0000 7fca58a8f640 1 -- 172.21.15.55:0/3143673960 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca50032440 con 0x7fca5415dca0 2024-04-25T09:02:40.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.883+0000 7fca58a8f640 1 -- 172.21.15.55:0/3143673960 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50032810 con 0x7fca5415dca0 2024-04-25T09:02:40.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.884+0000 7fca5bcf5640 1 -- 172.21.15.55:0/3143673960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca5415dca0 msgr2=0x7fca540ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:40.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.884+0000 7fca5bcf5640 1 --2- 172.21.15.55:0/3143673960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca5415dca0 0x7fca540ce940 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fca500097a0 tx=0x7fca5002a180 comp rx=0 tx=0).stop 2024-04-25T09:02:40.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.884+0000 7fca5bcf5640 1 -- 172.21.15.55:0/3143673960 shutdown_connections 2024-04-25T09:02:40.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.884+0000 7fca5bcf5640 1 --2- 172.21.15.55:0/3143673960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca540d1130 0x7fca540b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.884+0000 7fca5bcf5640 1 --2- 172.21.15.55:0/3143673960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca5415dca0 0x7fca540ce940 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.884+0000 7fca5bcf5640 1 -- 172.21.15.55:0/3143673960 >> 172.21.15.55:0/3143673960 conn(0x7fca540726c0 msgr2=0x7fca54072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.884+0000 7fca5bcf5640 1 -- 172.21.15.55:0/3143673960 shutdown_connections 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.884+0000 7fca5bcf5640 1 -- 172.21.15.55:0/3143673960 wait complete. 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.885+0000 7fca5bcf5640 1 Processor -- start 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.885+0000 7fca5bcf5640 1 -- start start 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca5bcf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca540d1130 0x7fca540ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca5bcf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca540d3b90 0x7fca54159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca5bcf5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca5415dca0 0x7fca54159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca5bcf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5415e200 con 0x7fca540d3b90 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca5bcf5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5415e080 con 0x7fca5415dca0 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca5bcf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca540cee80 con 0x7fca540d1130 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca59290640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca540d3b90 0x7fca54159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca59290640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca540d3b90 0x7fca54159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36678/0 (socket says 172.21.15.55:36678) 2024-04-25T09:02:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca59290640 1 -- 172.21.15.55:0/761652615 learned_addr learned my addr 172.21.15.55:0/761652615 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca59a91640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca540d1130 0x7fca540ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca5a292640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca5415dca0 0x7fca54159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca59290640 1 -- 172.21.15.55:0/761652615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca540d1130 msgr2=0x7fca540ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca59290640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca540d1130 0x7fca540ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca59290640 1 -- 172.21.15.55:0/761652615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca5415dca0 msgr2=0x7fca54159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca59290640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca5415dca0 0x7fca54159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca59290640 1 -- 172.21.15.55:0/761652615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540c7a50 con 0x7fca540d3b90 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca5a292640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca5415dca0 0x7fca54159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.886+0000 7fca59290640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca540d3b90 0x7fca54159960 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c470 tx=0x7fca44001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.887+0000 7fca4a7fc640 1 -- 172.21.15.55:0/761652615 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44017070 con 0x7fca540d3b90 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.887+0000 7fca4a7fc640 1 -- 172.21.15.55:0/761652615 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca44005ce0 con 0x7fca540d3b90 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.887+0000 7fca5bcf5640 1 -- 172.21.15.55:0/761652615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca540c7d30 con 0x7fca540d3b90 2024-04-25T09:02:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.887+0000 7fca4a7fc640 1 -- 172.21.15.55:0/761652615 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca440072f0 con 0x7fca540d3b90 2024-04-25T09:02:40.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.887+0000 7fca5bcf5640 1 -- 172.21.15.55:0/761652615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca540c82f0 con 0x7fca540d3b90 2024-04-25T09:02:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.888+0000 7fca4a7fc640 1 -- 172.21.15.55:0/761652615 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca4401a070 con 0x7fca540d3b90 2024-04-25T09:02:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.889+0000 7fca4a7fc640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca3806b4d0 0x7fca3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.889+0000 7fca4a7fc640 1 -- 172.21.15.55:0/761652615 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca44089610 con 0x7fca540d3b90 2024-04-25T09:02:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.889+0000 7fca59a91640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca3806b4d0 0x7fca3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.889+0000 7fca59a91640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca3806b4d0 0x7fca3806d990 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fca50034000 tx=0x7fca5002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.890+0000 7fca5e9fa740 1 Processor -- start 2024-04-25T09:02:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.890+0000 7fca5e9fa740 1 -- start start 2024-04-25T09:02:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fbeb10 0x564412fc1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeef0 0x564412fc1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412f91770 0x564412f94f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564412efada0 con 0x564412f91770 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564412ea3b80 con 0x564412fbeef0 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564412ef6e40 con 0x564412fbeb10 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5a292640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412f91770 0x564412f94f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5a292640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412f91770 0x564412f94f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36684/0 (socket says 172.21.15.55:36684) 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5a292640 1 -- 172.21.15.55:0/1708878235 learned_addr learned my addr 172.21.15.55:0/1708878235 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca59a91640 1 --2- 172.21.15.55:0/1708878235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fbeb10 0x564412fc1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca59290640 1 --2- 172.21.15.55:0/1708878235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeef0 0x564412fc1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5a292640 1 -- 172.21.15.55:0/1708878235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fbeb10 msgr2=0x564412fc1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5a292640 1 --2- 172.21.15.55:0/1708878235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fbeb10 0x564412fc1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5a292640 1 -- 172.21.15.55:0/1708878235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeef0 msgr2=0x564412fc1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5a292640 1 --2- 172.21.15.55:0/1708878235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeef0 0x564412fc1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca5a292640 1 -- 172.21.15.55:0/1708878235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564412eadf10 con 0x564412f91770 2024-04-25T09:02:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.891+0000 7fca59290640 1 --2- 172.21.15.55:0/1708878235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeef0 0x564412fc1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca5a292640 1 --2- 172.21.15.55:0/1708878235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412f91770 0x564412f94f80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0074e0 tx=0x7fca4c0079a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cd4ca1c392df4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca377fe640 1 -- 172.21.15.55:0/1708878235 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c0147e0 con 0x564412f91770 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca377fe640 1 -- 172.21.15.55:0/1708878235 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c01b070 con 0x564412f91770 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca377fe640 1 -- 172.21.15.55:0/1708878235 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c014bc0 con 0x564412f91770 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1708878235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412f91770 msgr2=0x564412f94f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/1708878235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412f91770 0x564412f94f80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0074e0 tx=0x7fca4c0079a0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1708878235 shutdown_connections 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/1708878235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412f91770 0x564412f94f80 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/1708878235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeef0 0x564412fc1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/1708878235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fbeb10 0x564412fc1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1708878235 >> 172.21.15.55:0/1708878235 conn(0x564412f939e0 msgr2=0x564412fdc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.892+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1708878235 shutdown_connections 2024-04-25T09:02:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.893+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1708878235 wait complete. 2024-04-25T09:02:40.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.893+0000 7fca5e9fa740 1 -- start start 2024-04-25T09:02:40.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.893+0000 7fca5e9fa740 1 Processor -- start 2024-04-25T09:02:40.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeb10 0x564412fb7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412fbbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fb9040 0x564412fbc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564412f96b90 con 0x564412fbeef0 2024-04-25T09:02:40.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564412e994b0 con 0x564412fbeb10 2024-04-25T09:02:40.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564412f96e70 con 0x564412fb9040 2024-04-25T09:02:40.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca5e9fa740 10 client.0 _ll_register_callbacks cb 0x564412ed9180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:40.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca59290640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412fbbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca59290640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412fbbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36686/0 (socket says 172.21.15.55:36686) 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca59290640 1 -- 172.21.15.55:0/2884554041 learned_addr learned my addr 172.21.15.55:0/2884554041 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca59a91640 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeb10 0x564412fb7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.894+0000 7fca5a292640 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fb9040 0x564412fbc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca59290640 1 -- 172.21.15.55:0/2884554041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fb9040 msgr2=0x564412fbc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca59290640 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fb9040 0x564412fbc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca59290640 1 -- 172.21.15.55:0/2884554041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeb10 msgr2=0x564412fb7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca59290640 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeb10 0x564412fb7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca59290640 1 -- 172.21.15.55:0/2884554041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564412cd97d0 con 0x564412fbeef0 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca59290640 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412fbbb30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fca44057a90 tx=0x7fca44058550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331e16cbac5d710e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca34ff9640 1 -- 172.21.15.55:0/2884554041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4406f020 con 0x564412fbeef0 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca34ff9640 1 -- 172.21.15.55:0/2884554041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca44054400 con 0x564412fbeef0 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca5e9fa740 1 -- 172.21.15.55:0/2884554041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca4c01b070 con 0x564412fbeef0 2024-04-25T09:02:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca34ff9640 1 -- 172.21.15.55:0/2884554041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca440604a0 con 0x564412fbeef0 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca5e9fa740 10 client.8580 fetch_fsmap learned FSMap version 72 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca5e9fa740 1 -- 172.21.15.55:0/2884554041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x564412c0f3f0 con 0x564412fbeef0 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca34ff9640 1 -- 172.21.15.55:0/2884554041 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c01b070 con 0x564412fbeef0 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca34ff9640 1 -- 172.21.15.55:0/2884554041 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fca44007490 con 0x564412fbeef0 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca5e9fa740 10 client.8580 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca5e9fa740 10 client.8580 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca5e9fa740 20 client.8580 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x564412fdd920 0x564412fb9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca5e9fa740 4 client.8580 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.895+0000 7fca5e9fa740 1 -- 172.21.15.55:0/2884554041 --> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564412f082e0 con 0x564412fdd920 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.896+0000 7fca59a91640 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x564412fdd920 0x564412fb9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.896+0000 7fca34ff9640 10 client.8580 ms_handle_connect on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.896+0000 7fca59a91640 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x564412fdd920 0x564412fb9c10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d22388ceed5e5e3 server_cookie=c8e947e3733b90d6 in_seq=0 out_seq=0 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.896+0000 7fca34ff9640 1 -- 172.21.15.55:0/2884554041 <== mds.0 v2:172.21.15.55:6834/538888347 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564412f082e0 con 0x564412fdd920 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.896+0000 7fca34ff9640 10 client.8580 handle_command_reply: tid=0 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.896+0000 7fca5e9fa740 1 client.8580 shutdown 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca5e9fa740 1 -- 172.21.15.55:0/2884554041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 msgr2=0x564412fbbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412fbbb30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fca44057a90 tx=0x7fca44058550 comp rx=0 tx=0).stop 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca5e9fa740 1 -- 172.21.15.55:0/2884554041 shutdown_connections 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fb9040 0x564412fbc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x564412fdd920 0x564412fb9c10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412fbbb30 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/2884554041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeb10 0x564412fb7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca34ff9640 0 client.8580 ms_handle_reset on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca5e9fa740 1 -- 172.21.15.55:0/2884554041 >> 172.21.15.55:0/2884554041 conn(0x564412f91770 msgr2=0x564412fbdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:40.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca5e9fa740 1 -- 172.21.15.55:0/2884554041 shutdown_connections 2024-04-25T09:02:40.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca5e9fa740 1 -- 172.21.15.55:0/2884554041 wait complete. 2024-04-25T09:02:40.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.897+0000 7fca5e9fa740 20 client.8580 trim_cache size 0 max 16384 2024-04-25T09:02:40.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.912+0000 7fca5e9fa740 1 Processor -- start 2024-04-25T09:02:40.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.912+0000 7fca5e9fa740 1 -- start start 2024-04-25T09:02:40.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fb9040 0x564412fb7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeb10 0x56441303d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412f922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca541fffe0 con 0x564412fbeef0 2024-04-25T09:02:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca541ff1e0 con 0x564412fbeb10 2024-04-25T09:02:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5415f120 con 0x564412fb9040 2024-04-25T09:02:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5a292640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412f922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5a292640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412f922c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36702/0 (socket says 172.21.15.55:36702) 2024-04-25T09:02:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5a292640 1 -- 172.21.15.55:0/4257894999 learned_addr learned my addr 172.21.15.55:0/4257894999 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca59290640 1 --2- 172.21.15.55:0/4257894999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeb10 0x56441303d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca59a91640 1 --2- 172.21.15.55:0/4257894999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fb9040 0x564412fb7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5a292640 1 -- 172.21.15.55:0/4257894999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fb9040 msgr2=0x564412fb7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5a292640 1 --2- 172.21.15.55:0/4257894999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fb9040 0x564412fb7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5a292640 1 -- 172.21.15.55:0/4257894999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeb10 msgr2=0x56441303d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5a292640 1 --2- 172.21.15.55:0/4257894999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeb10 0x56441303d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca5a292640 1 -- 172.21.15.55:0/4257894999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564412bcf0f0 con 0x564412fbeef0 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.913+0000 7fca59290640 1 --2- 172.21.15.55:0/4257894999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeb10 0x56441303d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca59a91640 1 --2- 172.21.15.55:0/4257894999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fb9040 0x564412fb7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca5a292640 1 --2- 172.21.15.55:0/4257894999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412f922c0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fca4c017000 tx=0x7fca4c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5049cf34fa5fe0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca36ffd640 1 -- 172.21.15.55:0/4257894999 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c0147e0 con 0x564412fbeef0 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca36ffd640 1 -- 172.21.15.55:0/4257894999 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c01b040 con 0x564412fbeef0 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca36ffd640 1 -- 172.21.15.55:0/4257894999 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c014be0 con 0x564412fbeef0 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca5e9fa740 1 -- 172.21.15.55:0/4257894999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 msgr2=0x564412f922c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/4257894999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412f922c0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fca4c017000 tx=0x7fca4c015000 comp rx=0 tx=0).stop 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca5e9fa740 1 -- 172.21.15.55:0/4257894999 shutdown_connections 2024-04-25T09:02:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/4257894999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeef0 0x564412f922c0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/4257894999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fbeb10 0x56441303d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/4257894999 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fb9040 0x564412fb7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca5e9fa740 1 -- 172.21.15.55:0/4257894999 >> 172.21.15.55:0/4257894999 conn(0x564412f91770 msgr2=0x564412ffe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca5e9fa740 1 -- 172.21.15.55:0/4257894999 shutdown_connections 2024-04-25T09:02:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.914+0000 7fca5e9fa740 1 -- 172.21.15.55:0/4257894999 wait complete. 2024-04-25T09:02:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.915+0000 7fca5e9fa740 1 -- start start 2024-04-25T09:02:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.915+0000 7fca5e9fa740 1 Processor -- start 2024-04-25T09:02:40.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fb9040 0x564412f95b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeb10 0x564412f92250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca5e9fa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fbeef0 0x564412f92790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564412eb1e20 con 0x564412fbeb10 2024-04-25T09:02:40.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5415f720 con 0x564412fb9040 2024-04-25T09:02:40.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca5e9fa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564412fd2c40 con 0x564412fbeef0 2024-04-25T09:02:40.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca5e9fa740 10 client.0 _ll_register_callbacks cb 0x7fca4c0099b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:40.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca59290640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeb10 0x564412f92250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca59290640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeb10 0x564412f92250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36716/0 (socket says 172.21.15.55:36716) 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca59290640 1 -- 172.21.15.55:0/1175045300 learned_addr learned my addr 172.21.15.55:0/1175045300 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca59a91640 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fb9040 0x564412f95b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca59290640 1 -- 172.21.15.55:0/1175045300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fbeef0 msgr2=0x564412f92790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca59290640 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fbeef0 0x564412f92790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca59290640 1 -- 172.21.15.55:0/1175045300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fb9040 msgr2=0x564412f95b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca59290640 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fb9040 0x564412f95b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.916+0000 7fca59290640 1 -- 172.21.15.55:0/1175045300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564412f96530 con 0x564412fbeb10 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca59290640 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeb10 0x564412f92250 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fca4405ff70 tx=0x7fca44087a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e846889f3c7f8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca34ff9640 1 -- 172.21.15.55:0/1175045300 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca440578d0 con 0x564412fbeb10 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca34ff9640 1 -- 172.21.15.55:0/1175045300 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca44054400 con 0x564412fbeb10 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1175045300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca4c01b040 con 0x564412fbeb10 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca34ff9640 1 -- 172.21.15.55:0/1175045300 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca440571e0 con 0x564412fbeb10 2024-04-25T09:02:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca5e9fa740 10 client.8586 fetch_fsmap learned FSMap version 72 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1175045300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x564412fd2a40 con 0x564412fbeb10 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca34ff9640 1 -- 172.21.15.55:0/1175045300 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c01b040 con 0x564412fbeb10 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca34ff9640 1 -- 172.21.15.55:0/1175045300 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fca44057380 con 0x564412fbeb10 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca5e9fa740 10 client.8586 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca5e9fa740 10 client.8586 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca5e9fa740 20 client.8586 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x564413024b20 0x564412fd1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca5e9fa740 4 client.8586 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1175045300 --> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564412f02630 con 0x564413024b20 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.917+0000 7fca59a91640 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x564413024b20 0x564412fd1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca34ff9640 10 client.8586 ms_handle_connect on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:40.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca59a91640 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x564413024b20 0x564412fd1cb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c49a544d4dc31f69 server_cookie=39682f1ae8392cfd in_seq=0 out_seq=0 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca34ff9640 1 -- 172.21.15.55:0/1175045300 <== mds.0 v2:172.21.15.55:6834/538888347 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564412f02630 con 0x564413024b20 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca34ff9640 10 client.8586 handle_command_reply: tid=0 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 1 client.8586 shutdown 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1175045300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeb10 msgr2=0x564412f92250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeb10 0x564412f92250 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fca4405ff70 tx=0x7fca44087a10 comp rx=0 tx=0).stop 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1175045300 shutdown_connections 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564412fbeef0 0x564412f92790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.55:6834/538888347,v1:172.21.15.55:6837/538888347] conn(0x564413024b20 0x564412fd1cb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564412fbeb10 0x564412f92250 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 1 --2- 172.21.15.55:0/1175045300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564412fb9040 0x564412f95b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca34ff9640 0 client.8586 ms_handle_reset on v2:172.21.15.55:6834/538888347 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1175045300 >> 172.21.15.55:0/1175045300 conn(0x564412f91770 msgr2=0x564412f8cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1175045300 shutdown_connections 2024-04-25T09:02:40.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 1 -- 172.21.15.55:0/1175045300 wait complete. 2024-04-25T09:02:40.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.918+0000 7fca5e9fa740 20 client.8586 trim_cache size 0 max 16384 2024-04-25T09:02:40.914 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:02:40.914 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-25T09:02:40.914 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-25T09:02:40.914 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:02:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 -- 172.21.15.55:0/761652615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca3806b4d0 msgr2=0x7fca3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca3806b4d0 0x7fca3806d990 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fca50034000 tx=0x7fca5002e000 comp rx=0 tx=0).stop 2024-04-25T09:02:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 -- 172.21.15.55:0/761652615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca540d3b90 msgr2=0x7fca54159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca540d3b90 0x7fca54159960 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c470 tx=0x7fca44001e70 comp rx=0 tx=0).stop 2024-04-25T09:02:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 -- 172.21.15.55:0/761652615 shutdown_connections 2024-04-25T09:02:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fca3806b4d0 0x7fca3806d990 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca5415dca0 0x7fca54159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca540d3b90 0x7fca54159960 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 --2- 172.21.15.55:0/761652615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca540d1130 0x7fca540ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 -- 172.21.15.55:0/761652615 >> 172.21.15.55:0/761652615 conn(0x7fca540726c0 msgr2=0x7fca540b88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 -- 172.21.15.55:0/761652615 shutdown_connections 2024-04-25T09:02:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:40.919+0000 7fca5bcf5640 1 -- 172.21.15.55:0/761652615 wait complete. 2024-04-25T09:02:40.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:40.918 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:02:40.919 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:41.019 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:02:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.151+0000 7f5054c53640 1 Processor -- start 2024-04-25T09:02:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.151+0000 7f5054c53640 1 -- start start 2024-04-25T09:02:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.152+0000 7f5054c53640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50500aedc0 0x7f505015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.152+0000 7f5054c53640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f505006d260 0x7f50500b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.152+0000 7f5054c53640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505006da40 con 0x7f50500b4730 2024-04-25T09:02:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.152+0000 7f5054c53640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505015c050 con 0x7f50500aedc0 2024-04-25T09:02:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.152+0000 7f5054c53640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50500b4b70 con 0x7f505006d260 2024-04-25T09:02:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.152+0000 7f504e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50500aedc0 0x7f505015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.152+0000 7f504ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f50500b4730 0x7f50500b26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45404/0 (socket says 172.21.15.55:45404) 2024-04-25T09:02:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.152+0000 7f504ed9d640 1 -- 172.21.15.55:0/3740855017 learned_addr learned my addr 172.21.15.55:0/3740855017 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.153+0000 7f504e59c640 1 -- 172.21.15.55:0/3740855017 >> v2:172.21.15.167:3300/0 conn(0x7f505006d260 msgr2=0x7f50500b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.153+0000 7f504e59c640 1 --2- 172.21.15.55:0/3740855017 >> v2:172.21.15.167:3300/0 conn(0x7f505006d260 0x7f50500b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.153+0000 7f504e59c640 1 -- 172.21.15.55:0/3740855017 >> v1:172.21.15.55:6789/0 conn(0x7f50500b4730 legacy=0x7f50500b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.153+0000 7f504e59c640 1 -- 172.21.15.55:0/3740855017 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505006dd20 con 0x7f50500aedc0 2024-04-25T09:02:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.153+0000 7f504e59c640 1 --2- 172.21.15.55:0/3740855017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500aedc0 0x7f505015ae20 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f505006f6e0 tx=0x7f504802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e80cc4699fb997 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.153+0000 7f504d59a640 1 -- 172.21.15.55:0/3740855017 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048037070 con 0x7f50500aedc0 2024-04-25T09:02:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.154+0000 7f504d59a640 1 -- 172.21.15.55:0/3740855017 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048032440 con 0x7f50500aedc0 2024-04-25T09:02:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.154+0000 7f504d59a640 1 -- 172.21.15.55:0/3740855017 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504802ae60 con 0x7f50500aedc0 2024-04-25T09:02:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.154+0000 7f5054c53640 1 -- 172.21.15.55:0/3740855017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500aedc0 msgr2=0x7f505015ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.154+0000 7f5054c53640 1 --2- 172.21.15.55:0/3740855017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500aedc0 0x7f505015ae20 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f505006f6e0 tx=0x7f504802a110 comp rx=0 tx=0).stop 2024-04-25T09:02:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.154+0000 7f5054c53640 1 -- 172.21.15.55:0/3740855017 shutdown_connections 2024-04-25T09:02:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.154+0000 7f5054c53640 1 --2- 172.21.15.55:0/3740855017 >> v2:172.21.15.167:3300/0 conn(0x7f505006d260 0x7f50500b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.154+0000 7f5054c53640 1 --2- 172.21.15.55:0/3740855017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500aedc0 0x7f505015ae20 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.154+0000 7f5054c53640 1 -- 172.21.15.55:0/3740855017 >> 172.21.15.55:0/3740855017 conn(0x7f505006aba0 msgr2=0x7f505006af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.154+0000 7f5054c53640 1 -- 172.21.15.55:0/3740855017 shutdown_connections 2024-04-25T09:02:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.154+0000 7f5054c53640 1 -- 172.21.15.55:0/3740855017 wait complete. 2024-04-25T09:02:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.155+0000 7f5054c53640 1 Processor -- start 2024-04-25T09:02:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.155+0000 7f5054c53640 1 -- start start 2024-04-25T09:02:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.156+0000 7f5054c53640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f505006d260 0x7f505014d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.156+0000 7f5054c53640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500aedc0 0x7f505014b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.156+0000 7f5054c53640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50500b4730 0x7f50500c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.156+0000 7f5054c53640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505015c2a0 con 0x7f50500aedc0 2024-04-25T09:02:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.156+0000 7f5054c53640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500af1a0 con 0x7f50500b4730 2024-04-25T09:02:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.156+0000 7f5054c53640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505006d6f0 con 0x7f505006d260 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.156+0000 7f504dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500aedc0 0x7f505014b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.156+0000 7f504dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500aedc0 0x7f505014b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36734/0 (socket says 172.21.15.55:36734) 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.156+0000 7f504dd9b640 1 -- 172.21.15.55:0/2396493498 learned_addr learned my addr 172.21.15.55:0/2396493498 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f504ed9d640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50500b4730 0x7f50500c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f504dd9b640 1 -- 172.21.15.55:0/2396493498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f505006d260 msgr2=0x7f505014d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f504e59c640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f505006d260 0x7f505014d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f504dd9b640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f505006d260 0x7f505014d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f504dd9b640 1 -- 172.21.15.55:0/2396493498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50500b4730 msgr2=0x7f50500c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f504dd9b640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50500b4730 0x7f50500c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f504dd9b640 1 -- 172.21.15.55:0/2396493498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505014b450 con 0x7f50500aedc0 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f504ed9d640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50500b4730 0x7f50500c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f504dd9b640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500aedc0 0x7f505014b750 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f503800b440 tx=0x7f503800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f5046ffd640 1 -- 172.21.15.55:0/2396493498 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038015020 con 0x7f50500aedc0 2024-04-25T09:02:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f5046ffd640 1 -- 172.21.15.55:0/2396493498 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5038011890 con 0x7f50500aedc0 2024-04-25T09:02:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f5054c53640 1 -- 172.21.15.55:0/2396493498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505014d560 con 0x7f50500aedc0 2024-04-25T09:02:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f5046ffd640 1 -- 172.21.15.55:0/2396493498 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038011c80 con 0x7f50500aedc0 2024-04-25T09:02:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.157+0000 7f5054c53640 1 -- 172.21.15.55:0/2396493498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505014c540 con 0x7f50500aedc0 2024-04-25T09:02:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.158+0000 7f5054c53640 1 -- 172.21.15.55:0/2396493498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50500750b0 con 0x7f50500aedc0 2024-04-25T09:02:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.159+0000 7f5046ffd640 1 -- 172.21.15.55:0/2396493498 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5038018020 con 0x7f50500aedc0 2024-04-25T09:02:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.159+0000 7f5046ffd640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f503006b4d0 0x7f503006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.159+0000 7f5046ffd640 1 -- 172.21.15.55:0/2396493498 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f503808a260 con 0x7f50500aedc0 2024-04-25T09:02:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.159+0000 7f504e59c640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f503006b4d0 0x7f503006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.160+0000 7f504e59c640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f503006b4d0 0x7f503006d990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5048034000 tx=0x7f504802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.163+0000 7f5046ffd640 1 -- 172.21.15.55:0/2396493498 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f503801f020 con 0x7f50500aedc0 2024-04-25T09:02:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.384+0000 7f5054c53640 1 -- 172.21.15.55:0/2396493498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f505014bc90 con 0x7f50500aedc0 2024-04-25T09:02:41.373 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T09:02:41.384+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:02:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.388+0000 7f5046ffd640 1 -- 172.21.15.55:0/2396493498 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7f503800d040 con 0x7f50500aedc0 2024-04-25T09:02:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:02:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.391+0000 7f5054c53640 1 -- 172.21.15.55:0/2396493498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f503006b4d0 msgr2=0x7f503006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.391+0000 7f5054c53640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f503006b4d0 0x7f503006d990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5048034000 tx=0x7f504802e000 comp rx=0 tx=0).stop 2024-04-25T09:02:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.391+0000 7f5054c53640 1 -- 172.21.15.55:0/2396493498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500aedc0 msgr2=0x7f505014b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.391+0000 7f5054c53640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500aedc0 0x7f505014b750 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f503800b440 tx=0x7f503800b900 comp rx=0 tx=0).stop 2024-04-25T09:02:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.391+0000 7f5054c53640 1 -- 172.21.15.55:0/2396493498 shutdown_connections 2024-04-25T09:02:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.391+0000 7f5054c53640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f503006b4d0 0x7f503006d990 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.391+0000 7f5054c53640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50500b4730 0x7f50500c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.391+0000 7f5054c53640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500aedc0 0x7f505014b750 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.391+0000 7f5054c53640 1 --2- 172.21.15.55:0/2396493498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f505006d260 0x7f505014d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.391+0000 7f5054c53640 1 -- 172.21.15.55:0/2396493498 >> 172.21.15.55:0/2396493498 conn(0x7f505006aba0 msgr2=0x7f505015a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.391+0000 7f5054c53640 1 -- 172.21.15.55:0/2396493498 shutdown_connections 2024-04-25T09:02:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.392+0000 7f5054c53640 1 -- 172.21.15.55:0/2396493498 wait complete. 2024-04-25T09:02:41.383 INFO:tasks.ceph.mds.c.smithi055.stderr: -7053> 2024-04-25T09:01:54.657+0000 7f9d9e108640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:02:41.392 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-04-25T09:02:41.415 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T09:02:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.447+0000 7f0fe6b29280 1 -- start start 2024-04-25T09:02:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.447+0000 7f0fe6b29280 1 Processor -- start 2024-04-25T09:02:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe6b29280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe3ee000 0x55dbbd68d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe6b29280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe3ef000 0x55dbbd68cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe6b29280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe3ef400 0x55dbbd68d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe6b29280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbe4dc000 con 0x55dbbe3ef400 2024-04-25T09:02:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe6b29280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbe4dc180 con 0x55dbbe3ef000 2024-04-25T09:02:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe6b29280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbbe4dc300 con 0x55dbbe3ee000 2024-04-25T09:02:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe5ad8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe3ef400 0x55dbbd68d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe5ad8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe3ef400 0x55dbbd68d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36762/0 (socket says 172.21.15.55:36762) 2024-04-25T09:02:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe5ad8640 1 -- 172.21.15.55:0/1591475555 learned_addr learned my addr 172.21.15.55:0/1591475555 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe4ad6640 1 --2- 172.21.15.55:0/1591475555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe3ef000 0x55dbbd68cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe52d7640 1 --2- 172.21.15.55:0/1591475555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe3ee000 0x55dbbd68d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe5ad8640 1 -- 172.21.15.55:0/1591475555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe3ee000 msgr2=0x55dbbd68d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe5ad8640 1 --2- 172.21.15.55:0/1591475555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe3ee000 0x55dbbd68d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe5ad8640 1 -- 172.21.15.55:0/1591475555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe3ef000 msgr2=0x55dbbd68cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe5ad8640 1 --2- 172.21.15.55:0/1591475555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe3ef000 0x55dbbd68cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.448+0000 7f0fe5ad8640 1 -- 172.21.15.55:0/1591475555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbbd652780 con 0x55dbbe3ef400 2024-04-25T09:02:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe5ad8640 1 --2- 172.21.15.55:0/1591475555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe3ef400 0x55dbbd68d600 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x55dbbe443170 tx=0x55dbbe3a1b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195cae8ec21dfe01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe2ad2640 1 -- 172.21.15.55:0/1591475555 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbd642d00 con 0x55dbbe3ef400 2024-04-25T09:02:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe2ad2640 1 -- 172.21.15.55:0/1591475555 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dbbd648c40 con 0x55dbbe3ef400 2024-04-25T09:02:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe2ad2640 1 -- 172.21.15.55:0/1591475555 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbd642680 con 0x55dbbe3ef400 2024-04-25T09:02:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1591475555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbbd652000 con 0x55dbbe3ef400 2024-04-25T09:02:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1591475555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55dbbd653680 con 0x55dbbe3ef400 2024-04-25T09:02:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe6b29280 4 waiting for MDS map... 2024-04-25T09:02:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe2ad2640 1 -- 172.21.15.55:0/1591475555 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x55dbbe4f4a00 con 0x55dbbe3ef400 2024-04-25T09:02:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe2ad2640 1 -- 172.21.15.55:0/1591475555 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 73) v1 ==== 2723+0+0 (secure 0 0 0) 0x55dbbd677180 con 0x55dbbe3ef400 2024-04-25T09:02:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe6b29280 4 Got MDS map 73 2024-04-25T09:02:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe6b29280 10 main: JournalTool::main 2024-04-25T09:02:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.449+0000 7f0fe6b29280 4 main: JournalTool: connecting to RADOS... 2024-04-25T09:02:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.450+0000 7f0fe6b29280 1 Processor -- start 2024-04-25T09:02:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.450+0000 7f0fe6b29280 1 -- start start 2024-04-25T09:02:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.450+0000 7f0fe6b29280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe3efc00 0x55dbbd68c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.450+0000 7f0fe6b29280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe4f2c00 0x55dbbd68e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.450+0000 7f0fe6b29280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3000 0x55dbbd68e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.450+0000 7f0fe6b29280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbe4dc480 con 0x55dbbe4f3000 2024-04-25T09:02:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.450+0000 7f0fe6b29280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbe4dc600 con 0x55dbbe4f2c00 2024-04-25T09:02:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.450+0000 7f0fe6b29280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbbe4dc780 con 0x55dbbe3efc00 2024-04-25T09:02:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe4ad6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3000 0x55dbbd68e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe4ad6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3000 0x55dbbd68e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36778/0 (socket says 172.21.15.55:36778) 2024-04-25T09:02:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe4ad6640 1 -- 172.21.15.55:0/3824269597 learned_addr learned my addr 172.21.15.55:0/3824269597 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe52d7640 1 --2- 172.21.15.55:0/3824269597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe4f2c00 0x55dbbd68e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe4ad6640 1 --2- 172.21.15.55:0/3824269597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe3efc00 0x55dbbd68c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe4ad6640 1 -- 172.21.15.55:0/3824269597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe3efc00 msgr2=0x55dbbd68c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe4ad6640 1 --2- 172.21.15.55:0/3824269597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe3efc00 0x55dbbd68c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe4ad6640 1 -- 172.21.15.55:0/3824269597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe4f2c00 msgr2=0x55dbbd68e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe4ad6640 1 --2- 172.21.15.55:0/3824269597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe4f2c00 0x55dbbd68e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe4ad6640 1 -- 172.21.15.55:0/3824269597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbbd653860 con 0x55dbbe4f3000 2024-04-25T09:02:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe4ad6640 1 --2- 172.21.15.55:0/3824269597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3000 0x55dbbd68e680 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x55dbbe534720 tx=0x55dbbe504c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bd70a61b6a4684 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe0ace640 1 -- 172.21.15.55:0/3824269597 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbd642d00 con 0x55dbbe4f3000 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe0ace640 1 -- 172.21.15.55:0/3824269597 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dbbd648700 con 0x55dbbe4f3000 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe0ace640 1 -- 172.21.15.55:0/3824269597 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbd642680 con 0x55dbbe4f3000 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe6b29280 1 -- 172.21.15.55:0/3824269597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3000 msgr2=0x55dbbd68e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/3824269597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3000 0x55dbbd68e680 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x55dbbe534720 tx=0x55dbbe504c60 comp rx=0 tx=0).stop 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe6b29280 1 -- 172.21.15.55:0/3824269597 shutdown_connections 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/3824269597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3000 0x55dbbd68e680 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/3824269597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe4f2c00 0x55dbbd68e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/3824269597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe3efc00 0x55dbbd68c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.451+0000 7f0fe6b29280 1 -- 172.21.15.55:0/3824269597 >> 172.21.15.55:0/3824269597 conn(0x55dbbe3ef800 msgr2=0x55dbbd705000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.452+0000 7f0fe6b29280 1 -- 172.21.15.55:0/3824269597 shutdown_connections 2024-04-25T09:02:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.452+0000 7f0fe6b29280 1 -- 172.21.15.55:0/3824269597 wait complete. 2024-04-25T09:02:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.452+0000 7f0fe6b29280 1 Processor -- start 2024-04-25T09:02:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.452+0000 7f0fe6b29280 1 -- start start 2024-04-25T09:02:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe6b29280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe3ef800 0x55dbbd68f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe6b29280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3c00 0x55dbbd68f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe6b29280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe4f3800 0x55dbbd68ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe6b29280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbe4dde00 con 0x55dbbe4f3c00 2024-04-25T09:02:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe6b29280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbe4ddc80 con 0x55dbbe3ef800 2024-04-25T09:02:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe6b29280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbbe4ddb00 con 0x55dbbe4f3800 2024-04-25T09:02:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe52d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3c00 0x55dbbd68f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe52d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3c00 0x55dbbd68f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36784/0 (socket says 172.21.15.55:36784) 2024-04-25T09:02:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe52d7640 1 -- 172.21.15.55:0/1482185349 learned_addr learned my addr 172.21.15.55:0/1482185349 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe4ad6640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe3ef800 0x55dbbd68f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe4ad6640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe4f3800 0x55dbbd68ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe52d7640 1 -- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe4f3800 msgr2=0x55dbbd68ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe52d7640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe4f3800 0x55dbbd68ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe52d7640 1 -- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe3ef800 msgr2=0x55dbbd68f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe52d7640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe3ef800 0x55dbbd68f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe52d7640 1 -- 172.21.15.55:0/1482185349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbbd652780 con 0x55dbbe4f3c00 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe52d7640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3c00 0x55dbbd68f180 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x55dbbe5353e0 tx=0x55dbbe3af5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fdf2cb640 1 -- 172.21.15.55:0/1482185349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbd642d00 con 0x55dbbe4f3c00 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fdf2cb640 1 -- 172.21.15.55:0/1482185349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dbbd648e00 con 0x55dbbe4f3c00 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fdf2cb640 1 -- 172.21.15.55:0/1482185349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbd642680 con 0x55dbbe4f3c00 2024-04-25T09:02:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dbbd652000 con 0x55dbbe4f3c00 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbbd653a40 con 0x55dbbe4f3c00 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.453+0000 7f0fe6b29280 4 main: JournalTool: resolving pool 14 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.455+0000 7f0fdf2cb640 1 -- 172.21.15.55:0/1482185349 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x55dbbe54ec00 con 0x55dbbe4f3c00 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.455+0000 7f0fdf2cb640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55dbbe558c00 0x55dbbd994000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.455+0000 7f0fdf2cb640 1 -- 172.21.15.55:0/1482185349 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x55dbbe54ce00 con 0x55dbbe4f3c00 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.455+0000 7f0fe6b29280 4 main: JournalTool: creating IoCtx.. 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.455+0000 7f0fe4ad6640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55dbbe558c00 0x55dbbd994000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.455+0000 7f0fe6b29280 4 main: Executing for rank 0 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.455+0000 7f0fe6b29280 4 Filtering by inode '1099511627777' 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.455+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55dbbe4f3400 0x55dbbd68e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.455+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v9 -- 0x55dbbe4f3000 con 0x55dbbe4f3400 2024-04-25T09:02:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.455+0000 7f0fe4ad6640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55dbbe4f3400 0x55dbbd68e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.456+0000 7f0fe4ad6640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55dbbe558c00 0x55dbbd994000 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55dbbe534870 tx=0x55dbbe3ae000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.456+0000 7f0fe4ad6640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55dbbe4f3400 0x55dbbd68e680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.458+0000 7f0fe4ad6640 1 -- 172.21.15.55:0/1482185349 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55dbbd718000 con 0x55dbbe4f3400 2024-04-25T09:02:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.458+0000 7f0fe6b29280 4 Pointer 400.00000000 is readable 2024-04-25T09:02:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.458+0000 7f0fe6b29280 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T09:02:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.458+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55dbbe4f2c00 0x55dbbd68e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.458+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v9 -- 0x55dbbe559000 con 0x55dbbe4f2c00 2024-04-25T09:02:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.458+0000 7f0fe5ad8640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55dbbe4f2c00 0x55dbbd68e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.459+0000 7f0fe5ad8640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55dbbe4f2c00 0x55dbbd68e100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.459+0000 7f0fe5ad8640 1 -- 172.21.15.55:0/1482185349 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55dbbd718500 con 0x55dbbe4f2c00 2024-04-25T09:02:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.459+0000 7f0fe6b29280 10 Header 0x400000 0x407d21 0x40809d 2024-04-25T09:02:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.459+0000 7f0fe6b29280 10 Starting journal scan from offset 0x407d21 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.459+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v9 -- 0x55dbbe559400 con 0x55dbbe4f2c00 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.460+0000 7f0fe5ad8640 1 -- 172.21.15.55:0/1482185349 <== osd.4 v2:172.21.15.167:6808/1392386852 2 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x55dbbd718500 con 0x55dbbe4f2c00 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.460+0000 7f0fe6b29280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.460+0000 7f0fe6b29280 10 Parsing data, 0x37c bytes available 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.460+0000 7f0fe6b29280 10 Attempting decode at 0x407d21 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.460+0000 7f0fe6b29280 10 Consumed 0x37c bytes 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.460+0000 7f0fe6b29280 10 Valid entry at 0x407d21 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.460+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55dbbe559800 0x55dbbd68c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.460+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v9 -- 0x55dbbe559c00 con 0x55dbbe559800 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.460+0000 7f0fe52d7640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55dbbe559800 0x55dbbd68c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.460+0000 7f0fe52d7640 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55dbbe559800 0x55dbbd68c580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe52d7640 1 -- 172.21.15.55:0/1482185349 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55dbbd718780 con 0x55dbbe559800 2024-04-25T09:02:41.458 INFO:teuthology.orchestra.run.smithi055.stdout:Events by type: 2024-04-25T09:02:41.458 INFO:teuthology.orchestra.run.smithi055.stdout:Errors: 0 2024-04-25T09:02:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 4 Reached end of journal objects 2024-04-25T09:02:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 4 Scanned objects, 0 missing, 1 valid 2024-04-25T09:02:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 4 Events scanned, 0 gaps 2024-04-25T09:02:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 4 Found 1 valid events 2024-04-25T09:02:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 4 Selected 0 events events for processing 2024-04-25T09:02:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 4 0 events 2024-04-25T09:02:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55dbbe559800 msgr2=0x55dbbd68c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55dbbe559800 0x55dbbd68c580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55dbbe4f2c00 msgr2=0x55dbbd68e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55dbbe4f2c00 0x55dbbd68e100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55dbbe4f3400 msgr2=0x55dbbd68e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55dbbe4f3400 0x55dbbd68e680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe52d7640 1 -- 172.21.15.55:0/1482185349 reap_dead start 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55dbbe558c00 msgr2=0x55dbbd994000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55dbbe558c00 0x55dbbd994000 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55dbbe534870 tx=0x55dbbe3ae000 comp rx=0 tx=0).stop 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3c00 msgr2=0x55dbbd68f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3c00 0x55dbbd68f180 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x55dbbe5353e0 tx=0x55dbbe3af5c0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 shutdown_connections 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55dbbe558c00 0x55dbbd994000 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1482185349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe4f3c00 0x55dbbd68f180 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 >> 172.21.15.55:0/1482185349 conn(0x55dbbe3efc00 msgr2=0x55dbbd705000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 shutdown_connections 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1482185349 wait complete. 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1591475555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe3ef400 msgr2=0x55dbbd68d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1591475555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe3ef400 0x55dbbd68d600 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x55dbbe443170 tx=0x55dbbe3a1b60 comp rx=0 tx=0).stop 2024-04-25T09:02:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1591475555 shutdown_connections 2024-04-25T09:02:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1591475555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbe3ef400 0x55dbbd68d600 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1591475555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbe3ef000 0x55dbbd68cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 --2- 172.21.15.55:0/1591475555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbe3ee000 0x55dbbd68d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.461+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1591475555 >> 172.21.15.55:0/1591475555 conn(0x55dbbd61d000 msgr2=0x55dbbd704000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.462+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1591475555 shutdown_connections 2024-04-25T09:02:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.462+0000 7f0fe6b29280 1 -- 172.21.15.55:0/1591475555 wait complete. 2024-04-25T09:02:41.466 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.073722, result: Events by type: Errors: 0 2024-04-25T09:02:41.466 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-04-25T09:02:41.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.555+0000 7fba97b30280 1 -- start start 2024-04-25T09:02:41.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.555+0000 7fba97b30280 1 Processor -- start 2024-04-25T09:02:41.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba97b30280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a5ca4c00 0x5596a5d14580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba97b30280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a5ca5800 0x5596a5d14b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba97b30280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a5ca5c00 0x5596a5d15080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba97b30280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a6a70180 con 0x5596a5ca4c00 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba97b30280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a6a70300 con 0x5596a5ca5c00 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba97b30280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596a6a70480 con 0x5596a5ca5800 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba962de640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a5ca4c00 0x5596a5d14580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba962de640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a5ca4c00 0x5596a5d14580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36786/0 (socket says 172.21.15.55:36786) 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba962de640 1 -- 172.21.15.55:0/3861765774 learned_addr learned my addr 172.21.15.55:0/3861765774 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba95add640 1 --2- 172.21.15.55:0/3861765774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a5ca5800 0x5596a5d14b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba96adf640 1 --2- 172.21.15.55:0/3861765774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a5ca5c00 0x5596a5d15080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba962de640 1 -- 172.21.15.55:0/3861765774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a5ca5800 msgr2=0x5596a5d14b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba962de640 1 --2- 172.21.15.55:0/3861765774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a5ca5800 0x5596a5d14b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba962de640 1 -- 172.21.15.55:0/3861765774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a5ca5c00 msgr2=0x5596a5d15080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba962de640 1 --2- 172.21.15.55:0/3861765774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a5ca5c00 0x5596a5d15080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba962de640 1 -- 172.21.15.55:0/3861765774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596a5cda780 con 0x5596a5ca4c00 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba962de640 1 --2- 172.21.15.55:0/3861765774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a5ca4c00 0x5596a5d14580 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x5596a6abd2f0 tx=0x5596a6b62120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fce49a061796e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba93ad9640 1 -- 172.21.15.55:0/3861765774 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596a5cca9c0 con 0x5596a5ca4c00 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba97b30280 1 -- 172.21.15.55:0/3861765774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596a5cda3c0 con 0x5596a5ca4c00 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba93ad9640 1 -- 172.21.15.55:0/3861765774 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596a5cd0fc0 con 0x5596a5ca4c00 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba93ad9640 1 -- 172.21.15.55:0/3861765774 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596a5cca680 con 0x5596a5ca4c00 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba97b30280 1 -- 172.21.15.55:0/3861765774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5596a5cdb680 con 0x5596a5ca4c00 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.556+0000 7fba97b30280 4 waiting for MDS map... 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.557+0000 7fba93ad9640 1 -- 172.21.15.55:0/3861765774 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x5596a6b78200 con 0x5596a5ca4c00 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.557+0000 7fba93ad9640 1 -- 172.21.15.55:0/3861765774 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 73) v1 ==== 2723+0+0 (secure 0 0 0) 0x5596a5cff180 con 0x5596a5ca4c00 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.557+0000 7fba97b30280 4 Got MDS map 73 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.557+0000 7fba97b30280 10 main: JournalTool::main 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.557+0000 7fba97b30280 4 main: JournalTool: connecting to RADOS... 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.557+0000 7fba97b30280 1 Processor -- start 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.557+0000 7fba97b30280 1 -- start start 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba97b30280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83c00 0x5596a5d15600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba97b30280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a6bbc000 0x5596a5d15b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba97b30280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a6bbc400 0x5596a5d16100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba97b30280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a6a70600 con 0x5596a6a83c00 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba97b30280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a6a70780 con 0x5596a6bbc400 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba97b30280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596a6a70900 con 0x5596a6bbc000 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba96adf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83c00 0x5596a5d15600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba96adf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83c00 0x5596a5d15600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36802/0 (socket says 172.21.15.55:36802) 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba96adf640 1 -- 172.21.15.55:0/1322387404 learned_addr learned my addr 172.21.15.55:0/1322387404 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba95add640 1 --2- 172.21.15.55:0/1322387404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a6bbc400 0x5596a5d16100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba962de640 1 --2- 172.21.15.55:0/1322387404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a6bbc000 0x5596a5d15b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba96adf640 1 -- 172.21.15.55:0/1322387404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a6bbc000 msgr2=0x5596a5d15b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba96adf640 1 --2- 172.21.15.55:0/1322387404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a6bbc000 0x5596a5d15b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba96adf640 1 -- 172.21.15.55:0/1322387404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a6bbc400 msgr2=0x5596a5d16100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba96adf640 1 --2- 172.21.15.55:0/1322387404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a6bbc400 0x5596a5d16100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.558+0000 7fba96adf640 1 -- 172.21.15.55:0/1322387404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596a5cdb4a0 con 0x5596a6a83c00 2024-04-25T09:02:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba96adf640 1 --2- 172.21.15.55:0/1322387404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83c00 0x5596a5d15600 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x5596a6a98900 tx=0x5596a6bd8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1cad92cd1fd7c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba91ad5640 1 -- 172.21.15.55:0/1322387404 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596a5cca9c0 con 0x5596a6a83c00 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba91ad5640 1 -- 172.21.15.55:0/1322387404 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596a5cd0a80 con 0x5596a6a83c00 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba91ad5640 1 -- 172.21.15.55:0/1322387404 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596a5cca680 con 0x5596a6a83c00 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba97b30280 1 -- 172.21.15.55:0/1322387404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83c00 msgr2=0x5596a5d15600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba97b30280 1 --2- 172.21.15.55:0/1322387404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83c00 0x5596a5d15600 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x5596a6a98900 tx=0x5596a6bd8000 comp rx=0 tx=0).stop 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba97b30280 1 -- 172.21.15.55:0/1322387404 shutdown_connections 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba97b30280 1 --2- 172.21.15.55:0/1322387404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a6bbc400 0x5596a5d16100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba97b30280 1 --2- 172.21.15.55:0/1322387404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a6bbc000 0x5596a5d15b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba97b30280 1 --2- 172.21.15.55:0/1322387404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83c00 0x5596a5d15600 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba97b30280 1 -- 172.21.15.55:0/1322387404 >> 172.21.15.55:0/1322387404 conn(0x5596a6a83800 msgr2=0x5596a5d8d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba97b30280 1 -- 172.21.15.55:0/1322387404 shutdown_connections 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.559+0000 7fba97b30280 1 -- 172.21.15.55:0/1322387404 wait complete. 2024-04-25T09:02:41.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.560+0000 7fba97b30280 1 Processor -- start 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.560+0000 7fba97b30280 1 -- start start 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.560+0000 7fba97b30280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83800 0x5596a5d17180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.560+0000 7fba97b30280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a6bbd000 0x5596a5d16c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.560+0000 7fba97b30280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a6bbcc00 0x5596a5d16680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.560+0000 7fba97b30280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a6a71c80 con 0x5596a6a83800 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.560+0000 7fba97b30280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a6a71b00 con 0x5596a6bbd000 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.560+0000 7fba97b30280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596a6a71980 con 0x5596a6bbcc00 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.560+0000 7fba96adf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83800 0x5596a5d17180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.560+0000 7fba96adf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83800 0x5596a5d17180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36814/0 (socket says 172.21.15.55:36814) 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.560+0000 7fba96adf640 1 -- 172.21.15.55:0/2430938051 learned_addr learned my addr 172.21.15.55:0/2430938051 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba962de640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a6bbd000 0x5596a5d16c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba95add640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a6bbcc00 0x5596a5d16680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba96adf640 1 -- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a6bbcc00 msgr2=0x5596a5d16680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba96adf640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a6bbcc00 0x5596a5d16680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba96adf640 1 -- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a6bbd000 msgr2=0x5596a5d16c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba96adf640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a6bbd000 0x5596a5d16c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba96adf640 1 -- 172.21.15.55:0/2430938051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596a5cda000 con 0x5596a6a83800 2024-04-25T09:02:41.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba96adf640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83800 0x5596a5d17180 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x5596a6a995c0 tx=0x5596a6b623c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba902d2640 1 -- 172.21.15.55:0/2430938051 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596a5cca4e0 con 0x5596a6a83800 2024-04-25T09:02:41.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba902d2640 1 -- 172.21.15.55:0/2430938051 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596a5cd0c40 con 0x5596a6a83800 2024-04-25T09:02:41.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5596a5cda960 con 0x5596a6a83800 2024-04-25T09:02:41.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba902d2640 1 -- 172.21.15.55:0/2430938051 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596a5cca9c0 con 0x5596a6a83800 2024-04-25T09:02:41.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596a5cdb860 con 0x5596a6a83800 2024-04-25T09:02:41.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.561+0000 7fba97b30280 4 main: JournalTool: resolving pool 14 2024-04-25T09:02:41.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.562+0000 7fba902d2640 1 -- 172.21.15.55:0/2430938051 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x5596a6bdac00 con 0x5596a6a83800 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.563+0000 7fba902d2640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5596a6010000 0x5596a5d17700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.563+0000 7fba902d2640 1 -- 172.21.15.55:0/2430938051 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x5596a6bc3400 con 0x5596a6a83800 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.563+0000 7fba962de640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5596a6010000 0x5596a5d17700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.563+0000 7fba97b30280 4 main: JournalTool: creating IoCtx.. 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.563+0000 7fba97b30280 4 main: Executing for rank 0 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.563+0000 7fba97b30280 4 Filtering by inode '1099511627778' 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.563+0000 7fba97b30280 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5596a6bbc800 0x5596a5d16100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.563+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v9 -- 0x5596a6bbc400 con 0x5596a6bbc800 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.563+0000 7fba95add640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5596a6bbc800 0x5596a5d16100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.563+0000 7fba962de640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5596a6010000 0x5596a5d17700 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x5596a6abdaa0 tx=0x5596a6b621e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.563+0000 7fba95add640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5596a6bbc800 0x5596a5d16100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.564+0000 7fba95add640 1 -- 172.21.15.55:0/2430938051 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5596a5da0000 con 0x5596a6bbc800 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.564+0000 7fba97b30280 4 Pointer 400.00000000 is readable 2024-04-25T09:02:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.564+0000 7fba97b30280 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.564+0000 7fba97b30280 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5596a6bbc000 0x5596a5d15b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.564+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v9 -- 0x5596a6011400 con 0x5596a6bbc000 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.564+0000 7fba96adf640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5596a6bbc000 0x5596a5d15b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.564+0000 7fba96adf640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5596a6bbc000 0x5596a5d15b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba96adf640 1 -- 172.21.15.55:0/2430938051 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5596a5da0500 con 0x5596a6bbc000 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba97b30280 10 Header 0x400000 0x407d21 0x40809d 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba97b30280 10 Starting journal scan from offset 0x407d21 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v9 -- 0x5596a6011800 con 0x5596a6bbc000 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba96adf640 1 -- 172.21.15.55:0/2430938051 <== osd.4 v2:172.21.15.167:6808/1392386852 2 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x5596a5da0500 con 0x5596a6bbc000 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba97b30280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba97b30280 10 Parsing data, 0x37c bytes available 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba97b30280 10 Attempting decode at 0x407d21 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba97b30280 10 Consumed 0x37c bytes 2024-04-25T09:02:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba97b30280 10 Valid entry at 0x407d21 2024-04-25T09:02:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba97b30280 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5596a6011c00 0x5596a5d15600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v9 -- 0x5596a6026000 con 0x5596a6011c00 2024-04-25T09:02:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.565+0000 7fba962de640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5596a6011c00 0x5596a5d15600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba962de640 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5596a6011c00 0x5596a5d15600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba962de640 1 -- 172.21.15.55:0/2430938051 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5596a5da0780 con 0x5596a6011c00 2024-04-25T09:02:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 4 Reached end of journal objects 2024-04-25T09:02:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 4 Scanned objects, 0 missing, 1 valid 2024-04-25T09:02:41.562 INFO:teuthology.orchestra.run.smithi055.stdout:Events by type: 2024-04-25T09:02:41.562 INFO:teuthology.orchestra.run.smithi055.stdout:Errors: 0 2024-04-25T09:02:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 4 Events scanned, 0 gaps 2024-04-25T09:02:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 4 Found 1 valid events 2024-04-25T09:02:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 4 Selected 0 events events for processing 2024-04-25T09:02:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 4 0 events 2024-04-25T09:02:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5596a6011c00 msgr2=0x5596a5d15600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5596a6011c00 0x5596a5d15600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5596a6bbc000 msgr2=0x5596a5d15b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x5596a6bbc000 0x5596a5d15b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5596a6bbc800 msgr2=0x5596a5d16100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5596a6bbc800 0x5596a5d16100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba95add640 1 -- 172.21.15.55:0/2430938051 reap_dead start 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5596a6010000 msgr2=0x5596a5d17700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5596a6010000 0x5596a5d17700 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x5596a6abdaa0 tx=0x5596a6b621e0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83800 msgr2=0x5596a5d17180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83800 0x5596a5d17180 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x5596a6a995c0 tx=0x5596a6b623c0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 shutdown_connections 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5596a6010000 0x5596a5d17700 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 --2- 172.21.15.55:0/2430938051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a6a83800 0x5596a5d17180 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 >> 172.21.15.55:0/2430938051 conn(0x5596a6a83c00 msgr2=0x5596a5d8d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 shutdown_connections 2024-04-25T09:02:41.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 -- 172.21.15.55:0/2430938051 wait complete. 2024-04-25T09:02:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 -- 172.21.15.55:0/3861765774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a5ca4c00 msgr2=0x5596a5d14580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.566+0000 7fba97b30280 1 --2- 172.21.15.55:0/3861765774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a5ca4c00 0x5596a5d14580 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x5596a6abd2f0 tx=0x5596a6b62120 comp rx=0 tx=0).stop 2024-04-25T09:02:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.567+0000 7fba97b30280 1 -- 172.21.15.55:0/3861765774 shutdown_connections 2024-04-25T09:02:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.567+0000 7fba97b30280 1 --2- 172.21.15.55:0/3861765774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596a5ca5c00 0x5596a5d15080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.567+0000 7fba97b30280 1 --2- 172.21.15.55:0/3861765774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596a5ca5800 0x5596a5d14b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.567+0000 7fba97b30280 1 --2- 172.21.15.55:0/3861765774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5596a5ca4c00 0x5596a5d14580 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.567+0000 7fba97b30280 1 -- 172.21.15.55:0/3861765774 >> 172.21.15.55:0/3861765774 conn(0x5596a5ca5000 msgr2=0x5596a5d8c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.567+0000 7fba97b30280 1 -- 172.21.15.55:0/3861765774 shutdown_connections 2024-04-25T09:02:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.567+0000 7fba97b30280 1 -- 172.21.15.55:0/3861765774 wait complete. 2024-04-25T09:02:41.567 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.101108, result: Events by type: Errors: 0 2024-04-25T09:02:41.567 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-04-25T09:02:41.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.660+0000 7f16c7cf4f40 1 Processor -- start 2024-04-25T09:02:41.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.660+0000 7f16c7cf4f40 1 -- start start 2024-04-25T09:02:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c7cf4f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557dee0652a0 0x557dee0d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c7cf4f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557dee067860 0x557dee0d6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c7cf4f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 0x557dee0d7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c7cf4f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dee067ea0 con 0x557dee0d8270 2024-04-25T09:02:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c7cf4f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dedfc4df0 con 0x557dee0652a0 2024-04-25T09:02:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c7cf4f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557dee068140 con 0x557dee067860 2024-04-25T09:02:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c5ff6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 0x557dee0d7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c5ff6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 0x557dee0d7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36826/0 (socket says 172.21.15.55:36826) 2024-04-25T09:02:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c5ff6640 1 -- 172.21.15.55:0/3169043413 learned_addr learned my addr 172.21.15.55:0/3169043413 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c57f5640 1 --2- 172.21.15.55:0/3169043413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557dee0652a0 0x557dee0d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c4ff4640 1 --2- 172.21.15.55:0/3169043413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557dee067860 0x557dee0d6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c5ff6640 1 -- 172.21.15.55:0/3169043413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557dee067860 msgr2=0x557dee0d6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c5ff6640 1 --2- 172.21.15.55:0/3169043413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557dee067860 0x557dee0d6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c5ff6640 1 -- 172.21.15.55:0/3169043413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557dee0652a0 msgr2=0x557dee0d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c5ff6640 1 --2- 172.21.15.55:0/3169043413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557dee0652a0 0x557dee0d5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c5ff6640 1 -- 172.21.15.55:0/3169043413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dedf4ac50 con 0x557dee0d8270 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c57f5640 1 --2- 172.21.15.55:0/3169043413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557dee0652a0 0x557dee0d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16c5ff6640 1 --2- 172.21.15.55:0/3169043413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 0x557dee0d7130 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f16c000c480 tx=0x7f16c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e153e67713ea72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16bf7fe640 1 -- 172.21.15.55:0/3169043413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c00115f0 con 0x557dee0d8270 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16bf7fe640 1 -- 172.21.15.55:0/3169043413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c0011790 con 0x557dee0d8270 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.661+0000 7f16bf7fe640 1 -- 172.21.15.55:0/3169043413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0011b80 con 0x557dee0d8270 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.662+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/3169043413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 msgr2=0x557dee0d7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.662+0000 7f16c7cf4f40 1 --2- 172.21.15.55:0/3169043413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 0x557dee0d7130 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f16c000c480 tx=0x7f16c000c940 comp rx=0 tx=0).stop 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.662+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/3169043413 shutdown_connections 2024-04-25T09:02:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.662+0000 7f16c7cf4f40 1 --2- 172.21.15.55:0/3169043413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 0x557dee0d7130 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.662+0000 7f16c7cf4f40 1 --2- 172.21.15.55:0/3169043413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557dee067860 0x557dee0d6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.662+0000 7f16c7cf4f40 1 --2- 172.21.15.55:0/3169043413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557dee0652a0 0x557dee0d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.662+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/3169043413 >> 172.21.15.55:0/3169043413 conn(0x557dee0483d0 msgr2=0x557dee0d9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.662+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/3169043413 shutdown_connections 2024-04-25T09:02:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.662+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/3169043413 wait complete. 2024-04-25T09:02:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.662+0000 7f16c7cf4f40 1 Processor -- start 2024-04-25T09:02:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.662+0000 7f16c7cf4f40 1 -- start start 2024-04-25T09:02:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c7cf4f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557dee0652a0 0x557dee0f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c7cf4f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557dee067860 0x557dee04cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c7cf4f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 0x557dee18f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c7cf4f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dee04d8c0 con 0x557dee0d8270 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c7cf4f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dee04d6f0 con 0x557dee0652a0 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c7cf4f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557dee04db60 con 0x557dee067860 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c5ff6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 0x557dee18f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c5ff6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 0x557dee18f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36840/0 (socket says 172.21.15.55:36840) 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c5ff6640 1 -- 172.21.15.55:0/1853486242 learned_addr learned my addr 172.21.15.55:0/1853486242 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c57f5640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557dee0652a0 0x557dee0f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c4ff4640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557dee067860 0x557dee04cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c5ff6640 1 -- 172.21.15.55:0/1853486242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557dee067860 msgr2=0x557dee04cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.663+0000 7f16c5ff6640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557dee067860 0x557dee04cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.664+0000 7f16c5ff6640 1 -- 172.21.15.55:0/1853486242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557dee0652a0 msgr2=0x557dee0f0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.664+0000 7f16c5ff6640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557dee0652a0 0x557dee0f0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.664+0000 7f16c5ff6640 1 -- 172.21.15.55:0/1853486242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dee0d4db0 con 0x557dee0d8270 2024-04-25T09:02:41.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.664+0000 7f16c57f5640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557dee0652a0 0x557dee0f0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:41.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.664+0000 7f16c4ff4640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557dee067860 0x557dee04cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:41.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.664+0000 7f16c5ff6640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 0x557dee18f200 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f16c000c210 tx=0x7f16c00033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.664+0000 7f16be7fc640 1 -- 172.21.15.55:0/1853486242 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0020070 con 0x557dee0d8270 2024-04-25T09:02:41.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.664+0000 7f16be7fc640 1 -- 172.21.15.55:0/1853486242 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c0013d50 con 0x557dee0d8270 2024-04-25T09:02:41.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.664+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/1853486242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557dee18fe60 con 0x557dee0d8270 2024-04-25T09:02:41.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.664+0000 7f16be7fc640 1 -- 172.21.15.55:0/1853486242 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c00115f0 con 0x557dee0d8270 2024-04-25T09:02:41.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.664+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/1853486242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557dee183ba0 con 0x557dee0d8270 2024-04-25T09:02:41.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.665+0000 7f16be7fc640 1 -- 172.21.15.55:0/1853486242 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f16c001c410 con 0x557dee0d8270 2024-04-25T09:02:41.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.666+0000 7f16be7fc640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f16a8069eb0 0x7f16a806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.666+0000 7f16be7fc640 1 -- 172.21.15.55:0/1853486242 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f16c008b2f0 con 0x557dee0d8270 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.666+0000 7f16c57f5640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f16a8069eb0 0x7f16a806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.666+0000 7f16c7cf4f40 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x557dee0d52a0 0x557dee1862e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.666+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/1853486242 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103) v9 -- 0x557dee0f1530 con 0x557dee0d52a0 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.666+0000 7f16c4ff4640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x557dee0d52a0 0x557dee1862e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.666+0000 7f16c57f5640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f16a8069eb0 0x7f16a806c370 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f16b8057000 tx=0x7f16b8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.666+0000 7f16c4ff4640 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x557dee0d52a0 0x557dee1862e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c4ff4640 1 -- 172.21.15.55:0/1853486242 <== osd.2 v2:172.21.15.55:6824/2942240833 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v103'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f16b000e420 con 0x557dee0d52a0 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x557dee0d52a0 msgr2=0x557dee1862e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c7cf4f40 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x557dee0d52a0 0x557dee1862e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f16a8069eb0 msgr2=0x7f16a806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c7cf4f40 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f16a8069eb0 0x7f16a806c370 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f16b8057000 tx=0x7f16b8052000 comp rx=0 tx=0).stop 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 msgr2=0x557dee18f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c7cf4f40 1 --2- 172.21.15.55:0/1853486242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557dee0d8270 0x557dee18f200 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f16c000c210 tx=0x7f16c00033a0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c5ff6640 1 -- 172.21.15.55:0/1853486242 reap_dead start 2024-04-25T09:02:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/1853486242 shutdown_connections 2024-04-25T09:02:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/1853486242 >> 172.21.15.55:0/1853486242 conn(0x557dee0483d0 msgr2=0x557dee0d9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/1853486242 shutdown_connections 2024-04-25T09:02:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.670+0000 7f16c7cf4f40 1 -- 172.21.15.55:0/1853486242 wait complete. 2024-04-25T09:02:41.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:02:41.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.817+0000 7fb91726b640 1 Processor -- start 2024-04-25T09:02:41.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.818+0000 7fb91726b640 1 -- start start 2024-04-25T09:02:41.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.818+0000 7fb91726b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb91015dca0 0x7fb9100ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.818+0000 7fb91726b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9100d1130 0x7fb9100b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.818+0000 7fb91726b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9100d4090 con 0x7fb9100d3b90 2024-04-25T09:02:41.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.819+0000 7fb91726b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9100b6b20 con 0x7fb9100d1130 2024-04-25T09:02:41.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.819+0000 7fb91726b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9100d4370 con 0x7fb91015dca0 2024-04-25T09:02:41.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.819+0000 7fb915808640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9100d1130 0x7fb9100b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.819+0000 7fb915808640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9100d1130 0x7fb9100b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36856/0 (socket says 172.21.15.55:36856) 2024-04-25T09:02:41.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.819+0000 7fb915808640 1 -- 172.21.15.55:0/14186384 learned_addr learned my addr 172.21.15.55:0/14186384 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:41.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.819+0000 7fb915007640 1 --2- 172.21.15.55:0/14186384 >> v2:172.21.15.167:3300/0 conn(0x7fb91015dca0 0x7fb9100ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.819+0000 7fb915808640 1 -- 172.21.15.55:0/14186384 >> v2:172.21.15.167:3300/0 conn(0x7fb91015dca0 msgr2=0x7fb9100ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:41.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.819+0000 7fb915808640 1 --2- 172.21.15.55:0/14186384 >> v2:172.21.15.167:3300/0 conn(0x7fb91015dca0 0x7fb9100ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.819+0000 7fb915808640 1 -- 172.21.15.55:0/14186384 >> v1:172.21.15.167:6789/0 conn(0x7fb9100d3b90 legacy=0x7fb9100d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.819+0000 7fb915808640 1 -- 172.21.15.55:0/14186384 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9100d4650 con 0x7fb9100d1130 2024-04-25T09:02:41.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.819+0000 7fb915007640 1 --2- 172.21.15.55:0/14186384 >> v2:172.21.15.167:3300/0 conn(0x7fb91015dca0 0x7fb9100ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:41.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.820+0000 7fb915808640 1 --2- 172.21.15.55:0/14186384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9100d1130 0x7fb9100b2500 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fb9100b6340 tx=0x7fb90802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59e35c355421108 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.820+0000 7fb907fff640 1 -- 172.21.15.55:0/14186384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908036070 con 0x7fb9100d1130 2024-04-25T09:02:41.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.820+0000 7fb907fff640 1 -- 172.21.15.55:0/14186384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb908031600 con 0x7fb9100d1130 2024-04-25T09:02:41.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.820+0000 7fb907fff640 1 -- 172.21.15.55:0/14186384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9080319d0 con 0x7fb9100d1130 2024-04-25T09:02:41.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.820+0000 7fb91726b640 1 -- 172.21.15.55:0/14186384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9100d1130 msgr2=0x7fb9100b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.820+0000 7fb91726b640 1 --2- 172.21.15.55:0/14186384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9100d1130 0x7fb9100b2500 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fb9100b6340 tx=0x7fb90802a730 comp rx=0 tx=0).stop 2024-04-25T09:02:41.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.820+0000 7fb91726b640 1 -- 172.21.15.55:0/14186384 shutdown_connections 2024-04-25T09:02:41.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.820+0000 7fb91726b640 1 --2- 172.21.15.55:0/14186384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9100d1130 0x7fb9100b2500 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.820+0000 7fb91726b640 1 --2- 172.21.15.55:0/14186384 >> v2:172.21.15.167:3300/0 conn(0x7fb91015dca0 0x7fb9100ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.820+0000 7fb91726b640 1 -- 172.21.15.55:0/14186384 >> 172.21.15.55:0/14186384 conn(0x7fb9100726c0 msgr2=0x7fb910072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.821+0000 7fb91726b640 1 -- 172.21.15.55:0/14186384 shutdown_connections 2024-04-25T09:02:41.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.821+0000 7fb91726b640 1 -- 172.21.15.55:0/14186384 wait complete. 2024-04-25T09:02:41.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.822+0000 7fb91726b640 1 Processor -- start 2024-04-25T09:02:41.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.822+0000 7fb91726b640 1 -- start start 2024-04-25T09:02:41.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.822+0000 7fb91726b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9100d1130 0x7fb91014beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.822+0000 7fb91726b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9100d3b90 0x7fb910160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.822+0000 7fb91726b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb91015dca0 0x7fb9100c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.822+0000 7fb91726b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91015e200 con 0x7fb9100d1130 2024-04-25T09:02:41.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.822+0000 7fb91726b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91015e080 con 0x7fb9100d3b90 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.822+0000 7fb91726b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9100cee80 con 0x7fb91015dca0 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb915007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9100d1130 0x7fb91014beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb915007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9100d1130 0x7fb91014beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36860/0 (socket says 172.21.15.55:36860) 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb915007640 1 -- 172.21.15.55:0/3071402585 learned_addr learned my addr 172.21.15.55:0/3071402585 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb915808640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb91015dca0 0x7fb9100c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb914806640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9100d3b90 0x7fb910160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb915007640 1 -- 172.21.15.55:0/3071402585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb91015dca0 msgr2=0x7fb9100c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb915007640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb91015dca0 0x7fb9100c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb915007640 1 -- 172.21.15.55:0/3071402585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9100d3b90 msgr2=0x7fb910160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb915007640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9100d3b90 0x7fb910160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb915007640 1 -- 172.21.15.55:0/3071402585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91015f130 con 0x7fb9100d1130 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb914806640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9100d3b90 0x7fb910160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb915007640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9100d1130 0x7fb91014beb0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d7d0 tx=0x7fb90c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb905ffb640 1 -- 172.21.15.55:0/3071402585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c004030 con 0x7fb9100d1130 2024-04-25T09:02:41.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb905ffb640 1 -- 172.21.15.55:0/3071402585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c0041d0 con 0x7fb9100d1130 2024-04-25T09:02:41.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb91726b640 1 -- 172.21.15.55:0/3071402585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91015f410 con 0x7fb9100d1130 2024-04-25T09:02:41.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.823+0000 7fb905ffb640 1 -- 172.21.15.55:0/3071402585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c0096a0 con 0x7fb9100d1130 2024-04-25T09:02:41.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.824+0000 7fb91726b640 1 -- 172.21.15.55:0/3071402585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91015f9d0 con 0x7fb9100d1130 2024-04-25T09:02:41.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.824+0000 7fb91726b640 1 -- 172.21.15.55:0/3071402585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9100750b0 con 0x7fb9100d1130 2024-04-25T09:02:41.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.825+0000 7fb905ffb640 1 -- 172.21.15.55:0/3071402585 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb90c009840 con 0x7fb9100d1130 2024-04-25T09:02:41.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.825+0000 7fb905ffb640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8f406b4d0 0x7fb8f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.825+0000 7fb905ffb640 1 -- 172.21.15.55:0/3071402585 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb90c08a4b0 con 0x7fb9100d1130 2024-04-25T09:02:41.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.825+0000 7fb914806640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8f406b4d0 0x7fb8f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.826+0000 7fb914806640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8f406b4d0 0x7fb8f406d990 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb9100b4320 tx=0x7fb900009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:41.830+0000 7fb905ffb640 1 -- 172.21.15.55:0/3071402585 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb90c0592d0 con 0x7fb9100d1130 2024-04-25T09:02:42.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.049+0000 7fb91726b640 1 -- 172.21.15.55:0/3071402585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fb9100cdb90 con 0x7fb9100d1130 2024-04-25T09:02:42.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.390+0000 7fb905ffb640 1 -- 172.21.15.55:0/3071402585 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v74) v1 ==== 162+0+0 (secure 0 0 0) 0x7fb90c058bd0 con 0x7fb9100d1130 2024-04-25T09:02:42.379 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:02:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 -- 172.21.15.55:0/3071402585 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8f406b4d0 msgr2=0x7fb8f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8f406b4d0 0x7fb8f406d990 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb9100b4320 tx=0x7fb900009040 comp rx=0 tx=0).stop 2024-04-25T09:02:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 -- 172.21.15.55:0/3071402585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9100d1130 msgr2=0x7fb91014beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9100d1130 0x7fb91014beb0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d7d0 tx=0x7fb90c00dc90 comp rx=0 tx=0).stop 2024-04-25T09:02:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 -- 172.21.15.55:0/3071402585 shutdown_connections 2024-04-25T09:02:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8f406b4d0 0x7fb8f406d990 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb91015dca0 0x7fb9100c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9100d3b90 0x7fb910160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 --2- 172.21.15.55:0/3071402585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9100d1130 0x7fb91014beb0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 -- 172.21.15.55:0/3071402585 >> 172.21.15.55:0/3071402585 conn(0x7fb9100726c0 msgr2=0x7fb9100b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 -- 172.21.15.55:0/3071402585 shutdown_connections 2024-04-25T09:02:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.392+0000 7fb91726b640 1 -- 172.21.15.55:0/3071402585 wait complete. 2024-04-25T09:02:42.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:42.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.509+0000 7f3ea139e640 1 Processor -- start 2024-04-25T09:02:42.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.509+0000 7f3ea139e640 1 -- start start 2024-04-25T09:02:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.510+0000 7f3ea139e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e9c06cdd0 0x7f3e9c0b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.510+0000 7f3ea139e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9c06c1f0 con 0x7f3e9c15dc30 2024-04-25T09:02:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.510+0000 7f3ea139e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9c0b1dd0 con 0x7f3e9c0b1960 2024-04-25T09:02:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.510+0000 7f3ea139e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0cfb40 con 0x7f3e9c06cdd0 2024-04-25T09:02:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.510+0000 7f3e9affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3e9c15dc30 0x7f3e9c06c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45436/0 (socket says 172.21.15.55:45436) 2024-04-25T09:02:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.510+0000 7f3e9affd640 1 -- 172.21.15.55:0/2816506067 learned_addr learned my addr 172.21.15.55:0/2816506067 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.511+0000 7f3e9a7fc640 1 --2- 172.21.15.55:0/2816506067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e9c06cdd0 0x7f3e9c0b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.511+0000 7f3e99ffb640 1 -- 172.21.15.55:0/2816506067 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914244962 0 0) 0x7f3e94001110 con 0x7f3e9c15dc30 2024-04-25T09:02:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.511+0000 7f3e99ffb640 1 -- 172.21.15.55:0/2816506067 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e88003520 con 0x7f3e9c15dc30 2024-04-25T09:02:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.511+0000 7f3e99ffb640 1 -- 172.21.15.55:0/2816506067 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337813337 0 0) 0x7f3e9c0b1dd0 con 0x7f3e9c0b1960 2024-04-25T09:02:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.511+0000 7f3e99ffb640 1 -- 172.21.15.55:0/2816506067 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e94001110 con 0x7f3e9c0b1960 2024-04-25T09:02:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.511+0000 7f3e9a7fc640 1 -- 172.21.15.55:0/2816506067 >> v1:172.21.15.167:6789/0 conn(0x7f3e9c0b1960 legacy=0x7f3e9c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.511+0000 7f3e9a7fc640 1 -- 172.21.15.55:0/2816506067 >> v1:172.21.15.55:6789/0 conn(0x7f3e9c15dc30 legacy=0x7f3e9c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.511+0000 7f3e99ffb640 1 -- 172.21.15.55:0/2816506067 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2468936790 0 0) 0x7f3e88003520 con 0x7f3e9c15dc30 2024-04-25T09:02:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.511+0000 7f3e9a7fc640 1 -- 172.21.15.55:0/2816506067 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c0b2060 con 0x7f3e9c06cdd0 2024-04-25T09:02:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.512+0000 7f3e9a7fc640 1 --2- 172.21.15.55:0/2816506067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e9c06cdd0 0x7f3e9c0b1420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e840097d0 tx=0x7f3e8402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3be73e6ea5f7b56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:42.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.512+0000 7f3e99ffb640 1 -- 172.21.15.55:0/2816506067 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84037070 con 0x7f3e9c06cdd0 2024-04-25T09:02:42.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.512+0000 7f3e99ffb640 1 -- 172.21.15.55:0/2816506067 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8402ac30 con 0x7f3e9c06cdd0 2024-04-25T09:02:42.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.512+0000 7f3e99ffb640 1 -- 172.21.15.55:0/2816506067 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94001840 con 0x7f3e9c06cdd0 2024-04-25T09:02:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.512+0000 7f3ea139e640 1 -- 172.21.15.55:0/2816506067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e9c06cdd0 msgr2=0x7f3e9c0b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.512+0000 7f3ea139e640 1 --2- 172.21.15.55:0/2816506067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e9c06cdd0 0x7f3e9c0b1420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e840097d0 tx=0x7f3e8402a1a0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.513+0000 7f3ea139e640 1 -- 172.21.15.55:0/2816506067 shutdown_connections 2024-04-25T09:02:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.513+0000 7f3ea139e640 1 --2- 172.21.15.55:0/2816506067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e9c06cdd0 0x7f3e9c0b1420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.513+0000 7f3ea139e640 1 -- 172.21.15.55:0/2816506067 >> 172.21.15.55:0/2816506067 conn(0x7f3e9c0d1900 msgr2=0x7f3e9c0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.513+0000 7f3ea139e640 1 -- 172.21.15.55:0/2816506067 shutdown_connections 2024-04-25T09:02:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.513+0000 7f3ea139e640 1 -- 172.21.15.55:0/2816506067 wait complete. 2024-04-25T09:02:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.514+0000 7f3ea139e640 1 Processor -- start 2024-04-25T09:02:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.514+0000 7f3ea139e640 1 -- start start 2024-04-25T09:02:42.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3ea139e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e9c06cdd0 0x7f3e9c1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:42.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3ea139e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c0b1960 0x7f3e9c15f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:42.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3ea139e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c15dc30 0x7f3e9c0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:42.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3ea139e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0cfde0 con 0x7f3e9c15dc30 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3ea139e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0b2620 con 0x7f3e9c0b1960 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3ea139e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c15e010 con 0x7f3e9c06cdd0 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e9b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c15dc30 0x7f3e9c0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e9b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c15dc30 0x7f3e9c0c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36866/0 (socket says 172.21.15.55:36866) 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e9b7fe640 1 -- 172.21.15.55:0/1902071384 learned_addr learned my addr 172.21.15.55:0/1902071384 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e9a7fc640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c0b1960 0x7f3e9c15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e9affd640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e9c06cdd0 0x7f3e9c1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e9b7fe640 1 -- 172.21.15.55:0/1902071384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e9c06cdd0 msgr2=0x7f3e9c1579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e9b7fe640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e9c06cdd0 0x7f3e9c1579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e9b7fe640 1 -- 172.21.15.55:0/1902071384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c0b1960 msgr2=0x7f3e9c15f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e9b7fe640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c0b1960 0x7f3e9c15f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e9b7fe640 1 -- 172.21.15.55:0/1902071384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c15e5e0 con 0x7f3e9c15dc30 2024-04-25T09:02:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e9b7fe640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c15dc30 0x7f3e9c0c7510 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00c790 tx=0x7f3e8c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e937fe640 1 -- 172.21.15.55:0/1902071384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c003b70 con 0x7f3e9c15dc30 2024-04-25T09:02:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e937fe640 1 -- 172.21.15.55:0/1902071384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c003d10 con 0x7f3e9c15dc30 2024-04-25T09:02:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3ea139e640 1 -- 172.21.15.55:0/1902071384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9c15e8c0 con 0x7f3e9c15dc30 2024-04-25T09:02:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3e937fe640 1 -- 172.21.15.55:0/1902071384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c00aa50 con 0x7f3e9c15dc30 2024-04-25T09:02:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.515+0000 7f3ea139e640 1 -- 172.21.15.55:0/1902071384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c15ee80 con 0x7f3e9c15dc30 2024-04-25T09:02:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.516+0000 7f3ea139e640 1 -- 172.21.15.55:0/1902071384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9c067850 con 0x7f3e9c15dc30 2024-04-25T09:02:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.517+0000 7f3e937fe640 1 -- 172.21.15.55:0/1902071384 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3e8c00abf0 con 0x7f3e9c15dc30 2024-04-25T09:02:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.518+0000 7f3e937fe640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3e7c06b500 0x7f3e7c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.518+0000 7f3e937fe640 1 -- 172.21.15.55:0/1902071384 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3e8c08a200 con 0x7f3e9c15dc30 2024-04-25T09:02:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.518+0000 7f3e9affd640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3e7c06b500 0x7f3e7c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:42.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.518+0000 7f3e9affd640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3e7c06b500 0x7f3e7c06d9c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3e94001eb0 tx=0x7f3e94009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:42.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.522+0000 7f3e937fe640 1 -- 172.21.15.55:0/1902071384 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e8c059020 con 0x7f3e9c15dc30 2024-04-25T09:02:42.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.742+0000 7f3ea139e640 1 -- 172.21.15.55:0/1902071384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e9c0b3980 con 0x7f3e9c15dc30 2024-04-25T09:02:42.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.742+0000 7f3e937fe640 1 -- 172.21.15.55:0/1902071384 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f3e8c058920 con 0x7f3e9c15dc30 2024-04-25T09:02:42.731 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:42.731 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":75,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:02:42.393006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8601":{"gid":8601,"name":"c","rank":0,"incarnation":75,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6837/3048692204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3048692204},{"type":"v1","addr":"172.21.15.55:6837","nonce":3048692204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:02:42.731 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 75 2024-04-25T09:02:42.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 -- 172.21.15.55:0/1902071384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3e7c06b500 msgr2=0x7f3e7c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3e7c06b500 0x7f3e7c06d9c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3e94001eb0 tx=0x7f3e94009040 comp rx=0 tx=0).stop 2024-04-25T09:02:42.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 -- 172.21.15.55:0/1902071384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c15dc30 msgr2=0x7f3e9c0c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:42.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c15dc30 0x7f3e9c0c7510 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00c790 tx=0x7f3e8c00cc50 comp rx=0 tx=0).stop 2024-04-25T09:02:42.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 -- 172.21.15.55:0/1902071384 shutdown_connections 2024-04-25T09:02:42.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3e7c06b500 0x7f3e7c06d9c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c15dc30 0x7f3e9c0c7510 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c0b1960 0x7f3e9c15f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 --2- 172.21.15.55:0/1902071384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e9c06cdd0 0x7f3e9c1579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:42.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 -- 172.21.15.55:0/1902071384 >> 172.21.15.55:0/1902071384 conn(0x7f3e9c0d1900 msgr2=0x7f3e9c0ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:42.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 -- 172.21.15.55:0/1902071384 shutdown_connections 2024-04-25T09:02:42.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:42.744+0000 7f3ea139e640 1 -- 172.21.15.55:0/1902071384 wait complete. 2024-04-25T09:02:43.147 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:01:52.042907+0000', 'modified': '2024-04-25T09:02:42.393006+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 103, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8601}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8601': {'gid': 8601, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6837/3048692204', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 3048692204}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3048692204}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:02:43.147 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8601:up:replay 2024-04-25T09:02:44.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:44.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.273+0000 7f4e58e93640 1 Processor -- start 2024-04-25T09:02:44.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.273+0000 7f4e58e93640 1 -- start start 2024-04-25T09:02:44.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e58e93640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4e5415dce0 0x7f4e540d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e58e93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e540d35b0 0x7f4e540b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e58e93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5415e0c0 con 0x7f4e540d1f90 2024-04-25T09:02:44.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e58e93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e540b7b10 con 0x7f4e540d35b0 2024-04-25T09:02:44.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e58e93640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e540d2510 con 0x7f4e5415dce0 2024-04-25T09:02:44.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e4bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e540d35b0 0x7f4e540b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e52d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4e540d1f90 0x7f4e5406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45446/0 (socket says 172.21.15.55:45446) 2024-04-25T09:02:44.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e52d9d640 1 -- 172.21.15.55:0/3791145799 learned_addr learned my addr 172.21.15.55:0/3791145799 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:44.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e5259c640 1 --2- 172.21.15.55:0/3791145799 >> v2:172.21.15.167:3300/0 conn(0x7f4e5415dce0 0x7f4e540d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e4bfff640 1 -- 172.21.15.55:0/3791145799 >> v2:172.21.15.167:3300/0 conn(0x7f4e5415dce0 msgr2=0x7f4e540d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e4bfff640 1 --2- 172.21.15.55:0/3791145799 >> v2:172.21.15.167:3300/0 conn(0x7f4e5415dce0 0x7f4e540d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e51d9b640 1 -- 172.21.15.55:0/3791145799 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834133870 0 0) 0x7f4e5415e0c0 con 0x7f4e540d1f90 2024-04-25T09:02:44.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e4bfff640 1 -- 172.21.15.55:0/3791145799 >> v1:172.21.15.55:6789/0 conn(0x7f4e540d1f90 legacy=0x7f4e5406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.274+0000 7f4e4bfff640 1 -- 172.21.15.55:0/3791145799 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540d27f0 con 0x7f4e540d35b0 2024-04-25T09:02:44.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.275+0000 7f4e4bfff640 1 --2- 172.21.15.55:0/3791145799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e540d35b0 0x7f4e540b5450 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f4e540ce220 tx=0x7f4e3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb1b57f91427941 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.275+0000 7f4e51d9b640 1 -- 172.21.15.55:0/3791145799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c037070 con 0x7f4e540d35b0 2024-04-25T09:02:44.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.275+0000 7f4e51d9b640 1 -- 172.21.15.55:0/3791145799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c032440 con 0x7f4e540d35b0 2024-04-25T09:02:44.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.275+0000 7f4e51d9b640 1 -- 172.21.15.55:0/3791145799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c032810 con 0x7f4e540d35b0 2024-04-25T09:02:44.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.276+0000 7f4e58e93640 1 -- 172.21.15.55:0/3791145799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e540d35b0 msgr2=0x7f4e540b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.276+0000 7f4e58e93640 1 --2- 172.21.15.55:0/3791145799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e540d35b0 0x7f4e540b5450 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f4e540ce220 tx=0x7f4e3c02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.276+0000 7f4e58e93640 1 -- 172.21.15.55:0/3791145799 shutdown_connections 2024-04-25T09:02:44.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.276+0000 7f4e58e93640 1 --2- 172.21.15.55:0/3791145799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e540d35b0 0x7f4e540b5450 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.276+0000 7f4e58e93640 1 --2- 172.21.15.55:0/3791145799 >> v2:172.21.15.167:3300/0 conn(0x7f4e5415dce0 0x7f4e540d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.276+0000 7f4e58e93640 1 -- 172.21.15.55:0/3791145799 >> 172.21.15.55:0/3791145799 conn(0x7f4e54072900 msgr2=0x7f4e540d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.276+0000 7f4e58e93640 1 -- 172.21.15.55:0/3791145799 shutdown_connections 2024-04-25T09:02:44.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.276+0000 7f4e58e93640 1 -- 172.21.15.55:0/3791145799 wait complete. 2024-04-25T09:02:44.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.277+0000 7f4e58e93640 1 Processor -- start 2024-04-25T09:02:44.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.277+0000 7f4e58e93640 1 -- start start 2024-04-25T09:02:44.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.278+0000 7f4e58e93640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e540d1f90 0x7f4e541f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.278+0000 7f4e58e93640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540d35b0 0x7f4e541f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.278+0000 7f4e58e93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e5415dce0 0x7f4e541f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.278+0000 7f4e58e93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540d3090 con 0x7f4e5415dce0 2024-04-25T09:02:44.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.278+0000 7f4e58e93640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540d2db0 con 0x7f4e540d35b0 2024-04-25T09:02:44.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.278+0000 7f4e58e93640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540b9820 con 0x7f4e540d1f90 2024-04-25T09:02:44.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.278+0000 7f4e52d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e5415dce0 0x7f4e541f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.278+0000 7f4e52d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e5415dce0 0x7f4e541f4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36892/0 (socket says 172.21.15.55:36892) 2024-04-25T09:02:44.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.278+0000 7f4e52d9d640 1 -- 172.21.15.55:0/1639340806 learned_addr learned my addr 172.21.15.55:0/1639340806 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.278+0000 7f4e4bfff640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540d35b0 0x7f4e541f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.278+0000 7f4e5259c640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e540d1f90 0x7f4e541f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.279+0000 7f4e52d9d640 1 -- 172.21.15.55:0/1639340806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e540d1f90 msgr2=0x7f4e541f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.279+0000 7f4e52d9d640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e540d1f90 0x7f4e541f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.279+0000 7f4e52d9d640 1 -- 172.21.15.55:0/1639340806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540d35b0 msgr2=0x7f4e541f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.279+0000 7f4e52d9d640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540d35b0 0x7f4e541f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.279+0000 7f4e52d9d640 1 -- 172.21.15.55:0/1639340806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e541f43d0 con 0x7f4e5415dce0 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.279+0000 7f4e52d9d640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e5415dce0 0x7f4e541f4600 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c7d0 tx=0x7f4e4c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.279+0000 7f4e4affd640 1 -- 172.21.15.55:0/1639340806 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c018070 con 0x7f4e5415dce0 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.279+0000 7f4e4affd640 1 -- 172.21.15.55:0/1639340806 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c00a5e0 con 0x7f4e5415dce0 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.279+0000 7f4e4affd640 1 -- 172.21.15.55:0/1639340806 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00aa10 con 0x7f4e5415dce0 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.279+0000 7f4e58e93640 1 -- 172.21.15.55:0/1639340806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5415f6f0 con 0x7f4e5415dce0 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.279+0000 7f4e58e93640 1 -- 172.21.15.55:0/1639340806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5415fcb0 con 0x7f4e5415dce0 2024-04-25T09:02:44.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.280+0000 7f4e58e93640 1 -- 172.21.15.55:0/1639340806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e540749b0 con 0x7f4e5415dce0 2024-04-25T09:02:44.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.280+0000 7f4e4affd640 1 -- 172.21.15.55:0/1639340806 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4e4c00abb0 con 0x7f4e5415dce0 2024-04-25T09:02:44.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.281+0000 7f4e4affd640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e3406b4d0 0x7f4e3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.281+0000 7f4e4affd640 1 -- 172.21.15.55:0/1639340806 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4e4c0897b0 con 0x7f4e5415dce0 2024-04-25T09:02:44.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.281+0000 7f4e5259c640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e3406b4d0 0x7f4e3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.281+0000 7f4e5259c640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e3406b4d0 0x7f4e3406d990 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4e5415cd40 tx=0x7f4e44009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.286+0000 7f4e4affd640 1 -- 172.21.15.55:0/1639340806 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e4c057f90 con 0x7f4e5415dce0 2024-04-25T09:02:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.507+0000 7f4e58e93640 1 -- 172.21.15.55:0/1639340806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e540b2660 con 0x7f4e5415dce0 2024-04-25T09:02:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.508+0000 7f4e4affd640 1 -- 172.21.15.55:0/1639340806 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f4e4c05c030 con 0x7f4e5415dce0 2024-04-25T09:02:44.498 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:44.498 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":77,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:02:43.406953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8601":{"gid":8601,"name":"c","rank":0,"incarnation":75,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.55:6837/3048692204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3048692204},{"type":"v1","addr":"172.21.15.55:6837","nonce":3048692204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:02:44.498 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 77 2024-04-25T09:02:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 -- 172.21.15.55:0/1639340806 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e3406b4d0 msgr2=0x7f4e3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e3406b4d0 0x7f4e3406d990 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4e5415cd40 tx=0x7f4e44009190 comp rx=0 tx=0).stop 2024-04-25T09:02:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 -- 172.21.15.55:0/1639340806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e5415dce0 msgr2=0x7f4e541f4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e5415dce0 0x7f4e541f4600 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c7d0 tx=0x7f4e4c00cc90 comp rx=0 tx=0).stop 2024-04-25T09:02:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 -- 172.21.15.55:0/1639340806 shutdown_connections 2024-04-25T09:02:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4e3406b4d0 0x7f4e3406d990 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e5415dce0 0x7f4e541f4600 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540d35b0 0x7f4e541f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 --2- 172.21.15.55:0/1639340806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e540d1f90 0x7f4e541f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 -- 172.21.15.55:0/1639340806 >> 172.21.15.55:0/1639340806 conn(0x7f4e54072900 msgr2=0x7f4e5415cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 -- 172.21.15.55:0/1639340806 shutdown_connections 2024-04-25T09:02:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:44.510+0000 7f4e58e93640 1 -- 172.21.15.55:0/1639340806 wait complete. 2024-04-25T09:02:44.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:01:52.042907+0000', 'modified': '2024-04-25T09:02:43.406953+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 103, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8601}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8601': {'gid': 8601, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.55:6837/3048692204', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 3048692204}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3048692204}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:02:44.914 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8601:up:rejoin 2024-04-25T09:02:45.915 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:46.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.040+0000 7f29880f7640 1 Processor -- start 2024-04-25T09:02:46.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.040+0000 7f29880f7640 1 -- start start 2024-04-25T09:02:46.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.041+0000 7f29880f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29800cd320 0x7f29800cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.041+0000 7f29880f7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f29800cfe80 0x7f29800cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.041+0000 7f29880f7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29800cd930 con 0x7f298015df40 2024-04-25T09:02:46.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.041+0000 7f29880f7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29800cdc10 con 0x7f29800cd320 2024-04-25T09:02:46.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.041+0000 7f29880f7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29800cdef0 con 0x7f29800cfe80 2024-04-25T09:02:46.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.041+0000 7f2985692640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29800cd320 0x7f29800cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.041+0000 7f2985692640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29800cd320 0x7f29800cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36896/0 (socket says 172.21.15.55:36896) 2024-04-25T09:02:46.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.041+0000 7f2985692640 1 -- 172.21.15.55:0/1266816066 learned_addr learned my addr 172.21.15.55:0/1266816066 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.041+0000 7f2986694640 1 --2- 172.21.15.55:0/1266816066 >> v2:172.21.15.167:3300/0 conn(0x7f29800cfe80 0x7f29800cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.042+0000 7f2985692640 1 -- 172.21.15.55:0/1266816066 >> v2:172.21.15.167:3300/0 conn(0x7f29800cfe80 msgr2=0x7f29800cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.042+0000 7f2985692640 1 --2- 172.21.15.55:0/1266816066 >> v2:172.21.15.167:3300/0 conn(0x7f29800cfe80 0x7f29800cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.042+0000 7f2985692640 1 -- 172.21.15.55:0/1266816066 >> v1:172.21.15.167:6789/0 conn(0x7f298015df40 legacy=0x7f29800b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.042+0000 7f2985692640 1 -- 172.21.15.55:0/1266816066 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29800cada0 con 0x7f29800cd320 2024-04-25T09:02:46.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.042+0000 7f2985692640 1 --2- 172.21.15.55:0/1266816066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29800cd320 0x7f29800cf940 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f29800d1740 tx=0x7f297002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feef1c0b0c7bd576 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.043+0000 7f2984e91640 1 -- 172.21.15.55:0/1266816066 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970037070 con 0x7f29800cd320 2024-04-25T09:02:46.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.043+0000 7f2984e91640 1 -- 172.21.15.55:0/1266816066 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2970032440 con 0x7f29800cd320 2024-04-25T09:02:46.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.043+0000 7f2984e91640 1 -- 172.21.15.55:0/1266816066 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970032810 con 0x7f29800cd320 2024-04-25T09:02:46.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.043+0000 7f29880f7640 1 -- 172.21.15.55:0/1266816066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29800cd320 msgr2=0x7f29800cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.043+0000 7f29880f7640 1 --2- 172.21.15.55:0/1266816066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29800cd320 0x7f29800cf940 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f29800d1740 tx=0x7f297002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.043+0000 7f29880f7640 1 -- 172.21.15.55:0/1266816066 shutdown_connections 2024-04-25T09:02:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.043+0000 7f29880f7640 1 --2- 172.21.15.55:0/1266816066 >> v2:172.21.15.167:3300/0 conn(0x7f29800cfe80 0x7f29800cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.043+0000 7f29880f7640 1 --2- 172.21.15.55:0/1266816066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29800cd320 0x7f29800cf940 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.043+0000 7f29880f7640 1 -- 172.21.15.55:0/1266816066 >> 172.21.15.55:0/1266816066 conn(0x7f29800d06b0 msgr2=0x7f29800d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.043+0000 7f29880f7640 1 -- 172.21.15.55:0/1266816066 shutdown_connections 2024-04-25T09:02:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.043+0000 7f29880f7640 1 -- 172.21.15.55:0/1266816066 wait complete. 2024-04-25T09:02:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.045+0000 7f29880f7640 1 Processor -- start 2024-04-25T09:02:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.045+0000 7f29880f7640 1 -- start start 2024-04-25T09:02:46.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.045+0000 7f29880f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29800cd320 0x7f29801f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.045+0000 7f29880f7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29800cfe80 0x7f29800b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.045+0000 7f29880f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f298015df40 0x7f29800c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.045+0000 7f29880f7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800c4200 con 0x7f29800cd320 2024-04-25T09:02:46.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.045+0000 7f29880f7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800d0290 con 0x7f298015df40 2024-04-25T09:02:46.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.045+0000 7f29880f7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29800c4380 con 0x7f29800cfe80 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.045+0000 7f2985e93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29800cd320 0x7f29801f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2985e93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29800cd320 0x7f29801f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36900/0 (socket says 172.21.15.55:36900) 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2985e93640 1 -- 172.21.15.55:0/2958576735 learned_addr learned my addr 172.21.15.55:0/2958576735 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2986694640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f298015df40 0x7f29800c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2985692640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29800cfe80 0x7f29800b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2985e93640 1 -- 172.21.15.55:0/2958576735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29800cfe80 msgr2=0x7f29800b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2985e93640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29800cfe80 0x7f29800b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2985e93640 1 -- 172.21.15.55:0/2958576735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f298015df40 msgr2=0x7f29800c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2985e93640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f298015df40 0x7f29800c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2985e93640 1 -- 172.21.15.55:0/2958576735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29801f72f0 con 0x7f29800cd320 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2986694640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f298015df40 0x7f29800c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2985692640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29800cfe80 0x7f29800b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f2985e93640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29800cd320 0x7f29801f6ac0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f297c00c7c0 tx=0x7f297c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f29767fc640 1 -- 172.21.15.55:0/2958576735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c016020 con 0x7f29800cd320 2024-04-25T09:02:46.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f29767fc640 1 -- 172.21.15.55:0/2958576735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c006d50 con 0x7f29800cd320 2024-04-25T09:02:46.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f29880f7640 1 -- 172.21.15.55:0/2958576735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29801f75d0 con 0x7f29800cd320 2024-04-25T09:02:46.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f29767fc640 1 -- 172.21.15.55:0/2958576735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c003bb0 con 0x7f29800cd320 2024-04-25T09:02:46.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.046+0000 7f29880f7640 1 -- 172.21.15.55:0/2958576735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29800b3ab0 con 0x7f29800cd320 2024-04-25T09:02:46.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.047+0000 7f29880f7640 1 -- 172.21.15.55:0/2958576735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29800749b0 con 0x7f29800cd320 2024-04-25T09:02:46.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.048+0000 7f29767fc640 1 -- 172.21.15.55:0/2958576735 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f297c00a850 con 0x7f29800cd320 2024-04-25T09:02:46.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.048+0000 7f29767fc640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f296406b4d0 0x7f296406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.048+0000 7f29767fc640 1 -- 172.21.15.55:0/2958576735 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f297c089f10 con 0x7f29800cd320 2024-04-25T09:02:46.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.048+0000 7f2985692640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f296406b4d0 0x7f296406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.049+0000 7f2985692640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f296406b4d0 0x7f296406d990 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2970034000 tx=0x7f297002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.052+0000 7f29767fc640 1 -- 172.21.15.55:0/2958576735 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f297c020020 con 0x7f29800cd320 2024-04-25T09:02:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.275+0000 7f29880f7640 1 -- 172.21.15.55:0/2958576735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29801f7000 con 0x7f29800cd320 2024-04-25T09:02:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.275+0000 7f29767fc640 1 -- 172.21.15.55:0/2958576735 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f297c019310 con 0x7f29800cd320 2024-04-25T09:02:46.264 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:46.264 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":78,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:02:44.417012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8601":{"gid":8601,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/3048692204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3048692204},{"type":"v1","addr":"172.21.15.55:6837","nonce":3048692204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:02:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 78 2024-04-25T09:02:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 -- 172.21.15.55:0/2958576735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f296406b4d0 msgr2=0x7f296406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f296406b4d0 0x7f296406d990 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2970034000 tx=0x7f297002e000 comp rx=0 tx=0).stop 2024-04-25T09:02:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 -- 172.21.15.55:0/2958576735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29800cd320 msgr2=0x7f29801f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29800cd320 0x7f29801f6ac0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f297c00c7c0 tx=0x7f297c00cc80 comp rx=0 tx=0).stop 2024-04-25T09:02:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 -- 172.21.15.55:0/2958576735 shutdown_connections 2024-04-25T09:02:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f296406b4d0 0x7f296406d990 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f298015df40 0x7f29800c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29800cfe80 0x7f29800b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 --2- 172.21.15.55:0/2958576735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29800cd320 0x7f29801f6ac0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 -- 172.21.15.55:0/2958576735 >> 172.21.15.55:0/2958576735 conn(0x7f29800d06b0 msgr2=0x7f29800cb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 -- 172.21.15.55:0/2958576735 shutdown_connections 2024-04-25T09:02:46.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.277+0000 7f29880f7640 1 -- 172.21.15.55:0/2958576735 wait complete. 2024-04-25T09:02:46.679 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:01:52.042907+0000', 'modified': '2024-04-25T09:02:44.417012+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 103, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8601}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8601': {'gid': 8601, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6837/3048692204', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 3048692204}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3048692204}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:02:46.679 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:02:46.679 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:02:46.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.798+0000 7fdb5c25d640 1 Processor -- start 2024-04-25T09:02:46.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.799+0000 7fdb5c25d640 1 -- start start 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.799+0000 7fdb5c25d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdb5415dbe0 0x7fdb5415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.799+0000 7fdb5c25d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb540b9980 con 0x7fdb540d3580 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.799+0000 7fdb5c25d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb540ce140 con 0x7fdb540b5c80 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.799+0000 7fdb5c25d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5415f210 con 0x7fdb5415dbe0 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb597f8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdb540d3580 0x7fdb540b5570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45454/0 (socket says 172.21.15.55:45454) 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb597f8640 1 -- 172.21.15.55:0/705372539 learned_addr learned my addr 172.21.15.55:0/705372539 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/705372539 >> v2:172.21.15.167:3300/0 conn(0x7fdb5415dbe0 0x7fdb5415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184552288 0 0) 0x7fdb540b9980 con 0x7fdb540d3580 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb40003520 con 0x7fdb540d3580 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 425570708 0 0) 0x7fdb40003520 con 0x7fdb540d3580 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 >> v2:172.21.15.167:3300/0 conn(0x7fdb5415dbe0 msgr2=0x7fdb5415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 --2- 172.21.15.55:0/705372539 >> v2:172.21.15.167:3300/0 conn(0x7fdb5415dbe0 0x7fdb5415ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 >> v1:172.21.15.167:6789/0 conn(0x7fdb540b5c80 legacy=0x7fdb54161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540ce420 con 0x7fdb540d3580 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fdb44001670 con 0x7fdb540d3580 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 >> v1:172.21.15.55:6789/0 conn(0x7fdb540d3580 legacy=0x7fdb540b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 --2- 172.21.15.55:0/705372539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 0x7fdb40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 --2- 172.21.15.55:0/705372539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb40004800 0x7fdb40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 --2- 172.21.15.55:0/705372539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb400051c0 0x7fdb4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5415f210 con 0x7fdb400039b0 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4000c060 con 0x7fdb40004800 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4000c260 con 0x7fdb400051c0 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.800+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/705372539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 0x7fdb40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.801+0000 7fdb597f8640 1 --2- 172.21.15.55:0/705372539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb40004800 0x7fdb40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.801+0000 7fdb5a7fa640 1 --2- 172.21.15.55:0/705372539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb400051c0 0x7fdb4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.801+0000 7fdb59ff9640 1 -- 172.21.15.55:0/705372539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb400051c0 msgr2=0x7fdb4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.801+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/705372539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb400051c0 0x7fdb4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.801+0000 7fdb59ff9640 1 -- 172.21.15.55:0/705372539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb40004800 msgr2=0x7fdb40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.801+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/705372539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb40004800 0x7fdb40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.801+0000 7fdb59ff9640 1 -- 172.21.15.55:0/705372539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb40003520 con 0x7fdb400039b0 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.801+0000 7fdb5a7fa640 1 -- 172.21.15.55:0/705372539 reap_dead start 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.801+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/705372539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 0x7fdb40003dd0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009ac0 tx=0x7fdb40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503476d087f862a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.802+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50036070 con 0x7fdb400039b0 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.802+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50031400 con 0x7fdb400039b0 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.802+0000 7fdb58ff7640 1 -- 172.21.15.55:0/705372539 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50009690 con 0x7fdb400039b0 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.802+0000 7fdb5c25d640 1 -- 172.21.15.55:0/705372539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 msgr2=0x7fdb40003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.802+0000 7fdb5c25d640 1 --2- 172.21.15.55:0/705372539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 0x7fdb40003dd0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009ac0 tx=0x7fdb40005830 comp rx=0 tx=0).stop 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.802+0000 7fdb5c25d640 1 -- 172.21.15.55:0/705372539 shutdown_connections 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.802+0000 7fdb5c25d640 1 --2- 172.21.15.55:0/705372539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 0x7fdb40003dd0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.802+0000 7fdb5c25d640 1 -- 172.21.15.55:0/705372539 >> 172.21.15.55:0/705372539 conn(0x7fdb54072900 msgr2=0x7fdb540d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.802+0000 7fdb5c25d640 1 -- 172.21.15.55:0/705372539 shutdown_connections 2024-04-25T09:02:46.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.802+0000 7fdb5c25d640 1 -- 172.21.15.55:0/705372539 wait complete. 2024-04-25T09:02:46.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.803+0000 7fdb5c25d640 1 Processor -- start 2024-04-25T09:02:46.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.804+0000 7fdb5c25d640 1 -- start start 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.804+0000 7fdb5c25d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 0x7fdb5415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.804+0000 7fdb5c25d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb540c8f60 0x7fdb540ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.804+0000 7fdb5c25d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb540c93e0 0x7fdb540cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.804+0000 7fdb5c25d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5415dfc0 con 0x7fdb400039b0 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.804+0000 7fdb5c25d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb540d3060 con 0x7fdb540c93e0 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.804+0000 7fdb5c25d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5415e140 con 0x7fdb540c8f60 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.804+0000 7fdb59ff9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 0x7fdb5415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.804+0000 7fdb59ff9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 0x7fdb5415cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36932/0 (socket says 172.21.15.55:36932) 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.804+0000 7fdb59ff9640 1 -- 172.21.15.55:0/2287052282 learned_addr learned my addr 172.21.15.55:0/2287052282 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.805+0000 7fdb59ff9640 1 -- 172.21.15.55:0/2287052282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb540c8f60 msgr2=0x7fdb540ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.805+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb540c8f60 0x7fdb540ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.805+0000 7fdb59ff9640 1 -- 172.21.15.55:0/2287052282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb540c93e0 msgr2=0x7fdb540cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.805+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb540c93e0 0x7fdb540cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.805+0000 7fdb59ff9640 1 -- 172.21.15.55:0/2287052282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540c9940 con 0x7fdb400039b0 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.805+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 0x7fdb5415cbd0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009be0 tx=0x7fdb50004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.805+0000 7fdb4a7fc640 1 -- 172.21.15.55:0/2287052282 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5003f020 con 0x7fdb400039b0 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.805+0000 7fdb4a7fc640 1 -- 172.21.15.55:0/2287052282 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50037040 con 0x7fdb400039b0 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.805+0000 7fdb5c25d640 1 -- 172.21.15.55:0/2287052282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb540c9c20 con 0x7fdb400039b0 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.805+0000 7fdb4a7fc640 1 -- 172.21.15.55:0/2287052282 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50036070 con 0x7fdb400039b0 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.805+0000 7fdb5c25d640 1 -- 172.21.15.55:0/2287052282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb540ca1e0 con 0x7fdb400039b0 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.807+0000 7fdb4a7fc640 1 -- 172.21.15.55:0/2287052282 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdb50042020 con 0x7fdb400039b0 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.807+0000 7fdb4a7fc640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb3806b500 0x7fdb3806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.807+0000 7fdb4a7fc640 1 -- 172.21.15.55:0/2287052282 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fdb500aa1d0 con 0x7fdb400039b0 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.807+0000 7fdb597f8640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb3806b500 0x7fdb3806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.808+0000 7fdb597f8640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb3806b500 0x7fdb3806d9c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdb44001b60 tx=0x7fdb44001ad0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.808+0000 7fdb5f039740 1 Processor -- start 2024-04-25T09:02:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.808+0000 7fdb5f039740 1 -- start start 2024-04-25T09:02:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff80610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ff9e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff55f10 0x55dd1ff9c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb5f039740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd1feb8a10 con 0x55dd1ff80230 2024-04-25T09:02:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb5f039740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd1fe61b30 con 0x55dd1ff55f10 2024-04-25T09:02:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb5f039740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd1feb4c50 con 0x55dd1ff9dad0 2024-04-25T09:02:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb59ff9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff80610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb59ff9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff80610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36942/0 (socket says 172.21.15.55:36942) 2024-04-25T09:02:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb59ff9640 1 -- 172.21.15.55:0/1003497357 learned_addr learned my addr 172.21.15.55:0/1003497357 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb597f8640 1 --2- 172.21.15.55:0/1003497357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ff9e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb5a7fa640 1 --2- 172.21.15.55:0/1003497357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff55f10 0x55dd1ff9c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb59ff9640 1 -- 172.21.15.55:0/1003497357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 msgr2=0x55dd1ff9e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/1003497357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ff9e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb59ff9640 1 -- 172.21.15.55:0/1003497357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff55f10 msgr2=0x55dd1ff9c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/1003497357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff55f10 0x55dd1ff9c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb59ff9640 1 -- 172.21.15.55:0/1003497357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd1fe76e10 con 0x55dd1ff80230 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.809+0000 7fdb5a7fa640 1 --2- 172.21.15.55:0/1003497357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff55f10 0x55dd1ff9c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/1003497357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff80610 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fdb50080ad0 tx=0x7fdb50039f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d6df9f8e8da8df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb377fe640 1 -- 172.21.15.55:0/1003497357 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50090020 con 0x55dd1ff80230 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb377fe640 1 -- 172.21.15.55:0/1003497357 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb500788f0 con 0x55dd1ff80230 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb377fe640 1 -- 172.21.15.55:0/1003497357 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5007ca40 con 0x55dd1ff80230 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb5f039740 1 -- 172.21.15.55:0/1003497357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 msgr2=0x55dd1ff80610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb5f039740 1 --2- 172.21.15.55:0/1003497357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff80610 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fdb50080ad0 tx=0x7fdb50039f90 comp rx=0 tx=0).stop 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb5f039740 1 -- 172.21.15.55:0/1003497357 shutdown_connections 2024-04-25T09:02:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb5f039740 1 --2- 172.21.15.55:0/1003497357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff55f10 0x55dd1ff9c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb5f039740 1 --2- 172.21.15.55:0/1003497357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ff9e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb5f039740 1 --2- 172.21.15.55:0/1003497357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff80610 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb5f039740 1 -- 172.21.15.55:0/1003497357 >> 172.21.15.55:0/1003497357 conn(0x55dd1ff52840 msgr2=0x55dd1ff9b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb5f039740 1 -- 172.21.15.55:0/1003497357 shutdown_connections 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.810+0000 7fdb5f039740 1 -- 172.21.15.55:0/1003497357 wait complete. 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.811+0000 7fdb5f039740 1 -- start start 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.811+0000 7fdb5f039740 1 Processor -- start 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff80230 0x55dd1ff7f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff9dad0 0x55dd1ff933b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff938f0 0x55dd1ff96bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb5f039740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd1feb4c50 con 0x55dd1ff9dad0 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb5f039740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd1fe750c0 con 0x55dd1ff80230 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb5f039740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd1feb8a10 con 0x55dd1ff938f0 2024-04-25T09:02:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb5f039740 10 client.0 _ll_register_callbacks cb 0x55dd1fe68ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb597f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff9dad0 0x55dd1ff933b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb597f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff9dad0 0x55dd1ff933b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36952/0 (socket says 172.21.15.55:36952) 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb597f8640 1 -- 172.21.15.55:0/2056003815 learned_addr learned my addr 172.21.15.55:0/2056003815 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff80230 0x55dd1ff7f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb5a7fa640 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff938f0 0x55dd1ff96bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb597f8640 1 -- 172.21.15.55:0/2056003815 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff938f0 msgr2=0x55dd1ff96bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb597f8640 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff938f0 0x55dd1ff96bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb597f8640 1 -- 172.21.15.55:0/2056003815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff80230 msgr2=0x55dd1ff7f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb597f8640 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff80230 0x55dd1ff7f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.812+0000 7fdb597f8640 1 -- 172.21.15.55:0/2056003815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd1fbcd2d0 con 0x55dd1ff9dad0 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb597f8640 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff9dad0 0x55dd1ff933b0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fdb44013780 tx=0x7fdb440078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3605926c77bd186 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb34ff9640 1 -- 172.21.15.55:0/2056003815 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440126a0 con 0x55dd1ff9dad0 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb34ff9640 1 -- 172.21.15.55:0/2056003815 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fdb44012840 con 0x55dd1ff9dad0 2024-04-25T09:02:46.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb5f039740 1 -- 172.21.15.55:0/2056003815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb500788f0 con 0x55dd1ff9dad0 2024-04-25T09:02:46.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb34ff9640 1 -- 172.21.15.55:0/2056003815 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb44012a40 con 0x55dd1ff9dad0 2024-04-25T09:02:46.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb5f039740 10 client.8670 fetch_fsmap learned FSMap version 78 2024-04-25T09:02:46.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb5f039740 1 -- 172.21.15.55:0/2056003815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55dd1fc976b0 con 0x55dd1ff9dad0 2024-04-25T09:02:46.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb34ff9640 1 -- 172.21.15.55:0/2056003815 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb500788f0 con 0x55dd1ff9dad0 2024-04-25T09:02:46.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb34ff9640 1 -- 172.21.15.55:0/2056003815 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdb44031080 con 0x55dd1ff9dad0 2024-04-25T09:02:46.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb5f039740 10 client.8670 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:02:46.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb5f039740 10 client.8670 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:02:46.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb5f039740 20 client.8670 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:46.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb5f039740 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x55dd1ff94610 0x55dd1ff949f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb5f039740 4 client.8670 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb5f039740 1 -- 172.21.15.55:0/2056003815 --> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd1ff17920 con 0x55dd1ff94610 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.813+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x55dd1ff94610 0x55dd1ff949f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.814+0000 7fdb34ff9640 10 client.8670 ms_handle_connect on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.814+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x55dd1ff94610 0x55dd1ff949f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85289a23c49f0ce4 server_cookie=e3a18b04f6d97a13 in_seq=0 out_seq=0 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.814+0000 7fdb34ff9640 1 -- 172.21.15.55:0/2056003815 <== mds.0 v2:172.21.15.55:6834/3048692204 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dd1ff17920 con 0x55dd1ff94610 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.814+0000 7fdb34ff9640 10 client.8670 handle_command_reply: tid=0 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.814+0000 7fdb5f039740 1 client.8670 shutdown 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.814+0000 7fdb5f039740 1 -- 172.21.15.55:0/2056003815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff9dad0 msgr2=0x55dd1ff933b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.814+0000 7fdb5f039740 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff9dad0 0x55dd1ff933b0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fdb44013780 tx=0x7fdb440078f0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.815+0000 7fdb5f039740 1 -- 172.21.15.55:0/2056003815 shutdown_connections 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.815+0000 7fdb5f039740 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x55dd1ff94610 0x55dd1ff949f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.815+0000 7fdb5f039740 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff938f0 0x55dd1ff96bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.815+0000 7fdb5f039740 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff9dad0 0x55dd1ff933b0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.815+0000 7fdb34ff9640 0 client.8670 ms_handle_reset on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:46.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.815+0000 7fdb5f039740 1 --2- 172.21.15.55:0/2056003815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff80230 0x55dd1ff7f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.815+0000 7fdb5f039740 1 -- 172.21.15.55:0/2056003815 >> 172.21.15.55:0/2056003815 conn(0x55dd1ff55f10 msgr2=0x55dd1ff551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.815+0000 7fdb5f039740 1 -- 172.21.15.55:0/2056003815 shutdown_connections 2024-04-25T09:02:46.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.815+0000 7fdb5f039740 1 -- 172.21.15.55:0/2056003815 wait complete. 2024-04-25T09:02:46.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.815+0000 7fdb5f039740 20 client.8670 trim_cache size 0 max 16384 2024-04-25T09:02:46.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.831+0000 7fdb5f039740 1 Processor -- start 2024-04-25T09:02:46.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.831+0000 7fdb5f039740 1 -- start start 2024-04-25T09:02:46.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff54f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 0x55dd1ffbda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ffad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb5f039740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb541ff920 con 0x55dd1ff80230 2024-04-25T09:02:46.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb5f039740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb541f4cd0 con 0x55dd1ff938f0 2024-04-25T09:02:46.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb5f039740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb541ff320 con 0x55dd1ff9dad0 2024-04-25T09:02:46.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb59ff9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff54f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb59ff9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff54f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36966/0 (socket says 172.21.15.55:36966) 2024-04-25T09:02:46.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb59ff9640 1 -- 172.21.15.55:0/3866493904 learned_addr learned my addr 172.21.15.55:0/3866493904 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb5a7fa640 1 --2- 172.21.15.55:0/3866493904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ffad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb597f8640 1 --2- 172.21.15.55:0/3866493904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 0x55dd1ffbda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb59ff9640 1 -- 172.21.15.55:0/3866493904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 msgr2=0x55dd1ffad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/3866493904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ffad780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb59ff9640 1 -- 172.21.15.55:0/3866493904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 msgr2=0x55dd1ffbda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/3866493904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 0x55dd1ffbda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb59ff9640 1 -- 172.21.15.55:0/3866493904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd1ff4c550 con 0x55dd1ff80230 2024-04-25T09:02:46.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb597f8640 1 --2- 172.21.15.55:0/3866493904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 0x55dd1ffbda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:46.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/3866493904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff54f90 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009bb0 tx=0x7fdb5007b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190fa7b0415625e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.832+0000 7fdb36ffd640 1 -- 172.21.15.55:0/3866493904 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50090040 con 0x55dd1ff80230 2024-04-25T09:02:46.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.833+0000 7fdb36ffd640 1 -- 172.21.15.55:0/3866493904 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50076990 con 0x55dd1ff80230 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.833+0000 7fdb36ffd640 1 -- 172.21.15.55:0/3866493904 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500a8240 con 0x55dd1ff80230 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.833+0000 7fdb5f039740 1 -- 172.21.15.55:0/3866493904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 msgr2=0x55dd1ff54f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.833+0000 7fdb5f039740 1 --2- 172.21.15.55:0/3866493904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff54f90 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009bb0 tx=0x7fdb5007b000 comp rx=0 tx=0).stop 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.833+0000 7fdb5f039740 1 -- 172.21.15.55:0/3866493904 shutdown_connections 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.833+0000 7fdb5f039740 1 --2- 172.21.15.55:0/3866493904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ffad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.833+0000 7fdb5f039740 1 --2- 172.21.15.55:0/3866493904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 0x55dd1ffbda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.833+0000 7fdb5f039740 1 --2- 172.21.15.55:0/3866493904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff54f90 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.833+0000 7fdb5f039740 1 -- 172.21.15.55:0/3866493904 >> 172.21.15.55:0/3866493904 conn(0x55dd1ff55f10 msgr2=0x55dd1ff7ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.833+0000 7fdb5f039740 1 -- 172.21.15.55:0/3866493904 shutdown_connections 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.833+0000 7fdb5f039740 1 -- 172.21.15.55:0/3866493904 wait complete. 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.834+0000 7fdb5f039740 1 -- start start 2024-04-25T09:02:46.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.834+0000 7fdb5f039740 1 Processor -- start 2024-04-25T09:02:46.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff7cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 0x55dd1ffff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb5f039740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ffad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb5f039740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd1ff95410 con 0x55dd1ff80230 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb5f039740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd1fe61b30 con 0x55dd1ff938f0 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb5f039740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd1ff927b0 con 0x55dd1ff9dad0 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb5f039740 10 client.0 _ll_register_callbacks cb 0x55dd1ff50c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb59ff9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff7cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb59ff9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff7cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36978/0 (socket says 172.21.15.55:36978) 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb59ff9640 1 -- 172.21.15.55:0/1638469987 learned_addr learned my addr 172.21.15.55:0/1638469987 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb597f8640 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 0x55dd1ffff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb5a7fa640 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ffad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb59ff9640 1 -- 172.21.15.55:0/1638469987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 msgr2=0x55dd1ffad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ffad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb59ff9640 1 -- 172.21.15.55:0/1638469987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 msgr2=0x55dd1ffff4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 0x55dd1ffff4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb59ff9640 1 -- 172.21.15.55:0/1638469987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd1ffffa10 con 0x55dd1ff80230 2024-04-25T09:02:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb597f8640 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 0x55dd1ffff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb59ff9640 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff7cb50 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fdb50078880 tx=0x7fdb50000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78aa8084a10ef977 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb34ff9640 1 -- 172.21.15.55:0/1638469987 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50095060 con 0x55dd1ff80230 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb34ff9640 1 -- 172.21.15.55:0/1638469987 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fdb50074f60 con 0x55dd1ff80230 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb5f039740 1 -- 172.21.15.55:0/1638469987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb50076990 con 0x55dd1ff80230 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb34ff9640 1 -- 172.21.15.55:0/1638469987 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb50090040 con 0x55dd1ff80230 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb5f039740 10 client.8676 fetch_fsmap learned FSMap version 78 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.835+0000 7fdb5f039740 1 -- 172.21.15.55:0/1638469987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55dd1ff934e0 con 0x55dd1ff80230 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb34ff9640 1 -- 172.21.15.55:0/1638469987 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50076990 con 0x55dd1ff80230 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb34ff9640 1 -- 172.21.15.55:0/1638469987 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdb50097300 con 0x55dd1ff80230 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb5f039740 10 client.8676 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb5f039740 10 client.8676 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb5f039740 20 client.8676 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb5f039740 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x55dd20005a10 0x55dd20005df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb5f039740 4 client.8676 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb5f039740 1 -- 172.21.15.55:0/1638469987 --> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dd1fec5f50 con 0x55dd20005a10 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb597f8640 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x55dd20005a10 0x55dd20005df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb34ff9640 10 client.8676 ms_handle_connect on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb597f8640 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x55dd20005a10 0x55dd20005df0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba4dee4fbb7c9f6b server_cookie=bddb36818e451784 in_seq=0 out_seq=0 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb34ff9640 1 -- 172.21.15.55:0/1638469987 <== mds.0 v2:172.21.15.55:6834/3048692204 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55dd1fec5f50 con 0x55dd20005a10 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb34ff9640 10 client.8676 handle_command_reply: tid=0 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.836+0000 7fdb5f039740 1 client.8676 shutdown 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5f039740 1 -- 172.21.15.55:0/1638469987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 msgr2=0x55dd1ff7cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5f039740 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff7cb50 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fdb50078880 tx=0x7fdb50000bc0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5f039740 1 -- 172.21.15.55:0/1638469987 shutdown_connections 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5f039740 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x55dd20005a10 0x55dd20005df0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5f039740 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dd1ff9dad0 0x55dd1ffad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb34ff9640 0 client.8676 ms_handle_reset on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5f039740 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1ff938f0 0x55dd1ffff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5f039740 1 --2- 172.21.15.55:0/1638469987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dd1ff80230 0x55dd1ff7cb50 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5f039740 1 -- 172.21.15.55:0/1638469987 >> 172.21.15.55:0/1638469987 conn(0x55dd1ff55f10 msgr2=0x55dd1ff94b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5f039740 1 -- 172.21.15.55:0/1638469987 shutdown_connections 2024-04-25T09:02:46.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5f039740 1 -- 172.21.15.55:0/1638469987 wait complete. 2024-04-25T09:02:46.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5f039740 20 client.8676 trim_cache size 0 max 16384 2024-04-25T09:02:46.833 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:02:46.833 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T09:02:46.833 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T09:02:46.833 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8601, 2024-04-25T09:02:46.833 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T09:02:46.833 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T09:02:46.834 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T09:02:46.834 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.4402080990000004, 2024-04-25T09:02:46.834 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 78, 2024-04-25T09:02:46.834 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 103, 2024-04-25T09:02:46.834 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 103, 2024-04-25T09:02:46.834 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 5.408402851 2024-04-25T09:02:46.834 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:02:46.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5c25d640 1 -- 172.21.15.55:0/2287052282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb3806b500 msgr2=0x7fdb3806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5c25d640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb3806b500 0x7fdb3806d9c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdb44001b60 tx=0x7fdb44001ad0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5c25d640 1 -- 172.21.15.55:0/2287052282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 msgr2=0x7fdb5415cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5c25d640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 0x7fdb5415cbd0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009be0 tx=0x7fdb50004730 comp rx=0 tx=0).stop 2024-04-25T09:02:46.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5c25d640 1 -- 172.21.15.55:0/2287052282 shutdown_connections 2024-04-25T09:02:46.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5c25d640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdb3806b500 0x7fdb3806d9c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5c25d640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb540c93e0 0x7fdb540cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5c25d640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb540c8f60 0x7fdb540ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5c25d640 1 --2- 172.21.15.55:0/2287052282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb400039b0 0x7fdb5415cbd0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.837+0000 7fdb5c25d640 1 -- 172.21.15.55:0/2287052282 >> 172.21.15.55:0/2287052282 conn(0x7fdb54072900 msgr2=0x7fdb541604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.838+0000 7fdb5c25d640 1 -- 172.21.15.55:0/2287052282 shutdown_connections 2024-04-25T09:02:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.838+0000 7fdb5c25d640 1 -- 172.21.15.55:0/2287052282 wait complete. 2024-04-25T09:02:46.837 DEBUG:teuthology.orchestra.run.smithi055:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T09:02:46.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:46.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T09:02:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.955+0000 7f0a3526f640 1 Processor -- start 2024-04-25T09:02:46.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.955+0000 7f0a3526f640 1 -- start start 2024-04-25T09:02:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a3526f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a300b35e0 0x7f0a30162350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a3526f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0a30161400 0x7f0a300cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a3526f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a300cfed0 con 0x7f0a300b3f80 2024-04-25T09:02:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a3526f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a30162890 con 0x7f0a30161400 2024-04-25T09:02:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a3526f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300cf850 con 0x7f0a300b35e0 2024-04-25T09:02:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a2f7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0a30161400 0x7f0a300cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a2e7fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0a300b3f80 0x7f0a30160cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:45386/0 (socket says 172.21.15.55:45386) 2024-04-25T09:02:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a2effd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a300b35e0 0x7f0a30162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a2e7fc640 1 -- 172.21.15.55:0/3628740889 learned_addr learned my addr 172.21.15.55:0/3628740889 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/3628740889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a300b35e0 msgr2=0x7f0a30162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/3628740889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a300b35e0 0x7f0a30162350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/3628740889 >> v1:172.21.15.167:6789/0 conn(0x7f0a300b3f80 legacy=0x7f0a30160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a2dffb640 1 -- 172.21.15.55:0/3628740889 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235602935 0 0) 0x7f0a300cfed0 con 0x7f0a300b3f80 2024-04-25T09:02:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.956+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/3628740889 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300cfb30 con 0x7f0a30161400 2024-04-25T09:02:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.957+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/3628740889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a30161400 0x7f0a300cc500 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0a280097a0 tx=0x7f0a2802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46a68c16a5d55112 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.957+0000 7f0a2dffb640 1 -- 172.21.15.55:0/3628740889 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28037070 con 0x7f0a30161400 2024-04-25T09:02:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.958+0000 7f0a2dffb640 1 -- 172.21.15.55:0/3628740889 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2802ae50 con 0x7f0a30161400 2024-04-25T09:02:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.958+0000 7f0a2dffb640 1 -- 172.21.15.55:0/3628740889 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28032660 con 0x7f0a30161400 2024-04-25T09:02:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.958+0000 7f0a3526f640 1 -- 172.21.15.55:0/3628740889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a30161400 msgr2=0x7f0a300cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.958+0000 7f0a3526f640 1 --2- 172.21.15.55:0/3628740889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a30161400 0x7f0a300cc500 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0a280097a0 tx=0x7f0a2802a100 comp rx=0 tx=0).stop 2024-04-25T09:02:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.958+0000 7f0a3526f640 1 -- 172.21.15.55:0/3628740889 shutdown_connections 2024-04-25T09:02:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.958+0000 7f0a3526f640 1 --2- 172.21.15.55:0/3628740889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a30161400 0x7f0a300cc500 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.958+0000 7f0a3526f640 1 --2- 172.21.15.55:0/3628740889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a300b35e0 0x7f0a30162350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.958+0000 7f0a3526f640 1 -- 172.21.15.55:0/3628740889 >> 172.21.15.55:0/3628740889 conn(0x7f0a3006f4c0 msgr2=0x7f0a3006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.958+0000 7f0a3526f640 1 -- 172.21.15.55:0/3628740889 shutdown_connections 2024-04-25T09:02:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.958+0000 7f0a3526f640 1 -- 172.21.15.55:0/3628740889 wait complete. 2024-04-25T09:02:46.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.960+0000 7f0a3526f640 1 Processor -- start 2024-04-25T09:02:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.961+0000 7f0a3526f640 1 -- start start 2024-04-25T09:02:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a3526f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a300b35e0 0x7f0a300c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a3526f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a300b3f80 0x7f0a300b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a3526f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a30161400 0x7f0a300b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a3526f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300d05d0 con 0x7f0a30161400 2024-04-25T09:02:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a3526f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300d0450 con 0x7f0a300b3f80 2024-04-25T09:02:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a3526f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300b39c0 con 0x7f0a300b35e0 2024-04-25T09:02:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a30161400 0x7f0a300b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a30161400 0x7f0a300b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36994/0 (socket says 172.21.15.55:36994) 2024-04-25T09:02:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/2231413942 learned_addr learned my addr 172.21.15.55:0/2231413942 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a2effd640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a300b35e0 0x7f0a300c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a2e7fc640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a300b3f80 0x7f0a300b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/2231413942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a300b35e0 msgr2=0x7f0a300c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a300b35e0 0x7f0a300c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/2231413942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a300b3f80 msgr2=0x7f0a300b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a300b3f80 0x7f0a300b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.962+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/2231413942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300b6d30 con 0x7f0a30161400 2024-04-25T09:02:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.963+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a30161400 0x7f0a300b49b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f0a280097a0 tx=0x7f0a280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.963+0000 7f0a177fe640 1 -- 172.21.15.55:0/2231413942 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28037040 con 0x7f0a30161400 2024-04-25T09:02:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.963+0000 7f0a3526f640 1 -- 172.21.15.55:0/2231413942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a300b7010 con 0x7f0a30161400 2024-04-25T09:02:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.963+0000 7f0a177fe640 1 -- 172.21.15.55:0/2231413942 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a28004030 con 0x7f0a30161400 2024-04-25T09:02:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.963+0000 7f0a177fe640 1 -- 172.21.15.55:0/2231413942 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28004420 con 0x7f0a30161400 2024-04-25T09:02:46.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.963+0000 7f0a3526f640 1 -- 172.21.15.55:0/2231413942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a300b6a00 con 0x7f0a30161400 2024-04-25T09:02:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.965+0000 7f0a177fe640 1 -- 172.21.15.55:0/2231413942 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0a28003610 con 0x7f0a30161400 2024-04-25T09:02:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.965+0000 7f0a177fe640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0a1c06b4d0 0x7f0a1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.965+0000 7f0a177fe640 1 -- 172.21.15.55:0/2231413942 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0a280aad20 con 0x7f0a30161400 2024-04-25T09:02:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.965+0000 7f0a2effd640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0a1c06b4d0 0x7f0a1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.966+0000 7f0a2effd640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0a1c06b4d0 0x7f0a1c06d990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0a200113e0 tx=0x7f0a2000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.966+0000 7f0a37f7a740 1 Processor -- start 2024-04-25T09:02:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.966+0000 7f0a37f7a740 1 -- start start 2024-04-25T09:02:46.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98b0bb0 0x560cf98b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98ab830 0x560cf98af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf9814ac0 con 0x560cf98afcf0 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf97bdd80 con 0x560cf98ab830 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cf9810b60 con 0x560cf98b0bb0 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37002/0 (socket says 172.21.15.55:37002) 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/1018777436 learned_addr learned my addr 172.21.15.55:0/1018777436 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a2effd640 1 --2- 172.21.15.55:0/1018777436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98b0bb0 0x560cf98b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a2e7fc640 1 --2- 172.21.15.55:0/1018777436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98ab830 0x560cf98af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/1018777436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98b0bb0 msgr2=0x560cf98b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/1018777436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98b0bb0 0x560cf98b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/1018777436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98ab830 msgr2=0x560cf98af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/1018777436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98ab830 0x560cf98af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.967+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/1018777436 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf95f17e0 con 0x560cf98afcf0 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.968+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/1018777436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98b0130 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f0a28035040 tx=0x7f0a280792d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78eca4720cc9d97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.968+0000 7f0a14ff9640 1 -- 172.21.15.55:0/1018777436 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28079500 con 0x560cf98afcf0 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.968+0000 7f0a14ff9640 1 -- 172.21.15.55:0/1018777436 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2802ae50 con 0x560cf98afcf0 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.968+0000 7f0a14ff9640 1 -- 172.21.15.55:0/1018777436 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2807d5a0 con 0x560cf98afcf0 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.969+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1018777436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 msgr2=0x560cf98b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.969+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/1018777436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98b0130 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f0a28035040 tx=0x7f0a280792d0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.969+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1018777436 shutdown_connections 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.969+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/1018777436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98b0130 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.969+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/1018777436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98ab830 0x560cf98af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.969+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/1018777436 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98b0bb0 0x560cf98b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.969+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1018777436 >> 172.21.15.55:0/1018777436 conn(0x560cf98adcb0 msgr2=0x560cf98f6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.969+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1018777436 shutdown_connections 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.969+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1018777436 wait complete. 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.969+0000 7f0a37f7a740 1 -- start start 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.969+0000 7f0a37f7a740 1 Processor -- start 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98d5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98b0bb0 0x560cf9909e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98d1ba0 0x560cf990a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf97bdd80 con 0x560cf98afcf0 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf97b3530 con 0x560cf98b0bb0 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cf9814ac0 con 0x560cf98d1ba0 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a37f7a740 10 client.0 _ll_register_callbacks cb 0x560cf980b130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a2effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98d5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a2effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98d5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37006/0 (socket says 172.21.15.55:37006) 2024-04-25T09:02:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a2effd640 1 -- 172.21.15.55:0/4189613167 learned_addr learned my addr 172.21.15.55:0/4189613167 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a2effd640 1 -- 172.21.15.55:0/4189613167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98d1ba0 msgr2=0x560cf990a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98d1ba0 0x560cf990a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a2e7fc640 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98b0bb0 0x560cf9909e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a2effd640 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98d1ba0 0x560cf990a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a2effd640 1 -- 172.21.15.55:0/4189613167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98b0bb0 msgr2=0x560cf9909e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.970+0000 7f0a2effd640 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98b0bb0 0x560cf9909e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a2effd640 1 -- 172.21.15.55:0/4189613167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560cf9651f70 con 0x560cf98afcf0 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a2effd640 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98d5590 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f0a200045f0 tx=0x7f0a20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a6fefdd8c20435 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a0dffb640 1 -- 172.21.15.55:0/4189613167 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20027030 con 0x560cf98afcf0 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a0dffb640 1 -- 172.21.15.55:0/4189613167 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0a20017d50 con 0x560cf98afcf0 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a37f7a740 1 -- 172.21.15.55:0/4189613167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a2802ae50 con 0x560cf98afcf0 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a0dffb640 1 -- 172.21.15.55:0/4189613167 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a20030050 con 0x560cf98afcf0 2024-04-25T09:02:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a37f7a740 10 client.8685 fetch_fsmap learned FSMap version 78 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a37f7a740 1 -- 172.21.15.55:0/4189613167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x560cf94e9170 con 0x560cf98afcf0 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a0dffb640 1 -- 172.21.15.55:0/4189613167 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2802ae50 con 0x560cf98afcf0 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a0dffb640 1 -- 172.21.15.55:0/4189613167 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0a20033020 con 0x560cf98afcf0 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a37f7a740 10 client.8685 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a37f7a740 10 client.8685 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a37f7a740 20 client.8685 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x560cf98d71d0 0x560cf98d7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a37f7a740 4 client.8685 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a37f7a740 1 -- 172.21.15.55:0/4189613167 --> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560cf9822000 con 0x560cf98d71d0 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.971+0000 7f0a2e7fc640 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x560cf98d71d0 0x560cf98d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.972+0000 7f0a0dffb640 10 client.8685 ms_handle_connect on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.972+0000 7f0a2e7fc640 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x560cf98d71d0 0x560cf98d7610 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db3a4586306f5dbe server_cookie=c0b2183dd5e5d06c in_seq=0 out_seq=0 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.972+0000 7f0a0dffb640 1 -- 172.21.15.55:0/4189613167 <== mds.0 v2:172.21.15.55:6834/3048692204 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560cf9822000 con 0x560cf98d71d0 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.972+0000 7f0a0dffb640 10 client.8685 handle_command_reply: tid=0 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.972+0000 7f0a37f7a740 1 client.8685 shutdown 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a37f7a740 1 -- 172.21.15.55:0/4189613167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 msgr2=0x560cf98d5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98d5590 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f0a200045f0 tx=0x7f0a20004a40 comp rx=0 tx=0).stop 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a37f7a740 1 -- 172.21.15.55:0/4189613167 shutdown_connections 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x560cf98d71d0 0x560cf98d7610 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98d1ba0 0x560cf990a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98b0bb0 0x560cf9909e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a0dffb640 0 client.8685 ms_handle_reset on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/4189613167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98afcf0 0x560cf98d5590 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a37f7a740 1 -- 172.21.15.55:0/4189613167 >> 172.21.15.55:0/4189613167 conn(0x560cf98ab830 msgr2=0x560cf98aaf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a37f7a740 1 -- 172.21.15.55:0/4189613167 shutdown_connections 2024-04-25T09:02:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a37f7a740 1 -- 172.21.15.55:0/4189613167 wait complete. 2024-04-25T09:02:46.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.973+0000 7f0a37f7a740 20 client.8685 trim_cache size 0 max 16384 2024-04-25T09:02:46.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.978+0000 7f39faf7e640 1 Processor -- start 2024-04-25T09:02:46.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.978+0000 7f39faf7e640 1 -- start start 2024-04-25T09:02:46.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39faf7e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39f415eed0 0x7f39f40b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39faf7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f39f40b75c0 0x7f39f40ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39faf7e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f40ceaf0 con 0x7f39f40ce680 2024-04-25T09:02:46.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39faf7e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f415f6a0 con 0x7f39f40b75c0 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39faf7e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f415f980 con 0x7f39f415eed0 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39f3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f39f40b75c0 0x7f39f40ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39f951b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f39f40ce680 0x7f39f4070ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45458/0 (socket says 172.21.15.55:45458) 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39f951b640 1 -- 172.21.15.55:0/210867874 learned_addr learned my addr 172.21.15.55:0/210867874 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39f8d1a640 1 --2- 172.21.15.55:0/210867874 >> v2:172.21.15.167:3300/0 conn(0x7f39f415eed0 0x7f39f40b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39f3fff640 1 -- 172.21.15.55:0/210867874 >> v2:172.21.15.167:3300/0 conn(0x7f39f415eed0 msgr2=0x7f39f40b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39f3fff640 1 --2- 172.21.15.55:0/210867874 >> v2:172.21.15.167:3300/0 conn(0x7f39f415eed0 0x7f39f40b7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39f3fff640 1 -- 172.21.15.55:0/210867874 >> v1:172.21.15.55:6789/0 conn(0x7f39f40ce680 legacy=0x7f39f4070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39f3fff640 1 -- 172.21.15.55:0/210867874 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f415fc60 con 0x7f39f40b75c0 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.979+0000 7f39f8d1a640 1 --2- 172.21.15.55:0/210867874 >> v2:172.21.15.167:3300/0 conn(0x7f39f415eed0 0x7f39f40b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.980+0000 7f39f3fff640 1 --2- 172.21.15.55:0/210867874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f40b75c0 0x7f39f40ce140 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f39f40cf020 tx=0x7f39e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fe6538eb572bad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.980+0000 7f39f37fe640 1 -- 172.21.15.55:0/210867874 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0037070 con 0x7f39f40b75c0 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.980+0000 7f39f37fe640 1 -- 172.21.15.55:0/210867874 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e0032440 con 0x7f39f40b75c0 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.980+0000 7f39f37fe640 1 -- 172.21.15.55:0/210867874 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0032810 con 0x7f39f40b75c0 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.981+0000 7f39faf7e640 1 -- 172.21.15.55:0/210867874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f40b75c0 msgr2=0x7f39f40ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.981+0000 7f39faf7e640 1 --2- 172.21.15.55:0/210867874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f40b75c0 0x7f39f40ce140 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f39f40cf020 tx=0x7f39e002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.981+0000 7f39faf7e640 1 -- 172.21.15.55:0/210867874 shutdown_connections 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.981+0000 7f39faf7e640 1 --2- 172.21.15.55:0/210867874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f40b75c0 0x7f39f40ce140 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.981+0000 7f39faf7e640 1 --2- 172.21.15.55:0/210867874 >> v2:172.21.15.167:3300/0 conn(0x7f39f415eed0 0x7f39f40b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.981+0000 7f39faf7e640 1 -- 172.21.15.55:0/210867874 >> 172.21.15.55:0/210867874 conn(0x7f39f406f4a0 msgr2=0x7f39f406f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.981+0000 7f39faf7e640 1 -- 172.21.15.55:0/210867874 shutdown_connections 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.981+0000 7f39faf7e640 1 -- 172.21.15.55:0/210867874 wait complete. 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.982+0000 7f39faf7e640 1 Processor -- start 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.982+0000 7f39faf7e640 1 -- start start 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39faf7e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39f40b75c0 0x7f39f415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39faf7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39f40ce680 0x7f39f4158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39faf7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f415eed0 0x7f39f40c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39faf7e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4160220 con 0x7f39f415eed0 2024-04-25T09:02:46.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39faf7e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f415ff40 con 0x7f39f40ce680 2024-04-25T09:02:46.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39faf7e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4160500 con 0x7f39f40b75c0 2024-04-25T09:02:46.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39f951b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f415eed0 0x7f39f40c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39f951b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f415eed0 0x7f39f40c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37018/0 (socket says 172.21.15.55:37018) 2024-04-25T09:02:46.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39f951b640 1 -- 172.21.15.55:0/206856498 learned_addr learned my addr 172.21.15.55:0/206856498 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39f3fff640 1 --2- 172.21.15.55:0/206856498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39f40ce680 0x7f39f4158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39f8d1a640 1 --2- 172.21.15.55:0/206856498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39f40b75c0 0x7f39f415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39f951b640 1 -- 172.21.15.55:0/206856498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39f40b75c0 msgr2=0x7f39f415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39f951b640 1 --2- 172.21.15.55:0/206856498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39f40b75c0 0x7f39f415bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39f951b640 1 -- 172.21.15.55:0/206856498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39f40ce680 msgr2=0x7f39f4158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39f951b640 1 --2- 172.21.15.55:0/206856498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39f40ce680 0x7f39f4158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39f951b640 1 -- 172.21.15.55:0/206856498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f415acf0 con 0x7f39f415eed0 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.983+0000 7f39f8d1a640 1 --2- 172.21.15.55:0/206856498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39f40b75c0 0x7f39f415bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.984+0000 7f39f951b640 1 --2- 172.21.15.55:0/206856498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f415eed0 0x7f39f40c8900 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00cab0 tx=0x7f39ec00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.984+0000 7f39f17fa640 1 -- 172.21.15.55:0/206856498 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec017070 con 0x7f39f415eed0 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.984+0000 7f39f17fa640 1 -- 172.21.15.55:0/206856498 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec00abd0 con 0x7f39f415eed0 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.984+0000 7f39f17fa640 1 -- 172.21.15.55:0/206856498 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec012400 con 0x7f39f415eed0 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.984+0000 7f39faf7e640 1 -- 172.21.15.55:0/206856498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f415afd0 con 0x7f39f415eed0 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.984+0000 7f39faf7e640 1 -- 172.21.15.55:0/206856498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f415b590 con 0x7f39f415eed0 2024-04-25T09:02:46.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.984+0000 7f39deffd640 1 -- 172.21.15.55:0/206856498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f39cc005270 con 0x7f39f415eed0 2024-04-25T09:02:46.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.985+0000 7f39f17fa640 1 -- 172.21.15.55:0/206856498 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f39ec01a070 con 0x7f39f415eed0 2024-04-25T09:02:46.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.985+0000 7f39f17fa640 1 --2- 172.21.15.55:0/206856498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39d806b4d0 0x7f39d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.986+0000 7f39f17fa640 1 -- 172.21.15.55:0/206856498 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f39ec089e10 con 0x7f39f415eed0 2024-04-25T09:02:46.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.986+0000 7f39f8d1a640 1 --2- 172.21.15.55:0/206856498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39d806b4d0 0x7f39d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.986+0000 7f39f17fa640 1 -- 172.21.15.55:0/206856498 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+510 (secure 0 0 0) 0x7f39ec08c490 con 0x7f39f415eed0 2024-04-25T09:02:46.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.986+0000 7f39deffd640 1 -- 172.21.15.55:0/206856498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f39cc005550 con 0x7f39f415eed0 2024-04-25T09:02:46.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.986+0000 7f39f8d1a640 1 --2- 172.21.15.55:0/206856498 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39d806b4d0 0x7f39d806d990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f39e800aa30 tx=0x7f39e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.986+0000 7f39f17fa640 1 -- 172.21.15.55:0/206856498 <== mon.0 v2:172.21.15.55:3300/0 7 ==== log(2 entries from seq 1131 at 2024-04-25T09:02:45.416036+0000) v1 ==== 389+0+0 (secure 0 0 0) 0x7f39ec0883f0 con 0x7f39f415eed0 2024-04-25T09:02:46.980 INFO:teuthology.orchestra.run.smithi055.stdout: cluster: 2024-04-25T09:02:46.981 INFO:teuthology.orchestra.run.smithi055.stdout: id: c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T09:02:46.981 INFO:teuthology.orchestra.run.smithi055.stdout: health: HEALTH_OK 2024-04-25T09:02:46.981 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:46.981 INFO:teuthology.orchestra.run.smithi055.stdout: services: 2024-04-25T09:02:46.981 INFO:teuthology.orchestra.run.smithi055.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-04-25T09:02:46.981 INFO:teuthology.orchestra.run.smithi055.stdout: mgr: y(active, since 9m), standbys: x 2024-04-25T09:02:46.981 INFO:teuthology.orchestra.run.smithi055.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T09:02:46.981 INFO:teuthology.orchestra.run.smithi055.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-04-25T09:02:46.981 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:46.981 INFO:teuthology.orchestra.run.smithi055.stdout: data: 2024-04-25T09:02:46.981 INFO:teuthology.orchestra.run.smithi055.stdout: volumes: 1/1 healthy 2024-04-25T09:02:46.982 INFO:teuthology.orchestra.run.smithi055.stdout: pools: 3 pools, 97 pgs 2024-04-25T09:02:46.982 INFO:teuthology.orchestra.run.smithi055.stdout: objects: 30 objects, 19 MiB 2024-04-25T09:02:46.982 INFO:teuthology.orchestra.run.smithi055.stdout: usage: 295 MiB used, 720 GiB / 720 GiB avail 2024-04-25T09:02:46.982 INFO:teuthology.orchestra.run.smithi055.stdout: pgs: 97 active+clean 2024-04-25T09:02:46.982 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:46.982 INFO:teuthology.orchestra.run.smithi055.stdout: io: 2024-04-25T09:02:46.982 INFO:teuthology.orchestra.run.smithi055.stdout: client: 204 B/s rd, 102 B/s wr, 0 op/s rd, 0 op/s wr 2024-04-25T09:02:46.982 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:46.983 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:02:46.983 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:45.416036+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T09:02:46.983 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:45.416058+0000 mon.a [INF] Cluster is now healthy 2024-04-25T09:02:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.989+0000 7f0a37f7a740 1 Processor -- start 2024-04-25T09:02:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.989+0000 7f0a37f7a740 1 -- start start 2024-04-25T09:02:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.990+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98afcf0 0x560cf9909bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.990+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98b0bb0 0x560cf98b1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.990+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98d1ba0 0x560cf98b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.990+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a301ffda0 con 0x560cf98d1ba0 2024-04-25T09:02:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.990+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3015b730 con 0x560cf98afcf0 2024-04-25T09:02:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.990+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300d1fb0 con 0x560cf98b0bb0 2024-04-25T09:02:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.990+0000 7f0a2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98d1ba0 0x560cf98b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.990+0000 7f0a2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98d1ba0 0x560cf98b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37026/0 (socket says 172.21.15.55:37026) 2024-04-25T09:02:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.990+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/3413443985 learned_addr learned my addr 172.21.15.55:0/3413443985 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.991+0000 7f0a2e7fc640 1 --2- 172.21.15.55:0/3413443985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98b0bb0 0x560cf98b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.991+0000 7f0a2effd640 1 --2- 172.21.15.55:0/3413443985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98afcf0 0x560cf9909bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.991+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/3413443985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98b0bb0 msgr2=0x560cf98b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.991+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/3413443985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98b0bb0 0x560cf98b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.991+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/3413443985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98afcf0 msgr2=0x560cf9909bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.991+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/3413443985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98afcf0 0x560cf9909bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.991+0000 7f0a2f7fe640 1 -- 172.21.15.55:0/3413443985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf98ac4e0 con 0x560cf98d1ba0 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.991+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/3413443985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98d1ba0 0x560cf98b1840 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f0a28075960 tx=0x7f0a28098000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d2aed5f65f6663 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.991+0000 7f0a0ffff640 1 -- 172.21.15.55:0/3413443985 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28081b60 con 0x560cf98d1ba0 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.991+0000 7f0a0ffff640 1 -- 172.21.15.55:0/3413443985 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2802ae50 con 0x560cf98d1ba0 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.991+0000 7f0a0ffff640 1 -- 172.21.15.55:0/3413443985 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2807d5a0 con 0x560cf98d1ba0 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.992+0000 7f0a37f7a740 1 -- 172.21.15.55:0/3413443985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98d1ba0 msgr2=0x560cf98b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.992+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/3413443985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98d1ba0 0x560cf98b1840 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f0a28075960 tx=0x7f0a28098000 comp rx=0 tx=0).stop 2024-04-25T09:02:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.992+0000 7f0a37f7a740 1 -- 172.21.15.55:0/3413443985 shutdown_connections 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.992+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/3413443985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98d1ba0 0x560cf98b1840 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.992+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/3413443985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98b0bb0 0x560cf98b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.992+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/3413443985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98afcf0 0x560cf9909bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.992+0000 7f0a37f7a740 1 -- 172.21.15.55:0/3413443985 >> 172.21.15.55:0/3413443985 conn(0x560cf98ab830 msgr2=0x560cf98dbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.992+0000 7f0a37f7a740 1 -- 172.21.15.55:0/3413443985 shutdown_connections 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.992+0000 7f0a37f7a740 1 -- 172.21.15.55:0/3413443985 wait complete. 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.992+0000 7f0a37f7a740 1 -- start start 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.992+0000 7f0a37f7a740 1 Processor -- start 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.993+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98afcf0 0x560cf98d75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.993+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98b0bb0 0x560cf995ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.993+0000 7f0a37f7a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98d1ba0 0x560cf9909bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.993+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf98ed620 con 0x560cf98b0bb0 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.993+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3015b130 con 0x560cf98d1ba0 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.993+0000 7f0a37f7a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cf9964890 con 0x560cf98afcf0 2024-04-25T09:02:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.993+0000 7f0a37f7a740 10 client.0 _ll_register_callbacks cb 0x7f0a28006ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.993+0000 7f0a2e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98b0bb0 0x560cf995ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.993+0000 7f0a2e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98b0bb0 0x560cf995ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37032/0 (socket says 172.21.15.55:37032) 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.993+0000 7f0a2e7fc640 1 -- 172.21.15.55:0/1699488313 learned_addr learned my addr 172.21.15.55:0/1699488313 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.993+0000 7f0a2f7fe640 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98d1ba0 0x560cf9909bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a2effd640 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98afcf0 0x560cf98d75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a2e7fc640 1 -- 172.21.15.55:0/1699488313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98afcf0 msgr2=0x560cf98d75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a2e7fc640 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98afcf0 0x560cf98d75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a2e7fc640 1 -- 172.21.15.55:0/1699488313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98d1ba0 msgr2=0x560cf9909bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a2e7fc640 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98d1ba0 0x560cf9909bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a2e7fc640 1 -- 172.21.15.55:0/1699488313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560cf98d8f70 con 0x560cf98b0bb0 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a2effd640 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98afcf0 0x560cf98d75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a2e7fc640 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98b0bb0 0x560cf995ad60 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f0a24000fb0 tx=0x7f0a24007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78049ca08d7d2b3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a0dffb640 1 -- 172.21.15.55:0/1699488313 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2401a8b0 con 0x560cf98b0bb0 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a0dffb640 1 -- 172.21.15.55:0/1699488313 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0a24026b50 con 0x560cf98b0bb0 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1699488313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a2802ae50 con 0x560cf98b0bb0 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a0dffb640 1 -- 172.21.15.55:0/1699488313 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a24026d50 con 0x560cf98b0bb0 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a37f7a740 10 client.8700 fetch_fsmap learned FSMap version 78 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1699488313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x560cf99645d0 con 0x560cf98b0bb0 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a0dffb640 1 -- 172.21.15.55:0/1699488313 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2802ae50 con 0x560cf98b0bb0 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a0dffb640 1 -- 172.21.15.55:0/1699488313 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0a2402d050 con 0x560cf98b0bb0 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a37f7a740 10 client.8700 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a37f7a740 10 client.8700 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.994+0000 7f0a37f7a740 20 client.8700 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.995+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x560cf990a110 0x560cf9961070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.995+0000 7f0a37f7a740 4 client.8700 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:02:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.995+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1699488313 --> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x560cf981c350 con 0x560cf990a110 2024-04-25T09:02:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.995+0000 7f0a2effd640 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x560cf990a110 0x560cf9961070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.995+0000 7f0a0dffb640 10 client.8700 ms_handle_connect on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.995+0000 7f0a2effd640 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x560cf990a110 0x560cf9961070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bbbe0db08616b2e server_cookie=1866d3652be66686 in_seq=0 out_seq=0 2024-04-25T09:02:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a0dffb640 1 -- 172.21.15.55:0/1699488313 <== mds.0 v2:172.21.15.55:6834/3048692204 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560cf981c350 con 0x560cf990a110 2024-04-25T09:02:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a0dffb640 10 client.8700 handle_command_reply: tid=0 2024-04-25T09:02:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 1 client.8700 shutdown 2024-04-25T09:02:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1699488313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98b0bb0 msgr2=0x560cf995ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98b0bb0 0x560cf995ad60 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f0a24000fb0 tx=0x7f0a24007710 comp rx=0 tx=0).stop 2024-04-25T09:02:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1699488313 shutdown_connections 2024-04-25T09:02:46.995 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f5586f22640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T09:02:46.995 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f5586f22640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T09:02:46.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x560cf990a110 0x560cf9961070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560cf98d1ba0 0x560cf9909bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a0dffb640 0 client.8700 ms_handle_reset on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:46.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560cf98b0bb0 0x560cf995ad60 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 1 --2- 172.21.15.55:0/1699488313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560cf98afcf0 0x560cf98d75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1699488313 >> 172.21.15.55:0/1699488313 conn(0x560cf98ab830 msgr2=0x560cf98daa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.996 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f5586f22640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T09:02:46.996 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f5586f22640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T09:02:46.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1699488313 shutdown_connections 2024-04-25T09:02:46.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 1 -- 172.21.15.55:0/1699488313 wait complete. 2024-04-25T09:02:46.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.996+0000 7f0a37f7a740 20 client.8700 trim_cache size 0 max 16384 2024-04-25T09:02:46.997 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:02:46.997 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-25T09:02:46.997 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "1a088e70-7aa4-4960-a5db-14e5520a3992", 2024-04-25T09:02:46.998 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-25T09:02:46.998 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:02:46.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 -- 172.21.15.55:0/2231413942 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0a1c06b4d0 msgr2=0x7f0a1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0a1c06b4d0 0x7f0a1c06d990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0a200113e0 tx=0x7f0a2000b040 comp rx=0 tx=0).stop 2024-04-25T09:02:46.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 -- 172.21.15.55:0/2231413942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a30161400 msgr2=0x7f0a300b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a30161400 0x7f0a300b49b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f0a280097a0 tx=0x7f0a280046c0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 -- 172.21.15.55:0/2231413942 shutdown_connections 2024-04-25T09:02:46.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0a1c06b4d0 0x7f0a1c06d990 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a30161400 0x7f0a300b49b0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a300b3f80 0x7f0a300b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 --2- 172.21.15.55:0/2231413942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a300b35e0 0x7f0a300c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 -- 172.21.15.55:0/2231413942 >> 172.21.15.55:0/2231413942 conn(0x7f0a3006f4c0 msgr2=0x7f0a300cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 -- 172.21.15.55:0/2231413942 shutdown_connections 2024-04-25T09:02:47.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:46.997+0000 7f0a3526f640 1 -- 172.21.15.55:0/2231413942 wait complete. 2024-04-25T09:02:47.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:47.000 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:02:47.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.115+0000 7f10680b3640 1 Processor -- start 2024-04-25T09:02:47.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.115+0000 7f10680b3640 1 -- start start 2024-04-25T09:02:47.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.116+0000 7f10680b3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f106015dd70 0x7f10600d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.116+0000 7f10680b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10600d0390 con 0x7f106015e150 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.116+0000 7f10680b3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106015e6d0 con 0x7f106015f1b0 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.116+0000 7f10680b3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106015e9b0 con 0x7f106015dd70 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.116+0000 7f1066650640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f106015e150 0x7f106006aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45466/0 (socket says 172.21.15.55:45466) 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.116+0000 7f1066650640 1 -- 172.21.15.55:0/4181036562 learned_addr learned my addr 172.21.15.55:0/4181036562 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.116+0000 7f1065e4f640 1 --2- 172.21.15.55:0/4181036562 >> v2:172.21.15.167:3300/0 conn(0x7f106015dd70 0x7f10600d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.116+0000 7f1064e4d640 1 -- 172.21.15.55:0/4181036562 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407331888 0 0) 0x7f10600d0390 con 0x7f106015e150 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.116+0000 7f1064e4d640 1 -- 172.21.15.55:0/4181036562 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f104c003520 con 0x7f106015e150 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.117+0000 7f1064e4d640 1 -- 172.21.15.55:0/4181036562 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914804652 0 0) 0x7f106015e6d0 con 0x7f106015f1b0 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.117+0000 7f1064e4d640 1 -- 172.21.15.55:0/4181036562 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10600d0390 con 0x7f106015f1b0 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.117+0000 7f1065e4f640 1 -- 172.21.15.55:0/4181036562 >> v1:172.21.15.167:6789/0 conn(0x7f106015f1b0 legacy=0x7f10600cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.117+0000 7f1065e4f640 1 -- 172.21.15.55:0/4181036562 >> v1:172.21.15.55:6789/0 conn(0x7f106015e150 legacy=0x7f106006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.117+0000 7f1064e4d640 1 -- 172.21.15.55:0/4181036562 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 496106598 0 0) 0x7f104c003520 con 0x7f106015e150 2024-04-25T09:02:47.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.117+0000 7f1065e4f640 1 -- 172.21.15.55:0/4181036562 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106015ec90 con 0x7f106015dd70 2024-04-25T09:02:47.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.118+0000 7f1065e4f640 1 --2- 172.21.15.55:0/4181036562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106015dd70 0x7f10600d1300 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f10580097a0 tx=0x7f105802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb326434e5e087d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.118+0000 7f1064e4d640 1 -- 172.21.15.55:0/4181036562 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058037070 con 0x7f106015dd70 2024-04-25T09:02:47.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.118+0000 7f1064e4d640 1 -- 172.21.15.55:0/4181036562 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105802abc0 con 0x7f106015dd70 2024-04-25T09:02:47.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.118+0000 7f1064e4d640 1 -- 172.21.15.55:0/4181036562 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0019f0 con 0x7f106015dd70 2024-04-25T09:02:47.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.118+0000 7f10680b3640 1 -- 172.21.15.55:0/4181036562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106015dd70 msgr2=0x7f10600d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.118+0000 7f10680b3640 1 --2- 172.21.15.55:0/4181036562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106015dd70 0x7f10600d1300 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f10580097a0 tx=0x7f105802a130 comp rx=0 tx=0).stop 2024-04-25T09:02:47.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.118+0000 7f10680b3640 1 -- 172.21.15.55:0/4181036562 shutdown_connections 2024-04-25T09:02:47.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.118+0000 7f10680b3640 1 --2- 172.21.15.55:0/4181036562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106015dd70 0x7f10600d1300 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.118+0000 7f10680b3640 1 -- 172.21.15.55:0/4181036562 >> 172.21.15.55:0/4181036562 conn(0x7f1060099a40 msgr2=0x7f10600d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.118+0000 7f10680b3640 1 -- 172.21.15.55:0/4181036562 shutdown_connections 2024-04-25T09:02:47.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.118+0000 7f10680b3640 1 -- 172.21.15.55:0/4181036562 wait complete. 2024-04-25T09:02:47.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.120+0000 7f10680b3640 1 Processor -- start 2024-04-25T09:02:47.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.120+0000 7f10680b3640 1 -- start start 2024-04-25T09:02:47.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.120+0000 7f10680b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106015dd70 0x7f10600c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.120+0000 7f10680b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106015e150 0x7f1060159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.120+0000 7f10680b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106015f1b0 0x7f106015c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.120+0000 7f10680b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1060168d90 con 0x7f106015f1b0 2024-04-25T09:02:47.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.120+0000 7f10680b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106006b500 con 0x7f106015dd70 2024-04-25T09:02:47.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.120+0000 7f10680b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1060168f10 con 0x7f106015e150 2024-04-25T09:02:47.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.120+0000 7f1066650640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106015f1b0 0x7f106015c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.120+0000 7f1066650640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106015f1b0 0x7f106015c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37046/0 (socket says 172.21.15.55:37046) 2024-04-25T09:02:47.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.120+0000 7f1066650640 1 -- 172.21.15.55:0/3257309063 learned_addr learned my addr 172.21.15.55:0/3257309063 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:47.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f106564e640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106015e150 0x7f1060159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f1065e4f640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106015dd70 0x7f10600c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f1066650640 1 -- 172.21.15.55:0/3257309063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106015e150 msgr2=0x7f1060159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f1066650640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106015e150 0x7f1060159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f1066650640 1 -- 172.21.15.55:0/3257309063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106015dd70 msgr2=0x7f10600c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f1066650640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106015dd70 0x7f10600c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f1066650640 1 -- 172.21.15.55:0/3257309063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106015a350 con 0x7f106015f1b0 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f1065e4f640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106015dd70 0x7f10600c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f106564e640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106015e150 0x7f1060159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f1066650640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106015f1b0 0x7f106015c130 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f105c00cc20 tx=0x7f105c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f10567fc640 1 -- 172.21.15.55:0/3257309063 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c017070 con 0x7f106015f1b0 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f10567fc640 1 -- 172.21.15.55:0/3257309063 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c00ce30 con 0x7f106015f1b0 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f10680b3640 1 -- 172.21.15.55:0/3257309063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106015a630 con 0x7f106015f1b0 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f10567fc640 1 -- 172.21.15.55:0/3257309063 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c012620 con 0x7f106015f1b0 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.121+0000 7f10680b3640 1 -- 172.21.15.55:0/3257309063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106015abf0 con 0x7f106015f1b0 2024-04-25T09:02:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.123+0000 7f10567fc640 1 -- 172.21.15.55:0/3257309063 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f105c01a070 con 0x7f106015f1b0 2024-04-25T09:02:47.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.123+0000 7f10567fc640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f104406b500 0x7f104406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.123+0000 7f10567fc640 1 -- 172.21.15.55:0/3257309063 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f105c08a0e0 con 0x7f106015f1b0 2024-04-25T09:02:47.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.123+0000 7f1065e4f640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f104406b500 0x7f104406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.124+0000 7f1065e4f640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f104406b500 0x7f104406d9c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1058034000 tx=0x7f105802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.124+0000 7f106adba740 1 Processor -- start 2024-04-25T09:02:47.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.124+0000 7f106adba740 1 -- start start 2024-04-25T09:02:47.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106adba740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4db10 0x562fc5d50320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106adba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4def0 0x562fc5d50860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106adba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d20770 0x562fc5d23f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106adba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc5c89da0 con 0x562fc5d4def0 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106adba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc5c32b80 con 0x562fc5d20770 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106adba740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562fc5c85e40 con 0x562fc5d4db10 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106564e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4def0 0x562fc5d50860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106564e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4def0 0x562fc5d50860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37054/0 (socket says 172.21.15.55:37054) 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106564e640 1 -- 172.21.15.55:0/4194071901 learned_addr learned my addr 172.21.15.55:0/4194071901 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f1066650640 1 --2- 172.21.15.55:0/4194071901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d20770 0x562fc5d23f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f1065e4f640 1 --2- 172.21.15.55:0/4194071901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4db10 0x562fc5d50320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106564e640 1 -- 172.21.15.55:0/4194071901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4db10 msgr2=0x562fc5d50320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106564e640 1 --2- 172.21.15.55:0/4194071901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4db10 0x562fc5d50320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106564e640 1 -- 172.21.15.55:0/4194071901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d20770 msgr2=0x562fc5d23f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106564e640 1 --2- 172.21.15.55:0/4194071901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d20770 0x562fc5d23f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f106564e640 1 -- 172.21.15.55:0/4194071901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fc5c3cf10 con 0x562fc5d4def0 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.125+0000 7f1066650640 1 --2- 172.21.15.55:0/4194071901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d20770 0x562fc5d23f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:47.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f106564e640 1 --2- 172.21.15.55:0/4194071901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4def0 0x562fc5d50860 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f10500015b0 tx=0x7f1050001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c5f4d377845afe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f10437fe640 1 -- 172.21.15.55:0/4194071901 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050019070 con 0x562fc5d4def0 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f10437fe640 1 -- 172.21.15.55:0/4194071901 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10500050d0 con 0x562fc5d4def0 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f10437fe640 1 -- 172.21.15.55:0/4194071901 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000e6e0 con 0x562fc5d4def0 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f106adba740 1 -- 172.21.15.55:0/4194071901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4def0 msgr2=0x562fc5d50860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f106adba740 1 --2- 172.21.15.55:0/4194071901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4def0 0x562fc5d50860 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f10500015b0 tx=0x7f1050001a70 comp rx=0 tx=0).stop 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f106adba740 1 -- 172.21.15.55:0/4194071901 shutdown_connections 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f106adba740 1 --2- 172.21.15.55:0/4194071901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d20770 0x562fc5d23f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f106adba740 1 --2- 172.21.15.55:0/4194071901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4def0 0x562fc5d50860 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f106adba740 1 --2- 172.21.15.55:0/4194071901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4db10 0x562fc5d50320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f106adba740 1 -- 172.21.15.55:0/4194071901 >> 172.21.15.55:0/4194071901 conn(0x562fc5d229e0 msgr2=0x562fc5d6b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f106adba740 1 -- 172.21.15.55:0/4194071901 shutdown_connections 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.126+0000 7f106adba740 1 -- 172.21.15.55:0/4194071901 wait complete. 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.127+0000 7f106adba740 1 -- start start 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.127+0000 7f106adba740 1 Processor -- start 2024-04-25T09:02:47.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f106adba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4db10 0x562fc5d6f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f106adba740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4def0 0x562fc5d520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f106adba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d7ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f106adba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc5d25b90 con 0x562fc5d4bbc0 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f106adba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc5c284b0 con 0x562fc5d4db10 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f106adba740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562fc5d25e70 con 0x562fc5d4def0 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f106adba740 10 client.0 _ll_register_callbacks cb 0x562fc5c68180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1066650640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d7ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1066650640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d7ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37056/0 (socket says 172.21.15.55:37056) 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1066650640 1 -- 172.21.15.55:0/3859939796 learned_addr learned my addr 172.21.15.55:0/3859939796 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1065e4f640 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4db10 0x562fc5d6f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f106564e640 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4def0 0x562fc5d520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1066650640 1 -- 172.21.15.55:0/3859939796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4def0 msgr2=0x562fc5d520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1066650640 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4def0 0x562fc5d520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1066650640 1 -- 172.21.15.55:0/3859939796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4db10 msgr2=0x562fc5d6f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1066650640 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4db10 0x562fc5d6f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1066650640 1 -- 172.21.15.55:0/3859939796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562fc5a687d0 con 0x562fc5d4bbc0 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1065e4f640 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4db10 0x562fc5d6f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f106564e640 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4def0 0x562fc5d520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1066650640 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d7ae80 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f105c001350 tx=0x7f105c0588c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78daea797545b7d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.128+0000 7f1040ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f1040ff9640 1 -- 172.21.15.55:0/3859939796 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c070370 con 0x562fc5d4bbc0 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f1040ff9640 1 -- 172.21.15.55:0/3859939796 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f105c060a80 con 0x562fc5d4bbc0 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f106adba740 1 -- 172.21.15.55:0/3859939796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10500050d0 con 0x562fc5d4bbc0 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f1040ff9640 1 -- 172.21.15.55:0/3859939796 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f105c088050 con 0x562fc5d4bbc0 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f106adba740 10 client.8712 fetch_fsmap learned FSMap version 78 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f106adba740 1 -- 172.21.15.55:0/3859939796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x562fc599e3f0 con 0x562fc5d4bbc0 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f1040ff9640 1 -- 172.21.15.55:0/3859939796 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10500050d0 con 0x562fc5d4bbc0 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f1040ff9640 1 -- 172.21.15.55:0/3859939796 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f105c004b60 con 0x562fc5d4bbc0 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f106adba740 10 client.8712 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f106adba740 10 client.8712 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:02:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f106adba740 20 client.8712 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f106adba740 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x562fc5d6d3b0 0x562fc5d6d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f106adba740 4 client.8712 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f106adba740 1 -- 172.21.15.55:0/3859939796 --> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562fc5c972e0 con 0x562fc5d6d3b0 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f1065e4f640 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x562fc5d6d3b0 0x562fc5d6d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f1065e4f640 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x562fc5d6d3b0 0x562fc5d6d790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bba03011b4e9e8da server_cookie=b58bdbf30bfdb4a7 in_seq=0 out_seq=0 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.129+0000 7f1040ff9640 10 client.8712 ms_handle_connect on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f1040ff9640 1 -- 172.21.15.55:0/3859939796 <== mds.0 v2:172.21.15.55:6834/3048692204 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562fc5c972e0 con 0x562fc5d6d3b0 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f1040ff9640 10 client.8712 handle_command_reply: tid=0 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 1 client.8712 shutdown 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 1 -- 172.21.15.55:0/3859939796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 msgr2=0x562fc5d7ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d7ae80 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f105c001350 tx=0x7f105c0588c0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 1 -- 172.21.15.55:0/3859939796 shutdown_connections 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x562fc5d6d3b0 0x562fc5d6d790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d7ae80 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4def0 0x562fc5d520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f1040ff9640 0 client.8712 ms_handle_reset on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 1 --2- 172.21.15.55:0/3859939796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4db10 0x562fc5d6f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 1 -- 172.21.15.55:0/3859939796 >> 172.21.15.55:0/3859939796 conn(0x562fc5d20770 msgr2=0x562fc5d1f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 1 -- 172.21.15.55:0/3859939796 shutdown_connections 2024-04-25T09:02:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 1 -- 172.21.15.55:0/3859939796 wait complete. 2024-04-25T09:02:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.130+0000 7f106adba740 20 client.8712 trim_cache size 0 max 16384 2024-04-25T09:02:47.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.146+0000 7f106adba740 1 Processor -- start 2024-04-25T09:02:47.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.146+0000 7f106adba740 1 -- start start 2024-04-25T09:02:47.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f106adba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d50450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f106adba740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4db10 0x562fc5d7da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f106adba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4def0 0x562fc5d4a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f106adba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10601ffe80 con 0x562fc5d4bbc0 2024-04-25T09:02:47.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f106adba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1060154330 con 0x562fc5d4def0 2024-04-25T09:02:47.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f106adba740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1060153730 con 0x562fc5d4db10 2024-04-25T09:02:47.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1065e4f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d50450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1065e4f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d50450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37058/0 (socket says 172.21.15.55:37058) 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1065e4f640 1 -- 172.21.15.55:0/2550329124 learned_addr learned my addr 172.21.15.55:0/2550329124 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f106564e640 1 --2- 172.21.15.55:0/2550329124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4db10 0x562fc5d7da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1066650640 1 --2- 172.21.15.55:0/2550329124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4def0 0x562fc5d4a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1065e4f640 1 -- 172.21.15.55:0/2550329124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4db10 msgr2=0x562fc5d7da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1065e4f640 1 --2- 172.21.15.55:0/2550329124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4db10 0x562fc5d7da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1065e4f640 1 -- 172.21.15.55:0/2550329124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4def0 msgr2=0x562fc5d4a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1065e4f640 1 --2- 172.21.15.55:0/2550329124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4def0 0x562fc5d4a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1065e4f640 1 -- 172.21.15.55:0/2550329124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fc595e0f0 con 0x562fc5d4bbc0 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1066650640 1 --2- 172.21.15.55:0/2550329124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4def0 0x562fc5d4a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1065e4f640 1 --2- 172.21.15.55:0/2550329124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d50450 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1058035040 tx=0x7f105802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1add757d176117a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1042ffd640 1 -- 172.21.15.55:0/2550329124 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058050070 con 0x562fc5d4bbc0 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1042ffd640 1 -- 172.21.15.55:0/2550329124 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105804b710 con 0x562fc5d4bbc0 2024-04-25T09:02:47.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.147+0000 7f1042ffd640 1 -- 172.21.15.55:0/2550329124 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058037040 con 0x562fc5d4bbc0 2024-04-25T09:02:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.148+0000 7f106adba740 1 -- 172.21.15.55:0/2550329124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 msgr2=0x562fc5d50450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.148+0000 7f106adba740 1 --2- 172.21.15.55:0/2550329124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d50450 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1058035040 tx=0x7f105802c000 comp rx=0 tx=0).stop 2024-04-25T09:02:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.148+0000 7f106adba740 1 -- 172.21.15.55:0/2550329124 shutdown_connections 2024-04-25T09:02:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.148+0000 7f106adba740 1 --2- 172.21.15.55:0/2550329124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4def0 0x562fc5d4a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.148+0000 7f106adba740 1 --2- 172.21.15.55:0/2550329124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4db10 0x562fc5d7da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.148+0000 7f106adba740 1 --2- 172.21.15.55:0/2550329124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4bbc0 0x562fc5d50450 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.148+0000 7f106adba740 1 -- 172.21.15.55:0/2550329124 >> 172.21.15.55:0/2550329124 conn(0x562fc5d20770 msgr2=0x562fc5d20e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.148+0000 7f106adba740 1 -- 172.21.15.55:0/2550329124 shutdown_connections 2024-04-25T09:02:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.148+0000 7f106adba740 1 -- 172.21.15.55:0/2550329124 wait complete. 2024-04-25T09:02:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.149+0000 7f106adba740 1 -- start start 2024-04-25T09:02:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.149+0000 7f106adba740 1 Processor -- start 2024-04-25T09:02:47.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.149+0000 7f106adba740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4bbc0 0x562fc5d7a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.149+0000 7f106adba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4db10 0x562fc5d724f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.149+0000 7f106adba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4def0 0x562fc5d516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.149+0000 7f106adba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc5c40e00 con 0x562fc5d4db10 2024-04-25T09:02:47.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.149+0000 7f106adba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1060153d30 con 0x562fc5d4def0 2024-04-25T09:02:47.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.149+0000 7f106adba740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562fc5c8c240 con 0x562fc5d4bbc0 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106adba740 10 client.0 _ll_register_callbacks cb 0x7f1050007e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106564e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4db10 0x562fc5d724f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106564e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4db10 0x562fc5d724f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37072/0 (socket says 172.21.15.55:37072) 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106564e640 1 -- 172.21.15.55:0/2430389505 learned_addr learned my addr 172.21.15.55:0/2430389505 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f1066650640 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4def0 0x562fc5d516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f1065e4f640 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4bbc0 0x562fc5d7a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106564e640 1 -- 172.21.15.55:0/2430389505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4bbc0 msgr2=0x562fc5d7a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106564e640 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4bbc0 0x562fc5d7a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106564e640 1 -- 172.21.15.55:0/2430389505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4def0 msgr2=0x562fc5d516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106564e640 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4def0 0x562fc5d516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106564e640 1 -- 172.21.15.55:0/2430389505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562fc5d51c00 con 0x562fc5d4db10 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106564e640 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4db10 0x562fc5d724f0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f1050013000 tx=0x7f1050000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f1ef662f726962 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f1040ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f1040ff9640 1 -- 172.21.15.55:0/2430389505 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050019040 con 0x562fc5d4db10 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f1040ff9640 1 -- 172.21.15.55:0/2430389505 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f105000e8e0 con 0x562fc5d4db10 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106adba740 1 -- 172.21.15.55:0/2430389505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f105804b710 con 0x562fc5d4db10 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f1040ff9640 1 -- 172.21.15.55:0/2430389505 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f105002c050 con 0x562fc5d4db10 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106adba740 10 client.8718 fetch_fsmap learned FSMap version 78 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.150+0000 7f106adba740 1 -- 172.21.15.55:0/2430389505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x562fc5d7e070 con 0x562fc5d4db10 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f1040ff9640 1 -- 172.21.15.55:0/2430389505 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105804b710 con 0x562fc5d4db10 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f1040ff9640 1 -- 172.21.15.55:0/2430389505 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f105002f020 con 0x562fc5d4db10 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f106adba740 10 client.8718 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f106adba740 10 client.8718 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f106adba740 20 client.8718 populate_metadata read hostname 'smithi055' 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f106adba740 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x562fc5dd6660 0x562fc5dd6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f106adba740 4 client.8718 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:02:47.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f106adba740 1 -- 172.21.15.55:0/2430389505 --> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562fc5c91630 con 0x562fc5dd6660 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f1065e4f640 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x562fc5dd6660 0x562fc5dd6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f1040ff9640 10 client.8718 ms_handle_connect on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f1065e4f640 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x562fc5dd6660 0x562fc5dd6a40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5451d861c1640f6b server_cookie=215d07543fa649c in_seq=0 out_seq=0 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f1040ff9640 1 -- 172.21.15.55:0/2430389505 <== mds.0 v2:172.21.15.55:6834/3048692204 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x562fc5c91630 con 0x562fc5dd6660 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f1040ff9640 10 client.8718 handle_command_reply: tid=0 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f106adba740 1 client.8718 shutdown 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f106adba740 1 -- 172.21.15.55:0/2430389505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4db10 msgr2=0x562fc5d724f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.151+0000 7f106adba740 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4db10 0x562fc5d724f0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f1050013000 tx=0x7f1050000ed0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f106adba740 1 -- 172.21.15.55:0/2430389505 shutdown_connections 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f106adba740 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x562fc5dd6660 0x562fc5dd6a40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f106adba740 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fc5d4def0 0x562fc5d516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f106adba740 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562fc5d4db10 0x562fc5d724f0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f106adba740 1 --2- 172.21.15.55:0/2430389505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562fc5d4bbc0 0x562fc5d7a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f106adba740 1 -- 172.21.15.55:0/2430389505 >> 172.21.15.55:0/2430389505 conn(0x562fc5d20770 msgr2=0x562fc5d1bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f1040ff9640 0 client.8718 ms_handle_reset on v2:172.21.15.55:6834/3048692204 2024-04-25T09:02:47.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f106adba740 1 -- 172.21.15.55:0/2430389505 shutdown_connections 2024-04-25T09:02:47.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f106adba740 1 -- 172.21.15.55:0/2430389505 wait complete. 2024-04-25T09:02:47.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f106adba740 20 client.8718 trim_cache size 0 max 16384 2024-04-25T09:02:47.147 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:02:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:02:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-25T09:02:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: "1a088e70-7aa4-4960-a5db-14e5520a3992": { 2024-04-25T09:02:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-04-25T09:02:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "1a088e70-7aa4-4960-a5db-14e5520a3992", 2024-04-25T09:02:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-25T09:02:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:02:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:02:47.148 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:02:47.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 -- 172.21.15.55:0/3257309063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f104406b500 msgr2=0x7f104406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f104406b500 0x7f104406d9c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1058034000 tx=0x7f105802e000 comp rx=0 tx=0).stop 2024-04-25T09:02:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 -- 172.21.15.55:0/3257309063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106015f1b0 msgr2=0x7f106015c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106015f1b0 0x7f106015c130 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f105c00cc20 tx=0x7f105c00a430 comp rx=0 tx=0).stop 2024-04-25T09:02:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 -- 172.21.15.55:0/3257309063 shutdown_connections 2024-04-25T09:02:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f104406b500 0x7f104406d9c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106015f1b0 0x7f106015c130 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106015e150 0x7f1060159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 --2- 172.21.15.55:0/3257309063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106015dd70 0x7f10600c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 -- 172.21.15.55:0/3257309063 >> 172.21.15.55:0/3257309063 conn(0x7f1060099a40 msgr2=0x7f10600d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 -- 172.21.15.55:0/3257309063 shutdown_connections 2024-04-25T09:02:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:47.152+0000 7f10680b3640 1 -- 172.21.15.55:0/3257309063 wait complete. 2024-04-25T09:02:47.151 INFO:tasks.cephfs.filesystem:scrub status for tag:1a088e70-7aa4-4960-a5db-14e5520a3992 - {'path': '/', 'tag': '1a088e70-7aa4-4960-a5db-14e5520a3992', 'options': 'recursive,repair'} 2024-04-25T09:02:47.386 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-04-25T09:02:47.397+0000 7f558af2a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:02:48.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:48.433+0000 7f39f17fa640 1 -- 172.21.15.55:0/206856498 <== mon.0 v2:172.21.15.55:3300/0 8 ==== log(8 entries from seq 1 at 2024-04-25T09:02:46.996687+0000) v1 ==== 1407+0+0 (secure 0 0 0) 0x7f39ec056680 con 0x7f39f415eed0 2024-04-25T09:02:48.422 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:46.996687+0000 mds.c [INF] scrub queued for path: / 2024-04-25T09:02:48.422 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:46.996691+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:02:48.423 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:46.996695+0000 mds.c [INF] scrub summary: active paths [/] 2024-04-25T09:02:48.423 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:46.997410+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-04-25T09:02:48.423 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:46.997417+0000 mds.c [ERR] inode table repaired for inode: 0x10000000001 2024-04-25T09:02:48.423 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:46.997499+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-04-25T09:02:48.423 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:46.997505+0000 mds.c [ERR] inode table repaired for inode: 0x10000000002 2024-04-25T09:02:48.423 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:46.998023+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:02:52.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:02:52.745+0000 7f39f17fa640 1 -- 172.21.15.55:0/206856498 <== mon.0 v2:172.21.15.55:3300/0 9 ==== log(1 entries from seq 9 at 2024-04-25T09:02:51.431327+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f39ec0568e0 con 0x7f39f415eed0 2024-04-25T09:02:52.734 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-25T09:02:51.431327+0000 mds.c [INF] scrub summary: idle 2024-04-25T09:03:11.041 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:11.044 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:17.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:17.153 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:03:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.280+0000 7fe0846ac640 1 Processor -- start 2024-04-25T09:03:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.280+0000 7fe0846ac640 1 -- start start 2024-04-25T09:03:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.281+0000 7fe0846ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe07c0d1130 0x7fe07c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.281+0000 7fe0846ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c0d4090 con 0x7fe07c15dca0 2024-04-25T09:03:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.281+0000 7fe0846ac640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c0d4370 con 0x7fe07c0d3b90 2024-04-25T09:03:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.281+0000 7fe0846ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c0b6b20 con 0x7fe07c0d1130 2024-04-25T09:03:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.281+0000 7fe082c49640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe07c0d1130 0x7fe07c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.281+0000 7fe082448640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe07c15dca0 0x7fe07c0ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48940/0 (socket says 172.21.15.55:48940) 2024-04-25T09:03:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.281+0000 7fe082448640 1 -- 172.21.15.55:0/1272988188 learned_addr learned my addr 172.21.15.55:0/1272988188 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.281+0000 7fe082c49640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe07c0d1130 0x7fe07c0b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58566/0 (socket says 172.21.15.55:58566) 2024-04-25T09:03:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.282+0000 7fe082c49640 1 -- 172.21.15.55:0/1272988188 >> v1:172.21.15.167:6789/0 conn(0x7fe07c0d3b90 legacy=0x7fe07c0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.282+0000 7fe082c49640 1 -- 172.21.15.55:0/1272988188 >> v1:172.21.15.55:6789/0 conn(0x7fe07c15dca0 legacy=0x7fe07c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.282+0000 7fe082c49640 1 -- 172.21.15.55:0/1272988188 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c0d4650 con 0x7fe07c0d1130 2024-04-25T09:03:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.282+0000 7fe082c49640 1 --2- 172.21.15.55:0/1272988188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0d1130 0x7fe07c0b2500 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fe074009d90 tx=0x7fe07402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd571ffc7090d79b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.282+0000 7fe081446640 1 -- 172.21.15.55:0/1272988188 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074007740 con 0x7fe07c0d1130 2024-04-25T09:03:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.283+0000 7fe081446640 1 -- 172.21.15.55:0/1272988188 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0740078e0 con 0x7fe07c0d1130 2024-04-25T09:03:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.283+0000 7fe081446640 1 -- 172.21.15.55:0/1272988188 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074007cb0 con 0x7fe07c0d1130 2024-04-25T09:03:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.283+0000 7fe0846ac640 1 -- 172.21.15.55:0/1272988188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0d1130 msgr2=0x7fe07c0b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.283+0000 7fe0846ac640 1 --2- 172.21.15.55:0/1272988188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0d1130 0x7fe07c0b2500 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fe074009d90 tx=0x7fe07402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.283+0000 7fe0846ac640 1 -- 172.21.15.55:0/1272988188 shutdown_connections 2024-04-25T09:03:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.283+0000 7fe0846ac640 1 --2- 172.21.15.55:0/1272988188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0d1130 0x7fe07c0b2500 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.283+0000 7fe0846ac640 1 -- 172.21.15.55:0/1272988188 >> 172.21.15.55:0/1272988188 conn(0x7fe07c0726c0 msgr2=0x7fe07c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.283+0000 7fe0846ac640 1 -- 172.21.15.55:0/1272988188 shutdown_connections 2024-04-25T09:03:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.283+0000 7fe0846ac640 1 -- 172.21.15.55:0/1272988188 wait complete. 2024-04-25T09:03:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.284+0000 7fe0846ac640 1 Processor -- start 2024-04-25T09:03:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.285+0000 7fe0846ac640 1 -- start start 2024-04-25T09:03:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.285+0000 7fe0846ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0d1130 0x7fe07c1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.285+0000 7fe0846ac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe07c0d3b90 0x7fe07c0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.285+0000 7fe0846ac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe07c15dca0 0x7fe07c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.285+0000 7fe0846ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c15e080 con 0x7fe07c0d1130 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.285+0000 7fe0846ac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0cf050 con 0x7fe07c15dca0 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.285+0000 7fe0846ac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c15e200 con 0x7fe07c0d3b90 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.285+0000 7fe082448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0d1130 0x7fe07c1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.285+0000 7fe082448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0d1130 0x7fe07c1568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58574/0 (socket says 172.21.15.55:58574) 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.285+0000 7fe082448640 1 -- 172.21.15.55:0/785414270 learned_addr learned my addr 172.21.15.55:0/785414270 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe082c49640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe07c15dca0 0x7fe07c0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe081c47640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe07c0d3b90 0x7fe07c0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe082448640 1 -- 172.21.15.55:0/785414270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe07c0d3b90 msgr2=0x7fe07c0c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe082448640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe07c0d3b90 0x7fe07c0c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe082448640 1 -- 172.21.15.55:0/785414270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe07c15dca0 msgr2=0x7fe07c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe082448640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe07c15dca0 0x7fe07c0cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe082448640 1 -- 172.21.15.55:0/785414270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c0c7740 con 0x7fe07c0d1130 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe082c49640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe07c15dca0 0x7fe07c0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe082448640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0d1130 0x7fe07c1568e0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fe07800c3c0 tx=0x7fe07800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe072ffd640 1 -- 172.21.15.55:0/785414270 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078017070 con 0x7fe07c0d1130 2024-04-25T09:03:17.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe072ffd640 1 -- 172.21.15.55:0/785414270 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe078005ce0 con 0x7fe07c0d1130 2024-04-25T09:03:17.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe0846ac640 1 -- 172.21.15.55:0/785414270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c0c7a20 con 0x7fe07c0d1130 2024-04-25T09:03:17.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe072ffd640 1 -- 172.21.15.55:0/785414270 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0780072f0 con 0x7fe07c0d1130 2024-04-25T09:03:17.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.286+0000 7fe0846ac640 1 -- 172.21.15.55:0/785414270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c0c7fe0 con 0x7fe07c0d1130 2024-04-25T09:03:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.288+0000 7fe072ffd640 1 -- 172.21.15.55:0/785414270 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe07801a070 con 0x7fe07c0d1130 2024-04-25T09:03:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.288+0000 7fe072ffd640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe06006b4d0 0x7fe06006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.288+0000 7fe072ffd640 1 -- 172.21.15.55:0/785414270 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe078089520 con 0x7fe07c0d1130 2024-04-25T09:03:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.288+0000 7fe081c47640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe06006b4d0 0x7fe06006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.289+0000 7fe081c47640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe06006b4d0 0x7fe06006d990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe07c0c9310 tx=0x7fe06c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.289+0000 7fe0873aa740 1 Processor -- start 2024-04-25T09:03:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.290+0000 7fe0873aa740 1 -- start start 2024-04-25T09:03:17.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.290+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c14763320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.290+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 0x561c14763860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.290+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14733770 0x561c14736f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.290+0000 7fe0873aa740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c1469cda0 con 0x561c14733770 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.290+0000 7fe0873aa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c14645b80 con 0x561c14760b10 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.290+0000 7fe0873aa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c14698e40 con 0x561c14760ef0 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.290+0000 7fe082c49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14733770 0x561c14736f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.290+0000 7fe082c49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14733770 0x561c14736f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58582/0 (socket says 172.21.15.55:58582) 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.290+0000 7fe082c49640 1 -- 172.21.15.55:0/4140151714 learned_addr learned my addr 172.21.15.55:0/4140151714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.291+0000 7fe082c49640 1 -- 172.21.15.55:0/4140151714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 msgr2=0x561c14763860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.291+0000 7fe082c49640 1 --2- 172.21.15.55:0/4140151714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 0x561c14763860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.291+0000 7fe082448640 1 --2- 172.21.15.55:0/4140151714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c14763320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.291+0000 7fe082c49640 1 -- 172.21.15.55:0/4140151714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 msgr2=0x561c14763320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.291+0000 7fe082c49640 1 --2- 172.21.15.55:0/4140151714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c14763320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.291+0000 7fe082c49640 1 -- 172.21.15.55:0/4140151714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c1464ff10 con 0x561c14733770 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.291+0000 7fe082c49640 1 --2- 172.21.15.55:0/4140151714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14733770 0x561c14736f80 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fe074009eb0 tx=0x7fe07402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34515639bea353bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.291+0000 7fe05ffff640 1 -- 172.21.15.55:0/4140151714 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074007840 con 0x561c14733770 2024-04-25T09:03:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.291+0000 7fe05ffff640 1 -- 172.21.15.55:0/4140151714 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0740079e0 con 0x561c14733770 2024-04-25T09:03:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.291+0000 7fe05ffff640 1 -- 172.21.15.55:0/4140151714 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074007db0 con 0x561c14733770 2024-04-25T09:03:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.292+0000 7fe0873aa740 1 -- 172.21.15.55:0/4140151714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14733770 msgr2=0x561c14736f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.292+0000 7fe0873aa740 1 --2- 172.21.15.55:0/4140151714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14733770 0x561c14736f80 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fe074009eb0 tx=0x7fe07402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.292+0000 7fe0873aa740 1 -- 172.21.15.55:0/4140151714 shutdown_connections 2024-04-25T09:03:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.292+0000 7fe0873aa740 1 --2- 172.21.15.55:0/4140151714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14733770 0x561c14736f80 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.292+0000 7fe0873aa740 1 --2- 172.21.15.55:0/4140151714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 0x561c14763860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.292+0000 7fe0873aa740 1 --2- 172.21.15.55:0/4140151714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c14763320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.292+0000 7fe0873aa740 1 -- 172.21.15.55:0/4140151714 >> 172.21.15.55:0/4140151714 conn(0x561c147359e0 msgr2=0x561c1477e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.292+0000 7fe0873aa740 1 -- 172.21.15.55:0/4140151714 shutdown_connections 2024-04-25T09:03:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.292+0000 7fe0873aa740 1 -- 172.21.15.55:0/4140151714 wait complete. 2024-04-25T09:03:17.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.292+0000 7fe0873aa740 1 -- start start 2024-04-25T09:03:17.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.293+0000 7fe0873aa740 1 Processor -- start 2024-04-25T09:03:17.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.293+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c14781a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.293+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760ef0 0x561c14757090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.293+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c147575d0 0x561c14765d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.293+0000 7fe0873aa740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c14738b90 con 0x561c14760ef0 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.293+0000 7fe0873aa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c1463b4b0 con 0x561c14760b10 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.293+0000 7fe0873aa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c14738e70 con 0x561c147575d0 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe0873aa740 10 client.0 _ll_register_callbacks cb 0x561c1467b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe081c47640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760ef0 0x561c14757090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe081c47640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760ef0 0x561c14757090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58596/0 (socket says 172.21.15.55:58596) 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe081c47640 1 -- 172.21.15.55:0/4022020897 learned_addr learned my addr 172.21.15.55:0/4022020897 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe082448640 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c14781a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe082c49640 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c147575d0 0x561c14765d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe081c47640 1 -- 172.21.15.55:0/4022020897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c147575d0 msgr2=0x561c14765d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe081c47640 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c147575d0 0x561c14765d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe081c47640 1 -- 172.21.15.55:0/4022020897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 msgr2=0x561c14781a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe081c47640 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c14781a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe081c47640 1 -- 172.21.15.55:0/4022020897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c1447b7d0 con 0x561c14760ef0 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe081c47640 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760ef0 0x561c14757090 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0048d0 tx=0x7fe06c004cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9466271d2bc3a50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe05d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe05d7fa640 1 -- 172.21.15.55:0/4022020897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c004e00 con 0x561c14760ef0 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe05d7fa640 1 -- 172.21.15.55:0/4022020897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe06c00db20 con 0x561c14760ef0 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe0873aa740 1 -- 172.21.15.55:0/4022020897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe0740079e0 con 0x561c14760ef0 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe05d7fa640 1 -- 172.21.15.55:0/4022020897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe06c029050 con 0x561c14760ef0 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.294+0000 7fe0873aa740 10 client.8733 fetch_fsmap learned FSMap version 78 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe0873aa740 1 -- 172.21.15.55:0/4022020897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x561c143b13f0 con 0x561c14760ef0 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe05d7fa640 1 -- 172.21.15.55:0/4022020897 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0740079e0 con 0x561c14760ef0 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe05d7fa640 1 -- 172.21.15.55:0/4022020897 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe06c02c020 con 0x561c14760ef0 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe0873aa740 10 client.8733 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:03:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe0873aa740 10 client.8733 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe0873aa740 20 client.8733 populate_metadata read hostname 'smithi055' 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe0873aa740 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x561c14791ed0 0x561c147922b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe0873aa740 4 client.8733 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe0873aa740 1 -- 172.21.15.55:0/4022020897 --> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c146aa2e0 con 0x561c14791ed0 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe082448640 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x561c14791ed0 0x561c147922b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe05d7fa640 10 client.8733 ms_handle_connect on v2:172.21.15.55:6834/3048692204 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.295+0000 7fe082448640 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x561c14791ed0 0x561c147922b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45ebd4dfe41b356c server_cookie=21e7ff2384a15c7 in_seq=0 out_seq=0 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe05d7fa640 1 -- 172.21.15.55:0/4022020897 <== mds.0 v2:172.21.15.55:6834/3048692204 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561c146aa2e0 con 0x561c14791ed0 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe05d7fa640 10 client.8733 handle_command_reply: tid=0 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 1 client.8733 shutdown 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 1 -- 172.21.15.55:0/4022020897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760ef0 msgr2=0x561c14757090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760ef0 0x561c14757090 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0048d0 tx=0x7fe06c004cd0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 1 -- 172.21.15.55:0/4022020897 shutdown_connections 2024-04-25T09:03:17.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x561c14791ed0 0x561c147922b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c147575d0 0x561c14765d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760ef0 0x561c14757090 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 1 --2- 172.21.15.55:0/4022020897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c14781a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe05d7fa640 0 client.8733 ms_handle_reset on v2:172.21.15.55:6834/3048692204 2024-04-25T09:03:17.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 1 -- 172.21.15.55:0/4022020897 >> 172.21.15.55:0/4022020897 conn(0x561c14733770 msgr2=0x561c1475ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 1 -- 172.21.15.55:0/4022020897 shutdown_connections 2024-04-25T09:03:17.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 1 -- 172.21.15.55:0/4022020897 wait complete. 2024-04-25T09:03:17.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.296+0000 7fe0873aa740 20 client.8733 trim_cache size 0 max 16384 2024-04-25T09:03:17.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.312+0000 7fe0873aa740 1 Processor -- start 2024-04-25T09:03:17.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.312+0000 7fe0873aa740 1 -- start start 2024-04-25T09:03:17.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.312+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c147575d0 0x561c14732600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.312+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760b10 0x561c1475f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.312+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 0x561c1475f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.312+0000 7fe0873aa740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c1ffee0 con 0x561c14760b10 2024-04-25T09:03:17.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.312+0000 7fe0873aa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c1f7d30 con 0x561c147575d0 2024-04-25T09:03:17.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.312+0000 7fe0873aa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0c9df0 con 0x561c14760ef0 2024-04-25T09:03:17.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.312+0000 7fe081c47640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760b10 0x561c1475f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.312+0000 7fe081c47640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760b10 0x561c1475f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58598/0 (socket says 172.21.15.55:58598) 2024-04-25T09:03:17.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.312+0000 7fe081c47640 1 -- 172.21.15.55:0/3619750518 learned_addr learned my addr 172.21.15.55:0/3619750518 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:17.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.313+0000 7fe082448640 1 --2- 172.21.15.55:0/3619750518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c147575d0 0x561c14732600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.313+0000 7fe081c47640 1 -- 172.21.15.55:0/3619750518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 msgr2=0x561c1475f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.313+0000 7fe082c49640 1 --2- 172.21.15.55:0/3619750518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 0x561c1475f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.313+0000 7fe081c47640 1 --2- 172.21.15.55:0/3619750518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 0x561c1475f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.313+0000 7fe081c47640 1 -- 172.21.15.55:0/3619750518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c147575d0 msgr2=0x561c14732600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.313+0000 7fe081c47640 1 --2- 172.21.15.55:0/3619750518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c147575d0 0x561c14732600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.313+0000 7fe081c47640 1 -- 172.21.15.55:0/3619750518 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c143710f0 con 0x561c14760b10 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.313+0000 7fe081c47640 1 --2- 172.21.15.55:0/3619750518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760b10 0x561c1475f190 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0048a0 tx=0x7fe06c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71334b2af84c77ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.313+0000 7fe05f7fe640 1 -- 172.21.15.55:0/3619750518 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c003aa0 con 0x561c14760b10 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.313+0000 7fe05f7fe640 1 -- 172.21.15.55:0/3619750518 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c00db20 con 0x561c14760b10 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.313+0000 7fe05f7fe640 1 -- 172.21.15.55:0/3619750518 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c021630 con 0x561c14760b10 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.314+0000 7fe0873aa740 1 -- 172.21.15.55:0/3619750518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760b10 msgr2=0x561c1475f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.314+0000 7fe0873aa740 1 --2- 172.21.15.55:0/3619750518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760b10 0x561c1475f190 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0048a0 tx=0x7fe06c018000 comp rx=0 tx=0).stop 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.314+0000 7fe0873aa740 1 -- 172.21.15.55:0/3619750518 shutdown_connections 2024-04-25T09:03:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.314+0000 7fe0873aa740 1 --2- 172.21.15.55:0/3619750518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 0x561c1475f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.314+0000 7fe0873aa740 1 --2- 172.21.15.55:0/3619750518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c14760b10 0x561c1475f190 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.314+0000 7fe0873aa740 1 --2- 172.21.15.55:0/3619750518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c147575d0 0x561c14732600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.314+0000 7fe0873aa740 1 -- 172.21.15.55:0/3619750518 >> 172.21.15.55:0/3619750518 conn(0x561c14733770 msgr2=0x561c1477f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.314+0000 7fe0873aa740 1 -- 172.21.15.55:0/3619750518 shutdown_connections 2024-04-25T09:03:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.314+0000 7fe0873aa740 1 -- 172.21.15.55:0/3619750518 wait complete. 2024-04-25T09:03:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.314+0000 7fe0873aa740 1 -- start start 2024-04-25T09:03:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.314+0000 7fe0873aa740 1 Processor -- start 2024-04-25T09:03:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.315+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c147575d0 0x561c1475f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.315+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c1475f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.315+0000 7fe0873aa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 0x561c14755450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.315+0000 7fe0873aa740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c14765270 con 0x561c147575d0 2024-04-25T09:03:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.315+0000 7fe0873aa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c1f7730 con 0x561c14760b10 2024-04-25T09:03:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.315+0000 7fe0873aa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c14739cf0 con 0x561c14760ef0 2024-04-25T09:03:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.315+0000 7fe0873aa740 10 client.0 _ll_register_callbacks cb 0x7fe074009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.315+0000 7fe082448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c147575d0 0x561c1475f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.315+0000 7fe082448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c147575d0 0x561c1475f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58612/0 (socket says 172.21.15.55:58612) 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.315+0000 7fe082448640 1 -- 172.21.15.55:0/2951041630 learned_addr learned my addr 172.21.15.55:0/2951041630 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe082c49640 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 0x561c14755450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe081c47640 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c1475f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe082448640 1 -- 172.21.15.55:0/2951041630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 msgr2=0x561c14755450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe082448640 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 0x561c14755450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe082448640 1 -- 172.21.15.55:0/2951041630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 msgr2=0x561c1475f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe082448640 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c1475f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe082448640 1 -- 172.21.15.55:0/2951041630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c1472f260 con 0x561c147575d0 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe081c47640 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c1475f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe082448640 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c147575d0 0x561c1475f170 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe0780579d0 tx=0x7fe07801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1eac48df09e3cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe05d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe05d7fa640 1 -- 172.21.15.55:0/2951041630 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078055fd0 con 0x561c147575d0 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe05d7fa640 1 -- 172.21.15.55:0/2951041630 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe078054340 con 0x561c147575d0 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe0873aa740 1 -- 172.21.15.55:0/2951041630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe06c00db20 con 0x561c147575d0 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe05d7fa640 1 -- 172.21.15.55:0/2951041630 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe078076050 con 0x561c147575d0 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe0873aa740 10 client.8739 fetch_fsmap learned FSMap version 78 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe0873aa740 1 -- 172.21.15.55:0/2951041630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x561c147561c0 con 0x561c147575d0 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe05d7fa640 1 -- 172.21.15.55:0/2951041630 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c00db20 con 0x561c147575d0 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.316+0000 7fe05d7fa640 1 -- 172.21.15.55:0/2951041630 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe078007490 con 0x561c147575d0 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 10 client.8739 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 10 client.8739 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 20 client.8739 populate_metadata read hostname 'smithi055' 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x561c147a11f0 0x561c14755990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 4 client.8739 mds_command: new command op to 8601 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 1 -- 172.21.15.55:0/2951041630 --> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561c146a4630 con 0x561c147a11f0 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe081c47640 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x561c147a11f0 0x561c14755990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe05d7fa640 10 client.8739 ms_handle_connect on v2:172.21.15.55:6834/3048692204 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe081c47640 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x561c147a11f0 0x561c14755990 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce0cb4200fdbd518 server_cookie=31c4ccfa97c82642 in_seq=0 out_seq=0 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe05d7fa640 1 -- 172.21.15.55:0/2951041630 <== mds.0 v2:172.21.15.55:6834/3048692204 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561c146a4630 con 0x561c147a11f0 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe05d7fa640 10 client.8739 handle_command_reply: tid=0 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 1 client.8739 shutdown 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 1 -- 172.21.15.55:0/2951041630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c147575d0 msgr2=0x561c1475f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c147575d0 0x561c1475f170 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe0780579d0 tx=0x7fe07801e040 comp rx=0 tx=0).stop 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 1 -- 172.21.15.55:0/2951041630 shutdown_connections 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.55:6834/3048692204,v1:172.21.15.55:6837/3048692204] conn(0x561c147a11f0 0x561c14755990 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561c14760ef0 0x561c14755450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561c14760b10 0x561c1475f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 1 --2- 172.21.15.55:0/2951041630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c147575d0 0x561c1475f170 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe05d7fa640 0 client.8739 ms_handle_reset on v2:172.21.15.55:6834/3048692204 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.317+0000 7fe0873aa740 1 -- 172.21.15.55:0/2951041630 >> 172.21.15.55:0/2951041630 conn(0x561c14733770 msgr2=0x561c14786020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0873aa740 1 -- 172.21.15.55:0/2951041630 shutdown_connections 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0873aa740 1 -- 172.21.15.55:0/2951041630 wait complete. 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0873aa740 20 client.8739 trim_cache size 0 max 16384 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:03:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 -- 172.21.15.55:0/785414270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe06006b4d0 msgr2=0x7fe06006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe06006b4d0 0x7fe06006d990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe07c0c9310 tx=0x7fe06c009040 comp rx=0 tx=0).stop 2024-04-25T09:03:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 -- 172.21.15.55:0/785414270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0d1130 msgr2=0x7fe07c1568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0d1130 0x7fe07c1568e0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fe07800c3c0 tx=0x7fe07800c880 comp rx=0 tx=0).stop 2024-04-25T09:03:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 -- 172.21.15.55:0/785414270 shutdown_connections 2024-04-25T09:03:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe06006b4d0 0x7fe06006d990 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe07c15dca0 0x7fe07c0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe07c0d3b90 0x7fe07c0c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 --2- 172.21.15.55:0/785414270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0d1130 0x7fe07c1568e0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 -- 172.21.15.55:0/785414270 >> 172.21.15.55:0/785414270 conn(0x7fe07c0726c0 msgr2=0x7fe07c0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 -- 172.21.15.55:0/785414270 shutdown_connections 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.318+0000 7fe0846ac640 1 -- 172.21.15.55:0/785414270 wait complete. 2024-04-25T09:03:17.318 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:03:17.419 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:03:17.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.533+0000 7f974bb70640 1 Processor -- start 2024-04-25T09:03:17.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.533+0000 7f974bb70640 1 -- start start 2024-04-25T09:03:17.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974bb70640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9744071590 0x7f97440cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974bb70640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f97440cd940 0x7f97440ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974bb70640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974406c220 con 0x7f974415dc50 2024-04-25T09:03:17.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974bb70640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97440cfe00 con 0x7f97440cd940 2024-04-25T09:03:17.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974bb70640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97440cec10 con 0x7f9744071590 2024-04-25T09:03:17.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974990c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f974415dc50 0x7f9744070e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48950/0 (socket says 172.21.15.55:48950) 2024-04-25T09:03:17.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974990c640 1 -- 172.21.15.55:0/1027593231 learned_addr learned my addr 172.21.15.55:0/1027593231 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:17.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974a10d640 1 --2- 172.21.15.55:0/1027593231 >> v2:172.21.15.167:3300/0 conn(0x7f97440cd940 0x7f97440ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719006946 0 0) 0x7f974406c220 con 0x7f974415dc50 2024-04-25T09:03:17.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974910b640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9744071590 0x7f97440cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9730003520 con 0x7f974415dc50 2024-04-25T09:03:17.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 831620520 0 0) 0x7f9730003520 con 0x7f974415dc50 2024-04-25T09:03:17.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9744071590 msgr2=0x7f97440cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9744071590 0x7f97440cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 >> v2:172.21.15.167:3300/0 conn(0x7f97440cd940 msgr2=0x7f97440ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 --2- 172.21.15.55:0/1027593231 >> v2:172.21.15.167:3300/0 conn(0x7f97440cd940 0x7f97440ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97440d0050 con 0x7f974415dc50 2024-04-25T09:03:17.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f9740001670 con 0x7f974415dc50 2024-04-25T09:03:17.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 >> v1:172.21.15.55:6789/0 conn(0x7f974415dc50 legacy=0x7f9744070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9744071590 0x7f97300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9730003f30 0x7f9730004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 0x7f97300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440cfe00 con 0x7f9730004d40 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440cec10 con 0x7f9730003f30 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.534+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973000b9c0 con 0x7f9744071590 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.535+0000 7f974a10d640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 0x7f97300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.535+0000 7f974910b640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9730003f30 0x7f9730004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.535+0000 7f974990c640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9744071590 0x7f97300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.535+0000 7f974a10d640 1 -- 172.21.15.55:0/1027593231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9744071590 msgr2=0x7f97300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.535+0000 7f974a10d640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9744071590 0x7f97300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.535+0000 7f974a10d640 1 -- 172.21.15.55:0/1027593231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9730003f30 msgr2=0x7f9730004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.535+0000 7f974a10d640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9730003f30 0x7f9730004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.535+0000 7f974a10d640 1 -- 172.21.15.55:0/1027593231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9730003520 con 0x7f9730004d40 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.536+0000 7f974a10d640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 0x7f97300051c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f973c009fc0 tx=0x7f9730005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5afc839f8485652 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.536+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c009c10 con 0x7f9730004d40 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.536+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c036070 con 0x7f9730004d40 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.536+0000 7f974890a640 1 -- 172.21.15.55:0/1027593231 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c02d070 con 0x7f9730004d40 2024-04-25T09:03:17.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.536+0000 7f974bb70640 1 -- 172.21.15.55:0/1027593231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 msgr2=0x7f97300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.536+0000 7f974bb70640 1 --2- 172.21.15.55:0/1027593231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 0x7f97300051c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f973c009fc0 tx=0x7f9730005830 comp rx=0 tx=0).stop 2024-04-25T09:03:17.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.536+0000 7f974a10d640 1 -- 172.21.15.55:0/1027593231 reap_dead start 2024-04-25T09:03:17.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.536+0000 7f974bb70640 1 -- 172.21.15.55:0/1027593231 shutdown_connections 2024-04-25T09:03:17.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.536+0000 7f974bb70640 1 -- 172.21.15.55:0/1027593231 >> 172.21.15.55:0/1027593231 conn(0x7f974406f430 msgr2=0x7f974406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.536+0000 7f974bb70640 1 -- 172.21.15.55:0/1027593231 shutdown_connections 2024-04-25T09:03:17.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.536+0000 7f974bb70640 1 -- 172.21.15.55:0/1027593231 wait complete. 2024-04-25T09:03:17.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.538+0000 7f974bb70640 1 Processor -- start 2024-04-25T09:03:17.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.538+0000 7f974bb70640 1 -- start start 2024-04-25T09:03:17.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.538+0000 7f974bb70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 0x7f974415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.538+0000 7f974bb70640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9744156e10 0x7f97440c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.538+0000 7f974bb70640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97440c6370 0x7f97440caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.538+0000 7f974bb70640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440ce8a0 con 0x7f9730004d40 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.538+0000 7f974bb70640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440cc0c0 con 0x7f9744156e10 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.538+0000 7f974bb70640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974415e030 con 0x7f97440c6370 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.538+0000 7f974990c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 0x7f974415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.538+0000 7f974990c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 0x7f974415ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58632/0 (socket says 172.21.15.55:58632) 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.538+0000 7f974990c640 1 -- 172.21.15.55:0/3297767534 learned_addr learned my addr 172.21.15.55:0/3297767534 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f974990c640 1 -- 172.21.15.55:0/3297767534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97440c6370 msgr2=0x7f97440caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f974990c640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97440c6370 0x7f97440caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f974990c640 1 -- 172.21.15.55:0/3297767534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9744156e10 msgr2=0x7f97440c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f974910b640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9744156e10 0x7f97440c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f974990c640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9744156e10 0x7f97440c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f974990c640 1 -- 172.21.15.55:0/3297767534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97440b4690 con 0x7f9730004d40 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f974990c640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 0x7f974415ab60 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f9740007290 tx=0x7f9740007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f973a7fc640 1 -- 172.21.15.55:0/3297767534 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974000f960 con 0x7f9730004d40 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f973a7fc640 1 -- 172.21.15.55:0/3297767534 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740018070 con 0x7f9730004d40 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f974bb70640 1 -- 172.21.15.55:0/3297767534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97440c69a0 con 0x7f9730004d40 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f973a7fc640 1 -- 172.21.15.55:0/3297767534 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974000fd20 con 0x7f9730004d40 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.539+0000 7f974bb70640 1 -- 172.21.15.55:0/3297767534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97440b5c50 con 0x7f9730004d40 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.540+0000 7f974bb70640 1 -- 172.21.15.55:0/3297767534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97440750b0 con 0x7f9730004d40 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.541+0000 7f973a7fc640 1 -- 172.21.15.55:0/3297767534 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f974001d460 con 0x7f9730004d40 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.541+0000 7f973a7fc640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f972806b500 0x7f972806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.541+0000 7f973a7fc640 1 -- 172.21.15.55:0/3297767534 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f974008a260 con 0x7f9730004d40 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.541+0000 7f974910b640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f972806b500 0x7f972806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.541+0000 7f974910b640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f972806b500 0x7f972806d9c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f97440cb690 tx=0x7f9734008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.545+0000 7f973a7fc640 1 -- 172.21.15.55:0/3297767534 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9740059110 con 0x7f9730004d40 2024-04-25T09:03:17.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.763+0000 7f974bb70640 1 -- 172.21.15.55:0/3297767534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f974406c220 con 0x7f9730004d40 2024-04-25T09:03:17.752 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T09:03:17.763+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:03:17.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.769+0000 7f973a7fc640 1 -- 172.21.15.55:0/3297767534 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9740058a10 con 0x7f9730004d40 2024-04-25T09:03:17.757 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 -- 172.21.15.55:0/3297767534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f972806b500 msgr2=0x7f972806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f972806b500 0x7f972806d9c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f97440cb690 tx=0x7f9734008040 comp rx=0 tx=0).stop 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 -- 172.21.15.55:0/3297767534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 msgr2=0x7f974415ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 0x7f974415ab60 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f9740007290 tx=0x7f9740007750 comp rx=0 tx=0).stop 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 -- 172.21.15.55:0/3297767534 shutdown_connections 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f972806b500 0x7f972806d9c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97440c6370 0x7f97440caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9744156e10 0x7f97440c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 --2- 172.21.15.55:0/3297767534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9730004d40 0x7f974415ab60 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 -- 172.21.15.55:0/3297767534 >> 172.21.15.55:0/3297767534 conn(0x7f974406f430 msgr2=0x7f9744070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 -- 172.21.15.55:0/3297767534 shutdown_connections 2024-04-25T09:03:17.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.771+0000 7f974bb70640 1 -- 172.21.15.55:0/3297767534 wait complete. 2024-04-25T09:03:17.761 INFO:tasks.ceph.mds.c.smithi055.stderr: -1148> 2024-04-25T09:02:46.996+0000 7f5586f22640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T09:03:17.761 INFO:tasks.ceph.mds.c.smithi055.stderr: -1145> 2024-04-25T09:02:46.996+0000 7f5586f22640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T09:03:17.762 INFO:tasks.ceph.mds.c.smithi055.stderr: -1129> 2024-04-25T09:02:46.996+0000 7f5586f22640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T09:03:17.762 INFO:tasks.ceph.mds.c.smithi055.stderr: -1126> 2024-04-25T09:02:46.996+0000 7f5586f22640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T09:03:17.762 INFO:tasks.ceph.mds.c.smithi055.stderr: -1000> 2024-04-25T09:02:47.397+0000 7f558af2a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:03:17.772 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-04-25T09:03:17.788 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T09:03:17.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.824+0000 7f3f9071e280 1 -- start start 2024-04-25T09:03:17.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.824+0000 7f3f9071e280 1 Processor -- start 2024-04-25T09:03:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.824+0000 7f3f9071e280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1056c00 0x5569e10c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.824+0000 7f3f9071e280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1057800 0x5569e10c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.824+0000 7f3f9071e280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1057c00 0x5569e10c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.824+0000 7f3f9071e280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e1f0c180 con 0x5569e1057800 2024-04-25T09:03:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.824+0000 7f3f9071e280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e1f0c300 con 0x5569e1056c00 2024-04-25T09:03:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.824+0000 7f3f9071e280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569e1f0c480 con 0x5569e1057c00 2024-04-25T09:03:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.824+0000 7f3f8dc28640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1057800 0x5569e10c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8dc28640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1057800 0x5569e10c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58648/0 (socket says 172.21.15.55:58648) 2024-04-25T09:03:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8dc28640 1 -- 172.21.15.55:0/498243447 learned_addr learned my addr 172.21.15.55:0/498243447 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8dc28640 1 -- 172.21.15.55:0/498243447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1057c00 msgr2=0x5569e10c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8ec2a640 1 --2- 172.21.15.55:0/498243447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1057c00 0x5569e10c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8e429640 1 --2- 172.21.15.55:0/498243447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1056c00 0x5569e10c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8dc28640 1 --2- 172.21.15.55:0/498243447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1057c00 0x5569e10c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8dc28640 1 -- 172.21.15.55:0/498243447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1056c00 msgr2=0x5569e10c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8dc28640 1 --2- 172.21.15.55:0/498243447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1056c00 0x5569e10c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8dc28640 1 -- 172.21.15.55:0/498243447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569e108c780 con 0x5569e1057800 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8dc28640 1 --2- 172.21.15.55:0/498243447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1057800 0x5569e10c6b00 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x5569e1e79110 tx=0x5569e1f18120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab192f07d85b6d02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8bc24640 1 -- 172.21.15.55:0/498243447 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5569e107c9c0 con 0x5569e1057800 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8bc24640 1 -- 172.21.15.55:0/498243447 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569e1082fc0 con 0x5569e1057800 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8bc24640 1 -- 172.21.15.55:0/498243447 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5569e107c680 con 0x5569e1057800 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f9071e280 1 -- 172.21.15.55:0/498243447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569e108d4a0 con 0x5569e1057800 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f9071e280 1 -- 172.21.15.55:0/498243447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5569e108c000 con 0x5569e1057800 2024-04-25T09:03:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f9071e280 4 waiting for MDS map... 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8bc24640 1 -- 172.21.15.55:0/498243447 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x5569e1f22600 con 0x5569e1057800 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f8bc24640 1 -- 172.21.15.55:0/498243447 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 79) v1 ==== 2723+0+0 (secure 0 0 0) 0x5569e10b1180 con 0x5569e1057800 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.825+0000 7f3f9071e280 4 Got MDS map 79 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.826+0000 7f3f9071e280 10 main: main 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.826+0000 7f3f9071e280 4 main: connecting to RADOS... 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.826+0000 7f3f9071e280 1 Processor -- start 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.826+0000 7f3f9071e280 1 -- start start 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f9071e280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3bc00 0x5569e10c7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f9071e280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1f78000 0x5569e10c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f9071e280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1f78400 0x5569e10c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f9071e280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e1f0c600 con 0x5569e1e3bc00 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f9071e280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e1f0c780 con 0x5569e1f78400 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f9071e280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569e1f0c900 con 0x5569e1f78000 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8ec2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3bc00 0x5569e10c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8ec2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3bc00 0x5569e10c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58656/0 (socket says 172.21.15.55:58656) 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8ec2a640 1 -- 172.21.15.55:0/1553756928 learned_addr learned my addr 172.21.15.55:0/1553756928 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8e429640 1 --2- 172.21.15.55:0/1553756928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1f78000 0x5569e10c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8ec2a640 1 -- 172.21.15.55:0/1553756928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1f78000 msgr2=0x5569e10c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8ec2a640 1 --2- 172.21.15.55:0/1553756928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1f78000 0x5569e10c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8ec2a640 1 -- 172.21.15.55:0/1553756928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1f78400 msgr2=0x5569e10c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8dc28640 1 --2- 172.21.15.55:0/1553756928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1f78400 0x5569e10c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8ec2a640 1 --2- 172.21.15.55:0/1553756928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1f78400 0x5569e10c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8ec2a640 1 -- 172.21.15.55:0/1553756928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569e108c3c0 con 0x5569e1e3bc00 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8e429640 1 --2- 172.21.15.55:0/1553756928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1f78000 0x5569e10c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8dc28640 1 --2- 172.21.15.55:0/1553756928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1f78400 0x5569e10c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f8ec2a640 1 --2- 172.21.15.55:0/1553756928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3bc00 0x5569e10c7600 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x5569e1f321e0 tx=0x5569e1f8c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf72c07a0fad247b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f89c20640 1 -- 172.21.15.55:0/1553756928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5569e107c9c0 con 0x5569e1e3bc00 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f89c20640 1 -- 172.21.15.55:0/1553756928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569e1082c40 con 0x5569e1e3bc00 2024-04-25T09:03:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.827+0000 7f3f89c20640 1 -- 172.21.15.55:0/1553756928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5569e107c680 con 0x5569e1e3bc00 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.828+0000 7f3f9071e280 1 -- 172.21.15.55:0/1553756928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3bc00 msgr2=0x5569e10c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.828+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1553756928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3bc00 0x5569e10c7600 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x5569e1f321e0 tx=0x5569e1f8c000 comp rx=0 tx=0).stop 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.828+0000 7f3f9071e280 1 -- 172.21.15.55:0/1553756928 shutdown_connections 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.828+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1553756928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1f78400 0x5569e10c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.828+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1553756928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1f78000 0x5569e10c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.828+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1553756928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3bc00 0x5569e10c7600 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.828+0000 7f3f9071e280 1 -- 172.21.15.55:0/1553756928 >> 172.21.15.55:0/1553756928 conn(0x5569e1e3b800 msgr2=0x5569e113f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.828+0000 7f3f9071e280 1 -- 172.21.15.55:0/1553756928 shutdown_connections 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.828+0000 7f3f9071e280 1 -- 172.21.15.55:0/1553756928 wait complete. 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.828+0000 7f3f9071e280 1 Processor -- start 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.828+0000 7f3f9071e280 1 -- start start 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f9071e280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3b800 0x5569e10c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f9071e280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1f79000 0x5569e10c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f9071e280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1f78c00 0x5569e10c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f9071e280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e1f0dc80 con 0x5569e1e3b800 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f9071e280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e1f0db00 con 0x5569e1f78c00 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f9071e280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569e1f0d980 con 0x5569e1f79000 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f8ec2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3b800 0x5569e10c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f8ec2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3b800 0x5569e10c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58664/0 (socket says 172.21.15.55:58664) 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f8ec2a640 1 -- 172.21.15.55:0/1466719311 learned_addr learned my addr 172.21.15.55:0/1466719311 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f8dc28640 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1f78c00 0x5569e10c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f8e429640 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1f79000 0x5569e10c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f8ec2a640 1 -- 172.21.15.55:0/1466719311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1f79000 msgr2=0x5569e10c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f8ec2a640 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1f79000 0x5569e10c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f8ec2a640 1 -- 172.21.15.55:0/1466719311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1f78c00 msgr2=0x5569e10c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f8ec2a640 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1f78c00 0x5569e10c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.829+0000 7f3f8ec2a640 1 -- 172.21.15.55:0/1466719311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569e108c960 con 0x5569e1e3b800 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.830+0000 7f3f8ec2a640 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3b800 0x5569e10c9180 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x5569e1f33320 tx=0x5569e1de9620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.830+0000 7f3f8841d640 1 -- 172.21.15.55:0/1466719311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5569e107c4e0 con 0x5569e1e3b800 2024-04-25T09:03:17.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.830+0000 7f3f8841d640 1 -- 172.21.15.55:0/1466719311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569e10821c0 con 0x5569e1e3b800 2024-04-25T09:03:17.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.830+0000 7f3f9071e280 1 -- 172.21.15.55:0/1466719311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5569e108d680 con 0x5569e1e3b800 2024-04-25T09:03:17.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.830+0000 7f3f8841d640 1 -- 172.21.15.55:0/1466719311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5569e107c9c0 con 0x5569e1e3b800 2024-04-25T09:03:17.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.830+0000 7f3f9071e280 1 -- 172.21.15.55:0/1466719311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569e108d860 con 0x5569e1e3b800 2024-04-25T09:03:17.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.830+0000 7f3f9071e280 4 main: resolving pool 14 2024-04-25T09:03:17.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.831+0000 7f3f8841d640 1 -- 172.21.15.55:0/1466719311 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x5569e1f88c00 con 0x5569e1e3b800 2024-04-25T09:03:17.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.831+0000 7f3f8841d640 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5569e13b2000 0x5569e10c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.831+0000 7f3f8841d640 1 -- 172.21.15.55:0/1466719311 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x5569e1f7f400 con 0x5569e1e3b800 2024-04-25T09:03:17.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.831+0000 7f3f9071e280 4 main: creating IoCtx.. 2024-04-25T09:03:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.831+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5569e1f78800 0x5569e10c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.831+0000 7f3f8e429640 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5569e13b2000 0x5569e10c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.831+0000 7f3f9071e280 1 -- 172.21.15.55:0/1466719311 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) v9 -- 0x5569e1f78400 con 0x5569e1f78800 2024-04-25T09:03:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.831+0000 7f3f8dc28640 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5569e1f78800 0x5569e10c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.832+0000 7f3f8dc28640 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5569e1f78800 0x5569e10c8100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.832+0000 7f3f8e429640 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5569e13b2000 0x5569e10c9700 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x5569e1132810 tx=0x5569e1f8c360 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.834+0000 7f3f8dc28640 1 -- 172.21.15.55:0/1466719311 <== osd.2 v2:172.21.15.55:6824/2942240833 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5569e1130000 con 0x5569e1f78800 2024-04-25T09:03:17.827 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:03:17.827 INFO:teuthology.orchestra.run.smithi055.stdout: "0": { 2024-04-25T09:03:17.827 INFO:teuthology.orchestra.run.smithi055.stdout: "data": { 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 5, 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: "inotable": { 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: "projected_free": [ 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: "start": 1099511627779, 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: "len": 1099511627773 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: "free": [ 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: "start": 1099511627779, 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: "len": 1099511627773 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:17.828 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:17.829 INFO:teuthology.orchestra.run.smithi055.stdout: "result": 0 2024-04-25T09:03:17.829 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:17.829 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:03:17.829 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:17.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.834+0000 7f3f9071e280 1 -- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5569e1f78800 msgr2=0x5569e10c8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.834+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5569e1f78800 0x5569e10c8100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.834+0000 7f3f9071e280 1 -- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5569e13b2000 msgr2=0x5569e10c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.834+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5569e13b2000 0x5569e10c9700 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x5569e1132810 tx=0x5569e1f8c360 comp rx=0 tx=0).stop 2024-04-25T09:03:17.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 -- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3b800 msgr2=0x5569e10c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3b800 0x5569e10c9180 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x5569e1f33320 tx=0x5569e1de9620 comp rx=0 tx=0).stop 2024-04-25T09:03:17.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 -- 172.21.15.55:0/1466719311 shutdown_connections 2024-04-25T09:03:17.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x5569e1f78800 0x5569e10c8100 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5569e13b2000 0x5569e10c9700 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1f78c00 0x5569e10c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1f79000 0x5569e10c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 --2- 172.21.15.55:0/1466719311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1e3b800 0x5569e10c9180 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 -- 172.21.15.55:0/1466719311 >> 172.21.15.55:0/1466719311 conn(0x5569e1e3bc00 msgr2=0x5569e113f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f8e429640 1 -- 172.21.15.55:0/1466719311 reap_dead start 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 -- 172.21.15.55:0/1466719311 shutdown_connections 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 -- 172.21.15.55:0/1466719311 wait complete. 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 -- 172.21.15.55:0/498243447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1057800 msgr2=0x5569e10c6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 --2- 172.21.15.55:0/498243447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1057800 0x5569e10c6b00 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x5569e1e79110 tx=0x5569e1f18120 comp rx=0 tx=0).stop 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 -- 172.21.15.55:0/498243447 shutdown_connections 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 --2- 172.21.15.55:0/498243447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5569e1057c00 0x5569e10c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 --2- 172.21.15.55:0/498243447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5569e1057800 0x5569e10c6b00 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 --2- 172.21.15.55:0/498243447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569e1056c00 0x5569e10c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 -- 172.21.15.55:0/498243447 >> 172.21.15.55:0/498243447 conn(0x5569e1057000 msgr2=0x5569e113e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 -- 172.21.15.55:0/498243447 shutdown_connections 2024-04-25T09:03:17.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:17.835+0000 7f3f9071e280 1 -- 172.21.15.55:0/498243447 wait complete. 2024-04-25T09:03:17.833 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.061075, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-04-25T09:03:17.833 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:03:17.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:17.907 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:17.954 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:03:17.955 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:17.955 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:17.971 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:17.971 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:03:17.971 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:17.988 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:17.989 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:17.989 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:18.027 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:18.027 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:03:18.027 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:18.045 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:18.045 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.179+0000 7f60a8c4d640 1 Processor -- start 2024-04-25T09:03:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.180+0000 7f60a8c4d640 1 -- start start 2024-04-25T09:03:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.180+0000 7f60a8c4d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60a415dce0 0x7f60a40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.180+0000 7f60a8c4d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a40b5b60 0x7f60a40b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.180+0000 7f60a8c4d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a415e0c0 con 0x7f60a40d35b0 2024-04-25T09:03:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.180+0000 7f60a8c4d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a40d2510 con 0x7f60a415dce0 2024-04-25T09:03:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.180+0000 7f60a8c4d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40d27f0 con 0x7f60a40b5b60 2024-04-25T09:03:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.181+0000 7f60a259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60a415dce0 0x7f60a40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.181+0000 7f60a259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60a415dce0 0x7f60a40d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58668/0 (socket says 172.21.15.55:58668) 2024-04-25T09:03:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.181+0000 7f60a259c640 1 -- 172.21.15.55:0/3516890724 learned_addr learned my addr 172.21.15.55:0/3516890724 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.181+0000 7f60a2d9d640 1 --2- 172.21.15.55:0/3516890724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a40b5b60 0x7f60a40b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.181+0000 7f60a259c640 1 -- 172.21.15.55:0/3516890724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a40b5b60 msgr2=0x7f60a40b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.181+0000 7f60a259c640 1 --2- 172.21.15.55:0/3516890724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a40b5b60 0x7f60a40b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.181+0000 7f60a259c640 1 -- 172.21.15.55:0/3516890724 >> v1:172.21.15.167:6789/0 conn(0x7f60a40d35b0 legacy=0x7f60a40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.181+0000 7f60a259c640 1 -- 172.21.15.55:0/3516890724 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a40d2ad0 con 0x7f60a415dce0 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.182+0000 7f60a259c640 1 --2- 172.21.15.55:0/3516890724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60a415dce0 0x7f60a40d1a50 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f6094009870 tx=0x7f609402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b390ce2e81602a52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.182+0000 7f60a159a640 1 -- 172.21.15.55:0/3516890724 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094037070 con 0x7f60a415dce0 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.182+0000 7f60a159a640 1 -- 172.21.15.55:0/3516890724 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094032440 con 0x7f60a415dce0 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.182+0000 7f60a159a640 1 -- 172.21.15.55:0/3516890724 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094032810 con 0x7f60a415dce0 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.182+0000 7f60a8c4d640 1 -- 172.21.15.55:0/3516890724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60a415dce0 msgr2=0x7f60a40d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.182+0000 7f60a8c4d640 1 --2- 172.21.15.55:0/3516890724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60a415dce0 0x7f60a40d1a50 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f6094009870 tx=0x7f609402a270 comp rx=0 tx=0).stop 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.182+0000 7f60a8c4d640 1 -- 172.21.15.55:0/3516890724 shutdown_connections 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.182+0000 7f60a8c4d640 1 --2- 172.21.15.55:0/3516890724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a40b5b60 0x7f60a40b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.182+0000 7f60a8c4d640 1 --2- 172.21.15.55:0/3516890724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60a415dce0 0x7f60a40d1a50 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.182+0000 7f60a8c4d640 1 -- 172.21.15.55:0/3516890724 >> 172.21.15.55:0/3516890724 conn(0x7f60a4072900 msgr2=0x7f60a40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.183+0000 7f60a8c4d640 1 -- 172.21.15.55:0/3516890724 shutdown_connections 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.183+0000 7f60a8c4d640 1 -- 172.21.15.55:0/3516890724 wait complete. 2024-04-25T09:03:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.184+0000 7f60a8c4d640 1 Processor -- start 2024-04-25T09:03:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.184+0000 7f60a8c4d640 1 -- start start 2024-04-25T09:03:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a8c4d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a40b5b60 0x7f60a414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a8c4d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60a40d35b0 0x7f60a41f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a8c4d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a415dce0 0x7f60a40b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a8c4d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40b9820 con 0x7f60a40d35b0 2024-04-25T09:03:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a8c4d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40d3090 con 0x7f60a415dce0 2024-04-25T09:03:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a8c4d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40b99a0 con 0x7f60a40b5b60 2024-04-25T09:03:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60a40d35b0 0x7f60a41f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60a40d35b0 0x7f60a41f39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58670/0 (socket says 172.21.15.55:58670) 2024-04-25T09:03:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a1d9b640 1 -- 172.21.15.55:0/1166209303 learned_addr learned my addr 172.21.15.55:0/1166209303 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a259c640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a40b5b60 0x7f60a414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a2d9d640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a415dce0 0x7f60a40b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a1d9b640 1 -- 172.21.15.55:0/1166209303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a40b5b60 msgr2=0x7f60a414dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a1d9b640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a40b5b60 0x7f60a414dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a1d9b640 1 -- 172.21.15.55:0/1166209303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a415dce0 msgr2=0x7f60a40b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a1d9b640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a415dce0 0x7f60a40b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a1d9b640 1 -- 172.21.15.55:0/1166209303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4161070 con 0x7f60a40d35b0 2024-04-25T09:03:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a259c640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a40b5b60 0x7f60a414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a2d9d640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a415dce0 0x7f60a40b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a1d9b640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60a40d35b0 0x7f60a41f39f0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f608c00c440 tx=0x7f608c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f609affd640 1 -- 172.21.15.55:0/1166209303 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0052d0 con 0x7f60a40d35b0 2024-04-25T09:03:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f609affd640 1 -- 172.21.15.55:0/1166209303 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c005470 con 0x7f60a40d35b0 2024-04-25T09:03:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f60a8c4d640 1 -- 172.21.15.55:0/1166209303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a40c8dc0 con 0x7f60a40d35b0 2024-04-25T09:03:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.185+0000 7f609affd640 1 -- 172.21.15.55:0/1166209303 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c007260 con 0x7f60a40d35b0 2024-04-25T09:03:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.186+0000 7f60a8c4d640 1 -- 172.21.15.55:0/1166209303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a40c9380 con 0x7f60a40d35b0 2024-04-25T09:03:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.186+0000 7f60a8c4d640 1 -- 172.21.15.55:0/1166209303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a40749b0 con 0x7f60a40d35b0 2024-04-25T09:03:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.187+0000 7f609affd640 1 -- 172.21.15.55:0/1166209303 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f608c007400 con 0x7f60a40d35b0 2024-04-25T09:03:18.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.187+0000 7f609affd640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f608406b4d0 0x7f608406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.187+0000 7f609affd640 1 -- 172.21.15.55:0/1166209303 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f608c089760 con 0x7f60a40d35b0 2024-04-25T09:03:18.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.187+0000 7f60a259c640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f608406b4d0 0x7f608406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.188+0000 7f60a259c640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f608406b4d0 0x7f608406d990 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6094034000 tx=0x7f609402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.191+0000 7f609affd640 1 -- 172.21.15.55:0/1166209303 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f608c0585c0 con 0x7f60a40d35b0 2024-04-25T09:03:18.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.414+0000 7f60a8c4d640 1 -- 172.21.15.55:0/1166209303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60a40c9550 con 0x7f60a40d35b0 2024-04-25T09:03:18.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.414+0000 7f609affd640 1 -- 172.21.15.55:0/1166209303 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f608c057ec0 con 0x7f60a40d35b0 2024-04-25T09:03:18.403 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:18.403 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":79,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:03:17.764577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:18.403 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 79 2024-04-25T09:03:18.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 -- 172.21.15.55:0/1166209303 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f608406b4d0 msgr2=0x7f608406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f608406b4d0 0x7f608406d990 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6094034000 tx=0x7f609402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:18.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 -- 172.21.15.55:0/1166209303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60a40d35b0 msgr2=0x7f60a41f39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60a40d35b0 0x7f60a41f39f0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f608c00c440 tx=0x7f608c001e70 comp rx=0 tx=0).stop 2024-04-25T09:03:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 -- 172.21.15.55:0/1166209303 shutdown_connections 2024-04-25T09:03:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f608406b4d0 0x7f608406d990 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a415dce0 0x7f60a40b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60a40d35b0 0x7f60a41f39f0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 --2- 172.21.15.55:0/1166209303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60a40b5b60 0x7f60a414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 -- 172.21.15.55:0/1166209303 >> 172.21.15.55:0/1166209303 conn(0x7f60a4072900 msgr2=0x7f60a40b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 -- 172.21.15.55:0/1166209303 shutdown_connections 2024-04-25T09:03:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.417+0000 7f60a8c4d640 1 -- 172.21.15.55:0/1166209303 wait complete. 2024-04-25T09:03:18.416 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:18.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.528+0000 7fdecac41640 1 Processor -- start 2024-04-25T09:03:18.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.528+0000 7fdecac41640 1 -- start start 2024-04-25T09:03:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.529+0000 7fdecac41640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdec40d35b0 0x7fdec40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.529+0000 7fdecac41640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdec40b5990 0x7fdec40b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.529+0000 7fdecac41640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec415e0c0 con 0x7fdec415dce0 2024-04-25T09:03:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.529+0000 7fdecac41640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec40d2510 con 0x7fdec40b5990 2024-04-25T09:03:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.529+0000 7fdecac41640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec40d27f0 con 0x7fdec40d35b0 2024-04-25T09:03:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.529+0000 7fdec91de640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdec40b5990 0x7fdec40b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.529+0000 7fdec89dd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdec415dce0 0x7fdec40d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48974/0 (socket says 172.21.15.55:48974) 2024-04-25T09:03:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.529+0000 7fdec89dd640 1 -- 172.21.15.55:0/4231806716 learned_addr learned my addr 172.21.15.55:0/4231806716 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.530+0000 7fdec91de640 1 -- 172.21.15.55:0/4231806716 >> v2:172.21.15.167:3300/0 conn(0x7fdec40d35b0 msgr2=0x7fdec40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.530+0000 7fdec3fff640 1 --2- 172.21.15.55:0/4231806716 >> v2:172.21.15.167:3300/0 conn(0x7fdec40d35b0 0x7fdec40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.530+0000 7fdec37fe640 1 -- 172.21.15.55:0/4231806716 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171794854 0 0) 0x7fdec415e0c0 con 0x7fdec415dce0 2024-04-25T09:03:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.530+0000 7fdec91de640 1 --2- 172.21.15.55:0/4231806716 >> v2:172.21.15.167:3300/0 conn(0x7fdec40d35b0 0x7fdec40b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.530+0000 7fdec91de640 1 -- 172.21.15.55:0/4231806716 >> v1:172.21.15.55:6789/0 conn(0x7fdec415dce0 legacy=0x7fdec40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.530+0000 7fdec91de640 1 -- 172.21.15.55:0/4231806716 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40d2ad0 con 0x7fdec40b5990 2024-04-25T09:03:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.530+0000 7fdec3fff640 1 --2- 172.21.15.55:0/4231806716 >> v2:172.21.15.167:3300/0 conn(0x7fdec40d35b0 0x7fdec40b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.530+0000 7fdec91de640 1 --2- 172.21.15.55:0/4231806716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec40b5990 0x7fdec40b6b00 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fdec40cdfa0 tx=0x7fdeb402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ff4b39e74c3226 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.531+0000 7fdec37fe640 1 -- 172.21.15.55:0/4231806716 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4037070 con 0x7fdec40b5990 2024-04-25T09:03:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.531+0000 7fdec37fe640 1 -- 172.21.15.55:0/4231806716 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb4032440 con 0x7fdec40b5990 2024-04-25T09:03:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.531+0000 7fdec37fe640 1 -- 172.21.15.55:0/4231806716 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4032810 con 0x7fdec40b5990 2024-04-25T09:03:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.531+0000 7fdecac41640 1 -- 172.21.15.55:0/4231806716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec40b5990 msgr2=0x7fdec40b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.531+0000 7fdecac41640 1 --2- 172.21.15.55:0/4231806716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec40b5990 0x7fdec40b6b00 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fdec40cdfa0 tx=0x7fdeb402a1a0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.531+0000 7fdecac41640 1 -- 172.21.15.55:0/4231806716 shutdown_connections 2024-04-25T09:03:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.531+0000 7fdecac41640 1 --2- 172.21.15.55:0/4231806716 >> v2:172.21.15.167:3300/0 conn(0x7fdec40d35b0 0x7fdec40b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.531+0000 7fdecac41640 1 --2- 172.21.15.55:0/4231806716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec40b5990 0x7fdec40b6b00 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.531+0000 7fdecac41640 1 -- 172.21.15.55:0/4231806716 >> 172.21.15.55:0/4231806716 conn(0x7fdec4072900 msgr2=0x7fdec40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.531+0000 7fdecac41640 1 -- 172.21.15.55:0/4231806716 shutdown_connections 2024-04-25T09:03:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.531+0000 7fdecac41640 1 -- 172.21.15.55:0/4231806716 wait complete. 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.532+0000 7fdecac41640 1 Processor -- start 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.532+0000 7fdecac41640 1 -- start start 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.533+0000 7fdecac41640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdec40b5990 0x7fdec415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.533+0000 7fdecac41640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec40d35b0 0x7fdec40aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.533+0000 7fdecac41640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec415dce0 0x7fdec40c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.533+0000 7fdecac41640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40d2160 con 0x7fdec40d35b0 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.533+0000 7fdecac41640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40d3090 con 0x7fdec415dce0 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.533+0000 7fdecac41640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40aba10 con 0x7fdec40b5990 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.533+0000 7fdec3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec40d35b0 0x7fdec40aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.533+0000 7fdec3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec40d35b0 0x7fdec40aa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58684/0 (socket says 172.21.15.55:58684) 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.533+0000 7fdec3fff640 1 -- 172.21.15.55:0/44238846 learned_addr learned my addr 172.21.15.55:0/44238846 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdec91de640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec415dce0 0x7fdec40c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdec89dd640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdec40b5990 0x7fdec415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdec3fff640 1 -- 172.21.15.55:0/44238846 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdec40b5990 msgr2=0x7fdec415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdec3fff640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdec40b5990 0x7fdec415b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdec3fff640 1 -- 172.21.15.55:0/44238846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec415dce0 msgr2=0x7fdec40c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdec3fff640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec415dce0 0x7fdec40c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdec3fff640 1 -- 172.21.15.55:0/44238846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40aae00 con 0x7fdec40d35b0 2024-04-25T09:03:18.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdec3fff640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec40d35b0 0x7fdec40aa3b0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800c820 tx=0x7fdeb800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdec17fa640 1 -- 172.21.15.55:0/44238846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8015070 con 0x7fdec40d35b0 2024-04-25T09:03:18.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdec17fa640 1 -- 172.21.15.55:0/44238846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb8007a30 con 0x7fdec40d35b0 2024-04-25T09:03:18.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdecac41640 1 -- 172.21.15.55:0/44238846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec40ab0e0 con 0x7fdec40d35b0 2024-04-25T09:03:18.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdec17fa640 1 -- 172.21.15.55:0/44238846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8007e00 con 0x7fdec40d35b0 2024-04-25T09:03:18.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.534+0000 7fdecac41640 1 -- 172.21.15.55:0/44238846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec40ab6a0 con 0x7fdec40d35b0 2024-04-25T09:03:18.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.535+0000 7fdecac41640 1 -- 172.21.15.55:0/44238846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec40749b0 con 0x7fdec40d35b0 2024-04-25T09:03:18.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.536+0000 7fdec17fa640 1 -- 172.21.15.55:0/44238846 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdeb8018070 con 0x7fdec40d35b0 2024-04-25T09:03:18.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.536+0000 7fdec17fa640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb006b4d0 0x7fdeb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.536+0000 7fdec17fa640 1 -- 172.21.15.55:0/44238846 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fdeb808a1f0 con 0x7fdec40d35b0 2024-04-25T09:03:18.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.536+0000 7fdec89dd640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb006b4d0 0x7fdeb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.537+0000 7fdec89dd640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb006b4d0 0x7fdeb006d990 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0012e0 tx=0x7fdebc001630 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.541+0000 7fdec17fa640 1 -- 172.21.15.55:0/44238846 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdeb8058960 con 0x7fdec40d35b0 2024-04-25T09:03:18.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.726+0000 7fdecac41640 1 -- 172.21.15.55:0/44238846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdec40b6ef0 con 0x7fdec40d35b0 2024-04-25T09:03:18.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.727+0000 7fdec17fa640 1 -- 172.21.15.55:0/44238846 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+16876 (secure 0 0 0) 0x7fdeb805ca00 con 0x7fdec40d35b0 2024-04-25T09:03:18.716 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:18.716 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":104,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:17.764590+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:50.330313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:51.020096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3048692204":"2024-04-26T09:03:17.764566+0000","172.21.15.55:6834/3048692204":"2024-04-26T09:03:17.764566+0000","172.21.15.55:6837/538888347":"2024-04-26T09:02:41.385611+0000","172.21.15.55:6834/538888347":"2024-04-26T09:02:41.385611+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 -- 172.21.15.55:0/44238846 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb006b4d0 msgr2=0x7fdeb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb006b4d0 0x7fdeb006d990 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0012e0 tx=0x7fdebc001630 comp rx=0 tx=0).stop 2024-04-25T09:03:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 -- 172.21.15.55:0/44238846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec40d35b0 msgr2=0x7fdec40aa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec40d35b0 0x7fdec40aa3b0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800c820 tx=0x7fdeb800cce0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 -- 172.21.15.55:0/44238846 shutdown_connections 2024-04-25T09:03:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdeb006b4d0 0x7fdeb006d990 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec415dce0 0x7fdec40c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec40d35b0 0x7fdec40aa3b0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 --2- 172.21.15.55:0/44238846 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdec40b5990 0x7fdec415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 -- 172.21.15.55:0/44238846 >> 172.21.15.55:0/44238846 conn(0x7fdec4072900 msgr2=0x7fdec40b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 -- 172.21.15.55:0/44238846 shutdown_connections 2024-04-25T09:03:18.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.730+0000 7fdecac41640 1 -- 172.21.15.55:0/44238846 wait complete. 2024-04-25T09:03:18.729 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:50.330313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:51.020096+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:18.730 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:18.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.846+0000 7faf765c8640 1 Processor -- start 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.846+0000 7faf765c8640 1 -- start start 2024-04-25T09:03:18.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.847+0000 7faf765c8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faf700d3b90 0x7faf700d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.847+0000 7faf765c8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf700d4090 con 0x7faf7015dca0 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.847+0000 7faf765c8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf700d4370 con 0x7faf700d0f60 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.847+0000 7faf765c8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf700b6b20 con 0x7faf700d3b90 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.847+0000 7faf6ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faf7015dca0 0x7faf700ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35844/0 (socket says 172.21.15.55:35844) 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.847+0000 7faf6ffff640 1 -- 172.21.15.55:0/1071682571 learned_addr learned my addr 172.21.15.55:0/1071682571 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.847+0000 7faf6f7fe640 1 --2- 172.21.15.55:0/1071682571 >> v2:172.21.15.167:3300/0 conn(0x7faf700d3b90 0x7faf700d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.847+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168070526 0 0) 0x7faf700d4090 con 0x7faf7015dca0 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.847+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf58003520 con 0x7faf7015dca0 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569435607 0 0) 0x7faf700d4370 con 0x7faf700d0f60 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf700d4090 con 0x7faf700d0f60 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2567276264 0 0) 0x7faf58003520 con 0x7faf7015dca0 2024-04-25T09:03:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 >> v2:172.21.15.167:3300/0 conn(0x7faf700d3b90 msgr2=0x7faf700d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 --2- 172.21.15.55:0/1071682571 >> v2:172.21.15.167:3300/0 conn(0x7faf700d3b90 0x7faf700d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 >> v1:172.21.15.167:6789/0 conn(0x7faf700d0f60 legacy=0x7faf700b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf700d4650 con 0x7faf7015dca0 2024-04-25T09:03:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7faf60001670 con 0x7faf7015dca0 2024-04-25T09:03:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6f7fe640 1 --2- 172.21.15.55:0/1071682571 >> v2:172.21.15.167:3300/0 conn(0x7faf700d3b90 0x7faf700d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 >> v1:172.21.15.55:6789/0 conn(0x7faf7015dca0 legacy=0x7faf700ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 --2- 172.21.15.55:0/1071682571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf58003b40 0x7faf58003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 --2- 172.21.15.55:0/1071682571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf58004800 0x7faf58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 --2- 172.21.15.55:0/1071682571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf580051c0 0x7faf5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5800c010 con 0x7faf580051c0 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5800c1c0 con 0x7faf58004800 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5800c3c0 con 0x7faf58003b40 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf74b65640 1 --2- 172.21.15.55:0/1071682571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf580051c0 0x7faf5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6ffff640 1 --2- 172.21.15.55:0/1071682571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf58003b40 0x7faf58003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf6f7fe640 1 --2- 172.21.15.55:0/1071682571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf58004800 0x7faf58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf74b65640 1 -- 172.21.15.55:0/1071682571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf58003b40 msgr2=0x7faf58003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf74b65640 1 --2- 172.21.15.55:0/1071682571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf58003b40 0x7faf58003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf74b65640 1 -- 172.21.15.55:0/1071682571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf58004800 msgr2=0x7faf58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf74b65640 1 --2- 172.21.15.55:0/1071682571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf58004800 0x7faf58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.848+0000 7faf74b65640 1 -- 172.21.15.55:0/1071682571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58003520 con 0x7faf580051c0 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.849+0000 7faf74b65640 1 -- 172.21.15.55:0/1071682571 reap_dead start 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.849+0000 7faf74b65640 1 --2- 172.21.15.55:0/1071682571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf580051c0 0x7faf5800b9c0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7faf68001fd0 tx=0x7faf58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bffb3daf0f36cad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.849+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68001bf0 con 0x7faf580051c0 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.849+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf68003b70 con 0x7faf580051c0 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.849+0000 7faf6effd640 1 -- 172.21.15.55:0/1071682571 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf680050d0 con 0x7faf580051c0 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.850+0000 7faf765c8640 1 -- 172.21.15.55:0/1071682571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf580051c0 msgr2=0x7faf5800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.850+0000 7faf765c8640 1 --2- 172.21.15.55:0/1071682571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf580051c0 0x7faf5800b9c0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7faf68001fd0 tx=0x7faf58005830 comp rx=0 tx=0).stop 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.850+0000 7faf765c8640 1 -- 172.21.15.55:0/1071682571 shutdown_connections 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.850+0000 7faf765c8640 1 --2- 172.21.15.55:0/1071682571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf580051c0 0x7faf5800b9c0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.850+0000 7faf765c8640 1 -- 172.21.15.55:0/1071682571 >> 172.21.15.55:0/1071682571 conn(0x7faf700726c0 msgr2=0x7faf70072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.850+0000 7faf765c8640 1 -- 172.21.15.55:0/1071682571 shutdown_connections 2024-04-25T09:03:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.850+0000 7faf765c8640 1 -- 172.21.15.55:0/1071682571 wait complete. 2024-04-25T09:03:18.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.851+0000 7faf765c8640 1 Processor -- start 2024-04-25T09:03:18.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.851+0000 7faf765c8640 1 -- start start 2024-04-25T09:03:18.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf765c8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf580051c0 0x7faf70152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf765c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf7015edf0 0x7faf701f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf765c8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf7015f270 0x7faf701f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf765c8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015e080 con 0x7faf7015edf0 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf765c8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf700d1390 con 0x7faf580051c0 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf765c8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015e200 con 0x7faf7015f270 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf6f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf7015edf0 0x7faf701f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf6f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf7015edf0 0x7faf701f3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53374/0 (socket says 172.21.15.55:53374) 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf6f7fe640 1 -- 172.21.15.55:0/2739543987 learned_addr learned my addr 172.21.15.55:0/2739543987 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf74b65640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf7015f270 0x7faf701f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf6ffff640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf580051c0 0x7faf70152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf6f7fe640 1 -- 172.21.15.55:0/2739543987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf7015f270 msgr2=0x7faf701f3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf6f7fe640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf7015f270 0x7faf701f3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf6f7fe640 1 -- 172.21.15.55:0/2739543987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf580051c0 msgr2=0x7faf70152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf6f7fe640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf580051c0 0x7faf70152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf6f7fe640 1 -- 172.21.15.55:0/2739543987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf70154db0 con 0x7faf7015edf0 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf6f7fe640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf7015edf0 0x7faf701f3800 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7faf64011a30 tx=0x7faf64011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.852+0000 7faf6cff9640 1 -- 172.21.15.55:0/2739543987 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6400fc10 con 0x7faf7015edf0 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.853+0000 7faf6cff9640 1 -- 172.21.15.55:0/2739543987 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6400fdb0 con 0x7faf7015edf0 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.853+0000 7faf765c8640 1 -- 172.21.15.55:0/2739543987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7015f7d0 con 0x7faf7015edf0 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.853+0000 7faf6cff9640 1 -- 172.21.15.55:0/2739543987 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64004270 con 0x7faf7015edf0 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.853+0000 7faf765c8640 1 -- 172.21.15.55:0/2739543987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf70155030 con 0x7faf7015edf0 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.854+0000 7faf765c8640 1 -- 172.21.15.55:0/2739543987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7015fcf0 con 0x7faf7015edf0 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.854+0000 7faf6cff9640 1 -- 172.21.15.55:0/2739543987 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf64012040 con 0x7faf7015edf0 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.855+0000 7faf6cff9640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faf5c06b500 0x7faf5c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.855+0000 7faf6cff9640 1 -- 172.21.15.55:0/2739543987 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7faf6408a690 con 0x7faf7015edf0 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.855+0000 7faf6ffff640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faf5c06b500 0x7faf5c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.855+0000 7faf6ffff640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faf5c06b500 0x7faf5c06d9c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7faf60001eb0 tx=0x7faf60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:18.859+0000 7faf6cff9640 1 -- 172.21.15.55:0/2739543987 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf7015fcf0 con 0x7faf7015edf0 2024-04-25T09:03:19.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.039+0000 7faf765c8640 1 -- 172.21.15.55:0/2739543987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf700750b0 con 0x7faf7015edf0 2024-04-25T09:03:19.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.039+0000 7faf6cff9640 1 -- 172.21.15.55:0/2739543987 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf70154db0 con 0x7faf7015edf0 2024-04-25T09:03:19.028 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:03:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 -- 172.21.15.55:0/2739543987 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faf5c06b500 msgr2=0x7faf5c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faf5c06b500 0x7faf5c06d9c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7faf60001eb0 tx=0x7faf60009040 comp rx=0 tx=0).stop 2024-04-25T09:03:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 -- 172.21.15.55:0/2739543987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf7015edf0 msgr2=0x7faf701f3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf7015edf0 0x7faf701f3800 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7faf64011a30 tx=0x7faf64011ef0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 -- 172.21.15.55:0/2739543987 shutdown_connections 2024-04-25T09:03:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faf5c06b500 0x7faf5c06d9c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf7015f270 0x7faf701f3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf7015edf0 0x7faf701f3800 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 --2- 172.21.15.55:0/2739543987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf580051c0 0x7faf70152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 -- 172.21.15.55:0/2739543987 >> 172.21.15.55:0/2739543987 conn(0x7faf700726c0 msgr2=0x7faf7015bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 -- 172.21.15.55:0/2739543987 shutdown_connections 2024-04-25T09:03:19.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.041+0000 7faf765c8640 1 -- 172.21.15.55:0/2739543987 wait complete. 2024-04-25T09:03:19.041 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:19.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.156+0000 7fbcbd902640 1 Processor -- start 2024-04-25T09:03:19.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.156+0000 7fbcbd902640 1 -- start start 2024-04-25T09:03:19.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcbd902640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcb815dca0 0x7fbcb80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcbd902640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbcb80d1130 0x7fbcb80b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcbd902640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb80d4090 con 0x7fbcb80d3b90 2024-04-25T09:03:19.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcbd902640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb80b6b20 con 0x7fbcb80d1130 2024-04-25T09:03:19.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcbd902640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80d4370 con 0x7fbcb815dca0 2024-04-25T09:03:19.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcaffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbcb80d3b90 0x7fbcb80d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35848/0 (socket says 172.21.15.55:35848) 2024-04-25T09:03:19.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcaffff640 1 -- 172.21.15.55:0/3264672171 learned_addr learned my addr 172.21.15.55:0/3264672171 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:19.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcb77fe640 1 --2- 172.21.15.55:0/3264672171 >> v2:172.21.15.167:3300/0 conn(0x7fbcb80d1130 0x7fbcb80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcb6ffd640 1 --2- 172.21.15.55:0/3264672171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcb815dca0 0x7fbcb80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcb67fc640 1 -- 172.21.15.55:0/3264672171 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600168757 0 0) 0x7fbcb80d4090 con 0x7fbcb80d3b90 2024-04-25T09:03:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcb67fc640 1 -- 172.21.15.55:0/3264672171 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca4003520 con 0x7fbcb80d3b90 2024-04-25T09:03:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcb67fc640 1 -- 172.21.15.55:0/3264672171 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2762525779 0 0) 0x7fbca4003520 con 0x7fbcb80d3b90 2024-04-25T09:03:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcb77fe640 1 -- 172.21.15.55:0/3264672171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcb815dca0 msgr2=0x7fbcb80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcb77fe640 1 --2- 172.21.15.55:0/3264672171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcb815dca0 0x7fbcb80ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcb77fe640 1 -- 172.21.15.55:0/3264672171 >> v1:172.21.15.55:6789/0 conn(0x7fbcb80d3b90 legacy=0x7fbcb80d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.157+0000 7fbcb77fe640 1 -- 172.21.15.55:0/3264672171 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb80d4650 con 0x7fbcb80d1130 2024-04-25T09:03:19.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.158+0000 7fbcb77fe640 1 --2- 172.21.15.55:0/3264672171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb80d1130 0x7fbcb80b2500 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009d90 tx=0x7fbcb002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db5159018612f063 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.158+0000 7fbcb67fc640 1 -- 172.21.15.55:0/3264672171 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0001670 con 0x7fbcb80d1130 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.158+0000 7fbcb67fc640 1 -- 172.21.15.55:0/3264672171 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb0007540 con 0x7fbcb80d1130 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.158+0000 7fbcb67fc640 1 -- 172.21.15.55:0/3264672171 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00078f0 con 0x7fbcb80d1130 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.159+0000 7fbcbd902640 1 -- 172.21.15.55:0/3264672171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb80d1130 msgr2=0x7fbcb80b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.159+0000 7fbcbd902640 1 --2- 172.21.15.55:0/3264672171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb80d1130 0x7fbcb80b2500 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009d90 tx=0x7fbcb002a5f0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.159+0000 7fbcbd902640 1 -- 172.21.15.55:0/3264672171 shutdown_connections 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.159+0000 7fbcbd902640 1 --2- 172.21.15.55:0/3264672171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb80d1130 0x7fbcb80b2500 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.159+0000 7fbcbd902640 1 --2- 172.21.15.55:0/3264672171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcb815dca0 0x7fbcb80ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.159+0000 7fbcbd902640 1 -- 172.21.15.55:0/3264672171 >> 172.21.15.55:0/3264672171 conn(0x7fbcb80726c0 msgr2=0x7fbcb8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.159+0000 7fbcbd902640 1 -- 172.21.15.55:0/3264672171 shutdown_connections 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.159+0000 7fbcbd902640 1 -- 172.21.15.55:0/3264672171 wait complete. 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.160+0000 7fbcbd902640 1 Processor -- start 2024-04-25T09:03:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.160+0000 7fbcbd902640 1 -- start start 2024-04-25T09:03:19.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcbd902640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb80d1130 0x7fbcb8158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcbd902640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80d3b90 0x7fbcb81f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcbd902640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcb815dca0 0x7fbcb81f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcbd902640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb815e200 con 0x7fbcb80d3b90 2024-04-25T09:03:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcbd902640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb815e080 con 0x7fbcb80d1130 2024-04-25T09:03:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcbd902640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80cee80 con 0x7fbcb815dca0 2024-04-25T09:03:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcaffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80d3b90 0x7fbcb81f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcaffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80d3b90 0x7fbcb81f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53386/0 (socket says 172.21.15.55:53386) 2024-04-25T09:03:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcaffff640 1 -- 172.21.15.55:0/157969742 learned_addr learned my addr 172.21.15.55:0/157969742 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcb6ffd640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb80d1130 0x7fbcb8158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcb77fe640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcb815dca0 0x7fbcb81f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcaffff640 1 -- 172.21.15.55:0/157969742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcb815dca0 msgr2=0x7fbcb81f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcaffff640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcb815dca0 0x7fbcb81f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcaffff640 1 -- 172.21.15.55:0/157969742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb80d1130 msgr2=0x7fbcb8158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcaffff640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb80d1130 0x7fbcb8158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcaffff640 1 -- 172.21.15.55:0/157969742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb8158ed0 con 0x7fbcb80d3b90 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcb77fe640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcb815dca0 0x7fbcb81f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.161+0000 7fbcaffff640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80d3b90 0x7fbcb81f2e00 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c780 tx=0x7fbca000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.162+0000 7fbcb4ff9640 1 -- 172.21.15.55:0/157969742 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0017070 con 0x7fbcb80d3b90 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.162+0000 7fbcb4ff9640 1 -- 172.21.15.55:0/157969742 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca0005ad0 con 0x7fbcb80d3b90 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.162+0000 7fbcbd902640 1 -- 172.21.15.55:0/157969742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb8159150 con 0x7fbcb80d3b90 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.162+0000 7fbcb4ff9640 1 -- 172.21.15.55:0/157969742 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0007070 con 0x7fbcb80d3b90 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.162+0000 7fbcbd902640 1 -- 172.21.15.55:0/157969742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb8159710 con 0x7fbcb80d3b90 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.163+0000 7fbcbd902640 1 -- 172.21.15.55:0/157969742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb80750b0 con 0x7fbcb80d3b90 2024-04-25T09:03:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.163+0000 7fbcb4ff9640 1 -- 172.21.15.55:0/157969742 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbca001a070 con 0x7fbcb80d3b90 2024-04-25T09:03:19.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.164+0000 7fbcb4ff9640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc9806b4d0 0x7fbc9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.164+0000 7fbcb4ff9640 1 -- 172.21.15.55:0/157969742 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fbca00897a0 con 0x7fbcb80d3b90 2024-04-25T09:03:19.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.164+0000 7fbcb6ffd640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc9806b4d0 0x7fbc9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.164+0000 7fbcb6ffd640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc9806b4d0 0x7fbc9806d990 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009aa0 tx=0x7fbca8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.168+0000 7fbcb4ff9640 1 -- 172.21.15.55:0/157969742 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbcb8158ed0 con 0x7fbcb80d3b90 2024-04-25T09:03:19.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.348+0000 7fbcbd902640 1 -- 172.21.15.55:0/157969742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbcb80b4ee0 con 0x7fbcb80d3b90 2024-04-25T09:03:19.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.348+0000 7fbcb4ff9640 1 -- 172.21.15.55:0/157969742 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbca0057f20 con 0x7fbcb80d3b90 2024-04-25T09:03:19.337 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T09:03:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 -- 172.21.15.55:0/157969742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc9806b4d0 msgr2=0x7fbc9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc9806b4d0 0x7fbc9806d990 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009aa0 tx=0x7fbca8009190 comp rx=0 tx=0).stop 2024-04-25T09:03:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 -- 172.21.15.55:0/157969742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80d3b90 msgr2=0x7fbcb81f2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80d3b90 0x7fbcb81f2e00 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c780 tx=0x7fbca000cc40 comp rx=0 tx=0).stop 2024-04-25T09:03:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 -- 172.21.15.55:0/157969742 shutdown_connections 2024-04-25T09:03:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc9806b4d0 0x7fbc9806d990 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcb815dca0 0x7fbcb81f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80d3b90 0x7fbcb81f2e00 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 --2- 172.21.15.55:0/157969742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb80d1130 0x7fbcb8158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 -- 172.21.15.55:0/157969742 >> 172.21.15.55:0/157969742 conn(0x7fbcb80726c0 msgr2=0x7fbcb80b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 -- 172.21.15.55:0/157969742 shutdown_connections 2024-04-25T09:03:19.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.350+0000 7fbcbd902640 1 -- 172.21.15.55:0/157969742 wait complete. 2024-04-25T09:03:19.350 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:19.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.465+0000 7f56fdb29640 1 Processor -- start 2024-04-25T09:03:19.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.465+0000 7f56fdb29640 1 -- start start 2024-04-25T09:03:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.466+0000 7f56fdb29640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f56f815dc80 0x7f56f8161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.466+0000 7f56fdb29640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56f80b5c00 0x7f56f80d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.466+0000 7f56fdb29640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f81627a0 con 0x7f56f80b97c0 2024-04-25T09:03:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.466+0000 7f56fdb29640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f81621e0 con 0x7f56f815dc80 2024-04-25T09:03:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.466+0000 7f56fdb29640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f81624c0 con 0x7f56f80b5c00 2024-04-25T09:03:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.466+0000 7f56f6ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f56f80b97c0 0x7f56f80b54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35862/0 (socket says 172.21.15.55:35862) 2024-04-25T09:03:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.466+0000 7f56f6ffd640 1 -- 172.21.15.55:0/682933506 learned_addr learned my addr 172.21.15.55:0/682933506 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f77fe640 1 --2- 172.21.15.55:0/682933506 >> v2:172.21.15.167:3300/0 conn(0x7f56f815dc80 0x7f56f8161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f7fff640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56f80b5c00 0x7f56f80d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336919361 0 0) 0x7f56f81627a0 con 0x7f56f80b97c0 2024-04-25T09:03:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56e0003520 con 0x7f56f80b97c0 2024-04-25T09:03:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1131455811 0 0) 0x7f56e0003520 con 0x7f56f80b97c0 2024-04-25T09:03:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56f80b5c00 msgr2=0x7f56f80d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56f80b5c00 0x7f56f80d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 >> v2:172.21.15.167:3300/0 conn(0x7f56f815dc80 msgr2=0x7f56f8161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 --2- 172.21.15.55:0/682933506 >> v2:172.21.15.167:3300/0 conn(0x7f56f815dc80 0x7f56f8161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80d1c70 con 0x7f56f80b97c0 2024-04-25T09:03:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f56ec001670 con 0x7f56f80b97c0 2024-04-25T09:03:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f77fe640 1 --2- 172.21.15.55:0/682933506 >> v2:172.21.15.167:3300/0 conn(0x7f56f815dc80 0x7f56f8161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 >> v1:172.21.15.55:6789/0 conn(0x7f56f80b97c0 legacy=0x7f56f80b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56e00039b0 0x7f56e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00043a0 0x7f56e0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56e0004ef0 0x7f56e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f81621e0 con 0x7f56e00043a0 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f81624c0 con 0x7f56e0004ef0 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e000bf00 con 0x7f56e00039b0 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f7fff640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56f80b5c00 0x7f56f80d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f6ffd640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00043a0 0x7f56e0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f77fe640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56e00039b0 0x7f56e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f7fff640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56e0004ef0 0x7f56e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f6ffd640 1 -- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56e00039b0 msgr2=0x7f56e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f6ffd640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56e00039b0 0x7f56e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f6ffd640 1 -- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56e0004ef0 msgr2=0x7f56e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.467+0000 7f56f6ffd640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56e0004ef0 0x7f56e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.468+0000 7f56f6ffd640 1 -- 172.21.15.55:0/682933506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e0003520 con 0x7f56e00043a0 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.468+0000 7f56f7fff640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56e0004ef0 0x7f56e000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.468+0000 7f56f77fe640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56e00039b0 0x7f56e0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.468+0000 7f56f6ffd640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00043a0 0x7f56e0004880 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00c290 tx=0x7f56e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05ec6d55b2830da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.468+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec007d50 con 0x7f56e00043a0 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.468+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec005af0 con 0x7f56e00043a0 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.468+0000 7f56f67fc640 1 -- 172.21.15.55:0/682933506 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec007070 con 0x7f56e00043a0 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.469+0000 7f56fdb29640 1 -- 172.21.15.55:0/682933506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00043a0 msgr2=0x7f56e0004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.469+0000 7f56fdb29640 1 --2- 172.21.15.55:0/682933506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00043a0 0x7f56e0004880 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00c290 tx=0x7f56e0005830 comp rx=0 tx=0).stop 2024-04-25T09:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.469+0000 7f56f7fff640 1 -- 172.21.15.55:0/682933506 reap_dead start 2024-04-25T09:03:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.469+0000 7f56fdb29640 1 -- 172.21.15.55:0/682933506 shutdown_connections 2024-04-25T09:03:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.469+0000 7f56fdb29640 1 -- 172.21.15.55:0/682933506 >> 172.21.15.55:0/682933506 conn(0x7f56f80d04f0 msgr2=0x7f56f80d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.469+0000 7f56fdb29640 1 -- 172.21.15.55:0/682933506 shutdown_connections 2024-04-25T09:03:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.469+0000 7f56fdb29640 1 -- 172.21.15.55:0/682933506 wait complete. 2024-04-25T09:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.470+0000 7f56fdb29640 1 Processor -- start 2024-04-25T09:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.470+0000 7f56fdb29640 1 -- start start 2024-04-25T09:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56fdb29640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56e00043a0 0x7f56f815f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56fdb29640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56f80b8210 0x7f56f814fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56fdb29640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80b8690 0x7f56f8150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56fdb29640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8161f30 con 0x7f56f80b8690 2024-04-25T09:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56fdb29640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8161db0 con 0x7f56f80b8210 2024-04-25T09:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56fdb29640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80d2470 con 0x7f56e00043a0 2024-04-25T09:03:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80b8690 0x7f56f8150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80b8690 0x7f56f8150310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53400/0 (socket says 172.21.15.55:53400) 2024-04-25T09:03:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56f7fff640 1 -- 172.21.15.55:0/2181938884 learned_addr learned my addr 172.21.15.55:0/2181938884 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56f77fe640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56e00043a0 0x7f56f815f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56f6ffd640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56f80b8210 0x7f56f814fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56f7fff640 1 -- 172.21.15.55:0/2181938884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56e00043a0 msgr2=0x7f56f815f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56f7fff640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56e00043a0 0x7f56f815f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56f7fff640 1 -- 172.21.15.55:0/2181938884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56f80b8210 msgr2=0x7f56f814fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56f7fff640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56f80b8210 0x7f56f814fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56f7fff640 1 -- 172.21.15.55:0/2181938884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80c9e40 con 0x7f56f80b8690 2024-04-25T09:03:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.471+0000 7f56f6ffd640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56f80b8210 0x7f56f814fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.472+0000 7f56f7fff640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80b8690 0x7f56f8150310 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f56f80b6950 tx=0x7f56f0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.472+0000 7f56dffff640 1 -- 172.21.15.55:0/2181938884 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0003b90 con 0x7f56f80b8690 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.472+0000 7f56dffff640 1 -- 172.21.15.55:0/2181938884 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f001b070 con 0x7f56f80b8690 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.472+0000 7f56dffff640 1 -- 172.21.15.55:0/2181938884 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0004030 con 0x7f56f80b8690 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.472+0000 7f56fdb29640 1 -- 172.21.15.55:0/2181938884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f80ca120 con 0x7f56f80b8690 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.472+0000 7f56fdb29640 1 -- 172.21.15.55:0/2181938884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f815fbf0 con 0x7f56f80b8690 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.473+0000 7f56fdb29640 1 -- 172.21.15.55:0/2181938884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f80750b0 con 0x7f56f80b8690 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.473+0000 7f56dffff640 1 -- 172.21.15.55:0/2181938884 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f56f0005d10 con 0x7f56f80b8690 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.474+0000 7f56dffff640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f56e406b4d0 0x7f56e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.474+0000 7f56dffff640 1 -- 172.21.15.55:0/2181938884 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f56f008af00 con 0x7f56f80b8690 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.474+0000 7f56f77fe640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f56e406b4d0 0x7f56e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.474+0000 7f56f77fe640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f56e406b4d0 0x7f56e406d990 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009ba0 tx=0x7f56e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.478+0000 7f56dffff640 1 -- 172.21.15.55:0/2181938884 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56f0025020 con 0x7f56f80b8690 2024-04-25T09:03:19.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.660+0000 7f56fdb29640 1 -- 172.21.15.55:0/2181938884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56f80b6c90 con 0x7f56f80b8690 2024-04-25T09:03:19.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.660+0000 7f56dffff640 1 -- 172.21.15.55:0/2181938884 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56f0059d60 con 0x7f56f80b8690 2024-04-25T09:03:19.649 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T09:03:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 -- 172.21.15.55:0/2181938884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f56e406b4d0 msgr2=0x7f56e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f56e406b4d0 0x7f56e406d990 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009ba0 tx=0x7f56e8008040 comp rx=0 tx=0).stop 2024-04-25T09:03:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 -- 172.21.15.55:0/2181938884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80b8690 msgr2=0x7f56f8150310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80b8690 0x7f56f8150310 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f56f80b6950 tx=0x7f56f0010590 comp rx=0 tx=0).stop 2024-04-25T09:03:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 -- 172.21.15.55:0/2181938884 shutdown_connections 2024-04-25T09:03:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f56e406b4d0 0x7f56e406d990 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80b8690 0x7f56f8150310 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56f80b8210 0x7f56f814fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 --2- 172.21.15.55:0/2181938884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56e00043a0 0x7f56f815f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 -- 172.21.15.55:0/2181938884 >> 172.21.15.55:0/2181938884 conn(0x7f56f80d04f0 msgr2=0x7f56f80b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 -- 172.21.15.55:0/2181938884 shutdown_connections 2024-04-25T09:03:19.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.662+0000 7f56fdb29640 1 -- 172.21.15.55:0/2181938884 wait complete. 2024-04-25T09:03:19.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.775+0000 7fe4d63e2640 1 Processor -- start 2024-04-25T09:03:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.776+0000 7fe4d63e2640 1 -- start start 2024-04-25T09:03:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.776+0000 7fe4d63e2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4d015f120 0x7fe4d00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.776+0000 7fe4d63e2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4d00cfdb0 0x7fe4d00ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.776+0000 7fe4d63e2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d00d0430 con 0x7fe4d00ce830 2024-04-25T09:03:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.776+0000 7fe4d63e2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d00d09f0 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.776+0000 7fe4d63e2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00cec70 con 0x7fe4d015f120 2024-04-25T09:03:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.776+0000 7fe4d497f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4d00cfdb0 0x7fe4d00ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.776+0000 7fe4d497f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4d00cfdb0 0x7fe4d00ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53406/0 (socket says 172.21.15.55:53406) 2024-04-25T09:03:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.776+0000 7fe4d497f640 1 -- 172.21.15.55:0/1100669221 learned_addr learned my addr 172.21.15.55:0/1100669221 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.777+0000 7fe4cffff640 1 --2- 172.21.15.55:0/1100669221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4d015f120 0x7fe4d00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.777+0000 7fe4d497f640 1 -- 172.21.15.55:0/1100669221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4d015f120 msgr2=0x7fe4d00ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.777+0000 7fe4d497f640 1 --2- 172.21.15.55:0/1100669221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4d015f120 0x7fe4d00ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.777+0000 7fe4d497f640 1 -- 172.21.15.55:0/1100669221 >> v1:172.21.15.167:6789/0 conn(0x7fe4d00ce830 legacy=0x7fe4d00cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.777+0000 7fe4d497f640 1 -- 172.21.15.55:0/1100669221 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00d0710 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.777+0000 7fe4d497f640 1 --2- 172.21.15.55:0/1100669221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d00cfdb0 0x7fe4d00ccfd0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009e50 tx=0x7fe4c802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763c438903fc6220 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.778+0000 7fe4ceffd640 1 -- 172.21.15.55:0/1100669221 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8036070 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.778+0000 7fe4ceffd640 1 -- 172.21.15.55:0/1100669221 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c8031600 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.778+0000 7fe4ceffd640 1 -- 172.21.15.55:0/1100669221 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c80319d0 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.778+0000 7fe4d63e2640 1 -- 172.21.15.55:0/1100669221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d00cfdb0 msgr2=0x7fe4d00ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.778+0000 7fe4d63e2640 1 --2- 172.21.15.55:0/1100669221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d00cfdb0 0x7fe4d00ccfd0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009e50 tx=0x7fe4c802a7a0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.778+0000 7fe4d63e2640 1 -- 172.21.15.55:0/1100669221 shutdown_connections 2024-04-25T09:03:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.778+0000 7fe4d63e2640 1 --2- 172.21.15.55:0/1100669221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d00cfdb0 0x7fe4d00ccfd0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.778+0000 7fe4d63e2640 1 --2- 172.21.15.55:0/1100669221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4d015f120 0x7fe4d00ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.778+0000 7fe4d63e2640 1 -- 172.21.15.55:0/1100669221 >> 172.21.15.55:0/1100669221 conn(0x7fe4d00d1900 msgr2=0x7fe4d00d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.778+0000 7fe4d63e2640 1 -- 172.21.15.55:0/1100669221 shutdown_connections 2024-04-25T09:03:19.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.778+0000 7fe4d63e2640 1 -- 172.21.15.55:0/1100669221 wait complete. 2024-04-25T09:03:19.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.779+0000 7fe4d63e2640 1 Processor -- start 2024-04-25T09:03:19.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.780+0000 7fe4d63e2640 1 -- start start 2024-04-25T09:03:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.780+0000 7fe4d63e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4d00ce830 0x7fe4d00b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.780+0000 7fe4d63e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d00cfdb0 0x7fe4d00b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.780+0000 7fe4d63e2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4d015f120 0x7fe4d014f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.780+0000 7fe4d63e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00cc480 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.780+0000 7fe4d63e2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00ccab0 con 0x7fe4d00ce830 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.780+0000 7fe4d63e2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00c5450 con 0x7fe4d015f120 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.780+0000 7fe4cf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d00cfdb0 0x7fe4d00b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.780+0000 7fe4cf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d00cfdb0 0x7fe4d00b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53408/0 (socket says 172.21.15.55:53408) 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.780+0000 7fe4cf7fe640 1 -- 172.21.15.55:0/3453703274 learned_addr learned my addr 172.21.15.55:0/3453703274 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4cffff640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4d00ce830 0x7fe4d00b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4d497f640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4d015f120 0x7fe4d014f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4cf7fe640 1 -- 172.21.15.55:0/3453703274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4d015f120 msgr2=0x7fe4d014f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4cf7fe640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4d015f120 0x7fe4d014f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4cf7fe640 1 -- 172.21.15.55:0/3453703274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4d00ce830 msgr2=0x7fe4d00b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4cf7fe640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4d00ce830 0x7fe4d00b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4cf7fe640 1 -- 172.21.15.55:0/3453703274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00c6bc0 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4cffff640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4d00ce830 0x7fe4d00b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4d497f640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4d015f120 0x7fe4d014f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4cf7fe640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d00cfdb0 0x7fe4d00b4e80 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c3c0 tx=0x7fe4c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4ccff9640 1 -- 172.21.15.55:0/3453703274 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40052d0 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4ccff9640 1 -- 172.21.15.55:0/3453703274 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c4005490 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4d63e2640 1 -- 172.21.15.55:0/3453703274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d00c6ea0 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4ccff9640 1 -- 172.21.15.55:0/3453703274 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4007260 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.781+0000 7fe4d63e2640 1 -- 172.21.15.55:0/3453703274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d00c7460 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.782+0000 7fe4d63e2640 1 -- 172.21.15.55:0/3453703274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d0067850 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.783+0000 7fe4ccff9640 1 -- 172.21.15.55:0/3453703274 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe4c4007400 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.783+0000 7fe4ccff9640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe4bc06b4d0 0x7fe4bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.783+0000 7fe4cffff640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe4bc06b4d0 0x7fe4bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.783+0000 7fe4ccff9640 1 -- 172.21.15.55:0/3453703274 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe4c4089790 con 0x7fe4d00cfdb0 2024-04-25T09:03:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.784+0000 7fe4cffff640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe4bc06b4d0 0x7fe4bc06d990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0006fd0 tx=0x7fe4c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:19.788+0000 7fe4ccff9640 1 -- 172.21.15.55:0/3453703274 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe4c4058560 con 0x7fe4d00cfdb0 2024-04-25T09:03:20.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.012+0000 7fe4d63e2640 1 -- 172.21.15.55:0/3453703274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4d00749b0 con 0x7fe4d00cfdb0 2024-04-25T09:03:20.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.012+0000 7fe4ccff9640 1 -- 172.21.15.55:0/3453703274 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4940 (secure 0 0 0) 0x7fe4c4057e60 con 0x7fe4d00cfdb0 2024-04-25T09:03:20.001 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:20.001 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":80,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":8754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/4013195286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4013195286},{"type":"v1","addr":"172.21.15.55:6837","nonce":4013195286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":79,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:03:17.764577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:20.001 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 80 2024-04-25T09:03:20.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.014+0000 7fe4d63e2640 1 -- 172.21.15.55:0/3453703274 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe4bc06b4d0 msgr2=0x7fe4bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.014+0000 7fe4d63e2640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe4bc06b4d0 0x7fe4bc06d990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0006fd0 tx=0x7fe4c0008040 comp rx=0 tx=0).stop 2024-04-25T09:03:20.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.014+0000 7fe4d63e2640 1 -- 172.21.15.55:0/3453703274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d00cfdb0 msgr2=0x7fe4d00b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.014+0000 7fe4d63e2640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d00cfdb0 0x7fe4d00b4e80 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c3c0 tx=0x7fe4c400c880 comp rx=0 tx=0).stop 2024-04-25T09:03:20.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.014+0000 7fe4d63e2640 1 -- 172.21.15.55:0/3453703274 shutdown_connections 2024-04-25T09:03:20.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.014+0000 7fe4d63e2640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe4bc06b4d0 0x7fe4bc06d990 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.014+0000 7fe4d63e2640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4d015f120 0x7fe4d014f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.014+0000 7fe4d63e2640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d00cfdb0 0x7fe4d00b4e80 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.014+0000 7fe4d63e2640 1 --2- 172.21.15.55:0/3453703274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4d00ce830 0x7fe4d00b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.014+0000 7fe4d63e2640 1 -- 172.21.15.55:0/3453703274 >> 172.21.15.55:0/3453703274 conn(0x7fe4d00d1900 msgr2=0x7fe4d00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.015+0000 7fe4d63e2640 1 -- 172.21.15.55:0/3453703274 shutdown_connections 2024-04-25T09:03:20.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.015+0000 7fe4d63e2640 1 -- 172.21.15.55:0/3453703274 wait complete. 2024-04-25T09:03:20.014 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:20.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.127+0000 7fc115d5c640 1 Processor -- start 2024-04-25T09:03:20.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.127+0000 7fc115d5c640 1 -- start start 2024-04-25T09:03:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.128+0000 7fc115d5c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc11015ba10 0x7fc110099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.128+0000 7fc115d5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11006c900 con 0x7fc11006c3c0 2024-04-25T09:03:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.128+0000 7fc115d5c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11006cbe0 con 0x7fc110099f80 2024-04-25T09:03:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.128+0000 7fc115d5c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1100cbe50 con 0x7fc11015ba10 2024-04-25T09:03:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.128+0000 7fc10ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc11006c3c0 0x7fc1100cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35868/0 (socket says 172.21.15.55:35868) 2024-04-25T09:03:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.128+0000 7fc10ffff640 1 -- 172.21.15.55:0/944231667 learned_addr learned my addr 172.21.15.55:0/944231667 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.128+0000 7fc10f7fe640 1 --2- 172.21.15.55:0/944231667 >> v2:172.21.15.167:3300/0 conn(0x7fc11015ba10 0x7fc110099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.128+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570244911 0 0) 0x7fc11006c900 con 0x7fc11006c3c0 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.128+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f8003520 con 0x7fc11006c3c0 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.128+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69488206 0 0) 0x7fc11006cbe0 con 0x7fc110099f80 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc11006c900 con 0x7fc110099f80 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3851472825 0 0) 0x7fc0f8003520 con 0x7fc11006c3c0 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 >> v2:172.21.15.167:3300/0 conn(0x7fc11015ba10 msgr2=0x7fc110099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 --2- 172.21.15.55:0/944231667 >> v2:172.21.15.167:3300/0 conn(0x7fc11015ba10 0x7fc110099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 >> v1:172.21.15.167:6789/0 conn(0x7fc110099f80 legacy=0x7fc11006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11006cec0 con 0x7fc11006c3c0 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc1080019f0 con 0x7fc11006c3c0 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10f7fe640 1 --2- 172.21.15.55:0/944231667 >> v2:172.21.15.167:3300/0 conn(0x7fc11015ba10 0x7fc110099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 >> v1:172.21.15.55:6789/0 conn(0x7fc11006c3c0 legacy=0x7fc1100cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f8003b40 0x7fc0f8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f8004800 0x7fc0f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f80051c0 0x7fc0f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f800c010 con 0x7fc0f80051c0 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f800c1c0 con 0x7fc0f8003b40 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f800c3c0 con 0x7fc0f8004800 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10ffff640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f80051c0 0x7fc0f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10f7fe640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f8003b40 0x7fc0f8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10effd640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f8004800 0x7fc0f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10ffff640 1 -- 172.21.15.55:0/944231667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f8004800 msgr2=0x7fc0f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10ffff640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f8004800 0x7fc0f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10ffff640 1 -- 172.21.15.55:0/944231667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f8003b40 msgr2=0x7fc0f8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10ffff640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0f8003b40 0x7fc0f8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10ffff640 1 -- 172.21.15.55:0/944231667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f8003520 con 0x7fc0f80051c0 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.129+0000 7fc10effd640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f8004800 0x7fc0f8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.130+0000 7fc10ffff640 1 -- 172.21.15.55:0/944231667 reap_dead start 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.130+0000 7fc10ffff640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f80051c0 0x7fc0f800b9c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fc10800a7f0 tx=0x7fc0f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5bfe634fc53580 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.130+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10800a450 con 0x7fc0f80051c0 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.130+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10802f070 con 0x7fc0f80051c0 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.130+0000 7fc10e7fc640 1 -- 172.21.15.55:0/944231667 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10802bc10 con 0x7fc0f80051c0 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.131+0000 7fc115d5c640 1 -- 172.21.15.55:0/944231667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f80051c0 msgr2=0x7fc0f800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.131+0000 7fc115d5c640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f80051c0 0x7fc0f800b9c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fc10800a7f0 tx=0x7fc0f8005830 comp rx=0 tx=0).stop 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.131+0000 7fc115d5c640 1 -- 172.21.15.55:0/944231667 shutdown_connections 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.131+0000 7fc115d5c640 1 --2- 172.21.15.55:0/944231667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f80051c0 0x7fc0f800b9c0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.131+0000 7fc115d5c640 1 -- 172.21.15.55:0/944231667 >> 172.21.15.55:0/944231667 conn(0x7fc1100b32f0 msgr2=0x7fc1100b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.131+0000 7fc115d5c640 1 -- 172.21.15.55:0/944231667 shutdown_connections 2024-04-25T09:03:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.131+0000 7fc115d5c640 1 -- 172.21.15.55:0/944231667 wait complete. 2024-04-25T09:03:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.132+0000 7fc115d5c640 1 Processor -- start 2024-04-25T09:03:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.132+0000 7fc115d5c640 1 -- start start 2024-04-25T09:03:20.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc115d5c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f80051c0 0x7fc110150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc115d5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11015e330 0x7fc1100af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc115d5c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1100afa40 0x7fc1100c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc115d5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110099dd0 con 0x7fc11015e330 2024-04-25T09:03:20.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc115d5c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110099c50 con 0x7fc1100afa40 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc115d5c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11009a3d0 con 0x7fc0f80051c0 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc10effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11015e330 0x7fc1100af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc10effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11015e330 0x7fc1100af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53428/0 (socket says 172.21.15.55:53428) 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc10effd640 1 -- 172.21.15.55:0/3085196111 learned_addr learned my addr 172.21.15.55:0/3085196111 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc10f7fe640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f80051c0 0x7fc110150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc10ffff640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1100afa40 0x7fc1100c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc10effd640 1 -- 172.21.15.55:0/3085196111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f80051c0 msgr2=0x7fc110150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc10effd640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f80051c0 0x7fc110150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc10effd640 1 -- 172.21.15.55:0/3085196111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1100afa40 msgr2=0x7fc1100c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc10effd640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1100afa40 0x7fc1100c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc10effd640 1 -- 172.21.15.55:0/3085196111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11015cc00 con 0x7fc11015e330 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc10effd640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11015e330 0x7fc1100af500 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fc10400e5b0 tx=0x7fc10400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc0f7fff640 1 -- 172.21.15.55:0/3085196111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1040052e0 con 0x7fc11015e330 2024-04-25T09:03:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc0f7fff640 1 -- 172.21.15.55:0/3085196111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc104007020 con 0x7fc11015e330 2024-04-25T09:03:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc0f7fff640 1 -- 172.21.15.55:0/3085196111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1040071f0 con 0x7fc11015e330 2024-04-25T09:03:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.133+0000 7fc115d5c640 1 -- 172.21.15.55:0/3085196111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11015d850 con 0x7fc11015e330 2024-04-25T09:03:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.134+0000 7fc115d5c640 1 -- 172.21.15.55:0/3085196111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11015e790 con 0x7fc11015e330 2024-04-25T09:03:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.135+0000 7fc115d5c640 1 -- 172.21.15.55:0/3085196111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11015f330 con 0x7fc11015e330 2024-04-25T09:03:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.135+0000 7fc0f7fff640 1 -- 172.21.15.55:0/3085196111 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc10401a020 con 0x7fc11015e330 2024-04-25T09:03:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.135+0000 7fc0f7fff640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0fc06b500 0x7fc0fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.136+0000 7fc0f7fff640 1 -- 172.21.15.55:0/3085196111 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fc104089950 con 0x7fc11015e330 2024-04-25T09:03:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.136+0000 7fc10f7fe640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0fc06b500 0x7fc0fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.136+0000 7fc10f7fe640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0fc06b500 0x7fc0fc06d9c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc100009c10 tx=0x7fc100008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.140+0000 7fc0f7fff640 1 -- 172.21.15.55:0/3085196111 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc11015f330 con 0x7fc11015e330 2024-04-25T09:03:20.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.320+0000 7fc115d5c640 1 -- 172.21.15.55:0/3085196111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1100749b0 con 0x7fc11015e330 2024-04-25T09:03:20.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.321+0000 7fc0f7fff640 1 -- 172.21.15.55:0/3085196111 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+16876 (secure 0 0 0) 0x7fc104058720 con 0x7fc11015e330 2024-04-25T09:03:20.310 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:20.310 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":104,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:17.764590+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:50.330313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:51.020096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3048692204":"2024-04-26T09:03:17.764566+0000","172.21.15.55:6834/3048692204":"2024-04-26T09:03:17.764566+0000","172.21.15.55:6837/538888347":"2024-04-26T09:02:41.385611+0000","172.21.15.55:6834/538888347":"2024-04-26T09:02:41.385611+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:20.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.323+0000 7fc115d5c640 1 -- 172.21.15.55:0/3085196111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0fc06b500 msgr2=0x7fc0fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.323+0000 7fc115d5c640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0fc06b500 0x7fc0fc06d9c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc100009c10 tx=0x7fc100008040 comp rx=0 tx=0).stop 2024-04-25T09:03:20.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.323+0000 7fc115d5c640 1 -- 172.21.15.55:0/3085196111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11015e330 msgr2=0x7fc1100af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.323+0000 7fc115d5c640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11015e330 0x7fc1100af500 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fc10400e5b0 tx=0x7fc10400ea70 comp rx=0 tx=0).stop 2024-04-25T09:03:20.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.323+0000 7fc115d5c640 1 -- 172.21.15.55:0/3085196111 shutdown_connections 2024-04-25T09:03:20.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.323+0000 7fc115d5c640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc0fc06b500 0x7fc0fc06d9c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.323+0000 7fc115d5c640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1100afa40 0x7fc1100c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.323+0000 7fc115d5c640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11015e330 0x7fc1100af500 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.323+0000 7fc115d5c640 1 --2- 172.21.15.55:0/3085196111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0f80051c0 0x7fc110150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.323+0000 7fc115d5c640 1 -- 172.21.15.55:0/3085196111 >> 172.21.15.55:0/3085196111 conn(0x7fc1100b32f0 msgr2=0x7fc110159e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.323+0000 7fc115d5c640 1 -- 172.21.15.55:0/3085196111 shutdown_connections 2024-04-25T09:03:20.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.324+0000 7fc115d5c640 1 -- 172.21.15.55:0/3085196111 wait complete. 2024-04-25T09:03:20.324 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:03:20.324 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:20.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.436+0000 7f9e3c94c640 1 Processor -- start 2024-04-25T09:03:20.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.436+0000 7f9e3c94c640 1 -- start start 2024-04-25T09:03:20.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e3c94c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e3815ba10 0x7f9e38099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e3c94c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e38099f80 0x7f9e3806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e3c94c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3809a3a0 con 0x7f9e3806c1f0 2024-04-25T09:03:20.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e3c94c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e380cbe50 con 0x7f9e38099f80 2024-04-25T09:03:20.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e3c94c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380cfe80 con 0x7f9e3815ba10 2024-04-25T09:03:20.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e2ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e38099f80 0x7f9e3806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e36d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9e3806c1f0 0x7f9e380cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35870/0 (socket says 172.21.15.55:35870) 2024-04-25T09:03:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e36d9d640 1 -- 172.21.15.55:0/1343360279 learned_addr learned my addr 172.21.15.55:0/1343360279 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e3659c640 1 --2- 172.21.15.55:0/1343360279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e3815ba10 0x7f9e38099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e2ffff640 1 -- 172.21.15.55:0/1343360279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e3815ba10 msgr2=0x7f9e38099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e2ffff640 1 --2- 172.21.15.55:0/1343360279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e3815ba10 0x7f9e38099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e2ffff640 1 -- 172.21.15.55:0/1343360279 >> v1:172.21.15.55:6789/0 conn(0x7f9e3806c1f0 legacy=0x7f9e380cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e2ffff640 1 -- 172.21.15.55:0/1343360279 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3806c680 con 0x7f9e38099f80 2024-04-25T09:03:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e35d9b640 1 -- 172.21.15.55:0/1343360279 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967865714 0 0) 0x7f9e3809a3a0 con 0x7f9e3806c1f0 2024-04-25T09:03:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.437+0000 7f9e3659c640 1 --2- 172.21.15.55:0/1343360279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e3815ba10 0x7f9e38099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.438+0000 7f9e2ffff640 1 --2- 172.21.15.55:0/1343360279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e38099f80 0x7f9e3806bcb0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f9e200097a0 tx=0x7f9e2002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7f8544b20f464b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.438+0000 7f9e35d9b640 1 -- 172.21.15.55:0/1343360279 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20037070 con 0x7f9e38099f80 2024-04-25T09:03:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.438+0000 7f9e35d9b640 1 -- 172.21.15.55:0/1343360279 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e20032440 con 0x7f9e38099f80 2024-04-25T09:03:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.438+0000 7f9e35d9b640 1 -- 172.21.15.55:0/1343360279 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20032810 con 0x7f9e38099f80 2024-04-25T09:03:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.439+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1343360279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e38099f80 msgr2=0x7f9e3806bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.439+0000 7f9e3c94c640 1 --2- 172.21.15.55:0/1343360279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e38099f80 0x7f9e3806bcb0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f9e200097a0 tx=0x7f9e2002a180 comp rx=0 tx=0).stop 2024-04-25T09:03:20.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.439+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1343360279 shutdown_connections 2024-04-25T09:03:20.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.439+0000 7f9e3c94c640 1 --2- 172.21.15.55:0/1343360279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e38099f80 0x7f9e3806bcb0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.439+0000 7f9e3c94c640 1 --2- 172.21.15.55:0/1343360279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e3815ba10 0x7f9e38099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.439+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1343360279 >> 172.21.15.55:0/1343360279 conn(0x7f9e380b32f0 msgr2=0x7f9e380b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.439+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1343360279 shutdown_connections 2024-04-25T09:03:20.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.439+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1343360279 wait complete. 2024-04-25T09:03:20.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.440+0000 7f9e3c94c640 1 Processor -- start 2024-04-25T09:03:20.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.440+0000 7f9e3c94c640 1 -- start start 2024-04-25T09:03:20.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3c94c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e3806c1f0 0x7f9e38158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3c94c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e38099f80 0x7f9e380c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3c94c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e3815ba10 0x7f9e380c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3c94c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3806cec0 con 0x7f9e3806c1f0 2024-04-25T09:03:20.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3c94c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3806cbe0 con 0x7f9e3815ba10 2024-04-25T09:03:20.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3c94c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380cd930 con 0x7f9e38099f80 2024-04-25T09:03:20.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e3806c1f0 0x7f9e38158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e3806c1f0 0x7f9e38158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53448/0 (socket says 172.21.15.55:53448) 2024-04-25T09:03:20.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3659c640 1 -- 172.21.15.55:0/1893546948 learned_addr learned my addr 172.21.15.55:0/1893546948 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:20.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e2ffff640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e38099f80 0x7f9e380c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e36d9d640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e3815ba10 0x7f9e380c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3659c640 1 -- 172.21.15.55:0/1893546948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e38099f80 msgr2=0x7f9e380c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3659c640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e38099f80 0x7f9e380c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3659c640 1 -- 172.21.15.55:0/1893546948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e3815ba10 msgr2=0x7f9e380c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3659c640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e3815ba10 0x7f9e380c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3659c640 1 -- 172.21.15.55:0/1893546948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380c7f10 con 0x7f9e3806c1f0 2024-04-25T09:03:20.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e3659c640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e3806c1f0 0x7f9e38158e10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800d7d0 tx=0x7f9e2800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e2effd640 1 -- 172.21.15.55:0/1893546948 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28004030 con 0x7f9e3806c1f0 2024-04-25T09:03:20.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.441+0000 7f9e2effd640 1 -- 172.21.15.55:0/1893546948 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e280041d0 con 0x7f9e3806c1f0 2024-04-25T09:03:20.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.442+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1893546948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e380c54d0 con 0x7f9e3806c1f0 2024-04-25T09:03:20.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.442+0000 7f9e2effd640 1 -- 172.21.15.55:0/1893546948 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800b6c0 con 0x7f9e3806c1f0 2024-04-25T09:03:20.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.442+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1893546948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e38159350 con 0x7f9e3806c1f0 2024-04-25T09:03:20.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.443+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1893546948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e380749b0 con 0x7f9e3806c1f0 2024-04-25T09:03:20.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.443+0000 7f9e2effd640 1 -- 172.21.15.55:0/1893546948 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9e2800b860 con 0x7f9e3806c1f0 2024-04-25T09:03:20.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.443+0000 7f9e2effd640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9e1806b4d0 0x7f9e1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.444+0000 7f9e2effd640 1 -- 172.21.15.55:0/1893546948 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f9e2808a630 con 0x7f9e3806c1f0 2024-04-25T09:03:20.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.444+0000 7f9e2ffff640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9e1806b4d0 0x7f9e1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.444+0000 7f9e2ffff640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9e1806b4d0 0x7f9e1806d990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9e20034000 tx=0x7f9e2002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.448+0000 7f9e2effd640 1 -- 172.21.15.55:0/1893546948 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9e28059370 con 0x7f9e3806c1f0 2024-04-25T09:03:20.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.665+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1893546948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e3809a570 con 0x7f9e3806c1f0 2024-04-25T09:03:20.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.666+0000 7f9e2effd640 1 -- 172.21.15.55:0/1893546948 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f9e28058c70 con 0x7f9e3806c1f0 2024-04-25T09:03:20.654 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:20.655 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":80,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":8754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/4013195286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4013195286},{"type":"v1","addr":"172.21.15.55:6837","nonce":4013195286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":79,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:03:17.764577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:20.655 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 80 2024-04-25T09:03:20.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1893546948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9e1806b4d0 msgr2=0x7f9e1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9e1806b4d0 0x7f9e1806d990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9e20034000 tx=0x7f9e2002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:20.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1893546948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e3806c1f0 msgr2=0x7f9e38158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e3806c1f0 0x7f9e38158e10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800d7d0 tx=0x7f9e2800dc90 comp rx=0 tx=0).stop 2024-04-25T09:03:20.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1893546948 shutdown_connections 2024-04-25T09:03:20.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9e1806b4d0 0x7f9e1806d990 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e3815ba10 0x7f9e380c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e38099f80 0x7f9e380c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 --2- 172.21.15.55:0/1893546948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e3806c1f0 0x7f9e38158e10 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1893546948 >> 172.21.15.55:0/1893546948 conn(0x7f9e380b32f0 msgr2=0x7f9e3815ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1893546948 shutdown_connections 2024-04-25T09:03:20.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.668+0000 7f9e3c94c640 1 -- 172.21.15.55:0/1893546948 wait complete. 2024-04-25T09:03:20.667 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:20.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.782+0000 7f68898f5640 1 Processor -- start 2024-04-25T09:03:20.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.782+0000 7f68898f5640 1 -- start start 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68898f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f688415dce0 0x7f68840d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68898f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68840b5b60 0x7f68840b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68898f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688415e0c0 con 0x7f68840d35b0 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68898f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68840d2510 con 0x7f68840b5b60 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68898f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68840d27f0 con 0x7f688415dce0 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68837fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68840b5b60 0x7f68840b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68837fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68840b5b60 0x7f68840b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53454/0 (socket says 172.21.15.55:53454) 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68837fe640 1 -- 172.21.15.55:0/1369874555 learned_addr learned my addr 172.21.15.55:0/1369874555 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f6882ffd640 1 --2- 172.21.15.55:0/1369874555 >> v2:172.21.15.167:3300/0 conn(0x7f688415dce0 0x7f68840d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68837fe640 1 -- 172.21.15.55:0/1369874555 >> v2:172.21.15.167:3300/0 conn(0x7f688415dce0 msgr2=0x7f68840d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68837fe640 1 --2- 172.21.15.55:0/1369874555 >> v2:172.21.15.167:3300/0 conn(0x7f688415dce0 0x7f68840d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68837fe640 1 -- 172.21.15.55:0/1369874555 >> v1:172.21.15.167:6789/0 conn(0x7f68840d35b0 legacy=0x7f68840b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.783+0000 7f68837fe640 1 -- 172.21.15.55:0/1369874555 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840d2ad0 con 0x7f68840b5b60 2024-04-25T09:03:20.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.784+0000 7f68837fe640 1 --2- 172.21.15.55:0/1369874555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68840b5b60 0x7f68840b6b00 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f68840ce220 tx=0x7f687402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe19324d580a09ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.784+0000 7f6881ffb640 1 -- 172.21.15.55:0/1369874555 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874036070 con 0x7f68840b5b60 2024-04-25T09:03:20.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.784+0000 7f6881ffb640 1 -- 172.21.15.55:0/1369874555 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874031600 con 0x7f68840b5b60 2024-04-25T09:03:20.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.784+0000 7f6881ffb640 1 -- 172.21.15.55:0/1369874555 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740319d0 con 0x7f68840b5b60 2024-04-25T09:03:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.785+0000 7f68898f5640 1 -- 172.21.15.55:0/1369874555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68840b5b60 msgr2=0x7f68840b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.785+0000 7f68898f5640 1 --2- 172.21.15.55:0/1369874555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68840b5b60 0x7f68840b6b00 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f68840ce220 tx=0x7f687402a730 comp rx=0 tx=0).stop 2024-04-25T09:03:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.785+0000 7f68898f5640 1 -- 172.21.15.55:0/1369874555 shutdown_connections 2024-04-25T09:03:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.785+0000 7f68898f5640 1 --2- 172.21.15.55:0/1369874555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68840b5b60 0x7f68840b6b00 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.785+0000 7f68898f5640 1 --2- 172.21.15.55:0/1369874555 >> v2:172.21.15.167:3300/0 conn(0x7f688415dce0 0x7f68840d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.785+0000 7f68898f5640 1 -- 172.21.15.55:0/1369874555 >> 172.21.15.55:0/1369874555 conn(0x7f6884072900 msgr2=0x7f68840d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.785+0000 7f68898f5640 1 -- 172.21.15.55:0/1369874555 shutdown_connections 2024-04-25T09:03:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.785+0000 7f68898f5640 1 -- 172.21.15.55:0/1369874555 wait complete. 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.786+0000 7f68898f5640 1 Processor -- start 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.786+0000 7f68898f5640 1 -- start start 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f68898f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68840b5b60 0x7f68841f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f68898f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68840d35b0 0x7f688414dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f68898f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688415dce0 0x7f6884160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f68898f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68840b9820 con 0x7f68840b5b60 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f68898f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68840d3090 con 0x7f688415dce0 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f68898f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68840b99a0 con 0x7f68840d35b0 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f6882ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68840b5b60 0x7f68841f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f6882ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68840b5b60 0x7f68841f3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53458/0 (socket says 172.21.15.55:53458) 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f6882ffd640 1 -- 172.21.15.55:0/4168055929 learned_addr learned my addr 172.21.15.55:0/4168055929 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f68837fe640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688415dce0 0x7f6884160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f68827fc640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68840d35b0 0x7f688414dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f6882ffd640 1 -- 172.21.15.55:0/4168055929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68840d35b0 msgr2=0x7f688414dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f6882ffd640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68840d35b0 0x7f688414dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f6882ffd640 1 -- 172.21.15.55:0/4168055929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688415dce0 msgr2=0x7f6884160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f6882ffd640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688415dce0 0x7f6884160c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f6882ffd640 1 -- 172.21.15.55:0/4168055929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68841611c0 con 0x7f68840b5b60 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f68827fc640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68840d35b0 0x7f688414dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.787+0000 7f6882ffd640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68840b5b60 0x7f68841f3470 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f687c00d5f0 tx=0x7f687c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.788+0000 7f687bfff640 1 -- 172.21.15.55:0/4168055929 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c0125f0 con 0x7f68840b5b60 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.788+0000 7f687bfff640 1 -- 172.21.15.55:0/4168055929 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c019070 con 0x7f68840b5b60 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.788+0000 7f687bfff640 1 -- 172.21.15.55:0/4168055929 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c0129d0 con 0x7f68840b5b60 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.788+0000 7f68898f5640 1 -- 172.21.15.55:0/4168055929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68841f3ad0 con 0x7f68840b5b60 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.788+0000 7f68898f5640 1 -- 172.21.15.55:0/4168055929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68841f4090 con 0x7f68840b5b60 2024-04-25T09:03:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.789+0000 7f68898f5640 1 -- 172.21.15.55:0/4168055929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68840749b0 con 0x7f68840b5b60 2024-04-25T09:03:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.789+0000 7f687bfff640 1 -- 172.21.15.55:0/4168055929 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f687c012b70 con 0x7f68840b5b60 2024-04-25T09:03:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.790+0000 7f687bfff640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f686406b4d0 0x7f686406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.790+0000 7f687bfff640 1 -- 172.21.15.55:0/4168055929 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f687c08a5e0 con 0x7f68840b5b60 2024-04-25T09:03:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.790+0000 7f68827fc640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f686406b4d0 0x7f686406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.790+0000 7f68827fc640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f686406b4d0 0x7f686406d990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f68841f69f0 tx=0x7f686c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:20.794+0000 7f687bfff640 1 -- 172.21.15.55:0/4168055929 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f687c059440 con 0x7f68840b5b60 2024-04-25T09:03:21.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.019+0000 7f68898f5640 1 -- 172.21.15.55:0/4168055929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68840b6c60 con 0x7f68840b5b60 2024-04-25T09:03:21.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.020+0000 7f687bfff640 1 -- 172.21.15.55:0/4168055929 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f687c058d40 con 0x7f68840b5b60 2024-04-25T09:03:21.009 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:21.009 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":80,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":8754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/4013195286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4013195286},{"type":"v1","addr":"172.21.15.55:6837","nonce":4013195286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":79,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:52.042907+0000","modified":"2024-04-25T09:03:17.764577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:03:21.009 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 80 2024-04-25T09:03:21.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 -- 172.21.15.55:0/4168055929 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f686406b4d0 msgr2=0x7f686406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f686406b4d0 0x7f686406d990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f68841f69f0 tx=0x7f686c009040 comp rx=0 tx=0).stop 2024-04-25T09:03:21.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 -- 172.21.15.55:0/4168055929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68840b5b60 msgr2=0x7f68841f3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68840b5b60 0x7f68841f3470 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f687c00d5f0 tx=0x7f687c00dab0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 -- 172.21.15.55:0/4168055929 shutdown_connections 2024-04-25T09:03:21.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f686406b4d0 0x7f686406d990 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688415dce0 0x7f6884160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68840d35b0 0x7f688414dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 --2- 172.21.15.55:0/4168055929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68840b5b60 0x7f68841f3470 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 -- 172.21.15.55:0/4168055929 >> 172.21.15.55:0/4168055929 conn(0x7f6884072900 msgr2=0x7f68840ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 -- 172.21.15.55:0/4168055929 shutdown_connections 2024-04-25T09:03:21.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.022+0000 7f68898f5640 1 -- 172.21.15.55:0/4168055929 wait complete. 2024-04-25T09:03:21.022 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:21.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.134+0000 7fbc940dd640 1 Processor -- start 2024-04-25T09:03:21.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.134+0000 7fbc940dd640 1 -- start start 2024-04-25T09:03:21.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.135+0000 7fbc940dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c15dce0 0x7fbc8c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.135+0000 7fbc940dd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbc8c0b5b60 0x7fbc8c0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.135+0000 7fbc940dd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8c15e0c0 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.135+0000 7fbc940dd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c0d2510 con 0x7fbc8c0b5b60 2024-04-25T09:03:21.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.135+0000 7fbc940dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0d27f0 con 0x7fbc8c15dce0 2024-04-25T09:03:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.136+0000 7fbc9267a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbc8c0b5b60 0x7fbc8c0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.136+0000 7fbc91e79640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c15dce0 0x7fbc8c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.136+0000 7fbc91678640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbc8c0d35b0 0x7fbc8c0b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:38248/0 (socket says 172.21.15.55:38248) 2024-04-25T09:03:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.136+0000 7fbc91e79640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c15dce0 0x7fbc8c0d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:34826/0 (socket says 172.21.15.55:34826) 2024-04-25T09:03:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.136+0000 7fbc9267a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbc8c0b5b60 0x7fbc8c0b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:39672/0 (socket says 172.21.15.55:39672) 2024-04-25T09:03:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.136+0000 7fbc91678640 1 -- 172.21.15.55:0/620184319 learned_addr learned my addr 172.21.15.55:0/620184319 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.136+0000 7fbc91e79640 1 -- 172.21.15.55:0/620184319 >> v2:172.21.15.167:3300/0 conn(0x7fbc8c0b5b60 msgr2=0x7fbc8c0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.136+0000 7fbc91e79640 1 --2- 172.21.15.55:0/620184319 >> v2:172.21.15.167:3300/0 conn(0x7fbc8c0b5b60 0x7fbc8c0b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.136+0000 7fbc91e79640 1 -- 172.21.15.55:0/620184319 >> v1:172.21.15.167:6789/0 conn(0x7fbc8c0d35b0 legacy=0x7fbc8c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.136+0000 7fbc91e79640 1 -- 172.21.15.55:0/620184319 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c0d2ad0 con 0x7fbc8c15dce0 2024-04-25T09:03:21.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.137+0000 7fbc91e79640 1 --2- 172.21.15.55:0/620184319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c15dce0 0x7fbc8c0d1a50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbc840097a0 tx=0x7fbc8402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c974e581100593 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.137+0000 7fbc90e77640 1 -- 172.21.15.55:0/620184319 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84037070 con 0x7fbc8c15dce0 2024-04-25T09:03:21.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.137+0000 7fbc90e77640 1 -- 172.21.15.55:0/620184319 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc84032440 con 0x7fbc8c15dce0 2024-04-25T09:03:21.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.137+0000 7fbc90e77640 1 -- 172.21.15.55:0/620184319 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84032810 con 0x7fbc8c15dce0 2024-04-25T09:03:21.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.137+0000 7fbc940dd640 1 -- 172.21.15.55:0/620184319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c15dce0 msgr2=0x7fbc8c0d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.137+0000 7fbc940dd640 1 --2- 172.21.15.55:0/620184319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c15dce0 0x7fbc8c0d1a50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbc840097a0 tx=0x7fbc8402a180 comp rx=0 tx=0).stop 2024-04-25T09:03:21.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.137+0000 7fbc940dd640 1 -- 172.21.15.55:0/620184319 shutdown_connections 2024-04-25T09:03:21.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.137+0000 7fbc940dd640 1 --2- 172.21.15.55:0/620184319 >> v2:172.21.15.167:3300/0 conn(0x7fbc8c0b5b60 0x7fbc8c0b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.137+0000 7fbc940dd640 1 --2- 172.21.15.55:0/620184319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c15dce0 0x7fbc8c0d1a50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.137+0000 7fbc940dd640 1 -- 172.21.15.55:0/620184319 >> 172.21.15.55:0/620184319 conn(0x7fbc8c072900 msgr2=0x7fbc8c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.138+0000 7fbc940dd640 1 -- 172.21.15.55:0/620184319 shutdown_connections 2024-04-25T09:03:21.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.138+0000 7fbc940dd640 1 -- 172.21.15.55:0/620184319 wait complete. 2024-04-25T09:03:21.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.139+0000 7fbc940dd640 1 Processor -- start 2024-04-25T09:03:21.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.139+0000 7fbc940dd640 1 -- start start 2024-04-25T09:03:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.139+0000 7fbc940dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c0b5b60 0x7fbc8c0b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.139+0000 7fbc940dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d35b0 0x7fbc8c0b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.139+0000 7fbc940dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc8c15dce0 0x7fbc8c0cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.139+0000 7fbc940dd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0b9820 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.139+0000 7fbc940dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0d3090 con 0x7fbc8c15dce0 2024-04-25T09:03:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.139+0000 7fbc940dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0b99a0 con 0x7fbc8c0b5b60 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc91678640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d35b0 0x7fbc8c0b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc91678640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d35b0 0x7fbc8c0b75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53464/0 (socket says 172.21.15.55:53464) 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc91678640 1 -- 172.21.15.55:0/3580052006 learned_addr learned my addr 172.21.15.55:0/3580052006 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc9267a640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc8c15dce0 0x7fbc8c0cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc91678640 1 -- 172.21.15.55:0/3580052006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c0b5b60 msgr2=0x7fbc8c0b7060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc91678640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c0b5b60 0x7fbc8c0b7060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc91678640 1 -- 172.21.15.55:0/3580052006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc8c15dce0 msgr2=0x7fbc8c0cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc91678640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc8c15dce0 0x7fbc8c0cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc91678640 1 -- 172.21.15.55:0/3580052006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c160520 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc91678640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d35b0 0x7fbc8c0b75a0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000c430 tx=0x7fbc8000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/3580052006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80017070 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/3580052006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc80005ce0 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc940dd640 1 -- 172.21.15.55:0/3580052006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c160800 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/3580052006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc800072f0 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.140+0000 7fbc940dd640 1 -- 172.21.15.55:0/3580052006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c160dc0 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.141+0000 7fbc940dd640 1 -- 172.21.15.55:0/3580052006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c0749b0 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.142+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/3580052006 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbc8001a070 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.142+0000 7fbc8a7fc640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 0x7fbc7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.142+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/3580052006 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fbc800897e0 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.142+0000 7fbc91e79640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 0x7fbc7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.143+0000 7fbc91e79640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 0x7fbc7806d990 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbc84034000 tx=0x7fbc8402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.146+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/3580052006 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc800584a0 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.328+0000 7fbc940dd640 1 -- 172.21.15.55:0/3580052006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc8c0d0780 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.329+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/3580052006 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+16876 (secure 0 0 0) 0x7fbc80057da0 con 0x7fbc8c0d35b0 2024-04-25T09:03:21.318 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:21.318 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":104,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:17.764590+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:50.330313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:51.020096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3048692204":"2024-04-26T09:03:17.764566+0000","172.21.15.55:6834/3048692204":"2024-04-26T09:03:17.764566+0000","172.21.15.55:6837/538888347":"2024-04-26T09:02:41.385611+0000","172.21.15.55:6834/538888347":"2024-04-26T09:02:41.385611+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 -- 172.21.15.55:0/3580052006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 msgr2=0x7fbc7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 0x7fbc7806d990 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbc84034000 tx=0x7fbc8402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 -- 172.21.15.55:0/3580052006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d35b0 msgr2=0x7fbc8c0b75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d35b0 0x7fbc8c0b75a0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000c430 tx=0x7fbc8000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 -- 172.21.15.55:0/3580052006 shutdown_connections 2024-04-25T09:03:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 0x7fbc7806d990 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc8c15dce0 0x7fbc8c0cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d35b0 0x7fbc8c0b75a0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 --2- 172.21.15.55:0/3580052006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c0b5b60 0x7fbc8c0b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 -- 172.21.15.55:0/3580052006 >> 172.21.15.55:0/3580052006 conn(0x7fbc8c072900 msgr2=0x7fbc8c0b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 -- 172.21.15.55:0/3580052006 shutdown_connections 2024-04-25T09:03:21.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.331+0000 7fbc940dd640 1 -- 172.21.15.55:0/3580052006 wait complete. 2024-04-25T09:03:21.331 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:03:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.445+0000 7efc326a1640 1 Processor -- start 2024-04-25T09:03:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.445+0000 7efc326a1640 1 -- start start 2024-04-25T09:03:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.445+0000 7efc326a1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efc2c1610b0 0x7efc2c0b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.445+0000 7efc326a1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efc2c1618d0 0x7efc2c0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc326a1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c162040 con 0x7efc2c0ced70 2024-04-25T09:03:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc326a1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0cf1c0 con 0x7efc2c1610b0 2024-04-25T09:03:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc326a1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0d1ea0 con 0x7efc2c1618d0 2024-04-25T09:03:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc2bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efc2c1610b0 0x7efc2c0b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc30c3e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efc2c0ced70 0x7efc2c06c250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35882/0 (socket says 172.21.15.55:35882) 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc30c3e640 1 -- 172.21.15.55:0/1564943632 learned_addr learned my addr 172.21.15.55:0/1564943632 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc2b7fe640 1 --2- 172.21.15.55:0/1564943632 >> v2:172.21.15.167:3300/0 conn(0x7efc2c1618d0 0x7efc2c0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc2affd640 1 -- 172.21.15.55:0/1564943632 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327549516 0 0) 0x7efc2c162040 con 0x7efc2c0ced70 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc2affd640 1 -- 172.21.15.55:0/1564943632 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc14003520 con 0x7efc2c0ced70 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc2bfff640 1 -- 172.21.15.55:0/1564943632 >> v2:172.21.15.167:3300/0 conn(0x7efc2c1618d0 msgr2=0x7efc2c0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc2bfff640 1 --2- 172.21.15.55:0/1564943632 >> v2:172.21.15.167:3300/0 conn(0x7efc2c1618d0 0x7efc2c0ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc2bfff640 1 -- 172.21.15.55:0/1564943632 >> v1:172.21.15.55:6789/0 conn(0x7efc2c0ced70 legacy=0x7efc2c06c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.446+0000 7efc2bfff640 1 -- 172.21.15.55:0/1564943632 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c162320 con 0x7efc2c1610b0 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc2bfff640 1 --2- 172.21.15.55:0/1564943632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc2c1610b0 0x7efc2c0b9580 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7efc2c06d320 tx=0x7efc1c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1a4254458ad491 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc2affd640 1 -- 172.21.15.55:0/1564943632 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c037070 con 0x7efc2c1610b0 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc2affd640 1 -- 172.21.15.55:0/1564943632 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c032440 con 0x7efc2c1610b0 2024-04-25T09:03:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc2affd640 1 -- 172.21.15.55:0/1564943632 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c02ae60 con 0x7efc2c1610b0 2024-04-25T09:03:21.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc326a1640 1 -- 172.21.15.55:0/1564943632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc2c1610b0 msgr2=0x7efc2c0b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc326a1640 1 --2- 172.21.15.55:0/1564943632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc2c1610b0 0x7efc2c0b9580 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7efc2c06d320 tx=0x7efc1c02a110 comp rx=0 tx=0).stop 2024-04-25T09:03:21.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc326a1640 1 -- 172.21.15.55:0/1564943632 shutdown_connections 2024-04-25T09:03:21.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc326a1640 1 --2- 172.21.15.55:0/1564943632 >> v2:172.21.15.167:3300/0 conn(0x7efc2c1618d0 0x7efc2c0ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc326a1640 1 --2- 172.21.15.55:0/1564943632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc2c1610b0 0x7efc2c0b9580 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc326a1640 1 -- 172.21.15.55:0/1564943632 >> 172.21.15.55:0/1564943632 conn(0x7efc2c0b5570 msgr2=0x7efc2c0b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc326a1640 1 -- 172.21.15.55:0/1564943632 shutdown_connections 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.447+0000 7efc326a1640 1 -- 172.21.15.55:0/1564943632 wait complete. 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.449+0000 7efc326a1640 1 Processor -- start 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.449+0000 7efc326a1640 1 -- start start 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.449+0000 7efc326a1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc2c0ced70 0x7efc2c14c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.449+0000 7efc326a1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc2c1610b0 0x7efc2c152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.449+0000 7efc326a1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc2c1618d0 0x7efc2c14f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.449+0000 7efc326a1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0b6c00 con 0x7efc2c1610b0 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.449+0000 7efc326a1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0d20f0 con 0x7efc2c0ced70 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.449+0000 7efc326a1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c161d10 con 0x7efc2c1618d0 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc2b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc2c1610b0 0x7efc2c152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc2b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc2c1610b0 0x7efc2c152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53490/0 (socket says 172.21.15.55:53490) 2024-04-25T09:03:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc2b7fe640 1 -- 172.21.15.55:0/1590842108 learned_addr learned my addr 172.21.15.55:0/1590842108 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc30c3e640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc2c1618d0 0x7efc2c14f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc2bfff640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc2c0ced70 0x7efc2c14c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc2b7fe640 1 -- 172.21.15.55:0/1590842108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc2c1618d0 msgr2=0x7efc2c14f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc2b7fe640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc2c1618d0 0x7efc2c14f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc2b7fe640 1 -- 172.21.15.55:0/1590842108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc2c0ced70 msgr2=0x7efc2c14c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc2b7fe640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc2c0ced70 0x7efc2c14c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc2b7fe640 1 -- 172.21.15.55:0/1590842108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c151e00 con 0x7efc2c1610b0 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc2bfff640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc2c0ced70 0x7efc2c14c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc2b7fe640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc2c1610b0 0x7efc2c152ea0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7efc2000d620 tx=0x7efc2000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc28ff9640 1 -- 172.21.15.55:0/1590842108 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2000b620 con 0x7efc2c1610b0 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc28ff9640 1 -- 172.21.15.55:0/1590842108 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc20019070 con 0x7efc2c1610b0 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc326a1640 1 -- 172.21.15.55:0/1590842108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c1520e0 con 0x7efc2c1610b0 2024-04-25T09:03:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc28ff9640 1 -- 172.21.15.55:0/1590842108 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2000ba00 con 0x7efc2c1610b0 2024-04-25T09:03:21.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.450+0000 7efc326a1640 1 -- 172.21.15.55:0/1590842108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c1526a0 con 0x7efc2c1610b0 2024-04-25T09:03:21.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.451+0000 7efc326a1640 1 -- 172.21.15.55:0/1590842108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c0750b0 con 0x7efc2c1610b0 2024-04-25T09:03:21.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.452+0000 7efc28ff9640 1 -- 172.21.15.55:0/1590842108 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc2000bba0 con 0x7efc2c1610b0 2024-04-25T09:03:21.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.452+0000 7efc28ff9640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1806b4d0 0x7efc1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.452+0000 7efc28ff9640 1 -- 172.21.15.55:0/1590842108 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7efc2008a790 con 0x7efc2c1610b0 2024-04-25T09:03:21.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.452+0000 7efc2bfff640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1806b4d0 0x7efc1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.453+0000 7efc2bfff640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1806b4d0 0x7efc1806d990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7efc1c034000 tx=0x7efc1c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.457+0000 7efc28ff9640 1 -- 172.21.15.55:0/1590842108 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc200594c0 con 0x7efc2c1610b0 2024-04-25T09:03:21.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.674+0000 7efc326a1640 1 -- 172.21.15.55:0/1590842108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efc2c0d1770 con 0x7efc2c1610b0 2024-04-25T09:03:21.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.834+0000 7efc28ff9640 1 -- 172.21.15.55:0/1590842108 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v81) v1 ==== 161+0+0 (secure 0 0 0) 0x7efc20058dc0 con 0x7efc2c1610b0 2024-04-25T09:03:21.823 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:03:21.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 -- 172.21.15.55:0/1590842108 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1806b4d0 msgr2=0x7efc1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1806b4d0 0x7efc1806d990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7efc1c034000 tx=0x7efc1c02e000 comp rx=0 tx=0).stop 2024-04-25T09:03:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 -- 172.21.15.55:0/1590842108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc2c1610b0 msgr2=0x7efc2c152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc2c1610b0 0x7efc2c152ea0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7efc2000d620 tx=0x7efc2000dae0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 -- 172.21.15.55:0/1590842108 shutdown_connections 2024-04-25T09:03:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efc1806b4d0 0x7efc1806d990 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc2c1618d0 0x7efc2c14f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc2c1610b0 0x7efc2c152ea0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 --2- 172.21.15.55:0/1590842108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc2c0ced70 0x7efc2c14c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 -- 172.21.15.55:0/1590842108 >> 172.21.15.55:0/1590842108 conn(0x7efc2c0b5570 msgr2=0x7efc2c0cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 -- 172.21.15.55:0/1590842108 shutdown_connections 2024-04-25T09:03:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.837+0000 7efc326a1640 1 -- 172.21.15.55:0/1590842108 wait complete. 2024-04-25T09:03:21.836 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:03:21.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.951+0000 7f2c06210640 1 Processor -- start 2024-04-25T09:03:21.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.951+0000 7f2c06210640 1 -- start start 2024-04-25T09:03:21.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.952+0000 7f2c06210640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c000cd310 0x7f2c00166670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.952+0000 7f2c06210640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0006dcb0 con 0x7f2c00144e70 2024-04-25T09:03:21.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.952+0000 7f2c06210640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0006df90 con 0x7f2c000ce9d0 2024-04-25T09:03:21.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.952+0000 7f2c06210640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0015bfe0 con 0x7f2c000cd310 2024-04-25T09:03:21.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.952+0000 7f2bff7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2c00144e70 0x7f2c0006d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35894/0 (socket says 172.21.15.55:35894) 2024-04-25T09:03:21.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.952+0000 7f2bfffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c000cd310 0x7f2c00166670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.952+0000 7f2bff7fe640 1 -- 172.21.15.55:0/2905576210 learned_addr learned my addr 172.21.15.55:0/2905576210 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:21.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.952+0000 7f2bfffff640 1 -- 172.21.15.55:0/2905576210 >> v1:172.21.15.167:6789/0 conn(0x7f2c000ce9d0 legacy=0x7f2c000cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:21.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.952+0000 7f2bfffff640 1 -- 172.21.15.55:0/2905576210 >> v1:172.21.15.55:6789/0 conn(0x7f2c00144e70 legacy=0x7f2c0006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.952+0000 7f2bfffff640 1 -- 172.21.15.55:0/2905576210 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0006e270 con 0x7f2c000cd310 2024-04-25T09:03:21.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.953+0000 7f2bfffff640 1 --2- 172.21.15.55:0/2905576210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c000cd310 0x7f2c00166670 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f2c0015c160 tx=0x7f2bf802a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d02e866bfd51ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.953+0000 7f2bfe7fc640 1 -- 172.21.15.55:0/2905576210 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8007740 con 0x7f2c000cd310 2024-04-25T09:03:21.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.953+0000 7f2bfe7fc640 1 -- 172.21.15.55:0/2905576210 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf80078e0 con 0x7f2c000cd310 2024-04-25T09:03:21.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.953+0000 7f2bfe7fc640 1 -- 172.21.15.55:0/2905576210 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8007cb0 con 0x7f2c000cd310 2024-04-25T09:03:21.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.954+0000 7f2c06210640 1 -- 172.21.15.55:0/2905576210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c000cd310 msgr2=0x7f2c00166670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.954+0000 7f2c06210640 1 --2- 172.21.15.55:0/2905576210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c000cd310 0x7f2c00166670 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f2c0015c160 tx=0x7f2bf802a570 comp rx=0 tx=0).stop 2024-04-25T09:03:21.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.954+0000 7f2c06210640 1 -- 172.21.15.55:0/2905576210 shutdown_connections 2024-04-25T09:03:21.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.954+0000 7f2c06210640 1 --2- 172.21.15.55:0/2905576210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c000cd310 0x7f2c00166670 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.954+0000 7f2c06210640 1 -- 172.21.15.55:0/2905576210 >> 172.21.15.55:0/2905576210 conn(0x7f2c0006aba0 msgr2=0x7f2c0006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.954+0000 7f2c06210640 1 -- 172.21.15.55:0/2905576210 shutdown_connections 2024-04-25T09:03:21.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.954+0000 7f2c06210640 1 -- 172.21.15.55:0/2905576210 wait complete. 2024-04-25T09:03:21.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.955+0000 7f2c06210640 1 Processor -- start 2024-04-25T09:03:21.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.955+0000 7f2c06210640 1 -- start start 2024-04-25T09:03:21.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2c06210640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c000cd310 0x7f2c000b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2c06210640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c000ce9d0 0x7f2c000afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2c06210640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c00144e70 0x7f2c001f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2c06210640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c001454b0 con 0x7f2c000cd310 2024-04-25T09:03:21.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2c06210640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0006d970 con 0x7f2c00144e70 2024-04-25T09:03:21.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2c06210640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c00145630 con 0x7f2c000ce9d0 2024-04-25T09:03:21.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2bff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c000cd310 0x7f2c000b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2bff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c000cd310 0x7f2c000b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53510/0 (socket says 172.21.15.55:53510) 2024-04-25T09:03:21.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2bff7fe640 1 -- 172.21.15.55:0/3834636134 learned_addr learned my addr 172.21.15.55:0/3834636134 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:21.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2bfffff640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c00144e70 0x7f2c001f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2bfeffd640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c000ce9d0 0x7f2c000afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2bff7fe640 1 -- 172.21.15.55:0/3834636134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c000ce9d0 msgr2=0x7f2c000afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2bff7fe640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c000ce9d0 0x7f2c000afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2bff7fe640 1 -- 172.21.15.55:0/3834636134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c00144e70 msgr2=0x7f2c001f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2bff7fe640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c00144e70 0x7f2c001f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.956+0000 7f2bff7fe640 1 -- 172.21.15.55:0/3834636134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c001f43e0 con 0x7f2c000cd310 2024-04-25T09:03:21.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.957+0000 7f2bff7fe640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c000cd310 0x7f2c000b1a80 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000c3c0 tx=0x7f2bf000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.957+0000 7f2be7fff640 1 -- 172.21.15.55:0/3834636134 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0017070 con 0x7f2c000cd310 2024-04-25T09:03:21.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.957+0000 7f2c06210640 1 -- 172.21.15.55:0/3834636134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c001f46c0 con 0x7f2c000cd310 2024-04-25T09:03:21.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.957+0000 7f2be7fff640 1 -- 172.21.15.55:0/3834636134 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0005ce0 con 0x7f2c000cd310 2024-04-25T09:03:21.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.957+0000 7f2be7fff640 1 -- 172.21.15.55:0/3834636134 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf00072f0 con 0x7f2c000cd310 2024-04-25T09:03:21.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.957+0000 7f2c06210640 1 -- 172.21.15.55:0/3834636134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0013ccf0 con 0x7f2c000cd310 2024-04-25T09:03:21.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.958+0000 7f2c06210640 1 -- 172.21.15.55:0/3834636134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c000750b0 con 0x7f2c000cd310 2024-04-25T09:03:21.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.958+0000 7f2be7fff640 1 -- 172.21.15.55:0/3834636134 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2bf001a070 con 0x7f2c000cd310 2024-04-25T09:03:21.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.959+0000 7f2be7fff640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2bec06b4d0 0x7f2bec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.959+0000 7f2be7fff640 1 -- 172.21.15.55:0/3834636134 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f2bf00896f0 con 0x7f2c000cd310 2024-04-25T09:03:21.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.959+0000 7f2bfeffd640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2bec06b4d0 0x7f2bec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.959+0000 7f2bfeffd640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2bec06b4d0 0x7f2bec06d990 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2c0015b120 tx=0x7f2bf4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:21.963+0000 7f2be7fff640 1 -- 172.21.15.55:0/3834636134 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2bf0057d50 con 0x7f2c000cd310 2024-04-25T09:03:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.186+0000 7f2c06210640 1 -- 172.21.15.55:0/3834636134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2c000aebe0 con 0x7f2c000cd310 2024-04-25T09:03:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.842+0000 7f2be7fff640 1 -- 172.21.15.55:0/3834636134 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v82) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2bf005bdf0 con 0x7f2c000cd310 2024-04-25T09:03:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 -- 172.21.15.55:0/3834636134 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2bec06b4d0 msgr2=0x7f2bec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2bec06b4d0 0x7f2bec06d990 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2c0015b120 tx=0x7f2bf4009040 comp rx=0 tx=0).stop 2024-04-25T09:03:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 -- 172.21.15.55:0/3834636134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c000cd310 msgr2=0x7f2c000b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c000cd310 0x7f2c000b1a80 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000c3c0 tx=0x7f2bf000c880 comp rx=0 tx=0).stop 2024-04-25T09:03:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 -- 172.21.15.55:0/3834636134 shutdown_connections 2024-04-25T09:03:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2bec06b4d0 0x7f2bec06d990 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c00144e70 0x7f2c001f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c000ce9d0 0x7f2c000afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 --2- 172.21.15.55:0/3834636134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c000cd310 0x7f2c000b1a80 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 -- 172.21.15.55:0/3834636134 >> 172.21.15.55:0/3834636134 conn(0x7f2c0006aba0 msgr2=0x7f2c000cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:22.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 -- 172.21.15.55:0/3834636134 shutdown_connections 2024-04-25T09:03:22.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.844+0000 7f2c06210640 1 -- 172.21.15.55:0/3834636134 wait complete. 2024-04-25T09:03:22.846 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:03:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.967+0000 7fbc940b5640 1 Processor -- start 2024-04-25T09:03:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.967+0000 7fbc940b5640 1 -- start start 2024-04-25T09:03:22.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.968+0000 7fbc940b5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c1610b0 0x7fbc8c0b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.968+0000 7fbc940b5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8c162040 con 0x7fbc8c1618d0 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.968+0000 7fbc940b5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8c162320 con 0x7fbc8c0cef40 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.968+0000 7fbc940b5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0d1ea0 con 0x7fbc8c1610b0 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.968+0000 7fbc91650640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbc8c1618d0 0x7fbc8c0ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35908/0 (socket says 172.21.15.55:35908) 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.968+0000 7fbc91650640 1 -- 172.21.15.55:0/3312351120 learned_addr learned my addr 172.21.15.55:0/3312351120 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc91e51640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c1610b0 0x7fbc8c0b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911823389 0 0) 0x7fbc8c162040 con 0x7fbc8c1618d0 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc74003520 con 0x7fbc8c1618d0 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 160292117 0 0) 0x7fbc74003520 con 0x7fbc8c1618d0 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c1610b0 msgr2=0x7fbc8c0b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c1610b0 0x7fbc8c0b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 >> v1:172.21.15.167:6789/0 conn(0x7fbc8c0cef40 legacy=0x7fbc8c0d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c162600 con 0x7fbc8c1618d0 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fbc80001690 con 0x7fbc8c1618d0 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 >> v1:172.21.15.55:6789/0 conn(0x7fbc8c1618d0 legacy=0x7fbc8c0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc740039e0 0x7fbc74003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc74004390 0x7fbc74004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c1610b0 0x7fbc74005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0d1ea0 con 0x7fbc740039e0 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7400ba70 con 0x7fbc74004390 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7400bc70 con 0x7fbc8c1610b0 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc91e51640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc740039e0 0x7fbc74003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc91650640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc74004390 0x7fbc74004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc92652640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c1610b0 0x7fbc74005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc91e51640 1 -- 172.21.15.55:0/3312351120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c1610b0 msgr2=0x7fbc74005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc91e51640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c1610b0 0x7fbc74005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc91e51640 1 -- 172.21.15.55:0/3312351120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc74004390 msgr2=0x7fbc74004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc91e51640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc74004390 0x7fbc74004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.969+0000 7fbc91e51640 1 -- 172.21.15.55:0/3312351120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74003520 con 0x7fbc740039e0 2024-04-25T09:03:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.970+0000 7fbc91e51640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc740039e0 0x7fbc74003dc0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009ac0 tx=0x7fbc74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb152e064ab02301 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.970+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84036070 con 0x7fbc740039e0 2024-04-25T09:03:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.970+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc84031400 con 0x7fbc740039e0 2024-04-25T09:03:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.970+0000 7fbc90e4f640 1 -- 172.21.15.55:0/3312351120 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84009690 con 0x7fbc740039e0 2024-04-25T09:03:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.971+0000 7fbc940b5640 1 -- 172.21.15.55:0/3312351120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc740039e0 msgr2=0x7fbc74003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.971+0000 7fbc940b5640 1 --2- 172.21.15.55:0/3312351120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc740039e0 0x7fbc74003dc0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009ac0 tx=0x7fbc74005830 comp rx=0 tx=0).stop 2024-04-25T09:03:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.971+0000 7fbc92652640 1 -- 172.21.15.55:0/3312351120 reap_dead start 2024-04-25T09:03:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.971+0000 7fbc940b5640 1 -- 172.21.15.55:0/3312351120 shutdown_connections 2024-04-25T09:03:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.971+0000 7fbc940b5640 1 -- 172.21.15.55:0/3312351120 >> 172.21.15.55:0/3312351120 conn(0x7fbc8c0b5570 msgr2=0x7fbc8c0b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.971+0000 7fbc940b5640 1 -- 172.21.15.55:0/3312351120 shutdown_connections 2024-04-25T09:03:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.971+0000 7fbc940b5640 1 -- 172.21.15.55:0/3312351120 wait complete. 2024-04-25T09:03:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.972+0000 7fbc940b5640 1 Processor -- start 2024-04-25T09:03:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.972+0000 7fbc940b5640 1 -- start start 2024-04-25T09:03:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc940b5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc740039e0 0x7fbc8c14b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc940b5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c0d0c50 0x7fbc8c15d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc940b5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d29a0 0x7fbc8c0d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc940b5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c161d10 con 0x7fbc8c0d29a0 2024-04-25T09:03:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc940b5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0b6c00 con 0x7fbc740039e0 2024-04-25T09:03:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc940b5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c161490 con 0x7fbc8c0d0c50 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc92652640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d29a0 0x7fbc8c0d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc92652640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d29a0 0x7fbc8c0d2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53526/0 (socket says 172.21.15.55:53526) 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc92652640 1 -- 172.21.15.55:0/1491697866 learned_addr learned my addr 172.21.15.55:0/1491697866 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc91650640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c0d0c50 0x7fbc8c15d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc91e51640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc740039e0 0x7fbc8c14b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc92652640 1 -- 172.21.15.55:0/1491697866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c0d0c50 msgr2=0x7fbc8c15d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc92652640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c0d0c50 0x7fbc8c15d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc92652640 1 -- 172.21.15.55:0/1491697866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc740039e0 msgr2=0x7fbc8c14b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc92652640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc740039e0 0x7fbc8c14b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.973+0000 7fbc92652640 1 -- 172.21.15.55:0/1491697866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c15cf90 con 0x7fbc8c0d29a0 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.974+0000 7fbc92652640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d29a0 0x7fbc8c0d2e20 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0d03e0 tx=0x7fbc7c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.974+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/1491697866 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c006d60 con 0x7fbc8c0d29a0 2024-04-25T09:03:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.974+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/1491697866 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c003970 con 0x7fbc8c0d29a0 2024-04-25T09:03:22.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.974+0000 7fbc940b5640 1 -- 172.21.15.55:0/1491697866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c15d270 con 0x7fbc8c0d29a0 2024-04-25T09:03:22.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.974+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/1491697866 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c003d60 con 0x7fbc8c0d29a0 2024-04-25T09:03:22.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.974+0000 7fbc940b5640 1 -- 172.21.15.55:0/1491697866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c153cf0 con 0x7fbc8c0d29a0 2024-04-25T09:03:22.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.975+0000 7fbc940b5640 1 -- 172.21.15.55:0/1491697866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c153ef0 con 0x7fbc8c0d29a0 2024-04-25T09:03:22.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.975+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/1491697866 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbc7c005070 con 0x7fbc8c0d29a0 2024-04-25T09:03:22.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.976+0000 7fbc8a7fc640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 0x7fbc7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.976+0000 7fbc91e51640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 0x7fbc7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.976+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/1491697866 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fbc7c089ad0 con 0x7fbc8c0d29a0 2024-04-25T09:03:22.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.976+0000 7fbc91e51640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 0x7fbc7806d990 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbc84033000 tx=0x7fbc84008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:22.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:22.980+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/1491697866 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc8c153ef0 con 0x7fbc8c0d29a0 2024-04-25T09:03:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.163+0000 7fbc940b5640 1 -- 172.21.15.55:0/1491697866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbc8c0750b0 con 0x7fbc8c0d29a0 2024-04-25T09:03:23.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.851+0000 7fbc8a7fc640 1 -- 172.21.15.55:0/1491697866 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbc7c058250 con 0x7fbc8c0d29a0 2024-04-25T09:03:23.840 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:03:23.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.854+0000 7fbc940b5640 1 -- 172.21.15.55:0/1491697866 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 msgr2=0x7fbc7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.854+0000 7fbc940b5640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 0x7fbc7806d990 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbc84033000 tx=0x7fbc84008030 comp rx=0 tx=0).stop 2024-04-25T09:03:23.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.854+0000 7fbc940b5640 1 -- 172.21.15.55:0/1491697866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d29a0 msgr2=0x7fbc8c0d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.854+0000 7fbc940b5640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d29a0 0x7fbc8c0d2e20 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0d03e0 tx=0x7fbc7c00ec80 comp rx=0 tx=0).stop 2024-04-25T09:03:23.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.854+0000 7fbc940b5640 1 -- 172.21.15.55:0/1491697866 shutdown_connections 2024-04-25T09:03:23.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.854+0000 7fbc940b5640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbc7806b4d0 0x7fbc7806d990 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.854+0000 7fbc940b5640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc8c0d29a0 0x7fbc8c0d2e20 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.854+0000 7fbc940b5640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc8c0d0c50 0x7fbc8c15d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.854+0000 7fbc940b5640 1 --2- 172.21.15.55:0/1491697866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc740039e0 0x7fbc8c14b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.854+0000 7fbc940b5640 1 -- 172.21.15.55:0/1491697866 >> 172.21.15.55:0/1491697866 conn(0x7fbc8c0b5570 msgr2=0x7fbc8c0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:23.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.855+0000 7fbc940b5640 1 -- 172.21.15.55:0/1491697866 shutdown_connections 2024-04-25T09:03:23.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.855+0000 7fbc940b5640 1 -- 172.21.15.55:0/1491697866 wait complete. 2024-04-25T09:03:23.860 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:03:23.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.983+0000 7f2ad9770640 1 Processor -- start 2024-04-25T09:03:23.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.983+0000 7f2ad9770640 1 -- start start 2024-04-25T09:03:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad9770640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad41610b0 0x7f2ad40b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad9770640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ad41618d0 0x7f2ad40ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad9770640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ad40ced70 0x7f2ad406c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad9770640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad40d1ea0 con 0x7f2ad40ced70 2024-04-25T09:03:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad9770640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad4162040 con 0x7f2ad41618d0 2024-04-25T09:03:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad9770640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4162320 con 0x7f2ad41610b0 2024-04-25T09:03:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ad40ced70 0x7f2ad406c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ad40ced70 0x7f2ad406c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53536/0 (socket says 172.21.15.55:53536) 2024-04-25T09:03:23.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4027112906 learned_addr learned my addr 172.21.15.55:0/4027112906 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:23.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad2ffd640 1 --2- 172.21.15.55:0/4027112906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad41610b0 0x7f2ad40b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad27fc640 1 --2- 172.21.15.55:0/4027112906 >> v2:172.21.15.167:3300/0 conn(0x7f2ad41618d0 0x7f2ad40ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4027112906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad41610b0 msgr2=0x7f2ad40b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:23.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad37fe640 1 --2- 172.21.15.55:0/4027112906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad41610b0 0x7f2ad40b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4027112906 >> v2:172.21.15.167:3300/0 conn(0x7f2ad41618d0 msgr2=0x7f2ad40ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:23.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad37fe640 1 --2- 172.21.15.55:0/4027112906 >> v2:172.21.15.167:3300/0 conn(0x7f2ad41618d0 0x7f2ad40ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.984+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4027112906 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad4162600 con 0x7f2ad40ced70 2024-04-25T09:03:23.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.985+0000 7f2ad37fe640 1 --2- 172.21.15.55:0/4027112906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40ced70 0x7f2ad406c250 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40d4b60 tx=0x7f2acc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76e87763547e72a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.985+0000 7f2ad1ffb640 1 -- 172.21.15.55:0/4027112906 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc036070 con 0x7f2ad40ced70 2024-04-25T09:03:23.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.985+0000 7f2ad1ffb640 1 -- 172.21.15.55:0/4027112906 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc031600 con 0x7f2ad40ced70 2024-04-25T09:03:23.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.985+0000 7f2ad1ffb640 1 -- 172.21.15.55:0/4027112906 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0319d0 con 0x7f2ad40ced70 2024-04-25T09:03:23.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.986+0000 7f2ad9770640 1 -- 172.21.15.55:0/4027112906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40ced70 msgr2=0x7f2ad406c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.986+0000 7f2ad9770640 1 --2- 172.21.15.55:0/4027112906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40ced70 0x7f2ad406c250 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40d4b60 tx=0x7f2acc02a610 comp rx=0 tx=0).stop 2024-04-25T09:03:23.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.986+0000 7f2ad9770640 1 -- 172.21.15.55:0/4027112906 shutdown_connections 2024-04-25T09:03:23.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.986+0000 7f2ad9770640 1 --2- 172.21.15.55:0/4027112906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad40ced70 0x7f2ad406c250 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.986+0000 7f2ad9770640 1 --2- 172.21.15.55:0/4027112906 >> v2:172.21.15.167:3300/0 conn(0x7f2ad41618d0 0x7f2ad40ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.986+0000 7f2ad9770640 1 --2- 172.21.15.55:0/4027112906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad41610b0 0x7f2ad40b9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.986+0000 7f2ad9770640 1 -- 172.21.15.55:0/4027112906 >> 172.21.15.55:0/4027112906 conn(0x7f2ad40b5570 msgr2=0x7f2ad40b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:23.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.986+0000 7f2ad9770640 1 -- 172.21.15.55:0/4027112906 shutdown_connections 2024-04-25T09:03:23.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.986+0000 7f2ad9770640 1 -- 172.21.15.55:0/4027112906 wait complete. 2024-04-25T09:03:23.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.987+0000 7f2ad9770640 1 Processor -- start 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.987+0000 7f2ad9770640 1 -- start start 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.988+0000 7f2ad9770640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad40ced70 0x7f2ad414fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.988+0000 7f2ad9770640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad41610b0 0x7f2ad41537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.988+0000 7f2ad9770640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad41618d0 0x7f2ad41f7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.988+0000 7f2ad9770640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4161d10 con 0x7f2ad41610b0 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.988+0000 7f2ad9770640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40b6c00 con 0x7f2ad41618d0 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.988+0000 7f2ad9770640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4161490 con 0x7f2ad40ced70 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.988+0000 7f2ad27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad41610b0 0x7f2ad41537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.988+0000 7f2ad27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad41610b0 0x7f2ad41537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53552/0 (socket says 172.21.15.55:53552) 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.988+0000 7f2ad27fc640 1 -- 172.21.15.55:0/3884935318 learned_addr learned my addr 172.21.15.55:0/3884935318 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.988+0000 7f2ad2ffd640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad40ced70 0x7f2ad414fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.988+0000 7f2ad37fe640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad41618d0 0x7f2ad41f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2ad27fc640 1 -- 172.21.15.55:0/3884935318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad40ced70 msgr2=0x7f2ad414fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2ad27fc640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad40ced70 0x7f2ad414fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2ad27fc640 1 -- 172.21.15.55:0/3884935318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad41618d0 msgr2=0x7f2ad41f7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2ad27fc640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad41618d0 0x7f2ad41f7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2ad27fc640 1 -- 172.21.15.55:0/3884935318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad41500b0 con 0x7f2ad41610b0 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2ad2ffd640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad40ced70 0x7f2ad414fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2ad37fe640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad41618d0 0x7f2ad41f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2ad27fc640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad41610b0 0x7f2ad41537e0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800d800 tx=0x7f2ac800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2abb7fe640 1 -- 172.21.15.55:0/3884935318 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800b6c0 con 0x7f2ad41610b0 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2abb7fe640 1 -- 172.21.15.55:0/3884935318 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac8019070 con 0x7f2ad41610b0 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2ad9770640 1 -- 172.21.15.55:0/3884935318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad41521f0 con 0x7f2ad41610b0 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2abb7fe640 1 -- 172.21.15.55:0/3884935318 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800ba80 con 0x7f2ad41610b0 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.989+0000 7f2ad9770640 1 -- 172.21.15.55:0/3884935318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad41527b0 con 0x7f2ad41610b0 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.990+0000 7f2ad9770640 1 -- 172.21.15.55:0/3884935318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad40750b0 con 0x7f2ad41610b0 2024-04-25T09:03:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.990+0000 7f2abb7fe640 1 -- 172.21.15.55:0/3884935318 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2ac800bc20 con 0x7f2ad41610b0 2024-04-25T09:03:23.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.991+0000 7f2abb7fe640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ac006b4d0 0x7f2ac006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.991+0000 7f2abb7fe640 1 -- 172.21.15.55:0/3884935318 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5443+0+0 (secure 0 0 0) 0x7f2ac808a4d0 con 0x7f2ad41610b0 2024-04-25T09:03:23.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.991+0000 7f2ad2ffd640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ac006b4d0 0x7f2ac006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.991+0000 7f2ad2ffd640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ac006b4d0 0x7f2ac006d990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4006fd0 tx=0x7f2ac4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:23.995+0000 7f2abb7fe640 1 -- 172.21.15.55:0/3884935318 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2ac80594e0 con 0x7f2ad41610b0 2024-04-25T09:03:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.179+0000 7f2ad9770640 1 -- 172.21.15.55:0/3884935318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ad40d1770 con 0x7f2ad41610b0 2024-04-25T09:03:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.862+0000 7f2abb7fe640 1 -- 172.21.15.55:0/3884935318 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2ac8058de0 con 0x7f2ad41610b0 2024-04-25T09:03:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-25T09:03:24.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 -- 172.21.15.55:0/3884935318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ac006b4d0 msgr2=0x7f2ac006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ac006b4d0 0x7f2ac006d990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4006fd0 tx=0x7f2ac4008040 comp rx=0 tx=0).stop 2024-04-25T09:03:24.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 -- 172.21.15.55:0/3884935318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad41610b0 msgr2=0x7f2ad41537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad41610b0 0x7f2ad41537e0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800d800 tx=0x7f2ac800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 -- 172.21.15.55:0/3884935318 shutdown_connections 2024-04-25T09:03:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2ac006b4d0 0x7f2ac006d990 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad41618d0 0x7f2ad41f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ad41610b0 0x7f2ad41537e0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 --2- 172.21.15.55:0/3884935318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad40ced70 0x7f2ad414fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 -- 172.21.15.55:0/3884935318 >> 172.21.15.55:0/3884935318 conn(0x7f2ad40b5570 msgr2=0x7f2ad4160380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 -- 172.21.15.55:0/3884935318 shutdown_connections 2024-04-25T09:03:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.865+0000 7f2ad9770640 1 -- 172.21.15.55:0/3884935318 wait complete. 2024-04-25T09:03:24.870 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:03:24.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.990+0000 7f24c89ce640 1 Processor -- start 2024-04-25T09:03:24.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.990+0000 7f24c89ce640 1 -- start start 2024-04-25T09:03:24.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.991+0000 7f24c89ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c40d3b90 0x7f24c40d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.991+0000 7f24c89ce640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c40d4090 con 0x7f24c40d0f60 2024-04-25T09:03:24.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.991+0000 7f24c89ce640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c40d4370 con 0x7f24c415dca0 2024-04-25T09:03:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.991+0000 7f24c89ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40b6b20 con 0x7f24c40d3b90 2024-04-25T09:03:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.991+0000 7f24c2d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f24c40d0f60 0x7f24c40b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35922/0 (socket says 172.21.15.55:35922) 2024-04-25T09:03:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.991+0000 7f24c2d9d640 1 -- 172.21.15.55:0/293220076 learned_addr learned my addr 172.21.15.55:0/293220076 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c1d9b640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c40d3b90 0x7f24c40d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425915146 0 0) 0x7f24c40d4090 con 0x7f24c40d0f60 2024-04-25T09:03:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b0003520 con 0x7f24c40d0f60 2024-04-25T09:03:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 734924184 0 0) 0x7f24b0003520 con 0x7f24c40d0f60 2024-04-25T09:03:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c40d3b90 msgr2=0x7f24c40d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c40d3b90 0x7f24c40d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 >> v1:172.21.15.167:6789/0 conn(0x7f24c415dca0 legacy=0x7f24c40ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c40d4650 con 0x7f24c40d0f60 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f24b40019f0 con 0x7f24c40d0f60 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 >> v1:172.21.15.55:6789/0 conn(0x7f24c40d0f60 legacy=0x7f24c40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b00039e0 0x7f24b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24b0004390 0x7f24b0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c40d3b90 0x7f24b00050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b000b9c0 con 0x7f24b0004390 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b000bb70 con 0x7f24b00039e0 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b000bd70 con 0x7f24c40d3b90 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c1d9b640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24b0004390 0x7f24b0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c259c640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b00039e0 0x7f24b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c2d9d640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c40d3b90 0x7f24b00050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c1d9b640 1 -- 172.21.15.55:0/293220076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c40d3b90 msgr2=0x7f24b00050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c1d9b640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c40d3b90 0x7f24b00050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c1d9b640 1 -- 172.21.15.55:0/293220076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b00039e0 msgr2=0x7f24b0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c1d9b640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b00039e0 0x7f24b0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.992+0000 7f24c1d9b640 1 -- 172.21.15.55:0/293220076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b0003520 con 0x7f24b0004390 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.993+0000 7f24c1d9b640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24b0004390 0x7f24b0004860 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009a90 tx=0x7f24b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701f86888af67836 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.993+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac036070 con 0x7f24b0004390 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.993+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac031400 con 0x7f24b0004390 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.993+0000 7f24c159a640 1 -- 172.21.15.55:0/293220076 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac009690 con 0x7f24b0004390 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.994+0000 7f24c89ce640 1 -- 172.21.15.55:0/293220076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24b0004390 msgr2=0x7f24b0004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.994+0000 7f24c89ce640 1 --2- 172.21.15.55:0/293220076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24b0004390 0x7f24b0004860 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009a90 tx=0x7f24b0005830 comp rx=0 tx=0).stop 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.994+0000 7f24c2d9d640 1 -- 172.21.15.55:0/293220076 reap_dead start 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.994+0000 7f24c89ce640 1 -- 172.21.15.55:0/293220076 shutdown_connections 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.994+0000 7f24c89ce640 1 -- 172.21.15.55:0/293220076 >> 172.21.15.55:0/293220076 conn(0x7f24c40726c0 msgr2=0x7f24c4072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.994+0000 7f24c89ce640 1 -- 172.21.15.55:0/293220076 shutdown_connections 2024-04-25T09:03:24.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.994+0000 7f24c89ce640 1 -- 172.21.15.55:0/293220076 wait complete. 2024-04-25T09:03:24.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.995+0000 7f24c89ce640 1 Processor -- start 2024-04-25T09:03:24.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.995+0000 7f24c89ce640 1 -- start start 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c89ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24b0004390 0x7f24c4156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c89ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c41598e0 0x7f24c415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c89ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c4160300 0x7f24c40cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c89ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c415e080 con 0x7f24c4160300 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c89ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40cf050 con 0x7f24c41598e0 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c89ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c415e200 con 0x7f24b0004390 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c4160300 0x7f24c40cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c4160300 0x7f24c40cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53570/0 (socket says 172.21.15.55:53570) 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c2d9d640 1 -- 172.21.15.55:0/507092222 learned_addr learned my addr 172.21.15.55:0/507092222 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c259c640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24b0004390 0x7f24c4156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c1d9b640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c41598e0 0x7f24c415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c2d9d640 1 -- 172.21.15.55:0/507092222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24b0004390 msgr2=0x7f24c4156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c2d9d640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24b0004390 0x7f24c4156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c2d9d640 1 -- 172.21.15.55:0/507092222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c41598e0 msgr2=0x7f24c415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c2d9d640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c41598e0 0x7f24c415fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.996+0000 7f24c2d9d640 1 -- 172.21.15.55:0/507092222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c415e400 con 0x7f24c4160300 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.997+0000 7f24c2d9d640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c4160300 0x7f24c40cc630 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f24c408ce10 tx=0x7f24b4007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.997+0000 7f24baffd640 1 -- 172.21.15.55:0/507092222 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b400eb60 con 0x7f24c4160300 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.997+0000 7f24baffd640 1 -- 172.21.15.55:0/507092222 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b400ed20 con 0x7f24c4160300 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.997+0000 7f24c89ce640 1 -- 172.21.15.55:0/507092222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c4159d60 con 0x7f24c4160300 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.997+0000 7f24baffd640 1 -- 172.21.15.55:0/507092222 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4013420 con 0x7f24c4160300 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.997+0000 7f24c89ce640 1 -- 172.21.15.55:0/507092222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c415e980 con 0x7f24c4160300 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.998+0000 7f24c89ce640 1 -- 172.21.15.55:0/507092222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c40cf890 con 0x7f24c4160300 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.998+0000 7f24baffd640 1 -- 172.21.15.55:0/507092222 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f24b401a020 con 0x7f24c4160300 2024-04-25T09:03:24.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.999+0000 7f24baffd640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24a406b500 0x7f24a406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.999+0000 7f24baffd640 1 -- 172.21.15.55:0/507092222 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f24b40896d0 con 0x7f24c4160300 2024-04-25T09:03:24.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.999+0000 7f24c259c640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24a406b500 0x7f24a406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:24.999+0000 7f24c259c640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24a406b500 0x7f24a406d9c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f24bc000c00 tx=0x7f24bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.003+0000 7f24baffd640 1 -- 172.21.15.55:0/507092222 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f24b4021020 con 0x7f24c4160300 2024-04-25T09:03:25.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.188+0000 7f24c89ce640 1 -- 172.21.15.55:0/507092222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f24c415d250 con 0x7f24c4160300 2024-04-25T09:03:25.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.192+0000 7f24baffd640 1 -- 172.21.15.55:0/507092222 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f24b4058230 con 0x7f24c4160300 2024-04-25T09:03:25.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 -- 172.21.15.55:0/507092222 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24a406b500 msgr2=0x7f24a406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24a406b500 0x7f24a406d9c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f24bc000c00 tx=0x7f24bc009040 comp rx=0 tx=0).stop 2024-04-25T09:03:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 -- 172.21.15.55:0/507092222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c4160300 msgr2=0x7f24c40cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c4160300 0x7f24c40cc630 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f24c408ce10 tx=0x7f24b4007b90 comp rx=0 tx=0).stop 2024-04-25T09:03:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 -- 172.21.15.55:0/507092222 shutdown_connections 2024-04-25T09:03:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f24a406b500 0x7f24a406d9c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c4160300 0x7f24c40cc630 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c41598e0 0x7f24c415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 --2- 172.21.15.55:0/507092222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24b0004390 0x7f24c4156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 -- 172.21.15.55:0/507092222 >> 172.21.15.55:0/507092222 conn(0x7f24c40726c0 msgr2=0x7f24c40b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 -- 172.21.15.55:0/507092222 shutdown_connections 2024-04-25T09:03:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.194+0000 7f24c89ce640 1 -- 172.21.15.55:0/507092222 wait complete. 2024-04-25T09:03:25.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T09:03:25.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.306+0000 7f67dd58b640 1 Processor -- start 2024-04-25T09:03:25.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.306+0000 7f67dd58b640 1 -- start start 2024-04-25T09:03:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67dd58b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67d80b5b60 0x7f67d81687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67dd58b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d815e0c0 con 0x7f67d80d35b0 2024-04-25T09:03:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67dd58b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d80d2510 con 0x7f67d815dce0 2024-04-25T09:03:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67dd58b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d80b7b10 con 0x7f67d80b5b60 2024-04-25T09:03:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67cffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f67d80d35b0 0x7f67d80b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35936/0 (socket says 172.21.15.55:35936) 2024-04-25T09:03:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67cffff640 1 -- 172.21.15.55:0/3989486517 learned_addr learned my addr 172.21.15.55:0/3989486517 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283624296 0 0) 0x7f67d815e0c0 con 0x7f67d80d35b0 2024-04-25T09:03:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67d77fe640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67d80b5b60 0x7f67d81687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67c4003520 con 0x7f67d80d35b0 2024-04-25T09:03:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3151002722 0 0) 0x7f67c4003520 con 0x7f67d80d35b0 2024-04-25T09:03:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67d80b5b60 msgr2=0x7f67d81687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67d67fc640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67d80b5b60 0x7f67d81687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 >> v1:172.21.15.167:6789/0 conn(0x7f67d815dce0 legacy=0x7f67d80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d80d27f0 con 0x7f67d80d35b0 2024-04-25T09:03:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f67c0001670 con 0x7f67d80d35b0 2024-04-25T09:03:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 >> v1:172.21.15.55:6789/0 conn(0x7f67d80d35b0 legacy=0x7f67d80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.307+0000 7f67d67fc640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67c40039e0 0x7f67c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d67fc640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67c4004800 0x7f67c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d67fc640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67d80b5b60 0x7f67c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d80b7b10 con 0x7f67c40039e0 2024-04-25T09:03:25.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c400ba70 con 0x7f67c4004800 2024-04-25T09:03:25.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c400bc70 con 0x7f67d80b5b60 2024-04-25T09:03:25.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d6ffd640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67c40039e0 0x7f67c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67cffff640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67c4004800 0x7f67c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d77fe640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67d80b5b60 0x7f67c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d6ffd640 1 -- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67d80b5b60 msgr2=0x7f67c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d6ffd640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67d80b5b60 0x7f67c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d6ffd640 1 -- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67c4004800 msgr2=0x7f67c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d6ffd640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67c4004800 0x7f67c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d6ffd640 1 -- 172.21.15.55:0/3989486517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c4003520 con 0x7f67c40039e0 2024-04-25T09:03:25.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.308+0000 7f67d77fe640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67d80b5b60 0x7f67c40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:25.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.309+0000 7f67d6ffd640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67c40039e0 0x7f67c4003e00 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f67c8001720 tx=0x7f67c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3611d4bbc1046d1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.309+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8001370 con 0x7f67c40039e0 2024-04-25T09:03:25.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.309+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c80052d0 con 0x7f67c40039e0 2024-04-25T09:03:25.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.309+0000 7f67d67fc640 1 -- 172.21.15.55:0/3989486517 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c802ab90 con 0x7f67c40039e0 2024-04-25T09:03:25.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.309+0000 7f67dd58b640 1 -- 172.21.15.55:0/3989486517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67c40039e0 msgr2=0x7f67c4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.309+0000 7f67dd58b640 1 --2- 172.21.15.55:0/3989486517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67c40039e0 0x7f67c4003e00 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f67c8001720 tx=0x7f67c4005830 comp rx=0 tx=0).stop 2024-04-25T09:03:25.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.309+0000 7f67d77fe640 1 -- 172.21.15.55:0/3989486517 reap_dead start 2024-04-25T09:03:25.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.309+0000 7f67dd58b640 1 -- 172.21.15.55:0/3989486517 shutdown_connections 2024-04-25T09:03:25.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.309+0000 7f67dd58b640 1 -- 172.21.15.55:0/3989486517 >> 172.21.15.55:0/3989486517 conn(0x7f67d8072900 msgr2=0x7f67d80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.309+0000 7f67dd58b640 1 -- 172.21.15.55:0/3989486517 shutdown_connections 2024-04-25T09:03:25.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.309+0000 7f67dd58b640 1 -- 172.21.15.55:0/3989486517 wait complete. 2024-04-25T09:03:25.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.311+0000 7f67dd58b640 1 Processor -- start 2024-04-25T09:03:25.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.311+0000 7f67dd58b640 1 -- start start 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.311+0000 7f67dd58b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c40039e0 0x7f67d814e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.311+0000 7f67dd58b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d8154a50 0x7f67d81609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.311+0000 7f67dd58b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d8160ee0 0x7f67d8155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.311+0000 7f67dd58b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d80d3090 con 0x7f67d8160ee0 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.311+0000 7f67dd58b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d80d2db0 con 0x7f67d8154a50 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.311+0000 7f67dd58b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d80d2160 con 0x7f67c40039e0 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.311+0000 7f67d77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d8160ee0 0x7f67d8155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.311+0000 7f67d77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d8160ee0 0x7f67d8155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53590/0 (socket says 172.21.15.55:53590) 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.311+0000 7f67d77fe640 1 -- 172.21.15.55:0/1581505900 learned_addr learned my addr 172.21.15.55:0/1581505900 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67d6ffd640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c40039e0 0x7f67d814e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67cffff640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d8154a50 0x7f67d81609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67d77fe640 1 -- 172.21.15.55:0/1581505900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c40039e0 msgr2=0x7f67d814e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67d77fe640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c40039e0 0x7f67d814e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67d77fe640 1 -- 172.21.15.55:0/1581505900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d8154a50 msgr2=0x7f67d81609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67d77fe640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d8154a50 0x7f67d81609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67d77fe640 1 -- 172.21.15.55:0/1581505900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d81539d0 con 0x7f67d8160ee0 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67d77fe640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d8160ee0 0x7f67d8155940 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f67d808ce80 tx=0x7f67d0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67cf7fe640 1 -- 172.21.15.55:0/1581505900 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d001a030 con 0x7f67d8160ee0 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67cf7fe640 1 -- 172.21.15.55:0/1581505900 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d0010e50 con 0x7f67d8160ee0 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67dd58b640 1 -- 172.21.15.55:0/1581505900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d8153c90 con 0x7f67d8160ee0 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67cf7fe640 1 -- 172.21.15.55:0/1581505900 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0003bd0 con 0x7f67d8160ee0 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.312+0000 7f67dd58b640 1 -- 172.21.15.55:0/1581505900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d8154250 con 0x7f67d8160ee0 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.313+0000 7f67dd58b640 1 -- 172.21.15.55:0/1581505900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d80cf370 con 0x7f67d8160ee0 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.313+0000 7f67cf7fe640 1 -- 172.21.15.55:0/1581505900 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f67d001d070 con 0x7f67d8160ee0 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.314+0000 7f67cf7fe640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f67b806b4d0 0x7f67b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.314+0000 7f67cf7fe640 1 -- 172.21.15.55:0/1581505900 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f67d008a3e0 con 0x7f67d8160ee0 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.314+0000 7f67d6ffd640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f67b806b4d0 0x7f67b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.314+0000 7f67d6ffd640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f67b806b4d0 0x7f67b806d990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f67c8032000 tx=0x7f67c802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.318+0000 7f67cf7fe640 1 -- 172.21.15.55:0/1581505900 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67d80cf370 con 0x7f67d8160ee0 2024-04-25T09:03:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.568+0000 7f67dd58b640 1 -- 172.21.15.55:0/1581505900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f67d80749b0 con 0x7f67d8160ee0 2024-04-25T09:03:25.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.863+0000 7f67cf7fe640 1 -- 172.21.15.55:0/1581505900 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v452) v1 ==== 146+0+0 (secure 0 0 0) 0x7f67d0058f40 con 0x7f67d8160ee0 2024-04-25T09:03:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 -- 172.21.15.55:0/1581505900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f67b806b4d0 msgr2=0x7f67b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f67b806b4d0 0x7f67b806d990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f67c8032000 tx=0x7f67c802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 -- 172.21.15.55:0/1581505900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d8160ee0 msgr2=0x7f67d8155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d8160ee0 0x7f67d8155940 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f67d808ce80 tx=0x7f67d0009f90 comp rx=0 tx=0).stop 2024-04-25T09:03:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 -- 172.21.15.55:0/1581505900 shutdown_connections 2024-04-25T09:03:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f67b806b4d0 0x7f67b806d990 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d8160ee0 0x7f67d8155940 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d8154a50 0x7f67d81609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 --2- 172.21.15.55:0/1581505900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c40039e0 0x7f67d814e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 -- 172.21.15.55:0/1581505900 >> 172.21.15.55:0/1581505900 conn(0x7f67d8072900 msgr2=0x7f67d815cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 -- 172.21.15.55:0/1581505900 shutdown_connections 2024-04-25T09:03:25.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.865+0000 7f67dd58b640 1 -- 172.21.15.55:0/1581505900 wait complete. 2024-04-25T09:03:25.866 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T09:03:25.866 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:03:25.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.980+0000 7f9cae734640 1 Processor -- start 2024-04-25T09:03:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.980+0000 7f9cae734640 1 -- start start 2024-04-25T09:03:25.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9cae734640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ca815df40 0x7f9ca80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9cae734640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca80b19c0 0x7f9ca80cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9cae734640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca80cd930 con 0x7f9ca80cfe80 2024-04-25T09:03:25.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9cae734640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca80cc5b0 con 0x7f9ca815df40 2024-04-25T09:03:25.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9cae734640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca80cdc10 con 0x7f9ca80b19c0 2024-04-25T09:03:25.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9ca7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ca815df40 0x7f9ca80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9ca7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ca815df40 0x7f9ca80cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53598/0 (socket says 172.21.15.55:53598) 2024-04-25T09:03:25.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9ca7fff640 1 -- 172.21.15.55:0/3279961961 learned_addr learned my addr 172.21.15.55:0/3279961961 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:25.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9ca77fe640 1 --2- 172.21.15.55:0/3279961961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca80b19c0 0x7f9ca80cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9ca7fff640 1 -- 172.21.15.55:0/3279961961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca80b19c0 msgr2=0x7f9ca80cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9ca7fff640 1 --2- 172.21.15.55:0/3279961961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca80b19c0 0x7f9ca80cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9ca7fff640 1 -- 172.21.15.55:0/3279961961 >> v1:172.21.15.167:6789/0 conn(0x7f9ca80cfe80 legacy=0x7f9ca806aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.981+0000 7f9ca7fff640 1 -- 172.21.15.55:0/3279961961 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca80cdef0 con 0x7f9ca815df40 2024-04-25T09:03:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.982+0000 7f9ca7fff640 1 --2- 172.21.15.55:0/3279961961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ca815df40 0x7f9ca80cd320 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009870 tx=0x7f9c9002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8fd18305c9583c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.982+0000 7f9ca6ffd640 1 -- 172.21.15.55:0/3279961961 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90037070 con 0x7f9ca815df40 2024-04-25T09:03:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.982+0000 7f9ca6ffd640 1 -- 172.21.15.55:0/3279961961 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c90032440 con 0x7f9ca815df40 2024-04-25T09:03:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.982+0000 7f9ca6ffd640 1 -- 172.21.15.55:0/3279961961 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90032810 con 0x7f9ca815df40 2024-04-25T09:03:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.983+0000 7f9cae734640 1 -- 172.21.15.55:0/3279961961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ca815df40 msgr2=0x7f9ca80cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.983+0000 7f9cae734640 1 --2- 172.21.15.55:0/3279961961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ca815df40 0x7f9ca80cd320 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009870 tx=0x7f9c9002a1c0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.983+0000 7f9cae734640 1 -- 172.21.15.55:0/3279961961 shutdown_connections 2024-04-25T09:03:25.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.983+0000 7f9cae734640 1 --2- 172.21.15.55:0/3279961961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca80b19c0 0x7f9ca80cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.983+0000 7f9cae734640 1 --2- 172.21.15.55:0/3279961961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ca815df40 0x7f9ca80cd320 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.983+0000 7f9cae734640 1 -- 172.21.15.55:0/3279961961 >> 172.21.15.55:0/3279961961 conn(0x7f9ca80d06b0 msgr2=0x7f9ca80d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.983+0000 7f9cae734640 1 -- 172.21.15.55:0/3279961961 shutdown_connections 2024-04-25T09:03:25.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.983+0000 7f9cae734640 1 -- 172.21.15.55:0/3279961961 wait complete. 2024-04-25T09:03:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.984+0000 7f9cae734640 1 Processor -- start 2024-04-25T09:03:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.984+0000 7f9cae734640 1 -- start start 2024-04-25T09:03:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9cae734640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca80b19c0 0x7f9ca8157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9cae734640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ca80cfe80 0x7f9ca815ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9cae734640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ca815df40 0x7f9ca815f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9cae734640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca80d0310 con 0x7f9ca815df40 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9cae734640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca80cb080 con 0x7f9ca80cfe80 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9cae734640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca80b1e20 con 0x7f9ca80b19c0 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9caccd1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ca815df40 0x7f9ca815f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9caccd1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ca815df40 0x7f9ca815f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53614/0 (socket says 172.21.15.55:53614) 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9caccd1640 1 -- 172.21.15.55:0/3855218641 learned_addr learned my addr 172.21.15.55:0/3855218641 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9ca77fe640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ca80cfe80 0x7f9ca815ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9ca7fff640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca80b19c0 0x7f9ca8157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9caccd1640 1 -- 172.21.15.55:0/3855218641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca80b19c0 msgr2=0x7f9ca8157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9caccd1640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca80b19c0 0x7f9ca8157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9caccd1640 1 -- 172.21.15.55:0/3855218641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ca80cfe80 msgr2=0x7f9ca815ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9caccd1640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ca80cfe80 0x7f9ca815ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.985+0000 7f9caccd1640 1 -- 172.21.15.55:0/3855218641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca80c9d60 con 0x7f9ca815df40 2024-04-25T09:03:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.986+0000 7f9caccd1640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ca815df40 0x7f9ca815f3c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c7a0 tx=0x7f9ca000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.986+0000 7f9ca4ff9640 1 -- 172.21.15.55:0/3855218641 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0003b70 con 0x7f9ca815df40 2024-04-25T09:03:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.986+0000 7f9ca4ff9640 1 -- 172.21.15.55:0/3855218641 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0003d30 con 0x7f9ca815df40 2024-04-25T09:03:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.986+0000 7f9ca4ff9640 1 -- 172.21.15.55:0/3855218641 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca000aa30 con 0x7f9ca815df40 2024-04-25T09:03:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.986+0000 7f9cae734640 1 -- 172.21.15.55:0/3855218641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca80ca040 con 0x7f9ca815df40 2024-04-25T09:03:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.986+0000 7f9cae734640 1 -- 172.21.15.55:0/3855218641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca81f7030 con 0x7f9ca815df40 2024-04-25T09:03:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.987+0000 7f9cae734640 1 -- 172.21.15.55:0/3855218641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca81f7230 con 0x7f9ca815df40 2024-04-25T09:03:25.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.987+0000 7f9ca4ff9640 1 -- 172.21.15.55:0/3855218641 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ca000abd0 con 0x7f9ca815df40 2024-04-25T09:03:25.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.988+0000 7f9ca4ff9640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c8806b4d0 0x7f9c8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.988+0000 7f9ca4ff9640 1 -- 172.21.15.55:0/3855218641 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9ca0089c50 con 0x7f9ca815df40 2024-04-25T09:03:25.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.988+0000 7f9ca7fff640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c8806b4d0 0x7f9c8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.988+0000 7f9ca7fff640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c8806b4d0 0x7f9c8806d990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9c90034000 tx=0x7f9c9002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:25.992+0000 7f9ca4ff9640 1 -- 172.21.15.55:0/3855218641 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9ca81f7230 con 0x7f9ca815df40 2024-04-25T09:03:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.173+0000 7f9cae734640 1 -- 172.21.15.55:0/3855218641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ca80749b0 con 0x7f9ca815df40 2024-04-25T09:03:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.174+0000 7f9ca4ff9640 1 -- 172.21.15.55:0/3855218641 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+13158 (secure 0 0 0) 0x7f9ca008f020 con 0x7f9ca815df40 2024-04-25T09:03:26.163 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:26.163 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":106,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:24.853098+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3048692204":"2024-04-26T09:03:17.764566+0000","172.21.15.55:6834/3048692204":"2024-04-26T09:03:17.764566+0000","172.21.15.55:6837/538888347":"2024-04-26T09:02:41.385611+0000","172.21.15.55:6834/538888347":"2024-04-26T09:02:41.385611+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 -- 172.21.15.55:0/3855218641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c8806b4d0 msgr2=0x7f9c8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c8806b4d0 0x7f9c8806d990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9c90034000 tx=0x7f9c9002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 -- 172.21.15.55:0/3855218641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ca815df40 msgr2=0x7f9ca815f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ca815df40 0x7f9ca815f3c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c7a0 tx=0x7f9ca000cc60 comp rx=0 tx=0).stop 2024-04-25T09:03:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 -- 172.21.15.55:0/3855218641 shutdown_connections 2024-04-25T09:03:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9c8806b4d0 0x7f9c8806d990 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ca815df40 0x7f9ca815f3c0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ca80cfe80 0x7f9ca815ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 --2- 172.21.15.55:0/3855218641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ca80b19c0 0x7f9ca8157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 -- 172.21.15.55:0/3855218641 >> 172.21.15.55:0/3855218641 conn(0x7f9ca80d06b0 msgr2=0x7f9ca80cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:26.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 -- 172.21.15.55:0/3855218641 shutdown_connections 2024-04-25T09:03:26.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.176+0000 7f9cae734640 1 -- 172.21.15.55:0/3855218641 wait complete. 2024-04-25T09:03:26.176 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:26.176 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:26.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.292+0000 7fa241cbc640 1 Processor -- start 2024-04-25T09:03:26.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.292+0000 7fa241cbc640 1 -- start start 2024-04-25T09:03:26.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.292+0000 7fa241cbc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa23c15b7b0 0x7fa23c0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.292+0000 7fa241cbc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c0cf760 0x7fa23c0cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.292+0000 7fa241cbc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c15f000 con 0x7fa23c15e110 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.292+0000 7fa241cbc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c0d0100 con 0x7fa23c15b7b0 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.292+0000 7fa241cbc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0ced00 con 0x7fa23c0cf760 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa23c15e110 0x7fa23c0cc080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35948/0 (socket says 172.21.15.55:35948) 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23bfff640 1 -- 172.21.15.55:0/3367578910 learned_addr learned my addr 172.21.15.55:0/3367578910 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23b7fe640 1 --2- 172.21.15.55:0/3367578910 >> v2:172.21.15.167:3300/0 conn(0x7fa23c15b7b0 0x7fa23c0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23affd640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c0cf760 0x7fa23c0cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671922095 0 0) 0x7fa23c15f000 con 0x7fa23c15e110 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa224003520 con 0x7fa23c15e110 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1630120519 0 0) 0x7fa224003520 con 0x7fa23c15e110 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c0cf760 msgr2=0x7fa23c0cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c0cf760 0x7fa23c0cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 >> v2:172.21.15.167:3300/0 conn(0x7fa23c15b7b0 msgr2=0x7fa23c0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 --2- 172.21.15.55:0/3367578910 >> v2:172.21.15.167:3300/0 conn(0x7fa23c15b7b0 0x7fa23c0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c15ed20 con 0x7fa23c15e110 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fa2340019f0 con 0x7fa23c15e110 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 >> v1:172.21.15.55:6789/0 conn(0x7fa23c15e110 legacy=0x7fa23c0cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c0cf760 0x7fa2240039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa224003f30 0x7fa224004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa224004d40 0x7fa2240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0ced00 con 0x7fa224004d40 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22400b9c0 con 0x7fa224003f30 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22400bb40 con 0x7fa23c0cf760 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23bfff640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa224004d40 0x7fa2240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23affd640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa224003f30 0x7fa224004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.293+0000 7fa23b7fe640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c0cf760 0x7fa2240039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.294+0000 7fa23bfff640 1 -- 172.21.15.55:0/3367578910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c0cf760 msgr2=0x7fa2240039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.294+0000 7fa23bfff640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c0cf760 0x7fa2240039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.294+0000 7fa23bfff640 1 -- 172.21.15.55:0/3367578910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa224003f30 msgr2=0x7fa224004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.294+0000 7fa23bfff640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa224003f30 0x7fa224004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.294+0000 7fa23bfff640 1 -- 172.21.15.55:0/3367578910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa224003520 con 0x7fa224004d40 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.294+0000 7fa23bfff640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa224004d40 0x7fa2240051c0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fa23400a880 tx=0x7fa224005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c398837f961e09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.295+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23400a4a0 con 0x7fa224004d40 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.295+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23402f070 con 0x7fa224004d40 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.295+0000 7fa23a7fc640 1 -- 172.21.15.55:0/3367578910 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23402bd40 con 0x7fa224004d40 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.295+0000 7fa241cbc640 1 -- 172.21.15.55:0/3367578910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa224004d40 msgr2=0x7fa2240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.295+0000 7fa241cbc640 1 --2- 172.21.15.55:0/3367578910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa224004d40 0x7fa2240051c0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fa23400a880 tx=0x7fa224005830 comp rx=0 tx=0).stop 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.295+0000 7fa23bfff640 1 -- 172.21.15.55:0/3367578910 reap_dead start 2024-04-25T09:03:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.295+0000 7fa241cbc640 1 -- 172.21.15.55:0/3367578910 shutdown_connections 2024-04-25T09:03:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.295+0000 7fa241cbc640 1 -- 172.21.15.55:0/3367578910 >> 172.21.15.55:0/3367578910 conn(0x7fa23c06f4a0 msgr2=0x7fa23c06f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.295+0000 7fa241cbc640 1 -- 172.21.15.55:0/3367578910 shutdown_connections 2024-04-25T09:03:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.295+0000 7fa241cbc640 1 -- 172.21.15.55:0/3367578910 wait complete. 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.296+0000 7fa241cbc640 1 Processor -- start 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.297+0000 7fa241cbc640 1 -- start start 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.297+0000 7fa241cbc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa23c0c7690 0x7fa23c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.297+0000 7fa241cbc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c148650 0x7fa23c145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.297+0000 7fa241cbc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c15bd00 0x7fa23c15c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.297+0000 7fa241cbc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0cdfc0 con 0x7fa23c148650 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.297+0000 7fa241cbc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0ce330 con 0x7fa23c0c7690 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.297+0000 7fa241cbc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c1619f0 con 0x7fa23c15bd00 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.297+0000 7fa23affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c148650 0x7fa23c145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.297+0000 7fa23affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c148650 0x7fa23c145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53626/0 (socket says 172.21.15.55:53626) 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.297+0000 7fa23affd640 1 -- 172.21.15.55:0/2090938192 learned_addr learned my addr 172.21.15.55:0/2090938192 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa23bfff640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c15bd00 0x7fa23c15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa23b7fe640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa23c0c7690 0x7fa23c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa23affd640 1 -- 172.21.15.55:0/2090938192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c15bd00 msgr2=0x7fa23c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa23affd640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c15bd00 0x7fa23c15c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa23affd640 1 -- 172.21.15.55:0/2090938192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa23c0c7690 msgr2=0x7fa23c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa23affd640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa23c0c7690 0x7fa23c0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa23affd640 1 -- 172.21.15.55:0/2090938192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c0b4620 con 0x7fa23c148650 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa23bfff640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c15bd00 0x7fa23c15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa23b7fe640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa23c0c7690 0x7fa23c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa23affd640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c148650 0x7fa23c145bf0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0119a0 tx=0x7fa22c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa223fff640 1 -- 172.21.15.55:0/2090938192 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00fa90 con 0x7fa23c148650 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa223fff640 1 -- 172.21.15.55:0/2090938192 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c00fc30 con 0x7fa23c148650 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa241cbc640 1 -- 172.21.15.55:0/2090938192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c0b48c0 con 0x7fa23c148650 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa223fff640 1 -- 172.21.15.55:0/2090938192 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c014440 con 0x7fa23c148650 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.298+0000 7fa241cbc640 1 -- 172.21.15.55:0/2090938192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c0b6560 con 0x7fa23c148650 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.299+0000 7fa241cbc640 1 -- 172.21.15.55:0/2090938192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c0750b0 con 0x7fa23c148650 2024-04-25T09:03:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.299+0000 7fa223fff640 1 -- 172.21.15.55:0/2090938192 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa22c012040 con 0x7fa23c148650 2024-04-25T09:03:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.300+0000 7fa223fff640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22806b500 0x7fa22806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.300+0000 7fa23b7fe640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22806b500 0x7fa22806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.300+0000 7fa223fff640 1 -- 172.21.15.55:0/2090938192 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa22c08a480 con 0x7fa23c148650 2024-04-25T09:03:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.300+0000 7fa23b7fe640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22806b500 0x7fa22806d9c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa230009c40 tx=0x7fa230008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.304+0000 7fa223fff640 1 -- 172.21.15.55:0/2090938192 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa22c019030 con 0x7fa23c148650 2024-04-25T09:03:26.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.483+0000 7fa241cbc640 1 -- 172.21.15.55:0/2090938192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa23c0b7870 con 0x7fa23c148650 2024-04-25T09:03:26.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.484+0000 7fa223fff640 1 -- 172.21.15.55:0/2090938192 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa22c059630 con 0x7fa23c148650 2024-04-25T09:03:26.472 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:03:26.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.485+0000 7fa241cbc640 1 -- 172.21.15.55:0/2090938192 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22806b500 msgr2=0x7fa22806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.485+0000 7fa241cbc640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22806b500 0x7fa22806d9c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa230009c40 tx=0x7fa230008040 comp rx=0 tx=0).stop 2024-04-25T09:03:26.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.485+0000 7fa241cbc640 1 -- 172.21.15.55:0/2090938192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c148650 msgr2=0x7fa23c145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.485+0000 7fa241cbc640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c148650 0x7fa23c145bf0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0119a0 tx=0x7fa22c011e60 comp rx=0 tx=0).stop 2024-04-25T09:03:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.485+0000 7fa241cbc640 1 -- 172.21.15.55:0/2090938192 shutdown_connections 2024-04-25T09:03:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.485+0000 7fa241cbc640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22806b500 0x7fa22806d9c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.485+0000 7fa241cbc640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa23c15bd00 0x7fa23c15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.485+0000 7fa241cbc640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c148650 0x7fa23c145bf0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.485+0000 7fa241cbc640 1 --2- 172.21.15.55:0/2090938192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa23c0c7690 0x7fa23c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.485+0000 7fa241cbc640 1 -- 172.21.15.55:0/2090938192 >> 172.21.15.55:0/2090938192 conn(0x7fa23c06f4a0 msgr2=0x7fa23c15d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.486+0000 7fa241cbc640 1 -- 172.21.15.55:0/2090938192 shutdown_connections 2024-04-25T09:03:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.486+0000 7fa241cbc640 1 -- 172.21.15.55:0/2090938192 wait complete. 2024-04-25T09:03:26.485 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T09:03:26.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.600+0000 7f5741f22640 1 Processor -- start 2024-04-25T09:03:26.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.600+0000 7f5741f22640 1 -- start start 2024-04-25T09:03:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f5741f22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c15dce0 0x7f573c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f5741f22640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f573c0b5b60 0x7f573c0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f5741f22640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c15e0c0 con 0x7f573c0d35b0 2024-04-25T09:03:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f5741f22640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c0d2510 con 0x7f573c0b5b60 2024-04-25T09:03:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f5741f22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0d27f0 con 0x7f573c15dce0 2024-04-25T09:03:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f573c0d35b0 0x7f573c0b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35960/0 (socket says 172.21.15.55:35960) 2024-04-25T09:03:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573affd640 1 -- 172.21.15.55:0/917204675 learned_addr learned my addr 172.21.15.55:0/917204675 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022966322 0 0) 0x7f573c15e0c0 con 0x7f573c0d35b0 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573bfff640 1 --2- 172.21.15.55:0/917204675 >> v2:172.21.15.167:3300/0 conn(0x7f573c0b5b60 0x7f573c0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573b7fe640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c15dce0 0x7f573c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5724003520 con 0x7f573c0d35b0 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2793359736 0 0) 0x7f5724003520 con 0x7f573c0d35b0 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c15dce0 msgr2=0x7f573c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573a7fc640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c15dce0 0x7f573c0d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 >> v2:172.21.15.167:3300/0 conn(0x7f573c0b5b60 msgr2=0x7f573c0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573a7fc640 1 --2- 172.21.15.55:0/917204675 >> v2:172.21.15.167:3300/0 conn(0x7f573c0b5b60 0x7f573c0b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c0d2ad0 con 0x7f573c0d35b0 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f5730001670 con 0x7f573c0d35b0 2024-04-25T09:03:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.601+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 >> v1:172.21.15.55:6789/0 conn(0x7f573c0d35b0 legacy=0x7f573c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573a7fc640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57240039b0 0x7f5724003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573a7fc640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5724004800 0x7f5724004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573a7fc640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c15dce0 0x7f57240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0d2510 con 0x7f5724004800 2024-04-25T09:03:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0d27f0 con 0x7f57240039b0 2024-04-25T09:03:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572400b9c0 con 0x7f573c15dce0 2024-04-25T09:03:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573affd640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5724004800 0x7f5724004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573b7fe640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57240039b0 0x7f5724003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573bfff640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c15dce0 0x7f57240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573affd640 1 -- 172.21.15.55:0/917204675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c15dce0 msgr2=0x7f57240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573affd640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c15dce0 0x7f57240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573affd640 1 -- 172.21.15.55:0/917204675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57240039b0 msgr2=0x7f5724003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573affd640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57240039b0 0x7f5724003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.602+0000 7f573affd640 1 -- 172.21.15.55:0/917204675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5724003520 con 0x7f5724004800 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.603+0000 7f573affd640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5724004800 0x7f5724004c80 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f5730007fd0 tx=0x7f5724005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d58de475585345 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.603+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730007d50 con 0x7f5724004800 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.603+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5730005ad0 con 0x7f5724004800 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.603+0000 7f573a7fc640 1 -- 172.21.15.55:0/917204675 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730007070 con 0x7f5724004800 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.603+0000 7f5741f22640 1 -- 172.21.15.55:0/917204675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5724004800 msgr2=0x7f5724004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.603+0000 7f5741f22640 1 --2- 172.21.15.55:0/917204675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5724004800 0x7f5724004c80 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f5730007fd0 tx=0x7f5724005830 comp rx=0 tx=0).stop 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.603+0000 7f573bfff640 1 -- 172.21.15.55:0/917204675 reap_dead start 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.603+0000 7f5741f22640 1 -- 172.21.15.55:0/917204675 shutdown_connections 2024-04-25T09:03:26.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.603+0000 7f5741f22640 1 -- 172.21.15.55:0/917204675 >> 172.21.15.55:0/917204675 conn(0x7f573c072900 msgr2=0x7f573c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:26.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.603+0000 7f5741f22640 1 -- 172.21.15.55:0/917204675 shutdown_connections 2024-04-25T09:03:26.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.603+0000 7f5741f22640 1 -- 172.21.15.55:0/917204675 wait complete. 2024-04-25T09:03:26.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.605+0000 7f5741f22640 1 Processor -- start 2024-04-25T09:03:26.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.605+0000 7f5741f22640 1 -- start start 2024-04-25T09:03:26.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.605+0000 7f5741f22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5724004800 0x7f573c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.605+0000 7f5741f22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c154240 0x7f573c154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.605+0000 7f5741f22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c154790 0x7f573c0b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.605+0000 7f5741f22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0b9820 con 0x7f573c154240 2024-04-25T09:03:26.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.605+0000 7f5741f22640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0d3090 con 0x7f5724004800 2024-04-25T09:03:26.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.605+0000 7f5741f22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0b99a0 con 0x7f573c154790 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f573affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c154240 0x7f573c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f573affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c154240 0x7f573c154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53634/0 (socket says 172.21.15.55:53634) 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f573affd640 1 -- 172.21.15.55:0/1370279055 learned_addr learned my addr 172.21.15.55:0/1370279055 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f573affd640 1 -- 172.21.15.55:0/1370279055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c154790 msgr2=0x7f573c0b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f573affd640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c154790 0x7f573c0b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f573affd640 1 -- 172.21.15.55:0/1370279055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5724004800 msgr2=0x7f573c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f573affd640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5724004800 0x7f573c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f573affd640 1 -- 172.21.15.55:0/1370279055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c160ae0 con 0x7f573c154240 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f573affd640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c154240 0x7f573c154d70 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f573002ae20 tx=0x7f573c0d2ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f5723fff640 1 -- 172.21.15.55:0/1370279055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730004bf0 con 0x7f573c154240 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f5723fff640 1 -- 172.21.15.55:0/1370279055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5730043070 con 0x7f573c154240 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f5741f22640 1 -- 172.21.15.55:0/1370279055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c160dc0 con 0x7f573c154240 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f5723fff640 1 -- 172.21.15.55:0/1370279055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730007070 con 0x7f573c154240 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.606+0000 7f5741f22640 1 -- 172.21.15.55:0/1370279055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c0b4160 con 0x7f573c154240 2024-04-25T09:03:26.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.607+0000 7f5741f22640 1 -- 172.21.15.55:0/1370279055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c158cb0 con 0x7f573c154240 2024-04-25T09:03:26.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.608+0000 7f5723fff640 1 -- 172.21.15.55:0/1370279055 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5730007210 con 0x7f573c154240 2024-04-25T09:03:26.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.608+0000 7f5723fff640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 0x7f572806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.608+0000 7f573b7fe640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 0x7f572806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.608+0000 7f5723fff640 1 -- 172.21.15.55:0/1370279055 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f57300aa560 con 0x7f573c154240 2024-04-25T09:03:26.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.609+0000 7f573b7fe640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 0x7f572806d9c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f572c009960 tx=0x7f572c009d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:26.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.613+0000 7f5723fff640 1 -- 172.21.15.55:0/1370279055 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f57300797a0 con 0x7f573c154240 2024-04-25T09:03:26.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:26.864+0000 7f5741f22640 1 -- 172.21.15.55:0/1370279055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f573c0749b0 con 0x7f573c154240 2024-04-25T09:03:27.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.872+0000 7f5723fff640 1 -- 172.21.15.55:0/1370279055 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v454) v1 ==== 147+0+0 (secure 0 0 0) 0x7f5730031e30 con 0x7f573c154240 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 -- 172.21.15.55:0/1370279055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 msgr2=0x7f572806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 0x7f572806d9c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f572c009960 tx=0x7f572c009d60 comp rx=0 tx=0).stop 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 -- 172.21.15.55:0/1370279055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c154240 msgr2=0x7f573c154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c154240 0x7f573c154d70 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f573002ae20 tx=0x7f573c0d2ca0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 -- 172.21.15.55:0/1370279055 shutdown_connections 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f572806b500 0x7f572806d9c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f573c154790 0x7f573c0b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573c154240 0x7f573c154d70 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 --2- 172.21.15.55:0/1370279055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5724004800 0x7f573c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 -- 172.21.15.55:0/1370279055 >> 172.21.15.55:0/1370279055 conn(0x7f573c072900 msgr2=0x7f573c0b7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 -- 172.21.15.55:0/1370279055 shutdown_connections 2024-04-25T09:03:27.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.875+0000 7f5741f22640 1 -- 172.21.15.55:0/1370279055 wait complete. 2024-04-25T09:03:27.877 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:03:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.999+0000 7f71c8ae1640 1 Processor -- start 2024-04-25T09:03:27.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:27.999+0000 7f71c8ae1640 1 -- start start 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71c8ae1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f71c415dca0 0x7f71c40ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71c8ae1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71c40d3b90 0x7f71c40d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71c8ae1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40d4090 con 0x7f71c40cee80 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71c8ae1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c40b6b20 con 0x7f71c40d3b90 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71c8ae1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c40d4370 con 0x7f71c415dca0 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71bbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71c40d3b90 0x7f71c40d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71bbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71c40d3b90 0x7f71c40d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53638/0 (socket says 172.21.15.55:53638) 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71bbfff640 1 -- 172.21.15.55:0/841910074 learned_addr learned my addr 172.21.15.55:0/841910074 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71c259c640 1 --2- 172.21.15.55:0/841910074 >> v2:172.21.15.167:3300/0 conn(0x7f71c415dca0 0x7f71c40ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71bbfff640 1 -- 172.21.15.55:0/841910074 >> v2:172.21.15.167:3300/0 conn(0x7f71c415dca0 msgr2=0x7f71c40ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71bbfff640 1 --2- 172.21.15.55:0/841910074 >> v2:172.21.15.167:3300/0 conn(0x7f71c415dca0 0x7f71c40ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71bbfff640 1 -- 172.21.15.55:0/841910074 >> v1:172.21.15.167:6789/0 conn(0x7f71c40cee80 legacy=0x7f71c40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.000+0000 7f71bbfff640 1 -- 172.21.15.55:0/841910074 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40d4650 con 0x7f71c40d3b90 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.001+0000 7f71bbfff640 1 --2- 172.21.15.55:0/841910074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71c40d3b90 0x7f71c40d0a20 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f71c40b6340 tx=0x7f71ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f37006c8b25245 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.001+0000 7f71c1d9b640 1 -- 172.21.15.55:0/841910074 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac037070 con 0x7f71c40d3b90 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.001+0000 7f71c1d9b640 1 -- 172.21.15.55:0/841910074 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac032440 con 0x7f71c40d3b90 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.001+0000 7f71c1d9b640 1 -- 172.21.15.55:0/841910074 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac032810 con 0x7f71c40d3b90 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.002+0000 7f71c8ae1640 1 -- 172.21.15.55:0/841910074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71c40d3b90 msgr2=0x7f71c40d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.002+0000 7f71c8ae1640 1 --2- 172.21.15.55:0/841910074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71c40d3b90 0x7f71c40d0a20 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f71c40b6340 tx=0x7f71ac02a270 comp rx=0 tx=0).stop 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.002+0000 7f71c8ae1640 1 -- 172.21.15.55:0/841910074 shutdown_connections 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.002+0000 7f71c8ae1640 1 --2- 172.21.15.55:0/841910074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71c40d3b90 0x7f71c40d0a20 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.002+0000 7f71c8ae1640 1 --2- 172.21.15.55:0/841910074 >> v2:172.21.15.167:3300/0 conn(0x7f71c415dca0 0x7f71c40ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.002+0000 7f71c8ae1640 1 -- 172.21.15.55:0/841910074 >> 172.21.15.55:0/841910074 conn(0x7f71c40726c0 msgr2=0x7f71c4072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.002+0000 7f71c8ae1640 1 -- 172.21.15.55:0/841910074 shutdown_connections 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.002+0000 7f71c8ae1640 1 -- 172.21.15.55:0/841910074 wait complete. 2024-04-25T09:03:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.003+0000 7f71c8ae1640 1 Processor -- start 2024-04-25T09:03:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.003+0000 7f71c8ae1640 1 -- start start 2024-04-25T09:03:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c8ae1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c40cee80 0x7f71c40cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c8ae1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c40d3b90 0x7f71c41f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c8ae1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71c415dca0 0x7f71c415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c8ae1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c415e200 con 0x7f71c415dca0 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c8ae1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c415e080 con 0x7f71c40d3b90 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c8ae1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40d0f60 con 0x7f71c40cee80 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71c415dca0 0x7f71c415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71c415dca0 0x7f71c415bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53642/0 (socket says 172.21.15.55:53642) 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c2d9d640 1 -- 172.21.15.55:0/2604475953 learned_addr learned my addr 172.21.15.55:0/2604475953 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71bbfff640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c40d3b90 0x7f71c41f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c259c640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c40cee80 0x7f71c40cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c2d9d640 1 -- 172.21.15.55:0/2604475953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c40cee80 msgr2=0x7f71c40cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c2d9d640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c40cee80 0x7f71c40cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c2d9d640 1 -- 172.21.15.55:0/2604475953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c40d3b90 msgr2=0x7f71c41f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c2d9d640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c40d3b90 0x7f71c41f7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c2d9d640 1 -- 172.21.15.55:0/2604475953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40cc040 con 0x7f71c415dca0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.004+0000 7f71c2d9d640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71c415dca0 0x7f71c415bdd0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c7a0 tx=0x7f71bc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.005+0000 7f71baffd640 1 -- 172.21.15.55:0/2604475953 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc003b70 con 0x7f71c415dca0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.005+0000 7f71baffd640 1 -- 172.21.15.55:0/2604475953 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc003d30 con 0x7f71c415dca0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.005+0000 7f71c8ae1640 1 -- 172.21.15.55:0/2604475953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c40cc320 con 0x7f71c415dca0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.005+0000 7f71baffd640 1 -- 172.21.15.55:0/2604475953 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00aa90 con 0x7f71c415dca0 2024-04-25T09:03:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.005+0000 7f71c8ae1640 1 -- 172.21.15.55:0/2604475953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c40cc8e0 con 0x7f71c415dca0 2024-04-25T09:03:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.006+0000 7f71c8ae1640 1 -- 172.21.15.55:0/2604475953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c40750b0 con 0x7f71c415dca0 2024-04-25T09:03:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.006+0000 7f71baffd640 1 -- 172.21.15.55:0/2604475953 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f71bc00ac30 con 0x7f71c415dca0 2024-04-25T09:03:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.007+0000 7f71baffd640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71a406b500 0x7f71a406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.007+0000 7f71baffd640 1 -- 172.21.15.55:0/2604475953 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f71bc089d80 con 0x7f71c415dca0 2024-04-25T09:03:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.007+0000 7f71c259c640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71a406b500 0x7f71a406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.007+0000 7f71c259c640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71a406b500 0x7f71a406d9c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f71b40079a0 tx=0x7f71b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.011+0000 7f71baffd640 1 -- 172.21.15.55:0/2604475953 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f71bc0587d0 con 0x7f71c415dca0 2024-04-25T09:03:28.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.190+0000 7f71c8ae1640 1 -- 172.21.15.55:0/2604475953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f71c40b8a50 con 0x7f71c415dca0 2024-04-25T09:03:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.198+0000 7f71baffd640 1 -- 172.21.15.55:0/2604475953 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f71bc05c870 con 0x7f71c415dca0 2024-04-25T09:03:28.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 -- 172.21.15.55:0/2604475953 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71a406b500 msgr2=0x7f71a406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71a406b500 0x7f71a406d9c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f71b40079a0 tx=0x7f71b4008040 comp rx=0 tx=0).stop 2024-04-25T09:03:28.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 -- 172.21.15.55:0/2604475953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71c415dca0 msgr2=0x7f71c415bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71c415dca0 0x7f71c415bdd0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c7a0 tx=0x7f71bc00cc60 comp rx=0 tx=0).stop 2024-04-25T09:03:28.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 -- 172.21.15.55:0/2604475953 shutdown_connections 2024-04-25T09:03:28.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71a406b500 0x7f71a406d9c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71c415dca0 0x7f71c415bdd0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c40d3b90 0x7f71c41f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 --2- 172.21.15.55:0/2604475953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c40cee80 0x7f71c40cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 -- 172.21.15.55:0/2604475953 >> 172.21.15.55:0/2604475953 conn(0x7f71c40726c0 msgr2=0x7f71c40b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:28.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 -- 172.21.15.55:0/2604475953 shutdown_connections 2024-04-25T09:03:28.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.200+0000 7f71c8ae1640 1 -- 172.21.15.55:0/2604475953 wait complete. 2024-04-25T09:03:28.199 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:03:28.199 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:28.241 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:28.293 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:03:28.293 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:28.293 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:28.309 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:28.309 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:03:28.309 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:28.326 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:28.326 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:28.326 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:28.364 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:28.365 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:03:28.365 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:28.384 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:28.384 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:03:28.385 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.517+0000 7fce9527d640 1 Processor -- start 2024-04-25T09:03:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.517+0000 7fce9527d640 1 -- start start 2024-04-25T09:03:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.518+0000 7fce9527d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce9015dc30 0x7fce9006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.518+0000 7fce9527d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce9006cc00 0x7fce900b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.518+0000 7fce9527d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9006c1f0 con 0x7fce900b1960 2024-04-25T09:03:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.518+0000 7fce9527d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce900cfb40 con 0x7fce9006cc00 2024-04-25T09:03:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.518+0000 7fce9527d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce900b2060 con 0x7fce9015dc30 2024-04-25T09:03:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.518+0000 7fce8e7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce9006cc00 0x7fce900b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.518+0000 7fce8e7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce9006cc00 0x7fce900b1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53656/0 (socket says 172.21.15.55:53656) 2024-04-25T09:03:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.518+0000 7fce8e7fc640 1 -- 172.21.15.55:0/1795903413 learned_addr learned my addr 172.21.15.55:0/1795903413 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.518+0000 7fce8effd640 1 --2- 172.21.15.55:0/1795903413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce9015dc30 0x7fce9006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.519+0000 7fce8e7fc640 1 -- 172.21.15.55:0/1795903413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce9015dc30 msgr2=0x7fce9006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.519+0000 7fce8e7fc640 1 --2- 172.21.15.55:0/1795903413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce9015dc30 0x7fce9006c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.519+0000 7fce8e7fc640 1 -- 172.21.15.55:0/1795903413 >> v1:172.21.15.167:6789/0 conn(0x7fce900b1960 legacy=0x7fce90099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.519+0000 7fce8e7fc640 1 -- 172.21.15.55:0/1795903413 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce900b2340 con 0x7fce9006cc00 2024-04-25T09:03:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.519+0000 7fce8e7fc640 1 --2- 172.21.15.55:0/1795903413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce9006cc00 0x7fce900b1420 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fce84009870 tx=0x7fce8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f54c2cb6e42507 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.519+0000 7fce8dffb640 1 -- 172.21.15.55:0/1795903413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84037070 con 0x7fce9006cc00 2024-04-25T09:03:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.519+0000 7fce8dffb640 1 -- 172.21.15.55:0/1795903413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce84032440 con 0x7fce9006cc00 2024-04-25T09:03:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.519+0000 7fce8dffb640 1 -- 172.21.15.55:0/1795903413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84032810 con 0x7fce9006cc00 2024-04-25T09:03:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.520+0000 7fce9527d640 1 -- 172.21.15.55:0/1795903413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce9006cc00 msgr2=0x7fce900b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.520+0000 7fce9527d640 1 --2- 172.21.15.55:0/1795903413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce9006cc00 0x7fce900b1420 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fce84009870 tx=0x7fce8402a270 comp rx=0 tx=0).stop 2024-04-25T09:03:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.520+0000 7fce9527d640 1 -- 172.21.15.55:0/1795903413 shutdown_connections 2024-04-25T09:03:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.520+0000 7fce9527d640 1 --2- 172.21.15.55:0/1795903413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce9006cc00 0x7fce900b1420 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.520+0000 7fce9527d640 1 --2- 172.21.15.55:0/1795903413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce9015dc30 0x7fce9006c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.520+0000 7fce9527d640 1 -- 172.21.15.55:0/1795903413 >> 172.21.15.55:0/1795903413 conn(0x7fce900d1900 msgr2=0x7fce900d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:28.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.520+0000 7fce9527d640 1 -- 172.21.15.55:0/1795903413 shutdown_connections 2024-04-25T09:03:28.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.520+0000 7fce9527d640 1 -- 172.21.15.55:0/1795903413 wait complete. 2024-04-25T09:03:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.521+0000 7fce9527d640 1 Processor -- start 2024-04-25T09:03:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.521+0000 7fce9527d640 1 -- start start 2024-04-25T09:03:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.522+0000 7fce9527d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce9006cc00 0x7fce90153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.522+0000 7fce9527d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce900b1960 0x7fce900c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.522+0000 7fce9527d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce9015dc30 0x7fce900b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.522+0000 7fce9527d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900b1d80 con 0x7fce9015dc30 2024-04-25T09:03:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.522+0000 7fce9527d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900cfde0 con 0x7fce900b1960 2024-04-25T09:03:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.522+0000 7fce9527d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9015e010 con 0x7fce9006cc00 2024-04-25T09:03:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.522+0000 7fce8f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce9015dc30 0x7fce900b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.522+0000 7fce8f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce9015dc30 0x7fce900b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53660/0 (socket says 172.21.15.55:53660) 2024-04-25T09:03:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.522+0000 7fce8f7fe640 1 -- 172.21.15.55:0/1453728310 learned_addr learned my addr 172.21.15.55:0/1453728310 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.522+0000 7fce8e7fc640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce900b1960 0x7fce900c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.522+0000 7fce8effd640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce9006cc00 0x7fce90153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce8f7fe640 1 -- 172.21.15.55:0/1453728310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce9006cc00 msgr2=0x7fce90153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce8f7fe640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce9006cc00 0x7fce90153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce8f7fe640 1 -- 172.21.15.55:0/1453728310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce900b1960 msgr2=0x7fce900c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce8f7fe640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce900b1960 0x7fce900c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce8f7fe640 1 -- 172.21.15.55:0/1453728310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90154370 con 0x7fce9015dc30 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce8e7fc640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce900b1960 0x7fce900c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce8f7fe640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce9015dc30 0x7fce900b4520 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fce8000c7a0 tx=0x7fce8000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce777fe640 1 -- 172.21.15.55:0/1453728310 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80003b70 con 0x7fce9015dc30 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce777fe640 1 -- 172.21.15.55:0/1453728310 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80003d30 con 0x7fce9015dc30 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce9527d640 1 -- 172.21.15.55:0/1453728310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce900c9b80 con 0x7fce9015dc30 2024-04-25T09:03:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce777fe640 1 -- 172.21.15.55:0/1453728310 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8000aa90 con 0x7fce9015dc30 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.523+0000 7fce9527d640 1 -- 172.21.15.55:0/1453728310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce900ca420 con 0x7fce9015dc30 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.524+0000 7fce9527d640 1 -- 172.21.15.55:0/1453728310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce90067850 con 0x7fce9015dc30 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.524+0000 7fce777fe640 1 -- 172.21.15.55:0/1453728310 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce8000ac30 con 0x7fce9015dc30 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.525+0000 7fce777fe640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fce7c06b4d0 0x7fce7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.525+0000 7fce777fe640 1 -- 172.21.15.55:0/1453728310 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fce80089ea0 con 0x7fce9015dc30 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.525+0000 7fce8effd640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fce7c06b4d0 0x7fce7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.525+0000 7fce8effd640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fce7c06b4d0 0x7fce7c06d990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fce88006fd0 tx=0x7fce88008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:28.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.529+0000 7fce777fe640 1 -- 172.21.15.55:0/1453728310 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fce9006c1f0 con 0x7fce9015dc30 2024-04-25T09:03:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.747+0000 7fce9527d640 1 -- 172.21.15.55:0/1453728310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce900b13d0 con 0x7fce9015dc30 2024-04-25T09:03:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.747+0000 7fce777fe640 1 -- 172.21.15.55:0/1453728310 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fce80058fc0 con 0x7fce9015dc30 2024-04-25T09:03:28.736 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:28.736 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":82,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2765065443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2765065443},{"type":"v1","addr":"172.21.15.167:6834","nonce":2765065443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1753473916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1753473916},{"type":"v1","addr":"172.21.15.167:6835","nonce":1753473916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1458689370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1458689370},{"type":"v1","addr":"172.21.15.55:6836","nonce":1458689370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":8754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/4013195286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4013195286},{"type":"v1","addr":"172.21.15.55:6837","nonce":4013195286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[]} 2024-04-25T09:03:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 82 2024-04-25T09:03:28.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 -- 172.21.15.55:0/1453728310 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fce7c06b4d0 msgr2=0x7fce7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fce7c06b4d0 0x7fce7c06d990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fce88006fd0 tx=0x7fce88008040 comp rx=0 tx=0).stop 2024-04-25T09:03:28.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 -- 172.21.15.55:0/1453728310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce9015dc30 msgr2=0x7fce900b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce9015dc30 0x7fce900b4520 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fce8000c7a0 tx=0x7fce8000cc60 comp rx=0 tx=0).stop 2024-04-25T09:03:28.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 -- 172.21.15.55:0/1453728310 shutdown_connections 2024-04-25T09:03:28.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fce7c06b4d0 0x7fce7c06d990 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce9015dc30 0x7fce900b4520 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce900b1960 0x7fce900c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 --2- 172.21.15.55:0/1453728310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce9006cc00 0x7fce90153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 -- 172.21.15.55:0/1453728310 >> 172.21.15.55:0/1453728310 conn(0x7fce900d1900 msgr2=0x7fce900d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:28.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 -- 172.21.15.55:0/1453728310 shutdown_connections 2024-04-25T09:03:28.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.749+0000 7fce9527d640 1 -- 172.21.15.55:0/1453728310 wait complete. 2024-04-25T09:03:28.749 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:03:28.749 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:03:28.749 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:03:28.749 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:28.749 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:03:28.749 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:03:28.750 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:03:28.750 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:28.750 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:03:28.750 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:03:28.750 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:03:28.750 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:28.750 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:03:28.751 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:03:28.751 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:03:28.751 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:28.758 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:03:28.759 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:03:28.759 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:03:28.760 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:03:28.762 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:03:28.762 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:03:28.763 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:03:28.763 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:03:28.802 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:03:28.802 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:28.802 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:03:28.803 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:28.805 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:03:28.805 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:28.805 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:03:28.805 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:28.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:03:28.878 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-25T09:03:28.878 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-25T09:03:28.883 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T09:03:28.884 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T09:03:28.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.924+0000 7f52c3102640 1 Processor -- start 2024-04-25T09:03:28.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.924+0000 7f52c3102640 1 -- start start 2024-04-25T09:03:28.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.925+0000 7f52c3102640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52bc0ceeb0 0x7f52bc168a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.925+0000 7f52c3102640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc161f80 con 0x7f52bc161090 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.925+0000 7f52c3102640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc162260 con 0x7f52bc0b9720 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.925+0000 7f52c3102640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0d21a0 con 0x7f52bc0ceeb0 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.925+0000 7f52c0e9e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f52bc161090 0x7f52bc161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44314/0 (socket says 172.21.15.55:44314) 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.925+0000 7f52c0e9e640 1 -- 172.21.15.55:0/2328796520 learned_addr learned my addr 172.21.15.55:0/2328796520 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52c169f640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52bc0ceeb0 0x7f52bc168a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240893949 0 0) 0x7f52bc161f80 con 0x7f52bc161090 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ac003520 con 0x7f52bc161090 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3952894233 0 0) 0x7f52ac003520 con 0x7f52bc161090 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52bc0ceeb0 msgr2=0x7f52bc168a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52bc0ceeb0 0x7f52bc168a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 >> v1:172.21.15.167:6789/0 conn(0x7f52bc0b9720 legacy=0x7f52bc0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc162540 con 0x7f52bc161090 2024-04-25T09:03:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f52b0001690 con 0x7f52bc161090 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 >> v1:172.21.15.55:6789/0 conn(0x7f52bc161090 legacy=0x7f52bc161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0039e0 0x7f52ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac004390 0x7f52ac004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52bc0ceeb0 0x7f52ac005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0d21a0 con 0x7f52ac0039e0 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac00baa0 con 0x7f52ac004390 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac00bca0 con 0x7f52bc0ceeb0 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52c0e9e640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0039e0 0x7f52ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52c169f640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52bc0ceeb0 0x7f52ac005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52bbfff640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac004390 0x7f52ac004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52c0e9e640 1 -- 172.21.15.55:0/2328796520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52bc0ceeb0 msgr2=0x7f52ac005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52c0e9e640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52bc0ceeb0 0x7f52ac005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52c0e9e640 1 -- 172.21.15.55:0/2328796520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac004390 msgr2=0x7f52ac004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.926+0000 7f52c0e9e640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac004390 0x7f52ac004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.927+0000 7f52c0e9e640 1 -- 172.21.15.55:0/2328796520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac003520 con 0x7f52ac0039e0 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.927+0000 7f52c0e9e640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0039e0 0x7f52ac003dc0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f52b0007fd0 tx=0x7f52ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1308d987089a3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.927+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0007ce0 con 0x7f52ac0039e0 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.927+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0005ad0 con 0x7f52ac0039e0 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.927+0000 7f52bb7fe640 1 -- 172.21.15.55:0/2328796520 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0007070 con 0x7f52ac0039e0 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.928+0000 7f52c3102640 1 -- 172.21.15.55:0/2328796520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0039e0 msgr2=0x7f52ac003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.928+0000 7f52c3102640 1 --2- 172.21.15.55:0/2328796520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0039e0 0x7f52ac003dc0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f52b0007fd0 tx=0x7f52ac005830 comp rx=0 tx=0).stop 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.928+0000 7f52c169f640 1 -- 172.21.15.55:0/2328796520 reap_dead start 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.928+0000 7f52c3102640 1 -- 172.21.15.55:0/2328796520 shutdown_connections 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.928+0000 7f52c3102640 1 -- 172.21.15.55:0/2328796520 >> 172.21.15.55:0/2328796520 conn(0x7f52bc0b55e0 msgr2=0x7f52bc0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.928+0000 7f52c3102640 1 -- 172.21.15.55:0/2328796520 shutdown_connections 2024-04-25T09:03:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.928+0000 7f52c3102640 1 -- 172.21.15.55:0/2328796520 wait complete. 2024-04-25T09:03:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.929+0000 7f52c3102640 1 Processor -- start 2024-04-25T09:03:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.929+0000 7f52c3102640 1 -- start start 2024-04-25T09:03:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.930+0000 7f52c3102640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52ac0039e0 0x7f52bc152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.930+0000 7f52c3102640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0c96b0 0x7f52bc0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.930+0000 7f52c3102640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52bc0cbfd0 0x7f52bc0cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.930+0000 7f52c3102640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0d3640 con 0x7f52bc0c96b0 2024-04-25T09:03:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.930+0000 7f52c3102640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc161470 con 0x7f52bc0cbfd0 2024-04-25T09:03:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.930+0000 7f52c3102640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0d37c0 con 0x7f52ac0039e0 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.930+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0c96b0 0x7f52bc0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.930+0000 7f52bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0c96b0 0x7f52bc0c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58652/0 (socket says 172.21.15.55:58652) 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.930+0000 7f52bbfff640 1 -- 172.21.15.55:0/3193721176 learned_addr learned my addr 172.21.15.55:0/3193721176 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.930+0000 7f52c0e9e640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52ac0039e0 0x7f52bc152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.930+0000 7f52c169f640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52bc0cbfd0 0x7f52bc0cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.931+0000 7f52bbfff640 1 -- 172.21.15.55:0/3193721176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52ac0039e0 msgr2=0x7f52bc152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.931+0000 7f52bbfff640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52ac0039e0 0x7f52bc152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.931+0000 7f52bbfff640 1 -- 172.21.15.55:0/3193721176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52bc0cbfd0 msgr2=0x7f52bc0cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.931+0000 7f52bbfff640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52bc0cbfd0 0x7f52bc0cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.931+0000 7f52bbfff640 1 -- 172.21.15.55:0/3193721176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc152590 con 0x7f52bc0c96b0 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.931+0000 7f52bbfff640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0c96b0 0x7f52bc0c9b30 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f52a800f8d0 tx=0x7f52a800fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.931+0000 7f52b97fa640 1 -- 172.21.15.55:0/3193721176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a801a070 con 0x7f52bc0c96b0 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.931+0000 7f52b97fa640 1 -- 172.21.15.55:0/3193721176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a8005320 con 0x7f52bc0c96b0 2024-04-25T09:03:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.931+0000 7f52c3102640 1 -- 172.21.15.55:0/3193721176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc0c80b0 con 0x7f52bc0c96b0 2024-04-25T09:03:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.931+0000 7f52b97fa640 1 -- 172.21.15.55:0/3193721176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a8007270 con 0x7f52bc0c96b0 2024-04-25T09:03:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.931+0000 7f52c3102640 1 -- 172.21.15.55:0/3193721176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc0c8670 con 0x7f52bc0c96b0 2024-04-25T09:03:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.932+0000 7f52c3102640 1 -- 172.21.15.55:0/3193721176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc0750b0 con 0x7f52bc0c96b0 2024-04-25T09:03:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.932+0000 7f52b97fa640 1 -- 172.21.15.55:0/3193721176 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f52a801d070 con 0x7f52bc0c96b0 2024-04-25T09:03:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.933+0000 7f52b97fa640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52a006b4d0 0x7f52a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.933+0000 7f52c0e9e640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52a006b4d0 0x7f52a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.933+0000 7f52b97fa640 1 -- 172.21.15.55:0/3193721176 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f52a8089690 con 0x7f52bc0c96b0 2024-04-25T09:03:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.934+0000 7f52c0e9e640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52a006b4d0 0x7f52a006d990 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f52b0032000 tx=0x7f52b002d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:28.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:28.937+0000 7f52b97fa640 1 -- 172.21.15.55:0/3193721176 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52bc152590 con 0x7f52bc0c96b0 2024-04-25T09:03:29.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:29.135+0000 7f52c3102640 1 -- 172.21.15.55:0/3193721176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f52bc0d1700 con 0x7f52bc0c96b0 2024-04-25T09:03:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.241+0000 7f52b97fa640 1 -- 172.21.15.55:0/3193721176 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v111) v1 ==== 97+0+0 (secure 0 0 0) 0x7f52a8058160 con 0x7f52bc0c96b0 2024-04-25T09:03:30.229 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-25T09:03:30.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.243+0000 7f52c3102640 1 -- 172.21.15.55:0/3193721176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52a006b4d0 msgr2=0x7f52a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.243+0000 7f52c3102640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52a006b4d0 0x7f52a006d990 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f52b0032000 tx=0x7f52b002d000 comp rx=0 tx=0).stop 2024-04-25T09:03:30.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.243+0000 7f52c3102640 1 -- 172.21.15.55:0/3193721176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0c96b0 msgr2=0x7f52bc0c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.243+0000 7f52c3102640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0c96b0 0x7f52bc0c9b30 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f52a800f8d0 tx=0x7f52a800fd90 comp rx=0 tx=0).stop 2024-04-25T09:03:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.244+0000 7f52c3102640 1 -- 172.21.15.55:0/3193721176 shutdown_connections 2024-04-25T09:03:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.244+0000 7f52c3102640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f52a006b4d0 0x7f52a006d990 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.244+0000 7f52c3102640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52bc0cbfd0 0x7f52bc0cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.244+0000 7f52c3102640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0c96b0 0x7f52bc0c9b30 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.244+0000 7f52c3102640 1 --2- 172.21.15.55:0/3193721176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52ac0039e0 0x7f52bc152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.244+0000 7f52c3102640 1 -- 172.21.15.55:0/3193721176 >> 172.21.15.55:0/3193721176 conn(0x7f52bc0b55e0 msgr2=0x7f52bc0d3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.244+0000 7f52c3102640 1 -- 172.21.15.55:0/3193721176 shutdown_connections 2024-04-25T09:03:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.244+0000 7f52c3102640 1 -- 172.21.15.55:0/3193721176 wait complete. 2024-04-25T09:03:30.246 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:03:30.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.365+0000 7f248fcf5640 1 Processor -- start 2024-04-25T09:03:30.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.365+0000 7f248fcf5640 1 -- start start 2024-04-25T09:03:30.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248fcf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f248806e8f0 0x7f248815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248fcf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f248815c820 0x7f24881654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248fcf5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24880ce6c0 con 0x7f248815bf00 2024-04-25T09:03:30.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248fcf5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24881455e0 con 0x7f248806e8f0 2024-04-25T09:03:30.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248fcf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248806d450 con 0x7f248815c820 2024-04-25T09:03:30.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248d290640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f248806e8f0 0x7f248815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248d290640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f248806e8f0 0x7f248815c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58666/0 (socket says 172.21.15.55:58666) 2024-04-25T09:03:30.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248da91640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f248815bf00 0x7f24880cbdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44326/0 (socket says 172.21.15.55:44326) 2024-04-25T09:03:30.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248d290640 1 -- 172.21.15.55:0/1811247489 learned_addr learned my addr 172.21.15.55:0/1811247489 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:30.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248e292640 1 --2- 172.21.15.55:0/1811247489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f248815c820 0x7f24881654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248d290640 1 -- 172.21.15.55:0/1811247489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f248815c820 msgr2=0x7f24881654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:30.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248d290640 1 --2- 172.21.15.55:0/1811247489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f248815c820 0x7f24881654b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248d290640 1 -- 172.21.15.55:0/1811247489 >> v1:172.21.15.55:6789/0 conn(0x7f248815bf00 legacy=0x7f24880cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248d290640 1 -- 172.21.15.55:0/1811247489 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24880cc4e0 con 0x7f248806e8f0 2024-04-25T09:03:30.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.366+0000 7f248ca8f640 1 -- 172.21.15.55:0/1811247489 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141901052 0 0) 0x7f2484001110 con 0x7f248815bf00 2024-04-25T09:03:30.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.367+0000 7f248d290640 1 --2- 172.21.15.55:0/1811247489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248806e8f0 0x7f248815c2e0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f2478009870 tx=0x7f247802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83281feef1f29884 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.367+0000 7f248ca8f640 1 -- 172.21.15.55:0/1811247489 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478037070 con 0x7f248806e8f0 2024-04-25T09:03:30.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.367+0000 7f248ca8f640 1 -- 172.21.15.55:0/1811247489 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2478032440 con 0x7f248806e8f0 2024-04-25T09:03:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.367+0000 7f248ca8f640 1 -- 172.21.15.55:0/1811247489 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478032810 con 0x7f248806e8f0 2024-04-25T09:03:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.368+0000 7f248fcf5640 1 -- 172.21.15.55:0/1811247489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248806e8f0 msgr2=0x7f248815c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.368+0000 7f248fcf5640 1 --2- 172.21.15.55:0/1811247489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248806e8f0 0x7f248815c2e0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f2478009870 tx=0x7f247802a270 comp rx=0 tx=0).stop 2024-04-25T09:03:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.368+0000 7f248fcf5640 1 -- 172.21.15.55:0/1811247489 shutdown_connections 2024-04-25T09:03:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.368+0000 7f248fcf5640 1 --2- 172.21.15.55:0/1811247489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f248815c820 0x7f24881654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.368+0000 7f248fcf5640 1 --2- 172.21.15.55:0/1811247489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248806e8f0 0x7f248815c2e0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.368+0000 7f248fcf5640 1 -- 172.21.15.55:0/1811247489 >> 172.21.15.55:0/1811247489 conn(0x7f248806aba0 msgr2=0x7f248806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.368+0000 7f248fcf5640 1 -- 172.21.15.55:0/1811247489 shutdown_connections 2024-04-25T09:03:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.368+0000 7f248fcf5640 1 -- 172.21.15.55:0/1811247489 wait complete. 2024-04-25T09:03:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.369+0000 7f248fcf5640 1 Processor -- start 2024-04-25T09:03:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.369+0000 7f248fcf5640 1 -- start start 2024-04-25T09:03:30.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248fcf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248806e8f0 0x7f2488138b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248fcf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f248815bf00 0x7f248815b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248fcf5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f248815c820 0x7f2488142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248fcf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24880ccd70 con 0x7f248806e8f0 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248fcf5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24880cca90 con 0x7f248815c820 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248fcf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24880cd050 con 0x7f248815bf00 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248da91640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248806e8f0 0x7f2488138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248da91640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248806e8f0 0x7f2488138b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58676/0 (socket says 172.21.15.55:58676) 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248da91640 1 -- 172.21.15.55:0/1128539249 learned_addr learned my addr 172.21.15.55:0/1128539249 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248d290640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f248815bf00 0x7f248815b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248e292640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f248815c820 0x7f2488142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248da91640 1 -- 172.21.15.55:0/1128539249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f248815bf00 msgr2=0x7f248815b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248da91640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f248815bf00 0x7f248815b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248da91640 1 -- 172.21.15.55:0/1128539249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f248815c820 msgr2=0x7f2488142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248da91640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f248815c820 0x7f2488142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.370+0000 7f248da91640 1 -- 172.21.15.55:0/1128539249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248815b6e0 con 0x7f248806e8f0 2024-04-25T09:03:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.371+0000 7f248da91640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248806e8f0 0x7f2488138b50 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f248400c780 tx=0x7f248400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.371+0000 7f247e7fc640 1 -- 172.21.15.55:0/1128539249 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484018070 con 0x7f248806e8f0 2024-04-25T09:03:30.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.371+0000 7f247e7fc640 1 -- 172.21.15.55:0/1128539249 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24840072d0 con 0x7f248806e8f0 2024-04-25T09:03:30.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.371+0000 7f248fcf5640 1 -- 172.21.15.55:0/1128539249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2488142440 con 0x7f248806e8f0 2024-04-25T09:03:30.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.371+0000 7f247e7fc640 1 -- 172.21.15.55:0/1128539249 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24840047e0 con 0x7f248806e8f0 2024-04-25T09:03:30.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.371+0000 7f248fcf5640 1 -- 172.21.15.55:0/1128539249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24881394c0 con 0x7f248806e8f0 2024-04-25T09:03:30.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.372+0000 7f248fcf5640 1 -- 172.21.15.55:0/1128539249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24880749b0 con 0x7f248806e8f0 2024-04-25T09:03:30.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.372+0000 7f247e7fc640 1 -- 172.21.15.55:0/1128539249 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f248401b070 con 0x7f248806e8f0 2024-04-25T09:03:30.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.373+0000 7f247e7fc640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f246c06b4d0 0x7f246c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.373+0000 7f247e7fc640 1 -- 172.21.15.55:0/1128539249 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2484089140 con 0x7f248806e8f0 2024-04-25T09:03:30.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.373+0000 7f248d290640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f246c06b4d0 0x7f246c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.373+0000 7f248d290640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f246c06b4d0 0x7f246c06d990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2478034000 tx=0x7f247802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.377+0000 7f247e7fc640 1 -- 172.21.15.55:0/1128539249 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f248815b6e0 con 0x7f248806e8f0 2024-04-25T09:03:30.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.625+0000 7f248fcf5640 1 -- 172.21.15.55:0/1128539249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f24881f1250 con 0x7f248806e8f0 2024-04-25T09:03:30.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.625+0000 7f247e7fc640 1 -- 172.21.15.55:0/1128539249 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f24880ce6c0 con 0x7f248806e8f0 2024-04-25T09:03:30.614 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:30.614 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:03:30.614 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-25T09:03:30.614 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.614 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-25T09:03:30.614 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm4IxeGBAAwuzfw8fkgBWLS/OHkVRPdA==", 2024-04-25T09:03:30.614 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmz17MIxAAOjfHLP2pVtyOH1KkaFBdpw==", 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T09:03:30.615 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcJlOHxAAWRBqx21VaZdp7n+bG6QdjA==", 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-25T09:03:30.616 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmbKyTKhAARg7pgR8TeZKNHV38FuAv+g==", 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDgGSpmMDqwHRAAte7ZpF14thK4VEsC4getWg==", 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:03:30.617 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDjGSpm7bEhHRAALQKewGfpKljGFsW75+h/Dg==", 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-25T09:03:30.618 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDmGSpmjg2RHBAA+DxXqJHuPIGUsVvwUirEwg==", 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDpGSpmxft1HBAAsIYtKh97QF4WhdL9kI2QeA==", 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.619 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDvGSpm4QDFIRAAlMSvRI/gNR4p8BgQdRUcBA==", 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyGSpmARfiHxAABn3CWZTkyRxXpTUxKGi71A==", 2024-04-25T09:03:30.620 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1GSpmLHBmHRAA4xXuyYK95pq8g+DAXREvKQ==", 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.621 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4GSpmMbpPGxAAP7YWBUzcafaowcZG1ZWhDA==", 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw==", 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:03:30.622 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmcP0TNxAA02w2xuYx7fMlMbZpgy53hQ==", 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.623 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmpD8INBAA29l06IV/RnM5qxOD6VL3MA==", 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDaGSpm8xftABAADCQqbD2gknLM2w+MV/H29A==", 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-25T09:03:30.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDYGSpmHI4oORAAQoQL0ylKsbBRG+EldcMd4g==", 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.625 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpmk2Q/FRAAwGHbq7UsFI+OdwcBOqLnlA==", 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDZGSpm6NfaERAAtb5ZheEavSDdOCOxeM0a2Q==", 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-25T09:03:30.626 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-25T09:03:30.627 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.627 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:30.627 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-25T09:03:30.627 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:03:30.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 -- 172.21.15.55:0/1128539249 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f246c06b4d0 msgr2=0x7f246c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f246c06b4d0 0x7f246c06d990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2478034000 tx=0x7f247802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:30.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 -- 172.21.15.55:0/1128539249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248806e8f0 msgr2=0x7f2488138b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248806e8f0 0x7f2488138b50 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f248400c780 tx=0x7f248400cc40 comp rx=0 tx=0).stop 2024-04-25T09:03:30.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 -- 172.21.15.55:0/1128539249 shutdown_connections 2024-04-25T09:03:30.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f246c06b4d0 0x7f246c06d990 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f248815c820 0x7f2488142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f248815bf00 0x7f248815b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 --2- 172.21.15.55:0/1128539249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248806e8f0 0x7f2488138b50 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 -- 172.21.15.55:0/1128539249 >> 172.21.15.55:0/1128539249 conn(0x7f248806aba0 msgr2=0x7f2488144080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 -- 172.21.15.55:0/1128539249 shutdown_connections 2024-04-25T09:03:30.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.627+0000 7f248fcf5640 1 -- 172.21.15.55:0/1128539249 wait complete. 2024-04-25T09:03:30.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.742+0000 7f4f2506f640 1 Processor -- start 2024-04-25T09:03:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.742+0000 7f4f2506f640 1 -- start start 2024-04-25T09:03:30.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.743+0000 7f4f2506f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4f2015f120 0x7f4f200ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.743+0000 7f4f2506f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 0x7f4f200cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.743+0000 7f4f2506f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f200cdfe0 con 0x7f4f200cfbe0 2024-04-25T09:03:30.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.743+0000 7f4f2506f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f200d09f0 con 0x7f4f2015f120 2024-04-25T09:03:30.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.743+0000 7f4f2506f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200cec70 con 0x7f4f200ce830 2024-04-25T09:03:30.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.743+0000 7f4f1ed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4f2015f120 0x7f4f200ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.743+0000 7f4f1e59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 0x7f4f200cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.743+0000 7f4f1f59e640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4f200cfbe0 0x7f4f20099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:40862/0 (socket says 172.21.15.55:40862) 2024-04-25T09:03:30.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.743+0000 7f4f1ed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4f2015f120 0x7f4f200ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:50728/0 (socket says 172.21.15.55:50728) 2024-04-25T09:03:30.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.743+0000 7f4f1e59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 0x7f4f200cf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:55152/0 (socket says 172.21.15.55:55152) 2024-04-25T09:03:30.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.743+0000 7f4f1f59e640 1 -- 172.21.15.55:0/2513856128 learned_addr learned my addr 172.21.15.55:0/2513856128 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:30.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.744+0000 7f4f1ed9d640 1 -- 172.21.15.55:0/2513856128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 msgr2=0x7f4f200cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:30.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.744+0000 7f4f1ed9d640 1 --2- 172.21.15.55:0/2513856128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 0x7f4f200cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.744+0000 7f4f1ed9d640 1 -- 172.21.15.55:0/2513856128 >> v1:172.21.15.167:6789/0 conn(0x7f4f200cfbe0 legacy=0x7f4f20099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.744+0000 7f4f1ed9d640 1 -- 172.21.15.55:0/2513856128 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200d0430 con 0x7f4f2015f120 2024-04-25T09:03:30.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.744+0000 7f4f1dd9b640 1 -- 172.21.15.55:0/2513856128 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283946266 0 0) 0x7f4f200cdfe0 con 0x7f4f200cfbe0 2024-04-25T09:03:30.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.744+0000 7f4f1ed9d640 1 --2- 172.21.15.55:0/2513856128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f2015f120 0x7f4f200ce2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4f100097a0 tx=0x7f4f1002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9729aca6059bd29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.745+0000 7f4f1dd9b640 1 -- 172.21.15.55:0/2513856128 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10037070 con 0x7f4f2015f120 2024-04-25T09:03:30.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.745+0000 7f4f1dd9b640 1 -- 172.21.15.55:0/2513856128 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10032440 con 0x7f4f2015f120 2024-04-25T09:03:30.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.745+0000 7f4f1dd9b640 1 -- 172.21.15.55:0/2513856128 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10032810 con 0x7f4f2015f120 2024-04-25T09:03:30.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.745+0000 7f4f2506f640 1 -- 172.21.15.55:0/2513856128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f2015f120 msgr2=0x7f4f200ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.745+0000 7f4f2506f640 1 --2- 172.21.15.55:0/2513856128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f2015f120 0x7f4f200ce2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4f100097a0 tx=0x7f4f1002a210 comp rx=0 tx=0).stop 2024-04-25T09:03:30.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.745+0000 7f4f2506f640 1 -- 172.21.15.55:0/2513856128 shutdown_connections 2024-04-25T09:03:30.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.745+0000 7f4f2506f640 1 --2- 172.21.15.55:0/2513856128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 0x7f4f200cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.745+0000 7f4f2506f640 1 --2- 172.21.15.55:0/2513856128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f2015f120 0x7f4f200ce2f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.745+0000 7f4f2506f640 1 -- 172.21.15.55:0/2513856128 >> 172.21.15.55:0/2513856128 conn(0x7f4f200d1900 msgr2=0x7f4f200d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.745+0000 7f4f2506f640 1 -- 172.21.15.55:0/2513856128 shutdown_connections 2024-04-25T09:03:30.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.745+0000 7f4f2506f640 1 -- 172.21.15.55:0/2513856128 wait complete. 2024-04-25T09:03:30.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.747+0000 7f4f2506f640 1 Processor -- start 2024-04-25T09:03:30.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.747+0000 7f4f2506f640 1 -- start start 2024-04-25T09:03:30.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.747+0000 7f4f2506f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 0x7f4f2006c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.747+0000 7f4f2506f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f200cfbe0 0x7f4f2015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.747+0000 7f4f2506f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f2015f120 0x7f4f2006d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.747+0000 7f4f2506f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200ccab0 con 0x7f4f2015f120 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.747+0000 7f4f2506f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200cc7d0 con 0x7f4f200cfbe0 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.747+0000 7f4f2506f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200cc480 con 0x7f4f200ce830 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f2015f120 0x7f4f2006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f2015f120 0x7f4f2006d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58680/0 (socket says 172.21.15.55:58680) 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1f59e640 1 -- 172.21.15.55:0/4232527450 learned_addr learned my addr 172.21.15.55:0/4232527450 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1ed9d640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 0x7f4f2006c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1e59c640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f200cfbe0 0x7f4f2015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1f59e640 1 -- 172.21.15.55:0/4232527450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 msgr2=0x7f4f2006c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1f59e640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 0x7f4f2006c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1f59e640 1 -- 172.21.15.55:0/4232527450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f200cfbe0 msgr2=0x7f4f2015c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1f59e640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f200cfbe0 0x7f4f2015c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1f59e640 1 -- 172.21.15.55:0/4232527450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2006c9a0 con 0x7f4f2015f120 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1ed9d640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 0x7f4f2006c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:30.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f1f59e640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f2015f120 0x7f4f2006d810 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c7a0 tx=0x7f4f1800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f077fe640 1 -- 172.21.15.55:0/4232527450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18018070 con 0x7f4f2015f120 2024-04-25T09:03:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f077fe640 1 -- 172.21.15.55:0/4232527450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1800a640 con 0x7f4f2015f120 2024-04-25T09:03:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f2506f640 1 -- 172.21.15.55:0/4232527450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2006cc80 con 0x7f4f2015f120 2024-04-25T09:03:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f077fe640 1 -- 172.21.15.55:0/4232527450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1800aab0 con 0x7f4f2015f120 2024-04-25T09:03:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.748+0000 7f4f2506f640 1 -- 172.21.15.55:0/4232527450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2006d240 con 0x7f4f2015f120 2024-04-25T09:03:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.749+0000 7f4f2506f640 1 -- 172.21.15.55:0/4232527450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f20067850 con 0x7f4f2015f120 2024-04-25T09:03:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.750+0000 7f4f077fe640 1 -- 172.21.15.55:0/4232527450 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4f1801b070 con 0x7f4f2015f120 2024-04-25T09:03:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.750+0000 7f4f077fe640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f0c06b500 0x7f4f0c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.750+0000 7f4f077fe640 1 -- 172.21.15.55:0/4232527450 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4f18089420 con 0x7f4f2015f120 2024-04-25T09:03:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.750+0000 7f4f1ed9d640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f0c06b500 0x7f4f0c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.751+0000 7f4f1ed9d640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f0c06b500 0x7f4f0c06d9c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4f10034000 tx=0x7f4f1002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.754+0000 7f4f077fe640 1 -- 172.21.15.55:0/4232527450 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4f18058680 con 0x7f4f2015f120 2024-04-25T09:03:30.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.934+0000 7f4f2506f640 1 -- 172.21.15.55:0/4232527450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f2006c0c0 con 0x7f4f2015f120 2024-04-25T09:03:30.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.935+0000 7f4f077fe640 1 -- 172.21.15.55:0/4232527450 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+12901 (secure 0 0 0) 0x7f4f18057f80 con 0x7f4f2015f120 2024-04-25T09:03:30.923 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:30.924 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":111,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:30.235737+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:30.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 -- 172.21.15.55:0/4232527450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f0c06b500 msgr2=0x7f4f0c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f0c06b500 0x7f4f0c06d9c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4f10034000 tx=0x7f4f1002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:30.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 -- 172.21.15.55:0/4232527450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f2015f120 msgr2=0x7f4f2006d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f2015f120 0x7f4f2006d810 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c7a0 tx=0x7f4f1800cc60 comp rx=0 tx=0).stop 2024-04-25T09:03:30.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 -- 172.21.15.55:0/4232527450 shutdown_connections 2024-04-25T09:03:30.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f0c06b500 0x7f4f0c06d9c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f2015f120 0x7f4f2006d810 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f200cfbe0 0x7f4f2015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 --2- 172.21.15.55:0/4232527450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f200ce830 0x7f4f2006c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 -- 172.21.15.55:0/4232527450 >> 172.21.15.55:0/4232527450 conn(0x7f4f200d1900 msgr2=0x7f4f2006fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 -- 172.21.15.55:0/4232527450 shutdown_connections 2024-04-25T09:03:30.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:30.937+0000 7f4f2506f640 1 -- 172.21.15.55:0/4232527450 wait complete. 2024-04-25T09:03:30.937 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:30.937 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:31.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.053+0000 7ff5c2fce640 1 Processor -- start 2024-04-25T09:03:31.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.053+0000 7ff5c2fce640 1 -- start start 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c2fce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5bc0ce3a0 0x7ff5bc0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c2fce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5bc15d450 0x7ff5bc15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c2fce640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5bc0b1f60 con 0x7ff5bc06aba0 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c2fce640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5bc0b0130 con 0x7ff5bc15d450 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c2fce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0b09d0 con 0x7ff5bc0ce3a0 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c156b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5bc15d450 0x7ff5bc15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c156b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5bc15d450 0x7ff5bc15d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58688/0 (socket says 172.21.15.55:58688) 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c156b640 1 -- 172.21.15.55:0/284045985 learned_addr learned my addr 172.21.15.55:0/284045985 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5bbfff640 1 --2- 172.21.15.55:0/284045985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5bc0ce3a0 0x7ff5bc0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c156b640 1 -- 172.21.15.55:0/284045985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5bc0ce3a0 msgr2=0x7ff5bc0b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c156b640 1 --2- 172.21.15.55:0/284045985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5bc0ce3a0 0x7ff5bc0b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c156b640 1 -- 172.21.15.55:0/284045985 >> v1:172.21.15.167:6789/0 conn(0x7ff5bc06aba0 legacy=0x7ff5bc06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5c156b640 1 -- 172.21.15.55:0/284045985 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0b0380 con 0x7ff5bc15d450 2024-04-25T09:03:31.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.054+0000 7ff5bbfff640 1 --2- 172.21.15.55:0/284045985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5bc0ce3a0 0x7ff5bc0b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.055+0000 7ff5c156b640 1 --2- 172.21.15.55:0/284045985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5bc15d450 0x7ff5bc15d8e0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009e80 tx=0x7ff5b402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d5e8a205e2ec89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.055+0000 7ff5bb7fe640 1 -- 172.21.15.55:0/284045985 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4036070 con 0x7ff5bc15d450 2024-04-25T09:03:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.055+0000 7ff5bb7fe640 1 -- 172.21.15.55:0/284045985 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b4031600 con 0x7ff5bc15d450 2024-04-25T09:03:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.055+0000 7ff5bb7fe640 1 -- 172.21.15.55:0/284045985 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40319d0 con 0x7ff5bc15d450 2024-04-25T09:03:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.056+0000 7ff5c2fce640 1 -- 172.21.15.55:0/284045985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5bc15d450 msgr2=0x7ff5bc15d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.056+0000 7ff5c2fce640 1 --2- 172.21.15.55:0/284045985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5bc15d450 0x7ff5bc15d8e0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009e80 tx=0x7ff5b402a750 comp rx=0 tx=0).stop 2024-04-25T09:03:31.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.056+0000 7ff5c2fce640 1 -- 172.21.15.55:0/284045985 shutdown_connections 2024-04-25T09:03:31.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.056+0000 7ff5c2fce640 1 --2- 172.21.15.55:0/284045985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5bc15d450 0x7ff5bc15d8e0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.056+0000 7ff5c2fce640 1 --2- 172.21.15.55:0/284045985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5bc0ce3a0 0x7ff5bc0b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.056+0000 7ff5c2fce640 1 -- 172.21.15.55:0/284045985 >> 172.21.15.55:0/284045985 conn(0x7ff5bc0d07d0 msgr2=0x7ff5bc0d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.056+0000 7ff5c2fce640 1 -- 172.21.15.55:0/284045985 shutdown_connections 2024-04-25T09:03:31.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.056+0000 7ff5c2fce640 1 -- 172.21.15.55:0/284045985 wait complete. 2024-04-25T09:03:31.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.057+0000 7ff5c2fce640 1 Processor -- start 2024-04-25T09:03:31.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.057+0000 7ff5c2fce640 1 -- start start 2024-04-25T09:03:31.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c2fce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc06aba0 0x7ff5bc09a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c2fce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5bc0ce3a0 0x7ff5bc0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c2fce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5bc15d450 0x7ff5bc1f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c2fce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0b0e60 con 0x7ff5bc15d450 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c2fce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc06b880 con 0x7ff5bc06aba0 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c2fce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0b0fe0 con 0x7ff5bc0ce3a0 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c156b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5bc15d450 0x7ff5bc1f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c156b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5bc15d450 0x7ff5bc1f7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58694/0 (socket says 172.21.15.55:58694) 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c156b640 1 -- 172.21.15.55:0/555178762 learned_addr learned my addr 172.21.15.55:0/555178762 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c0d6a640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc06aba0 0x7ff5bc09a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5bbfff640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5bc0ce3a0 0x7ff5bc0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c156b640 1 -- 172.21.15.55:0/555178762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5bc0ce3a0 msgr2=0x7ff5bc0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c156b640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5bc0ce3a0 0x7ff5bc0b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c156b640 1 -- 172.21.15.55:0/555178762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc06aba0 msgr2=0x7ff5bc09a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c156b640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc06aba0 0x7ff5bc09a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c156b640 1 -- 172.21.15.55:0/555178762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0b5100 con 0x7ff5bc15d450 2024-04-25T09:03:31.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c0d6a640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc06aba0 0x7ff5bc09a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:31.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5c156b640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5bc15d450 0x7ff5bc1f7120 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4034040 tx=0x7ff5b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.058+0000 7ff5b97fa640 1 -- 172.21.15.55:0/555178762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4041020 con 0x7ff5bc15d450 2024-04-25T09:03:31.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.059+0000 7ff5b97fa640 1 -- 172.21.15.55:0/555178762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b40077a0 con 0x7ff5bc15d450 2024-04-25T09:03:31.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.059+0000 7ff5c2fce640 1 -- 172.21.15.55:0/555178762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc0b53e0 con 0x7ff5bc15d450 2024-04-25T09:03:31.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.059+0000 7ff5b97fa640 1 -- 172.21.15.55:0/555178762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4036040 con 0x7ff5bc15d450 2024-04-25T09:03:31.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.059+0000 7ff5c2fce640 1 -- 172.21.15.55:0/555178762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc0b59a0 con 0x7ff5bc15d450 2024-04-25T09:03:31.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.060+0000 7ff5c2fce640 1 -- 172.21.15.55:0/555178762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc0750b0 con 0x7ff5bc15d450 2024-04-25T09:03:31.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.060+0000 7ff5b97fa640 1 -- 172.21.15.55:0/555178762 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff5b4044020 con 0x7ff5bc15d450 2024-04-25T09:03:31.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.061+0000 7ff5b97fa640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5a006b4d0 0x7ff5a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.061+0000 7ff5b97fa640 1 -- 172.21.15.55:0/555178762 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff5b40aaac0 con 0x7ff5bc15d450 2024-04-25T09:03:31.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.061+0000 7ff5c0d6a640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5a006b4d0 0x7ff5a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.061+0000 7ff5c0d6a640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5a006b4d0 0x7ff5a006d990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0001700 tx=0x7ff5b0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.065+0000 7ff5b97fa640 1 -- 172.21.15.55:0/555178762 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff5b404b030 con 0x7ff5bc15d450 2024-04-25T09:03:31.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.247+0000 7ff5c2fce640 1 -- 172.21.15.55:0/555178762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5bc072f40 con 0x7ff5bc15d450 2024-04-25T09:03:31.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.248+0000 7ff5b97fa640 1 -- 172.21.15.55:0/555178762 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5b4079c90 con 0x7ff5bc15d450 2024-04-25T09:03:31.236 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:03:31.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 -- 172.21.15.55:0/555178762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5a006b4d0 msgr2=0x7ff5a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5a006b4d0 0x7ff5a006d990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0001700 tx=0x7ff5b0009040 comp rx=0 tx=0).stop 2024-04-25T09:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 -- 172.21.15.55:0/555178762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5bc15d450 msgr2=0x7ff5bc1f7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5bc15d450 0x7ff5bc1f7120 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4034040 tx=0x7ff5b4004a40 comp rx=0 tx=0).stop 2024-04-25T09:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 -- 172.21.15.55:0/555178762 shutdown_connections 2024-04-25T09:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff5a006b4d0 0x7ff5a006d990 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5bc15d450 0x7ff5bc1f7120 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5bc0ce3a0 0x7ff5bc0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 --2- 172.21.15.55:0/555178762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc06aba0 0x7ff5bc09a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 -- 172.21.15.55:0/555178762 >> 172.21.15.55:0/555178762 conn(0x7ff5bc0d07d0 msgr2=0x7ff5bc06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 -- 172.21.15.55:0/555178762 shutdown_connections 2024-04-25T09:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.250+0000 7ff5c2fce640 1 -- 172.21.15.55:0/555178762 wait complete. 2024-04-25T09:03:31.250 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:03:31.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.362+0000 7f4867a1f640 1 Processor -- start 2024-04-25T09:03:31.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.362+0000 7f4867a1f640 1 -- start start 2024-04-25T09:03:31.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4867a1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48600cd320 0x7f48600cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4867a1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f48600cfe80 0x7f48600cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4867a1f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48600cd930 con 0x7f486015df40 2024-04-25T09:03:31.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4867a1f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600cdc10 con 0x7f48600cfe80 2024-04-25T09:03:31.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4867a1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600cdef0 con 0x7f48600cd320 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4865fbc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f48600cfe80 0x7f48600cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f48657bb640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f486015df40 0x7f48600b19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44342/0 (socket says 172.21.15.55:44342) 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f48657bb640 1 -- 172.21.15.55:0/2775331617 learned_addr learned my addr 172.21.15.55:0/2775331617 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4865fbc640 1 -- 172.21.15.55:0/2775331617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48600cd320 msgr2=0x7f48600cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4864fba640 1 --2- 172.21.15.55:0/2775331617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48600cd320 0x7f48600cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4857fff640 1 -- 172.21.15.55:0/2775331617 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651183552 0 0) 0x7f48600cd930 con 0x7f486015df40 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4865fbc640 1 --2- 172.21.15.55:0/2775331617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48600cd320 0x7f48600cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4865fbc640 1 -- 172.21.15.55:0/2775331617 >> v1:172.21.15.55:6789/0 conn(0x7f486015df40 legacy=0x7f48600b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4865fbc640 1 -- 172.21.15.55:0/2775331617 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600cada0 con 0x7f48600cfe80 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.363+0000 7f4864fba640 1 --2- 172.21.15.55:0/2775331617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48600cd320 0x7f48600cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.364+0000 7f4865fbc640 1 --2- 172.21.15.55:0/2775331617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48600cfe80 0x7f48600cb5a0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f4858009d90 tx=0x7f485802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f9b916efe856eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.364+0000 7f4857fff640 1 -- 172.21.15.55:0/2775331617 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858031600 con 0x7f48600cfe80 2024-04-25T09:03:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.364+0000 7f4857fff640 1 -- 172.21.15.55:0/2775331617 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48580317a0 con 0x7f48600cfe80 2024-04-25T09:03:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.364+0000 7f4857fff640 1 -- 172.21.15.55:0/2775331617 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858031b70 con 0x7f48600cfe80 2024-04-25T09:03:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.365+0000 7f4867a1f640 1 -- 172.21.15.55:0/2775331617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48600cfe80 msgr2=0x7f48600cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.365+0000 7f4867a1f640 1 --2- 172.21.15.55:0/2775331617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48600cfe80 0x7f48600cb5a0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f4858009d90 tx=0x7f485802a5d0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.365+0000 7f4867a1f640 1 -- 172.21.15.55:0/2775331617 shutdown_connections 2024-04-25T09:03:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.365+0000 7f4867a1f640 1 --2- 172.21.15.55:0/2775331617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48600cd320 0x7f48600cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.365+0000 7f4867a1f640 1 --2- 172.21.15.55:0/2775331617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48600cfe80 0x7f48600cb5a0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.365+0000 7f4867a1f640 1 -- 172.21.15.55:0/2775331617 >> 172.21.15.55:0/2775331617 conn(0x7f48600d06b0 msgr2=0x7f48600d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.365+0000 7f4867a1f640 1 -- 172.21.15.55:0/2775331617 shutdown_connections 2024-04-25T09:03:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.365+0000 7f4867a1f640 1 -- 172.21.15.55:0/2775331617 wait complete. 2024-04-25T09:03:31.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.366+0000 7f4867a1f640 1 Processor -- start 2024-04-25T09:03:31.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.366+0000 7f4867a1f640 1 -- start start 2024-04-25T09:03:31.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4867a1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48600cd320 0x7f48601f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4867a1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48600cfe80 0x7f48600c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4867a1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f486015df40 0x7f48600c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4867a1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600c4200 con 0x7f486015df40 2024-04-25T09:03:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4867a1f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600d0310 con 0x7f48600cfe80 2024-04-25T09:03:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4867a1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600c4380 con 0x7f48600cd320 2024-04-25T09:03:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4865fbc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f486015df40 0x7f48600c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4865fbc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f486015df40 0x7f48600c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58708/0 (socket says 172.21.15.55:58708) 2024-04-25T09:03:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4865fbc640 1 -- 172.21.15.55:0/3375119307 learned_addr learned my addr 172.21.15.55:0/3375119307 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4864fba640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48600cfe80 0x7f48600c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4865fbc640 1 -- 172.21.15.55:0/3375119307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48600cd320 msgr2=0x7f48601f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f48657bb640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48600cd320 0x7f48601f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4865fbc640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48600cd320 0x7f48601f2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4865fbc640 1 -- 172.21.15.55:0/3375119307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48600cfe80 msgr2=0x7f48600c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4865fbc640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48600cfe80 0x7f48600c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4865fbc640 1 -- 172.21.15.55:0/3375119307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600b32b0 con 0x7f486015df40 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4864fba640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48600cfe80 0x7f48600c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4865fbc640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f486015df40 0x7f48600c5af0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f4858009eb0 tx=0x7f4858004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.367+0000 7f4855ffb640 1 -- 172.21.15.55:0/3375119307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485803f070 con 0x7f486015df40 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.368+0000 7f4855ffb640 1 -- 172.21.15.55:0/3375119307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4858030b60 con 0x7f486015df40 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.368+0000 7f4867a1f640 1 -- 172.21.15.55:0/3375119307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48600c65d0 con 0x7f486015df40 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.368+0000 7f4855ffb640 1 -- 172.21.15.55:0/3375119307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858044460 con 0x7f486015df40 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.368+0000 7f4867a1f640 1 -- 172.21.15.55:0/3375119307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48600b3850 con 0x7f486015df40 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.369+0000 7f4867a1f640 1 -- 172.21.15.55:0/3375119307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48600749b0 con 0x7f486015df40 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.369+0000 7f4855ffb640 1 -- 172.21.15.55:0/3375119307 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f485803b410 con 0x7f486015df40 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.369+0000 7f4855ffb640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f484406b4d0 0x7f484406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.370+0000 7f4855ffb640 1 -- 172.21.15.55:0/3375119307 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f48580ab5d0 con 0x7f486015df40 2024-04-25T09:03:31.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.370+0000 7f48657bb640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f484406b4d0 0x7f484406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.370+0000 7f48657bb640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f484406b4d0 0x7f484406d990 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f485c007fd0 tx=0x7f485c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.374+0000 7f4855ffb640 1 -- 172.21.15.55:0/3375119307 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f485807a860 con 0x7f486015df40 2024-04-25T09:03:31.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.555+0000 7f4867a1f640 1 -- 172.21.15.55:0/3375119307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f486006d280 con 0x7f486015df40 2024-04-25T09:03:31.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.555+0000 7f4855ffb640 1 -- 172.21.15.55:0/3375119307 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v111) v1 ==== 84+0+65 (secure 0 0 0) 0x7f485807a160 con 0x7f486015df40 2024-04-25T09:03:31.544 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:31.544 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-25T09:03:31.544 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-25T09:03:31.544 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-25T09:03:31.544 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-25T09:03:31.544 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-25T09:03:31.544 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 -- 172.21.15.55:0/3375119307 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f484406b4d0 msgr2=0x7f484406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f484406b4d0 0x7f484406d990 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f485c007fd0 tx=0x7f485c009040 comp rx=0 tx=0).stop 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 -- 172.21.15.55:0/3375119307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f486015df40 msgr2=0x7f48600c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f486015df40 0x7f48600c5af0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f4858009eb0 tx=0x7f4858004a40 comp rx=0 tx=0).stop 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 -- 172.21.15.55:0/3375119307 shutdown_connections 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f484406b4d0 0x7f484406d990 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f486015df40 0x7f48600c5af0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48600cfe80 0x7f48600c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 --2- 172.21.15.55:0/3375119307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48600cd320 0x7f48601f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 -- 172.21.15.55:0/3375119307 >> 172.21.15.55:0/3375119307 conn(0x7f48600d06b0 msgr2=0x7f486015cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 -- 172.21.15.55:0/3375119307 shutdown_connections 2024-04-25T09:03:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.557+0000 7f4867a1f640 1 -- 172.21.15.55:0/3375119307 wait complete. 2024-04-25T09:03:31.556 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:03:31.557 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:03:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.674+0000 7f9d0d415640 1 Processor -- start 2024-04-25T09:03:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.674+0000 7f9d0d415640 1 -- start start 2024-04-25T09:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d0d415640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9d08161090 0x7f9d08161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d0d415640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d080b9720 0x7f9d080ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d0d415640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d08161f80 con 0x7f9d080cece0 2024-04-25T09:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d0d415640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d080cf130 con 0x7f9d08161090 2024-04-25T09:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d0d415640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080d21a0 con 0x7f9d080b9720 2024-04-25T09:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d06ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9d08161090 0x7f9d08161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d06ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9d08161090 0x7f9d08161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58720/0 (socket says 172.21.15.55:58720) 2024-04-25T09:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d06ffd640 1 -- 172.21.15.55:0/2378496169 learned_addr learned my addr 172.21.15.55:0/2378496169 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d06ffd640 1 -- 172.21.15.55:0/2378496169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d080b9720 msgr2=0x7f9d080ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d06ffd640 1 --2- 172.21.15.55:0/2378496169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d080b9720 0x7f9d080ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d06ffd640 1 -- 172.21.15.55:0/2378496169 >> v1:172.21.15.167:6789/0 conn(0x7f9d080cece0 legacy=0x7f9d0806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.675+0000 7f9d06ffd640 1 -- 172.21.15.55:0/2378496169 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d08162260 con 0x7f9d08161090 2024-04-25T09:03:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.676+0000 7f9d06ffd640 1 --2- 172.21.15.55:0/2378496169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d08161090 0x7f9d08161730 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009870 tx=0x7f9cf802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32602d1446df3c66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.676+0000 7f9d067fc640 1 -- 172.21.15.55:0/2378496169 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8037070 con 0x7f9d08161090 2024-04-25T09:03:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.676+0000 7f9d067fc640 1 -- 172.21.15.55:0/2378496169 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8032440 con 0x7f9d08161090 2024-04-25T09:03:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.676+0000 7f9d067fc640 1 -- 172.21.15.55:0/2378496169 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8032810 con 0x7f9d08161090 2024-04-25T09:03:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.677+0000 7f9d0d415640 1 -- 172.21.15.55:0/2378496169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d08161090 msgr2=0x7f9d08161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.677+0000 7f9d0d415640 1 --2- 172.21.15.55:0/2378496169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d08161090 0x7f9d08161730 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009870 tx=0x7f9cf802a210 comp rx=0 tx=0).stop 2024-04-25T09:03:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.677+0000 7f9d0d415640 1 -- 172.21.15.55:0/2378496169 shutdown_connections 2024-04-25T09:03:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.677+0000 7f9d0d415640 1 --2- 172.21.15.55:0/2378496169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d080b9720 0x7f9d080ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.677+0000 7f9d0d415640 1 --2- 172.21.15.55:0/2378496169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d08161090 0x7f9d08161730 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.677+0000 7f9d0d415640 1 -- 172.21.15.55:0/2378496169 >> 172.21.15.55:0/2378496169 conn(0x7f9d080b55e0 msgr2=0x7f9d080b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.677+0000 7f9d0d415640 1 -- 172.21.15.55:0/2378496169 shutdown_connections 2024-04-25T09:03:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.677+0000 7f9d0d415640 1 -- 172.21.15.55:0/2378496169 wait complete. 2024-04-25T09:03:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.678+0000 7f9d0d415640 1 Processor -- start 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.678+0000 7f9d0d415640 1 -- start start 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d0d415640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d080b9720 0x7f9d080c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d0d415640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d080cece0 0x7f9d0814f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d0d415640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d08161090 0x7f9d0815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d0d415640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08161470 con 0x7f9d08161090 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d0d415640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080d1e30 con 0x7f9d080cece0 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d0d415640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08161c70 con 0x7f9d080b9720 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d08161090 0x7f9d0815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d08161090 0x7f9d0815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58736/0 (socket says 172.21.15.55:58736) 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d077fe640 1 -- 172.21.15.55:0/3303737579 learned_addr learned my addr 172.21.15.55:0/3303737579 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d06ffd640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d080b9720 0x7f9d080c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9cfffff640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d080cece0 0x7f9d0814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d077fe640 1 -- 172.21.15.55:0/3303737579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d080b9720 msgr2=0x7f9d080c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d077fe640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d080b9720 0x7f9d080c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d077fe640 1 -- 172.21.15.55:0/3303737579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d080cece0 msgr2=0x7f9d0814f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d077fe640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d080cece0 0x7f9d0814f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d077fe640 1 -- 172.21.15.55:0/3303737579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d080c8140 con 0x7f9d08161090 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9d06ffd640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d080b9720 0x7f9d080c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.679+0000 7f9cfffff640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d080cece0 0x7f9d0814f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.680+0000 7f9d077fe640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d08161090 0x7f9d0815a4c0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000c780 tx=0x7f9d0000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.680+0000 7f9cff7fe640 1 -- 172.21.15.55:0/3303737579 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d00017070 con 0x7f9d08161090 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.680+0000 7f9cff7fe640 1 -- 172.21.15.55:0/3303737579 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d00003da0 con 0x7f9d08161090 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.680+0000 7f9cff7fe640 1 -- 172.21.15.55:0/3303737579 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d000052b0 con 0x7f9d08161090 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.680+0000 7f9d0d415640 1 -- 172.21.15.55:0/3303737579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d080c8420 con 0x7f9d08161090 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.680+0000 7f9d0d415640 1 -- 172.21.15.55:0/3303737579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d080c89e0 con 0x7f9d08161090 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.681+0000 7f9d0d415640 1 -- 172.21.15.55:0/3303737579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d080750b0 con 0x7f9d08161090 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.681+0000 7f9cff7fe640 1 -- 172.21.15.55:0/3303737579 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d0001a070 con 0x7f9d08161090 2024-04-25T09:03:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.682+0000 7f9cff7fe640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ce806b4d0 0x7f9ce806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.682+0000 7f9cff7fe640 1 -- 172.21.15.55:0/3303737579 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9d00089530 con 0x7f9d08161090 2024-04-25T09:03:31.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.682+0000 7f9d06ffd640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ce806b4d0 0x7f9ce806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.682+0000 7f9d06ffd640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ce806b4d0 0x7f9ce806d990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8034000 tx=0x7f9cf802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.686+0000 7f9cff7fe640 1 -- 172.21.15.55:0/3303737579 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d00058700 con 0x7f9d08161090 2024-04-25T09:03:31.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:31.868+0000 7f9d0d415640 1 -- 172.21.15.55:0/3303737579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9d080d1700 con 0x7f9d08161090 2024-04-25T09:03:32.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.247+0000 7f9cff7fe640 1 -- 172.21.15.55:0/3303737579 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v112) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9d00058000 con 0x7f9d08161090 2024-04-25T09:03:32.236 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-25T09:03:32.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.249+0000 7f9d0d415640 1 -- 172.21.15.55:0/3303737579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ce806b4d0 msgr2=0x7f9ce806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.249+0000 7f9d0d415640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ce806b4d0 0x7f9ce806d990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8034000 tx=0x7f9cf802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:32.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.249+0000 7f9d0d415640 1 -- 172.21.15.55:0/3303737579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d08161090 msgr2=0x7f9d0815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.249+0000 7f9d0d415640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d08161090 0x7f9d0815a4c0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000c780 tx=0x7f9d0000cc40 comp rx=0 tx=0).stop 2024-04-25T09:03:32.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.249+0000 7f9d0d415640 1 -- 172.21.15.55:0/3303737579 shutdown_connections 2024-04-25T09:03:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.249+0000 7f9d0d415640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ce806b4d0 0x7f9ce806d990 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.249+0000 7f9d0d415640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d08161090 0x7f9d0815a4c0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.249+0000 7f9d0d415640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d080cece0 0x7f9d0814f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.249+0000 7f9d0d415640 1 --2- 172.21.15.55:0/3303737579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d080b9720 0x7f9d080c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.250+0000 7f9d0d415640 1 -- 172.21.15.55:0/3303737579 >> 172.21.15.55:0/3303737579 conn(0x7f9d080b55e0 msgr2=0x7f9d080b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.250+0000 7f9d0d415640 1 -- 172.21.15.55:0/3303737579 shutdown_connections 2024-04-25T09:03:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.250+0000 7f9d0d415640 1 -- 172.21.15.55:0/3303737579 wait complete. 2024-04-25T09:03:32.254 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:03:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.376+0000 7f965895c640 1 Processor -- start 2024-04-25T09:03:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.376+0000 7f965895c640 1 -- start start 2024-04-25T09:03:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f965895c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f965415dd90 0x7f96540d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f965895c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96540d1a30 0x7f96540b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f965895c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96540d2410 con 0x7f96540d03e0 2024-04-25T09:03:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f965895c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96540d26f0 con 0x7f96540d1a30 2024-04-25T09:03:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f965895c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96540d29d0 con 0x7f965415dd90 2024-04-25T09:03:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f9652d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96540d1a30 0x7f96540b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f9652d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96540d1a30 0x7f96540b69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58748/0 (socket says 172.21.15.55:58748) 2024-04-25T09:03:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f9652d9d640 1 -- 172.21.15.55:0/2641975323 learned_addr learned my addr 172.21.15.55:0/2641975323 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f965259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f96540d03e0 0x7f96540d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44358/0 (socket says 172.21.15.55:44358) 2024-04-25T09:03:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f964bfff640 1 --2- 172.21.15.55:0/2641975323 >> v2:172.21.15.167:3300/0 conn(0x7f965415dd90 0x7f96540d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f9652d9d640 1 -- 172.21.15.55:0/2641975323 >> v2:172.21.15.167:3300/0 conn(0x7f965415dd90 msgr2=0x7f96540d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f9652d9d640 1 --2- 172.21.15.55:0/2641975323 >> v2:172.21.15.167:3300/0 conn(0x7f965415dd90 0x7f96540d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f9652d9d640 1 -- 172.21.15.55:0/2641975323 >> v1:172.21.15.55:6789/0 conn(0x7f96540d03e0 legacy=0x7f96540d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f9652d9d640 1 -- 172.21.15.55:0/2641975323 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540d2cb0 con 0x7f96540d1a30 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.377+0000 7f9651d9b640 1 -- 172.21.15.55:0/2641975323 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839233338 0 0) 0x7f96540d2410 con 0x7f96540d03e0 2024-04-25T09:03:32.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.378+0000 7f9652d9d640 1 --2- 172.21.15.55:0/2641975323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540d1a30 0x7f96540b69d0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f965406cfd0 tx=0x7f964c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700b6be6bb85df4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.378+0000 7f9651d9b640 1 -- 172.21.15.55:0/2641975323 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c036070 con 0x7f96540d1a30 2024-04-25T09:03:32.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.378+0000 7f9651d9b640 1 -- 172.21.15.55:0/2641975323 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c031600 con 0x7f96540d1a30 2024-04-25T09:03:32.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.378+0000 7f9651d9b640 1 -- 172.21.15.55:0/2641975323 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0319f0 con 0x7f96540d1a30 2024-04-25T09:03:32.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.379+0000 7f965895c640 1 -- 172.21.15.55:0/2641975323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540d1a30 msgr2=0x7f96540b69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.379+0000 7f965895c640 1 --2- 172.21.15.55:0/2641975323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540d1a30 0x7f96540b69d0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f965406cfd0 tx=0x7f964c02a7c0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.379+0000 7f965895c640 1 -- 172.21.15.55:0/2641975323 shutdown_connections 2024-04-25T09:03:32.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.379+0000 7f965895c640 1 --2- 172.21.15.55:0/2641975323 >> v2:172.21.15.167:3300/0 conn(0x7f965415dd90 0x7f96540d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.379+0000 7f965895c640 1 --2- 172.21.15.55:0/2641975323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540d1a30 0x7f96540b69d0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.379+0000 7f965895c640 1 -- 172.21.15.55:0/2641975323 >> 172.21.15.55:0/2641975323 conn(0x7f9654072900 msgr2=0x7f965406c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.379+0000 7f965895c640 1 -- 172.21.15.55:0/2641975323 shutdown_connections 2024-04-25T09:03:32.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.379+0000 7f965895c640 1 -- 172.21.15.55:0/2641975323 wait complete. 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.380+0000 7f965895c640 1 Processor -- start 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.380+0000 7f965895c640 1 -- start start 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f965895c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96540d03e0 0x7f96540c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f965895c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540d1a30 0x7f965414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f965895c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f965415dd90 0x7f96540b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f965895c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96540b99a0 con 0x7f96540d1a30 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f965895c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96540b9820 con 0x7f96540d03e0 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f965895c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96540d1ec0 con 0x7f965415dd90 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f964bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540d1a30 0x7f965414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f964bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540d1a30 0x7f965414eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58750/0 (socket says 172.21.15.55:58750) 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f964bfff640 1 -- 172.21.15.55:0/1836277708 learned_addr learned my addr 172.21.15.55:0/1836277708 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f9652d9d640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f965415dd90 0x7f96540b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f965259c640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96540d03e0 0x7f96540c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f964bfff640 1 -- 172.21.15.55:0/1836277708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f965415dd90 msgr2=0x7f96540b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f964bfff640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f965415dd90 0x7f96540b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f964bfff640 1 -- 172.21.15.55:0/1836277708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96540d03e0 msgr2=0x7f96540c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f964bfff640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96540d03e0 0x7f96540c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f964bfff640 1 -- 172.21.15.55:0/1836277708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96541f4550 con 0x7f96540d1a30 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f9652d9d640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f965415dd90 0x7f96540b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f964bfff640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540d1a30 0x7f965414eed0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f963c00d7d0 tx=0x7f963c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.381+0000 7f964affd640 1 -- 172.21.15.55:0/1836277708 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c018020 con 0x7f96540d1a30 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.382+0000 7f964affd640 1 -- 172.21.15.55:0/1836277708 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c0096c0 con 0x7f96540d1a30 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.382+0000 7f965895c640 1 -- 172.21.15.55:0/1836277708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96540c8700 con 0x7f96540d1a30 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.382+0000 7f964affd640 1 -- 172.21.15.55:0/1836277708 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c009ab0 con 0x7f96540d1a30 2024-04-25T09:03:32.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.382+0000 7f965895c640 1 -- 172.21.15.55:0/1836277708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96540c8420 con 0x7f96540d1a30 2024-04-25T09:03:32.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.383+0000 7f965895c640 1 -- 172.21.15.55:0/1836277708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96540749b0 con 0x7f96540d1a30 2024-04-25T09:03:32.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.383+0000 7f964affd640 1 -- 172.21.15.55:0/1836277708 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f963c01b020 con 0x7f96540d1a30 2024-04-25T09:03:32.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.384+0000 7f964affd640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f963406b4d0 0x7f963406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.384+0000 7f964affd640 1 -- 172.21.15.55:0/1836277708 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f963c08a6a0 con 0x7f96540d1a30 2024-04-25T09:03:32.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.384+0000 7f965259c640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f963406b4d0 0x7f963406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.384+0000 7f965259c640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f963406b4d0 0x7f963406d990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9644000f60 tx=0x7f9644007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.388+0000 7f964affd640 1 -- 172.21.15.55:0/1836277708 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f963c022020 con 0x7f96540d1a30 2024-04-25T09:03:32.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:32.571+0000 7f965895c640 1 -- 172.21.15.55:0/1836277708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f965415d390 con 0x7f96540d1a30 2024-04-25T09:03:33.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.254+0000 7f964affd640 1 -- 172.21.15.55:0/1836277708 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v113) v1 ==== 170+0+0 (secure 0 0 0) 0x7f963c059680 con 0x7f96540d1a30 2024-04-25T09:03:33.243 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-25T09:03:33.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.257+0000 7f965895c640 1 -- 172.21.15.55:0/1836277708 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f963406b4d0 msgr2=0x7f963406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.257+0000 7f965895c640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f963406b4d0 0x7f963406d990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9644000f60 tx=0x7f9644007d50 comp rx=0 tx=0).stop 2024-04-25T09:03:33.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.257+0000 7f965895c640 1 -- 172.21.15.55:0/1836277708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540d1a30 msgr2=0x7f965414eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.257+0000 7f965895c640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540d1a30 0x7f965414eed0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f963c00d7d0 tx=0x7f963c00dc90 comp rx=0 tx=0).stop 2024-04-25T09:03:33.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.258+0000 7f965895c640 1 -- 172.21.15.55:0/1836277708 shutdown_connections 2024-04-25T09:03:33.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.258+0000 7f965895c640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f963406b4d0 0x7f963406d990 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.258+0000 7f965895c640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f965415dd90 0x7f96540b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.258+0000 7f965895c640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540d1a30 0x7f965414eed0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.258+0000 7f965895c640 1 --2- 172.21.15.55:0/1836277708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96540d03e0 0x7f96540c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.260+0000 7f965895c640 1 -- 172.21.15.55:0/1836277708 >> 172.21.15.55:0/1836277708 conn(0x7f9654072900 msgr2=0x7f96540ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.260+0000 7f965895c640 1 -- 172.21.15.55:0/1836277708 shutdown_connections 2024-04-25T09:03:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.260+0000 7f965895c640 1 -- 172.21.15.55:0/1836277708 wait complete. 2024-04-25T09:03:33.275 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:03:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.395+0000 7f1d2db53640 1 Processor -- start 2024-04-25T09:03:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.395+0000 7f1d2db53640 1 -- start start 2024-04-25T09:03:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d2db53640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d2815bdb0 0x7f1d2809a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d2db53640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d280cf830 0x7f1d280cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d2db53640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2809ae30 con 0x7f1d2809a990 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d2db53640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2809b110 con 0x7f1d2815bdb0 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d2db53640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280c5bd0 con 0x7f1d280cf830 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d277fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d2815bdb0 0x7f1d2809a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d277fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d2815bdb0 0x7f1d2809a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58762/0 (socket says 172.21.15.55:58762) 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d277fe640 1 -- 172.21.15.55:0/2184339412 learned_addr learned my addr 172.21.15.55:0/2184339412 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d26ffd640 1 --2- 172.21.15.55:0/2184339412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d280cf830 0x7f1d280cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d277fe640 1 -- 172.21.15.55:0/2184339412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d280cf830 msgr2=0x7f1d280cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d277fe640 1 --2- 172.21.15.55:0/2184339412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d280cf830 0x7f1d280cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d277fe640 1 -- 172.21.15.55:0/2184339412 >> v1:172.21.15.167:6789/0 conn(0x7f1d2809a990 legacy=0x7f1d280cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.396+0000 7f1d277fe640 1 -- 172.21.15.55:0/2184339412 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d280c5580 con 0x7f1d2815bdb0 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.397+0000 7f1d277fe640 1 --2- 172.21.15.55:0/2184339412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2815bdb0 0x7f1d2809a450 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009870 tx=0x7f1d1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d80b26dc29a06a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.397+0000 7f1d267fc640 1 -- 172.21.15.55:0/2184339412 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18037070 con 0x7f1d2815bdb0 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.397+0000 7f1d267fc640 1 -- 172.21.15.55:0/2184339412 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d18032440 con 0x7f1d2815bdb0 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.397+0000 7f1d267fc640 1 -- 172.21.15.55:0/2184339412 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18032810 con 0x7f1d2815bdb0 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.397+0000 7f1d2db53640 1 -- 172.21.15.55:0/2184339412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2815bdb0 msgr2=0x7f1d2809a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.397+0000 7f1d2db53640 1 --2- 172.21.15.55:0/2184339412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2815bdb0 0x7f1d2809a450 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009870 tx=0x7f1d1802a270 comp rx=0 tx=0).stop 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.398+0000 7f1d2db53640 1 -- 172.21.15.55:0/2184339412 shutdown_connections 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.398+0000 7f1d2db53640 1 --2- 172.21.15.55:0/2184339412 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d280cf830 0x7f1d280cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.398+0000 7f1d2db53640 1 --2- 172.21.15.55:0/2184339412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2815bdb0 0x7f1d2809a450 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.398+0000 7f1d2db53640 1 -- 172.21.15.55:0/2184339412 >> 172.21.15.55:0/2184339412 conn(0x7f1d280b33f0 msgr2=0x7f1d280b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.398+0000 7f1d2db53640 1 -- 172.21.15.55:0/2184339412 shutdown_connections 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.398+0000 7f1d2db53640 1 -- 172.21.15.55:0/2184339412 wait complete. 2024-04-25T09:03:33.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.399+0000 7f1d2db53640 1 Processor -- start 2024-04-25T09:03:33.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.399+0000 7f1d2db53640 1 -- start start 2024-04-25T09:03:33.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d2db53640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d2809a990 0x7f1d28156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d2db53640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d280cf830 0x7f1d280b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d2db53640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d2815bdb0 0x7f1d28155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d2db53640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280c8070 con 0x7f1d280cf830 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d2db53640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2815c190 con 0x7f1d2815bdb0 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d2db53640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280c81f0 con 0x7f1d2809a990 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d26ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d280cf830 0x7f1d280b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d26ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d280cf830 0x7f1d280b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58770/0 (socket says 172.21.15.55:58770) 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d26ffd640 1 -- 172.21.15.55:0/1452469434 learned_addr learned my addr 172.21.15.55:0/1452469434 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d277fe640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d2809a990 0x7f1d28156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d27fff640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d2815bdb0 0x7f1d28155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d26ffd640 1 -- 172.21.15.55:0/1452469434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d2809a990 msgr2=0x7f1d28156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d26ffd640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d2809a990 0x7f1d28156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d26ffd640 1 -- 172.21.15.55:0/1452469434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d2815bdb0 msgr2=0x7f1d28155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d26ffd640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d2815bdb0 0x7f1d28155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d26ffd640 1 -- 172.21.15.55:0/1452469434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d280b6560 con 0x7f1d280cf830 2024-04-25T09:03:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.400+0000 7f1d26ffd640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d280cf830 0x7f1d280b6ea0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00e870 tx=0x7f1d1c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.401+0000 7f1d0ffff640 1 -- 172.21.15.55:0/1452469434 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c017070 con 0x7f1d280cf830 2024-04-25T09:03:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.401+0000 7f1d0ffff640 1 -- 172.21.15.55:0/1452469434 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c00c940 con 0x7f1d280cf830 2024-04-25T09:03:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.401+0000 7f1d2db53640 1 -- 172.21.15.55:0/1452469434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2815ea20 con 0x7f1d280cf830 2024-04-25T09:03:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.401+0000 7f1d0ffff640 1 -- 172.21.15.55:0/1452469434 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c00cd30 con 0x7f1d280cf830 2024-04-25T09:03:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.401+0000 7f1d2db53640 1 -- 172.21.15.55:0/1452469434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d280c9b50 con 0x7f1d280cf830 2024-04-25T09:03:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.401+0000 7f1d2db53640 1 -- 172.21.15.55:0/1452469434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d280750b0 con 0x7f1d280cf830 2024-04-25T09:03:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.402+0000 7f1d0ffff640 1 -- 172.21.15.55:0/1452469434 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d1c01a070 con 0x7f1d280cf830 2024-04-25T09:03:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.403+0000 7f1d0ffff640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d1406b500 0x7f1d1406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.403+0000 7f1d0ffff640 1 -- 172.21.15.55:0/1452469434 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f1d1c089f50 con 0x7f1d280cf830 2024-04-25T09:03:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.403+0000 7f1d277fe640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d1406b500 0x7f1d1406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.403+0000 7f1d277fe640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d1406b500 0x7f1d1406d9c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1d18034000 tx=0x7f1d1802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.407+0000 7f1d0ffff640 1 -- 172.21.15.55:0/1452469434 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1d1c0587f0 con 0x7f1d280cf830 2024-04-25T09:03:33.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:33.626+0000 7f1d2db53640 1 -- 172.21.15.55:0/1452469434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1d280cdfd0 con 0x7f1d280cf830 2024-04-25T09:03:34.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.256+0000 7f1d0ffff640 1 -- 172.21.15.55:0/1452469434 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v84) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1d1c05c890 con 0x7f1d280cf830 2024-04-25T09:03:34.245 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 16 and data pool 17 2024-04-25T09:03:34.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.262+0000 7f1d2db53640 1 -- 172.21.15.55:0/1452469434 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d1406b500 msgr2=0x7f1d1406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.262+0000 7f1d2db53640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d1406b500 0x7f1d1406d9c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1d18034000 tx=0x7f1d1802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:34.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.263+0000 7f1d2db53640 1 -- 172.21.15.55:0/1452469434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d280cf830 msgr2=0x7f1d280b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.263+0000 7f1d2db53640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d280cf830 0x7f1d280b6ea0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00e870 tx=0x7f1d1c00ed30 comp rx=0 tx=0).stop 2024-04-25T09:03:34.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.263+0000 7f1d2db53640 1 -- 172.21.15.55:0/1452469434 shutdown_connections 2024-04-25T09:03:34.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.263+0000 7f1d2db53640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d1406b500 0x7f1d1406d9c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.263+0000 7f1d2db53640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d2815bdb0 0x7f1d28155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.263+0000 7f1d2db53640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d280cf830 0x7f1d280b6ea0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.263+0000 7f1d2db53640 1 --2- 172.21.15.55:0/1452469434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d2809a990 0x7f1d28156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.263+0000 7f1d2db53640 1 -- 172.21.15.55:0/1452469434 >> 172.21.15.55:0/1452469434 conn(0x7f1d280b33f0 msgr2=0x7f1d28070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.264+0000 7f1d2db53640 1 -- 172.21.15.55:0/1452469434 shutdown_connections 2024-04-25T09:03:34.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.264+0000 7f1d2db53640 1 -- 172.21.15.55:0/1452469434 wait complete. 2024-04-25T09:03:34.292 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:34.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f529e116640 1 Processor -- start 2024-04-25T09:03:34.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f529e116640 1 -- start start 2024-04-25T09:03:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f529e116640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529815dce0 0x7f52980d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f529e116640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52980d35b0 0x7f52980b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f529e116640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529815e0c0 con 0x7f52980d1f90 2024-04-25T09:03:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f529e116640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52980b7b10 con 0x7f52980d35b0 2024-04-25T09:03:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f529e116640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52980d2510 con 0x7f529815dce0 2024-04-25T09:03:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f52977fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529815dce0 0x7f52980d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f5296ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52980d35b0 0x7f52980b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f52977fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529815dce0 0x7f52980d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:55266/0 (socket says 172.21.15.55:55266) 2024-04-25T09:03:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f52977fe640 1 -- 172.21.15.55:0/2832553064 learned_addr learned my addr 172.21.15.55:0/2832553064 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.409+0000 7f52967fc640 1 -- 172.21.15.55:0/2832553064 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400076175 0 0) 0x7f529815e0c0 con 0x7f52980d1f90 2024-04-25T09:03:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.410+0000 7f52967fc640 1 -- 172.21.15.55:0/2832553064 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5280003520 con 0x7f52980d1f90 2024-04-25T09:03:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.410+0000 7f52977fe640 1 -- 172.21.15.55:0/2832553064 >> v2:172.21.15.167:3300/0 conn(0x7f52980d35b0 msgr2=0x7f52980b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:34.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.410+0000 7f52977fe640 1 --2- 172.21.15.55:0/2832553064 >> v2:172.21.15.167:3300/0 conn(0x7f52980d35b0 0x7f52980b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.410+0000 7f52977fe640 1 -- 172.21.15.55:0/2832553064 >> v1:172.21.15.167:6789/0 conn(0x7f52980d1f90 legacy=0x7f529806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.410+0000 7f52977fe640 1 -- 172.21.15.55:0/2832553064 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980d27f0 con 0x7f529815dce0 2024-04-25T09:03:34.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.410+0000 7f5296ffd640 1 --2- 172.21.15.55:0/2832553064 >> v2:172.21.15.167:3300/0 conn(0x7f52980d35b0 0x7f52980b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.410+0000 7f52977fe640 1 --2- 172.21.15.55:0/2832553064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529815dce0 0x7f52980d1a50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5288009870 tx=0x7f528802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3b82fc393b294bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.411+0000 7f52967fc640 1 -- 172.21.15.55:0/2832553064 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288037070 con 0x7f529815dce0 2024-04-25T09:03:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.411+0000 7f52967fc640 1 -- 172.21.15.55:0/2832553064 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5288032440 con 0x7f529815dce0 2024-04-25T09:03:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.411+0000 7f52967fc640 1 -- 172.21.15.55:0/2832553064 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288032810 con 0x7f529815dce0 2024-04-25T09:03:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.411+0000 7f529e116640 1 -- 172.21.15.55:0/2832553064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529815dce0 msgr2=0x7f52980d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.411+0000 7f529e116640 1 --2- 172.21.15.55:0/2832553064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529815dce0 0x7f52980d1a50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5288009870 tx=0x7f528802a1c0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.411+0000 7f529e116640 1 -- 172.21.15.55:0/2832553064 shutdown_connections 2024-04-25T09:03:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.411+0000 7f529e116640 1 --2- 172.21.15.55:0/2832553064 >> v2:172.21.15.167:3300/0 conn(0x7f52980d35b0 0x7f52980b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.411+0000 7f529e116640 1 --2- 172.21.15.55:0/2832553064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f529815dce0 0x7f52980d1a50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.411+0000 7f529e116640 1 -- 172.21.15.55:0/2832553064 >> 172.21.15.55:0/2832553064 conn(0x7f5298072900 msgr2=0x7f52980d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.411+0000 7f529e116640 1 -- 172.21.15.55:0/2832553064 shutdown_connections 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.411+0000 7f529e116640 1 -- 172.21.15.55:0/2832553064 wait complete. 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.412+0000 7f529e116640 1 Processor -- start 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f529e116640 1 -- start start 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f529e116640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52980d1f90 0x7f529815e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f529e116640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52980d35b0 0x7f52980c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f529e116640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529815dce0 0x7f52980c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f529e116640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52980d3090 con 0x7f529815dce0 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f529e116640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52980d2db0 con 0x7f52980d35b0 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f529e116640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52980b9820 con 0x7f52980d1f90 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f5297fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529815dce0 0x7f52980c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f5297fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529815dce0 0x7f52980c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58778/0 (socket says 172.21.15.55:58778) 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f5297fff640 1 -- 172.21.15.55:0/52863838 learned_addr learned my addr 172.21.15.55:0/52863838 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f52977fe640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52980d1f90 0x7f529815e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.413+0000 7f5296ffd640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52980d35b0 0x7f52980c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.414+0000 7f5297fff640 1 -- 172.21.15.55:0/52863838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52980d1f90 msgr2=0x7f529815e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.414+0000 7f5297fff640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52980d1f90 0x7f529815e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.414+0000 7f5297fff640 1 -- 172.21.15.55:0/52863838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52980d35b0 msgr2=0x7f52980c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.414+0000 7f5297fff640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52980d35b0 0x7f52980c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.414+0000 7f5297fff640 1 -- 172.21.15.55:0/52863838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980cb9d0 con 0x7f529815dce0 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.414+0000 7f5297fff640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529815dce0 0x7f52980c9a60 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f529000c6e0 tx=0x7f529000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.414+0000 7f527ffff640 1 -- 172.21.15.55:0/52863838 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290003b70 con 0x7f529815dce0 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.414+0000 7f527ffff640 1 -- 172.21.15.55:0/52863838 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5290003d10 con 0x7f529815dce0 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.414+0000 7f529e116640 1 -- 172.21.15.55:0/52863838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52980cbc70 con 0x7f529815dce0 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.414+0000 7f527ffff640 1 -- 172.21.15.55:0/52863838 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900052d0 con 0x7f529815dce0 2024-04-25T09:03:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.414+0000 7f529e116640 1 -- 172.21.15.55:0/52863838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52980cc230 con 0x7f529815dce0 2024-04-25T09:03:34.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.415+0000 7f529e116640 1 -- 172.21.15.55:0/52863838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52980749b0 con 0x7f529815dce0 2024-04-25T09:03:34.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.416+0000 7f527ffff640 1 -- 172.21.15.55:0/52863838 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5290005470 con 0x7f529815dce0 2024-04-25T09:03:34.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.416+0000 7f527ffff640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f528406b4d0 0x7f528406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.416+0000 7f527ffff640 1 -- 172.21.15.55:0/52863838 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f529008a050 con 0x7f529815dce0 2024-04-25T09:03:34.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.416+0000 7f52977fe640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f528406b4d0 0x7f528406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.417+0000 7f52977fe640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f528406b4d0 0x7f528406d990 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5288034000 tx=0x7f528802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.421+0000 7f527ffff640 1 -- 172.21.15.55:0/52863838 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52900587f0 con 0x7f529815dce0 2024-04-25T09:03:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.601+0000 7f529e116640 1 -- 172.21.15.55:0/52863838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f529815d360 con 0x7f529815dce0 2024-04-25T09:03:34.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.602+0000 7f527ffff640 1 -- 172.21.15.55:0/52863838 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+16640 (secure 0 0 0) 0x7f529005c890 con 0x7f529815dce0 2024-04-25T09:03:34.591 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:34.591 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":114,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:33.628674+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:31.900630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:32.603273+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.604+0000 7f529e116640 1 -- 172.21.15.55:0/52863838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f528406b4d0 msgr2=0x7f528406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.604+0000 7f529e116640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f528406b4d0 0x7f528406d990 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5288034000 tx=0x7f528802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.604+0000 7f529e116640 1 -- 172.21.15.55:0/52863838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529815dce0 msgr2=0x7f52980c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.604+0000 7f529e116640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529815dce0 0x7f52980c9a60 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f529000c6e0 tx=0x7f529000cba0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.604+0000 7f529e116640 1 -- 172.21.15.55:0/52863838 shutdown_connections 2024-04-25T09:03:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.604+0000 7f529e116640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f528406b4d0 0x7f528406d990 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.604+0000 7f529e116640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529815dce0 0x7f52980c9a60 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.604+0000 7f529e116640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52980d35b0 0x7f52980c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.604+0000 7f529e116640 1 --2- 172.21.15.55:0/52863838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52980d1f90 0x7f529815e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.604+0000 7f529e116640 1 -- 172.21.15.55:0/52863838 >> 172.21.15.55:0/52863838 conn(0x7f5298072900 msgr2=0x7f52980d39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.604+0000 7f529e116640 1 -- 172.21.15.55:0/52863838 shutdown_connections 2024-04-25T09:03:34.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.605+0000 7f529e116640 1 -- 172.21.15.55:0/52863838 wait complete. 2024-04-25T09:03:34.605 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:34.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.718+0000 7f19a60cb640 1 Processor -- start 2024-04-25T09:03:34.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.718+0000 7f19a60cb640 1 -- start start 2024-04-25T09:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f19a60cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19a006c2d0 0x7f19a006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f19a60cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19a00acd80 0x7f19a00ad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f19a60cb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a006dc70 con 0x7f19a006bef0 2024-04-25T09:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f19a60cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a006eb20 con 0x7f19a006c2d0 2024-04-25T09:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f19a60cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a006df10 con 0x7f19a00acd80 2024-04-25T09:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f199effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19a006c2d0 0x7f19a006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f199effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19a006c2d0 0x7f19a006efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58782/0 (socket says 172.21.15.55:58782) 2024-04-25T09:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f199effd640 1 -- 172.21.15.55:0/424662318 learned_addr learned my addr 172.21.15.55:0/424662318 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:34.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f199ffff640 1 --2- 172.21.15.55:0/424662318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19a00acd80 0x7f19a00ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f199effd640 1 -- 172.21.15.55:0/424662318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19a00acd80 msgr2=0x7f19a00ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:34.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f199effd640 1 --2- 172.21.15.55:0/424662318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19a00acd80 0x7f19a00ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f199effd640 1 -- 172.21.15.55:0/424662318 >> v1:172.21.15.167:6789/0 conn(0x7f19a006bef0 legacy=0x7f19a015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f199effd640 1 -- 172.21.15.55:0/424662318 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a006e1f0 con 0x7f19a006c2d0 2024-04-25T09:03:34.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.719+0000 7f199ffff640 1 --2- 172.21.15.55:0/424662318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19a00acd80 0x7f19a00ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.720+0000 7f199effd640 1 --2- 172.21.15.55:0/424662318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a006c2d0 0x7f19a006efb0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f19a006eca0 tx=0x7f199402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec5e701ca6d8d0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.720+0000 7f199e7fc640 1 -- 172.21.15.55:0/424662318 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994037070 con 0x7f19a006c2d0 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.720+0000 7f199e7fc640 1 -- 172.21.15.55:0/424662318 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1994032440 con 0x7f19a006c2d0 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.720+0000 7f199e7fc640 1 -- 172.21.15.55:0/424662318 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994032810 con 0x7f19a006c2d0 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.721+0000 7f19a60cb640 1 -- 172.21.15.55:0/424662318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a006c2d0 msgr2=0x7f19a006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.721+0000 7f19a60cb640 1 --2- 172.21.15.55:0/424662318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a006c2d0 0x7f19a006efb0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f19a006eca0 tx=0x7f199402a250 comp rx=0 tx=0).stop 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.721+0000 7f19a60cb640 1 -- 172.21.15.55:0/424662318 shutdown_connections 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.721+0000 7f19a60cb640 1 --2- 172.21.15.55:0/424662318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19a00acd80 0x7f19a00ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.721+0000 7f19a60cb640 1 --2- 172.21.15.55:0/424662318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a006c2d0 0x7f19a006efb0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.721+0000 7f19a60cb640 1 -- 172.21.15.55:0/424662318 >> 172.21.15.55:0/424662318 conn(0x7f19a00b2220 msgr2=0x7f19a00cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.721+0000 7f19a60cb640 1 -- 172.21.15.55:0/424662318 shutdown_connections 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.721+0000 7f19a60cb640 1 -- 172.21.15.55:0/424662318 wait complete. 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.722+0000 7f19a60cb640 1 Processor -- start 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.722+0000 7f19a60cb640 1 -- start start 2024-04-25T09:03:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f19a60cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19a006bef0 0x7f19a0140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f19a60cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a006c2d0 0x7f19a014ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f19a60cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19a00acd80 0x7f19a01f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f19a60cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00ada00 con 0x7f19a006c2d0 2024-04-25T09:03:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f19a60cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a006e7b0 con 0x7f19a006bef0 2024-04-25T09:03:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f19a60cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00adb80 con 0x7f19a00acd80 2024-04-25T09:03:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f199effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a006c2d0 0x7f19a014ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f199effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a006c2d0 0x7f19a014ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58798/0 (socket says 172.21.15.55:58798) 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f199effd640 1 -- 172.21.15.55:0/708824047 learned_addr learned my addr 172.21.15.55:0/708824047 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f199f7fe640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19a006bef0 0x7f19a0140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f199ffff640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19a00acd80 0x7f19a01f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f199effd640 1 -- 172.21.15.55:0/708824047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19a00acd80 msgr2=0x7f19a01f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f199effd640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19a00acd80 0x7f19a01f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f199effd640 1 -- 172.21.15.55:0/708824047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19a006bef0 msgr2=0x7f19a0140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f199effd640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19a006bef0 0x7f19a0140850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.723+0000 7f199effd640 1 -- 172.21.15.55:0/708824047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a014e010 con 0x7f19a006c2d0 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.724+0000 7f199effd640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a006c2d0 0x7f19a014ec30 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f199402a290 tx=0x7f19940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.724+0000 7f1987fff640 1 -- 172.21.15.55:0/708824047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994041020 con 0x7f19a006c2d0 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.724+0000 7f1987fff640 1 -- 172.21.15.55:0/708824047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19940306c0 con 0x7f19a006c2d0 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.724+0000 7f19a60cb640 1 -- 172.21.15.55:0/708824047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a009b970 con 0x7f19a006c2d0 2024-04-25T09:03:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.724+0000 7f1987fff640 1 -- 172.21.15.55:0/708824047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994037040 con 0x7f19a006c2d0 2024-04-25T09:03:34.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.724+0000 7f19a60cb640 1 -- 172.21.15.55:0/708824047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a009bef0 con 0x7f19a006c2d0 2024-04-25T09:03:34.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.725+0000 7f19a60cb640 1 -- 172.21.15.55:0/708824047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a00749b0 con 0x7f19a006c2d0 2024-04-25T09:03:34.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.725+0000 7f1987fff640 1 -- 172.21.15.55:0/708824047 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1994044020 con 0x7f19a006c2d0 2024-04-25T09:03:34.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.726+0000 7f1987fff640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f198c06b4d0 0x7f198c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.726+0000 7f1987fff640 1 -- 172.21.15.55:0/708824047 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19940aa940 con 0x7f19a006c2d0 2024-04-25T09:03:34.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.726+0000 7f199f7fe640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f198c06b4d0 0x7f198c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.726+0000 7f199f7fe640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f198c06b4d0 0x7f198c06d990 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1990001780 tx=0x7f1990009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.730+0000 7f1987fff640 1 -- 172.21.15.55:0/708824047 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f199404b030 con 0x7f19a006c2d0 2024-04-25T09:03:34.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.912+0000 7f19a60cb640 1 -- 172.21.15.55:0/708824047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19a00d0b70 con 0x7f19a006c2d0 2024-04-25T09:03:34.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.913+0000 7f1987fff640 1 -- 172.21.15.55:0/708824047 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+16640 (secure 0 0 0) 0x7f19a014e010 con 0x7f19a006c2d0 2024-04-25T09:03:34.902 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:34.903 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":114,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:33.628674+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:31.900630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:32.603273+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:34.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.915+0000 7f19a60cb640 1 -- 172.21.15.55:0/708824047 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f198c06b4d0 msgr2=0x7f198c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.915+0000 7f19a60cb640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f198c06b4d0 0x7f198c06d990 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1990001780 tx=0x7f1990009040 comp rx=0 tx=0).stop 2024-04-25T09:03:34.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.915+0000 7f19a60cb640 1 -- 172.21.15.55:0/708824047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a006c2d0 msgr2=0x7f19a014ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.915+0000 7f19a60cb640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a006c2d0 0x7f19a014ec30 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f199402a290 tx=0x7f19940046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.916+0000 7f19a60cb640 1 -- 172.21.15.55:0/708824047 shutdown_connections 2024-04-25T09:03:34.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.916+0000 7f19a60cb640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f198c06b4d0 0x7f198c06d990 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.916+0000 7f19a60cb640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19a00acd80 0x7f19a01f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.916+0000 7f19a60cb640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a006c2d0 0x7f19a014ec30 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.916+0000 7f19a60cb640 1 --2- 172.21.15.55:0/708824047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19a006bef0 0x7f19a0140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.916+0000 7f19a60cb640 1 -- 172.21.15.55:0/708824047 >> 172.21.15.55:0/708824047 conn(0x7f19a00b2220 msgr2=0x7f19a01544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.916+0000 7f19a60cb640 1 -- 172.21.15.55:0/708824047 shutdown_connections 2024-04-25T09:03:34.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:34.916+0000 7f19a60cb640 1 -- 172.21.15.55:0/708824047 wait complete. 2024-04-25T09:03:34.915 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:03:35.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.031+0000 7f9008e5d640 1 Processor -- start 2024-04-25T09:03:35.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.031+0000 7f9008e5d640 1 -- start start 2024-04-25T09:03:35.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.032+0000 7f9008e5d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90040b42c0 0x7f900415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.032+0000 7f9008e5d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900415b370 con 0x7f900415aef0 2024-04-25T09:03:35.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.032+0000 7f9008e5d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900415b650 con 0x7f90040b46a0 2024-04-25T09:03:35.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.032+0000 7f9008e5d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90040d05d0 con 0x7f90040b42c0 2024-04-25T09:03:35.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.032+0000 7f900259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90040b42c0 0x7f900415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.032+0000 7f8ff9d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f900415aef0 0x7f90040cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44360/0 (socket says 172.21.15.55:44360) 2024-04-25T09:03:35.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.032+0000 7f8ff9d9b640 1 -- 172.21.15.55:0/537129727 learned_addr learned my addr 172.21.15.55:0/537129727 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:35.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.032+0000 7f900259c640 1 -- 172.21.15.55:0/537129727 >> v1:172.21.15.167:6789/0 conn(0x7f90040b46a0 legacy=0x7f90041549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:35.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.032+0000 7f900259c640 1 -- 172.21.15.55:0/537129727 >> v1:172.21.15.55:6789/0 conn(0x7f900415aef0 legacy=0x7f90040cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.032+0000 7f900259c640 1 -- 172.21.15.55:0/537129727 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900415b930 con 0x7f90040b42c0 2024-04-25T09:03:35.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.032+0000 7f9001d9b640 1 -- 172.21.15.55:0/537129727 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394042773 0 0) 0x7f900415b370 con 0x7f900415aef0 2024-04-25T09:03:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.033+0000 7f900259c640 1 --2- 172.21.15.55:0/537129727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90040b42c0 0x7f900415ef40 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40097a0 tx=0x7f8ff402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb995e9455f44e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.033+0000 7f9001d9b640 1 -- 172.21.15.55:0/537129727 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4037070 con 0x7f90040b42c0 2024-04-25T09:03:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.033+0000 7f9001d9b640 1 -- 172.21.15.55:0/537129727 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff402adc0 con 0x7f90040b42c0 2024-04-25T09:03:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.033+0000 7f9001d9b640 1 -- 172.21.15.55:0/537129727 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4032660 con 0x7f90040b42c0 2024-04-25T09:03:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.033+0000 7f9008e5d640 1 -- 172.21.15.55:0/537129727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90040b42c0 msgr2=0x7f900415ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.033+0000 7f9008e5d640 1 --2- 172.21.15.55:0/537129727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90040b42c0 0x7f900415ef40 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40097a0 tx=0x7f8ff402a0b0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.033+0000 7f9008e5d640 1 -- 172.21.15.55:0/537129727 shutdown_connections 2024-04-25T09:03:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.033+0000 7f9008e5d640 1 --2- 172.21.15.55:0/537129727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90040b42c0 0x7f900415ef40 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.033+0000 7f9008e5d640 1 -- 172.21.15.55:0/537129727 >> 172.21.15.55:0/537129727 conn(0x7f900406aba0 msgr2=0x7f900406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.034+0000 7f9008e5d640 1 -- 172.21.15.55:0/537129727 shutdown_connections 2024-04-25T09:03:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.034+0000 7f9008e5d640 1 -- 172.21.15.55:0/537129727 wait complete. 2024-04-25T09:03:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.035+0000 7f9008e5d640 1 Processor -- start 2024-04-25T09:03:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.035+0000 7f9008e5d640 1 -- start start 2024-04-25T09:03:35.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f9008e5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90040b42c0 0x7f90041e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f9008e5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90040b46a0 0x7f90041568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f9008e5d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f900415aef0 0x7f9004155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f9008e5d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900406ec60 con 0x7f90040b46a0 2024-04-25T09:03:35.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f9008e5d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900406eae0 con 0x7f900415aef0 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f9008e5d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90041550e0 con 0x7f90040b42c0 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f8ff9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90040b46a0 0x7f90041568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f8ff9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90040b46a0 0x7f90041568d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58810/0 (socket says 172.21.15.55:58810) 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f8ff9d9b640 1 -- 172.21.15.55:0/1546635271 learned_addr learned my addr 172.21.15.55:0/1546635271 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f9002d9d640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f900415aef0 0x7f9004155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f900259c640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90040b42c0 0x7f90041e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f8ff9d9b640 1 -- 172.21.15.55:0/1546635271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90040b42c0 msgr2=0x7f90041e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f8ff9d9b640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90040b42c0 0x7f90041e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f8ff9d9b640 1 -- 172.21.15.55:0/1546635271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f900415aef0 msgr2=0x7f9004155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f8ff9d9b640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f900415aef0 0x7f9004155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f8ff9d9b640 1 -- 172.21.15.55:0/1546635271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90041e5fc0 con 0x7f90040b46a0 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.036+0000 7f8ff9d9b640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90040b46a0 0x7f90041568d0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c410 tx=0x7f8fec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.037+0000 7f8ffb7fe640 1 -- 172.21.15.55:0/1546635271 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0074e0 con 0x7f90040b46a0 2024-04-25T09:03:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.037+0000 7f9008e5d640 1 -- 172.21.15.55:0/1546635271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90041e62a0 con 0x7f90040b46a0 2024-04-25T09:03:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.037+0000 7f8ffb7fe640 1 -- 172.21.15.55:0/1546635271 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec0047e0 con 0x7f90040b46a0 2024-04-25T09:03:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.037+0000 7f8ffb7fe640 1 -- 172.21.15.55:0/1546635271 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec004bd0 con 0x7f90040b46a0 2024-04-25T09:03:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.037+0000 7f9008e5d640 1 -- 172.21.15.55:0/1546635271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90041e6860 con 0x7f90040b46a0 2024-04-25T09:03:35.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.038+0000 7f9008e5d640 1 -- 172.21.15.55:0/1546635271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90040ca070 con 0x7f90040b46a0 2024-04-25T09:03:35.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.038+0000 7f8ffb7fe640 1 -- 172.21.15.55:0/1546635271 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8fec011070 con 0x7f90040b46a0 2024-04-25T09:03:35.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.039+0000 7f8ffb7fe640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fe406b4d0 0x7f8fe406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.039+0000 7f8ffb7fe640 1 -- 172.21.15.55:0/1546635271 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fec089e50 con 0x7f90040b46a0 2024-04-25T09:03:35.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.039+0000 7f900259c640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fe406b4d0 0x7f8fe406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.039+0000 7f900259c640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fe406b4d0 0x7f8fe406d990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4034000 tx=0x7f8ff402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.043+0000 7f8ffb7fe640 1 -- 172.21.15.55:0/1546635271 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f90040ca070 con 0x7f90040b46a0 2024-04-25T09:03:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.261+0000 7f9008e5d640 1 -- 172.21.15.55:0/1546635271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f90040750b0 con 0x7f90040b46a0 2024-04-25T09:03:35.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.269+0000 7f8ffb7fe640 1 -- 172.21.15.55:0/1546635271 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8fec058560 con 0x7f90040b46a0 2024-04-25T09:03:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 -- 172.21.15.55:0/1546635271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fe406b4d0 msgr2=0x7f8fe406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fe406b4d0 0x7f8fe406d990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4034000 tx=0x7f8ff402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 -- 172.21.15.55:0/1546635271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90040b46a0 msgr2=0x7f90041568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90040b46a0 0x7f90041568d0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c410 tx=0x7f8fec00c8d0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 -- 172.21.15.55:0/1546635271 shutdown_connections 2024-04-25T09:03:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8fe406b4d0 0x7f8fe406d990 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f900415aef0 0x7f9004155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90040b46a0 0x7f90041568d0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 --2- 172.21.15.55:0/1546635271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90040b42c0 0x7f90041e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 -- 172.21.15.55:0/1546635271 >> 172.21.15.55:0/1546635271 conn(0x7f900406aba0 msgr2=0x7f900415c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 -- 172.21.15.55:0/1546635271 shutdown_connections 2024-04-25T09:03:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.271+0000 7f9008e5d640 1 -- 172.21.15.55:0/1546635271 wait complete. 2024-04-25T09:03:35.272 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:03:35.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:03:35.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.388+0000 7f0c5c989640 1 Processor -- start 2024-04-25T09:03:35.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.388+0000 7f0c5c989640 1 -- start start 2024-04-25T09:03:35.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.388+0000 7f0c5c989640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c5815dca0 0x7f0c580ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.388+0000 7f0c5c989640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c580d1130 0x7f0c580b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.388+0000 7f0c5c989640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c580d4090 con 0x7f0c580d3b90 2024-04-25T09:03:35.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.389+0000 7f0c5c989640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c580b6b20 con 0x7f0c580d1130 2024-04-25T09:03:35.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.389+0000 7f0c5c989640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580d4370 con 0x7f0c5815dca0 2024-04-25T09:03:35.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.389+0000 7f0c56d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c580d1130 0x7f0c580b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.389+0000 7f0c56d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c580d1130 0x7f0c580b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58812/0 (socket says 172.21.15.55:58812) 2024-04-25T09:03:35.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.389+0000 7f0c56d9d640 1 -- 172.21.15.55:0/1336431962 learned_addr learned my addr 172.21.15.55:0/1336431962 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:35.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.389+0000 7f0c55d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0c580d3b90 0x7f0c580d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44364/0 (socket says 172.21.15.55:44364) 2024-04-25T09:03:35.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.389+0000 7f0c56d9d640 1 -- 172.21.15.55:0/1336431962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c5815dca0 msgr2=0x7f0c580ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:35.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.389+0000 7f0c56d9d640 1 --2- 172.21.15.55:0/1336431962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c5815dca0 0x7f0c580ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.389+0000 7f0c56d9d640 1 -- 172.21.15.55:0/1336431962 >> v1:172.21.15.55:6789/0 conn(0x7f0c580d3b90 legacy=0x7f0c580d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.389+0000 7f0c5559a640 1 -- 172.21.15.55:0/1336431962 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106860708 0 0) 0x7f0c580d4090 con 0x7f0c580d3b90 2024-04-25T09:03:35.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.389+0000 7f0c56d9d640 1 -- 172.21.15.55:0/1336431962 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580d4650 con 0x7f0c580d1130 2024-04-25T09:03:35.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.390+0000 7f0c56d9d640 1 --2- 172.21.15.55:0/1336431962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c580d1130 0x7f0c580b2500 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009e50 tx=0x7f0c4802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e4084bf22a517b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.390+0000 7f0c5559a640 1 -- 172.21.15.55:0/1336431962 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48036070 con 0x7f0c580d1130 2024-04-25T09:03:35.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.390+0000 7f0c5559a640 1 -- 172.21.15.55:0/1336431962 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c48031600 con 0x7f0c580d1130 2024-04-25T09:03:35.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.390+0000 7f0c5559a640 1 -- 172.21.15.55:0/1336431962 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480319d0 con 0x7f0c580d1130 2024-04-25T09:03:35.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.390+0000 7f0c5c989640 1 -- 172.21.15.55:0/1336431962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c580d1130 msgr2=0x7f0c580b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.390+0000 7f0c5c989640 1 --2- 172.21.15.55:0/1336431962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c580d1130 0x7f0c580b2500 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009e50 tx=0x7f0c4802a710 comp rx=0 tx=0).stop 2024-04-25T09:03:35.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.391+0000 7f0c5c989640 1 -- 172.21.15.55:0/1336431962 shutdown_connections 2024-04-25T09:03:35.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.391+0000 7f0c5c989640 1 --2- 172.21.15.55:0/1336431962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c580d1130 0x7f0c580b2500 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.391+0000 7f0c5c989640 1 --2- 172.21.15.55:0/1336431962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c5815dca0 0x7f0c580ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.391+0000 7f0c5c989640 1 -- 172.21.15.55:0/1336431962 >> 172.21.15.55:0/1336431962 conn(0x7f0c580726c0 msgr2=0x7f0c58072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.391+0000 7f0c5c989640 1 -- 172.21.15.55:0/1336431962 shutdown_connections 2024-04-25T09:03:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.391+0000 7f0c5c989640 1 -- 172.21.15.55:0/1336431962 wait complete. 2024-04-25T09:03:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.392+0000 7f0c5c989640 1 Processor -- start 2024-04-25T09:03:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.392+0000 7f0c5c989640 1 -- start start 2024-04-25T09:03:35.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c5c989640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c580d1130 0x7f0c581441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c5c989640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c580d3b90 0x7f0c58159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c5c989640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c5815dca0 0x7f0c58159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c5c989640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5815e200 con 0x7f0c5815dca0 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c5c989640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5815e080 con 0x7f0c580d3b90 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c5c989640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580cee80 con 0x7f0c580d1130 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c56d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c5815dca0 0x7f0c58159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c56d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c5815dca0 0x7f0c58159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58822/0 (socket says 172.21.15.55:58822) 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c56d9d640 1 -- 172.21.15.55:0/4234696957 learned_addr learned my addr 172.21.15.55:0/4234696957 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c5659c640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c580d1130 0x7f0c581441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c55d9b640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c580d3b90 0x7f0c58159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c56d9d640 1 -- 172.21.15.55:0/4234696957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c580d1130 msgr2=0x7f0c581441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c56d9d640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c580d1130 0x7f0c581441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c56d9d640 1 -- 172.21.15.55:0/4234696957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c580d3b90 msgr2=0x7f0c58159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c56d9d640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c580d3b90 0x7f0c58159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c56d9d640 1 -- 172.21.15.55:0/4234696957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580cbce0 con 0x7f0c5815dca0 2024-04-25T09:03:35.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c55d9b640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c580d3b90 0x7f0c58159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:35.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c56d9d640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c5815dca0 0x7f0c58159ac0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f0c48034040 tx=0x7f0c48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c4effd640 1 -- 172.21.15.55:0/4234696957 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48041020 con 0x7f0c5815dca0 2024-04-25T09:03:35.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c4effd640 1 -- 172.21.15.55:0/4234696957 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c48007780 con 0x7f0c5815dca0 2024-04-25T09:03:35.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c5c989640 1 -- 172.21.15.55:0/4234696957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c580cbfc0 con 0x7f0c5815dca0 2024-04-25T09:03:35.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c4effd640 1 -- 172.21.15.55:0/4234696957 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48036040 con 0x7f0c5815dca0 2024-04-25T09:03:35.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.393+0000 7f0c5c989640 1 -- 172.21.15.55:0/4234696957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c580cc580 con 0x7f0c5815dca0 2024-04-25T09:03:35.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.394+0000 7f0c5c989640 1 -- 172.21.15.55:0/4234696957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c580750b0 con 0x7f0c5815dca0 2024-04-25T09:03:35.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.395+0000 7f0c4effd640 1 -- 172.21.15.55:0/4234696957 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0c48044020 con 0x7f0c5815dca0 2024-04-25T09:03:35.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.395+0000 7f0c4effd640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0c3806b4d0 0x7f0c3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.395+0000 7f0c4effd640 1 -- 172.21.15.55:0/4234696957 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c480aaec0 con 0x7f0c5815dca0 2024-04-25T09:03:35.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.395+0000 7f0c5659c640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0c3806b4d0 0x7f0c3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.396+0000 7f0c5659c640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0c3806b4d0 0x7f0c3806d990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0c500098e0 tx=0x7f0c50009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.399+0000 7f0c4effd640 1 -- 172.21.15.55:0/4234696957 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0c4804b030 con 0x7f0c5815dca0 2024-04-25T09:03:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:35.620+0000 7f0c5c989640 1 -- 172.21.15.55:0/4234696957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0c5815d0e0 con 0x7f0c5815dca0 2024-04-25T09:03:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.281+0000 7f0c4effd640 1 -- 172.21.15.55:0/4234696957 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0c48079e90 con 0x7f0c5815dca0 2024-04-25T09:03:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 -- 172.21.15.55:0/4234696957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0c3806b4d0 msgr2=0x7f0c3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0c3806b4d0 0x7f0c3806d990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0c500098e0 tx=0x7f0c50009060 comp rx=0 tx=0).stop 2024-04-25T09:03:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 -- 172.21.15.55:0/4234696957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c5815dca0 msgr2=0x7f0c58159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c5815dca0 0x7f0c58159ac0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f0c48034040 tx=0x7f0c48004a40 comp rx=0 tx=0).stop 2024-04-25T09:03:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 -- 172.21.15.55:0/4234696957 shutdown_connections 2024-04-25T09:03:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0c3806b4d0 0x7f0c3806d990 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c5815dca0 0x7f0c58159ac0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c580d3b90 0x7f0c58159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 --2- 172.21.15.55:0/4234696957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c580d1130 0x7f0c581441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 -- 172.21.15.55:0/4234696957 >> 172.21.15.55:0/4234696957 conn(0x7f0c580726c0 msgr2=0x7f0c580d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 -- 172.21.15.55:0/4234696957 shutdown_connections 2024-04-25T09:03:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.283+0000 7f0c5c989640 1 -- 172.21.15.55:0/4234696957 wait complete. 2024-04-25T09:03:36.286 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:03:36.286 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:36.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.405+0000 7f03dc922640 1 Processor -- start 2024-04-25T09:03:36.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.405+0000 7f03dc922640 1 -- start start 2024-04-25T09:03:36.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.406+0000 7f03dc922640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03d815a730 0x7f03d80ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.406+0000 7f03dc922640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03d80cebc0 0x7f03d80b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.406+0000 7f03dc922640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d80cc020 con 0x7f03d80b4020 2024-04-25T09:03:36.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.406+0000 7f03dc922640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d80b49d0 con 0x7f03d815a730 2024-04-25T09:03:36.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.406+0000 7f03dc922640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80b32b0 con 0x7f03d80cebc0 2024-04-25T09:03:36.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.406+0000 7f03d659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03d815a730 0x7f03d80ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.406+0000 7f03d5d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f03d80b4020 0x7f03d806d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44366/0 (socket says 172.21.15.55:44366) 2024-04-25T09:03:36.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.406+0000 7f03d5d9b640 1 -- 172.21.15.55:0/1421620584 learned_addr learned my addr 172.21.15.55:0/1421620584 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:36.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.407+0000 7f03d6d9d640 1 --2- 172.21.15.55:0/1421620584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03d80cebc0 0x7f03d80b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.407+0000 7f03d659c640 1 -- 172.21.15.55:0/1421620584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03d80cebc0 msgr2=0x7f03d80b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.407+0000 7f03d659c640 1 --2- 172.21.15.55:0/1421620584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03d80cebc0 0x7f03d80b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.407+0000 7f03d659c640 1 -- 172.21.15.55:0/1421620584 >> v1:172.21.15.55:6789/0 conn(0x7f03d80b4020 legacy=0x7f03d806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.407+0000 7f03d559a640 1 -- 172.21.15.55:0/1421620584 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269160739 0 0) 0x7f03d80cc020 con 0x7f03d80b4020 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.407+0000 7f03d659c640 1 -- 172.21.15.55:0/1421620584 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d80b3590 con 0x7f03d815a730 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.407+0000 7f03d659c640 1 --2- 172.21.15.55:0/1421620584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03d815a730 0x7f03d80ae9b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f03d00097a0 tx=0x7f03d002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c814f5010f71b303 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.407+0000 7f03d559a640 1 -- 172.21.15.55:0/1421620584 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0037070 con 0x7f03d815a730 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.408+0000 7f03d559a640 1 -- 172.21.15.55:0/1421620584 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d0032440 con 0x7f03d815a730 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.408+0000 7f03d559a640 1 -- 172.21.15.55:0/1421620584 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0032810 con 0x7f03d815a730 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.408+0000 7f03dc922640 1 -- 172.21.15.55:0/1421620584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03d815a730 msgr2=0x7f03d80ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.408+0000 7f03dc922640 1 --2- 172.21.15.55:0/1421620584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03d815a730 0x7f03d80ae9b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f03d00097a0 tx=0x7f03d002a180 comp rx=0 tx=0).stop 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.408+0000 7f03dc922640 1 -- 172.21.15.55:0/1421620584 shutdown_connections 2024-04-25T09:03:36.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.408+0000 7f03dc922640 1 --2- 172.21.15.55:0/1421620584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03d80cebc0 0x7f03d80b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.408+0000 7f03dc922640 1 --2- 172.21.15.55:0/1421620584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03d815a730 0x7f03d80ae9b0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.408+0000 7f03dc922640 1 -- 172.21.15.55:0/1421620584 >> 172.21.15.55:0/1421620584 conn(0x7f03d806aba0 msgr2=0x7f03d806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.408+0000 7f03dc922640 1 -- 172.21.15.55:0/1421620584 shutdown_connections 2024-04-25T09:03:36.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.408+0000 7f03dc922640 1 -- 172.21.15.55:0/1421620584 wait complete. 2024-04-25T09:03:36.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03dc922640 1 Processor -- start 2024-04-25T09:03:36.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03dc922640 1 -- start start 2024-04-25T09:03:36.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03dc922640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03d80b4020 0x7f03d8146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03dc922640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03d80cebc0 0x7f03d80b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03dc922640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03d815a730 0x7f03d80b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03dc922640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80cd620 con 0x7f03d815a730 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03dc922640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80b3b50 con 0x7f03d80cebc0 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03dc922640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80aeef0 con 0x7f03d80b4020 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03d6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03d815a730 0x7f03d80b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03d6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03d815a730 0x7f03d80b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58850/0 (socket says 172.21.15.55:58850) 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03d6d9d640 1 -- 172.21.15.55:0/3557963751 learned_addr learned my addr 172.21.15.55:0/3557963751 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.410+0000 7f03d659c640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03d80b4020 0x7f03d8146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03d5d9b640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03d80cebc0 0x7f03d80b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03d6d9d640 1 -- 172.21.15.55:0/3557963751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03d80b4020 msgr2=0x7f03d8146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03d6d9d640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03d80b4020 0x7f03d8146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03d6d9d640 1 -- 172.21.15.55:0/3557963751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03d80cebc0 msgr2=0x7f03d80b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03d6d9d640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03d80cebc0 0x7f03d80b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03d6d9d640 1 -- 172.21.15.55:0/3557963751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d81f3580 con 0x7f03d815a730 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03d6d9d640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03d815a730 0x7f03d80b06e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f03c8007e70 tx=0x7f03c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03c6ffd640 1 -- 172.21.15.55:0/3557963751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c8014620 con 0x7f03d815a730 2024-04-25T09:03:36.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03c6ffd640 1 -- 172.21.15.55:0/3557963751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c8019070 con 0x7f03d815a730 2024-04-25T09:03:36.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03c6ffd640 1 -- 172.21.15.55:0/3557963751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c8014a20 con 0x7f03d815a730 2024-04-25T09:03:36.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03dc922640 1 -- 172.21.15.55:0/3557963751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d81f3860 con 0x7f03d815a730 2024-04-25T09:03:36.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.411+0000 7f03dc922640 1 -- 172.21.15.55:0/3557963751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d81f3230 con 0x7f03d815a730 2024-04-25T09:03:36.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.412+0000 7f03dc922640 1 -- 172.21.15.55:0/3557963751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d80749b0 con 0x7f03d815a730 2024-04-25T09:03:36.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.413+0000 7f03c6ffd640 1 -- 172.21.15.55:0/3557963751 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f03c8014bc0 con 0x7f03d815a730 2024-04-25T09:03:36.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.413+0000 7f03c6ffd640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03b806b4d0 0x7f03b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.413+0000 7f03c6ffd640 1 -- 172.21.15.55:0/3557963751 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03c808a9c0 con 0x7f03d815a730 2024-04-25T09:03:36.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.413+0000 7f03d659c640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03b806b4d0 0x7f03b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.414+0000 7f03d659c640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03b806b4d0 0x7f03b806d990 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f03d0034000 tx=0x7f03d002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.417+0000 7f03c6ffd640 1 -- 172.21.15.55:0/3557963751 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f03c808ce20 con 0x7f03d815a730 2024-04-25T09:03:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.636+0000 7f03dc922640 1 -- 172.21.15.55:0/3557963751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03d806c170 con 0x7f03d815a730 2024-04-25T09:03:36.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.637+0000 7f03c6ffd640 1 -- 172.21.15.55:0/3557963751 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f03c805f070 con 0x7f03d815a730 2024-04-25T09:03:36.626 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:36.626 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":86,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:03:35.622068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8922},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8922":{"gid":8922,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/4257598582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":4257598582},{"type":"v1","addr":"172.21.15.55:6837","nonce":4257598582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:03:36.627 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 86 2024-04-25T09:03:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 -- 172.21.15.55:0/3557963751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03b806b4d0 msgr2=0x7f03b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03b806b4d0 0x7f03b806d990 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f03d0034000 tx=0x7f03d002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 -- 172.21.15.55:0/3557963751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03d815a730 msgr2=0x7f03d80b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03d815a730 0x7f03d80b06e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f03c8007e70 tx=0x7f03c800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 -- 172.21.15.55:0/3557963751 shutdown_connections 2024-04-25T09:03:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f03b806b4d0 0x7f03b806d990 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03d815a730 0x7f03d80b06e0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03d80cebc0 0x7f03d80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 --2- 172.21.15.55:0/3557963751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03d80b4020 0x7f03d8146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 -- 172.21.15.55:0/3557963751 >> 172.21.15.55:0/3557963751 conn(0x7f03d806aba0 msgr2=0x7f03d8150110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 -- 172.21.15.55:0/3557963751 shutdown_connections 2024-04-25T09:03:36.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.639+0000 7f03dc922640 1 -- 172.21.15.55:0/3557963751 wait complete. 2024-04-25T09:03:36.639 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:36.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.751+0000 7fdcc981f640 1 Processor -- start 2024-04-25T09:03:36.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.751+0000 7fdcc981f640 1 -- start start 2024-04-25T09:03:36.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.752+0000 7fdcc981f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdcc40b9460 0x7fdcc40ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.752+0000 7fdcc981f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc40d2440 con 0x7fdcc40d34e0 2024-04-25T09:03:36.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.752+0000 7fdcc981f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc40d2720 con 0x7fdcc415dd50 2024-04-25T09:03:36.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.752+0000 7fdcc981f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc40d2a00 con 0x7fdcc40b9460 2024-04-25T09:03:36.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.752+0000 7fdcc37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdcc40d34e0 0x7fdcc40b6c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44378/0 (socket says 172.21.15.55:44378) 2024-04-25T09:03:36.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.752+0000 7fdcc37fe640 1 -- 172.21.15.55:0/2200456985 learned_addr learned my addr 172.21.15.55:0/2200456985 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:36.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc27fc640 1 --2- 172.21.15.55:0/2200456985 >> v2:172.21.15.167:3300/0 conn(0x7fdcc40b9460 0x7fdcc40ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183422368 0 0) 0x7fdcc40d2440 con 0x7fdcc40d34e0 2024-04-25T09:03:36.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb0003520 con 0x7fdcc40d34e0 2024-04-25T09:03:36.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4146466796 0 0) 0x7fdcb0003520 con 0x7fdcc40d34e0 2024-04-25T09:03:36.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 >> v2:172.21.15.167:3300/0 conn(0x7fdcc40b9460 msgr2=0x7fdcc40ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 --2- 172.21.15.55:0/2200456985 >> v2:172.21.15.167:3300/0 conn(0x7fdcc40b9460 0x7fdcc40ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 >> v1:172.21.15.167:6789/0 conn(0x7fdcc415dd50 legacy=0x7fdcc40d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40d2ce0 con 0x7fdcc40d34e0 2024-04-25T09:03:36.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fdcb40019f0 con 0x7fdcc40d34e0 2024-04-25T09:03:36.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 >> v1:172.21.15.55:6789/0 conn(0x7fdcc40d34e0 legacy=0x7fdcc40b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 --2- 172.21.15.55:0/2200456985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb00039b0 0x7fdcb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 --2- 172.21.15.55:0/2200456985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb0004800 0x7fdcb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 --2- 172.21.15.55:0/2200456985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb00051c0 0x7fdcb000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40d2a00 con 0x7fdcb00051c0 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb000c160 con 0x7fdcb0004800 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb000c360 con 0x7fdcb00039b0 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc37fe640 1 --2- 172.21.15.55:0/2200456985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb00051c0 0x7fdcb000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc27fc640 1 --2- 172.21.15.55:0/2200456985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb0004800 0x7fdcb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.753+0000 7fdcc2ffd640 1 --2- 172.21.15.55:0/2200456985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb00039b0 0x7fdcb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.754+0000 7fdcc37fe640 1 -- 172.21.15.55:0/2200456985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb00039b0 msgr2=0x7fdcb0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.754+0000 7fdcc37fe640 1 --2- 172.21.15.55:0/2200456985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb00039b0 0x7fdcb0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.754+0000 7fdcc37fe640 1 -- 172.21.15.55:0/2200456985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb0004800 msgr2=0x7fdcb0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.754+0000 7fdcc37fe640 1 --2- 172.21.15.55:0/2200456985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb0004800 0x7fdcb0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.754+0000 7fdcc37fe640 1 -- 172.21.15.55:0/2200456985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0003520 con 0x7fdcb00051c0 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.754+0000 7fdcc37fe640 1 -- 172.21.15.55:0/2200456985 reap_dead start 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.754+0000 7fdcc37fe640 1 --2- 172.21.15.55:0/2200456985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb00051c0 0x7fdcb000b9c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400a860 tx=0x7fdcb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e22dcb38d0bb87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.754+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400a480 con 0x7fdcb00051c0 2024-04-25T09:03:36.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.754+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb402f070 con 0x7fdcb00051c0 2024-04-25T09:03:36.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.754+0000 7fdcc1ffb640 1 -- 172.21.15.55:0/2200456985 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb402bcc0 con 0x7fdcb00051c0 2024-04-25T09:03:36.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.755+0000 7fdcc981f640 1 -- 172.21.15.55:0/2200456985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb00051c0 msgr2=0x7fdcb000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.755+0000 7fdcc981f640 1 --2- 172.21.15.55:0/2200456985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb00051c0 0x7fdcb000b9c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400a860 tx=0x7fdcb0005830 comp rx=0 tx=0).stop 2024-04-25T09:03:36.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.755+0000 7fdcc981f640 1 -- 172.21.15.55:0/2200456985 shutdown_connections 2024-04-25T09:03:36.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.755+0000 7fdcc981f640 1 --2- 172.21.15.55:0/2200456985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb00051c0 0x7fdcb000b9c0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.755+0000 7fdcc981f640 1 -- 172.21.15.55:0/2200456985 >> 172.21.15.55:0/2200456985 conn(0x7fdcc40722d0 msgr2=0x7fdcc40726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.755+0000 7fdcc981f640 1 -- 172.21.15.55:0/2200456985 shutdown_connections 2024-04-25T09:03:36.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.755+0000 7fdcc981f640 1 -- 172.21.15.55:0/2200456985 wait complete. 2024-04-25T09:03:36.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.756+0000 7fdcc981f640 1 Processor -- start 2024-04-25T09:03:36.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.756+0000 7fdcc981f640 1 -- start start 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.757+0000 7fdcc981f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb00051c0 0x7fdcc414aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.757+0000 7fdcc981f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc40b4280 0x7fdcc40b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.757+0000 7fdcc981f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc40cae70 0x7fdcc40cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.757+0000 7fdcc981f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40d1d90 con 0x7fdcc40cae70 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.757+0000 7fdcc981f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40d1c10 con 0x7fdcb00051c0 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.757+0000 7fdcc981f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40d1f10 con 0x7fdcc40b4280 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.757+0000 7fdcc37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc40cae70 0x7fdcc40cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.757+0000 7fdcc37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc40cae70 0x7fdcc40cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58856/0 (socket says 172.21.15.55:58856) 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.757+0000 7fdcc37fe640 1 -- 172.21.15.55:0/3422239533 learned_addr learned my addr 172.21.15.55:0/3422239533 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.757+0000 7fdcc27fc640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc40b4280 0x7fdcc40b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.757+0000 7fdcc2ffd640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb00051c0 0x7fdcc414aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.758+0000 7fdcc37fe640 1 -- 172.21.15.55:0/3422239533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc40b4280 msgr2=0x7fdcc40b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.758+0000 7fdcc37fe640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc40b4280 0x7fdcc40b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.758+0000 7fdcc37fe640 1 -- 172.21.15.55:0/3422239533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb00051c0 msgr2=0x7fdcc414aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.758+0000 7fdcc37fe640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb00051c0 0x7fdcc414aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.758+0000 7fdcc37fe640 1 -- 172.21.15.55:0/3422239533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40b4d40 con 0x7fdcc40cae70 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.758+0000 7fdcc37fe640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc40cae70 0x7fdcc40cb2f0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fdcb402b530 tx=0x7fdcc40d2610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.758+0000 7fdcbbfff640 1 -- 172.21.15.55:0/3422239533 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4044070 con 0x7fdcc40cae70 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.758+0000 7fdcbbfff640 1 -- 172.21.15.55:0/3422239533 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb402bdc0 con 0x7fdcc40cae70 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.758+0000 7fdcc981f640 1 -- 172.21.15.55:0/3422239533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc40b5020 con 0x7fdcc40cae70 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.758+0000 7fdcbbfff640 1 -- 172.21.15.55:0/3422239533 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400a480 con 0x7fdcc40cae70 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.758+0000 7fdcc981f640 1 -- 172.21.15.55:0/3422239533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc40b55e0 con 0x7fdcc40cae70 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.759+0000 7fdcc981f640 1 -- 172.21.15.55:0/3422239533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc4067850 con 0x7fdcc40cae70 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.759+0000 7fdcbbfff640 1 -- 172.21.15.55:0/3422239533 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdcb4047070 con 0x7fdcc40cae70 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.760+0000 7fdcbbfff640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdca406b4d0 0x7fdca406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.760+0000 7fdcbbfff640 1 -- 172.21.15.55:0/3422239533 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcb40a9bb0 con 0x7fdcc40cae70 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.760+0000 7fdcc2ffd640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdca406b4d0 0x7fdca406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.760+0000 7fdcc2ffd640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdca406b4d0 0x7fdca406d990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc001760 tx=0x7fdcbc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.764+0000 7fdcbbfff640 1 -- 172.21.15.55:0/3422239533 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdcb40783e0 con 0x7fdcc40cae70 2024-04-25T09:03:36.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.947+0000 7fdcc981f640 1 -- 172.21.15.55:0/3422239533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcc40749b0 con 0x7fdcc40cae70 2024-04-25T09:03:36.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.948+0000 7fdcbbfff640 1 -- 172.21.15.55:0/3422239533 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16627 (secure 0 0 0) 0x7fdcb40ad070 con 0x7fdcc40cae70 2024-04-25T09:03:36.936 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:36.937 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":115,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:35.269007+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:31.900630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:32.603273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 -- 172.21.15.55:0/3422239533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdca406b4d0 msgr2=0x7fdca406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdca406b4d0 0x7fdca406d990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc001760 tx=0x7fdcbc009040 comp rx=0 tx=0).stop 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 -- 172.21.15.55:0/3422239533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc40cae70 msgr2=0x7fdcc40cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc40cae70 0x7fdcc40cb2f0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fdcb402b530 tx=0x7fdcc40d2610 comp rx=0 tx=0).stop 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 -- 172.21.15.55:0/3422239533 shutdown_connections 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdca406b4d0 0x7fdca406d990 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc40cae70 0x7fdcc40cb2f0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcc40b4280 0x7fdcc40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 --2- 172.21.15.55:0/3422239533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb00051c0 0x7fdcc414aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 -- 172.21.15.55:0/3422239533 >> 172.21.15.55:0/3422239533 conn(0x7fdcc40722d0 msgr2=0x7fdcc415c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 -- 172.21.15.55:0/3422239533 shutdown_connections 2024-04-25T09:03:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:36.950+0000 7fdcc981f640 1 -- 172.21.15.55:0/3422239533 wait complete. 2024-04-25T09:03:36.950 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:03:36.950 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:03:37.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.063+0000 7f77d2b4c640 1 Processor -- start 2024-04-25T09:03:37.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.063+0000 7f77d2b4c640 1 -- start start 2024-04-25T09:03:37.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.064+0000 7f77d2b4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 0x7f77cc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.064+0000 7f77d2b4c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f77cc0cfdb0 0x7f77cc0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.064+0000 7f77d2b4c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc0d0430 con 0x7f77cc0ce830 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.064+0000 7f77d2b4c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77cc0d09f0 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.064+0000 7f77d2b4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0cec70 con 0x7f77cc15f120 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.065+0000 7f77d10e9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f77cc0cfdb0 0x7f77cc0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.065+0000 7f77d08e8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 0x7f77cc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.065+0000 7f77d10e9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f77cc0cfdb0 0x7f77cc0ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:50866/0 (socket says 172.21.15.55:50866) 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.065+0000 7f77d08e8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 0x7f77cc0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:55368/0 (socket says 172.21.15.55:55368) 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.065+0000 7f77d10e9640 1 -- 172.21.15.55:0/520258288 learned_addr learned my addr 172.21.15.55:0/520258288 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.065+0000 7f77cbfff640 1 --1- 172.21.15.55:0/520258288 >> v1:172.21.15.167:6789/0 conn(0x7f77cc0ce830 0x7f77cc0cf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:40920/0 (socket says 172.21.15.55:40920) 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.065+0000 7f77d08e8640 1 -- 172.21.15.55:0/520258288 >> v2:172.21.15.167:3300/0 conn(0x7f77cc0cfdb0 msgr2=0x7f77cc0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.065+0000 7f77d08e8640 1 --2- 172.21.15.55:0/520258288 >> v2:172.21.15.167:3300/0 conn(0x7f77cc0cfdb0 0x7f77cc0ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.065+0000 7f77d08e8640 1 -- 172.21.15.55:0/520258288 >> v1:172.21.15.167:6789/0 conn(0x7f77cc0ce830 legacy=0x7f77cc0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.065+0000 7f77d08e8640 1 -- 172.21.15.55:0/520258288 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc0d0710 con 0x7f77cc15f120 2024-04-25T09:03:37.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77d08e8640 1 --2- 172.21.15.55:0/520258288 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 0x7f77cc0ce2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77c00097a0 tx=0x7f77c002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41effa1bdc5ba8ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77cb7fe640 1 -- 172.21.15.55:0/520258288 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0037070 con 0x7f77cc15f120 2024-04-25T09:03:37.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77cb7fe640 1 -- 172.21.15.55:0/520258288 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c0032440 con 0x7f77cc15f120 2024-04-25T09:03:37.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77cb7fe640 1 -- 172.21.15.55:0/520258288 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0032810 con 0x7f77cc15f120 2024-04-25T09:03:37.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77d2b4c640 1 -- 172.21.15.55:0/520258288 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 msgr2=0x7f77cc0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77d2b4c640 1 --2- 172.21.15.55:0/520258288 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 0x7f77cc0ce2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77c00097a0 tx=0x7f77c002a210 comp rx=0 tx=0).stop 2024-04-25T09:03:37.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77d2b4c640 1 -- 172.21.15.55:0/520258288 shutdown_connections 2024-04-25T09:03:37.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77d2b4c640 1 --2- 172.21.15.55:0/520258288 >> v2:172.21.15.167:3300/0 conn(0x7f77cc0cfdb0 0x7f77cc0ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77d2b4c640 1 --2- 172.21.15.55:0/520258288 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 0x7f77cc0ce2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77d2b4c640 1 -- 172.21.15.55:0/520258288 >> 172.21.15.55:0/520258288 conn(0x7f77cc0d1900 msgr2=0x7f77cc0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77d2b4c640 1 -- 172.21.15.55:0/520258288 shutdown_connections 2024-04-25T09:03:37.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.066+0000 7f77d2b4c640 1 -- 172.21.15.55:0/520258288 wait complete. 2024-04-25T09:03:37.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.068+0000 7f77d2b4c640 1 Processor -- start 2024-04-25T09:03:37.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.068+0000 7f77d2b4c640 1 -- start start 2024-04-25T09:03:37.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.068+0000 7f77d2b4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc0ce830 0x7f77cc157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.068+0000 7f77d2b4c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77cc0cfdb0 0x7f77cc0ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.068+0000 7f77d2b4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 0x7f77cc15dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.068+0000 7f77d2b4c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0cc480 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.068+0000 7f77d2b4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0ccab0 con 0x7f77cc0ce830 2024-04-25T09:03:37.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.068+0000 7f77d2b4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0c5450 con 0x7f77cc15f120 2024-04-25T09:03:37.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77cbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77cc0cfdb0 0x7f77cc0ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77cbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77cc0cfdb0 0x7f77cc0ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58862/0 (socket says 172.21.15.55:58862) 2024-04-25T09:03:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77cbfff640 1 -- 172.21.15.55:0/3903407470 learned_addr learned my addr 172.21.15.55:0/3903407470 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77d10e9640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 0x7f77cc15dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77cbfff640 1 -- 172.21.15.55:0/3903407470 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 msgr2=0x7f77cc15dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77d08e8640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc0ce830 0x7f77cc157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77cbfff640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 0x7f77cc15dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77cbfff640 1 -- 172.21.15.55:0/3903407470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc0ce830 msgr2=0x7f77cc157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77cbfff640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc0ce830 0x7f77cc157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77cbfff640 1 -- 172.21.15.55:0/3903407470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc0c8b00 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77d08e8640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc0ce830 0x7f77cc157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77cbfff640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77cc0cfdb0 0x7f77cc0ca090 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f77b800c3c0 tx=0x7f77b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77c97fa640 1 -- 172.21.15.55:0/3903407470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80074e0 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77c97fa640 1 -- 172.21.15.55:0/3903407470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b8007680 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77c97fa640 1 -- 172.21.15.55:0/3903407470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8004a00 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77d2b4c640 1 -- 172.21.15.55:0/3903407470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77cc0c8da0 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.069+0000 7f77d2b4c640 1 -- 172.21.15.55:0/3903407470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77cc0c9360 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.070+0000 7f77d2b4c640 1 -- 172.21.15.55:0/3903407470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77cc0749b0 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.071+0000 7f77c97fa640 1 -- 172.21.15.55:0/3903407470 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f77b801a020 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.071+0000 7f77c97fa640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f77b006b4d0 0x7f77b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.071+0000 7f77c97fa640 1 -- 172.21.15.55:0/3903407470 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77b80898e0 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.071+0000 7f77d08e8640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f77b006b4d0 0x7f77b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.072+0000 7f77d08e8640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f77b006b4d0 0x7f77b006d990 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f77c0034000 tx=0x7f77c002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.076+0000 7f77c97fa640 1 -- 172.21.15.55:0/3903407470 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f77b80587f0 con 0x7f77cc0cfdb0 2024-04-25T09:03:37.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.253+0000 7f77d2b4c640 1 -- 172.21.15.55:0/3903407470 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77cc0c8790 con 0x7f77b006b4d0 2024-04-25T09:03:37.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.259+0000 7f77c97fa640 1 -- 172.21.15.55:0/3903407470 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252420 (secure 0 0 0) 0x7f77cc0c8790 con 0x7f77b006b4d0 2024-04-25T09:03:37.252 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:37.253 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 -- 172.21.15.55:0/3903407470 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f77b006b4d0 msgr2=0x7f77b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f77b006b4d0 0x7f77b006d990 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f77c0034000 tx=0x7f77c002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 -- 172.21.15.55:0/3903407470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77cc0cfdb0 msgr2=0x7f77cc0ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77cc0cfdb0 0x7f77cc0ca090 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f77b800c3c0 tx=0x7f77b800c880 comp rx=0 tx=0).stop 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 -- 172.21.15.55:0/3903407470 shutdown_connections 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f77b006b4d0 0x7f77b006d990 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77cc15f120 0x7f77cc15dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77cc0cfdb0 0x7f77cc0ca090 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 --2- 172.21.15.55:0/3903407470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc0ce830 0x7f77cc157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 -- 172.21.15.55:0/3903407470 >> 172.21.15.55:0/3903407470 conn(0x7f77cc0d1900 msgr2=0x7f77cc0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 -- 172.21.15.55:0/3903407470 shutdown_connections 2024-04-25T09:03:37.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.262+0000 7f77d2b4c640 1 -- 172.21.15.55:0/3903407470 wait complete. 2024-04-25T09:03:37.262 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":413,"stamp":"2024-04-25T09:03:36.688696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265796,"kb_used_data":12176,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754708924,"statfs":{"total":773094113280,"available":772821938176,"internally_reserved":0,"allocated":12468224,"data_stored":6033378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.435288"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.288317+0000","last_change":"2024-04-25T09:03:34.284312+0000","last_active":"2024-04-25T09:03:34.288317+0000","last_peered":"2024-04-25T09:03:34.288317+0000","last_clean":"2024-04-25T09:03:34.288317+0000","last_became_active":"2024-04-25T09:03:34.284021+0000","last_became_peered":"2024-04-25T09:03:34.284021+0000","last_unstale":"2024-04-25T09:03:34.288317+0000","last_undegraded":"2024-04-25T09:03:34.288317+0000","last_fullsized":"2024-04-25T09:03:34.288317+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:59.422034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.295841+0000","last_change":"2024-04-25T09:03:34.290162+0000","last_active":"2024-04-25T09:03:34.295841+0000","last_peered":"2024-04-25T09:03:34.295841+0000","last_clean":"2024-04-25T09:03:34.295841+0000","last_became_active":"2024-04-25T09:03:34.289896+0000","last_became_peered":"2024-04-25T09:03:34.289896+0000","last_unstale":"2024-04-25T09:03:34.295841+0000","last_undegraded":"2024-04-25T09:03:34.295841+0000","last_fullsized":"2024-04-25T09:03:34.295841+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:45.912269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282162+0000","last_change":"2024-04-25T09:03:34.276928+0000","last_active":"2024-04-25T09:03:34.282162+0000","last_peered":"2024-04-25T09:03:34.282162+0000","last_clean":"2024-04-25T09:03:34.282162+0000","last_became_active":"2024-04-25T09:03:34.276657+0000","last_became_peered":"2024-04-25T09:03:34.276657+0000","last_unstale":"2024-04-25T09:03:34.282162+0000","last_undegraded":"2024-04-25T09:03:34.282162+0000","last_fullsized":"2024-04-25T09:03:34.282162+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:17.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291117+0000","last_change":"2024-04-25T09:03:34.285433+0000","last_active":"2024-04-25T09:03:34.291117+0000","last_peered":"2024-04-25T09:03:34.291117+0000","last_clean":"2024-04-25T09:03:34.291117+0000","last_became_active":"2024-04-25T09:03:34.285175+0000","last_became_peered":"2024-04-25T09:03:34.285175+0000","last_unstale":"2024-04-25T09:03:34.291117+0000","last_undegraded":"2024-04-25T09:03:34.291117+0000","last_fullsized":"2024-04-25T09:03:34.291117+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:39.106644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284267+0000","last_change":"2024-04-25T09:03:34.282106+0000","last_active":"2024-04-25T09:03:34.284267+0000","last_peered":"2024-04-25T09:03:34.284267+0000","last_clean":"2024-04-25T09:03:34.284267+0000","last_became_active":"2024-04-25T09:03:34.281811+0000","last_became_peered":"2024-04-25T09:03:34.281811+0000","last_unstale":"2024-04-25T09:03:34.284267+0000","last_undegraded":"2024-04-25T09:03:34.284267+0000","last_fullsized":"2024-04-25T09:03:34.284267+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:12.152348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638789+0000","last_change":"2024-04-25T09:03:34.287973+0000","last_active":"2024-04-25T09:03:35.638789+0000","last_peered":"2024-04-25T09:03:35.638789+0000","last_clean":"2024-04-25T09:03:35.638789+0000","last_became_active":"2024-04-25T09:03:34.287188+0000","last_became_peered":"2024-04-25T09:03:34.287188+0000","last_unstale":"2024-04-25T09:03:35.638789+0000","last_undegraded":"2024-04-25T09:03:35.638789+0000","last_fullsized":"2024-04-25T09:03:35.638789+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:34.798354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.276112+0000","last_change":"2024-04-25T09:03:34.270990+0000","last_active":"2024-04-25T09:03:34.276112+0000","last_peered":"2024-04-25T09:03:34.276112+0000","last_clean":"2024-04-25T09:03:34.276112+0000","last_became_active":"2024-04-25T09:03:34.270443+0000","last_became_peered":"2024-04-25T09:03:34.270443+0000","last_unstale":"2024-04-25T09:03:34.276112+0000","last_undegraded":"2024-04-25T09:03:34.276112+0000","last_fullsized":"2024-04-25T09:03:34.276112+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:59.655500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.295943+0000","last_change":"2024-04-25T09:03:34.291423+0000","last_active":"2024-04-25T09:03:34.295943+0000","last_peered":"2024-04-25T09:03:34.295943+0000","last_clean":"2024-04-25T09:03:34.295943+0000","last_became_active":"2024-04-25T09:03:34.291191+0000","last_became_peered":"2024-04-25T09:03:34.291191+0000","last_unstale":"2024-04-25T09:03:34.295943+0000","last_undegraded":"2024-04-25T09:03:34.295943+0000","last_fullsized":"2024-04-25T09:03:34.295943+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:59.512760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.288299+0000","last_change":"2024-04-25T09:03:34.284017+0000","last_active":"2024-04-25T09:03:34.288299+0000","last_peered":"2024-04-25T09:03:34.288299+0000","last_clean":"2024-04-25T09:03:34.288299+0000","last_became_active":"2024-04-25T09:03:34.283689+0000","last_became_peered":"2024-04-25T09:03:34.283689+0000","last_unstale":"2024-04-25T09:03:34.288299+0000","last_undegraded":"2024-04-25T09:03:34.288299+0000","last_fullsized":"2024-04-25T09:03:34.288299+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:15.703522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.286469+0000","last_change":"2024-04-25T09:03:34.279031+0000","last_active":"2024-04-25T09:03:34.286469+0000","last_peered":"2024-04-25T09:03:34.286469+0000","last_clean":"2024-04-25T09:03:34.286469+0000","last_became_active":"2024-04-25T09:03:34.278459+0000","last_became_peered":"2024-04-25T09:03:34.278459+0000","last_unstale":"2024-04-25T09:03:34.286469+0000","last_undegraded":"2024-04-25T09:03:34.286469+0000","last_fullsized":"2024-04-25T09:03:34.286469+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:43.809728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284060+0000","last_change":"2024-04-25T09:03:34.279068+0000","last_active":"2024-04-25T09:03:34.284060+0000","last_peered":"2024-04-25T09:03:34.284060+0000","last_clean":"2024-04-25T09:03:34.284060+0000","last_became_active":"2024-04-25T09:03:34.278783+0000","last_became_peered":"2024-04-25T09:03:34.278783+0000","last_unstale":"2024-04-25T09:03:34.284060+0000","last_undegraded":"2024-04-25T09:03:34.284060+0000","last_fullsized":"2024-04-25T09:03:34.284060+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:16.343669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291630+0000","last_change":"2024-04-25T09:03:34.287049+0000","last_active":"2024-04-25T09:03:34.291630+0000","last_peered":"2024-04-25T09:03:34.291630+0000","last_clean":"2024-04-25T09:03:34.291630+0000","last_became_active":"2024-04-25T09:03:34.286776+0000","last_became_peered":"2024-04-25T09:03:34.286776+0000","last_unstale":"2024-04-25T09:03:34.291630+0000","last_undegraded":"2024-04-25T09:03:34.291630+0000","last_fullsized":"2024-04-25T09:03:34.291630+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:26.066243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294637+0000","last_change":"2024-04-25T09:03:34.289549+0000","last_active":"2024-04-25T09:03:34.294637+0000","last_peered":"2024-04-25T09:03:34.294637+0000","last_clean":"2024-04-25T09:03:34.294637+0000","last_became_active":"2024-04-25T09:03:34.289243+0000","last_became_peered":"2024-04-25T09:03:34.289243+0000","last_unstale":"2024-04-25T09:03:34.294637+0000","last_undegraded":"2024-04-25T09:03:34.294637+0000","last_fullsized":"2024-04-25T09:03:34.294637+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:58.452354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.285216+0000","last_change":"2024-04-25T09:03:34.283570+0000","last_active":"2024-04-25T09:03:34.285216+0000","last_peered":"2024-04-25T09:03:34.285216+0000","last_clean":"2024-04-25T09:03:34.285216+0000","last_became_active":"2024-04-25T09:03:34.283282+0000","last_became_peered":"2024-04-25T09:03:34.283282+0000","last_unstale":"2024-04-25T09:03:34.285216+0000","last_undegraded":"2024-04-25T09:03:34.285216+0000","last_fullsized":"2024-04-25T09:03:34.285216+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:32.371110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638741+0000","last_change":"2024-04-25T09:03:34.278728+0000","last_active":"2024-04-25T09:03:35.638741+0000","last_peered":"2024-04-25T09:03:35.638741+0000","last_clean":"2024-04-25T09:03:35.638741+0000","last_became_active":"2024-04-25T09:03:34.278454+0000","last_became_peered":"2024-04-25T09:03:34.278454+0000","last_unstale":"2024-04-25T09:03:35.638741+0000","last_undegraded":"2024-04-25T09:03:35.638741+0000","last_fullsized":"2024-04-25T09:03:35.638741+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:02.289175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291872+0000","last_change":"2024-04-25T09:03:34.284396+0000","last_active":"2024-04-25T09:03:34.291872+0000","last_peered":"2024-04-25T09:03:34.291872+0000","last_clean":"2024-04-25T09:03:34.291872+0000","last_became_active":"2024-04-25T09:03:34.283756+0000","last_became_peered":"2024-04-25T09:03:34.283756+0000","last_unstale":"2024-04-25T09:03:34.291872+0000","last_undegraded":"2024-04-25T09:03:34.291872+0000","last_fullsized":"2024-04-25T09:03:34.291872+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:21.874881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.285370+0000","last_change":"2024-04-25T09:03:34.281933+0000","last_active":"2024-04-25T09:03:34.285370+0000","last_peered":"2024-04-25T09:03:34.285370+0000","last_clean":"2024-04-25T09:03:34.285370+0000","last_became_active":"2024-04-25T09:03:34.281388+0000","last_became_peered":"2024-04-25T09:03:34.281388+0000","last_unstale":"2024-04-25T09:03:34.285370+0000","last_undegraded":"2024-04-25T09:03:34.285370+0000","last_fullsized":"2024-04-25T09:03:34.285370+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:57.971601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282469+0000","last_change":"2024-04-25T09:03:34.275420+0000","last_active":"2024-04-25T09:03:34.282469+0000","last_peered":"2024-04-25T09:03:34.282469+0000","last_clean":"2024-04-25T09:03:34.282469+0000","last_became_active":"2024-04-25T09:03:34.275156+0000","last_became_peered":"2024-04-25T09:03:34.275156+0000","last_unstale":"2024-04-25T09:03:34.282469+0000","last_undegraded":"2024-04-25T09:03:34.282469+0000","last_fullsized":"2024-04-25T09:03:34.282469+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:17.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294673+0000","last_change":"2024-04-25T09:03:34.289490+0000","last_active":"2024-04-25T09:03:34.294673+0000","last_peered":"2024-04-25T09:03:34.294673+0000","last_clean":"2024-04-25T09:03:34.294673+0000","last_became_active":"2024-04-25T09:03:34.289170+0000","last_became_peered":"2024-04-25T09:03:34.289170+0000","last_unstale":"2024-04-25T09:03:34.294673+0000","last_undegraded":"2024-04-25T09:03:34.294673+0000","last_fullsized":"2024-04-25T09:03:34.294673+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:57.971601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.283758+0000","last_change":"2024-04-25T09:03:34.276268+0000","last_active":"2024-04-25T09:03:34.283758+0000","last_peered":"2024-04-25T09:03:34.283758+0000","last_clean":"2024-04-25T09:03:34.283758+0000","last_became_active":"2024-04-25T09:03:34.275993+0000","last_became_peered":"2024-04-25T09:03:34.275993+0000","last_unstale":"2024-04-25T09:03:34.283758+0000","last_undegraded":"2024-04-25T09:03:34.283758+0000","last_fullsized":"2024-04-25T09:03:34.283758+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:17.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284168+0000","last_change":"2024-04-25T09:03:34.281275+0000","last_active":"2024-04-25T09:03:34.284168+0000","last_peered":"2024-04-25T09:03:34.284168+0000","last_clean":"2024-04-25T09:03:34.284168+0000","last_became_active":"2024-04-25T09:03:34.280775+0000","last_became_peered":"2024-04-25T09:03:34.280775+0000","last_unstale":"2024-04-25T09:03:34.284168+0000","last_undegraded":"2024-04-25T09:03:34.284168+0000","last_fullsized":"2024-04-25T09:03:34.284168+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:32.417692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.275373+0000","last_change":"2024-04-25T09:03:34.270150+0000","last_active":"2024-04-25T09:03:34.275373+0000","last_peered":"2024-04-25T09:03:34.275373+0000","last_clean":"2024-04-25T09:03:34.275373+0000","last_became_active":"2024-04-25T09:03:34.269860+0000","last_became_peered":"2024-04-25T09:03:34.269860+0000","last_unstale":"2024-04-25T09:03:34.275373+0000","last_undegraded":"2024-04-25T09:03:34.275373+0000","last_fullsized":"2024-04-25T09:03:34.275373+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:58.452354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.281949+0000","last_change":"2024-04-25T09:03:34.275488+0000","last_active":"2024-04-25T09:03:34.281949+0000","last_peered":"2024-04-25T09:03:34.281949+0000","last_clean":"2024-04-25T09:03:34.281949+0000","last_became_active":"2024-04-25T09:03:34.275116+0000","last_became_peered":"2024-04-25T09:03:34.275116+0000","last_unstale":"2024-04-25T09:03:34.281949+0000","last_undegraded":"2024-04-25T09:03:34.281949+0000","last_fullsized":"2024-04-25T09:03:34.281949+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:37.440115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282482+0000","last_change":"2024-04-25T09:03:34.276749+0000","last_active":"2024-04-25T09:03:34.282482+0000","last_peered":"2024-04-25T09:03:34.282482+0000","last_clean":"2024-04-25T09:03:34.282482+0000","last_became_active":"2024-04-25T09:03:34.276438+0000","last_became_peered":"2024-04-25T09:03:34.276438+0000","last_unstale":"2024-04-25T09:03:34.282482+0000","last_undegraded":"2024-04-25T09:03:34.282482+0000","last_fullsized":"2024-04-25T09:03:34.282482+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:44.160566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.283974+0000","last_change":"2024-04-25T09:03:34.280076+0000","last_active":"2024-04-25T09:03:34.283974+0000","last_peered":"2024-04-25T09:03:34.283974+0000","last_clean":"2024-04-25T09:03:34.283974+0000","last_became_active":"2024-04-25T09:03:34.279807+0000","last_became_peered":"2024-04-25T09:03:34.279807+0000","last_unstale":"2024-04-25T09:03:34.283974+0000","last_undegraded":"2024-04-25T09:03:34.283974+0000","last_fullsized":"2024-04-25T09:03:34.283974+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:32.371110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.286447+0000","last_change":"2024-04-25T09:03:34.278783+0000","last_active":"2024-04-25T09:03:34.286447+0000","last_peered":"2024-04-25T09:03:34.286447+0000","last_clean":"2024-04-25T09:03:34.286447+0000","last_became_active":"2024-04-25T09:03:34.278082+0000","last_became_peered":"2024-04-25T09:03:34.278082+0000","last_unstale":"2024-04-25T09:03:34.286447+0000","last_undegraded":"2024-04-25T09:03:34.286447+0000","last_fullsized":"2024-04-25T09:03:34.286447+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:18.206553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.639057+0000","last_change":"2024-04-25T09:03:34.284953+0000","last_active":"2024-04-25T09:03:35.639057+0000","last_peered":"2024-04-25T09:03:35.639057+0000","last_clean":"2024-04-25T09:03:35.639057+0000","last_became_active":"2024-04-25T09:03:34.284618+0000","last_became_peered":"2024-04-25T09:03:34.284618+0000","last_unstale":"2024-04-25T09:03:35.639057+0000","last_undegraded":"2024-04-25T09:03:35.639057+0000","last_fullsized":"2024-04-25T09:03:35.639057+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:54.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.292032+0000","last_change":"2024-04-25T09:03:34.289182+0000","last_active":"2024-04-25T09:03:34.292032+0000","last_peered":"2024-04-25T09:03:34.292032+0000","last_clean":"2024-04-25T09:03:34.292032+0000","last_became_active":"2024-04-25T09:03:34.288906+0000","last_became_peered":"2024-04-25T09:03:34.288906+0000","last_unstale":"2024-04-25T09:03:34.292032+0000","last_undegraded":"2024-04-25T09:03:34.292032+0000","last_fullsized":"2024-04-25T09:03:34.292032+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:51.997091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284144+0000","last_change":"2024-04-25T09:03:34.278962+0000","last_active":"2024-04-25T09:03:34.284144+0000","last_peered":"2024-04-25T09:03:34.284144+0000","last_clean":"2024-04-25T09:03:34.284144+0000","last_became_active":"2024-04-25T09:03:34.278709+0000","last_became_peered":"2024-04-25T09:03:34.278709+0000","last_unstale":"2024-04-25T09:03:34.284144+0000","last_undegraded":"2024-04-25T09:03:34.284144+0000","last_fullsized":"2024-04-25T09:03:34.284144+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:28.678482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.281750+0000","last_change":"2024-04-25T09:03:34.275344+0000","last_active":"2024-04-25T09:03:34.281750+0000","last_peered":"2024-04-25T09:03:34.281750+0000","last_clean":"2024-04-25T09:03:34.281750+0000","last_became_active":"2024-04-25T09:03:34.275068+0000","last_became_peered":"2024-04-25T09:03:34.275068+0000","last_unstale":"2024-04-25T09:03:34.281750+0000","last_undegraded":"2024-04-25T09:03:34.281750+0000","last_fullsized":"2024-04-25T09:03:34.281750+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:56.783299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.288261+0000","last_change":"2024-04-25T09:03:34.283274+0000","last_active":"2024-04-25T09:03:34.288261+0000","last_peered":"2024-04-25T09:03:34.288261+0000","last_clean":"2024-04-25T09:03:34.288261+0000","last_became_active":"2024-04-25T09:03:34.282968+0000","last_became_peered":"2024-04-25T09:03:34.282968+0000","last_unstale":"2024-04-25T09:03:34.288261+0000","last_undegraded":"2024-04-25T09:03:34.288261+0000","last_fullsized":"2024-04-25T09:03:34.288261+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:41.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638920+0000","last_change":"2024-04-25T09:03:34.286922+0000","last_active":"2024-04-25T09:03:35.638920+0000","last_peered":"2024-04-25T09:03:35.638920+0000","last_clean":"2024-04-25T09:03:35.638920+0000","last_became_active":"2024-04-25T09:03:34.286625+0000","last_became_peered":"2024-04-25T09:03:34.286625+0000","last_unstale":"2024-04-25T09:03:35.638920+0000","last_undegraded":"2024-04-25T09:03:35.638920+0000","last_fullsized":"2024-04-25T09:03:35.638920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:41.989619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.639006+0000","last_change":"2024-04-25T09:03:34.285629+0000","last_active":"2024-04-25T09:03:35.639006+0000","last_peered":"2024-04-25T09:03:35.639006+0000","last_clean":"2024-04-25T09:03:35.639006+0000","last_became_active":"2024-04-25T09:03:34.285314+0000","last_became_peered":"2024-04-25T09:03:34.285314+0000","last_unstale":"2024-04-25T09:03:35.639006+0000","last_undegraded":"2024-04-25T09:03:35.639006+0000","last_fullsized":"2024-04-25T09:03:35.639006+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:48.352360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"114'4","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.283422+0000","last_change":"2024-04-25T09:03:33.271897+0000","last_active":"2024-04-25T09:03:34.283422+0000","last_peered":"2024-04-25T09:03:34.283422+0000","last_clean":"2024-04-25T09:03:34.283422+0000","last_became_active":"2024-04-25T09:03:33.271633+0000","last_became_peered":"2024-04-25T09:03:33.271633+0000","last_unstale":"2024-04-25T09:03:34.283422+0000","last_undegraded":"2024-04-25T09:03:34.283422+0000","last_fullsized":"2024-04-25T09:03:34.283422+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:20.665904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282546+0000","last_change":"2024-04-25T09:03:34.277186+0000","last_active":"2024-04-25T09:03:34.282546+0000","last_peered":"2024-04-25T09:03:34.282546+0000","last_clean":"2024-04-25T09:03:34.282546+0000","last_became_active":"2024-04-25T09:03:34.276893+0000","last_became_peered":"2024-04-25T09:03:34.276893+0000","last_unstale":"2024-04-25T09:03:34.282546+0000","last_undegraded":"2024-04-25T09:03:34.282546+0000","last_fullsized":"2024-04-25T09:03:34.282546+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:28.678482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.283995+0000","last_change":"2024-04-25T09:03:33.272237+0000","last_active":"2024-04-25T09:03:34.283995+0000","last_peered":"2024-04-25T09:03:34.283995+0000","last_clean":"2024-04-25T09:03:34.283995+0000","last_became_active":"2024-04-25T09:03:33.271941+0000","last_became_peered":"2024-04-25T09:03:33.271941+0000","last_unstale":"2024-04-25T09:03:34.283995+0000","last_undegraded":"2024-04-25T09:03:34.283995+0000","last_fullsized":"2024-04-25T09:03:34.283995+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:36.437928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638938+0000","last_change":"2024-04-25T09:03:34.285171+0000","last_active":"2024-04-25T09:03:35.638938+0000","last_peered":"2024-04-25T09:03:35.638938+0000","last_clean":"2024-04-25T09:03:35.638938+0000","last_became_active":"2024-04-25T09:03:34.284859+0000","last_became_peered":"2024-04-25T09:03:34.284859+0000","last_unstale":"2024-04-25T09:03:35.638938+0000","last_undegraded":"2024-04-25T09:03:35.638938+0000","last_fullsized":"2024-04-25T09:03:35.638938+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:34.446609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.288632+0000","last_change":"2024-04-25T09:03:33.275583+0000","last_active":"2024-04-25T09:03:34.288632+0000","last_peered":"2024-04-25T09:03:34.288632+0000","last_clean":"2024-04-25T09:03:34.288632+0000","last_became_active":"2024-04-25T09:03:33.272844+0000","last_became_peered":"2024-04-25T09:03:33.272844+0000","last_unstale":"2024-04-25T09:03:34.288632+0000","last_undegraded":"2024-04-25T09:03:34.288632+0000","last_fullsized":"2024-04-25T09:03:34.288632+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:23.755894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294737+0000","last_change":"2024-04-25T09:03:34.289760+0000","last_active":"2024-04-25T09:03:34.294737+0000","last_peered":"2024-04-25T09:03:34.294737+0000","last_clean":"2024-04-25T09:03:34.294737+0000","last_became_active":"2024-04-25T09:03:34.289259+0000","last_became_peered":"2024-04-25T09:03:34.289259+0000","last_unstale":"2024-04-25T09:03:34.294737+0000","last_undegraded":"2024-04-25T09:03:34.294737+0000","last_fullsized":"2024-04-25T09:03:34.294737+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:38.737934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291163+0000","last_change":"2024-04-25T09:03:33.274356+0000","last_active":"2024-04-25T09:03:34.291163+0000","last_peered":"2024-04-25T09:03:34.291163+0000","last_clean":"2024-04-25T09:03:34.291163+0000","last_became_active":"2024-04-25T09:03:33.271646+0000","last_became_peered":"2024-04-25T09:03:33.271646+0000","last_unstale":"2024-04-25T09:03:34.291163+0000","last_undegraded":"2024-04-25T09:03:34.291163+0000","last_fullsized":"2024-04-25T09:03:34.291163+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:30.001026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294433+0000","last_change":"2024-04-25T09:03:34.292589+0000","last_active":"2024-04-25T09:03:34.294433+0000","last_peered":"2024-04-25T09:03:34.294433+0000","last_clean":"2024-04-25T09:03:34.294433+0000","last_became_active":"2024-04-25T09:03:34.292312+0000","last_became_peered":"2024-04-25T09:03:34.292312+0000","last_unstale":"2024-04-25T09:03:34.294433+0000","last_undegraded":"2024-04-25T09:03:34.294433+0000","last_fullsized":"2024-04-25T09:03:34.294433+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:22.909901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.288278+0000","last_change":"2024-04-25T09:03:33.275637+0000","last_active":"2024-04-25T09:03:34.288278+0000","last_peered":"2024-04-25T09:03:34.288278+0000","last_clean":"2024-04-25T09:03:34.288278+0000","last_became_active":"2024-04-25T09:03:33.275352+0000","last_became_peered":"2024-04-25T09:03:33.275352+0000","last_unstale":"2024-04-25T09:03:34.288278+0000","last_undegraded":"2024-04-25T09:03:34.288278+0000","last_fullsized":"2024-04-25T09:03:34.288278+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:28.360614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294759+0000","last_change":"2024-04-25T09:03:34.286012+0000","last_active":"2024-04-25T09:03:34.294759+0000","last_peered":"2024-04-25T09:03:34.294759+0000","last_clean":"2024-04-25T09:03:34.294759+0000","last_became_active":"2024-04-25T09:03:34.285649+0000","last_became_peered":"2024-04-25T09:03:34.285649+0000","last_unstale":"2024-04-25T09:03:34.294759+0000","last_undegraded":"2024-04-25T09:03:34.294759+0000","last_fullsized":"2024-04-25T09:03:34.294759+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:58.452354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.281480+0000","last_change":"2024-04-25T09:03:33.274637+0000","last_active":"2024-04-25T09:03:34.281480+0000","last_peered":"2024-04-25T09:03:34.281480+0000","last_clean":"2024-04-25T09:03:34.281480+0000","last_became_active":"2024-04-25T09:03:33.274365+0000","last_became_peered":"2024-04-25T09:03:33.274365+0000","last_unstale":"2024-04-25T09:03:34.281480+0000","last_undegraded":"2024-04-25T09:03:34.281480+0000","last_fullsized":"2024-04-25T09:03:34.281480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:56.969414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291923+0000","last_change":"2024-04-25T09:03:34.289039+0000","last_active":"2024-04-25T09:03:34.291923+0000","last_peered":"2024-04-25T09:03:34.291923+0000","last_clean":"2024-04-25T09:03:34.291923+0000","last_became_active":"2024-04-25T09:03:34.288769+0000","last_became_peered":"2024-04-25T09:03:34.288769+0000","last_unstale":"2024-04-25T09:03:34.291923+0000","last_undegraded":"2024-04-25T09:03:34.291923+0000","last_fullsized":"2024-04-25T09:03:34.291923+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:30.066414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.266938+0000","last_change":"2024-04-25T09:03:33.268677+0000","last_active":"2024-04-25T09:03:34.266938+0000","last_peered":"2024-04-25T09:03:34.266938+0000","last_clean":"2024-04-25T09:03:34.266938+0000","last_became_active":"2024-04-25T09:03:33.268334+0000","last_became_peered":"2024-04-25T09:03:33.268334+0000","last_unstale":"2024-04-25T09:03:34.266938+0000","last_undegraded":"2024-04-25T09:03:34.266938+0000","last_fullsized":"2024-04-25T09:03:34.266938+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:12.380408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.276134+0000","last_change":"2024-04-25T09:03:34.272665+0000","last_active":"2024-04-25T09:03:34.276134+0000","last_peered":"2024-04-25T09:03:34.276134+0000","last_clean":"2024-04-25T09:03:34.276134+0000","last_became_active":"2024-04-25T09:03:34.272386+0000","last_became_peered":"2024-04-25T09:03:34.272386+0000","last_unstale":"2024-04-25T09:03:34.276134+0000","last_undegraded":"2024-04-25T09:03:34.276134+0000","last_fullsized":"2024-04-25T09:03:34.276134+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:34.400861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.273836+0000","last_change":"2024-04-25T09:03:33.277952+0000","last_active":"2024-04-25T09:03:34.273836+0000","last_peered":"2024-04-25T09:03:34.273836+0000","last_clean":"2024-04-25T09:03:34.273836+0000","last_became_active":"2024-04-25T09:03:33.275471+0000","last_became_peered":"2024-04-25T09:03:33.275471+0000","last_unstale":"2024-04-25T09:03:34.273836+0000","last_undegraded":"2024-04-25T09:03:34.273836+0000","last_fullsized":"2024-04-25T09:03:34.273836+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:27.981497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294577+0000","last_change":"2024-04-25T09:03:34.285758+0000","last_active":"2024-04-25T09:03:34.294577+0000","last_peered":"2024-04-25T09:03:34.294577+0000","last_clean":"2024-04-25T09:03:34.294577+0000","last_became_active":"2024-04-25T09:03:34.285489+0000","last_became_peered":"2024-04-25T09:03:34.285489+0000","last_unstale":"2024-04-25T09:03:34.294577+0000","last_undegraded":"2024-04-25T09:03:34.294577+0000","last_fullsized":"2024-04-25T09:03:34.294577+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:32.155280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.262037+0000","last_change":"2024-04-25T09:03:33.278151+0000","last_active":"2024-04-25T09:03:34.262037+0000","last_peered":"2024-04-25T09:03:34.262037+0000","last_clean":"2024-04-25T09:03:34.262037+0000","last_became_active":"2024-04-25T09:03:33.277820+0000","last_became_peered":"2024-04-25T09:03:33.277820+0000","last_unstale":"2024-04-25T09:03:34.262037+0000","last_undegraded":"2024-04-25T09:03:34.262037+0000","last_fullsized":"2024-04-25T09:03:34.262037+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:08.554732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.286243+0000","last_change":"2024-04-25T09:03:34.284665+0000","last_active":"2024-04-25T09:03:34.286243+0000","last_peered":"2024-04-25T09:03:34.286243+0000","last_clean":"2024-04-25T09:03:34.286243+0000","last_became_active":"2024-04-25T09:03:34.284290+0000","last_became_peered":"2024-04-25T09:03:34.284290+0000","last_unstale":"2024-04-25T09:03:34.286243+0000","last_undegraded":"2024-04-25T09:03:34.286243+0000","last_fullsized":"2024-04-25T09:03:34.286243+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:32.371110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.261820+0000","last_change":"2024-04-25T09:03:33.264477+0000","last_active":"2024-04-25T09:03:34.261820+0000","last_peered":"2024-04-25T09:03:34.261820+0000","last_clean":"2024-04-25T09:03:34.261820+0000","last_became_active":"2024-04-25T09:03:33.264198+0000","last_became_peered":"2024-04-25T09:03:33.264198+0000","last_unstale":"2024-04-25T09:03:34.261820+0000","last_undegraded":"2024-04-25T09:03:34.261820+0000","last_fullsized":"2024-04-25T09:03:34.261820+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:15.341482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.275923+0000","last_change":"2024-04-25T09:03:34.272588+0000","last_active":"2024-04-25T09:03:34.275923+0000","last_peered":"2024-04-25T09:03:34.275923+0000","last_clean":"2024-04-25T09:03:34.275923+0000","last_became_active":"2024-04-25T09:03:34.272292+0000","last_became_peered":"2024-04-25T09:03:34.272292+0000","last_unstale":"2024-04-25T09:03:34.275923+0000","last_undegraded":"2024-04-25T09:03:34.275923+0000","last_fullsized":"2024-04-25T09:03:34.275923+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:59.512760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"114'3","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291196+0000","last_change":"2024-04-25T09:03:33.276871+0000","last_active":"2024-04-25T09:03:34.291196+0000","last_peered":"2024-04-25T09:03:34.291196+0000","last_clean":"2024-04-25T09:03:34.291196+0000","last_became_active":"2024-04-25T09:03:33.276575+0000","last_became_peered":"2024-04-25T09:03:33.276575+0000","last_unstale":"2024-04-25T09:03:34.291196+0000","last_undegraded":"2024-04-25T09:03:34.291196+0000","last_fullsized":"2024-04-25T09:03:34.291196+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:50.994904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282239+0000","last_change":"2024-04-25T09:03:34.279070+0000","last_active":"2024-04-25T09:03:34.282239+0000","last_peered":"2024-04-25T09:03:34.282239+0000","last_clean":"2024-04-25T09:03:34.282239+0000","last_became_active":"2024-04-25T09:03:34.278800+0000","last_became_peered":"2024-04-25T09:03:34.278800+0000","last_unstale":"2024-04-25T09:03:34.282239+0000","last_undegraded":"2024-04-25T09:03:34.282239+0000","last_fullsized":"2024-04-25T09:03:34.282239+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:05.142587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"114'6","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.296811+0000","last_change":"2024-04-25T09:03:33.275881+0000","last_active":"2024-04-25T09:03:34.296811+0000","last_peered":"2024-04-25T09:03:34.296811+0000","last_clean":"2024-04-25T09:03:34.296811+0000","last_became_active":"2024-04-25T09:03:33.275525+0000","last_became_peered":"2024-04-25T09:03:33.275525+0000","last_unstale":"2024-04-25T09:03:34.296811+0000","last_undegraded":"2024-04-25T09:03:34.296811+0000","last_fullsized":"2024-04-25T09:03:34.296811+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:16.400815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.275404+0000","last_change":"2024-04-25T09:03:34.271458+0000","last_active":"2024-04-25T09:03:34.275404+0000","last_peered":"2024-04-25T09:03:34.275404+0000","last_clean":"2024-04-25T09:03:34.275404+0000","last_became_active":"2024-04-25T09:03:34.271181+0000","last_became_peered":"2024-04-25T09:03:34.271181+0000","last_unstale":"2024-04-25T09:03:34.275404+0000","last_undegraded":"2024-04-25T09:03:34.275404+0000","last_fullsized":"2024-04-25T09:03:34.275404+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:38.737934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.639030+0000","last_change":"2024-04-25T09:03:33.273613+0000","last_active":"2024-04-25T09:03:35.639030+0000","last_peered":"2024-04-25T09:03:35.639030+0000","last_clean":"2024-04-25T09:03:35.639030+0000","last_became_active":"2024-04-25T09:03:33.273333+0000","last_became_peered":"2024-04-25T09:03:33.273333+0000","last_unstale":"2024-04-25T09:03:35.639030+0000","last_undegraded":"2024-04-25T09:03:35.639030+0000","last_fullsized":"2024-04-25T09:03:35.639030+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:22.426391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.279168+0000","last_change":"2024-04-25T09:03:34.275112+0000","last_active":"2024-04-25T09:03:34.279168+0000","last_peered":"2024-04-25T09:03:34.279168+0000","last_clean":"2024-04-25T09:03:34.279168+0000","last_became_active":"2024-04-25T09:03:34.274787+0000","last_became_peered":"2024-04-25T09:03:34.274787+0000","last_unstale":"2024-04-25T09:03:34.279168+0000","last_undegraded":"2024-04-25T09:03:34.279168+0000","last_fullsized":"2024-04-25T09:03:34.279168+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:54.643348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.262453+0000","last_change":"2024-04-25T09:03:33.275936+0000","last_active":"2024-04-25T09:03:34.262453+0000","last_peered":"2024-04-25T09:03:34.262453+0000","last_clean":"2024-04-25T09:03:34.262453+0000","last_became_active":"2024-04-25T09:03:33.275610+0000","last_became_peered":"2024-04-25T09:03:33.275610+0000","last_unstale":"2024-04-25T09:03:34.262453+0000","last_undegraded":"2024-04-25T09:03:34.262453+0000","last_fullsized":"2024-04-25T09:03:34.262453+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:55.649688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.274331+0000","last_change":"2024-04-25T09:03:34.270698+0000","last_active":"2024-04-25T09:03:34.274331+0000","last_peered":"2024-04-25T09:03:34.274331+0000","last_clean":"2024-04-25T09:03:34.274331+0000","last_became_active":"2024-04-25T09:03:34.270434+0000","last_became_peered":"2024-04-25T09:03:34.270434+0000","last_unstale":"2024-04-25T09:03:34.274331+0000","last_undegraded":"2024-04-25T09:03:34.274331+0000","last_fullsized":"2024-04-25T09:03:34.274331+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:45.912269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"114'8","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.293176+0000","last_change":"2024-04-25T09:03:33.277724+0000","last_active":"2024-04-25T09:03:34.293176+0000","last_peered":"2024-04-25T09:03:34.293176+0000","last_clean":"2024-04-25T09:03:34.293176+0000","last_became_active":"2024-04-25T09:03:33.277401+0000","last_became_peered":"2024-04-25T09:03:33.277401+0000","last_unstale":"2024-04-25T09:03:34.293176+0000","last_undegraded":"2024-04-25T09:03:34.293176+0000","last_fullsized":"2024-04-25T09:03:34.293176+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:37.733654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284185+0000","last_change":"2024-04-25T09:03:34.280990+0000","last_active":"2024-04-25T09:03:34.284185+0000","last_peered":"2024-04-25T09:03:34.284185+0000","last_clean":"2024-04-25T09:03:34.284185+0000","last_became_active":"2024-04-25T09:03:34.280681+0000","last_became_peered":"2024-04-25T09:03:34.280681+0000","last_unstale":"2024-04-25T09:03:34.284185+0000","last_undegraded":"2024-04-25T09:03:34.284185+0000","last_fullsized":"2024-04-25T09:03:34.284185+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:53.463830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.285952+0000","last_change":"2024-04-25T09:03:33.278683+0000","last_active":"2024-04-25T09:03:34.285952+0000","last_peered":"2024-04-25T09:03:34.285952+0000","last_clean":"2024-04-25T09:03:34.285952+0000","last_became_active":"2024-04-25T09:03:33.278177+0000","last_became_peered":"2024-04-25T09:03:33.278177+0000","last_unstale":"2024-04-25T09:03:34.285952+0000","last_undegraded":"2024-04-25T09:03:34.285952+0000","last_fullsized":"2024-04-25T09:03:34.285952+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:58.361274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638918+0000","last_change":"2024-04-25T09:03:34.288496+0000","last_active":"2024-04-25T09:03:35.638918+0000","last_peered":"2024-04-25T09:03:35.638918+0000","last_clean":"2024-04-25T09:03:35.638918+0000","last_became_active":"2024-04-25T09:03:34.288218+0000","last_became_peered":"2024-04-25T09:03:34.288218+0000","last_unstale":"2024-04-25T09:03:35.638918+0000","last_undegraded":"2024-04-25T09:03:35.638918+0000","last_fullsized":"2024-04-25T09:03:35.638918+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:36.746101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284560+0000","last_change":"2024-04-25T09:03:33.269768+0000","last_active":"2024-04-25T09:03:34.284560+0000","last_peered":"2024-04-25T09:03:34.284560+0000","last_clean":"2024-04-25T09:03:34.284560+0000","last_became_active":"2024-04-25T09:03:33.269296+0000","last_became_peered":"2024-04-25T09:03:33.269296+0000","last_unstale":"2024-04-25T09:03:34.284560+0000","last_undegraded":"2024-04-25T09:03:34.284560+0000","last_fullsized":"2024-04-25T09:03:34.284560+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:56.304107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.295975+0000","last_change":"2024-04-25T09:03:34.292796+0000","last_active":"2024-04-25T09:03:34.295975+0000","last_peered":"2024-04-25T09:03:34.295975+0000","last_clean":"2024-04-25T09:03:34.295975+0000","last_became_active":"2024-04-25T09:03:34.292548+0000","last_became_peered":"2024-04-25T09:03:34.292548+0000","last_unstale":"2024-04-25T09:03:34.295975+0000","last_undegraded":"2024-04-25T09:03:34.295975+0000","last_fullsized":"2024-04-25T09:03:34.295975+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:54.643348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.292124+0000","last_change":"2024-04-25T09:03:33.273188+0000","last_active":"2024-04-25T09:03:34.292124+0000","last_peered":"2024-04-25T09:03:34.292124+0000","last_clean":"2024-04-25T09:03:34.292124+0000","last_became_active":"2024-04-25T09:03:33.272903+0000","last_became_peered":"2024-04-25T09:03:33.272903+0000","last_unstale":"2024-04-25T09:03:34.292124+0000","last_undegraded":"2024-04-25T09:03:34.292124+0000","last_fullsized":"2024-04-25T09:03:34.292124+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:36.437928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284516+0000","last_change":"2024-04-25T09:03:34.283089+0000","last_active":"2024-04-25T09:03:34.284516+0000","last_peered":"2024-04-25T09:03:34.284516+0000","last_clean":"2024-04-25T09:03:34.284516+0000","last_became_active":"2024-04-25T09:03:34.282773+0000","last_became_peered":"2024-04-25T09:03:34.282773+0000","last_unstale":"2024-04-25T09:03:34.284516+0000","last_undegraded":"2024-04-25T09:03:34.284516+0000","last_fullsized":"2024-04-25T09:03:34.284516+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:16.343669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.267871+0000","last_change":"2024-04-25T09:03:33.277534+0000","last_active":"2024-04-25T09:03:34.267871+0000","last_peered":"2024-04-25T09:03:34.267871+0000","last_clean":"2024-04-25T09:03:34.267871+0000","last_became_active":"2024-04-25T09:03:33.277231+0000","last_became_peered":"2024-04-25T09:03:33.277231+0000","last_unstale":"2024-04-25T09:03:34.267871+0000","last_undegraded":"2024-04-25T09:03:34.267871+0000","last_fullsized":"2024-04-25T09:03:34.267871+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:22.307202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282837+0000","last_change":"2024-04-25T09:03:34.279284+0000","last_active":"2024-04-25T09:03:34.282837+0000","last_peered":"2024-04-25T09:03:34.282837+0000","last_clean":"2024-04-25T09:03:34.282837+0000","last_became_active":"2024-04-25T09:03:34.279031+0000","last_became_peered":"2024-04-25T09:03:34.279031+0000","last_unstale":"2024-04-25T09:03:34.282837+0000","last_undegraded":"2024-04-25T09:03:34.282837+0000","last_fullsized":"2024-04-25T09:03:34.282837+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:28.678482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.639023+0000","last_change":"2024-04-25T09:03:33.281406+0000","last_active":"2024-04-25T09:03:35.639023+0000","last_peered":"2024-04-25T09:03:35.639023+0000","last_clean":"2024-04-25T09:03:35.639023+0000","last_became_active":"2024-04-25T09:03:33.281081+0000","last_became_peered":"2024-04-25T09:03:33.281081+0000","last_unstale":"2024-04-25T09:03:35.639023+0000","last_undegraded":"2024-04-25T09:03:35.639023+0000","last_fullsized":"2024-04-25T09:03:35.639023+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:40.672565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.286357+0000","last_change":"2024-04-25T09:03:34.279623+0000","last_active":"2024-04-25T09:03:34.286357+0000","last_peered":"2024-04-25T09:03:34.286357+0000","last_clean":"2024-04-25T09:03:34.286357+0000","last_became_active":"2024-04-25T09:03:34.279331+0000","last_became_peered":"2024-04-25T09:03:34.279331+0000","last_unstale":"2024-04-25T09:03:34.286357+0000","last_undegraded":"2024-04-25T09:03:34.286357+0000","last_fullsized":"2024-04-25T09:03:34.286357+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:00.515548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.262793+0000","last_change":"2024-04-25T09:03:33.276115+0000","last_active":"2024-04-25T09:03:34.262793+0000","last_peered":"2024-04-25T09:03:34.262793+0000","last_clean":"2024-04-25T09:03:34.262793+0000","last_became_active":"2024-04-25T09:03:33.273933+0000","last_became_peered":"2024-04-25T09:03:33.273933+0000","last_unstale":"2024-04-25T09:03:34.262793+0000","last_undegraded":"2024-04-25T09:03:34.262793+0000","last_fullsized":"2024-04-25T09:03:34.262793+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:53.524426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294688+0000","last_change":"2024-04-25T09:03:34.289693+0000","last_active":"2024-04-25T09:03:34.294688+0000","last_peered":"2024-04-25T09:03:34.294688+0000","last_clean":"2024-04-25T09:03:34.294688+0000","last_became_active":"2024-04-25T09:03:34.289334+0000","last_became_peered":"2024-04-25T09:03:34.289334+0000","last_unstale":"2024-04-25T09:03:34.294688+0000","last_undegraded":"2024-04-25T09:03:34.294688+0000","last_fullsized":"2024-04-25T09:03:34.294688+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:45.912269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638848+0000","last_change":"2024-04-25T09:03:33.278180+0000","last_active":"2024-04-25T09:03:35.638848+0000","last_peered":"2024-04-25T09:03:35.638848+0000","last_clean":"2024-04-25T09:03:35.638848+0000","last_became_active":"2024-04-25T09:03:33.277887+0000","last_became_peered":"2024-04-25T09:03:33.277887+0000","last_unstale":"2024-04-25T09:03:35.638848+0000","last_undegraded":"2024-04-25T09:03:35.638848+0000","last_fullsized":"2024-04-25T09:03:35.638848+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:19.575309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291819+0000","last_change":"2024-04-25T09:03:34.280838+0000","last_active":"2024-04-25T09:03:34.291819+0000","last_peered":"2024-04-25T09:03:34.291819+0000","last_clean":"2024-04-25T09:03:34.291819+0000","last_became_active":"2024-04-25T09:03:34.280537+0000","last_became_peered":"2024-04-25T09:03:34.280537+0000","last_unstale":"2024-04-25T09:03:34.291819+0000","last_undegraded":"2024-04-25T09:03:34.291819+0000","last_fullsized":"2024-04-25T09:03:34.291819+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:28.451715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.274013+0000","last_change":"2024-04-25T09:03:33.278084+0000","last_active":"2024-04-25T09:03:34.274013+0000","last_peered":"2024-04-25T09:03:34.274013+0000","last_clean":"2024-04-25T09:03:34.274013+0000","last_became_active":"2024-04-25T09:03:33.275867+0000","last_became_peered":"2024-04-25T09:03:33.275867+0000","last_unstale":"2024-04-25T09:03:34.274013+0000","last_undegraded":"2024-04-25T09:03:34.274013+0000","last_fullsized":"2024-04-25T09:03:34.274013+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:02.247226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.286277+0000","last_change":"2024-04-25T09:03:34.284891+0000","last_active":"2024-04-25T09:03:34.286277+0000","last_peered":"2024-04-25T09:03:34.286277+0000","last_clean":"2024-04-25T09:03:34.286277+0000","last_became_active":"2024-04-25T09:03:34.284567+0000","last_became_peered":"2024-04-25T09:03:34.284567+0000","last_unstale":"2024-04-25T09:03:34.286277+0000","last_undegraded":"2024-04-25T09:03:34.286277+0000","last_fullsized":"2024-04-25T09:03:34.286277+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:32.417692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.280102+0000","last_change":"2024-04-25T09:03:33.274444+0000","last_active":"2024-04-25T09:03:34.280102+0000","last_peered":"2024-04-25T09:03:34.280102+0000","last_clean":"2024-04-25T09:03:34.280102+0000","last_became_active":"2024-04-25T09:03:33.271957+0000","last_became_peered":"2024-04-25T09:03:33.271957+0000","last_unstale":"2024-04-25T09:03:34.280102+0000","last_undegraded":"2024-04-25T09:03:34.280102+0000","last_fullsized":"2024-04-25T09:03:34.280102+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:31.368923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.289390+0000","last_change":"2024-04-25T09:03:34.286234+0000","last_active":"2024-04-25T09:03:34.289390+0000","last_peered":"2024-04-25T09:03:34.289390+0000","last_clean":"2024-04-25T09:03:34.289390+0000","last_became_active":"2024-04-25T09:03:34.285855+0000","last_became_peered":"2024-04-25T09:03:34.285855+0000","last_unstale":"2024-04-25T09:03:34.289390+0000","last_undegraded":"2024-04-25T09:03:34.289390+0000","last_fullsized":"2024-04-25T09:03:34.289390+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:34.636706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.262771+0000","last_change":"2024-04-25T09:03:33.271803+0000","last_active":"2024-04-25T09:03:34.262771+0000","last_peered":"2024-04-25T09:03:34.262771+0000","last_clean":"2024-04-25T09:03:34.262771+0000","last_became_active":"2024-04-25T09:03:33.271457+0000","last_became_peered":"2024-04-25T09:03:33.271457+0000","last_unstale":"2024-04-25T09:03:34.262771+0000","last_undegraded":"2024-04-25T09:03:34.262771+0000","last_fullsized":"2024-04-25T09:03:34.262771+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:07.461238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294081+0000","last_change":"2024-04-25T09:03:34.291493+0000","last_active":"2024-04-25T09:03:34.294081+0000","last_peered":"2024-04-25T09:03:34.294081+0000","last_clean":"2024-04-25T09:03:34.294081+0000","last_became_active":"2024-04-25T09:03:34.290924+0000","last_became_peered":"2024-04-25T09:03:34.290924+0000","last_unstale":"2024-04-25T09:03:34.294081+0000","last_undegraded":"2024-04-25T09:03:34.294081+0000","last_fullsized":"2024-04-25T09:03:34.294081+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:09.161119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.267731+0000","last_change":"2024-04-25T09:03:33.279583+0000","last_active":"2024-04-25T09:03:34.267731+0000","last_peered":"2024-04-25T09:03:34.267731+0000","last_clean":"2024-04-25T09:03:34.267731+0000","last_became_active":"2024-04-25T09:03:33.279148+0000","last_became_peered":"2024-04-25T09:03:33.279148+0000","last_unstale":"2024-04-25T09:03:34.267731+0000","last_undegraded":"2024-04-25T09:03:34.267731+0000","last_fullsized":"2024-04-25T09:03:34.267731+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:56.395132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282502+0000","last_change":"2024-04-25T09:03:34.278987+0000","last_active":"2024-04-25T09:03:34.282502+0000","last_peered":"2024-04-25T09:03:34.282502+0000","last_clean":"2024-04-25T09:03:34.282502+0000","last_became_active":"2024-04-25T09:03:34.278689+0000","last_became_peered":"2024-04-25T09:03:34.278689+0000","last_unstale":"2024-04-25T09:03:34.282502+0000","last_undegraded":"2024-04-25T09:03:34.282502+0000","last_fullsized":"2024-04-25T09:03:34.282502+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:16.343669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.263152+0000","last_change":"2024-04-25T09:03:33.272491+0000","last_active":"2024-04-25T09:03:34.263152+0000","last_peered":"2024-04-25T09:03:34.263152+0000","last_clean":"2024-04-25T09:03:34.263152+0000","last_became_active":"2024-04-25T09:03:33.272203+0000","last_became_peered":"2024-04-25T09:03:33.272203+0000","last_unstale":"2024-04-25T09:03:34.263152+0000","last_undegraded":"2024-04-25T09:03:34.263152+0000","last_fullsized":"2024-04-25T09:03:34.263152+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:31.415505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.274042+0000","last_change":"2024-04-25T09:03:34.273011+0000","last_active":"2024-04-25T09:03:34.274042+0000","last_peered":"2024-04-25T09:03:34.274042+0000","last_clean":"2024-04-25T09:03:34.274042+0000","last_became_active":"2024-04-25T09:03:34.272725+0000","last_became_peered":"2024-04-25T09:03:34.272725+0000","last_unstale":"2024-04-25T09:03:34.274042+0000","last_undegraded":"2024-04-25T09:03:34.274042+0000","last_fullsized":"2024-04-25T09:03:34.274042+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:08.463426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.268585+0000","last_change":"2024-04-25T09:03:33.273232+0000","last_active":"2024-04-25T09:03:34.268585+0000","last_peered":"2024-04-25T09:03:34.268585+0000","last_clean":"2024-04-25T09:03:34.268585+0000","last_became_active":"2024-04-25T09:03:33.272651+0000","last_became_peered":"2024-04-25T09:03:33.272651+0000","last_unstale":"2024-04-25T09:03:34.268585+0000","last_undegraded":"2024-04-25T09:03:34.268585+0000","last_fullsized":"2024-04-25T09:03:34.268585+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:02.995246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.272471+0000","last_change":"2024-04-25T09:03:34.271367+0000","last_active":"2024-04-25T09:03:34.272471+0000","last_peered":"2024-04-25T09:03:34.272471+0000","last_clean":"2024-04-25T09:03:34.272471+0000","last_became_active":"2024-04-25T09:03:34.271062+0000","last_became_peered":"2024-04-25T09:03:34.271062+0000","last_unstale":"2024-04-25T09:03:34.272471+0000","last_undegraded":"2024-04-25T09:03:34.272471+0000","last_fullsized":"2024-04-25T09:03:34.272471+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:56.651875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.266236+0000","last_change":"2024-04-25T09:03:33.273771+0000","last_active":"2024-04-25T09:03:34.266236+0000","last_peered":"2024-04-25T09:03:34.266236+0000","last_clean":"2024-04-25T09:03:34.266236+0000","last_became_active":"2024-04-25T09:03:33.273487+0000","last_became_peered":"2024-04-25T09:03:33.273487+0000","last_unstale":"2024-04-25T09:03:34.266236+0000","last_undegraded":"2024-04-25T09:03:34.266236+0000","last_fullsized":"2024-04-25T09:03:34.266236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:31.153093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.285235+0000","last_change":"2024-04-25T09:03:34.284172+0000","last_active":"2024-04-25T09:03:34.285235+0000","last_peered":"2024-04-25T09:03:34.285235+0000","last_clean":"2024-04-25T09:03:34.285235+0000","last_became_active":"2024-04-25T09:03:34.283887+0000","last_became_peered":"2024-04-25T09:03:34.283887+0000","last_unstale":"2024-04-25T09:03:34.285235+0000","last_undegraded":"2024-04-25T09:03:34.285235+0000","last_fullsized":"2024-04-25T09:03:34.285235+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:32.417692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.261697+0000","last_change":"2024-04-25T09:03:33.274367+0000","last_active":"2024-04-25T09:03:34.261697+0000","last_peered":"2024-04-25T09:03:34.261697+0000","last_clean":"2024-04-25T09:03:34.261697+0000","last_became_active":"2024-04-25T09:03:33.272149+0000","last_became_peered":"2024-04-25T09:03:33.272149+0000","last_unstale":"2024-04-25T09:03:34.261697+0000","last_undegraded":"2024-04-25T09:03:34.261697+0000","last_fullsized":"2024-04-25T09:03:34.261697+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:48.845902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.290233+0000","last_change":"2024-04-25T09:03:34.288118+0000","last_active":"2024-04-25T09:03:34.290233+0000","last_peered":"2024-04-25T09:03:34.290233+0000","last_clean":"2024-04-25T09:03:34.290233+0000","last_became_active":"2024-04-25T09:03:34.287546+0000","last_became_peered":"2024-04-25T09:03:34.287546+0000","last_unstale":"2024-04-25T09:03:34.290233+0000","last_undegraded":"2024-04-25T09:03:34.290233+0000","last_fullsized":"2024-04-25T09:03:34.290233+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:23.787585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.274207+0000","last_change":"2024-04-25T09:03:33.276734+0000","last_active":"2024-04-25T09:03:34.274207+0000","last_peered":"2024-04-25T09:03:34.274207+0000","last_clean":"2024-04-25T09:03:34.274207+0000","last_became_active":"2024-04-25T09:03:33.271787+0000","last_became_peered":"2024-04-25T09:03:33.271787+0000","last_unstale":"2024-04-25T09:03:34.274207+0000","last_undegraded":"2024-04-25T09:03:34.274207+0000","last_fullsized":"2024-04-25T09:03:34.274207+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:46.455727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282458+0000","last_change":"2024-04-25T09:03:34.275902+0000","last_active":"2024-04-25T09:03:34.282458+0000","last_peered":"2024-04-25T09:03:34.282458+0000","last_clean":"2024-04-25T09:03:34.282458+0000","last_became_active":"2024-04-25T09:03:34.275565+0000","last_became_peered":"2024-04-25T09:03:34.275565+0000","last_unstale":"2024-04-25T09:03:34.282458+0000","last_undegraded":"2024-04-25T09:03:34.282458+0000","last_fullsized":"2024-04-25T09:03:34.282458+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:44.141551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.266927+0000","last_change":"2024-04-25T09:03:33.277462+0000","last_active":"2024-04-25T09:03:34.266927+0000","last_peered":"2024-04-25T09:03:34.266927+0000","last_clean":"2024-04-25T09:03:34.266927+0000","last_became_active":"2024-04-25T09:03:33.277149+0000","last_became_peered":"2024-04-25T09:03:33.277149+0000","last_unstale":"2024-04-25T09:03:34.266927+0000","last_undegraded":"2024-04-25T09:03:34.266927+0000","last_fullsized":"2024-04-25T09:03:34.266927+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:43.498929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":338,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.270387+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T09:03:34.270387+0000","last_peered":"2024-04-25T09:03:34.270387+0000","last_clean":"2024-04-25T09:03:34.270387+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:03:34.270387+0000","last_undegraded":"2024-04-25T09:03:34.270387+0000","last_fullsized":"2024-04-25T09:03:34.270387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509565,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":1990656,"data_stored":1192332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":601964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509565,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":601964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509564,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1409024,"data_stored":608739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509564,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1425408,"data_stored":610421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509566,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":601964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509564,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2023424,"data_stored":1200831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":615163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:03:37.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:03:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.415+0000 7f5967ee1640 1 Processor -- start 2024-04-25T09:03:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.415+0000 7f5967ee1640 1 -- start start 2024-04-25T09:03:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.416+0000 7f5967ee1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f596015dce0 0x7f59600d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.416+0000 7f5967ee1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d35b0 0x7f59600b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.416+0000 7f5967ee1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596015e0c0 con 0x7f59600d1f90 2024-04-25T09:03:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.416+0000 7f5967ee1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59600b7b10 con 0x7f596015dce0 2024-04-25T09:03:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.416+0000 7f5967ee1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59600d2510 con 0x7f59600d35b0 2024-04-25T09:03:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.416+0000 7f596547c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d35b0 0x7f59600b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.416+0000 7f5965c7d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f596015dce0 0x7f59600d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.416+0000 7f596547c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d35b0 0x7f59600b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:55380/0 (socket says 172.21.15.55:55380) 2024-04-25T09:03:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.416+0000 7f596547c640 1 -- 172.21.15.55:0/748937723 learned_addr learned my addr 172.21.15.55:0/748937723 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.416+0000 7f5965c7d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f596015dce0 0x7f59600d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:50878/0 (socket says 172.21.15.55:50878) 2024-04-25T09:03:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.417+0000 7f596547c640 1 -- 172.21.15.55:0/748937723 >> v2:172.21.15.167:3300/0 conn(0x7f596015dce0 msgr2=0x7f59600d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.417+0000 7f596547c640 1 --2- 172.21.15.55:0/748937723 >> v2:172.21.15.167:3300/0 conn(0x7f596015dce0 0x7f59600d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.417+0000 7f596547c640 1 -- 172.21.15.55:0/748937723 >> v1:172.21.15.167:6789/0 conn(0x7f59600d1f90 legacy=0x7f596006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.417+0000 7f596547c640 1 -- 172.21.15.55:0/748937723 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600d27f0 con 0x7f59600d35b0 2024-04-25T09:03:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.417+0000 7f5965c7d640 1 --2- 172.21.15.55:0/748937723 >> v2:172.21.15.167:3300/0 conn(0x7f596015dce0 0x7f59600d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.418+0000 7f596547c640 1 --2- 172.21.15.55:0/748937723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d35b0 0x7f59600b5450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5950009870 tx=0x7f595002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe75ea49e4fd6e8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.418+0000 7f5964c7b640 1 -- 172.21.15.55:0/748937723 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950037070 con 0x7f59600d35b0 2024-04-25T09:03:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.418+0000 7f5964c7b640 1 -- 172.21.15.55:0/748937723 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5950032440 con 0x7f59600d35b0 2024-04-25T09:03:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.418+0000 7f5964c7b640 1 -- 172.21.15.55:0/748937723 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950032810 con 0x7f59600d35b0 2024-04-25T09:03:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.418+0000 7f5967ee1640 1 -- 172.21.15.55:0/748937723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d35b0 msgr2=0x7f59600b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.418+0000 7f5967ee1640 1 --2- 172.21.15.55:0/748937723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d35b0 0x7f59600b5450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5950009870 tx=0x7f595002a1c0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.418+0000 7f5967ee1640 1 -- 172.21.15.55:0/748937723 shutdown_connections 2024-04-25T09:03:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.418+0000 7f5967ee1640 1 --2- 172.21.15.55:0/748937723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d35b0 0x7f59600b5450 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.418+0000 7f5967ee1640 1 --2- 172.21.15.55:0/748937723 >> v2:172.21.15.167:3300/0 conn(0x7f596015dce0 0x7f59600d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.418+0000 7f5967ee1640 1 -- 172.21.15.55:0/748937723 >> 172.21.15.55:0/748937723 conn(0x7f5960072900 msgr2=0x7f59600d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.419+0000 7f5967ee1640 1 -- 172.21.15.55:0/748937723 shutdown_connections 2024-04-25T09:03:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.419+0000 7f5967ee1640 1 -- 172.21.15.55:0/748937723 wait complete. 2024-04-25T09:03:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.420+0000 7f5967ee1640 1 Processor -- start 2024-04-25T09:03:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.420+0000 7f5967ee1640 1 -- start start 2024-04-25T09:03:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.420+0000 7f5967ee1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d1f90 0x7f59600cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.420+0000 7f5967ee1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59600d35b0 0x7f596015e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.420+0000 7f5967ee1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596015dce0 0x7f596015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.420+0000 7f5967ee1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600d3090 con 0x7f596015dce0 2024-04-25T09:03:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.420+0000 7f5967ee1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600d2db0 con 0x7f59600d35b0 2024-04-25T09:03:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.420+0000 7f5967ee1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59600b9820 con 0x7f59600d1f90 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f596647e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596015dce0 0x7f596015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f596647e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596015dce0 0x7f596015e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58866/0 (socket says 172.21.15.55:58866) 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f596647e640 1 -- 172.21.15.55:0/2008705372 learned_addr learned my addr 172.21.15.55:0/2008705372 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f5965c7d640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d1f90 0x7f59600cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f596547c640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59600d35b0 0x7f596015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f596647e640 1 -- 172.21.15.55:0/2008705372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d1f90 msgr2=0x7f59600cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f596647e640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d1f90 0x7f59600cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f596647e640 1 -- 172.21.15.55:0/2008705372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59600d35b0 msgr2=0x7f596015e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f596647e640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59600d35b0 0x7f596015e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f596647e640 1 -- 172.21.15.55:0/2008705372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600cbaf0 con 0x7f596015dce0 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f596647e640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596015dce0 0x7f596015e8d0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f595800c6b0 tx=0x7f595800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f59567fc640 1 -- 172.21.15.55:0/2008705372 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958003b70 con 0x7f596015dce0 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f59567fc640 1 -- 172.21.15.55:0/2008705372 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5958003d30 con 0x7f596015dce0 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f5967ee1640 1 -- 172.21.15.55:0/2008705372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59600cbdd0 con 0x7f596015dce0 2024-04-25T09:03:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f59567fc640 1 -- 172.21.15.55:0/2008705372 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958005310 con 0x7f596015dce0 2024-04-25T09:03:37.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.421+0000 7f5967ee1640 1 -- 172.21.15.55:0/2008705372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59600cc390 con 0x7f596015dce0 2024-04-25T09:03:37.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.423+0000 7f5967ee1640 1 -- 172.21.15.55:0/2008705372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59600749b0 con 0x7f596015dce0 2024-04-25T09:03:37.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.423+0000 7f59567fc640 1 -- 172.21.15.55:0/2008705372 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f59580054b0 con 0x7f596015dce0 2024-04-25T09:03:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.423+0000 7f59567fc640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f594406b4d0 0x7f594406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.423+0000 7f59567fc640 1 -- 172.21.15.55:0/2008705372 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f595808a060 con 0x7f596015dce0 2024-04-25T09:03:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.423+0000 7f5965c7d640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f594406b4d0 0x7f594406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.424+0000 7f5965c7d640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f594406b4d0 0x7f594406d990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f595c009560 tx=0x7f595c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.428+0000 7f59567fc640 1 -- 172.21.15.55:0/2008705372 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5958058ee0 con 0x7f596015dce0 2024-04-25T09:03:37.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.607+0000 7f5967ee1640 1 -- 172.21.15.55:0/2008705372 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5960067e10 con 0x7f594406b4d0 2024-04-25T09:03:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.613+0000 7f59567fc640 1 -- 172.21.15.55:0/2008705372 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252420 (secure 0 0 0) 0x7f5960067e10 con 0x7f594406b4d0 2024-04-25T09:03:37.604 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 -- 172.21.15.55:0/2008705372 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f594406b4d0 msgr2=0x7f594406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f594406b4d0 0x7f594406d990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f595c009560 tx=0x7f595c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 -- 172.21.15.55:0/2008705372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596015dce0 msgr2=0x7f596015e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596015dce0 0x7f596015e8d0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f595800c6b0 tx=0x7f595800cb70 comp rx=0 tx=0).stop 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 -- 172.21.15.55:0/2008705372 shutdown_connections 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f594406b4d0 0x7f594406d990 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596015dce0 0x7f596015e8d0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59600d35b0 0x7f596015e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 --2- 172.21.15.55:0/2008705372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59600d1f90 0x7f59600cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 -- 172.21.15.55:0/2008705372 >> 172.21.15.55:0/2008705372 conn(0x7f5960072900 msgr2=0x7f59600b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 -- 172.21.15.55:0/2008705372 shutdown_connections 2024-04-25T09:03:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.616+0000 7f5967ee1640 1 -- 172.21.15.55:0/2008705372 wait complete. 2024-04-25T09:03:37.615 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":413,"stamp":"2024-04-25T09:03:36.688696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265796,"kb_used_data":12176,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754708924,"statfs":{"total":773094113280,"available":772821938176,"internally_reserved":0,"allocated":12468224,"data_stored":6033378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.435288"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.288317+0000","last_change":"2024-04-25T09:03:34.284312+0000","last_active":"2024-04-25T09:03:34.288317+0000","last_peered":"2024-04-25T09:03:34.288317+0000","last_clean":"2024-04-25T09:03:34.288317+0000","last_became_active":"2024-04-25T09:03:34.284021+0000","last_became_peered":"2024-04-25T09:03:34.284021+0000","last_unstale":"2024-04-25T09:03:34.288317+0000","last_undegraded":"2024-04-25T09:03:34.288317+0000","last_fullsized":"2024-04-25T09:03:34.288317+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:59.422034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.295841+0000","last_change":"2024-04-25T09:03:34.290162+0000","last_active":"2024-04-25T09:03:34.295841+0000","last_peered":"2024-04-25T09:03:34.295841+0000","last_clean":"2024-04-25T09:03:34.295841+0000","last_became_active":"2024-04-25T09:03:34.289896+0000","last_became_peered":"2024-04-25T09:03:34.289896+0000","last_unstale":"2024-04-25T09:03:34.295841+0000","last_undegraded":"2024-04-25T09:03:34.295841+0000","last_fullsized":"2024-04-25T09:03:34.295841+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:45.912269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282162+0000","last_change":"2024-04-25T09:03:34.276928+0000","last_active":"2024-04-25T09:03:34.282162+0000","last_peered":"2024-04-25T09:03:34.282162+0000","last_clean":"2024-04-25T09:03:34.282162+0000","last_became_active":"2024-04-25T09:03:34.276657+0000","last_became_peered":"2024-04-25T09:03:34.276657+0000","last_unstale":"2024-04-25T09:03:34.282162+0000","last_undegraded":"2024-04-25T09:03:34.282162+0000","last_fullsized":"2024-04-25T09:03:34.282162+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:17.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291117+0000","last_change":"2024-04-25T09:03:34.285433+0000","last_active":"2024-04-25T09:03:34.291117+0000","last_peered":"2024-04-25T09:03:34.291117+0000","last_clean":"2024-04-25T09:03:34.291117+0000","last_became_active":"2024-04-25T09:03:34.285175+0000","last_became_peered":"2024-04-25T09:03:34.285175+0000","last_unstale":"2024-04-25T09:03:34.291117+0000","last_undegraded":"2024-04-25T09:03:34.291117+0000","last_fullsized":"2024-04-25T09:03:34.291117+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:39.106644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284267+0000","last_change":"2024-04-25T09:03:34.282106+0000","last_active":"2024-04-25T09:03:34.284267+0000","last_peered":"2024-04-25T09:03:34.284267+0000","last_clean":"2024-04-25T09:03:34.284267+0000","last_became_active":"2024-04-25T09:03:34.281811+0000","last_became_peered":"2024-04-25T09:03:34.281811+0000","last_unstale":"2024-04-25T09:03:34.284267+0000","last_undegraded":"2024-04-25T09:03:34.284267+0000","last_fullsized":"2024-04-25T09:03:34.284267+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:12.152348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638789+0000","last_change":"2024-04-25T09:03:34.287973+0000","last_active":"2024-04-25T09:03:35.638789+0000","last_peered":"2024-04-25T09:03:35.638789+0000","last_clean":"2024-04-25T09:03:35.638789+0000","last_became_active":"2024-04-25T09:03:34.287188+0000","last_became_peered":"2024-04-25T09:03:34.287188+0000","last_unstale":"2024-04-25T09:03:35.638789+0000","last_undegraded":"2024-04-25T09:03:35.638789+0000","last_fullsized":"2024-04-25T09:03:35.638789+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:34.798354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.276112+0000","last_change":"2024-04-25T09:03:34.270990+0000","last_active":"2024-04-25T09:03:34.276112+0000","last_peered":"2024-04-25T09:03:34.276112+0000","last_clean":"2024-04-25T09:03:34.276112+0000","last_became_active":"2024-04-25T09:03:34.270443+0000","last_became_peered":"2024-04-25T09:03:34.270443+0000","last_unstale":"2024-04-25T09:03:34.276112+0000","last_undegraded":"2024-04-25T09:03:34.276112+0000","last_fullsized":"2024-04-25T09:03:34.276112+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:59.655500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.295943+0000","last_change":"2024-04-25T09:03:34.291423+0000","last_active":"2024-04-25T09:03:34.295943+0000","last_peered":"2024-04-25T09:03:34.295943+0000","last_clean":"2024-04-25T09:03:34.295943+0000","last_became_active":"2024-04-25T09:03:34.291191+0000","last_became_peered":"2024-04-25T09:03:34.291191+0000","last_unstale":"2024-04-25T09:03:34.295943+0000","last_undegraded":"2024-04-25T09:03:34.295943+0000","last_fullsized":"2024-04-25T09:03:34.295943+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:59.512760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.288299+0000","last_change":"2024-04-25T09:03:34.284017+0000","last_active":"2024-04-25T09:03:34.288299+0000","last_peered":"2024-04-25T09:03:34.288299+0000","last_clean":"2024-04-25T09:03:34.288299+0000","last_became_active":"2024-04-25T09:03:34.283689+0000","last_became_peered":"2024-04-25T09:03:34.283689+0000","last_unstale":"2024-04-25T09:03:34.288299+0000","last_undegraded":"2024-04-25T09:03:34.288299+0000","last_fullsized":"2024-04-25T09:03:34.288299+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:15.703522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.286469+0000","last_change":"2024-04-25T09:03:34.279031+0000","last_active":"2024-04-25T09:03:34.286469+0000","last_peered":"2024-04-25T09:03:34.286469+0000","last_clean":"2024-04-25T09:03:34.286469+0000","last_became_active":"2024-04-25T09:03:34.278459+0000","last_became_peered":"2024-04-25T09:03:34.278459+0000","last_unstale":"2024-04-25T09:03:34.286469+0000","last_undegraded":"2024-04-25T09:03:34.286469+0000","last_fullsized":"2024-04-25T09:03:34.286469+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:43.809728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284060+0000","last_change":"2024-04-25T09:03:34.279068+0000","last_active":"2024-04-25T09:03:34.284060+0000","last_peered":"2024-04-25T09:03:34.284060+0000","last_clean":"2024-04-25T09:03:34.284060+0000","last_became_active":"2024-04-25T09:03:34.278783+0000","last_became_peered":"2024-04-25T09:03:34.278783+0000","last_unstale":"2024-04-25T09:03:34.284060+0000","last_undegraded":"2024-04-25T09:03:34.284060+0000","last_fullsized":"2024-04-25T09:03:34.284060+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:16.343669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291630+0000","last_change":"2024-04-25T09:03:34.287049+0000","last_active":"2024-04-25T09:03:34.291630+0000","last_peered":"2024-04-25T09:03:34.291630+0000","last_clean":"2024-04-25T09:03:34.291630+0000","last_became_active":"2024-04-25T09:03:34.286776+0000","last_became_peered":"2024-04-25T09:03:34.286776+0000","last_unstale":"2024-04-25T09:03:34.291630+0000","last_undegraded":"2024-04-25T09:03:34.291630+0000","last_fullsized":"2024-04-25T09:03:34.291630+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:26.066243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294637+0000","last_change":"2024-04-25T09:03:34.289549+0000","last_active":"2024-04-25T09:03:34.294637+0000","last_peered":"2024-04-25T09:03:34.294637+0000","last_clean":"2024-04-25T09:03:34.294637+0000","last_became_active":"2024-04-25T09:03:34.289243+0000","last_became_peered":"2024-04-25T09:03:34.289243+0000","last_unstale":"2024-04-25T09:03:34.294637+0000","last_undegraded":"2024-04-25T09:03:34.294637+0000","last_fullsized":"2024-04-25T09:03:34.294637+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:58.452354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.285216+0000","last_change":"2024-04-25T09:03:34.283570+0000","last_active":"2024-04-25T09:03:34.285216+0000","last_peered":"2024-04-25T09:03:34.285216+0000","last_clean":"2024-04-25T09:03:34.285216+0000","last_became_active":"2024-04-25T09:03:34.283282+0000","last_became_peered":"2024-04-25T09:03:34.283282+0000","last_unstale":"2024-04-25T09:03:34.285216+0000","last_undegraded":"2024-04-25T09:03:34.285216+0000","last_fullsized":"2024-04-25T09:03:34.285216+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:32.371110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638741+0000","last_change":"2024-04-25T09:03:34.278728+0000","last_active":"2024-04-25T09:03:35.638741+0000","last_peered":"2024-04-25T09:03:35.638741+0000","last_clean":"2024-04-25T09:03:35.638741+0000","last_became_active":"2024-04-25T09:03:34.278454+0000","last_became_peered":"2024-04-25T09:03:34.278454+0000","last_unstale":"2024-04-25T09:03:35.638741+0000","last_undegraded":"2024-04-25T09:03:35.638741+0000","last_fullsized":"2024-04-25T09:03:35.638741+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:02.289175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291872+0000","last_change":"2024-04-25T09:03:34.284396+0000","last_active":"2024-04-25T09:03:34.291872+0000","last_peered":"2024-04-25T09:03:34.291872+0000","last_clean":"2024-04-25T09:03:34.291872+0000","last_became_active":"2024-04-25T09:03:34.283756+0000","last_became_peered":"2024-04-25T09:03:34.283756+0000","last_unstale":"2024-04-25T09:03:34.291872+0000","last_undegraded":"2024-04-25T09:03:34.291872+0000","last_fullsized":"2024-04-25T09:03:34.291872+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:21.874881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.285370+0000","last_change":"2024-04-25T09:03:34.281933+0000","last_active":"2024-04-25T09:03:34.285370+0000","last_peered":"2024-04-25T09:03:34.285370+0000","last_clean":"2024-04-25T09:03:34.285370+0000","last_became_active":"2024-04-25T09:03:34.281388+0000","last_became_peered":"2024-04-25T09:03:34.281388+0000","last_unstale":"2024-04-25T09:03:34.285370+0000","last_undegraded":"2024-04-25T09:03:34.285370+0000","last_fullsized":"2024-04-25T09:03:34.285370+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:57.971601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282469+0000","last_change":"2024-04-25T09:03:34.275420+0000","last_active":"2024-04-25T09:03:34.282469+0000","last_peered":"2024-04-25T09:03:34.282469+0000","last_clean":"2024-04-25T09:03:34.282469+0000","last_became_active":"2024-04-25T09:03:34.275156+0000","last_became_peered":"2024-04-25T09:03:34.275156+0000","last_unstale":"2024-04-25T09:03:34.282469+0000","last_undegraded":"2024-04-25T09:03:34.282469+0000","last_fullsized":"2024-04-25T09:03:34.282469+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:17.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294673+0000","last_change":"2024-04-25T09:03:34.289490+0000","last_active":"2024-04-25T09:03:34.294673+0000","last_peered":"2024-04-25T09:03:34.294673+0000","last_clean":"2024-04-25T09:03:34.294673+0000","last_became_active":"2024-04-25T09:03:34.289170+0000","last_became_peered":"2024-04-25T09:03:34.289170+0000","last_unstale":"2024-04-25T09:03:34.294673+0000","last_undegraded":"2024-04-25T09:03:34.294673+0000","last_fullsized":"2024-04-25T09:03:34.294673+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:57.971601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.283758+0000","last_change":"2024-04-25T09:03:34.276268+0000","last_active":"2024-04-25T09:03:34.283758+0000","last_peered":"2024-04-25T09:03:34.283758+0000","last_clean":"2024-04-25T09:03:34.283758+0000","last_became_active":"2024-04-25T09:03:34.275993+0000","last_became_peered":"2024-04-25T09:03:34.275993+0000","last_unstale":"2024-04-25T09:03:34.283758+0000","last_undegraded":"2024-04-25T09:03:34.283758+0000","last_fullsized":"2024-04-25T09:03:34.283758+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:17.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284168+0000","last_change":"2024-04-25T09:03:34.281275+0000","last_active":"2024-04-25T09:03:34.284168+0000","last_peered":"2024-04-25T09:03:34.284168+0000","last_clean":"2024-04-25T09:03:34.284168+0000","last_became_active":"2024-04-25T09:03:34.280775+0000","last_became_peered":"2024-04-25T09:03:34.280775+0000","last_unstale":"2024-04-25T09:03:34.284168+0000","last_undegraded":"2024-04-25T09:03:34.284168+0000","last_fullsized":"2024-04-25T09:03:34.284168+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:32.417692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.275373+0000","last_change":"2024-04-25T09:03:34.270150+0000","last_active":"2024-04-25T09:03:34.275373+0000","last_peered":"2024-04-25T09:03:34.275373+0000","last_clean":"2024-04-25T09:03:34.275373+0000","last_became_active":"2024-04-25T09:03:34.269860+0000","last_became_peered":"2024-04-25T09:03:34.269860+0000","last_unstale":"2024-04-25T09:03:34.275373+0000","last_undegraded":"2024-04-25T09:03:34.275373+0000","last_fullsized":"2024-04-25T09:03:34.275373+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:58.452354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.281949+0000","last_change":"2024-04-25T09:03:34.275488+0000","last_active":"2024-04-25T09:03:34.281949+0000","last_peered":"2024-04-25T09:03:34.281949+0000","last_clean":"2024-04-25T09:03:34.281949+0000","last_became_active":"2024-04-25T09:03:34.275116+0000","last_became_peered":"2024-04-25T09:03:34.275116+0000","last_unstale":"2024-04-25T09:03:34.281949+0000","last_undegraded":"2024-04-25T09:03:34.281949+0000","last_fullsized":"2024-04-25T09:03:34.281949+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:37.440115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282482+0000","last_change":"2024-04-25T09:03:34.276749+0000","last_active":"2024-04-25T09:03:34.282482+0000","last_peered":"2024-04-25T09:03:34.282482+0000","last_clean":"2024-04-25T09:03:34.282482+0000","last_became_active":"2024-04-25T09:03:34.276438+0000","last_became_peered":"2024-04-25T09:03:34.276438+0000","last_unstale":"2024-04-25T09:03:34.282482+0000","last_undegraded":"2024-04-25T09:03:34.282482+0000","last_fullsized":"2024-04-25T09:03:34.282482+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:44.160566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.283974+0000","last_change":"2024-04-25T09:03:34.280076+0000","last_active":"2024-04-25T09:03:34.283974+0000","last_peered":"2024-04-25T09:03:34.283974+0000","last_clean":"2024-04-25T09:03:34.283974+0000","last_became_active":"2024-04-25T09:03:34.279807+0000","last_became_peered":"2024-04-25T09:03:34.279807+0000","last_unstale":"2024-04-25T09:03:34.283974+0000","last_undegraded":"2024-04-25T09:03:34.283974+0000","last_fullsized":"2024-04-25T09:03:34.283974+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:32.371110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.286447+0000","last_change":"2024-04-25T09:03:34.278783+0000","last_active":"2024-04-25T09:03:34.286447+0000","last_peered":"2024-04-25T09:03:34.286447+0000","last_clean":"2024-04-25T09:03:34.286447+0000","last_became_active":"2024-04-25T09:03:34.278082+0000","last_became_peered":"2024-04-25T09:03:34.278082+0000","last_unstale":"2024-04-25T09:03:34.286447+0000","last_undegraded":"2024-04-25T09:03:34.286447+0000","last_fullsized":"2024-04-25T09:03:34.286447+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:18.206553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.639057+0000","last_change":"2024-04-25T09:03:34.284953+0000","last_active":"2024-04-25T09:03:35.639057+0000","last_peered":"2024-04-25T09:03:35.639057+0000","last_clean":"2024-04-25T09:03:35.639057+0000","last_became_active":"2024-04-25T09:03:34.284618+0000","last_became_peered":"2024-04-25T09:03:34.284618+0000","last_unstale":"2024-04-25T09:03:35.639057+0000","last_undegraded":"2024-04-25T09:03:35.639057+0000","last_fullsized":"2024-04-25T09:03:35.639057+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:54.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.292032+0000","last_change":"2024-04-25T09:03:34.289182+0000","last_active":"2024-04-25T09:03:34.292032+0000","last_peered":"2024-04-25T09:03:34.292032+0000","last_clean":"2024-04-25T09:03:34.292032+0000","last_became_active":"2024-04-25T09:03:34.288906+0000","last_became_peered":"2024-04-25T09:03:34.288906+0000","last_unstale":"2024-04-25T09:03:34.292032+0000","last_undegraded":"2024-04-25T09:03:34.292032+0000","last_fullsized":"2024-04-25T09:03:34.292032+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:51.997091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284144+0000","last_change":"2024-04-25T09:03:34.278962+0000","last_active":"2024-04-25T09:03:34.284144+0000","last_peered":"2024-04-25T09:03:34.284144+0000","last_clean":"2024-04-25T09:03:34.284144+0000","last_became_active":"2024-04-25T09:03:34.278709+0000","last_became_peered":"2024-04-25T09:03:34.278709+0000","last_unstale":"2024-04-25T09:03:34.284144+0000","last_undegraded":"2024-04-25T09:03:34.284144+0000","last_fullsized":"2024-04-25T09:03:34.284144+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:28.678482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.281750+0000","last_change":"2024-04-25T09:03:34.275344+0000","last_active":"2024-04-25T09:03:34.281750+0000","last_peered":"2024-04-25T09:03:34.281750+0000","last_clean":"2024-04-25T09:03:34.281750+0000","last_became_active":"2024-04-25T09:03:34.275068+0000","last_became_peered":"2024-04-25T09:03:34.275068+0000","last_unstale":"2024-04-25T09:03:34.281750+0000","last_undegraded":"2024-04-25T09:03:34.281750+0000","last_fullsized":"2024-04-25T09:03:34.281750+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:56.783299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.288261+0000","last_change":"2024-04-25T09:03:34.283274+0000","last_active":"2024-04-25T09:03:34.288261+0000","last_peered":"2024-04-25T09:03:34.288261+0000","last_clean":"2024-04-25T09:03:34.288261+0000","last_became_active":"2024-04-25T09:03:34.282968+0000","last_became_peered":"2024-04-25T09:03:34.282968+0000","last_unstale":"2024-04-25T09:03:34.288261+0000","last_undegraded":"2024-04-25T09:03:34.288261+0000","last_fullsized":"2024-04-25T09:03:34.288261+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:41.741079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638920+0000","last_change":"2024-04-25T09:03:34.286922+0000","last_active":"2024-04-25T09:03:35.638920+0000","last_peered":"2024-04-25T09:03:35.638920+0000","last_clean":"2024-04-25T09:03:35.638920+0000","last_became_active":"2024-04-25T09:03:34.286625+0000","last_became_peered":"2024-04-25T09:03:34.286625+0000","last_unstale":"2024-04-25T09:03:35.638920+0000","last_undegraded":"2024-04-25T09:03:35.638920+0000","last_fullsized":"2024-04-25T09:03:35.638920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:41.989619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.639006+0000","last_change":"2024-04-25T09:03:34.285629+0000","last_active":"2024-04-25T09:03:35.639006+0000","last_peered":"2024-04-25T09:03:35.639006+0000","last_clean":"2024-04-25T09:03:35.639006+0000","last_became_active":"2024-04-25T09:03:34.285314+0000","last_became_peered":"2024-04-25T09:03:34.285314+0000","last_unstale":"2024-04-25T09:03:35.639006+0000","last_undegraded":"2024-04-25T09:03:35.639006+0000","last_fullsized":"2024-04-25T09:03:35.639006+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:48.352360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"114'4","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.283422+0000","last_change":"2024-04-25T09:03:33.271897+0000","last_active":"2024-04-25T09:03:34.283422+0000","last_peered":"2024-04-25T09:03:34.283422+0000","last_clean":"2024-04-25T09:03:34.283422+0000","last_became_active":"2024-04-25T09:03:33.271633+0000","last_became_peered":"2024-04-25T09:03:33.271633+0000","last_unstale":"2024-04-25T09:03:34.283422+0000","last_undegraded":"2024-04-25T09:03:34.283422+0000","last_fullsized":"2024-04-25T09:03:34.283422+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:20.665904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282546+0000","last_change":"2024-04-25T09:03:34.277186+0000","last_active":"2024-04-25T09:03:34.282546+0000","last_peered":"2024-04-25T09:03:34.282546+0000","last_clean":"2024-04-25T09:03:34.282546+0000","last_became_active":"2024-04-25T09:03:34.276893+0000","last_became_peered":"2024-04-25T09:03:34.276893+0000","last_unstale":"2024-04-25T09:03:34.282546+0000","last_undegraded":"2024-04-25T09:03:34.282546+0000","last_fullsized":"2024-04-25T09:03:34.282546+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:28.678482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.283995+0000","last_change":"2024-04-25T09:03:33.272237+0000","last_active":"2024-04-25T09:03:34.283995+0000","last_peered":"2024-04-25T09:03:34.283995+0000","last_clean":"2024-04-25T09:03:34.283995+0000","last_became_active":"2024-04-25T09:03:33.271941+0000","last_became_peered":"2024-04-25T09:03:33.271941+0000","last_unstale":"2024-04-25T09:03:34.283995+0000","last_undegraded":"2024-04-25T09:03:34.283995+0000","last_fullsized":"2024-04-25T09:03:34.283995+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:36.437928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638938+0000","last_change":"2024-04-25T09:03:34.285171+0000","last_active":"2024-04-25T09:03:35.638938+0000","last_peered":"2024-04-25T09:03:35.638938+0000","last_clean":"2024-04-25T09:03:35.638938+0000","last_became_active":"2024-04-25T09:03:34.284859+0000","last_became_peered":"2024-04-25T09:03:34.284859+0000","last_unstale":"2024-04-25T09:03:35.638938+0000","last_undegraded":"2024-04-25T09:03:35.638938+0000","last_fullsized":"2024-04-25T09:03:35.638938+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:34.446609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.288632+0000","last_change":"2024-04-25T09:03:33.275583+0000","last_active":"2024-04-25T09:03:34.288632+0000","last_peered":"2024-04-25T09:03:34.288632+0000","last_clean":"2024-04-25T09:03:34.288632+0000","last_became_active":"2024-04-25T09:03:33.272844+0000","last_became_peered":"2024-04-25T09:03:33.272844+0000","last_unstale":"2024-04-25T09:03:34.288632+0000","last_undegraded":"2024-04-25T09:03:34.288632+0000","last_fullsized":"2024-04-25T09:03:34.288632+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:23.755894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294737+0000","last_change":"2024-04-25T09:03:34.289760+0000","last_active":"2024-04-25T09:03:34.294737+0000","last_peered":"2024-04-25T09:03:34.294737+0000","last_clean":"2024-04-25T09:03:34.294737+0000","last_became_active":"2024-04-25T09:03:34.289259+0000","last_became_peered":"2024-04-25T09:03:34.289259+0000","last_unstale":"2024-04-25T09:03:34.294737+0000","last_undegraded":"2024-04-25T09:03:34.294737+0000","last_fullsized":"2024-04-25T09:03:34.294737+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:38.737934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291163+0000","last_change":"2024-04-25T09:03:33.274356+0000","last_active":"2024-04-25T09:03:34.291163+0000","last_peered":"2024-04-25T09:03:34.291163+0000","last_clean":"2024-04-25T09:03:34.291163+0000","last_became_active":"2024-04-25T09:03:33.271646+0000","last_became_peered":"2024-04-25T09:03:33.271646+0000","last_unstale":"2024-04-25T09:03:34.291163+0000","last_undegraded":"2024-04-25T09:03:34.291163+0000","last_fullsized":"2024-04-25T09:03:34.291163+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:30.001026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294433+0000","last_change":"2024-04-25T09:03:34.292589+0000","last_active":"2024-04-25T09:03:34.294433+0000","last_peered":"2024-04-25T09:03:34.294433+0000","last_clean":"2024-04-25T09:03:34.294433+0000","last_became_active":"2024-04-25T09:03:34.292312+0000","last_became_peered":"2024-04-25T09:03:34.292312+0000","last_unstale":"2024-04-25T09:03:34.294433+0000","last_undegraded":"2024-04-25T09:03:34.294433+0000","last_fullsized":"2024-04-25T09:03:34.294433+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:22.909901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.288278+0000","last_change":"2024-04-25T09:03:33.275637+0000","last_active":"2024-04-25T09:03:34.288278+0000","last_peered":"2024-04-25T09:03:34.288278+0000","last_clean":"2024-04-25T09:03:34.288278+0000","last_became_active":"2024-04-25T09:03:33.275352+0000","last_became_peered":"2024-04-25T09:03:33.275352+0000","last_unstale":"2024-04-25T09:03:34.288278+0000","last_undegraded":"2024-04-25T09:03:34.288278+0000","last_fullsized":"2024-04-25T09:03:34.288278+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:28.360614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294759+0000","last_change":"2024-04-25T09:03:34.286012+0000","last_active":"2024-04-25T09:03:34.294759+0000","last_peered":"2024-04-25T09:03:34.294759+0000","last_clean":"2024-04-25T09:03:34.294759+0000","last_became_active":"2024-04-25T09:03:34.285649+0000","last_became_peered":"2024-04-25T09:03:34.285649+0000","last_unstale":"2024-04-25T09:03:34.294759+0000","last_undegraded":"2024-04-25T09:03:34.294759+0000","last_fullsized":"2024-04-25T09:03:34.294759+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:58.452354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.281480+0000","last_change":"2024-04-25T09:03:33.274637+0000","last_active":"2024-04-25T09:03:34.281480+0000","last_peered":"2024-04-25T09:03:34.281480+0000","last_clean":"2024-04-25T09:03:34.281480+0000","last_became_active":"2024-04-25T09:03:33.274365+0000","last_became_peered":"2024-04-25T09:03:33.274365+0000","last_unstale":"2024-04-25T09:03:34.281480+0000","last_undegraded":"2024-04-25T09:03:34.281480+0000","last_fullsized":"2024-04-25T09:03:34.281480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:56.969414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291923+0000","last_change":"2024-04-25T09:03:34.289039+0000","last_active":"2024-04-25T09:03:34.291923+0000","last_peered":"2024-04-25T09:03:34.291923+0000","last_clean":"2024-04-25T09:03:34.291923+0000","last_became_active":"2024-04-25T09:03:34.288769+0000","last_became_peered":"2024-04-25T09:03:34.288769+0000","last_unstale":"2024-04-25T09:03:34.291923+0000","last_undegraded":"2024-04-25T09:03:34.291923+0000","last_fullsized":"2024-04-25T09:03:34.291923+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:30.066414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.266938+0000","last_change":"2024-04-25T09:03:33.268677+0000","last_active":"2024-04-25T09:03:34.266938+0000","last_peered":"2024-04-25T09:03:34.266938+0000","last_clean":"2024-04-25T09:03:34.266938+0000","last_became_active":"2024-04-25T09:03:33.268334+0000","last_became_peered":"2024-04-25T09:03:33.268334+0000","last_unstale":"2024-04-25T09:03:34.266938+0000","last_undegraded":"2024-04-25T09:03:34.266938+0000","last_fullsized":"2024-04-25T09:03:34.266938+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:12.380408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.276134+0000","last_change":"2024-04-25T09:03:34.272665+0000","last_active":"2024-04-25T09:03:34.276134+0000","last_peered":"2024-04-25T09:03:34.276134+0000","last_clean":"2024-04-25T09:03:34.276134+0000","last_became_active":"2024-04-25T09:03:34.272386+0000","last_became_peered":"2024-04-25T09:03:34.272386+0000","last_unstale":"2024-04-25T09:03:34.276134+0000","last_undegraded":"2024-04-25T09:03:34.276134+0000","last_fullsized":"2024-04-25T09:03:34.276134+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:34.400861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.273836+0000","last_change":"2024-04-25T09:03:33.277952+0000","last_active":"2024-04-25T09:03:34.273836+0000","last_peered":"2024-04-25T09:03:34.273836+0000","last_clean":"2024-04-25T09:03:34.273836+0000","last_became_active":"2024-04-25T09:03:33.275471+0000","last_became_peered":"2024-04-25T09:03:33.275471+0000","last_unstale":"2024-04-25T09:03:34.273836+0000","last_undegraded":"2024-04-25T09:03:34.273836+0000","last_fullsized":"2024-04-25T09:03:34.273836+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:27.981497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294577+0000","last_change":"2024-04-25T09:03:34.285758+0000","last_active":"2024-04-25T09:03:34.294577+0000","last_peered":"2024-04-25T09:03:34.294577+0000","last_clean":"2024-04-25T09:03:34.294577+0000","last_became_active":"2024-04-25T09:03:34.285489+0000","last_became_peered":"2024-04-25T09:03:34.285489+0000","last_unstale":"2024-04-25T09:03:34.294577+0000","last_undegraded":"2024-04-25T09:03:34.294577+0000","last_fullsized":"2024-04-25T09:03:34.294577+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:32.155280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.262037+0000","last_change":"2024-04-25T09:03:33.278151+0000","last_active":"2024-04-25T09:03:34.262037+0000","last_peered":"2024-04-25T09:03:34.262037+0000","last_clean":"2024-04-25T09:03:34.262037+0000","last_became_active":"2024-04-25T09:03:33.277820+0000","last_became_peered":"2024-04-25T09:03:33.277820+0000","last_unstale":"2024-04-25T09:03:34.262037+0000","last_undegraded":"2024-04-25T09:03:34.262037+0000","last_fullsized":"2024-04-25T09:03:34.262037+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:08.554732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.286243+0000","last_change":"2024-04-25T09:03:34.284665+0000","last_active":"2024-04-25T09:03:34.286243+0000","last_peered":"2024-04-25T09:03:34.286243+0000","last_clean":"2024-04-25T09:03:34.286243+0000","last_became_active":"2024-04-25T09:03:34.284290+0000","last_became_peered":"2024-04-25T09:03:34.284290+0000","last_unstale":"2024-04-25T09:03:34.286243+0000","last_undegraded":"2024-04-25T09:03:34.286243+0000","last_fullsized":"2024-04-25T09:03:34.286243+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:32.371110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.261820+0000","last_change":"2024-04-25T09:03:33.264477+0000","last_active":"2024-04-25T09:03:34.261820+0000","last_peered":"2024-04-25T09:03:34.261820+0000","last_clean":"2024-04-25T09:03:34.261820+0000","last_became_active":"2024-04-25T09:03:33.264198+0000","last_became_peered":"2024-04-25T09:03:33.264198+0000","last_unstale":"2024-04-25T09:03:34.261820+0000","last_undegraded":"2024-04-25T09:03:34.261820+0000","last_fullsized":"2024-04-25T09:03:34.261820+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:15.341482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.275923+0000","last_change":"2024-04-25T09:03:34.272588+0000","last_active":"2024-04-25T09:03:34.275923+0000","last_peered":"2024-04-25T09:03:34.275923+0000","last_clean":"2024-04-25T09:03:34.275923+0000","last_became_active":"2024-04-25T09:03:34.272292+0000","last_became_peered":"2024-04-25T09:03:34.272292+0000","last_unstale":"2024-04-25T09:03:34.275923+0000","last_undegraded":"2024-04-25T09:03:34.275923+0000","last_fullsized":"2024-04-25T09:03:34.275923+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:59.512760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"114'3","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291196+0000","last_change":"2024-04-25T09:03:33.276871+0000","last_active":"2024-04-25T09:03:34.291196+0000","last_peered":"2024-04-25T09:03:34.291196+0000","last_clean":"2024-04-25T09:03:34.291196+0000","last_became_active":"2024-04-25T09:03:33.276575+0000","last_became_peered":"2024-04-25T09:03:33.276575+0000","last_unstale":"2024-04-25T09:03:34.291196+0000","last_undegraded":"2024-04-25T09:03:34.291196+0000","last_fullsized":"2024-04-25T09:03:34.291196+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:50.994904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282239+0000","last_change":"2024-04-25T09:03:34.279070+0000","last_active":"2024-04-25T09:03:34.282239+0000","last_peered":"2024-04-25T09:03:34.282239+0000","last_clean":"2024-04-25T09:03:34.282239+0000","last_became_active":"2024-04-25T09:03:34.278800+0000","last_became_peered":"2024-04-25T09:03:34.278800+0000","last_unstale":"2024-04-25T09:03:34.282239+0000","last_undegraded":"2024-04-25T09:03:34.282239+0000","last_fullsized":"2024-04-25T09:03:34.282239+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:05.142587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"114'6","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.296811+0000","last_change":"2024-04-25T09:03:33.275881+0000","last_active":"2024-04-25T09:03:34.296811+0000","last_peered":"2024-04-25T09:03:34.296811+0000","last_clean":"2024-04-25T09:03:34.296811+0000","last_became_active":"2024-04-25T09:03:33.275525+0000","last_became_peered":"2024-04-25T09:03:33.275525+0000","last_unstale":"2024-04-25T09:03:34.296811+0000","last_undegraded":"2024-04-25T09:03:34.296811+0000","last_fullsized":"2024-04-25T09:03:34.296811+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:16.400815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.275404+0000","last_change":"2024-04-25T09:03:34.271458+0000","last_active":"2024-04-25T09:03:34.275404+0000","last_peered":"2024-04-25T09:03:34.275404+0000","last_clean":"2024-04-25T09:03:34.275404+0000","last_became_active":"2024-04-25T09:03:34.271181+0000","last_became_peered":"2024-04-25T09:03:34.271181+0000","last_unstale":"2024-04-25T09:03:34.275404+0000","last_undegraded":"2024-04-25T09:03:34.275404+0000","last_fullsized":"2024-04-25T09:03:34.275404+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:38.737934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.639030+0000","last_change":"2024-04-25T09:03:33.273613+0000","last_active":"2024-04-25T09:03:35.639030+0000","last_peered":"2024-04-25T09:03:35.639030+0000","last_clean":"2024-04-25T09:03:35.639030+0000","last_became_active":"2024-04-25T09:03:33.273333+0000","last_became_peered":"2024-04-25T09:03:33.273333+0000","last_unstale":"2024-04-25T09:03:35.639030+0000","last_undegraded":"2024-04-25T09:03:35.639030+0000","last_fullsized":"2024-04-25T09:03:35.639030+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:22.426391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.279168+0000","last_change":"2024-04-25T09:03:34.275112+0000","last_active":"2024-04-25T09:03:34.279168+0000","last_peered":"2024-04-25T09:03:34.279168+0000","last_clean":"2024-04-25T09:03:34.279168+0000","last_became_active":"2024-04-25T09:03:34.274787+0000","last_became_peered":"2024-04-25T09:03:34.274787+0000","last_unstale":"2024-04-25T09:03:34.279168+0000","last_undegraded":"2024-04-25T09:03:34.279168+0000","last_fullsized":"2024-04-25T09:03:34.279168+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:54.643348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.262453+0000","last_change":"2024-04-25T09:03:33.275936+0000","last_active":"2024-04-25T09:03:34.262453+0000","last_peered":"2024-04-25T09:03:34.262453+0000","last_clean":"2024-04-25T09:03:34.262453+0000","last_became_active":"2024-04-25T09:03:33.275610+0000","last_became_peered":"2024-04-25T09:03:33.275610+0000","last_unstale":"2024-04-25T09:03:34.262453+0000","last_undegraded":"2024-04-25T09:03:34.262453+0000","last_fullsized":"2024-04-25T09:03:34.262453+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:55.649688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.274331+0000","last_change":"2024-04-25T09:03:34.270698+0000","last_active":"2024-04-25T09:03:34.274331+0000","last_peered":"2024-04-25T09:03:34.274331+0000","last_clean":"2024-04-25T09:03:34.274331+0000","last_became_active":"2024-04-25T09:03:34.270434+0000","last_became_peered":"2024-04-25T09:03:34.270434+0000","last_unstale":"2024-04-25T09:03:34.274331+0000","last_undegraded":"2024-04-25T09:03:34.274331+0000","last_fullsized":"2024-04-25T09:03:34.274331+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:45.912269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"114'8","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.293176+0000","last_change":"2024-04-25T09:03:33.277724+0000","last_active":"2024-04-25T09:03:34.293176+0000","last_peered":"2024-04-25T09:03:34.293176+0000","last_clean":"2024-04-25T09:03:34.293176+0000","last_became_active":"2024-04-25T09:03:33.277401+0000","last_became_peered":"2024-04-25T09:03:33.277401+0000","last_unstale":"2024-04-25T09:03:34.293176+0000","last_undegraded":"2024-04-25T09:03:34.293176+0000","last_fullsized":"2024-04-25T09:03:34.293176+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:37.733654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284185+0000","last_change":"2024-04-25T09:03:34.280990+0000","last_active":"2024-04-25T09:03:34.284185+0000","last_peered":"2024-04-25T09:03:34.284185+0000","last_clean":"2024-04-25T09:03:34.284185+0000","last_became_active":"2024-04-25T09:03:34.280681+0000","last_became_peered":"2024-04-25T09:03:34.280681+0000","last_unstale":"2024-04-25T09:03:34.284185+0000","last_undegraded":"2024-04-25T09:03:34.284185+0000","last_fullsized":"2024-04-25T09:03:34.284185+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:53.463830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.285952+0000","last_change":"2024-04-25T09:03:33.278683+0000","last_active":"2024-04-25T09:03:34.285952+0000","last_peered":"2024-04-25T09:03:34.285952+0000","last_clean":"2024-04-25T09:03:34.285952+0000","last_became_active":"2024-04-25T09:03:33.278177+0000","last_became_peered":"2024-04-25T09:03:33.278177+0000","last_unstale":"2024-04-25T09:03:34.285952+0000","last_undegraded":"2024-04-25T09:03:34.285952+0000","last_fullsized":"2024-04-25T09:03:34.285952+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:58.361274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638918+0000","last_change":"2024-04-25T09:03:34.288496+0000","last_active":"2024-04-25T09:03:35.638918+0000","last_peered":"2024-04-25T09:03:35.638918+0000","last_clean":"2024-04-25T09:03:35.638918+0000","last_became_active":"2024-04-25T09:03:34.288218+0000","last_became_peered":"2024-04-25T09:03:34.288218+0000","last_unstale":"2024-04-25T09:03:35.638918+0000","last_undegraded":"2024-04-25T09:03:35.638918+0000","last_fullsized":"2024-04-25T09:03:35.638918+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:36.746101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284560+0000","last_change":"2024-04-25T09:03:33.269768+0000","last_active":"2024-04-25T09:03:34.284560+0000","last_peered":"2024-04-25T09:03:34.284560+0000","last_clean":"2024-04-25T09:03:34.284560+0000","last_became_active":"2024-04-25T09:03:33.269296+0000","last_became_peered":"2024-04-25T09:03:33.269296+0000","last_unstale":"2024-04-25T09:03:34.284560+0000","last_undegraded":"2024-04-25T09:03:34.284560+0000","last_fullsized":"2024-04-25T09:03:34.284560+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:56.304107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.295975+0000","last_change":"2024-04-25T09:03:34.292796+0000","last_active":"2024-04-25T09:03:34.295975+0000","last_peered":"2024-04-25T09:03:34.295975+0000","last_clean":"2024-04-25T09:03:34.295975+0000","last_became_active":"2024-04-25T09:03:34.292548+0000","last_became_peered":"2024-04-25T09:03:34.292548+0000","last_unstale":"2024-04-25T09:03:34.295975+0000","last_undegraded":"2024-04-25T09:03:34.295975+0000","last_fullsized":"2024-04-25T09:03:34.295975+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:54.643348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.292124+0000","last_change":"2024-04-25T09:03:33.273188+0000","last_active":"2024-04-25T09:03:34.292124+0000","last_peered":"2024-04-25T09:03:34.292124+0000","last_clean":"2024-04-25T09:03:34.292124+0000","last_became_active":"2024-04-25T09:03:33.272903+0000","last_became_peered":"2024-04-25T09:03:33.272903+0000","last_unstale":"2024-04-25T09:03:34.292124+0000","last_undegraded":"2024-04-25T09:03:34.292124+0000","last_fullsized":"2024-04-25T09:03:34.292124+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:36.437928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.284516+0000","last_change":"2024-04-25T09:03:34.283089+0000","last_active":"2024-04-25T09:03:34.284516+0000","last_peered":"2024-04-25T09:03:34.284516+0000","last_clean":"2024-04-25T09:03:34.284516+0000","last_became_active":"2024-04-25T09:03:34.282773+0000","last_became_peered":"2024-04-25T09:03:34.282773+0000","last_unstale":"2024-04-25T09:03:34.284516+0000","last_undegraded":"2024-04-25T09:03:34.284516+0000","last_fullsized":"2024-04-25T09:03:34.284516+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:16.343669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.267871+0000","last_change":"2024-04-25T09:03:33.277534+0000","last_active":"2024-04-25T09:03:34.267871+0000","last_peered":"2024-04-25T09:03:34.267871+0000","last_clean":"2024-04-25T09:03:34.267871+0000","last_became_active":"2024-04-25T09:03:33.277231+0000","last_became_peered":"2024-04-25T09:03:33.277231+0000","last_unstale":"2024-04-25T09:03:34.267871+0000","last_undegraded":"2024-04-25T09:03:34.267871+0000","last_fullsized":"2024-04-25T09:03:34.267871+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:22.307202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282837+0000","last_change":"2024-04-25T09:03:34.279284+0000","last_active":"2024-04-25T09:03:34.282837+0000","last_peered":"2024-04-25T09:03:34.282837+0000","last_clean":"2024-04-25T09:03:34.282837+0000","last_became_active":"2024-04-25T09:03:34.279031+0000","last_became_peered":"2024-04-25T09:03:34.279031+0000","last_unstale":"2024-04-25T09:03:34.282837+0000","last_undegraded":"2024-04-25T09:03:34.282837+0000","last_fullsized":"2024-04-25T09:03:34.282837+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:28.678482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.639023+0000","last_change":"2024-04-25T09:03:33.281406+0000","last_active":"2024-04-25T09:03:35.639023+0000","last_peered":"2024-04-25T09:03:35.639023+0000","last_clean":"2024-04-25T09:03:35.639023+0000","last_became_active":"2024-04-25T09:03:33.281081+0000","last_became_peered":"2024-04-25T09:03:33.281081+0000","last_unstale":"2024-04-25T09:03:35.639023+0000","last_undegraded":"2024-04-25T09:03:35.639023+0000","last_fullsized":"2024-04-25T09:03:35.639023+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:40.672565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.286357+0000","last_change":"2024-04-25T09:03:34.279623+0000","last_active":"2024-04-25T09:03:34.286357+0000","last_peered":"2024-04-25T09:03:34.286357+0000","last_clean":"2024-04-25T09:03:34.286357+0000","last_became_active":"2024-04-25T09:03:34.279331+0000","last_became_peered":"2024-04-25T09:03:34.279331+0000","last_unstale":"2024-04-25T09:03:34.286357+0000","last_undegraded":"2024-04-25T09:03:34.286357+0000","last_fullsized":"2024-04-25T09:03:34.286357+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:00.515548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.262793+0000","last_change":"2024-04-25T09:03:33.276115+0000","last_active":"2024-04-25T09:03:34.262793+0000","last_peered":"2024-04-25T09:03:34.262793+0000","last_clean":"2024-04-25T09:03:34.262793+0000","last_became_active":"2024-04-25T09:03:33.273933+0000","last_became_peered":"2024-04-25T09:03:33.273933+0000","last_unstale":"2024-04-25T09:03:34.262793+0000","last_undegraded":"2024-04-25T09:03:34.262793+0000","last_fullsized":"2024-04-25T09:03:34.262793+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:53.524426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294688+0000","last_change":"2024-04-25T09:03:34.289693+0000","last_active":"2024-04-25T09:03:34.294688+0000","last_peered":"2024-04-25T09:03:34.294688+0000","last_clean":"2024-04-25T09:03:34.294688+0000","last_became_active":"2024-04-25T09:03:34.289334+0000","last_became_peered":"2024-04-25T09:03:34.289334+0000","last_unstale":"2024-04-25T09:03:34.294688+0000","last_undegraded":"2024-04-25T09:03:34.294688+0000","last_fullsized":"2024-04-25T09:03:34.294688+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:45.912269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T09:03:35.638848+0000","last_change":"2024-04-25T09:03:33.278180+0000","last_active":"2024-04-25T09:03:35.638848+0000","last_peered":"2024-04-25T09:03:35.638848+0000","last_clean":"2024-04-25T09:03:35.638848+0000","last_became_active":"2024-04-25T09:03:33.277887+0000","last_became_peered":"2024-04-25T09:03:33.277887+0000","last_unstale":"2024-04-25T09:03:35.638848+0000","last_undegraded":"2024-04-25T09:03:35.638848+0000","last_fullsized":"2024-04-25T09:03:35.638848+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:19.575309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.291819+0000","last_change":"2024-04-25T09:03:34.280838+0000","last_active":"2024-04-25T09:03:34.291819+0000","last_peered":"2024-04-25T09:03:34.291819+0000","last_clean":"2024-04-25T09:03:34.291819+0000","last_became_active":"2024-04-25T09:03:34.280537+0000","last_became_peered":"2024-04-25T09:03:34.280537+0000","last_unstale":"2024-04-25T09:03:34.291819+0000","last_undegraded":"2024-04-25T09:03:34.291819+0000","last_fullsized":"2024-04-25T09:03:34.291819+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:28.451715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.274013+0000","last_change":"2024-04-25T09:03:33.278084+0000","last_active":"2024-04-25T09:03:34.274013+0000","last_peered":"2024-04-25T09:03:34.274013+0000","last_clean":"2024-04-25T09:03:34.274013+0000","last_became_active":"2024-04-25T09:03:33.275867+0000","last_became_peered":"2024-04-25T09:03:33.275867+0000","last_unstale":"2024-04-25T09:03:34.274013+0000","last_undegraded":"2024-04-25T09:03:34.274013+0000","last_fullsized":"2024-04-25T09:03:34.274013+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:02.247226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.286277+0000","last_change":"2024-04-25T09:03:34.284891+0000","last_active":"2024-04-25T09:03:34.286277+0000","last_peered":"2024-04-25T09:03:34.286277+0000","last_clean":"2024-04-25T09:03:34.286277+0000","last_became_active":"2024-04-25T09:03:34.284567+0000","last_became_peered":"2024-04-25T09:03:34.284567+0000","last_unstale":"2024-04-25T09:03:34.286277+0000","last_undegraded":"2024-04-25T09:03:34.286277+0000","last_fullsized":"2024-04-25T09:03:34.286277+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:32.417692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.280102+0000","last_change":"2024-04-25T09:03:33.274444+0000","last_active":"2024-04-25T09:03:34.280102+0000","last_peered":"2024-04-25T09:03:34.280102+0000","last_clean":"2024-04-25T09:03:34.280102+0000","last_became_active":"2024-04-25T09:03:33.271957+0000","last_became_peered":"2024-04-25T09:03:33.271957+0000","last_unstale":"2024-04-25T09:03:34.280102+0000","last_undegraded":"2024-04-25T09:03:34.280102+0000","last_fullsized":"2024-04-25T09:03:34.280102+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:31.368923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.289390+0000","last_change":"2024-04-25T09:03:34.286234+0000","last_active":"2024-04-25T09:03:34.289390+0000","last_peered":"2024-04-25T09:03:34.289390+0000","last_clean":"2024-04-25T09:03:34.289390+0000","last_became_active":"2024-04-25T09:03:34.285855+0000","last_became_peered":"2024-04-25T09:03:34.285855+0000","last_unstale":"2024-04-25T09:03:34.289390+0000","last_undegraded":"2024-04-25T09:03:34.289390+0000","last_fullsized":"2024-04-25T09:03:34.289390+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:34.636706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.262771+0000","last_change":"2024-04-25T09:03:33.271803+0000","last_active":"2024-04-25T09:03:34.262771+0000","last_peered":"2024-04-25T09:03:34.262771+0000","last_clean":"2024-04-25T09:03:34.262771+0000","last_became_active":"2024-04-25T09:03:33.271457+0000","last_became_peered":"2024-04-25T09:03:33.271457+0000","last_unstale":"2024-04-25T09:03:34.262771+0000","last_undegraded":"2024-04-25T09:03:34.262771+0000","last_fullsized":"2024-04-25T09:03:34.262771+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:07.461238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.294081+0000","last_change":"2024-04-25T09:03:34.291493+0000","last_active":"2024-04-25T09:03:34.294081+0000","last_peered":"2024-04-25T09:03:34.294081+0000","last_clean":"2024-04-25T09:03:34.294081+0000","last_became_active":"2024-04-25T09:03:34.290924+0000","last_became_peered":"2024-04-25T09:03:34.290924+0000","last_unstale":"2024-04-25T09:03:34.294081+0000","last_undegraded":"2024-04-25T09:03:34.294081+0000","last_fullsized":"2024-04-25T09:03:34.294081+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:09.161119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.267731+0000","last_change":"2024-04-25T09:03:33.279583+0000","last_active":"2024-04-25T09:03:34.267731+0000","last_peered":"2024-04-25T09:03:34.267731+0000","last_clean":"2024-04-25T09:03:34.267731+0000","last_became_active":"2024-04-25T09:03:33.279148+0000","last_became_peered":"2024-04-25T09:03:33.279148+0000","last_unstale":"2024-04-25T09:03:34.267731+0000","last_undegraded":"2024-04-25T09:03:34.267731+0000","last_fullsized":"2024-04-25T09:03:34.267731+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:56.395132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282502+0000","last_change":"2024-04-25T09:03:34.278987+0000","last_active":"2024-04-25T09:03:34.282502+0000","last_peered":"2024-04-25T09:03:34.282502+0000","last_clean":"2024-04-25T09:03:34.282502+0000","last_became_active":"2024-04-25T09:03:34.278689+0000","last_became_peered":"2024-04-25T09:03:34.278689+0000","last_unstale":"2024-04-25T09:03:34.282502+0000","last_undegraded":"2024-04-25T09:03:34.282502+0000","last_fullsized":"2024-04-25T09:03:34.282502+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:16.343669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.263152+0000","last_change":"2024-04-25T09:03:33.272491+0000","last_active":"2024-04-25T09:03:34.263152+0000","last_peered":"2024-04-25T09:03:34.263152+0000","last_clean":"2024-04-25T09:03:34.263152+0000","last_became_active":"2024-04-25T09:03:33.272203+0000","last_became_peered":"2024-04-25T09:03:33.272203+0000","last_unstale":"2024-04-25T09:03:34.263152+0000","last_undegraded":"2024-04-25T09:03:34.263152+0000","last_fullsized":"2024-04-25T09:03:34.263152+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:31.415505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.274042+0000","last_change":"2024-04-25T09:03:34.273011+0000","last_active":"2024-04-25T09:03:34.274042+0000","last_peered":"2024-04-25T09:03:34.274042+0000","last_clean":"2024-04-25T09:03:34.274042+0000","last_became_active":"2024-04-25T09:03:34.272725+0000","last_became_peered":"2024-04-25T09:03:34.272725+0000","last_unstale":"2024-04-25T09:03:34.274042+0000","last_undegraded":"2024-04-25T09:03:34.274042+0000","last_fullsized":"2024-04-25T09:03:34.274042+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:08.463426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.268585+0000","last_change":"2024-04-25T09:03:33.273232+0000","last_active":"2024-04-25T09:03:34.268585+0000","last_peered":"2024-04-25T09:03:34.268585+0000","last_clean":"2024-04-25T09:03:34.268585+0000","last_became_active":"2024-04-25T09:03:33.272651+0000","last_became_peered":"2024-04-25T09:03:33.272651+0000","last_unstale":"2024-04-25T09:03:34.268585+0000","last_undegraded":"2024-04-25T09:03:34.268585+0000","last_fullsized":"2024-04-25T09:03:34.268585+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:02.995246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.272471+0000","last_change":"2024-04-25T09:03:34.271367+0000","last_active":"2024-04-25T09:03:34.272471+0000","last_peered":"2024-04-25T09:03:34.272471+0000","last_clean":"2024-04-25T09:03:34.272471+0000","last_became_active":"2024-04-25T09:03:34.271062+0000","last_became_peered":"2024-04-25T09:03:34.271062+0000","last_unstale":"2024-04-25T09:03:34.272471+0000","last_undegraded":"2024-04-25T09:03:34.272471+0000","last_fullsized":"2024-04-25T09:03:34.272471+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:56.651875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.266236+0000","last_change":"2024-04-25T09:03:33.273771+0000","last_active":"2024-04-25T09:03:34.266236+0000","last_peered":"2024-04-25T09:03:34.266236+0000","last_clean":"2024-04-25T09:03:34.266236+0000","last_became_active":"2024-04-25T09:03:33.273487+0000","last_became_peered":"2024-04-25T09:03:33.273487+0000","last_unstale":"2024-04-25T09:03:34.266236+0000","last_undegraded":"2024-04-25T09:03:34.266236+0000","last_fullsized":"2024-04-25T09:03:34.266236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:31.153093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.285235+0000","last_change":"2024-04-25T09:03:34.284172+0000","last_active":"2024-04-25T09:03:34.285235+0000","last_peered":"2024-04-25T09:03:34.285235+0000","last_clean":"2024-04-25T09:03:34.285235+0000","last_became_active":"2024-04-25T09:03:34.283887+0000","last_became_peered":"2024-04-25T09:03:34.283887+0000","last_unstale":"2024-04-25T09:03:34.285235+0000","last_undegraded":"2024-04-25T09:03:34.285235+0000","last_fullsized":"2024-04-25T09:03:34.285235+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:32.417692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.261697+0000","last_change":"2024-04-25T09:03:33.274367+0000","last_active":"2024-04-25T09:03:34.261697+0000","last_peered":"2024-04-25T09:03:34.261697+0000","last_clean":"2024-04-25T09:03:34.261697+0000","last_became_active":"2024-04-25T09:03:33.272149+0000","last_became_peered":"2024-04-25T09:03:33.272149+0000","last_unstale":"2024-04-25T09:03:34.261697+0000","last_undegraded":"2024-04-25T09:03:34.261697+0000","last_fullsized":"2024-04-25T09:03:34.261697+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:48.845902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.290233+0000","last_change":"2024-04-25T09:03:34.288118+0000","last_active":"2024-04-25T09:03:34.290233+0000","last_peered":"2024-04-25T09:03:34.290233+0000","last_clean":"2024-04-25T09:03:34.290233+0000","last_became_active":"2024-04-25T09:03:34.287546+0000","last_became_peered":"2024-04-25T09:03:34.287546+0000","last_unstale":"2024-04-25T09:03:34.290233+0000","last_undegraded":"2024-04-25T09:03:34.290233+0000","last_fullsized":"2024-04-25T09:03:34.290233+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:23.787585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.274207+0000","last_change":"2024-04-25T09:03:33.276734+0000","last_active":"2024-04-25T09:03:34.274207+0000","last_peered":"2024-04-25T09:03:34.274207+0000","last_clean":"2024-04-25T09:03:34.274207+0000","last_became_active":"2024-04-25T09:03:33.271787+0000","last_became_peered":"2024-04-25T09:03:33.271787+0000","last_unstale":"2024-04-25T09:03:34.274207+0000","last_undegraded":"2024-04-25T09:03:34.274207+0000","last_fullsized":"2024-04-25T09:03:34.274207+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:46.455727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.282458+0000","last_change":"2024-04-25T09:03:34.275902+0000","last_active":"2024-04-25T09:03:34.282458+0000","last_peered":"2024-04-25T09:03:34.282458+0000","last_clean":"2024-04-25T09:03:34.282458+0000","last_became_active":"2024-04-25T09:03:34.275565+0000","last_became_peered":"2024-04-25T09:03:34.275565+0000","last_unstale":"2024-04-25T09:03:34.282458+0000","last_undegraded":"2024-04-25T09:03:34.282458+0000","last_fullsized":"2024-04-25T09:03:34.282458+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:33.248774+0000","last_clean_scrub_stamp":"2024-04-25T09:03:33.248774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:44.141551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.266927+0000","last_change":"2024-04-25T09:03:33.277462+0000","last_active":"2024-04-25T09:03:34.266927+0000","last_peered":"2024-04-25T09:03:34.266927+0000","last_clean":"2024-04-25T09:03:34.266927+0000","last_became_active":"2024-04-25T09:03:33.277149+0000","last_became_peered":"2024-04-25T09:03:33.277149+0000","last_unstale":"2024-04-25T09:03:34.266927+0000","last_undegraded":"2024-04-25T09:03:34.266927+0000","last_fullsized":"2024-04-25T09:03:34.266927+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:32.246586+0000","last_clean_scrub_stamp":"2024-04-25T09:03:32.246586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:43.498929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":338,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.270387+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T09:03:34.270387+0000","last_peered":"2024-04-25T09:03:34.270387+0000","last_clean":"2024-04-25T09:03:34.270387+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:03:34.270387+0000","last_undegraded":"2024-04-25T09:03:34.270387+0000","last_fullsized":"2024-04-25T09:03:34.270387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509565,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":1990656,"data_stored":1192332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":601964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509565,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":601964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509564,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1409024,"data_stored":608739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509564,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1425408,"data_stored":610421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509566,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":601964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509564,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2023424,"data_stored":1200831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":615163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:03:37.619 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:03:37.619 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:03:37.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.775+0000 7f4497f89640 1 Processor -- start 2024-04-25T09:03:37.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.775+0000 7f4497f89640 1 -- start start 2024-04-25T09:03:37.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.776+0000 7f4497f89640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44900b0da0 0x7f449015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.776+0000 7f4497f89640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f44900b52e0 0x7f4490070d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.776+0000 7f4497f89640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44900b4980 con 0x7f4490071280 2024-04-25T09:03:37.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.776+0000 7f4497f89640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449006bc10 con 0x7f44900b52e0 2024-04-25T09:03:37.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.776+0000 7f4497f89640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44900b57a0 con 0x7f44900b0da0 2024-04-25T09:03:37.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.776+0000 7f4496526640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4490071280 0x7f4490161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44392/0 (socket says 172.21.15.55:44392) 2024-04-25T09:03:37.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.776+0000 7f4496526640 1 -- 172.21.15.55:0/3249516552 learned_addr learned my addr 172.21.15.55:0/3249516552 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:37.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.777+0000 7f4495d25640 1 --2- 172.21.15.55:0/3249516552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44900b0da0 0x7f449015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.777+0000 7f4495524640 1 --2- 172.21.15.55:0/3249516552 >> v2:172.21.15.167:3300/0 conn(0x7f44900b52e0 0x7f4490070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.777+0000 7f4494d23640 1 -- 172.21.15.55:0/3249516552 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245663940 0 0) 0x7f44900b4980 con 0x7f4490071280 2024-04-25T09:03:37.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.777+0000 7f4494d23640 1 -- 172.21.15.55:0/3249516552 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4478003520 con 0x7f4490071280 2024-04-25T09:03:37.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.777+0000 7f4495524640 1 -- 172.21.15.55:0/3249516552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44900b0da0 msgr2=0x7f449015eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.777+0000 7f4495524640 1 --2- 172.21.15.55:0/3249516552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44900b0da0 0x7f449015eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.777+0000 7f4495524640 1 -- 172.21.15.55:0/3249516552 >> v1:172.21.15.55:6789/0 conn(0x7f4490071280 legacy=0x7f4490161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.777+0000 7f4495524640 1 -- 172.21.15.55:0/3249516552 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44900b5a80 con 0x7f44900b52e0 2024-04-25T09:03:37.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.778+0000 7f4495524640 1 --2- 172.21.15.55:0/3249516552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900b52e0 0x7f4490070d40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f44840097a0 tx=0x7f448402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35b14d0e3faf6c11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.778+0000 7f4494d23640 1 -- 172.21.15.55:0/3249516552 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484037070 con 0x7f44900b52e0 2024-04-25T09:03:37.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.778+0000 7f4494d23640 1 -- 172.21.15.55:0/3249516552 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4484032440 con 0x7f44900b52e0 2024-04-25T09:03:37.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.778+0000 7f4494d23640 1 -- 172.21.15.55:0/3249516552 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484032810 con 0x7f44900b52e0 2024-04-25T09:03:37.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.778+0000 7f4497f89640 1 -- 172.21.15.55:0/3249516552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900b52e0 msgr2=0x7f4490070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.778+0000 7f4497f89640 1 --2- 172.21.15.55:0/3249516552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900b52e0 0x7f4490070d40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f44840097a0 tx=0x7f448402a180 comp rx=0 tx=0).stop 2024-04-25T09:03:37.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.778+0000 7f4497f89640 1 -- 172.21.15.55:0/3249516552 shutdown_connections 2024-04-25T09:03:37.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.778+0000 7f4497f89640 1 --2- 172.21.15.55:0/3249516552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900b52e0 0x7f4490070d40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.778+0000 7f4497f89640 1 --2- 172.21.15.55:0/3249516552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44900b0da0 0x7f449015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.778+0000 7f4497f89640 1 -- 172.21.15.55:0/3249516552 >> 172.21.15.55:0/3249516552 conn(0x7f44900b34c0 msgr2=0x7f44900b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.778+0000 7f4497f89640 1 -- 172.21.15.55:0/3249516552 shutdown_connections 2024-04-25T09:03:37.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.779+0000 7f4497f89640 1 -- 172.21.15.55:0/3249516552 wait complete. 2024-04-25T09:03:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.780+0000 7f4497f89640 1 Processor -- start 2024-04-25T09:03:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.780+0000 7f4497f89640 1 -- start start 2024-04-25T09:03:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.780+0000 7f4497f89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4490071280 0x7f449014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.780+0000 7f4497f89640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900b0da0 0x7f4490153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.780+0000 7f4497f89640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44900b52e0 0x7f449015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.780+0000 7f4497f89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449006d670 con 0x7f4490071280 2024-04-25T09:03:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.780+0000 7f4497f89640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449006c140 con 0x7f44900b0da0 2024-04-25T09:03:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.780+0000 7f4497f89640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449006d7f0 con 0x7f44900b52e0 2024-04-25T09:03:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.780+0000 7f4495d25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4490071280 0x7f449014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4495d25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4490071280 0x7f449014fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58870/0 (socket says 172.21.15.55:58870) 2024-04-25T09:03:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4495d25640 1 -- 172.21.15.55:0/3738431450 learned_addr learned my addr 172.21.15.55:0/3738431450 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4496526640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44900b52e0 0x7f449015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4495524640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900b0da0 0x7f4490153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4495d25640 1 -- 172.21.15.55:0/3738431450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44900b52e0 msgr2=0x7f449015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4495d25640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44900b52e0 0x7f449015bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4495d25640 1 -- 172.21.15.55:0/3738431450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900b0da0 msgr2=0x7f4490153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4495d25640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900b0da0 0x7f4490153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4495d25640 1 -- 172.21.15.55:0/3738431450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4490154120 con 0x7f4490071280 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4495d25640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4490071280 0x7f449014fcb0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f448800e9b0 tx=0x7f448800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f448e7fc640 1 -- 172.21.15.55:0/3738431450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488017070 con 0x7f4490071280 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f448e7fc640 1 -- 172.21.15.55:0/3738431450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448800c9a0 con 0x7f4490071280 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4497f89640 1 -- 172.21.15.55:0/3738431450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44900cacc0 con 0x7f4490071280 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f448e7fc640 1 -- 172.21.15.55:0/3738431450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448800cd90 con 0x7f4490071280 2024-04-25T09:03:37.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.781+0000 7f4497f89640 1 -- 172.21.15.55:0/3738431450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44900cb280 con 0x7f4490071280 2024-04-25T09:03:37.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.782+0000 7f4497f89640 1 -- 172.21.15.55:0/3738431450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44900749b0 con 0x7f4490071280 2024-04-25T09:03:37.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.783+0000 7f448e7fc640 1 -- 172.21.15.55:0/3738431450 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f448801a070 con 0x7f4490071280 2024-04-25T09:03:37.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.783+0000 7f448e7fc640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f447c06b4d0 0x7f447c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.783+0000 7f448e7fc640 1 -- 172.21.15.55:0/3738431450 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f448808a240 con 0x7f4490071280 2024-04-25T09:03:37.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.783+0000 7f4495524640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f447c06b4d0 0x7f447c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.784+0000 7f4495524640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f447c06b4d0 0x7f447c06d990 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4484034000 tx=0x7f448402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:37.787+0000 7f448e7fc640 1 -- 172.21.15.55:0/3738431450 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f44880590c0 con 0x7f4490071280 2024-04-25T09:03:38.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.044+0000 7f4497f89640 1 -- 172.21.15.55:0/3738431450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f44900d27d0 con 0x7f4490071280 2024-04-25T09:03:38.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.046+0000 7f448e7fc640 1 -- 172.21.15.55:0/3738431450 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f44880589c0 con 0x7f4490071280 2024-04-25T09:03:38.035 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-04-25T09:03:38.035 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZGSpmo4mGLhAA3KddP2Iw2E97LfKUOxjzDw== 2024-04-25T09:03:38.035 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2024-04-25T09:03:38.035 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2024-04-25T09:03:38.035 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:03:38.035 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-25T09:03:38.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 -- 172.21.15.55:0/3738431450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f447c06b4d0 msgr2=0x7f447c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f447c06b4d0 0x7f447c06d990 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4484034000 tx=0x7f448402e000 comp rx=0 tx=0).stop 2024-04-25T09:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 -- 172.21.15.55:0/3738431450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4490071280 msgr2=0x7f449014fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4490071280 0x7f449014fcb0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f448800e9b0 tx=0x7f448800ee70 comp rx=0 tx=0).stop 2024-04-25T09:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 -- 172.21.15.55:0/3738431450 shutdown_connections 2024-04-25T09:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f447c06b4d0 0x7f447c06d990 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44900b52e0 0x7f449015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900b0da0 0x7f4490153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 --2- 172.21.15.55:0/3738431450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4490071280 0x7f449014fcb0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 -- 172.21.15.55:0/3738431450 >> 172.21.15.55:0/3738431450 conn(0x7f44900b34c0 msgr2=0x7f449015d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 -- 172.21.15.55:0/3738431450 shutdown_connections 2024-04-25T09:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.049+0000 7f4497f89640 1 -- 172.21.15.55:0/3738431450 wait complete. 2024-04-25T09:03:38.048 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.161+0000 7fb90808f640 1 Processor -- start 2024-04-25T09:03:38.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.161+0000 7fb90808f640 1 -- start start 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb90808f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb90015dce0 0x7fb9000d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb90808f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb9000b5b60 0x7fb9000b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb90808f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90015e0c0 con 0x7fb9000d35b0 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb90808f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9000d2510 con 0x7fb90015dce0 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb90808f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9000d27f0 con 0x7fb9000b5b60 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb905e2b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb90015dce0 0x7fb9000d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb90562a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb9000d35b0 0x7fb9000b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44396/0 (socket says 172.21.15.55:44396) 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb90562a640 1 -- 172.21.15.55:0/1799930527 learned_addr learned my addr 172.21.15.55:0/1799930527 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb905e2b640 1 -- 172.21.15.55:0/1799930527 >> v2:172.21.15.167:3300/0 conn(0x7fb9000b5b60 msgr2=0x7fb9000b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb905e2b640 1 --2- 172.21.15.55:0/1799930527 >> v2:172.21.15.167:3300/0 conn(0x7fb9000b5b60 0x7fb9000b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb905e2b640 1 -- 172.21.15.55:0/1799930527 >> v1:172.21.15.55:6789/0 conn(0x7fb9000d35b0 legacy=0x7fb9000b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb905e2b640 1 -- 172.21.15.55:0/1799930527 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9000d2ad0 con 0x7fb90015dce0 2024-04-25T09:03:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.162+0000 7fb904e29640 1 -- 172.21.15.55:0/1799930527 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645832378 0 0) 0x7fb90015e0c0 con 0x7fb9000d35b0 2024-04-25T09:03:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.163+0000 7fb905e2b640 1 --2- 172.21.15.55:0/1799930527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90015dce0 0x7fb9000d1a50 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb9000b3390 tx=0x7fb8fc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b42195d3417d37 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.163+0000 7fb904e29640 1 -- 172.21.15.55:0/1799930527 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc037070 con 0x7fb90015dce0 2024-04-25T09:03:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.163+0000 7fb904e29640 1 -- 172.21.15.55:0/1799930527 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc032440 con 0x7fb90015dce0 2024-04-25T09:03:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.163+0000 7fb904e29640 1 -- 172.21.15.55:0/1799930527 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc032810 con 0x7fb90015dce0 2024-04-25T09:03:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.164+0000 7fb90808f640 1 -- 172.21.15.55:0/1799930527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90015dce0 msgr2=0x7fb9000d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.164+0000 7fb90808f640 1 --2- 172.21.15.55:0/1799930527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90015dce0 0x7fb9000d1a50 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb9000b3390 tx=0x7fb8fc02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.164+0000 7fb90808f640 1 -- 172.21.15.55:0/1799930527 shutdown_connections 2024-04-25T09:03:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.164+0000 7fb90808f640 1 --2- 172.21.15.55:0/1799930527 >> v2:172.21.15.167:3300/0 conn(0x7fb9000b5b60 0x7fb9000b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.164+0000 7fb90808f640 1 --2- 172.21.15.55:0/1799930527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90015dce0 0x7fb9000d1a50 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.164+0000 7fb90808f640 1 -- 172.21.15.55:0/1799930527 >> 172.21.15.55:0/1799930527 conn(0x7fb900072900 msgr2=0x7fb9000d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.164+0000 7fb90808f640 1 -- 172.21.15.55:0/1799930527 shutdown_connections 2024-04-25T09:03:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.164+0000 7fb90808f640 1 -- 172.21.15.55:0/1799930527 wait complete. 2024-04-25T09:03:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.165+0000 7fb90808f640 1 Processor -- start 2024-04-25T09:03:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.165+0000 7fb90808f640 1 -- start start 2024-04-25T09:03:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90808f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9000b5b60 0x7fb9000aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90808f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9000d35b0 0x7fb9000ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90808f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90015dce0 0x7fb90015f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90808f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000b9820 con 0x7fb90015dce0 2024-04-25T09:03:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90808f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000d3090 con 0x7fb9000d35b0 2024-04-25T09:03:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90808f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000b99a0 con 0x7fb9000b5b60 2024-04-25T09:03:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90662c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90015dce0 0x7fb90015f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90662c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90015dce0 0x7fb90015f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58888/0 (socket says 172.21.15.55:58888) 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90662c640 1 -- 172.21.15.55:0/725767838 learned_addr learned my addr 172.21.15.55:0/725767838 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90562a640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9000d35b0 0x7fb9000ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90662c640 1 -- 172.21.15.55:0/725767838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9000b5b60 msgr2=0x7fb9000aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb905e2b640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9000b5b60 0x7fb9000aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90662c640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9000b5b60 0x7fb9000aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90662c640 1 -- 172.21.15.55:0/725767838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9000d35b0 msgr2=0x7fb9000ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90662c640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9000d35b0 0x7fb9000ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90662c640 1 -- 172.21.15.55:0/725767838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90015e450 con 0x7fb90015dce0 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90562a640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9000d35b0 0x7fb9000ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb905e2b640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9000b5b60 0x7fb9000aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.166+0000 7fb90662c640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90015dce0 0x7fb90015f4f0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800b970 tx=0x7fb8f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.167+0000 7fb8f67fc640 1 -- 172.21.15.55:0/725767838 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8019070 con 0x7fb90015dce0 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.167+0000 7fb8f67fc640 1 -- 172.21.15.55:0/725767838 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f800cb60 con 0x7fb90015dce0 2024-04-25T09:03:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.167+0000 7fb90808f640 1 -- 172.21.15.55:0/725767838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90015e730 con 0x7fb90015dce0 2024-04-25T09:03:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.167+0000 7fb8f67fc640 1 -- 172.21.15.55:0/725767838 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8014440 con 0x7fb90015dce0 2024-04-25T09:03:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.167+0000 7fb90808f640 1 -- 172.21.15.55:0/725767838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90015ecf0 con 0x7fb90015dce0 2024-04-25T09:03:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.168+0000 7fb90808f640 1 -- 172.21.15.55:0/725767838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb900067490 con 0x7fb90015dce0 2024-04-25T09:03:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.168+0000 7fb8f67fc640 1 -- 172.21.15.55:0/725767838 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb8f801c070 con 0x7fb90015dce0 2024-04-25T09:03:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.169+0000 7fb8f67fc640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8e406b500 0x7fb8e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.169+0000 7fb8f67fc640 1 -- 172.21.15.55:0/725767838 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8f8089ea0 con 0x7fb90015dce0 2024-04-25T09:03:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.169+0000 7fb905e2b640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8e406b500 0x7fb8e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.169+0000 7fb905e2b640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8e406b500 0x7fb8e406d9c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc034000 tx=0x7fb8fc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.173+0000 7fb8f67fc640 1 -- 172.21.15.55:0/725767838 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb900067490 con 0x7fb90015dce0 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.393+0000 7fb90808f640 1 -- 172.21.15.55:0/725767838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9000749b0 con 0x7fb90015dce0 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.394+0000 7fb8f67fc640 1 -- 172.21.15.55:0/725767838 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fb8f8058db0 con 0x7fb90015dce0 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":86,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:03:35.622068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8922},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8922":{"gid":8922,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/4257598582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":4257598582},{"type":"v1","addr":"172.21.15.55:6837","nonce":4257598582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:03:38.383 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 86 2024-04-25T09:03:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 -- 172.21.15.55:0/725767838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8e406b500 msgr2=0x7fb8e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8e406b500 0x7fb8e406d9c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc034000 tx=0x7fb8fc02e000 comp rx=0 tx=0).stop 2024-04-25T09:03:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 -- 172.21.15.55:0/725767838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90015dce0 msgr2=0x7fb90015f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90015dce0 0x7fb90015f4f0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800b970 tx=0x7fb8f800be30 comp rx=0 tx=0).stop 2024-04-25T09:03:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 -- 172.21.15.55:0/725767838 shutdown_connections 2024-04-25T09:03:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb8e406b500 0x7fb8e406d9c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90015dce0 0x7fb90015f4f0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9000d35b0 0x7fb9000ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 --2- 172.21.15.55:0/725767838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9000b5b60 0x7fb9000aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 -- 172.21.15.55:0/725767838 >> 172.21.15.55:0/725767838 conn(0x7fb900072900 msgr2=0x7fb9000b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 -- 172.21.15.55:0/725767838 shutdown_connections 2024-04-25T09:03:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.396+0000 7fb90808f640 1 -- 172.21.15.55:0/725767838 wait complete. 2024-04-25T09:03:38.798 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:03:33.628986+0000', 'modified': '2024-04-25T09:03:35.622068+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8922}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8922': {'gid': 8922, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/4257598582', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 4257598582}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 4257598582}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:03:38.798 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:03:38.798 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:03:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.919+0000 7fe66d01f640 1 Processor -- start 2024-04-25T09:03:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.919+0000 7fe66d01f640 1 -- start start 2024-04-25T09:03:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.919+0000 7fe66d01f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe66815abf0 0x7fe6680cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.919+0000 7fe66d01f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe66815baf0 0x7fe6680d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.919+0000 7fe66d01f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66815bf50 con 0x7fe6680ccf20 2024-04-25T09:03:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.919+0000 7fe66d01f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6680cbdc0 con 0x7fe66815baf0 2024-04-25T09:03:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.919+0000 7fe66d01f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680d1640 con 0x7fe66815abf0 2024-04-25T09:03:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.920+0000 7fe666d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe66815abf0 0x7fe6680cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.920+0000 7fe65ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe66815baf0 0x7fe6680d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.920+0000 7fe65ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe66815baf0 0x7fe6680d0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:53464/0 (socket says 172.21.15.55:53464) 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.920+0000 7fe666d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe66815abf0 0x7fe6680cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:34834/0 (socket says 172.21.15.55:34834) 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.920+0000 7fe65ffff640 1 -- 172.21.15.55:0/2855474218 learned_addr learned my addr 172.21.15.55:0/2855474218 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.920+0000 7fe66759e640 1 --1- 172.21.15.55:0/2855474218 >> v1:172.21.15.167:6789/0 conn(0x7fe6680ccf20 0x7fe6680ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:45470/0 (socket says 172.21.15.55:45470) 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.920+0000 7fe65ffff640 1 -- 172.21.15.55:0/2855474218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe66815abf0 msgr2=0x7fe6680cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.920+0000 7fe65ffff640 1 --2- 172.21.15.55:0/2855474218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe66815abf0 0x7fe6680cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.920+0000 7fe65ffff640 1 -- 172.21.15.55:0/2855474218 >> v1:172.21.15.167:6789/0 conn(0x7fe6680ccf20 legacy=0x7fe6680ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.920+0000 7fe65ffff640 1 -- 172.21.15.55:0/2855474218 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680cb490 con 0x7fe66815baf0 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.920+0000 7fe666d9d640 1 --2- 172.21.15.55:0/2855474218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe66815abf0 0x7fe6680cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.921+0000 7fe65ffff640 1 --2- 172.21.15.55:0/2855474218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe66815baf0 0x7fe6680d0ef0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe650009870 tx=0x7fe65002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f53450eaa84f8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.921+0000 7fe66659c640 1 -- 172.21.15.55:0/2855474218 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650037070 con 0x7fe66815baf0 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.921+0000 7fe66659c640 1 -- 172.21.15.55:0/2855474218 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650032440 con 0x7fe66815baf0 2024-04-25T09:03:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.921+0000 7fe66659c640 1 -- 172.21.15.55:0/2855474218 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650032810 con 0x7fe66815baf0 2024-04-25T09:03:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.922+0000 7fe66d01f640 1 -- 172.21.15.55:0/2855474218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe66815baf0 msgr2=0x7fe6680d0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.922+0000 7fe66d01f640 1 --2- 172.21.15.55:0/2855474218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe66815baf0 0x7fe6680d0ef0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe650009870 tx=0x7fe65002a250 comp rx=0 tx=0).stop 2024-04-25T09:03:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.922+0000 7fe66d01f640 1 -- 172.21.15.55:0/2855474218 shutdown_connections 2024-04-25T09:03:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.922+0000 7fe66d01f640 1 --2- 172.21.15.55:0/2855474218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe66815baf0 0x7fe6680d0ef0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.922+0000 7fe66d01f640 1 --2- 172.21.15.55:0/2855474218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe66815abf0 0x7fe6680cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.922+0000 7fe66d01f640 1 -- 172.21.15.55:0/2855474218 >> 172.21.15.55:0/2855474218 conn(0x7fe668099a40 msgr2=0x7fe6680d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.922+0000 7fe66d01f640 1 -- 172.21.15.55:0/2855474218 shutdown_connections 2024-04-25T09:03:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.922+0000 7fe66d01f640 1 -- 172.21.15.55:0/2855474218 wait complete. 2024-04-25T09:03:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.923+0000 7fe66d01f640 1 Processor -- start 2024-04-25T09:03:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.923+0000 7fe66d01f640 1 -- start start 2024-04-25T09:03:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66d01f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6680ccf20 0x7fe668151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66d01f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe66815baf0 0x7fe6680b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66d01f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680b6080 0x7fe6680b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66d01f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680cd3b0 con 0x7fe6680b6080 2024-04-25T09:03:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66d01f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680cba50 con 0x7fe66815baf0 2024-04-25T09:03:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66d01f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680cd530 con 0x7fe6680ccf20 2024-04-25T09:03:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680b6080 0x7fe6680b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680b6080 0x7fe6680b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38806/0 (socket says 172.21.15.55:38806) 2024-04-25T09:03:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66759e640 1 -- 172.21.15.55:0/2528491737 learned_addr learned my addr 172.21.15.55:0/2528491737 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe666d9d640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6680ccf20 0x7fe668151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe65ffff640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe66815baf0 0x7fe6680b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66759e640 1 -- 172.21.15.55:0/2528491737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6680ccf20 msgr2=0x7fe668151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66759e640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6680ccf20 0x7fe668151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66759e640 1 -- 172.21.15.55:0/2528491737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe66815baf0 msgr2=0x7fe6680b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66759e640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe66815baf0 0x7fe6680b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.924+0000 7fe66759e640 1 -- 172.21.15.55:0/2528491737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680b29f0 con 0x7fe6680b6080 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.925+0000 7fe66759e640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680b6080 0x7fe6680b1d60 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fe66000c7b0 tx=0x7fe66000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.925+0000 7fe65f7fe640 1 -- 172.21.15.55:0/2528491737 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660017070 con 0x7fe6680b6080 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.925+0000 7fe65f7fe640 1 -- 172.21.15.55:0/2528491737 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66000a640 con 0x7fe6680b6080 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.925+0000 7fe66d01f640 1 -- 172.21.15.55:0/2528491737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6680b2cd0 con 0x7fe6680b6080 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.925+0000 7fe65f7fe640 1 -- 172.21.15.55:0/2528491737 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66000a9f0 con 0x7fe6680b6080 2024-04-25T09:03:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.925+0000 7fe66d01f640 1 -- 172.21.15.55:0/2528491737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6680b36a0 con 0x7fe6680b6080 2024-04-25T09:03:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.926+0000 7fe65f7fe640 1 -- 172.21.15.55:0/2528491737 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe66001a070 con 0x7fe6680b6080 2024-04-25T09:03:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.927+0000 7fe65f7fe640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe64806b4d0 0x7fe64806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.927+0000 7fe65f7fe640 1 -- 172.21.15.55:0/2528491737 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe660089760 con 0x7fe6680b6080 2024-04-25T09:03:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.927+0000 7fe666d9d640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe64806b4d0 0x7fe64806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.927+0000 7fe666d9d640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe64806b4d0 0x7fe64806d990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe658009560 tx=0x7fe658009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.928+0000 7fe66fdff740 1 Processor -- start 2024-04-25T09:03:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.928+0000 7fe66fdff740 1 -- start start 2024-04-25T09:03:38.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0ea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b108020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0bff10 0x56042b106190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe66fdff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56042b022a10 con 0x56042b107ad0 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe66fdff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56042afcbb30 con 0x56042b0ea230 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe66fdff740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56042b01ec50 con 0x56042b0bff10 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe65ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe65ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b108020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38810/0 (socket says 172.21.15.55:38810) 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe65ffff640 1 -- 172.21.15.55:0/1711118229 learned_addr learned my addr 172.21.15.55:0/1711118229 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe66759e640 1 --2- 172.21.15.55:0/1711118229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0bff10 0x56042b106190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe666d9d640 1 --2- 172.21.15.55:0/1711118229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe65ffff640 1 -- 172.21.15.55:0/1711118229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0bff10 msgr2=0x56042b106190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe65ffff640 1 --2- 172.21.15.55:0/1711118229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0bff10 0x56042b106190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe65ffff640 1 -- 172.21.15.55:0/1711118229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 msgr2=0x56042b0ea610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe65ffff640 1 --2- 172.21.15.55:0/1711118229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0ea610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe65ffff640 1 -- 172.21.15.55:0/1711118229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56042afe0e10 con 0x56042b107ad0 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe65ffff640 1 --2- 172.21.15.55:0/1711118229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b108020 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fe65002a290 tx=0x7fe65002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d73c7154258f32c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.929+0000 7fe65cff9640 1 -- 172.21.15.55:0/1711118229 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650043070 con 0x56042b107ad0 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.930+0000 7fe65cff9640 1 -- 172.21.15.55:0/1711118229 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650032780 con 0x56042b107ad0 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.930+0000 7fe65cff9640 1 -- 172.21.15.55:0/1711118229 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650037040 con 0x56042b107ad0 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.930+0000 7fe66fdff740 1 -- 172.21.15.55:0/1711118229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 msgr2=0x56042b108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.930+0000 7fe66fdff740 1 --2- 172.21.15.55:0/1711118229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b108020 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fe65002a290 tx=0x7fe65002c000 comp rx=0 tx=0).stop 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.930+0000 7fe66fdff740 1 -- 172.21.15.55:0/1711118229 shutdown_connections 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.930+0000 7fe66fdff740 1 --2- 172.21.15.55:0/1711118229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0bff10 0x56042b106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.930+0000 7fe66fdff740 1 --2- 172.21.15.55:0/1711118229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b108020 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.930+0000 7fe66fdff740 1 --2- 172.21.15.55:0/1711118229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0ea610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.930+0000 7fe66fdff740 1 -- 172.21.15.55:0/1711118229 >> 172.21.15.55:0/1711118229 conn(0x56042b0bc840 msgr2=0x56042b105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.930+0000 7fe66fdff740 1 -- 172.21.15.55:0/1711118229 shutdown_connections 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.930+0000 7fe66fdff740 1 -- 172.21.15.55:0/1711118229 wait complete. 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.931+0000 7fe66fdff740 1 -- start start 2024-04-25T09:03:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.931+0000 7fe66fdff740 1 Processor -- start 2024-04-25T09:03:38.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0d9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0eb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0eddb0 0x56042b0d73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe66fdff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56042b0c0cb0 con 0x56042b107ad0 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe66fdff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56042afdf0c0 con 0x56042b0ea230 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe66fdff740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56042b0ba770 con 0x56042b0eddb0 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe66fdff740 10 client.0 _ll_register_callbacks cb 0x56042afd2ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe65ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0eb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe65ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0eb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38814/0 (socket says 172.21.15.55:38814) 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe65ffff640 1 -- 172.21.15.55:0/2536793297 learned_addr learned my addr 172.21.15.55:0/2536793297 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe66759e640 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0eddb0 0x56042b0d73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe666d9d640 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0d9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe65ffff640 1 -- 172.21.15.55:0/2536793297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0eddb0 msgr2=0x56042b0d73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe65ffff640 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0eddb0 0x56042b0d73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe65ffff640 1 -- 172.21.15.55:0/2536793297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 msgr2=0x56042b0d9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe65ffff640 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0d9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe65ffff640 1 -- 172.21.15.55:0/2536793297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56042ad372d0 con 0x56042b107ad0 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe666d9d640 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0d9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe65ffff640 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0eb290 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fe650009990 tx=0x7fe650004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b00e21061f079ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.932+0000 7fe645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe645ffb640 1 -- 172.21.15.55:0/2536793297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650037040 con 0x56042b107ad0 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe645ffb640 1 -- 172.21.15.55:0/2536793297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe650032b40 con 0x56042b107ad0 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe66fdff740 1 -- 172.21.15.55:0/2536793297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe650032780 con 0x56042b107ad0 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe645ffb640 1 -- 172.21.15.55:0/2536793297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe650052050 con 0x56042b107ad0 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe66fdff740 10 client.9054 fetch_fsmap learned FSMap version 86 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe66fdff740 1 -- 172.21.15.55:0/2536793297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x56042ae016b0 con 0x56042b107ad0 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe645ffb640 1 -- 172.21.15.55:0/2536793297 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650032780 con 0x56042b107ad0 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe645ffb640 1 -- 172.21.15.55:0/2536793297 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 86) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe650055020 con 0x56042b107ad0 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe66fdff740 10 client.9054 fetch_fsmap finished waiting for FSMap version 86 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe66fdff740 10 client.9054 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe66fdff740 20 client.9054 populate_metadata read hostname 'smithi055' 2024-04-25T09:03:38.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe66fdff740 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x56042b120cc0 0x56042b1230b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe66fdff740 4 client.9054 mds_command: new command op to 8922 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe66fdff740 1 -- 172.21.15.55:0/2536793297 --> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56042b081920 con 0x56042b120cc0 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe666d9d640 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x56042b120cc0 0x56042b1230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe666d9d640 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x56042b120cc0 0x56042b1230b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66cc9aa6ea49daf7 server_cookie=822b3b513fdbe97a in_seq=0 out_seq=0 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.933+0000 7fe645ffb640 10 client.9054 ms_handle_connect on v2:172.21.15.55:6835/4257598582 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe645ffb640 1 -- 172.21.15.55:0/2536793297 <== mds.0 v2:172.21.15.55:6835/4257598582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56042b081920 con 0x56042b120cc0 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe645ffb640 10 client.9054 handle_command_reply: tid=0 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 1 client.9054 shutdown 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 1 -- 172.21.15.55:0/2536793297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 msgr2=0x56042b0eb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0eb290 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fe650009990 tx=0x7fe650004730 comp rx=0 tx=0).stop 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 1 -- 172.21.15.55:0/2536793297 shutdown_connections 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x56042b120cc0 0x56042b1230b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0eddb0 0x56042b0d73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0eb290 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe645ffb640 0 client.9054 ms_handle_reset on v2:172.21.15.55:6835/4257598582 2024-04-25T09:03:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 1 --2- 172.21.15.55:0/2536793297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0d9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 1 -- 172.21.15.55:0/2536793297 >> 172.21.15.55:0/2536793297 conn(0x56042b0bff10 msgr2=0x56042b1085c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 1 -- 172.21.15.55:0/2536793297 shutdown_connections 2024-04-25T09:03:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 1 -- 172.21.15.55:0/2536793297 wait complete. 2024-04-25T09:03:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.934+0000 7fe66fdff740 20 client.9054 trim_cache size 0 max 16384 2024-04-25T09:03:38.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.950+0000 7fe66fdff740 1 Processor -- start 2024-04-25T09:03:38.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.950+0000 7fe66fdff740 1 -- start start 2024-04-25T09:03:38.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0ea230 0x56042b0bd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0eddb0 0x56042b127ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0d70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66fdff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6681fefe0 con 0x56042b107ad0 2024-04-25T09:03:38.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66fdff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680ae2a0 con 0x56042b0eddb0 2024-04-25T09:03:38.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66fdff740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6681fe9e0 con 0x56042b0ea230 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0d70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0d70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38828/0 (socket says 172.21.15.55:38828) 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66759e640 1 -- 172.21.15.55:0/2726568049 learned_addr learned my addr 172.21.15.55:0/2726568049 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66759e640 1 -- 172.21.15.55:0/2726568049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0ea230 msgr2=0x56042b0bd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe666d9d640 1 --2- 172.21.15.55:0/2726568049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0ea230 0x56042b0bd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66759e640 1 --2- 172.21.15.55:0/2726568049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0ea230 0x56042b0bd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe65ffff640 1 --2- 172.21.15.55:0/2726568049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0eddb0 0x56042b127ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66759e640 1 -- 172.21.15.55:0/2726568049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0eddb0 msgr2=0x56042b127ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66759e640 1 --2- 172.21.15.55:0/2726568049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0eddb0 0x56042b127ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.951+0000 7fe66759e640 1 -- 172.21.15.55:0/2726568049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56042b0fcce0 con 0x56042b107ad0 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe66759e640 1 --2- 172.21.15.55:0/2726568049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0d70f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fe660087c30 tx=0x7fe6600014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145bd3b7dfe2b1b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe647fff640 1 -- 172.21.15.55:0/2726568049 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600605f0 con 0x56042b107ad0 2024-04-25T09:03:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe647fff640 1 -- 172.21.15.55:0/2726568049 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660056290 con 0x56042b107ad0 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe647fff640 1 -- 172.21.15.55:0/2726568049 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600581f0 con 0x56042b107ad0 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe66fdff740 1 -- 172.21.15.55:0/2726568049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 msgr2=0x56042b0d70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe66fdff740 1 --2- 172.21.15.55:0/2726568049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0d70f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fe660087c30 tx=0x7fe6600014a0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe66fdff740 1 -- 172.21.15.55:0/2726568049 shutdown_connections 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe66fdff740 1 --2- 172.21.15.55:0/2726568049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b107ad0 0x56042b0d70f0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe66fdff740 1 --2- 172.21.15.55:0/2726568049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0eddb0 0x56042b127ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe66fdff740 1 --2- 172.21.15.55:0/2726568049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b0ea230 0x56042b0bd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe66fdff740 1 -- 172.21.15.55:0/2726568049 >> 172.21.15.55:0/2726568049 conn(0x56042b0bff10 msgr2=0x56042b0fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe66fdff740 1 -- 172.21.15.55:0/2726568049 shutdown_connections 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.952+0000 7fe66fdff740 1 -- 172.21.15.55:0/2726568049 wait complete. 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.953+0000 7fe66fdff740 1 -- start start 2024-04-25T09:03:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.953+0000 7fe66fdff740 1 Processor -- start 2024-04-25T09:03:38.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0fb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b0eddb0 0x56042b1705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe66fdff740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b107ad0 0x56042b0b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe66fdff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56042b0ece90 con 0x56042b0eddb0 2024-04-25T09:03:38.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe66fdff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56042b0c0cb0 con 0x56042b0ea230 2024-04-25T09:03:38.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe66fdff740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56042b0ed640 con 0x56042b107ad0 2024-04-25T09:03:38.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe66fdff740 10 client.0 _ll_register_callbacks cb 0x56042b0bac50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe65ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b0eddb0 0x56042b1705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe65ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b0eddb0 0x56042b1705d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38834/0 (socket says 172.21.15.55:38834) 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe65ffff640 1 -- 172.21.15.55:0/3902511034 learned_addr learned my addr 172.21.15.55:0/3902511034 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe666d9d640 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0fb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe66759e640 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b107ad0 0x56042b0b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe65ffff640 1 -- 172.21.15.55:0/3902511034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b107ad0 msgr2=0x56042b0b94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe65ffff640 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b107ad0 0x56042b0b94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe65ffff640 1 -- 172.21.15.55:0/3902511034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 msgr2=0x56042b0fb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe65ffff640 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0fb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe65ffff640 1 -- 172.21.15.55:0/3902511034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56042b0ecb00 con 0x56042b0eddb0 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe65ffff640 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b0eddb0 0x56042b1705d0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fe650009960 tx=0x7fe65002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaabf5abd46e8254 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:03:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.954+0000 7fe645ffb640 1 -- 172.21.15.55:0/3902511034 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65005b060 con 0x56042b0eddb0 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe645ffb640 1 -- 172.21.15.55:0/3902511034 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe650003a20 con 0x56042b0eddb0 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe66fdff740 1 -- 172.21.15.55:0/3902511034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe660056290 con 0x56042b0eddb0 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe645ffb640 1 -- 172.21.15.55:0/3902511034 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe650040070 con 0x56042b0eddb0 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe66fdff740 10 client.9060 fetch_fsmap learned FSMap version 86 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe66fdff740 1 -- 172.21.15.55:0/3902511034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x56042b170ea0 con 0x56042b0eddb0 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe645ffb640 1 -- 172.21.15.55:0/3902511034 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660056290 con 0x56042b0eddb0 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe645ffb640 1 -- 172.21.15.55:0/3902511034 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 86) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe650055040 con 0x56042b0eddb0 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe66fdff740 10 client.9060 fetch_fsmap finished waiting for FSMap version 86 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe66fdff740 10 client.9060 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe66fdff740 20 client.9060 populate_metadata read hostname 'smithi055' 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe66fdff740 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x56042b0b99e0 0x56042b116fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe66fdff740 4 client.9060 mds_command: new command op to 8922 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe66fdff740 1 -- 172.21.15.55:0/3902511034 --> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56042b0fd2a0 con 0x56042b0b99e0 2024-04-25T09:03:38.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe666d9d640 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x56042b0b99e0 0x56042b116fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe666d9d640 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x56042b0b99e0 0x56042b116fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c086e8b4b0269c4 server_cookie=1e44c6b57190b1aa in_seq=0 out_seq=0 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.955+0000 7fe645ffb640 10 client.9060 ms_handle_connect on v2:172.21.15.55:6835/4257598582 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe645ffb640 1 -- 172.21.15.55:0/3902511034 <== mds.0 v2:172.21.15.55:6835/4257598582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x56042b0fd2a0 con 0x56042b0b99e0 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe645ffb640 10 client.9060 handle_command_reply: tid=0 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 1 client.9060 shutdown 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 1 -- 172.21.15.55:0/3902511034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b0eddb0 msgr2=0x56042b1705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b0eddb0 0x56042b1705d0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fe650009960 tx=0x7fe65002e000 comp rx=0 tx=0).stop 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 1 -- 172.21.15.55:0/3902511034 shutdown_connections 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x56042b0b99e0 0x56042b116fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56042b107ad0 0x56042b0b94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe645ffb640 0 client.9060 ms_handle_reset on v2:172.21.15.55:6835/4257598582 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56042b0eddb0 0x56042b1705d0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 1 --2- 172.21.15.55:0/3902511034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56042b0ea230 0x56042b0fb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 1 -- 172.21.15.55:0/3902511034 >> 172.21.15.55:0/3902511034 conn(0x56042b0bff10 msgr2=0x56042b0ebe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 1 -- 172.21.15.55:0/3902511034 shutdown_connections 2024-04-25T09:03:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 1 -- 172.21.15.55:0/3902511034 wait complete. 2024-04-25T09:03:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66fdff740 20 client.9060 trim_cache size 0 max 16384 2024-04-25T09:03:38.951 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:03:38.951 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T09:03:38.951 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T09:03:38.951 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8922, 2024-04-25T09:03:38.951 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T09:03:38.951 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T09:03:38.952 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T09:03:38.952 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.698039402, 2024-04-25T09:03:38.952 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 86, 2024-04-25T09:03:38.952 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 115, 2024-04-25T09:03:38.952 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 115, 2024-04-25T09:03:38.952 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 10.063545531000001 2024-04-25T09:03:38.952 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:03:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 -- 172.21.15.55:0/2528491737 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe64806b4d0 msgr2=0x7fe64806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe64806b4d0 0x7fe64806d990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe658009560 tx=0x7fe658009190 comp rx=0 tx=0).stop 2024-04-25T09:03:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 -- 172.21.15.55:0/2528491737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680b6080 msgr2=0x7fe6680b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680b6080 0x7fe6680b1d60 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fe66000c7b0 tx=0x7fe66000cc70 comp rx=0 tx=0).stop 2024-04-25T09:03:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 -- 172.21.15.55:0/2528491737 shutdown_connections 2024-04-25T09:03:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe64806b4d0 0x7fe64806d990 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680b6080 0x7fe6680b1d60 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe66815baf0 0x7fe6680b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 --2- 172.21.15.55:0/2528491737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6680ccf20 0x7fe668151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 -- 172.21.15.55:0/2528491737 >> 172.21.15.55:0/2528491737 conn(0x7fe668099a40 msgr2=0x7fe6680cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 -- 172.21.15.55:0/2528491737 shutdown_connections 2024-04-25T09:03:38.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:38.956+0000 7fe66d01f640 1 -- 172.21.15.55:0/2528491737 wait complete. 2024-04-25T09:03:38.956 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:03:39.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.068+0000 7f99df76a640 1 Processor -- start 2024-04-25T09:03:39.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.068+0000 7f99df76a640 1 -- start start 2024-04-25T09:03:39.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.069+0000 7f99df76a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f99d815dce0 0x7f99d80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.069+0000 7f99df76a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d80d35b0 0x7f99d80b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.069+0000 7f99df76a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d815e0c0 con 0x7f99d80d1f90 2024-04-25T09:03:39.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.069+0000 7f99df76a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d80b7b10 con 0x7f99d815dce0 2024-04-25T09:03:39.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.069+0000 7f99df76a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d80d2510 con 0x7f99d80d35b0 2024-04-25T09:03:39.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.069+0000 7f99ddd07640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f99d80d1f90 0x7f99d806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55806/0 (socket says 172.21.15.55:55806) 2024-04-25T09:03:39.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.069+0000 7f99ddd07640 1 -- 172.21.15.55:0/2254804484 learned_addr learned my addr 172.21.15.55:0/2254804484 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:39.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.069+0000 7f99dcd05640 1 --2- 172.21.15.55:0/2254804484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d80d35b0 0x7f99d80b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.069+0000 7f99dd506640 1 --2- 172.21.15.55:0/2254804484 >> v2:172.21.15.167:3300/0 conn(0x7f99d815dce0 0x7f99d80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.069+0000 7f99cffff640 1 -- 172.21.15.55:0/2254804484 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694743870 0 0) 0x7f99d815e0c0 con 0x7f99d80d1f90 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.069+0000 7f99cffff640 1 -- 172.21.15.55:0/2254804484 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99c4003520 con 0x7f99d80d1f90 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.070+0000 7f99cffff640 1 -- 172.21.15.55:0/2254804484 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3918396861 0 0) 0x7f99c4003520 con 0x7f99d80d1f90 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.070+0000 7f99dcd05640 1 -- 172.21.15.55:0/2254804484 >> v2:172.21.15.167:3300/0 conn(0x7f99d815dce0 msgr2=0x7f99d80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.070+0000 7f99dcd05640 1 --2- 172.21.15.55:0/2254804484 >> v2:172.21.15.167:3300/0 conn(0x7f99d815dce0 0x7f99d80d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.070+0000 7f99dcd05640 1 -- 172.21.15.55:0/2254804484 >> v1:172.21.15.55:6789/0 conn(0x7f99d80d1f90 legacy=0x7f99d806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.070+0000 7f99dcd05640 1 -- 172.21.15.55:0/2254804484 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d80d27f0 con 0x7f99d80d35b0 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.070+0000 7f99dd506640 1 --2- 172.21.15.55:0/2254804484 >> v2:172.21.15.167:3300/0 conn(0x7f99d815dce0 0x7f99d80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.070+0000 7f99dcd05640 1 --2- 172.21.15.55:0/2254804484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d80d35b0 0x7f99d80b5450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f99c80097a0 tx=0x7f99c802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aec29842182c8987 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.071+0000 7f99cffff640 1 -- 172.21.15.55:0/2254804484 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8037070 con 0x7f99d80d35b0 2024-04-25T09:03:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.071+0000 7f99cffff640 1 -- 172.21.15.55:0/2254804484 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c802ab10 con 0x7f99d80d35b0 2024-04-25T09:03:39.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.071+0000 7f99cffff640 1 -- 172.21.15.55:0/2254804484 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00019f0 con 0x7f99d80d35b0 2024-04-25T09:03:39.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.071+0000 7f99df76a640 1 -- 172.21.15.55:0/2254804484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d80d35b0 msgr2=0x7f99d80b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.071+0000 7f99df76a640 1 --2- 172.21.15.55:0/2254804484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d80d35b0 0x7f99d80b5450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f99c80097a0 tx=0x7f99c802a080 comp rx=0 tx=0).stop 2024-04-25T09:03:39.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.071+0000 7f99df76a640 1 -- 172.21.15.55:0/2254804484 shutdown_connections 2024-04-25T09:03:39.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.071+0000 7f99df76a640 1 --2- 172.21.15.55:0/2254804484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d80d35b0 0x7f99d80b5450 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.071+0000 7f99df76a640 1 --2- 172.21.15.55:0/2254804484 >> v2:172.21.15.167:3300/0 conn(0x7f99d815dce0 0x7f99d80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.071+0000 7f99df76a640 1 -- 172.21.15.55:0/2254804484 >> 172.21.15.55:0/2254804484 conn(0x7f99d8072900 msgr2=0x7f99d80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:39.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.071+0000 7f99df76a640 1 -- 172.21.15.55:0/2254804484 shutdown_connections 2024-04-25T09:03:39.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.071+0000 7f99df76a640 1 -- 172.21.15.55:0/2254804484 wait complete. 2024-04-25T09:03:39.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.072+0000 7f99df76a640 1 Processor -- start 2024-04-25T09:03:39.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.072+0000 7f99df76a640 1 -- start start 2024-04-25T09:03:39.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.073+0000 7f99df76a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d80d1f90 0x7f99d815fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.073+0000 7f99df76a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99d80d35b0 0x7f99d815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.073+0000 7f99df76a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d815dce0 0x7f99d81529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.073+0000 7f99df76a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d80d3090 con 0x7f99d80d1f90 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.073+0000 7f99df76a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d80d2db0 con 0x7f99d80d35b0 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.073+0000 7f99df76a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d80b9820 con 0x7f99d815dce0 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.073+0000 7f99dd506640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d80d1f90 0x7f99d815fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.073+0000 7f99dd506640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d80d1f90 0x7f99d815fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38842/0 (socket says 172.21.15.55:38842) 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.073+0000 7f99dd506640 1 -- 172.21.15.55:0/2299937056 learned_addr learned my addr 172.21.15.55:0/2299937056 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99dd506640 1 -- 172.21.15.55:0/2299937056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d815dce0 msgr2=0x7f99d81529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99ddd07640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d815dce0 0x7f99d81529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99dd506640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d815dce0 0x7f99d81529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99dcd05640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99d80d35b0 0x7f99d815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99dd506640 1 -- 172.21.15.55:0/2299937056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99d80d35b0 msgr2=0x7f99d815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99dd506640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99d80d35b0 0x7f99d815e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99dd506640 1 -- 172.21.15.55:0/2299937056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8160400 con 0x7f99d80d1f90 2024-04-25T09:03:39.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99dd506640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d80d1f90 0x7f99d815fec0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f99d400ebe0 tx=0x7f99d400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99cdffb640 1 -- 172.21.15.55:0/2299937056 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4017070 con 0x7f99d80d1f90 2024-04-25T09:03:39.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99cdffb640 1 -- 172.21.15.55:0/2299937056 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d400cc30 con 0x7f99d80d1f90 2024-04-25T09:03:39.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99df76a640 1 -- 172.21.15.55:0/2299937056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d81f3740 con 0x7f99d80d1f90 2024-04-25T09:03:39.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99cdffb640 1 -- 172.21.15.55:0/2299937056 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4013470 con 0x7f99d80d1f90 2024-04-25T09:03:39.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.074+0000 7f99df76a640 1 -- 172.21.15.55:0/2299937056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d8160960 con 0x7f99d80d1f90 2024-04-25T09:03:39.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.075+0000 7f99df76a640 1 -- 172.21.15.55:0/2299937056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d80749b0 con 0x7f99d80d1f90 2024-04-25T09:03:39.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.076+0000 7f99cdffb640 1 -- 172.21.15.55:0/2299937056 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f99d401a070 con 0x7f99d80d1f90 2024-04-25T09:03:39.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.076+0000 7f99cdffb640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99bc06b4d0 0x7f99bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.076+0000 7f99cdffb640 1 -- 172.21.15.55:0/2299937056 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99d408a460 con 0x7f99d80d1f90 2024-04-25T09:03:39.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.076+0000 7f99dcd05640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99bc06b4d0 0x7f99bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.077+0000 7f99dcd05640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99bc06b4d0 0x7f99bc06d990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f99c8034000 tx=0x7f99c802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.080+0000 7f99cdffb640 1 -- 172.21.15.55:0/2299937056 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f99d8160400 con 0x7f99d80d1f90 2024-04-25T09:03:39.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.297+0000 7f99df76a640 1 -- 172.21.15.55:0/2299937056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99d80cdce0 con 0x7f99d80d1f90 2024-04-25T09:03:39.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.301+0000 7f99cdffb640 1 -- 172.21.15.55:0/2299937056 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) v1 ==== 53+0+73 (secure 0 0 0) 0x7f99d4059370 con 0x7f99d80d1f90 2024-04-25T09:03:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:03:39.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 -- 172.21.15.55:0/2299937056 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99bc06b4d0 msgr2=0x7f99bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99bc06b4d0 0x7f99bc06d990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f99c8034000 tx=0x7f99c802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:39.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 -- 172.21.15.55:0/2299937056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d80d1f90 msgr2=0x7f99d815fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d80d1f90 0x7f99d815fec0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f99d400ebe0 tx=0x7f99d400c520 comp rx=0 tx=0).stop 2024-04-25T09:03:39.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 -- 172.21.15.55:0/2299937056 shutdown_connections 2024-04-25T09:03:39.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f99bc06b4d0 0x7f99bc06d990 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99d815dce0 0x7f99d81529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99d80d35b0 0x7f99d815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 --2- 172.21.15.55:0/2299937056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d80d1f90 0x7f99d815fec0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 -- 172.21.15.55:0/2299937056 >> 172.21.15.55:0/2299937056 conn(0x7f99d8072900 msgr2=0x7f99d80d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:39.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 -- 172.21.15.55:0/2299937056 shutdown_connections 2024-04-25T09:03:39.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:39.303+0000 7f99df76a640 1 -- 172.21.15.55:0/2299937056 wait complete. 2024-04-25T09:03:39.303 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:03:39.303 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:03:39.303 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T09:03:39.303 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:03:39.303 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.303 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:03:39.303 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:03:39.303 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:03:39.303 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:39.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.304 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T09:03:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:39.320 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:39.321 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:39.321 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.321 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:39.321 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:39.321 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:39.321 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T09:03:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:39.322 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:39.322 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T09:03:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:03:39.322 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:39.322 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T09:03:39.323 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:03:39.323 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42138sec preferred_lft 42138sec 2024-04-25T09:03:39.323 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T09:03:39.323 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:39.323 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:39.323 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T09:03:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:39.323 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:39.323 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:03:39.323 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.324 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T09:03:39.324 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:39.324 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:03:39.324 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T09:03:39.324 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:39.324 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:03:39.324 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T09:03:39.324 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:39.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.325 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:03:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:03:39.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.385 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T09:03:39.441 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T09:03:39.441 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:03:39.441 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:03:39.441 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:03:39.441 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:03:39.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.441 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:03:39.441 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:03:39.442 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:03:39.442 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:03:39.442 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:03:39.442 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:03:39.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.527 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:03:39.542 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:03:39.542 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:03:39.543 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:39.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.543 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T09:03:39.607 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:39.607 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.663 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:39.664 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:39.664 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.720 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:03:39.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.721 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:39.804 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:39.804 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:39.804 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:03:39.812 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:39.813 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:39.813 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:03:39.813 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:03:39.813 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:39.817 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:39.817 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:39.817 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:03:39.818 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:03:39.818 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:39.818 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T09:03:39.818 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T09:03:39.818 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T09:03:39.818 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:03:39.818 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:03:39.818 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:03:39.818 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:03:39.819 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:03:39.820 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:03:39.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.885 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:39.885 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-25T09:03:39.896+0000 7f5592ad1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:03:39.945 INFO:teuthology.orchestra.run.smithi055.stdout:client7100 2024-04-25T09:03:39.946 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:39.946 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:40.002 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:40.002 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:40.002 DEBUG:teuthology.orchestra.run.smithi055:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T09:03:40.002 DEBUG:teuthology.orchestra.run.smithi055:> parent = os.path.join(mount_point, "parent") 2024-04-25T09:03:40.002 DEBUG:teuthology.orchestra.run.smithi055:> os.mkdir(parent) 2024-04-25T09:03:40.002 DEBUG:teuthology.orchestra.run.smithi055:> flushed = os.path.join(parent, "flushed") 2024-04-25T09:03:40.002 DEBUG:teuthology.orchestra.run.smithi055:> os.mkdir(flushed) 2024-04-25T09:03:40.002 DEBUG:teuthology.orchestra.run.smithi055:> for f in ["alpha", "bravo", "charlie"]: 2024-04-25T09:03:40.003 DEBUG:teuthology.orchestra.run.smithi055:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-04-25T09:03:40.003 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:40.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:40.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:40.130 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:03:40.190 INFO:teuthology.orchestra.run.smithi055.stdout:./ 2024-04-25T09:03:40.190 INFO:teuthology.orchestra.run.smithi055.stdout:./parent 2024-04-25T09:03:40.190 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed 2024-04-25T09:03:40.190 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/charlie 2024-04-25T09:03:40.190 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/alpha 2024-04-25T09:03:40.190 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/bravo 2024-04-25T09:03:40.191 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:40.191 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:40.191 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:40.191 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:40.191 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:03:40.191 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:40.297 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:03:40.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:40.307 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:40.307 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:40.307 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:40.307 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:40.307 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T09:03:40.307 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:40.414 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-25T09:03:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:40.424 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:40.424 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:40.424 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:40.424 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:40.424 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T09:03:40.424 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:40.531 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-25T09:03:40.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:40.540 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:40.540 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:40.541 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:40.541 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:40.541 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T09:03:40.541 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:40.647 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627780 2024-04-25T09:03:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:40.655 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:40.656 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:40.656 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:40.656 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:40.656 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T09:03:40.656 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:40.763 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627778 2024-04-25T09:03:40.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:40.772 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:40.772 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:40.773 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:40.773 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:40.773 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T09:03:40.773 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:40.880 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627779 2024-04-25T09:03:40.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:40.888 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:40.888 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:40.944 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:40.944 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:41.000 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:41.137 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:41.140 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.152+0000 7f4ac22f5640 1 Processor -- start 2024-04-25T09:03:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.153+0000 7f4ac22f5640 1 -- start start 2024-04-25T09:03:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4ac22f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4abc15dc30 0x7f4abc06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4ac22f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4abc06cc00 0x7f4abc0b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4ac22f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4abc06c1f0 con 0x7f4abc0b1960 2024-04-25T09:03:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4ac22f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4abc0cfb40 con 0x7f4abc15dc30 2024-04-25T09:03:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4ac22f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc0b2060 con 0x7f4abc06cc00 2024-04-25T09:03:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4ac0892640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4abc0b1960 0x7f4abc099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55822/0 (socket says 172.21.15.55:55822) 2024-04-25T09:03:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4abbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4abc15dc30 0x7f4abc06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4ac0892640 1 -- 172.21.15.55:0/3135985071 learned_addr learned my addr 172.21.15.55:0/3135985071 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4abb7fe640 1 --2- 172.21.15.55:0/3135985071 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4abc06cc00 0x7f4abc0b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4abbfff640 1 -- 172.21.15.55:0/3135985071 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4abc06cc00 msgr2=0x7f4abc0b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4abbfff640 1 --2- 172.21.15.55:0/3135985071 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4abc06cc00 0x7f4abc0b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4abbfff640 1 -- 172.21.15.55:0/3135985071 >> v1:172.21.15.55:6789/0 conn(0x7f4abc0b1960 legacy=0x7f4abc099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4abaffd640 1 -- 172.21.15.55:0/3135985071 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808122674 0 0) 0x7f4ab4001490 con 0x7f4abc0b1960 2024-04-25T09:03:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.154+0000 7f4abbfff640 1 -- 172.21.15.55:0/3135985071 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc0b2340 con 0x7f4abc15dc30 2024-04-25T09:03:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.155+0000 7f4abbfff640 1 --2- 172.21.15.55:0/3135985071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4abc15dc30 0x7f4abc06c6c0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0097a0 tx=0x7f4aac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ddeb85f7adfa91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.155+0000 7f4abaffd640 1 -- 172.21.15.55:0/3135985071 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac037070 con 0x7f4abc15dc30 2024-04-25T09:03:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.155+0000 7f4abaffd640 1 -- 172.21.15.55:0/3135985071 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac032440 con 0x7f4abc15dc30 2024-04-25T09:03:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.155+0000 7f4abaffd640 1 -- 172.21.15.55:0/3135985071 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac032810 con 0x7f4abc15dc30 2024-04-25T09:03:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.156+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3135985071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4abc15dc30 msgr2=0x7f4abc06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.156+0000 7f4ac22f5640 1 --2- 172.21.15.55:0/3135985071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4abc15dc30 0x7f4abc06c6c0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0097a0 tx=0x7f4aac02a180 comp rx=0 tx=0).stop 2024-04-25T09:03:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.156+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3135985071 shutdown_connections 2024-04-25T09:03:41.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.156+0000 7f4ac22f5640 1 --2- 172.21.15.55:0/3135985071 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4abc06cc00 0x7f4abc0b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.156+0000 7f4ac22f5640 1 --2- 172.21.15.55:0/3135985071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4abc15dc30 0x7f4abc06c6c0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.156+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3135985071 >> 172.21.15.55:0/3135985071 conn(0x7f4abc0d1900 msgr2=0x7f4abc0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.156+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3135985071 shutdown_connections 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.156+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3135985071 wait complete. 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.157+0000 7f4ac22f5640 1 Processor -- start 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.157+0000 7f4ac22f5640 1 -- start start 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac22f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4abc06cc00 0x7f4abc0b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac22f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4abc0b1960 0x7f4abc15e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac22f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4abc15dc30 0x7f4abc15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac22f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc0b1d80 con 0x7f4abc15dc30 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac22f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc0cfde0 con 0x7f4abc0b1960 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac22f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc15e010 con 0x7f4abc06cc00 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac0892640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4abc15dc30 0x7f4abc15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac0892640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4abc15dc30 0x7f4abc15ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38858/0 (socket says 172.21.15.55:38858) 2024-04-25T09:03:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac0892640 1 -- 172.21.15.55:0/3565060384 learned_addr learned my addr 172.21.15.55:0/3565060384 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4abbfff640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4abc06cc00 0x7f4abc0b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4abb7fe640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4abc0b1960 0x7f4abc15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac0892640 1 -- 172.21.15.55:0/3565060384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4abc06cc00 msgr2=0x7f4abc0b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac0892640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4abc06cc00 0x7f4abc0b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac0892640 1 -- 172.21.15.55:0/3565060384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4abc0b1960 msgr2=0x7f4abc15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac0892640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4abc0b1960 0x7f4abc15e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.158+0000 7f4ac0892640 1 -- 172.21.15.55:0/3565060384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc0b7310 con 0x7f4abc15dc30 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.159+0000 7f4ac0892640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4abc15dc30 0x7f4abc15ec80 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400c7f0 tx=0x7f4ab400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.159+0000 7f4ab8ff9640 1 -- 172.21.15.55:0/3565060384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4018070 con 0x7f4abc15dc30 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.159+0000 7f4ab8ff9640 1 -- 172.21.15.55:0/3565060384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab400a5e0 con 0x7f4abc15dc30 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.159+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3565060384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4abc160750 con 0x7f4abc15dc30 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.159+0000 7f4ab8ff9640 1 -- 172.21.15.55:0/3565060384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab400aa10 con 0x7f4abc15dc30 2024-04-25T09:03:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.159+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3565060384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4abc160d10 con 0x7f4abc15dc30 2024-04-25T09:03:41.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.160+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3565060384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4abc067850 con 0x7f4abc15dc30 2024-04-25T09:03:41.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.160+0000 7f4ab8ff9640 1 -- 172.21.15.55:0/3565060384 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ab401b070 con 0x7f4abc15dc30 2024-04-25T09:03:41.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.161+0000 7f4ab8ff9640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4aa806b500 0x7f4aa806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.161+0000 7f4ab8ff9640 1 -- 172.21.15.55:0/3565060384 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ab40896b0 con 0x7f4abc15dc30 2024-04-25T09:03:41.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.161+0000 7f4abbfff640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4aa806b500 0x7f4aa806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.161+0000 7f4abbfff640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4aa806b500 0x7f4aa806d9c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4aac034000 tx=0x7f4aac02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.165+0000 7f4ab8ff9640 1 -- 172.21.15.55:0/3565060384 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4abc06c1f0 con 0x7f4abc15dc30 2024-04-25T09:03:41.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.354+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3565060384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4abc0749b0 con 0x7f4abc15dc30 2024-04-25T09:03:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.355+0000 7f4ab8ff9640 1 -- 172.21.15.55:0/3565060384 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16627 (secure 0 0 0) 0x7f4ab4057ee0 con 0x7f4abc15dc30 2024-04-25T09:03:41.344 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:41.344 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":115,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:35.269007+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:31.900630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:32.603273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3565060384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4aa806b500 msgr2=0x7f4aa806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4aa806b500 0x7f4aa806d9c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4aac034000 tx=0x7f4aac02e000 comp rx=0 tx=0).stop 2024-04-25T09:03:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3565060384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4abc15dc30 msgr2=0x7f4abc15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4abc15dc30 0x7f4abc15ec80 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400c7f0 tx=0x7f4ab400ccb0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3565060384 shutdown_connections 2024-04-25T09:03:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4aa806b500 0x7f4aa806d9c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4abc15dc30 0x7f4abc15ec80 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4abc0b1960 0x7f4abc15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 --2- 172.21.15.55:0/3565060384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4abc06cc00 0x7f4abc0b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3565060384 >> 172.21.15.55:0/3565060384 conn(0x7f4abc0d1900 msgr2=0x7f4abc0d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3565060384 shutdown_connections 2024-04-25T09:03:41.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.357+0000 7f4ac22f5640 1 -- 172.21.15.55:0/3565060384 wait complete. 2024-04-25T09:03:41.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:03:31.900630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:03:32.603273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:41.357 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.472+0000 7f21b7e6f640 1 Processor -- start 2024-04-25T09:03:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.473+0000 7f21b7e6f640 1 -- start start 2024-04-25T09:03:41.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.473+0000 7f21b7e6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21b00d3b90 0x7f21b00d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.473+0000 7f21b7e6f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21b00d0f60 0x7f21b00b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.474+0000 7f21b7e6f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b00d4090 con 0x7f21b015dca0 2024-04-25T09:03:41.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.474+0000 7f21b7e6f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b00b6b20 con 0x7f21b00d3b90 2024-04-25T09:03:41.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.474+0000 7f21b7e6f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00d1390 con 0x7f21b00d0f60 2024-04-25T09:03:41.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.474+0000 7f21b540a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21b00d3b90 0x7f21b00d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.474+0000 7f21b540a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21b00d3b90 0x7f21b00d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38868/0 (socket says 172.21.15.55:38868) 2024-04-25T09:03:41.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.474+0000 7f21b540a640 1 -- 172.21.15.55:0/3049174260 learned_addr learned my addr 172.21.15.55:0/3049174260 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.474+0000 7f21b640c640 1 --2- 172.21.15.55:0/3049174260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21b00d0f60 0x7f21b00b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.474+0000 7f21b540a640 1 -- 172.21.15.55:0/3049174260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21b00d0f60 msgr2=0x7f21b00b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.474+0000 7f21b540a640 1 --2- 172.21.15.55:0/3049174260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21b00d0f60 0x7f21b00b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.474+0000 7f21b540a640 1 -- 172.21.15.55:0/3049174260 >> v1:172.21.15.167:6789/0 conn(0x7f21b015dca0 legacy=0x7f21b00ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.474+0000 7f21b540a640 1 -- 172.21.15.55:0/3049174260 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00d4370 con 0x7f21b00d3b90 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b540a640 1 --2- 172.21.15.55:0/3049174260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21b00d3b90 0x7f21b00d0a20 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f21a00098a0 tx=0x7f21a002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7dbf4ddf41aa3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b4c09640 1 -- 172.21.15.55:0/3049174260 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0037070 con 0x7f21b00d3b90 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b4c09640 1 -- 172.21.15.55:0/3049174260 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a0032440 con 0x7f21b00d3b90 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b4c09640 1 -- 172.21.15.55:0/3049174260 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0032810 con 0x7f21b00d3b90 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b7e6f640 1 -- 172.21.15.55:0/3049174260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21b00d3b90 msgr2=0x7f21b00d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b7e6f640 1 --2- 172.21.15.55:0/3049174260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21b00d3b90 0x7f21b00d0a20 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f21a00098a0 tx=0x7f21a002a250 comp rx=0 tx=0).stop 2024-04-25T09:03:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b7e6f640 1 -- 172.21.15.55:0/3049174260 shutdown_connections 2024-04-25T09:03:41.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b7e6f640 1 --2- 172.21.15.55:0/3049174260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21b00d0f60 0x7f21b00b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b7e6f640 1 --2- 172.21.15.55:0/3049174260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21b00d3b90 0x7f21b00d0a20 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b7e6f640 1 -- 172.21.15.55:0/3049174260 >> 172.21.15.55:0/3049174260 conn(0x7f21b00726c0 msgr2=0x7f21b0072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b7e6f640 1 -- 172.21.15.55:0/3049174260 shutdown_connections 2024-04-25T09:03:41.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.475+0000 7f21b7e6f640 1 -- 172.21.15.55:0/3049174260 wait complete. 2024-04-25T09:03:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.477+0000 7f21b7e6f640 1 Processor -- start 2024-04-25T09:03:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.477+0000 7f21b7e6f640 1 -- start start 2024-04-25T09:03:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.477+0000 7f21b7e6f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21b00d0f60 0x7f21b014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.477+0000 7f21b7e6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21b00d3b90 0x7f21b014f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.477+0000 7f21b7e6f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21b015dca0 0x7f21b01603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.477+0000 7f21b7e6f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00cf050 con 0x7f21b00d3b90 2024-04-25T09:03:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.477+0000 7f21b7e6f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00b6d50 con 0x7f21b00d0f60 2024-04-25T09:03:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.477+0000 7f21b7e6f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b015e080 con 0x7f21b015dca0 2024-04-25T09:03:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.477+0000 7f21b540a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21b00d3b90 0x7f21b014f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.477+0000 7f21b540a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21b00d3b90 0x7f21b014f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38870/0 (socket says 172.21.15.55:38870) 2024-04-25T09:03:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.477+0000 7f21b540a640 1 -- 172.21.15.55:0/4073748223 learned_addr learned my addr 172.21.15.55:0/4073748223 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21b5c0b640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21b00d0f60 0x7f21b014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21b640c640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21b015dca0 0x7f21b01603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21b540a640 1 -- 172.21.15.55:0/4073748223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21b015dca0 msgr2=0x7f21b01603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21b540a640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21b015dca0 0x7f21b01603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21b540a640 1 -- 172.21.15.55:0/4073748223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21b00d0f60 msgr2=0x7f21b014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21b540a640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21b00d0f60 0x7f21b014ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21b540a640 1 -- 172.21.15.55:0/4073748223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b014cfb0 con 0x7f21b00d3b90 2024-04-25T09:03:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21b540a640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21b00d3b90 0x7f21b014f300 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f21a0000c00 tx=0x7f21a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21a67fc640 1 -- 172.21.15.55:0/4073748223 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0037040 con 0x7f21b00d3b90 2024-04-25T09:03:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21a67fc640 1 -- 172.21.15.55:0/4073748223 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a0004230 con 0x7f21b00d3b90 2024-04-25T09:03:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21a67fc640 1 -- 172.21.15.55:0/4073748223 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0003610 con 0x7f21b00d3b90 2024-04-25T09:03:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21b7e6f640 1 -- 172.21.15.55:0/4073748223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b014d430 con 0x7f21b00d3b90 2024-04-25T09:03:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.478+0000 7f21b7e6f640 1 -- 172.21.15.55:0/4073748223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b0150070 con 0x7f21b00d3b90 2024-04-25T09:03:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.479+0000 7f21b7e6f640 1 -- 172.21.15.55:0/4073748223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b00750b0 con 0x7f21b00d3b90 2024-04-25T09:03:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.480+0000 7f21a67fc640 1 -- 172.21.15.55:0/4073748223 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f21a00037b0 con 0x7f21b00d3b90 2024-04-25T09:03:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.480+0000 7f21a67fc640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f219406b500 0x7f219406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.480+0000 7f21b5c0b640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f219406b500 0x7f219406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.480+0000 7f21a67fc640 1 -- 172.21.15.55:0/4073748223 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21a00aae90 con 0x7f21b00d3b90 2024-04-25T09:03:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.481+0000 7f21b5c0b640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f219406b500 0x7f219406d9c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006fd0 tx=0x7f21ac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.484+0000 7f21a67fc640 1 -- 172.21.15.55:0/4073748223 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f21a0079da0 con 0x7f21b00d3b90 2024-04-25T09:03:41.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.669+0000 7f21b7e6f640 1 -- 172.21.15.55:0/4073748223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21b00b4f40 con 0x7f21b00d3b90 2024-04-25T09:03:41.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.669+0000 7f21a67fc640 1 -- 172.21.15.55:0/4073748223 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21a00796a0 con 0x7f21b00d3b90 2024-04-25T09:03:41.658 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:03:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 -- 172.21.15.55:0/4073748223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f219406b500 msgr2=0x7f219406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f219406b500 0x7f219406d9c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006fd0 tx=0x7f21ac008040 comp rx=0 tx=0).stop 2024-04-25T09:03:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 -- 172.21.15.55:0/4073748223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21b00d3b90 msgr2=0x7f21b014f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21b00d3b90 0x7f21b014f300 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f21a0000c00 tx=0x7f21a00046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 -- 172.21.15.55:0/4073748223 shutdown_connections 2024-04-25T09:03:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f219406b500 0x7f219406d9c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21b015dca0 0x7f21b01603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21b00d3b90 0x7f21b014f300 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 --2- 172.21.15.55:0/4073748223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21b00d0f60 0x7f21b014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 -- 172.21.15.55:0/4073748223 >> 172.21.15.55:0/4073748223 conn(0x7f21b00726c0 msgr2=0x7f21b015d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 -- 172.21.15.55:0/4073748223 shutdown_connections 2024-04-25T09:03:41.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.672+0000 7f21b7e6f640 1 -- 172.21.15.55:0/4073748223 wait complete. 2024-04-25T09:03:41.671 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:41.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.786+0000 7fc907e5d640 1 Processor -- start 2024-04-25T09:03:41.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.786+0000 7fc907e5d640 1 -- start start 2024-04-25T09:03:41.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.787+0000 7fc907e5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc90015dc80 0x7fc900161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.787+0000 7fc907e5d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9000b97c0 0x7fc9000b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.787+0000 7fc907e5d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9001627a0 con 0x7fc9000b5a30 2024-04-25T09:03:41.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.787+0000 7fc907e5d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9000b5ea0 con 0x7fc9000b97c0 2024-04-25T09:03:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.787+0000 7fc907e5d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9001621e0 con 0x7fc90015dc80 2024-04-25T09:03:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.787+0000 7fc9053f8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9000b97c0 0x7fc9000b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.787+0000 7fc9063fa640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc9000b5a30 0x7fc90006bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55826/0 (socket says 172.21.15.55:55826) 2024-04-25T09:03:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.787+0000 7fc9063fa640 1 -- 172.21.15.55:0/1707348839 learned_addr learned my addr 172.21.15.55:0/1707348839 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.787+0000 7fc9053f8640 1 --2- 172.21.15.55:0/1707348839 >> v2:172.21.15.55:3300/0 conn(0x7fc9000b97c0 0x7fc9000b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38886/0 (socket says 172.21.15.55:38886) 2024-04-25T09:03:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.788+0000 7fc905bf9640 1 --2- 172.21.15.55:0/1707348839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc90015dc80 0x7fc900161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.788+0000 7fc9053f8640 1 -- 172.21.15.55:0/1707348839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc90015dc80 msgr2=0x7fc900161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.788+0000 7fc9053f8640 1 --2- 172.21.15.55:0/1707348839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc90015dc80 0x7fc900161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.788+0000 7fc9053f8640 1 -- 172.21.15.55:0/1707348839 >> v1:172.21.15.55:6789/0 conn(0x7fc9000b5a30 legacy=0x7fc90006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.788+0000 7fc9053f8640 1 -- 172.21.15.55:0/1707348839 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9001624c0 con 0x7fc9000b97c0 2024-04-25T09:03:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.788+0000 7fc905bf9640 1 --2- 172.21.15.55:0/1707348839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc90015dc80 0x7fc900161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:41.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.788+0000 7fc904bf7640 1 -- 172.21.15.55:0/1707348839 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677686968 0 0) 0x7fc9001627a0 con 0x7fc9000b5a30 2024-04-25T09:03:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.788+0000 7fc9053f8640 1 --2- 172.21.15.55:0/1707348839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9000b97c0 0x7fc9000b54f0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00097a0 tx=0x7fc8f002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd98f6a0b46ecf46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.789+0000 7fc904bf7640 1 -- 172.21.15.55:0/1707348839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0037070 con 0x7fc9000b97c0 2024-04-25T09:03:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.789+0000 7fc904bf7640 1 -- 172.21.15.55:0/1707348839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f0032440 con 0x7fc9000b97c0 2024-04-25T09:03:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.789+0000 7fc904bf7640 1 -- 172.21.15.55:0/1707348839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0032810 con 0x7fc9000b97c0 2024-04-25T09:03:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.789+0000 7fc907e5d640 1 -- 172.21.15.55:0/1707348839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9000b97c0 msgr2=0x7fc9000b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.789+0000 7fc907e5d640 1 --2- 172.21.15.55:0/1707348839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9000b97c0 0x7fc9000b54f0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00097a0 tx=0x7fc8f002a180 comp rx=0 tx=0).stop 2024-04-25T09:03:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.789+0000 7fc907e5d640 1 -- 172.21.15.55:0/1707348839 shutdown_connections 2024-04-25T09:03:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.789+0000 7fc907e5d640 1 --2- 172.21.15.55:0/1707348839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9000b97c0 0x7fc9000b54f0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.789+0000 7fc907e5d640 1 --2- 172.21.15.55:0/1707348839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc90015dc80 0x7fc900161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.789+0000 7fc907e5d640 1 -- 172.21.15.55:0/1707348839 >> 172.21.15.55:0/1707348839 conn(0x7fc9000d04f0 msgr2=0x7fc9000d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.789+0000 7fc907e5d640 1 -- 172.21.15.55:0/1707348839 shutdown_connections 2024-04-25T09:03:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.789+0000 7fc907e5d640 1 -- 172.21.15.55:0/1707348839 wait complete. 2024-04-25T09:03:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.790+0000 7fc907e5d640 1 Processor -- start 2024-04-25T09:03:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc907e5d640 1 -- start start 2024-04-25T09:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc907e5d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9000b5a30 0x7fc9000cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc907e5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9000b97c0 0x7fc90014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc907e5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc90015dc80 0x7fc900149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc907e5d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc900161db0 con 0x7fc90015dc80 2024-04-25T09:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc907e5d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90015e060 con 0x7fc9000b5a30 2024-04-25T09:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc907e5d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc900161f30 con 0x7fc9000b97c0 2024-04-25T09:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc9063fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc90015dc80 0x7fc900149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc9063fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc90015dc80 0x7fc900149580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38898/0 (socket says 172.21.15.55:38898) 2024-04-25T09:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc9063fa640 1 -- 172.21.15.55:0/2749321039 learned_addr learned my addr 172.21.15.55:0/2749321039 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc9053f8640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9000b97c0 0x7fc90014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.791+0000 7fc905bf9640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9000b5a30 0x7fc9000cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc9063fa640 1 -- 172.21.15.55:0/2749321039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9000b97c0 msgr2=0x7fc90014ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc9063fa640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9000b97c0 0x7fc90014ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc9063fa640 1 -- 172.21.15.55:0/2749321039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9000b5a30 msgr2=0x7fc9000cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc9063fa640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9000b5a30 0x7fc9000cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc9063fa640 1 -- 172.21.15.55:0/2749321039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9000cd2f0 con 0x7fc90015dc80 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc9053f8640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9000b97c0 0x7fc90014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc905bf9640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9000b5a30 0x7fc9000cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc9063fa640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc90015dc80 0x7fc900149580 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800c7a0 tx=0x7fc8f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc8f67fc640 1 -- 172.21.15.55:0/2749321039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8018070 con 0x7fc90015dc80 2024-04-25T09:03:41.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc8f67fc640 1 -- 172.21.15.55:0/2749321039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f800a640 con 0x7fc90015dc80 2024-04-25T09:03:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc907e5d640 1 -- 172.21.15.55:0/2749321039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9000cabe0 con 0x7fc90015dc80 2024-04-25T09:03:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc8f67fc640 1 -- 172.21.15.55:0/2749321039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f800aab0 con 0x7fc90015dc80 2024-04-25T09:03:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.792+0000 7fc907e5d640 1 -- 172.21.15.55:0/2749321039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9000cd590 con 0x7fc90015dc80 2024-04-25T09:03:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.793+0000 7fc907e5d640 1 -- 172.21.15.55:0/2749321039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9000750b0 con 0x7fc90015dc80 2024-04-25T09:03:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.793+0000 7fc8f67fc640 1 -- 172.21.15.55:0/2749321039 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc8f801b070 con 0x7fc90015dc80 2024-04-25T09:03:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.794+0000 7fc8f67fc640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8e406b4d0 0x7fc8e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.794+0000 7fc8f67fc640 1 -- 172.21.15.55:0/2749321039 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8f8089790 con 0x7fc90015dc80 2024-04-25T09:03:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.794+0000 7fc905bf9640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8e406b4d0 0x7fc8e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.794+0000 7fc905bf9640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8e406b4d0 0x7fc8e406d990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc006fd0 tx=0x7fc8fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.798+0000 7fc8f67fc640 1 -- 172.21.15.55:0/2749321039 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc8f80586a0 con 0x7fc90015dc80 2024-04-25T09:03:41.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.979+0000 7fc907e5d640 1 -- 172.21.15.55:0/2749321039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9000d1780 con 0x7fc90015dc80 2024-04-25T09:03:41.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.979+0000 7fc8f67fc640 1 -- 172.21.15.55:0/2749321039 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8f8057fa0 con 0x7fc90015dc80 2024-04-25T09:03:41.968 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T09:03:41.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 -- 172.21.15.55:0/2749321039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8e406b4d0 msgr2=0x7fc8e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8e406b4d0 0x7fc8e406d990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc006fd0 tx=0x7fc8fc008040 comp rx=0 tx=0).stop 2024-04-25T09:03:41.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 -- 172.21.15.55:0/2749321039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc90015dc80 msgr2=0x7fc900149580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc90015dc80 0x7fc900149580 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800c7a0 tx=0x7fc8f800cc60 comp rx=0 tx=0).stop 2024-04-25T09:03:41.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 -- 172.21.15.55:0/2749321039 shutdown_connections 2024-04-25T09:03:41.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc8e406b4d0 0x7fc8e406d990 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc90015dc80 0x7fc900149580 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9000b97c0 0x7fc90014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 --2- 172.21.15.55:0/2749321039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9000b5a30 0x7fc9000cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 -- 172.21.15.55:0/2749321039 >> 172.21.15.55:0/2749321039 conn(0x7fc9000d04f0 msgr2=0x7fc9000b8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 -- 172.21.15.55:0/2749321039 shutdown_connections 2024-04-25T09:03:41.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:41.981+0000 7fc907e5d640 1 -- 172.21.15.55:0/2749321039 wait complete. 2024-04-25T09:03:41.981 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:42.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.097+0000 7f8c1c046640 1 Processor -- start 2024-04-25T09:03:42.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.097+0000 7f8c1c046640 1 -- start start 2024-04-25T09:03:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.098+0000 7f8c1c046640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c140b97c0 0x7f8c140b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.098+0000 7f8c1c046640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c140b5a30 0x7f8c140d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.098+0000 7f8c1c046640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c141627a0 con 0x7f8c1415dc80 2024-04-25T09:03:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.098+0000 7f8c1c046640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c140b5ea0 con 0x7f8c140b5a30 2024-04-25T09:03:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.098+0000 7f8c1c046640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14161f80 con 0x7f8c140b97c0 2024-04-25T09:03:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.098+0000 7f8c1a5e3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c140b5a30 0x7f8c140d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.098+0000 7f8c1a5e3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c140b5a30 0x7f8c140d2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38906/0 (socket says 172.21.15.55:38906) 2024-04-25T09:03:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.098+0000 7f8c1a5e3640 1 -- 172.21.15.55:0/3244487942 learned_addr learned my addr 172.21.15.55:0/3244487942 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.099+0000 7f8c195e1640 1 --2- 172.21.15.55:0/3244487942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c140b97c0 0x7f8c140b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.099+0000 7f8c1a5e3640 1 -- 172.21.15.55:0/3244487942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c140b97c0 msgr2=0x7f8c140b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.099+0000 7f8c1a5e3640 1 --2- 172.21.15.55:0/3244487942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c140b97c0 0x7f8c140b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.099+0000 7f8c1a5e3640 1 -- 172.21.15.55:0/3244487942 >> v1:172.21.15.167:6789/0 conn(0x7f8c1415dc80 legacy=0x7f8c14161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.099+0000 7f8c1a5e3640 1 -- 172.21.15.55:0/3244487942 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c141621e0 con 0x7f8c140b5a30 2024-04-25T09:03:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.099+0000 7f8c1a5e3640 1 --2- 172.21.15.55:0/3244487942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c140b5a30 0x7f8c140d2470 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0098a0 tx=0x7f8c0c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a37d0e744253a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.100+0000 7f8c18de0640 1 -- 172.21.15.55:0/3244487942 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c037070 con 0x7f8c140b5a30 2024-04-25T09:03:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.100+0000 7f8c18de0640 1 -- 172.21.15.55:0/3244487942 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c032440 con 0x7f8c140b5a30 2024-04-25T09:03:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.100+0000 7f8c18de0640 1 -- 172.21.15.55:0/3244487942 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c032810 con 0x7f8c140b5a30 2024-04-25T09:03:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.100+0000 7f8c1c046640 1 -- 172.21.15.55:0/3244487942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c140b5a30 msgr2=0x7f8c140d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.100+0000 7f8c1c046640 1 --2- 172.21.15.55:0/3244487942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c140b5a30 0x7f8c140d2470 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0098a0 tx=0x7f8c0c02a290 comp rx=0 tx=0).stop 2024-04-25T09:03:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.100+0000 7f8c1c046640 1 -- 172.21.15.55:0/3244487942 shutdown_connections 2024-04-25T09:03:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.100+0000 7f8c1c046640 1 --2- 172.21.15.55:0/3244487942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c140b5a30 0x7f8c140d2470 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.100+0000 7f8c1c046640 1 --2- 172.21.15.55:0/3244487942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c140b97c0 0x7f8c140b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.100+0000 7f8c1c046640 1 -- 172.21.15.55:0/3244487942 >> 172.21.15.55:0/3244487942 conn(0x7f8c140d04f0 msgr2=0x7f8c140d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.100+0000 7f8c1c046640 1 -- 172.21.15.55:0/3244487942 shutdown_connections 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.100+0000 7f8c1c046640 1 -- 172.21.15.55:0/3244487942 wait complete. 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.101+0000 7f8c1c046640 1 Processor -- start 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c1c046640 1 -- start start 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c1c046640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c140b5a30 0x7f8c140cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c1c046640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c140b97c0 0x7f8c140b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c1c046640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c1415dc80 0x7f8c14149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c1c046640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1415e060 con 0x7f8c140b97c0 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c1c046640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140d1c70 con 0x7f8c1415dc80 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c1c046640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140d29b0 con 0x7f8c140b5a30 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c195e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c140b97c0 0x7f8c140b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c195e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c140b97c0 0x7f8c140b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38914/0 (socket says 172.21.15.55:38914) 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c195e1640 1 -- 172.21.15.55:0/2564816535 learned_addr learned my addr 172.21.15.55:0/2564816535 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c1a5e3640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c1415dc80 0x7f8c14149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.102+0000 7f8c19de2640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c140b5a30 0x7f8c140cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.103+0000 7f8c195e1640 1 -- 172.21.15.55:0/2564816535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c140b5a30 msgr2=0x7f8c140cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.103+0000 7f8c195e1640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c140b5a30 0x7f8c140cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.103+0000 7f8c195e1640 1 -- 172.21.15.55:0/2564816535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c1415dc80 msgr2=0x7f8c14149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.103+0000 7f8c195e1640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c1415dc80 0x7f8c14149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.103+0000 7f8c195e1640 1 -- 172.21.15.55:0/2564816535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c141f4100 con 0x7f8c140b97c0 2024-04-25T09:03:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.103+0000 7f8c195e1640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c140b97c0 0x7f8c140b5010 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800d800 tx=0x7f8c0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.103+0000 7f8c127fc640 1 -- 172.21.15.55:0/2564816535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0800b6c0 con 0x7f8c140b97c0 2024-04-25T09:03:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.103+0000 7f8c127fc640 1 -- 172.21.15.55:0/2564816535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c08019070 con 0x7f8c140b97c0 2024-04-25T09:03:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.103+0000 7f8c1c046640 1 -- 172.21.15.55:0/2564816535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c141f43e0 con 0x7f8c140b97c0 2024-04-25T09:03:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.103+0000 7f8c127fc640 1 -- 172.21.15.55:0/2564816535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0800ba80 con 0x7f8c140b97c0 2024-04-25T09:03:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.103+0000 7f8c1c046640 1 -- 172.21.15.55:0/2564816535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c141f4c80 con 0x7f8c140b97c0 2024-04-25T09:03:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.104+0000 7f8c1c046640 1 -- 172.21.15.55:0/2564816535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c141f45b0 con 0x7f8c140b97c0 2024-04-25T09:03:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.105+0000 7f8c127fc640 1 -- 172.21.15.55:0/2564816535 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c0800bc20 con 0x7f8c140b97c0 2024-04-25T09:03:42.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.105+0000 7f8c127fc640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c0006b4d0 0x7f8c0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.105+0000 7f8c127fc640 1 -- 172.21.15.55:0/2564816535 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c0808a540 con 0x7f8c140b97c0 2024-04-25T09:03:42.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.105+0000 7f8c19de2640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c0006b4d0 0x7f8c0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.106+0000 7f8c19de2640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c0006b4d0 0x7f8c0006d990 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8c04001e70 tx=0x7f8c04009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.109+0000 7f8c127fc640 1 -- 172.21.15.55:0/2564816535 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c08058d70 con 0x7f8c140b97c0 2024-04-25T09:03:42.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.293+0000 7f8c1c046640 1 -- 172.21.15.55:0/2564816535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c140750b0 con 0x7f8c140b97c0 2024-04-25T09:03:42.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.294+0000 7f8c127fc640 1 -- 172.21.15.55:0/2564816535 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c0805f0c0 con 0x7f8c140b97c0 2024-04-25T09:03:42.282 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T09:03:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 -- 172.21.15.55:0/2564816535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c0006b4d0 msgr2=0x7f8c0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c0006b4d0 0x7f8c0006d990 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8c04001e70 tx=0x7f8c04009040 comp rx=0 tx=0).stop 2024-04-25T09:03:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 -- 172.21.15.55:0/2564816535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c140b97c0 msgr2=0x7f8c140b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c140b97c0 0x7f8c140b5010 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800d800 tx=0x7f8c0800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 -- 172.21.15.55:0/2564816535 shutdown_connections 2024-04-25T09:03:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8c0006b4d0 0x7f8c0006d990 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c1415dc80 0x7f8c14149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c140b97c0 0x7f8c140b5010 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 --2- 172.21.15.55:0/2564816535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c140b5a30 0x7f8c140cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 -- 172.21.15.55:0/2564816535 >> 172.21.15.55:0/2564816535 conn(0x7f8c140d04f0 msgr2=0x7f8c1406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 -- 172.21.15.55:0/2564816535 shutdown_connections 2024-04-25T09:03:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.296+0000 7f8c1c046640 1 -- 172.21.15.55:0/2564816535 wait complete. 2024-04-25T09:03:42.295 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:03:42.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.409+0000 7fd6d8b34640 1 Processor -- start 2024-04-25T09:03:42.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.409+0000 7fd6d8b34640 1 -- start start 2024-04-25T09:03:42.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d8b34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6d40b0740 0x7fd6d40b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d8b34640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd6d40cfd60 0x7fd6d40d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d8b34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d415f660 con 0x7fd6d415ef60 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d8b34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d415f940 con 0x7fd6d40b0740 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d8b34640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d415fc20 con 0x7fd6d40cfd60 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d1d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6d40b0740 0x7fd6d40b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd6d415ef60 0x7fd6d40ce4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55838/0 (socket says 172.21.15.55:55838) 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d259c640 1 -- 172.21.15.55:0/3773578569 learned_addr learned my addr 172.21.15.55:0/3773578569 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d2d9d640 1 --2- 172.21.15.55:0/3773578569 >> v2:172.21.15.167:3300/0 conn(0x7fd6d40cfd60 0x7fd6d40d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d1d9b640 1 -- 172.21.15.55:0/3773578569 >> v2:172.21.15.167:3300/0 conn(0x7fd6d40cfd60 msgr2=0x7fd6d40d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d1d9b640 1 --2- 172.21.15.55:0/3773578569 >> v2:172.21.15.167:3300/0 conn(0x7fd6d40cfd60 0x7fd6d40d0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d1d9b640 1 -- 172.21.15.55:0/3773578569 >> v1:172.21.15.55:6789/0 conn(0x7fd6d415ef60 legacy=0x7fd6d40ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.410+0000 7fd6d1d9b640 1 -- 172.21.15.55:0/3773578569 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d415ff00 con 0x7fd6d40b0740 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.411+0000 7fd6d1d9b640 1 --2- 172.21.15.55:0/3773578569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d40b0740 0x7fd6d40b0bd0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40700e0 tx=0x7fd6bc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e067fa16165299 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.411+0000 7fd6d159a640 1 -- 172.21.15.55:0/3773578569 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc037070 con 0x7fd6d40b0740 2024-04-25T09:03:42.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.411+0000 7fd6d159a640 1 -- 172.21.15.55:0/3773578569 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc032440 con 0x7fd6d40b0740 2024-04-25T09:03:42.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.411+0000 7fd6d159a640 1 -- 172.21.15.55:0/3773578569 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc032810 con 0x7fd6d40b0740 2024-04-25T09:03:42.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.412+0000 7fd6d8b34640 1 -- 172.21.15.55:0/3773578569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d40b0740 msgr2=0x7fd6d40b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.412+0000 7fd6d8b34640 1 --2- 172.21.15.55:0/3773578569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d40b0740 0x7fd6d40b0bd0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40700e0 tx=0x7fd6bc02a230 comp rx=0 tx=0).stop 2024-04-25T09:03:42.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.412+0000 7fd6d8b34640 1 -- 172.21.15.55:0/3773578569 shutdown_connections 2024-04-25T09:03:42.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.412+0000 7fd6d8b34640 1 --2- 172.21.15.55:0/3773578569 >> v2:172.21.15.167:3300/0 conn(0x7fd6d40cfd60 0x7fd6d40d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.412+0000 7fd6d8b34640 1 --2- 172.21.15.55:0/3773578569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d40b0740 0x7fd6d40b0bd0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.412+0000 7fd6d8b34640 1 -- 172.21.15.55:0/3773578569 >> 172.21.15.55:0/3773578569 conn(0x7fd6d406f4c0 msgr2=0x7fd6d406f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.412+0000 7fd6d8b34640 1 -- 172.21.15.55:0/3773578569 shutdown_connections 2024-04-25T09:03:42.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.412+0000 7fd6d8b34640 1 -- 172.21.15.55:0/3773578569 wait complete. 2024-04-25T09:03:42.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.413+0000 7fd6d8b34640 1 Processor -- start 2024-04-25T09:03:42.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.413+0000 7fd6d8b34640 1 -- start start 2024-04-25T09:03:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d8b34640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d40b0740 0x7fd6d4153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d8b34640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d40cfd60 0x7fd6d40acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d8b34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d415ef60 0x7fd6d40a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d8b34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d415f340 con 0x7fd6d415ef60 2024-04-25T09:03:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d8b34640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d41604c0 con 0x7fd6d40cfd60 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d8b34640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40cebd0 con 0x7fd6d40b0740 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d415ef60 0x7fd6d40a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d415ef60 0x7fd6d40a85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38924/0 (socket says 172.21.15.55:38924) 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d2d9d640 1 -- 172.21.15.55:0/2947181286 learned_addr learned my addr 172.21.15.55:0/2947181286 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d1d9b640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d40cfd60 0x7fd6d40acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d2d9d640 1 -- 172.21.15.55:0/2947181286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d40b0740 msgr2=0x7fd6d4153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d2d9d640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d40b0740 0x7fd6d4153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d2d9d640 1 -- 172.21.15.55:0/2947181286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d40cfd60 msgr2=0x7fd6d40acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d2d9d640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d40cfd60 0x7fd6d40acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d2d9d640 1 -- 172.21.15.55:0/2947181286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d4154180 con 0x7fd6d415ef60 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.414+0000 7fd6d1d9b640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d40cfd60 0x7fd6d40acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.415+0000 7fd6d2d9d640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d415ef60 0x7fd6d40a85d0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400cd70 tx=0x7fd6c400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.415+0000 7fd6caffd640 1 -- 172.21.15.55:0/2947181286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4003b90 con 0x7fd6d415ef60 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.415+0000 7fd6caffd640 1 -- 172.21.15.55:0/2947181286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4003d30 con 0x7fd6d415ef60 2024-04-25T09:03:42.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.415+0000 7fd6caffd640 1 -- 172.21.15.55:0/2947181286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4004240 con 0x7fd6d415ef60 2024-04-25T09:03:42.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.415+0000 7fd6d8b34640 1 -- 172.21.15.55:0/2947181286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d4153c70 con 0x7fd6d415ef60 2024-04-25T09:03:42.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.415+0000 7fd6d8b34640 1 -- 172.21.15.55:0/2947181286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d40a9700 con 0x7fd6d415ef60 2024-04-25T09:03:42.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.416+0000 7fd6d8b34640 1 -- 172.21.15.55:0/2947181286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d40750b0 con 0x7fd6d415ef60 2024-04-25T09:03:42.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.416+0000 7fd6caffd640 1 -- 172.21.15.55:0/2947181286 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd6c40043e0 con 0x7fd6d415ef60 2024-04-25T09:03:42.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.417+0000 7fd6caffd640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6b406b4d0 0x7fd6b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.417+0000 7fd6caffd640 1 -- 172.21.15.55:0/2947181286 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6c408ad20 con 0x7fd6d415ef60 2024-04-25T09:03:42.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.417+0000 7fd6d259c640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6b406b4d0 0x7fd6b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.417+0000 7fd6d259c640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6b406b4d0 0x7fd6b406d990 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc000f60 tx=0x7fd6cc007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.421+0000 7fd6caffd640 1 -- 172.21.15.55:0/2947181286 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd6c4059ba0 con 0x7fd6d415ef60 2024-04-25T09:03:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.615+0000 7fd6d8b34640 1 -- 172.21.15.55:0/2947181286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd6d40b4900 con 0x7fd6d415ef60 2024-04-25T09:03:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.616+0000 7fd6caffd640 1 -- 172.21.15.55:0/2947181286 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v115) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd6c40594a0 con 0x7fd6d415ef60 2024-04-25T09:03:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 -- 172.21.15.55:0/2947181286 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6b406b4d0 msgr2=0x7fd6b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6b406b4d0 0x7fd6b406d990 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc000f60 tx=0x7fd6cc007a80 comp rx=0 tx=0).stop 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 -- 172.21.15.55:0/2947181286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d415ef60 msgr2=0x7fd6d40a85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d415ef60 0x7fd6d40a85d0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400cd70 tx=0x7fd6c400a660 comp rx=0 tx=0).stop 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 -- 172.21.15.55:0/2947181286 shutdown_connections 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6b406b4d0 0x7fd6b406d990 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d415ef60 0x7fd6d40a85d0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d40cfd60 0x7fd6d40acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 --2- 172.21.15.55:0/2947181286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d40b0740 0x7fd6d4153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 -- 172.21.15.55:0/2947181286 >> 172.21.15.55:0/2947181286 conn(0x7fd6d406f4c0 msgr2=0x7fd6d40b6900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 -- 172.21.15.55:0/2947181286 shutdown_connections 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.618+0000 7fd6d8b34640 1 -- 172.21.15.55:0/2947181286 wait complete. 2024-04-25T09:03:42.617 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:03:42.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:42.618 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:42.687 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:03:42.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:42.687 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:03:42.720 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:03:42.720 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.875+0000 7f8a4195c640 1 Processor -- start 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.875+0000 7f8a4195c640 1 -- start start 2024-04-25T09:03:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a4195c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8a3c0d3b90 0x7f8a3c0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a4195c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0d0f60 0x7f8a3c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a4195c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c0d4090 con 0x7f8a3c15dca0 2024-04-25T09:03:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a4195c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3c0b6b20 con 0x7f8a3c0d3b90 2024-04-25T09:03:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a4195c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0d1390 con 0x7f8a3c0d0f60 2024-04-25T09:03:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a3affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8a3c15dca0 0x7f8a3c0ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55842/0 (socket says 172.21.15.55:55842) 2024-04-25T09:03:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a3affd640 1 -- 172.21.15.55:0/3475025327 learned_addr learned my addr 172.21.15.55:0/3475025327 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/3475025327 >> v2:172.21.15.167:3300/0 conn(0x7f8a3c0d3b90 0x7f8a3c0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0d0f60 0x7f8a3c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056897044 0 0) 0x7f8a3c0d4090 con 0x7f8a3c15dca0 2024-04-25T09:03:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a24003520 con 0x7f8a3c15dca0 2024-04-25T09:03:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3715505266 0 0) 0x7f8a24003520 con 0x7f8a3c15dca0 2024-04-25T09:03:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0d0f60 msgr2=0x7f8a3c0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a39ffb640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0d0f60 0x7f8a3c0b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 >> v2:172.21.15.167:3300/0 conn(0x7f8a3c0d3b90 msgr2=0x7f8a3c0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a39ffb640 1 --2- 172.21.15.55:0/3475025327 >> v2:172.21.15.167:3300/0 conn(0x7f8a3c0d3b90 0x7f8a3c0d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c0d4370 con 0x7f8a3c15dca0 2024-04-25T09:03:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f8a2c001670 con 0x7f8a3c15dca0 2024-04-25T09:03:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.876+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 >> v1:172.21.15.55:6789/0 conn(0x7f8a3c15dca0 legacy=0x7f8a3c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a39ffb640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a240039e0 0x7f8a24003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a39ffb640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0d0f60 0x7f8a24004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a39ffb640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 0x7f8a240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0d1390 con 0x7f8a24004d40 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2400b9c0 con 0x7f8a240039e0 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2400bb40 con 0x7f8a3c0d0f60 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 0x7f8a240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0d0f60 0x7f8a24004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a3affd640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a240039e0 0x7f8a24003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a3b7fe640 1 -- 172.21.15.55:0/3475025327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0d0f60 msgr2=0x7f8a24004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0d0f60 0x7f8a24004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a3b7fe640 1 -- 172.21.15.55:0/3475025327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a240039e0 msgr2=0x7f8a24003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a240039e0 0x7f8a24003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.877+0000 7f8a3b7fe640 1 -- 172.21.15.55:0/3475025327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24003520 con 0x7f8a24004d40 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.878+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 0x7f8a240051c0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009fc0 tx=0x7f8a24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c4275dd8daeb9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.878+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34009c10 con 0x7f8a24004d40 2024-04-25T09:03:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.878+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a34036070 con 0x7f8a24004d40 2024-04-25T09:03:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.878+0000 7f8a39ffb640 1 -- 172.21.15.55:0/3475025327 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34031670 con 0x7f8a24004d40 2024-04-25T09:03:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.878+0000 7f8a4195c640 1 -- 172.21.15.55:0/3475025327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 msgr2=0x7f8a240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.878+0000 7f8a4195c640 1 --2- 172.21.15.55:0/3475025327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 0x7f8a240051c0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009fc0 tx=0x7f8a24005830 comp rx=0 tx=0).stop 2024-04-25T09:03:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.878+0000 7f8a3b7fe640 1 -- 172.21.15.55:0/3475025327 reap_dead start 2024-04-25T09:03:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.878+0000 7f8a4195c640 1 -- 172.21.15.55:0/3475025327 shutdown_connections 2024-04-25T09:03:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.878+0000 7f8a4195c640 1 -- 172.21.15.55:0/3475025327 >> 172.21.15.55:0/3475025327 conn(0x7f8a3c0726c0 msgr2=0x7f8a3c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.878+0000 7f8a4195c640 1 -- 172.21.15.55:0/3475025327 shutdown_connections 2024-04-25T09:03:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.878+0000 7f8a4195c640 1 -- 172.21.15.55:0/3475025327 wait complete. 2024-04-25T09:03:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.880+0000 7f8a4195c640 1 Processor -- start 2024-04-25T09:03:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.880+0000 7f8a4195c640 1 -- start start 2024-04-25T09:03:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.880+0000 7f8a4195c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 0x7f8a3c0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.880+0000 7f8a4195c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c0cb500 0x7f8a3c14d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.880+0000 7f8a4195c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0b2620 0x7f8a3c0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.880+0000 7f8a4195c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0cf050 con 0x7f8a24004d40 2024-04-25T09:03:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.880+0000 7f8a4195c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0b6d50 con 0x7f8a3c0cb500 2024-04-25T09:03:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.880+0000 7f8a4195c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c15e080 con 0x7f8a3c0b2620 2024-04-25T09:03:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a3affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 0x7f8a3c0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a3affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 0x7f8a3c0cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38946/0 (socket says 172.21.15.55:38946) 2024-04-25T09:03:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a3affd640 1 -- 172.21.15.55:0/3863093575 learned_addr learned my addr 172.21.15.55:0/3863093575 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0b2620 0x7f8a3c0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c0cb500 0x7f8a3c14d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a3affd640 1 -- 172.21.15.55:0/3863093575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0b2620 msgr2=0x7f8a3c0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a3affd640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0b2620 0x7f8a3c0b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a3affd640 1 -- 172.21.15.55:0/3863093575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c0cb500 msgr2=0x7f8a3c14d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a3affd640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c0cb500 0x7f8a3c14d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a3affd640 1 -- 172.21.15.55:0/3863093575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c0cbc70 con 0x7f8a24004d40 2024-04-25T09:03:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a3affd640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 0x7f8a3c0cae00 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c007310 tx=0x7f8a2c0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a23fff640 1 -- 172.21.15.55:0/3863093575 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c01a070 con 0x7f8a24004d40 2024-04-25T09:03:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a23fff640 1 -- 172.21.15.55:0/3863093575 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00f960 con 0x7f8a24004d40 2024-04-25T09:03:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a4195c640 1 -- 172.21.15.55:0/3863093575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c14d820 con 0x7f8a24004d40 2024-04-25T09:03:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a23fff640 1 -- 172.21.15.55:0/3863093575 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00fd30 con 0x7f8a24004d40 2024-04-25T09:03:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.881+0000 7f8a4195c640 1 -- 172.21.15.55:0/3863093575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c1571d0 con 0x7f8a24004d40 2024-04-25T09:03:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.883+0000 7f8a23fff640 1 -- 172.21.15.55:0/3863093575 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a2c01d070 con 0x7f8a24004d40 2024-04-25T09:03:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.883+0000 7f8a23fff640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 0x7f8a2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.884+0000 7f8a23fff640 1 -- 172.21.15.55:0/3863093575 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a2c089c40 con 0x7f8a24004d40 2024-04-25T09:03:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.884+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 0x7f8a2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.884+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 0x7f8a2806d990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0cdd80 tx=0x7f8a30008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.884+0000 7f8a44667740 1 Processor -- start 2024-04-25T09:03:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.884+0000 7f8a44667740 1 -- start start 2024-04-25T09:03:42.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.885+0000 7f8a44667740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562249007b10 0x56224900a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.885+0000 7f8a44667740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224900a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.885+0000 7f8a44667740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562248fda770 0x562248fddf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.885+0000 7f8a44667740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562248f43da0 con 0x562249007ef0 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.885+0000 7f8a44667740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562248eecb80 con 0x562248fda770 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.885+0000 7f8a44667740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562248f3fe40 con 0x562249007b10 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.885+0000 7f8a3a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224900a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.885+0000 7f8a3a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224900a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38950/0 (socket says 172.21.15.55:38950) 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.885+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2842165546 learned_addr learned my addr 172.21.15.55:0/2842165546 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.886+0000 7f8a3affd640 1 --2- 172.21.15.55:0/2842165546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562249007b10 0x56224900a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.886+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/2842165546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562248fda770 0x562248fddf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.886+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2842165546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562249007b10 msgr2=0x56224900a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.886+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/2842165546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562249007b10 0x56224900a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.886+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2842165546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562248fda770 msgr2=0x562248fddf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.886+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/2842165546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562248fda770 0x562248fddf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.886+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2842165546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562248ef6f10 con 0x562249007ef0 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.886+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/2842165546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224900a860 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f8a30004650 tx=0x7f8a30016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e837f04bc03be67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.886+0000 7f8a217fa640 1 -- 172.21.15.55:0/2842165546 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30013dd0 con 0x562249007ef0 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.886+0000 7f8a217fa640 1 -- 172.21.15.55:0/2842165546 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a30028070 con 0x562249007ef0 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.886+0000 7f8a217fa640 1 -- 172.21.15.55:0/2842165546 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30023680 con 0x562249007ef0 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.887+0000 7f8a44667740 1 -- 172.21.15.55:0/2842165546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 msgr2=0x56224900a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.887+0000 7f8a44667740 1 --2- 172.21.15.55:0/2842165546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224900a860 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f8a30004650 tx=0x7f8a30016000 comp rx=0 tx=0).stop 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.887+0000 7f8a44667740 1 -- 172.21.15.55:0/2842165546 shutdown_connections 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.887+0000 7f8a44667740 1 --2- 172.21.15.55:0/2842165546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562248fda770 0x562248fddf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.887+0000 7f8a44667740 1 --2- 172.21.15.55:0/2842165546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224900a860 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.887+0000 7f8a44667740 1 --2- 172.21.15.55:0/2842165546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562249007b10 0x56224900a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.887+0000 7f8a44667740 1 -- 172.21.15.55:0/2842165546 >> 172.21.15.55:0/2842165546 conn(0x562248fdc9e0 msgr2=0x562249025320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.887+0000 7f8a44667740 1 -- 172.21.15.55:0/2842165546 shutdown_connections 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.887+0000 7f8a44667740 1 -- 172.21.15.55:0/2842165546 wait complete. 2024-04-25T09:03:42.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.887+0000 7f8a44667740 1 -- start start 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.887+0000 7f8a44667740 1 Processor -- start 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a44667740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x562248ffefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a44667740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562249007ef0 0x56224900ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a44667740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56224900b390 0x56224900cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a44667740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562248fdfb90 con 0x56224900b390 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a44667740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562248ee24b0 con 0x562249007b10 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a44667740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562248fdfe70 con 0x562249007ef0 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a44667740 10 client.0 _ll_register_callbacks cb 0x562248f22180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a3b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56224900b390 0x56224900cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a3b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56224900b390 0x56224900cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38966/0 (socket says 172.21.15.55:38966) 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a3b7fe640 1 -- 172.21.15.55:0/1681206331 learned_addr learned my addr 172.21.15.55:0/1681206331 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a3affd640 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x562248ffefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.888+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562249007ef0 0x56224900ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a3b7fe640 1 -- 172.21.15.55:0/1681206331 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562249007ef0 msgr2=0x56224900ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562249007ef0 0x56224900ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a3b7fe640 1 -- 172.21.15.55:0/1681206331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 msgr2=0x562248ffefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x562248ffefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a3b7fe640 1 -- 172.21.15.55:0/1681206331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562248d227d0 con 0x56224900b390 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562249007ef0 0x56224900ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56224900b390 0x56224900cb40 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400e200 tx=0x7f8a34004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c444fbfa090b956 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/1681206331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34009cd0 con 0x56224900b390 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/1681206331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a34031a50 con 0x56224900b390 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a44667740 1 -- 172.21.15.55:0/1681206331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a30028070 con 0x56224900b390 2024-04-25T09:03:42.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/1681206331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a3404d050 con 0x56224900b390 2024-04-25T09:03:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a44667740 10 client.9117 fetch_fsmap learned FSMap version 86 2024-04-25T09:03:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a44667740 1 -- 172.21.15.55:0/1681206331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x562248c583f0 con 0x56224900b390 2024-04-25T09:03:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/1681206331 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a30028070 con 0x56224900b390 2024-04-25T09:03:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/1681206331 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 86) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8a34050020 con 0x56224900b390 2024-04-25T09:03:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a44667740 10 client.9117 fetch_fsmap finished waiting for FSMap version 86 2024-04-25T09:03:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a44667740 10 client.9117 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T09:03:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a44667740 20 client.9117 populate_metadata read hostname 'smithi055' 2024-04-25T09:03:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a44667740 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x5622490275d0 0x5622490279e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a44667740 4 client.9117 mds_command: new command op to 8922 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.889+0000 7f8a44667740 1 -- 172.21.15.55:0/1681206331 --> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562248f512e0 con 0x5622490275d0 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.890+0000 7f8a3affd640 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x5622490275d0 0x5622490279e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.890+0000 7f8a3affd640 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x5622490275d0 0x5622490279e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83fc1e1aaa4a9616 server_cookie=40c7bc806f33460b in_seq=0 out_seq=0 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.890+0000 7f8a1a7fc640 10 client.9117 ms_handle_connect on v2:172.21.15.55:6835/4257598582 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.890+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/1681206331 <== mds.0 v2:172.21.15.55:6835/4257598582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562248f512e0 con 0x5622490275d0 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.890+0000 7f8a1a7fc640 10 client.9117 handle_command_reply: tid=0 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.890+0000 7f8a44667740 1 client.9117 shutdown 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a44667740 1 -- 172.21.15.55:0/1681206331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56224900b390 msgr2=0x56224900cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a44667740 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56224900b390 0x56224900cb40 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400e200 tx=0x7f8a34004ab0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a44667740 1 -- 172.21.15.55:0/1681206331 shutdown_connections 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a44667740 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x5622490275d0 0x5622490279e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a44667740 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56224900b390 0x56224900cb40 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a44667740 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562249007ef0 0x56224900ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a1a7fc640 0 client.9117 ms_handle_reset on v2:172.21.15.55:6835/4257598582 2024-04-25T09:03:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a44667740 1 --2- 172.21.15.55:0/1681206331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x562248ffefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a44667740 1 -- 172.21.15.55:0/1681206331 >> 172.21.15.55:0/1681206331 conn(0x562248fda770 msgr2=0x562248fdb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a44667740 1 -- 172.21.15.55:0/1681206331 shutdown_connections 2024-04-25T09:03:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a44667740 1 -- 172.21.15.55:0/1681206331 wait complete. 2024-04-25T09:03:42.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.891+0000 7f8a44667740 20 client.9117 trim_cache size 0 max 16384 2024-04-25T09:03:42.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.904+0000 7f8a44667740 1 Processor -- start 2024-04-25T09:03:42.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.904+0000 7f8a44667740 1 -- start start 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a44667740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x562248fdb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a44667740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x562248fd97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a44667740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56224900b390 0x562249006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a44667740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c2002b0 con 0x562249007ef0 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a44667740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c1ff4a0 con 0x562249007b10 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a44667740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c1588c0 con 0x56224900b390 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a3a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x562248fd97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a3a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x562248fd97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38978/0 (socket says 172.21.15.55:38978) 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2313924050 learned_addr learned my addr 172.21.15.55:0/2313924050 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2313924050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56224900b390 msgr2=0x562249006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/2313924050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56224900b390 0x562249006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2313924050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 msgr2=0x562248fdb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/2313924050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x562248fdb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2313924050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562248c180f0 con 0x562249007ef0 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.905+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/2313924050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x562248fd97f0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009860 tx=0x7f8a3001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2743e24f166e8369 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a20ff9640 1 -- 172.21.15.55:0/2313924050 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30023440 con 0x562249007ef0 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a20ff9640 1 -- 172.21.15.55:0/2313924050 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a30028040 con 0x562249007ef0 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a20ff9640 1 -- 172.21.15.55:0/2313924050 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30023840 con 0x562249007ef0 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a44667740 1 -- 172.21.15.55:0/2313924050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 msgr2=0x562248fd97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a44667740 1 --2- 172.21.15.55:0/2313924050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x562248fd97f0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009860 tx=0x7f8a3001a000 comp rx=0 tx=0).stop 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a44667740 1 -- 172.21.15.55:0/2313924050 shutdown_connections 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a44667740 1 --2- 172.21.15.55:0/2313924050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56224900b390 0x562249006190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a44667740 1 --2- 172.21.15.55:0/2313924050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x562248fd97f0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a44667740 1 --2- 172.21.15.55:0/2313924050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x562248fdb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a44667740 1 -- 172.21.15.55:0/2313924050 >> 172.21.15.55:0/2313924050 conn(0x562248fda770 msgr2=0x562249022220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a44667740 1 -- 172.21.15.55:0/2313924050 shutdown_connections 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.906+0000 7f8a44667740 1 -- 172.21.15.55:0/2313924050 wait complete. 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.907+0000 7f8a44667740 1 -- start start 2024-04-25T09:03:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.907+0000 7f8a44667740 1 Processor -- start 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a44667740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x5622490067e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a44667740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224908f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a44667740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56224900b390 0x56224908fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a44667740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562249037a00 con 0x562249007ef0 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a44667740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c158ec0 con 0x562249007b10 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a44667740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562249028470 con 0x56224900b390 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a44667740 10 client.0 _ll_register_callbacks cb 0x7f8a30009730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224908f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224908f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38994/0 (socket says 172.21.15.55:38994) 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2161109 learned_addr learned my addr 172.21.15.55:0/2161109 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56224900b390 0x56224908fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3affd640 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x5622490067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2161109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56224900b390 msgr2=0x56224908fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56224900b390 0x56224908fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2161109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 msgr2=0x5622490067e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x5622490067e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3a7fc640 1 -- 172.21.15.55:0/2161109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562249046c60 con 0x562249007ef0 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3b7fe640 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56224900b390 0x56224908fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3affd640 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x5622490067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a3a7fc640 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224908f8e0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009fd0 tx=0x7f8a30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9239e2486388e3fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.908+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/2161109 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30044060 con 0x562249007ef0 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/2161109 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a30032070 con 0x562249007ef0 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a44667740 1 -- 172.21.15.55:0/2161109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a30028040 con 0x562249007ef0 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/2161109 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a3004a050 con 0x562249007ef0 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a44667740 10 client.9123 fetch_fsmap learned FSMap version 86 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a44667740 1 -- 172.21.15.55:0/2161109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x5622490058d0 con 0x562249007ef0 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/2161109 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a30028040 con 0x562249007ef0 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/2161109 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 86) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8a3004d020 con 0x562249007ef0 2024-04-25T09:03:42.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a44667740 10 client.9123 fetch_fsmap finished waiting for FSMap version 86 2024-04-25T09:03:42.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a44667740 10 client.9123 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T09:03:42.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a44667740 20 client.9123 populate_metadata read hostname 'smithi055' 2024-04-25T09:03:42.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a44667740 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x562249006d20 0x5622490340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a44667740 4 client.9123 mds_command: new command op to 8922 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T09:03:42.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a44667740 1 -- 172.21.15.55:0/2161109 --> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562248f4b630 con 0x562249006d20 2024-04-25T09:03:42.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a3affd640 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x562249006d20 0x5622490340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a3affd640 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x562249006d20 0x5622490340c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19df0f849f6d2ff server_cookie=6c93ed7b954a8fd1 in_seq=0 out_seq=0 2024-04-25T09:03:42.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.909+0000 7f8a1a7fc640 10 client.9123 ms_handle_connect on v2:172.21.15.55:6835/4257598582 2024-04-25T09:03:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a1a7fc640 1 -- 172.21.15.55:0/2161109 <== mds.0 v2:172.21.15.55:6835/4257598582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562248f4b630 con 0x562249006d20 2024-04-25T09:03:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a1a7fc640 10 client.9123 handle_command_reply: tid=0 2024-04-25T09:03:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 1 client.9123 shutdown 2024-04-25T09:03:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 1 -- 172.21.15.55:0/2161109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 msgr2=0x56224908f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224908f8e0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009fd0 tx=0x7f8a30004730 comp rx=0 tx=0).stop 2024-04-25T09:03:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 1 -- 172.21.15.55:0/2161109 shutdown_connections 2024-04-25T09:03:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.55:6835/4257598582,v1:172.21.15.55:6837/4257598582] conn(0x562249006d20 0x5622490340c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56224900b390 0x56224908fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a1a7fc640 0 client.9123 ms_handle_reset on v2:172.21.15.55:6835/4257598582 2024-04-25T09:03:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562249007ef0 0x56224908f8e0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 1 --2- 172.21.15.55:0/2161109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562249007b10 0x5622490067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 1 -- 172.21.15.55:0/2161109 >> 172.21.15.55:0/2161109 conn(0x562248fda770 msgr2=0x562248fd5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 1 -- 172.21.15.55:0/2161109 shutdown_connections 2024-04-25T09:03:42.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 1 -- 172.21.15.55:0/2161109 wait complete. 2024-04-25T09:03:42.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.924+0000 7f8a44667740 20 client.9123 trim_cache size 0 max 16384 2024-04-25T09:03:42.914 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:03:42.914 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "", 2024-04-25T09:03:42.914 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0 2024-04-25T09:03:42.914 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:03:42.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 -- 172.21.15.55:0/3863093575 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 msgr2=0x7f8a2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 0x7f8a2806d990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0cdd80 tx=0x7f8a30008040 comp rx=0 tx=0).stop 2024-04-25T09:03:42.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 -- 172.21.15.55:0/3863093575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 msgr2=0x7f8a3c0cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 0x7f8a3c0cae00 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c007310 tx=0x7f8a2c0077d0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 -- 172.21.15.55:0/3863093575 shutdown_connections 2024-04-25T09:03:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a2806b4d0 0x7f8a2806d990 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3c0b2620 0x7f8a3c0b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c0cb500 0x7f8a3c14d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 --2- 172.21.15.55:0/3863093575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24004d40 0x7f8a3c0cae00 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 -- 172.21.15.55:0/3863093575 >> 172.21.15.55:0/3863093575 conn(0x7f8a3c0726c0 msgr2=0x7f8a3c0b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 -- 172.21.15.55:0/3863093575 shutdown_connections 2024-04-25T09:03:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:42.925+0000 7f8a4195c640 1 -- 172.21.15.55:0/3863093575 wait complete. 2024-04-25T09:03:42.924 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:03:43.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.036+0000 7fab72753640 1 Processor -- start 2024-04-25T09:03:43.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.036+0000 7fab72753640 1 -- start start 2024-04-25T09:03:43.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.037+0000 7fab72753640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fab6c15dc30 0x7fab6c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.037+0000 7fab72753640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fab6c06cc00 0x7fab6c0b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.037+0000 7fab72753640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c06c1f0 con 0x7fab6c0b1960 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.037+0000 7fab72753640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c0cfb40 con 0x7fab6c15dc30 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.037+0000 7fab72753640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c0b1db0 con 0x7fab6c06cc00 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.037+0000 7fab6bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fab6c15dc30 0x7fab6c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.037+0000 7fab70cf0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fab6c0b1960 0x7fab6c099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55846/0 (socket says 172.21.15.55:55846) 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.037+0000 7fab70cf0640 1 -- 172.21.15.55:0/1629443251 learned_addr learned my addr 172.21.15.55:0/1629443251 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.038+0000 7fab6bfff640 1 -- 172.21.15.55:0/1629443251 >> v2:172.21.15.167:3300/0 conn(0x7fab6c06cc00 msgr2=0x7fab6c0b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.038+0000 7fab6b7fe640 1 --2- 172.21.15.55:0/1629443251 >> v2:172.21.15.167:3300/0 conn(0x7fab6c06cc00 0x7fab6c0b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.038+0000 7fab6bfff640 1 --2- 172.21.15.55:0/1629443251 >> v2:172.21.15.167:3300/0 conn(0x7fab6c06cc00 0x7fab6c0b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.038+0000 7fab6bfff640 1 -- 172.21.15.55:0/1629443251 >> v1:172.21.15.55:6789/0 conn(0x7fab6c0b1960 legacy=0x7fab6c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.038+0000 7fab6affd640 1 -- 172.21.15.55:0/1629443251 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826795830 0 0) 0x7fab64001490 con 0x7fab6c0b1960 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.038+0000 7fab6bfff640 1 -- 172.21.15.55:0/1629443251 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0b2060 con 0x7fab6c15dc30 2024-04-25T09:03:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.038+0000 7fab6b7fe640 1 --2- 172.21.15.55:0/1629443251 >> v2:172.21.15.167:3300/0 conn(0x7fab6c06cc00 0x7fab6c0b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.038+0000 7fab6bfff640 1 --2- 172.21.15.55:0/1629443251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab6c15dc30 0x7fab6c06c6c0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0d27a0 tx=0x7fab5c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1cdfeddcf35883 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.039+0000 7fab6affd640 1 -- 172.21.15.55:0/1629443251 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c037070 con 0x7fab6c15dc30 2024-04-25T09:03:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.039+0000 7fab6affd640 1 -- 172.21.15.55:0/1629443251 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c032440 con 0x7fab6c15dc30 2024-04-25T09:03:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.039+0000 7fab6affd640 1 -- 172.21.15.55:0/1629443251 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c032810 con 0x7fab6c15dc30 2024-04-25T09:03:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.039+0000 7fab72753640 1 -- 172.21.15.55:0/1629443251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab6c15dc30 msgr2=0x7fab6c06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.039+0000 7fab72753640 1 --2- 172.21.15.55:0/1629443251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab6c15dc30 0x7fab6c06c6c0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0d27a0 tx=0x7fab5c02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.039+0000 7fab72753640 1 -- 172.21.15.55:0/1629443251 shutdown_connections 2024-04-25T09:03:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.039+0000 7fab72753640 1 --2- 172.21.15.55:0/1629443251 >> v2:172.21.15.167:3300/0 conn(0x7fab6c06cc00 0x7fab6c0b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.039+0000 7fab72753640 1 --2- 172.21.15.55:0/1629443251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab6c15dc30 0x7fab6c06c6c0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.039+0000 7fab72753640 1 -- 172.21.15.55:0/1629443251 >> 172.21.15.55:0/1629443251 conn(0x7fab6c0d1900 msgr2=0x7fab6c0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.039+0000 7fab72753640 1 -- 172.21.15.55:0/1629443251 shutdown_connections 2024-04-25T09:03:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.039+0000 7fab72753640 1 -- 172.21.15.55:0/1629443251 wait complete. 2024-04-25T09:03:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.040+0000 7fab72753640 1 Processor -- start 2024-04-25T09:03:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.041+0000 7fab72753640 1 -- start start 2024-04-25T09:03:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.041+0000 7fab72753640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab6c06cc00 0x7fab6c15e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.041+0000 7fab72753640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab6c0b1960 0x7fab6c1f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.041+0000 7fab72753640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab6c15dc30 0x7fab6c1f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.041+0000 7fab72753640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0cfde0 con 0x7fab6c06cc00 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.041+0000 7fab72753640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0b2620 con 0x7fab6c0b1960 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.041+0000 7fab72753640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c15e010 con 0x7fab6c15dc30 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.041+0000 7fab6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab6c06cc00 0x7fab6c15e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.041+0000 7fab6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab6c06cc00 0x7fab6c15e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39020/0 (socket says 172.21.15.55:39020) 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.041+0000 7fab6bfff640 1 -- 172.21.15.55:0/2392992952 learned_addr learned my addr 172.21.15.55:0/2392992952 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.042+0000 7fab6bfff640 1 -- 172.21.15.55:0/2392992952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab6c15dc30 msgr2=0x7fab6c1f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.042+0000 7fab6bfff640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab6c15dc30 0x7fab6c1f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.042+0000 7fab6bfff640 1 -- 172.21.15.55:0/2392992952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab6c0b1960 msgr2=0x7fab6c1f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.042+0000 7fab6bfff640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab6c0b1960 0x7fab6c1f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.042+0000 7fab6bfff640 1 -- 172.21.15.55:0/2392992952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c15e8b0 con 0x7fab6c06cc00 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.042+0000 7fab6bfff640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab6c06cc00 0x7fab6c15e220 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fab5c000c00 tx=0x7fab5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.042+0000 7fab68ff9640 1 -- 172.21.15.55:0/2392992952 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c037040 con 0x7fab6c06cc00 2024-04-25T09:03:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.042+0000 7fab68ff9640 1 -- 172.21.15.55:0/2392992952 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c042070 con 0x7fab6c06cc00 2024-04-25T09:03:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.042+0000 7fab72753640 1 -- 172.21.15.55:0/2392992952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c15eb90 con 0x7fab6c06cc00 2024-04-25T09:03:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.042+0000 7fab68ff9640 1 -- 172.21.15.55:0/2392992952 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c030a50 con 0x7fab6c06cc00 2024-04-25T09:03:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.042+0000 7fab72753640 1 -- 172.21.15.55:0/2392992952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c15f150 con 0x7fab6c06cc00 2024-04-25T09:03:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.043+0000 7fab72753640 1 -- 172.21.15.55:0/2392992952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c067850 con 0x7fab6c06cc00 2024-04-25T09:03:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.043+0000 7fab68ff9640 1 -- 172.21.15.55:0/2392992952 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab5c030bf0 con 0x7fab6c06cc00 2024-04-25T09:03:43.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.044+0000 7fab68ff9640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab5806b4d0 0x7fab5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.044+0000 7fab68ff9640 1 -- 172.21.15.55:0/2392992952 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab5c0aad10 con 0x7fab6c06cc00 2024-04-25T09:03:43.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.044+0000 7fab6b7fe640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab5806b4d0 0x7fab5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.044+0000 7fab6b7fe640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab5806b4d0 0x7fab5806d990 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fab60006fd0 tx=0x7fab60008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.048+0000 7fab68ff9640 1 -- 172.21.15.55:0/2392992952 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab5c045360 con 0x7fab6c06cc00 2024-04-25T09:03:43.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.273+0000 7fab72753640 1 -- 172.21.15.55:0/2392992952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fab6c15d350 con 0x7fab6c06cc00 2024-04-25T09:03:43.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.274+0000 7fab68ff9640 1 -- 172.21.15.55:0/2392992952 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) v1 ==== 53+0+73 (secure 0 0 0) 0x7fab5c079b90 con 0x7fab6c06cc00 2024-04-25T09:03:43.262 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:03:43.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 -- 172.21.15.55:0/2392992952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab5806b4d0 msgr2=0x7fab5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab5806b4d0 0x7fab5806d990 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fab60006fd0 tx=0x7fab60008040 comp rx=0 tx=0).stop 2024-04-25T09:03:43.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 -- 172.21.15.55:0/2392992952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab6c06cc00 msgr2=0x7fab6c15e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab6c06cc00 0x7fab6c15e220 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fab5c000c00 tx=0x7fab5c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 -- 172.21.15.55:0/2392992952 shutdown_connections 2024-04-25T09:03:43.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fab5806b4d0 0x7fab5806d990 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab6c15dc30 0x7fab6c1f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab6c0b1960 0x7fab6c1f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 --2- 172.21.15.55:0/2392992952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab6c06cc00 0x7fab6c15e220 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 -- 172.21.15.55:0/2392992952 >> 172.21.15.55:0/2392992952 conn(0x7fab6c0d1900 msgr2=0x7fab6c0704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 -- 172.21.15.55:0/2392992952 shutdown_connections 2024-04-25T09:03:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:43.276+0000 7fab72753640 1 -- 172.21.15.55:0/2392992952 wait complete. 2024-04-25T09:03:43.275 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:03:43.276 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:03:43.276 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T09:03:43.276 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:03:43.276 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:43.276 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:03:43.276 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:03:43.276 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:03:43.276 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:43.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.276 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T09:03:43.294 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:43.294 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:43.294 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:43.295 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:43.295 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:43.295 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:43.295 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:43.295 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:43.296 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T09:03:43.296 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:43.296 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:43.296 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T09:03:43.297 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:03:43.297 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:43.297 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T09:03:43.297 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:03:43.297 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42134sec preferred_lft 42134sec 2024-04-25T09:03:43.297 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T09:03:43.298 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:43.298 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:43.298 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:43.298 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T09:03:43.298 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:43.299 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:43.299 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:03:43.299 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:43.299 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T09:03:43.299 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:43.299 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:43.299 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:03:43.300 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T09:03:43.300 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:43.300 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:43.300 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:03:43.300 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T09:03:43.300 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:43.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.301 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:03:43.357 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:03:43.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.359 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T09:03:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T09:03:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:03:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:03:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:03:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:03:43.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.416 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:03:43.416 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:03:43.416 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:03:43.416 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:03:43.416 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:03:43.416 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:03:43.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.501 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:03:43.516 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:03:43.516 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:03:43.516 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:43.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.517 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T09:03:43.580 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:43.581 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:43.637 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:43.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:43.637 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:43.692 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:03:43.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.692 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:43.774 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:43.775 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:43.775 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:03:43.783 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:43.783 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:43.783 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:03:43.783 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:03:43.783 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:43.788 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:43.788 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:43.788 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:03:43.788 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:03:43.788 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:43.788 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T09:03:43.788 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T09:03:43.789 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T09:03:43.789 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:03:43.789 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:03:43.789 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:03:43.789 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:03:43.789 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:03:43.790 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:03:43.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.791 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:43.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.855 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:43.911 INFO:teuthology.orchestra.run.smithi055.stdout:client7951 2024-04-25T09:03:43.912 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:43.912 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:43.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.968 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-04-25T09:03:44.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:44.027 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-04-25T09:03:44.106 INFO:teuthology.orchestra.run.smithi055.stderr:8+0 records in 2024-04-25T09:03:44.106 INFO:teuthology.orchestra.run.smithi055.stderr:8+0 records out 2024-04-25T09:03:44.106 INFO:teuthology.orchestra.run.smithi055.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0229432 s, 366 MB/s 2024-04-25T09:03:44.107 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:44.107 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:44.107 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:44.107 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:44.107 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T09:03:44.107 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:44.214 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627781 2024-04-25T09:03:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:44.223 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:44.223 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:44.224 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:44.224 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:44.224 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T09:03:44.224 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:44.330 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627782 2024-04-25T09:03:44.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:44.340 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:44.340 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:44.396 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:44.396 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:44.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:44.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.603+0000 7fde82012640 1 Processor -- start 2024-04-25T09:03:44.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.603+0000 7fde82012640 1 -- start start 2024-04-25T09:03:44.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.604+0000 7fde82012640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c15dce0 0x7fde7c0d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.604+0000 7fde82012640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fde7c0b5b60 0x7fde7c0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.604+0000 7fde82012640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7c15e0c0 con 0x7fde7c0d35b0 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.604+0000 7fde82012640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c0d2510 con 0x7fde7c0b5b60 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.604+0000 7fde82012640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0d27f0 con 0x7fde7c15dce0 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.604+0000 7fde7affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fde7c0d35b0 0x7fde7c0b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55854/0 (socket says 172.21.15.55:55854) 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.604+0000 7fde7affd640 1 -- 172.21.15.55:0/3200958787 learned_addr learned my addr 172.21.15.55:0/3200958787 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.604+0000 7fde7bfff640 1 --2- 172.21.15.55:0/3200958787 >> v2:172.21.15.167:3300/0 conn(0x7fde7c0b5b60 0x7fde7c0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.604+0000 7fde7b7fe640 1 --2- 172.21.15.55:0/3200958787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c15dce0 0x7fde7c0d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.605+0000 7fde7a7fc640 1 -- 172.21.15.55:0/3200958787 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651281559 0 0) 0x7fde7c15e0c0 con 0x7fde7c0d35b0 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.605+0000 7fde7a7fc640 1 -- 172.21.15.55:0/3200958787 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde64003520 con 0x7fde7c0d35b0 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.605+0000 7fde7bfff640 1 -- 172.21.15.55:0/3200958787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c15dce0 msgr2=0x7fde7c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.605+0000 7fde7bfff640 1 --2- 172.21.15.55:0/3200958787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c15dce0 0x7fde7c0d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.605+0000 7fde7bfff640 1 -- 172.21.15.55:0/3200958787 >> v1:172.21.15.55:6789/0 conn(0x7fde7c0d35b0 legacy=0x7fde7c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.605+0000 7fde7bfff640 1 -- 172.21.15.55:0/3200958787 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0d2ad0 con 0x7fde7c0b5b60 2024-04-25T09:03:44.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.605+0000 7fde7b7fe640 1 --2- 172.21.15.55:0/3200958787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c15dce0 0x7fde7c0d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:44.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde7bfff640 1 --2- 172.21.15.55:0/3200958787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde7c0b5b60 0x7fde7c0b6b00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fde74009d90 tx=0x7fde7402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fd08feeabf2b370 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde7a7fc640 1 -- 172.21.15.55:0/3200958787 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74007740 con 0x7fde7c0b5b60 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde7a7fc640 1 -- 172.21.15.55:0/3200958787 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde740078e0 con 0x7fde7c0b5b60 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde7a7fc640 1 -- 172.21.15.55:0/3200958787 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74007c90 con 0x7fde7c0b5b60 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde82012640 1 -- 172.21.15.55:0/3200958787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde7c0b5b60 msgr2=0x7fde7c0b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde82012640 1 --2- 172.21.15.55:0/3200958787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde7c0b5b60 0x7fde7c0b6b00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fde74009d90 tx=0x7fde7402a660 comp rx=0 tx=0).stop 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde82012640 1 -- 172.21.15.55:0/3200958787 shutdown_connections 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde82012640 1 --2- 172.21.15.55:0/3200958787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde7c0b5b60 0x7fde7c0b6b00 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde82012640 1 --2- 172.21.15.55:0/3200958787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c15dce0 0x7fde7c0d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde82012640 1 -- 172.21.15.55:0/3200958787 >> 172.21.15.55:0/3200958787 conn(0x7fde7c072900 msgr2=0x7fde7c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde82012640 1 -- 172.21.15.55:0/3200958787 shutdown_connections 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.606+0000 7fde82012640 1 -- 172.21.15.55:0/3200958787 wait complete. 2024-04-25T09:03:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.608+0000 7fde82012640 1 Processor -- start 2024-04-25T09:03:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.608+0000 7fde82012640 1 -- start start 2024-04-25T09:03:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.608+0000 7fde82012640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c0b5b60 0x7fde7c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.608+0000 7fde82012640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde7c0d35b0 0x7fde7c0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.608+0000 7fde82012640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde7c15dce0 0x7fde7c1f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.608+0000 7fde82012640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0b9820 con 0x7fde7c15dce0 2024-04-25T09:03:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.608+0000 7fde82012640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0d3090 con 0x7fde7c0d35b0 2024-04-25T09:03:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.608+0000 7fde82012640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0b99a0 con 0x7fde7c0b5b60 2024-04-25T09:03:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde7c15dce0 0x7fde7c1f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde7c15dce0 0x7fde7c1f31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39022/0 (socket says 172.21.15.55:39022) 2024-04-25T09:03:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7bfff640 1 -- 172.21.15.55:0/3053499482 learned_addr learned my addr 172.21.15.55:0/3053499482 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7affd640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde7c0d35b0 0x7fde7c0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7b7fe640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c0b5b60 0x7fde7c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7bfff640 1 -- 172.21.15.55:0/3053499482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c0b5b60 msgr2=0x7fde7c153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7bfff640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c0b5b60 0x7fde7c153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7bfff640 1 -- 172.21.15.55:0/3053499482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde7c0d35b0 msgr2=0x7fde7c0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7bfff640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde7c0d35b0 0x7fde7c0c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7bfff640 1 -- 172.21.15.55:0/3053499482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c1f3b60 con 0x7fde7c15dce0 2024-04-25T09:03:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7b7fe640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c0b5b60 0x7fde7c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7affd640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde7c0d35b0 0x7fde7c0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde7bfff640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde7c15dce0 0x7fde7c1f31c0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fde74009d90 tx=0x7fde74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde63fff640 1 -- 172.21.15.55:0/3053499482 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74009450 con 0x7fde7c15dce0 2024-04-25T09:03:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde63fff640 1 -- 172.21.15.55:0/3053499482 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74004240 con 0x7fde7c15dce0 2024-04-25T09:03:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde82012640 1 -- 172.21.15.55:0/3053499482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c1f3e40 con 0x7fde7c15dce0 2024-04-25T09:03:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde63fff640 1 -- 172.21.15.55:0/3053499482 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74004630 con 0x7fde7c15dce0 2024-04-25T09:03:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.609+0000 7fde82012640 1 -- 172.21.15.55:0/3053499482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c0c7980 con 0x7fde7c15dce0 2024-04-25T09:03:44.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.610+0000 7fde82012640 1 -- 172.21.15.55:0/3053499482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c0d2020 con 0x7fde7c15dce0 2024-04-25T09:03:44.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.611+0000 7fde63fff640 1 -- 172.21.15.55:0/3053499482 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fde74039040 con 0x7fde7c15dce0 2024-04-25T09:03:44.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.611+0000 7fde63fff640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde6806b4d0 0x7fde6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.611+0000 7fde63fff640 1 -- 172.21.15.55:0/3053499482 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde740ab210 con 0x7fde7c15dce0 2024-04-25T09:03:44.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.611+0000 7fde7b7fe640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde6806b4d0 0x7fde6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.612+0000 7fde7b7fe640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde6806b4d0 0x7fde6806d990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009a20 tx=0x7fde6c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.616+0000 7fde63fff640 1 -- 172.21.15.55:0/3053499482 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fde7c0d2020 con 0x7fde7c15dce0 2024-04-25T09:03:44.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.800+0000 7fde82012640 1 -- 172.21.15.55:0/3053499482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde7c0749b0 con 0x7fde7c15dce0 2024-04-25T09:03:44.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.801+0000 7fde63fff640 1 -- 172.21.15.55:0/3053499482 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16627 (secure 0 0 0) 0x7fde74040030 con 0x7fde7c15dce0 2024-04-25T09:03:44.789 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:44.789 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":115,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:35.269007+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:31.900630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:32.603273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:44.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 -- 172.21.15.55:0/3053499482 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde6806b4d0 msgr2=0x7fde6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde6806b4d0 0x7fde6806d990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009a20 tx=0x7fde6c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:44.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 -- 172.21.15.55:0/3053499482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde7c15dce0 msgr2=0x7fde7c1f31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde7c15dce0 0x7fde7c1f31c0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fde74009d90 tx=0x7fde74004a40 comp rx=0 tx=0).stop 2024-04-25T09:03:44.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 -- 172.21.15.55:0/3053499482 shutdown_connections 2024-04-25T09:03:44.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde6806b4d0 0x7fde6806d990 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde7c15dce0 0x7fde7c1f31c0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde7c0d35b0 0x7fde7c0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 --2- 172.21.15.55:0/3053499482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde7c0b5b60 0x7fde7c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 -- 172.21.15.55:0/3053499482 >> 172.21.15.55:0/3053499482 conn(0x7fde7c072900 msgr2=0x7fde7c0b80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:44.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 -- 172.21.15.55:0/3053499482 shutdown_connections 2024-04-25T09:03:44.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.803+0000 7fde82012640 1 -- 172.21.15.55:0/3053499482 wait complete. 2024-04-25T09:03:44.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:03:31.900630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:03:32.603273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:44.803 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:44.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.918+0000 7fe52f076640 1 Processor -- start 2024-04-25T09:03:44.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.919+0000 7fe52f076640 1 -- start start 2024-04-25T09:03:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.919+0000 7fe52f076640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe52815dc80 0x7fe528161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.919+0000 7fe52f076640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5280b5c00 0x7fe5280d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.919+0000 7fe52f076640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5281627a0 con 0x7fe5280b97c0 2024-04-25T09:03:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.919+0000 7fe52f076640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5281621e0 con 0x7fe52815dc80 2024-04-25T09:03:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.919+0000 7fe52f076640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5281624c0 con 0x7fe5280b5c00 2024-04-25T09:03:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.920+0000 7fe52d613640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5280b5c00 0x7fe5280d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.920+0000 7fe52ce12640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe52815dc80 0x7fe528161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.920+0000 7fe52ce12640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe52815dc80 0x7fe528161870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:53666/0 (socket says 172.21.15.55:53666) 2024-04-25T09:03:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.920+0000 7fe52d613640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5280b5c00 0x7fe5280d2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:35066/0 (socket says 172.21.15.55:35066) 2024-04-25T09:03:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.920+0000 7fe52ce12640 1 -- 172.21.15.55:0/2341643831 learned_addr learned my addr 172.21.15.55:0/2341643831 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.920+0000 7fe527fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe5280b97c0 0x7fe5280b54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:45498/0 (socket says 172.21.15.55:45498) 2024-04-25T09:03:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.920+0000 7fe52ce12640 1 -- 172.21.15.55:0/2341643831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5280b5c00 msgr2=0x7fe5280d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.920+0000 7fe52ce12640 1 --2- 172.21.15.55:0/2341643831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5280b5c00 0x7fe5280d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.920+0000 7fe52ce12640 1 -- 172.21.15.55:0/2341643831 >> v1:172.21.15.167:6789/0 conn(0x7fe5280b97c0 legacy=0x7fe5280b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.920+0000 7fe52ce12640 1 -- 172.21.15.55:0/2341643831 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5280d1c70 con 0x7fe52815dc80 2024-04-25T09:03:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.921+0000 7fe52ce12640 1 --2- 172.21.15.55:0/2341643831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe52815dc80 0x7fe528161870 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe51c009870 tx=0x7fe51c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57d0998920e16dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.921+0000 7fe5277fe640 1 -- 172.21.15.55:0/2341643831 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c037070 con 0x7fe52815dc80 2024-04-25T09:03:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.921+0000 7fe5277fe640 1 -- 172.21.15.55:0/2341643831 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c032440 con 0x7fe52815dc80 2024-04-25T09:03:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.921+0000 7fe5277fe640 1 -- 172.21.15.55:0/2341643831 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c032810 con 0x7fe52815dc80 2024-04-25T09:03:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.921+0000 7fe52f076640 1 -- 172.21.15.55:0/2341643831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe52815dc80 msgr2=0x7fe528161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.921+0000 7fe52f076640 1 --2- 172.21.15.55:0/2341643831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe52815dc80 0x7fe528161870 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe51c009870 tx=0x7fe51c02a270 comp rx=0 tx=0).stop 2024-04-25T09:03:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.922+0000 7fe52f076640 1 -- 172.21.15.55:0/2341643831 shutdown_connections 2024-04-25T09:03:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.922+0000 7fe52f076640 1 --2- 172.21.15.55:0/2341643831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5280b5c00 0x7fe5280d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.922+0000 7fe52f076640 1 --2- 172.21.15.55:0/2341643831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe52815dc80 0x7fe528161870 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.922+0000 7fe52f076640 1 -- 172.21.15.55:0/2341643831 >> 172.21.15.55:0/2341643831 conn(0x7fe5280d04f0 msgr2=0x7fe5280d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.922+0000 7fe52f076640 1 -- 172.21.15.55:0/2341643831 shutdown_connections 2024-04-25T09:03:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.922+0000 7fe52f076640 1 -- 172.21.15.55:0/2341643831 wait complete. 2024-04-25T09:03:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.923+0000 7fe52f076640 1 Processor -- start 2024-04-25T09:03:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.923+0000 7fe52f076640 1 -- start start 2024-04-25T09:03:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe52f076640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5280b5c00 0x7fe5280c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe52f076640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5280b97c0 0x7fe5280c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe52f076640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52815dc80 0x7fe5280c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe52f076640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe528161f30 con 0x7fe5280b97c0 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe52f076640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe528161db0 con 0x7fe5280b5c00 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe52f076640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280d29b0 con 0x7fe52815dc80 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe527fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5280b97c0 0x7fe5280c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe527fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5280b97c0 0x7fe5280c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39026/0 (socket says 172.21.15.55:39026) 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe527fff640 1 -- 172.21.15.55:0/786721300 learned_addr learned my addr 172.21.15.55:0/786721300 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe52ce12640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5280b5c00 0x7fe5280c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe52d613640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52815dc80 0x7fe5280c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe527fff640 1 -- 172.21.15.55:0/786721300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52815dc80 msgr2=0x7fe5280c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe527fff640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52815dc80 0x7fe5280c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe527fff640 1 -- 172.21.15.55:0/786721300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5280b5c00 msgr2=0x7fe5280c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe527fff640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5280b5c00 0x7fe5280c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe527fff640 1 -- 172.21.15.55:0/786721300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5280aa830 con 0x7fe5280b97c0 2024-04-25T09:03:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.924+0000 7fe527fff640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5280b97c0 0x7fe5280c85f0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fe51400c430 tx=0x7fe51400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.925+0000 7fe5257fa640 1 -- 172.21.15.55:0/786721300 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140074e0 con 0x7fe5280b97c0 2024-04-25T09:03:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.925+0000 7fe5257fa640 1 -- 172.21.15.55:0/786721300 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe514007680 con 0x7fe5280b97c0 2024-04-25T09:03:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.925+0000 7fe52f076640 1 -- 172.21.15.55:0/786721300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52814cd30 con 0x7fe5280b97c0 2024-04-25T09:03:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.925+0000 7fe5257fa640 1 -- 172.21.15.55:0/786721300 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514004a00 con 0x7fe5280b97c0 2024-04-25T09:03:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.925+0000 7fe52f076640 1 -- 172.21.15.55:0/786721300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52814d2f0 con 0x7fe5280b97c0 2024-04-25T09:03:44.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.926+0000 7fe52f076640 1 -- 172.21.15.55:0/786721300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52814d4f0 con 0x7fe5280b97c0 2024-04-25T09:03:44.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.926+0000 7fe5257fa640 1 -- 172.21.15.55:0/786721300 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe51401a020 con 0x7fe5280b97c0 2024-04-25T09:03:44.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.926+0000 7fe5257fa640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 0x7fe50c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.926+0000 7fe5257fa640 1 -- 172.21.15.55:0/786721300 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5140898b0 con 0x7fe5280b97c0 2024-04-25T09:03:44.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.927+0000 7fe52ce12640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 0x7fe50c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.927+0000 7fe52ce12640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 0x7fe50c06d990 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe51c034000 tx=0x7fe51c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:44.931+0000 7fe5257fa640 1 -- 172.21.15.55:0/786721300 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe52814d4f0 con 0x7fe5280b97c0 2024-04-25T09:03:45.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.109+0000 7fe52f076640 1 -- 172.21.15.55:0/786721300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5280750b0 con 0x7fe5280b97c0 2024-04-25T09:03:45.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.110+0000 7fe5257fa640 1 -- 172.21.15.55:0/786721300 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5140580e0 con 0x7fe5280b97c0 2024-04-25T09:03:45.098 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:03:45.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.111+0000 7fe52f076640 1 -- 172.21.15.55:0/786721300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 msgr2=0x7fe50c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.111+0000 7fe52f076640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 0x7fe50c06d990 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe51c034000 tx=0x7fe51c02e000 comp rx=0 tx=0).stop 2024-04-25T09:03:45.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.111+0000 7fe52f076640 1 -- 172.21.15.55:0/786721300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5280b97c0 msgr2=0x7fe5280c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.111+0000 7fe52f076640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5280b97c0 0x7fe5280c85f0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fe51400c430 tx=0x7fe51400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.112+0000 7fe52f076640 1 -- 172.21.15.55:0/786721300 shutdown_connections 2024-04-25T09:03:45.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.112+0000 7fe52f076640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe50c06b4d0 0x7fe50c06d990 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.112+0000 7fe52f076640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe52815dc80 0x7fe5280c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.112+0000 7fe52f076640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5280b97c0 0x7fe5280c85f0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.112+0000 7fe52f076640 1 --2- 172.21.15.55:0/786721300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5280b5c00 0x7fe5280c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.112+0000 7fe52f076640 1 -- 172.21.15.55:0/786721300 >> 172.21.15.55:0/786721300 conn(0x7fe5280d04f0 msgr2=0x7fe5280b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.112+0000 7fe52f076640 1 -- 172.21.15.55:0/786721300 shutdown_connections 2024-04-25T09:03:45.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.112+0000 7fe52f076640 1 -- 172.21.15.55:0/786721300 wait complete. 2024-04-25T09:03:45.111 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:45.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.227+0000 7f58e7942640 1 Processor -- start 2024-04-25T09:03:45.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.227+0000 7f58e7942640 1 -- start start 2024-04-25T09:03:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e7942640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e015dc80 0x7f58e0161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e7942640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58e00b97c0 0x7f58e00b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e7942640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f58e00b5a30 0x7f58e006bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e7942640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e00b5ea0 con 0x7f58e00b97c0 2024-04-25T09:03:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e7942640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e01627a0 con 0x7f58e00b5a30 2024-04-25T09:03:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e7942640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e01621e0 con 0x7f58e015dc80 2024-04-25T09:03:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e4edd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58e00b97c0 0x7f58e00b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e4edd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58e00b97c0 0x7f58e00b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39028/0 (socket says 172.21.15.55:39028) 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e4edd640 1 -- 172.21.15.55:0/1484863970 learned_addr learned my addr 172.21.15.55:0/1484863970 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e4edd640 1 -- 172.21.15.55:0/1484863970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e015dc80 msgr2=0x7f58e0161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e5edf640 1 --2- 172.21.15.55:0/1484863970 >> v2:172.21.15.167:3300/0 conn(0x7f58e00b5a30 0x7f58e006bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e56de640 1 --2- 172.21.15.55:0/1484863970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e015dc80 0x7f58e0161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e4edd640 1 --2- 172.21.15.55:0/1484863970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e015dc80 0x7f58e0161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e4edd640 1 -- 172.21.15.55:0/1484863970 >> v2:172.21.15.167:3300/0 conn(0x7f58e00b5a30 msgr2=0x7f58e006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e4edd640 1 --2- 172.21.15.55:0/1484863970 >> v2:172.21.15.167:3300/0 conn(0x7f58e00b5a30 0x7f58e006bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.228+0000 7f58e4edd640 1 -- 172.21.15.55:0/1484863970 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e01624c0 con 0x7f58e00b97c0 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.229+0000 7f58e5edf640 1 --2- 172.21.15.55:0/1484863970 >> v2:172.21.15.167:3300/0 conn(0x7f58e00b5a30 0x7f58e006bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.229+0000 7f58e56de640 1 --2- 172.21.15.55:0/1484863970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e015dc80 0x7f58e0161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.229+0000 7f58e4edd640 1 --2- 172.21.15.55:0/1484863970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e00b97c0 0x7f58e00b54f0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f58e00d16d0 tx=0x7f58d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f0188a51f9c905 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.229+0000 7f58dffff640 1 -- 172.21.15.55:0/1484863970 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4037070 con 0x7f58e00b97c0 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.229+0000 7f58dffff640 1 -- 172.21.15.55:0/1484863970 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d4032440 con 0x7f58e00b97c0 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.229+0000 7f58dffff640 1 -- 172.21.15.55:0/1484863970 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4032810 con 0x7f58e00b97c0 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.230+0000 7f58e7942640 1 -- 172.21.15.55:0/1484863970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e00b97c0 msgr2=0x7f58e00b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.230+0000 7f58e7942640 1 --2- 172.21.15.55:0/1484863970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e00b97c0 0x7f58e00b54f0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f58e00d16d0 tx=0x7f58d402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.230+0000 7f58e7942640 1 -- 172.21.15.55:0/1484863970 shutdown_connections 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.230+0000 7f58e7942640 1 --2- 172.21.15.55:0/1484863970 >> v2:172.21.15.167:3300/0 conn(0x7f58e00b5a30 0x7f58e006bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.230+0000 7f58e7942640 1 --2- 172.21.15.55:0/1484863970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e00b97c0 0x7f58e00b54f0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.230+0000 7f58e7942640 1 --2- 172.21.15.55:0/1484863970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e015dc80 0x7f58e0161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.230+0000 7f58e7942640 1 -- 172.21.15.55:0/1484863970 >> 172.21.15.55:0/1484863970 conn(0x7f58e00d04f0 msgr2=0x7f58e00d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.230+0000 7f58e7942640 1 -- 172.21.15.55:0/1484863970 shutdown_connections 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.230+0000 7f58e7942640 1 -- 172.21.15.55:0/1484863970 wait complete. 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.231+0000 7f58e7942640 1 Processor -- start 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.231+0000 7f58e7942640 1 -- start start 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e7942640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e00b5a30 0x7f58e00c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e7942640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e00b97c0 0x7f58e00b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e7942640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e015dc80 0x7f58e00ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e7942640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e0161db0 con 0x7f58e00b97c0 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e7942640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e015e060 con 0x7f58e00b5a30 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e7942640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e0161f30 con 0x7f58e015dc80 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e4edd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e00b97c0 0x7f58e00b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e4edd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e00b97c0 0x7f58e00b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39042/0 (socket says 172.21.15.55:39042) 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e4edd640 1 -- 172.21.15.55:0/286831487 learned_addr learned my addr 172.21.15.55:0/286831487 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e5edf640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e015dc80 0x7f58e00ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e56de640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e00b5a30 0x7f58e00c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e4edd640 1 -- 172.21.15.55:0/286831487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e015dc80 msgr2=0x7f58e00ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e4edd640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e015dc80 0x7f58e00ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e4edd640 1 -- 172.21.15.55:0/286831487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e00b5a30 msgr2=0x7f58e00c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e4edd640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e00b5a30 0x7f58e00c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.232+0000 7f58e4edd640 1 -- 172.21.15.55:0/286831487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00b2d10 con 0x7f58e00b97c0 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.233+0000 7f58e4edd640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e00b97c0 0x7f58e00b1aa0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f58d4000c00 tx=0x7f58d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.233+0000 7f58ddffb640 1 -- 172.21.15.55:0/286831487 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4037040 con 0x7f58e00b97c0 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.233+0000 7f58ddffb640 1 -- 172.21.15.55:0/286831487 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d4042070 con 0x7f58e00b97c0 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.233+0000 7f58e7942640 1 -- 172.21.15.55:0/286831487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e00ca300 con 0x7f58e00b97c0 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.233+0000 7f58ddffb640 1 -- 172.21.15.55:0/286831487 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4030bb0 con 0x7f58e00b97c0 2024-04-25T09:03:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.233+0000 7f58e7942640 1 -- 172.21.15.55:0/286831487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e00b2750 con 0x7f58e00b97c0 2024-04-25T09:03:45.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.234+0000 7f58e7942640 1 -- 172.21.15.55:0/286831487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e00750b0 con 0x7f58e00b97c0 2024-04-25T09:03:45.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.234+0000 7f58ddffb640 1 -- 172.21.15.55:0/286831487 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f58d4047460 con 0x7f58e00b97c0 2024-04-25T09:03:45.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.235+0000 7f58ddffb640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f58cc06b4d0 0x7f58cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.235+0000 7f58ddffb640 1 -- 172.21.15.55:0/286831487 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58d40aac90 con 0x7f58e00b97c0 2024-04-25T09:03:45.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.235+0000 7f58e56de640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f58cc06b4d0 0x7f58cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.235+0000 7f58e56de640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f58cc06b4d0 0x7f58cc06d990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f58d800aac0 tx=0x7f58d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.239+0000 7f58ddffb640 1 -- 172.21.15.55:0/286831487 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f58d4079550 con 0x7f58e00b97c0 2024-04-25T09:03:45.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.418+0000 7f58e7942640 1 -- 172.21.15.55:0/286831487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58e00d1780 con 0x7f58e00b97c0 2024-04-25T09:03:45.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.418+0000 7f58ddffb640 1 -- 172.21.15.55:0/286831487 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7f58d407d5f0 con 0x7f58e00b97c0 2024-04-25T09:03:45.407 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T09:03:45.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 -- 172.21.15.55:0/286831487 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f58cc06b4d0 msgr2=0x7f58cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f58cc06b4d0 0x7f58cc06d990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f58d800aac0 tx=0x7f58d8008040 comp rx=0 tx=0).stop 2024-04-25T09:03:45.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 -- 172.21.15.55:0/286831487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e00b97c0 msgr2=0x7f58e00b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e00b97c0 0x7f58e00b1aa0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f58d4000c00 tx=0x7f58d40046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 -- 172.21.15.55:0/286831487 shutdown_connections 2024-04-25T09:03:45.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f58cc06b4d0 0x7f58cc06d990 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e015dc80 0x7f58e00ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e00b97c0 0x7f58e00b1aa0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 --2- 172.21.15.55:0/286831487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e00b5a30 0x7f58e00c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 -- 172.21.15.55:0/286831487 >> 172.21.15.55:0/286831487 conn(0x7f58e00d04f0 msgr2=0x7f58e00b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 -- 172.21.15.55:0/286831487 shutdown_connections 2024-04-25T09:03:45.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.420+0000 7f58e7942640 1 -- 172.21.15.55:0/286831487 wait complete. 2024-04-25T09:03:45.419 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:45.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.535+0000 7fdc4ece1640 1 Processor -- start 2024-04-25T09:03:45.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.535+0000 7fdc4ece1640 1 -- start start 2024-04-25T09:03:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.535+0000 7fdc4ece1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdc4815dc80 0x7fdc48161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.535+0000 7fdc4ece1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc480b97c0 0x7fdc480b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.535+0000 7fdc4ece1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc480b5e40 con 0x7fdc480b5a30 2024-04-25T09:03:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.535+0000 7fdc4ece1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc481627a0 con 0x7fdc480b97c0 2024-04-25T09:03:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.535+0000 7fdc4ece1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc481621e0 con 0x7fdc4815dc80 2024-04-25T09:03:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.536+0000 7fdc47fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc480b97c0 0x7fdc480b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.536+0000 7fdc4d27e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc480b5a30 0x7fdc4806bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55858/0 (socket says 172.21.15.55:55858) 2024-04-25T09:03:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.536+0000 7fdc4d27e640 1 -- 172.21.15.55:0/4255287884 learned_addr learned my addr 172.21.15.55:0/4255287884 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.536+0000 7fdc4ca7d640 1 --2- 172.21.15.55:0/4255287884 >> v2:172.21.15.167:3300/0 conn(0x7fdc4815dc80 0x7fdc48161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.536+0000 7fdc47fff640 1 -- 172.21.15.55:0/4255287884 >> v2:172.21.15.167:3300/0 conn(0x7fdc4815dc80 msgr2=0x7fdc48161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.536+0000 7fdc47fff640 1 --2- 172.21.15.55:0/4255287884 >> v2:172.21.15.167:3300/0 conn(0x7fdc4815dc80 0x7fdc48161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.536+0000 7fdc47fff640 1 -- 172.21.15.55:0/4255287884 >> v1:172.21.15.55:6789/0 conn(0x7fdc480b5a30 legacy=0x7fdc4806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.536+0000 7fdc47fff640 1 -- 172.21.15.55:0/4255287884 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc481624c0 con 0x7fdc480b97c0 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.536+0000 7fdc477fe640 1 -- 172.21.15.55:0/4255287884 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666978816 0 0) 0x7fdc38001110 con 0x7fdc480b5a30 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.536+0000 7fdc4ca7d640 1 --2- 172.21.15.55:0/4255287884 >> v2:172.21.15.167:3300/0 conn(0x7fdc4815dc80 0x7fdc48161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc47fff640 1 --2- 172.21.15.55:0/4255287884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc480b97c0 0x7fdc480b54f0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fdc4806dab0 tx=0x7fdc3002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572a0f2eb7eed098 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc477fe640 1 -- 172.21.15.55:0/4255287884 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30037070 con 0x7fdc480b97c0 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc477fe640 1 -- 172.21.15.55:0/4255287884 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc30032440 con 0x7fdc480b97c0 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc477fe640 1 -- 172.21.15.55:0/4255287884 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30032810 con 0x7fdc480b97c0 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc4ece1640 1 -- 172.21.15.55:0/4255287884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc480b97c0 msgr2=0x7fdc480b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc4ece1640 1 --2- 172.21.15.55:0/4255287884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc480b97c0 0x7fdc480b54f0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fdc4806dab0 tx=0x7fdc3002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc4ece1640 1 -- 172.21.15.55:0/4255287884 shutdown_connections 2024-04-25T09:03:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc4ece1640 1 --2- 172.21.15.55:0/4255287884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc480b97c0 0x7fdc480b54f0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc4ece1640 1 --2- 172.21.15.55:0/4255287884 >> v2:172.21.15.167:3300/0 conn(0x7fdc4815dc80 0x7fdc48161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc4ece1640 1 -- 172.21.15.55:0/4255287884 >> 172.21.15.55:0/4255287884 conn(0x7fdc480d04f0 msgr2=0x7fdc480d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc4ece1640 1 -- 172.21.15.55:0/4255287884 shutdown_connections 2024-04-25T09:03:45.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.537+0000 7fdc4ece1640 1 -- 172.21.15.55:0/4255287884 wait complete. 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.539+0000 7fdc4ece1640 1 Processor -- start 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.539+0000 7fdc4ece1640 1 -- start start 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.539+0000 7fdc4ece1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc480b5a30 0x7fdc480cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.539+0000 7fdc4ece1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc480b97c0 0x7fdc480aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc4ece1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc4815dc80 0x7fdc481f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc4ece1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48161db0 con 0x7fdc480b97c0 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc4ece1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4815e060 con 0x7fdc480b5a30 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc4ece1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48161f30 con 0x7fdc4815dc80 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc480b97c0 0x7fdc480aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc480b97c0 0x7fdc480aa6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39062/0 (socket says 172.21.15.55:39062) 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc47fff640 1 -- 172.21.15.55:0/1144084853 learned_addr learned my addr 172.21.15.55:0/1144084853 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc4ca7d640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc480b5a30 0x7fdc480cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc47fff640 1 -- 172.21.15.55:0/1144084853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc4815dc80 msgr2=0x7fdc481f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc47fff640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc4815dc80 0x7fdc481f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc47fff640 1 -- 172.21.15.55:0/1144084853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc480b5a30 msgr2=0x7fdc480cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc47fff640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc480b5a30 0x7fdc480cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc47fff640 1 -- 172.21.15.55:0/1144084853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc480cccd0 con 0x7fdc480b97c0 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc4ca7d640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc480b5a30 0x7fdc480cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc47fff640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc480b97c0 0x7fdc480aa6f0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fdc30035040 tx=0x7fdc300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc457fa640 1 -- 172.21.15.55:0/1144084853 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30037050 con 0x7fdc480b97c0 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc457fa640 1 -- 172.21.15.55:0/1144084853 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc30038040 con 0x7fdc480b97c0 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc4ece1640 1 -- 172.21.15.55:0/1144084853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc480ccfb0 con 0x7fdc480b97c0 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc457fa640 1 -- 172.21.15.55:0/1144084853 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30004450 con 0x7fdc480b97c0 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.540+0000 7fdc4ece1640 1 -- 172.21.15.55:0/1144084853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc480b27c0 con 0x7fdc480b97c0 2024-04-25T09:03:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.541+0000 7fdc4ece1640 1 -- 172.21.15.55:0/1144084853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc480750b0 con 0x7fdc480b97c0 2024-04-25T09:03:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.542+0000 7fdc457fa640 1 -- 172.21.15.55:0/1144084853 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdc30030980 con 0x7fdc480b97c0 2024-04-25T09:03:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.542+0000 7fdc457fa640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2806b4d0 0x7fdc2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.542+0000 7fdc457fa640 1 -- 172.21.15.55:0/1144084853 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc300aaef0 con 0x7fdc480b97c0 2024-04-25T09:03:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.542+0000 7fdc4ca7d640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2806b4d0 0x7fdc2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.543+0000 7fdc4ca7d640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2806b4d0 0x7fdc2806d990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fdc4815d700 tx=0x7fdc400074b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.547+0000 7fdc457fa640 1 -- 172.21.15.55:0/1144084853 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdc30079e90 con 0x7fdc480b97c0 2024-04-25T09:03:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.726+0000 7fdc4ece1640 1 -- 172.21.15.55:0/1144084853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc4814c970 con 0x7fdc480b97c0 2024-04-25T09:03:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.727+0000 7fdc457fa640 1 -- 172.21.15.55:0/1144084853 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc30079790 con 0x7fdc480b97c0 2024-04-25T09:03:45.715 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 -- 172.21.15.55:0/1144084853 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2806b4d0 msgr2=0x7fdc2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2806b4d0 0x7fdc2806d990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fdc4815d700 tx=0x7fdc400074b0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 -- 172.21.15.55:0/1144084853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc480b97c0 msgr2=0x7fdc480aa6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc480b97c0 0x7fdc480aa6f0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fdc30035040 tx=0x7fdc300046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 -- 172.21.15.55:0/1144084853 shutdown_connections 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fdc2806b4d0 0x7fdc2806d990 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc4815dc80 0x7fdc481f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc480b97c0 0x7fdc480aa6f0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 --2- 172.21.15.55:0/1144084853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc480b5a30 0x7fdc480cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 -- 172.21.15.55:0/1144084853 >> 172.21.15.55:0/1144084853 conn(0x7fdc480d04f0 msgr2=0x7fdc480c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 -- 172.21.15.55:0/1144084853 shutdown_connections 2024-04-25T09:03:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.729+0000 7fdc4ece1640 1 -- 172.21.15.55:0/1144084853 wait complete. 2024-04-25T09:03:45.728 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:03:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.842+0000 7fb0b0d1d640 1 Processor -- start 2024-04-25T09:03:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.842+0000 7fb0b0d1d640 1 -- start start 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0b0d1d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0ac1610b0 0x7fb0ac0b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0b0d1d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac0cef40 0x7fb0ac0d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0b0d1d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ac162040 con 0x7fb0ac1618d0 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0b0d1d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ac0d1ea0 con 0x7fb0ac1610b0 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0b0d1d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac162320 con 0x7fb0ac0cef40 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb0ac1618d0 0x7fb0ac0ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55868/0 (socket says 172.21.15.55:55868) 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a3fff640 1 -- 172.21.15.55:0/2686965985 learned_addr learned my addr 172.21.15.55:0/2686965985 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325459444 0 0) 0x7fb0ac162040 con 0x7fb0ac1618d0 2024-04-25T09:03:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb098003520 con 0x7fb0ac1618d0 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0aa59c640 1 --2- 172.21.15.55:0/2686965985 >> v2:172.21.15.167:3300/0 conn(0x7fb0ac1610b0 0x7fb0ac0b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0aad9d640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac0cef40 0x7fb0ac0d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2680972165 0 0) 0x7fb098003520 con 0x7fb0ac1618d0 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac0cef40 msgr2=0x7fb0ac0d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac0cef40 0x7fb0ac0d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 >> v2:172.21.15.167:3300/0 conn(0x7fb0ac1610b0 msgr2=0x7fb0ac0b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 --2- 172.21.15.55:0/2686965985 >> v2:172.21.15.167:3300/0 conn(0x7fb0ac1610b0 0x7fb0ac0b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac162600 con 0x7fb0ac1618d0 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fb094001690 con 0x7fb0ac1618d0 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 >> v1:172.21.15.55:6789/0 conn(0x7fb0ac1618d0 legacy=0x7fb0ac0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac0cef40 0x7fb0980039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098003f80 0x7fb098004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 0x7fb0980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0d1ea0 con 0x7fb098004d40 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac162320 con 0x7fb098003f80 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.843+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09800bb20 con 0x7fb0ac0cef40 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.844+0000 7fb0aad9d640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 0x7fb0980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.844+0000 7fb0aa59c640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac0cef40 0x7fb0980039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.844+0000 7fb0a3fff640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098003f80 0x7fb098004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.844+0000 7fb0aad9d640 1 -- 172.21.15.55:0/2686965985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac0cef40 msgr2=0x7fb0980039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.844+0000 7fb0aad9d640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac0cef40 0x7fb0980039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.844+0000 7fb0aad9d640 1 -- 172.21.15.55:0/2686965985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098003f80 msgr2=0x7fb098004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.844+0000 7fb0aad9d640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098003f80 0x7fb098004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.844+0000 7fb0aad9d640 1 -- 172.21.15.55:0/2686965985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098003520 con 0x7fb098004d40 2024-04-25T09:03:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.845+0000 7fb0aad9d640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 0x7fb0980051c0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0d03e0 tx=0x7fb098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d59f3da23fd89e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.845+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4033070 con 0x7fb098004d40 2024-04-25T09:03:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.845+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a402f630 con 0x7fb098004d40 2024-04-25T09:03:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.845+0000 7fb0a9d9b640 1 -- 172.21.15.55:0/2686965985 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4009be0 con 0x7fb098004d40 2024-04-25T09:03:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.845+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/2686965985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 msgr2=0x7fb0980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.845+0000 7fb0b0d1d640 1 --2- 172.21.15.55:0/2686965985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 0x7fb0980051c0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0d03e0 tx=0x7fb098005830 comp rx=0 tx=0).stop 2024-04-25T09:03:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.845+0000 7fb0aad9d640 1 -- 172.21.15.55:0/2686965985 reap_dead start 2024-04-25T09:03:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.845+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/2686965985 shutdown_connections 2024-04-25T09:03:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.845+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/2686965985 >> 172.21.15.55:0/2686965985 conn(0x7fb0ac0b5570 msgr2=0x7fb0ac0b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.845+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/2686965985 shutdown_connections 2024-04-25T09:03:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.845+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/2686965985 wait complete. 2024-04-25T09:03:45.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.847+0000 7fb0b0d1d640 1 Processor -- start 2024-04-25T09:03:45.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.847+0000 7fb0b0d1d640 1 -- start start 2024-04-25T09:03:45.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.847+0000 7fb0b0d1d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 0x7fb0ac0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.847+0000 7fb0b0d1d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac1f7e70 0x7fb0ac15a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.847+0000 7fb0b0d1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0ac15ad60 0x7fb0ac1f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.847+0000 7fb0b0d1d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac161d10 con 0x7fb098004d40 2024-04-25T09:03:45.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.847+0000 7fb0b0d1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0b6c00 con 0x7fb0ac15ad60 2024-04-25T09:03:45.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.847+0000 7fb0b0d1d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac161490 con 0x7fb0ac1f7e70 2024-04-25T09:03:45.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.847+0000 7fb0aa59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 0x7fb0ac0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.847+0000 7fb0aa59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 0x7fb0ac0c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39080/0 (socket says 172.21.15.55:39080) 2024-04-25T09:03:45.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.847+0000 7fb0aa59c640 1 -- 172.21.15.55:0/1146289333 learned_addr learned my addr 172.21.15.55:0/1146289333 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0aad9d640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0ac15ad60 0x7fb0ac1f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0a3fff640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac1f7e70 0x7fb0ac15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0aa59c640 1 -- 172.21.15.55:0/1146289333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac1f7e70 msgr2=0x7fb0ac15a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0aa59c640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac1f7e70 0x7fb0ac15a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0aa59c640 1 -- 172.21.15.55:0/1146289333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0ac15ad60 msgr2=0x7fb0ac1f3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0aa59c640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0ac15ad60 0x7fb0ac1f3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0aa59c640 1 -- 172.21.15.55:0/1146289333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac1f73b0 con 0x7fb098004d40 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0aa59c640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 0x7fb0ac0c9dd0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fb09c011aa0 tx=0x7fb09c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0a2ffd640 1 -- 172.21.15.55:0/1146289333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00fb20 con 0x7fb098004d40 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0a2ffd640 1 -- 172.21.15.55:0/1146289333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c00fcc0 con 0x7fb098004d40 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/1146289333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ac1f49e0 con 0x7fb098004d40 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0a2ffd640 1 -- 172.21.15.55:0/1146289333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c014660 con 0x7fb098004d40 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.848+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/1146289333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ac0ca310 con 0x7fb098004d40 2024-04-25T09:03:45.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.849+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/1146289333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ac0750b0 con 0x7fb098004d40 2024-04-25T09:03:45.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.850+0000 7fb0a2ffd640 1 -- 172.21.15.55:0/1146289333 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb09c012040 con 0x7fb098004d40 2024-04-25T09:03:45.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.850+0000 7fb0a2ffd640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb08c06b4d0 0x7fb08c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.850+0000 7fb0a2ffd640 1 -- 172.21.15.55:0/1146289333 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb09c08a830 con 0x7fb098004d40 2024-04-25T09:03:45.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.850+0000 7fb0a3fff640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb08c06b4d0 0x7fb08c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.850+0000 7fb0a3fff640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb08c06b4d0 0x7fb08c06d990 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac15ecf0 tx=0x7fb094009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:45.854+0000 7fb0a2ffd640 1 -- 172.21.15.55:0/1146289333 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb09c019030 con 0x7fb098004d40 2024-04-25T09:03:46.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.050+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/1146289333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb0ac15b140 con 0x7fb098004d40 2024-04-25T09:03:46.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.050+0000 7fb0a2ffd640 1 -- 172.21.15.55:0/1146289333 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v115) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb09c0596b0 con 0x7fb098004d40 2024-04-25T09:03:46.039 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-25T09:03:46.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.052+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/1146289333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb08c06b4d0 msgr2=0x7fb08c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.052+0000 7fb0b0d1d640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb08c06b4d0 0x7fb08c06d990 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac15ecf0 tx=0x7fb094009040 comp rx=0 tx=0).stop 2024-04-25T09:03:46.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.052+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/1146289333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 msgr2=0x7fb0ac0c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.052+0000 7fb0b0d1d640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 0x7fb0ac0c9dd0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fb09c011aa0 tx=0x7fb09c011f60 comp rx=0 tx=0).stop 2024-04-25T09:03:46.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.052+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/1146289333 shutdown_connections 2024-04-25T09:03:46.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.052+0000 7fb0b0d1d640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb08c06b4d0 0x7fb08c06d990 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.052+0000 7fb0b0d1d640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0ac15ad60 0x7fb0ac1f3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.052+0000 7fb0b0d1d640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0ac1f7e70 0x7fb0ac15a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.052+0000 7fb0b0d1d640 1 --2- 172.21.15.55:0/1146289333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb098004d40 0x7fb0ac0c9dd0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.052+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/1146289333 >> 172.21.15.55:0/1146289333 conn(0x7fb0ac0b5570 msgr2=0x7fb0ac0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.052+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/1146289333 shutdown_connections 2024-04-25T09:03:46.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.053+0000 7fb0b0d1d640 1 -- 172.21.15.55:0/1146289333 wait complete. 2024-04-25T09:03:46.051 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:03:46.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:46.051 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:46.113 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:03:46.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:46.113 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:03:46.139 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:46.139 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:46.197 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:46.197 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:03:46.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:46.197 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:03:46.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T09:03:46.253 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:03:46.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.408+0000 7f98b8009640 1 Processor -- start 2024-04-25T09:03:46.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.408+0000 7f98b8009640 1 -- start start 2024-04-25T09:03:46.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.408+0000 7f98b8009640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f98b0161090 0x7f98b0161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.408+0000 7f98b8009640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f98b00ceeb0 0x7f98b00d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b8009640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b0161f80 con 0x7f98b00b9720 2024-04-25T09:03:46.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b8009640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b00d21a0 con 0x7f98b0161090 2024-04-25T09:03:46.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b8009640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b0162260 con 0x7f98b00ceeb0 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b5da5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f98b0161090 0x7f98b0161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b55a4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f98b00b9720 0x7f98b00ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55880/0 (socket says 172.21.15.55:55880) 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b55a4640 1 -- 172.21.15.55:0/3283515775 learned_addr learned my addr 172.21.15.55:0/3283515775 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b65a6640 1 --2- 172.21.15.55:0/3283515775 >> v2:172.21.15.167:3300/0 conn(0x7f98b00ceeb0 0x7f98b00d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b5da5640 1 -- 172.21.15.55:0/3283515775 >> v2:172.21.15.167:3300/0 conn(0x7f98b00ceeb0 msgr2=0x7f98b00d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b5da5640 1 --2- 172.21.15.55:0/3283515775 >> v2:172.21.15.167:3300/0 conn(0x7f98b00ceeb0 0x7f98b00d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b5da5640 1 -- 172.21.15.55:0/3283515775 >> v1:172.21.15.55:6789/0 conn(0x7f98b00b9720 legacy=0x7f98b00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b4da3640 1 -- 172.21.15.55:0/3283515775 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414020213 0 0) 0x7f98b0161f80 con 0x7f98b00b9720 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b5da5640 1 -- 172.21.15.55:0/3283515775 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b0162540 con 0x7f98b0161090 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.409+0000 7f98b65a6640 1 --2- 172.21.15.55:0/3283515775 >> v2:172.21.15.167:3300/0 conn(0x7f98b00ceeb0 0x7f98b00d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.410+0000 7f98b5da5640 1 --2- 172.21.15.55:0/3283515775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98b0161090 0x7f98b0161730 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f98b00b69d0 tx=0x7f98ac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c9837f548bb163 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.410+0000 7f98b4da3640 1 -- 172.21.15.55:0/3283515775 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac037070 con 0x7f98b0161090 2024-04-25T09:03:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.410+0000 7f98b4da3640 1 -- 172.21.15.55:0/3283515775 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac032440 con 0x7f98b0161090 2024-04-25T09:03:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.410+0000 7f98b4da3640 1 -- 172.21.15.55:0/3283515775 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac02ae60 con 0x7f98b0161090 2024-04-25T09:03:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.410+0000 7f98b8009640 1 -- 172.21.15.55:0/3283515775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98b0161090 msgr2=0x7f98b0161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.410+0000 7f98b8009640 1 --2- 172.21.15.55:0/3283515775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98b0161090 0x7f98b0161730 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f98b00b69d0 tx=0x7f98ac02a110 comp rx=0 tx=0).stop 2024-04-25T09:03:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.410+0000 7f98b8009640 1 -- 172.21.15.55:0/3283515775 shutdown_connections 2024-04-25T09:03:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.410+0000 7f98b8009640 1 --2- 172.21.15.55:0/3283515775 >> v2:172.21.15.167:3300/0 conn(0x7f98b00ceeb0 0x7f98b00d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.410+0000 7f98b8009640 1 --2- 172.21.15.55:0/3283515775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98b0161090 0x7f98b0161730 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.410+0000 7f98b8009640 1 -- 172.21.15.55:0/3283515775 >> 172.21.15.55:0/3283515775 conn(0x7f98b00b55e0 msgr2=0x7f98b00b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.411+0000 7f98b8009640 1 -- 172.21.15.55:0/3283515775 shutdown_connections 2024-04-25T09:03:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.411+0000 7f98b8009640 1 -- 172.21.15.55:0/3283515775 wait complete. 2024-04-25T09:03:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.412+0000 7f98b8009640 1 Processor -- start 2024-04-25T09:03:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.412+0000 7f98b8009640 1 -- start start 2024-04-25T09:03:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.412+0000 7f98b8009640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98b00b9720 0x7f98b00cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.412+0000 7f98b8009640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98b00ceeb0 0x7f98b01f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.412+0000 7f98b8009640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98b0161090 0x7f98b015ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.412+0000 7f98b8009640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b0161c70 con 0x7f98b00b9720 2024-04-25T09:03:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.412+0000 7f98b8009640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b0161470 con 0x7f98b00ceeb0 2024-04-25T09:03:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.412+0000 7f98b8009640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b00d2b70 con 0x7f98b0161090 2024-04-25T09:03:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.412+0000 7f98b5da5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98b00b9720 0x7f98b00cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.412+0000 7f98b5da5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98b00b9720 0x7f98b00cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39100/0 (socket says 172.21.15.55:39100) 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.412+0000 7f98b5da5640 1 -- 172.21.15.55:0/1792146541 learned_addr learned my addr 172.21.15.55:0/1792146541 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.413+0000 7f98b5da5640 1 -- 172.21.15.55:0/1792146541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98b0161090 msgr2=0x7f98b015ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.413+0000 7f98b5da5640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98b0161090 0x7f98b015ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.413+0000 7f98b5da5640 1 -- 172.21.15.55:0/1792146541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98b00ceeb0 msgr2=0x7f98b01f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.413+0000 7f98b5da5640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98b00ceeb0 0x7f98b01f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.413+0000 7f98b5da5640 1 -- 172.21.15.55:0/1792146541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b0160450 con 0x7f98b00b9720 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.413+0000 7f98b5da5640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98b00b9720 0x7f98b00cc730 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f98ac000c00 tx=0x7f98ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.413+0000 7f98a67fc640 1 -- 172.21.15.55:0/1792146541 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac037040 con 0x7f98b00b9720 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.413+0000 7f98a67fc640 1 -- 172.21.15.55:0/1792146541 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac042070 con 0x7f98b00b9720 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.413+0000 7f98a67fc640 1 -- 172.21.15.55:0/1792146541 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac030a50 con 0x7f98b00b9720 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.413+0000 7f98b8009640 1 -- 172.21.15.55:0/1792146541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b01f48d0 con 0x7f98b00b9720 2024-04-25T09:03:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.413+0000 7f98b8009640 1 -- 172.21.15.55:0/1792146541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b00ccff0 con 0x7f98b00b9720 2024-04-25T09:03:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.414+0000 7f98b8009640 1 -- 172.21.15.55:0/1792146541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b00750b0 con 0x7f98b00b9720 2024-04-25T09:03:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.415+0000 7f98a67fc640 1 -- 172.21.15.55:0/1792146541 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f98ac030bf0 con 0x7f98b00b9720 2024-04-25T09:03:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.415+0000 7f98a67fc640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989406b4d0 0x7f989406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.415+0000 7f98a67fc640 1 -- 172.21.15.55:0/1792146541 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98ac0aac50 con 0x7f98b00b9720 2024-04-25T09:03:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.415+0000 7f98b55a4640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989406b4d0 0x7f989406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.416+0000 7f98b55a4640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989406b4d0 0x7f989406d990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f98a0007fd0 tx=0x7f98a0007920 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.419+0000 7f98a67fc640 1 -- 172.21.15.55:0/1792146541 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98ac0b0020 con 0x7f98b00b9720 2024-04-25T09:03:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.637+0000 7f98b8009640 1 -- 172.21.15.55:0/1792146541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f98b00d1700 con 0x7f98b00b9720 2024-04-25T09:03:46.626 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T09:03:46.638+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:03:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.640+0000 7f98a67fc640 1 -- 172.21.15.55:0/1792146541 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) v1 ==== 161+0+0 (secure 0 0 0) 0x7f98ac045360 con 0x7f98b00b9720 2024-04-25T09:03:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:03:46.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.642+0000 7f98b8009640 1 -- 172.21.15.55:0/1792146541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989406b4d0 msgr2=0x7f989406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.642+0000 7f98b8009640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989406b4d0 0x7f989406d990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f98a0007fd0 tx=0x7f98a0007920 comp rx=0 tx=0).stop 2024-04-25T09:03:46.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.642+0000 7f98b8009640 1 -- 172.21.15.55:0/1792146541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98b00b9720 msgr2=0x7f98b00cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.642+0000 7f98b8009640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98b00b9720 0x7f98b00cc730 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f98ac000c00 tx=0x7f98ac0046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.642+0000 7f98b8009640 1 -- 172.21.15.55:0/1792146541 shutdown_connections 2024-04-25T09:03:46.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.642+0000 7f98b8009640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f989406b4d0 0x7f989406d990 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.642+0000 7f98b8009640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98b0161090 0x7f98b015ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.642+0000 7f98b8009640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98b00ceeb0 0x7f98b01f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.642+0000 7f98b8009640 1 --2- 172.21.15.55:0/1792146541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98b00b9720 0x7f98b00cc730 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.642+0000 7f98b8009640 1 -- 172.21.15.55:0/1792146541 >> 172.21.15.55:0/1792146541 conn(0x7f98b00b55e0 msgr2=0x7f98b00d2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.643+0000 7f98b8009640 1 -- 172.21.15.55:0/1792146541 shutdown_connections 2024-04-25T09:03:46.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.643+0000 7f98b8009640 1 -- 172.21.15.55:0/1792146541 wait complete. 2024-04-25T09:03:46.635 INFO:tasks.ceph.mds.a.smithi055.stderr: -7880> 2024-04-25T09:03:39.896+0000 7f5592ad1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:03:46.644 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:03:46.646 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:03:46.668 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-25T09:03:46.688 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-25T09:03:46.688 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-25T09:03:46.688 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:03:46.688 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-25T09:03:46.688 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.688 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-25T09:03:46.688 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.688 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-25T09:03:46.688 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.688 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.689 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-25T09:03:46.690 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.692 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-25T09:03:46.699 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-25T09:03:46.699 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-25T09:03:46.699 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:46.699 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-25T09:03:46.699 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2024-04-25T09:03:46.699 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-25T09:03:46.699 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = False 2024-04-25T09:03:46.699 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T09:03:46.699 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T09:03:46.699 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.55,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: bdev async discard = True 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: bdev enable discard = True 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore allocator = bitmap 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-04-25T09:03:46.705 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 1/20 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 1/20 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 4/10 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.706 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-04-25T09:03:46.707 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2024-04-25T09:03:46.709 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-04-25T09:03:46.710 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2024-04-25T09:03:46.711 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-04-25T09:03:46.711 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = False 2024-04-25T09:03:46.711 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T09:03:46.711 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T09:03:46.711 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T09:03:46.713 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:03:46.755 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:03:46.797 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-25T09:03:46.797 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.798 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-25T09:03:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-04-25T09:03:46.800 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-25T09:03:46.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-25T09:03:46.802 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-25T09:03:46.803 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-25T09:03:46.804 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.805 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:46.806 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-25T09:03:46.807 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = False 2024-04-25T09:03:46.808 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-25T09:03:46.808 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = False 2024-04-25T09:03:46.808 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T09:03:46.808 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T09:03:46.808 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T09:03:46.808 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-04-25T09:03:46.808 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:03:46.809 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-04-25T09:03:46.810 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.55,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2024-04-25T09:03:46.811 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-04-25T09:03:46.812 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-04-25T09:03:46.813 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.814 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-04-25T09:03:46.814 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-04-25T09:03:46.814 INFO:teuthology.orchestra.run.smithi167.stdout: bdev async discard = True 2024-04-25T09:03:46.814 INFO:teuthology.orchestra.run.smithi167.stdout: bdev enable discard = True 2024-04-25T09:03:46.814 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore allocator = bitmap 2024-04-25T09:03:46.814 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-04-25T09:03:46.814 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-04-25T09:03:46.814 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 1/20 2024-04-25T09:03:46.814 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 1/20 2024-04-25T09:03:46.814 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:46.814 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 4/10 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T09:03:46.815 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:46.816 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:46.817 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-04-25T09:03:46.818 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = False 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = False 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T09:03:46.819 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T09:03:46.821 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-04-25T09:03:46.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.917+0000 7f5c8e619f40 1 Processor -- start 2024-04-25T09:03:46.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.917+0000 7f5c8e619f40 1 -- start start 2024-04-25T09:03:46.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c8e619f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c78003630 0x555f0c4ddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c8e619f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c44bdd0 0x555f0c4d8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c8e619f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f0c4f88e0 0x555f0c4d90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c8e619f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0c46bea0 con 0x555f0c44bdd0 2024-04-25T09:03:46.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c8e619f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0c3c8df0 con 0x555f0c4f88e0 2024-04-25T09:03:46.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c8e619f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f0c46c140 con 0x7f5c78003630 2024-04-25T09:03:46.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c83fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c44bdd0 0x555f0c4d8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c83fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c44bdd0 0x555f0c4d8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39142/0 (socket says 172.21.15.55:39142) 2024-04-25T09:03:46.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c83fff640 1 -- 172.21.15.55:0/150332771 learned_addr learned my addr 172.21.15.55:0/150332771 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:46.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c8c91b640 1 --2- 172.21.15.55:0/150332771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f0c4f88e0 0x555f0c4d90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c8c11a640 1 --2- 172.21.15.55:0/150332771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c78003630 0x555f0c4ddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c83fff640 1 -- 172.21.15.55:0/150332771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c78003630 msgr2=0x555f0c4ddd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c83fff640 1 --2- 172.21.15.55:0/150332771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c78003630 0x555f0c4ddd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c83fff640 1 -- 172.21.15.55:0/150332771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f0c4f88e0 msgr2=0x555f0c4d90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c83fff640 1 --2- 172.21.15.55:0/150332771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f0c4f88e0 0x555f0c4d90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c83fff640 1 -- 172.21.15.55:0/150332771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f0c34ec50 con 0x555f0c44bdd0 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.918+0000 7f5c83fff640 1 --2- 172.21.15.55:0/150332771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c44bdd0 0x555f0c4d8b70 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f5c740096a0 tx=0x7f5c74009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fb858bf20f09d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8b118640 1 -- 172.21.15.55:0/150332771 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7400e9c0 con 0x555f0c44bdd0 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8b118640 1 -- 172.21.15.55:0/150332771 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c74013030 con 0x555f0c44bdd0 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8b118640 1 -- 172.21.15.55:0/150332771 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7400eda0 con 0x555f0c44bdd0 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8e619f40 1 -- 172.21.15.55:0/150332771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c44bdd0 msgr2=0x555f0c4d8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8e619f40 1 --2- 172.21.15.55:0/150332771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c44bdd0 0x555f0c4d8b70 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f5c740096a0 tx=0x7f5c74009b60 comp rx=0 tx=0).stop 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8e619f40 1 -- 172.21.15.55:0/150332771 shutdown_connections 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8e619f40 1 --2- 172.21.15.55:0/150332771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f0c4f88e0 0x555f0c4d90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8e619f40 1 --2- 172.21.15.55:0/150332771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c44bdd0 0x555f0c4d8b70 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8e619f40 1 --2- 172.21.15.55:0/150332771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c78003630 0x555f0c4ddd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8e619f40 1 -- 172.21.15.55:0/150332771 >> 172.21.15.55:0/150332771 conn(0x555f0c44c3d0 msgr2=0x555f0c451ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8e619f40 1 -- 172.21.15.55:0/150332771 shutdown_connections 2024-04-25T09:03:46.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.919+0000 7f5c8e619f40 1 -- 172.21.15.55:0/150332771 wait complete. 2024-04-25T09:03:46.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.920+0000 7f5c8e619f40 1 Processor -- start 2024-04-25T09:03:46.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.920+0000 7f5c8e619f40 1 -- start start 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.920+0000 7f5c8e619f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f0c44bdd0 0x555f0c4f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.920+0000 7f5c8e619f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c4f88e0 0x555f0c445370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.920+0000 7f5c8e619f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c78003630 0x555f0c4458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.920+0000 7f5c8e619f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0c4f8390 con 0x555f0c4f88e0 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.920+0000 7f5c8e619f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0c4f8670 con 0x555f0c44bdd0 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.920+0000 7f5c8e619f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f0c4dac90 con 0x7f5c78003630 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c83fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c4f88e0 0x555f0c445370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c83fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c4f88e0 0x555f0c445370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39148/0 (socket says 172.21.15.55:39148) 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c83fff640 1 -- 172.21.15.55:0/2817227817 learned_addr learned my addr 172.21.15.55:0/2817227817 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c8c91b640 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c78003630 0x555f0c4458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c8c11a640 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f0c44bdd0 0x555f0c4f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c83fff640 1 -- 172.21.15.55:0/2817227817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c78003630 msgr2=0x555f0c4458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c83fff640 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c78003630 0x555f0c4458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c83fff640 1 -- 172.21.15.55:0/2817227817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f0c44bdd0 msgr2=0x555f0c4f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c83fff640 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f0c44bdd0 0x555f0c4f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c83fff640 1 -- 172.21.15.55:0/2817227817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f0c4503b0 con 0x555f0c4f88e0 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c83fff640 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c4f88e0 0x555f0c445370 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f5c74013000 tx=0x7f5c74001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c8a116640 1 -- 172.21.15.55:0/2817227817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74025650 con 0x555f0c4f88e0 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c8a116640 1 -- 172.21.15.55:0/2817227817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c740257f0 con 0x555f0c4f88e0 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c8e619f40 1 -- 172.21.15.55:0/2817227817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f0c444ce0 con 0x555f0c4f88e0 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c8a116640 1 -- 172.21.15.55:0/2817227817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74025ba0 con 0x555f0c4f88e0 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.921+0000 7f5c8e619f40 1 -- 172.21.15.55:0/2817227817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f0c450950 con 0x555f0c4f88e0 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.923+0000 7f5c8a116640 1 -- 172.21.15.55:0/2817227817 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5c7400f450 con 0x555f0c4f88e0 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.923+0000 7f5c8a116640 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c6c069eb0 0x7f5c6c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.923+0000 7f5c8a116640 1 -- 172.21.15.55:0/2817227817 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5c7408b2a0 con 0x555f0c4f88e0 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.923+0000 7f5c8c11a640 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c6c069eb0 0x7f5c6c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.923+0000 7f5c8e619f40 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x555f0c451640 0x555f0c451a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.923+0000 7f5c8e619f40 1 -- 172.21.15.55:0/2817227817 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:1 16.7 16:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) v9 -- 0x555f0c451f60 con 0x555f0c451640 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.923+0000 7f5c8c91b640 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x555f0c451640 0x555f0c451a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.924+0000 7f5c8c11a640 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c6c069eb0 0x7f5c6c06c370 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c005e80 tx=0x7f5c7c00c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.924+0000 7f5c8c91b640 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x555f0c451640 0x555f0c451a20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8c91b640 1 -- 172.21.15.55:0/2817227817 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v116'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5c8404d940 con 0x555f0c451640 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8e619f40 1 -- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x555f0c451640 msgr2=0x555f0c451a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8e619f40 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x555f0c451640 0x555f0c451a20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8e619f40 1 -- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c6c069eb0 msgr2=0x7f5c6c06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8e619f40 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5c6c069eb0 0x7f5c6c06c370 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c005e80 tx=0x7f5c7c00c040 comp rx=0 tx=0).stop 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8e619f40 1 -- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c4f88e0 msgr2=0x555f0c445370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8e619f40 1 --2- 172.21.15.55:0/2817227817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f0c4f88e0 0x555f0c445370 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f5c74013000 tx=0x7f5c74001ab0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8c91b640 1 -- 172.21.15.55:0/2817227817 reap_dead start 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8e619f40 1 -- 172.21.15.55:0/2817227817 shutdown_connections 2024-04-25T09:03:46.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8e619f40 1 -- 172.21.15.55:0/2817227817 >> 172.21.15.55:0/2817227817 conn(0x555f0c44c3d0 msgr2=0x555f0c4ddd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8e619f40 1 -- 172.21.15.55:0/2817227817 shutdown_connections 2024-04-25T09:03:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:46.925+0000 7f5c8e619f40 1 -- 172.21.15.55:0/2817227817 wait complete. 2024-04-25T09:03:46.919 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:03:47.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.035+0000 7fc5430db640 1 Processor -- start 2024-04-25T09:03:47.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.035+0000 7fc5430db640 1 -- start start 2024-04-25T09:03:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.035+0000 7fc5430db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc53c0cfe70 0x7fc53c0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.035+0000 7fc5430db640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc53c15e110 0x7fc53c15e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.035+0000 7fc5430db640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c15f000 con 0x7fc53c15b7b0 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.035+0000 7fc5430db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c0ced00 con 0x7fc53c0cfe70 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc5430db640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c0ce330 con 0x7fc53c15e110 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc53bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc53c0cfe70 0x7fc53c0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc540e77640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc53c15b7b0 0x7fc53c0cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55896/0 (socket says 172.21.15.55:55896) 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc53bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc53c0cfe70 0x7fc53c0ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39156/0 (socket says 172.21.15.55:39156) 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc540e77640 1 -- 172.21.15.55:0/233461706 learned_addr learned my addr 172.21.15.55:0/233461706 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc541678640 1 --2- 172.21.15.55:0/233461706 >> v2:172.21.15.167:3300/0 conn(0x7fc53c15e110 0x7fc53c15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc53bfff640 1 -- 172.21.15.55:0/233461706 >> v2:172.21.15.167:3300/0 conn(0x7fc53c15e110 msgr2=0x7fc53c15e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc53bfff640 1 --2- 172.21.15.55:0/233461706 >> v2:172.21.15.167:3300/0 conn(0x7fc53c15e110 0x7fc53c15e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc53bfff640 1 -- 172.21.15.55:0/233461706 >> v1:172.21.15.55:6789/0 conn(0x7fc53c15b7b0 legacy=0x7fc53c0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc53bfff640 1 -- 172.21.15.55:0/233461706 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c15ea60 con 0x7fc53c0cfe70 2024-04-25T09:03:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc53b7fe640 1 -- 172.21.15.55:0/233461706 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526875935 0 0) 0x7fc53c15f000 con 0x7fc53c15b7b0 2024-04-25T09:03:47.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.036+0000 7fc541678640 1 --2- 172.21.15.55:0/233461706 >> v2:172.21.15.167:3300/0 conn(0x7fc53c15e110 0x7fc53c15e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:47.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.037+0000 7fc53bfff640 1 --2- 172.21.15.55:0/233461706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc53c0cfe70 0x7fc53c0ce7c0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fc53c161670 tx=0x7fc52402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfd0ceed4c7deb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.037+0000 7fc53b7fe640 1 -- 172.21.15.55:0/233461706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524037070 con 0x7fc53c0cfe70 2024-04-25T09:03:47.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.037+0000 7fc53b7fe640 1 -- 172.21.15.55:0/233461706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524032440 con 0x7fc53c0cfe70 2024-04-25T09:03:47.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.037+0000 7fc53b7fe640 1 -- 172.21.15.55:0/233461706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524032810 con 0x7fc53c0cfe70 2024-04-25T09:03:47.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.037+0000 7fc5430db640 1 -- 172.21.15.55:0/233461706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc53c0cfe70 msgr2=0x7fc53c0ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.037+0000 7fc5430db640 1 --2- 172.21.15.55:0/233461706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc53c0cfe70 0x7fc53c0ce7c0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fc53c161670 tx=0x7fc52402a1a0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.037+0000 7fc5430db640 1 -- 172.21.15.55:0/233461706 shutdown_connections 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.037+0000 7fc5430db640 1 --2- 172.21.15.55:0/233461706 >> v2:172.21.15.167:3300/0 conn(0x7fc53c15e110 0x7fc53c15e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.037+0000 7fc5430db640 1 --2- 172.21.15.55:0/233461706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc53c0cfe70 0x7fc53c0ce7c0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.037+0000 7fc5430db640 1 -- 172.21.15.55:0/233461706 >> 172.21.15.55:0/233461706 conn(0x7fc53c06f4a0 msgr2=0x7fc53c06f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.037+0000 7fc5430db640 1 -- 172.21.15.55:0/233461706 shutdown_connections 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.038+0000 7fc5430db640 1 -- 172.21.15.55:0/233461706 wait complete. 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.039+0000 7fc5430db640 1 Processor -- start 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.039+0000 7fc5430db640 1 -- start start 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.039+0000 7fc5430db640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc53c0cfe70 0x7fc53c1e7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.039+0000 7fc5430db640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc53c15b7b0 0x7fc53c158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc5430db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc53c15e110 0x7fc53c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc5430db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0cdfc0 con 0x7fc53c15e110 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc5430db640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0cdce0 con 0x7fc53c15b7b0 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc5430db640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c1619f0 con 0x7fc53c0cfe70 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc541678640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc53c15e110 0x7fc53c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc541678640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc53c15e110 0x7fc53c158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39166/0 (socket says 172.21.15.55:39166) 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc541678640 1 -- 172.21.15.55:0/2903928151 learned_addr learned my addr 172.21.15.55:0/2903928151 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc53bfff640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc53c15b7b0 0x7fc53c158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc540e77640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc53c0cfe70 0x7fc53c1e7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc541678640 1 -- 172.21.15.55:0/2903928151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc53c0cfe70 msgr2=0x7fc53c1e7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc541678640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc53c0cfe70 0x7fc53c1e7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc541678640 1 -- 172.21.15.55:0/2903928151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc53c15b7b0 msgr2=0x7fc53c158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc541678640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc53c15b7b0 0x7fc53c158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc541678640 1 -- 172.21.15.55:0/2903928151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c0b1350 con 0x7fc53c15e110 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc53bfff640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc53c15b7b0 0x7fc53c158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc541678640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc53c15e110 0x7fc53c158bb0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00d5f0 tx=0x7fc52c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc5397fa640 1 -- 172.21.15.55:0/2903928151 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c004030 con 0x7fc53c15e110 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc5397fa640 1 -- 172.21.15.55:0/2903928151 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c0041d0 con 0x7fc53c15e110 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc5397fa640 1 -- 172.21.15.55:0/2903928151 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c003610 con 0x7fc53c15e110 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc5430db640 1 -- 172.21.15.55:0/2903928151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c0b1630 con 0x7fc53c15e110 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.040+0000 7fc5430db640 1 -- 172.21.15.55:0/2903928151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c0b1bf0 con 0x7fc53c15e110 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.042+0000 7fc5430db640 1 -- 172.21.15.55:0/2903928151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c0750b0 con 0x7fc53c15e110 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.042+0000 7fc5397fa640 1 -- 172.21.15.55:0/2903928151 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc52c0037b0 con 0x7fc53c15e110 2024-04-25T09:03:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.042+0000 7fc5397fa640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc51c06b4d0 0x7fc51c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.043+0000 7fc540e77640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc51c06b4d0 0x7fc51c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.043+0000 7fc5397fa640 1 -- 172.21.15.55:0/2903928151 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc52c08a4f0 con 0x7fc53c15e110 2024-04-25T09:03:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.043+0000 7fc540e77640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc51c06b4d0 0x7fc51c06d990 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc5340012e0 tx=0x7fc534007ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.047+0000 7fc5397fa640 1 -- 172.21.15.55:0/2903928151 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc52c059310 con 0x7fc53c15e110 2024-04-25T09:03:47.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.270+0000 7fc5430db640 1 -- 172.21.15.55:0/2903928151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fc53c15daf0 con 0x7fc53c15e110 2024-04-25T09:03:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.641+0000 7fc5397fa640 1 -- 172.21.15.55:0/2903928151 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v88) v1 ==== 162+0+0 (secure 0 0 0) 0x7fc52c058c10 con 0x7fc53c15e110 2024-04-25T09:03:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:03:47.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 -- 172.21.15.55:0/2903928151 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc51c06b4d0 msgr2=0x7fc51c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc51c06b4d0 0x7fc51c06d990 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc5340012e0 tx=0x7fc534007ed0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 -- 172.21.15.55:0/2903928151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc53c15e110 msgr2=0x7fc53c158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc53c15e110 0x7fc53c158bb0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00d5f0 tx=0x7fc52c00dab0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 -- 172.21.15.55:0/2903928151 shutdown_connections 2024-04-25T09:03:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc51c06b4d0 0x7fc51c06d990 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc53c15e110 0x7fc53c158bb0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc53c15b7b0 0x7fc53c158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 --2- 172.21.15.55:0/2903928151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc53c0cfe70 0x7fc53c1e7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 -- 172.21.15.55:0/2903928151 >> 172.21.15.55:0/2903928151 conn(0x7fc53c06f4a0 msgr2=0x7fc53c159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 -- 172.21.15.55:0/2903928151 shutdown_connections 2024-04-25T09:03:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.644+0000 7fc5430db640 1 -- 172.21.15.55:0/2903928151 wait complete. 2024-04-25T09:03:47.647 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:47.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.760+0000 7f5adb122640 1 Processor -- start 2024-04-25T09:03:47.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.760+0000 7f5adb122640 1 -- start start 2024-04-25T09:03:47.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.761+0000 7f5adb122640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad415dce0 0x7f5ad40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.761+0000 7f5adb122640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ad40d35b0 0x7f5ad40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.761+0000 7f5adb122640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad415e0c0 con 0x7f5ad40d1f90 2024-04-25T09:03:47.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.761+0000 7f5adb122640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad40b7b10 con 0x7f5ad40d35b0 2024-04-25T09:03:47.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.761+0000 7f5adb122640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40d2510 con 0x7f5ad415dce0 2024-04-25T09:03:47.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad3fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ad40d35b0 0x7f5ad40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad8ebe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad415dce0 0x7f5ad40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad3fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ad40d35b0 0x7f5ad40b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:53834/0 (socket says 172.21.15.55:53834) 2024-04-25T09:03:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad96bf640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f5ad40d1f90 0x7f5ad406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:45510/0 (socket says 172.21.15.55:45510) 2024-04-25T09:03:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad3fff640 1 -- 172.21.15.55:0/2645040018 learned_addr learned my addr 172.21.15.55:0/2645040018 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad8ebe640 1 --2- 172.21.15.55:0/2645040018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad415dce0 0x7f5ad40d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:35188/0 (socket says 172.21.15.55:35188) 2024-04-25T09:03:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2645040018 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528134799 0 0) 0x7f5ad415e0c0 con 0x7f5ad40d1f90 2024-04-25T09:03:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2645040018 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5abc003520 con 0x7f5ad40d1f90 2024-04-25T09:03:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad3fff640 1 -- 172.21.15.55:0/2645040018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad415dce0 msgr2=0x7f5ad40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad3fff640 1 --2- 172.21.15.55:0/2645040018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad415dce0 0x7f5ad40d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad3fff640 1 -- 172.21.15.55:0/2645040018 >> v1:172.21.15.167:6789/0 conn(0x7f5ad40d1f90 legacy=0x7f5ad406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad3fff640 1 -- 172.21.15.55:0/2645040018 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40d27f0 con 0x7f5ad40d35b0 2024-04-25T09:03:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.762+0000 7f5ad8ebe640 1 --2- 172.21.15.55:0/2645040018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad415dce0 0x7f5ad40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.763+0000 7f5ad3fff640 1 --2- 172.21.15.55:0/2645040018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad40d35b0 0x7f5ad40b5450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009870 tx=0x7f5ac802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5f458abe20511ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.763+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2645040018 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8037070 con 0x7f5ad40d35b0 2024-04-25T09:03:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.763+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2645040018 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac8032440 con 0x7f5ad40d35b0 2024-04-25T09:03:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.763+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2645040018 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8032810 con 0x7f5ad40d35b0 2024-04-25T09:03:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.764+0000 7f5adb122640 1 -- 172.21.15.55:0/2645040018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad40d35b0 msgr2=0x7f5ad40b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.764+0000 7f5adb122640 1 --2- 172.21.15.55:0/2645040018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad40d35b0 0x7f5ad40b5450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009870 tx=0x7f5ac802a1c0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.764+0000 7f5adb122640 1 -- 172.21.15.55:0/2645040018 shutdown_connections 2024-04-25T09:03:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.764+0000 7f5adb122640 1 --2- 172.21.15.55:0/2645040018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad40d35b0 0x7f5ad40b5450 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.764+0000 7f5adb122640 1 --2- 172.21.15.55:0/2645040018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad415dce0 0x7f5ad40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.764+0000 7f5adb122640 1 -- 172.21.15.55:0/2645040018 >> 172.21.15.55:0/2645040018 conn(0x7f5ad4072900 msgr2=0x7f5ad40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.764+0000 7f5adb122640 1 -- 172.21.15.55:0/2645040018 shutdown_connections 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.764+0000 7f5adb122640 1 -- 172.21.15.55:0/2645040018 wait complete. 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.765+0000 7f5adb122640 1 Processor -- start 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.765+0000 7f5adb122640 1 -- start start 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5adb122640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad40d1f90 0x7f5ad41576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5adb122640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad40d35b0 0x7f5ad4153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5adb122640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad415dce0 0x7f5ad415ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5adb122640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40d3090 con 0x7f5ad415dce0 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5adb122640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40d2db0 con 0x7f5ad40d1f90 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5adb122640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40b9820 con 0x7f5ad40d35b0 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5ad96bf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad415dce0 0x7f5ad415ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5ad96bf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad415dce0 0x7f5ad415ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39180/0 (socket says 172.21.15.55:39180) 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5ad96bf640 1 -- 172.21.15.55:0/3191191957 learned_addr learned my addr 172.21.15.55:0/3191191957 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:47.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5ad3fff640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad40d35b0 0x7f5ad4153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5ad8ebe640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad40d1f90 0x7f5ad41576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5ad96bf640 1 -- 172.21.15.55:0/3191191957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad40d35b0 msgr2=0x7f5ad4153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5ad96bf640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad40d35b0 0x7f5ad4153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5ad96bf640 1 -- 172.21.15.55:0/3191191957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad40d1f90 msgr2=0x7f5ad41576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5ad96bf640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad40d1f90 0x7f5ad41576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5ad96bf640 1 -- 172.21.15.55:0/3191191957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40c84f0 con 0x7f5ad415dce0 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.766+0000 7f5ad96bf640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad415dce0 0x7f5ad415ec30 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400c3f0 tx=0x7f5ac400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.767+0000 7f5ad17fa640 1 -- 172.21.15.55:0/3191191957 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40074e0 con 0x7f5ad415dce0 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.767+0000 7f5ad17fa640 1 -- 172.21.15.55:0/3191191957 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac40047e0 con 0x7f5ad415dce0 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.767+0000 7f5adb122640 1 -- 172.21.15.55:0/3191191957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad40c87d0 con 0x7f5ad415dce0 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.767+0000 7f5ad17fa640 1 -- 172.21.15.55:0/3191191957 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4004bd0 con 0x7f5ad415dce0 2024-04-25T09:03:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.767+0000 7f5adb122640 1 -- 172.21.15.55:0/3191191957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad40c8d90 con 0x7f5ad415dce0 2024-04-25T09:03:47.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.768+0000 7f5adb122640 1 -- 172.21.15.55:0/3191191957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad40749b0 con 0x7f5ad415dce0 2024-04-25T09:03:47.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.768+0000 7f5ad17fa640 1 -- 172.21.15.55:0/3191191957 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5ac401a020 con 0x7f5ad415dce0 2024-04-25T09:03:47.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.769+0000 7f5ad17fa640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac006b4d0 0x7f5ac006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.769+0000 7f5ad17fa640 1 -- 172.21.15.55:0/3191191957 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5ac40899d0 con 0x7f5ad415dce0 2024-04-25T09:03:47.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.769+0000 7f5ad8ebe640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac006b4d0 0x7f5ac006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.769+0000 7f5ad8ebe640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac006b4d0 0x7f5ac006d990 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009bd0 tx=0x7f5acc00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.773+0000 7f5ad17fa640 1 -- 172.21.15.55:0/3191191957 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5ac4010300 con 0x7f5ad415dce0 2024-04-25T09:03:47.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.991+0000 7f5adb122640 1 -- 172.21.15.55:0/3191191957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ad40c70a0 con 0x7f5ad415dce0 2024-04-25T09:03:47.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.991+0000 7f5ad17fa640 1 -- 172.21.15.55:0/3191191957 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f5ac4058880 con 0x7f5ad415dce0 2024-04-25T09:03:47.980 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:47.980 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":89,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:03:47.644865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9177":{"gid":9177,"name":"a","rank":0,"incarnation":89,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6837/3667784674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3667784674},{"type":"v1","addr":"172.21.15.55:6837","nonce":3667784674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:03:47.980 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 89 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 -- 172.21.15.55:0/3191191957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac006b4d0 msgr2=0x7f5ac006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac006b4d0 0x7f5ac006d990 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009bd0 tx=0x7f5acc00b040 comp rx=0 tx=0).stop 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 -- 172.21.15.55:0/3191191957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad415dce0 msgr2=0x7f5ad415ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad415dce0 0x7f5ad415ec30 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400c3f0 tx=0x7f5ac400c8b0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 -- 172.21.15.55:0/3191191957 shutdown_connections 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5ac006b4d0 0x7f5ac006d990 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad415dce0 0x7f5ad415ec30 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ad40d35b0 0x7f5ad4153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 --2- 172.21.15.55:0/3191191957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad40d1f90 0x7f5ad41576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 -- 172.21.15.55:0/3191191957 >> 172.21.15.55:0/3191191957 conn(0x7f5ad4072900 msgr2=0x7f5ad40d39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 -- 172.21.15.55:0/3191191957 shutdown_connections 2024-04-25T09:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:47.993+0000 7f5adb122640 1 -- 172.21.15.55:0/3191191957 wait complete. 2024-04-25T09:03:48.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:03:33.628986+0000', 'modified': '2024-04-25T09:03:47.644865+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 116, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9177}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9177': {'gid': 9177, 'name': 'a', 'rank': 0, 'incarnation': 89, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6837/3667784674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 3667784674}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3667784674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:03:48.394 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9177:up:replay 2024-04-25T09:03:49.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:49.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.521+0000 7fa3b037e640 1 Processor -- start 2024-04-25T09:03:49.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.521+0000 7fa3b037e640 1 -- start start 2024-04-25T09:03:49.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3b037e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3a815dce0 0x7fa3a80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3b037e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a80d35b0 0x7fa3a80b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3b037e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa3a80d1f90 0x7fa3a80b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3b037e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a815e0c0 con 0x7fa3a815dce0 2024-04-25T09:03:49.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3b037e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a80d2510 con 0x7fa3a80d1f90 2024-04-25T09:03:49.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3b037e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80d27f0 con 0x7fa3a80d35b0 2024-04-25T09:03:49.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3ae11a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3a815dce0 0x7fa3a80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3ae11a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3a815dce0 0x7fa3a80d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55228/0 (socket says 172.21.15.55:55228) 2024-04-25T09:03:49.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3ae11a640 1 -- 172.21.15.55:0/495764495 learned_addr learned my addr 172.21.15.55:0/495764495 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:49.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3ae91b640 1 --2- 172.21.15.55:0/495764495 >> v2:172.21.15.167:3300/0 conn(0x7fa3a80d1f90 0x7fa3a80b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3ad919640 1 --2- 172.21.15.55:0/495764495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a80d35b0 0x7fa3a80b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3ae11a640 1 -- 172.21.15.55:0/495764495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a80d35b0 msgr2=0x7fa3a80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:49.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3ae11a640 1 --2- 172.21.15.55:0/495764495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a80d35b0 0x7fa3a80b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3ae11a640 1 -- 172.21.15.55:0/495764495 >> v2:172.21.15.167:3300/0 conn(0x7fa3a80d1f90 msgr2=0x7fa3a80b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:49.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3ae11a640 1 --2- 172.21.15.55:0/495764495 >> v2:172.21.15.167:3300/0 conn(0x7fa3a80d1f90 0x7fa3a80b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3ae11a640 1 -- 172.21.15.55:0/495764495 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a80d2ad0 con 0x7fa3a815dce0 2024-04-25T09:03:49.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.522+0000 7fa3ae91b640 1 --2- 172.21.15.55:0/495764495 >> v2:172.21.15.167:3300/0 conn(0x7fa3a80d1f90 0x7fa3a80b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:49.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.523+0000 7fa3ae11a640 1 --2- 172.21.15.55:0/495764495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a815dce0 0x7fa3a80d1a50 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8161710 tx=0x7fa3a402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e39d8273655c71c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.523+0000 7fa3ad118640 1 -- 172.21.15.55:0/495764495 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4037070 con 0x7fa3a815dce0 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.523+0000 7fa3ad118640 1 -- 172.21.15.55:0/495764495 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4032440 con 0x7fa3a815dce0 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.523+0000 7fa3ad118640 1 -- 172.21.15.55:0/495764495 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4032810 con 0x7fa3a815dce0 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.524+0000 7fa3b037e640 1 -- 172.21.15.55:0/495764495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a815dce0 msgr2=0x7fa3a80d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.524+0000 7fa3b037e640 1 --2- 172.21.15.55:0/495764495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a815dce0 0x7fa3a80d1a50 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8161710 tx=0x7fa3a402a140 comp rx=0 tx=0).stop 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.524+0000 7fa3b037e640 1 -- 172.21.15.55:0/495764495 shutdown_connections 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.524+0000 7fa3b037e640 1 --2- 172.21.15.55:0/495764495 >> v2:172.21.15.167:3300/0 conn(0x7fa3a80d1f90 0x7fa3a80b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.524+0000 7fa3b037e640 1 --2- 172.21.15.55:0/495764495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a80d35b0 0x7fa3a80b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.524+0000 7fa3b037e640 1 --2- 172.21.15.55:0/495764495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a815dce0 0x7fa3a80d1a50 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.524+0000 7fa3b037e640 1 -- 172.21.15.55:0/495764495 >> 172.21.15.55:0/495764495 conn(0x7fa3a8072900 msgr2=0x7fa3a80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.524+0000 7fa3b037e640 1 -- 172.21.15.55:0/495764495 shutdown_connections 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.524+0000 7fa3b037e640 1 -- 172.21.15.55:0/495764495 wait complete. 2024-04-25T09:03:49.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.525+0000 7fa3b037e640 1 Processor -- start 2024-04-25T09:03:49.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.525+0000 7fa3b037e640 1 -- start start 2024-04-25T09:03:49.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3b037e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80d1f90 0x7fa3a80caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3b037e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a80d35b0 0x7fa3a80c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3b037e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a815dce0 0x7fa3a80c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3b037e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80b9820 con 0x7fa3a80d1f90 2024-04-25T09:03:49.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3b037e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80d3090 con 0x7fa3a815dce0 2024-04-25T09:03:49.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3b037e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80b99a0 con 0x7fa3a80d35b0 2024-04-25T09:03:49.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ae11a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80d1f90 0x7fa3a80caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ae11a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80d1f90 0x7fa3a80caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55242/0 (socket says 172.21.15.55:55242) 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ae11a640 1 -- 172.21.15.55:0/3673307231 learned_addr learned my addr 172.21.15.55:0/3673307231 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ad919640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a80d35b0 0x7fa3a80c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ae91b640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a815dce0 0x7fa3a80c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ae11a640 1 -- 172.21.15.55:0/3673307231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a80d35b0 msgr2=0x7fa3a80c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ae11a640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a80d35b0 0x7fa3a80c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ae11a640 1 -- 172.21.15.55:0/3673307231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a815dce0 msgr2=0x7fa3a80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ae11a640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a815dce0 0x7fa3a80c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ae11a640 1 -- 172.21.15.55:0/3673307231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a80ca380 con 0x7fa3a80d1f90 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ad919640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a80d35b0 0x7fa3a80c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.526+0000 7fa3ae91b640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a815dce0 0x7fa3a80c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.527+0000 7fa3ae11a640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80d1f90 0x7fa3a80caaa0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4000c00 tx=0x7fa3a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.527+0000 7fa39effd640 1 -- 172.21.15.55:0/3673307231 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4041020 con 0x7fa3a80d1f90 2024-04-25T09:03:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.527+0000 7fa39effd640 1 -- 172.21.15.55:0/3673307231 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a40306c0 con 0x7fa3a80d1f90 2024-04-25T09:03:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.527+0000 7fa3b037e640 1 -- 172.21.15.55:0/3673307231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a80cd8e0 con 0x7fa3a80d1f90 2024-04-25T09:03:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.527+0000 7fa39effd640 1 -- 172.21.15.55:0/3673307231 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4037040 con 0x7fa3a80d1f90 2024-04-25T09:03:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.527+0000 7fa3b037e640 1 -- 172.21.15.55:0/3673307231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a80cd600 con 0x7fa3a80d1f90 2024-04-25T09:03:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.528+0000 7fa3b037e640 1 -- 172.21.15.55:0/3673307231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a80749b0 con 0x7fa3a80d1f90 2024-04-25T09:03:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.528+0000 7fa39effd640 1 -- 172.21.15.55:0/3673307231 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa3a4044020 con 0x7fa3a80d1f90 2024-04-25T09:03:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.529+0000 7fa39effd640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b500 0x7fa38c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.529+0000 7fa39effd640 1 -- 172.21.15.55:0/3673307231 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa3a40aaaf0 con 0x7fa3a80d1f90 2024-04-25T09:03:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.529+0000 7fa3ad919640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b500 0x7fa38c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.529+0000 7fa3ad919640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b500 0x7fa38c06d9c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa398006fd0 tx=0x7fa398008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.533+0000 7fa39effd640 1 -- 172.21.15.55:0/3673307231 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa3a404b030 con 0x7fa3a80d1f90 2024-04-25T09:03:49.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.752+0000 7fa3b037e640 1 -- 172.21.15.55:0/3673307231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3a80c77b0 con 0x7fa3a80d1f90 2024-04-25T09:03:49.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.752+0000 7fa39effd640 1 -- 172.21.15.55:0/3673307231 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4945 (secure 0 0 0) 0x7fa3a4079880 con 0x7fa3a80d1f90 2024-04-25T09:03:49.741 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:49.741 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:03:48.652080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9177":{"gid":9177,"name":"a","rank":0,"incarnation":89,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.55:6837/3667784674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3667784674},{"type":"v1","addr":"172.21.15.55:6837","nonce":3667784674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:03:49.741 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 91 2024-04-25T09:03:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.754+0000 7fa3b037e640 1 -- 172.21.15.55:0/3673307231 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b500 msgr2=0x7fa38c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.754+0000 7fa3b037e640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b500 0x7fa38c06d9c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa398006fd0 tx=0x7fa398008040 comp rx=0 tx=0).stop 2024-04-25T09:03:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.754+0000 7fa3b037e640 1 -- 172.21.15.55:0/3673307231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80d1f90 msgr2=0x7fa3a80caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.754+0000 7fa3b037e640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80d1f90 0x7fa3a80caaa0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4000c00 tx=0x7fa3a40046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.754+0000 7fa3b037e640 1 -- 172.21.15.55:0/3673307231 shutdown_connections 2024-04-25T09:03:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.754+0000 7fa3b037e640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa38c06b500 0x7fa38c06d9c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.754+0000 7fa3b037e640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a815dce0 0x7fa3a80c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.754+0000 7fa3b037e640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a80d35b0 0x7fa3a80c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.754+0000 7fa3b037e640 1 --2- 172.21.15.55:0/3673307231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80d1f90 0x7fa3a80caaa0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.754+0000 7fa3b037e640 1 -- 172.21.15.55:0/3673307231 >> 172.21.15.55:0/3673307231 conn(0x7fa3a8072900 msgr2=0x7fa3a80ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.755+0000 7fa3b037e640 1 -- 172.21.15.55:0/3673307231 shutdown_connections 2024-04-25T09:03:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:49.755+0000 7fa3b037e640 1 -- 172.21.15.55:0/3673307231 wait complete. 2024-04-25T09:03:50.157 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:03:33.628986+0000', 'modified': '2024-04-25T09:03:48.652080+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 116, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9177}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9177': {'gid': 9177, 'name': 'a', 'rank': 0, 'incarnation': 89, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.55:6837/3667784674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 3667784674}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3667784674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:03:50.157 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9177:up:rejoin 2024-04-25T09:03:51.158 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.284+0000 7f81ca57e640 1 Processor -- start 2024-04-25T09:03:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.284+0000 7f81ca57e640 1 -- start start 2024-04-25T09:03:51.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.284+0000 7f81ca57e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c406e8f0 0x7f81c415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81ca57e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c40ce6c0 con 0x7f81c415c820 2024-04-25T09:03:51.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81ca57e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c40cc4e0 con 0x7f81c415bf00 2024-04-25T09:03:51.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81ca57e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c41455e0 con 0x7f81c406e8f0 2024-04-25T09:03:51.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c8b1b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f81c415c820 0x7f81c41654b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53560/0 (socket says 172.21.15.55:53560) 2024-04-25T09:03:51.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c8b1b640 1 -- 172.21.15.55:0/581565935 learned_addr learned my addr 172.21.15.55:0/581565935 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c37fe640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c406e8f0 0x7f81c415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367256420 0 0) 0x7f81bc001490 con 0x7f81c415c820 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81ac003520 con 0x7f81c415c820 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54058947 0 0) 0x7f81c40cc4e0 con 0x7f81c415bf00 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81bc001490 con 0x7f81c415bf00 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2810226630 0 0) 0x7f81ac003520 con 0x7f81c415c820 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c406e8f0 msgr2=0x7f81c415c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c406e8f0 0x7f81c415c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 >> v1:172.21.15.167:6789/0 conn(0x7f81c415bf00 legacy=0x7f81c40cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c40cc7b0 con 0x7f81c415c820 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f81bc001bc0 con 0x7f81c415c820 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 >> v1:172.21.15.55:6789/0 conn(0x7f81c415c820 legacy=0x7f81c41654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c406e8f0 0x7f81ac003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81ac0040d0 0x7f81ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac004d40 0x7f81ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c41455e0 con 0x7f81ac004d40 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac00baa0 con 0x7f81ac0040d0 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.285+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac00bca0 con 0x7f81c406e8f0 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.286+0000 7f81c8b1b640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac004d40 0x7f81ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.286+0000 7f81c3fff640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c406e8f0 0x7f81ac003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.286+0000 7f81c37fe640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81ac0040d0 0x7f81ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.286+0000 7f81c8b1b640 1 -- 172.21.15.55:0/581565935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c406e8f0 msgr2=0x7f81ac003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.286+0000 7f81c8b1b640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c406e8f0 0x7f81ac003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.286+0000 7f81c8b1b640 1 -- 172.21.15.55:0/581565935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81ac0040d0 msgr2=0x7f81ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.286+0000 7f81c8b1b640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81ac0040d0 0x7f81ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.286+0000 7f81c8b1b640 1 -- 172.21.15.55:0/581565935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac003520 con 0x7f81ac004d40 2024-04-25T09:03:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.287+0000 7f81c8b1b640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac004d40 0x7f81ac0051c0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00a9c0 tx=0x7f81ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596d8d1868dfb4e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.287+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc00a5e0 con 0x7f81ac004d40 2024-04-25T09:03:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.287+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc02f070 con 0x7f81ac004d40 2024-04-25T09:03:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.287+0000 7f81c2ffd640 1 -- 172.21.15.55:0/581565935 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc034470 con 0x7f81ac004d40 2024-04-25T09:03:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.287+0000 7f81ca57e640 1 -- 172.21.15.55:0/581565935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac004d40 msgr2=0x7f81ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.287+0000 7f81ca57e640 1 --2- 172.21.15.55:0/581565935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac004d40 0x7f81ac0051c0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00a9c0 tx=0x7f81ac005830 comp rx=0 tx=0).stop 2024-04-25T09:03:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.287+0000 7f81c8b1b640 1 -- 172.21.15.55:0/581565935 reap_dead start 2024-04-25T09:03:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.287+0000 7f81ca57e640 1 -- 172.21.15.55:0/581565935 shutdown_connections 2024-04-25T09:03:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.287+0000 7f81ca57e640 1 -- 172.21.15.55:0/581565935 >> 172.21.15.55:0/581565935 conn(0x7f81c406aba0 msgr2=0x7f81c406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.287+0000 7f81ca57e640 1 -- 172.21.15.55:0/581565935 shutdown_connections 2024-04-25T09:03:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.287+0000 7f81ca57e640 1 -- 172.21.15.55:0/581565935 wait complete. 2024-04-25T09:03:51.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.289+0000 7f81ca57e640 1 Processor -- start 2024-04-25T09:03:51.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.289+0000 7f81ca57e640 1 -- start start 2024-04-25T09:03:51.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81ca57e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c4158170 0x7f81c413ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81ca57e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c413f440 0x7f81c41e5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81ca57e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81c41e5880 0x7f81c413ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81ca57e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40ccd70 con 0x7f81c413f440 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81ca57e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c406d450 con 0x7f81c41e5880 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81ca57e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40cd050 con 0x7f81c4158170 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c413f440 0x7f81c41e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c413f440 0x7f81c41e5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55258/0 (socket says 172.21.15.55:55258) 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c37fe640 1 -- 172.21.15.55:0/2442284907 learned_addr learned my addr 172.21.15.55:0/2442284907 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c8b1b640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81c41e5880 0x7f81c413ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c3fff640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c4158170 0x7f81c413ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c37fe640 1 -- 172.21.15.55:0/2442284907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c4158170 msgr2=0x7f81c413ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c37fe640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c4158170 0x7f81c413ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c37fe640 1 -- 172.21.15.55:0/2442284907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81c41e5880 msgr2=0x7f81c413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c37fe640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81c41e5880 0x7f81c413ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c37fe640 1 -- 172.21.15.55:0/2442284907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c41e42a0 con 0x7f81c413f440 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c8b1b640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81c41e5880 0x7f81c413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c3fff640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c4158170 0x7f81c413ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c37fe640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c413f440 0x7f81c41e5340 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f81b8011970 tx=0x7f81b8011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c0ff9640 1 -- 172.21.15.55:0/2442284907 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800faf0 con 0x7f81c413f440 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81c0ff9640 1 -- 172.21.15.55:0/2442284907 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b800fc90 con 0x7f81c413f440 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.290+0000 7f81ca57e640 1 -- 172.21.15.55:0/2442284907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c41e4580 con 0x7f81c413f440 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.291+0000 7f81c0ff9640 1 -- 172.21.15.55:0/2442284907 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8014440 con 0x7f81c413f440 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.291+0000 7f81ca57e640 1 -- 172.21.15.55:0/2442284907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c41e4b40 con 0x7f81c413f440 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.292+0000 7f81ca57e640 1 -- 172.21.15.55:0/2442284907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c406bb30 con 0x7f81c413f440 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.292+0000 7f81c0ff9640 1 -- 172.21.15.55:0/2442284907 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f81b8012040 con 0x7f81c413f440 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.293+0000 7f81c0ff9640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81b006b500 0x7f81b006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.293+0000 7f81c3fff640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81b006b500 0x7f81b006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.293+0000 7f81c0ff9640 1 -- 172.21.15.55:0/2442284907 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f81b808a840 con 0x7f81c413f440 2024-04-25T09:03:51.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.293+0000 7f81c3fff640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81b006b500 0x7f81b006d9c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f81b40036b0 tx=0x7f81b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.297+0000 7f81c0ff9640 1 -- 172.21.15.55:0/2442284907 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81b8019030 con 0x7f81c413f440 2024-04-25T09:03:51.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.514+0000 7f81ca57e640 1 -- 172.21.15.55:0/2442284907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81c41e5c60 con 0x7f81c413f440 2024-04-25T09:03:51.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.514+0000 7f81c0ff9640 1 -- 172.21.15.55:0/2442284907 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f81b80590a0 con 0x7f81c413f440 2024-04-25T09:03:51.503 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:51.503 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:03:49.659242+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9177":{"gid":9177,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/3667784674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3667784674},{"type":"v1","addr":"172.21.15.55:6837","nonce":3667784674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:03:51.505 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 92 2024-04-25T09:03:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 -- 172.21.15.55:0/2442284907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81b006b500 msgr2=0x7f81b006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81b006b500 0x7f81b006d9c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f81b40036b0 tx=0x7f81b4009040 comp rx=0 tx=0).stop 2024-04-25T09:03:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 -- 172.21.15.55:0/2442284907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c413f440 msgr2=0x7f81c41e5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c413f440 0x7f81c41e5340 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f81b8011970 tx=0x7f81b8011e30 comp rx=0 tx=0).stop 2024-04-25T09:03:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 -- 172.21.15.55:0/2442284907 shutdown_connections 2024-04-25T09:03:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81b006b500 0x7f81b006d9c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81c41e5880 0x7f81c413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c413f440 0x7f81c41e5340 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 --2- 172.21.15.55:0/2442284907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c4158170 0x7f81c413ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 -- 172.21.15.55:0/2442284907 >> 172.21.15.55:0/2442284907 conn(0x7f81c406aba0 msgr2=0x7f81c40ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 -- 172.21.15.55:0/2442284907 shutdown_connections 2024-04-25T09:03:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:51.516+0000 7f81ca57e640 1 -- 172.21.15.55:0/2442284907 wait complete. 2024-04-25T09:03:51.918 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:03:33.628986+0000', 'modified': '2024-04-25T09:03:49.659242+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 116, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9177}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9177': {'gid': 9177, 'name': 'a', 'rank': 0, 'incarnation': 89, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6837/3667784674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 3667784674}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3667784674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:03:51.918 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:03:51.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:03:52.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.036+0000 7ff2f2b63640 1 Processor -- start 2024-04-25T09:03:52.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.037+0000 7ff2f2b63640 1 -- start start 2024-04-25T09:03:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.037+0000 7ff2f2b63640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0ceeb0 0x7ff2ec168a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.037+0000 7ff2f2b63640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec161f80 con 0x7ff2ec0b9720 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.037+0000 7ff2f2b63640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec162260 con 0x7ff2ec161090 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.037+0000 7ff2f2b63640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0d21a0 con 0x7ff2ec0ceeb0 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.037+0000 7ff2ebfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff2ec0b9720 0x7ff2ec0ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53564/0 (socket says 172.21.15.55:53564) 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.037+0000 7ff2ebfff640 1 -- 172.21.15.55:0/532229766 learned_addr learned my addr 172.21.15.55:0/532229766 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2f1100640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0ceeb0 0x7ff2ec168a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764646295 0 0) 0x7ff2ec161f80 con 0x7ff2ec0b9720 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d4003520 con 0x7ff2ec0b9720 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474042502 0 0) 0x7ff2ec162260 con 0x7ff2ec161090 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2ec161f80 con 0x7ff2ec161090 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3753405972 0 0) 0x7ff2d4003520 con 0x7ff2ec0b9720 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0ceeb0 msgr2=0x7ff2ec168a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0ceeb0 0x7ff2ec168a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 >> v1:172.21.15.167:6789/0 conn(0x7ff2ec161090 legacy=0x7ff2ec161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec162540 con 0x7ff2ec0b9720 2024-04-25T09:03:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7ff2e0001690 con 0x7ff2ec0b9720 2024-04-25T09:03:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 >> v1:172.21.15.55:6789/0 conn(0x7ff2ec0b9720 legacy=0x7ff2ec0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2d4003b70 0x7ff2d4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0ceeb0 0x7ff2d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d4004d40 0x7ff2d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0d21a0 con 0x7ff2d4004d40 2024-04-25T09:03:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d400bb50 con 0x7ff2d4003b70 2024-04-25T09:03:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d400bd50 con 0x7ff2ec0ceeb0 2024-04-25T09:03:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2f1100640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d4004d40 0x7ff2d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2d4003b70 0x7ff2d4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.038+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0ceeb0 0x7ff2d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.039+0000 7ff2f1100640 1 -- 172.21.15.55:0/532229766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0ceeb0 msgr2=0x7ff2d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.039+0000 7ff2f1100640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec0ceeb0 0x7ff2d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.039+0000 7ff2f1100640 1 -- 172.21.15.55:0/532229766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2d4003b70 msgr2=0x7ff2d4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.039+0000 7ff2f1100640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2d4003b70 0x7ff2d4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.039+0000 7ff2f1100640 1 -- 172.21.15.55:0/532229766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4003520 con 0x7ff2d4004d40 2024-04-25T09:03:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.039+0000 7ff2f1100640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d4004d40 0x7ff2d40051c0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009a90 tx=0x7ff2d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab9e56f7a261673 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.040+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc036070 con 0x7ff2d4004d40 2024-04-25T09:03:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.040+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc031400 con 0x7ff2d4004d40 2024-04-25T09:03:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.040+0000 7ff2eb7fe640 1 -- 172.21.15.55:0/532229766 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc009690 con 0x7ff2d4004d40 2024-04-25T09:03:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.040+0000 7ff2f2b63640 1 -- 172.21.15.55:0/532229766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d4004d40 msgr2=0x7ff2d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.040+0000 7ff2f2b63640 1 --2- 172.21.15.55:0/532229766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d4004d40 0x7ff2d40051c0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009a90 tx=0x7ff2d4005830 comp rx=0 tx=0).stop 2024-04-25T09:03:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.040+0000 7ff2f1100640 1 -- 172.21.15.55:0/532229766 reap_dead start 2024-04-25T09:03:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.040+0000 7ff2f2b63640 1 -- 172.21.15.55:0/532229766 shutdown_connections 2024-04-25T09:03:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.040+0000 7ff2f2b63640 1 -- 172.21.15.55:0/532229766 >> 172.21.15.55:0/532229766 conn(0x7ff2ec0b55e0 msgr2=0x7ff2ec0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.040+0000 7ff2f2b63640 1 -- 172.21.15.55:0/532229766 shutdown_connections 2024-04-25T09:03:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.040+0000 7ff2f2b63640 1 -- 172.21.15.55:0/532229766 wait complete. 2024-04-25T09:03:52.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.041+0000 7ff2f2b63640 1 Processor -- start 2024-04-25T09:03:52.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.041+0000 7ff2f2b63640 1 -- start start 2024-04-25T09:03:52.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.042+0000 7ff2f2b63640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2d4004d40 0x7ff2ec1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.042+0000 7ff2f2b63640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec157710 0x7ff2ec1f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.042+0000 7ff2f2b63640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec158760 0x7ff2ec1f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.042+0000 7ff2f2b63640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0d3640 con 0x7ff2ec157710 2024-04-25T09:03:52.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.042+0000 7ff2f2b63640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec161470 con 0x7ff2d4004d40 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.042+0000 7ff2f2b63640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0d37c0 con 0x7ff2ec158760 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.042+0000 7ff2ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec157710 0x7ff2ec1f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.042+0000 7ff2ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec157710 0x7ff2ec1f6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55272/0 (socket says 172.21.15.55:55272) 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.042+0000 7ff2ebfff640 1 -- 172.21.15.55:0/2811070060 learned_addr learned my addr 172.21.15.55:0/2811070060 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2f1100640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec158760 0x7ff2ec1f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2d4004d40 0x7ff2ec1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2ebfff640 1 -- 172.21.15.55:0/2811070060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec158760 msgr2=0x7ff2ec1f71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec158760 0x7ff2ec1f71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2ebfff640 1 -- 172.21.15.55:0/2811070060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2d4004d40 msgr2=0x7ff2ec1521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2d4004d40 0x7ff2ec1521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2ebfff640 1 -- 172.21.15.55:0/2811070060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec158cb0 con 0x7ff2ec157710 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec157710 0x7ff2ec1f6c70 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0004ef0 tx=0x7ff2e0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2e97fa640 1 -- 172.21.15.55:0/2811070060 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000f7b0 con 0x7ff2ec157710 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2e97fa640 1 -- 172.21.15.55:0/2811070060 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0018070 con 0x7ff2ec157710 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2e97fa640 1 -- 172.21.15.55:0/2811070060 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000fb90 con 0x7ff2ec157710 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2f2b63640 1 -- 172.21.15.55:0/2811070060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec156c30 con 0x7ff2ec157710 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.043+0000 7ff2f2b63640 1 -- 172.21.15.55:0/2811070060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec1571f0 con 0x7ff2ec157710 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.044+0000 7ff2e97fa640 1 -- 172.21.15.55:0/2811070060 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff2e000fd30 con 0x7ff2ec157710 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.045+0000 7ff2e97fa640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2d806b500 0x7ff2d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.045+0000 7ff2e97fa640 1 -- 172.21.15.55:0/2811070060 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff2e008a120 con 0x7ff2ec157710 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.045+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2d806b500 0x7ff2d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.045+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2d806b500 0x7ff2d806d9c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec067f70 tx=0x7ff2e4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.046+0000 7ff2f586f740 1 Processor -- start 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.046+0000 7ff2f586f740 1 -- start start 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.046+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4ef610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.046+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c50cad0 0x557e1c50d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.046+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c4c4f10 0x557e1c50b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.046+0000 7ff2f586f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e1c427a10 con 0x557e1c4ef230 2024-04-25T09:03:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.046+0000 7ff2f586f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e1c3d0b30 con 0x557e1c4c4f10 2024-04-25T09:03:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.046+0000 7ff2f586f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e1c423c50 con 0x557e1c50cad0 2024-04-25T09:03:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2f08ff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2f08ff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4ef610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55276/0 (socket says 172.21.15.55:55276) 2024-04-25T09:03:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3095163585 learned_addr learned my addr 172.21.15.55:0/3095163585 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/3095163585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c50cad0 0x557e1c50d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2f1100640 1 --2- 172.21.15.55:0/3095163585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c4c4f10 0x557e1c50b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3095163585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c50cad0 msgr2=0x557e1c50d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/3095163585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c50cad0 0x557e1c50d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3095163585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c4c4f10 msgr2=0x557e1c50b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/3095163585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c4c4f10 0x557e1c50b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3095163585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e1c3e5e10 con 0x557e1c4ef230 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/3095163585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c50cad0 0x557e1c50d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2f1100640 1 --2- 172.21.15.55:0/3095163585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c4c4f10 0x557e1c50b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/3095163585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4ef610 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40021e0 tx=0x7ff2e4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419aebfe3d8c7b50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2d27fc640 1 -- 172.21.15.55:0/3095163585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4027070 con 0x557e1c4ef230 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2d27fc640 1 -- 172.21.15.55:0/3095163585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e4005650 con 0x557e1c4ef230 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.047+0000 7ff2d27fc640 1 -- 172.21.15.55:0/3095163585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4013560 con 0x557e1c4ef230 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.048+0000 7ff2f586f740 1 -- 172.21.15.55:0/3095163585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 msgr2=0x557e1c4ef610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.048+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3095163585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4ef610 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40021e0 tx=0x7ff2e4013000 comp rx=0 tx=0).stop 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.048+0000 7ff2f586f740 1 -- 172.21.15.55:0/3095163585 shutdown_connections 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.048+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3095163585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c4c4f10 0x557e1c50b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.048+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3095163585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c50cad0 0x557e1c50d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.048+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3095163585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4ef610 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.048+0000 7ff2f586f740 1 -- 172.21.15.55:0/3095163585 >> 172.21.15.55:0/3095163585 conn(0x557e1c4c1840 msgr2=0x557e1c50a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.048+0000 7ff2f586f740 1 -- 172.21.15.55:0/3095163585 shutdown_connections 2024-04-25T09:03:52.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.048+0000 7ff2f586f740 1 -- 172.21.15.55:0/3095163585 wait complete. 2024-04-25T09:03:52.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.049+0000 7ff2f586f740 1 -- start start 2024-04-25T09:03:52.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.049+0000 7ff2f586f740 1 Processor -- start 2024-04-25T09:03:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c508d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c50cad0 0x557e1c4f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c4ede50 0x557e1c4ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f586f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e1c4c5cb0 con 0x557e1c4ef230 2024-04-25T09:03:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f586f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e1c3e40c0 con 0x557e1c4ede50 2024-04-25T09:03:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f586f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e1c4bf770 con 0x557e1c50cad0 2024-04-25T09:03:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f586f740 10 client.0 _ll_register_callbacks cb 0x557e1c3d7ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f08ff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c508d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f08ff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c508d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55292/0 (socket says 172.21.15.55:55292) 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3438168267 learned_addr learned my addr 172.21.15.55:0/3438168267 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c50cad0 0x557e1c4f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f1100640 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c4ede50 0x557e1c4ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3438168267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c50cad0 msgr2=0x557e1c4f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c50cad0 0x557e1c4f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3438168267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c4ede50 msgr2=0x557e1c4ee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c4ede50 0x557e1c4ee2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3438168267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e1c13c2d0 con 0x557e1c4ef230 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c508d20 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4005420 tx=0x7ff2e4001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845dc7013ff35c9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/3438168267 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4033060 con 0x557e1c4ef230 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/3438168267 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff2e402e680 con 0x557e1c4ef230 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f586f740 1 -- 172.21.15.55:0/3438168267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2e4005650 con 0x557e1c4ef230 2024-04-25T09:03:52.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/3438168267 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2e4039050 con 0x557e1c4ef230 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f586f740 10 client.9222 fetch_fsmap learned FSMap version 92 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.050+0000 7ff2f586f740 1 -- 172.21.15.55:0/3438168267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x557e1c2066b0 con 0x557e1c4ef230 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.051+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/3438168267 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e4005650 con 0x557e1c4ef230 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.051+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/3438168267 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 92) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff2e403c020 con 0x557e1c4ef230 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.051+0000 7ff2f586f740 10 client.9222 fetch_fsmap finished waiting for FSMap version 92 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.051+0000 7ff2f586f740 10 client.9222 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.051+0000 7ff2f586f740 20 client.9222 populate_metadata read hostname 'smithi055' 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.051+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x557e1c4f03c0 0x557e1c4f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.051+0000 7ff2f586f740 4 client.9222 mds_command: new command op to 9177 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.051+0000 7ff2f586f740 1 -- 172.21.15.55:0/3438168267 --> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e1c486920 con 0x557e1c4f03c0 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.051+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x557e1c4f03c0 0x557e1c4f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.051+0000 7ff2cb7fe640 10 client.9222 ms_handle_connect on v2:172.21.15.55:6835/3667784674 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.051+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x557e1c4f03c0 0x557e1c4f07a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=182b91bf482d7a4d server_cookie=4c4ce331667fa49 in_seq=0 out_seq=0 2024-04-25T09:03:52.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/3438168267 <== mds.0 v2:172.21.15.55:6835/3667784674 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557e1c486920 con 0x557e1c4f03c0 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2cb7fe640 10 client.9222 handle_command_reply: tid=0 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 1 client.9222 shutdown 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 1 -- 172.21.15.55:0/3438168267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 msgr2=0x557e1c508d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c508d20 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4005420 tx=0x7ff2e4001650 comp rx=0 tx=0).stop 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 1 -- 172.21.15.55:0/3438168267 shutdown_connections 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c4ede50 0x557e1c4ee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x557e1c4f03c0 0x557e1c4f07a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c50cad0 0x557e1c4f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3438168267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c508d20 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2cb7fe640 0 client.9222 ms_handle_reset on v2:172.21.15.55:6835/3667784674 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 1 -- 172.21.15.55:0/3438168267 >> 172.21.15.55:0/3438168267 conn(0x557e1c4c4f10 msgr2=0x557e1c50d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 1 -- 172.21.15.55:0/3438168267 shutdown_connections 2024-04-25T09:03:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 1 -- 172.21.15.55:0/3438168267 wait complete. 2024-04-25T09:03:52.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.052+0000 7ff2f586f740 20 client.9222 trim_cache size 0 max 16384 2024-04-25T09:03:52.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.068+0000 7ff2f586f740 1 Processor -- start 2024-04-25T09:03:52.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.068+0000 7ff2f586f740 1 -- start start 2024-04-25T09:03:52.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ede50 0x557e1c4f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c4ef230 0x557e1c51a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c50cad0 0x557e1c51aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f586f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec200600 con 0x557e1c4ede50 2024-04-25T09:03:52.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f586f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec1ff770 con 0x557e1c50cad0 2024-04-25T09:03:52.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f586f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0c98f0 con 0x557e1c4ef230 2024-04-25T09:03:52.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f08ff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ede50 0x557e1c4f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f08ff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ede50 0x557e1c4f2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55306/0 (socket says 172.21.15.55:55306) 2024-04-25T09:03:52.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3417120671 learned_addr learned my addr 172.21.15.55:0/3417120671 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:52.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3417120671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c4ef230 msgr2=0x557e1c51a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/3417120671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c4ef230 0x557e1c51a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3417120671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c50cad0 msgr2=0x557e1c51aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/3417120671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c50cad0 0x557e1c51aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f08ff640 1 -- 172.21.15.55:0/3417120671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e1c500f20 con 0x557e1c4ede50 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.069+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/3417120671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ede50 0x557e1c4f2cf0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4031040 tx=0x7ff2e402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d3eaaec85a7444 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/3417120671 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4027070 con 0x557e1c4ede50 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/3417120671 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e4028040 con 0x557e1c4ede50 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2d1ffb640 1 -- 172.21.15.55:0/3417120671 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e402e480 con 0x557e1c4ede50 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2f586f740 1 -- 172.21.15.55:0/3417120671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ede50 msgr2=0x557e1c4f2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3417120671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ede50 0x557e1c4f2cf0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4031040 tx=0x7ff2e402c000 comp rx=0 tx=0).stop 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2f586f740 1 -- 172.21.15.55:0/3417120671 shutdown_connections 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3417120671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c50cad0 0x557e1c51aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3417120671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c4ef230 0x557e1c51a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2f586f740 1 --2- 172.21.15.55:0/3417120671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ede50 0x557e1c4f2cf0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2f586f740 1 -- 172.21.15.55:0/3417120671 >> 172.21.15.55:0/3417120671 conn(0x557e1c4c4f10 msgr2=0x557e1c50a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2f586f740 1 -- 172.21.15.55:0/3417120671 shutdown_connections 2024-04-25T09:03:52.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.070+0000 7ff2f586f740 1 -- 172.21.15.55:0/3417120671 wait complete. 2024-04-25T09:03:52.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.071+0000 7ff2f586f740 1 -- start start 2024-04-25T09:03:52.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.071+0000 7ff2f586f740 1 Processor -- start 2024-04-25T09:03:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c4ede50 0x557e1c4c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f586f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c50cad0 0x557e1c502510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f586f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e1c51e3d0 con 0x557e1c4ef230 2024-04-25T09:03:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f586f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec1ff170 con 0x557e1c50cad0 2024-04-25T09:03:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f586f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e1c51e060 con 0x557e1c4ede50 2024-04-25T09:03:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f586f740 10 client.0 _ll_register_callbacks cb 0x557e1c4bfc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55316/0 (socket says 172.21.15.55:55316) 2024-04-25T09:03:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2ebfff640 1 -- 172.21.15.55:0/25315885 learned_addr learned my addr 172.21.15.55:0/25315885 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c4ede50 0x557e1c4c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f1100640 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c50cad0 0x557e1c502510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2ebfff640 1 -- 172.21.15.55:0/25315885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c4ede50 msgr2=0x557e1c4c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c4ede50 0x557e1c4c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2ebfff640 1 -- 172.21.15.55:0/25315885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c50cad0 msgr2=0x557e1c502510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c50cad0 0x557e1c502510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2ebfff640 1 -- 172.21.15.55:0/25315885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e1c4f0ac0 con 0x557e1c4ef230 2024-04-25T09:03:52.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2ebfff640 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4c58a0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00583a0 tx=0x7ff2e00589c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f482e23ba79da4a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:03:52.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/25315885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0075060 con 0x557e1c4ef230 2024-04-25T09:03:52.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/25315885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff2e0054f40 con 0x557e1c4ef230 2024-04-25T09:03:52.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f586f740 1 -- 172.21.15.55:0/25315885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2e4028040 con 0x557e1c4ef230 2024-04-25T09:03:52.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/25315885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2e0088390 con 0x557e1c4ef230 2024-04-25T09:03:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f586f740 10 client.9228 fetch_fsmap learned FSMap version 92 2024-04-25T09:03:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.072+0000 7ff2f586f740 1 -- 172.21.15.55:0/25315885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x557e1c4eedb0 con 0x557e1c4ef230 2024-04-25T09:03:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/25315885 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e4028040 con 0x557e1c4ef230 2024-04-25T09:03:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/25315885 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 92) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff2e0088070 con 0x557e1c4ef230 2024-04-25T09:03:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 10 client.9228 fetch_fsmap finished waiting for FSMap version 92 2024-04-25T09:03:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 10 client.9228 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:03:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 20 client.9228 populate_metadata read hostname 'smithi055' 2024-04-25T09:03:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x557e1c502cd0 0x557e1c5093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 4 client.9228 mds_command: new command op to 9177 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:03:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 1 -- 172.21.15.55:0/25315885 --> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557e1c503950 con 0x557e1c502cd0 2024-04-25T09:03:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x557e1c502cd0 0x557e1c5093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f08ff640 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x557e1c502cd0 0x557e1c5093e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2244e64ba9c3dac6 server_cookie=ffc85615f3f9fcdd in_seq=0 out_seq=0 2024-04-25T09:03:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2cb7fe640 10 client.9228 ms_handle_connect on v2:172.21.15.55:6835/3667784674 2024-04-25T09:03:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2cb7fe640 1 -- 172.21.15.55:0/25315885 <== mds.0 v2:172.21.15.55:6835/3667784674 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x557e1c503950 con 0x557e1c502cd0 2024-04-25T09:03:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2cb7fe640 10 client.9228 handle_command_reply: tid=0 2024-04-25T09:03:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 1 client.9228 shutdown 2024-04-25T09:03:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 1 -- 172.21.15.55:0/25315885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 msgr2=0x557e1c4c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4c58a0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00583a0 tx=0x7ff2e00589c0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 1 -- 172.21.15.55:0/25315885 shutdown_connections 2024-04-25T09:03:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e1c50cad0 0x557e1c502510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e1c4ef230 0x557e1c4c58a0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x557e1c502cd0 0x557e1c5093e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2f586f740 1 --2- 172.21.15.55:0/25315885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557e1c4ede50 0x557e1c4c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.073+0000 7ff2cb7fe640 0 client.9228 ms_handle_reset on v2:172.21.15.55:6835/3667784674 2024-04-25T09:03:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f586f740 1 -- 172.21.15.55:0/25315885 >> 172.21.15.55:0/25315885 conn(0x557e1c4c4f10 msgr2=0x557e1c4c4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f586f740 1 -- 172.21.15.55:0/25315885 shutdown_connections 2024-04-25T09:03:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f586f740 1 -- 172.21.15.55:0/25315885 wait complete. 2024-04-25T09:03:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f586f740 20 client.9228 trim_cache size 0 max 16384 2024-04-25T09:03:52.075 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:03:52.076 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T09:03:52.076 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T09:03:52.076 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9177, 2024-04-25T09:03:52.076 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T09:03:52.076 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T09:03:52.076 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T09:03:52.076 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.4255302419999998, 2024-04-25T09:03:52.076 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 92, 2024-04-25T09:03:52.076 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 116, 2024-04-25T09:03:52.076 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 116, 2024-04-25T09:03:52.076 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 5.3922318919999999 2024-04-25T09:03:52.077 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:03:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 -- 172.21.15.55:0/2811070060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2d806b500 msgr2=0x7ff2d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2d806b500 0x7ff2d806d9c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec067f70 tx=0x7ff2e4009040 comp rx=0 tx=0).stop 2024-04-25T09:03:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 -- 172.21.15.55:0/2811070060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec157710 msgr2=0x7ff2ec1f6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec157710 0x7ff2ec1f6c70 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0004ef0 tx=0x7ff2e0007430 comp rx=0 tx=0).stop 2024-04-25T09:03:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 -- 172.21.15.55:0/2811070060 shutdown_connections 2024-04-25T09:03:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff2d806b500 0x7ff2d806d9c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2ec158760 0x7ff2ec1f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec157710 0x7ff2ec1f6c70 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 --2- 172.21.15.55:0/2811070060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2d4004d40 0x7ff2ec1521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 -- 172.21.15.55:0/2811070060 >> 172.21.15.55:0/2811070060 conn(0x7ff2ec0b55e0 msgr2=0x7ff2ec0b73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 -- 172.21.15.55:0/2811070060 shutdown_connections 2024-04-25T09:03:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.074+0000 7ff2f2b63640 1 -- 172.21.15.55:0/2811070060 wait complete. 2024-04-25T09:03:52.080 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:03:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.192+0000 7f3ddd6dd640 1 Processor -- start 2024-04-25T09:03:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.192+0000 7f3ddd6dd640 1 -- start start 2024-04-25T09:03:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3ddd6dd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3dd815dce0 0x7f3dd80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3ddd6dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dd80b5b60 0x7f3dd80b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3ddd6dd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd815e0c0 con 0x7f3dd80d35b0 2024-04-25T09:03:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3ddd6dd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd80d2510 con 0x7f3dd815dce0 2024-04-25T09:03:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3ddd6dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80d27f0 con 0x7f3dd80b5b60 2024-04-25T09:03:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3dd6ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3dd815dce0 0x7f3dd80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3dd77fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dd80b5b60 0x7f3dd80b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3dd67fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3dd80d35b0 0x7f3dd80b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:55548/0 (socket says 172.21.15.55:55548) 2024-04-25T09:03:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3dd67fc640 1 -- 172.21.15.55:0/3468291769 learned_addr learned my addr 172.21.15.55:0/3468291769 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3dd5ffb640 1 -- 172.21.15.55:0/3468291769 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907012309 0 0) 0x7f3dd815e0c0 con 0x7f3dd80d35b0 2024-04-25T09:03:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3dd5ffb640 1 -- 172.21.15.55:0/3468291769 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc0003520 con 0x7f3dd80d35b0 2024-04-25T09:03:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3dd6ffd640 1 -- 172.21.15.55:0/3468291769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dd80b5b60 msgr2=0x7f3dd80b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3dd6ffd640 1 --2- 172.21.15.55:0/3468291769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dd80b5b60 0x7f3dd80b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3dd6ffd640 1 -- 172.21.15.55:0/3468291769 >> v1:172.21.15.167:6789/0 conn(0x7f3dd80d35b0 legacy=0x7f3dd80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3dd6ffd640 1 -- 172.21.15.55:0/3468291769 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd80d2ad0 con 0x7f3dd815dce0 2024-04-25T09:03:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.193+0000 7f3dd77fe640 1 --2- 172.21.15.55:0/3468291769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dd80b5b60 0x7f3dd80b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.194+0000 7f3dd6ffd640 1 --2- 172.21.15.55:0/3468291769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd815dce0 0x7f3dd80d1a50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80097a0 tx=0x7f3dc802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=580b5625405d7840 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.194+0000 7f3dd5ffb640 1 -- 172.21.15.55:0/3468291769 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8037070 con 0x7f3dd815dce0 2024-04-25T09:03:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.194+0000 7f3dd5ffb640 1 -- 172.21.15.55:0/3468291769 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc8032440 con 0x7f3dd815dce0 2024-04-25T09:03:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.194+0000 7f3dd5ffb640 1 -- 172.21.15.55:0/3468291769 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80327f0 con 0x7f3dd815dce0 2024-04-25T09:03:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.195+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/3468291769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd815dce0 msgr2=0x7f3dd80d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.195+0000 7f3ddd6dd640 1 --2- 172.21.15.55:0/3468291769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd815dce0 0x7f3dd80d1a50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80097a0 tx=0x7f3dc802a180 comp rx=0 tx=0).stop 2024-04-25T09:03:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.195+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/3468291769 shutdown_connections 2024-04-25T09:03:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.195+0000 7f3ddd6dd640 1 --2- 172.21.15.55:0/3468291769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dd80b5b60 0x7f3dd80b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.195+0000 7f3ddd6dd640 1 --2- 172.21.15.55:0/3468291769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd815dce0 0x7f3dd80d1a50 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.195+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/3468291769 >> 172.21.15.55:0/3468291769 conn(0x7f3dd8072900 msgr2=0x7f3dd80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.195+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/3468291769 shutdown_connections 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.195+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/3468291769 wait complete. 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.196+0000 7f3ddd6dd640 1 Processor -- start 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.196+0000 7f3ddd6dd640 1 -- start start 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3ddd6dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dd80b5b60 0x7f3dd815ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3ddd6dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dd80d35b0 0x7f3dd815b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3ddd6dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd815dce0 0x7f3dd81592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3ddd6dd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80b9820 con 0x7f3dd80d35b0 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3ddd6dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80d3090 con 0x7f3dd815dce0 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3ddd6dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80b99a0 con 0x7f3dd80b5b60 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3dd67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dd80d35b0 0x7f3dd815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3dd67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dd80d35b0 0x7f3dd815b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55332/0 (socket says 172.21.15.55:55332) 2024-04-25T09:03:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3dd67fc640 1 -- 172.21.15.55:0/2727235978 learned_addr learned my addr 172.21.15.55:0/2727235978 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3dd77fe640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd815dce0 0x7f3dd81592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3dd6ffd640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dd80b5b60 0x7f3dd815ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3dd67fc640 1 -- 172.21.15.55:0/2727235978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dd80b5b60 msgr2=0x7f3dd815ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3dd67fc640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dd80b5b60 0x7f3dd815ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3dd67fc640 1 -- 172.21.15.55:0/2727235978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd815dce0 msgr2=0x7f3dd81592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3dd67fc640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd815dce0 0x7f3dd81592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.197+0000 7f3dd67fc640 1 -- 172.21.15.55:0/2727235978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd815a0f0 con 0x7f3dd80d35b0 2024-04-25T09:03:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.198+0000 7f3dd67fc640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dd80d35b0 0x7f3dd815b050 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00c400 tx=0x7f3dcc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.198+0000 7f3dbf7fe640 1 -- 172.21.15.55:0/2727235978 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc017070 con 0x7f3dd80d35b0 2024-04-25T09:03:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.198+0000 7f3dbf7fe640 1 -- 172.21.15.55:0/2727235978 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc005d00 con 0x7f3dd80d35b0 2024-04-25T09:03:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.198+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/2727235978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd815efe0 con 0x7f3dd80d35b0 2024-04-25T09:03:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.198+0000 7f3dbf7fe640 1 -- 172.21.15.55:0/2727235978 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc007310 con 0x7f3dd80d35b0 2024-04-25T09:03:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.198+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/2727235978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd815f5a0 con 0x7f3dd80d35b0 2024-04-25T09:03:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.199+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/2727235978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd80d0f40 con 0x7f3dd80d35b0 2024-04-25T09:03:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.199+0000 7f3dbf7fe640 1 -- 172.21.15.55:0/2727235978 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3dcc01a070 con 0x7f3dd80d35b0 2024-04-25T09:03:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.200+0000 7f3dbf7fe640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3dc406b4d0 0x7f3dc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.200+0000 7f3dbf7fe640 1 -- 172.21.15.55:0/2727235978 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3dcc0894c0 con 0x7f3dd80d35b0 2024-04-25T09:03:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.200+0000 7f3dd6ffd640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3dc406b4d0 0x7f3dc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.200+0000 7f3dd6ffd640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3dc406b4d0 0x7f3dc406d990 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8034000 tx=0x7f3dc802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.204+0000 7f3dbf7fe640 1 -- 172.21.15.55:0/2727235978 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3dd80d0f40 con 0x7f3dd80d35b0 2024-04-25T09:03:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.424+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/2727235978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3dd80749b0 con 0x7f3dd80d35b0 2024-04-25T09:03:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.424+0000 7f3dbf7fe640 1 -- 172.21.15.55:0/2727235978 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3dcc057d20 con 0x7f3dd80d35b0 2024-04-25T09:03:52.413 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:03:52.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/2727235978 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3dc406b4d0 msgr2=0x7f3dc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3dc406b4d0 0x7f3dc406d990 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8034000 tx=0x7f3dc802e000 comp rx=0 tx=0).stop 2024-04-25T09:03:52.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/2727235978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dd80d35b0 msgr2=0x7f3dd815b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dd80d35b0 0x7f3dd815b050 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00c400 tx=0x7f3dcc00c800 comp rx=0 tx=0).stop 2024-04-25T09:03:52.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/2727235978 shutdown_connections 2024-04-25T09:03:52.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f3dc406b4d0 0x7f3dc406d990 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd815dce0 0x7f3dd81592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dd80d35b0 0x7f3dd815b050 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 --2- 172.21.15.55:0/2727235978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dd80b5b60 0x7f3dd815ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/2727235978 >> 172.21.15.55:0/2727235978 conn(0x7f3dd8072900 msgr2=0x7f3dd815ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/2727235978 shutdown_connections 2024-04-25T09:03:52.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:52.426+0000 7f3ddd6dd640 1 -- 172.21.15.55:0/2727235978 wait complete. 2024-04-25T09:03:52.425 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:03:52.425 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:03:52.425 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T09:03:52.425 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:03:52.426 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:52.426 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:03:52.426 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:03:52.426 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:03:52.426 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:52.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:52.426 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T09:03:52.442 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:52.442 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:52.442 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:52.442 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:52.442 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:52.442 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:52.442 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:52.442 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:52.442 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42125sec preferred_lft 42125sec 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:03:52.443 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:52.444 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:03:52.445 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T09:03:52.445 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:52.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:52.445 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:03:52.505 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:03:52.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:52.506 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T09:03:52.562 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T09:03:52.562 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:03:52.562 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:03:52.562 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:03:52.562 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:03:52.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:52.563 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:03:52.563 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:03:52.563 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:03:52.563 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:03:52.563 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:03:52.563 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:03:52.637 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-25T09:03:52.649+0000 7fd8fd00e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:03:52.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:52.648 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:03:52.703 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:03:52.704 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:03:52.704 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:52.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:52.704 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T09:03:52.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:52.769 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:52.824 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:52.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:52.825 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:52.880 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:03:52.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:52.880 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:52.962 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:52.962 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:52.962 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:03:52.971 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:52.971 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:52.971 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:03:52.971 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:03:52.971 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:52.976 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:52.976 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:52.976 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:03:52.976 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:03:52.976 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:52.976 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T09:03:52.976 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T09:03:52.976 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T09:03:52.979 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:03:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:03:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:03:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:03:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:03:52.980 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:03:52.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:52.980 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:53.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:53.045 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:53.101 INFO:teuthology.orchestra.run.smithi055.stdout:client7199 2024-04-25T09:03:53.101 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:53.102 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:53.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:53.158 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:03:53.216 INFO:teuthology.orchestra.run.smithi055.stdout:./ 2024-04-25T09:03:53.217 INFO:teuthology.orchestra.run.smithi055.stdout:./parent 2024-04-25T09:03:53.217 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed 2024-04-25T09:03:53.217 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/charlie 2024-04-25T09:03:53.217 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/alpha 2024-04-25T09:03:53.217 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/unflushed 2024-04-25T09:03:53.217 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/unflushed/jfile 2024-04-25T09:03:53.217 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:53.217 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:53.217 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:53.217 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:53.217 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:03:53.217 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:53.323 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:03:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:53.333 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:53.333 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:53.333 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:53.333 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:53.333 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T09:03:53.333 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:53.440 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-25T09:03:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:53.449 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:53.449 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:53.449 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:53.449 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:53.449 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T09:03:53.449 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:53.556 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-25T09:03:53.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:53.565 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:53.566 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:53.566 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:53.566 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:53.566 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T09:03:53.566 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:53.673 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627780 2024-04-25T09:03:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:53.683 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:53.683 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:53.683 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:53.683 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:53.683 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T09:03:53.683 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:53.791 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627778 2024-04-25T09:03:53.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:53.800 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:53.800 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:53.800 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:53.800 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:53.800 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T09:03:53.800 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:53.907 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627781 2024-04-25T09:03:53.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:53.916 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:03:53.916 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:03:53.917 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:03:53.917 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:03:53.917 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T09:03:53.917 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:03:54.023 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627782 2024-04-25T09:03:54.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:54.032 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:54.033 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:54.088 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:03:54.088 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:54.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:54.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.296+0000 7f4fb67e7640 1 Processor -- start 2024-04-25T09:03:54.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.296+0000 7f4fb67e7640 1 -- start start 2024-04-25T09:03:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.297+0000 7f4fb67e7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fb015ba10 0x7f4fb0099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.297+0000 7f4fb67e7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4fb006c3c0 0x7f4fb00cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.297+0000 7f4fb67e7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb009a3a0 con 0x7f4fb0099f80 2024-04-25T09:03:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.297+0000 7f4fb67e7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb00cbe50 con 0x7f4fb006c3c0 2024-04-25T09:03:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.297+0000 7f4fb67e7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00cfe80 con 0x7f4fb015ba10 2024-04-25T09:03:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.297+0000 7f4fb4d84640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4fb006c3c0 0x7f4fb00cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.297+0000 7f4fb4d84640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4fb006c3c0 0x7f4fb00cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55340/0 (socket says 172.21.15.55:55340) 2024-04-25T09:03:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.297+0000 7f4fb4d84640 1 -- 172.21.15.55:0/577449524 learned_addr learned my addr 172.21.15.55:0/577449524 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.298+0000 7f4faffff640 1 --2- 172.21.15.55:0/577449524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fb015ba10 0x7f4fb0099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.298+0000 7f4fb4d84640 1 -- 172.21.15.55:0/577449524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fb015ba10 msgr2=0x7f4fb0099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.298+0000 7f4fb4d84640 1 --2- 172.21.15.55:0/577449524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fb015ba10 0x7f4fb0099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.298+0000 7f4fb4d84640 1 -- 172.21.15.55:0/577449524 >> v1:172.21.15.167:6789/0 conn(0x7f4fb0099f80 legacy=0x7f4fb006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.298+0000 7f4fb4d84640 1 -- 172.21.15.55:0/577449524 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb006c900 con 0x7f4fb006c3c0 2024-04-25T09:03:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.298+0000 7f4faffff640 1 --2- 172.21.15.55:0/577449524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fb015ba10 0x7f4fb0099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.298+0000 7f4fb4d84640 1 --2- 172.21.15.55:0/577449524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fb006c3c0 0x7f4fb00cd220 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009e50 tx=0x7f4fa802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0c672d2063e117 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.298+0000 7f4faeffd640 1 -- 172.21.15.55:0/577449524 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8036070 con 0x7f4fb006c3c0 2024-04-25T09:03:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.298+0000 7f4faeffd640 1 -- 172.21.15.55:0/577449524 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa8031600 con 0x7f4fb006c3c0 2024-04-25T09:03:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.298+0000 7f4faeffd640 1 -- 172.21.15.55:0/577449524 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80319d0 con 0x7f4fb006c3c0 2024-04-25T09:03:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.299+0000 7f4fb67e7640 1 -- 172.21.15.55:0/577449524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fb006c3c0 msgr2=0x7f4fb00cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.299+0000 7f4fb67e7640 1 --2- 172.21.15.55:0/577449524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fb006c3c0 0x7f4fb00cd220 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009e50 tx=0x7f4fa802a6c0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.299+0000 7f4fb67e7640 1 -- 172.21.15.55:0/577449524 shutdown_connections 2024-04-25T09:03:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.299+0000 7f4fb67e7640 1 --2- 172.21.15.55:0/577449524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fb006c3c0 0x7f4fb00cd220 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.299+0000 7f4fb67e7640 1 --2- 172.21.15.55:0/577449524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fb015ba10 0x7f4fb0099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.299+0000 7f4fb67e7640 1 -- 172.21.15.55:0/577449524 >> 172.21.15.55:0/577449524 conn(0x7f4fb00b32f0 msgr2=0x7f4fb00b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.299+0000 7f4fb67e7640 1 -- 172.21.15.55:0/577449524 shutdown_connections 2024-04-25T09:03:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.299+0000 7f4fb67e7640 1 -- 172.21.15.55:0/577449524 wait complete. 2024-04-25T09:03:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.300+0000 7f4fb67e7640 1 Processor -- start 2024-04-25T09:03:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.300+0000 7f4fb67e7640 1 -- start start 2024-04-25T09:03:54.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.301+0000 7f4fb67e7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fb006c3c0 0x7f4fb0158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.301+0000 7f4fb67e7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fb0099f80 0x7f4fb00af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.301+0000 7f4fb67e7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fb015ba10 0x7f4fb00c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.301+0000 7f4fb67e7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00cd760 con 0x7f4fb0099f80 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.301+0000 7f4fb67e7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb006cec0 con 0x7f4fb006c3c0 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.301+0000 7f4fb67e7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00cd8e0 con 0x7f4fb015ba10 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.301+0000 7f4faf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fb0099f80 0x7f4fb00af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.301+0000 7f4faf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fb0099f80 0x7f4fb00af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55350/0 (socket says 172.21.15.55:55350) 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.301+0000 7f4faf7fe640 1 -- 172.21.15.55:0/2361709413 learned_addr learned my addr 172.21.15.55:0/2361709413 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.301+0000 7f4fb4d84640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fb015ba10 0x7f4fb00c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.301+0000 7f4faffff640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fb006c3c0 0x7f4fb0158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.302+0000 7f4faf7fe640 1 -- 172.21.15.55:0/2361709413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fb015ba10 msgr2=0x7f4fb00c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.302+0000 7f4faf7fe640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fb015ba10 0x7f4fb00c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.302+0000 7f4faf7fe640 1 -- 172.21.15.55:0/2361709413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fb006c3c0 msgr2=0x7f4fb0158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.302+0000 7f4faf7fe640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fb006c3c0 0x7f4fb0158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.302+0000 7f4faf7fe640 1 -- 172.21.15.55:0/2361709413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0159330 con 0x7f4fb0099f80 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.302+0000 7f4faf7fe640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fb0099f80 0x7f4fb00af1e0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c460 tx=0x7f4fa000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.302+0000 7f4facff9640 1 -- 172.21.15.55:0/2361709413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0016020 con 0x7f4fb0099f80 2024-04-25T09:03:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.302+0000 7f4facff9640 1 -- 172.21.15.55:0/2361709413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa0012870 con 0x7f4fb0099f80 2024-04-25T09:03:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.302+0000 7f4fb67e7640 1 -- 172.21.15.55:0/2361709413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb00c9390 con 0x7f4fb0099f80 2024-04-25T09:03:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.302+0000 7f4facff9640 1 -- 172.21.15.55:0/2361709413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0012c60 con 0x7f4fb0099f80 2024-04-25T09:03:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.302+0000 7f4fb67e7640 1 -- 172.21.15.55:0/2361709413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb00ae9e0 con 0x7f4fb0099f80 2024-04-25T09:03:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.303+0000 7f4fb67e7640 1 -- 172.21.15.55:0/2361709413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb00749b0 con 0x7f4fb0099f80 2024-04-25T09:03:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.303+0000 7f4facff9640 1 -- 172.21.15.55:0/2361709413 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4fa0019020 con 0x7f4fb0099f80 2024-04-25T09:03:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.304+0000 7f4facff9640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.304+0000 7f4facff9640 1 -- 172.21.15.55:0/2361709413 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4fa0089d90 con 0x7f4fb0099f80 2024-04-25T09:03:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.304+0000 7f4faffff640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.304+0000 7f4faffff640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400aac0 tx=0x7f4fa4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.309+0000 7f4facff9640 1 -- 172.21.15.55:0/2361709413 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4fa0020030 con 0x7f4fb0099f80 2024-04-25T09:03:54.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.492+0000 7f4fb67e7640 1 -- 172.21.15.55:0/2361709413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fb009a570 con 0x7f4fb0099f80 2024-04-25T09:03:54.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.493+0000 7f4facff9640 1 -- 172.21.15.55:0/2361709413 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16756 (secure 0 0 0) 0x7f4fa00585f0 con 0x7f4fb0099f80 2024-04-25T09:03:54.481 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:54.481 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":116,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:46.639021+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:31.900630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:32.603273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/4257598582":"2024-04-26T09:03:46.638997+0000","172.21.15.55:6835/4257598582":"2024-04-26T09:03:46.638997+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:54.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.494+0000 7f4fb67e7640 1 -- 172.21.15.55:0/2361709413 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 msgr2=0x7f4f9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.494+0000 7f4fb67e7640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400aac0 tx=0x7f4fa4008040 comp rx=0 tx=0).stop 2024-04-25T09:03:54.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.494+0000 7f4fb67e7640 1 -- 172.21.15.55:0/2361709413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fb0099f80 msgr2=0x7f4fb00af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.494+0000 7f4fb67e7640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fb0099f80 0x7f4fb00af1e0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c460 tx=0x7f4fa000c920 comp rx=0 tx=0).stop 2024-04-25T09:03:54.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.495+0000 7f4fb67e7640 1 -- 172.21.15.55:0/2361709413 shutdown_connections 2024-04-25T09:03:54.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.495+0000 7f4fb67e7640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4f9c06b4d0 0x7f4f9c06d990 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.495+0000 7f4fb67e7640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fb015ba10 0x7f4fb00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.495+0000 7f4fb67e7640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fb0099f80 0x7f4fb00af1e0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.495+0000 7f4fb67e7640 1 --2- 172.21.15.55:0/2361709413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fb006c3c0 0x7f4fb0158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.495+0000 7f4fb67e7640 1 -- 172.21.15.55:0/2361709413 >> 172.21.15.55:0/2361709413 conn(0x7f4fb00b32f0 msgr2=0x7f4fb006bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:54.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.495+0000 7f4fb67e7640 1 -- 172.21.15.55:0/2361709413 shutdown_connections 2024-04-25T09:03:54.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.495+0000 7f4fb67e7640 1 -- 172.21.15.55:0/2361709413 wait complete. 2024-04-25T09:03:54.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:03:31.900630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:03:32.603273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:54.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:54.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.610+0000 7f791409a640 1 Processor -- start 2024-04-25T09:03:54.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.610+0000 7f791409a640 1 -- start start 2024-04-25T09:03:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f791409a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f790c15b7b0 0x7f790c0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f791409a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f790c0cf760 0x7f790c0cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f791409a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f790c15e110 0x7f790c15e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f791409a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c0d0100 con 0x7f790c15e110 2024-04-25T09:03:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f791409a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c0ced00 con 0x7f790c0cf760 2024-04-25T09:03:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f791409a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c15eae0 con 0x7f790c15b7b0 2024-04-25T09:03:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f7912637640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f790c15e110 0x7f790c15e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f7912637640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f790c15e110 0x7f790c15e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55358/0 (socket says 172.21.15.55:55358) 2024-04-25T09:03:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f7912637640 1 -- 172.21.15.55:0/3178007443 learned_addr learned my addr 172.21.15.55:0/3178007443 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f7911635640 1 --2- 172.21.15.55:0/3178007443 >> v2:172.21.15.167:3300/0 conn(0x7f790c0cf760 0x7f790c0cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f7911e36640 1 --2- 172.21.15.55:0/3178007443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f790c15b7b0 0x7f790c0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f7912637640 1 -- 172.21.15.55:0/3178007443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f790c15b7b0 msgr2=0x7f790c0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f7912637640 1 --2- 172.21.15.55:0/3178007443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f790c15b7b0 0x7f790c0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f7912637640 1 -- 172.21.15.55:0/3178007443 >> v2:172.21.15.167:3300/0 conn(0x7f790c0cf760 msgr2=0x7f790c0cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f7912637640 1 --2- 172.21.15.55:0/3178007443 >> v2:172.21.15.167:3300/0 conn(0x7f790c0cf760 0x7f790c0cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f7912637640 1 -- 172.21.15.55:0/3178007443 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c15f000 con 0x7f790c15e110 2024-04-25T09:03:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.611+0000 7f7911635640 1 --2- 172.21.15.55:0/3178007443 >> v2:172.21.15.167:3300/0 conn(0x7f790c0cf760 0x7f790c0cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:54.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.612+0000 7f7912637640 1 --2- 172.21.15.55:0/3178007443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f790c15e110 0x7f790c15e5a0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f790c072e90 tx=0x7f78fc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2018ccb9f828f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.612+0000 7f7910e34640 1 -- 172.21.15.55:0/3178007443 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc036070 con 0x7f790c15e110 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.612+0000 7f7910e34640 1 -- 172.21.15.55:0/3178007443 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc031600 con 0x7f790c15e110 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.612+0000 7f7910e34640 1 -- 172.21.15.55:0/3178007443 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0319d0 con 0x7f790c15e110 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.613+0000 7f791409a640 1 -- 172.21.15.55:0/3178007443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f790c15e110 msgr2=0x7f790c15e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.613+0000 7f791409a640 1 --2- 172.21.15.55:0/3178007443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f790c15e110 0x7f790c15e5a0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f790c072e90 tx=0x7f78fc02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.613+0000 7f791409a640 1 -- 172.21.15.55:0/3178007443 shutdown_connections 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.613+0000 7f791409a640 1 --2- 172.21.15.55:0/3178007443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f790c15e110 0x7f790c15e5a0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.613+0000 7f791409a640 1 --2- 172.21.15.55:0/3178007443 >> v2:172.21.15.167:3300/0 conn(0x7f790c0cf760 0x7f790c0cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.613+0000 7f791409a640 1 --2- 172.21.15.55:0/3178007443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f790c15b7b0 0x7f790c0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.613+0000 7f791409a640 1 -- 172.21.15.55:0/3178007443 >> 172.21.15.55:0/3178007443 conn(0x7f790c06f4a0 msgr2=0x7f790c06f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.613+0000 7f791409a640 1 -- 172.21.15.55:0/3178007443 shutdown_connections 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.613+0000 7f791409a640 1 -- 172.21.15.55:0/3178007443 wait complete. 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.614+0000 7f791409a640 1 Processor -- start 2024-04-25T09:03:54.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.614+0000 7f791409a640 1 -- start start 2024-04-25T09:03:54.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f791409a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c0cf760 0x7f790c1f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f791409a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f790c15b7b0 0x7f790c0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f791409a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f790c15e110 0x7f790c15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f791409a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0cdce0 con 0x7f790c15e110 2024-04-25T09:03:54.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f791409a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0ce330 con 0x7f790c0cf760 2024-04-25T09:03:54.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f791409a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0cdfc0 con 0x7f790c15b7b0 2024-04-25T09:03:54.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f7912637640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f790c15e110 0x7f790c15cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f7912637640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f790c15e110 0x7f790c15cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55372/0 (socket says 172.21.15.55:55372) 2024-04-25T09:03:54.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f7912637640 1 -- 172.21.15.55:0/1276829682 learned_addr learned my addr 172.21.15.55:0/1276829682 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f7911e36640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c0cf760 0x7f790c1f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f7911635640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f790c15b7b0 0x7f790c0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f7912637640 1 -- 172.21.15.55:0/1276829682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f790c15b7b0 msgr2=0x7f790c0b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f7912637640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f790c15b7b0 0x7f790c0b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f7912637640 1 -- 172.21.15.55:0/1276829682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c0cf760 msgr2=0x7f790c1f6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f7912637640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c0cf760 0x7f790c1f6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.615+0000 7f7912637640 1 -- 172.21.15.55:0/1276829682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0b4860 con 0x7f790c15e110 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.616+0000 7f7912637640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f790c15e110 0x7f790c15cd00 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f78fc034040 tx=0x7f78fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.616+0000 7f790a7fc640 1 -- 172.21.15.55:0/1276829682 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc036050 con 0x7f790c15e110 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.616+0000 7f790a7fc640 1 -- 172.21.15.55:0/1276829682 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc042070 con 0x7f790c15e110 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.616+0000 7f791409a640 1 -- 172.21.15.55:0/1276829682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c0b4b40 con 0x7f790c15e110 2024-04-25T09:03:54.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.616+0000 7f790a7fc640 1 -- 172.21.15.55:0/1276829682 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc009510 con 0x7f790c15e110 2024-04-25T09:03:54.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.616+0000 7f791409a640 1 -- 172.21.15.55:0/1276829682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c0b5100 con 0x7f790c15e110 2024-04-25T09:03:54.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.617+0000 7f791409a640 1 -- 172.21.15.55:0/1276829682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c0750b0 con 0x7f790c15e110 2024-04-25T09:03:54.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.617+0000 7f790a7fc640 1 -- 172.21.15.55:0/1276829682 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f78fc007bd0 con 0x7f790c15e110 2024-04-25T09:03:54.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.618+0000 7f790a7fc640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78f806b4d0 0x7f78f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.618+0000 7f790a7fc640 1 -- 172.21.15.55:0/1276829682 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f78fc0aafa0 con 0x7f790c15e110 2024-04-25T09:03:54.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.618+0000 7f7911e36640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78f806b4d0 0x7f78f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.618+0000 7f7911e36640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78f806b4d0 0x7f78f806d990 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7904006fd0 tx=0x7f7904008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.622+0000 7f790a7fc640 1 -- 172.21.15.55:0/1276829682 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f78fc079770 con 0x7f790c15e110 2024-04-25T09:03:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.804+0000 7f791409a640 1 -- 172.21.15.55:0/1276829682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f790c0b10e0 con 0x7f790c15e110 2024-04-25T09:03:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.805+0000 7f790a7fc640 1 -- 172.21.15.55:0/1276829682 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78fc07d810 con 0x7f790c15e110 2024-04-25T09:03:54.793 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 -- 172.21.15.55:0/1276829682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78f806b4d0 msgr2=0x7f78f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78f806b4d0 0x7f78f806d990 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7904006fd0 tx=0x7f7904008040 comp rx=0 tx=0).stop 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 -- 172.21.15.55:0/1276829682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f790c15e110 msgr2=0x7f790c15cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f790c15e110 0x7f790c15cd00 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f78fc034040 tx=0x7f78fc004a40 comp rx=0 tx=0).stop 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 -- 172.21.15.55:0/1276829682 shutdown_connections 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f78f806b4d0 0x7f78f806d990 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f790c15e110 0x7f790c15cd00 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f790c15b7b0 0x7f790c0b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 --2- 172.21.15.55:0/1276829682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c0cf760 0x7f790c1f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 -- 172.21.15.55:0/1276829682 >> 172.21.15.55:0/1276829682 conn(0x7f790c06f4a0 msgr2=0x7f790c159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 -- 172.21.15.55:0/1276829682 shutdown_connections 2024-04-25T09:03:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.807+0000 7f791409a640 1 -- 172.21.15.55:0/1276829682 wait complete. 2024-04-25T09:03:54.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:54.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.922+0000 7fd376db0640 1 Processor -- start 2024-04-25T09:03:54.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.922+0000 7fd376db0640 1 -- start start 2024-04-25T09:03:54.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.922+0000 7fd376db0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd37015bbe0 0x7fd3700cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.922+0000 7fd376db0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3700cf510 0x7fd3700cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.922+0000 7fd376db0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3700cc830 con 0x7fd3700cff00 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.922+0000 7fd376db0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3700ccb10 con 0x7fd3700cf510 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.922+0000 7fd376db0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3700ccdf0 con 0x7fd37015bbe0 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.923+0000 7fd36ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3700cf510 0x7fd3700cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.923+0000 7fd36ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3700cf510 0x7fd3700cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55378/0 (socket says 172.21.15.55:55378) 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.923+0000 7fd36ffff640 1 -- 172.21.15.55:0/2079204060 learned_addr learned my addr 172.21.15.55:0/2079204060 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.923+0000 7fd374b4c640 1 --2- 172.21.15.55:0/2079204060 >> v2:172.21.15.167:3300/0 conn(0x7fd37015bbe0 0x7fd3700cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.923+0000 7fd36ffff640 1 -- 172.21.15.55:0/2079204060 >> v2:172.21.15.167:3300/0 conn(0x7fd37015bbe0 msgr2=0x7fd3700cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.923+0000 7fd36ffff640 1 --2- 172.21.15.55:0/2079204060 >> v2:172.21.15.167:3300/0 conn(0x7fd37015bbe0 0x7fd3700cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.923+0000 7fd36ffff640 1 -- 172.21.15.55:0/2079204060 >> v1:172.21.15.167:6789/0 conn(0x7fd3700cff00 legacy=0x7fd3700c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.923+0000 7fd36ffff640 1 -- 172.21.15.55:0/2079204060 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700cd0d0 con 0x7fd3700cf510 2024-04-25T09:03:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.923+0000 7fd374b4c640 1 --2- 172.21.15.55:0/2079204060 >> v2:172.21.15.167:3300/0 conn(0x7fd37015bbe0 0x7fd3700cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd36ffff640 1 --2- 172.21.15.55:0/2079204060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3700cf510 0x7fd3700cf970 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd37009a700 tx=0x7fd36002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22925436df9c87c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd36f7fe640 1 -- 172.21.15.55:0/2079204060 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360037070 con 0x7fd3700cf510 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd36f7fe640 1 -- 172.21.15.55:0/2079204060 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360032440 con 0x7fd3700cf510 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd36f7fe640 1 -- 172.21.15.55:0/2079204060 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360032810 con 0x7fd3700cf510 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd376db0640 1 -- 172.21.15.55:0/2079204060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3700cf510 msgr2=0x7fd3700cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd376db0640 1 --2- 172.21.15.55:0/2079204060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3700cf510 0x7fd3700cf970 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd37009a700 tx=0x7fd36002a270 comp rx=0 tx=0).stop 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd376db0640 1 -- 172.21.15.55:0/2079204060 shutdown_connections 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd376db0640 1 --2- 172.21.15.55:0/2079204060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3700cf510 0x7fd3700cf970 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd376db0640 1 --2- 172.21.15.55:0/2079204060 >> v2:172.21.15.167:3300/0 conn(0x7fd37015bbe0 0x7fd3700cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd376db0640 1 -- 172.21.15.55:0/2079204060 >> 172.21.15.55:0/2079204060 conn(0x7fd3700b3430 msgr2=0x7fd3700b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd376db0640 1 -- 172.21.15.55:0/2079204060 shutdown_connections 2024-04-25T09:03:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.924+0000 7fd376db0640 1 -- 172.21.15.55:0/2079204060 wait complete. 2024-04-25T09:03:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.926+0000 7fd376db0640 1 Processor -- start 2024-04-25T09:03:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.926+0000 7fd376db0640 1 -- start start 2024-04-25T09:03:54.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.926+0000 7fd376db0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3700cf510 0x7fd3700b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.926+0000 7fd376db0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3700cff00 0x7fd370152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.926+0000 7fd376db0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015bbe0 0x7fd370159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd376db0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700cde10 con 0x7fd37015bbe0 2024-04-25T09:03:54.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd376db0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37015bfc0 con 0x7fd3700cf510 2024-04-25T09:03:54.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd376db0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700cc450 con 0x7fd3700cff00 2024-04-25T09:03:54.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd37534d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015bbe0 0x7fd370159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd37534d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015bbe0 0x7fd370159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55394/0 (socket says 172.21.15.55:55394) 2024-04-25T09:03:54.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd37534d640 1 -- 172.21.15.55:0/2955547267 learned_addr learned my addr 172.21.15.55:0/2955547267 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd374b4c640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3700cf510 0x7fd3700b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd36ffff640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3700cff00 0x7fd370152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd37534d640 1 -- 172.21.15.55:0/2955547267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3700cff00 msgr2=0x7fd370152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd37534d640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3700cff00 0x7fd370152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd37534d640 1 -- 172.21.15.55:0/2955547267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3700cf510 msgr2=0x7fd3700b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd37534d640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3700cf510 0x7fd3700b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd37534d640 1 -- 172.21.15.55:0/2955547267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3701534c0 con 0x7fd37015bbe0 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd37534d640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015bbe0 0x7fd370159e10 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd358001eb0 tx=0x7fd35800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd36d7fa640 1 -- 172.21.15.55:0/2955547267 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358017070 con 0x7fd37015bbe0 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd36d7fa640 1 -- 172.21.15.55:0/2955547267 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3580052d0 con 0x7fd37015bbe0 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd36d7fa640 1 -- 172.21.15.55:0/2955547267 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358003810 con 0x7fd37015bbe0 2024-04-25T09:03:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd376db0640 1 -- 172.21.15.55:0/2955547267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37015cb90 con 0x7fd37015bbe0 2024-04-25T09:03:54.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.927+0000 7fd376db0640 1 -- 172.21.15.55:0/2955547267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37015d150 con 0x7fd37015bbe0 2024-04-25T09:03:54.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.928+0000 7fd376db0640 1 -- 172.21.15.55:0/2955547267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3700750b0 con 0x7fd37015bbe0 2024-04-25T09:03:54.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.929+0000 7fd36d7fa640 1 -- 172.21.15.55:0/2955547267 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd35801a070 con 0x7fd37015bbe0 2024-04-25T09:03:54.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.929+0000 7fd36d7fa640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd35006b4d0 0x7fd35006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.929+0000 7fd36d7fa640 1 -- 172.21.15.55:0/2955547267 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd358089570 con 0x7fd37015bbe0 2024-04-25T09:03:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.929+0000 7fd374b4c640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd35006b4d0 0x7fd35006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.930+0000 7fd374b4c640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd35006b4d0 0x7fd35006d990 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd368003fd0 tx=0x7fd368003ce0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:54.933+0000 7fd36d7fa640 1 -- 172.21.15.55:0/2955547267 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd3701534c0 con 0x7fd37015bbe0 2024-04-25T09:03:55.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.112+0000 7fd376db0640 1 -- 172.21.15.55:0/2955547267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3700b2cf0 con 0x7fd37015bbe0 2024-04-25T09:03:55.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.112+0000 7fd36d7fa640 1 -- 172.21.15.55:0/2955547267 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd358058420 con 0x7fd37015bbe0 2024-04-25T09:03:55.101 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T09:03:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.114+0000 7fd376db0640 1 -- 172.21.15.55:0/2955547267 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd35006b4d0 msgr2=0x7fd35006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.114+0000 7fd376db0640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd35006b4d0 0x7fd35006d990 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd368003fd0 tx=0x7fd368003ce0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.114+0000 7fd376db0640 1 -- 172.21.15.55:0/2955547267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015bbe0 msgr2=0x7fd370159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.114+0000 7fd376db0640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015bbe0 0x7fd370159e10 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd358001eb0 tx=0x7fd35800c890 comp rx=0 tx=0).stop 2024-04-25T09:03:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.114+0000 7fd376db0640 1 -- 172.21.15.55:0/2955547267 shutdown_connections 2024-04-25T09:03:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.114+0000 7fd376db0640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd35006b4d0 0x7fd35006d990 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.114+0000 7fd376db0640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015bbe0 0x7fd370159e10 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.114+0000 7fd376db0640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3700cff00 0x7fd370152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.114+0000 7fd376db0640 1 --2- 172.21.15.55:0/2955547267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3700cf510 0x7fd3700b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.114+0000 7fd376db0640 1 -- 172.21.15.55:0/2955547267 >> 172.21.15.55:0/2955547267 conn(0x7fd3700b3430 msgr2=0x7fd3700c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:55.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.115+0000 7fd376db0640 1 -- 172.21.15.55:0/2955547267 shutdown_connections 2024-04-25T09:03:55.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.115+0000 7fd376db0640 1 -- 172.21.15.55:0/2955547267 wait complete. 2024-04-25T09:03:55.114 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:55.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.230+0000 7fd8b2f0a640 1 Processor -- start 2024-04-25T09:03:55.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.230+0000 7fd8b2f0a640 1 -- start start 2024-04-25T09:03:55.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8b2f0a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd8ac0d3b90 0x7fd8ac0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8b2f0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac0d0f60 0x7fd8ac0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8b2f0a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ac0d4090 con 0x7fd8ac15dca0 2024-04-25T09:03:55.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8b2f0a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b6b20 con 0x7fd8ac0d3b90 2024-04-25T09:03:55.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8b2f0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0d1390 con 0x7fd8ac0d0f60 2024-04-25T09:03:55.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8b0ca6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd8ac15dca0 0x7fd8ac0ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53566/0 (socket says 172.21.15.55:53566) 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8b0ca6640 1 -- 172.21.15.55:0/3648014129 learned_addr learned my addr 172.21.15.55:0/3648014129 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8b14a7640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac0d0f60 0x7fd8ac0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8abfff640 1 --2- 172.21.15.55:0/3648014129 >> v2:172.21.15.167:3300/0 conn(0x7fd8ac0d3b90 0x7fd8ac0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756817950 0 0) 0x7fd8ac0d4090 con 0x7fd8ac15dca0 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd89c003520 con 0x7fd8ac15dca0 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2849955041 0 0) 0x7fd89c003520 con 0x7fd8ac15dca0 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac0d0f60 msgr2=0x7fd8ac0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8ab7fe640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac0d0f60 0x7fd8ac0b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 >> v2:172.21.15.167:3300/0 conn(0x7fd8ac0d3b90 msgr2=0x7fd8ac0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.231+0000 7fd8ab7fe640 1 --2- 172.21.15.55:0/3648014129 >> v2:172.21.15.167:3300/0 conn(0x7fd8ac0d3b90 0x7fd8ac0d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac0d4370 con 0x7fd8ac15dca0 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fd8a0001670 con 0x7fd8ac15dca0 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 >> v1:172.21.15.55:6789/0 conn(0x7fd8ac15dca0 legacy=0x7fd8ac0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8ab7fe640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd89c0039e0 0x7fd89c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8ab7fe640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 0x7fd89c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8ab7fe640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac0d0f60 0x7fd89c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0d1390 con 0x7fd89c004800 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c00b9c0 con 0x7fd89c0039e0 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c00bb40 con 0x7fd8ac0d0f60 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8abfff640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 0x7fd89c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8b0ca6640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd89c0039e0 0x7fd89c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8b14a7640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac0d0f60 0x7fd89c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8abfff640 1 -- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac0d0f60 msgr2=0x7fd89c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8abfff640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac0d0f60 0x7fd89c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8abfff640 1 -- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd89c0039e0 msgr2=0x7fd89c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8abfff640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd89c0039e0 0x7fd89c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8abfff640 1 -- 172.21.15.55:0/3648014129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c003520 con 0x7fd89c004800 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.232+0000 7fd8b14a7640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac0d0f60 0x7fd89c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.233+0000 7fd8abfff640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 0x7fd89c004c80 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fd898009a90 tx=0x7fd89c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8607c429b7a24585 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.233+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898036070 con 0x7fd89c004800 2024-04-25T09:03:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.233+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898031400 con 0x7fd89c004800 2024-04-25T09:03:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.233+0000 7fd8ab7fe640 1 -- 172.21.15.55:0/3648014129 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898009690 con 0x7fd89c004800 2024-04-25T09:03:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.233+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/3648014129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 msgr2=0x7fd89c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.233+0000 7fd8b2f0a640 1 --2- 172.21.15.55:0/3648014129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 0x7fd89c004c80 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fd898009a90 tx=0x7fd89c005830 comp rx=0 tx=0).stop 2024-04-25T09:03:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.233+0000 7fd8b14a7640 1 -- 172.21.15.55:0/3648014129 reap_dead start 2024-04-25T09:03:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.233+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/3648014129 shutdown_connections 2024-04-25T09:03:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.233+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/3648014129 >> 172.21.15.55:0/3648014129 conn(0x7fd8ac0726c0 msgr2=0x7fd8ac072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.233+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/3648014129 shutdown_connections 2024-04-25T09:03:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.233+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/3648014129 wait complete. 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.235+0000 7fd8b2f0a640 1 Processor -- start 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.235+0000 7fd8b2f0a640 1 -- start start 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b2f0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 0x7fd8ac0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b2f0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac1554b0 0x7fd8ac1f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b2f0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8ac1605d0 0x7fd8ac160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b2f0a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0cf050 con 0x7fd89c004800 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b2f0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b6d50 con 0x7fd8ac1605d0 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b2f0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac15e080 con 0x7fd8ac1554b0 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b0ca6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 0x7fd8ac0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b0ca6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 0x7fd8ac0cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55406/0 (socket says 172.21.15.55:55406) 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b0ca6640 1 -- 172.21.15.55:0/2679661541 learned_addr learned my addr 172.21.15.55:0/2679661541 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8abfff640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac1554b0 0x7fd8ac1f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b14a7640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8ac1605d0 0x7fd8ac160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b0ca6640 1 -- 172.21.15.55:0/2679661541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac1554b0 msgr2=0x7fd8ac1f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b0ca6640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac1554b0 0x7fd8ac1f6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b0ca6640 1 -- 172.21.15.55:0/2679661541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8ac1605d0 msgr2=0x7fd8ac160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b0ca6640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8ac1605d0 0x7fd8ac160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b0ca6640 1 -- 172.21.15.55:0/2679661541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac155930 con 0x7fd89c004800 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b0ca6640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 0x7fd8ac0cab60 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0007310 tx=0x7fd8a00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8a97fa640 1 -- 172.21.15.55:0/2679661541 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000f9c0 con 0x7fd89c004800 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8a97fa640 1 -- 172.21.15.55:0/2679661541 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a0018070 con 0x7fd89c004800 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8a97fa640 1 -- 172.21.15.55:0/2679661541 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000fde0 con 0x7fd89c004800 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/2679661541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ac0cb1f0 con 0x7fd89c004800 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.236+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/2679661541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ac0cb7b0 con 0x7fd89c004800 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.237+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/2679661541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ac073030 con 0x7fd89c004800 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.238+0000 7fd8a97fa640 1 -- 172.21.15.55:0/2679661541 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd8a001d460 con 0x7fd89c004800 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.238+0000 7fd8a97fa640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd89006b4d0 0x7fd89006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.239+0000 7fd8abfff640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd89006b4d0 0x7fd89006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.239+0000 7fd8a97fa640 1 -- 172.21.15.55:0/2679661541 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd8a008a2c0 con 0x7fd89c004800 2024-04-25T09:03:55.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.239+0000 7fd8abfff640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd89006b4d0 0x7fd89006d990 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd898033000 tx=0x7fd898008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.243+0000 7fd8a97fa640 1 -- 172.21.15.55:0/2679661541 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd8ac073030 con 0x7fd89c004800 2024-04-25T09:03:55.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.424+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/2679661541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8ac0750b0 con 0x7fd89c004800 2024-04-25T09:03:55.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.424+0000 7fd8a97fa640 1 -- 172.21.15.55:0/2679661541 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8ac155930 con 0x7fd89c004800 2024-04-25T09:03:55.413 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T09:03:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/2679661541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd89006b4d0 msgr2=0x7fd89006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd89006b4d0 0x7fd89006d990 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd898033000 tx=0x7fd898008030 comp rx=0 tx=0).stop 2024-04-25T09:03:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/2679661541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 msgr2=0x7fd8ac0cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 0x7fd8ac0cab60 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0007310 tx=0x7fd8a00077d0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/2679661541 shutdown_connections 2024-04-25T09:03:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd89006b4d0 0x7fd89006d990 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8ac1605d0 0x7fd8ac160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8ac1554b0 0x7fd8ac1f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 --2- 172.21.15.55:0/2679661541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd89c004800 0x7fd8ac0cab60 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/2679661541 >> 172.21.15.55:0/2679661541 conn(0x7fd8ac0726c0 msgr2=0x7fd8ac0b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:55.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/2679661541 shutdown_connections 2024-04-25T09:03:55.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.426+0000 7fd8b2f0a640 1 -- 172.21.15.55:0/2679661541 wait complete. 2024-04-25T09:03:55.426 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:03:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.540+0000 7feb33a22640 1 Processor -- start 2024-04-25T09:03:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.540+0000 7feb33a22640 1 -- start start 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb33a22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb2c145260 0x7feb2c0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb33a22640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb2c0cc490 0x7feb2c071200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb33a22640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feb2c071740 0x7feb2c15f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb33a22640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2c0cea00 con 0x7feb2c0cc490 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb33a22640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2c0cc9a0 con 0x7feb2c071740 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb33a22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0ccc80 con 0x7feb2c145260 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb30fbd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb2c0cc490 0x7feb2c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb30fbd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb2c0cc490 0x7feb2c071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55412/0 (socket says 172.21.15.55:55412) 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb30fbd640 1 -- 172.21.15.55:0/3497373178 learned_addr learned my addr 172.21.15.55:0/3497373178 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb31fbf640 1 --2- 172.21.15.55:0/3497373178 >> v2:172.21.15.167:3300/0 conn(0x7feb2c071740 0x7feb2c15f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb317be640 1 --2- 172.21.15.55:0/3497373178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb2c145260 0x7feb2c0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb30fbd640 1 -- 172.21.15.55:0/3497373178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb2c145260 msgr2=0x7feb2c0cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb30fbd640 1 --2- 172.21.15.55:0/3497373178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb2c145260 0x7feb2c0cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb30fbd640 1 -- 172.21.15.55:0/3497373178 >> v2:172.21.15.167:3300/0 conn(0x7feb2c071740 msgr2=0x7feb2c15f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb30fbd640 1 --2- 172.21.15.55:0/3497373178 >> v2:172.21.15.167:3300/0 conn(0x7feb2c071740 0x7feb2c15f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.541+0000 7feb30fbd640 1 -- 172.21.15.55:0/3497373178 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c0ccf60 con 0x7feb2c0cc490 2024-04-25T09:03:55.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.542+0000 7feb30fbd640 1 --2- 172.21.15.55:0/3497373178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c0cc490 0x7feb2c071200 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7feb2c1606b0 tx=0x7feb1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93fc3552d670905 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.542+0000 7feb23fff640 1 -- 172.21.15.55:0/3497373178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c037070 con 0x7feb2c0cc490 2024-04-25T09:03:55.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.542+0000 7feb23fff640 1 -- 172.21.15.55:0/3497373178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c032440 con 0x7feb2c0cc490 2024-04-25T09:03:55.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.542+0000 7feb23fff640 1 -- 172.21.15.55:0/3497373178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c032810 con 0x7feb2c0cc490 2024-04-25T09:03:55.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.543+0000 7feb33a22640 1 -- 172.21.15.55:0/3497373178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c0cc490 msgr2=0x7feb2c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.543+0000 7feb33a22640 1 --2- 172.21.15.55:0/3497373178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c0cc490 0x7feb2c071200 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7feb2c1606b0 tx=0x7feb1c02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.543+0000 7feb33a22640 1 -- 172.21.15.55:0/3497373178 shutdown_connections 2024-04-25T09:03:55.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.543+0000 7feb33a22640 1 --2- 172.21.15.55:0/3497373178 >> v2:172.21.15.167:3300/0 conn(0x7feb2c071740 0x7feb2c15f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.543+0000 7feb33a22640 1 --2- 172.21.15.55:0/3497373178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c0cc490 0x7feb2c071200 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.543+0000 7feb33a22640 1 --2- 172.21.15.55:0/3497373178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb2c145260 0x7feb2c0cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.543+0000 7feb33a22640 1 -- 172.21.15.55:0/3497373178 >> 172.21.15.55:0/3497373178 conn(0x7feb2c06aba0 msgr2=0x7feb2c06af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.543+0000 7feb33a22640 1 -- 172.21.15.55:0/3497373178 shutdown_connections 2024-04-25T09:03:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.543+0000 7feb33a22640 1 -- 172.21.15.55:0/3497373178 wait complete. 2024-04-25T09:03:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.544+0000 7feb33a22640 1 Processor -- start 2024-04-25T09:03:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.544+0000 7feb33a22640 1 -- start start 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb33a22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb2c071740 0x7feb2c1408a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb33a22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c0cc490 0x7feb2c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb33a22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb2c145260 0x7feb2c0b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb33a22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c15c270 con 0x7feb2c0cc490 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb33a22640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c145640 con 0x7feb2c071740 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb33a22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c15c3f0 con 0x7feb2c145260 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb30fbd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c0cc490 0x7feb2c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb30fbd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c0cc490 0x7feb2c15b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55422/0 (socket says 172.21.15.55:55422) 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb30fbd640 1 -- 172.21.15.55:0/3671595831 learned_addr learned my addr 172.21.15.55:0/3671595831 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb31fbf640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb2c145260 0x7feb2c0b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb317be640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb2c071740 0x7feb2c1408a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb30fbd640 1 -- 172.21.15.55:0/3671595831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb2c145260 msgr2=0x7feb2c0b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb30fbd640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb2c145260 0x7feb2c0b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb30fbd640 1 -- 172.21.15.55:0/3671595831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb2c071740 msgr2=0x7feb2c1408a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb30fbd640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb2c071740 0x7feb2c1408a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb30fbd640 1 -- 172.21.15.55:0/3671595831 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c13dde0 con 0x7feb2c0cc490 2024-04-25T09:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb30fbd640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c0cc490 0x7feb2c15b300 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7feb1c000c00 tx=0x7feb1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb21ffb640 1 -- 172.21.15.55:0/3671595831 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c041070 con 0x7feb2c0cc490 2024-04-25T09:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb21ffb640 1 -- 172.21.15.55:0/3671595831 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c03c870 con 0x7feb2c0cc490 2024-04-25T09:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb21ffb640 1 -- 172.21.15.55:0/3671595831 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c037040 con 0x7feb2c0cc490 2024-04-25T09:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.545+0000 7feb33a22640 1 -- 172.21.15.55:0/3671595831 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2c1f37d0 con 0x7feb2c0cc490 2024-04-25T09:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.546+0000 7feb33a22640 1 -- 172.21.15.55:0/3671595831 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2c1f34c0 con 0x7feb2c0cc490 2024-04-25T09:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.547+0000 7feb33a22640 1 -- 172.21.15.55:0/3671595831 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2c0750b0 con 0x7feb2c0cc490 2024-04-25T09:03:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.547+0000 7feb21ffb640 1 -- 172.21.15.55:0/3671595831 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feb1c044070 con 0x7feb2c0cc490 2024-04-25T09:03:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.547+0000 7feb21ffb640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb1006b4d0 0x7feb1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.548+0000 7feb21ffb640 1 -- 172.21.15.55:0/3671595831 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7feb1c0aaf90 con 0x7feb2c0cc490 2024-04-25T09:03:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.548+0000 7feb317be640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb1006b4d0 0x7feb1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.548+0000 7feb317be640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb1006b4d0 0x7feb1006d990 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7feb28006fd0 tx=0x7feb28008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.552+0000 7feb21ffb640 1 -- 172.21.15.55:0/3671595831 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feb1c079f60 con 0x7feb2c0cc490 2024-04-25T09:03:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.748+0000 7feb33a22640 1 -- 172.21.15.55:0/3671595831 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feb2c06c220 con 0x7feb2c0cc490 2024-04-25T09:03:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.748+0000 7feb21ffb640 1 -- 172.21.15.55:0/3671595831 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v116) v1 ==== 80+0+122 (secure 0 0 0) 0x7feb1c079860 con 0x7feb2c0cc490 2024-04-25T09:03:55.737 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/4257598582 2024-04-26T09:03:46.638997+0000 2024-04-25T09:03:55.737 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/4257598582 2024-04-26T09:03:46.638997+0000 2024-04-25T09:03:55.737 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-04-25T09:03:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 -- 172.21.15.55:0/3671595831 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb1006b4d0 msgr2=0x7feb1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb1006b4d0 0x7feb1006d990 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7feb28006fd0 tx=0x7feb28008040 comp rx=0 tx=0).stop 2024-04-25T09:03:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 -- 172.21.15.55:0/3671595831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c0cc490 msgr2=0x7feb2c15b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c0cc490 0x7feb2c15b300 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7feb1c000c00 tx=0x7feb1c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 -- 172.21.15.55:0/3671595831 shutdown_connections 2024-04-25T09:03:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7feb1006b4d0 0x7feb1006d990 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb2c145260 0x7feb2c0b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c0cc490 0x7feb2c15b300 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 --2- 172.21.15.55:0/3671595831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb2c071740 0x7feb2c1408a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 -- 172.21.15.55:0/3671595831 >> 172.21.15.55:0/3671595831 conn(0x7feb2c06aba0 msgr2=0x7feb2c15c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:55.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 -- 172.21.15.55:0/3671595831 shutdown_connections 2024-04-25T09:03:55.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.750+0000 7feb33a22640 1 -- 172.21.15.55:0/3671595831 wait complete. 2024-04-25T09:03:55.749 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:03:55.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:55.750 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:55.777 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:03:55.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:55.777 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:03:55.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:55.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.985+0000 7f725e2b3640 1 Processor -- start 2024-04-25T09:03:55.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.985+0000 7f725e2b3640 1 -- start start 2024-04-25T09:03:55.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f725e2b3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f72580d35b0 0x7f72580b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f725e2b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 0x7f72580b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f725e2b3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725815e0c0 con 0x7f725815dce0 2024-04-25T09:03:55.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f725e2b3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72580d2510 con 0x7f72580d35b0 2024-04-25T09:03:55.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f725e2b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580d27f0 con 0x7f72580b5990 2024-04-25T09:03:55.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f725c850640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 0x7f72580b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f72577fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f72580d35b0 0x7f72580b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f7257fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f725815dce0 0x7f72580d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:55584/0 (socket says 172.21.15.55:55584) 2024-04-25T09:03:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f725c850640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 0x7f72580b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:35518/0 (socket says 172.21.15.55:35518) 2024-04-25T09:03:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f7257fff640 1 -- 172.21.15.55:0/1415700722 learned_addr learned my addr 172.21.15.55:0/1415700722 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f72577fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f72580d35b0 0x7f72580b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:51366/0 (socket says 172.21.15.55:51366) 2024-04-25T09:03:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f7256ffd640 1 -- 172.21.15.55:0/1415700722 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906989979 0 0) 0x7f725815e0c0 con 0x7f725815dce0 2024-04-25T09:03:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.986+0000 7f7256ffd640 1 -- 172.21.15.55:0/1415700722 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7240003520 con 0x7f725815dce0 2024-04-25T09:03:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.987+0000 7f72577fe640 1 -- 172.21.15.55:0/1415700722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 msgr2=0x7f72580b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.987+0000 7f72577fe640 1 --2- 172.21.15.55:0/1415700722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 0x7f72580b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.987+0000 7f72577fe640 1 -- 172.21.15.55:0/1415700722 >> v1:172.21.15.167:6789/0 conn(0x7f725815dce0 legacy=0x7f72580d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.987+0000 7f72577fe640 1 -- 172.21.15.55:0/1415700722 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72580d2ad0 con 0x7f72580d35b0 2024-04-25T09:03:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.987+0000 7f725c850640 1 --2- 172.21.15.55:0/1415700722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 0x7f72580b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.987+0000 7f72577fe640 1 --2- 172.21.15.55:0/1415700722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72580d35b0 0x7f72580b5450 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f724c0097a0 tx=0x7f724c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e71fbded8d612e5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.987+0000 7f7256ffd640 1 -- 172.21.15.55:0/1415700722 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c037070 con 0x7f72580d35b0 2024-04-25T09:03:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.988+0000 7f7256ffd640 1 -- 172.21.15.55:0/1415700722 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c032440 con 0x7f72580d35b0 2024-04-25T09:03:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.988+0000 7f7256ffd640 1 -- 172.21.15.55:0/1415700722 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c032810 con 0x7f72580d35b0 2024-04-25T09:03:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.988+0000 7f725e2b3640 1 -- 172.21.15.55:0/1415700722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72580d35b0 msgr2=0x7f72580b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.988+0000 7f725e2b3640 1 --2- 172.21.15.55:0/1415700722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72580d35b0 0x7f72580b5450 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f724c0097a0 tx=0x7f724c02a180 comp rx=0 tx=0).stop 2024-04-25T09:03:55.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.988+0000 7f725e2b3640 1 -- 172.21.15.55:0/1415700722 shutdown_connections 2024-04-25T09:03:55.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.988+0000 7f725e2b3640 1 --2- 172.21.15.55:0/1415700722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 0x7f72580b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.988+0000 7f725e2b3640 1 --2- 172.21.15.55:0/1415700722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72580d35b0 0x7f72580b5450 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.988+0000 7f725e2b3640 1 -- 172.21.15.55:0/1415700722 >> 172.21.15.55:0/1415700722 conn(0x7f7258072900 msgr2=0x7f72580d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:55.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.988+0000 7f725e2b3640 1 -- 172.21.15.55:0/1415700722 shutdown_connections 2024-04-25T09:03:55.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.988+0000 7f725e2b3640 1 -- 172.21.15.55:0/1415700722 wait complete. 2024-04-25T09:03:55.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.989+0000 7f725e2b3640 1 Processor -- start 2024-04-25T09:03:55.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.989+0000 7f725e2b3640 1 -- start start 2024-04-25T09:03:55.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.990+0000 7f725e2b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 0x7f7258156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.990+0000 7f725e2b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72580d35b0 0x7f72580b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.990+0000 7f725e2b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f725815dce0 0x7f72581f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.990+0000 7f725e2b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580d2160 con 0x7f72580d35b0 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.990+0000 7f725e2b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580d3090 con 0x7f725815dce0 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.990+0000 7f725e2b3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72581573e0 con 0x7f72580b5990 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.990+0000 7f72577fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72580d35b0 0x7f72580b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.990+0000 7f72577fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72580d35b0 0x7f72580b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55434/0 (socket says 172.21.15.55:55434) 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.990+0000 7f72577fe640 1 -- 172.21.15.55:0/1288654807 learned_addr learned my addr 172.21.15.55:0/1288654807 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.990+0000 7f7257fff640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 0x7f7258156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.990+0000 7f725c850640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f725815dce0 0x7f72581f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.991+0000 7f72577fe640 1 -- 172.21.15.55:0/1288654807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 msgr2=0x7f7258156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.991+0000 7f72577fe640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 0x7f7258156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.991+0000 7f72577fe640 1 -- 172.21.15.55:0/1288654807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f725815dce0 msgr2=0x7f72581f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.991+0000 7f72577fe640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f725815dce0 0x7f72581f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.991+0000 7f72577fe640 1 -- 172.21.15.55:0/1288654807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7258157be0 con 0x7f72580d35b0 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.991+0000 7f72577fe640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72580d35b0 0x7f72580b1c30 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f724c035040 tx=0x7f724c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.991+0000 7f7254ff9640 1 -- 172.21.15.55:0/1288654807 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c041030 con 0x7f72580d35b0 2024-04-25T09:03:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.991+0000 7f7254ff9640 1 -- 172.21.15.55:0/1288654807 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c03d420 con 0x7f72580d35b0 2024-04-25T09:03:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.991+0000 7f725e2b3640 1 -- 172.21.15.55:0/1288654807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7258157ec0 con 0x7f72580d35b0 2024-04-25T09:03:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.991+0000 7f7254ff9640 1 -- 172.21.15.55:0/1288654807 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c037040 con 0x7f72580d35b0 2024-04-25T09:03:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.991+0000 7f725e2b3640 1 -- 172.21.15.55:0/1288654807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7258158480 con 0x7f72580d35b0 2024-04-25T09:03:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.992+0000 7f725e2b3640 1 -- 172.21.15.55:0/1288654807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72580749b0 con 0x7f72580d35b0 2024-04-25T09:03:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.993+0000 7f7254ff9640 1 -- 172.21.15.55:0/1288654807 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f724c044070 con 0x7f72580d35b0 2024-04-25T09:03:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.993+0000 7f7254ff9640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f724406b4d0 0x7f724406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.993+0000 7f7254ff9640 1 -- 172.21.15.55:0/1288654807 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f724c0aa890 con 0x7f72580d35b0 2024-04-25T09:03:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.993+0000 7f7257fff640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f724406b4d0 0x7f724406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.994+0000 7f7257fff640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f724406b4d0 0x7f724406d990 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7248005880 tx=0x7f7248009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:55.997+0000 7f7254ff9640 1 -- 172.21.15.55:0/1288654807 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f724c0797e0 con 0x7f72580d35b0 2024-04-25T09:03:56.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.217+0000 7f725e2b3640 1 -- 172.21.15.55:0/1288654807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72580b8b80 con 0x7f72580d35b0 2024-04-25T09:03:56.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.217+0000 7f7254ff9640 1 -- 172.21.15.55:0/1288654807 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f724c0790e0 con 0x7f72580d35b0 2024-04-25T09:03:56.206 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:56.206 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:03:49.659242+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9177":{"gid":9177,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/3667784674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3667784674},{"type":"v1","addr":"172.21.15.55:6837","nonce":3667784674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:03:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 92 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 -- 172.21.15.55:0/1288654807 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f724406b4d0 msgr2=0x7f724406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f724406b4d0 0x7f724406d990 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7248005880 tx=0x7f7248009040 comp rx=0 tx=0).stop 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 -- 172.21.15.55:0/1288654807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72580d35b0 msgr2=0x7f72580b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72580d35b0 0x7f72580b1c30 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f724c035040 tx=0x7f724c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 -- 172.21.15.55:0/1288654807 shutdown_connections 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f724406b4d0 0x7f724406d990 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f725815dce0 0x7f72581f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72580d35b0 0x7f72580b1c30 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 --2- 172.21.15.55:0/1288654807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72580b5990 0x7f7258156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 -- 172.21.15.55:0/1288654807 >> 172.21.15.55:0/1288654807 conn(0x7f7258072900 msgr2=0x7f72580b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 -- 172.21.15.55:0/1288654807 shutdown_connections 2024-04-25T09:03:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.219+0000 7f725e2b3640 1 -- 172.21.15.55:0/1288654807 wait complete. 2024-04-25T09:03:56.218 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parent mytag123 2024-04-25T09:03:56.341 INFO:teuthology.orchestra.run.smithi055.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-04-25T09:03:56.341 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-04-25T09:03:56.342 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000003.00000000 scrub_tag 2024-04-25T09:03:56.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.396+0000 7f9278920f40 1 Processor -- start 2024-04-25T09:03:56.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.396+0000 7f9278920f40 1 -- start start 2024-04-25T09:03:56.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9278920f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9260002820 0x55f2a413a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9278920f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a41ca380 0x55f2a41aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9278920f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f2a40f5b90 0x55f2a40f6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9278920f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a413dea0 con 0x55f2a40f5b90 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9278920f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a409adf0 con 0x55f2a41ca380 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9278920f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2a413e140 con 0x7f9260002820 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9276307640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f2a40f5b90 0x55f2a40f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9276307640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f2a40f5b90 0x55f2a40f6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55452/0 (socket says 172.21.15.55:55452) 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9276307640 1 -- 172.21.15.55:0/3186218861 learned_addr learned my addr 172.21.15.55:0/3186218861 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9275305640 1 --2- 172.21.15.55:0/3186218861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a41ca380 0x55f2a41aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9275b06640 1 --2- 172.21.15.55:0/3186218861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9260002820 0x55f2a413a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9276307640 1 -- 172.21.15.55:0/3186218861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9260002820 msgr2=0x55f2a413a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9276307640 1 --2- 172.21.15.55:0/3186218861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9260002820 0x55f2a413a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9276307640 1 -- 172.21.15.55:0/3186218861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a41ca380 msgr2=0x55f2a41aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.397+0000 7f9276307640 1 --2- 172.21.15.55:0/3186218861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a41ca380 0x55f2a41aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9276307640 1 -- 172.21.15.55:0/3186218861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2a4020c50 con 0x55f2a40f5b90 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9275305640 1 --2- 172.21.15.55:0/3186218861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a41ca380 0x55f2a41aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9276307640 1 --2- 172.21.15.55:0/3186218861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f2a40f5b90 0x55f2a40f6010 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x55f2a40f7090 tx=0x7f9270005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f40d47c7579e5ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9267fff640 1 -- 172.21.15.55:0/3186218861 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927001b070 con 0x55f2a40f5b90 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9267fff640 1 -- 172.21.15.55:0/3186218861 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9270015630 con 0x55f2a40f5b90 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9267fff640 1 -- 172.21.15.55:0/3186218861 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270015a00 con 0x55f2a40f5b90 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9278920f40 1 -- 172.21.15.55:0/3186218861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f2a40f5b90 msgr2=0x55f2a40f6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9278920f40 1 --2- 172.21.15.55:0/3186218861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f2a40f5b90 0x55f2a40f6010 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x55f2a40f7090 tx=0x7f9270005a00 comp rx=0 tx=0).stop 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9278920f40 1 -- 172.21.15.55:0/3186218861 shutdown_connections 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9278920f40 1 --2- 172.21.15.55:0/3186218861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f2a40f5b90 0x55f2a40f6010 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9278920f40 1 --2- 172.21.15.55:0/3186218861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a41ca380 0x55f2a41aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9278920f40 1 --2- 172.21.15.55:0/3186218861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9260002820 0x55f2a413a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9278920f40 1 -- 172.21.15.55:0/3186218861 >> 172.21.15.55:0/3186218861 conn(0x55f2a411e3d0 msgr2=0x55f2a411d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9278920f40 1 -- 172.21.15.55:0/3186218861 shutdown_connections 2024-04-25T09:03:56.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.398+0000 7f9278920f40 1 -- 172.21.15.55:0/3186218861 wait complete. 2024-04-25T09:03:56.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.399+0000 7f9278920f40 1 Processor -- start 2024-04-25T09:03:56.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.399+0000 7f9278920f40 1 -- start start 2024-04-25T09:03:56.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9278920f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a40f5b90 0x55f2a41c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9278920f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f2a41ca380 0x55f2a41c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9278920f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260002820 0x55f2a425bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9278920f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a41ab4c0 con 0x7f9260002820 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9278920f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a41b4df0 con 0x55f2a40f5b90 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9278920f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2a41b4b10 con 0x55f2a41ca380 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9276307640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260002820 0x55f2a425bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9276307640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260002820 0x55f2a425bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55464/0 (socket says 172.21.15.55:55464) 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9276307640 1 -- 172.21.15.55:0/3828922162 learned_addr learned my addr 172.21.15.55:0/3828922162 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9275305640 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f2a41ca380 0x55f2a41c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9275b06640 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a40f5b90 0x55f2a41c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9276307640 1 -- 172.21.15.55:0/3828922162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f2a41ca380 msgr2=0x55f2a41c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9276307640 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f2a41ca380 0x55f2a41c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9276307640 1 -- 172.21.15.55:0/3828922162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a40f5b90 msgr2=0x55f2a41c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9276307640 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f2a40f5b90 0x55f2a41c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9276307640 1 -- 172.21.15.55:0/3828922162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2a425a1c0 con 0x7f9260002820 2024-04-25T09:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9276307640 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260002820 0x55f2a425bce0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f9270005400 tx=0x7f9270002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9266ffd640 1 -- 172.21.15.55:0/3828922162 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927001b040 con 0x7f9260002820 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9266ffd640 1 -- 172.21.15.55:0/3828922162 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9270025070 con 0x7f9260002820 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9266ffd640 1 -- 172.21.15.55:0/3828922162 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270007680 con 0x7f9260002820 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.400+0000 7f9278920f40 1 -- 172.21.15.55:0/3828922162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2a4259a70 con 0x7f9260002820 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.401+0000 7f9278920f40 1 -- 172.21.15.55:0/3828922162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2a41b40b0 con 0x7f9260002820 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.402+0000 7f9266ffd640 1 -- 172.21.15.55:0/3828922162 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f927001e070 con 0x7f9260002820 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.402+0000 7f9266ffd640 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9258069ee0 0x7f925806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.402+0000 7f9266ffd640 1 -- 172.21.15.55:0/3828922162 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9270089c90 con 0x7f9260002820 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.402+0000 7f9275b06640 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9258069ee0 0x7f925806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.402+0000 7f9278920f40 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55f2a41ad6a0 0x55f2a41a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.402+0000 7f9278920f40 1 -- 172.21.15.55:0/3828922162 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:1 17.32 17:4def72d4:::10000000003.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e116) v9 -- 0x55f2a41a98a0 con 0x55f2a41ad6a0 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.403+0000 7f9275305640 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55f2a41ad6a0 0x55f2a41a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.403+0000 7f9275b06640 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9258069ee0 0x7f925806c3a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55f2a425cda0 tx=0x7f9268007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.403+0000 7f9275305640 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55f2a41ad6a0 0x55f2a41a9360 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.403+0000 7f9275305640 1 -- 172.21.15.55:0/3828922162 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== osd_op_reply(1 10000000003.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f926c001430 con 0x55f2a41ad6a0 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:error getting xattr cephfs_data/10000000003.00000000/scrub_tag: (61) No data available 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.403+0000 7f9278920f40 1 -- 172.21.15.55:0/3828922162 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55f2a41ad6a0 msgr2=0x55f2a41a9360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.404+0000 7f9278920f40 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55f2a41ad6a0 0x55f2a41a9360 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.404+0000 7f9278920f40 1 -- 172.21.15.55:0/3828922162 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9258069ee0 msgr2=0x7f925806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.404+0000 7f9278920f40 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9258069ee0 0x7f925806c3a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55f2a425cda0 tx=0x7f9268007040 comp rx=0 tx=0).stop 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.404+0000 7f9278920f40 1 -- 172.21.15.55:0/3828922162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260002820 msgr2=0x55f2a425bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.404+0000 7f9278920f40 1 --2- 172.21.15.55:0/3828922162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260002820 0x55f2a425bce0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f9270005400 tx=0x7f9270002fb0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.404+0000 7f9276307640 1 -- 172.21.15.55:0/3828922162 reap_dead start 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.404+0000 7f9278920f40 1 -- 172.21.15.55:0/3828922162 shutdown_connections 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.404+0000 7f9278920f40 1 -- 172.21.15.55:0/3828922162 >> 172.21.15.55:0/3828922162 conn(0x55f2a411e3d0 msgr2=0x55f2a40f48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.404+0000 7f9278920f40 1 -- 172.21.15.55:0/3828922162 shutdown_connections 2024-04-25T09:03:56.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.404+0000 7f9278920f40 1 -- 172.21.15.55:0/3828922162 wait complete. 2024-04-25T09:03:56.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:56.398 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T09:03:56.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.493+0000 7f825d087f40 1 Processor -- start 2024-04-25T09:03:56.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.493+0000 7f825d087f40 1 -- start start 2024-04-25T09:03:56.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825d087f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8244003630 0x55dfc5ee0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825d087f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dfc5e382f0 0x55dfc5f742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825d087f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dfc5e386d0 0x55dfc5f74830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825d087f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5ee2c00 con 0x55dfc5e382f0 2024-04-25T09:03:56.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825d087f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5db3df0 con 0x7f8244003630 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825d087f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5ee2d80 con 0x55dfc5e386d0 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825a387640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dfc5e382f0 0x55dfc5f742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825a387640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dfc5e382f0 0x55dfc5f742f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55482/0 (socket says 172.21.15.55:55482) 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825a387640 1 -- 172.21.15.55:0/1315227411 learned_addr learned my addr 172.21.15.55:0/1315227411 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825ab88640 1 --2- 172.21.15.55:0/1315227411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8244003630 0x55dfc5ee0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825b389640 1 --2- 172.21.15.55:0/1315227411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dfc5e386d0 0x55dfc5f74830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825a387640 1 -- 172.21.15.55:0/1315227411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dfc5e386d0 msgr2=0x55dfc5f74830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825a387640 1 --2- 172.21.15.55:0/1315227411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dfc5e386d0 0x55dfc5f74830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825a387640 1 -- 172.21.15.55:0/1315227411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8244003630 msgr2=0x55dfc5ee0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825a387640 1 --2- 172.21.15.55:0/1315227411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8244003630 0x55dfc5ee0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825a387640 1 -- 172.21.15.55:0/1315227411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfc5d39c50 con 0x55dfc5e382f0 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825ab88640 1 --2- 172.21.15.55:0/1315227411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8244003630 0x55dfc5ee0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.494+0000 7f825b389640 1 --2- 172.21.15.55:0/1315227411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dfc5e386d0 0x55dfc5f74830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:56.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f825a387640 1 --2- 172.21.15.55:0/1315227411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dfc5e382f0 0x55dfc5f742f0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f8250009910 tx=0x7f8250009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd77a8007f91a12e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f8259385640 1 -- 172.21.15.55:0/1315227411 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000eb60 con 0x55dfc5e382f0 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f8259385640 1 -- 172.21.15.55:0/1315227411 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8250013030 con 0x55dfc5e382f0 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f8259385640 1 -- 172.21.15.55:0/1315227411 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000f450 con 0x55dfc5e382f0 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f825d087f40 1 -- 172.21.15.55:0/1315227411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dfc5e382f0 msgr2=0x55dfc5f742f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f825d087f40 1 --2- 172.21.15.55:0/1315227411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dfc5e382f0 0x55dfc5f742f0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f8250009910 tx=0x7f8250009dd0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f825d087f40 1 -- 172.21.15.55:0/1315227411 shutdown_connections 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f825d087f40 1 --2- 172.21.15.55:0/1315227411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dfc5e386d0 0x55dfc5f74830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f825d087f40 1 --2- 172.21.15.55:0/1315227411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dfc5e382f0 0x55dfc5f742f0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f825d087f40 1 --2- 172.21.15.55:0/1315227411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8244003630 0x55dfc5ee0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f825d087f40 1 -- 172.21.15.55:0/1315227411 >> 172.21.15.55:0/1315227411 conn(0x55dfc5e373d0 msgr2=0x55dfc5e3cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f825d087f40 1 -- 172.21.15.55:0/1315227411 shutdown_connections 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.495+0000 7f825d087f40 1 -- 172.21.15.55:0/1315227411 wait complete. 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.496+0000 7f825d087f40 1 Processor -- start 2024-04-25T09:03:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.496+0000 7f825d087f40 1 -- start start 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825d087f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dfc5e382f0 0x55dfc5ed7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825d087f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc5e386d0 0x55dfc5ee02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825d087f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8244003630 0x55dfc5edaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825d087f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5e0e990 con 0x7f8244003630 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825d087f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5edc920 con 0x55dfc5e386d0 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825d087f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5ed8540 con 0x55dfc5e382f0 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825b389640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8244003630 0x55dfc5edaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825b389640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8244003630 0x55dfc5edaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55494/0 (socket says 172.21.15.55:55494) 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825b389640 1 -- 172.21.15.55:0/4016584231 learned_addr learned my addr 172.21.15.55:0/4016584231 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825ab88640 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dfc5e382f0 0x55dfc5ed7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825a387640 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc5e386d0 0x55dfc5ee02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825b389640 1 -- 172.21.15.55:0/4016584231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dfc5e382f0 msgr2=0x55dfc5ed7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825b389640 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dfc5e382f0 0x55dfc5ed7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825b389640 1 -- 172.21.15.55:0/4016584231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc5e386d0 msgr2=0x55dfc5ee02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825b389640 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc5e386d0 0x55dfc5ee02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825b389640 1 -- 172.21.15.55:0/4016584231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfc5ee47e0 con 0x7f8244003630 2024-04-25T09:03:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825b389640 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8244003630 0x55dfc5edaeb0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f824c058040 tx=0x7f824c0033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f8243fff640 1 -- 172.21.15.55:0/4016584231 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c068070 con 0x7f8244003630 2024-04-25T09:03:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f8243fff640 1 -- 172.21.15.55:0/4016584231 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c05b040 con 0x7f8244003630 2024-04-25T09:03:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f825d087f40 1 -- 172.21.15.55:0/4016584231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dfc5eda3d0 con 0x7f8244003630 2024-04-25T09:03:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.497+0000 7f8243fff640 1 -- 172.21.15.55:0/4016584231 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c05a070 con 0x7f8244003630 2024-04-25T09:03:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.498+0000 7f825d087f40 1 -- 172.21.15.55:0/4016584231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dfc5eda990 con 0x7f8244003630 2024-04-25T09:03:56.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.499+0000 7f8243fff640 1 -- 172.21.15.55:0/4016584231 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f824c06b070 con 0x7f8244003630 2024-04-25T09:03:56.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.499+0000 7f8243fff640 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8248069eb0 0x7f824806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.499+0000 7f8243fff640 1 -- 172.21.15.55:0/4016584231 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f824c0cc2c0 con 0x7f8244003630 2024-04-25T09:03:56.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.499+0000 7f825ab88640 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8248069eb0 0x7f824806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.499+0000 7f825d087f40 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55dfc5ed5500 0x55dfc5f795d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.499+0000 7f825d087f40 1 -- 172.21.15.55:0/4016584231 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:1 17.12 17:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e116) v9 -- 0x55dfc5ee07f0 con 0x55dfc5ed5500 2024-04-25T09:03:56.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825a387640 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55dfc5ed5500 0x55dfc5f795d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825ab88640 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8248069eb0 0x7f824806c370 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8254005cf0 tx=0x7f825400c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825a387640 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55dfc5ed5500 0x55dfc5f795d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825a387640 1 -- 172.21.15.55:0/4016584231 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f825000e9e0 con 0x55dfc5ed5500 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825d087f40 1 -- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55dfc5ed5500 msgr2=0x55dfc5f795d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825d087f40 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55dfc5ed5500 0x55dfc5f795d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825d087f40 1 -- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8248069eb0 msgr2=0x7f824806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825d087f40 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8248069eb0 0x7f824806c370 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8254005cf0 tx=0x7f825400c040 comp rx=0 tx=0).stop 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825d087f40 1 -- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8244003630 msgr2=0x55dfc5edaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825d087f40 1 --2- 172.21.15.55:0/4016584231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8244003630 0x55dfc5edaeb0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f824c058040 tx=0x7f824c0033a0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825b389640 1 -- 172.21.15.55:0/4016584231 reap_dead start 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825d087f40 1 -- 172.21.15.55:0/4016584231 shutdown_connections 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.500+0000 7f825d087f40 1 -- 172.21.15.55:0/4016584231 >> 172.21.15.55:0/4016584231 conn(0x55dfc5e373d0 msgr2=0x55dfc5e3cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.501+0000 7f825d087f40 1 -- 172.21.15.55:0/4016584231 shutdown_connections 2024-04-25T09:03:56.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.501+0000 7f825d087f40 1 -- 172.21.15.55:0/4016584231 wait complete. 2024-04-25T09:03:56.494 INFO:teuthology.orchestra.run.smithi055.stdout:mytag123 2024-04-25T09:03:56.495 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-04-25T09:03:56.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.591+0000 7f81b5c75f40 1 Processor -- start 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.591+0000 7f81b5c75f40 1 -- start start 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.591+0000 7f81b5c75f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 0x56303538be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.591+0000 7f81b5c75f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563035305f50 0x563035388a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.591+0000 7f81b5c75f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56303538cd70 0x563035394260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.591+0000 7f81b5c75f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630352ed530 con 0x7f81a0002890 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.591+0000 7f81b5c75f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563035265df0 con 0x563035305f50 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.591+0000 7f81b5c75f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630352ed7d0 con 0x56303538cd70 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b3776640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 0x56303538be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b3776640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 0x56303538be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55504/0 (socket says 172.21.15.55:55504) 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b3776640 1 -- 172.21.15.55:0/3853625759 learned_addr learned my addr 172.21.15.55:0/3853625759 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b3f77640 1 --2- 172.21.15.55:0/3853625759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56303538cd70 0x563035394260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b2f75640 1 --2- 172.21.15.55:0/3853625759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563035305f50 0x563035388a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b3776640 1 -- 172.21.15.55:0/3853625759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56303538cd70 msgr2=0x563035394260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b3776640 1 --2- 172.21.15.55:0/3853625759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56303538cd70 0x563035394260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b3776640 1 -- 172.21.15.55:0/3853625759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563035305f50 msgr2=0x563035388a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b3776640 1 --2- 172.21.15.55:0/3853625759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563035305f50 0x563035388a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b3776640 1 -- 172.21.15.55:0/3853625759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630351ebc50 con 0x7f81a0002890 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b3776640 1 --2- 172.21.15.55:0/3853625759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 0x56303538be40 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009780 tx=0x7f81ac009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d008ac02954d67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b1f73640 1 -- 172.21.15.55:0/3853625759 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00ebc0 con 0x7f81a0002890 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b1f73640 1 -- 172.21.15.55:0/3853625759 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac013030 con 0x7f81a0002890 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.592+0000 7f81b1f73640 1 -- 172.21.15.55:0/3853625759 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00f450 con 0x7f81a0002890 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.593+0000 7f81b5c75f40 1 -- 172.21.15.55:0/3853625759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 msgr2=0x56303538be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.593+0000 7f81b5c75f40 1 --2- 172.21.15.55:0/3853625759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 0x56303538be40 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009780 tx=0x7f81ac009c40 comp rx=0 tx=0).stop 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.593+0000 7f81b5c75f40 1 -- 172.21.15.55:0/3853625759 shutdown_connections 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.593+0000 7f81b5c75f40 1 --2- 172.21.15.55:0/3853625759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56303538cd70 0x563035394260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.593+0000 7f81b5c75f40 1 --2- 172.21.15.55:0/3853625759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563035305f50 0x563035388a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.593+0000 7f81b5c75f40 1 --2- 172.21.15.55:0/3853625759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 0x56303538be40 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.593+0000 7f81b5c75f40 1 -- 172.21.15.55:0/3853625759 >> 172.21.15.55:0/3853625759 conn(0x5630352e93d0 msgr2=0x563035393170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.593+0000 7f81b5c75f40 1 -- 172.21.15.55:0/3853625759 shutdown_connections 2024-04-25T09:03:56.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.593+0000 7f81b5c75f40 1 -- 172.21.15.55:0/3853625759 wait complete. 2024-04-25T09:03:56.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.593+0000 7f81b5c75f40 1 Processor -- start 2024-04-25T09:03:56.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.593+0000 7f81b5c75f40 1 -- start start 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b5c75f40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563035305f50 0x563035394220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b5c75f40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56303538cd70 0x563035395e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b5c75f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 0x5630353850c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b5c75f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630352ef340 con 0x7f81a0002890 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b5c75f40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630352ef060 con 0x563035305f50 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b5c75f40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630352ed270 con 0x56303538cd70 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b3f77640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 0x5630353850c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b3f77640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 0x5630353850c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55508/0 (socket says 172.21.15.55:55508) 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b3f77640 1 -- 172.21.15.55:0/1963218036 learned_addr learned my addr 172.21.15.55:0/1963218036 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b3776640 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563035305f50 0x563035394220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b2f75640 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56303538cd70 0x563035395e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b3f77640 1 -- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56303538cd70 msgr2=0x563035395e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b3f77640 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56303538cd70 0x563035395e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b3f77640 1 -- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563035305f50 msgr2=0x563035394220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b3f77640 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563035305f50 0x563035394220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b3f77640 1 -- 172.21.15.55:0/1963218036 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563035394800 con 0x7f81a0002890 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.594+0000 7f81b2f75640 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56303538cd70 0x563035395e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.595+0000 7f81b3f77640 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 0x5630353850c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x5630352ed460 tx=0x7f81a4010630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.595+0000 7f81b0f71640 1 -- 172.21.15.55:0/1963218036 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4014440 con 0x7f81a0002890 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.595+0000 7f81b0f71640 1 -- 172.21.15.55:0/1963218036 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a4014600 con 0x7f81a0002890 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.595+0000 7f81b5c75f40 1 -- 172.21.15.55:0/1963218036 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5630352c0b90 con 0x7f81a0002890 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.595+0000 7f81b0f71640 1 -- 172.21.15.55:0/1963218036 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a40149f0 con 0x7f81a0002890 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.595+0000 7f81b5c75f40 1 -- 172.21.15.55:0/1963218036 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630352c1150 con 0x7f81a0002890 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.596+0000 7f81b0f71640 1 -- 172.21.15.55:0/1963218036 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f81a4014b90 con 0x7f81a0002890 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.596+0000 7f81b0f71640 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8194069eb0 0x7f819406c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.597+0000 7f81b0f71640 1 -- 172.21.15.55:0/1963218036 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f81a4089670 con 0x7f81a0002890 2024-04-25T09:03:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.597+0000 7f81b3776640 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8194069eb0 0x7f819406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.597+0000 7f81b5c75f40 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x56303538f460 0x56303538f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.597+0000 7f81b5c75f40 1 -- 172.21.15.55:0/1963218036 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:1 17.5 17:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e116) v9 -- 0x56303538fd80 con 0x56303538f460 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.597+0000 7f81b2f75640 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x56303538f460 0x56303538f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.597+0000 7f81b3776640 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8194069eb0 0x7f819406c370 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x563035308250 tx=0x7f81ac005000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.597+0000 7f81b2f75640 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x56303538f460 0x56303538f840 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b2f75640 1 -- 172.21.15.55:0/1963218036 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f819c00a040 con 0x56303538f460 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b5c75f40 1 -- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x56303538f460 msgr2=0x56303538f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b5c75f40 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x56303538f460 0x56303538f840 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b5c75f40 1 -- 172.21.15.55:0/1963218036 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8194069eb0 msgr2=0x7f819406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b5c75f40 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8194069eb0 0x7f819406c370 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x563035308250 tx=0x7f81ac005000 comp rx=0 tx=0).stop 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b5c75f40 1 -- 172.21.15.55:0/1963218036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 msgr2=0x5630353850c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b5c75f40 1 --2- 172.21.15.55:0/1963218036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a0002890 0x5630353850c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x5630352ed460 tx=0x7f81a4010630 comp rx=0 tx=0).stop 2024-04-25T09:03:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b3f77640 1 -- 172.21.15.55:0/1963218036 reap_dead start 2024-04-25T09:03:56.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b5c75f40 1 -- 172.21.15.55:0/1963218036 shutdown_connections 2024-04-25T09:03:56.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b5c75f40 1 -- 172.21.15.55:0/1963218036 >> 172.21.15.55:0/1963218036 conn(0x5630352e93d0 msgr2=0x563035393170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b5c75f40 1 -- 172.21.15.55:0/1963218036 shutdown_connections 2024-04-25T09:03:56.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.598+0000 7f81b5c75f40 1 -- 172.21.15.55:0/1963218036 wait complete. 2024-04-25T09:03:56.591 INFO:teuthology.orchestra.run.smithi055.stdout:mytag123 2024-04-25T09:03:56.592 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000006.00000000 scrub_tag 2024-04-25T09:03:56.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.687+0000 7fe63811ff40 1 Processor -- start 2024-04-25T09:03:56.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.687+0000 7fe63811ff40 1 -- start start 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.687+0000 7fe63811ff40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bbce47880 0x555bbcee1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.687+0000 7fe63811ff40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555bbceeab60 0x555bbceef2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63811ff40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceed5e0 0x555bbceef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63811ff40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbceee860 con 0x555bbceed5e0 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63811ff40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbcdbedf0 con 0x555bbce47880 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63811ff40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x555bbceee9e0 con 0x555bbceeab60 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63599b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceed5e0 0x555bbceef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63519a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bbce47880 0x555bbcee1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63599b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceed5e0 0x555bbceef7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55532/0 (socket says 172.21.15.55:55532) 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63599b640 1 -- 172.21.15.55:0/4064306572 learned_addr learned my addr 172.21.15.55:0/4064306572 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe634999640 1 --2- 172.21.15.55:0/4064306572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555bbceeab60 0x555bbceef2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63599b640 1 -- 172.21.15.55:0/4064306572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555bbceeab60 msgr2=0x555bbceef2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63599b640 1 --2- 172.21.15.55:0/4064306572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555bbceeab60 0x555bbceef2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63599b640 1 -- 172.21.15.55:0/4064306572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bbce47880 msgr2=0x555bbcee1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63599b640 1 --2- 172.21.15.55:0/4064306572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bbce47880 0x555bbcee1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63599b640 1 -- 172.21.15.55:0/4064306572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bbcd44c50 con 0x555bbceed5e0 2024-04-25T09:03:56.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.688+0000 7fe63599b640 1 --2- 172.21.15.55:0/4064306572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceed5e0 0x555bbceef7e0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fe6300015f0 tx=0x7fe630001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89032b423a0f9f29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.690+0000 7fe6277fe640 1 -- 172.21.15.55:0/4064306572 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630003650 con 0x555bbceed5e0 2024-04-25T09:03:56.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.690+0000 7fe6277fe640 1 -- 172.21.15.55:0/4064306572 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6300037f0 con 0x555bbceed5e0 2024-04-25T09:03:56.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.690+0000 7fe6277fe640 1 -- 172.21.15.55:0/4064306572 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630003c20 con 0x555bbceed5e0 2024-04-25T09:03:56.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.691+0000 7fe63811ff40 1 -- 172.21.15.55:0/4064306572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceed5e0 msgr2=0x555bbceef7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.691+0000 7fe63811ff40 1 --2- 172.21.15.55:0/4064306572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceed5e0 0x555bbceef7e0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fe6300015f0 tx=0x7fe630001ab0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.691+0000 7fe63811ff40 1 -- 172.21.15.55:0/4064306572 shutdown_connections 2024-04-25T09:03:56.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.691+0000 7fe63811ff40 1 --2- 172.21.15.55:0/4064306572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceed5e0 0x555bbceef7e0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.691+0000 7fe63811ff40 1 --2- 172.21.15.55:0/4064306572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555bbceeab60 0x555bbceef2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.691+0000 7fe63811ff40 1 --2- 172.21.15.55:0/4064306572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bbce47880 0x555bbcee1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.691+0000 7fe63811ff40 1 -- 172.21.15.55:0/4064306572 >> 172.21.15.55:0/4064306572 conn(0x555bbce423d0 msgr2=0x555bbce41660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.691+0000 7fe63811ff40 1 -- 172.21.15.55:0/4064306572 shutdown_connections 2024-04-25T09:03:56.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.691+0000 7fe63811ff40 1 -- 172.21.15.55:0/4064306572 wait complete. 2024-04-25T09:03:56.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.691+0000 7fe63811ff40 1 Processor -- start 2024-04-25T09:03:56.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.691+0000 7fe63811ff40 1 -- start start 2024-04-25T09:03:56.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe63811ff40 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555bbce47880 0x555bbce19fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe63811ff40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceeab60 0x555bbcee0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe63811ff40 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bbceed5e0 0x555bbce467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe63811ff40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbceefd20 con 0x555bbceeab60 2024-04-25T09:03:56.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe63811ff40 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbceea030 con 0x555bbceed5e0 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe63811ff40 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x555bbcee7c00 con 0x555bbce47880 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe634999640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceeab60 0x555bbcee0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe634999640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceeab60 0x555bbcee0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55536/0 (socket says 172.21.15.55:55536) 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe634999640 1 -- 172.21.15.55:0/1355476592 learned_addr learned my addr 172.21.15.55:0/1355476592 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe63519a640 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555bbce47880 0x555bbce19fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe63599b640 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bbceed5e0 0x555bbce467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.692+0000 7fe634999640 1 -- 172.21.15.55:0/1355476592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555bbce47880 msgr2=0x555bbce19fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.693+0000 7fe634999640 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555bbce47880 0x555bbce19fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.693+0000 7fe634999640 1 -- 172.21.15.55:0/1355476592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bbceed5e0 msgr2=0x555bbce467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.693+0000 7fe634999640 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bbceed5e0 0x555bbce467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.693+0000 7fe634999640 1 -- 172.21.15.55:0/1355476592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bbcee4690 con 0x555bbceeab60 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.693+0000 7fe63599b640 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bbceed5e0 0x555bbce467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.693+0000 7fe634999640 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceeab60 0x555bbcee0e10 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009f50 tx=0x7fe62c009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.693+0000 7fe6267fc640 1 -- 172.21.15.55:0/1355476592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c015460 con 0x555bbceeab60 2024-04-25T09:03:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.693+0000 7fe6267fc640 1 -- 172.21.15.55:0/1355476592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c01a070 con 0x555bbceeab60 2024-04-25T09:03:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.693+0000 7fe63811ff40 1 -- 172.21.15.55:0/1355476592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555bbcee6e30 con 0x555bbceeab60 2024-04-25T09:03:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.693+0000 7fe6267fc640 1 -- 172.21.15.55:0/1355476592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c015820 con 0x555bbceeab60 2024-04-25T09:03:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.693+0000 7fe63811ff40 1 -- 172.21.15.55:0/1355476592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555bbcee7110 con 0x555bbceeab60 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.694+0000 7fe6267fc640 1 -- 172.21.15.55:0/1355476592 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe62c013030 con 0x555bbceeab60 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.695+0000 7fe6267fc640 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe618069eb0 0x7fe61806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.695+0000 7fe6267fc640 1 -- 172.21.15.55:0/1355476592 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe62c088e50 con 0x555bbceeab60 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.695+0000 7fe63519a640 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe618069eb0 0x7fe61806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.695+0000 7fe63811ff40 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x555bbceef840 0x555bbcf892a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.695+0000 7fe63811ff40 1 -- 172.21.15.55:0/1355476592 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:1 17.25 17:a5feb6f3:::10000000006.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e116) v9 -- 0x555bbce5e830 con 0x555bbceef840 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.695+0000 7fe63599b640 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x555bbceef840 0x555bbcf892a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.695+0000 7fe63519a640 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe618069eb0 0x7fe61806c370 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe628056000 tx=0x7fe628050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.695+0000 7fe63599b640 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x555bbceef840 0x555bbcf892a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63599b640 1 -- 172.21.15.55:0/1355476592 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(1 10000000006.00000000 [getxattr (12) out=12b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7fe63000f030 con 0x555bbceef840 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63811ff40 1 -- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x555bbceef840 msgr2=0x555bbcf892a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63811ff40 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x555bbceef840 0x555bbcf892a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63811ff40 1 -- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe618069eb0 msgr2=0x7fe61806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63811ff40 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe618069eb0 0x7fe61806c370 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe628056000 tx=0x7fe628050000 comp rx=0 tx=0).stop 2024-04-25T09:03:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63811ff40 1 -- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceeab60 msgr2=0x555bbcee0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63811ff40 1 --2- 172.21.15.55:0/1355476592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555bbceeab60 0x555bbcee0e10 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009f50 tx=0x7fe62c009f80 comp rx=0 tx=0).stop 2024-04-25T09:03:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63599b640 1 -- 172.21.15.55:0/1355476592 reap_dead start 2024-04-25T09:03:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63811ff40 1 -- 172.21.15.55:0/1355476592 shutdown_connections 2024-04-25T09:03:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63811ff40 1 -- 172.21.15.55:0/1355476592 >> 172.21.15.55:0/1355476592 conn(0x555bbce423d0 msgr2=0x555bbce61700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63811ff40 1 -- 172.21.15.55:0/1355476592 shutdown_connections 2024-04-25T09:03:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.696+0000 7fe63811ff40 1 -- 172.21.15.55:0/1355476592 wait complete. 2024-04-25T09:03:56.688 INFO:teuthology.orchestra.run.smithi055.stdout:mytag123 2024-04-25T09:03:56.688 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:03:56.688 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T09:03:56.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.843+0000 7effc917e640 1 Processor -- start 2024-04-25T09:03:56.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.843+0000 7effc917e640 1 -- start start 2024-04-25T09:03:56.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.843+0000 7effc917e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc4161120 0x7effc41617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.843+0000 7effc917e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7effc4161ce0 0x7effc40b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.843+0000 7effc917e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7effc40b5a90 0x7effc406c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.843+0000 7effc917e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc4162740 con 0x7effc40b5a90 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.843+0000 7effc917e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc4161500 con 0x7effc4161ce0 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.843+0000 7effc917e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc4162180 con 0x7effc4161120 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.844+0000 7effc359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7effc40b5a90 0x7effc406c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.844+0000 7effc359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7effc40b5a90 0x7effc406c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55546/0 (socket says 172.21.15.55:55546) 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.844+0000 7effc359e640 1 -- 172.21.15.55:0/2190546844 learned_addr learned my addr 172.21.15.55:0/2190546844 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.844+0000 7effbbfff640 1 --2- 172.21.15.55:0/2190546844 >> v2:172.21.15.167:3300/0 conn(0x7effc4161ce0 0x7effc40b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.844+0000 7effc2d9d640 1 --2- 172.21.15.55:0/2190546844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc4161120 0x7effc41617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.844+0000 7effc359e640 1 -- 172.21.15.55:0/2190546844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc4161120 msgr2=0x7effc41617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.844+0000 7effc359e640 1 --2- 172.21.15.55:0/2190546844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc4161120 0x7effc41617a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.844+0000 7effc359e640 1 -- 172.21.15.55:0/2190546844 >> v2:172.21.15.167:3300/0 conn(0x7effc4161ce0 msgr2=0x7effc40b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.844+0000 7effc359e640 1 --2- 172.21.15.55:0/2190546844 >> v2:172.21.15.167:3300/0 conn(0x7effc4161ce0 0x7effc40b5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.844+0000 7effc359e640 1 -- 172.21.15.55:0/2190546844 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc4162460 con 0x7effc40b5a90 2024-04-25T09:03:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc359e640 1 --2- 172.21.15.55:0/2190546844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effc40b5a90 0x7effc406c090 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7effc40d4b60 tx=0x7effbc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625f8b1553cba038 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc259c640 1 -- 172.21.15.55:0/2190546844 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc036070 con 0x7effc40b5a90 2024-04-25T09:03:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc259c640 1 -- 172.21.15.55:0/2190546844 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc031600 con 0x7effc40b5a90 2024-04-25T09:03:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc259c640 1 -- 172.21.15.55:0/2190546844 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc0319d0 con 0x7effc40b5a90 2024-04-25T09:03:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc917e640 1 -- 172.21.15.55:0/2190546844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effc40b5a90 msgr2=0x7effc406c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc917e640 1 --2- 172.21.15.55:0/2190546844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effc40b5a90 0x7effc406c090 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7effc40d4b60 tx=0x7effbc02a610 comp rx=0 tx=0).stop 2024-04-25T09:03:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc917e640 1 -- 172.21.15.55:0/2190546844 shutdown_connections 2024-04-25T09:03:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc917e640 1 --2- 172.21.15.55:0/2190546844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effc40b5a90 0x7effc406c090 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc917e640 1 --2- 172.21.15.55:0/2190546844 >> v2:172.21.15.167:3300/0 conn(0x7effc4161ce0 0x7effc40b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc917e640 1 --2- 172.21.15.55:0/2190546844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc4161120 0x7effc41617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc917e640 1 -- 172.21.15.55:0/2190546844 >> 172.21.15.55:0/2190546844 conn(0x7effc40d0550 msgr2=0x7effc40d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc917e640 1 -- 172.21.15.55:0/2190546844 shutdown_connections 2024-04-25T09:03:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.845+0000 7effc917e640 1 -- 172.21.15.55:0/2190546844 wait complete. 2024-04-25T09:03:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.847+0000 7effc917e640 1 Processor -- start 2024-04-25T09:03:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.847+0000 7effc917e640 1 -- start start 2024-04-25T09:03:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.847+0000 7effc917e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc40b5a90 0x7effc40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.847+0000 7effc917e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc4161120 0x7effc40c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.847+0000 7effc917e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effc4161ce0 0x7effc4159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.847+0000 7effc917e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc40b95f0 con 0x7effc4161ce0 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.847+0000 7effc917e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc40d2040 con 0x7effc40b5a90 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.847+0000 7effc917e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc40b9770 con 0x7effc4161120 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effc4161ce0 0x7effc4159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effc4161ce0 0x7effc4159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55554/0 (socket says 172.21.15.55:55554) 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc359e640 1 -- 172.21.15.55:0/714516227 learned_addr learned my addr 172.21.15.55:0/714516227 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effbbfff640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc4161120 0x7effc40c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc2d9d640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc40b5a90 0x7effc40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc359e640 1 -- 172.21.15.55:0/714516227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc4161120 msgr2=0x7effc40c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc359e640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc4161120 0x7effc40c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc359e640 1 -- 172.21.15.55:0/714516227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc40b5a90 msgr2=0x7effc40c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc359e640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc40b5a90 0x7effc40c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc359e640 1 -- 172.21.15.55:0/714516227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc40c7d90 con 0x7effc4161ce0 2024-04-25T09:03:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc2d9d640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc40b5a90 0x7effc40c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc359e640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effc4161ce0 0x7effc4159290 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7effbc009f40 tx=0x7effbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effbb7fe640 1 -- 172.21.15.55:0/714516227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc036050 con 0x7effc4161ce0 2024-04-25T09:03:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effbb7fe640 1 -- 172.21.15.55:0/714516227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc042070 con 0x7effc4161ce0 2024-04-25T09:03:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc917e640 1 -- 172.21.15.55:0/714516227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc40c80d0 con 0x7effc4161ce0 2024-04-25T09:03:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effbb7fe640 1 -- 172.21.15.55:0/714516227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc009510 con 0x7effc4161ce0 2024-04-25T09:03:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.848+0000 7effc917e640 1 -- 172.21.15.55:0/714516227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc40c8910 con 0x7effc4161ce0 2024-04-25T09:03:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.850+0000 7effbb7fe640 1 -- 172.21.15.55:0/714516227 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effbc007bd0 con 0x7effc4161ce0 2024-04-25T09:03:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.850+0000 7effbb7fe640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effa406b4d0 0x7effa406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.850+0000 7effbb7fe640 1 -- 172.21.15.55:0/714516227 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7effbc0ab1c0 con 0x7effc4161ce0 2024-04-25T09:03:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.850+0000 7effc2d9d640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effa406b4d0 0x7effa406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.851+0000 7effc2d9d640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effa406b4d0 0x7effa406d990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7effb400aa50 tx=0x7effb4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.851+0000 7effcbe81740 1 Processor -- start 2024-04-25T09:03:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.851+0000 7effcbe81740 1 -- start start 2024-04-25T09:03:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effcbe81740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889b10 0x55ea4588c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effcbe81740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45889ef0 0x55ea4588c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effcbe81740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea4585c770 0x55ea4585ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effcbe81740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea457c5da0 con 0x55ea4585c770 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effcbe81740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea4576eb80 con 0x55ea45889ef0 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effcbe81740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea457c1e40 con 0x55ea45889b10 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effc359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea4585c770 0x55ea4585ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effc359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea4585c770 0x55ea4585ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55560/0 (socket says 172.21.15.55:55560) 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effc359e640 1 -- 172.21.15.55:0/1342448441 learned_addr learned my addr 172.21.15.55:0/1342448441 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effbbfff640 1 --2- 172.21.15.55:0/1342448441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45889ef0 0x55ea4588c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effc2d9d640 1 --2- 172.21.15.55:0/1342448441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889b10 0x55ea4588c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effc359e640 1 -- 172.21.15.55:0/1342448441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889b10 msgr2=0x55ea4588c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effc359e640 1 --2- 172.21.15.55:0/1342448441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889b10 0x55ea4588c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effc359e640 1 -- 172.21.15.55:0/1342448441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45889ef0 msgr2=0x55ea4588c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effc359e640 1 --2- 172.21.15.55:0/1342448441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45889ef0 0x55ea4588c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.852+0000 7effc359e640 1 -- 172.21.15.55:0/1342448441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea45778f10 con 0x55ea4585c770 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.853+0000 7effc359e640 1 --2- 172.21.15.55:0/1342448441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea4585c770 0x55ea4585ff80 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7effbc034040 tx=0x7effbc079410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ac4ece0e22eefa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.853+0000 7effb8ff9640 1 -- 172.21.15.55:0/1342448441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc091030 con 0x55ea4585c770 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.853+0000 7effb8ff9640 1 -- 172.21.15.55:0/1342448441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc037040 con 0x55ea4585c770 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.853+0000 7effb8ff9640 1 -- 172.21.15.55:0/1342448441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc079fd0 con 0x55ea4585c770 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.853+0000 7effcbe81740 1 -- 172.21.15.55:0/1342448441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea4585c770 msgr2=0x55ea4585ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.853+0000 7effcbe81740 1 --2- 172.21.15.55:0/1342448441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea4585c770 0x55ea4585ff80 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7effbc034040 tx=0x7effbc079410 comp rx=0 tx=0).stop 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.853+0000 7effcbe81740 1 -- 172.21.15.55:0/1342448441 shutdown_connections 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.853+0000 7effcbe81740 1 --2- 172.21.15.55:0/1342448441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea4585c770 0x55ea4585ff80 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.853+0000 7effcbe81740 1 --2- 172.21.15.55:0/1342448441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45889ef0 0x55ea4588c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.853+0000 7effcbe81740 1 --2- 172.21.15.55:0/1342448441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889b10 0x55ea4588c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.853+0000 7effcbe81740 1 -- 172.21.15.55:0/1342448441 >> 172.21.15.55:0/1342448441 conn(0x55ea4585e9e0 msgr2=0x55ea458a7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.854+0000 7effcbe81740 1 -- 172.21.15.55:0/1342448441 shutdown_connections 2024-04-25T09:03:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.854+0000 7effcbe81740 1 -- 172.21.15.55:0/1342448441 wait complete. 2024-04-25T09:03:56.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.854+0000 7effcbe81740 1 -- start start 2024-04-25T09:03:56.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.854+0000 7effcbe81740 1 Processor -- start 2024-04-25T09:03:56.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effcbe81740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45861390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effcbe81740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 0x55ea45880700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effcbe81740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45882060 0x55ea45880c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effcbe81740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea4576eb80 con 0x55ea45889b10 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effcbe81740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea457644b0 con 0x55ea45882060 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effcbe81740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea457c5da0 con 0x55ea45889ef0 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effcbe81740 10 client.0 _ll_register_callbacks cb 0x55ea457a4180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effc2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45861390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effc2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45861390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55572/0 (socket says 172.21.15.55:55572) 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effc2d9d640 1 -- 172.21.15.55:0/1079728588 learned_addr learned my addr 172.21.15.55:0/1079728588 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effbbfff640 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 0x55ea45880700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effc359e640 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45882060 0x55ea45880c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effc2d9d640 1 -- 172.21.15.55:0/1079728588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 msgr2=0x55ea45880700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effc2d9d640 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 0x55ea45880700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effc2d9d640 1 -- 172.21.15.55:0/1079728588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45882060 msgr2=0x55ea45880c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effc2d9d640 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45882060 0x55ea45880c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effc2d9d640 1 -- 172.21.15.55:0/1079728588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea455a47d0 con 0x55ea45889b10 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.855+0000 7effc359e640 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45882060 0x55ea45880c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effc2d9d640 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45861390 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7effb40139d0 tx=0x7effb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bc432a1ccda901 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effa1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effa1ffb640 1 -- 172.21.15.55:0/1079728588 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4024020 con 0x55ea45889b10 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effa1ffb640 1 -- 172.21.15.55:0/1079728588 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7effb4014b90 con 0x55ea45889b10 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effcbe81740 1 -- 172.21.15.55:0/1079728588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7effbc037040 con 0x55ea45889b10 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effa1ffb640 1 -- 172.21.15.55:0/1079728588 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7effb402e050 con 0x55ea45889b10 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effcbe81740 10 client.9315 fetch_fsmap learned FSMap version 92 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effcbe81740 1 -- 172.21.15.55:0/1079728588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55ea454da3f0 con 0x55ea45889b10 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effa1ffb640 1 -- 172.21.15.55:0/1079728588 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc037040 con 0x55ea45889b10 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effa1ffb640 1 -- 172.21.15.55:0/1079728588 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 92) v1 ==== 3294+0+0 (secure 0 0 0) 0x7effb4031020 con 0x55ea45889b10 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effcbe81740 10 client.9315 fetch_fsmap finished waiting for FSMap version 92 2024-04-25T09:03:56.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effcbe81740 10 client.9315 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effcbe81740 20 client.9315 populate_metadata read hostname 'smithi055' 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effcbe81740 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x55ea458853c0 0x55ea458857d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effcbe81740 4 client.9315 mds_command: new command op to 9177 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effcbe81740 1 -- 172.21.15.55:0/1079728588 --> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea457d32e0 con 0x55ea458853c0 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.856+0000 7effbbfff640 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x55ea458853c0 0x55ea458857d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effa1ffb640 10 client.9315 ms_handle_connect on v2:172.21.15.55:6835/3667784674 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effbbfff640 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x55ea458853c0 0x55ea458857d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16ff7b4ae1f15dec server_cookie=99941b732edef65 in_seq=0 out_seq=0 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effa1ffb640 1 -- 172.21.15.55:0/1079728588 <== mds.0 v2:172.21.15.55:6835/3667784674 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ea457d32e0 con 0x55ea458853c0 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effa1ffb640 10 client.9315 handle_command_reply: tid=0 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effcbe81740 1 client.9315 shutdown 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effcbe81740 1 -- 172.21.15.55:0/1079728588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 msgr2=0x55ea45861390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effcbe81740 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45861390 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7effb40139d0 tx=0x7effb4004730 comp rx=0 tx=0).stop 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effcbe81740 1 -- 172.21.15.55:0/1079728588 shutdown_connections 2024-04-25T09:03:56.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effcbe81740 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45882060 0x55ea45880c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effcbe81740 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x55ea458853c0 0x55ea458857d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effcbe81740 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 0x55ea45880700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effcbe81740 1 --2- 172.21.15.55:0/1079728588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45861390 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effa1ffb640 0 client.9315 ms_handle_reset on v2:172.21.15.55:6835/3667784674 2024-04-25T09:03:56.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effcbe81740 1 -- 172.21.15.55:0/1079728588 >> 172.21.15.55:0/1079728588 conn(0x55ea4585c770 msgr2=0x55ea45888190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effcbe81740 1 -- 172.21.15.55:0/1079728588 shutdown_connections 2024-04-25T09:03:56.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.857+0000 7effcbe81740 1 -- 172.21.15.55:0/1079728588 wait complete. 2024-04-25T09:03:56.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.858+0000 7effcbe81740 20 client.9315 trim_cache size 0 max 16384 2024-04-25T09:03:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.871+0000 7effcbe81740 1 Processor -- start 2024-04-25T09:03:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.871+0000 7effcbe81740 1 -- start start 2024-04-25T09:03:56.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.871+0000 7effcbe81740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45882060 0x55ea45881540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.871+0000 7effcbe81740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45881a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.871+0000 7effcbe81740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 0x55ea4588f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.871+0000 7effcbe81740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc41fffd0 con 0x55ea45889b10 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.871+0000 7effcbe81740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc41ff170 con 0x55ea45882060 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.871+0000 7effcbe81740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc41fe680 con 0x55ea45889ef0 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effbbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45881a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effbbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45881a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55586/0 (socket says 172.21.15.55:55586) 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effbbfff640 1 -- 172.21.15.55:0/3857007559 learned_addr learned my addr 172.21.15.55:0/3857007559 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effbbfff640 1 -- 172.21.15.55:0/3857007559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 msgr2=0x55ea4588f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effbbfff640 1 --2- 172.21.15.55:0/3857007559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 0x55ea4588f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effbbfff640 1 -- 172.21.15.55:0/3857007559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45882060 msgr2=0x55ea45881540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effbbfff640 1 --2- 172.21.15.55:0/3857007559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45882060 0x55ea45881540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effbbfff640 1 -- 172.21.15.55:0/3857007559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea4549a0f0 con 0x55ea45889b10 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effbbfff640 1 --2- 172.21.15.55:0/3857007559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45881a80 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7effc40b6860 tx=0x7effac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3164bc3bd371d34f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effa3fff640 1 -- 172.21.15.55:0/3857007559 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac004230 con 0x55ea45889b10 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effa3fff640 1 -- 172.21.15.55:0/3857007559 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0043d0 con 0x55ea45889b10 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.872+0000 7effa3fff640 1 -- 172.21.15.55:0/3857007559 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac017b30 con 0x55ea45889b10 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.873+0000 7effcbe81740 1 -- 172.21.15.55:0/3857007559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 msgr2=0x55ea45881a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.873+0000 7effcbe81740 1 --2- 172.21.15.55:0/3857007559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45881a80 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7effc40b6860 tx=0x7effac008040 comp rx=0 tx=0).stop 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.873+0000 7effcbe81740 1 -- 172.21.15.55:0/3857007559 shutdown_connections 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.873+0000 7effcbe81740 1 --2- 172.21.15.55:0/3857007559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 0x55ea4588f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.873+0000 7effcbe81740 1 --2- 172.21.15.55:0/3857007559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45889b10 0x55ea45881a80 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.873+0000 7effcbe81740 1 --2- 172.21.15.55:0/3857007559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45882060 0x55ea45881540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.873+0000 7effcbe81740 1 -- 172.21.15.55:0/3857007559 >> 172.21.15.55:0/3857007559 conn(0x55ea4585c770 msgr2=0x55ea458c9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.873+0000 7effcbe81740 1 -- 172.21.15.55:0/3857007559 shutdown_connections 2024-04-25T09:03:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.873+0000 7effcbe81740 1 -- 172.21.15.55:0/3857007559 wait complete. 2024-04-25T09:03:56.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.873+0000 7effcbe81740 1 -- start start 2024-04-25T09:03:56.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.873+0000 7effcbe81740 1 Processor -- start 2024-04-25T09:03:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effcbe81740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45882060 0x55ea45910bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effcbe81740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45889b10 0x55ea4589d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effcbe81740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 0x55ea4589d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effcbe81740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea45884050 con 0x55ea45882060 2024-04-25T09:03:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effcbe81740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc41feba0 con 0x55ea45889b10 2024-04-25T09:03:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effcbe81740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea458ab590 con 0x55ea45889ef0 2024-04-25T09:03:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effcbe81740 10 client.0 _ll_register_callbacks cb 0x7effbc007ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effc2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45882060 0x55ea45910bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effc2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45882060 0x55ea45910bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55602/0 (socket says 172.21.15.55:55602) 2024-04-25T09:03:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effc2d9d640 1 -- 172.21.15.55:0/2656842019 learned_addr learned my addr 172.21.15.55:0/2656842019 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effbbfff640 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45889b10 0x55ea4589d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effc359e640 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 0x55ea4589d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effc2d9d640 1 -- 172.21.15.55:0/2656842019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 msgr2=0x55ea4589d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effc2d9d640 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 0x55ea4589d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effc2d9d640 1 -- 172.21.15.55:0/2656842019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45889b10 msgr2=0x55ea4589d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effc2d9d640 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45889b10 0x55ea4589d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.874+0000 7effc2d9d640 1 -- 172.21.15.55:0/2656842019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea45912070 con 0x55ea45882060 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effbbfff640 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45889b10 0x55ea4589d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effc2d9d640 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45882060 0x55ea45910bf0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7effb400e7c0 tx=0x7effb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a3c4bfcf05d9d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effa1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effa1ffb640 1 -- 172.21.15.55:0/2656842019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4036020 con 0x55ea45882060 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effa1ffb640 1 -- 172.21.15.55:0/2656842019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7effb4020620 con 0x55ea45882060 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effcbe81740 1 -- 172.21.15.55:0/2656842019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7effac0043d0 con 0x55ea45882060 2024-04-25T09:03:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effa1ffb640 1 -- 172.21.15.55:0/2656842019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7effb401a070 con 0x55ea45882060 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effcbe81740 10 client.9321 fetch_fsmap learned FSMap version 92 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effcbe81740 1 -- 172.21.15.55:0/2656842019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55ea45860b60 con 0x55ea45882060 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effa1ffb640 1 -- 172.21.15.55:0/2656842019 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0043d0 con 0x55ea45882060 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effa1ffb640 1 -- 172.21.15.55:0/2656842019 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 92) v1 ==== 3294+0+0 (secure 0 0 0) 0x7effb4031040 con 0x55ea45882060 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effcbe81740 10 client.9321 fetch_fsmap finished waiting for FSMap version 92 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effcbe81740 10 client.9321 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effcbe81740 20 client.9321 populate_metadata read hostname 'smithi055' 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effcbe81740 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x55ea45881b20 0x55ea4585fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effcbe81740 4 client.9321 mds_command: new command op to 9177 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effcbe81740 1 -- 172.21.15.55:0/2656842019 --> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ea457cd630 con 0x55ea45881b20 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.875+0000 7effbbfff640 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x55ea45881b20 0x55ea4585fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.876+0000 7effa1ffb640 10 client.9321 ms_handle_connect on v2:172.21.15.55:6835/3667784674 2024-04-25T09:03:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.876+0000 7effbbfff640 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x55ea45881b20 0x55ea4585fdf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21c9f99a1f1c9a79 server_cookie=ec7d35dfeec6f777 in_seq=0 out_seq=0 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.894+0000 7effa1ffb640 1 -- 172.21.15.55:0/2656842019 <== mds.0 v2:172.21.15.55:6835/3667784674 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ea457cd630 con 0x55ea45881b20 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.894+0000 7effa1ffb640 10 client.9321 handle_command_reply: tid=0 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.894+0000 7effcbe81740 1 client.9321 shutdown 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effcbe81740 1 -- 172.21.15.55:0/2656842019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45882060 msgr2=0x55ea45910bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effcbe81740 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45882060 0x55ea45910bf0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7effb400e7c0 tx=0x7effb40046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effcbe81740 1 -- 172.21.15.55:0/2656842019 shutdown_connections 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effcbe81740 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.55:6835/3667784674,v1:172.21.15.55:6837/3667784674] conn(0x55ea45881b20 0x55ea4585fdf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effcbe81740 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ea45889ef0 0x55ea4589d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effcbe81740 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea45889b10 0x55ea4589d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effcbe81740 1 --2- 172.21.15.55:0/2656842019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea45882060 0x55ea45910bf0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effa1ffb640 0 client.9321 ms_handle_reset on v2:172.21.15.55:6835/3667784674 2024-04-25T09:03:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effcbe81740 1 -- 172.21.15.55:0/2656842019 >> 172.21.15.55:0/2656842019 conn(0x55ea4585c770 msgr2=0x55ea4588c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effcbe81740 1 -- 172.21.15.55:0/2656842019 shutdown_connections 2024-04-25T09:03:56.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effcbe81740 1 -- 172.21.15.55:0/2656842019 wait complete. 2024-04-25T09:03:56.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effcbe81740 20 client.9321 trim_cache size 0 max 16384 2024-04-25T09:03:56.885 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:03:56.885 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "", 2024-04-25T09:03:56.885 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0 2024-04-25T09:03:56.885 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:03:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effc917e640 1 -- 172.21.15.55:0/714516227 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effa406b4d0 msgr2=0x7effa406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effc917e640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effa406b4d0 0x7effa406d990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7effb400aa50 tx=0x7effb4008040 comp rx=0 tx=0).stop 2024-04-25T09:03:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effc917e640 1 -- 172.21.15.55:0/714516227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effc4161ce0 msgr2=0x7effc4159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effc917e640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effc4161ce0 0x7effc4159290 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7effbc009f40 tx=0x7effbc004a40 comp rx=0 tx=0).stop 2024-04-25T09:03:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effc917e640 1 -- 172.21.15.55:0/714516227 shutdown_connections 2024-04-25T09:03:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effc917e640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7effa406b4d0 0x7effa406d990 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effc917e640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effc4161ce0 0x7effc4159290 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effc917e640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc4161120 0x7effc40c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effc917e640 1 --2- 172.21.15.55:0/714516227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc40b5a90 0x7effc40c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.895+0000 7effc917e640 1 -- 172.21.15.55:0/714516227 >> 172.21.15.55:0/714516227 conn(0x7effc40d0550 msgr2=0x7effc40b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.896+0000 7effc917e640 1 -- 172.21.15.55:0/714516227 shutdown_connections 2024-04-25T09:03:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:56.896+0000 7effc917e640 1 -- 172.21.15.55:0/714516227 wait complete. 2024-04-25T09:03:56.895 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:03:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.008+0000 7fd6defb7640 1 Processor -- start 2024-04-25T09:03:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.009+0000 7fd6defb7640 1 -- start start 2024-04-25T09:03:56.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.009+0000 7fd6defb7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6d8161090 0x7fd6d8161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.009+0000 7fd6defb7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd6d80b9720 0x7fd6d80ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.009+0000 7fd6defb7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80cece0 0x7fd6d806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.009+0000 7fd6defb7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d80cf130 con 0x7fd6d8161090 2024-04-25T09:03:56.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.009+0000 7fd6defb7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d80d21a0 con 0x7fd6d80b9720 2024-04-25T09:03:56.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.009+0000 7fd6defb7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8161f80 con 0x7fd6d80cece0 2024-04-25T09:03:56.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.009+0000 7fd6dcd53640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6d8161090 0x7fd6d8161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.010+0000 7fd6dcd53640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6d8161090 0x7fd6d8161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55612/0 (socket says 172.21.15.55:55612) 2024-04-25T09:03:56.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.010+0000 7fd6dcd53640 1 -- 172.21.15.55:0/1856110727 learned_addr learned my addr 172.21.15.55:0/1856110727 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.010+0000 7fd6d7fff640 1 --2- 172.21.15.55:0/1856110727 >> v2:172.21.15.167:3300/0 conn(0x7fd6d80b9720 0x7fd6d80ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.010+0000 7fd6dd554640 1 --2- 172.21.15.55:0/1856110727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80cece0 0x7fd6d806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.010+0000 7fd6dcd53640 1 -- 172.21.15.55:0/1856110727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80cece0 msgr2=0x7fd6d806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.010+0000 7fd6dcd53640 1 --2- 172.21.15.55:0/1856110727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80cece0 0x7fd6d806c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.010+0000 7fd6dcd53640 1 -- 172.21.15.55:0/1856110727 >> v2:172.21.15.167:3300/0 conn(0x7fd6d80b9720 msgr2=0x7fd6d80ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.010+0000 7fd6dcd53640 1 --2- 172.21.15.55:0/1856110727 >> v2:172.21.15.167:3300/0 conn(0x7fd6d80b9720 0x7fd6d80ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.010+0000 7fd6dcd53640 1 -- 172.21.15.55:0/1856110727 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8162260 con 0x7fd6d8161090 2024-04-25T09:03:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6dcd53640 1 --2- 172.21.15.55:0/1856110727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d8161090 0x7fd6d8161730 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fd6d808cf10 tx=0x7fd6cc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52f60defe47daaf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6d77fe640 1 -- 172.21.15.55:0/1856110727 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc037070 con 0x7fd6d8161090 2024-04-25T09:03:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6d77fe640 1 -- 172.21.15.55:0/1856110727 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc032440 con 0x7fd6d8161090 2024-04-25T09:03:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6d77fe640 1 -- 172.21.15.55:0/1856110727 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc032810 con 0x7fd6d8161090 2024-04-25T09:03:57.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6defb7640 1 -- 172.21.15.55:0/1856110727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d8161090 msgr2=0x7fd6d8161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6defb7640 1 --2- 172.21.15.55:0/1856110727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d8161090 0x7fd6d8161730 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fd6d808cf10 tx=0x7fd6cc02a140 comp rx=0 tx=0).stop 2024-04-25T09:03:57.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6defb7640 1 -- 172.21.15.55:0/1856110727 shutdown_connections 2024-04-25T09:03:57.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6defb7640 1 --2- 172.21.15.55:0/1856110727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80cece0 0x7fd6d806c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6defb7640 1 --2- 172.21.15.55:0/1856110727 >> v2:172.21.15.167:3300/0 conn(0x7fd6d80b9720 0x7fd6d80ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6defb7640 1 --2- 172.21.15.55:0/1856110727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d8161090 0x7fd6d8161730 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6defb7640 1 -- 172.21.15.55:0/1856110727 >> 172.21.15.55:0/1856110727 conn(0x7fd6d80b55e0 msgr2=0x7fd6d80b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6defb7640 1 -- 172.21.15.55:0/1856110727 shutdown_connections 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.011+0000 7fd6defb7640 1 -- 172.21.15.55:0/1856110727 wait complete. 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.012+0000 7fd6defb7640 1 Processor -- start 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.012+0000 7fd6defb7640 1 -- start start 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.013+0000 7fd6defb7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d80b9720 0x7fd6d81f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.013+0000 7fd6defb7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80cece0 0x7fd6d81f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.013+0000 7fd6defb7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d8161090 0x7fd6d81f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.013+0000 7fd6defb7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8161470 con 0x7fd6d80b9720 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.013+0000 7fd6defb7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80d1e30 con 0x7fd6d8161090 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.013+0000 7fd6defb7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8161c70 con 0x7fd6d80cece0 2024-04-25T09:03:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.013+0000 7fd6dcd53640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d80b9720 0x7fd6d81f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.013+0000 7fd6dcd53640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d80b9720 0x7fd6d81f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55616/0 (socket says 172.21.15.55:55616) 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.013+0000 7fd6dcd53640 1 -- 172.21.15.55:0/844566060 learned_addr learned my addr 172.21.15.55:0/844566060 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6d7fff640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80cece0 0x7fd6d81f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6dd554640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d8161090 0x7fd6d81f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6dcd53640 1 -- 172.21.15.55:0/844566060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80cece0 msgr2=0x7fd6d81f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6dcd53640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80cece0 0x7fd6d81f77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6dcd53640 1 -- 172.21.15.55:0/844566060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d8161090 msgr2=0x7fd6d81f0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6dcd53640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d8161090 0x7fd6d81f0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6dcd53640 1 -- 172.21.15.55:0/844566060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d815d0e0 con 0x7fd6d80b9720 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6dd554640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d8161090 0x7fd6d81f0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6dcd53640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d80b9720 0x7fd6d81f37e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc000c00 tx=0x7fd6cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6d57fa640 1 -- 172.21.15.55:0/844566060 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc041020 con 0x7fd6d80b9720 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6d57fa640 1 -- 172.21.15.55:0/844566060 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0306c0 con 0x7fd6d80b9720 2024-04-25T09:03:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6defb7640 1 -- 172.21.15.55:0/844566060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d81f7d20 con 0x7fd6d80b9720 2024-04-25T09:03:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6d57fa640 1 -- 172.21.15.55:0/844566060 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc037040 con 0x7fd6d80b9720 2024-04-25T09:03:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.014+0000 7fd6defb7640 1 -- 172.21.15.55:0/844566060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d81f3e30 con 0x7fd6d80b9720 2024-04-25T09:03:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.016+0000 7fd6defb7640 1 -- 172.21.15.55:0/844566060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d80b91e0 con 0x7fd6d80b9720 2024-04-25T09:03:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.016+0000 7fd6d57fa640 1 -- 172.21.15.55:0/844566060 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd6cc044020 con 0x7fd6d80b9720 2024-04-25T09:03:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.016+0000 7fd6d57fa640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6bc06b520 0x7fd6bc06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.016+0000 7fd6d57fa640 1 -- 172.21.15.55:0/844566060 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd6cc0aa9a0 con 0x7fd6d80b9720 2024-04-25T09:03:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.017+0000 7fd6d7fff640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6bc06b520 0x7fd6bc06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.017+0000 7fd6d7fff640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6bc06b520 0x7fd6bc06d9e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80cdd50 tx=0x7fd6c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.021+0000 7fd6d57fa640 1 -- 172.21.15.55:0/844566060 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd6d80b91e0 con 0x7fd6d80b9720 2024-04-25T09:03:57.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.239+0000 7fd6defb7640 1 -- 172.21.15.55:0/844566060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd6d80750b0 con 0x7fd6d80b9720 2024-04-25T09:03:57.227 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T09:03:57.239+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:03:57.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.241+0000 7fd6d57fa640 1 -- 172.21.15.55:0/844566060 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v93) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd6cc04b030 con 0x7fd6d80b9720 2024-04-25T09:03:57.229 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 -- 172.21.15.55:0/844566060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6bc06b520 msgr2=0x7fd6bc06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6bc06b520 0x7fd6bc06d9e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80cdd50 tx=0x7fd6c4008040 comp rx=0 tx=0).stop 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 -- 172.21.15.55:0/844566060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d80b9720 msgr2=0x7fd6d81f37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d80b9720 0x7fd6d81f37e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc000c00 tx=0x7fd6cc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 -- 172.21.15.55:0/844566060 shutdown_connections 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fd6bc06b520 0x7fd6bc06d9e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d8161090 0x7fd6d81f0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80cece0 0x7fd6d81f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 --2- 172.21.15.55:0/844566060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6d80b9720 0x7fd6d81f37e0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 -- 172.21.15.55:0/844566060 >> 172.21.15.55:0/844566060 conn(0x7fd6d80b55e0 msgr2=0x7fd6d80d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 -- 172.21.15.55:0/844566060 shutdown_connections 2024-04-25T09:03:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.243+0000 7fd6defb7640 1 -- 172.21.15.55:0/844566060 wait complete. 2024-04-25T09:03:57.233 INFO:tasks.ceph.mds.a.smithi055.stderr: -1744> 2024-04-25T09:03:52.649+0000 7fd8fd00e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:03:57.245 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-04-25T09:03:57.262 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-25T09:03:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.301+0000 7f5e9385b280 1 -- start start 2024-04-25T09:03:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.301+0000 7f5e9385b280 1 Processor -- start 2024-04-25T09:03:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae48ac00 0x5564ae4fa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae48b800 0x5564ae4fab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564ae48bc00 0x5564ae4fb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e9385b280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af268600 con 0x5564ae48ac00 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e9385b280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af268480 con 0x5564ae48b800 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e9385b280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564af268300 con 0x5564ae48bc00 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e92009640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae48ac00 0x5564ae4fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e92009640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae48ac00 0x5564ae4fa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55634/0 (socket says 172.21.15.55:55634) 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e92009640 1 -- 172.21.15.55:0/2353191176 learned_addr learned my addr 172.21.15.55:0/2353191176 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e9280a640 1 --2- 172.21.15.55:0/2353191176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564ae48bc00 0x5564ae4fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e91808640 1 --2- 172.21.15.55:0/2353191176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae48b800 0x5564ae4fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e92009640 1 -- 172.21.15.55:0/2353191176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564ae48bc00 msgr2=0x5564ae4fb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.302+0000 7f5e92009640 1 --2- 172.21.15.55:0/2353191176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564ae48bc00 0x5564ae4fb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e92009640 1 -- 172.21.15.55:0/2353191176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae48b800 msgr2=0x5564ae4fab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e92009640 1 --2- 172.21.15.55:0/2353191176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae48b800 0x5564ae4fab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e92009640 1 -- 172.21.15.55:0/2353191176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564ae4c0780 con 0x5564ae48ac00 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e91808640 1 --2- 172.21.15.55:0/2353191176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae48b800 0x5564ae4fab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e92009640 1 --2- 172.21.15.55:0/2353191176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae48ac00 0x5564ae4fa580 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x5564af2b73b0 tx=0x5564af350120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c02d99dee69ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e8f804640 1 -- 172.21.15.55:0/2353191176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5564ae4b0680 con 0x5564ae48ac00 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e8f804640 1 -- 172.21.15.55:0/2353191176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5564ae4b6e00 con 0x5564ae48ac00 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e8f804640 1 -- 172.21.15.55:0/2353191176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5564ae4b09c0 con 0x5564ae48ac00 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e9385b280 1 -- 172.21.15.55:0/2353191176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564ae4c03c0 con 0x5564ae48ac00 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e9385b280 1 -- 172.21.15.55:0/2353191176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5564ae4c1860 con 0x5564ae48ac00 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e9385b280 4 waiting for MDS map... 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e8f804640 1 -- 172.21.15.55:0/2353191176 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x5564af362400 con 0x5564ae48ac00 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e8f804640 1 -- 172.21.15.55:0/2353191176 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 93) v1 ==== 2723+0+0 (secure 0 0 0) 0x5564ae4e5180 con 0x5564ae48ac00 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e9385b280 4 Got MDS map 93 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e9385b280 10 main: JournalTool::main 2024-04-25T09:03:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.303+0000 7f5e9385b280 4 main: JournalTool: connecting to RADOS... 2024-04-25T09:03:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.304+0000 7f5e9385b280 1 Processor -- start 2024-04-25T09:03:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.304+0000 7f5e9385b280 1 -- start start 2024-04-25T09:03:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.304+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26bc00 0x5564ae4fb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.304+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3ae000 0x5564ae4fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.304+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3ae400 0x5564ae4fc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.304+0000 7f5e9385b280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af268180 con 0x5564af26bc00 2024-04-25T09:03:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.304+0000 7f5e9385b280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564ae4ec480 con 0x5564af3ae000 2024-04-25T09:03:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.304+0000 7f5e9385b280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564ae4ec900 con 0x5564af3ae400 2024-04-25T09:03:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e9280a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26bc00 0x5564ae4fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e9280a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26bc00 0x5564ae4fb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55638/0 (socket says 172.21.15.55:55638) 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e9280a640 1 -- 172.21.15.55:0/2352805952 learned_addr learned my addr 172.21.15.55:0/2352805952 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e91808640 1 --2- 172.21.15.55:0/2352805952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3ae400 0x5564ae4fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e92009640 1 --2- 172.21.15.55:0/2352805952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3ae000 0x5564ae4fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e9280a640 1 -- 172.21.15.55:0/2352805952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3ae400 msgr2=0x5564ae4fc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e9280a640 1 --2- 172.21.15.55:0/2352805952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3ae400 0x5564ae4fc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e9280a640 1 -- 172.21.15.55:0/2352805952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3ae000 msgr2=0x5564ae4fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e9280a640 1 --2- 172.21.15.55:0/2352805952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3ae000 0x5564ae4fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e9280a640 1 -- 172.21.15.55:0/2352805952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564ae4c1680 con 0x5564af26bc00 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e9280a640 1 --2- 172.21.15.55:0/2352805952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26bc00 0x5564ae4fb600 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x5564af3529f0 tx=0x5564af3bc000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4973a30d6a84a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e8d800640 1 -- 172.21.15.55:0/2352805952 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5564ae4b0680 con 0x5564af26bc00 2024-04-25T09:03:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e8d800640 1 -- 172.21.15.55:0/2352805952 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5564ae4b6c40 con 0x5564af26bc00 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.305+0000 7f5e8d800640 1 -- 172.21.15.55:0/2352805952 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5564ae4b09c0 con 0x5564af26bc00 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.306+0000 7f5e9385b280 1 -- 172.21.15.55:0/2352805952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26bc00 msgr2=0x5564ae4fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.306+0000 7f5e9385b280 1 --2- 172.21.15.55:0/2352805952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26bc00 0x5564ae4fb600 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x5564af3529f0 tx=0x5564af3bc000 comp rx=0 tx=0).stop 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.306+0000 7f5e9385b280 1 -- 172.21.15.55:0/2352805952 shutdown_connections 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.306+0000 7f5e9385b280 1 --2- 172.21.15.55:0/2352805952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3ae400 0x5564ae4fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.306+0000 7f5e9385b280 1 --2- 172.21.15.55:0/2352805952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3ae000 0x5564ae4fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.306+0000 7f5e9385b280 1 --2- 172.21.15.55:0/2352805952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26bc00 0x5564ae4fb600 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.306+0000 7f5e9385b280 1 -- 172.21.15.55:0/2352805952 >> 172.21.15.55:0/2352805952 conn(0x5564af26b800 msgr2=0x5564ae570800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.306+0000 7f5e9385b280 1 -- 172.21.15.55:0/2352805952 shutdown_connections 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.306+0000 7f5e9385b280 1 -- 172.21.15.55:0/2352805952 wait complete. 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.306+0000 7f5e9385b280 1 Processor -- start 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.306+0000 7f5e9385b280 1 -- start start 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26b800 0x5564ae4fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3af000 0x5564ae4fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3aec00 0x5564ae4fc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9385b280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af269380 con 0x5564af26b800 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9385b280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af268180 con 0x5564af3aec00 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9385b280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564af269500 con 0x5564af3af000 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9280a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26b800 0x5564ae4fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9280a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26b800 0x5564ae4fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55654/0 (socket says 172.21.15.55:55654) 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9280a640 1 -- 172.21.15.55:0/1958808406 learned_addr learned my addr 172.21.15.55:0/1958808406 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e91808640 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3aec00 0x5564ae4fc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e92009640 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3af000 0x5564ae4fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9280a640 1 -- 172.21.15.55:0/1958808406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3af000 msgr2=0x5564ae4fcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9280a640 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3af000 0x5564ae4fcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9280a640 1 -- 172.21.15.55:0/1958808406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3aec00 msgr2=0x5564ae4fc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9280a640 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3aec00 0x5564ae4fc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9280a640 1 -- 172.21.15.55:0/1958808406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564ae4c14a0 con 0x5564af26b800 2024-04-25T09:03:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.307+0000 7f5e9280a640 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26b800 0x5564ae4fd180 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x5564af3536b0 tx=0x5564af350420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.308+0000 7f5e8bffd640 1 -- 172.21.15.55:0/1958808406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5564ae4b0680 con 0x5564af26b800 2024-04-25T09:03:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.308+0000 7f5e8bffd640 1 -- 172.21.15.55:0/1958808406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5564ae4b61c0 con 0x5564af26b800 2024-04-25T09:03:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.308+0000 7f5e9385b280 1 -- 172.21.15.55:0/1958808406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5564ae4c0960 con 0x5564af26b800 2024-04-25T09:03:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.308+0000 7f5e8bffd640 1 -- 172.21.15.55:0/1958808406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5564ae4b09c0 con 0x5564af26b800 2024-04-25T09:03:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.308+0000 7f5e9385b280 1 -- 172.21.15.55:0/1958808406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564ae4c1a40 con 0x5564af26b800 2024-04-25T09:03:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.308+0000 7f5e9385b280 4 main: JournalTool: resolving pool 16 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.309+0000 7f5e8bffd640 1 -- 172.21.15.55:0/1958808406 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x5564af3bac00 con 0x5564af26b800 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.309+0000 7f5e8bffd640 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5564ae7f2000 0x5564ae4fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.309+0000 7f5e8bffd640 1 -- 172.21.15.55:0/1958808406 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x5564af3b8a00 con 0x5564af26b800 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.309+0000 7f5e9385b280 4 main: JournalTool: creating IoCtx.. 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.309+0000 7f5e92009640 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5564ae7f2000 0x5564ae4fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.309+0000 7f5e9385b280 4 main: Executing for rank 0 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.310+0000 7f5e92009640 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5564ae7f2000 0x5564ae4fd700 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x5564af2b7890 tx=0x5564af3501e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.310+0000 7f5e9385b280 1 -- start start 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.310+0000 7f5e9385b280 1 Processor -- start 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3ae400 0x5564ae4fc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3ae000 0x5564ae4fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e9385b280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae7f3400 0x5564ae4fb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e9385b280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af269800 con 0x5564ae7f3400 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e9385b280 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af269980 con 0x5564af3ae400 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e9385b280 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564ae4ec900 con 0x5564af3ae000 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e91808640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae7f3400 0x5564ae4fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e91808640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae7f3400 0x5564ae4fb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55666/0 (socket says 172.21.15.55:55666) 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e91808640 1 -- 172.21.15.55:0/199385686 learned_addr learned my addr 172.21.15.55:0/199385686 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e92009640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3ae000 0x5564ae4fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e9280a640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3ae400 0x5564ae4fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e91808640 1 -- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3ae000 msgr2=0x5564ae4fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e91808640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3ae000 0x5564ae4fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e91808640 1 -- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3ae400 msgr2=0x5564ae4fc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e91808640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3ae400 0x5564ae4fc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e91808640 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564ae4c1c20 con 0x5564ae7f3400 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e91808640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae7f3400 0x5564ae4fb600 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x5564ae79fb00 tx=0x5564ae7fcc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79942413f34a6ebc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e88ff7640 1 -- 172.21.15.55:0/199385686 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5564af3ff520 con 0x5564ae7f3400 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e88ff7640 1 -- 172.21.15.55:0/199385686 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5564ae4b68c0 con 0x5564ae7f3400 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e88ff7640 1 -- 172.21.15.55:0/199385686 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5564af3ff380 con 0x5564ae7f3400 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564ae4c0000 con 0x5564ae7f3400 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5564ae4c1680 con 0x5564ae7f3400 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.311+0000 7f5e9385b280 4 waiting for MDS map... 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.312+0000 7f5e88ff7640 1 -- 172.21.15.55:0/199385686 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x5564ae85a600 con 0x5564ae7f3400 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.312+0000 7f5e88ff7640 1 -- 172.21.15.55:0/199385686 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 93) v1 ==== 2723+0+0 (secure 0 0 0) 0x5564ae868000 con 0x5564ae7f3400 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.312+0000 7f5e9385b280 4 Got MDS map 93 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.312+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5564ae7f3800 0x5564ae876000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.312+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:1 16.f 16:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x5564ae7f3c00 con 0x5564ae7f3800 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.312+0000 7f5e9280a640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5564ae7f3800 0x5564ae876000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.312+0000 7f5e9280a640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5564ae7f3800 0x5564ae876000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=5aab2f40ceab4f64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.316+0000 7f5e9280a640 1 -- 172.21.15.55:0/199385686 <== osd.0 v2:172.21.15.55:6808/382211730 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v117'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5564ae564000 con 0x5564ae7f3800 2024-04-25T09:03:57.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.316+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:2 16.14 16:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x5564ae859000 con 0x5564ae7f3800 2024-04-25T09:03:57.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.317+0000 7f5e9280a640 1 -- 172.21.15.55:0/199385686 <== osd.0 v2:172.21.15.55:6808/382211730 2 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v117'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5564ae564000 con 0x5564ae7f3800 2024-04-25T09:03:57.315 INFO:teuthology.orchestra.run.smithi055.stdout:writing EResetJournal entry 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.317+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:3 16.14 16:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x5564ae859400 con 0x5564ae7f3800 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x5564ae859800 0x5564ae876580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:4 16.1b 16:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x5564ae859c00 con 0x5564ae859800 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5564ae882000 0x5564ae876b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:5 16.b 16:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x5564ae882400 con 0x5564ae882000 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:6 16.1f 16:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x5564ae882800 con 0x5564ae859800 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x5564ae882c00 0x5564ae877080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:7 16.1a 16:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x5564ae883000 con 0x5564ae882c00 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5564ae883400 0x5564ae877600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:8 16.1e 16:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x5564ae883800 con 0x5564ae883400 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e9280a640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5564ae882000 0x5564ae876b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e92009640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x5564ae882c00 0x5564ae877080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e91808640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5564ae883400 0x5564ae877600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e92009640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x5564ae859800 0x5564ae876580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e9280a640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5564ae882000 0x5564ae876b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=8c4392669f75208c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.318+0000 7f5e92009640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x5564ae882c00 0x5564ae877080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=19110c8af8591c8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.319+0000 7f5e92009640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x5564ae859800 0x5564ae876580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=ce8a9ddb22dc16a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.319+0000 7f5e91808640 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5564ae883400 0x5564ae877600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=eec4c615b64209c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.319+0000 7f5e9280a640 1 -- 172.21.15.55:0/199385686 <== osd.0 v2:172.21.15.55:6808/382211730 3 ==== osd_op_reply(3 200.00000001 [delete] v117'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5564ae564000 con 0x5564ae7f3800 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.319+0000 7f5e9280a640 1 -- 172.21.15.55:0/199385686 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(5 200.00000003 [delete] v117'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5564ae564000 con 0x5564ae882000 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.320+0000 7f5e92009640 1 -- 172.21.15.55:0/199385686 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== osd_op_reply(7 200.00000005 [delete] v117'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5564ae564500 con 0x5564ae882c00 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.320+0000 7f5e92009640 1 -- 172.21.15.55:0/199385686 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== osd_op_reply(6 200.00000004 [delete] v117'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5564ae564500 con 0x5564ae859800 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.320+0000 7f5e92009640 1 -- 172.21.15.55:0/199385686 <== osd.5 v2:172.21.15.167:6800/1337224202 2 ==== osd_op_reply(4 200.00000002 [delete] v117'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5564ae564500 con 0x5564ae859800 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.320+0000 7f5e877f4640 1 -- 172.21.15.55:0/199385686 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:9 16.14 16:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x5564ae7f3000 con 0x5564ae7f3800 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.322+0000 7f5e91808640 1 -- 172.21.15.55:0/199385686 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== osd_op_reply(8 200.00000006 [delete] v117'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5564ae564780 con 0x5564ae883400 2024-04-25T09:03:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9280a640 1 -- 172.21.15.55:0/199385686 <== osd.0 v2:172.21.15.55:6808/382211730 4 ==== osd_op_reply(9 200.00000001 [write 0~48] v117'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5564ae564000 con 0x5564ae7f3800 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 4 Successfully wrote new journal pointer and header for rank 8:0 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5564ae7f3800 msgr2=0x5564ae876000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x5564ae7f3800 0x5564ae876000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5564ae882000 msgr2=0x5564ae876b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x5564ae882000 0x5564ae876b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x5564ae882c00 msgr2=0x5564ae877080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x5564ae882c00 0x5564ae877080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e91808640 1 -- 172.21.15.55:0/199385686 reap_dead start 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x5564ae859800 msgr2=0x5564ae876580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x5564ae859800 0x5564ae876580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5564ae883400 msgr2=0x5564ae877600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5564ae883400 0x5564ae877600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae7f3400 msgr2=0x5564ae4fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae7f3400 0x5564ae4fb600 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x5564ae79fb00 tx=0x5564ae7fcc00 comp rx=0 tx=0).stop 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 shutdown_connections 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x5564ae883400 0x5564ae877600 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x5564ae859800 0x5564ae876580 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 --2- 172.21.15.55:0/199385686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae7f3400 0x5564ae4fb600 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 >> 172.21.15.55:0/199385686 conn(0x5564af3ae800 msgr2=0x5564ae570000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 shutdown_connections 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/199385686 wait complete. 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/1958808406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5564ae7f2000 msgr2=0x5564ae4fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5564ae7f2000 0x5564ae4fd700 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x5564af2b7890 tx=0x5564af3501e0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 -- 172.21.15.55:0/1958808406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26b800 msgr2=0x5564ae4fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.325+0000 7f5e9385b280 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26b800 0x5564ae4fd180 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x5564af3536b0 tx=0x5564af350420 comp rx=0 tx=0).stop 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 -- 172.21.15.55:0/1958808406 shutdown_connections 2024-04-25T09:03:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x5564ae7f2000 0x5564ae4fd700 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564af3aec00 0x5564ae4fc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564af3af000 0x5564ae4fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 --2- 172.21.15.55:0/1958808406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564af26b800 0x5564ae4fd180 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 -- 172.21.15.55:0/1958808406 >> 172.21.15.55:0/1958808406 conn(0x5564af26bc00 msgr2=0x5564ae570800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 -- 172.21.15.55:0/1958808406 shutdown_connections 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 -- 172.21.15.55:0/1958808406 wait complete. 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 -- 172.21.15.55:0/2353191176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae48ac00 msgr2=0x5564ae4fa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 --2- 172.21.15.55:0/2353191176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae48ac00 0x5564ae4fa580 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x5564af2b73b0 tx=0x5564af350120 comp rx=0 tx=0).stop 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 -- 172.21.15.55:0/2353191176 shutdown_connections 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 --2- 172.21.15.55:0/2353191176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5564ae48bc00 0x5564ae4fb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 --2- 172.21.15.55:0/2353191176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae48b800 0x5564ae4fab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 --2- 172.21.15.55:0/2353191176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5564ae48ac00 0x5564ae4fa580 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 -- 172.21.15.55:0/2353191176 >> 172.21.15.55:0/2353191176 conn(0x5564ae48b000 msgr2=0x5564ae571000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 -- 172.21.15.55:0/2353191176 shutdown_connections 2024-04-25T09:03:57.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.326+0000 7f5e9385b280 1 -- 172.21.15.55:0/2353191176 wait complete. 2024-04-25T09:03:57.325 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.080408, result: writing EResetJournal entry 2024-04-25T09:03:57.325 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T09:03:57.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f70685a8740 1 -- start start 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f70685a8740 1 Processor -- start 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f70685a8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360cb2800 0x55635ff56b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f70685a8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360cb3c00 0x55635ff57b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f70685a8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360cb3400 0x55635ff57080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f70685a8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556360cfa000 con 0x556360cb3c00 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f70685a8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556360cfa180 con 0x556360cb3400 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f70685a8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556360cfa300 con 0x556360cb2800 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f7064b97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360cb3c00 0x55635ff57b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f7064b97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360cb3c00 0x55635ff57b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55676/0 (socket says 172.21.15.55:55676) 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f7064b97640 1 -- 172.21.15.55:0/2447570366 learned_addr learned my addr 172.21.15.55:0/2447570366 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f7065398640 1 --2- 172.21.15.55:0/2447570366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360cb2800 0x55635ff56b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.412+0000 7f7065b99640 1 --2- 172.21.15.55:0/2447570366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360cb3400 0x55635ff57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f7064b97640 1 -- 172.21.15.55:0/2447570366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360cb2800 msgr2=0x55635ff56b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f7064b97640 1 --2- 172.21.15.55:0/2447570366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360cb2800 0x55635ff56b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f7064b97640 1 -- 172.21.15.55:0/2447570366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360cb3400 msgr2=0x55635ff57080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f7064b97640 1 --2- 172.21.15.55:0/2447570366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360cb3400 0x55635ff57080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f7064b97640 1 -- 172.21.15.55:0/2447570366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55635ff13680 con 0x556360cb3c00 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f7064b97640 1 --2- 172.21.15.55:0/2447570366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360cb3c00 0x55635ff57b80 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x556360d11ad0 tx=0x556360db8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299a621786d30f44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f7062b93640 1 -- 172.21.15.55:0/2447570366 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55635ff0c9c0 con 0x556360cb3c00 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f7062b93640 1 -- 172.21.15.55:0/2447570366 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55635ff30c40 con 0x556360cb3c00 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f7062b93640 1 -- 172.21.15.55:0/2447570366 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55635ff0cb60 con 0x556360cb3c00 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f70685a8740 1 -- 172.21.15.55:0/2447570366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55635ff123c0 con 0x556360cb3c00 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f70685a8740 1 -- 172.21.15.55:0/2447570366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55635ff12b40 con 0x556360cb3c00 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f70685a8740 4 waiting for MDS map... 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f7062b93640 1 -- 172.21.15.55:0/2447570366 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x556360dbc600 con 0x556360cb3c00 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f7062b93640 1 -- 172.21.15.55:0/2447570366 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 93) v1 ==== 2723+0+0 (secure 0 0 0) 0x55635ff3f180 con 0x556360cb3c00 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f70685a8740 4 Got MDS map 93 2024-04-25T09:03:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f70685a8740 4 datascan.main: Using metadata pool output 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.413+0000 7f70685a8740 4 datascan.main: connecting to RADOS... 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.414+0000 7f70685a8740 1 Processor -- start 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.414+0000 7f70685a8740 1 -- start start 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.414+0000 7f70685a8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360dbac00 0x55635ff56580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.414+0000 7f70685a8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb000 0x55635ff58100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.414+0000 7f70685a8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360dbb400 0x55635ff58680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.414+0000 7f70685a8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556360cfa480 con 0x556360dbb000 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.414+0000 7f70685a8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556360cfa600 con 0x556360dbb400 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.414+0000 7f70685a8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556360cfa780 con 0x556360dbac00 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.414+0000 7f7065398640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb000 0x55635ff58100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7065398640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb000 0x55635ff58100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55690/0 (socket says 172.21.15.55:55690) 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7065398640 1 -- 172.21.15.55:0/4161908219 learned_addr learned my addr 172.21.15.55:0/4161908219 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7065b99640 1 --2- 172.21.15.55:0/4161908219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360dbac00 0x55635ff56580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7064b97640 1 --2- 172.21.15.55:0/4161908219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360dbb400 0x55635ff58680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7065398640 1 -- 172.21.15.55:0/4161908219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360dbac00 msgr2=0x55635ff56580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7065398640 1 --2- 172.21.15.55:0/4161908219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360dbac00 0x55635ff56580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7065398640 1 -- 172.21.15.55:0/4161908219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360dbb400 msgr2=0x55635ff58680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7065398640 1 --2- 172.21.15.55:0/4161908219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360dbb400 0x55635ff58680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7065398640 1 -- 172.21.15.55:0/4161908219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55635ff13c20 con 0x556360dbb000 2024-04-25T09:03:57.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7065398640 1 --2- 172.21.15.55:0/4161908219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb000 0x55635ff58100 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x556360dcee70 tx=0x556360e24000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ceb5f4a4dcf178a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7060b8f640 1 -- 172.21.15.55:0/4161908219 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55635ff0c9c0 con 0x556360dbb000 2024-04-25T09:03:57.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7060b8f640 1 -- 172.21.15.55:0/4161908219 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55635ff30a80 con 0x556360dbb000 2024-04-25T09:03:57.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.415+0000 7f7060b8f640 1 -- 172.21.15.55:0/4161908219 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55635ff0cb60 con 0x556360dbb000 2024-04-25T09:03:57.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.416+0000 7f70685a8740 1 -- 172.21.15.55:0/4161908219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb000 msgr2=0x55635ff58100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.416+0000 7f70685a8740 1 --2- 172.21.15.55:0/4161908219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb000 0x55635ff58100 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x556360dcee70 tx=0x556360e24000 comp rx=0 tx=0).stop 2024-04-25T09:03:57.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.416+0000 7f70685a8740 1 -- 172.21.15.55:0/4161908219 shutdown_connections 2024-04-25T09:03:57.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.416+0000 7f70685a8740 1 --2- 172.21.15.55:0/4161908219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360dbb400 0x55635ff58680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.416+0000 7f70685a8740 1 --2- 172.21.15.55:0/4161908219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb000 0x55635ff58100 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.416+0000 7f70685a8740 1 --2- 172.21.15.55:0/4161908219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360dbac00 0x55635ff56580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.416+0000 7f70685a8740 1 -- 172.21.15.55:0/4161908219 >> 172.21.15.55:0/4161908219 conn(0x556360cb3800 msgr2=0x55635ffcf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.416+0000 7f70685a8740 1 -- 172.21.15.55:0/4161908219 shutdown_connections 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.416+0000 7f70685a8740 1 -- 172.21.15.55:0/4161908219 wait complete. 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.416+0000 7f70685a8740 1 Processor -- start 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.416+0000 7f70685a8740 1 -- start start 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f70685a8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360dbac00 0x55635ff56580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f70685a8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360dbb000 0x55635ff58100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f70685a8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb400 0x55635ff58680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f70685a8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556360cfbe00 con 0x556360dbb400 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f70685a8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556360cfbc80 con 0x556360dbb000 2024-04-25T09:03:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f70685a8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556360cfbb00 con 0x556360dbac00 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f7064b97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb400 0x55635ff58680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f7064b97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb400 0x55635ff58680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55698/0 (socket says 172.21.15.55:55698) 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 learned_addr learned my addr 172.21.15.55:0/3739264291 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f7065b99640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360dbac00 0x55635ff56580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f7065398640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360dbb000 0x55635ff58100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360dbac00 msgr2=0x55635ff56580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f7064b97640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360dbac00 0x55635ff56580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360dbb000 msgr2=0x55635ff58100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f7064b97640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360dbb000 0x55635ff58100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55635ff13680 con 0x556360dbb400 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f7064b97640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb400 0x55635ff58680 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x556360dcfbc0 tx=0x556360c79800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f705f38c640 1 -- 172.21.15.55:0/3739264291 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55635ff0c820 con 0x556360dbb400 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f705f38c640 1 -- 172.21.15.55:0/3739264291 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55635ff31500 con 0x556360dbb400 2024-04-25T09:03:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55635ff123c0 con 0x556360dbb400 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.417+0000 7f705f38c640 1 -- 172.21.15.55:0/3739264291 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55635ff0c9c0 con 0x556360dbb400 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.418+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55635ff13e00 con 0x556360dbb400 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.418+0000 7f70685a8740 4 datascan.init: resolving metadata pool 16 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.419+0000 7f705f38c640 1 -- 172.21.15.55:0/3739264291 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x556360e2cc00 con 0x556360dbb400 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.419+0000 7f705f38c640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x556360e23c00 0x55635ff59700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.419+0000 7f705f38c640 1 -- 172.21.15.55:0/3739264291 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x556360e2aa00 con 0x556360dbb400 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.419+0000 7f70685a8740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.419+0000 7f70685a8740 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.419+0000 7f70685a8740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.419+0000 7f7065b99640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x556360e23c00 0x55635ff59700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.419+0000 7f70685a8740 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x556360dbb800 0x55635ff58c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.419+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360dbbc00 con 0x556360dbb800 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.419+0000 7f7065398640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x556360dbb800 0x55635ff58c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.420+0000 7f7065b99640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x556360e23c00 0x55635ff59700 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x55635ff27620 tx=0x556360c796e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.420+0000 7f7065398640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x556360dbb800 0x55635ff58c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.420+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== osd_op_reply(1 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.420+0000 7f706038e640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x556360e22800 0x55636026c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.420+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:2 17.20 17:04000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360e22000 con 0x556360e22800 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.420+0000 7f7065b99640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x556360e22800 0x55636026c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.421+0000 7f7065b99640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x556360e22800 0x55636026c000 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.421+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(2 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e22800 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.421+0000 7f7060b8f640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x556360dbbc00 0x55636026c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.421+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:3 17.10 17:08000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274000 con 0x556360dbbc00 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.421+0000 7f7065398640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x556360dbbc00 0x55636026c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.421+0000 7f7065398640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x556360dbbc00 0x55636026c580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.422+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== osd_op_reply(3 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbbc00 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.422+0000 7f706038e640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x556360e22400 0x55636026cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.422+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:4 17.30 17:0c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274800 con 0x556360e22400 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.422+0000 7f7064b97640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x556360e22400 0x55636026cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.422+0000 7f7064b97640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x556360e22400 0x55636026cb00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.422+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 1 ==== osd_op_reply(4 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.422+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:5 17.8 17:10000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274400 con 0x556360dbb800 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.423+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 2 ==== osd_op_reply(5 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.423+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:6 17.28 17:14000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274c00 con 0x556360dbbc00 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.423+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.3 v2:172.21.15.55:6816/2016500802 2 ==== osd_op_reply(6 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbbc00 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.423+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:7 17.18 17:18000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275400 con 0x556360e22400 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.423+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 2 ==== osd_op_reply(7 [pgnls start_epoch 117 out=81b] v115'17 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.423+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:8 17.18 17:1ad8d55b:::10000000006.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027a000 con 0x556360e22400 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.424+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 3 ==== osd_op_reply(8 10000000006.00000001 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.424+0000 7f70685a8740 10 datascan.operator(): handling object 1099511627782.1 2024-04-25T09:03:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.424+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:9 17.25 17:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027a400 con 0x556360e22800 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.425+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.1 v2:172.21.15.55:6800/2726345870 2 ==== osd_op_reply(9 10000000006.00000000 [call] v117'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55635ffd4500 con 0x556360e22800 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.425+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:10 17.38 17:1c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027a800 con 0x556360dbb800 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.425+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 3 ==== osd_op_reply(10 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.425+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:11 17.4 17:20000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275800 con 0x556360e22400 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.426+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 4 ==== osd_op_reply(11 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.426+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:12 17.24 17:24000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275000 con 0x556360dbbc00 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.426+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.3 v2:172.21.15.55:6816/2016500802 3 ==== osd_op_reply(12 [pgnls start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbbc00 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.426+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:13 17.14 17:28000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275c00 con 0x556360dbbc00 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.426+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.3 v2:172.21.15.55:6816/2016500802 4 ==== osd_op_reply(13 [pgnls start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbbc00 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.426+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:14 17.34 17:2c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274000 con 0x556360e22400 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.426+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 5 ==== osd_op_reply(14 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.426+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:15 17.c 17:30000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274400 con 0x556360dbb800 2024-04-25T09:03:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.427+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 4 ==== osd_op_reply(15 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.427+0000 7f706038e640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x556360e23800 0x55636026d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.427+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:16 17.2c 17:34000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360e23400 con 0x556360e23800 2024-04-25T09:03:57.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.427+0000 7f7065b99640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x556360e23800 0x55636026d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.427+0000 7f7065b99640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x556360e23800 0x55636026d080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.428+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== osd_op_reply(16 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e23800 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.428+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:17 17.1c 17:38000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274c00 con 0x556360e22800 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.428+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.1 v2:172.21.15.55:6800/2726345870 3 ==== osd_op_reply(17 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e22800 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.428+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:18 17.3c 17:3c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360e23000 con 0x556360e22400 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.428+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 6 ==== osd_op_reply(18 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.428+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:19 17.2 17:40000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275000 con 0x556360e23800 2024-04-25T09:03:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.429+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.4 v2:172.21.15.167:6808/1392386852 2 ==== osd_op_reply(19 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e23800 2024-04-25T09:03:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.429+0000 7f706038e640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x556360274c00 0x55636026d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.429+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:20 17.22 17:44000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275000 con 0x556360274c00 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.429+0000 7f7065398640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x556360274c00 0x55636026d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.429+0000 7f7065398640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x556360274c00 0x55636026d600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.430+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== osd_op_reply(20 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360274c00 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.430+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:21 17.12 17:48000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274800 con 0x556360dbbc00 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.430+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.3 v2:172.21.15.55:6816/2016500802 5 ==== osd_op_reply(21 [pgnls start_epoch 117 out=81b] v116'22 uv22 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbbc00 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.430+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:22 17.12 17:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027ac00 con 0x556360dbbc00 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.430+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.3 v2:172.21.15.55:6816/2016500802 6 ==== osd_op_reply(22 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbbc00 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.430+0000 7f70685a8740 10 datascan.operator(): handling object 1099511627778.0 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.430+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:23 17.12 17:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027b000 con 0x556360dbbc00 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.431+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.3 v2:172.21.15.55:6816/2016500802 7 ==== osd_op_reply(23 10000000002.00000000 [call] v117'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbbc00 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.431+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:24 17.32 17:4c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027b400 con 0x556360dbb800 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.432+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 5 ==== osd_op_reply(24 [pgnls start_epoch 117 out=81b] v115'16 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.432+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:25 17.32 17:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027ac00 con 0x556360dbb800 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.432+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 6 ==== osd_op_reply(25 10000000003.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.432+0000 7f70685a8740 10 datascan.operator(): handling object 1099511627779.0 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.432+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:26 17.32 17:4def72d4:::10000000003.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027b000 con 0x556360dbb800 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.433+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 7 ==== osd_op_reply(26 10000000003.00000000 [call] v117'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.433+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:27 17.a 17:50000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275c00 con 0x556360dbb800 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.434+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 8 ==== osd_op_reply(27 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.434+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:28 17.2a 17:54000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360e22000 con 0x556360dbbc00 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.434+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.3 v2:172.21.15.55:6816/2016500802 8 ==== osd_op_reply(28 [pgnls start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbbc00 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.434+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:29 17.1a 17:58000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027a400 con 0x556360e22400 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.434+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 7 ==== osd_op_reply(29 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.434+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:30 17.3a 17:5c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360e23400 con 0x556360e22800 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.435+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.1 v2:172.21.15.55:6800/2726345870 4 ==== osd_op_reply(30 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e22800 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.435+0000 7f7060b8f640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55636027a800 0x55636026e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.435+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:31 17.6 17:60000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027a000 con 0x55636027a800 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.435+0000 7f7064b97640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55636027a800 0x55636026e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.435+0000 7f7064b97640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55636027a800 0x55636026e680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.435+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== osd_op_reply(31 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x55636027a800 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.436+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:32 17.26 17:64000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55635fee7800 con 0x556360e22400 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.436+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 8 ==== osd_op_reply(32 [pgnls start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.436+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:33 17.16 17:68000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027b800 con 0x556360274c00 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.436+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.5 v2:172.21.15.167:6800/1337224202 2 ==== osd_op_reply(33 [pgnls start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360274c00 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.436+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:34 17.36 17:6c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029c000 con 0x556360e22400 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.436+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 9 ==== osd_op_reply(34 [pgnls start_epoch 117 out=49b] v115'32 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.436+0000 7f7060b8f640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55636027bc00 0x55636026ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.436+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:35 17.e 17:70000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55635fee7800 con 0x55636027bc00 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.437+0000 7f7065b99640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55636027bc00 0x55636026ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.437+0000 7f7065b99640 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55636027bc00 0x55636026ec00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.437+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.2 v2:172.21.15.55:6824/2942240833 1 ==== osd_op_reply(35 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x55636027bc00 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.437+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:36 17.2e 17:74000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029c400 con 0x55636027a800 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.437+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.6 v2:172.21.15.167:6820/1814554564 2 ==== osd_op_reply(36 [pgnls start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x55636027a800 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.437+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:37 17.1e 17:78000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027a400 con 0x556360e22800 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.438+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.1 v2:172.21.15.55:6800/2726345870 5 ==== osd_op_reply(37 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e22800 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.438+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:38 17.3e 17:7c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029c800 con 0x556360e23800 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.438+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.4 v2:172.21.15.167:6808/1392386852 3 ==== osd_op_reply(38 [pgnls start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e23800 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.438+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:39 17.1 17:80000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027a000 con 0x556360e22400 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.438+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 10 ==== osd_op_reply(39 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.438+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:40 17.21 17:84000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029cc00 con 0x556360e22400 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.439+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 11 ==== osd_op_reply(40 [pgnls start_epoch 117 out=49b] v115'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.439+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:41 17.11 17:88000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360e23000 con 0x556360dbbc00 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.439+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.3 v2:172.21.15.55:6816/2016500802 9 ==== osd_op_reply(41 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbbc00 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.439+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:42 17.31 17:8c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029d000 con 0x556360e22800 2024-04-25T09:03:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.439+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.1 v2:172.21.15.55:6800/2726345870 6 ==== osd_op_reply(42 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e22800 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.439+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:43 17.9 17:90000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275800 con 0x556360dbbc00 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.439+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.3 v2:172.21.15.55:6816/2016500802 10 ==== osd_op_reply(43 [pgnls start_epoch 117 out=49b] v115'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbbc00 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.439+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:44 17.29 17:94000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029d400 con 0x556360e23800 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.440+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.4 v2:172.21.15.167:6808/1392386852 4 ==== osd_op_reply(44 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e23800 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.440+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:45 17.19 17:98000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274000 con 0x556360274c00 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.440+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.5 v2:172.21.15.167:6800/1337224202 3 ==== osd_op_reply(45 [pgnls start_epoch 117 out=49b] v115'21 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360274c00 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.440+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:46 17.39 17:9c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360e22000 con 0x556360274c00 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.440+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.5 v2:172.21.15.167:6800/1337224202 4 ==== osd_op_reply(46 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360274c00 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.440+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:47 17.5 17:a0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029c000 con 0x55636027a800 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.441+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.6 v2:172.21.15.167:6820/1814554564 3 ==== osd_op_reply(47 [pgnls start_epoch 117 out=81b] v116'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55635ffd4780 con 0x55636027a800 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.441+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:48 17.5 17:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274400 con 0x55636027a800 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.441+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.6 v2:172.21.15.167:6820/1814554564 4 ==== osd_op_reply(48 10000000004.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55635ffd4780 con 0x55636027a800 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.441+0000 7f70685a8740 10 datascan.operator(): handling object 1099511627780.0 2024-04-25T09:03:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.441+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:49 17.5 17:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275000 con 0x55636027a800 2024-04-25T09:03:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.443+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.6 v2:172.21.15.167:6820/1814554564 5 ==== osd_op_reply(49 10000000004.00000000 [call] v117'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55635ffd4780 con 0x55636027a800 2024-04-25T09:03:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.443+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:50 17.25 17:a4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274800 con 0x556360e22800 2024-04-25T09:03:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.443+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.1 v2:172.21.15.55:6800/2726345870 7 ==== osd_op_reply(50 [pgnls start_epoch 117 out=81b] v117'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55635ffd4500 con 0x556360e22800 2024-04-25T09:03:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.443+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:51 17.25 17:a5feb6f3:::10000000006.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275400 con 0x556360e22800 2024-04-25T09:03:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.443+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.1 v2:172.21.15.55:6800/2726345870 8 ==== osd_op_reply(51 10000000006.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55635ffd4500 con 0x556360e22800 2024-04-25T09:03:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.443+0000 7f70685a8740 10 datascan.operator(): handling object 1099511627782.0 2024-04-25T09:03:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.443+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:52 17.25 17:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274800 con 0x556360e22800 2024-04-25T09:03:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.444+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.1 v2:172.21.15.55:6800/2726345870 9 ==== osd_op_reply(52 10000000006.00000000 [call] v117'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55635ffd4500 con 0x556360e22800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.444+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:53 17.15 17:a8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029c800 con 0x556360274c00 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.445+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.5 v2:172.21.15.167:6800/1337224202 5 ==== osd_op_reply(53 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360274c00 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.445+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:54 17.35 17:ac000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360e23000 con 0x556360e23800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.445+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.4 v2:172.21.15.167:6808/1392386852 5 ==== osd_op_reply(54 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e23800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.445+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:55 17.d 17:b0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029d800 con 0x556360dbb800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.446+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 9 ==== osd_op_reply(55 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.446+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:56 17.2d 17:b4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027b400 con 0x556360dbb800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.446+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 10 ==== osd_op_reply(56 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.446+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:57 17.1d 17:b8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029dc00 con 0x556360dbb800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.446+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 11 ==== osd_op_reply(57 [pgnls start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.447+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:58 17.3d 17:bc000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027ac00 con 0x556360dbb800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.447+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 12 ==== osd_op_reply(58 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.447+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:59 17.3 17:c0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027b400 con 0x556360e23800 2024-04-25T09:03:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.447+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.4 v2:172.21.15.167:6808/1392386852 6 ==== osd_op_reply(59 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e23800 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.447+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:60 17.23 17:c4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027b000 con 0x556360e23800 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.447+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.4 v2:172.21.15.167:6808/1392386852 7 ==== osd_op_reply(60 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e23800 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.447+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:61 17.13 17:c8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027ac00 con 0x556360dbbc00 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.448+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.3 v2:172.21.15.55:6816/2016500802 11 ==== osd_op_reply(61 [pgnls start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbbc00 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.448+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:62 17.33 17:cc000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636027b800 con 0x556360dbb800 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.448+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 <== osd.7 v2:172.21.15.167:6816/2254116283 13 ==== osd_op_reply(62 [pgnls start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4000 con 0x556360dbb800 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.448+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:63 17.b 17:d0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029c800 con 0x556360e22400 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.448+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 12 ==== osd_op_reply(63 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.448+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:64 17.2b 17:d4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275c00 con 0x556360e23800 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.449+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.4 v2:172.21.15.167:6808/1392386852 8 ==== osd_op_reply(64 [pgnls start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e23800 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.449+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:65 17.1b 17:d8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029d800 con 0x556360e23800 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.449+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.4 v2:172.21.15.167:6808/1392386852 9 ==== osd_op_reply(65 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e23800 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.449+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:66 17.3b 17:dc000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x5563602a2000 con 0x55636027bc00 2024-04-25T09:03:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.449+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.2 v2:172.21.15.55:6824/2942240833 2 ==== osd_op_reply(66 [pgnls start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x55636027bc00 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.450+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:67 17.7 17:e0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55636029dc00 con 0x556360e22400 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.450+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 13 ==== osd_op_reply(67 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.450+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:68 17.27 17:e4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x5563602a2400 con 0x556360e23800 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.450+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.4 v2:172.21.15.167:6808/1392386852 10 ==== osd_op_reply(68 [pgnls start_epoch 117 out=49b] v115'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e23800 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.450+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:69 17.17 17:e8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360e22000 con 0x55636027a800 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.451+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.6 v2:172.21.15.167:6820/1814554564 6 ==== osd_op_reply(69 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x55636027a800 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.451+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:70 17.37 17:ec000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x5563602a2800 con 0x556360e22400 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.451+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 14 ==== osd_op_reply(70 [pgnls start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.451+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:71 17.f 17:f0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360275800 con 0x556360e22800 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.451+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.1 v2:172.21.15.55:6800/2726345870 10 ==== osd_op_reply(71 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e22800 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.451+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:72 17.2f 17:f4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x5563602a2c00 con 0x556360e23800 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.451+0000 7f7065b99640 1 -- 172.21.15.55:0/3739264291 <== osd.4 v2:172.21.15.167:6808/1392386852 11 ==== osd_op_reply(72 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4500 con 0x556360e23800 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.451+0000 7f7060b8f640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:73 17.1f 17:f8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x556360274000 con 0x55636027a800 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.6 v2:172.21.15.167:6820/1814554564 7 ==== osd_op_reply(73 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x55636027a800 2024-04-25T09:03:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f706038e640 1 -- 172.21.15.55:0/3739264291 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:74 17.3f 17:fc000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x5563602a3000 con 0x556360e22400 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f7064b97640 1 -- 172.21.15.55:0/3739264291 <== osd.0 v2:172.21.15.55:6808/382211730 15 ==== osd_op_reply(74 [pgnls start_epoch 117 out=49b] v115'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55635ffd4780 con 0x556360e22400 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x556360e22400 msgr2=0x55636026cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x556360e22400 0x55636026cb00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x556360e22800 msgr2=0x55636026c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x556360e22800 0x55636026c000 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55636027bc00 msgr2=0x55636026ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55636027bc00 0x55636026ec00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x556360dbbc00 msgr2=0x55636026c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x556360dbbc00 0x55636026c580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 reap_dead start 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x556360e23800 msgr2=0x55636026d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x556360e23800 0x55636026d080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 reap_dead start 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x556360274c00 msgr2=0x55636026d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x556360274c00 0x55636026d600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55636027a800 msgr2=0x55636026e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55636027a800 0x55636026e680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x556360dbb800 msgr2=0x55635ff58c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x556360dbb800 0x55635ff58c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x556360e23c00 msgr2=0x55635ff59700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x556360e23c00 0x55635ff59700 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x55635ff27620 tx=0x556360c796e0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb400 msgr2=0x55635ff58680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 --2- 172.21.15.55:0/3739264291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360dbb400 0x55635ff58680 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x556360dcfbc0 tx=0x556360c79800 comp rx=0 tx=0).stop 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f7065398640 1 -- 172.21.15.55:0/3739264291 reap_dead start 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 shutdown_connections 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 >> 172.21.15.55:0/3739264291 conn(0x556360cb3800 msgr2=0x55635ffcf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 shutdown_connections 2024-04-25T09:03:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.452+0000 7f70685a8740 1 -- 172.21.15.55:0/3739264291 wait complete. 2024-04-25T09:03:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.453+0000 7f70685a8740 1 -- 172.21.15.55:0/2447570366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360cb3c00 msgr2=0x55635ff57b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.453+0000 7f70685a8740 1 --2- 172.21.15.55:0/2447570366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360cb3c00 0x55635ff57b80 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x556360d11ad0 tx=0x556360db8000 comp rx=0 tx=0).stop 2024-04-25T09:03:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.453+0000 7f70685a8740 1 -- 172.21.15.55:0/2447570366 shutdown_connections 2024-04-25T09:03:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.453+0000 7f70685a8740 1 --2- 172.21.15.55:0/2447570366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556360cb3400 0x55635ff57080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.453+0000 7f70685a8740 1 --2- 172.21.15.55:0/2447570366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556360cb3c00 0x55635ff57b80 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.453+0000 7f70685a8740 1 --2- 172.21.15.55:0/2447570366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556360cb2800 0x55635ff56b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.453+0000 7f70685a8740 1 -- 172.21.15.55:0/2447570366 >> 172.21.15.55:0/2447570366 conn(0x55635fee7000 msgr2=0x55635ffce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.453+0000 7f70685a8740 1 -- 172.21.15.55:0/2447570366 shutdown_connections 2024-04-25T09:03:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.453+0000 7f70685a8740 1 -- 172.21.15.55:0/2447570366 wait complete. 2024-04-25T09:03:57.452 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.127303, result: 2024-04-25T09:03:57.453 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-04-25T09:03:57.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.540+0000 7f808b81f740 1 -- start start 2024-04-25T09:03:57.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.540+0000 7f808b81f740 1 Processor -- start 2024-04-25T09:03:57.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.540+0000 7f808b81f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbc05cc00 0x55dbbc0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f808b81f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbc05d800 0x55dbbc0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f808b81f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbc05dc00 0x55dbbc0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f808b81f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbc1d0780 con 0x55dbbc05cc00 2024-04-25T09:03:57.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f808b81f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbc1d0600 con 0x55dbbc05dc00 2024-04-25T09:03:57.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f808b81f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbbc1d0480 con 0x55dbbc05d800 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8089445640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbc05cc00 0x55dbbc0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8089445640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbc05cc00 0x55dbbc0cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55712/0 (socket says 172.21.15.55:55712) 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8089445640 1 -- 172.21.15.55:0/2227584701 learned_addr learned my addr 172.21.15.55:0/2227584701 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8089c46640 1 --2- 172.21.15.55:0/2227584701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbc05dc00 0x55dbbc0cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8088c44640 1 --2- 172.21.15.55:0/2227584701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbc05d800 0x55dbbc0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8089445640 1 -- 172.21.15.55:0/2227584701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbc05d800 msgr2=0x55dbbc0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8089445640 1 --2- 172.21.15.55:0/2227584701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbc05d800 0x55dbbc0ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8089445640 1 -- 172.21.15.55:0/2227584701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbc05dc00 msgr2=0x55dbbc0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8089445640 1 --2- 172.21.15.55:0/2227584701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbc05dc00 0x55dbbc0cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8089445640 1 -- 172.21.15.55:0/2227584701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbbc089680 con 0x55dbbc05cc00 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8089445640 1 --2- 172.21.15.55:0/2227584701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbc05cc00 0x55dbbc0cc580 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x55dbbce6f200 tx=0x55dbbcf1a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2409ecd8ff1229fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8086c40640 1 -- 172.21.15.55:0/2227584701 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbc0829c0 con 0x55dbbc05cc00 2024-04-25T09:03:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8086c40640 1 -- 172.21.15.55:0/2227584701 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dbbc0a6e00 con 0x55dbbc05cc00 2024-04-25T09:03:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f808b81f740 1 -- 172.21.15.55:0/2227584701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbbc089860 con 0x55dbbc05cc00 2024-04-25T09:03:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f808b81f740 1 -- 172.21.15.55:0/2227584701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55dbbc0892c0 con 0x55dbbc05cc00 2024-04-25T09:03:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f808b81f740 4 waiting for MDS map... 2024-04-25T09:03:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.541+0000 7f8086c40640 1 -- 172.21.15.55:0/2227584701 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbc082680 con 0x55dbbc05cc00 2024-04-25T09:03:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.542+0000 7f8086c40640 1 -- 172.21.15.55:0/2227584701 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x55dbbcf32200 con 0x55dbbc05cc00 2024-04-25T09:03:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.542+0000 7f8086c40640 1 -- 172.21.15.55:0/2227584701 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 93) v1 ==== 2723+0+0 (secure 0 0 0) 0x55dbbc0b5180 con 0x55dbbc05cc00 2024-04-25T09:03:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.542+0000 7f808b81f740 4 Got MDS map 93 2024-04-25T09:03:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.542+0000 7f808b81f740 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-04-25T09:03:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.542+0000 7f808b81f740 4 datascan.main: Using metadata pool output 2024-04-25T09:03:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.542+0000 7f808b81f740 4 datascan.main: connecting to RADOS... 2024-04-25T09:03:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.542+0000 7f808b81f740 1 Processor -- start 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.542+0000 7f808b81f740 1 -- start start 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f808b81f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbc139c00 0x55dbbc0cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f808b81f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbcf74000 0x55dbbc0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f808b81f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf74400 0x55dbbc0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f808b81f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbc1d0300 con 0x55dbbcf74400 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f808b81f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbc1d0000 con 0x55dbbc139c00 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f808b81f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbbc0bc900 con 0x55dbbcf74000 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f8088c44640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf74400 0x55dbbc0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f8088c44640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf74400 0x55dbbc0ce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55726/0 (socket says 172.21.15.55:55726) 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f8088c44640 1 -- 172.21.15.55:0/916104722 learned_addr learned my addr 172.21.15.55:0/916104722 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f8089c46640 1 --2- 172.21.15.55:0/916104722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbc139c00 0x55dbbc0cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f8089445640 1 --2- 172.21.15.55:0/916104722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbcf74000 0x55dbbc0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f8088c44640 1 -- 172.21.15.55:0/916104722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbcf74000 msgr2=0x55dbbc0cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f8088c44640 1 --2- 172.21.15.55:0/916104722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbcf74000 0x55dbbc0cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f8088c44640 1 -- 172.21.15.55:0/916104722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbc139c00 msgr2=0x55dbbc0cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f8088c44640 1 --2- 172.21.15.55:0/916104722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbc139c00 0x55dbbc0cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f8088c44640 1 -- 172.21.15.55:0/916104722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbbc0894a0 con 0x55dbbcf74400 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.543+0000 7f8089445640 1 --2- 172.21.15.55:0/916104722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbcf74000 0x55dbbc0cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f8088c44640 1 --2- 172.21.15.55:0/916104722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf74400 0x55dbbc0ce100 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x55dbbcf147e0 tx=0x55dbbcf80000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e45084a935babe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f8084c3c640 1 -- 172.21.15.55:0/916104722 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbc0829c0 con 0x55dbbcf74400 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f8084c3c640 1 -- 172.21.15.55:0/916104722 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dbbc0a6a80 con 0x55dbbcf74400 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f8084c3c640 1 -- 172.21.15.55:0/916104722 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbc082680 con 0x55dbbcf74400 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f808b81f740 1 -- 172.21.15.55:0/916104722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf74400 msgr2=0x55dbbc0ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f808b81f740 1 --2- 172.21.15.55:0/916104722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf74400 0x55dbbc0ce100 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x55dbbcf147e0 tx=0x55dbbcf80000 comp rx=0 tx=0).stop 2024-04-25T09:03:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f808b81f740 1 -- 172.21.15.55:0/916104722 shutdown_connections 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f808b81f740 1 --2- 172.21.15.55:0/916104722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf74400 0x55dbbc0ce100 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f808b81f740 1 --2- 172.21.15.55:0/916104722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbcf74000 0x55dbbc0cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f808b81f740 1 --2- 172.21.15.55:0/916104722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbc139c00 0x55dbbc0cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f808b81f740 1 -- 172.21.15.55:0/916104722 >> 172.21.15.55:0/916104722 conn(0x55dbbc139800 msgr2=0x55dbbc145000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f808b81f740 1 -- 172.21.15.55:0/916104722 shutdown_connections 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.544+0000 7f808b81f740 1 -- 172.21.15.55:0/916104722 wait complete. 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.545+0000 7f808b81f740 1 Processor -- start 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.545+0000 7f808b81f740 1 -- start start 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.545+0000 7f808b81f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbc139800 0x55dbbc0cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.545+0000 7f808b81f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf75000 0x55dbbc0cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.545+0000 7f808b81f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbcf74c00 0x55dbbc0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.545+0000 7f808b81f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbc1d0000 con 0x55dbbcf75000 2024-04-25T09:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.545+0000 7f808b81f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbbc1d1500 con 0x55dbbcf74c00 2024-04-25T09:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.545+0000 7f808b81f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbbc1d0300 con 0x55dbbc139800 2024-04-25T09:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.545+0000 7f8089445640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf75000 0x55dbbc0cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.545+0000 7f8089445640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf75000 0x55dbbc0cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55730/0 (socket says 172.21.15.55:55730) 2024-04-25T09:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.545+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 learned_addr learned my addr 172.21.15.55:0/1272407502 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8089c46640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbc139800 0x55dbbc0cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbc139800 msgr2=0x55dbbc0cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8088c44640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbcf74c00 0x55dbbc0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8089445640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbc139800 0x55dbbc0cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbcf74c00 msgr2=0x55dbbc0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8089445640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbcf74c00 0x55dbbc0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbbc0890e0 con 0x55dbbcf75000 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8089c46640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbc139800 0x55dbbc0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8088c44640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbcf74c00 0x55dbbc0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8089445640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf75000 0x55dbbc0cec00 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x55dbbcf15a10 tx=0x55dbbcf1a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8083439640 1 -- 172.21.15.55:0/1272407502 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbc082b60 con 0x55dbbcf75000 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8083439640 1 -- 172.21.15.55:0/1272407502 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dbbc0a6c40 con 0x55dbbcf75000 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dbbc089a40 con 0x55dbbcf75000 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f8083439640 1 -- 172.21.15.55:0/1272407502 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55dbbc082820 con 0x55dbbcf75000 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbbc0883c0 con 0x55dbbcf75000 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.546+0000 7f808b81f740 4 datascan.init: resolving metadata pool 16 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.547+0000 7f8083439640 1 -- 172.21.15.55:0/1272407502 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x55dbbcf82c00 con 0x55dbbcf75000 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f8083439640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55dbbcfa1000 0x55dbbc0cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f8083439640 1 -- 172.21.15.55:0/1272407502 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x55dbbcf7b200 con 0x55dbbcf75000 2024-04-25T09:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f808b81f740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f808b81f740 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-25T09:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f808b81f740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f8089c46640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55dbbcfa1000 0x55dbbc0cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55dbbcf74800 0x55dbbc0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:1 16.14 16:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf74400 con 0x55dbbcf74800 2024-04-25T09:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f8088c44640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55dbbcf74800 0x55dbbc0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f8089c46640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55dbbcfa1000 0x55dbbc0cf700 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55dbbcdf0fc0 tx=0x55dbbcf806c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f8088c44640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55dbbcf74800 0x55dbbc0ce100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.548+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv34 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.549+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55dbbcf74000 0x55dbbc0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.549+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:2 16.1f 16:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf75c00 con 0x55dbbcf74000 2024-04-25T09:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.549+0000 7f8089c46640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55dbbcf74000 0x55dbbc0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.549+0000 7f8089c46640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55dbbcf74000 0x55dbbc0cdb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.550+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbcf74000 2024-04-25T09:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.550+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55dbbcf75400 0x55dbbc0cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.550+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:3 17.0 17:00000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf75800 con 0x55dbbcf75400 2024-04-25T09:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.550+0000 7f8089445640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55dbbcf75400 0x55dbbc0cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.550+0000 7f8089445640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55dbbcf75400 0x55dbbc0cd600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.551+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.551+0000 7f808443b640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55dbbc3e4000 0x55dbbc3ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.551+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:4 17.20 17:04000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e4400 con 0x55dbbc3e4000 2024-04-25T09:03:57.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.551+0000 7f8088c44640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55dbbc3e4000 0x55dbbc3ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.551+0000 7f8088c44640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55dbbc3e4000 0x55dbbc3ea000 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.551+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3e4000 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.551+0000 7f8084c3c640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55dbbc3e4c00 0x55dbbc3ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.551+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:5 17.10 17:08000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5000 con 0x55dbbc3e4c00 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.551+0000 7f8089c46640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55dbbc3e4c00 0x55dbbc3ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.552+0000 7f8089c46640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55dbbc3e4c00 0x55dbbc3ea580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.552+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.552+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:6 17.30 17:0c000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e4800 con 0x55dbbcf74800 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.552+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.552+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:7 17.8 17:10000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5400 con 0x55dbbcf75400 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.553+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.553+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:8 17.28 17:14000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5800 con 0x55dbbc3e4c00 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.553+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.553+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:9 17.18 17:18000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5000 con 0x55dbbcf74800 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.554+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 3 ==== osd_op_reply(9 [pgnls-filter start_epoch 117 out=49b] v115'17 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.554+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:10 17.38 17:1c000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5c00 con 0x55dbbcf75400 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.554+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 3 ==== osd_op_reply(10 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.554+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:11 17.4 17:20000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf75c00 con 0x55dbbcf74800 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.554+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.554+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:12 17.24 17:24000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5800 con 0x55dbbc3e4c00 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.554+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 3 ==== osd_op_reply(12 [pgnls-filter start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.554+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:13 17.14 17:28000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcfa1c00 con 0x55dbbc3e4c00 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.555+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 4 ==== osd_op_reply(13 [pgnls-filter start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.555+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:14 17.34 17:2c000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4000 con 0x55dbbcf74800 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.555+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.555+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:15 17.c 17:30000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf75c00 con 0x55dbbcf75400 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.555+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 4 ==== osd_op_reply(15 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.555+0000 7f808443b640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55dbbc3f4400 0x55dbbc3eab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.555+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:16 17.2c 17:34000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4800 con 0x55dbbc3f4400 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.556+0000 7f8089445640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55dbbc3f4400 0x55dbbc3eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.556+0000 7f8089445640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55dbbc3f4400 0x55dbbc3eab00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.556+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.556+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:17 17.1c 17:38000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e4400 con 0x55dbbc3e4000 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.557+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.1 v2:172.21.15.55:6800/2726345870 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3e4000 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.557+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:18 17.3c 17:3c000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4c00 con 0x55dbbcf74800 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.557+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 6 ==== osd_op_reply(18 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.557+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:19 17.2 17:40000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e4800 con 0x55dbbc3f4400 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.557+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.557+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:20 17.22 17:44000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5000 con 0x55dbbcf74000 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.558+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.5 v2:172.21.15.167:6800/1337224202 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbcf74000 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.558+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:21 17.12 17:48000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5000 con 0x55dbbc3e4c00 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.558+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 5 ==== osd_op_reply(21 [pgnls-filter start_epoch 117 out=81b] v117'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.558+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:22 17.0 17:00000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf74400 con 0x55dbbcf75400 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.559+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.559+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:23 17.20 17:04000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf75800 con 0x55dbbc3e4000 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.559+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.1 v2:172.21.15.55:6800/2726345870 3 ==== osd_op_reply(23 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3e4000 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.559+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:24 17.10 17:08000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4000 con 0x55dbbc3e4c00 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.559+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 6 ==== osd_op_reply(24 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.559+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:25 17.30 17:0c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5400 con 0x55dbbcf74800 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.559+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.559+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:26 17.8 17:10000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5400 con 0x55dbbcf75400 2024-04-25T09:03:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.560+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 6 ==== osd_op_reply(26 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.560+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:27 17.28 17:14000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5c00 con 0x55dbbc3e4c00 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.560+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 7 ==== osd_op_reply(27 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.560+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:28 17.18 17:18000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5800 con 0x55dbbcf74800 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.560+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 8 ==== osd_op_reply(28 [pgnls-filter start_epoch 117 out=49b] v115'17 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.560+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:29 17.38 17:1c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcfa0c00 con 0x55dbbcf75400 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.561+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 7 ==== osd_op_reply(29 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.561+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:30 17.4 17:20000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5c00 con 0x55dbbcf74800 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.561+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 9 ==== osd_op_reply(30 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.561+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:31 17.24 17:24000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcfa0800 con 0x55dbbc3e4c00 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.561+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 8 ==== osd_op_reply(31 [pgnls-filter start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.561+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:32 17.14 17:28000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf75c00 con 0x55dbbc3e4c00 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.561+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 9 ==== osd_op_reply(32 [pgnls-filter start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.561+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:33 17.34 17:2c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e4400 con 0x55dbbcf74800 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.562+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 10 ==== osd_op_reply(33 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.562+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:34 17.c 17:30000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4c00 con 0x55dbbcf75400 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.562+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 8 ==== osd_op_reply(34 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.562+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:35 17.2c 17:34000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5400 con 0x55dbbc3f4400 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.562+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.562+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:36 17.1c 17:38000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5800 con 0x55dbbc3e4000 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.563+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.1 v2:172.21.15.55:6800/2726345870 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3e4000 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.563+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:37 17.3c 17:3c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5800 con 0x55dbbcf74800 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.563+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 11 ==== osd_op_reply(37 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.563+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:38 17.2 17:40000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5c00 con 0x55dbbc3f4400 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.563+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.563+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:39 17.22 17:44000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5000 con 0x55dbbcf74000 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.564+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.5 v2:172.21.15.167:6800/1337224202 3 ==== osd_op_reply(39 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbcf74000 2024-04-25T09:03:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.564+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:40 17.12 17:48000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5000 con 0x55dbbc3e4c00 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.564+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 10 ==== osd_op_reply(40 [pgnls-filter start_epoch 117 out=49b] v117'23 uv23 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.564+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:41 17.32 17:4c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcfa1c00 con 0x55dbbcf75400 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.564+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 9 ==== osd_op_reply(41 [pgnls-filter start_epoch 117 out=81b] v117'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.564+0000 7f808b81f740 20 datascan.forall_objects: OSD matched oid 10000000003.00000000 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.564+0000 7f808b81f740 10 datascan.operator(): handling object 10000000003.0 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.564+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:42 17.32 17:4def72d4:::10000000003.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5400 con 0x55dbbcf75400 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.565+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 10 ==== osd_op_reply(42 10000000003.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+194 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.565+0000 7f808b81f740 10 datascan.inject_with_backtrace: inode: 0x0x10000000003 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.565+0000 7f808b81f740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.565+0000 7f808b81f740 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.565+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:43 16.7 16:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4800 con 0x55dbbc3e4c00 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.565+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 11 ==== osd_op_reply(43 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.565+0000 7f808b81f740 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-04-25T09:03:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.565+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55dbbc3f5400 0x55dbbc3eb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.565+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:44 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4c00 con 0x55dbbc3f5400 2024-04-25T09:03:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.565+0000 7f8088c44640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55dbbc3f5400 0x55dbbc3eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f8088c44640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55dbbc3f5400 0x55dbbc3eb600 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.2 v2:172.21.15.55:6824/2942240833 1 ==== osd_op_reply(44 10000000000.00000000 [omap-get-vals-by-keys out=585b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+585 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3f5400 2024-04-25T09:03:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f808b81f740 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-04-25T09:03:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f808b81f740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-25T09:03:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f808b81f740 20 datascan.get_frag_of: frag is * 2024-04-25T09:03:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:45 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcfa0c00 con 0x55dbbc3e4c00 2024-04-25T09:03:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 12 ==== osd_op_reply(45 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f808b81f740 10 datascan.find_or_create_dirfrag: read_version = 8 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f808b81f740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:46 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf74400 con 0x55dbbc3e4c00 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 13 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f808b81f740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f808b81f740 20 datascan.read_dentry: bravo_head not found in result 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f808b81f740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000003 at 0x0x10000000001/bravo with size=5 bytes 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.566+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:47 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5000 con 0x55dbbc3e4c00 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.568+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 14 ==== osd_op_reply(47 10000000001.00000000 [omap-set-vals] v117'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.568+0000 7f808b81f740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x10000000003 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.568+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:48 17.a 17:50000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4800 con 0x55dbbcf75400 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.568+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 11 ==== osd_op_reply(48 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.568+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:49 17.2a 17:54000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf75800 con 0x55dbbc3e4c00 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.569+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 15 ==== osd_op_reply(49 [pgnls-filter start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.569+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:50 17.1a 17:58000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4000 con 0x55dbbcf74800 2024-04-25T09:03:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.569+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 12 ==== osd_op_reply(50 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.569+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:51 17.3a 17:5c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc410000 con 0x55dbbc3e4000 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.569+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.1 v2:172.21.15.55:6800/2726345870 5 ==== osd_op_reply(51 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3e4000 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.569+0000 7f808443b640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55dbbc411c00 0x55dbbc3eb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.569+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:52 17.6 17:60000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc412000 con 0x55dbbc411c00 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.570+0000 7f8089c46640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55dbbc411c00 0x55dbbc3eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.570+0000 7f8089c46640 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55dbbc411c00 0x55dbbc3eb080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.570+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== osd_op_reply(52 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc411c00 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.570+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:53 17.26 17:64000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc410400 con 0x55dbbcf74800 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.570+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 13 ==== osd_op_reply(53 [pgnls-filter start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.571+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:54 17.16 17:68000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc412400 con 0x55dbbcf74000 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.571+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.5 v2:172.21.15.167:6800/1337224202 4 ==== osd_op_reply(54 [pgnls-filter start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbcf74000 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.571+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:55 17.36 17:6c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc410800 con 0x55dbbcf74800 2024-04-25T09:03:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.571+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 14 ==== osd_op_reply(55 [pgnls-filter start_epoch 117 out=49b] v115'32 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.571+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:56 17.e 17:70000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc412800 con 0x55dbbc3f5400 2024-04-25T09:03:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.571+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.2 v2:172.21.15.55:6824/2942240833 2 ==== osd_op_reply(56 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3f5400 2024-04-25T09:03:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.571+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:57 17.2e 17:74000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc410c00 con 0x55dbbc411c00 2024-04-25T09:03:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.572+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.6 v2:172.21.15.167:6820/1814554564 2 ==== osd_op_reply(57 [pgnls-filter start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc411c00 2024-04-25T09:03:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.572+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:58 17.1e 17:78000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc412c00 con 0x55dbbc3e4000 2024-04-25T09:03:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.572+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.1 v2:172.21.15.55:6800/2726345870 6 ==== osd_op_reply(58 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3e4000 2024-04-25T09:03:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.572+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:59 17.3e 17:7c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc411000 con 0x55dbbc3f4400 2024-04-25T09:03:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.572+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 5 ==== osd_op_reply(59 [pgnls-filter start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.572+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:60 17.1 17:80000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc413000 con 0x55dbbcf74800 2024-04-25T09:03:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.573+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 15 ==== osd_op_reply(60 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.573+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:61 17.21 17:84000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc411400 con 0x55dbbcf74800 2024-04-25T09:03:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.573+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 16 ==== osd_op_reply(61 [pgnls-filter start_epoch 117 out=49b] v115'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.573+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:62 17.11 17:88000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc413400 con 0x55dbbc3e4c00 2024-04-25T09:03:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.573+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 16 ==== osd_op_reply(62 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.573+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:63 17.31 17:8c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc411800 con 0x55dbbc3e4000 2024-04-25T09:03:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.573+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.1 v2:172.21.15.55:6800/2726345870 7 ==== osd_op_reply(63 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3e4000 2024-04-25T09:03:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.573+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:64 17.9 17:90000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc413800 con 0x55dbbc3e4c00 2024-04-25T09:03:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.574+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 17 ==== osd_op_reply(64 [pgnls-filter start_epoch 117 out=49b] v115'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.574+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:65 17.29 17:94000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5000 con 0x55dbbc3f4400 2024-04-25T09:03:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.574+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.574+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:66 17.19 17:98000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc413c00 con 0x55dbbcf74000 2024-04-25T09:03:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.574+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.5 v2:172.21.15.167:6800/1337224202 5 ==== osd_op_reply(66 [pgnls-filter start_epoch 117 out=49b] v115'21 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbcf74000 2024-04-25T09:03:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.575+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:67 17.39 17:9c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e4400 con 0x55dbbcf74000 2024-04-25T09:03:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.575+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.5 v2:172.21.15.167:6800/1337224202 6 ==== osd_op_reply(67 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbcf74000 2024-04-25T09:03:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.575+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc410c00 con 0x55dbbc411c00 2024-04-25T09:03:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.575+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.6 v2:172.21.15.167:6820/1814554564 3 ==== osd_op_reply(68 [pgnls-filter start_epoch 117 out=49b] v117'12 uv12 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc411c00 2024-04-25T09:03:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.575+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:69 17.25 17:a4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5800 con 0x55dbbc3e4000 2024-04-25T09:03:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.576+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.1 v2:172.21.15.55:6800/2726345870 8 ==== osd_op_reply(69 [pgnls-filter start_epoch 117 out=49b] v117'17 uv17 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3e4000 2024-04-25T09:03:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.576+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:70 17.15 17:a8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc410000 con 0x55dbbcf74000 2024-04-25T09:03:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.576+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.5 v2:172.21.15.167:6800/1337224202 7 ==== osd_op_reply(70 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbcf74000 2024-04-25T09:03:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.576+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:71 17.35 17:ac000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc412000 con 0x55dbbc3f4400 2024-04-25T09:03:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.576+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 7 ==== osd_op_reply(71 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.576+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:72 17.d 17:b0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc410400 con 0x55dbbcf75400 2024-04-25T09:03:57.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.577+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 12 ==== osd_op_reply(72 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.577+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:73 17.2d 17:b4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc412400 con 0x55dbbcf75400 2024-04-25T09:03:57.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.577+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 13 ==== osd_op_reply(73 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.577+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:74 17.1d 17:b8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5800 con 0x55dbbcf75400 2024-04-25T09:03:57.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.578+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 14 ==== osd_op_reply(74 [pgnls-filter start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.578+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:75 17.3d 17:bc000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf74400 con 0x55dbbcf75400 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.578+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 15 ==== osd_op_reply(75 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.578+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:76 17.3 17:c0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4c00 con 0x55dbbc3f4400 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.578+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.578+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:77 17.23 17:c4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcf75800 con 0x55dbbc3f4400 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.579+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 9 ==== osd_op_reply(77 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.579+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:78 17.13 17:c8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4000 con 0x55dbbc3e4c00 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.579+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.3 v2:172.21.15.55:6816/2016500802 18 ==== osd_op_reply(78 [pgnls-filter start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc3e4c00 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.579+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:79 17.33 17:cc000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbcfa0c00 con 0x55dbbcf75400 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.580+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.7 v2:172.21.15.167:6816/2254116283 16 ==== osd_op_reply(79 [pgnls-filter start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbcf75400 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.580+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:80 17.b 17:d0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc412000 con 0x55dbbcf74800 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.580+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 17 ==== osd_op_reply(80 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.580+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:81 17.2b 17:d4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc412800 con 0x55dbbc3f4400 2024-04-25T09:03:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.580+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 10 ==== osd_op_reply(81 [pgnls-filter start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.580+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:82 17.1b 17:d8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5c00 con 0x55dbbc3f4400 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.581+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 11 ==== osd_op_reply(82 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.581+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:83 17.3b 17:dc000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc412c00 con 0x55dbbc3f5400 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.581+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.2 v2:172.21.15.55:6824/2942240833 3 ==== osd_op_reply(83 [pgnls-filter start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3f5400 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.581+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:84 17.7 17:e0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f4800 con 0x55dbbcf74800 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.581+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 18 ==== osd_op_reply(84 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.581+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:85 17.27 17:e4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc413000 con 0x55dbbc3f4400 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.581+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 117 out=49b] v115'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.582+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:86 17.17 17:e8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3f5000 con 0x55dbbc411c00 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.582+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.6 v2:172.21.15.167:6820/1814554564 4 ==== osd_op_reply(86 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc411c00 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.582+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:87 17.37 17:ec000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc412000 con 0x55dbbcf74800 2024-04-25T09:03:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.582+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 19 ==== osd_op_reply(87 [pgnls-filter start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.582+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:88 17.f 17:f0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc411000 con 0x55dbbc3e4000 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.583+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.1 v2:172.21.15.55:6800/2726345870 9 ==== osd_op_reply(88 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbc3e4000 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.583+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:89 17.2f 17:f4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5800 con 0x55dbbc3f4400 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.583+0000 7f8089445640 1 -- 172.21.15.55:0/1272407502 <== osd.4 v2:172.21.15.167:6808/1392386852 13 ==== osd_op_reply(89 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a780 con 0x55dbbc3f4400 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.583+0000 7f808443b640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:90 17.1f 17:f8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc3e5400 con 0x55dbbc411c00 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.583+0000 7f8089c46640 1 -- 172.21.15.55:0/1272407502 <== osd.6 v2:172.21.15.167:6820/1814554564 5 ==== osd_op_reply(90 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a500 con 0x55dbbc411c00 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f8084c3c640 1 -- 172.21.15.55:0/1272407502 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:91 17.3f 17:fc000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55dbbc410800 con 0x55dbbcf74800 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 <== osd.0 v2:172.21.15.55:6808/382211730 20 ==== osd_op_reply(91 [pgnls-filter start_epoch 117 out=49b] v115'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55dbbc14a000 con 0x55dbbcf74800 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55dbbcf74800 msgr2=0x55dbbc0ce100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55dbbcf74800 0x55dbbc0ce100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55dbbc3e4000 msgr2=0x55dbbc3ea000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55dbbc3e4000 0x55dbbc3ea000 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55dbbc3f5400 msgr2=0x55dbbc3eb600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55dbbc3f5400 0x55dbbc3eb600 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55dbbc3e4c00 msgr2=0x55dbbc3ea580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55dbbc3e4c00 0x55dbbc3ea580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55dbbc3f4400 msgr2=0x55dbbc3eab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55dbbc3f4400 0x55dbbc3eab00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55dbbcf74000 msgr2=0x55dbbc0cdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55dbbcf74000 0x55dbbc0cdb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55dbbc411c00 msgr2=0x55dbbc3eb080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55dbbc411c00 0x55dbbc3eb080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55dbbcf75400 msgr2=0x55dbbc0cd600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55dbbcf75400 0x55dbbc0cd600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 reap_dead start 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55dbbcfa1000 msgr2=0x55dbbc0cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55dbbcfa1000 0x55dbbc0cf700 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55dbbcdf0fc0 tx=0x55dbbcf806c0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 reap_dead start 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f8088c44640 1 -- 172.21.15.55:0/1272407502 reap_dead start 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf75000 msgr2=0x55dbbc0cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf75000 0x55dbbc0cec00 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x55dbbcf15a10 tx=0x55dbbcf1a1e0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 shutdown_connections 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 --2- 172.21.15.55:0/1272407502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbcf75000 0x55dbbc0cec00 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 >> 172.21.15.55:0/1272407502 conn(0x55dbbc139c00 msgr2=0x55dbbc145000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 shutdown_connections 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.584+0000 7f808b81f740 1 -- 172.21.15.55:0/1272407502 wait complete. 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.585+0000 7f808b81f740 1 -- 172.21.15.55:0/2227584701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbc05cc00 msgr2=0x55dbbc0cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.585+0000 7f808b81f740 1 --2- 172.21.15.55:0/2227584701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbc05cc00 0x55dbbc0cc580 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x55dbbce6f200 tx=0x55dbbcf1a120 comp rx=0 tx=0).stop 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.585+0000 7f808b81f740 1 -- 172.21.15.55:0/2227584701 shutdown_connections 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.585+0000 7f808b81f740 1 --2- 172.21.15.55:0/2227584701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbbc05dc00 0x55dbbc0cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.585+0000 7f808b81f740 1 --2- 172.21.15.55:0/2227584701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55dbbc05d800 0x55dbbc0ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.585+0000 7f808b81f740 1 --2- 172.21.15.55:0/2227584701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55dbbc05cc00 0x55dbbc0cc580 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.585+0000 7f808b81f740 1 -- 172.21.15.55:0/2227584701 >> 172.21.15.55:0/2227584701 conn(0x55dbbc05d000 msgr2=0x55dbbc144800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.585+0000 7f808b81f740 1 -- 172.21.15.55:0/2227584701 shutdown_connections 2024-04-25T09:03:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.585+0000 7f808b81f740 1 -- 172.21.15.55:0/2227584701 wait complete. 2024-04-25T09:03:57.590 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.137401, result: 2024-04-25T09:03:57.590 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T09:03:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.674+0000 7f5121c12740 1 -- start start 2024-04-25T09:03:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.674+0000 7f5121c12740 1 Processor -- start 2024-04-25T09:03:57.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.674+0000 7f5121c12740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc668dac00 0x55fc6694a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.674+0000 7f5121c12740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc668db800 0x55fc6694ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.674+0000 7f5121c12740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc668dbc00 0x55fc6694b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.674+0000 7f5121c12740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc676a0180 con 0x55fc668dac00 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.674+0000 7f5121c12740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc676a0300 con 0x55fc668db800 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.674+0000 7f5121c12740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc676a0480 con 0x55fc668dbc00 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.674+0000 7f511f8d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc668dac00 0x55fc6694a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.674+0000 7f511f8d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc668dac00 0x55fc6694a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55744/0 (socket says 172.21.15.55:55744) 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.674+0000 7f511f8d8640 1 -- 172.21.15.55:0/3251422647 learned_addr learned my addr 172.21.15.55:0/3251422647 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f511f8d8640 1 -- 172.21.15.55:0/3251422647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc668dbc00 msgr2=0x55fc6694b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f511f8d8640 1 --2- 172.21.15.55:0/3251422647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc668dbc00 0x55fc6694b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f511f8d8640 1 -- 172.21.15.55:0/3251422647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc668db800 msgr2=0x55fc6694ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f511f8d8640 1 --2- 172.21.15.55:0/3251422647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc668db800 0x55fc6694ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f511f8d8640 1 -- 172.21.15.55:0/3251422647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc66907680 con 0x55fc668dac00 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f511f8d8640 1 --2- 172.21.15.55:0/3251422647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc668dac00 0x55fc6694a580 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x55fc676e1c80 tx=0x55fc66bcc120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63dcedc06b87a82d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f511d0d3640 1 -- 172.21.15.55:0/3251422647 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc66900680 con 0x55fc668dac00 2024-04-25T09:03:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f511d0d3640 1 -- 172.21.15.55:0/3251422647 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc66924540 con 0x55fc668dac00 2024-04-25T09:03:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f5121c12740 1 -- 172.21.15.55:0/3251422647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc669074a0 con 0x55fc668dac00 2024-04-25T09:03:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f5121c12740 1 -- 172.21.15.55:0/3251422647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55fc66907a40 con 0x55fc668dac00 2024-04-25T09:03:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f5121c12740 4 waiting for MDS map... 2024-04-25T09:03:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f511d0d3640 1 -- 172.21.15.55:0/3251422647 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc66900b60 con 0x55fc668dac00 2024-04-25T09:03:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f511d0d3640 1 -- 172.21.15.55:0/3251422647 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x55fc66bdc600 con 0x55fc668dac00 2024-04-25T09:03:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f511d0d3640 1 -- 172.21.15.55:0/3251422647 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 93) v1 ==== 2723+0+0 (secure 0 0 0) 0x55fc66933180 con 0x55fc668dac00 2024-04-25T09:03:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f5121c12740 4 Got MDS map 93 2024-04-25T09:03:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f5121c12740 4 datascan.main: Using metadata pool output 2024-04-25T09:03:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.675+0000 7f5121c12740 4 datascan.main: connecting to RADOS... 2024-04-25T09:03:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.676+0000 7f5121c12740 1 Processor -- start 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.676+0000 7f5121c12740 1 -- start start 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.676+0000 7f5121c12740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc66bdf000 0x55fc6694b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.676+0000 7f5121c12740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc66bdf400 0x55fc6694bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.676+0000 7f5121c12740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf800 0x55fc6694c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.676+0000 7f5121c12740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc676a0600 con 0x55fc66bdf800 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.676+0000 7f5121c12740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc676a0780 con 0x55fc66bdf400 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.676+0000 7f5121c12740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc676a0900 con 0x55fc66bdf000 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511f0d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf800 0x55fc6694c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511f0d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf800 0x55fc6694c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55752/0 (socket says 172.21.15.55:55752) 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511f0d7640 1 -- 172.21.15.55:0/1809923602 learned_addr learned my addr 172.21.15.55:0/1809923602 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511f8d8640 1 --2- 172.21.15.55:0/1809923602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc66bdf400 0x55fc6694bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f51200d9640 1 --2- 172.21.15.55:0/1809923602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc66bdf000 0x55fc6694b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511f0d7640 1 -- 172.21.15.55:0/1809923602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc66bdf000 msgr2=0x55fc6694b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511f0d7640 1 --2- 172.21.15.55:0/1809923602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc66bdf000 0x55fc6694b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511f0d7640 1 -- 172.21.15.55:0/1809923602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc66bdf400 msgr2=0x55fc6694bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511f0d7640 1 --2- 172.21.15.55:0/1809923602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc66bdf400 0x55fc6694bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511f0d7640 1 -- 172.21.15.55:0/1809923602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc66907860 con 0x55fc66bdf800 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511f0d7640 1 --2- 172.21.15.55:0/1809923602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf800 0x55fc6694c100 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x55fc676e11d0 tx=0x55fc66c48060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4649738fe8b915 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511b0cf640 1 -- 172.21.15.55:0/1809923602 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc669009c0 con 0x55fc66bdf800 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511b0cf640 1 -- 172.21.15.55:0/1809923602 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc66924e00 con 0x55fc66bdf800 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.677+0000 7f511b0cf640 1 -- 172.21.15.55:0/1809923602 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc66900680 con 0x55fc66bdf800 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.678+0000 7f5121c12740 1 -- 172.21.15.55:0/1809923602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf800 msgr2=0x55fc6694c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.678+0000 7f5121c12740 1 --2- 172.21.15.55:0/1809923602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf800 0x55fc6694c100 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x55fc676e11d0 tx=0x55fc66c48060 comp rx=0 tx=0).stop 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.678+0000 7f5121c12740 1 -- 172.21.15.55:0/1809923602 shutdown_connections 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.678+0000 7f5121c12740 1 --2- 172.21.15.55:0/1809923602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf800 0x55fc6694c100 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.678+0000 7f5121c12740 1 --2- 172.21.15.55:0/1809923602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc66bdf400 0x55fc6694bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.678+0000 7f5121c12740 1 --2- 172.21.15.55:0/1809923602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc66bdf000 0x55fc6694b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.678+0000 7f5121c12740 1 -- 172.21.15.55:0/1809923602 >> 172.21.15.55:0/1809923602 conn(0x55fc66bdec00 msgr2=0x55fc669c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.678+0000 7f5121c12740 1 -- 172.21.15.55:0/1809923602 shutdown_connections 2024-04-25T09:03:57.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.678+0000 7f5121c12740 1 -- 172.21.15.55:0/1809923602 wait complete. 2024-04-25T09:03:57.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.678+0000 7f5121c12740 1 Processor -- start 2024-04-25T09:03:57.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.678+0000 7f5121c12740 1 -- start start 2024-04-25T09:03:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f5121c12740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf000 0x55fc6694d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f5121c12740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc66bdf400 0x55fc6694cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f5121c12740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc66bdf800 0x55fc6694c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f5121c12740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc676a1b00 con 0x55fc66bdf000 2024-04-25T09:03:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f5121c12740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc676a1980 con 0x55fc66bdf800 2024-04-25T09:03:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f5121c12740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc676a1800 con 0x55fc66bdf400 2024-04-25T09:03:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f51200d9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf000 0x55fc6694d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f51200d9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf000 0x55fc6694d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55766/0 (socket says 172.21.15.55:55766) 2024-04-25T09:03:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 learned_addr learned my addr 172.21.15.55:0/366766845 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f511f8d8640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc66bdf400 0x55fc6694cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f511f0d7640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc66bdf800 0x55fc6694c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc66bdf400 msgr2=0x55fc6694cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc66bdf400 0x55fc6694cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc66bdf800 msgr2=0x55fc6694c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc66bdf800 0x55fc6694c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc66907680 con 0x55fc66bdf000 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf000 0x55fc6694d180 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x55fc66beba70 tx=0x55fc66bcdf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.679+0000 7f51198cc640 1 -- 172.21.15.55:0/366766845 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc669009c0 con 0x55fc66bdf000 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.680+0000 7f51198cc640 1 -- 172.21.15.55:0/366766845 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc66924a80 con 0x55fc66bdf000 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.680+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc669074a0 con 0x55fc66bdf000 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.680+0000 7f51198cc640 1 -- 172.21.15.55:0/366766845 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc66900680 con 0x55fc66bdf000 2024-04-25T09:03:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.680+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc66907a40 con 0x55fc66bdf000 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.680+0000 7f5121c12740 4 datascan.init: resolving metadata pool 16 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.681+0000 7f51198cc640 1 -- 172.21.15.55:0/366766845 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x55fc66bd4c00 con 0x55fc66bdf000 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.681+0000 7f51198cc640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55fc66c4c800 0x55fc6694d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.681+0000 7f51198cc640 1 -- 172.21.15.55:0/366766845 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x55fc66c5aa00 con 0x55fc66bdf000 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.681+0000 7f5121c12740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.681+0000 7f5121c12740 4 datascan.main: resolving metadata pool 16 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.681+0000 7f511f8d8640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55fc66c4c800 0x55fc6694d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.681+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55fc66c4cc00 0x55fc6694c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.681+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:1 16.0 16:00000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66c4d000 con 0x55fc66c4cc00 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.681+0000 7f511f0d7640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55fc66c4cc00 0x55fc6694c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.682+0000 7f511f8d8640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55fc66c4c800 0x55fc6694d700 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x55fc66bea3f0 tx=0x55fc66bcc060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.682+0000 7f511f0d7640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55fc66c4cc00 0x55fc6694c100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.682+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 1 ==== osd_op_reply(1 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.682+0000 7f511f0d7640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55fc66c4d000 0x55fc66d54000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.682+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:2 16.10 16:08000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ad400 con 0x55fc66c4d000 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.682+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55fc66c4d000 0x55fc66d54000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.682+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55fc66c4d000 0x55fc66d54000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.683+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 1 ==== osd_op_reply(2 [pgnls start_epoch 117 out=177b] v116'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.683+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:3 16.8 16:10000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ad400 con 0x55fc66c4cc00 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.683+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 2 ==== osd_op_reply(3 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.683+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:4 16.18 16:18000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ad400 con 0x55fc66c4cc00 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.683+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 3 ==== osd_op_reply(4 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.683+0000 7f511f0d7640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55fc676ad400 0x55fc66d54580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.683+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:5 16.4 16:20000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ad000 con 0x55fc676ad400 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.683+0000 7f511f8d8640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55fc676ad400 0x55fc66d54580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.684+0000 7f511f8d8640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55fc676ad400 0x55fc66d54580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.684+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== osd_op_reply(5 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.684+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:6 16.14 16:28000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ad000 con 0x55fc66c4cc00 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.684+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 4 ==== osd_op_reply(6 [pgnls start_epoch 117 out=149b] v117'41 uv41 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.684+0000 7f511f0d7640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55fc676ad000 0x55fc66d54b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.684+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:7 16.c 16:30000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676acc00 con 0x55fc676ad000 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.685+0000 7f511f0d7640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55fc676ad000 0x55fc66d54b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.685+0000 7f511f0d7640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55fc676ad000 0x55fc66d54b00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.685+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== osd_op_reply(7 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.685+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:8 16.1c 16:38000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676acc00 con 0x55fc66c4d000 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.686+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 2 ==== osd_op_reply(8 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.686+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55fc676acc00 0x55fc66d55080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.686+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:9 16.2 16:40000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6a000 con 0x55fc676acc00 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.686+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55fc676acc00 0x55fc66d55080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.686+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55fc676acc00 0x55fc66d55080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.687+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== osd_op_reply(9 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8500 con 0x55fc676acc00 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.687+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55fc66d6a000 0x55fc66d55600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.687+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:10 16.12 16:48000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6a400 con 0x55fc66d6a000 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.687+0000 7f511f8d8640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55fc66d6a000 0x55fc66d55600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.687+0000 7f511f8d8640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55fc66d6a000 0x55fc66d55600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.688+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== osd_op_reply(10 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8780 con 0x55fc66d6a000 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.688+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:11 16.a 16:50000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6a400 con 0x55fc66c4d000 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.688+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 3 ==== osd_op_reply(11 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.688+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:12 16.1a 16:58000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6a400 con 0x55fc676ad400 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.688+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 2 ==== osd_op_reply(12 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.688+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:13 16.6 16:60000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6a400 con 0x55fc66d6a000 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.689+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.6 v2:172.21.15.167:6820/1814554564 2 ==== osd_op_reply(13 [pgnls start_epoch 117 out=77b] v116'9 uv9 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55fc669c8780 con 0x55fc66d6a000 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.689+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:14 16.16 16:68000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6a400 con 0x55fc676ad400 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.689+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 3 ==== osd_op_reply(14 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.689+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:15 16.e 16:70000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6a400 con 0x55fc66c4d000 2024-04-25T09:03:57.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.689+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 4 ==== osd_op_reply(15 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.689+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55fc66d6a400 0x55fc66d55b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.689+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:16 16.1e 16:78000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6a800 con 0x55fc66d6a400 2024-04-25T09:03:57.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.689+0000 7f511f0d7640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55fc66d6a400 0x55fc66d55b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.690+0000 7f511f0d7640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55fc66d6a400 0x55fc66d55b80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.690+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== osd_op_reply(16 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66d6a400 2024-04-25T09:03:57.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.690+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:17 16.1 16:80000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6a800 con 0x55fc66c4d000 2024-04-25T09:03:57.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.691+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 5 ==== osd_op_reply(17 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.691+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:18 16.11 16:88000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6a800 con 0x55fc676ad000 2024-04-25T09:03:57.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.691+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 2 ==== osd_op_reply(18 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.691+0000 7f511f0d7640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55fc66d6a800 0x55fc66d56100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.691+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:19 16.9 16:90000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc66d6a800 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.691+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55fc66d6a800 0x55fc66d56100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.691+0000 7f51200d9640 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55fc66d6a800 0x55fc66d56100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.692+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== osd_op_reply(19 [pgnls start_epoch 117 out=81b] v116'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66d6a800 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.692+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:20 16.19 16:98000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc676acc00 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.692+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.4 v2:172.21.15.167:6808/1392386852 2 ==== osd_op_reply(20 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8500 con 0x55fc676acc00 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.692+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:21 16.5 16:a0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc66c4cc00 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.692+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 5 ==== osd_op_reply(21 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.692+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:22 16.15 16:a8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc66c4cc00 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.693+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 6 ==== osd_op_reply(22 [pgnls start_epoch 117 out=97b] v116'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.693+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:23 16.d 16:b0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc66d6a000 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.693+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.6 v2:172.21.15.167:6820/1814554564 3 ==== osd_op_reply(23 [pgnls start_epoch 117 out=74b] v114'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55fc669c8780 con 0x55fc66d6a000 2024-04-25T09:03:57.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.693+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:24 16.1d 16:b8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc66c4d000 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.693+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 6 ==== osd_op_reply(24 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.693+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:25 16.3 16:c0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc676ad000 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.694+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 3 ==== osd_op_reply(25 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.694+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:26 16.13 16:c8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc66d6a800 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.694+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.1 v2:172.21.15.55:6800/2726345870 2 ==== osd_op_reply(26 [pgnls start_epoch 117 out=98b] v116'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66d6a800 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.694+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:27 16.b 16:d0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc66d6a800 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.694+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.1 v2:172.21.15.55:6800/2726345870 3 ==== osd_op_reply(27 [pgnls start_epoch 117 out=76b] v117'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66d6a800 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.694+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:28 16.1b 16:d8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc676ad000 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.695+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 4 ==== osd_op_reply(28 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.695+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:29 16.7 16:e0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc676ad400 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.695+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 4 ==== osd_op_reply(29 [pgnls start_epoch 117 out=105b] v117'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.695+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:30 16.17 16:e8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc66c4d000 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.695+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 7 ==== osd_op_reply(30 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.695+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:31 16.f 16:f0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc66c4cc00 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.696+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 7 ==== osd_op_reply(31 [pgnls start_epoch 117 out=73b] v117'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.696+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:32 16.1f 16:f8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc676ac800 con 0x55fc676ad000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.696+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 5 ==== osd_op_reply(32 [pgnls start_epoch 117 out=101b] v117'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.696+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.696+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:33 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66c4d400 con 0x55fc66c4d000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.696+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.696+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.696+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:34 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66c4d800 con 0x55fc66c4d000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:35 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66c4dc00 con 0x55fc66c4d000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1169 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:36 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6ac00 con 0x55fc66c4d000 2024-04-25T09:03:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:37 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6b000 con 0x55fc66c4d000 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.697+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:38 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6b400 con 0x55fc66c4cc00 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.698+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 8 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.698+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.698+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:39 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6b800 con 0x55fc66c4d000 2024-04-25T09:03:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.698+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.698+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.698+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.698+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.698+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:40 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6bc00 con 0x55fc66c4d000 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.698+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 14 ==== osd_op_reply(40 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.698+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 10000000005.00000000 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.698+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:41 16.9 16:9258b67d:::10000000005.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6ac00 con 0x55fc66d6a800 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.1 v2:172.21.15.55:6800/2726345870 4 ==== osd_op_reply(41 10000000005.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+584 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66d6a800 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:42 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6b000 con 0x55fc66c4cc00 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:03:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:43 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66c4d400 con 0x55fc66c4d000 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.699+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:44 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66c4d800 con 0x55fc66d6a800 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.1 v2:172.21.15.55:6800/2726345870 5 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66d6a800 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:45 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66c4dc00 con 0x55fc676ad400 2024-04-25T09:03:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 5 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:46 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e000 con 0x55fc676ad400 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 6 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1667 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 20 datascan.scan_links: injected ino detected 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.700+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:47 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e400 con 0x55fc676ad000 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.701+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 6 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+585 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.701+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:48 16.0 16:00000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4cc00 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.701+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 10 ==== osd_op_reply(48 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.701+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:49 16.10 16:08000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4d000 2024-04-25T09:03:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.702+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 16 ==== osd_op_reply(49 [pgnls start_epoch 117 out=177b] v116'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.702+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:50 16.8 16:10000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4cc00 2024-04-25T09:03:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.702+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 11 ==== osd_op_reply(50 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.702+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:51 16.18 16:18000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4cc00 2024-04-25T09:03:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.702+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 12 ==== osd_op_reply(51 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.702+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:52 16.4 16:20000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676ad400 2024-04-25T09:03:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.702+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 7 ==== osd_op_reply(52 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.702+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:53 16.14 16:28000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4cc00 2024-04-25T09:03:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.703+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 13 ==== osd_op_reply(53 [pgnls start_epoch 117 out=149b] v117'41 uv41 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.703+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:54 16.c 16:30000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676ad000 2024-04-25T09:03:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.703+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 7 ==== osd_op_reply(54 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.703+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:55 16.1c 16:38000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4d000 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.703+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 17 ==== osd_op_reply(55 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.703+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:56 16.2 16:40000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676acc00 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.704+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.4 v2:172.21.15.167:6808/1392386852 3 ==== osd_op_reply(56 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8500 con 0x55fc676acc00 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.704+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:57 16.12 16:48000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66d6a000 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.704+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.6 v2:172.21.15.167:6820/1814554564 4 ==== osd_op_reply(57 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8780 con 0x55fc66d6a000 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.704+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:58 16.a 16:50000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4d000 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.704+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 18 ==== osd_op_reply(58 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.704+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:59 16.1a 16:58000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676ad400 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.705+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 8 ==== osd_op_reply(59 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.705+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:60 16.6 16:60000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66d6a000 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.705+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.6 v2:172.21.15.167:6820/1814554564 5 ==== osd_op_reply(60 [pgnls start_epoch 117 out=77b] v116'9 uv9 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55fc669c8780 con 0x55fc66d6a000 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.705+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:61 16.16 16:68000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676ad400 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.705+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 9 ==== osd_op_reply(61 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.705+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:62 16.e 16:70000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4d000 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.705+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 19 ==== osd_op_reply(62 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.705+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- osd_op(unknown.0.0:63 16.1e 16:78000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66d6a400 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.706+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.7 v2:172.21.15.167:6816/2254116283 2 ==== osd_op_reply(63 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66d6a400 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.706+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:64 16.1 16:80000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4d000 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.706+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 20 ==== osd_op_reply(64 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.706+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:65 16.11 16:88000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676ad000 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.706+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 8 ==== osd_op_reply(65 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.706+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:66 16.9 16:90000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66d6a800 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.707+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.1 v2:172.21.15.55:6800/2726345870 6 ==== osd_op_reply(66 [pgnls start_epoch 117 out=81b] v116'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66d6a800 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.707+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- osd_op(unknown.0.0:67 16.19 16:98000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676acc00 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.707+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.4 v2:172.21.15.167:6808/1392386852 4 ==== osd_op_reply(67 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8500 con 0x55fc676acc00 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.707+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:68 16.5 16:a0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4cc00 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.707+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 14 ==== osd_op_reply(68 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.707+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:69 16.15 16:a8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4cc00 2024-04-25T09:03:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.708+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 15 ==== osd_op_reply(69 [pgnls start_epoch 117 out=97b] v116'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.708+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:70 16.d 16:b0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66d6a000 2024-04-25T09:03:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.708+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.6 v2:172.21.15.167:6820/1814554564 6 ==== osd_op_reply(70 [pgnls start_epoch 117 out=74b] v114'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55fc669c8780 con 0x55fc66d6a000 2024-04-25T09:03:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.708+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:71 16.1d 16:b8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4d000 2024-04-25T09:03:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.709+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 21 ==== osd_op_reply(71 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.709+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:72 16.3 16:c0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676ad000 2024-04-25T09:03:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.709+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 9 ==== osd_op_reply(72 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.709+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:73 16.13 16:c8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66d6a800 2024-04-25T09:03:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.709+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.1 v2:172.21.15.55:6800/2726345870 7 ==== osd_op_reply(73 [pgnls start_epoch 117 out=98b] v116'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66d6a800 2024-04-25T09:03:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.709+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:74 16.b 16:d0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66d6a800 2024-04-25T09:03:57.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.709+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.1 v2:172.21.15.55:6800/2726345870 8 ==== osd_op_reply(74 [pgnls start_epoch 117 out=76b] v117'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66d6a800 2024-04-25T09:03:57.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.709+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:75 16.1b 16:d8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676ad000 2024-04-25T09:03:57.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.710+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 10 ==== osd_op_reply(75 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.710+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:76 16.7 16:e0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676ad400 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.710+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 10 ==== osd_op_reply(76 [pgnls start_epoch 117 out=105b] v117'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.710+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:77 16.17 16:e8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4d000 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.710+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 22 ==== osd_op_reply(77 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.710+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:78 16.f 16:f0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc66c4cc00 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.710+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 16 ==== osd_op_reply(78 [pgnls start_epoch 117 out=73b] v117'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.710+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:79 16.1f 16:f8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676ad000 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.711+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 11 ==== osd_op_reply(79 [pgnls start_epoch 117 out=101b] v117'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.711+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.711+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:80 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7ec00 con 0x55fc66c4d000 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.711+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 23 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.711+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.711+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:81 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7f000 con 0x55fc66c4d000 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.711+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 24 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.711+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.711+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:82 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7f400 con 0x55fc66c4d000 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 25 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1169 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:83 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7f800 con 0x55fc66c4d000 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 26 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:84 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7fc00 con 0x55fc66c4d000 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 27 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:85 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7ec00 con 0x55fc66c4cc00 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 17 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.712+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:86 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7f000 con 0x55fc66c4d000 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 28 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:87 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7f400 con 0x55fc66c4d000 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 29 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 10000000005.00000000 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:88 16.9 16:9258b67d:::10000000005.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66c4d800 con 0x55fc66d6a800 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.1 v2:172.21.15.55:6800/2726345870 9 ==== osd_op_reply(88 10000000005.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+584 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66d6a800 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.713+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- osd_op(unknown.0.0:89 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66c4d400 con 0x55fc66c4cc00 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.0 v2:172.21.15.55:6808/382211730 18 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8000 con 0x55fc66c4cc00 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- osd_op(unknown.0.0:90 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6ac00 con 0x55fc66c4d000 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.2 v2:172.21.15.55:6824/2942240833 30 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66c4d000 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:91 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6bc00 con 0x55fc66d6a800 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.1 v2:172.21.15.55:6800/2726345870 10 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66d6a800 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.714+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:92 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6b800 con 0x55fc676ad400 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 11 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:93 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66c4d400 con 0x55fc676ad400 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 12 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1667 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f5121c12740 20 datascan.scan_links: injected ino detected 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f5121c12740 20 datascan.scan_links: adding 0x10000000003 for future processing to fix dnfirst 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f5121c12740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f5121c12740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.715+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- osd_op(unknown.0.0:94 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e400 con 0x55fc676ad000 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 <== osd.5 v2:172.21.15.167:6800/1337224202 12 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+585 (crc 0 0 0) 0x55fc669c8000 con 0x55fc676ad000 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f5121c12740 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f5121c12740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f5121c12740 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f5121c12740 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f5121c12740 10 datascan.scan_links: handling injected_ino 0x10000000003 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f5121c12740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:95 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7e800 con 0x55fc676ad400 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 13 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f5121c12740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f5121c12740 20 datascan.scan_links: first is now 2 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.716+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- osd_op(unknown.0.0:96 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d7ec00 con 0x55fc676ad400 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.717+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.3 v2:172.21.15.55:6816/2016500802 14 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v117'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55fc669c8780 con 0x55fc676ad400 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.717+0000 7f5121c12740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x10000000003 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.717+0000 7f5121c12740 10 datascan.scan_links: updating inotable 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.717+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- osd_op(unknown.0.0:97 16.13 16:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6b400 con 0x55fc66d6a800 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.717+0000 7f51200d9640 1 -- 172.21.15.55:0/366766845 <== osd.1 v2:172.21.15.55:6800/2726345870 11 ==== osd_op_reply(97 mds0_inotable [read 0~34 out=34b] v0'0 uv4 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x55fc669c8500 con 0x55fc66d6a800 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.717+0000 7f5121c12740 10 datascan.scan_links: updating snaptable 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.717+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- osd_op(unknown.0.0:98 16.d 16:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) v9 -- 0x55fc66d6b000 con 0x55fc66d6a000 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f511f8d8640 1 -- 172.21.15.55:0/366766845 <== osd.6 v2:172.21.15.167:6820/1814554564 7 ==== osd_op_reply(98 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55fc669c8780 con 0x55fc66d6a000 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55fc66c4cc00 msgr2=0x55fc6694c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x55fc66c4cc00 0x55fc6694c100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55fc66d6a800 msgr2=0x55fc66d56100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x55fc66d6a800 0x55fc66d56100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55fc66c4d000 msgr2=0x55fc66d54000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x55fc66c4d000 0x55fc66d54000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55fc676ad400 msgr2=0x55fc66d54580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x55fc676ad400 0x55fc66d54580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55fc676acc00 msgr2=0x55fc66d55080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x55fc676acc00 0x55fc66d55080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55fc676ad000 msgr2=0x55fc66d54b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x55fc676ad000 0x55fc66d54b00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55fc66d6a000 msgr2=0x55fc66d55600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x55fc66d6a000 0x55fc66d55600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55fc66d6a400 msgr2=0x55fc66d55b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 reap_dead start 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x55fc66d6a400 0x55fc66d55b80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 reap_dead start 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f511f0d7640 1 -- 172.21.15.55:0/366766845 reap_dead start 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55fc66c4c800 msgr2=0x55fc6694d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55fc66c4c800 0x55fc6694d700 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x55fc66bea3f0 tx=0x55fc66bcc060 comp rx=0 tx=0).stop 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf000 msgr2=0x55fc6694d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf000 0x55fc6694d180 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x55fc66beba70 tx=0x55fc66bcdf20 comp rx=0 tx=0).stop 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 shutdown_connections 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x55fc66c4c800 0x55fc6694d700 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 --2- 172.21.15.55:0/366766845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc66bdf000 0x55fc6694d180 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 >> 172.21.15.55:0/366766845 conn(0x55fc66bdec00 msgr2=0x55fc669c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 shutdown_connections 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.718+0000 7f5121c12740 1 -- 172.21.15.55:0/366766845 wait complete. 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.719+0000 7f5121c12740 1 -- 172.21.15.55:0/3251422647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc668dac00 msgr2=0x55fc6694a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.719+0000 7f5121c12740 1 --2- 172.21.15.55:0/3251422647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc668dac00 0x55fc6694a580 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x55fc676e1c80 tx=0x55fc66bcc120 comp rx=0 tx=0).stop 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.719+0000 7f5121c12740 1 -- 172.21.15.55:0/3251422647 shutdown_connections 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.719+0000 7f5121c12740 1 --2- 172.21.15.55:0/3251422647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fc668dbc00 0x55fc6694b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.719+0000 7f5121c12740 1 --2- 172.21.15.55:0/3251422647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc668db800 0x55fc6694ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.719+0000 7f5121c12740 1 --2- 172.21.15.55:0/3251422647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc668dac00 0x55fc6694a580 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.719+0000 7f5121c12740 1 -- 172.21.15.55:0/3251422647 >> 172.21.15.55:0/3251422647 conn(0x55fc668db000 msgr2=0x55fc669c2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.719+0000 7f5121c12740 1 -- 172.21.15.55:0/3251422647 shutdown_connections 2024-04-25T09:03:57.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:57.719+0000 7f5121c12740 1 -- 172.21.15.55:0/3251422647 wait complete. 2024-04-25T09:03:57.726 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.135916, result: 2024-04-25T09:03:57.727 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:03:57.759 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:03:57.799 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-25T09:03:57.799 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.800 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-25T09:03:57.801 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.802 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.803 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-25T09:03:57.804 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-04-25T09:03:57.805 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:57.806 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-25T09:03:57.806 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-04-25T09:03:57.806 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:03:57.806 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-25T09:03:57.806 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:03:57.806 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:03:57.806 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-25T09:03:57.806 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T09:03:57.806 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.806 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-25T09:03:57.806 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-25T09:03:57.807 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-25T09:03:57.808 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:57.809 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:57.810 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-25T09:03:57.811 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = False 2024-04-25T09:03:57.811 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-25T09:03:57.811 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2024-04-25T09:03:57.811 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T09:03:57.811 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T09:03:57.811 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T09:03:57.811 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-04-25T09:03:57.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:03:57.813 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-04-25T09:03:57.814 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.55,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-04-25T09:03:57.815 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.816 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: bdev async discard = True 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: bdev enable discard = True 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore allocator = bitmap 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 1/20 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 1/20 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 4/10 2024-04-25T09:03:57.817 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:57.818 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:57.819 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.820 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-04-25T09:03:57.821 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = False 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T09:03:57.822 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T09:03:57.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:03:57.866 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:03:57.906 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-25T09:03:57.906 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-25T09:03:57.906 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:03:57.906 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-25T09:03:57.906 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.906 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-25T09:03:57.906 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.906 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-25T09:03:57.906 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.906 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-25T09:03:57.907 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-25T09:03:57.908 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-25T09:03:57.909 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.910 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-25T09:03:57.911 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-25T09:03:57.912 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-25T09:03:57.913 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:03:57.914 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-25T09:03:57.915 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T09:03:57.916 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T09:03:57.917 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T09:03:57.917 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-04-25T09:03:57.917 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-04-25T09:03:57.917 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:03:57.917 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-04-25T09:03:57.917 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.917 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-04-25T09:03:57.917 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:03:57.918 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.919 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.55,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = c39ac909-02b8-4b68-9f8d-b272de9b1a7b 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.920 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.921 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-04-25T09:03:57.922 INFO:teuthology.orchestra.run.smithi167.stdout: bdev async discard = True 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: bdev enable discard = True 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore allocator = bitmap 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 1/20 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 1/20 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 4/10 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:03:57.923 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-04-25T09:03:57.924 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.925 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:03:57.926 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:03:57.926 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:03:57.926 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.926 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-04-25T09:03:57.926 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:03:57.926 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.926 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:03:57.926 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-04-25T09:03:57.926 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T09:03:57.926 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-04-25T09:03:57.926 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-04-25T09:03:57.927 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T09:03:57.928 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T09:03:57.929 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T09:03:57.930 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:03:58.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.085+0000 7fe4192cb640 1 Processor -- start 2024-04-25T09:03:58.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.086+0000 7fe4192cb640 1 -- start start 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.086+0000 7fe4192cb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe4140b97c0 0x7fe4140b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.086+0000 7fe4192cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4140b5e40 con 0x7fe41415dc80 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.086+0000 7fe4192cb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4141627a0 con 0x7fe4140b5a30 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.086+0000 7fe4192cb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe414161f80 con 0x7fe4140b97c0 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.086+0000 7fe412ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe41415dc80 0x7fe414161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53614/0 (socket says 172.21.15.55:53614) 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.086+0000 7fe412ffd640 1 -- 172.21.15.55:0/4285108838 learned_addr learned my addr 172.21.15.55:0/4285108838 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe4127fc640 1 --2- 172.21.15.55:0/4285108838 >> v2:172.21.15.167:3300/0 conn(0x7fe4140b97c0 0x7fe4140b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546709443 0 0) 0x7fe404001490 con 0x7fe41415dc80 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe400003520 con 0x7fe41415dc80 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3535994179 0 0) 0x7fe400003520 con 0x7fe41415dc80 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 >> v2:172.21.15.167:3300/0 conn(0x7fe4140b97c0 msgr2=0x7fe4140b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 --2- 172.21.15.55:0/4285108838 >> v2:172.21.15.167:3300/0 conn(0x7fe4140b97c0 0x7fe4140b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 >> v1:172.21.15.167:6789/0 conn(0x7fe4140b5a30 legacy=0x7fe4140d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4141621e0 con 0x7fe41415dc80 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fe404001bc0 con 0x7fe41415dc80 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 >> v1:172.21.15.55:6789/0 conn(0x7fe41415dc80 legacy=0x7fe414161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 --2- 172.21.15.55:0/4285108838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4000039b0 0x7fe400003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 --2- 172.21.15.55:0/4285108838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe400004800 0x7fe400004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 --2- 172.21.15.55:0/4285108838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4000051c0 0x7fe40000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe414161f80 con 0x7fe4000039b0 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40000c060 con 0x7fe400004800 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40000c260 con 0x7fe4000051c0 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe412ffd640 1 --2- 172.21.15.55:0/4285108838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4000039b0 0x7fe400003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe4127fc640 1 --2- 172.21.15.55:0/4285108838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe400004800 0x7fe400004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe4137fe640 1 --2- 172.21.15.55:0/4285108838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4000051c0 0x7fe40000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe412ffd640 1 -- 172.21.15.55:0/4285108838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4000051c0 msgr2=0x7fe40000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe412ffd640 1 --2- 172.21.15.55:0/4285108838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4000051c0 0x7fe40000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe412ffd640 1 -- 172.21.15.55:0/4285108838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe400004800 msgr2=0x7fe400004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe412ffd640 1 --2- 172.21.15.55:0/4285108838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe400004800 0x7fe400004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe412ffd640 1 -- 172.21.15.55:0/4285108838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400003520 con 0x7fe4000039b0 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.087+0000 7fe4137fe640 1 -- 172.21.15.55:0/4285108838 reap_dead start 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.088+0000 7fe412ffd640 1 --2- 172.21.15.55:0/4285108838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4000039b0 0x7fe400003dd0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fe40400aa30 tx=0x7fe400005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61de9d2934faa0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.088+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40400a650 con 0x7fe4000039b0 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.088+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40402f070 con 0x7fe4000039b0 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.088+0000 7fe411ffb640 1 -- 172.21.15.55:0/4285108838 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404034470 con 0x7fe4000039b0 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.089+0000 7fe4192cb640 1 -- 172.21.15.55:0/4285108838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4000039b0 msgr2=0x7fe400003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.089+0000 7fe4192cb640 1 --2- 172.21.15.55:0/4285108838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4000039b0 0x7fe400003dd0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fe40400aa30 tx=0x7fe400005830 comp rx=0 tx=0).stop 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.089+0000 7fe4192cb640 1 -- 172.21.15.55:0/4285108838 shutdown_connections 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.089+0000 7fe4192cb640 1 --2- 172.21.15.55:0/4285108838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4000039b0 0x7fe400003dd0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.089+0000 7fe4192cb640 1 -- 172.21.15.55:0/4285108838 >> 172.21.15.55:0/4285108838 conn(0x7fe4140d04f0 msgr2=0x7fe4140d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.089+0000 7fe4192cb640 1 -- 172.21.15.55:0/4285108838 shutdown_connections 2024-04-25T09:03:58.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.089+0000 7fe4192cb640 1 -- 172.21.15.55:0/4285108838 wait complete. 2024-04-25T09:03:58.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.090+0000 7fe4192cb640 1 Processor -- start 2024-04-25T09:03:58.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.090+0000 7fe4192cb640 1 -- start start 2024-04-25T09:03:58.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4192cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4000039b0 0x7fe414156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4192cb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4140cd0b0 0x7fe4140cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4192cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4141e8be0 0x7fe4141e9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4192cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41415e060 con 0x7fe4141e8be0 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4192cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140d1c70 con 0x7fe4000039b0 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4192cb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140b54f0 con 0x7fe4140cd0b0 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4137fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4141e8be0 0x7fe4141e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4137fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4141e8be0 0x7fe4141e9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55782/0 (socket says 172.21.15.55:55782) 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4137fe640 1 -- 172.21.15.55:0/1956268438 learned_addr learned my addr 172.21.15.55:0/1956268438 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe412ffd640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4000039b0 0x7fe414156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4127fc640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4140cd0b0 0x7fe4140cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4137fe640 1 -- 172.21.15.55:0/1956268438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4140cd0b0 msgr2=0x7fe4140cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4137fe640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4140cd0b0 0x7fe4140cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4137fe640 1 -- 172.21.15.55:0/1956268438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4000039b0 msgr2=0x7fe414156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4137fe640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4000039b0 0x7fe414156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.091+0000 7fe4137fe640 1 -- 172.21.15.55:0/1956268438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140cde70 con 0x7fe4141e8be0 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.092+0000 7fe4137fe640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4141e8be0 0x7fe4141e9090 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fe4140d15f0 tx=0x7fe40c00e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.092+0000 7fe40b7fe640 1 -- 172.21.15.55:0/1956268438 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c019070 con 0x7fe4141e8be0 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.092+0000 7fe40b7fe640 1 -- 172.21.15.55:0/1956268438 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c00ee90 con 0x7fe4141e8be0 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.092+0000 7fe4192cb640 1 -- 172.21.15.55:0/1956268438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4140cdb90 con 0x7fe4141e8be0 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.092+0000 7fe40b7fe640 1 -- 172.21.15.55:0/1956268438 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0035f0 con 0x7fe4141e8be0 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.092+0000 7fe4192cb640 1 -- 172.21.15.55:0/1956268438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe414157d00 con 0x7fe4141e8be0 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.093+0000 7fe4192cb640 1 -- 172.21.15.55:0/1956268438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4140750b0 con 0x7fe4141e8be0 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.093+0000 7fe40b7fe640 1 -- 172.21.15.55:0/1956268438 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe40c01c070 con 0x7fe4141e8be0 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.094+0000 7fe40b7fe640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe3f406b4d0 0x7fe3f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.094+0000 7fe412ffd640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe3f406b4d0 0x7fe3f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.094+0000 7fe40b7fe640 1 -- 172.21.15.55:0/1956268438 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe40c0895c0 con 0x7fe4141e8be0 2024-04-25T09:03:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.094+0000 7fe412ffd640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe3f406b4d0 0x7fe3f406d990 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe404033000 tx=0x7fe404009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.098+0000 7fe40b7fe640 1 -- 172.21.15.55:0/1956268438 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe4140cde70 con 0x7fe4141e8be0 2024-04-25T09:03:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:58.321+0000 7fe4192cb640 1 -- 172.21.15.55:0/1956268438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fe4140b4360 con 0x7fe4141e8be0 2024-04-25T09:03:59.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.258+0000 7fe40b7fe640 1 -- 172.21.15.55:0/1956268438 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v95) v1 ==== 162+0+0 (secure 0 0 0) 0x7fe40c058420 con 0x7fe4141e8be0 2024-04-25T09:03:59.246 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:03:59.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.260+0000 7fe4192cb640 1 -- 172.21.15.55:0/1956268438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe3f406b4d0 msgr2=0x7fe3f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.260+0000 7fe4192cb640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe3f406b4d0 0x7fe3f406d990 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe404033000 tx=0x7fe404009030 comp rx=0 tx=0).stop 2024-04-25T09:03:59.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.260+0000 7fe4192cb640 1 -- 172.21.15.55:0/1956268438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4141e8be0 msgr2=0x7fe4141e9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.260+0000 7fe4192cb640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4141e8be0 0x7fe4141e9090 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fe4140d15f0 tx=0x7fe40c00e690 comp rx=0 tx=0).stop 2024-04-25T09:03:59.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.260+0000 7fe4192cb640 1 -- 172.21.15.55:0/1956268438 shutdown_connections 2024-04-25T09:03:59.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.260+0000 7fe4192cb640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fe3f406b4d0 0x7fe3f406d990 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.260+0000 7fe4192cb640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4141e8be0 0x7fe4141e9090 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.260+0000 7fe4192cb640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe4140cd0b0 0x7fe4140cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.261+0000 7fe4192cb640 1 --2- 172.21.15.55:0/1956268438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4000039b0 0x7fe414156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.261+0000 7fe4192cb640 1 -- 172.21.15.55:0/1956268438 >> 172.21.15.55:0/1956268438 conn(0x7fe4140d04f0 msgr2=0x7fe4140b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.261+0000 7fe4192cb640 1 -- 172.21.15.55:0/1956268438 shutdown_connections 2024-04-25T09:03:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.261+0000 7fe4192cb640 1 -- 172.21.15.55:0/1956268438 wait complete. 2024-04-25T09:03:59.265 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:59.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.384+0000 7f2918d34640 1 Processor -- start 2024-04-25T09:03:59.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.384+0000 7f2918d34640 1 -- start start 2024-04-25T09:03:59.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.385+0000 7f2918d34640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29140cea00 0x7f29140cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.385+0000 7f2918d34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29140cfbe0 0x7f29140ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.385+0000 7f2918d34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29140d0430 con 0x7f291415f120 2024-04-25T09:03:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.385+0000 7f2918d34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29140d09f0 con 0x7f29140cfbe0 2024-04-25T09:03:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.385+0000 7f2918d34640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29140d0710 con 0x7f29140cea00 2024-04-25T09:03:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.386+0000 7f291259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f291415f120 0x7f29140ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39310/0 (socket says 172.21.15.55:39310) 2024-04-25T09:03:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.386+0000 7f291259c640 1 -- 172.21.15.55:0/4189198009 learned_addr learned my addr 172.21.15.55:0/4189198009 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:03:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.386+0000 7f2912d9d640 1 --2- 172.21.15.55:0/4189198009 >> v2:172.21.15.55:3300/0 conn(0x7f29140cfbe0 0x7f29140ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.386+0000 7f2911d9b640 1 --2- 172.21.15.55:0/4189198009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29140cea00 0x7f29140cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.386+0000 7f2912d9d640 1 -- 172.21.15.55:0/4189198009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29140cea00 msgr2=0x7f29140cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.386+0000 7f2912d9d640 1 --2- 172.21.15.55:0/4189198009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29140cea00 0x7f29140cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.386+0000 7f2912d9d640 1 -- 172.21.15.55:0/4189198009 >> v1:172.21.15.55:6789/0 conn(0x7f291415f120 legacy=0x7f29140ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.386+0000 7f2912d9d640 1 -- 172.21.15.55:0/4189198009 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29140cc7d0 con 0x7f29140cfbe0 2024-04-25T09:03:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.386+0000 7f291159a640 1 -- 172.21.15.55:0/4189198009 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100153359 0 0) 0x7f29140d0430 con 0x7f291415f120 2024-04-25T09:03:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.387+0000 7f2912d9d640 1 --2- 172.21.15.55:0/4189198009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29140cfbe0 0x7f29140ccfd0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f2904009d90 tx=0x7f290402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10e7e8998f4b9a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.387+0000 7f291159a640 1 -- 172.21.15.55:0/4189198009 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904007740 con 0x7f29140cfbe0 2024-04-25T09:03:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.387+0000 7f291159a640 1 -- 172.21.15.55:0/4189198009 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29040078e0 con 0x7f29140cfbe0 2024-04-25T09:03:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.387+0000 7f291159a640 1 -- 172.21.15.55:0/4189198009 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904007cb0 con 0x7f29140cfbe0 2024-04-25T09:03:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.387+0000 7f2918d34640 1 -- 172.21.15.55:0/4189198009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29140cfbe0 msgr2=0x7f29140ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.387+0000 7f2918d34640 1 --2- 172.21.15.55:0/4189198009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29140cfbe0 0x7f29140ccfd0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f2904009d90 tx=0x7f290402a6f0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.387+0000 7f2918d34640 1 -- 172.21.15.55:0/4189198009 shutdown_connections 2024-04-25T09:03:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.387+0000 7f2918d34640 1 --2- 172.21.15.55:0/4189198009 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29140cea00 0x7f29140cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.387+0000 7f2918d34640 1 --2- 172.21.15.55:0/4189198009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29140cfbe0 0x7f29140ccfd0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.388+0000 7f2918d34640 1 -- 172.21.15.55:0/4189198009 >> 172.21.15.55:0/4189198009 conn(0x7f29140d1900 msgr2=0x7f29140d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.388+0000 7f2918d34640 1 -- 172.21.15.55:0/4189198009 shutdown_connections 2024-04-25T09:03:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.388+0000 7f2918d34640 1 -- 172.21.15.55:0/4189198009 wait complete. 2024-04-25T09:03:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.389+0000 7f2918d34640 1 Processor -- start 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.389+0000 7f2918d34640 1 -- start start 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f2918d34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29140cea00 0x7f29140ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f2918d34640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29140cfbe0 0x7f29140c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f2918d34640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f291415f120 0x7f29140b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f2918d34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29140c5450 con 0x7f29140cea00 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f2918d34640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29140cc480 con 0x7f291415f120 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f2918d34640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29140d0090 con 0x7f29140cfbe0 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f291259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29140cea00 0x7f29140ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f291259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29140cea00 0x7f29140ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59888/0 (socket says 172.21.15.55:59888) 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f291259c640 1 -- 172.21.15.55:0/207061797 learned_addr learned my addr 172.21.15.55:0/207061797 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f2911d9b640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29140cfbe0 0x7f29140c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f2912d9d640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f291415f120 0x7f29140b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f291259c640 1 -- 172.21.15.55:0/207061797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29140cfbe0 msgr2=0x7f29140c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f291259c640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29140cfbe0 0x7f29140c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f291259c640 1 -- 172.21.15.55:0/207061797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f291415f120 msgr2=0x7f29140b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f291259c640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f291415f120 0x7f29140b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f291259c640 1 -- 172.21.15.55:0/207061797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29140c8b70 con 0x7f29140cea00 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f2912d9d640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f291415f120 0x7f29140b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f2911d9b640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29140cfbe0 0x7f29140c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.390+0000 7f291259c640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29140cea00 0x7f29140ca8e0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c460 tx=0x7f290c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.391+0000 7f290affd640 1 -- 172.21.15.55:0/207061797 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c018070 con 0x7f29140cea00 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.391+0000 7f290affd640 1 -- 172.21.15.55:0/207061797 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c007500 con 0x7f29140cea00 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.391+0000 7f2918d34640 1 -- 172.21.15.55:0/207061797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29140c8e10 con 0x7f29140cea00 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.391+0000 7f290affd640 1 -- 172.21.15.55:0/207061797 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c004a20 con 0x7f29140cea00 2024-04-25T09:03:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.391+0000 7f2918d34640 1 -- 172.21.15.55:0/207061797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29140c93d0 con 0x7f29140cea00 2024-04-25T09:03:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.392+0000 7f2918d34640 1 -- 172.21.15.55:0/207061797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29140749b0 con 0x7f29140cea00 2024-04-25T09:03:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.392+0000 7f290affd640 1 -- 172.21.15.55:0/207061797 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f290c01b070 con 0x7f29140cea00 2024-04-25T09:03:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.393+0000 7f290affd640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f28f406b4d0 0x7f28f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.393+0000 7f290affd640 1 -- 172.21.15.55:0/207061797 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f290c089480 con 0x7f29140cea00 2024-04-25T09:03:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.393+0000 7f2911d9b640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f28f406b4d0 0x7f28f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.393+0000 7f2911d9b640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f28f406b4d0 0x7f28f406d990 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f29140b7390 tx=0x7f28fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.397+0000 7f290affd640 1 -- 172.21.15.55:0/207061797 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f290c0582e0 con 0x7f29140cea00 2024-04-25T09:03:59.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.614+0000 7f2918d34640 1 -- 172.21.15.55:0/207061797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29140c75e0 con 0x7f29140cea00 2024-04-25T09:03:59.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.615+0000 7f290affd640 1 -- 172.21.15.55:0/207061797 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f290c057be0 con 0x7f29140cea00 2024-04-25T09:03:59.603 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:03:59.603 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:03:59.262327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"a","rank":0,"incarnation":96,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6837/3300284863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3300284863},{"type":"v1","addr":"172.21.15.55:6837","nonce":3300284863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:03:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 96 2024-04-25T09:03:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.616+0000 7f2918d34640 1 -- 172.21.15.55:0/207061797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f28f406b4d0 msgr2=0x7f28f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.616+0000 7f2918d34640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f28f406b4d0 0x7f28f406d990 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f29140b7390 tx=0x7f28fc008040 comp rx=0 tx=0).stop 2024-04-25T09:03:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.616+0000 7f2918d34640 1 -- 172.21.15.55:0/207061797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29140cea00 msgr2=0x7f29140ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.616+0000 7f2918d34640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29140cea00 0x7f29140ca8e0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c460 tx=0x7f290c00c920 comp rx=0 tx=0).stop 2024-04-25T09:03:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.617+0000 7f2918d34640 1 -- 172.21.15.55:0/207061797 shutdown_connections 2024-04-25T09:03:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.617+0000 7f2918d34640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f28f406b4d0 0x7f28f406d990 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.617+0000 7f2918d34640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f291415f120 0x7f29140b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.617+0000 7f2918d34640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29140cfbe0 0x7f29140c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.617+0000 7f2918d34640 1 --2- 172.21.15.55:0/207061797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29140cea00 0x7f29140ca8e0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.617+0000 7f2918d34640 1 -- 172.21.15.55:0/207061797 >> 172.21.15.55:0/207061797 conn(0x7f29140d1900 msgr2=0x7f291415cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.617+0000 7f2918d34640 1 -- 172.21.15.55:0/207061797 shutdown_connections 2024-04-25T09:03:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:03:59.617+0000 7f2918d34640 1 -- 172.21.15.55:0/207061797 wait complete. 2024-04-25T09:04:00.019 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 96, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:03:33.628986+0000', 'modified': '2024-04-25T09:03:59.262327+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 117, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9336}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9336': {'gid': 9336, 'name': 'a', 'rank': 0, 'incarnation': 96, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6837/3300284863', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 3300284863}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3300284863}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:04:00.019 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9336:up:replay 2024-04-25T09:04:01.020 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.146+0000 7ff76a21f640 1 Processor -- start 2024-04-25T09:04:01.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.146+0000 7ff76a21f640 1 -- start start 2024-04-25T09:04:01.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff76a21f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff7640d35b0 0x7ff7640b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff76a21f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7640b5990 0x7ff7640b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff76a21f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76415e0c0 con 0x7ff76415dce0 2024-04-25T09:04:01.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff76a21f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640d2510 con 0x7ff7640b5990 2024-04-25T09:04:01.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff76a21f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640d27f0 con 0x7ff7640d35b0 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff763fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7640b5990 0x7ff7640b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff7637fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff76415dce0 0x7ff7640d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39318/0 (socket says 172.21.15.55:39318) 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff7637fe640 1 -- 172.21.15.55:0/3901861805 learned_addr learned my addr 172.21.15.55:0/3901861805 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff762ffd640 1 --2- 172.21.15.55:0/3901861805 >> v2:172.21.15.167:3300/0 conn(0x7ff7640d35b0 0x7ff7640b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff763fff640 1 -- 172.21.15.55:0/3901861805 >> v2:172.21.15.167:3300/0 conn(0x7ff7640d35b0 msgr2=0x7ff7640b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff763fff640 1 --2- 172.21.15.55:0/3901861805 >> v2:172.21.15.167:3300/0 conn(0x7ff7640d35b0 0x7ff7640b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff763fff640 1 -- 172.21.15.55:0/3901861805 >> v1:172.21.15.55:6789/0 conn(0x7ff76415dce0 legacy=0x7ff7640d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff763fff640 1 -- 172.21.15.55:0/3901861805 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640d2ad0 con 0x7ff7640b5990 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.147+0000 7ff7627fc640 1 -- 172.21.15.55:0/3901861805 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954034033 0 0) 0x7ff76415e0c0 con 0x7ff76415dce0 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.148+0000 7ff763fff640 1 --2- 172.21.15.55:0/3901861805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7640b5990 0x7ff7640b6b00 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7ff7640cdfa0 tx=0x7ff75c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e248736c7ece84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.148+0000 7ff7627fc640 1 -- 172.21.15.55:0/3901861805 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c007740 con 0x7ff7640b5990 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.148+0000 7ff7627fc640 1 -- 172.21.15.55:0/3901861805 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c0078e0 con 0x7ff7640b5990 2024-04-25T09:04:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.148+0000 7ff7627fc640 1 -- 172.21.15.55:0/3901861805 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c007cb0 con 0x7ff7640b5990 2024-04-25T09:04:01.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.149+0000 7ff76a21f640 1 -- 172.21.15.55:0/3901861805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7640b5990 msgr2=0x7ff7640b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.149+0000 7ff76a21f640 1 --2- 172.21.15.55:0/3901861805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7640b5990 0x7ff7640b6b00 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7ff7640cdfa0 tx=0x7ff75c02a680 comp rx=0 tx=0).stop 2024-04-25T09:04:01.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.149+0000 7ff76a21f640 1 -- 172.21.15.55:0/3901861805 shutdown_connections 2024-04-25T09:04:01.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.149+0000 7ff76a21f640 1 --2- 172.21.15.55:0/3901861805 >> v2:172.21.15.167:3300/0 conn(0x7ff7640d35b0 0x7ff7640b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.149+0000 7ff76a21f640 1 --2- 172.21.15.55:0/3901861805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7640b5990 0x7ff7640b6b00 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.149+0000 7ff76a21f640 1 -- 172.21.15.55:0/3901861805 >> 172.21.15.55:0/3901861805 conn(0x7ff764072900 msgr2=0x7ff7640d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:01.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.149+0000 7ff76a21f640 1 -- 172.21.15.55:0/3901861805 shutdown_connections 2024-04-25T09:04:01.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.149+0000 7ff76a21f640 1 -- 172.21.15.55:0/3901861805 wait complete. 2024-04-25T09:04:01.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.150+0000 7ff76a21f640 1 Processor -- start 2024-04-25T09:04:01.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.150+0000 7ff76a21f640 1 -- start start 2024-04-25T09:04:01.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff76a21f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7640b5990 0x7ff7640ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff76a21f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7640d35b0 0x7ff7641f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff76a21f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff76415dce0 0x7ff7640aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff76a21f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640d2160 con 0x7ff7640d35b0 2024-04-25T09:04:01.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff76a21f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640d3090 con 0x7ff7640b5990 2024-04-25T09:04:01.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff76a21f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640acf90 con 0x7ff76415dce0 2024-04-25T09:04:01.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff762ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7640d35b0 0x7ff7641f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff762ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7640d35b0 0x7ff7641f2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59916/0 (socket says 172.21.15.55:59916) 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff762ffd640 1 -- 172.21.15.55:0/130358579 learned_addr learned my addr 172.21.15.55:0/130358579 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff763fff640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff76415dce0 0x7ff7640aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff7637fe640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7640b5990 0x7ff7640ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff762ffd640 1 -- 172.21.15.55:0/130358579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff76415dce0 msgr2=0x7ff7640aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff762ffd640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff76415dce0 0x7ff7640aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff762ffd640 1 -- 172.21.15.55:0/130358579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7640b5990 msgr2=0x7ff7640ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff762ffd640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7640b5990 0x7ff7640ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.151+0000 7ff762ffd640 1 -- 172.21.15.55:0/130358579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640ad270 con 0x7ff7640d35b0 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.152+0000 7ff762ffd640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7640d35b0 0x7ff7641f2f00 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7ff75800d800 tx=0x7ff75800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.152+0000 7ff74bfff640 1 -- 172.21.15.55:0/130358579 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800b6c0 con 0x7ff7640d35b0 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.152+0000 7ff74bfff640 1 -- 172.21.15.55:0/130358579 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff758019070 con 0x7ff7640d35b0 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.152+0000 7ff76a21f640 1 -- 172.21.15.55:0/130358579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76415e350 con 0x7ff7640d35b0 2024-04-25T09:04:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.152+0000 7ff74bfff640 1 -- 172.21.15.55:0/130358579 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800ba80 con 0x7ff7640d35b0 2024-04-25T09:04:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.152+0000 7ff76a21f640 1 -- 172.21.15.55:0/130358579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76415e910 con 0x7ff7640d35b0 2024-04-25T09:04:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.153+0000 7ff76a21f640 1 -- 172.21.15.55:0/130358579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7640cf8d0 con 0x7ff7640d35b0 2024-04-25T09:04:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.153+0000 7ff74bfff640 1 -- 172.21.15.55:0/130358579 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff75800bc20 con 0x7ff7640d35b0 2024-04-25T09:04:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.154+0000 7ff74bfff640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff75006b4d0 0x7ff75006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.154+0000 7ff74bfff640 1 -- 172.21.15.55:0/130358579 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7ff75808a710 con 0x7ff7640d35b0 2024-04-25T09:04:01.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.154+0000 7ff7637fe640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff75006b4d0 0x7ff75006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.154+0000 7ff7637fe640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff75006b4d0 0x7ff75006d990 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff754000f60 tx=0x7ff754007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:01.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.158+0000 7ff74bfff640 1 -- 172.21.15.55:0/130358579 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7640cf8d0 con 0x7ff7640d35b0 2024-04-25T09:04:01.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.381+0000 7ff76a21f640 1 -- 172.21.15.55:0/130358579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7640749b0 con 0x7ff7640d35b0 2024-04-25T09:04:01.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.381+0000 7ff74bfff640 1 -- 172.21.15.55:0/130358579 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4945 (secure 0 0 0) 0x7ff75801c360 con 0x7ff7640d35b0 2024-04-25T09:04:01.370 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:01.370 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":98,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:04:00.270943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"a","rank":0,"incarnation":96,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.55:6837/3300284863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3300284863},{"type":"v1","addr":"172.21.15.55:6837","nonce":3300284863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:01.370 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 98 2024-04-25T09:04:01.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.383+0000 7ff76a21f640 1 -- 172.21.15.55:0/130358579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff75006b4d0 msgr2=0x7ff75006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.383+0000 7ff76a21f640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff75006b4d0 0x7ff75006d990 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff754000f60 tx=0x7ff754007c00 comp rx=0 tx=0).stop 2024-04-25T09:04:01.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.383+0000 7ff76a21f640 1 -- 172.21.15.55:0/130358579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7640d35b0 msgr2=0x7ff7641f2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.383+0000 7ff76a21f640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7640d35b0 0x7ff7641f2f00 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7ff75800d800 tx=0x7ff75800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.384+0000 7ff76a21f640 1 -- 172.21.15.55:0/130358579 shutdown_connections 2024-04-25T09:04:01.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.384+0000 7ff76a21f640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff75006b4d0 0x7ff75006d990 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.384+0000 7ff76a21f640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff76415dce0 0x7ff7640aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.384+0000 7ff76a21f640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7640d35b0 0x7ff7641f2f00 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.384+0000 7ff76a21f640 1 --2- 172.21.15.55:0/130358579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7640b5990 0x7ff7640ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.384+0000 7ff76a21f640 1 -- 172.21.15.55:0/130358579 >> 172.21.15.55:0/130358579 conn(0x7ff764072900 msgr2=0x7ff76415ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:01.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.384+0000 7ff76a21f640 1 -- 172.21.15.55:0/130358579 shutdown_connections 2024-04-25T09:04:01.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:01.384+0000 7ff76a21f640 1 -- 172.21.15.55:0/130358579 wait complete. 2024-04-25T09:04:01.786 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:03:33.628986+0000', 'modified': '2024-04-25T09:04:00.270943+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 117, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9336}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9336': {'gid': 9336, 'name': 'a', 'rank': 0, 'incarnation': 96, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.55:6837/3300284863', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 3300284863}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3300284863}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:04:01.786 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9336:up:rejoin 2024-04-25T09:04:02.787 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:02.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.913+0000 7fbdfa0f5640 1 Processor -- start 2024-04-25T09:04:02.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.913+0000 7fbdfa0f5640 1 -- start start 2024-04-25T09:04:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.914+0000 7fbdfa0f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf415dce0 0x7fbdf40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.914+0000 7fbdfa0f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf415e0c0 con 0x7fbdf40d35b0 2024-04-25T09:04:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.914+0000 7fbdfa0f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf40d2510 con 0x7fbdf40b5b60 2024-04-25T09:04:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.914+0000 7fbdfa0f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40d27f0 con 0x7fbdf415dce0 2024-04-25T09:04:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.914+0000 7fbdf2ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbdf40d35b0 0x7fbdf40b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39324/0 (socket says 172.21.15.55:39324) 2024-04-25T09:04:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.914+0000 7fbdf2ffd640 1 -- 172.21.15.55:0/4062730043 learned_addr learned my addr 172.21.15.55:0/4062730043 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.914+0000 7fbdf37fe640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf415dce0 0x7fbdf40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.914+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871223129 0 0) 0x7fbdf415e0c0 con 0x7fbdf40d35b0 2024-04-25T09:04:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.914+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbddc003520 con 0x7fbdf40d35b0 2024-04-25T09:04:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.914+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072032304 0 0) 0x7fbdf40d2510 con 0x7fbdf40b5b60 2024-04-25T09:04:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf415e0c0 con 0x7fbdf40b5b60 2024-04-25T09:04:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3709506162 0 0) 0x7fbddc003520 con 0x7fbdf40d35b0 2024-04-25T09:04:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf415dce0 msgr2=0x7fbdf40d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf415dce0 0x7fbdf40d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 >> v1:172.21.15.167:6789/0 conn(0x7fbdf40b5b60 legacy=0x7fbdf40b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40d2ad0 con 0x7fbdf40d35b0 2024-04-25T09:04:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fbde8001670 con 0x7fbdf40d35b0 2024-04-25T09:04:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 >> v1:172.21.15.55:6789/0 conn(0x7fbdf40d35b0 legacy=0x7fbdf40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbddc003b70 0x7fbddc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbddc004800 0x7fbddc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0051c0 0x7fbddc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40d27f0 con 0x7fbddc003b70 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc00bfe0 con 0x7fbddc0051c0 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc00c1e0 con 0x7fbddc004800 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf37fe640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf415dce0 0x7fbdf40d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf37fe640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbddc003b70 0x7fbddc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf2ffd640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbddc004800 0x7fbddc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf3fff640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0051c0 0x7fbddc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf37fe640 1 -- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbddc004800 msgr2=0x7fbddc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf37fe640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbddc004800 0x7fbddc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf37fe640 1 -- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0051c0 msgr2=0x7fbddc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf37fe640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc0051c0 0x7fbddc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf37fe640 1 -- 172.21.15.55:0/4062730043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc003520 con 0x7fbddc003b70 2024-04-25T09:04:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.915+0000 7fbdf2ffd640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbddc004800 0x7fbddc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.916+0000 7fbdf37fe640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbddc003b70 0x7fbddc003f70 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fbdf406d020 tx=0x7fbddc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b3a18e3b9b674a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.916+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4036070 con 0x7fbddc003b70 2024-04-25T09:04:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.916+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde4004030 con 0x7fbddc003b70 2024-04-25T09:04:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.916+0000 7fbdf27fc640 1 -- 172.21.15.55:0/4062730043 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40097d0 con 0x7fbddc003b70 2024-04-25T09:04:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.917+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/4062730043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbddc003b70 msgr2=0x7fbddc003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.917+0000 7fbdfa0f5640 1 --2- 172.21.15.55:0/4062730043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbddc003b70 0x7fbddc003f70 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fbdf406d020 tx=0x7fbddc005830 comp rx=0 tx=0).stop 2024-04-25T09:04:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.917+0000 7fbdf3fff640 1 -- 172.21.15.55:0/4062730043 reap_dead start 2024-04-25T09:04:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.917+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/4062730043 shutdown_connections 2024-04-25T09:04:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.917+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/4062730043 >> 172.21.15.55:0/4062730043 conn(0x7fbdf4072900 msgr2=0x7fbdf40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.917+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/4062730043 shutdown_connections 2024-04-25T09:04:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.917+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/4062730043 wait complete. 2024-04-25T09:04:02.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.918+0000 7fbdfa0f5640 1 Processor -- start 2024-04-25T09:04:02.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.918+0000 7fbdfa0f5640 1 -- start start 2024-04-25T09:04:02.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdfa0f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc003b70 0x7fbdf4152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdfa0f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf415bd40 0x7fbdf40aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdfa0f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf40ac370 0x7fbdf40ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdfa0f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40b9820 con 0x7fbdf415bd40 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdfa0f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40d3090 con 0x7fbddc003b70 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdfa0f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40b99a0 con 0x7fbdf40ac370 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdf2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf415bd40 0x7fbdf40aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdf2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf415bd40 0x7fbdf40aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59930/0 (socket says 172.21.15.55:59930) 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdf2ffd640 1 -- 172.21.15.55:0/1810798900 learned_addr learned my addr 172.21.15.55:0/1810798900 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdf37fe640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc003b70 0x7fbdf4152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdf3fff640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf40ac370 0x7fbdf40ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdf2ffd640 1 -- 172.21.15.55:0/1810798900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf40ac370 msgr2=0x7fbdf40ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdf2ffd640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf40ac370 0x7fbdf40ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdf2ffd640 1 -- 172.21.15.55:0/1810798900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc003b70 msgr2=0x7fbdf4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdf2ffd640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc003b70 0x7fbdf4152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.919+0000 7fbdf2ffd640 1 -- 172.21.15.55:0/1810798900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40ab2d0 con 0x7fbdf415bd40 2024-04-25T09:04:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.920+0000 7fbdf2ffd640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf415bd40 0x7fbdf40aa960 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fbde80072c0 tx=0x7fbde8007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.920+0000 7fbddbfff640 1 -- 172.21.15.55:0/1810798900 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde801a070 con 0x7fbdf415bd40 2024-04-25T09:04:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.920+0000 7fbddbfff640 1 -- 172.21.15.55:0/1810798900 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde800f9c0 con 0x7fbdf415bd40 2024-04-25T09:04:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.920+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/1810798900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf40ab5b0 con 0x7fbdf415bd40 2024-04-25T09:04:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.920+0000 7fbddbfff640 1 -- 172.21.15.55:0/1810798900 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800fd70 con 0x7fbdf415bd40 2024-04-25T09:04:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.920+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/1810798900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf40abb70 con 0x7fbdf415bd40 2024-04-25T09:04:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.921+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/1810798900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf40749b0 con 0x7fbdf415bd40 2024-04-25T09:04:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.921+0000 7fbddbfff640 1 -- 172.21.15.55:0/1810798900 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbde801d070 con 0x7fbdf415bd40 2024-04-25T09:04:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.922+0000 7fbddbfff640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbde006b4d0 0x7fbde006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.922+0000 7fbddbfff640 1 -- 172.21.15.55:0/1810798900 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fbde8089dd0 con 0x7fbdf415bd40 2024-04-25T09:04:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.922+0000 7fbdf37fe640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbde006b4d0 0x7fbde006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.922+0000 7fbdf37fe640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbde006b4d0 0x7fbde006d990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbde4033000 tx=0x7fbde4008070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:02.926+0000 7fbddbfff640 1 -- 172.21.15.55:0/1810798900 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbde80584b0 con 0x7fbdf415bd40 2024-04-25T09:04:03.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.143+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/1810798900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdf40b4460 con 0x7fbdf415bd40 2024-04-25T09:04:03.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.144+0000 7fbddbfff640 1 -- 172.21.15.55:0/1810798900 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4945 (secure 0 0 0) 0x7fbde805c550 con 0x7fbdf415bd40 2024-04-25T09:04:03.132 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:03.132 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":99,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:04:01.276221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/3300284863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3300284863},{"type":"v1","addr":"172.21.15.55:6837","nonce":3300284863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:03.133 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 99 2024-04-25T09:04:03.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/1810798900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbde006b4d0 msgr2=0x7fbde006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbde006b4d0 0x7fbde006d990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbde4033000 tx=0x7fbde4008070 comp rx=0 tx=0).stop 2024-04-25T09:04:03.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/1810798900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf415bd40 msgr2=0x7fbdf40aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf415bd40 0x7fbdf40aa960 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fbde80072c0 tx=0x7fbde8007780 comp rx=0 tx=0).stop 2024-04-25T09:04:03.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/1810798900 shutdown_connections 2024-04-25T09:04:03.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fbde006b4d0 0x7fbde006d990 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdf40ac370 0x7fbdf40ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf415bd40 0x7fbdf40aa960 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 --2- 172.21.15.55:0/1810798900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbddc003b70 0x7fbdf4152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/1810798900 >> 172.21.15.55:0/1810798900 conn(0x7fbdf4072900 msgr2=0x7fbdf40b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/1810798900 shutdown_connections 2024-04-25T09:04:03.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.146+0000 7fbdfa0f5640 1 -- 172.21.15.55:0/1810798900 wait complete. 2024-04-25T09:04:03.240 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-25T09:04:03.252+0000 7f9ee8fb9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:04:03.549 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 99, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:03:33.628986+0000', 'modified': '2024-04-25T09:04:01.276221+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 117, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9336}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9336': {'gid': 9336, 'name': 'a', 'rank': 0, 'incarnation': 96, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6837/3300284863', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 3300284863}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3300284863}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:04:03.549 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:04:03.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:04:03.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.667+0000 7f39ca8e1640 1 Processor -- start 2024-04-25T09:04:03.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.668+0000 7f39ca8e1640 1 -- start start 2024-04-25T09:04:03.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.668+0000 7f39ca8e1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40b0740 0x7f39c40b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.668+0000 7f39ca8e1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39c40cfd60 0x7f39c40d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.668+0000 7f39ca8e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c415f660 con 0x7f39c415ef60 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.668+0000 7f39ca8e1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c415f940 con 0x7f39c40cfd60 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.668+0000 7f39ca8e1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c415fc20 con 0x7f39c40b0740 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.668+0000 7f39c3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f39c415ef60 0x7f39c40ce4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39326/0 (socket says 172.21.15.55:39326) 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.668+0000 7f39c3fff640 1 -- 172.21.15.55:0/306398747 learned_addr learned my addr 172.21.15.55:0/306398747 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c8e7e640 1 --2- 172.21.15.55:0/306398747 >> v2:172.21.15.167:3300/0 conn(0x7f39c40cfd60 0x7f39c40d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c37fe640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40b0740 0x7f39c40b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551493106 0 0) 0x7f39c415f660 con 0x7f39c415ef60 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39ac003520 con 0x7f39c415ef60 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 162513002 0 0) 0x7f39ac003520 con 0x7f39c415ef60 2024-04-25T09:04:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40b0740 msgr2=0x7f39c40b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40b0740 0x7f39c40b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 >> v2:172.21.15.167:3300/0 conn(0x7f39c40cfd60 msgr2=0x7f39c40d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 --2- 172.21.15.55:0/306398747 >> v2:172.21.15.167:3300/0 conn(0x7f39c40cfd60 0x7f39c40d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c415ff00 con 0x7f39c415ef60 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f39b4001670 con 0x7f39c415ef60 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c37fe640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40b0740 0x7f39c40b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c8e7e640 1 --2- 172.21.15.55:0/306398747 >> v2:172.21.15.167:3300/0 conn(0x7f39c40cfd60 0x7f39c40d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 >> v1:172.21.15.55:6789/0 conn(0x7f39c415ef60 legacy=0x7f39c40ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39ac0039b0 0x7f39ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ac004800 0x7f39ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40b0740 0x7f39ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c415f940 con 0x7f39ac0039b0 2024-04-25T09:04:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c415fc20 con 0x7f39ac004800 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac00b9c0 con 0x7f39c40b0740 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c3fff640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39ac0039b0 0x7f39ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c37fe640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ac004800 0x7f39ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.669+0000 7f39c8e7e640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40b0740 0x7f39ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.670+0000 7f39c3fff640 1 -- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40b0740 msgr2=0x7f39ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.670+0000 7f39c3fff640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40b0740 0x7f39ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.670+0000 7f39c3fff640 1 -- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ac004800 msgr2=0x7f39ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.670+0000 7f39c3fff640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ac004800 0x7f39ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.670+0000 7f39c3fff640 1 -- 172.21.15.55:0/306398747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac003520 con 0x7f39ac0039b0 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.670+0000 7f39c3fff640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39ac0039b0 0x7f39ac003dd0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c290 tx=0x7f39ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782ffaf6cb4cb3ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.670+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4007d50 con 0x7f39ac0039b0 2024-04-25T09:04:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.670+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4005af0 con 0x7f39ac0039b0 2024-04-25T09:04:03.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.670+0000 7f39c2ffd640 1 -- 172.21.15.55:0/306398747 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4007070 con 0x7f39ac0039b0 2024-04-25T09:04:03.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.671+0000 7f39ca8e1640 1 -- 172.21.15.55:0/306398747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39ac0039b0 msgr2=0x7f39ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.671+0000 7f39ca8e1640 1 --2- 172.21.15.55:0/306398747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39ac0039b0 0x7f39ac003dd0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c290 tx=0x7f39ac005830 comp rx=0 tx=0).stop 2024-04-25T09:04:03.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.671+0000 7f39c8e7e640 1 -- 172.21.15.55:0/306398747 reap_dead start 2024-04-25T09:04:03.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.671+0000 7f39ca8e1640 1 -- 172.21.15.55:0/306398747 shutdown_connections 2024-04-25T09:04:03.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.671+0000 7f39ca8e1640 1 -- 172.21.15.55:0/306398747 >> 172.21.15.55:0/306398747 conn(0x7f39c406f4c0 msgr2=0x7f39c406f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.671+0000 7f39ca8e1640 1 -- 172.21.15.55:0/306398747 shutdown_connections 2024-04-25T09:04:03.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.671+0000 7f39ca8e1640 1 -- 172.21.15.55:0/306398747 wait complete. 2024-04-25T09:04:03.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.672+0000 7f39ca8e1640 1 Processor -- start 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.672+0000 7f39ca8e1640 1 -- start start 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.673+0000 7f39ca8e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c414ed90 0x7f39c40af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.673+0000 7f39ca8e1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40ac8c0 0x7f39c40acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.673+0000 7f39ca8e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c40ad280 0x7f39c406c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.673+0000 7f39ca8e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c415f340 con 0x7f39c414ed90 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.673+0000 7f39ca8e1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c41604c0 con 0x7f39c40ad280 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.673+0000 7f39ca8e1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c40cebd0 con 0x7f39c40ac8c0 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.673+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c414ed90 0x7f39c40af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.673+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c414ed90 0x7f39c40af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59948/0 (socket says 172.21.15.55:59948) 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.673+0000 7f39c3fff640 1 -- 172.21.15.55:0/314910384 learned_addr learned my addr 172.21.15.55:0/314910384 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.673+0000 7f39c3fff640 1 -- 172.21.15.55:0/314910384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40ac8c0 msgr2=0x7f39c40acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.673+0000 7f39c3fff640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40ac8c0 0x7f39c40acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.674+0000 7f39c3fff640 1 -- 172.21.15.55:0/314910384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c40ad280 msgr2=0x7f39c406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.674+0000 7f39c3fff640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c40ad280 0x7f39c406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.674+0000 7f39c3fff640 1 -- 172.21.15.55:0/314910384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c40ad700 con 0x7f39c414ed90 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.674+0000 7f39c3fff640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c414ed90 0x7f39c40af9e0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f39b4034040 tx=0x7f39c40b7370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.674+0000 7f39c0ff9640 1 -- 172.21.15.55:0/314910384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4042020 con 0x7f39c414ed90 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.674+0000 7f39c0ff9640 1 -- 172.21.15.55:0/314910384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4004cb0 con 0x7f39c414ed90 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.674+0000 7f39ca8e1640 1 -- 172.21.15.55:0/314910384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c40b0110 con 0x7f39c414ed90 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.674+0000 7f39c0ff9640 1 -- 172.21.15.55:0/314910384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4001c80 con 0x7f39c414ed90 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.674+0000 7f39ca8e1640 1 -- 172.21.15.55:0/314910384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c406bf00 con 0x7f39c414ed90 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.675+0000 7f39c0ff9640 1 -- 172.21.15.55:0/314910384 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f39b4045020 con 0x7f39c414ed90 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.676+0000 7f39c0ff9640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39b006b500 0x7f39b006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.676+0000 7f39c0ff9640 1 -- 172.21.15.55:0/314910384 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f39b40aa830 con 0x7f39c414ed90 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.676+0000 7f39c37fe640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39b006b500 0x7f39b006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.676+0000 7f39c37fe640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39b006b500 0x7f39b006d9c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f39c40d13b0 tx=0x7f39b8009320 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.677+0000 7f39cd5e3740 1 Processor -- start 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.677+0000 7f39cd5e3740 1 -- start start 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.677+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f503700610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.677+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50371dad0 0x55f50371e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.677+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f5036d5f10 0x55f50371c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.677+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f503638a10 con 0x55f503700230 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.677+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5035e1b30 con 0x55f50371dad0 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.677+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f503634c50 con 0x55f5036d5f10 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f503700610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f503700610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59964/0 (socket says 172.21.15.55:59964) 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39c3fff640 1 -- 172.21.15.55:0/1673680383 learned_addr learned my addr 172.21.15.55:0/1673680383 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39c3fff640 1 -- 172.21.15.55:0/1673680383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f5036d5f10 msgr2=0x55f50371c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39c3fff640 1 --2- 172.21.15.55:0/1673680383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f5036d5f10 0x55f50371c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39c3fff640 1 -- 172.21.15.55:0/1673680383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50371dad0 msgr2=0x55f50371e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39c3fff640 1 --2- 172.21.15.55:0/1673680383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50371dad0 0x55f50371e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39c3fff640 1 -- 172.21.15.55:0/1673680383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5035f6e10 con 0x55f503700230 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39c3fff640 1 --2- 172.21.15.55:0/1673680383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f503700610 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f39b4078e80 tx=0x7f39b4079730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a89bdbba7e96fd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39a9ffb640 1 -- 172.21.15.55:0/1673680383 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b40a7070 con 0x55f503700230 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39a9ffb640 1 -- 172.21.15.55:0/1673680383 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4081600 con 0x55f503700230 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.678+0000 7f39a9ffb640 1 -- 172.21.15.55:0/1673680383 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4090070 con 0x55f503700230 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.679+0000 7f39cd5e3740 1 -- 172.21.15.55:0/1673680383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 msgr2=0x55f503700610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.679+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/1673680383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f503700610 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f39b4078e80 tx=0x7f39b4079730 comp rx=0 tx=0).stop 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.679+0000 7f39cd5e3740 1 -- 172.21.15.55:0/1673680383 shutdown_connections 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.679+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/1673680383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f5036d5f10 0x55f50371c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.679+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/1673680383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50371dad0 0x55f50371e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.679+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/1673680383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f503700610 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.679+0000 7f39cd5e3740 1 -- 172.21.15.55:0/1673680383 >> 172.21.15.55:0/1673680383 conn(0x55f5036d2840 msgr2=0x55f50371b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.679+0000 7f39cd5e3740 1 -- 172.21.15.55:0/1673680383 shutdown_connections 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.679+0000 7f39cd5e3740 1 -- 172.21.15.55:0/1673680383 wait complete. 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.679+0000 7f39cd5e3740 1 -- start start 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.680+0000 7f39cd5e3740 1 Processor -- start 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.680+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f5036fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.680+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f50371dad0 0x55f50372ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.680+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 0x55f503703380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.680+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5035e1b30 con 0x55f503700230 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.680+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5035f50c0 con 0x55f503702f00 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.680+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f503638a10 con 0x55f50371dad0 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.680+0000 7f39cd5e3740 10 client.0 _ll_register_callbacks cb 0x55f5035e8ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.680+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f5036fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.680+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f5036fdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59978/0 (socket says 172.21.15.55:59978) 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.680+0000 7f39c3fff640 1 -- 172.21.15.55:0/2631424307 learned_addr learned my addr 172.21.15.55:0/2631424307 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:03.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39c37fe640 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f50371dad0 0x55f50372ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39c3fff640 1 -- 172.21.15.55:0/2631424307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f50371dad0 msgr2=0x55f50372ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39c8e7e640 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 0x55f503703380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39c3fff640 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f50371dad0 0x55f50372ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39c3fff640 1 -- 172.21.15.55:0/2631424307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 msgr2=0x55f503703380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39c3fff640 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 0x55f503703380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39c3fff640 1 -- 172.21.15.55:0/2631424307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f50334d2d0 con 0x55f503700230 2024-04-25T09:04:03.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39c37fe640 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f50371dad0 0x55f50372ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:03.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39c8e7e640 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 0x55f503703380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:03.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39c3fff640 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f5036fdb30 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f39b402ae50 tx=0x7f39b4000f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bd1c0c5807eddf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39a2ffd640 1 -- 172.21.15.55:0/2631424307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b40a7070 con 0x55f503700230 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39a2ffd640 1 -- 172.21.15.55:0/2631424307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f39b4081370 con 0x55f503700230 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2631424307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39b4081600 con 0x55f503700230 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39a2ffd640 1 -- 172.21.15.55:0/2631424307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b409e050 con 0x55f503700230 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39cd5e3740 10 client.9429 fetch_fsmap learned FSMap version 99 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2631424307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) v3 -- 0x55f5034176b0 con 0x55f503700230 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39a2ffd640 1 -- 172.21.15.55:0/2631424307 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4081600 con 0x55f503700230 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39a2ffd640 1 -- 172.21.15.55:0/2631424307 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 99) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f39b4078340 con 0x55f503700230 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39cd5e3740 10 client.9429 fetch_fsmap finished waiting for FSMap version 99 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39cd5e3740 10 client.9429 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.681+0000 7f39cd5e3740 20 client.9429 populate_metadata read hostname 'smithi055' 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.682+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.55:6835/3300284863,v1:172.21.15.55:6837/3300284863] conn(0x55f5037368e0 0x55f503738cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.682+0000 7f39cd5e3740 4 client.9429 mds_command: new command op to 9336 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:03.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.682+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2631424307 --> [v2:172.21.15.55:6835/3300284863,v1:172.21.15.55:6837/3300284863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f503697920 con 0x55f5037368e0 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.682+0000 7f39c37fe640 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.55:6835/3300284863,v1:172.21.15.55:6837/3300284863] conn(0x55f5037368e0 0x55f503738cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.682+0000 7f39c37fe640 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.55:6835/3300284863,v1:172.21.15.55:6837/3300284863] conn(0x55f5037368e0 0x55f503738cd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c261665c07a2104 server_cookie=714c93ad6fb6351d in_seq=0 out_seq=0 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.682+0000 7f39a2ffd640 10 client.9429 ms_handle_connect on v2:172.21.15.55:6835/3300284863 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.682+0000 7f39a2ffd640 1 -- 172.21.15.55:0/2631424307 <== mds.0 v2:172.21.15.55:6835/3300284863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f503697920 con 0x55f5037368e0 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.682+0000 7f39a2ffd640 10 client.9429 handle_command_reply: tid=0 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 1 client.9429 shutdown 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2631424307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 msgr2=0x55f5036fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f5036fdb30 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f39b402ae50 tx=0x7f39b4000f90 comp rx=0 tx=0).stop 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2631424307 shutdown_connections 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 0x55f503703380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f50371dad0 0x55f50372ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.55:6835/3300284863,v1:172.21.15.55:6837/3300284863] conn(0x55f5037368e0 0x55f503738cd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/2631424307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f5036fdb30 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39a2ffd640 0 client.9429 ms_handle_reset on v2:172.21.15.55:6835/3300284863 2024-04-25T09:04:03.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2631424307 >> 172.21.15.55:0/2631424307 conn(0x55f5036d5f10 msgr2=0x55f5036d51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2631424307 shutdown_connections 2024-04-25T09:04:03.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2631424307 wait complete. 2024-04-25T09:04:03.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.683+0000 7f39cd5e3740 20 client.9429 trim_cache size 0 max 16384 2024-04-25T09:04:03.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.699+0000 7f39cd5e3740 1 Processor -- start 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.699+0000 7f39cd5e3740 1 -- start start 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.699+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f50377d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.699+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 0x55f50373cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.699+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f50371dad0 0x55f50373d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.699+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c41ffe00 con 0x55f503700230 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.699+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c41503e0 con 0x55f503702f00 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.699+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c41ff800 con 0x55f50371dad0 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.699+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f50377d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.699+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f50377d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59994/0 (socket says 172.21.15.55:59994) 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.699+0000 7f39c3fff640 1 -- 172.21.15.55:0/2122781573 learned_addr learned my addr 172.21.15.55:0/2122781573 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39c37fe640 1 --2- 172.21.15.55:0/2122781573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 0x55f50373cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39c8e7e640 1 --2- 172.21.15.55:0/2122781573 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f50371dad0 0x55f50373d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39c3fff640 1 -- 172.21.15.55:0/2122781573 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f50371dad0 msgr2=0x55f50373d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39c3fff640 1 --2- 172.21.15.55:0/2122781573 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f50371dad0 0x55f50373d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39c3fff640 1 -- 172.21.15.55:0/2122781573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 msgr2=0x55f50373cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39c3fff640 1 --2- 172.21.15.55:0/2122781573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 0x55f50373cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39c3fff640 1 -- 172.21.15.55:0/2122781573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5034176b0 con 0x55f503700230 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39c37fe640 1 --2- 172.21.15.55:0/2122781573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 0x55f50373cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39c3fff640 1 --2- 172.21.15.55:0/2122781573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f50377d5c0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f39b4075300 tx=0x7f39b40a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf12b2b06cdb5d6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39a97fa640 1 -- 172.21.15.55:0/2122781573 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4090040 con 0x55f503700230 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39a97fa640 1 -- 172.21.15.55:0/2122781573 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4095070 con 0x55f503700230 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.700+0000 7f39a97fa640 1 -- 172.21.15.55:0/2122781573 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4081600 con 0x55f503700230 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.701+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2122781573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 msgr2=0x55f50377d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.701+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/2122781573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f50377d5c0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f39b4075300 tx=0x7f39b40a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.701+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2122781573 shutdown_connections 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.701+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/2122781573 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f50371dad0 0x55f50373d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.701+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/2122781573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f503702f00 0x55f50373cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.701+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/2122781573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503700230 0x55f50377d5c0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.701+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2122781573 >> 172.21.15.55:0/2122781573 conn(0x55f5036d5f10 msgr2=0x55f50371e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.701+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2122781573 shutdown_connections 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.701+0000 7f39cd5e3740 1 -- 172.21.15.55:0/2122781573 wait complete. 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.701+0000 7f39cd5e3740 1 -- start start 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.701+0000 7f39cd5e3740 1 Processor -- start 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f503700230 0x55f503776460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503702f00 0x55f50373cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39cd5e3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50371dad0 0x55f50373d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5035e1b30 con 0x55f503702f00 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5035f50c0 con 0x55f50371dad0 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39cd5e3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5037163e0 con 0x55f503700230 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39cd5e3740 10 client.0 _ll_register_callbacks cb 0x55f5036d0c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503702f00 0x55f50373cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503702f00 0x55f50373cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60002/0 (socket says 172.21.15.55:60002) 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39c37fe640 1 -- 172.21.15.55:0/3994944991 learned_addr learned my addr 172.21.15.55:0/3994944991 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39c3fff640 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f503700230 0x55f503776460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.702+0000 7f39c8e7e640 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50371dad0 0x55f50373d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39c37fe640 1 -- 172.21.15.55:0/3994944991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f503700230 msgr2=0x55f503776460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39c37fe640 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f503700230 0x55f503776460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39c37fe640 1 -- 172.21.15.55:0/3994944991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50371dad0 msgr2=0x55f50373d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39c37fe640 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50371dad0 0x55f50373d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39c37fe640 1 -- 172.21.15.55:0/3994944991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f50371eee0 con 0x55f503702f00 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39c37fe640 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503702f00 0x55f50373cea0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f39b8011690 tx=0x7f39b8011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2906fed2706c0dbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39a2ffd640 1 -- 172.21.15.55:0/3994944991 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8026e60 con 0x55f503702f00 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39a2ffd640 1 -- 172.21.15.55:0/3994944991 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f39b800f040 con 0x55f503702f00 2024-04-25T09:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39cd5e3740 1 -- 172.21.15.55:0/3994944991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39b4095070 con 0x55f503702f00 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39a2ffd640 1 -- 172.21.15.55:0/3994944991 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b8004310 con 0x55f503702f00 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39cd5e3740 10 client.9435 fetch_fsmap learned FSMap version 99 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39cd5e3740 1 -- 172.21.15.55:0/3994944991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) v3 -- 0x55f50371ec00 con 0x55f503702f00 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39a2ffd640 1 -- 172.21.15.55:0/3994944991 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4095070 con 0x55f503702f00 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39a2ffd640 1 -- 172.21.15.55:0/3994944991 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 99) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f39b8038080 con 0x55f503702f00 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39cd5e3740 10 client.9435 fetch_fsmap finished waiting for FSMap version 99 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39cd5e3740 10 client.9435 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39cd5e3740 20 client.9435 populate_metadata read hostname 'smithi055' 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.55:6835/3300284863,v1:172.21.15.55:6837/3300284863] conn(0x55f50377c590 0x55f50377f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39cd5e3740 4 client.9435 mds_command: new command op to 9336 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.703+0000 7f39cd5e3740 1 -- 172.21.15.55:0/3994944991 --> [v2:172.21.15.55:6835/3300284863,v1:172.21.15.55:6837/3300284863] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f503645f50 con 0x55f50377c590 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39c3fff640 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.55:6835/3300284863,v1:172.21.15.55:6837/3300284863] conn(0x55f50377c590 0x55f50377f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39c3fff640 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.55:6835/3300284863,v1:172.21.15.55:6837/3300284863] conn(0x55f50377c590 0x55f50377f5d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa625aae94d83de7 server_cookie=258f736dc3890ffa in_seq=0 out_seq=0 2024-04-25T09:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39a2ffd640 10 client.9435 ms_handle_connect on v2:172.21.15.55:6835/3300284863 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39a2ffd640 1 -- 172.21.15.55:0/3994944991 <== mds.0 v2:172.21.15.55:6835/3300284863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55f503645f50 con 0x55f50377c590 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39a2ffd640 10 client.9435 handle_command_reply: tid=0 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 1 client.9435 shutdown 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 1 -- 172.21.15.55:0/3994944991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503702f00 msgr2=0x55f50373cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503702f00 0x55f50373cea0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f39b8011690 tx=0x7f39b8011ce0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 1 -- 172.21.15.55:0/3994944991 shutdown_connections 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50371dad0 0x55f50373d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.55:6835/3300284863,v1:172.21.15.55:6837/3300284863] conn(0x55f50377c590 0x55f50377f5d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f503702f00 0x55f50373cea0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 1 --2- 172.21.15.55:0/3994944991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f503700230 0x55f503776460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39a2ffd640 0 client.9435 ms_handle_reset on v2:172.21.15.55:6835/3300284863 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 1 -- 172.21.15.55:0/3994944991 >> 172.21.15.55:0/3994944991 conn(0x55f5036d5f10 msgr2=0x55f5036fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 1 -- 172.21.15.55:0/3994944991 shutdown_connections 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 1 -- 172.21.15.55:0/3994944991 wait complete. 2024-04-25T09:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.704+0000 7f39cd5e3740 20 client.9435 trim_cache size 0 max 16384 2024-04-25T09:04:03.704 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:04:03.704 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c39ac909-02b8-4b68-9f8d-b272de9b1a7b", 2024-04-25T09:04:03.704 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-25T09:04:03.704 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9336, 2024-04-25T09:04:03.704 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-25T09:04:03.704 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-25T09:04:03.704 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-25T09:04:03.704 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.4414172330000001, 2024-04-25T09:04:03.704 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 99, 2024-04-25T09:04:03.704 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 117, 2024-04-25T09:04:03.705 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 117, 2024-04-25T09:04:03.705 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 6.4279275509999998 2024-04-25T09:04:03.705 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:04:03.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 -- 172.21.15.55:0/314910384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39b006b500 msgr2=0x7f39b006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39b006b500 0x7f39b006d9c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f39c40d13b0 tx=0x7f39b8009320 comp rx=0 tx=0).stop 2024-04-25T09:04:03.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 -- 172.21.15.55:0/314910384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c414ed90 msgr2=0x7f39c40af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c414ed90 0x7f39c40af9e0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f39b4034040 tx=0x7f39c40b7370 comp rx=0 tx=0).stop 2024-04-25T09:04:03.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 -- 172.21.15.55:0/314910384 shutdown_connections 2024-04-25T09:04:03.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f39b006b500 0x7f39b006d9c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c40ad280 0x7f39c406c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c40ac8c0 0x7f39c40acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 --2- 172.21.15.55:0/314910384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c414ed90 0x7f39c40af9e0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 -- 172.21.15.55:0/314910384 >> 172.21.15.55:0/314910384 conn(0x7f39c406f4c0 msgr2=0x7f39c40ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 -- 172.21.15.55:0/314910384 shutdown_connections 2024-04-25T09:04:03.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.705+0000 7f39ca8e1640 1 -- 172.21.15.55:0/314910384 wait complete. 2024-04-25T09:04:03.707 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:04:03.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.820+0000 7f8d5b7ce640 1 Processor -- start 2024-04-25T09:04:03.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.820+0000 7f8d5b7ce640 1 -- start start 2024-04-25T09:04:03.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d5b7ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 0x7f8d540b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d5b7ce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8d540b5990 0x7f8d540b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d5b7ce640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5415e0c0 con 0x7f8d5415dce0 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d5b7ce640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d540b5de0 con 0x7f8d540b5990 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d5b7ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540d2510 con 0x7f8d540d35b0 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d59d6b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8d540b5990 0x7f8d540b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d59d6b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8d540b5990 0x7f8d540b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60014/0 (socket says 172.21.15.55:60014) 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d59d6b640 1 -- 172.21.15.55:0/1821362291 learned_addr learned my addr 172.21.15.55:0/1821362291 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d58d69640 1 --2- 172.21.15.55:0/1821362291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 0x7f8d540b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d59d6b640 1 -- 172.21.15.55:0/1821362291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 msgr2=0x7f8d540b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d59d6b640 1 --2- 172.21.15.55:0/1821362291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 0x7f8d540b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d59d6b640 1 -- 172.21.15.55:0/1821362291 >> v1:172.21.15.167:6789/0 conn(0x7f8d5415dce0 legacy=0x7f8d540d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d59d6b640 1 -- 172.21.15.55:0/1821362291 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d540d27f0 con 0x7f8d540b5990 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.821+0000 7f8d58d69640 1 --2- 172.21.15.55:0/1821362291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 0x7f8d540b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.822+0000 7f8d59d6b640 1 --2- 172.21.15.55:0/1821362291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d540b5990 0x7f8d540b6b00 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009e50 tx=0x7f8d4c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112921b6022433dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.822+0000 7f8d4bfff640 1 -- 172.21.15.55:0/1821362291 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c036070 con 0x7f8d540b5990 2024-04-25T09:04:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.822+0000 7f8d4bfff640 1 -- 172.21.15.55:0/1821362291 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c031600 con 0x7f8d540b5990 2024-04-25T09:04:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.822+0000 7f8d4bfff640 1 -- 172.21.15.55:0/1821362291 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0319d0 con 0x7f8d540b5990 2024-04-25T09:04:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.822+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/1821362291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d540b5990 msgr2=0x7f8d540b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.822+0000 7f8d5b7ce640 1 --2- 172.21.15.55:0/1821362291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d540b5990 0x7f8d540b6b00 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009e50 tx=0x7f8d4c02a6d0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.823+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/1821362291 shutdown_connections 2024-04-25T09:04:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.823+0000 7f8d5b7ce640 1 --2- 172.21.15.55:0/1821362291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d540b5990 0x7f8d540b6b00 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.823+0000 7f8d5b7ce640 1 --2- 172.21.15.55:0/1821362291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 0x7f8d540b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.823+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/1821362291 >> 172.21.15.55:0/1821362291 conn(0x7f8d54072900 msgr2=0x7f8d540d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.823+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/1821362291 shutdown_connections 2024-04-25T09:04:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.823+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/1821362291 wait complete. 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.824+0000 7f8d5b7ce640 1 Processor -- start 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.824+0000 7f8d5b7ce640 1 -- start start 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5b7ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d540b5990 0x7f8d541f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5b7ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 0x7f8d54159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5b7ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d5415dce0 0x7f8d5415efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5b7ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540d3090 con 0x7f8d540b5990 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5b7ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540d2db0 con 0x7f8d5415dce0 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5b7ce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540d2160 con 0x7f8d540d35b0 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5956a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d540b5990 0x7f8d541f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5956a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d540b5990 0x7f8d541f3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60024/0 (socket says 172.21.15.55:60024) 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5956a640 1 -- 172.21.15.55:0/362679163 learned_addr learned my addr 172.21.15.55:0/362679163 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d59d6b640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d5415dce0 0x7f8d5415efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d58d69640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 0x7f8d54159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5956a640 1 -- 172.21.15.55:0/362679163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 msgr2=0x7f8d54159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5956a640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 0x7f8d54159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5956a640 1 -- 172.21.15.55:0/362679163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d5415dce0 msgr2=0x7f8d5415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5956a640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d5415dce0 0x7f8d5415efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5956a640 1 -- 172.21.15.55:0/362679163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5415f830 con 0x7f8d540b5990 2024-04-25T09:04:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d58d69640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 0x7f8d54159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5956a640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d540b5990 0x7f8d541f3bd0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000b3f0 tx=0x7f8d5000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d49ffb640 1 -- 172.21.15.55:0/362679163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50015020 con 0x7f8d540b5990 2024-04-25T09:04:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d49ffb640 1 -- 172.21.15.55:0/362679163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d50011830 con 0x7f8d540b5990 2024-04-25T09:04:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d49ffb640 1 -- 172.21.15.55:0/362679163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50011c20 con 0x7f8d540b5990 2024-04-25T09:04:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.825+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/362679163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d540c8c20 con 0x7f8d540b5990 2024-04-25T09:04:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.826+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/362679163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d54159d90 con 0x7f8d540b5990 2024-04-25T09:04:03.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.827+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/362679163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d540749b0 con 0x7f8d540b5990 2024-04-25T09:04:03.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.827+0000 7f8d49ffb640 1 -- 172.21.15.55:0/362679163 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8d50018020 con 0x7f8d540b5990 2024-04-25T09:04:03.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.828+0000 7f8d49ffb640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d3806b4d0 0x7f8d3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.828+0000 7f8d49ffb640 1 -- 172.21.15.55:0/362679163 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f8d50089db0 con 0x7f8d540b5990 2024-04-25T09:04:03.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.828+0000 7f8d58d69640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d3806b4d0 0x7f8d3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.828+0000 7f8d58d69640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d3806b4d0 0x7f8d3806d990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8d5415ea90 tx=0x7f8d44008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:03.832+0000 7f8d49ffb640 1 -- 172.21.15.55:0/362679163 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d5001f030 con 0x7f8d540b5990 2024-04-25T09:04:04.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.052+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/362679163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d540b4f30 con 0x7f8d540b5990 2024-04-25T09:04:04.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.053+0000 7f8d49ffb640 1 -- 172.21.15.55:0/362679163 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v99) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8d50058c10 con 0x7f8d540b5990 2024-04-25T09:04:04.041 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:04:04.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/362679163 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d3806b4d0 msgr2=0x7f8d3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d3806b4d0 0x7f8d3806d990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8d5415ea90 tx=0x7f8d44008040 comp rx=0 tx=0).stop 2024-04-25T09:04:04.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/362679163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d540b5990 msgr2=0x7f8d541f3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d540b5990 0x7f8d541f3bd0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000b3f0 tx=0x7f8d5000b8b0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/362679163 shutdown_connections 2024-04-25T09:04:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8d3806b4d0 0x7f8d3806d990 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d5415dce0 0x7f8d5415efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d540d35b0 0x7f8d54159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 --2- 172.21.15.55:0/362679163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d540b5990 0x7f8d541f3bd0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/362679163 >> 172.21.15.55:0/362679163 conn(0x7f8d54072900 msgr2=0x7f8d540b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/362679163 shutdown_connections 2024-04-25T09:04:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04.055+0000 7f8d5b7ce640 1 -- 172.21.15.55:0/362679163 wait complete. 2024-04-25T09:04:04.054 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:04:04.054 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:04:04.054 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T09:04:04.054 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:04:04.054 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:04.054 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:04:04.054 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:04:04.054 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:04:04.055 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:04.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:04.055 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T09:04:04.071 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:04.071 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:04.071 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:04.071 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:04.071 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:04.071 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:04.071 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:04:04.071 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:04.071 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T09:04:04.071 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:04:04.071 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42113sec preferred_lft 42113sec 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T09:04:04.072 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:04:04.073 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:04.073 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:04:04.073 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:04.073 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::58ec:54ff:fe3e:e2eb/64 scope link 2024-04-25T09:04:04.073 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:04.073 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:04:04.073 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 9e:8b:6b:0e:9c:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:04:04.073 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::9c8b:6bff:fe0e:9ca5/64 scope link 2024-04-25T09:04:04.074 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:04.074 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:04:04.074 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether e2:67:87:f5:e2:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:04:04.074 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::e067:87ff:fef5:e21e/64 scope link 2024-04-25T09:04:04.074 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:04.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:04.074 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:04:04.134 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:04:04.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:04.136 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T09:04:04.192 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T09:04:04.192 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:04:04.192 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:04:04.192 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:04:04.192 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:04:04.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:04.193 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:04:04.193 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:04:04.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:04:04.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:04:04.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:04:04.193 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:04:04.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:04.278 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:04:04.295 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:04:04.295 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:04:04.295 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:04.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:04.295 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T09:04:04.360 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:04.360 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:04.416 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:04.417 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:04.417 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:04.473 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:04:04.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:04.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:04.555 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:04.555 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:04.555 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:04:04.564 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:04.564 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:04.564 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:04:04.564 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:04:04.564 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:04.569 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:04.569 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:04.569 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:04:04.570 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T09:04:04.570 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:04.570 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790" 2024-04-25T09:04:04.570 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.167:6789,172.21.15.167:6790:/ 2024-04-25T09:04:04.570 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c39ac909-02b8-4b68-9f8d-b272de9b1a7b" will pass to kernel 2024-04-25T09:04:04.570 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:04:04.570 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:04:04.570 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:04:04.570 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:04:04.571 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:04:04.572 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:04:04.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:04.572 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:04.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:04.636 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:04.694 INFO:teuthology.orchestra.run.smithi055.stdout:client8203 2024-04-25T09:04:04.694 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:04:04.694 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:04.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:04.750 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:04:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:./ 2024-04-25T09:04:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:./parent 2024-04-25T09:04:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed 2024-04-25T09:04:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/charlie 2024-04-25T09:04:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/alpha 2024-04-25T09:04:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/bravo 2024-04-25T09:04:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/unflushed 2024-04-25T09:04:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/unflushed/jfile 2024-04-25T09:04:04.811 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:04:04.811 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:04:04.811 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:04:04.811 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:04:04.811 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:04:04.811 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:04:04.917 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:04:04.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:04:04.926 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:04:04.926 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:04:04.926 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:04:04.926 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:04:04.926 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T09:04:04.927 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:04:05.033 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-25T09:04:05.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:04:05.042 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:04:05.042 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:04:05.042 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:04:05.042 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:04:05.042 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T09:04:05.042 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:04:05.148 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-25T09:04:05.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:04:05.157 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:04:05.157 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:04:05.158 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:04:05.158 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:04:05.158 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T09:04:05.158 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:04:05.265 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627780 2024-04-25T09:04:05.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:04:05.274 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:04:05.275 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:04:05.275 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:04:05.275 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:04:05.275 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T09:04:05.275 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:04:05.382 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627778 2024-04-25T09:04:05.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:04:05.391 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:04:05.391 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:04:05.391 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:04:05.391 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:04:05.391 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T09:04:05.391 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:04:05.498 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627779 2024-04-25T09:04:05.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:04:05.508 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:04:05.508 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:04:05.508 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:04:05.508 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:04:05.508 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T09:04:05.508 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:04:05.615 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627781 2024-04-25T09:04:05.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:04:05.625 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-04-25T09:04:05.625 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-25T09:04:05.625 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-25T09:04:05.625 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-25T09:04:05.625 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T09:04:05.625 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-25T09:04:05.732 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627782 2024-04-25T09:04:05.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:04:05.741 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:04:05.741 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:05.818 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:05.868 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:04:05.868 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:04:05.868 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:05.884 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:04:05.884 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:05.940 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:06.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.092+0000 7f031d9e0640 1 Processor -- start 2024-04-25T09:04:06.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.092+0000 7f031d9e0640 1 -- start start 2024-04-25T09:04:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.093+0000 7f031d9e0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03180cfdb0 0x7f0318166720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.093+0000 7f031d9e0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03180cdfe0 con 0x7f031815f120 2024-04-25T09:04:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.093+0000 7f031d9e0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03180d0430 con 0x7f03180cea00 2024-04-25T09:04:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.093+0000 7f031d9e0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03180d09f0 con 0x7f03180cfdb0 2024-04-25T09:04:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.093+0000 7f0316ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f031815f120 0x7f03180ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39340/0 (socket says 172.21.15.55:39340) 2024-04-25T09:04:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.093+0000 7f0316ffd640 1 -- 172.21.15.55:0/3217081630 learned_addr learned my addr 172.21.15.55:0/3217081630 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f03177fe640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03180cfdb0 0x7f0318166720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882623660 0 0) 0x7f03180cdfe0 con 0x7f031815f120 2024-04-25T09:04:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0300003520 con 0x7f031815f120 2024-04-25T09:04:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1527210101 0 0) 0x7f0300003520 con 0x7f031815f120 2024-04-25T09:04:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03180cfdb0 msgr2=0x7f0318166720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03180cfdb0 0x7f0318166720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 >> v1:172.21.15.167:6789/0 conn(0x7f03180cea00 legacy=0x7f03180cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03180d0710 con 0x7f031815f120 2024-04-25T09:04:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f0310001670 con 0x7f031815f120 2024-04-25T09:04:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 >> v1:172.21.15.55:6789/0 conn(0x7f031815f120 legacy=0x7f03180ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03000039e0 0x7f0300003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0300004390 0x7f0300004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03180cfdb0 0x7f03000050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180d09f0 con 0x7f0300004390 2024-04-25T09:04:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030000b9c0 con 0x7f03000039e0 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030000bbc0 con 0x7f03180cfdb0 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f03167fc640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0300004390 0x7f0300004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f0316ffd640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03000039e0 0x7f0300003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f03177fe640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03180cfdb0 0x7f03000050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f03167fc640 1 -- 172.21.15.55:0/3217081630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03180cfdb0 msgr2=0x7f03000050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f03167fc640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03180cfdb0 0x7f03000050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f03167fc640 1 -- 172.21.15.55:0/3217081630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03000039e0 msgr2=0x7f0300003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f03167fc640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03000039e0 0x7f0300003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.094+0000 7f03167fc640 1 -- 172.21.15.55:0/3217081630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300003520 con 0x7f0300004390 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.095+0000 7f03167fc640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0300004390 0x7f0300004860 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f030c001860 tx=0x7f0300005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beee914f45548085 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.095+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c037070 con 0x7f0300004390 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.095+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c02abf0 con 0x7f0300004390 2024-04-25T09:04:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.095+0000 7f0315ffb640 1 -- 172.21.15.55:0/3217081630 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c001430 con 0x7f0300004390 2024-04-25T09:04:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.096+0000 7f031d9e0640 1 -- 172.21.15.55:0/3217081630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0300004390 msgr2=0x7f0300004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.096+0000 7f031d9e0640 1 --2- 172.21.15.55:0/3217081630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0300004390 0x7f0300004860 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f030c001860 tx=0x7f0300005830 comp rx=0 tx=0).stop 2024-04-25T09:04:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.096+0000 7f03177fe640 1 -- 172.21.15.55:0/3217081630 reap_dead start 2024-04-25T09:04:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.096+0000 7f031d9e0640 1 -- 172.21.15.55:0/3217081630 shutdown_connections 2024-04-25T09:04:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.096+0000 7f031d9e0640 1 -- 172.21.15.55:0/3217081630 >> 172.21.15.55:0/3217081630 conn(0x7f03180d1900 msgr2=0x7f03180d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.096+0000 7f031d9e0640 1 -- 172.21.15.55:0/3217081630 shutdown_connections 2024-04-25T09:04:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.096+0000 7f031d9e0640 1 -- 172.21.15.55:0/3217081630 wait complete. 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.097+0000 7f031d9e0640 1 Processor -- start 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.097+0000 7f031d9e0640 1 -- start start 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f031d9e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0300004390 0x7f03180b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f031d9e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03180b0880 0x7f031814b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f031d9e0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03181f47d0 0x7f03181f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f031d9e0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180cc480 con 0x7f03180b0880 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f031d9e0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180ccab0 con 0x7f0300004390 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f031d9e0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03180c5450 con 0x7f03181f47d0 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f03167fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03180b0880 0x7f031814b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f03167fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03180b0880 0x7f031814b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60042/0 (socket says 172.21.15.55:60042) 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f03167fc640 1 -- 172.21.15.55:0/589775070 learned_addr learned my addr 172.21.15.55:0/589775070 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f03177fe640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03181f47d0 0x7f03181f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f0316ffd640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0300004390 0x7f03180b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f03167fc640 1 -- 172.21.15.55:0/589775070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03181f47d0 msgr2=0x7f03181f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f03167fc640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03181f47d0 0x7f03181f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.098+0000 7f03167fc640 1 -- 172.21.15.55:0/589775070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0300004390 msgr2=0x7f03180b70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.099+0000 7f03167fc640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0300004390 0x7f03180b70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.099+0000 7f03167fc640 1 -- 172.21.15.55:0/589775070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03180b7600 con 0x7f03180b0880 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.099+0000 7f03167fc640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03180b0880 0x7f031814b6c0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f030c0077b0 tx=0x7f030c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.099+0000 7f02fffff640 1 -- 172.21.15.55:0/589775070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c03f020 con 0x7f03180b0880 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.099+0000 7f02fffff640 1 -- 172.21.15.55:0/589775070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c005270 con 0x7f03180b0880 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.099+0000 7f031d9e0640 1 -- 172.21.15.55:0/589775070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031814bc00 con 0x7f03180b0880 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.099+0000 7f02fffff640 1 -- 172.21.15.55:0/589775070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c037040 con 0x7f03180b0880 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.099+0000 7f031d9e0640 1 -- 172.21.15.55:0/589775070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03180b1120 con 0x7f03180b0880 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.100+0000 7f031d9e0640 1 -- 172.21.15.55:0/589775070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0318067850 con 0x7f03180b0880 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.100+0000 7f02fffff640 1 -- 172.21.15.55:0/589775070 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f030c042020 con 0x7f03180b0880 2024-04-25T09:04:06.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.101+0000 7f02fffff640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f030406b4d0 0x7f030406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.101+0000 7f02fffff640 1 -- 172.21.15.55:0/589775070 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f030c0aa3b0 con 0x7f03180b0880 2024-04-25T09:04:06.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.101+0000 7f0316ffd640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f030406b4d0 0x7f030406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.101+0000 7f0316ffd640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f030406b4d0 0x7f030406d990 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0310001cf0 tx=0x7f0310001b80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.105+0000 7f02fffff640 1 -- 172.21.15.55:0/589775070 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f030c049020 con 0x7f03180b0880 2024-04-25T09:04:06.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.289+0000 7f031d9e0640 1 -- 172.21.15.55:0/589775070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03180749b0 con 0x7f03180b0880 2024-04-25T09:04:06.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.290+0000 7f02fffff640 1 -- 172.21.15.55:0/589775070 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16886 (secure 0 0 0) 0x7f030c078b30 con 0x7f03180b0880 2024-04-25T09:04:06.278 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:06.279 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":117,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:57.240387+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:31.900630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:32.603273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3667784674":"2024-04-26T09:03:57.240366+0000","172.21.15.55:6835/3667784674":"2024-04-26T09:03:57.240366+0000","172.21.15.55:6837/4257598582":"2024-04-26T09:03:46.638997+0000","172.21.15.55:6835/4257598582":"2024-04-26T09:03:46.638997+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 -- 172.21.15.55:0/589775070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f030406b4d0 msgr2=0x7f030406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f030406b4d0 0x7f030406d990 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0310001cf0 tx=0x7f0310001b80 comp rx=0 tx=0).stop 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 -- 172.21.15.55:0/589775070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03180b0880 msgr2=0x7f031814b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03180b0880 0x7f031814b6c0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f030c0077b0 tx=0x7f030c001230 comp rx=0 tx=0).stop 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 -- 172.21.15.55:0/589775070 shutdown_connections 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f030406b4d0 0x7f030406d990 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03181f47d0 0x7f03181f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03180b0880 0x7f031814b6c0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 --2- 172.21.15.55:0/589775070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0300004390 0x7f03180b70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 -- 172.21.15.55:0/589775070 >> 172.21.15.55:0/589775070 conn(0x7f03180d1900 msgr2=0x7f03180b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 -- 172.21.15.55:0/589775070 shutdown_connections 2024-04-25T09:04:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.292+0000 7f031d9e0640 1 -- 172.21.15.55:0/589775070 wait complete. 2024-04-25T09:04:06.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:03:31.900630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:03:32.603273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:06.292 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:06.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.409+0000 7f039d949640 1 Processor -- start 2024-04-25T09:04:06.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.409+0000 7f039d949640 1 -- start start 2024-04-25T09:04:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.409+0000 7f039d949640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03980b97c0 0x7f03980b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.409+0000 7f039d949640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03980b5a30 0x7f03980d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.409+0000 7f039d949640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03981627a0 con 0x7f039815dc80 2024-04-25T09:04:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.409+0000 7f039d949640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03980b5ea0 con 0x7f03980b5a30 2024-04-25T09:04:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.409+0000 7f039d949640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0398161f80 con 0x7f03980b97c0 2024-04-25T09:04:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.410+0000 7f03977fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03980b5a30 0x7f03980d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.410+0000 7f03977fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03980b5a30 0x7f03980d2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60050/0 (socket says 172.21.15.55:60050) 2024-04-25T09:04:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.410+0000 7f03977fe640 1 -- 172.21.15.55:0/163845621 learned_addr learned my addr 172.21.15.55:0/163845621 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.410+0000 7f03967fc640 1 --2- 172.21.15.55:0/163845621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03980b97c0 0x7f03980b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.410+0000 7f03977fe640 1 -- 172.21.15.55:0/163845621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03980b97c0 msgr2=0x7f03980b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.410+0000 7f03977fe640 1 --2- 172.21.15.55:0/163845621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03980b97c0 0x7f03980b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.410+0000 7f03977fe640 1 -- 172.21.15.55:0/163845621 >> v1:172.21.15.167:6789/0 conn(0x7f039815dc80 legacy=0x7f0398161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.410+0000 7f03977fe640 1 -- 172.21.15.55:0/163845621 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03981621e0 con 0x7f03980b5a30 2024-04-25T09:04:06.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.411+0000 7f03977fe640 1 --2- 172.21.15.55:0/163845621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03980b5a30 0x7f03980d2470 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f0388009e80 tx=0x7f038802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d351d273f4613f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.411+0000 7f0395ffb640 1 -- 172.21.15.55:0/163845621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388036070 con 0x7f03980b5a30 2024-04-25T09:04:06.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.411+0000 7f0395ffb640 1 -- 172.21.15.55:0/163845621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0388031600 con 0x7f03980b5a30 2024-04-25T09:04:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.411+0000 7f0395ffb640 1 -- 172.21.15.55:0/163845621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03880319d0 con 0x7f03980b5a30 2024-04-25T09:04:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.411+0000 7f039d949640 1 -- 172.21.15.55:0/163845621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03980b5a30 msgr2=0x7f03980d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.411+0000 7f039d949640 1 --2- 172.21.15.55:0/163845621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03980b5a30 0x7f03980d2470 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f0388009e80 tx=0x7f038802a750 comp rx=0 tx=0).stop 2024-04-25T09:04:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.411+0000 7f039d949640 1 -- 172.21.15.55:0/163845621 shutdown_connections 2024-04-25T09:04:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.411+0000 7f039d949640 1 --2- 172.21.15.55:0/163845621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03980b5a30 0x7f03980d2470 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.411+0000 7f039d949640 1 --2- 172.21.15.55:0/163845621 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03980b97c0 0x7f03980b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.411+0000 7f039d949640 1 -- 172.21.15.55:0/163845621 >> 172.21.15.55:0/163845621 conn(0x7f03980d04f0 msgr2=0x7f03980d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.412+0000 7f039d949640 1 -- 172.21.15.55:0/163845621 shutdown_connections 2024-04-25T09:04:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.412+0000 7f039d949640 1 -- 172.21.15.55:0/163845621 wait complete. 2024-04-25T09:04:06.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.413+0000 7f039d949640 1 Processor -- start 2024-04-25T09:04:06.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.413+0000 7f039d949640 1 -- start start 2024-04-25T09:04:06.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.413+0000 7f039d949640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03980b5a30 0x7f0398160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f039d949640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03980b97c0 0x7f03981e76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f039d949640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f039815dc80 0x7f0398158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f039d949640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039815e060 con 0x7f03980b97c0 2024-04-25T09:04:06.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f039d949640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980d1c70 con 0x7f03980b5a30 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f039d949640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03980d29b0 con 0x7f039815dc80 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f03967fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03980b97c0 0x7f03981e76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f03967fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03980b97c0 0x7f03981e76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60062/0 (socket says 172.21.15.55:60062) 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f03967fc640 1 -- 172.21.15.55:0/1433393350 learned_addr learned my addr 172.21.15.55:0/1433393350 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f03977fe640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f039815dc80 0x7f0398158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f0396ffd640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03980b5a30 0x7f0398160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f03967fc640 1 -- 172.21.15.55:0/1433393350 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f039815dc80 msgr2=0x7f0398158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f03967fc640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f039815dc80 0x7f0398158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f03967fc640 1 -- 172.21.15.55:0/1433393350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03980b5a30 msgr2=0x7f0398160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f03967fc640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03980b5a30 0x7f0398160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f03967fc640 1 -- 172.21.15.55:0/1433393350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03981e7e20 con 0x7f03980b97c0 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f03967fc640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03980b97c0 0x7f03981e76b0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f038000e980 tx=0x7f038000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f038ffff640 1 -- 172.21.15.55:0/1433393350 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380017070 con 0x7f03980b97c0 2024-04-25T09:04:06.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f038ffff640 1 -- 172.21.15.55:0/1433393350 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038000ca00 con 0x7f03980b97c0 2024-04-25T09:04:06.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f038ffff640 1 -- 172.21.15.55:0/1433393350 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038000cdd0 con 0x7f03980b97c0 2024-04-25T09:04:06.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f039d949640 1 -- 172.21.15.55:0/1433393350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03981e8100 con 0x7f03980b97c0 2024-04-25T09:04:06.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.414+0000 7f039d949640 1 -- 172.21.15.55:0/1433393350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03981e86c0 con 0x7f03980b97c0 2024-04-25T09:04:06.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.415+0000 7f039d949640 1 -- 172.21.15.55:0/1433393350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03980750b0 con 0x7f03980b97c0 2024-04-25T09:04:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.416+0000 7f038ffff640 1 -- 172.21.15.55:0/1433393350 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f038001a070 con 0x7f03980b97c0 2024-04-25T09:04:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.416+0000 7f038ffff640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f037806b4d0 0x7f037806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.416+0000 7f038ffff640 1 -- 172.21.15.55:0/1433393350 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f038008a6d0 con 0x7f03980b97c0 2024-04-25T09:04:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.416+0000 7f0396ffd640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f037806b4d0 0x7f037806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.417+0000 7f0396ffd640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f037806b4d0 0x7f037806d990 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0390007fd0 tx=0x7f0390009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.421+0000 7f038ffff640 1 -- 172.21.15.55:0/1433393350 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0380059420 con 0x7f03980b97c0 2024-04-25T09:04:06.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.605+0000 7f039d949640 1 -- 172.21.15.55:0/1433393350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03980d1780 con 0x7f03980b97c0 2024-04-25T09:04:06.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.606+0000 7f038ffff640 1 -- 172.21.15.55:0/1433393350 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0380058d20 con 0x7f03980b97c0 2024-04-25T09:04:06.594 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:04:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 -- 172.21.15.55:0/1433393350 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f037806b4d0 msgr2=0x7f037806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f037806b4d0 0x7f037806d990 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0390007fd0 tx=0x7f0390009040 comp rx=0 tx=0).stop 2024-04-25T09:04:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 -- 172.21.15.55:0/1433393350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03980b97c0 msgr2=0x7f03981e76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03980b97c0 0x7f03981e76b0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f038000e980 tx=0x7f038000ee40 comp rx=0 tx=0).stop 2024-04-25T09:04:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 -- 172.21.15.55:0/1433393350 shutdown_connections 2024-04-25T09:04:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f037806b4d0 0x7f037806d990 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f039815dc80 0x7f0398158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03980b97c0 0x7f03981e76b0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 --2- 172.21.15.55:0/1433393350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03980b5a30 0x7f0398160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 -- 172.21.15.55:0/1433393350 >> 172.21.15.55:0/1433393350 conn(0x7f03980d04f0 msgr2=0x7f03980cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 -- 172.21.15.55:0/1433393350 shutdown_connections 2024-04-25T09:04:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.608+0000 7f039d949640 1 -- 172.21.15.55:0/1433393350 wait complete. 2024-04-25T09:04:06.607 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.723+0000 7f0b607f4640 1 Processor -- start 2024-04-25T09:04:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.723+0000 7f0b607f4640 1 -- start start 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b607f4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0b5815dc80 0x7f0b58161870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b607f4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b580b97c0 0x7f0b580b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b607f4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b580b5a30 0x7f0b5806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b607f4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b580b5e60 con 0x7f0b580b97c0 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b607f4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b581627a0 con 0x7f0b5815dc80 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b607f4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b581621e0 con 0x7f0b580b5a30 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b5dd8f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b580b97c0 0x7f0b580b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b5dd8f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b580b97c0 0x7f0b580b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60070/0 (socket says 172.21.15.55:60070) 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b5dd8f640 1 -- 172.21.15.55:0/2911624148 learned_addr learned my addr 172.21.15.55:0/2911624148 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b5ed91640 1 --2- 172.21.15.55:0/2911624148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b580b5a30 0x7f0b5806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b5e590640 1 --2- 172.21.15.55:0/2911624148 >> v2:172.21.15.167:3300/0 conn(0x7f0b5815dc80 0x7f0b58161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b5dd8f640 1 -- 172.21.15.55:0/2911624148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b580b5a30 msgr2=0x7f0b5806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b5dd8f640 1 --2- 172.21.15.55:0/2911624148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b580b5a30 0x7f0b5806bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b5dd8f640 1 -- 172.21.15.55:0/2911624148 >> v2:172.21.15.167:3300/0 conn(0x7f0b5815dc80 msgr2=0x7f0b58161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b5dd8f640 1 --2- 172.21.15.55:0/2911624148 >> v2:172.21.15.167:3300/0 conn(0x7f0b5815dc80 0x7f0b58161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b5dd8f640 1 -- 172.21.15.55:0/2911624148 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b581624c0 con 0x7f0b580b97c0 2024-04-25T09:04:06.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.724+0000 7f0b5e590640 1 --2- 172.21.15.55:0/2911624148 >> v2:172.21.15.167:3300/0 conn(0x7f0b5815dc80 0x7f0b58161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:06.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.725+0000 7f0b5dd8f640 1 --2- 172.21.15.55:0/2911624148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b580b97c0 0x7f0b580b54f0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f0b5806dab0 tx=0x7f0b4802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daca21402d750f0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.725+0000 7f0b5d58e640 1 -- 172.21.15.55:0/2911624148 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48037070 con 0x7f0b580b97c0 2024-04-25T09:04:06.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.725+0000 7f0b5d58e640 1 -- 172.21.15.55:0/2911624148 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48032440 con 0x7f0b580b97c0 2024-04-25T09:04:06.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.725+0000 7f0b5d58e640 1 -- 172.21.15.55:0/2911624148 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48032810 con 0x7f0b580b97c0 2024-04-25T09:04:06.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.726+0000 7f0b607f4640 1 -- 172.21.15.55:0/2911624148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b580b97c0 msgr2=0x7f0b580b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.726+0000 7f0b607f4640 1 --2- 172.21.15.55:0/2911624148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b580b97c0 0x7f0b580b54f0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f0b5806dab0 tx=0x7f0b4802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.726+0000 7f0b607f4640 1 -- 172.21.15.55:0/2911624148 shutdown_connections 2024-04-25T09:04:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.726+0000 7f0b607f4640 1 --2- 172.21.15.55:0/2911624148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b580b5a30 0x7f0b5806bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.726+0000 7f0b607f4640 1 --2- 172.21.15.55:0/2911624148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b580b97c0 0x7f0b580b54f0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.726+0000 7f0b607f4640 1 --2- 172.21.15.55:0/2911624148 >> v2:172.21.15.167:3300/0 conn(0x7f0b5815dc80 0x7f0b58161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.726+0000 7f0b607f4640 1 -- 172.21.15.55:0/2911624148 >> 172.21.15.55:0/2911624148 conn(0x7f0b580d04f0 msgr2=0x7f0b580d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.726+0000 7f0b607f4640 1 -- 172.21.15.55:0/2911624148 shutdown_connections 2024-04-25T09:04:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.726+0000 7f0b607f4640 1 -- 172.21.15.55:0/2911624148 wait complete. 2024-04-25T09:04:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.727+0000 7f0b607f4640 1 Processor -- start 2024-04-25T09:04:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.727+0000 7f0b607f4640 1 -- start start 2024-04-25T09:04:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b607f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b580b5a30 0x7f0b5815fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b607f4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b580b97c0 0x7f0b58149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b607f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5815dc80 0x7f0b58149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b607f4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b58161db0 con 0x7f0b5815dc80 2024-04-25T09:04:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b607f4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5815e060 con 0x7f0b580b5a30 2024-04-25T09:04:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b607f4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b58161f30 con 0x7f0b580b97c0 2024-04-25T09:04:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b5ed91640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5815dc80 0x7f0b58149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b5ed91640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5815dc80 0x7f0b58149940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60084/0 (socket says 172.21.15.55:60084) 2024-04-25T09:04:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b5ed91640 1 -- 172.21.15.55:0/3087990918 learned_addr learned my addr 172.21.15.55:0/3087990918 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b5e590640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b580b5a30 0x7f0b5815fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b5dd8f640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b580b97c0 0x7f0b58149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b5ed91640 1 -- 172.21.15.55:0/3087990918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b580b97c0 msgr2=0x7f0b58149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b5ed91640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b580b97c0 0x7f0b58149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b5ed91640 1 -- 172.21.15.55:0/3087990918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b580b5a30 msgr2=0x7f0b5815fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b5ed91640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b580b5a30 0x7f0b5815fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b5ed91640 1 -- 172.21.15.55:0/3087990918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b580cd990 con 0x7f0b5815dc80 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b5ed91640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5815dc80 0x7f0b58149940 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000eed0 tx=0x7f0b5000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b4effd640 1 -- 172.21.15.55:0/3087990918 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50018020 con 0x7f0b5815dc80 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b4effd640 1 -- 172.21.15.55:0/3087990918 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50014400 con 0x7f0b5815dc80 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.728+0000 7f0b607f4640 1 -- 172.21.15.55:0/3087990918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5815f1f0 con 0x7f0b5815dc80 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.729+0000 7f0b4effd640 1 -- 172.21.15.55:0/3087990918 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b500147f0 con 0x7f0b5815dc80 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.729+0000 7f0b607f4640 1 -- 172.21.15.55:0/3087990918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b581495c0 con 0x7f0b5815dc80 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.730+0000 7f0b607f4640 1 -- 172.21.15.55:0/3087990918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b580d0e00 con 0x7f0b5815dc80 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.730+0000 7f0b4effd640 1 -- 172.21.15.55:0/3087990918 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b50005d10 con 0x7f0b5815dc80 2024-04-25T09:04:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.730+0000 7f0b4effd640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b3c06b4d0 0x7f0b3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.730+0000 7f0b4effd640 1 -- 172.21.15.55:0/3087990918 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0b5008aab0 con 0x7f0b5815dc80 2024-04-25T09:04:06.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.730+0000 7f0b5e590640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b3c06b4d0 0x7f0b3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.731+0000 7f0b5e590640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b3c06b4d0 0x7f0b3c06d990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0b54006fd0 tx=0x7f0b54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.734+0000 7f0b4effd640 1 -- 172.21.15.55:0/3087990918 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b580d0e00 con 0x7f0b5815dc80 2024-04-25T09:04:06.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.915+0000 7f0b607f4640 1 -- 172.21.15.55:0/3087990918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b580750b0 con 0x7f0b5815dc80 2024-04-25T09:04:06.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.916+0000 7f0b4effd640 1 -- 172.21.15.55:0/3087990918 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b50022030 con 0x7f0b5815dc80 2024-04-25T09:04:06.904 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T09:04:06.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 -- 172.21.15.55:0/3087990918 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b3c06b4d0 msgr2=0x7f0b3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b3c06b4d0 0x7f0b3c06d990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0b54006fd0 tx=0x7f0b54008040 comp rx=0 tx=0).stop 2024-04-25T09:04:06.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 -- 172.21.15.55:0/3087990918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5815dc80 msgr2=0x7f0b58149940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5815dc80 0x7f0b58149940 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000eed0 tx=0x7f0b5000b480 comp rx=0 tx=0).stop 2024-04-25T09:04:06.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 -- 172.21.15.55:0/3087990918 shutdown_connections 2024-04-25T09:04:06.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f0b3c06b4d0 0x7f0b3c06d990 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5815dc80 0x7f0b58149940 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b580b97c0 0x7f0b58149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 --2- 172.21.15.55:0/3087990918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b580b5a30 0x7f0b5815fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 -- 172.21.15.55:0/3087990918 >> 172.21.15.55:0/3087990918 conn(0x7f0b580d04f0 msgr2=0x7f0b580b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 -- 172.21.15.55:0/3087990918 shutdown_connections 2024-04-25T09:04:06.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:06.918+0000 7f0b607f4640 1 -- 172.21.15.55:0/3087990918 wait complete. 2024-04-25T09:04:06.917 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:07.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.033+0000 7fac49c9e640 1 Processor -- start 2024-04-25T09:04:07.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.033+0000 7fac49c9e640 1 -- start start 2024-04-25T09:04:07.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.034+0000 7fac49c9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fac4415dca0 0x7fac440ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.034+0000 7fac49c9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac440d3b90 0x7fac440d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.034+0000 7fac49c9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac440d4090 con 0x7fac440cee80 2024-04-25T09:04:07.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.034+0000 7fac49c9e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440b6b20 con 0x7fac4415dca0 2024-04-25T09:04:07.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.034+0000 7fac49c9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac440d4370 con 0x7fac440d3b90 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.034+0000 7fac43fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fac440cee80 0x7fac440b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39356/0 (socket says 172.21.15.55:39356) 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.034+0000 7fac43fff640 1 -- 172.21.15.55:0/2722224807 learned_addr learned my addr 172.21.15.55:0/2722224807 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.034+0000 7fac42ffd640 1 --2- 172.21.15.55:0/2722224807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac440d3b90 0x7fac440d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.034+0000 7fac437fe640 1 --2- 172.21.15.55:0/2722224807 >> v2:172.21.15.167:3300/0 conn(0x7fac4415dca0 0x7fac440ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.034+0000 7fac427fc640 1 -- 172.21.15.55:0/2722224807 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058958935 0 0) 0x7fac440d4090 con 0x7fac440cee80 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.035+0000 7fac427fc640 1 -- 172.21.15.55:0/2722224807 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac2c003520 con 0x7fac440cee80 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.035+0000 7fac42ffd640 1 -- 172.21.15.55:0/2722224807 >> v2:172.21.15.167:3300/0 conn(0x7fac4415dca0 msgr2=0x7fac440ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.035+0000 7fac427fc640 1 -- 172.21.15.55:0/2722224807 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2238926766 0 0) 0x7fac2c003520 con 0x7fac440cee80 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.035+0000 7fac42ffd640 1 --2- 172.21.15.55:0/2722224807 >> v2:172.21.15.167:3300/0 conn(0x7fac4415dca0 0x7fac440ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.035+0000 7fac42ffd640 1 -- 172.21.15.55:0/2722224807 >> v1:172.21.15.55:6789/0 conn(0x7fac440cee80 legacy=0x7fac440b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.035+0000 7fac42ffd640 1 -- 172.21.15.55:0/2722224807 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440d4650 con 0x7fac440d3b90 2024-04-25T09:04:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.035+0000 7fac437fe640 1 --2- 172.21.15.55:0/2722224807 >> v2:172.21.15.167:3300/0 conn(0x7fac4415dca0 0x7fac440ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:07.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac42ffd640 1 --2- 172.21.15.55:0/2722224807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac440d3b90 0x7fac440d0a20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac380097a0 tx=0x7fac3802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95b773ab273a558b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac427fc640 1 -- 172.21.15.55:0/2722224807 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38037070 con 0x7fac440d3b90 2024-04-25T09:04:07.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac427fc640 1 -- 172.21.15.55:0/2722224807 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3802aba0 con 0x7fac440d3b90 2024-04-25T09:04:07.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac427fc640 1 -- 172.21.15.55:0/2722224807 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0019f0 con 0x7fac440d3b90 2024-04-25T09:04:07.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac49c9e640 1 -- 172.21.15.55:0/2722224807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac440d3b90 msgr2=0x7fac440d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac49c9e640 1 --2- 172.21.15.55:0/2722224807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac440d3b90 0x7fac440d0a20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac380097a0 tx=0x7fac3802a110 comp rx=0 tx=0).stop 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac49c9e640 1 -- 172.21.15.55:0/2722224807 shutdown_connections 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac49c9e640 1 --2- 172.21.15.55:0/2722224807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac440d3b90 0x7fac440d0a20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac49c9e640 1 --2- 172.21.15.55:0/2722224807 >> v2:172.21.15.167:3300/0 conn(0x7fac4415dca0 0x7fac440ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac49c9e640 1 -- 172.21.15.55:0/2722224807 >> 172.21.15.55:0/2722224807 conn(0x7fac440726c0 msgr2=0x7fac44072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac49c9e640 1 -- 172.21.15.55:0/2722224807 shutdown_connections 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.036+0000 7fac49c9e640 1 -- 172.21.15.55:0/2722224807 wait complete. 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.037+0000 7fac49c9e640 1 Processor -- start 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.038+0000 7fac49c9e640 1 -- start start 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.038+0000 7fac49c9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac440cee80 0x7fac44155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.038+0000 7fac49c9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac440d3b90 0x7fac4415ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.038+0000 7fac49c9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac4415dca0 0x7fac44153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.038+0000 7fac49c9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4415e200 con 0x7fac440d3b90 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.038+0000 7fac49c9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4415e080 con 0x7fac4415dca0 2024-04-25T09:04:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.038+0000 7fac49c9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac440d0f60 con 0x7fac440cee80 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac42ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac440d3b90 0x7fac4415ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac42ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac440d3b90 0x7fac4415ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60092/0 (socket says 172.21.15.55:60092) 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac42ffd640 1 -- 172.21.15.55:0/244235852 learned_addr learned my addr 172.21.15.55:0/244235852 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac437fe640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac440cee80 0x7fac44155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac43fff640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac4415dca0 0x7fac44153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac42ffd640 1 -- 172.21.15.55:0/244235852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac440cee80 msgr2=0x7fac44155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac42ffd640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac440cee80 0x7fac44155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac42ffd640 1 -- 172.21.15.55:0/244235852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac4415dca0 msgr2=0x7fac44153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac42ffd640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac4415dca0 0x7fac44153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac42ffd640 1 -- 172.21.15.55:0/244235852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac44157680 con 0x7fac440d3b90 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac42ffd640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac440d3b90 0x7fac4415ed90 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fac38035040 tx=0x7fac380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac2bfff640 1 -- 172.21.15.55:0/244235852 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38041020 con 0x7fac440d3b90 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac2bfff640 1 -- 172.21.15.55:0/244235852 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3803d620 con 0x7fac440d3b90 2024-04-25T09:04:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac49c9e640 1 -- 172.21.15.55:0/244235852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4415f2d0 con 0x7fac440d3b90 2024-04-25T09:04:07.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac2bfff640 1 -- 172.21.15.55:0/244235852 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38037040 con 0x7fac440d3b90 2024-04-25T09:04:07.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.039+0000 7fac49c9e640 1 -- 172.21.15.55:0/244235852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4415f850 con 0x7fac440d3b90 2024-04-25T09:04:07.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.040+0000 7fac49c9e640 1 -- 172.21.15.55:0/244235852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac440750b0 con 0x7fac440d3b90 2024-04-25T09:04:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.041+0000 7fac2bfff640 1 -- 172.21.15.55:0/244235852 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac38044020 con 0x7fac440d3b90 2024-04-25T09:04:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.041+0000 7fac2bfff640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3006b4d0 0x7fac3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.041+0000 7fac2bfff640 1 -- 172.21.15.55:0/244235852 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fac380aa620 con 0x7fac440d3b90 2024-04-25T09:04:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.041+0000 7fac437fe640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3006b4d0 0x7fac3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.042+0000 7fac437fe640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3006b4d0 0x7fac3006d990 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fac34009560 tx=0x7fac34009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.046+0000 7fac2bfff640 1 -- 172.21.15.55:0/244235852 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac3804b030 con 0x7fac440d3b90 2024-04-25T09:04:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.226+0000 7fac49c9e640 1 -- 172.21.15.55:0/244235852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac440b8880 con 0x7fac440d3b90 2024-04-25T09:04:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.227+0000 7fac2bfff640 1 -- 172.21.15.55:0/244235852 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac38078da0 con 0x7fac440d3b90 2024-04-25T09:04:07.215 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T09:04:07.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 -- 172.21.15.55:0/244235852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3006b4d0 msgr2=0x7fac3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3006b4d0 0x7fac3006d990 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fac34009560 tx=0x7fac34009190 comp rx=0 tx=0).stop 2024-04-25T09:04:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 -- 172.21.15.55:0/244235852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac440d3b90 msgr2=0x7fac4415ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac440d3b90 0x7fac4415ed90 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fac38035040 tx=0x7fac380046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 -- 172.21.15.55:0/244235852 shutdown_connections 2024-04-25T09:04:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fac3006b4d0 0x7fac3006d990 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac4415dca0 0x7fac44153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac440d3b90 0x7fac4415ed90 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 --2- 172.21.15.55:0/244235852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac440cee80 0x7fac44155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 -- 172.21.15.55:0/244235852 >> 172.21.15.55:0/244235852 conn(0x7fac440726c0 msgr2=0x7fac4415d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 -- 172.21.15.55:0/244235852 shutdown_connections 2024-04-25T09:04:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.229+0000 7fac49c9e640 1 -- 172.21.15.55:0/244235852 wait complete. 2024-04-25T09:04:07.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:04:07.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.342+0000 7ff9c0ce1640 1 Processor -- start 2024-04-25T09:04:07.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.343+0000 7ff9c0ce1640 1 -- start start 2024-04-25T09:04:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.343+0000 7ff9c0ce1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15dc50 0x7ff9bc070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9c0ce1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc162690 con 0x7ff9bc0cf600 2024-04-25T09:04:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9c0ce1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc06c220 con 0x7ff9bc0cd940 2024-04-25T09:04:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9c0ce1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0cfe00 con 0x7ff9bc15dc50 2024-04-25T09:04:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9bad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff9bc0cf600 0x7ff9bc161f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39366/0 (socket says 172.21.15.55:39366) 2024-04-25T09:04:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9bad9d640 1 -- 172.21.15.55:0/509859700 learned_addr learned my addr 172.21.15.55:0/509859700 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702939205 0 0) 0x7ff9bc162690 con 0x7ff9bc0cf600 2024-04-25T09:04:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9ba59c640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15dc50 0x7ff9bc070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a4003520 con 0x7ff9bc0cf600 2024-04-25T09:04:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3944597526 0 0) 0x7ff9a4003520 con 0x7ff9bc0cf600 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15dc50 msgr2=0x7ff9bc070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15dc50 0x7ff9bc070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 >> v1:172.21.15.167:6789/0 conn(0x7ff9bc0cd940 legacy=0x7ff9bc161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc0cec10 con 0x7ff9bc0cf600 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7ff9ac0019f0 con 0x7ff9bc0cf600 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 >> v1:172.21.15.55:6789/0 conn(0x7ff9bc0cf600 legacy=0x7ff9bc161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a40039e0 0x7ff9a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15dc50 0x7ff9a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9a4004d40 0x7ff9a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0cfe00 con 0x7ff9a40039e0 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a400ba70 con 0x7ff9a4004d40 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.344+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a400bc20 con 0x7ff9bc15dc50 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.345+0000 7ff9ba59c640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a40039e0 0x7ff9a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.345+0000 7ff9b9d9b640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15dc50 0x7ff9a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.345+0000 7ff9bad9d640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9a4004d40 0x7ff9a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.345+0000 7ff9ba59c640 1 -- 172.21.15.55:0/509859700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15dc50 msgr2=0x7ff9a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.345+0000 7ff9ba59c640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15dc50 0x7ff9a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.345+0000 7ff9ba59c640 1 -- 172.21.15.55:0/509859700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9a4004d40 msgr2=0x7ff9a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.345+0000 7ff9ba59c640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9a4004d40 0x7ff9a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.345+0000 7ff9ba59c640 1 -- 172.21.15.55:0/509859700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a4003520 con 0x7ff9a40039e0 2024-04-25T09:04:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.346+0000 7ff9ba59c640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a40039e0 0x7ff9a4003dc0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009ac0 tx=0x7ff9a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53405d1c0078fe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.346+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4036070 con 0x7ff9a40039e0 2024-04-25T09:04:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.346+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b4031400 con 0x7ff9a40039e0 2024-04-25T09:04:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.346+0000 7ff9b959a640 1 -- 172.21.15.55:0/509859700 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4009690 con 0x7ff9a40039e0 2024-04-25T09:04:07.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.346+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/509859700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a40039e0 msgr2=0x7ff9a4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.346+0000 7ff9c0ce1640 1 --2- 172.21.15.55:0/509859700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a40039e0 0x7ff9a4003dc0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009ac0 tx=0x7ff9a4005830 comp rx=0 tx=0).stop 2024-04-25T09:04:07.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.346+0000 7ff9bad9d640 1 -- 172.21.15.55:0/509859700 reap_dead start 2024-04-25T09:04:07.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.346+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/509859700 shutdown_connections 2024-04-25T09:04:07.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.346+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/509859700 >> 172.21.15.55:0/509859700 conn(0x7ff9bc06f430 msgr2=0x7ff9bc06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.346+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/509859700 shutdown_connections 2024-04-25T09:04:07.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.346+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/509859700 wait complete. 2024-04-25T09:04:07.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.348+0000 7ff9c0ce1640 1 Processor -- start 2024-04-25T09:04:07.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.348+0000 7ff9c0ce1640 1 -- start start 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.348+0000 7ff9c0ce1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9a40039e0 0x7ff9bc0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.348+0000 7ff9c0ce1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15fde0 0x7ff9bc0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.348+0000 7ff9c0ce1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9bc0b60d0 0x7ff9bc0b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9c0ce1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0cc0c0 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9c0ce1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0d0330 con 0x7ff9a40039e0 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9c0ce1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0ce8a0 con 0x7ff9bc15fde0 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9bad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9bc0b60d0 0x7ff9bc0b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9bad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9bc0b60d0 0x7ff9bc0b6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60114/0 (socket says 172.21.15.55:60114) 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9bad9d640 1 -- 172.21.15.55:0/2393878132 learned_addr learned my addr 172.21.15.55:0/2393878132 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9bad9d640 1 -- 172.21.15.55:0/2393878132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15fde0 msgr2=0x7ff9bc0b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9bad9d640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15fde0 0x7ff9bc0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9bad9d640 1 -- 172.21.15.55:0/2393878132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9a40039e0 msgr2=0x7ff9bc0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9ba59c640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9a40039e0 0x7ff9bc0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9bad9d640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9a40039e0 0x7ff9bc0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9bad9d640 1 -- 172.21.15.55:0/2393878132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc0c9030 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9ba59c640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9a40039e0 0x7ff9bc0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9bad9d640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9bc0b60d0 0x7ff9bc0b6550 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac002230 tx=0x7ff9ac007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9aaffd640 1 -- 172.21.15.55:0/2393878132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00ab90 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9aaffd640 1 -- 172.21.15.55:0/2393878132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac018070 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9aaffd640 1 -- 172.21.15.55:0/2393878132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0133f0 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/2393878132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc0c9310 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.349+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/2393878132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc0c98d0 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.350+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/2393878132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc0c4c00 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.351+0000 7ff9aaffd640 1 -- 172.21.15.55:0/2393878132 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9ac013590 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.351+0000 7ff9aaffd640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff99c06b500 0x7ff99c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.351+0000 7ff9aaffd640 1 -- 172.21.15.55:0/2393878132 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7ff9ac08a8b0 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.351+0000 7ff9ba59c640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff99c06b500 0x7ff99c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.352+0000 7ff9ba59c640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff99c06b500 0x7ff99c06d9c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4033000 tx=0x7ff9b4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.355+0000 7ff9aaffd640 1 -- 172.21.15.55:0/2393878132 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9bc0c4c00 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.549+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/2393878132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff9bc162640 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.549+0000 7ff9aaffd640 1 -- 172.21.15.55:0/2393878132 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v117) v1 ==== 80+0+244 (secure 0 0 0) 0x7ff9ac059680 con 0x7ff9bc0b60d0 2024-04-25T09:04:07.538 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/3667784674 2024-04-26T09:03:57.240366+0000 2024-04-25T09:04:07.538 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/3667784674 2024-04-26T09:03:57.240366+0000 2024-04-25T09:04:07.538 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/4257598582 2024-04-26T09:03:46.638997+0000 2024-04-25T09:04:07.538 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/4257598582 2024-04-26T09:03:46.638997+0000 2024-04-25T09:04:07.538 INFO:teuthology.orchestra.run.smithi055.stderr:listed 4 entries 2024-04-25T09:04:07.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/2393878132 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff99c06b500 msgr2=0x7ff99c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff99c06b500 0x7ff99c06d9c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4033000 tx=0x7ff9b4008030 comp rx=0 tx=0).stop 2024-04-25T09:04:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/2393878132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9bc0b60d0 msgr2=0x7ff9bc0b6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9bc0b60d0 0x7ff9bc0b6550 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac002230 tx=0x7ff9ac007bd0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/2393878132 shutdown_connections 2024-04-25T09:04:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff99c06b500 0x7ff99c06d9c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9bc0b60d0 0x7ff9bc0b6550 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9bc15fde0 0x7ff9bc0b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 --2- 172.21.15.55:0/2393878132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9a40039e0 0x7ff9bc0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/2393878132 >> 172.21.15.55:0/2393878132 conn(0x7ff9bc06f430 msgr2=0x7ff9bc06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/2393878132 shutdown_connections 2024-04-25T09:04:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.551+0000 7ff9c0ce1640 1 -- 172.21.15.55:0/2393878132 wait complete. 2024-04-25T09:04:07.550 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:04:07.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:07.550 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:07.578 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:04:07.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:07.579 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:04:07.633 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:04:07.634 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:07.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:07.652 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:04:07.653 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:07.692 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:04:07.693 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:04:07.693 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:07.711 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:07.711 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:07.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.846+0000 7faefd2fc640 1 Processor -- start 2024-04-25T09:04:07.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.846+0000 7faefd2fc640 1 -- start start 2024-04-25T09:04:07.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.847+0000 7faefd2fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faef815dce0 0x7faef80d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.847+0000 7faefd2fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef80d35b0 0x7faef80b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.847+0000 7faefd2fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef815e0c0 con 0x7faef80d1f90 2024-04-25T09:04:07.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.847+0000 7faefd2fc640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef80b7b10 con 0x7faef815dce0 2024-04-25T09:04:07.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.847+0000 7faefd2fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef80d2510 con 0x7faef80d35b0 2024-04-25T09:04:07.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.847+0000 7faef6ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faef815dce0 0x7faef80d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.847+0000 7faeeffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef80d35b0 0x7faef80b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.847+0000 7faef6ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faef815dce0 0x7faef80d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:33420/0 (socket says 172.21.15.55:33420) 2024-04-25T09:04:07.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.847+0000 7faef6ffd640 1 -- 172.21.15.55:0/990684129 learned_addr learned my addr 172.21.15.55:0/990684129 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:07.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.847+0000 7faeeffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef80d35b0 0x7faef80b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:44972/0 (socket says 172.21.15.55:44972) 2024-04-25T09:04:07.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.847+0000 7faef77fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7faef80d1f90 0x7faef806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:40350/0 (socket says 172.21.15.55:40350) 2024-04-25T09:04:07.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.848+0000 7faeeffff640 1 -- 172.21.15.55:0/990684129 >> v2:172.21.15.167:3300/0 conn(0x7faef815dce0 msgr2=0x7faef80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.848+0000 7faeeffff640 1 --2- 172.21.15.55:0/990684129 >> v2:172.21.15.167:3300/0 conn(0x7faef815dce0 0x7faef80d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.848+0000 7faeeffff640 1 -- 172.21.15.55:0/990684129 >> v1:172.21.15.167:6789/0 conn(0x7faef80d1f90 legacy=0x7faef806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.848+0000 7faeeffff640 1 -- 172.21.15.55:0/990684129 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef80d27f0 con 0x7faef80d35b0 2024-04-25T09:04:07.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.848+0000 7faef6ffd640 1 --2- 172.21.15.55:0/990684129 >> v2:172.21.15.167:3300/0 conn(0x7faef815dce0 0x7faef80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.848+0000 7faeeffff640 1 --2- 172.21.15.55:0/990684129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef80d35b0 0x7faef80b5450 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faee00097a0 tx=0x7faee002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3684f39dcb4ac0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.849+0000 7faef67fc640 1 -- 172.21.15.55:0/990684129 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0037070 con 0x7faef80d35b0 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.849+0000 7faef67fc640 1 -- 172.21.15.55:0/990684129 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee002ae50 con 0x7faef80d35b0 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.849+0000 7faef67fc640 1 -- 172.21.15.55:0/990684129 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0032660 con 0x7faef80d35b0 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.849+0000 7faefd2fc640 1 -- 172.21.15.55:0/990684129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef80d35b0 msgr2=0x7faef80b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.849+0000 7faefd2fc640 1 --2- 172.21.15.55:0/990684129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef80d35b0 0x7faef80b5450 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faee00097a0 tx=0x7faee002a100 comp rx=0 tx=0).stop 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.849+0000 7faefd2fc640 1 -- 172.21.15.55:0/990684129 shutdown_connections 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.849+0000 7faefd2fc640 1 --2- 172.21.15.55:0/990684129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef80d35b0 0x7faef80b5450 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.849+0000 7faefd2fc640 1 --2- 172.21.15.55:0/990684129 >> v2:172.21.15.167:3300/0 conn(0x7faef815dce0 0x7faef80d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.849+0000 7faefd2fc640 1 -- 172.21.15.55:0/990684129 >> 172.21.15.55:0/990684129 conn(0x7faef8072900 msgr2=0x7faef80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.849+0000 7faefd2fc640 1 -- 172.21.15.55:0/990684129 shutdown_connections 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.849+0000 7faefd2fc640 1 -- 172.21.15.55:0/990684129 wait complete. 2024-04-25T09:04:07.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.850+0000 7faefd2fc640 1 Processor -- start 2024-04-25T09:04:07.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.850+0000 7faefd2fc640 1 -- start start 2024-04-25T09:04:07.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.851+0000 7faefd2fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef80d1f90 0x7faef80c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.851+0000 7faefd2fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef80d35b0 0x7faef814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.851+0000 7faefd2fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef815dce0 0x7faef8160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.851+0000 7faefd2fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef80d3090 con 0x7faef80d1f90 2024-04-25T09:04:07.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.851+0000 7faefd2fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef80d2db0 con 0x7faef80d35b0 2024-04-25T09:04:07.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.851+0000 7faefd2fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef80b9820 con 0x7faef815dce0 2024-04-25T09:04:07.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.851+0000 7faef6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef80d1f90 0x7faef80c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.851+0000 7faef6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef80d1f90 0x7faef80c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60118/0 (socket says 172.21.15.55:60118) 2024-04-25T09:04:07.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.851+0000 7faef6ffd640 1 -- 172.21.15.55:0/1425245548 learned_addr learned my addr 172.21.15.55:0/1425245548 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faeeffff640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef80d35b0 0x7faef814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faef77fe640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef815dce0 0x7faef8160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faef6ffd640 1 -- 172.21.15.55:0/1425245548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef815dce0 msgr2=0x7faef8160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faef6ffd640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef815dce0 0x7faef8160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faef6ffd640 1 -- 172.21.15.55:0/1425245548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef80d35b0 msgr2=0x7faef814ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faef6ffd640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef80d35b0 0x7faef814ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faef6ffd640 1 -- 172.21.15.55:0/1425245548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef81574a0 con 0x7faef80d1f90 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faef77fe640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef815dce0 0x7faef8160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faeeffff640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef80d35b0 0x7faef814ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faef6ffd640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef80d1f90 0x7faef80c7500 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7faee800ea00 tx=0x7faee800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faeef7fe640 1 -- 172.21.15.55:0/1425245548 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8017070 con 0x7faef80d1f90 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faeef7fe640 1 -- 172.21.15.55:0/1425245548 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee800ca60 con 0x7faef80d1f90 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faeef7fe640 1 -- 172.21.15.55:0/1425245548 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee800ce10 con 0x7faef80d1f90 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faefd2fc640 1 -- 172.21.15.55:0/1425245548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef814b320 con 0x7faef80d1f90 2024-04-25T09:04:07.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.852+0000 7faefd2fc640 1 -- 172.21.15.55:0/1425245548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef815ffe0 con 0x7faef80d1f90 2024-04-25T09:04:07.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.853+0000 7faefd2fc640 1 -- 172.21.15.55:0/1425245548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef80749b0 con 0x7faef80d1f90 2024-04-25T09:04:07.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.854+0000 7faeef7fe640 1 -- 172.21.15.55:0/1425245548 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faee801a070 con 0x7faef80d1f90 2024-04-25T09:04:07.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.854+0000 7faeef7fe640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faed806b500 0x7faed806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.854+0000 7faeef7fe640 1 -- 172.21.15.55:0/1425245548 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7faee808a270 con 0x7faef80d1f90 2024-04-25T09:04:07.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.854+0000 7faeeffff640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faed806b500 0x7faed806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.854+0000 7faeeffff640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faed806b500 0x7faed806d9c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7faee0034000 tx=0x7faee002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:07.858+0000 7faeef7fe640 1 -- 172.21.15.55:0/1425245548 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faef814b320 con 0x7faef80d1f90 2024-04-25T09:04:08.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.078+0000 7faefd2fc640 1 -- 172.21.15.55:0/1425245548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faef80c7260 con 0x7faef80d1f90 2024-04-25T09:04:08.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.078+0000 7faeef7fe640 1 -- 172.21.15.55:0/1425245548 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4945 (secure 0 0 0) 0x7faee8058fc0 con 0x7faef80d1f90 2024-04-25T09:04:08.067 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:08.067 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":99,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:04:01.276221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/3300284863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3300284863},{"type":"v1","addr":"172.21.15.55:6837","nonce":3300284863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 99 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 -- 172.21.15.55:0/1425245548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faed806b500 msgr2=0x7faed806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faed806b500 0x7faed806d9c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7faee0034000 tx=0x7faee002e000 comp rx=0 tx=0).stop 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 -- 172.21.15.55:0/1425245548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef80d1f90 msgr2=0x7faef80c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef80d1f90 0x7faef80c7500 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7faee800ea00 tx=0x7faee800eec0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 -- 172.21.15.55:0/1425245548 shutdown_connections 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faed806b500 0x7faed806d9c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faef815dce0 0x7faef8160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef80d35b0 0x7faef814ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 --2- 172.21.15.55:0/1425245548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef80d1f90 0x7faef80c7500 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 -- 172.21.15.55:0/1425245548 >> 172.21.15.55:0/1425245548 conn(0x7faef8072900 msgr2=0x7faef80b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 -- 172.21.15.55:0/1425245548 shutdown_connections 2024-04-25T09:04:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.080+0000 7faefd2fc640 1 -- 172.21.15.55:0/1425245548 wait complete. 2024-04-25T09:04:08.080 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:08.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.193+0000 7f4268007640 1 Processor -- start 2024-04-25T09:04:08.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.193+0000 7f4268007640 1 -- start start 2024-04-25T09:04:08.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.194+0000 7f4268007640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f426015dce0 0x7f42600d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.194+0000 7f4268007640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42600d35b0 0x7f42600b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.194+0000 7f4268007640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426015e0c0 con 0x7f42600d1f90 2024-04-25T09:04:08.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.194+0000 7f4268007640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42600b7b10 con 0x7f426015dce0 2024-04-25T09:04:08.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.194+0000 7f4268007640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42600d2510 con 0x7f42600d35b0 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.194+0000 7f42665a4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f42600d1f90 0x7f426006bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39370/0 (socket says 172.21.15.55:39370) 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.194+0000 7f42665a4640 1 -- 172.21.15.55:0/4042727184 learned_addr learned my addr 172.21.15.55:0/4042727184 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4265da3640 1 --2- 172.21.15.55:0/4042727184 >> v2:172.21.15.167:3300/0 conn(0x7f426015dce0 0x7f42600d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f42655a2640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42600d35b0 0x7f42600b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667942339 0 0) 0x7f426015e0c0 con 0x7f42600d1f90 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4248003520 con 0x7f42600d1f90 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 919388305 0 0) 0x7f4248003520 con 0x7f42600d1f90 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42600d35b0 msgr2=0x7f42600b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42600d35b0 0x7f42600b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 >> v2:172.21.15.167:3300/0 conn(0x7f426015dce0 msgr2=0x7f42600d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 --2- 172.21.15.55:0/4042727184 >> v2:172.21.15.167:3300/0 conn(0x7f426015dce0 0x7f42600d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600d27f0 con 0x7f42600d1f90 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f42500019f0 con 0x7f42600d1f90 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4265da3640 1 --2- 172.21.15.55:0/4042727184 >> v2:172.21.15.167:3300/0 conn(0x7f426015dce0 0x7f42600d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f42655a2640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42600d35b0 0x7f42600b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 >> v1:172.21.15.55:6789/0 conn(0x7f42600d1f90 legacy=0x7f426006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480039b0 0x7f4248003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248004800 0x7f4248004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42600d35b0 0x7f42480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600b7b10 con 0x7f42480039b0 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600d2510 con 0x7f4248004800 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424800b9c0 con 0x7f42600d35b0 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4265da3640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480039b0 0x7f4248003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f42665a4640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42600d35b0 0x7f42480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f42655a2640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248004800 0x7f4248004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4265da3640 1 -- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42600d35b0 msgr2=0x7f42480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4265da3640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42600d35b0 0x7f42480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4265da3640 1 -- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248004800 msgr2=0x7f4248004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4265da3640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248004800 0x7f4248004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.195+0000 7f4265da3640 1 -- 172.21.15.55:0/4042727184 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4248003520 con 0x7f42480039b0 2024-04-25T09:04:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.196+0000 7f4265da3640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480039b0 0x7f4248003dd0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f4258009c90 tx=0x7f4248005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a591fc8b9086e60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.196+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258036070 con 0x7f42480039b0 2024-04-25T09:04:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.196+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4258031400 con 0x7f42480039b0 2024-04-25T09:04:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.196+0000 7f4264da1640 1 -- 172.21.15.55:0/4042727184 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258009860 con 0x7f42480039b0 2024-04-25T09:04:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.197+0000 7f4268007640 1 -- 172.21.15.55:0/4042727184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480039b0 msgr2=0x7f4248003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.197+0000 7f4268007640 1 --2- 172.21.15.55:0/4042727184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480039b0 0x7f4248003dd0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f4258009c90 tx=0x7f4248005830 comp rx=0 tx=0).stop 2024-04-25T09:04:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.197+0000 7f42665a4640 1 -- 172.21.15.55:0/4042727184 reap_dead start 2024-04-25T09:04:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.197+0000 7f4268007640 1 -- 172.21.15.55:0/4042727184 shutdown_connections 2024-04-25T09:04:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.197+0000 7f4268007640 1 -- 172.21.15.55:0/4042727184 >> 172.21.15.55:0/4042727184 conn(0x7f4260072900 msgr2=0x7f42600d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.197+0000 7f4268007640 1 -- 172.21.15.55:0/4042727184 shutdown_connections 2024-04-25T09:04:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.197+0000 7f4268007640 1 -- 172.21.15.55:0/4042727184 wait complete. 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.198+0000 7f4268007640 1 Processor -- start 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.198+0000 7f4268007640 1 -- start start 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f4268007640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42480039b0 0x7f42600ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f4268007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42601529a0 0x7f4260152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f4268007640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42600aae90 0x7f42600ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f4268007640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600d3090 con 0x7f42601529a0 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f4268007640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600d2db0 con 0x7f42600aae90 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f4268007640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42600b9820 con 0x7f42480039b0 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f42655a2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42601529a0 0x7f4260152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f42655a2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42601529a0 0x7f4260152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60138/0 (socket says 172.21.15.55:60138) 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f42655a2640 1 -- 172.21.15.55:0/2937965519 learned_addr learned my addr 172.21.15.55:0/2937965519 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f4265da3640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42480039b0 0x7f42600ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f42665a4640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42600aae90 0x7f42600ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f42655a2640 1 -- 172.21.15.55:0/2937965519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42480039b0 msgr2=0x7f42600ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f42655a2640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42480039b0 0x7f42600ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f42655a2640 1 -- 172.21.15.55:0/2937965519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42600aae90 msgr2=0x7f42600ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f42655a2640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42600aae90 0x7f42600ab310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f42655a2640 1 -- 172.21.15.55:0/2937965519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600abc00 con 0x7f42601529a0 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.199+0000 7f42655a2640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42601529a0 0x7f4260152e20 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f4254011600 tx=0x7f4254011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.200+0000 7f425e7fc640 1 -- 172.21.15.55:0/2937965519 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425400f920 con 0x7f42601529a0 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.200+0000 7f425e7fc640 1 -- 172.21.15.55:0/2937965519 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425400fac0 con 0x7f42601529a0 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.200+0000 7f4268007640 1 -- 172.21.15.55:0/2937965519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42600abee0 con 0x7f42601529a0 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.200+0000 7f425e7fc640 1 -- 172.21.15.55:0/2937965519 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425400fe70 con 0x7f42601529a0 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.200+0000 7f4268007640 1 -- 172.21.15.55:0/2937965519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42600ac4a0 con 0x7f42601529a0 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.201+0000 7f4268007640 1 -- 172.21.15.55:0/2937965519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42600749b0 con 0x7f42601529a0 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.201+0000 7f425e7fc640 1 -- 172.21.15.55:0/2937965519 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4254015460 con 0x7f42601529a0 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.202+0000 7f425e7fc640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f424c06b500 0x7f424c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.202+0000 7f425e7fc640 1 -- 172.21.15.55:0/2937965519 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f425408aca0 con 0x7f42601529a0 2024-04-25T09:04:08.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.202+0000 7f4265da3640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f424c06b500 0x7f424c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.202+0000 7f4265da3640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f424c06b500 0x7f424c06d9c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4258033000 tx=0x7f4258008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.206+0000 7f425e7fc640 1 -- 172.21.15.55:0/2937965519 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4254019030 con 0x7f42601529a0 2024-04-25T09:04:08.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.388+0000 7f4268007640 1 -- 172.21.15.55:0/2937965519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4260153360 con 0x7f42601529a0 2024-04-25T09:04:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.389+0000 7f425e7fc640 1 -- 172.21.15.55:0/2937965519 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16886 (secure 0 0 0) 0x7f42540599d0 con 0x7f42601529a0 2024-04-25T09:04:08.377 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:08.377 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":117,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:57.240387+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:31.900630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:32.603273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3667784674":"2024-04-26T09:03:57.240366+0000","172.21.15.55:6835/3667784674":"2024-04-26T09:03:57.240366+0000","172.21.15.55:6837/4257598582":"2024-04-26T09:03:46.638997+0000","172.21.15.55:6835/4257598582":"2024-04-26T09:03:46.638997+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:08.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 -- 172.21.15.55:0/2937965519 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f424c06b500 msgr2=0x7f424c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f424c06b500 0x7f424c06d9c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4258033000 tx=0x7f4258008030 comp rx=0 tx=0).stop 2024-04-25T09:04:08.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 -- 172.21.15.55:0/2937965519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42601529a0 msgr2=0x7f4260152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42601529a0 0x7f4260152e20 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f4254011600 tx=0x7f4254011ac0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 -- 172.21.15.55:0/2937965519 shutdown_connections 2024-04-25T09:04:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f424c06b500 0x7f424c06d9c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42600aae90 0x7f42600ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42601529a0 0x7f4260152e20 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 --2- 172.21.15.55:0/2937965519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42480039b0 0x7f42600ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 -- 172.21.15.55:0/2937965519 >> 172.21.15.55:0/2937965519 conn(0x7f4260072900 msgr2=0x7f42600ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 -- 172.21.15.55:0/2937965519 shutdown_connections 2024-04-25T09:04:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.391+0000 7f4268007640 1 -- 172.21.15.55:0/2937965519 wait complete. 2024-04-25T09:04:08.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:53:30.593901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:03:31.900630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:03:32.603273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:08.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:08.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.506+0000 7fcf04970640 1 Processor -- start 2024-04-25T09:04:08.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.506+0000 7fcf04970640 1 -- start start 2024-04-25T09:04:08.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.507+0000 7fcf04970640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcf000cf510 0x7fcf000cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.507+0000 7fcf04970640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000cc830 con 0x7fcf000cff00 2024-04-25T09:04:08.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.507+0000 7fcf04970640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000ccb10 con 0x7fcf0015bbe0 2024-04-25T09:04:08.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.507+0000 7fcf04970640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf000ccdf0 con 0x7fcf000cf510 2024-04-25T09:04:08.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.507+0000 7fcefed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcf000cff00 0x7fcf000c5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39376/0 (socket says 172.21.15.55:39376) 2024-04-25T09:04:08.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.507+0000 7fcefed9d640 1 -- 172.21.15.55:0/1958083817 learned_addr learned my addr 172.21.15.55:0/1958083817 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:08.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefdd9b640 1 --2- 172.21.15.55:0/1958083817 >> v2:172.21.15.167:3300/0 conn(0x7fcf000cf510 0x7fcf000cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349257491 0 0) 0x7fcf000cc830 con 0x7fcf000cff00 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceec003520 con 0x7fcf000cff00 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2958833566 0 0) 0x7fceec003520 con 0x7fcf000cff00 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 >> v2:172.21.15.167:3300/0 conn(0x7fcf000cf510 msgr2=0x7fcf000cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 --2- 172.21.15.55:0/1958083817 >> v2:172.21.15.167:3300/0 conn(0x7fcf000cf510 0x7fcf000cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 >> v1:172.21.15.167:6789/0 conn(0x7fcf0015bbe0 legacy=0x7fcf000cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf000cd0d0 con 0x7fcf000cff00 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fcef00019f0 con 0x7fcf000cff00 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 >> v1:172.21.15.55:6789/0 conn(0x7fcf000cff00 legacy=0x7fcf000c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 --2- 172.21.15.55:0/1958083817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fceec0039b0 0x7fceec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 --2- 172.21.15.55:0/1958083817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec004800 0x7fceec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 --2- 172.21.15.55:0/1958083817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 0x7fceec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000ccdf0 con 0x7fceec0051c0 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec00c060 con 0x7fceec0039b0 2024-04-25T09:04:08.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec00c260 con 0x7fceec004800 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefed9d640 1 --2- 172.21.15.55:0/1958083817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 0x7fceec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefe59c640 1 --2- 172.21.15.55:0/1958083817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fceec0039b0 0x7fceec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefdd9b640 1 --2- 172.21.15.55:0/1958083817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec004800 0x7fceec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefed9d640 1 -- 172.21.15.55:0/1958083817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec004800 msgr2=0x7fceec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefed9d640 1 --2- 172.21.15.55:0/1958083817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec004800 0x7fceec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefed9d640 1 -- 172.21.15.55:0/1958083817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fceec0039b0 msgr2=0x7fceec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefed9d640 1 --2- 172.21.15.55:0/1958083817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fceec0039b0 0x7fceec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.508+0000 7fcefed9d640 1 -- 172.21.15.55:0/1958083817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec003520 con 0x7fceec0051c0 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.509+0000 7fcefed9d640 1 -- 172.21.15.55:0/1958083817 reap_dead start 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.509+0000 7fcefed9d640 1 --2- 172.21.15.55:0/1958083817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 0x7fceec00b9c0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fcef000a850 tx=0x7fceec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385f339102ebebe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.509+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef000a4a0 con 0x7fceec0051c0 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.509+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef002f070 con 0x7fceec0051c0 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.509+0000 7fcefd59a640 1 -- 172.21.15.55:0/1958083817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef002bce0 con 0x7fceec0051c0 2024-04-25T09:04:08.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.510+0000 7fcf04970640 1 -- 172.21.15.55:0/1958083817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 msgr2=0x7fceec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.510+0000 7fcf04970640 1 --2- 172.21.15.55:0/1958083817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 0x7fceec00b9c0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fcef000a850 tx=0x7fceec005830 comp rx=0 tx=0).stop 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.510+0000 7fcf04970640 1 -- 172.21.15.55:0/1958083817 shutdown_connections 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.510+0000 7fcf04970640 1 --2- 172.21.15.55:0/1958083817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 0x7fceec00b9c0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.510+0000 7fcf04970640 1 -- 172.21.15.55:0/1958083817 >> 172.21.15.55:0/1958083817 conn(0x7fcf000b3430 msgr2=0x7fcf000b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.510+0000 7fcf04970640 1 -- 172.21.15.55:0/1958083817 shutdown_connections 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.510+0000 7fcf04970640 1 -- 172.21.15.55:0/1958083817 wait complete. 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.511+0000 7fcf04970640 1 Processor -- start 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.511+0000 7fcf04970640 1 -- start start 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcf04970640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 0x7fcf0009d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcf04970640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf00150ca0 0x7fcf0009b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcf04970640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf00151100 0x7fcf0009dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcf04970640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000cc450 con 0x7fceec0051c0 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcf04970640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0015bfc0 con 0x7fcf00151100 2024-04-25T09:04:08.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcf04970640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000cc5d0 con 0x7fcf00150ca0 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcefe59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 0x7fcf0009d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcefe59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 0x7fcf0009d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60158/0 (socket says 172.21.15.55:60158) 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcefe59c640 1 -- 172.21.15.55:0/2399827884 learned_addr learned my addr 172.21.15.55:0/2399827884 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcefdd9b640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf00150ca0 0x7fcf0009b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcefed9d640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf00151100 0x7fcf0009dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcefe59c640 1 -- 172.21.15.55:0/2399827884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf00150ca0 msgr2=0x7fcf0009b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcefe59c640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf00150ca0 0x7fcf0009b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcefe59c640 1 -- 172.21.15.55:0/2399827884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf00151100 msgr2=0x7fcf0009dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcefe59c640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf00151100 0x7fcf0009dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.512+0000 7fcefe59c640 1 -- 172.21.15.55:0/2399827884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0009c1d0 con 0x7fceec0051c0 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.513+0000 7fcefe59c640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 0x7fcf0009d270 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fcef800f5f0 tx=0x7fcef800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.513+0000 7fcef6ffd640 1 -- 172.21.15.55:0/2399827884 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef80052e0 con 0x7fceec0051c0 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.513+0000 7fcef6ffd640 1 -- 172.21.15.55:0/2399827884 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef8018070 con 0x7fceec0051c0 2024-04-25T09:04:08.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.513+0000 7fcef6ffd640 1 -- 172.21.15.55:0/2399827884 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8003810 con 0x7fceec0051c0 2024-04-25T09:04:08.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.513+0000 7fcf04970640 1 -- 172.21.15.55:0/2399827884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0009c4b0 con 0x7fceec0051c0 2024-04-25T09:04:08.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.513+0000 7fcf04970640 1 -- 172.21.15.55:0/2399827884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0009ca70 con 0x7fceec0051c0 2024-04-25T09:04:08.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.514+0000 7fcf04970640 1 -- 172.21.15.55:0/2399827884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf000750b0 con 0x7fceec0051c0 2024-04-25T09:04:08.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.514+0000 7fcef6ffd640 1 -- 172.21.15.55:0/2399827884 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcef80039b0 con 0x7fceec0051c0 2024-04-25T09:04:08.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.515+0000 7fcef6ffd640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcee006b4d0 0x7fcee006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.515+0000 7fcefdd9b640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcee006b4d0 0x7fcee006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.515+0000 7fcef6ffd640 1 -- 172.21.15.55:0/2399827884 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fcef808a160 con 0x7fceec0051c0 2024-04-25T09:04:08.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.515+0000 7fcefdd9b640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcee006b4d0 0x7fcee006d990 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fcf00154780 tx=0x7fcee8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.519+0000 7fcef6ffd640 1 -- 172.21.15.55:0/2399827884 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcef8058ea0 con 0x7fceec0051c0 2024-04-25T09:04:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.701+0000 7fcf04970640 1 -- 172.21.15.55:0/2399827884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf000b42d0 con 0x7fceec0051c0 2024-04-25T09:04:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.702+0000 7fcef6ffd640 1 -- 172.21.15.55:0/2399827884 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcef80587a0 con 0x7fceec0051c0 2024-04-25T09:04:08.690 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-25T09:04:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 -- 172.21.15.55:0/2399827884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcee006b4d0 msgr2=0x7fcee006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcee006b4d0 0x7fcee006d990 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fcf00154780 tx=0x7fcee8008040 comp rx=0 tx=0).stop 2024-04-25T09:04:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 -- 172.21.15.55:0/2399827884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 msgr2=0x7fcf0009d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 0x7fcf0009d270 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fcef800f5f0 tx=0x7fcef800fab0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 -- 172.21.15.55:0/2399827884 shutdown_connections 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fcee006b4d0 0x7fcee006d990 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf00151100 0x7fcf0009dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf00150ca0 0x7fcf0009b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 --2- 172.21.15.55:0/2399827884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceec0051c0 0x7fcf0009d270 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 -- 172.21.15.55:0/2399827884 >> 172.21.15.55:0/2399827884 conn(0x7fcf000b3430 msgr2=0x7fcf000c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 -- 172.21.15.55:0/2399827884 shutdown_connections 2024-04-25T09:04:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.704+0000 7fcf04970640 1 -- 172.21.15.55:0/2399827884 wait complete. 2024-04-25T09:04:08.703 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:08.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.818+0000 7f2669f4c640 1 Processor -- start 2024-04-25T09:04:08.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.819+0000 7f2669f4c640 1 -- start start 2024-04-25T09:04:08.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.819+0000 7f2669f4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266406ec20 0x7f26640cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.819+0000 7f2669f4c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2664147a30 con 0x7f2664147650 2024-04-25T09:04:08.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.819+0000 7f2669f4c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266406b110 con 0x7f266406aba0 2024-04-25T09:04:08.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.819+0000 7f2669f4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266406d780 con 0x7f266406ec20 2024-04-25T09:04:08.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.820+0000 7f26637fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2664147650 0x7f26640720e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54594/0 (socket says 172.21.15.55:54594) 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.820+0000 7f26637fe640 1 -- 172.21.15.55:0/3310657200 learned_addr learned my addr 172.21.15.55:0/3310657200 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.820+0000 7f2662ffd640 1 --2- 172.21.15.55:0/3310657200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266406ec20 0x7f26640cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.820+0000 7f26627fc640 1 -- 172.21.15.55:0/3310657200 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62429667 0 0) 0x7f2664147a30 con 0x7f2664147650 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.820+0000 7f26627fc640 1 -- 172.21.15.55:0/3310657200 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f264c003520 con 0x7f2664147650 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.820+0000 7f26627fc640 1 -- 172.21.15.55:0/3310657200 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591457632 0 0) 0x7f266406b110 con 0x7f266406aba0 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.820+0000 7f26627fc640 1 -- 172.21.15.55:0/3310657200 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2664147a30 con 0x7f266406aba0 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.820+0000 7f2662ffd640 1 -- 172.21.15.55:0/3310657200 >> v1:172.21.15.167:6789/0 conn(0x7f266406aba0 legacy=0x7f2664167820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.820+0000 7f26627fc640 1 -- 172.21.15.55:0/3310657200 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2517657195 0 0) 0x7f264c003520 con 0x7f2664147650 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.820+0000 7f2662ffd640 1 -- 172.21.15.55:0/3310657200 >> v1:172.21.15.55:6789/0 conn(0x7f2664147650 legacy=0x7f26640720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.820+0000 7f2662ffd640 1 -- 172.21.15.55:0/3310657200 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266406b3f0 con 0x7f266406ec20 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.821+0000 7f2662ffd640 1 --2- 172.21.15.55:0/3310657200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266406ec20 0x7f26640cd710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f26580097d0 tx=0x7f265802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c81a50f24f0a99b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.821+0000 7f26627fc640 1 -- 172.21.15.55:0/3310657200 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658037070 con 0x7f266406ec20 2024-04-25T09:04:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.821+0000 7f26627fc640 1 -- 172.21.15.55:0/3310657200 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265802ab90 con 0x7f266406ec20 2024-04-25T09:04:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.821+0000 7f26627fc640 1 -- 172.21.15.55:0/3310657200 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654001670 con 0x7f266406ec20 2024-04-25T09:04:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.822+0000 7f2669f4c640 1 -- 172.21.15.55:0/3310657200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266406ec20 msgr2=0x7f26640cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.822+0000 7f2669f4c640 1 --2- 172.21.15.55:0/3310657200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266406ec20 0x7f26640cd710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f26580097d0 tx=0x7f265802a100 comp rx=0 tx=0).stop 2024-04-25T09:04:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.822+0000 7f2669f4c640 1 -- 172.21.15.55:0/3310657200 shutdown_connections 2024-04-25T09:04:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.822+0000 7f2669f4c640 1 --2- 172.21.15.55:0/3310657200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266406ec20 0x7f26640cd710 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.822+0000 7f2669f4c640 1 -- 172.21.15.55:0/3310657200 >> 172.21.15.55:0/3310657200 conn(0x7f26640cc5e0 msgr2=0x7f26640cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.822+0000 7f2669f4c640 1 -- 172.21.15.55:0/3310657200 shutdown_connections 2024-04-25T09:04:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.822+0000 7f2669f4c640 1 -- 172.21.15.55:0/3310657200 wait complete. 2024-04-25T09:04:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.823+0000 7f2669f4c640 1 Processor -- start 2024-04-25T09:04:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.823+0000 7f2669f4c640 1 -- start start 2024-04-25T09:04:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f2669f4c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266406aba0 0x7f26641e4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f2669f4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266406ec20 0x7f26641e94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f2669f4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2664147650 0x7f26640c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f2669f4c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26640cdc50 con 0x7f266406aba0 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f2669f4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266406b9b0 con 0x7f266406ec20 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f2669f4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26640cddd0 con 0x7f2664147650 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f26637fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266406aba0 0x7f26641e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f26637fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266406aba0 0x7f26641e4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45694/0 (socket says 172.21.15.55:45694) 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f26637fe640 1 -- 172.21.15.55:0/2296734954 learned_addr learned my addr 172.21.15.55:0/2296734954 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f2662ffd640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266406ec20 0x7f26641e94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f2663fff640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2664147650 0x7f26640c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f26637fe640 1 -- 172.21.15.55:0/2296734954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2664147650 msgr2=0x7f26640c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f26637fe640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2664147650 0x7f26640c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f26637fe640 1 -- 172.21.15.55:0/2296734954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266406ec20 msgr2=0x7f26641e94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f26637fe640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266406ec20 0x7f26641e94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f26637fe640 1 -- 172.21.15.55:0/2296734954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26641e8450 con 0x7f266406aba0 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f2662ffd640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266406ec20 0x7f26641e94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.824+0000 7f26637fe640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266406aba0 0x7f26641e4400 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f265400c5a0 tx=0x7f265400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.825+0000 7f264bfff640 1 -- 172.21.15.55:0/2296734954 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654017070 con 0x7f266406aba0 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.825+0000 7f264bfff640 1 -- 172.21.15.55:0/2296734954 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2654005d00 con 0x7f266406aba0 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.825+0000 7f2669f4c640 1 -- 172.21.15.55:0/2296734954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26641e8730 con 0x7f266406aba0 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.825+0000 7f264bfff640 1 -- 172.21.15.55:0/2296734954 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26540072b0 con 0x7f266406aba0 2024-04-25T09:04:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.825+0000 7f2669f4c640 1 -- 172.21.15.55:0/2296734954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26641e8cf0 con 0x7f266406aba0 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.826+0000 7f2669f4c640 1 -- 172.21.15.55:0/2296734954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26640750b0 con 0x7f266406aba0 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.826+0000 7f264bfff640 1 -- 172.21.15.55:0/2296734954 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f265401a070 con 0x7f266406aba0 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.827+0000 7f264bfff640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f265006b4d0 0x7f265006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.827+0000 7f2662ffd640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f265006b4d0 0x7f265006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.827+0000 7f264bfff640 1 -- 172.21.15.55:0/2296734954 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f2654089780 con 0x7f266406aba0 2024-04-25T09:04:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.827+0000 7f2662ffd640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f265006b4d0 0x7f265006d990 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2658034000 tx=0x7f265802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:08.831+0000 7f264bfff640 1 -- 172.21.15.55:0/2296734954 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2654058550 con 0x7f266406aba0 2024-04-25T09:04:08.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.010+0000 7f2669f4c640 1 -- 172.21.15.55:0/2296734954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26640ce3b0 con 0x7f266406aba0 2024-04-25T09:04:08.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.010+0000 7f264bfff640 1 -- 172.21.15.55:0/2296734954 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2654057e50 con 0x7f266406aba0 2024-04-25T09:04:08.999 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-25T09:04:09.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 -- 172.21.15.55:0/2296734954 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f265006b4d0 msgr2=0x7f265006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f265006b4d0 0x7f265006d990 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2658034000 tx=0x7f265802e000 comp rx=0 tx=0).stop 2024-04-25T09:04:09.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 -- 172.21.15.55:0/2296734954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266406aba0 msgr2=0x7f26641e4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266406aba0 0x7f26641e4400 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f265400c5a0 tx=0x7f265400ca60 comp rx=0 tx=0).stop 2024-04-25T09:04:09.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 -- 172.21.15.55:0/2296734954 shutdown_connections 2024-04-25T09:04:09.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f265006b4d0 0x7f265006d990 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2664147650 0x7f26640c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266406ec20 0x7f26641e94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 --2- 172.21.15.55:0/2296734954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266406aba0 0x7f26641e4400 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 -- 172.21.15.55:0/2296734954 >> 172.21.15.55:0/2296734954 conn(0x7f26640cc5e0 msgr2=0x7f2664146700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 -- 172.21.15.55:0/2296734954 shutdown_connections 2024-04-25T09:04:09.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.012+0000 7f2669f4c640 1 -- 172.21.15.55:0/2296734954 wait complete. 2024-04-25T09:04:09.011 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:09.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.127+0000 7f4fdfcdb640 1 Processor -- start 2024-04-25T09:04:09.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.127+0000 7f4fdfcdb640 1 -- start start 2024-04-25T09:04:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.128+0000 7f4fdfcdb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4fd80d3b90 0x7f4fd80d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.128+0000 7f4fdfcdb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80d4090 con 0x7f4fd80d0f60 2024-04-25T09:04:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.128+0000 7f4fdfcdb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80d4370 con 0x7f4fd815dca0 2024-04-25T09:04:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.128+0000 7f4fdfcdb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80b6b20 con 0x7f4fd80d3b90 2024-04-25T09:04:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.128+0000 7f4fdd276640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4fd80d3b90 0x7f4fd80d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.128+0000 7f4fde278640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4fd80d0f60 0x7f4fd80b2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54604/0 (socket says 172.21.15.55:54604) 2024-04-25T09:04:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.128+0000 7f4fde278640 1 -- 172.21.15.55:0/3390729416 learned_addr learned my addr 172.21.15.55:0/3390729416 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.128+0000 7f4fdd276640 1 -- 172.21.15.55:0/3390729416 >> v1:172.21.15.167:6789/0 conn(0x7f4fd815dca0 legacy=0x7f4fd80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.128+0000 7f4fdd276640 1 -- 172.21.15.55:0/3390729416 >> v1:172.21.15.55:6789/0 conn(0x7f4fd80d0f60 legacy=0x7f4fd80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.128+0000 7f4fdd276640 1 -- 172.21.15.55:0/3390729416 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80d4650 con 0x7f4fd80d3b90 2024-04-25T09:04:09.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.129+0000 7f4fdd276640 1 --2- 172.21.15.55:0/3390729416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd80d3b90 0x7f4fd80d0a20 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097a0 tx=0x7f4fc802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70a37d9038beeda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.129+0000 7f4fdca75640 1 -- 172.21.15.55:0/3390729416 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8037070 con 0x7f4fd80d3b90 2024-04-25T09:04:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.129+0000 7f4fdca75640 1 -- 172.21.15.55:0/3390729416 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc8032440 con 0x7f4fd80d3b90 2024-04-25T09:04:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.129+0000 7f4fdca75640 1 -- 172.21.15.55:0/3390729416 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8032810 con 0x7f4fd80d3b90 2024-04-25T09:04:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.130+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/3390729416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd80d3b90 msgr2=0x7f4fd80d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.130+0000 7f4fdfcdb640 1 --2- 172.21.15.55:0/3390729416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd80d3b90 0x7f4fd80d0a20 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097a0 tx=0x7f4fc802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.130+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/3390729416 shutdown_connections 2024-04-25T09:04:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.130+0000 7f4fdfcdb640 1 --2- 172.21.15.55:0/3390729416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd80d3b90 0x7f4fd80d0a20 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.130+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/3390729416 >> 172.21.15.55:0/3390729416 conn(0x7f4fd80726c0 msgr2=0x7f4fd8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.130+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/3390729416 shutdown_connections 2024-04-25T09:04:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.130+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/3390729416 wait complete. 2024-04-25T09:04:09.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.131+0000 7f4fdfcdb640 1 Processor -- start 2024-04-25T09:04:09.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.131+0000 7f4fdfcdb640 1 -- start start 2024-04-25T09:04:09.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdfcdb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd80d0f60 0x7f4fd814fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdfcdb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80d3b90 0x7f4fd80ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdfcdb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fd815dca0 0x7f4fd81f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdfcdb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80cf050 con 0x7f4fd80d0f60 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdfcdb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80d1390 con 0x7f4fd80d3b90 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdfcdb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd815e080 con 0x7f4fd815dca0 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdda77640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd80d0f60 0x7f4fd814fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdda77640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd80d0f60 0x7f4fd814fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45714/0 (socket says 172.21.15.55:45714) 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdda77640 1 -- 172.21.15.55:0/1681456796 learned_addr learned my addr 172.21.15.55:0/1681456796 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdd276640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80d3b90 0x7f4fd80ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fde278640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fd815dca0 0x7f4fd81f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdda77640 1 -- 172.21.15.55:0/1681456796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fd815dca0 msgr2=0x7f4fd81f39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdda77640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fd815dca0 0x7f4fd81f39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdda77640 1 -- 172.21.15.55:0/1681456796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80d3b90 msgr2=0x7f4fd80ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdda77640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80d3b90 0x7f4fd80ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.132+0000 7f4fdda77640 1 -- 172.21.15.55:0/1681456796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd815f840 con 0x7f4fd80d0f60 2024-04-25T09:04:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.133+0000 7f4fdda77640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd80d0f60 0x7f4fd814fe60 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b420 tx=0x7f4fd400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.133+0000 7f4fce7fc640 1 -- 172.21.15.55:0/1681456796 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4011830 con 0x7f4fd80d0f60 2024-04-25T09:04:09.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.133+0000 7f4fce7fc640 1 -- 172.21.15.55:0/1681456796 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd4016070 con 0x7f4fd80d0f60 2024-04-25T09:04:09.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.133+0000 7f4fce7fc640 1 -- 172.21.15.55:0/1681456796 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4011c10 con 0x7f4fd80d0f60 2024-04-25T09:04:09.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.133+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/1681456796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd815fb20 con 0x7f4fd80d0f60 2024-04-25T09:04:09.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.133+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/1681456796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd81600e0 con 0x7f4fd80d0f60 2024-04-25T09:04:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.134+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/1681456796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd80750b0 con 0x7f4fd80d0f60 2024-04-25T09:04:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.134+0000 7f4fce7fc640 1 -- 172.21.15.55:0/1681456796 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4fd401b460 con 0x7f4fd80d0f60 2024-04-25T09:04:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.135+0000 7f4fce7fc640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4fbc06b4d0 0x7f4fbc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.135+0000 7f4fce7fc640 1 -- 172.21.15.55:0/1681456796 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f4fd4089ce0 con 0x7f4fd80d0f60 2024-04-25T09:04:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.135+0000 7f4fdd276640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4fbc06b4d0 0x7f4fbc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.135+0000 7f4fdd276640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4fbc06b4d0 0x7f4fbc06d990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8034000 tx=0x7f4fc802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.139+0000 7f4fce7fc640 1 -- 172.21.15.55:0/1681456796 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4fd4020020 con 0x7f4fd80d0f60 2024-04-25T09:04:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.322+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/1681456796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4fd806b1d0 con 0x7f4fd80d0f60 2024-04-25T09:04:09.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.323+0000 7f4fce7fc640 1 -- 172.21.15.55:0/1681456796 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4fd40583d0 con 0x7f4fd80d0f60 2024-04-25T09:04:09.314 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-25T09:04:09.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.324+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/1681456796 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4fbc06b4d0 msgr2=0x7f4fbc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.324+0000 7f4fdfcdb640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4fbc06b4d0 0x7f4fbc06d990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8034000 tx=0x7f4fc802e000 comp rx=0 tx=0).stop 2024-04-25T09:04:09.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.325+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/1681456796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd80d0f60 msgr2=0x7f4fd814fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.325+0000 7f4fdfcdb640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd80d0f60 0x7f4fd814fe60 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b420 tx=0x7f4fd400b8e0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.325+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/1681456796 shutdown_connections 2024-04-25T09:04:09.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.325+0000 7f4fdfcdb640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4fbc06b4d0 0x7f4fbc06d990 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.325+0000 7f4fdfcdb640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fd815dca0 0x7f4fd81f39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.325+0000 7f4fdfcdb640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80d3b90 0x7f4fd80ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.325+0000 7f4fdfcdb640 1 --2- 172.21.15.55:0/1681456796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd80d0f60 0x7f4fd814fe60 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.325+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/1681456796 >> 172.21.15.55:0/1681456796 conn(0x7f4fd80726c0 msgr2=0x7f4fd80b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.325+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/1681456796 shutdown_connections 2024-04-25T09:04:09.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.325+0000 7f4fdfcdb640 1 -- 172.21.15.55:0/1681456796 wait complete. 2024-04-25T09:04:09.324 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:09.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.438+0000 7ff71b058640 1 Processor -- start 2024-04-25T09:04:09.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.438+0000 7ff71b058640 1 -- start start 2024-04-25T09:04:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.438+0000 7ff71b058640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7140b9460 0x7ff7140ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.438+0000 7ff71b058640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7140d2440 con 0x7ff7140d34e0 2024-04-25T09:04:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.438+0000 7ff71b058640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7140d2720 con 0x7ff71415dd50 2024-04-25T09:04:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.438+0000 7ff71b058640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7140d2a00 con 0x7ff7140b9460 2024-04-25T09:04:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.439+0000 7ff713fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7140b9460 0x7ff7140ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.439+0000 7ff7195f5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff7140d34e0 0x7ff7140b6c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54620/0 (socket says 172.21.15.55:54620) 2024-04-25T09:04:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.439+0000 7ff7195f5640 1 -- 172.21.15.55:0/3528919895 learned_addr learned my addr 172.21.15.55:0/3528919895 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.439+0000 7ff713fff640 1 -- 172.21.15.55:0/3528919895 >> v1:172.21.15.167:6789/0 conn(0x7ff71415dd50 legacy=0x7ff7140d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.439+0000 7ff713fff640 1 -- 172.21.15.55:0/3528919895 >> v1:172.21.15.55:6789/0 conn(0x7ff7140d34e0 legacy=0x7ff7140b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.439+0000 7ff713fff640 1 -- 172.21.15.55:0/3528919895 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140d2ce0 con 0x7ff7140b9460 2024-04-25T09:04:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.439+0000 7ff7137fe640 1 -- 172.21.15.55:0/3528919895 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724859711 0 0) 0x7ff7140d2440 con 0x7ff7140d34e0 2024-04-25T09:04:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.440+0000 7ff713fff640 1 --2- 172.21.15.55:0/3528919895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7140b9460 0x7ff7140ce7a0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0097a0 tx=0x7ff6fc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feca68ed3a37b4a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.440+0000 7ff7137fe640 1 -- 172.21.15.55:0/3528919895 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc037070 con 0x7ff7140b9460 2024-04-25T09:04:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.440+0000 7ff7137fe640 1 -- 172.21.15.55:0/3528919895 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc02ae50 con 0x7ff7140b9460 2024-04-25T09:04:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.440+0000 7ff7137fe640 1 -- 172.21.15.55:0/3528919895 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc032660 con 0x7ff7140b9460 2024-04-25T09:04:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.440+0000 7ff71b058640 1 -- 172.21.15.55:0/3528919895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7140b9460 msgr2=0x7ff7140ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.440+0000 7ff71b058640 1 --2- 172.21.15.55:0/3528919895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7140b9460 0x7ff7140ce7a0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0097a0 tx=0x7ff6fc02a140 comp rx=0 tx=0).stop 2024-04-25T09:04:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.440+0000 7ff71b058640 1 -- 172.21.15.55:0/3528919895 shutdown_connections 2024-04-25T09:04:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.440+0000 7ff71b058640 1 --2- 172.21.15.55:0/3528919895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7140b9460 0x7ff7140ce7a0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.440+0000 7ff71b058640 1 -- 172.21.15.55:0/3528919895 >> 172.21.15.55:0/3528919895 conn(0x7ff7140722d0 msgr2=0x7ff7140726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.440+0000 7ff71b058640 1 -- 172.21.15.55:0/3528919895 shutdown_connections 2024-04-25T09:04:09.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.441+0000 7ff71b058640 1 -- 172.21.15.55:0/3528919895 wait complete. 2024-04-25T09:04:09.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.442+0000 7ff71b058640 1 Processor -- start 2024-04-25T09:04:09.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.442+0000 7ff71b058640 1 -- start start 2024-04-25T09:04:09.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.442+0000 7ff71b058640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7140b9460 0x7ff7140c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.442+0000 7ff71b058640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7140d34e0 0x7ff714149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.442+0000 7ff71b058640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415dd50 0x7ff7140c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.442+0000 7ff71b058640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140cee60 con 0x7ff71415dd50 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.442+0000 7ff71b058640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140cece0 con 0x7ff7140b9460 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.442+0000 7ff71b058640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140cefe0 con 0x7ff7140d34e0 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7195f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415dd50 0x7ff7140c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7195f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415dd50 0x7ff7140c8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45736/0 (socket says 172.21.15.55:45736) 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7195f5640 1 -- 172.21.15.55:0/369909795 learned_addr learned my addr 172.21.15.55:0/369909795 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff718df4640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7140b9460 0x7ff7140c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff713fff640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7140d34e0 0x7ff714149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7195f5640 1 -- 172.21.15.55:0/369909795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7140d34e0 msgr2=0x7ff714149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7195f5640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7140d34e0 0x7ff714149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7195f5640 1 -- 172.21.15.55:0/369909795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7140b9460 msgr2=0x7ff7140c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7195f5640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7140b9460 0x7ff7140c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7195f5640 1 -- 172.21.15.55:0/369909795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140c7b40 con 0x7ff71415dd50 2024-04-25T09:04:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff713fff640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7140d34e0 0x7ff714149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7195f5640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415dd50 0x7ff7140c8e60 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00c800 tx=0x7ff70c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7117fa640 1 -- 172.21.15.55:0/369909795 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c018070 con 0x7ff71415dd50 2024-04-25T09:04:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7117fa640 1 -- 172.21.15.55:0/369909795 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c004d80 con 0x7ff71415dd50 2024-04-25T09:04:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff71b058640 1 -- 172.21.15.55:0/369909795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7140c7dc0 con 0x7ff71415dd50 2024-04-25T09:04:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff7117fa640 1 -- 172.21.15.55:0/369909795 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00a880 con 0x7ff71415dd50 2024-04-25T09:04:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.443+0000 7ff71b058640 1 -- 172.21.15.55:0/369909795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7140c8380 con 0x7ff71415dd50 2024-04-25T09:04:09.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.444+0000 7ff71b058640 1 -- 172.21.15.55:0/369909795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7140749b0 con 0x7ff71415dd50 2024-04-25T09:04:09.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.445+0000 7ff7117fa640 1 -- 172.21.15.55:0/369909795 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff70c01b070 con 0x7ff71415dd50 2024-04-25T09:04:09.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.445+0000 7ff7117fa640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6f406b4d0 0x7ff6f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.445+0000 7ff7117fa640 1 -- 172.21.15.55:0/369909795 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7ff70c0897b0 con 0x7ff71415dd50 2024-04-25T09:04:09.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.445+0000 7ff718df4640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6f406b4d0 0x7ff6f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.446+0000 7ff718df4640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6f406b4d0 0x7ff6f406d990 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff704004ea0 tx=0x7ff704009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.449+0000 7ff7117fa640 1 -- 172.21.15.55:0/369909795 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7140c7b40 con 0x7ff71415dd50 2024-04-25T09:04:09.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.667+0000 7ff71b058640 1 -- 172.21.15.55:0/369909795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7140d4780 con 0x7ff71415dd50 2024-04-25T09:04:09.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.668+0000 7ff7117fa640 1 -- 172.21.15.55:0/369909795 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4945 (secure 0 0 0) 0x7ff70c058640 con 0x7ff71415dd50 2024-04-25T09:04:09.656 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:09.657 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":99,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:04:01.276221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/3300284863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3300284863},{"type":"v1","addr":"172.21.15.55:6837","nonce":3300284863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:09.657 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 99 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 -- 172.21.15.55:0/369909795 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6f406b4d0 msgr2=0x7ff6f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6f406b4d0 0x7ff6f406d990 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff704004ea0 tx=0x7ff704009040 comp rx=0 tx=0).stop 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 -- 172.21.15.55:0/369909795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415dd50 msgr2=0x7ff7140c8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415dd50 0x7ff7140c8e60 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00c800 tx=0x7ff70c00ccc0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 -- 172.21.15.55:0/369909795 shutdown_connections 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff6f406b4d0 0x7ff6f406d990 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415dd50 0x7ff7140c8e60 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7140d34e0 0x7ff714149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 --2- 172.21.15.55:0/369909795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7140b9460 0x7ff7140c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 -- 172.21.15.55:0/369909795 >> 172.21.15.55:0/369909795 conn(0x7ff7140722d0 msgr2=0x7ff71415a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 -- 172.21.15.55:0/369909795 shutdown_connections 2024-04-25T09:04:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.670+0000 7ff71b058640 1 -- 172.21.15.55:0/369909795 wait complete. 2024-04-25T09:04:09.669 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.782+0000 7f579106b640 1 Processor -- start 2024-04-25T09:04:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.782+0000 7f579106b640 1 -- start start 2024-04-25T09:04:09.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.783+0000 7f579106b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f578c15f120 0x7f578c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.783+0000 7f579106b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f578c0ce830 0x7f578c0cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.783+0000 7f579106b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f578c0cfbe0 0x7f578c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.783+0000 7f579106b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c0d09f0 con 0x7f578c0ce830 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.783+0000 7f579106b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c0cec70 con 0x7f578c15f120 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.783+0000 7f579106b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0d0430 con 0x7f578c0cfbe0 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.783+0000 7f578a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f578c0ce830 0x7f578c0cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.783+0000 7f578a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f578c0ce830 0x7f578c0cf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45738/0 (socket says 172.21.15.55:45738) 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.783+0000 7f578a59c640 1 -- 172.21.15.55:0/2124081495 learned_addr learned my addr 172.21.15.55:0/2124081495 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.784+0000 7f578ad9d640 1 --2- 172.21.15.55:0/2124081495 >> v2:172.21.15.167:3300/0 conn(0x7f578c15f120 0x7f578c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.784+0000 7f578b59e640 1 --2- 172.21.15.55:0/2124081495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f578c0cfbe0 0x7f578c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.784+0000 7f578a59c640 1 -- 172.21.15.55:0/2124081495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f578c0cfbe0 msgr2=0x7f578c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.784+0000 7f578a59c640 1 --2- 172.21.15.55:0/2124081495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f578c0cfbe0 0x7f578c099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.784+0000 7f578a59c640 1 -- 172.21.15.55:0/2124081495 >> v2:172.21.15.167:3300/0 conn(0x7f578c15f120 msgr2=0x7f578c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.784+0000 7f578a59c640 1 --2- 172.21.15.55:0/2124081495 >> v2:172.21.15.167:3300/0 conn(0x7f578c15f120 0x7f578c0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.784+0000 7f578a59c640 1 -- 172.21.15.55:0/2124081495 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0d0710 con 0x7f578c0ce830 2024-04-25T09:04:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.784+0000 7f578a59c640 1 --2- 172.21.15.55:0/2124081495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578c0ce830 0x7f578c0cf6a0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f578c09b000 tx=0x7f577402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40bfce1cde1d744 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.784+0000 7f5789d9b640 1 -- 172.21.15.55:0/2124081495 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774037070 con 0x7f578c0ce830 2024-04-25T09:04:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.784+0000 7f5789d9b640 1 -- 172.21.15.55:0/2124081495 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5774032440 con 0x7f578c0ce830 2024-04-25T09:04:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.784+0000 7f5789d9b640 1 -- 172.21.15.55:0/2124081495 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774032810 con 0x7f578c0ce830 2024-04-25T09:04:09.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.785+0000 7f579106b640 1 -- 172.21.15.55:0/2124081495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578c0ce830 msgr2=0x7f578c0cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.785+0000 7f579106b640 1 --2- 172.21.15.55:0/2124081495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578c0ce830 0x7f578c0cf6a0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f578c09b000 tx=0x7f577402a270 comp rx=0 tx=0).stop 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.785+0000 7f579106b640 1 -- 172.21.15.55:0/2124081495 shutdown_connections 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.785+0000 7f579106b640 1 --2- 172.21.15.55:0/2124081495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f578c0cfbe0 0x7f578c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.785+0000 7f579106b640 1 --2- 172.21.15.55:0/2124081495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578c0ce830 0x7f578c0cf6a0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.785+0000 7f579106b640 1 --2- 172.21.15.55:0/2124081495 >> v2:172.21.15.167:3300/0 conn(0x7f578c15f120 0x7f578c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.785+0000 7f579106b640 1 -- 172.21.15.55:0/2124081495 >> 172.21.15.55:0/2124081495 conn(0x7f578c0d1900 msgr2=0x7f578c0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.785+0000 7f579106b640 1 -- 172.21.15.55:0/2124081495 shutdown_connections 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.785+0000 7f579106b640 1 -- 172.21.15.55:0/2124081495 wait complete. 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.786+0000 7f579106b640 1 Processor -- start 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.786+0000 7f579106b640 1 -- start start 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.787+0000 7f579106b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578c0ce830 0x7f578c1f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.787+0000 7f579106b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578c0cfbe0 0x7f578c0b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.787+0000 7f579106b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f578c15f120 0x7f578c0b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.787+0000 7f579106b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0cc480 con 0x7f578c0cfbe0 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.787+0000 7f579106b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0ccab0 con 0x7f578c0ce830 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.787+0000 7f579106b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0c5450 con 0x7f578c15f120 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.787+0000 7f578a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578c0cfbe0 0x7f578c0b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.787+0000 7f578a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578c0cfbe0 0x7f578c0b6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45740/0 (socket says 172.21.15.55:45740) 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.787+0000 7f578a59c640 1 -- 172.21.15.55:0/4051812484 learned_addr learned my addr 172.21.15.55:0/4051812484 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f578ad9d640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578c0ce830 0x7f578c1f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f578b59e640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f578c15f120 0x7f578c0b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f578a59c640 1 -- 172.21.15.55:0/4051812484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f578c15f120 msgr2=0x7f578c0b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f578a59c640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f578c15f120 0x7f578c0b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f578a59c640 1 -- 172.21.15.55:0/4051812484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578c0ce830 msgr2=0x7f578c1f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f578a59c640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578c0ce830 0x7f578c1f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f578a59c640 1 -- 172.21.15.55:0/4051812484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0af340 con 0x7f578c0cfbe0 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f578ad9d640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578c0ce830 0x7f578c1f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f578b59e640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f578c15f120 0x7f578c0b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:09.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f578a59c640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578c0cfbe0 0x7f578c0b6ba0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f5774000c00 tx=0x7f57740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f57837fe640 1 -- 172.21.15.55:0/4051812484 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774037040 con 0x7f578c0cfbe0 2024-04-25T09:04:09.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f57837fe640 1 -- 172.21.15.55:0/4051812484 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5774042070 con 0x7f578c0cfbe0 2024-04-25T09:04:09.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f57837fe640 1 -- 172.21.15.55:0/4051812484 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774030bb0 con 0x7f578c0cfbe0 2024-04-25T09:04:09.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f579106b640 1 -- 172.21.15.55:0/4051812484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c1f48e0 con 0x7f578c0cfbe0 2024-04-25T09:04:09.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.788+0000 7f579106b640 1 -- 172.21.15.55:0/4051812484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c0af8c0 con 0x7f578c0cfbe0 2024-04-25T09:04:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.789+0000 7f579106b640 1 -- 172.21.15.55:0/4051812484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c067850 con 0x7f578c0cfbe0 2024-04-25T09:04:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.790+0000 7f57837fe640 1 -- 172.21.15.55:0/4051812484 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5774047460 con 0x7f578c0cfbe0 2024-04-25T09:04:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.790+0000 7f57837fe640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576c06b4d0 0x7f576c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.790+0000 7f57837fe640 1 -- 172.21.15.55:0/4051812484 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f57740aae50 con 0x7f578c0cfbe0 2024-04-25T09:04:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.790+0000 7f578ad9d640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576c06b4d0 0x7f576c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.791+0000 7f578ad9d640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576c06b4d0 0x7f576c06d990 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f578400b820 tx=0x7f5784008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.794+0000 7f57837fe640 1 -- 172.21.15.55:0/4051812484 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5774045360 con 0x7f578c0cfbe0 2024-04-25T09:04:09.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.975+0000 7f579106b640 1 -- 172.21.15.55:0/4051812484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f578c0cf760 con 0x7f578c0cfbe0 2024-04-25T09:04:09.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.976+0000 7f57837fe640 1 -- 172.21.15.55:0/4051812484 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16886 (secure 0 0 0) 0x7f5774079cb0 con 0x7f578c0cfbe0 2024-04-25T09:04:09.965 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:09.965 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":117,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:57.240387+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:31.900630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:32.603273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3667784674":"2024-04-26T09:03:57.240366+0000","172.21.15.55:6835/3667784674":"2024-04-26T09:03:57.240366+0000","172.21.15.55:6837/4257598582":"2024-04-26T09:03:46.638997+0000","172.21.15.55:6835/4257598582":"2024-04-26T09:03:46.638997+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 -- 172.21.15.55:0/4051812484 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576c06b4d0 msgr2=0x7f576c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576c06b4d0 0x7f576c06d990 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f578400b820 tx=0x7f5784008040 comp rx=0 tx=0).stop 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 -- 172.21.15.55:0/4051812484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578c0cfbe0 msgr2=0x7f578c0b6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578c0cfbe0 0x7f578c0b6ba0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f5774000c00 tx=0x7f57740046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 -- 172.21.15.55:0/4051812484 shutdown_connections 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f576c06b4d0 0x7f576c06d990 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f578c15f120 0x7f578c0b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578c0cfbe0 0x7f578c0b6ba0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 --2- 172.21.15.55:0/4051812484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578c0ce830 0x7f578c1f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 -- 172.21.15.55:0/4051812484 >> 172.21.15.55:0/4051812484 conn(0x7f578c0d1900 msgr2=0x7f578c0cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 -- 172.21.15.55:0/4051812484 shutdown_connections 2024-04-25T09:04:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:09.978+0000 7f579106b640 1 -- 172.21.15.55:0/4051812484 wait complete. 2024-04-25T09:04:09.978 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:04:09.978 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:10.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.091+0000 7fde3558b640 1 Processor -- start 2024-04-25T09:04:10.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.091+0000 7fde3558b640 1 -- start start 2024-04-25T09:04:10.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde3558b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde300d35b0 0x7fde300b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde3558b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fde300b5990 0x7fde300b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde3558b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3015e0c0 con 0x7fde3015dce0 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde3558b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300d2510 con 0x7fde300d35b0 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde3558b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300d27f0 con 0x7fde300b5990 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde2effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fde3015dce0 0x7fde300d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54636/0 (socket says 172.21.15.55:54636) 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde2effd640 1 -- 172.21.15.55:0/914529334 learned_addr learned my addr 172.21.15.55:0/914529334 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde27fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde300d35b0 0x7fde300b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde2f7fe640 1 --2- 172.21.15.55:0/914529334 >> v2:172.21.15.167:3300/0 conn(0x7fde300b5990 0x7fde300b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde27fff640 1 -- 172.21.15.55:0/914529334 >> v2:172.21.15.167:3300/0 conn(0x7fde300b5990 msgr2=0x7fde300b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde27fff640 1 --2- 172.21.15.55:0/914529334 >> v2:172.21.15.167:3300/0 conn(0x7fde300b5990 0x7fde300b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde27fff640 1 -- 172.21.15.55:0/914529334 >> v1:172.21.15.55:6789/0 conn(0x7fde3015dce0 legacy=0x7fde300d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde27fff640 1 -- 172.21.15.55:0/914529334 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde300d2ad0 con 0x7fde300d35b0 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.092+0000 7fde2f7fe640 1 --2- 172.21.15.55:0/914529334 >> v2:172.21.15.167:3300/0 conn(0x7fde300b5990 0x7fde300b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.093+0000 7fde27fff640 1 --2- 172.21.15.55:0/914529334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde300d35b0 0x7fde300b5450 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fde300b3390 tx=0x7fde1802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778b5500dac7d828 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.093+0000 7fde2e7fc640 1 -- 172.21.15.55:0/914529334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18037070 con 0x7fde300d35b0 2024-04-25T09:04:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.093+0000 7fde2e7fc640 1 -- 172.21.15.55:0/914529334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde18032440 con 0x7fde300d35b0 2024-04-25T09:04:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.093+0000 7fde2e7fc640 1 -- 172.21.15.55:0/914529334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18032810 con 0x7fde300d35b0 2024-04-25T09:04:10.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.094+0000 7fde3558b640 1 -- 172.21.15.55:0/914529334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde300d35b0 msgr2=0x7fde300b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.094+0000 7fde3558b640 1 --2- 172.21.15.55:0/914529334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde300d35b0 0x7fde300b5450 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fde300b3390 tx=0x7fde1802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.094+0000 7fde3558b640 1 -- 172.21.15.55:0/914529334 shutdown_connections 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.094+0000 7fde3558b640 1 --2- 172.21.15.55:0/914529334 >> v2:172.21.15.167:3300/0 conn(0x7fde300b5990 0x7fde300b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.094+0000 7fde3558b640 1 --2- 172.21.15.55:0/914529334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde300d35b0 0x7fde300b5450 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.094+0000 7fde3558b640 1 -- 172.21.15.55:0/914529334 >> 172.21.15.55:0/914529334 conn(0x7fde30072900 msgr2=0x7fde300d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.094+0000 7fde3558b640 1 -- 172.21.15.55:0/914529334 shutdown_connections 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.094+0000 7fde3558b640 1 -- 172.21.15.55:0/914529334 wait complete. 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.095+0000 7fde3558b640 1 Processor -- start 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.095+0000 7fde3558b640 1 -- start start 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde3558b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde300b5990 0x7fde3015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde3558b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde300d35b0 0x7fde30158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde3558b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3015dce0 0x7fde30160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde3558b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde300d2160 con 0x7fde300d35b0 2024-04-25T09:04:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde3558b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde300d3090 con 0x7fde3015dce0 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde3558b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde301588b0 con 0x7fde300b5990 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde27fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde300d35b0 0x7fde30158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde27fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde300d35b0 0x7fde30158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45758/0 (socket says 172.21.15.55:45758) 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde27fff640 1 -- 172.21.15.55:0/2734672800 learned_addr learned my addr 172.21.15.55:0/2734672800 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde2f7fe640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3015dce0 0x7fde30160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde2effd640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde300b5990 0x7fde3015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde27fff640 1 -- 172.21.15.55:0/2734672800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde300b5990 msgr2=0x7fde3015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde27fff640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde300b5990 0x7fde3015ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde27fff640 1 -- 172.21.15.55:0/2734672800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3015dce0 msgr2=0x7fde30160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde27fff640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3015dce0 0x7fde30160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde27fff640 1 -- 172.21.15.55:0/2734672800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde301f3c70 con 0x7fde300d35b0 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde2f7fe640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3015dce0 0x7fde30160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde2effd640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde300b5990 0x7fde3015ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.096+0000 7fde27fff640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde300d35b0 0x7fde30158370 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fde18009890 tx=0x7fde180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.097+0000 7fde277fe640 1 -- 172.21.15.55:0/2734672800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18037040 con 0x7fde300d35b0 2024-04-25T09:04:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.097+0000 7fde277fe640 1 -- 172.21.15.55:0/2734672800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde18042070 con 0x7fde300d35b0 2024-04-25T09:04:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.097+0000 7fde3558b640 1 -- 172.21.15.55:0/2734672800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde301f3f50 con 0x7fde300d35b0 2024-04-25T09:04:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.097+0000 7fde277fe640 1 -- 172.21.15.55:0/2734672800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18030a50 con 0x7fde300d35b0 2024-04-25T09:04:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.097+0000 7fde3558b640 1 -- 172.21.15.55:0/2734672800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde301f4510 con 0x7fde300d35b0 2024-04-25T09:04:10.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.098+0000 7fde3558b640 1 -- 172.21.15.55:0/2734672800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde300749b0 con 0x7fde300d35b0 2024-04-25T09:04:10.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.098+0000 7fde277fe640 1 -- 172.21.15.55:0/2734672800 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fde18030bf0 con 0x7fde300d35b0 2024-04-25T09:04:10.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.099+0000 7fde277fe640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde1006b4d0 0x7fde1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.099+0000 7fde2effd640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde1006b4d0 0x7fde1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.099+0000 7fde277fe640 1 -- 172.21.15.55:0/2734672800 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fde180aae40 con 0x7fde300d35b0 2024-04-25T09:04:10.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.099+0000 7fde2effd640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde1006b4d0 0x7fde1006d990 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fde3015ed60 tx=0x7fde20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.103+0000 7fde277fe640 1 -- 172.21.15.55:0/2734672800 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fde18045360 con 0x7fde300d35b0 2024-04-25T09:04:10.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.321+0000 7fde3558b640 1 -- 172.21.15.55:0/2734672800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde300d46f0 con 0x7fde300d35b0 2024-04-25T09:04:10.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.322+0000 7fde277fe640 1 -- 172.21.15.55:0/2734672800 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4945 (secure 0 0 0) 0x7fde18079b90 con 0x7fde300d35b0 2024-04-25T09:04:10.311 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:10.311 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":99,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:04:01.276221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/3300284863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3300284863},{"type":"v1","addr":"172.21.15.55:6837","nonce":3300284863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:10.311 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 99 2024-04-25T09:04:10.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 -- 172.21.15.55:0/2734672800 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde1006b4d0 msgr2=0x7fde1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde1006b4d0 0x7fde1006d990 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fde3015ed60 tx=0x7fde20009040 comp rx=0 tx=0).stop 2024-04-25T09:04:10.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 -- 172.21.15.55:0/2734672800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde300d35b0 msgr2=0x7fde30158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde300d35b0 0x7fde30158370 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fde18009890 tx=0x7fde180046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 -- 172.21.15.55:0/2734672800 shutdown_connections 2024-04-25T09:04:10.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fde1006b4d0 0x7fde1006d990 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3015dce0 0x7fde30160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde300d35b0 0x7fde30158370 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 --2- 172.21.15.55:0/2734672800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde300b5990 0x7fde3015ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 -- 172.21.15.55:0/2734672800 >> 172.21.15.55:0/2734672800 conn(0x7fde30072900 msgr2=0x7fde300b8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 -- 172.21.15.55:0/2734672800 shutdown_connections 2024-04-25T09:04:10.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.324+0000 7fde3558b640 1 -- 172.21.15.55:0/2734672800 wait complete. 2024-04-25T09:04:10.324 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:10.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.437+0000 7f8a88815640 1 Processor -- start 2024-04-25T09:04:10.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.437+0000 7f8a88815640 1 -- start start 2024-04-25T09:04:10.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a88815640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a840d35b0 0x7f8a840b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a88815640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8a840b5990 0x7f8a840b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a88815640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8415e0c0 con 0x7f8a8415dce0 2024-04-25T09:04:10.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a88815640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a840b5de0 con 0x7f8a840b5990 2024-04-25T09:04:10.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a88815640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840d2510 con 0x7f8a840d35b0 2024-04-25T09:04:10.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a82d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8a840b5990 0x7f8a840b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a81d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a840d35b0 0x7f8a840b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a82d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8a840b5990 0x7f8a840b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:57826/0 (socket says 172.21.15.55:57826) 2024-04-25T09:04:10.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a8259c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f8a8415dce0 0x7f8a840d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:48652/0 (socket says 172.21.15.55:48652) 2024-04-25T09:04:10.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a82d9d640 1 -- 172.21.15.55:0/2056493023 learned_addr learned my addr 172.21.15.55:0/2056493023 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:10.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a82d9d640 1 -- 172.21.15.55:0/2056493023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a840d35b0 msgr2=0x7f8a840b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:10.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a82d9d640 1 --2- 172.21.15.55:0/2056493023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a840d35b0 0x7f8a840b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a82d9d640 1 -- 172.21.15.55:0/2056493023 >> v1:172.21.15.167:6789/0 conn(0x7f8a8415dce0 legacy=0x7f8a840d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a82d9d640 1 -- 172.21.15.55:0/2056493023 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a840d27f0 con 0x7f8a840b5990 2024-04-25T09:04:10.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.438+0000 7f8a81d9b640 1 --2- 172.21.15.55:0/2056493023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a840d35b0 0x7f8a840b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.439+0000 7f8a82d9d640 1 --2- 172.21.15.55:0/2056493023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a840b5990 0x7f8a840b6b00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009e50 tx=0x7f8a7c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f524ade7a19b8902 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.439+0000 7f8a8159a640 1 -- 172.21.15.55:0/2056493023 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c036070 con 0x7f8a840b5990 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.439+0000 7f8a8159a640 1 -- 172.21.15.55:0/2056493023 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c031600 con 0x7f8a840b5990 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.439+0000 7f8a8159a640 1 -- 172.21.15.55:0/2056493023 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0319d0 con 0x7f8a840b5990 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.440+0000 7f8a88815640 1 -- 172.21.15.55:0/2056493023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a840b5990 msgr2=0x7f8a840b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.440+0000 7f8a88815640 1 --2- 172.21.15.55:0/2056493023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a840b5990 0x7f8a840b6b00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009e50 tx=0x7f8a7c02a710 comp rx=0 tx=0).stop 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.440+0000 7f8a88815640 1 -- 172.21.15.55:0/2056493023 shutdown_connections 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.440+0000 7f8a88815640 1 --2- 172.21.15.55:0/2056493023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a840b5990 0x7f8a840b6b00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.440+0000 7f8a88815640 1 --2- 172.21.15.55:0/2056493023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a840d35b0 0x7f8a840b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.440+0000 7f8a88815640 1 -- 172.21.15.55:0/2056493023 >> 172.21.15.55:0/2056493023 conn(0x7f8a84072900 msgr2=0x7f8a840d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.440+0000 7f8a88815640 1 -- 172.21.15.55:0/2056493023 shutdown_connections 2024-04-25T09:04:10.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.440+0000 7f8a88815640 1 -- 172.21.15.55:0/2056493023 wait complete. 2024-04-25T09:04:10.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.441+0000 7f8a88815640 1 Processor -- start 2024-04-25T09:04:10.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.441+0000 7f8a88815640 1 -- start start 2024-04-25T09:04:10.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a88815640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a840b5990 0x7f8a84152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a88815640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a840d35b0 0x7f8a840b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a88815640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a8415dce0 0x7f8a840b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a88815640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840d3090 con 0x7f8a840b5990 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a88815640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840d2db0 con 0x7f8a840d35b0 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a88815640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840d2160 con 0x7f8a8415dce0 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a8259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a840b5990 0x7f8a84152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a8259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a840b5990 0x7f8a84152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45772/0 (socket says 172.21.15.55:45772) 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a8259c640 1 -- 172.21.15.55:0/3619564539 learned_addr learned my addr 172.21.15.55:0/3619564539 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a81d9b640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a840d35b0 0x7f8a840b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a82d9d640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a8415dce0 0x7f8a840b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a8259c640 1 -- 172.21.15.55:0/3619564539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a8415dce0 msgr2=0x7f8a840b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a8259c640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a8415dce0 0x7f8a840b7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a8259c640 1 -- 172.21.15.55:0/3619564539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a840d35b0 msgr2=0x7f8a840b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.442+0000 7f8a8259c640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a840d35b0 0x7f8a840b7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.443+0000 7f8a8259c640 1 -- 172.21.15.55:0/3619564539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84152740 con 0x7f8a840b5990 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.443+0000 7f8a8259c640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a840b5990 0x7f8a84152200 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c3f0 tx=0x7f8a7400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.443+0000 7f8a72ffd640 1 -- 172.21.15.55:0/3619564539 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a740074e0 con 0x7f8a840b5990 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.443+0000 7f8a72ffd640 1 -- 172.21.15.55:0/3619564539 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a74007680 con 0x7f8a840b5990 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.443+0000 7f8a88815640 1 -- 172.21.15.55:0/3619564539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a840c81f0 con 0x7f8a840b5990 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.443+0000 7f8a72ffd640 1 -- 172.21.15.55:0/3619564539 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74004a00 con 0x7f8a840b5990 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.443+0000 7f8a88815640 1 -- 172.21.15.55:0/3619564539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a840c87b0 con 0x7f8a840b5990 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.444+0000 7f8a88815640 1 -- 172.21.15.55:0/3619564539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a840749b0 con 0x7f8a840b5990 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.444+0000 7f8a72ffd640 1 -- 172.21.15.55:0/3619564539 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a7401a020 con 0x7f8a840b5990 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.445+0000 7f8a72ffd640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a6406b4d0 0x7f8a6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.445+0000 7f8a72ffd640 1 -- 172.21.15.55:0/3619564539 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f8a74089ae0 con 0x7f8a840b5990 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.445+0000 7f8a81d9b640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a6406b4d0 0x7f8a6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.445+0000 7f8a81d9b640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a6406b4d0 0x7f8a6406d990 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009560 tx=0x7f8a78008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.449+0000 7f8a72ffd640 1 -- 172.21.15.55:0/3619564539 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8a74058810 con 0x7f8a840b5990 2024-04-25T09:04:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.667+0000 7f8a88815640 1 -- 172.21.15.55:0/3619564539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a840d15a0 con 0x7f8a840b5990 2024-04-25T09:04:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.668+0000 7f8a72ffd640 1 -- 172.21.15.55:0/3619564539 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f8a74058110 con 0x7f8a840b5990 2024-04-25T09:04:10.656 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:10.656 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":99,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:33.628986+0000","modified":"2024-04-25T09:04:01.276221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6837/3300284863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3300284863},{"type":"v1","addr":"172.21.15.55:6837","nonce":3300284863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:04:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 99 2024-04-25T09:04:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.669+0000 7f8a88815640 1 -- 172.21.15.55:0/3619564539 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a6406b4d0 msgr2=0x7f8a6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.669+0000 7f8a88815640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a6406b4d0 0x7f8a6406d990 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009560 tx=0x7f8a78008040 comp rx=0 tx=0).stop 2024-04-25T09:04:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.669+0000 7f8a88815640 1 -- 172.21.15.55:0/3619564539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a840b5990 msgr2=0x7f8a84152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.669+0000 7f8a88815640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a840b5990 0x7f8a84152200 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c3f0 tx=0x7f8a7400c8b0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.669+0000 7f8a88815640 1 -- 172.21.15.55:0/3619564539 shutdown_connections 2024-04-25T09:04:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.669+0000 7f8a88815640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f8a6406b4d0 0x7f8a6406d990 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.669+0000 7f8a88815640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a8415dce0 0x7f8a840b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.669+0000 7f8a88815640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a840d35b0 0x7f8a840b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.669+0000 7f8a88815640 1 --2- 172.21.15.55:0/3619564539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a840b5990 0x7f8a84152200 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.669+0000 7f8a88815640 1 -- 172.21.15.55:0/3619564539 >> 172.21.15.55:0/3619564539 conn(0x7f8a84072900 msgr2=0x7f8a840c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.670+0000 7f8a88815640 1 -- 172.21.15.55:0/3619564539 shutdown_connections 2024-04-25T09:04:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.670+0000 7f8a88815640 1 -- 172.21.15.55:0/3619564539 wait complete. 2024-04-25T09:04:10.669 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:10.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.782+0000 7fa2457d5640 1 Processor -- start 2024-04-25T09:04:10.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.782+0000 7fa2457d5640 1 -- start start 2024-04-25T09:04:10.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa2457d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa24015ba10 0x7fa240099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa2457d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa240099f80 0x7fa24006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa2457d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24009a3a0 con 0x7fa24006c1f0 2024-04-25T09:04:10.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa2457d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2400cbe50 con 0x7fa24015ba10 2024-04-25T09:04:10.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa2457d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400cfe80 con 0x7fa240099f80 2024-04-25T09:04:10.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa23effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa24015ba10 0x7fa240099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa23f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa24006c1f0 0x7fa2400cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54642/0 (socket says 172.21.15.55:54642) 2024-04-25T09:04:10.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa23f7fe640 1 -- 172.21.15.55:0/1567339106 learned_addr learned my addr 172.21.15.55:0/1567339106 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:10.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa23effd640 1 -- 172.21.15.55:0/1567339106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa240099f80 msgr2=0x7fa24006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:10.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa23effd640 1 --2- 172.21.15.55:0/1567339106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa240099f80 0x7fa24006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa23effd640 1 -- 172.21.15.55:0/1567339106 >> v1:172.21.15.55:6789/0 conn(0x7fa24006c1f0 legacy=0x7fa2400cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa23effd640 1 -- 172.21.15.55:0/1567339106 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24006c680 con 0x7fa24015ba10 2024-04-25T09:04:10.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.783+0000 7fa23dffb640 1 -- 172.21.15.55:0/1567339106 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932481235 0 0) 0x7fa24009a3a0 con 0x7fa24006c1f0 2024-04-25T09:04:10.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.784+0000 7fa23effd640 1 --2- 172.21.15.55:0/1567339106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa24015ba10 0x7fa240099a40 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fa2380097a0 tx=0x7fa23802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6beeae40d62b58bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.784+0000 7fa23dffb640 1 -- 172.21.15.55:0/1567339106 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238037070 con 0x7fa24015ba10 2024-04-25T09:04:10.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.784+0000 7fa23dffb640 1 -- 172.21.15.55:0/1567339106 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa238032440 con 0x7fa24015ba10 2024-04-25T09:04:10.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.784+0000 7fa23dffb640 1 -- 172.21.15.55:0/1567339106 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238032810 con 0x7fa24015ba10 2024-04-25T09:04:10.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.785+0000 7fa2457d5640 1 -- 172.21.15.55:0/1567339106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa24015ba10 msgr2=0x7fa240099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.785+0000 7fa2457d5640 1 --2- 172.21.15.55:0/1567339106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa24015ba10 0x7fa240099a40 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fa2380097a0 tx=0x7fa23802a180 comp rx=0 tx=0).stop 2024-04-25T09:04:10.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.785+0000 7fa2457d5640 1 -- 172.21.15.55:0/1567339106 shutdown_connections 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.785+0000 7fa2457d5640 1 --2- 172.21.15.55:0/1567339106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa240099f80 0x7fa24006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.785+0000 7fa2457d5640 1 --2- 172.21.15.55:0/1567339106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa24015ba10 0x7fa240099a40 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.785+0000 7fa2457d5640 1 -- 172.21.15.55:0/1567339106 >> 172.21.15.55:0/1567339106 conn(0x7fa2400b32f0 msgr2=0x7fa2400b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.785+0000 7fa2457d5640 1 -- 172.21.15.55:0/1567339106 shutdown_connections 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.785+0000 7fa2457d5640 1 -- 172.21.15.55:0/1567339106 wait complete. 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.786+0000 7fa2457d5640 1 Processor -- start 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.786+0000 7fa2457d5640 1 -- start start 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa2457d5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24006c1f0 0x7fa2400ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa2457d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa240099f80 0x7fa24015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa2457d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa24015ba10 0x7fa24015c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa2457d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24006cec0 con 0x7fa240099f80 2024-04-25T09:04:10.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa2457d5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24006cbe0 con 0x7fa24006c1f0 2024-04-25T09:04:10.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa2457d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400cd930 con 0x7fa24015ba10 2024-04-25T09:04:10.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa23e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa240099f80 0x7fa24015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa23e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa240099f80 0x7fa24015e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45790/0 (socket says 172.21.15.55:45790) 2024-04-25T09:04:10.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa23e7fc640 1 -- 172.21.15.55:0/2910132727 learned_addr learned my addr 172.21.15.55:0/2910132727 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:10.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa23f7fe640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa24015ba10 0x7fa24015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa23effd640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24006c1f0 0x7fa2400ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa23e7fc640 1 -- 172.21.15.55:0/2910132727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa24015ba10 msgr2=0x7fa24015c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa23e7fc640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa24015ba10 0x7fa24015c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa23e7fc640 1 -- 172.21.15.55:0/2910132727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24006c1f0 msgr2=0x7fa2400ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa23e7fc640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24006c1f0 0x7fa2400ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.787+0000 7fa23e7fc640 1 -- 172.21.15.55:0/2910132727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24015d280 con 0x7fa240099f80 2024-04-25T09:04:10.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.788+0000 7fa23e7fc640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa240099f80 0x7fa24015e030 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fa23400b4a0 tx=0x7fa23400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.788+0000 7fa2277fe640 1 -- 172.21.15.55:0/2910132727 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234014070 con 0x7fa240099f80 2024-04-25T09:04:10.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.788+0000 7fa2277fe640 1 -- 172.21.15.55:0/2910132727 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa234010610 con 0x7fa240099f80 2024-04-25T09:04:10.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.788+0000 7fa2457d5640 1 -- 172.21.15.55:0/2910132727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2400c6a30 con 0x7fa240099f80 2024-04-25T09:04:10.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.788+0000 7fa2277fe640 1 -- 172.21.15.55:0/2910132727 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234010a00 con 0x7fa240099f80 2024-04-25T09:04:10.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.788+0000 7fa2457d5640 1 -- 172.21.15.55:0/2910132727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2400ae9f0 con 0x7fa240099f80 2024-04-25T09:04:10.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.789+0000 7fa2457d5640 1 -- 172.21.15.55:0/2910132727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2400749b0 con 0x7fa240099f80 2024-04-25T09:04:10.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.789+0000 7fa2277fe640 1 -- 172.21.15.55:0/2910132727 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa234017070 con 0x7fa240099f80 2024-04-25T09:04:10.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.790+0000 7fa2277fe640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 0x7fa22c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.790+0000 7fa23effd640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 0x7fa22c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.790+0000 7fa2277fe640 1 -- 172.21.15.55:0/2910132727 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fa234089cf0 con 0x7fa240099f80 2024-04-25T09:04:10.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.790+0000 7fa23effd640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 0x7fa22c06d990 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa238034000 tx=0x7fa23802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.794+0000 7fa2277fe640 1 -- 172.21.15.55:0/2910132727 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa23408e070 con 0x7fa240099f80 2024-04-25T09:04:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.979+0000 7fa2457d5640 1 -- 172.21.15.55:0/2910132727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2400c8460 con 0x7fa240099f80 2024-04-25T09:04:10.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.980+0000 7fa2277fe640 1 -- 172.21.15.55:0/2910132727 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16886 (secure 0 0 0) 0x7fa234058b50 con 0x7fa240099f80 2024-04-25T09:04:10.969 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:10.969 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":117,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:03:57.240387+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:31.900630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:32.603273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3667784674":"2024-04-26T09:03:57.240366+0000","172.21.15.55:6835/3667784674":"2024-04-26T09:03:57.240366+0000","172.21.15.55:6837/4257598582":"2024-04-26T09:03:46.638997+0000","172.21.15.55:6835/4257598582":"2024-04-26T09:03:46.638997+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 -- 172.21.15.55:0/2910132727 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 msgr2=0x7fa22c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 0x7fa22c06d990 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa238034000 tx=0x7fa23802e000 comp rx=0 tx=0).stop 2024-04-25T09:04:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 -- 172.21.15.55:0/2910132727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa240099f80 msgr2=0x7fa24015e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa240099f80 0x7fa24015e030 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fa23400b4a0 tx=0x7fa23400b960 comp rx=0 tx=0).stop 2024-04-25T09:04:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 -- 172.21.15.55:0/2910132727 shutdown_connections 2024-04-25T09:04:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa22c06b4d0 0x7fa22c06d990 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa24015ba10 0x7fa24015c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa240099f80 0x7fa24015e030 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 --2- 172.21.15.55:0/2910132727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24006c1f0 0x7fa2400ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 -- 172.21.15.55:0/2910132727 >> 172.21.15.55:0/2910132727 conn(0x7fa2400b32f0 msgr2=0x7fa24015abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 -- 172.21.15.55:0/2910132727 shutdown_connections 2024-04-25T09:04:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:10.982+0000 7fa2457d5640 1 -- 172.21.15.55:0/2910132727 wait complete. 2024-04-25T09:04:10.982 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:04:11.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.095+0000 7f9ee3b7d640 1 Processor -- start 2024-04-25T09:04:11.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.095+0000 7f9ee3b7d640 1 -- start start 2024-04-25T09:04:11.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.096+0000 7f9ee3b7d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9edc0d24b0 0x7f9edc0d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.096+0000 7f9ee3b7d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc0d0990 0x7f9edc0b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.096+0000 7f9ee3b7d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0d0e40 con 0x7f9edc15dec0 2024-04-25T09:04:11.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.096+0000 7f9ee3b7d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc0d2a20 con 0x7f9edc0d24b0 2024-04-25T09:04:11.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.096+0000 7f9ee3b7d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0d2d00 con 0x7f9edc0d0990 2024-04-25T09:04:11.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.096+0000 7f9ee1118640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9edc0d24b0 0x7f9edc0d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.096+0000 7f9ee1118640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9edc0d24b0 0x7f9edc0d0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45804/0 (socket says 172.21.15.55:45804) 2024-04-25T09:04:11.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.096+0000 7f9ee1118640 1 -- 172.21.15.55:0/4007339969 learned_addr learned my addr 172.21.15.55:0/4007339969 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:11.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.096+0000 7f9ee211a640 1 --2- 172.21.15.55:0/4007339969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc0d0990 0x7f9edc0b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.097+0000 7f9ee1118640 1 -- 172.21.15.55:0/4007339969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc0d0990 msgr2=0x7f9edc0b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.097+0000 7f9ee1118640 1 --2- 172.21.15.55:0/4007339969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc0d0990 0x7f9edc0b6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.097+0000 7f9ee1118640 1 -- 172.21.15.55:0/4007339969 >> v1:172.21.15.167:6789/0 conn(0x7f9edc15dec0 legacy=0x7f9edc0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.097+0000 7f9ee1118640 1 -- 172.21.15.55:0/4007339969 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc0d2fe0 con 0x7f9edc0d24b0 2024-04-25T09:04:11.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.097+0000 7f9ee1118640 1 --2- 172.21.15.55:0/4007339969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d24b0 0x7f9edc0d0450 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00098a0 tx=0x7f9ed002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12eb95c485bd2d5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.097+0000 7f9ee0917640 1 -- 172.21.15.55:0/4007339969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0037070 con 0x7f9edc0d24b0 2024-04-25T09:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.097+0000 7f9ee0917640 1 -- 172.21.15.55:0/4007339969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed0032440 con 0x7f9edc0d24b0 2024-04-25T09:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.098+0000 7f9ee0917640 1 -- 172.21.15.55:0/4007339969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0032810 con 0x7f9edc0d24b0 2024-04-25T09:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.098+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/4007339969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d24b0 msgr2=0x7f9edc0d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.098+0000 7f9ee3b7d640 1 --2- 172.21.15.55:0/4007339969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d24b0 0x7f9edc0d0450 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00098a0 tx=0x7f9ed002a290 comp rx=0 tx=0).stop 2024-04-25T09:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.098+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/4007339969 shutdown_connections 2024-04-25T09:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.098+0000 7f9ee3b7d640 1 --2- 172.21.15.55:0/4007339969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc0d0990 0x7f9edc0b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.098+0000 7f9ee3b7d640 1 --2- 172.21.15.55:0/4007339969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d24b0 0x7f9edc0d0450 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.098+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/4007339969 >> 172.21.15.55:0/4007339969 conn(0x7f9edc072900 msgr2=0x7f9edc0b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.098+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/4007339969 shutdown_connections 2024-04-25T09:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.098+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/4007339969 wait complete. 2024-04-25T09:04:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.099+0000 7f9ee3b7d640 1 Processor -- start 2024-04-25T09:04:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.099+0000 7f9ee3b7d640 1 -- start start 2024-04-25T09:04:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee3b7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0990 0x7f9edc160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee3b7d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc0d24b0 0x7f9edc0c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee3b7d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc15dec0 0x7f9edc1f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee3b7d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0b73d0 con 0x7f9edc0d0990 2024-04-25T09:04:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee3b7d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0d35a0 con 0x7f9edc0d24b0 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee3b7d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0b7550 con 0x7f9edc15dec0 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee1919640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0990 0x7f9edc160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee1919640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0990 0x7f9edc160c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45814/0 (socket says 172.21.15.55:45814) 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee1919640 1 -- 172.21.15.55:0/235409139 learned_addr learned my addr 172.21.15.55:0/235409139 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee211a640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc15dec0 0x7f9edc1f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee1118640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc0d24b0 0x7f9edc0c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee1919640 1 -- 172.21.15.55:0/235409139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc15dec0 msgr2=0x7f9edc1f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee1919640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc15dec0 0x7f9edc1f6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee1919640 1 -- 172.21.15.55:0/235409139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc0d24b0 msgr2=0x7f9edc0c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee1919640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc0d24b0 0x7f9edc0c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.100+0000 7f9ee1919640 1 -- 172.21.15.55:0/235409139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc15bac0 con 0x7f9edc0d0990 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.101+0000 7f9ee1919640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0990 0x7f9edc160c50 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400c3c0 tx=0x7f9ed400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.101+0000 7f9eda7fc640 1 -- 172.21.15.55:0/235409139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40052d0 con 0x7f9edc0d0990 2024-04-25T09:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.101+0000 7f9eda7fc640 1 -- 172.21.15.55:0/235409139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed4005490 con 0x7f9edc0d0990 2024-04-25T09:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.101+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/235409139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc15bda0 con 0x7f9edc0d0990 2024-04-25T09:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.101+0000 7f9eda7fc640 1 -- 172.21.15.55:0/235409139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4007260 con 0x7f9edc0d0990 2024-04-25T09:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.101+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/235409139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc15c360 con 0x7f9edc0d0990 2024-04-25T09:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.102+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/235409139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc0750b0 con 0x7f9edc0d0990 2024-04-25T09:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.102+0000 7f9eda7fc640 1 -- 172.21.15.55:0/235409139 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ed4007400 con 0x7f9edc0d0990 2024-04-25T09:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.103+0000 7f9eda7fc640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ec806b500 0x7f9ec806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.103+0000 7f9eda7fc640 1 -- 172.21.15.55:0/235409139 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f9ed40895c0 con 0x7f9edc0d0990 2024-04-25T09:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.103+0000 7f9ee1118640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ec806b500 0x7f9ec806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.103+0000 7f9ee1118640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ec806b500 0x7f9ec806d9c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0034000 tx=0x7f9ed002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.107+0000 7f9eda7fc640 1 -- 172.21.15.55:0/235409139 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9ed4057dd0 con 0x7f9edc0d0990 2024-04-25T09:04:11.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:11.263 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:11.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.327+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/235409139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9edc1555c0 con 0x7f9edc0d0990 2024-04-25T09:04:11.316 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-25T09:04:11.328+0000 7f757f284640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:04:11.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.331+0000 7f9eda7fc640 1 -- 172.21.15.55:0/235409139 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v100) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9ed405be70 con 0x7f9edc0d0990 2024-04-25T09:04:11.319 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:04:11.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.334+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/235409139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ec806b500 msgr2=0x7f9ec806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.334+0000 7f9ee3b7d640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ec806b500 0x7f9ec806d9c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0034000 tx=0x7f9ed002e000 comp rx=0 tx=0).stop 2024-04-25T09:04:11.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.334+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/235409139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0990 msgr2=0x7f9edc160c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.334+0000 7f9ee3b7d640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0990 0x7f9edc160c50 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400c3c0 tx=0x7f9ed400c880 comp rx=0 tx=0).stop 2024-04-25T09:04:11.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.334+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/235409139 shutdown_connections 2024-04-25T09:04:11.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.334+0000 7f9ee3b7d640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f9ec806b500 0x7f9ec806d9c0 secure :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0034000 tx=0x7f9ed002e000 comp rx=0 tx=0).stop 2024-04-25T09:04:11.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.334+0000 7f9ee3b7d640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc15dec0 0x7f9edc1f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.334+0000 7f9ee3b7d640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc0d24b0 0x7f9edc0c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.334+0000 7f9ee3b7d640 1 --2- 172.21.15.55:0/235409139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0990 0x7f9edc160c50 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.334+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/235409139 >> 172.21.15.55:0/235409139 conn(0x7f9edc072900 msgr2=0x7f9edc159990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.335+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/235409139 shutdown_connections 2024-04-25T09:04:11.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.335+0000 7f9ee3b7d640 1 -- 172.21.15.55:0/235409139 wait complete. 2024-04-25T09:04:11.324 INFO:tasks.ceph.mds.a.smithi055.stderr: -1195> 2024-04-25T09:04:03.252+0000 7f9ee8fb9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:04:11.335 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:04:11.349 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-25T09:04:11.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.464+0000 7fea32989640 1 Processor -- start 2024-04-25T09:04:11.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.464+0000 7fea32989640 1 -- start start 2024-04-25T09:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea32989640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fea2c0d3b90 0x7fea2c0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea32989640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea2c0d0f60 0x7fea2c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea32989640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2c0d4090 con 0x7fea2c15dca0 2024-04-25T09:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea32989640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2c0b6b20 con 0x7fea2c0d0f60 2024-04-25T09:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea32989640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2c0d1390 con 0x7fea2c0d3b90 2024-04-25T09:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea30f26640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea2c0d0f60 0x7fea2c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea2bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fea2c15dca0 0x7fea2c0ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54652/0 (socket says 172.21.15.55:54652) 2024-04-25T09:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea2bfff640 1 -- 172.21.15.55:0/619314667 learned_addr learned my addr 172.21.15.55:0/619314667 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea2b7fe640 1 --2- 172.21.15.55:0/619314667 >> v2:172.21.15.167:3300/0 conn(0x7fea2c0d3b90 0x7fea2c0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea30f26640 1 -- 172.21.15.55:0/619314667 >> v2:172.21.15.167:3300/0 conn(0x7fea2c0d3b90 msgr2=0x7fea2c0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea30f26640 1 --2- 172.21.15.55:0/619314667 >> v2:172.21.15.167:3300/0 conn(0x7fea2c0d3b90 0x7fea2c0d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea30f26640 1 -- 172.21.15.55:0/619314667 >> v1:172.21.15.55:6789/0 conn(0x7fea2c15dca0 legacy=0x7fea2c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea2affd640 1 -- 172.21.15.55:0/619314667 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559617959 0 0) 0x7fea2c0d4090 con 0x7fea2c15dca0 2024-04-25T09:04:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.465+0000 7fea30f26640 1 -- 172.21.15.55:0/619314667 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c0d4370 con 0x7fea2c0d0f60 2024-04-25T09:04:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.466+0000 7fea30f26640 1 --2- 172.21.15.55:0/619314667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea2c0d0f60 0x7fea2c0b2500 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0b6560 tx=0x7fea2402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71480c431d1b90cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.466+0000 7fea2affd640 1 -- 172.21.15.55:0/619314667 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24007740 con 0x7fea2c0d0f60 2024-04-25T09:04:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.466+0000 7fea2affd640 1 -- 172.21.15.55:0/619314667 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea240078e0 con 0x7fea2c0d0f60 2024-04-25T09:04:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.466+0000 7fea2affd640 1 -- 172.21.15.55:0/619314667 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24007cb0 con 0x7fea2c0d0f60 2024-04-25T09:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.467+0000 7fea32989640 1 -- 172.21.15.55:0/619314667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea2c0d0f60 msgr2=0x7fea2c0b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.467+0000 7fea32989640 1 --2- 172.21.15.55:0/619314667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea2c0d0f60 0x7fea2c0b2500 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0b6560 tx=0x7fea2402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.467+0000 7fea32989640 1 -- 172.21.15.55:0/619314667 shutdown_connections 2024-04-25T09:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.467+0000 7fea32989640 1 --2- 172.21.15.55:0/619314667 >> v2:172.21.15.167:3300/0 conn(0x7fea2c0d3b90 0x7fea2c0d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.467+0000 7fea32989640 1 --2- 172.21.15.55:0/619314667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea2c0d0f60 0x7fea2c0b2500 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.467+0000 7fea32989640 1 -- 172.21.15.55:0/619314667 >> 172.21.15.55:0/619314667 conn(0x7fea2c0726c0 msgr2=0x7fea2c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.467+0000 7fea32989640 1 -- 172.21.15.55:0/619314667 shutdown_connections 2024-04-25T09:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.467+0000 7fea32989640 1 -- 172.21.15.55:0/619314667 wait complete. 2024-04-25T09:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.468+0000 7fea32989640 1 Processor -- start 2024-04-25T09:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.468+0000 7fea32989640 1 -- start start 2024-04-25T09:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea32989640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea2c0d0f60 0x7fea2c152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea32989640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea2c0d3b90 0x7fea2c155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea32989640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea2c15dca0 0x7fea2c155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea32989640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c0cf050 con 0x7fea2c0d3b90 2024-04-25T09:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea32989640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c0b6d50 con 0x7fea2c15dca0 2024-04-25T09:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea32989640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c15e080 con 0x7fea2c0d0f60 2024-04-25T09:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea2b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea2c0d3b90 0x7fea2c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea2b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea2c0d3b90 0x7fea2c155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45842/0 (socket says 172.21.15.55:45842) 2024-04-25T09:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea2b7fe640 1 -- 172.21.15.55:0/3074170930 learned_addr learned my addr 172.21.15.55:0/3074170930 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea2bfff640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea2c0d0f60 0x7fea2c152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea30f26640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea2c15dca0 0x7fea2c155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea2b7fe640 1 -- 172.21.15.55:0/3074170930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea2c0d0f60 msgr2=0x7fea2c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea2b7fe640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea2c0d0f60 0x7fea2c152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea2b7fe640 1 -- 172.21.15.55:0/3074170930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea2c15dca0 msgr2=0x7fea2c155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea2b7fe640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea2c15dca0 0x7fea2c155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea2b7fe640 1 -- 172.21.15.55:0/3074170930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c154750 con 0x7fea2c0d3b90 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea2bfff640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea2c0d0f60 0x7fea2c152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea30f26640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea2c15dca0 0x7fea2c155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea2b7fe640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea2c0d3b90 0x7fea2c155000 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fea1400d800 tx=0x7fea1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea28ff9640 1 -- 172.21.15.55:0/3074170930 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400b6c0 con 0x7fea2c0d3b90 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea28ff9640 1 -- 172.21.15.55:0/3074170930 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14019070 con 0x7fea2c0d3b90 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.469+0000 7fea32989640 1 -- 172.21.15.55:0/3074170930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2c154a30 con 0x7fea2c0d3b90 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.470+0000 7fea28ff9640 1 -- 172.21.15.55:0/3074170930 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400ba80 con 0x7fea2c0d3b90 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.470+0000 7fea32989640 1 -- 172.21.15.55:0/3074170930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2c0cac00 con 0x7fea2c0d3b90 2024-04-25T09:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.471+0000 7fea32989640 1 -- 172.21.15.55:0/3074170930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2c0750b0 con 0x7fea2c0d3b90 2024-04-25T09:04:11.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.471+0000 7fea28ff9640 1 -- 172.21.15.55:0/3074170930 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fea1400bc20 con 0x7fea2c0d3b90 2024-04-25T09:04:11.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.471+0000 7fea28ff9640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea0c06b4d0 0x7fea0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.472+0000 7fea28ff9640 1 -- 172.21.15.55:0/3074170930 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fea1408a780 con 0x7fea2c0d3b90 2024-04-25T09:04:11.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.472+0000 7fea2bfff640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea0c06b4d0 0x7fea0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.472+0000 7fea2bfff640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea0c06b4d0 0x7fea0c06d990 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fea1c000f60 tx=0x7fea1c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.476+0000 7fea28ff9640 1 -- 172.21.15.55:0/3074170930 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fea14059510 con 0x7fea2c0d3b90 2024-04-25T09:04:11.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:11.693+0000 7fea32989640 1 -- 172.21.15.55:0/3074170930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fea2c0b51e0 con 0x7fea2c0d3b90 2024-04-25T09:04:12.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.332+0000 7fea28ff9640 1 -- 172.21.15.55:0/3074170930 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v101) v1 ==== 104+0+0 (secure 0 0 0) 0x7fea14058e10 con 0x7fea2c0d3b90 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 -- 172.21.15.55:0/3074170930 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea0c06b4d0 msgr2=0x7fea0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea0c06b4d0 0x7fea0c06d990 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fea1c000f60 tx=0x7fea1c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 -- 172.21.15.55:0/3074170930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea2c0d3b90 msgr2=0x7fea2c155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea2c0d3b90 0x7fea2c155000 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fea1400d800 tx=0x7fea1400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 -- 172.21.15.55:0/3074170930 shutdown_connections 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fea0c06b4d0 0x7fea0c06d990 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea2c15dca0 0x7fea2c155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea2c0d3b90 0x7fea2c155000 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 --2- 172.21.15.55:0/3074170930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea2c0d0f60 0x7fea2c152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 -- 172.21.15.55:0/3074170930 >> 172.21.15.55:0/3074170930 conn(0x7fea2c0726c0 msgr2=0x7fea2c0cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 -- 172.21.15.55:0/3074170930 shutdown_connections 2024-04-25T09:04:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.335+0000 7fea32989640 1 -- 172.21.15.55:0/3074170930 wait complete. 2024-04-25T09:04:12.337 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:04:12.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.459+0000 7f613d9d5640 1 Processor -- start 2024-04-25T09:04:12.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.459+0000 7f613d9d5640 1 -- start start 2024-04-25T09:04:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f613d9d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61380b9720 0x7f61380ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f613d9d5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61380cece0 0x7f61380d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f613d9d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6138161f80 con 0x7f6138161090 2024-04-25T09:04:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f613d9d5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61380cf130 con 0x7f61380cece0 2024-04-25T09:04:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f613d9d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61380d21a0 con 0x7f61380b9720 2024-04-25T09:04:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f6136ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6138161090 0x7f6138161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54664/0 (socket says 172.21.15.55:54664) 2024-04-25T09:04:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f6136ffd640 1 -- 172.21.15.55:0/1062700492 learned_addr learned my addr 172.21.15.55:0/1062700492 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997806647 0 0) 0x7f6138161f80 con 0x7f6138161090 2024-04-25T09:04:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6124003520 con 0x7f6138161090 2024-04-25T09:04:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61377fe640 1 --2- 172.21.15.55:0/1062700492 >> v2:172.21.15.167:3300/0 conn(0x7f61380cece0 0x7f61380d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f612e7fc640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61380b9720 0x7f61380ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2346382496 0 0) 0x7f6124003520 con 0x7f6138161090 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61380b9720 msgr2=0x7f61380ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61380b9720 0x7f61380ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 >> v2:172.21.15.167:3300/0 conn(0x7f61380cece0 msgr2=0x7f61380d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 --2- 172.21.15.55:0/1062700492 >> v2:172.21.15.167:3300/0 conn(0x7f61380cece0 0x7f61380d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138162260 con 0x7f6138161090 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7f6128001670 con 0x7f6138161090 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 >> v1:172.21.15.55:6789/0 conn(0x7f6138161090 legacy=0x7f6138161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 0x7f6124003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124004800 0x7f6124004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.460+0000 7f61367fc640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61380b9720 0x7f61240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61380cf130 con 0x7f61240039b0 2024-04-25T09:04:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61380d21a0 con 0x7f6124004800 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612400b9c0 con 0x7f61380b9720 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f6136ffd640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 0x7f6124003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f612e7fc640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124004800 0x7f6124004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f61377fe640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61380b9720 0x7f61240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f6136ffd640 1 -- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61380b9720 msgr2=0x7f61240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f6136ffd640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61380b9720 0x7f61240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f6136ffd640 1 -- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124004800 msgr2=0x7f6124004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f6136ffd640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124004800 0x7f6124004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f6136ffd640 1 -- 172.21.15.55:0/1062700492 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6124003520 con 0x7f61240039b0 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.461+0000 7f61377fe640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61380b9720 0x7f61240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.462+0000 7f6136ffd640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 0x7f6124003dd0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f612800c290 tx=0x7f6124005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375ca56ae96e4e04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.462+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128007d50 con 0x7f61240039b0 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.462+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6128005af0 con 0x7f61240039b0 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.462+0000 7f61367fc640 1 -- 172.21.15.55:0/1062700492 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128007070 con 0x7f61240039b0 2024-04-25T09:04:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.462+0000 7f613d9d5640 1 -- 172.21.15.55:0/1062700492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 msgr2=0x7f6124003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.462+0000 7f613d9d5640 1 --2- 172.21.15.55:0/1062700492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 0x7f6124003dd0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f612800c290 tx=0x7f6124005830 comp rx=0 tx=0).stop 2024-04-25T09:04:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.462+0000 7f61377fe640 1 -- 172.21.15.55:0/1062700492 reap_dead start 2024-04-25T09:04:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.462+0000 7f613d9d5640 1 -- 172.21.15.55:0/1062700492 shutdown_connections 2024-04-25T09:04:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.462+0000 7f613d9d5640 1 -- 172.21.15.55:0/1062700492 >> 172.21.15.55:0/1062700492 conn(0x7f61380b55e0 msgr2=0x7f61380b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.462+0000 7f613d9d5640 1 -- 172.21.15.55:0/1062700492 shutdown_connections 2024-04-25T09:04:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.462+0000 7f613d9d5640 1 -- 172.21.15.55:0/1062700492 wait complete. 2024-04-25T09:04:12.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.464+0000 7f613d9d5640 1 Processor -- start 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.464+0000 7f613d9d5640 1 -- start start 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.464+0000 7f613d9d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 0x7f61380cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.464+0000 7f613d9d5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61381f7070 0x7f61380b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f613d9d5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6138150910 0x7f6138150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f613d9d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6138161470 con 0x7f61240039b0 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f613d9d5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61380d1e30 con 0x7f6138150910 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f613d9d5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61380ce7a0 con 0x7f61381f7070 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6136ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 0x7f61380cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6136ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 0x7f61380cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45870/0 (socket says 172.21.15.55:45870) 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6136ffd640 1 -- 172.21.15.55:0/307669321 learned_addr learned my addr 172.21.15.55:0/307669321 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f61377fe640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6138150910 0x7f6138150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f612e7fc640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61381f7070 0x7f61380b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6136ffd640 1 -- 172.21.15.55:0/307669321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61381f7070 msgr2=0x7f61380b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6136ffd640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61381f7070 0x7f61380b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6136ffd640 1 -- 172.21.15.55:0/307669321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6138150910 msgr2=0x7f6138150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6136ffd640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6138150910 0x7f6138150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6136ffd640 1 -- 172.21.15.55:0/307669321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61381f77e0 con 0x7f61240039b0 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f61377fe640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6138150910 0x7f6138150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6136ffd640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 0x7f61380cde00 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f6128001970 tx=0x7f61380d1b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6134ff9640 1 -- 172.21.15.55:0/307669321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128042070 con 0x7f61240039b0 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6134ff9640 1 -- 172.21.15.55:0/307669321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6128007480 con 0x7f61240039b0 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f6134ff9640 1 -- 172.21.15.55:0/307669321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128001c80 con 0x7f61240039b0 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.465+0000 7f613d9d5640 1 -- 172.21.15.55:0/307669321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61381f7ac0 con 0x7f61240039b0 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.466+0000 7f613d9d5640 1 -- 172.21.15.55:0/307669321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613815d090 con 0x7f61240039b0 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.466+0000 7f613d9d5640 1 -- 172.21.15.55:0/307669321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61380750b0 con 0x7f61240039b0 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.467+0000 7f6134ff9640 1 -- 172.21.15.55:0/307669321 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6128045070 con 0x7f61240039b0 2024-04-25T09:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.467+0000 7f6134ff9640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f611806b4d0 0x7f611806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.467+0000 7f6134ff9640 1 -- 172.21.15.55:0/307669321 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f61280aafb0 con 0x7f61240039b0 2024-04-25T09:04:12.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.467+0000 7f612e7fc640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f611806b4d0 0x7f611806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.468+0000 7f612e7fc640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f611806b4d0 0x7f611806d990 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f61380b4af0 tx=0x7f6120008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.471+0000 7f6134ff9640 1 -- 172.21.15.55:0/307669321 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6128005ac0 con 0x7f61240039b0 2024-04-25T09:04:12.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:12.651+0000 7f613d9d5640 1 -- 172.21.15.55:0/307669321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f61380d1700 con 0x7f61240039b0 2024-04-25T09:04:13.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.337+0000 7f6134ff9640 1 -- 172.21.15.55:0/307669321 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v119) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6128079650 con 0x7f61240039b0 2024-04-25T09:04:13.326 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:04:13.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 -- 172.21.15.55:0/307669321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f611806b4d0 msgr2=0x7f611806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f611806b4d0 0x7f611806d990 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f61380b4af0 tx=0x7f6120008040 comp rx=0 tx=0).stop 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 -- 172.21.15.55:0/307669321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 msgr2=0x7f61380cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 0x7f61380cde00 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f6128001970 tx=0x7f61380d1b50 comp rx=0 tx=0).stop 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 -- 172.21.15.55:0/307669321 shutdown_connections 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f611806b4d0 0x7f611806d990 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6138150910 0x7f6138150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61381f7070 0x7f61380b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 --2- 172.21.15.55:0/307669321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61240039b0 0x7f61380cde00 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 -- 172.21.15.55:0/307669321 >> 172.21.15.55:0/307669321 conn(0x7f61380b55e0 msgr2=0x7f61380b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 -- 172.21.15.55:0/307669321 shutdown_connections 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.340+0000 7f613d9d5640 1 -- 172.21.15.55:0/307669321 wait complete. 2024-04-25T09:04:13.344 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:04:13.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.467+0000 7fc18203f640 1 Processor -- start 2024-04-25T09:04:13.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.467+0000 7fc18203f640 1 -- start start 2024-04-25T09:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.468+0000 7fc18203f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c1610b0 0x7fc17c0b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.468+0000 7fc18203f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc17c0cef40 0x7fc17c0d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.468+0000 7fc18203f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c162040 con 0x7fc17c1618d0 2024-04-25T09:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.468+0000 7fc18203f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c0d1ea0 con 0x7fc17c0cef40 2024-04-25T09:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.468+0000 7fc18203f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c162320 con 0x7fc17c1610b0 2024-04-25T09:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.468+0000 7fc17affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc17c1618d0 0x7fc17c0ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54666/0 (socket says 172.21.15.55:54666) 2024-04-25T09:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.468+0000 7fc17affd640 1 -- 172.21.15.55:0/974976385 learned_addr learned my addr 172.21.15.55:0/974976385 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.468+0000 7fc17b7fe640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c1610b0 0x7fc17c0b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.468+0000 7fc17bfff640 1 --2- 172.21.15.55:0/974976385 >> v2:172.21.15.167:3300/0 conn(0x7fc17c0cef40 0x7fc17c0d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.468+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359943447 0 0) 0x7fc17c162040 con 0x7fc17c1618d0 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc164003520 con 0x7fc17c1618d0 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2995762984 0 0) 0x7fc164003520 con 0x7fc17c1618d0 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c1610b0 msgr2=0x7fc17c0b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c1610b0 0x7fc17c0b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 >> v2:172.21.15.167:3300/0 conn(0x7fc17c0cef40 msgr2=0x7fc17c0d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 --2- 172.21.15.55:0/974976385 >> v2:172.21.15.167:3300/0 conn(0x7fc17c0cef40 0x7fc17c0d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c162600 con 0x7fc17c1618d0 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc170001690 con 0x7fc17c1618d0 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 >> v1:172.21.15.55:6789/0 conn(0x7fc17c1618d0 legacy=0x7fc17c0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1640039b0 0x7fc164003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c1610b0 0x7fc164004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc164004d40 0x7fc1640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0d1ea0 con 0x7fc1640039b0 2024-04-25T09:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c162320 con 0x7fc164004d40 2024-04-25T09:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1640141d0 con 0x7fc17c1610b0 2024-04-25T09:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17bfff640 1 --2- 172.21.15.55:0/974976385 >> v2:172.21.15.167:3300/0 conn(0x7fc17c0cef40 0x7fc17c0d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17b7fe640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1640039b0 0x7fc164003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17affd640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c1610b0 0x7fc164004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17bfff640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc164004d40 0x7fc1640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17b7fe640 1 -- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c1610b0 msgr2=0x7fc164004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17b7fe640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c1610b0 0x7fc164004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17b7fe640 1 -- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc164004d40 msgr2=0x7fc1640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17b7fe640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc164004d40 0x7fc1640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17b7fe640 1 -- 172.21.15.55:0/974976385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc164003520 con 0x7fc1640039b0 2024-04-25T09:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.469+0000 7fc17bfff640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc164004d40 0x7fc1640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:13.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.470+0000 7fc17b7fe640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1640039b0 0x7fc164003dd0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009ac0 tx=0x7fc164005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b2f75d9050b069 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.470+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c036070 con 0x7fc1640039b0 2024-04-25T09:04:13.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.470+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c031400 con 0x7fc1640039b0 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.470+0000 7fc17a7fc640 1 -- 172.21.15.55:0/974976385 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c009690 con 0x7fc1640039b0 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.471+0000 7fc18203f640 1 -- 172.21.15.55:0/974976385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1640039b0 msgr2=0x7fc164003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.471+0000 7fc18203f640 1 --2- 172.21.15.55:0/974976385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1640039b0 0x7fc164003dd0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009ac0 tx=0x7fc164005830 comp rx=0 tx=0).stop 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.471+0000 7fc17bfff640 1 -- 172.21.15.55:0/974976385 reap_dead start 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.471+0000 7fc18203f640 1 -- 172.21.15.55:0/974976385 shutdown_connections 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.471+0000 7fc18203f640 1 -- 172.21.15.55:0/974976385 >> 172.21.15.55:0/974976385 conn(0x7fc17c0b5570 msgr2=0x7fc17c0b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.471+0000 7fc18203f640 1 -- 172.21.15.55:0/974976385 shutdown_connections 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.471+0000 7fc18203f640 1 -- 172.21.15.55:0/974976385 wait complete. 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.472+0000 7fc18203f640 1 Processor -- start 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.472+0000 7fc18203f640 1 -- start start 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc18203f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1640039b0 0x7fc17c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc18203f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc17c0c9700 0x7fc17c1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc18203f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c0cc9e0 0x7fc17c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc18203f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c161d10 con 0x7fc17c0c9700 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc18203f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0b6c00 con 0x7fc1640039b0 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc18203f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c161490 con 0x7fc17c0cc9e0 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc17affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc17c0c9700 0x7fc17c1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc17affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc17c0c9700 0x7fc17c1542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45900/0 (socket says 172.21.15.55:45900) 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc17affd640 1 -- 172.21.15.55:0/19892404 learned_addr learned my addr 172.21.15.55:0/19892404 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc17b7fe640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1640039b0 0x7fc17c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc17bfff640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c0cc9e0 0x7fc17c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc17affd640 1 -- 172.21.15.55:0/19892404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c0cc9e0 msgr2=0x7fc17c156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc17affd640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c0cc9e0 0x7fc17c156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc17affd640 1 -- 172.21.15.55:0/19892404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1640039b0 msgr2=0x7fc17c151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc17affd640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1640039b0 0x7fc17c151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc17affd640 1 -- 172.21.15.55:0/19892404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c0cbc90 con 0x7fc17c0c9700 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.473+0000 7fc17b7fe640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1640039b0 0x7fc17c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.474+0000 7fc17affd640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc17c0c9700 0x7fc17c1542a0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fc170007370 tx=0x7fc170007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.474+0000 7fc163fff640 1 -- 172.21.15.55:0/19892404 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17000f960 con 0x7fc17c0c9700 2024-04-25T09:04:13.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.474+0000 7fc163fff640 1 -- 172.21.15.55:0/19892404 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc170018070 con 0x7fc17c0c9700 2024-04-25T09:04:13.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.474+0000 7fc163fff640 1 -- 172.21.15.55:0/19892404 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17000fd40 con 0x7fc17c0c9700 2024-04-25T09:04:13.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.474+0000 7fc18203f640 1 -- 172.21.15.55:0/19892404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c1547e0 con 0x7fc17c0c9700 2024-04-25T09:04:13.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.474+0000 7fc18203f640 1 -- 172.21.15.55:0/19892404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c0cc1e0 con 0x7fc17c0c9700 2024-04-25T09:04:13.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.475+0000 7fc18203f640 1 -- 172.21.15.55:0/19892404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c0750b0 con 0x7fc17c0c9700 2024-04-25T09:04:13.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.475+0000 7fc163fff640 1 -- 172.21.15.55:0/19892404 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc17001d460 con 0x7fc17c0c9700 2024-04-25T09:04:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.476+0000 7fc163fff640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc16806b4d0 0x7fc16806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.476+0000 7fc163fff640 1 -- 172.21.15.55:0/19892404 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5529+0+0 (secure 0 0 0) 0x7fc17008a170 con 0x7fc17c0c9700 2024-04-25T09:04:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.476+0000 7fc17b7fe640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc16806b4d0 0x7fc16806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.476+0000 7fc17b7fe640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc16806b4d0 0x7fc16806d990 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc16c033000 tx=0x7fc16c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.480+0000 7fc163fff640 1 -- 172.21.15.55:0/19892404 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc1700591f0 con 0x7fc17c0c9700 2024-04-25T09:04:13.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:13.666+0000 7fc18203f640 1 -- 172.21.15.55:0/19892404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc17c0cf740 con 0x7fc17c0c9700 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.339+0000 7fc163fff640 1 -- 172.21.15.55:0/19892404 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v120) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc170058af0 con 0x7fc17c0c9700 2024-04-25T09:04:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-25T09:04:14.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.341+0000 7fc18203f640 1 -- 172.21.15.55:0/19892404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc16806b4d0 msgr2=0x7fc16806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.341+0000 7fc18203f640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc16806b4d0 0x7fc16806d990 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc16c033000 tx=0x7fc16c008030 comp rx=0 tx=0).stop 2024-04-25T09:04:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.341+0000 7fc18203f640 1 -- 172.21.15.55:0/19892404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc17c0c9700 msgr2=0x7fc17c1542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.341+0000 7fc18203f640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc17c0c9700 0x7fc17c1542a0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fc170007370 tx=0x7fc170007830 comp rx=0 tx=0).stop 2024-04-25T09:04:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.341+0000 7fc18203f640 1 -- 172.21.15.55:0/19892404 shutdown_connections 2024-04-25T09:04:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.341+0000 7fc18203f640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc16806b4d0 0x7fc16806d990 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.341+0000 7fc18203f640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c0cc9e0 0x7fc17c156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.341+0000 7fc18203f640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc17c0c9700 0x7fc17c1542a0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.341+0000 7fc18203f640 1 --2- 172.21.15.55:0/19892404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1640039b0 0x7fc17c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.341+0000 7fc18203f640 1 -- 172.21.15.55:0/19892404 >> 172.21.15.55:0/19892404 conn(0x7fc17c0b5570 msgr2=0x7fc17c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.341+0000 7fc18203f640 1 -- 172.21.15.55:0/19892404 shutdown_connections 2024-04-25T09:04:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.342+0000 7fc18203f640 1 -- 172.21.15.55:0/19892404 wait complete. 2024-04-25T09:04:14.348 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:04:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.467+0000 7fa37c370640 1 Processor -- start 2024-04-25T09:04:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.467+0000 7fa37c370640 1 -- start start 2024-04-25T09:04:14.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37c370640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3740cfe70 0x7fa3740ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37c370640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa37415e110 0x7fa37415e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37c370640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37415f000 con 0x7fa37415b7b0 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37c370640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3740ced00 con 0x7fa3740cfe70 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37c370640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3740ce330 con 0x7fa37415e110 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37990b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3740cfe70 0x7fa3740ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37990b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3740cfe70 0x7fa3740ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45904/0 (socket says 172.21.15.55:45904) 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37990b640 1 -- 172.21.15.55:0/3740383351 learned_addr learned my addr 172.21.15.55:0/3740383351 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37a90d640 1 --2- 172.21.15.55:0/3740383351 >> v2:172.21.15.167:3300/0 conn(0x7fa37415e110 0x7fa37415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37990b640 1 -- 172.21.15.55:0/3740383351 >> v2:172.21.15.167:3300/0 conn(0x7fa37415e110 msgr2=0x7fa37415e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37990b640 1 --2- 172.21.15.55:0/3740383351 >> v2:172.21.15.167:3300/0 conn(0x7fa37415e110 0x7fa37415e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37990b640 1 -- 172.21.15.55:0/3740383351 >> v1:172.21.15.167:6789/0 conn(0x7fa37415b7b0 legacy=0x7fa3740cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.468+0000 7fa37990b640 1 -- 172.21.15.55:0/3740383351 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37415ea60 con 0x7fa3740cfe70 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.469+0000 7fa37990b640 1 --2- 172.21.15.55:0/3740383351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3740cfe70 0x7fa3740ce7c0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fa374161670 tx=0x7fa36802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d1406dee775d60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.469+0000 7fa37910a640 1 -- 172.21.15.55:0/3740383351 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368037070 con 0x7fa3740cfe70 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.469+0000 7fa37910a640 1 -- 172.21.15.55:0/3740383351 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa368032440 con 0x7fa3740cfe70 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.469+0000 7fa37910a640 1 -- 172.21.15.55:0/3740383351 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368032810 con 0x7fa3740cfe70 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.470+0000 7fa37c370640 1 -- 172.21.15.55:0/3740383351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3740cfe70 msgr2=0x7fa3740ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.470+0000 7fa37c370640 1 --2- 172.21.15.55:0/3740383351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3740cfe70 0x7fa3740ce7c0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fa374161670 tx=0x7fa36802a230 comp rx=0 tx=0).stop 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.470+0000 7fa37c370640 1 -- 172.21.15.55:0/3740383351 shutdown_connections 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.470+0000 7fa37c370640 1 --2- 172.21.15.55:0/3740383351 >> v2:172.21.15.167:3300/0 conn(0x7fa37415e110 0x7fa37415e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.470+0000 7fa37c370640 1 --2- 172.21.15.55:0/3740383351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3740cfe70 0x7fa3740ce7c0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.470+0000 7fa37c370640 1 -- 172.21.15.55:0/3740383351 >> 172.21.15.55:0/3740383351 conn(0x7fa37406f4a0 msgr2=0x7fa37406f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.470+0000 7fa37c370640 1 -- 172.21.15.55:0/3740383351 shutdown_connections 2024-04-25T09:04:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.470+0000 7fa37c370640 1 -- 172.21.15.55:0/3740383351 wait complete. 2024-04-25T09:04:14.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.471+0000 7fa37c370640 1 Processor -- start 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.471+0000 7fa37c370640 1 -- start start 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37c370640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3740cfe70 0x7fa3741534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37c370640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa37415b7b0 0x7fa3740b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37c370640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa37415e110 0x7fa3741587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37c370640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740cdfc0 con 0x7fa3740cfe70 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37c370640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740cdce0 con 0x7fa37415e110 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37c370640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3741619f0 con 0x7fa37415b7b0 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37a10c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3740cfe70 0x7fa3741534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37a10c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3740cfe70 0x7fa3741534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45910/0 (socket says 172.21.15.55:45910) 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37a10c640 1 -- 172.21.15.55:0/2685355900 learned_addr learned my addr 172.21.15.55:0/2685355900 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37990b640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa37415b7b0 0x7fa3740b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37a90d640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa37415e110 0x7fa3741587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37a10c640 1 -- 172.21.15.55:0/2685355900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa37415b7b0 msgr2=0x7fa3740b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37a10c640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa37415b7b0 0x7fa3740b6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37a10c640 1 -- 172.21.15.55:0/2685355900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa37415e110 msgr2=0x7fa3741587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37a10c640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa37415e110 0x7fa3741587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.472+0000 7fa37a10c640 1 -- 172.21.15.55:0/2685355900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740b1580 con 0x7fa3740cfe70 2024-04-25T09:04:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.473+0000 7fa37a10c640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3740cfe70 0x7fa3741534c0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c7d0 tx=0x7fa36400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.473+0000 7fa372ffd640 1 -- 172.21.15.55:0/2685355900 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364017070 con 0x7fa3740cfe70 2024-04-25T09:04:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.473+0000 7fa372ffd640 1 -- 172.21.15.55:0/2685355900 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa364003da0 con 0x7fa3740cfe70 2024-04-25T09:04:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.473+0000 7fa37c370640 1 -- 172.21.15.55:0/2685355900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3740b1860 con 0x7fa3740cfe70 2024-04-25T09:04:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.473+0000 7fa372ffd640 1 -- 172.21.15.55:0/2685355900 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3640052b0 con 0x7fa3740cfe70 2024-04-25T09:04:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.473+0000 7fa37c370640 1 -- 172.21.15.55:0/2685355900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3740b1e20 con 0x7fa3740cfe70 2024-04-25T09:04:14.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.474+0000 7fa37c370640 1 -- 172.21.15.55:0/2685355900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3740750b0 con 0x7fa3740cfe70 2024-04-25T09:04:14.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.474+0000 7fa372ffd640 1 -- 172.21.15.55:0/2685355900 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa36401a070 con 0x7fa3740cfe70 2024-04-25T09:04:14.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.475+0000 7fa372ffd640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa36006b4d0 0x7fa36006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.475+0000 7fa37990b640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa36006b4d0 0x7fa36006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.475+0000 7fa372ffd640 1 -- 172.21.15.55:0/2685355900 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fa364089640 con 0x7fa3740cfe70 2024-04-25T09:04:14.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.475+0000 7fa37990b640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa36006b4d0 0x7fa36006d990 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa368034000 tx=0x7fa36802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.479+0000 7fa372ffd640 1 -- 172.21.15.55:0/2685355900 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa3640580c0 con 0x7fa3740cfe70 2024-04-25T09:04:14.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.662+0000 7fa37c370640 1 -- 172.21.15.55:0/2685355900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa3740b7870 con 0x7fa3740cfe70 2024-04-25T09:04:14.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.665+0000 7fa372ffd640 1 -- 172.21.15.55:0/2685355900 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa36405c160 con 0x7fa3740cfe70 2024-04-25T09:04:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.667+0000 7fa37c370640 1 -- 172.21.15.55:0/2685355900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa36006b4d0 msgr2=0x7fa36006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.667+0000 7fa37c370640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa36006b4d0 0x7fa36006d990 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa368034000 tx=0x7fa36802e000 comp rx=0 tx=0).stop 2024-04-25T09:04:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.667+0000 7fa37c370640 1 -- 172.21.15.55:0/2685355900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3740cfe70 msgr2=0x7fa3741534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.667+0000 7fa37c370640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3740cfe70 0x7fa3741534c0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c7d0 tx=0x7fa36400cc90 comp rx=0 tx=0).stop 2024-04-25T09:04:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.668+0000 7fa37c370640 1 -- 172.21.15.55:0/2685355900 shutdown_connections 2024-04-25T09:04:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.668+0000 7fa37c370640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa36006b4d0 0x7fa36006d990 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.668+0000 7fa37c370640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa37415e110 0x7fa3741587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.668+0000 7fa37c370640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa37415b7b0 0x7fa3740b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.668+0000 7fa37c370640 1 --2- 172.21.15.55:0/2685355900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3740cfe70 0x7fa3741534c0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.668+0000 7fa37c370640 1 -- 172.21.15.55:0/2685355900 >> 172.21.15.55:0/2685355900 conn(0x7fa37406f4a0 msgr2=0x7fa37406d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.668+0000 7fa37c370640 1 -- 172.21.15.55:0/2685355900 shutdown_connections 2024-04-25T09:04:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.668+0000 7fa37c370640 1 -- 172.21.15.55:0/2685355900 wait complete. 2024-04-25T09:04:14.669 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T09:04:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.782+0000 7fba80b89640 1 Processor -- start 2024-04-25T09:04:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.783+0000 7fba80b89640 1 -- start start 2024-04-25T09:04:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.783+0000 7fba80b89640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba7c0b5b60 0x7fba7c1687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.783+0000 7fba80b89640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c15e0c0 con 0x7fba7c15dce0 2024-04-25T09:04:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.783+0000 7fba80b89640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c0d2510 con 0x7fba7c0d35b0 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.783+0000 7fba80b89640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c0b7b10 con 0x7fba7c0b5b60 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.783+0000 7fba7a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fba7c15dce0 0x7fba7c0d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54676/0 (socket says 172.21.15.55:54676) 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.783+0000 7fba7a59c640 1 -- 172.21.15.55:0/2364929391 learned_addr learned my addr 172.21.15.55:0/2364929391 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704864352 0 0) 0x7fba7c15e0c0 con 0x7fba7c15dce0 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba68003520 con 0x7fba7c15dce0 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba7ad9d640 1 --2- 172.21.15.55:0/2364929391 >> v2:172.21.15.167:3300/0 conn(0x7fba7c0b5b60 0x7fba7c1687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1333305351 0 0) 0x7fba68003520 con 0x7fba7c15dce0 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 >> v2:172.21.15.167:3300/0 conn(0x7fba7c0b5b60 msgr2=0x7fba7c1687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 --2- 172.21.15.55:0/2364929391 >> v2:172.21.15.167:3300/0 conn(0x7fba7c0b5b60 0x7fba7c1687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 >> v1:172.21.15.167:6789/0 conn(0x7fba7c0d35b0 legacy=0x7fba7c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0d27f0 con 0x7fba7c15dce0 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba7ad9d640 1 --2- 172.21.15.55:0/2364929391 >> v2:172.21.15.167:3300/0 conn(0x7fba7c0b5b60 0x7fba7c1687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fba6c001670 con 0x7fba7c15dce0 2024-04-25T09:04:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 >> v1:172.21.15.55:6789/0 conn(0x7fba7c15dce0 legacy=0x7fba7c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 --2- 172.21.15.55:0/2364929391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba68003a00 0x7fba68003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 --2- 172.21.15.55:0/2364929391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba68004800 0x7fba68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 --2- 172.21.15.55:0/2364929391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba68005210 0x7fba6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0b7b10 con 0x7fba68005210 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6800c160 con 0x7fba68003a00 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6800c360 con 0x7fba68004800 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba7ad9d640 1 --2- 172.21.15.55:0/2364929391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba68005210 0x7fba6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba7a59c640 1 --2- 172.21.15.55:0/2364929391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba68003a00 0x7fba68003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.784+0000 7fba73fff640 1 --2- 172.21.15.55:0/2364929391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba68004800 0x7fba68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.785+0000 7fba7ad9d640 1 -- 172.21.15.55:0/2364929391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba68004800 msgr2=0x7fba68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.785+0000 7fba7ad9d640 1 --2- 172.21.15.55:0/2364929391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba68004800 0x7fba68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.785+0000 7fba7ad9d640 1 -- 172.21.15.55:0/2364929391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba68003a00 msgr2=0x7fba68003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.785+0000 7fba7ad9d640 1 --2- 172.21.15.55:0/2364929391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba68003a00 0x7fba68003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.785+0000 7fba7ad9d640 1 -- 172.21.15.55:0/2364929391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba68003520 con 0x7fba68005210 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.785+0000 7fba7ad9d640 1 -- 172.21.15.55:0/2364929391 reap_dead start 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.785+0000 7fba7ad9d640 1 --2- 172.21.15.55:0/2364929391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba68005210 0x7fba6800b9c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fba740073e0 tx=0x7fba68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe2c8ca44501995 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.785+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74009c80 con 0x7fba68005210 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.785+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7402c6c0 con 0x7fba68005210 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.785+0000 7fba79d9b640 1 -- 172.21.15.55:0/2364929391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7402cab0 con 0x7fba68005210 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.786+0000 7fba80b89640 1 -- 172.21.15.55:0/2364929391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba68005210 msgr2=0x7fba6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.786+0000 7fba80b89640 1 --2- 172.21.15.55:0/2364929391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba68005210 0x7fba6800b9c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fba740073e0 tx=0x7fba68005830 comp rx=0 tx=0).stop 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.786+0000 7fba80b89640 1 -- 172.21.15.55:0/2364929391 shutdown_connections 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.786+0000 7fba80b89640 1 --2- 172.21.15.55:0/2364929391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba68005210 0x7fba6800b9c0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.786+0000 7fba80b89640 1 -- 172.21.15.55:0/2364929391 >> 172.21.15.55:0/2364929391 conn(0x7fba7c072900 msgr2=0x7fba7c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.786+0000 7fba80b89640 1 -- 172.21.15.55:0/2364929391 shutdown_connections 2024-04-25T09:04:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.786+0000 7fba80b89640 1 -- 172.21.15.55:0/2364929391 wait complete. 2024-04-25T09:04:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.787+0000 7fba80b89640 1 Processor -- start 2024-04-25T09:04:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.787+0000 7fba80b89640 1 -- start start 2024-04-25T09:04:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba80b89640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba68005210 0x7fba7c0cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba80b89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba7c1609c0 0x7fba7c15e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba80b89640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba7c154950 0x7fba7c154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba80b89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0d3090 con 0x7fba7c1609c0 2024-04-25T09:04:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba80b89640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0d2db0 con 0x7fba68005210 2024-04-25T09:04:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba80b89640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0b9820 con 0x7fba7c154950 2024-04-25T09:04:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba73fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba7c1609c0 0x7fba7c15e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba73fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba7c1609c0 0x7fba7c15e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45928/0 (socket says 172.21.15.55:45928) 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba73fff640 1 -- 172.21.15.55:0/259800181 learned_addr learned my addr 172.21.15.55:0/259800181 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba7a59c640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba68005210 0x7fba7c0cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba7ad9d640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba7c154950 0x7fba7c154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba73fff640 1 -- 172.21.15.55:0/259800181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba7c154950 msgr2=0x7fba7c154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba73fff640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba7c154950 0x7fba7c154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba73fff640 1 -- 172.21.15.55:0/259800181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba68005210 msgr2=0x7fba7c0cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba73fff640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba68005210 0x7fba7c0cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.788+0000 7fba73fff640 1 -- 172.21.15.55:0/259800181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c160ef0 con 0x7fba7c1609c0 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.789+0000 7fba7ad9d640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba7c154950 0x7fba7c154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.789+0000 7fba73fff640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba7c1609c0 0x7fba7c15e390 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fba6400f550 tx=0x7fba6400f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.789+0000 7fba72ffd640 1 -- 172.21.15.55:0/259800181 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba640052e0 con 0x7fba7c1609c0 2024-04-25T09:04:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.789+0000 7fba72ffd640 1 -- 172.21.15.55:0/259800181 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba64018070 con 0x7fba7c1609c0 2024-04-25T09:04:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.789+0000 7fba80b89640 1 -- 172.21.15.55:0/259800181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c1611d0 con 0x7fba7c1609c0 2024-04-25T09:04:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.789+0000 7fba72ffd640 1 -- 172.21.15.55:0/259800181 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64003830 con 0x7fba7c1609c0 2024-04-25T09:04:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.789+0000 7fba80b89640 1 -- 172.21.15.55:0/259800181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c154150 con 0x7fba7c1609c0 2024-04-25T09:04:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.790+0000 7fba80b89640 1 -- 172.21.15.55:0/259800181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c0749b0 con 0x7fba7c1609c0 2024-04-25T09:04:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.790+0000 7fba72ffd640 1 -- 172.21.15.55:0/259800181 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fba640039d0 con 0x7fba7c1609c0 2024-04-25T09:04:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.791+0000 7fba72ffd640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba5c06b500 0x7fba5c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.791+0000 7fba72ffd640 1 -- 172.21.15.55:0/259800181 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fba64089770 con 0x7fba7c1609c0 2024-04-25T09:04:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.791+0000 7fba7a59c640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba5c06b500 0x7fba5c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.791+0000 7fba7a59c640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba5c06b500 0x7fba5c06d9c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0b8d70 tx=0x7fba6c000f50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:14.795+0000 7fba72ffd640 1 -- 172.21.15.55:0/259800181 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba64058830 con 0x7fba7c1609c0 2024-04-25T09:04:15.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.051+0000 7fba80b89640 1 -- 172.21.15.55:0/259800181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7fba7c15a500 con 0x7fba7c1609c0 2024-04-25T09:04:15.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.348+0000 7fba72ffd640 1 -- 172.21.15.55:0/259800181 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v498) v1 ==== 144+0+0 (secure 0 0 0) 0x7fba64058130 con 0x7fba7c1609c0 2024-04-25T09:04:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.350+0000 7fba80b89640 1 -- 172.21.15.55:0/259800181 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba5c06b500 msgr2=0x7fba5c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.350+0000 7fba80b89640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba5c06b500 0x7fba5c06d9c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0b8d70 tx=0x7fba6c000f50 comp rx=0 tx=0).stop 2024-04-25T09:04:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.350+0000 7fba80b89640 1 -- 172.21.15.55:0/259800181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba7c1609c0 msgr2=0x7fba7c15e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.350+0000 7fba80b89640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba7c1609c0 0x7fba7c15e390 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fba6400f550 tx=0x7fba6400f950 comp rx=0 tx=0).stop 2024-04-25T09:04:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.350+0000 7fba80b89640 1 -- 172.21.15.55:0/259800181 shutdown_connections 2024-04-25T09:04:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.351+0000 7fba80b89640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fba5c06b500 0x7fba5c06d9c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.351+0000 7fba80b89640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba7c154950 0x7fba7c154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.351+0000 7fba80b89640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba7c1609c0 0x7fba7c15e390 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.351+0000 7fba80b89640 1 --2- 172.21.15.55:0/259800181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba68005210 0x7fba7c0cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.351+0000 7fba80b89640 1 -- 172.21.15.55:0/259800181 >> 172.21.15.55:0/259800181 conn(0x7fba7c072900 msgr2=0x7fba7c0b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.351+0000 7fba80b89640 1 -- 172.21.15.55:0/259800181 shutdown_connections 2024-04-25T09:04:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:15.351+0000 7fba80b89640 1 -- 172.21.15.55:0/259800181 wait complete. 2024-04-25T09:04:15.351 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T09:04:15.351 INFO:tasks.cephfs_test_runner: 2024-04-25T09:04:15.351 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T09:04:15.351 INFO:tasks.cephfs_test_runner:Ran 7 tests in 602.777s 2024-04-25T09:04:15.351 INFO:tasks.cephfs_test_runner: 2024-04-25T09:04:15.351 INFO:tasks.cephfs_test_runner:OK 2024-04-25T09:04:15.352 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T09:04:15.360 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T09:04:15.394 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T09:04:15.395 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:04:15.395 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:15.411 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:04:15.411 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:04:15.411 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:15.467 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056881,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:04:15.467 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:04:15.467 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:15.486 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:15.486 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:04:15.486 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:15.544 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=238 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:15.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.544 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:04:15.560 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:04:15.560 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:04:15.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.560 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:04:15.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.626 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:04:15.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.693 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-25T09:04:15.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.787 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:04:15.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.802 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-25T09:04:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-04-25T09:04:15.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:15.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.871 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T09:04:15.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T09:04:15.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T09:04:15.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T09:04:15.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:04:16.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:16.027 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-04-25T09:04:16.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:16.123 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T09:04:16.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:16.138 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-04-25T09:04:16.206 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2024-04-25T09:04:16.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:16.208 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T09:04:16.217 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:04:16.217 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:16.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.334+0000 7ff259cac640 1 Processor -- start 2024-04-25T09:04:16.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.334+0000 7ff259cac640 1 -- start start 2024-04-25T09:04:16.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff259cac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff25406e8f0 0x7ff25415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff259cac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff25415c820 0x7ff2541654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff259cac640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2540ce6c0 con 0x7ff25415bf00 2024-04-25T09:04:16.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff259cac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2541455e0 con 0x7ff25415c820 2024-04-25T09:04:16.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff259cac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25406d450 con 0x7ff25406e8f0 2024-04-25T09:04:16.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff253fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff25415c820 0x7ff2541654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff253fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff25415c820 0x7ff2541654b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45938/0 (socket says 172.21.15.55:45938) 2024-04-25T09:04:16.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff253fff640 1 -- 172.21.15.55:0/2043673113 learned_addr learned my addr 172.21.15.55:0/2043673113 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:16.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff252ffd640 1 --2- 172.21.15.55:0/2043673113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff25406e8f0 0x7ff25415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff253fff640 1 -- 172.21.15.55:0/2043673113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff25406e8f0 msgr2=0x7ff25415c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff253fff640 1 --2- 172.21.15.55:0/2043673113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff25406e8f0 0x7ff25415c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff253fff640 1 -- 172.21.15.55:0/2043673113 >> v1:172.21.15.167:6789/0 conn(0x7ff25415bf00 legacy=0x7ff2540cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.335+0000 7ff253fff640 1 -- 172.21.15.55:0/2043673113 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2540cc4e0 con 0x7ff25415c820 2024-04-25T09:04:16.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.336+0000 7ff253fff640 1 --2- 172.21.15.55:0/2043673113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff25415c820 0x7ff2541654b0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009e50 tx=0x7ff24c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e852cf2987fc89d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.336+0000 7ff2527fc640 1 -- 172.21.15.55:0/2043673113 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c036070 con 0x7ff25415c820 2024-04-25T09:04:16.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.336+0000 7ff2527fc640 1 -- 172.21.15.55:0/2043673113 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c031600 con 0x7ff25415c820 2024-04-25T09:04:16.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.336+0000 7ff2527fc640 1 -- 172.21.15.55:0/2043673113 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0319d0 con 0x7ff25415c820 2024-04-25T09:04:16.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.337+0000 7ff259cac640 1 -- 172.21.15.55:0/2043673113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff25415c820 msgr2=0x7ff2541654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.337+0000 7ff259cac640 1 --2- 172.21.15.55:0/2043673113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff25415c820 0x7ff2541654b0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009e50 tx=0x7ff24c02a710 comp rx=0 tx=0).stop 2024-04-25T09:04:16.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.337+0000 7ff259cac640 1 -- 172.21.15.55:0/2043673113 shutdown_connections 2024-04-25T09:04:16.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.337+0000 7ff259cac640 1 --2- 172.21.15.55:0/2043673113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff25415c820 0x7ff2541654b0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.337+0000 7ff259cac640 1 --2- 172.21.15.55:0/2043673113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff25406e8f0 0x7ff25415c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.337+0000 7ff259cac640 1 -- 172.21.15.55:0/2043673113 >> 172.21.15.55:0/2043673113 conn(0x7ff25406aba0 msgr2=0x7ff25406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.337+0000 7ff259cac640 1 -- 172.21.15.55:0/2043673113 shutdown_connections 2024-04-25T09:04:16.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.337+0000 7ff259cac640 1 -- 172.21.15.55:0/2043673113 wait complete. 2024-04-25T09:04:16.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.338+0000 7ff259cac640 1 Processor -- start 2024-04-25T09:04:16.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.338+0000 7ff259cac640 1 -- start start 2024-04-25T09:04:16.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff259cac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff25406e8f0 0x7ff25413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff259cac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff25415bf00 0x7ff254140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff259cac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25415c820 0x7ff25413d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff259cac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540ccd70 con 0x7ff25415bf00 2024-04-25T09:04:16.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff259cac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540cca90 con 0x7ff25415c820 2024-04-25T09:04:16.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff259cac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540cd050 con 0x7ff25406e8f0 2024-04-25T09:04:16.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff252ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff25415bf00 0x7ff254140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff252ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff25415bf00 0x7ff254140910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45946/0 (socket says 172.21.15.55:45946) 2024-04-25T09:04:16.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff252ffd640 1 -- 172.21.15.55:0/3694647475 learned_addr learned my addr 172.21.15.55:0/3694647475 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff253fff640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25415c820 0x7ff25413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff2537fe640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff25406e8f0 0x7ff25413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff252ffd640 1 -- 172.21.15.55:0/3694647475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff25406e8f0 msgr2=0x7ff25413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff252ffd640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff25406e8f0 0x7ff25413eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff252ffd640 1 -- 172.21.15.55:0/3694647475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25415c820 msgr2=0x7ff25413d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff252ffd640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25415c820 0x7ff25413d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff252ffd640 1 -- 172.21.15.55:0/3694647475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25413de20 con 0x7ff25415bf00 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff2537fe640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff25406e8f0 0x7ff25413eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.339+0000 7ff252ffd640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff25415bf00 0x7ff254140910 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7ff24800d7d0 tx=0x7ff24800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.340+0000 7ff23bfff640 1 -- 172.21.15.55:0/3694647475 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff248004020 con 0x7ff25415bf00 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.340+0000 7ff23bfff640 1 -- 172.21.15.55:0/3694647475 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2480041e0 con 0x7ff25415bf00 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.340+0000 7ff259cac640 1 -- 172.21.15.55:0/3694647475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25413e100 con 0x7ff25415bf00 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.340+0000 7ff23bfff640 1 -- 172.21.15.55:0/3694647475 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2480043d0 con 0x7ff25415bf00 2024-04-25T09:04:16.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.340+0000 7ff259cac640 1 -- 172.21.15.55:0/3694647475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25413e6c0 con 0x7ff25415bf00 2024-04-25T09:04:16.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.341+0000 7ff259cac640 1 -- 172.21.15.55:0/3694647475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25406bb30 con 0x7ff25415bf00 2024-04-25T09:04:16.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.341+0000 7ff23bfff640 1 -- 172.21.15.55:0/3694647475 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff24801b020 con 0x7ff25415bf00 2024-04-25T09:04:16.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.342+0000 7ff23bfff640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff24006b4d0 0x7ff24006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.342+0000 7ff23bfff640 1 -- 172.21.15.55:0/3694647475 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7ff248089c90 con 0x7ff25415bf00 2024-04-25T09:04:16.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.342+0000 7ff2537fe640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff24006b4d0 0x7ff24006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.342+0000 7ff2537fe640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff24006b4d0 0x7ff24006d990 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff244001700 tx=0x7ff244009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.346+0000 7ff23bfff640 1 -- 172.21.15.55:0/3694647475 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff248058d50 con 0x7ff25415bf00 2024-04-25T09:04:16.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.526+0000 7ff259cac640 1 -- 172.21.15.55:0/3694647475 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2540749b0 con 0x7ff24006b4d0 2024-04-25T09:04:16.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.526+0000 7ff23bfff640 1 -- 172.21.15.55:0/3694647475 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13511 (secure 0 0 0) 0x7ff2540749b0 con 0x7ff24006b4d0 2024-04-25T09:04:16.515 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:16.515 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:04:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 -- 172.21.15.55:0/3694647475 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff24006b4d0 msgr2=0x7ff24006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff24006b4d0 0x7ff24006d990 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff244001700 tx=0x7ff244009040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 -- 172.21.15.55:0/3694647475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff25415bf00 msgr2=0x7ff254140910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff25415bf00 0x7ff254140910 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7ff24800d7d0 tx=0x7ff24800dc90 comp rx=0 tx=0).stop 2024-04-25T09:04:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 -- 172.21.15.55:0/3694647475 shutdown_connections 2024-04-25T09:04:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7ff24006b4d0 0x7ff24006d990 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25415c820 0x7ff25413d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff25415bf00 0x7ff254140910 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 --2- 172.21.15.55:0/3694647475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff25406e8f0 0x7ff25413eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 -- 172.21.15.55:0/3694647475 >> 172.21.15.55:0/3694647475 conn(0x7ff25406aba0 msgr2=0x7ff25415d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 -- 172.21.15.55:0/3694647475 shutdown_connections 2024-04-25T09:04:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.528+0000 7ff259cac640 1 -- 172.21.15.55:0/3694647475 wait complete. 2024-04-25T09:04:16.527 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":437,"stamp":"2024-04-25T09:04:14.697025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":295132,"kb_used_data":29048,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754679588,"statfs":{"total":773094113280,"available":772791898112,"internally_reserved":0,"allocated":29745152,"data_stored":23046710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390399,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-252,"num_read_kb":-260,"num_write":-169,"num_write_kb":-8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001077"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":348,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.342446+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T09:04:13.342446+0000","last_peered":"2024-04-25T09:04:13.342446+0000","last_clean":"2024-04-25T09:04:13.342446+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:04:13.342446+0000","last_undegraded":"2024-04-25T09:04:13.342446+0000","last_fullsized":"2024-04-25T09:04:13.342446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509573,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2072576,"data_stored":1230088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509571,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32628,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1482752,"data_stored":639727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509573,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":634149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509572,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":639715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509572,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36788,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335052,"statfs":{"total":96636764160,"available":96599093248,"internally_reserved":0,"allocated":1478656,"data_stored":639720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509574,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1458176,"data_stored":633540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509572,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45560,"kb_used_data":10220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326280,"statfs":{"total":96636764160,"available":96590110720,"internally_reserved":0,"allocated":10465280,"data_stored":9613752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574980,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44948,"kb_used_data":9612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326892,"statfs":{"total":96636764160,"available":96590737408,"internally_reserved":0,"allocated":9842688,"data_stored":9016019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:16.528 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:16.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.641+0000 7faec773b640 1 Processor -- start 2024-04-25T09:04:16.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.641+0000 7faec773b640 1 -- start start 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.642+0000 7faec773b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faec0144450 0x7faec00c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.642+0000 7faec773b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faec015eaa0 0x7faec015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.642+0000 7faec773b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec00c75c0 con 0x7faec00ccdc0 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.642+0000 7faec773b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec00cdb60 con 0x7faec015eaa0 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.642+0000 7faec773b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec00cd2c0 con 0x7faec0144450 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.642+0000 7faec5cd8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faec015eaa0 0x7faec015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.642+0000 7faec4cd6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faec00ccdc0 0x7faec00722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54692/0 (socket says 172.21.15.55:54692) 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.642+0000 7faec4cd6640 1 -- 172.21.15.55:0/3748840531 learned_addr learned my addr 172.21.15.55:0/3748840531 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.643+0000 7faec54d7640 1 --2- 172.21.15.55:0/3748840531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faec0144450 0x7faec00c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.643+0000 7faec5cd8640 1 -- 172.21.15.55:0/3748840531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faec0144450 msgr2=0x7faec00c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.643+0000 7faec5cd8640 1 --2- 172.21.15.55:0/3748840531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faec0144450 0x7faec00c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.643+0000 7faec5cd8640 1 -- 172.21.15.55:0/3748840531 >> v1:172.21.15.55:6789/0 conn(0x7faec00ccdc0 legacy=0x7faec00722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.643+0000 7faec5cd8640 1 -- 172.21.15.55:0/3748840531 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00cd5a0 con 0x7faec015eaa0 2024-04-25T09:04:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.643+0000 7faeb7fff640 1 -- 172.21.15.55:0/3748840531 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748511372 0 0) 0x7faec00c75c0 con 0x7faec00ccdc0 2024-04-25T09:04:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.643+0000 7faec5cd8640 1 --2- 172.21.15.55:0/3748840531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec015eaa0 0x7faec015ef30 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7faebc009dc0 tx=0x7faebc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65916ef347d21bab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.644+0000 7faeb7fff640 1 -- 172.21.15.55:0/3748840531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc007740 con 0x7faec015eaa0 2024-04-25T09:04:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.644+0000 7faeb7fff640 1 -- 172.21.15.55:0/3748840531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc0078e0 con 0x7faec015eaa0 2024-04-25T09:04:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.644+0000 7faeb7fff640 1 -- 172.21.15.55:0/3748840531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc007cb0 con 0x7faec015eaa0 2024-04-25T09:04:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.644+0000 7faec773b640 1 -- 172.21.15.55:0/3748840531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec015eaa0 msgr2=0x7faec015ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.644+0000 7faec773b640 1 --2- 172.21.15.55:0/3748840531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec015eaa0 0x7faec015ef30 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7faebc009dc0 tx=0x7faebc02a5f0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.644+0000 7faec773b640 1 -- 172.21.15.55:0/3748840531 shutdown_connections 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.644+0000 7faec773b640 1 --2- 172.21.15.55:0/3748840531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec015eaa0 0x7faec015ef30 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.644+0000 7faec773b640 1 --2- 172.21.15.55:0/3748840531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faec0144450 0x7faec00c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.644+0000 7faec773b640 1 -- 172.21.15.55:0/3748840531 >> 172.21.15.55:0/3748840531 conn(0x7faec00b2370 msgr2=0x7faec00b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.644+0000 7faec773b640 1 -- 172.21.15.55:0/3748840531 shutdown_connections 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.644+0000 7faec773b640 1 -- 172.21.15.55:0/3748840531 wait complete. 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.646+0000 7faec773b640 1 Processor -- start 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.646+0000 7faec773b640 1 -- start start 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.646+0000 7faec773b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faec00ccdc0 0x7faec01f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.646+0000 7faec773b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec0144450 0x7faec01eea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.646+0000 7faec773b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec015eaa0 0x7faec00d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.646+0000 7faec773b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec00729b0 con 0x7faec0144450 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.646+0000 7faec773b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec015e580 con 0x7faec015eaa0 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.646+0000 7faec773b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec0072b30 con 0x7faec00ccdc0 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.646+0000 7faec4cd6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec0144450 0x7faec01eea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.646+0000 7faec4cd6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec0144450 0x7faec01eea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45952/0 (socket says 172.21.15.55:45952) 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.646+0000 7faec4cd6640 1 -- 172.21.15.55:0/2661187232 learned_addr learned my addr 172.21.15.55:0/2661187232 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faec5cd8640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec015eaa0 0x7faec00d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faec54d7640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faec00ccdc0 0x7faec01f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faec4cd6640 1 -- 172.21.15.55:0/2661187232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faec00ccdc0 msgr2=0x7faec01f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faec4cd6640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faec00ccdc0 0x7faec01f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faec4cd6640 1 -- 172.21.15.55:0/2661187232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec015eaa0 msgr2=0x7faec00d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faec4cd6640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec015eaa0 0x7faec00d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faec4cd6640 1 -- 172.21.15.55:0/2661187232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec015c420 con 0x7faec0144450 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faec54d7640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faec00ccdc0 0x7faec01f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faec4cd6640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec0144450 0x7faec01eea00 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c4a0 tx=0x7faeb000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faeb5ffb640 1 -- 172.21.15.55:0/2661187232 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0018070 con 0x7faec0144450 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faeb5ffb640 1 -- 172.21.15.55:0/2661187232 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb00074e0 con 0x7faec0144450 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faec773b640 1 -- 172.21.15.55:0/2661187232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec015c700 con 0x7faec0144450 2024-04-25T09:04:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faeb5ffb640 1 -- 172.21.15.55:0/2661187232 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0004a20 con 0x7faec0144450 2024-04-25T09:04:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.647+0000 7faec773b640 1 -- 172.21.15.55:0/2661187232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec015ccc0 con 0x7faec0144450 2024-04-25T09:04:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.648+0000 7faec773b640 1 -- 172.21.15.55:0/2661187232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec00749b0 con 0x7faec0144450 2024-04-25T09:04:16.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.649+0000 7faeb5ffb640 1 -- 172.21.15.55:0/2661187232 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faeb001b070 con 0x7faec0144450 2024-04-25T09:04:16.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.649+0000 7faeb5ffb640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faea406b4d0 0x7faea406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.649+0000 7faeb5ffb640 1 -- 172.21.15.55:0/2661187232 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7faeb0089290 con 0x7faec0144450 2024-04-25T09:04:16.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.649+0000 7faec54d7640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faea406b4d0 0x7faea406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.649+0000 7faec54d7640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faea406b4d0 0x7faea406d990 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7faec0068720 tx=0x7faeb8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.653+0000 7faeb5ffb640 1 -- 172.21.15.55:0/2661187232 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faeb00583f0 con 0x7faec0144450 2024-04-25T09:04:16.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.832+0000 7faec773b640 1 -- 172.21.15.55:0/2661187232 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faec006fb80 con 0x7faea406b4d0 2024-04-25T09:04:16.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.833+0000 7faeb5ffb640 1 -- 172.21.15.55:0/2661187232 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13509 (secure 0 0 0) 0x7faec006fb80 con 0x7faea406b4d0 2024-04-25T09:04:16.821 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:16.822 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:04:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 -- 172.21.15.55:0/2661187232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faea406b4d0 msgr2=0x7faea406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faea406b4d0 0x7faea406d990 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7faec0068720 tx=0x7faeb8008040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 -- 172.21.15.55:0/2661187232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec0144450 msgr2=0x7faec01eea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec0144450 0x7faec01eea00 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c4a0 tx=0x7faeb000c960 comp rx=0 tx=0).stop 2024-04-25T09:04:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 -- 172.21.15.55:0/2661187232 shutdown_connections 2024-04-25T09:04:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7faea406b4d0 0x7faea406d990 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec015eaa0 0x7faec00d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec0144450 0x7faec01eea00 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 --2- 172.21.15.55:0/2661187232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faec00ccdc0 0x7faec01f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 -- 172.21.15.55:0/2661187232 >> 172.21.15.55:0/2661187232 conn(0x7faec00b2370 msgr2=0x7faec00cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 -- 172.21.15.55:0/2661187232 shutdown_connections 2024-04-25T09:04:16.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.835+0000 7faec773b640 1 -- 172.21.15.55:0/2661187232 wait complete. 2024-04-25T09:04:16.834 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":438,"stamp":"2024-04-25T09:04:16.697322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":286980,"kb_used_data":20892,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754687740,"statfs":{"total":773094113280,"available":772800245760,"internally_reserved":0,"allocated":21393408,"data_stored":14676143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-174,"num_write_kb":-8302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001082"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":348,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.342446+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T09:04:13.342446+0000","last_peered":"2024-04-25T09:04:13.342446+0000","last_clean":"2024-04-25T09:04:13.342446+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:04:13.342446+0000","last_undegraded":"2024-04-25T09:04:13.342446+0000","last_fullsized":"2024-04-25T09:04:13.342446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509573,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2072576,"data_stored":1230088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509571,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32628,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1482752,"data_stored":639727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509573,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":634149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509572,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":639715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509572,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36788,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335052,"statfs":{"total":96636764160,"available":96599093248,"internally_reserved":0,"allocated":1478656,"data_stored":639720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509574,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1458176,"data_stored":633540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509572,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45560,"kb_used_data":10220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326280,"statfs":{"total":96636764160,"available":96590110720,"internally_reserved":0,"allocated":10465280,"data_stored":9613752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36796,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:16.835 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:04:16.835 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:16.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.947+0000 7f5b6fbb0640 1 Processor -- start 2024-04-25T09:04:16.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.948+0000 7f5b6fbb0640 1 -- start start 2024-04-25T09:04:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.948+0000 7f5b6fbb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b680d35b0 0x7f5b680b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.948+0000 7f5b6fbb0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5b680b5990 0x7f5b680b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.948+0000 7f5b6fbb0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6815e0c0 con 0x7f5b6815dce0 2024-04-25T09:04:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.948+0000 7f5b6fbb0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b680b5de0 con 0x7f5b680b5990 2024-04-25T09:04:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.948+0000 7f5b6fbb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680d2510 con 0x7f5b680d35b0 2024-04-25T09:04:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.949+0000 7f5b6e14d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5b680b5990 0x7f5b680b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.949+0000 7f5b6d14b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b680d35b0 0x7f5b680b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.949+0000 7f5b6e14d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5b680b5990 0x7f5b680b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:58036/0 (socket says 172.21.15.55:58036) 2024-04-25T09:04:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.949+0000 7f5b6e14d640 1 -- 172.21.15.55:0/3996433136 learned_addr learned my addr 172.21.15.55:0/3996433136 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.949+0000 7f5b6e14d640 1 -- 172.21.15.55:0/3996433136 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b680d35b0 msgr2=0x7f5b680b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.949+0000 7f5b6e14d640 1 --2- 172.21.15.55:0/3996433136 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b680d35b0 0x7f5b680b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.949+0000 7f5b6e14d640 1 -- 172.21.15.55:0/3996433136 >> v1:172.21.15.167:6789/0 conn(0x7f5b6815dce0 legacy=0x7f5b680d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.949+0000 7f5b6c94a640 1 -- 172.21.15.55:0/3996433136 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256051877 0 0) 0x7f5b6815e0c0 con 0x7f5b6815dce0 2024-04-25T09:04:16.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.949+0000 7f5b6e14d640 1 -- 172.21.15.55:0/3996433136 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680d27f0 con 0x7f5b680b5990 2024-04-25T09:04:16.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.950+0000 7f5b6e14d640 1 --2- 172.21.15.55:0/3996433136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b680b5990 0x7f5b680b6b00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009e50 tx=0x7f5b5802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a323e8678850d8f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.950+0000 7f5b6c94a640 1 -- 172.21.15.55:0/3996433136 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58036070 con 0x7f5b680b5990 2024-04-25T09:04:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.950+0000 7f5b6c94a640 1 -- 172.21.15.55:0/3996433136 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58031600 con 0x7f5b680b5990 2024-04-25T09:04:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.950+0000 7f5b6c94a640 1 -- 172.21.15.55:0/3996433136 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b580319d0 con 0x7f5b680b5990 2024-04-25T09:04:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.951+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/3996433136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b680b5990 msgr2=0x7f5b680b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.951+0000 7f5b6fbb0640 1 --2- 172.21.15.55:0/3996433136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b680b5990 0x7f5b680b6b00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009e50 tx=0x7f5b5802a710 comp rx=0 tx=0).stop 2024-04-25T09:04:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.951+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/3996433136 shutdown_connections 2024-04-25T09:04:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.951+0000 7f5b6fbb0640 1 --2- 172.21.15.55:0/3996433136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b680b5990 0x7f5b680b6b00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.951+0000 7f5b6fbb0640 1 --2- 172.21.15.55:0/3996433136 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b680d35b0 0x7f5b680b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.951+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/3996433136 >> 172.21.15.55:0/3996433136 conn(0x7f5b68072900 msgr2=0x7f5b680d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.951+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/3996433136 shutdown_connections 2024-04-25T09:04:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.951+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/3996433136 wait complete. 2024-04-25T09:04:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.952+0000 7f5b6fbb0640 1 Processor -- start 2024-04-25T09:04:16.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.952+0000 7f5b6fbb0640 1 -- start start 2024-04-25T09:04:16.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6fbb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b680b5990 0x7f5b68155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6fbb0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680d35b0 0x7f5b68154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6fbb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b6815dce0 0x7f5b680c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6fbb0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680d3090 con 0x7f5b680d35b0 2024-04-25T09:04:16.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6fbb0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680d2db0 con 0x7f5b6815dce0 2024-04-25T09:04:16.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6fbb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680d2160 con 0x7f5b680b5990 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6d14b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680d35b0 0x7f5b68154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6d14b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680d35b0 0x7f5b68154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45968/0 (socket says 172.21.15.55:45968) 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6d14b640 1 -- 172.21.15.55:0/196217900 learned_addr learned my addr 172.21.15.55:0/196217900 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6e14d640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b6815dce0 0x7f5b680c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6d94c640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b680b5990 0x7f5b68155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6d14b640 1 -- 172.21.15.55:0/196217900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b680b5990 msgr2=0x7f5b68155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6d14b640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b680b5990 0x7f5b68155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6d14b640 1 -- 172.21.15.55:0/196217900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b6815dce0 msgr2=0x7f5b680c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6d14b640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b6815dce0 0x7f5b680c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6d14b640 1 -- 172.21.15.55:0/196217900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680ca380 con 0x7f5b680d35b0 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.953+0000 7f5b6d14b640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680d35b0 0x7f5b68154c50 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00e9e0 tx=0x7f5b5c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.954+0000 7f5b667fc640 1 -- 172.21.15.55:0/196217900 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c017070 con 0x7f5b680d35b0 2024-04-25T09:04:16.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.954+0000 7f5b667fc640 1 -- 172.21.15.55:0/196217900 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c00c9d0 con 0x7f5b680d35b0 2024-04-25T09:04:16.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.954+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/196217900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b68155190 con 0x7f5b680d35b0 2024-04-25T09:04:16.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.954+0000 7f5b667fc640 1 -- 172.21.15.55:0/196217900 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00cdc0 con 0x7f5b680d35b0 2024-04-25T09:04:16.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.954+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/196217900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b680ca0a0 con 0x7f5b680d35b0 2024-04-25T09:04:16.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.955+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/196217900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b680749b0 con 0x7f5b680d35b0 2024-04-25T09:04:16.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.955+0000 7f5b667fc640 1 -- 172.21.15.55:0/196217900 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b5c01a070 con 0x7f5b680d35b0 2024-04-25T09:04:16.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.956+0000 7f5b667fc640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b5406b4d0 0x7f5b5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.956+0000 7f5b667fc640 1 -- 172.21.15.55:0/196217900 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f5b5c089f50 con 0x7f5b680d35b0 2024-04-25T09:04:16.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.956+0000 7f5b6d94c640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b5406b4d0 0x7f5b5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.956+0000 7f5b6d94c640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b5406b4d0 0x7f5b5406d990 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5b60000f60 tx=0x7f5b60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:16.960+0000 7f5b667fc640 1 -- 172.21.15.55:0/196217900 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b5c0589d0 con 0x7f5b680d35b0 2024-04-25T09:04:17.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.135+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/196217900 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b680cdce0 con 0x7f5b5406b4d0 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.136+0000 7f5b667fc640 1 -- 172.21.15.55:0/196217900 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13509 (secure 0 0 0) 0x7f5b680cdce0 con 0x7f5b5406b4d0 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:04:17.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/196217900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b5406b4d0 msgr2=0x7f5b5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b5406b4d0 0x7f5b5406d990 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5b60000f60 tx=0x7f5b60009040 comp rx=0 tx=0).stop 2024-04-25T09:04:17.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/196217900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680d35b0 msgr2=0x7f5b68154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680d35b0 0x7f5b68154c50 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00e9e0 tx=0x7f5b5c00eea0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/196217900 shutdown_connections 2024-04-25T09:04:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f5b5406b4d0 0x7f5b5406d990 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b6815dce0 0x7f5b680c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680d35b0 0x7f5b68154c50 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 --2- 172.21.15.55:0/196217900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b680b5990 0x7f5b68155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/196217900 >> 172.21.15.55:0/196217900 conn(0x7f5b68072900 msgr2=0x7f5b680d39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/196217900 shutdown_connections 2024-04-25T09:04:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.138+0000 7f5b6fbb0640 1 -- 172.21.15.55:0/196217900 wait complete. 2024-04-25T09:04:17.137 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":438,"stamp":"2024-04-25T09:04:16.697322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":286980,"kb_used_data":20892,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754687740,"statfs":{"total":773094113280,"available":772800245760,"internally_reserved":0,"allocated":21393408,"data_stored":14676143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-174,"num_write_kb":-8302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001082"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":348,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.342446+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T09:04:13.342446+0000","last_peered":"2024-04-25T09:04:13.342446+0000","last_clean":"2024-04-25T09:04:13.342446+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:04:13.342446+0000","last_undegraded":"2024-04-25T09:04:13.342446+0000","last_fullsized":"2024-04-25T09:04:13.342446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509573,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2072576,"data_stored":1230088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509571,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32628,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1482752,"data_stored":639727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509573,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":634149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509572,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":639715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509572,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36788,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335052,"statfs":{"total":96636764160,"available":96599093248,"internally_reserved":0,"allocated":1478656,"data_stored":639720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509574,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1458176,"data_stored":633540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509572,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45560,"kb_used_data":10220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326280,"statfs":{"total":96636764160,"available":96590110720,"internally_reserved":0,"allocated":10465280,"data_stored":9613752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36796,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:17.137 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:17.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.251+0000 7efc0194c640 1 Processor -- start 2024-04-25T09:04:17.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.251+0000 7efc0194c640 1 -- start start 2024-04-25T09:04:17.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efc0194c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efbfc0d1320 0x7efbfc0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efc0194c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc06c900 con 0x7efbfc09a150 2024-04-25T09:04:17.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efc0194c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc06cbe0 con 0x7efbfc15ba10 2024-04-25T09:04:17.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efc0194c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc0cbe50 con 0x7efbfc0d1320 2024-04-25T09:04:17.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbfa7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efbfc09a150 0x7efbfc06bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54696/0 (socket says 172.21.15.55:54696) 2024-04-25T09:04:17.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbfa7fc640 1 -- 172.21.15.55:0/977161867 learned_addr learned my addr 172.21.15.55:0/977161867 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:17.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbfb7fe640 1 --2- 172.21.15.55:0/977161867 >> v2:172.21.15.167:3300/0 conn(0x7efbfc0d1320 0x7efbfc0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016378496 0 0) 0x7efbfc06c900 con 0x7efbfc09a150 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe4003520 con 0x7efbfc09a150 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4209449608 0 0) 0x7efbe4003520 con 0x7efbfc09a150 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 >> v2:172.21.15.167:3300/0 conn(0x7efbfc0d1320 msgr2=0x7efbfc0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 --2- 172.21.15.55:0/977161867 >> v2:172.21.15.167:3300/0 conn(0x7efbfc0d1320 0x7efbfc0cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 >> v1:172.21.15.167:6789/0 conn(0x7efbfc15ba10 legacy=0x7efbfc099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc06cec0 con 0x7efbfc09a150 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7efbf0001670 con 0x7efbfc09a150 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 >> v1:172.21.15.55:6789/0 conn(0x7efbfc09a150 legacy=0x7efbfc06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 0x7efbe4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efbe4004800 0x7efbe4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efbe40051c0 0x7efbe400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe400c030 con 0x7efbe40039b0 2024-04-25T09:04:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe400c1e0 con 0x7efbe4004800 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbe400c3e0 con 0x7efbe40051c0 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.252+0000 7efbfaffd640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 0x7efbe4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.253+0000 7efbfa7fc640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efbe4004800 0x7efbe4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.253+0000 7efbfb7fe640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efbe40051c0 0x7efbe400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.253+0000 7efbfaffd640 1 -- 172.21.15.55:0/977161867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efbe40051c0 msgr2=0x7efbe400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.253+0000 7efbfaffd640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efbe40051c0 0x7efbe400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.253+0000 7efbfaffd640 1 -- 172.21.15.55:0/977161867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efbe4004800 msgr2=0x7efbe4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.253+0000 7efbfaffd640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efbe4004800 0x7efbe4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.253+0000 7efbfaffd640 1 -- 172.21.15.55:0/977161867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe4003520 con 0x7efbe40039b0 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.253+0000 7efbfb7fe640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efbe40051c0 0x7efbe400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.253+0000 7efbfb7fe640 1 -- 172.21.15.55:0/977161867 reap_dead start 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.253+0000 7efbfaffd640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 0x7efbe4003dd0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7efbec001750 tx=0x7efbe4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d60ec6916ffb961 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.254+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec001370 con 0x7efbe40039b0 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.254+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec0052d0 con 0x7efbe40039b0 2024-04-25T09:04:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.254+0000 7efbf9ffb640 1 -- 172.21.15.55:0/977161867 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec02abc0 con 0x7efbe40039b0 2024-04-25T09:04:17.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.254+0000 7efc0194c640 1 -- 172.21.15.55:0/977161867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 msgr2=0x7efbe4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.254+0000 7efc0194c640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 0x7efbe4003dd0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7efbec001750 tx=0x7efbe4005830 comp rx=0 tx=0).stop 2024-04-25T09:04:17.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.254+0000 7efc0194c640 1 -- 172.21.15.55:0/977161867 shutdown_connections 2024-04-25T09:04:17.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.254+0000 7efc0194c640 1 --2- 172.21.15.55:0/977161867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 0x7efbe4003dd0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.254+0000 7efc0194c640 1 -- 172.21.15.55:0/977161867 >> 172.21.15.55:0/977161867 conn(0x7efbfc0b32f0 msgr2=0x7efbfc0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.254+0000 7efc0194c640 1 -- 172.21.15.55:0/977161867 shutdown_connections 2024-04-25T09:04:17.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.254+0000 7efc0194c640 1 -- 172.21.15.55:0/977161867 wait complete. 2024-04-25T09:04:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.255+0000 7efc0194c640 1 Processor -- start 2024-04-25T09:04:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.256+0000 7efc0194c640 1 -- start start 2024-04-25T09:04:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.256+0000 7efc0194c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 0x7efbfc0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.256+0000 7efc0194c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efbfc154050 0x7efbfc0b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.256+0000 7efc0194c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efbfc0c7eb0 0x7efbfc1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.256+0000 7efc0194c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc099dd0 con 0x7efbe40039b0 2024-04-25T09:04:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.256+0000 7efc0194c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc099c50 con 0x7efbfc154050 2024-04-25T09:04:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.256+0000 7efc0194c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc099f50 con 0x7efbfc0c7eb0 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 0x7efbfc0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 0x7efbfc0c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45986/0 (socket says 172.21.15.55:45986) 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfaffd640 1 -- 172.21.15.55:0/3806974619 learned_addr learned my addr 172.21.15.55:0/3806974619 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfa7fc640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efbfc154050 0x7efbfc0b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfb7fe640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efbfc0c7eb0 0x7efbfc1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfaffd640 1 -- 172.21.15.55:0/3806974619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efbfc0c7eb0 msgr2=0x7efbfc1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfaffd640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efbfc0c7eb0 0x7efbfc1579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfaffd640 1 -- 172.21.15.55:0/3806974619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efbfc154050 msgr2=0x7efbfc0b6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfaffd640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efbfc154050 0x7efbfc0b6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfaffd640 1 -- 172.21.15.55:0/3806974619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc0c5a40 con 0x7efbe40039b0 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfa7fc640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efbfc154050 0x7efbfc0b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbfaffd640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 0x7efbfc0c5500 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7efbec005040 tx=0x7efbec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbe3fff640 1 -- 172.21.15.55:0/3806974619 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec037040 con 0x7efbe40039b0 2024-04-25T09:04:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbe3fff640 1 -- 172.21.15.55:0/3806974619 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec005480 con 0x7efbe40039b0 2024-04-25T09:04:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efc0194c640 1 -- 172.21.15.55:0/3806974619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc0c8390 con 0x7efbe40039b0 2024-04-25T09:04:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efbe3fff640 1 -- 172.21.15.55:0/3806974619 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec007a30 con 0x7efbe40039b0 2024-04-25T09:04:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.257+0000 7efc0194c640 1 -- 172.21.15.55:0/3806974619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc0b5ff0 con 0x7efbe40039b0 2024-04-25T09:04:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.259+0000 7efc0194c640 1 -- 172.21.15.55:0/3806974619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc0749b0 con 0x7efbe40039b0 2024-04-25T09:04:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.259+0000 7efbe3fff640 1 -- 172.21.15.55:0/3806974619 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efbec044020 con 0x7efbe40039b0 2024-04-25T09:04:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.259+0000 7efbe3fff640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efbe806b4d0 0x7efbe806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.259+0000 7efbe3fff640 1 -- 172.21.15.55:0/3806974619 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7efbec0a9c70 con 0x7efbe40039b0 2024-04-25T09:04:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.259+0000 7efbfa7fc640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efbe806b4d0 0x7efbe806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.260+0000 7efbfa7fc640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efbe806b4d0 0x7efbe806d990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7efbfc09f800 tx=0x7efbf0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.264+0000 7efbe3fff640 1 -- 172.21.15.55:0/3806974619 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efbec078cb0 con 0x7efbe40039b0 2024-04-25T09:04:17.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.449+0000 7efc0194c640 1 -- 172.21.15.55:0/3806974619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efbfc09a570 con 0x7efbe40039b0 2024-04-25T09:04:17.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.450+0000 7efbe3fff640 1 -- 172.21.15.55:0/3806974619 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+13290 (secure 0 0 0) 0x7efbec0785b0 con 0x7efbe40039b0 2024-04-25T09:04:17.438 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:17.438 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":120,"fsid":"c39ac909-02b8-4b68-9f8d-b272de9b1a7b","created":"2024-04-25T08:53:18.265535+0000","modified":"2024-04-25T09:04:14.338354+0000","last_up_change":"2024-04-25T08:53:29.027280+0000","last_in_change":"2024-04-25T08:53:20.446747+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:53:30.593901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43a3f6b5-4714-409f-9f16-1413553399ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6809","nonce":382211730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6811","nonce":382211730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6815","nonce":382211730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":382211730},{"type":"v1","addr":"172.21.15.55:6813","nonce":382211730}]},"public_addr":"172.21.15.55:6809/382211730","cluster_addr":"172.21.15.55:6811/382211730","heartbeat_back_addr":"172.21.15.55:6815/382211730","heartbeat_front_addr":"172.21.15.55:6813/382211730","state":["exists","up"]},{"osd":1,"uuid":"96ef6179-4eab-4b78-b4fe-b17fa7237792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6801","nonce":2726345870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6803","nonce":2726345870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6807","nonce":2726345870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2726345870},{"type":"v1","addr":"172.21.15.55:6805","nonce":2726345870}]},"public_addr":"172.21.15.55:6801/2726345870","cluster_addr":"172.21.15.55:6803/2726345870","heartbeat_back_addr":"172.21.15.55:6807/2726345870","heartbeat_front_addr":"172.21.15.55:6805/2726345870","state":["exists","up"]},{"osd":2,"uuid":"58f32851-02c2-4eca-b308-9aaa0f8fbcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6825","nonce":2942240833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6827","nonce":2942240833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6831","nonce":2942240833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2942240833},{"type":"v1","addr":"172.21.15.55:6829","nonce":2942240833}]},"public_addr":"172.21.15.55:6825/2942240833","cluster_addr":"172.21.15.55:6827/2942240833","heartbeat_back_addr":"172.21.15.55:6831/2942240833","heartbeat_front_addr":"172.21.15.55:6829/2942240833","state":["exists","up"]},{"osd":3,"uuid":"bc5cfff6-8dd5-4999-bd07-d5b173b92159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6817","nonce":2016500802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6819","nonce":2016500802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6823","nonce":2016500802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2016500802},{"type":"v1","addr":"172.21.15.55:6821","nonce":2016500802}]},"public_addr":"172.21.15.55:6817/2016500802","cluster_addr":"172.21.15.55:6819/2016500802","heartbeat_back_addr":"172.21.15.55:6823/2016500802","heartbeat_front_addr":"172.21.15.55:6821/2016500802","state":["exists","up"]},{"osd":4,"uuid":"bb89cbf1-515c-437d-8c11-7e5db4a93bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6809","nonce":1392386852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6811","nonce":1392386852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6815","nonce":1392386852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1392386852},{"type":"v1","addr":"172.21.15.167:6813","nonce":1392386852}]},"public_addr":"172.21.15.167:6809/1392386852","cluster_addr":"172.21.15.167:6811/1392386852","heartbeat_back_addr":"172.21.15.167:6815/1392386852","heartbeat_front_addr":"172.21.15.167:6813/1392386852","state":["exists","up"]},{"osd":5,"uuid":"1e876c9c-a1d4-4dc0-a615-ee47696047fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337224202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337224202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337224202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337224202},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337224202}]},"public_addr":"172.21.15.167:6801/1337224202","cluster_addr":"172.21.15.167:6803/1337224202","heartbeat_back_addr":"172.21.15.167:6807/1337224202","heartbeat_front_addr":"172.21.15.167:6805/1337224202","state":["exists","up"]},{"osd":6,"uuid":"a9bd913f-c780-4e2a-a4c9-6eb958ac2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6823","nonce":1814554564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6827","nonce":1814554564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6831","nonce":1814554564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1814554564},{"type":"v1","addr":"172.21.15.167:6829","nonce":1814554564}]},"public_addr":"172.21.15.167:6823/1814554564","cluster_addr":"172.21.15.167:6827/1814554564","heartbeat_back_addr":"172.21.15.167:6831/1814554564","heartbeat_front_addr":"172.21.15.167:6829/1814554564","state":["exists","up"]},{"osd":7,"uuid":"fafadc46-2e92-422f-bffa-2fbc3f6b978d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6817","nonce":2254116283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6819","nonce":2254116283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6826","nonce":2254116283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2254116283},{"type":"v1","addr":"172.21.15.167:6822","nonce":2254116283}]},"public_addr":"172.21.15.167:6817/2254116283","cluster_addr":"172.21.15.167:6819/2254116283","heartbeat_back_addr":"172.21.15.167:6826/2254116283","heartbeat_front_addr":"172.21.15.167:6822/2254116283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.619669+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.597652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.600918+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.574631+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.656077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.595924+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.628343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:53:25.689772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3300284863":"2024-04-26T09:04:11.329196+0000","172.21.15.55:6835/3300284863":"2024-04-26T09:04:11.329196+0000","172.21.15.55:6837/3667784674":"2024-04-26T09:03:57.240366+0000","172.21.15.55:6835/3667784674":"2024-04-26T09:03:57.240366+0000","172.21.15.55:6837/4257598582":"2024-04-26T09:03:46.638997+0000","172.21.15.55:6835/4257598582":"2024-04-26T09:03:46.638997+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 -- 172.21.15.55:0/3806974619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efbe806b4d0 msgr2=0x7efbe806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efbe806b4d0 0x7efbe806d990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7efbfc09f800 tx=0x7efbf0009040 comp rx=0 tx=0).stop 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 -- 172.21.15.55:0/3806974619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 msgr2=0x7efbfc0c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 0x7efbfc0c5500 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7efbec005040 tx=0x7efbec001120 comp rx=0 tx=0).stop 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 -- 172.21.15.55:0/3806974619 shutdown_connections 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7efbe806b4d0 0x7efbe806d990 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efbfc0c7eb0 0x7efbfc1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efbfc154050 0x7efbfc0b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 --2- 172.21.15.55:0/3806974619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbe40039b0 0x7efbfc0c5500 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 -- 172.21.15.55:0/3806974619 >> 172.21.15.55:0/3806974619 conn(0x7efbfc0b32f0 msgr2=0x7efbfc15a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 -- 172.21.15.55:0/3806974619 shutdown_connections 2024-04-25T09:04:17.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:17.452+0000 7efc0194c640 1 -- 172.21.15.55:0/3806974619 wait complete. 2024-04-25T09:04:18.452 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T09:04:18.452 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:04:18.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.571+0000 7fa510ee1640 1 Processor -- start 2024-04-25T09:04:18.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.571+0000 7fa510ee1640 1 -- start start 2024-04-25T09:04:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.572+0000 7fa510ee1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa50c0aedc0 0x7fa50c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.572+0000 7fa510ee1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c06da40 con 0x7fa50c0b4900 2024-04-25T09:04:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.572+0000 7fa510ee1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c06dd20 con 0x7fa50c06d260 2024-04-25T09:04:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.572+0000 7fa510ee1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c15c050 con 0x7fa50c0aedc0 2024-04-25T09:04:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.572+0000 7fa50ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa50c0b4900 0x7fa50c15c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54708/0 (socket says 172.21.15.55:54708) 2024-04-25T09:04:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.572+0000 7fa50ad9d640 1 -- 172.21.15.55:0/1874636447 learned_addr learned my addr 172.21.15.55:0/1874636447 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.572+0000 7fa50a59c640 1 --2- 172.21.15.55:0/1874636447 >> v2:172.21.15.167:3300/0 conn(0x7fa50c0aedc0 0x7fa50c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.572+0000 7fa50959a640 1 -- 172.21.15.55:0/1874636447 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486334606 0 0) 0x7fa50c06da40 con 0x7fa50c0b4900 2024-04-25T09:04:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.572+0000 7fa50959a640 1 -- 172.21.15.55:0/1874636447 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f8003520 con 0x7fa50c0b4900 2024-04-25T09:04:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.572+0000 7fa50959a640 1 -- 172.21.15.55:0/1874636447 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009547039 0 0) 0x7fa50c06dd20 con 0x7fa50c06d260 2024-04-25T09:04:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.572+0000 7fa50959a640 1 -- 172.21.15.55:0/1874636447 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa50c06da40 con 0x7fa50c06d260 2024-04-25T09:04:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.573+0000 7fa50a59c640 1 -- 172.21.15.55:0/1874636447 >> v1:172.21.15.167:6789/0 conn(0x7fa50c06d260 legacy=0x7fa50c0b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.573+0000 7fa50a59c640 1 -- 172.21.15.55:0/1874636447 >> v1:172.21.15.55:6789/0 conn(0x7fa50c0b4900 legacy=0x7fa50c15c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.573+0000 7fa50a59c640 1 -- 172.21.15.55:0/1874636447 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c06e000 con 0x7fa50c0aedc0 2024-04-25T09:04:18.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.573+0000 7fa50a59c640 1 --2- 172.21.15.55:0/1874636447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa50c0aedc0 0x7fa50c15ae20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa50c15c1d0 tx=0x7fa4fc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d008e967320692a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.574+0000 7fa50959a640 1 -- 172.21.15.55:0/1874636447 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc007740 con 0x7fa50c0aedc0 2024-04-25T09:04:18.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.574+0000 7fa50959a640 1 -- 172.21.15.55:0/1874636447 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0078e0 con 0x7fa50c0aedc0 2024-04-25T09:04:18.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.574+0000 7fa50959a640 1 -- 172.21.15.55:0/1874636447 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc007cb0 con 0x7fa50c0aedc0 2024-04-25T09:04:18.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.574+0000 7fa510ee1640 1 -- 172.21.15.55:0/1874636447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa50c0aedc0 msgr2=0x7fa50c15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.574+0000 7fa510ee1640 1 --2- 172.21.15.55:0/1874636447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa50c0aedc0 0x7fa50c15ae20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa50c15c1d0 tx=0x7fa4fc02a660 comp rx=0 tx=0).stop 2024-04-25T09:04:18.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.574+0000 7fa510ee1640 1 -- 172.21.15.55:0/1874636447 shutdown_connections 2024-04-25T09:04:18.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.574+0000 7fa510ee1640 1 --2- 172.21.15.55:0/1874636447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa50c0aedc0 0x7fa50c15ae20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.574+0000 7fa510ee1640 1 -- 172.21.15.55:0/1874636447 >> 172.21.15.55:0/1874636447 conn(0x7fa50c06aba0 msgr2=0x7fa50c06af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.574+0000 7fa510ee1640 1 -- 172.21.15.55:0/1874636447 shutdown_connections 2024-04-25T09:04:18.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.574+0000 7fa510ee1640 1 -- 172.21.15.55:0/1874636447 wait complete. 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.576+0000 7fa510ee1640 1 Processor -- start 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.576+0000 7fa510ee1640 1 -- start start 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.576+0000 7fa510ee1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa50c06d260 0x7fa50c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.576+0000 7fa510ee1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa50c0aedc0 0x7fa50c13fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.576+0000 7fa510ee1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa50c0b4900 0x7fa50c140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.576+0000 7fa510ee1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c06d670 con 0x7fa50c06d260 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.576+0000 7fa510ee1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0af1a0 con 0x7fa50c0aedc0 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.576+0000 7fa510ee1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c06d7f0 con 0x7fa50c0b4900 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.576+0000 7fa50a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa50c06d260 0x7fa50c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.576+0000 7fa50a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa50c06d260 0x7fa50c15ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45992/0 (socket says 172.21.15.55:45992) 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.576+0000 7fa50a59c640 1 -- 172.21.15.55:0/2721229784 learned_addr learned my addr 172.21.15.55:0/2721229784 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa50ad9d640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa50c0b4900 0x7fa50c140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa509d9b640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa50c0aedc0 0x7fa50c13fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa50a59c640 1 -- 172.21.15.55:0/2721229784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa50c0b4900 msgr2=0x7fa50c140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa50a59c640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa50c0b4900 0x7fa50c140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa50a59c640 1 -- 172.21.15.55:0/2721229784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa50c0aedc0 msgr2=0x7fa50c13fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa50a59c640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa50c0aedc0 0x7fa50c13fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa50a59c640 1 -- 172.21.15.55:0/2721229784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c0a8a10 con 0x7fa50c06d260 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa50a59c640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa50c06d260 0x7fa50c15ca30 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009e80 tx=0x7fa4fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa502ffd640 1 -- 172.21.15.55:0/2721229784 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc040070 con 0x7fa50c06d260 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa502ffd640 1 -- 172.21.15.55:0/2721229784 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc031c40 con 0x7fa50c06d260 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa510ee1640 1 -- 172.21.15.55:0/2721229784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c0a8cf0 con 0x7fa50c06d260 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa502ffd640 1 -- 172.21.15.55:0/2721229784 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc009450 con 0x7fa50c06d260 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.577+0000 7fa510ee1640 1 -- 172.21.15.55:0/2721229784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c0a92b0 con 0x7fa50c06d260 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.578+0000 7fa510ee1640 1 -- 172.21.15.55:0/2721229784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa50c0750b0 con 0x7fa50c06d260 2024-04-25T09:04:18.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.579+0000 7fa502ffd640 1 -- 172.21.15.55:0/2721229784 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa4fc039040 con 0x7fa50c06d260 2024-04-25T09:04:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.579+0000 7fa502ffd640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa4ec06b500 0x7fa4ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.579+0000 7fa502ffd640 1 -- 172.21.15.55:0/2721229784 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fa4fc0ab8e0 con 0x7fa50c06d260 2024-04-25T09:04:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.579+0000 7fa509d9b640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa4ec06b500 0x7fa4ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.579+0000 7fa502ffd640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x7fa4ec071500 0x7fa4ec073920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.579+0000 7fa502ffd640 1 -- 172.21.15.55:0/2721229784 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4fc0047f0 con 0x7fa4ec071500 2024-04-25T09:04:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.579+0000 7fa502ffd640 1 -- 172.21.15.55:0/2721229784 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4fc0abd70 con 0x7fa50c06d260 2024-04-25T09:04:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.579+0000 7fa50ad9d640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x7fa4ec071500 0x7fa4ec073920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.580+0000 7fa509d9b640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa4ec06b500 0x7fa4ec06d9c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4007fd0 tx=0x7fa4f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.580+0000 7fa50ad9d640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x7fa4ec071500 0x7fa4ec073920 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.580+0000 7fa502ffd640 1 -- 172.21.15.55:0/2721229784 <== osd.0 v2:172.21.15.55:6808/382211730 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa4fc0047f0 con 0x7fa4ec071500 2024-04-25T09:04:18.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa510ee1640 1 -- 172.21.15.55:0/2721229784 --> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa50c1514e0 con 0x7fa4ec071500 2024-04-25T09:04:18.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa502ffd640 1 -- 172.21.15.55:0/2721229784 <== osd.0 v2:172.21.15.55:6808/382211730 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa50c1514e0 con 0x7fa4ec071500 2024-04-25T09:04:18.583 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:04:18.583 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:04:18.583 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:04:18.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa510ee1640 1 -- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x7fa4ec071500 msgr2=0x7fa4ec073920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa510ee1640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:6808/382211730,v1:172.21.15.55:6809/382211730] conn(0x7fa4ec071500 0x7fa4ec073920 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa510ee1640 1 -- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa4ec06b500 msgr2=0x7fa4ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa510ee1640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fa4ec06b500 0x7fa4ec06d9c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4007fd0 tx=0x7fa4f4009040 comp rx=0 tx=0).stop 2024-04-25T09:04:18.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa510ee1640 1 -- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa50c06d260 msgr2=0x7fa50c15ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa510ee1640 1 --2- 172.21.15.55:0/2721229784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa50c06d260 0x7fa50c15ca30 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009e80 tx=0x7fa4fc004a40 comp rx=0 tx=0).stop 2024-04-25T09:04:18.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa50ad9d640 1 -- 172.21.15.55:0/2721229784 reap_dead start 2024-04-25T09:04:18.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa510ee1640 1 -- 172.21.15.55:0/2721229784 shutdown_connections 2024-04-25T09:04:18.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa510ee1640 1 -- 172.21.15.55:0/2721229784 >> 172.21.15.55:0/2721229784 conn(0x7fa50c06aba0 msgr2=0x7fa50c0b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa510ee1640 1 -- 172.21.15.55:0/2721229784 shutdown_connections 2024-04-25T09:04:18.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.594+0000 7fa510ee1640 1 -- 172.21.15.55:0/2721229784 wait complete. 2024-04-25T09:04:18.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T09:04:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.706+0000 7f1e8cc4c640 1 Processor -- start 2024-04-25T09:04:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.706+0000 7f1e8cc4c640 1 -- start start 2024-04-25T09:04:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.707+0000 7f1e8cc4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e88161090 0x7f1e88161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.707+0000 7f1e8cc4c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e880b9720 0x7f1e880ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.707+0000 7f1e8cc4c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e880cece0 0x7f1e8806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.707+0000 7f1e8cc4c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e880cf130 con 0x7f1e880b9720 2024-04-25T09:04:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.707+0000 7f1e8cc4c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e880d21a0 con 0x7f1e880cece0 2024-04-25T09:04:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.707+0000 7f1e8cc4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88161f80 con 0x7f1e88161090 2024-04-25T09:04:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.708+0000 7f1e85d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e880b9720 0x7f1e880ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.708+0000 7f1e85d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e880b9720 0x7f1e880ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57882/0 (socket says 172.21.15.55:57882) 2024-04-25T09:04:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.708+0000 7f1e85d9b640 1 -- 172.21.15.55:0/604294234 learned_addr learned my addr 172.21.15.55:0/604294234 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.708+0000 7f1e86d9d640 1 --2- 172.21.15.55:0/604294234 >> v2:172.21.15.167:3300/0 conn(0x7f1e880cece0 0x7f1e8806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.708+0000 7f1e8659c640 1 --2- 172.21.15.55:0/604294234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e88161090 0x7f1e88161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.708+0000 7f1e85d9b640 1 -- 172.21.15.55:0/604294234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e88161090 msgr2=0x7f1e88161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.708+0000 7f1e85d9b640 1 --2- 172.21.15.55:0/604294234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e88161090 0x7f1e88161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.708+0000 7f1e85d9b640 1 -- 172.21.15.55:0/604294234 >> v2:172.21.15.167:3300/0 conn(0x7f1e880cece0 msgr2=0x7f1e8806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.708+0000 7f1e85d9b640 1 --2- 172.21.15.55:0/604294234 >> v2:172.21.15.167:3300/0 conn(0x7f1e880cece0 0x7f1e8806c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.708+0000 7f1e85d9b640 1 -- 172.21.15.55:0/604294234 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88162260 con 0x7f1e880b9720 2024-04-25T09:04:18.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e85d9b640 1 --2- 172.21.15.55:0/604294234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e880b9720 0x7f1e880ce7a0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f1e880cab30 tx=0x7f1e7c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ddd4cb940703da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e8559a640 1 -- 172.21.15.55:0/604294234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c037070 con 0x7f1e880b9720 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e8559a640 1 -- 172.21.15.55:0/604294234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c032440 con 0x7f1e880b9720 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e8559a640 1 -- 172.21.15.55:0/604294234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c032810 con 0x7f1e880b9720 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/604294234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e880b9720 msgr2=0x7f1e880ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e8cc4c640 1 --2- 172.21.15.55:0/604294234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e880b9720 0x7f1e880ce7a0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f1e880cab30 tx=0x7f1e7c02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/604294234 shutdown_connections 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e8cc4c640 1 --2- 172.21.15.55:0/604294234 >> v2:172.21.15.167:3300/0 conn(0x7f1e880cece0 0x7f1e8806c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e8cc4c640 1 --2- 172.21.15.55:0/604294234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e880b9720 0x7f1e880ce7a0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e8cc4c640 1 --2- 172.21.15.55:0/604294234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e88161090 0x7f1e88161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/604294234 >> 172.21.15.55:0/604294234 conn(0x7f1e880b55e0 msgr2=0x7f1e880b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.709+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/604294234 shutdown_connections 2024-04-25T09:04:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.710+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/604294234 wait complete. 2024-04-25T09:04:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.711+0000 7f1e8cc4c640 1 Processor -- start 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.711+0000 7f1e8cc4c640 1 -- start start 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8cc4c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e880b9720 0x7f1e881f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8cc4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e880cece0 0x7f1e8814ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8cc4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e88161090 0x7f1e881585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8cc4c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88161470 con 0x7f1e880b9720 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8cc4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880d1e30 con 0x7f1e88161090 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8cc4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88161c70 con 0x7f1e880cece0 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e880b9720 0x7f1e881f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e880b9720 0x7f1e881f78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57892/0 (socket says 172.21.15.55:57892) 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8659c640 1 -- 172.21.15.55:0/4017856351 learned_addr learned my addr 172.21.15.55:0/4017856351 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e85d9b640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e880cece0 0x7f1e8814ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e86d9d640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e88161090 0x7f1e881585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8659c640 1 -- 172.21.15.55:0/4017856351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e880cece0 msgr2=0x7f1e8814ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8659c640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e880cece0 0x7f1e8814ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8659c640 1 -- 172.21.15.55:0/4017856351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e88161090 msgr2=0x7f1e881585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8659c640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e88161090 0x7f1e881585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8659c640 1 -- 172.21.15.55:0/4017856351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e880ce280 con 0x7f1e880b9720 2024-04-25T09:04:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8659c640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e880b9720 0x7f1e881f78c0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800e8a0 tx=0x7f1e7800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e76ffd640 1 -- 172.21.15.55:0/4017856351 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78017070 con 0x7f1e880b9720 2024-04-25T09:04:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e76ffd640 1 -- 172.21.15.55:0/4017856351 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7800c940 con 0x7f1e880b9720 2024-04-25T09:04:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e76ffd640 1 -- 172.21.15.55:0/4017856351 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7800cd30 con 0x7f1e880b9720 2024-04-25T09:04:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/4017856351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e88157b10 con 0x7f1e880b9720 2024-04-25T09:04:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.712+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/4017856351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e880cdfa0 con 0x7f1e880b9720 2024-04-25T09:04:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.713+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/4017856351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e880750b0 con 0x7f1e880b9720 2024-04-25T09:04:18.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.714+0000 7f1e76ffd640 1 -- 172.21.15.55:0/4017856351 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e7801a070 con 0x7f1e880b9720 2024-04-25T09:04:18.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.714+0000 7f1e76ffd640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e6806b4d0 0x7f1e6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.714+0000 7f1e76ffd640 1 -- 172.21.15.55:0/4017856351 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f1e78089ce0 con 0x7f1e880b9720 2024-04-25T09:04:18.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.714+0000 7f1e85d9b640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e6806b4d0 0x7f1e6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.715+0000 7f1e85d9b640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e6806b4d0 0x7f1e6806d990 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c034000 tx=0x7f1e7c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.719+0000 7f1e76ffd640 1 -- 172.21.15.55:0/4017856351 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e780587f0 con 0x7f1e880b9720 2024-04-25T09:04:18.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.904+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/4017856351 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e880d1700 con 0x7f1e6806b4d0 2024-04-25T09:04:18.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.904+0000 7f1e76ffd640 1 -- 172.21.15.55:0/4017856351 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1e880d1700 con 0x7f1e6806b4d0 2024-04-25T09:04:18.892 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T09:04:18.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/4017856351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e6806b4d0 msgr2=0x7f1e6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e6806b4d0 0x7f1e6806d990 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c034000 tx=0x7f1e7c02e000 comp rx=0 tx=0).stop 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/4017856351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e880b9720 msgr2=0x7f1e881f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e880b9720 0x7f1e881f78c0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800e8a0 tx=0x7f1e7800ed60 comp rx=0 tx=0).stop 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/4017856351 shutdown_connections 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1e6806b4d0 0x7f1e6806d990 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e88161090 0x7f1e881585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e880cece0 0x7f1e8814ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 --2- 172.21.15.55:0/4017856351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e880b9720 0x7f1e881f78c0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/4017856351 >> 172.21.15.55:0/4017856351 conn(0x7f1e880b55e0 msgr2=0x7f1e880d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/4017856351 shutdown_connections 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:18.906+0000 7f1e8cc4c640 1 -- 172.21.15.55:0/4017856351 wait complete. 2024-04-25T09:04:18.905 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T09:04:18.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:04:19.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.021+0000 7f79df522640 1 Processor -- start 2024-04-25T09:04:19.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.022+0000 7f79df522640 1 -- start start 2024-04-25T09:04:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.022+0000 7f79df522640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d8161090 0x7f79d8161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.022+0000 7f79df522640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f79d80ceeb0 0x7f79d80d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.022+0000 7f79df522640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d8161f80 con 0x7f79d80b9720 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.022+0000 7f79df522640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d80d21a0 con 0x7f79d80ceeb0 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.022+0000 7f79df522640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8162260 con 0x7f79d8161090 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.023+0000 7f79dcabd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f79d80b9720 0x7f79d80ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45834/0 (socket says 172.21.15.55:45834) 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.023+0000 7f79dcabd640 1 -- 172.21.15.55:0/3456000077 learned_addr learned my addr 172.21.15.55:0/3456000077 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.023+0000 7f79dd2be640 1 --2- 172.21.15.55:0/3456000077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d8161090 0x7f79d8161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.023+0000 7f79ddabf640 1 --2- 172.21.15.55:0/3456000077 >> v2:172.21.15.167:3300/0 conn(0x7f79d80ceeb0 0x7f79d80d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.023+0000 7f79d7fff640 1 -- 172.21.15.55:0/3456000077 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463233305 0 0) 0x7f79d8161f80 con 0x7f79d80b9720 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.023+0000 7f79d7fff640 1 -- 172.21.15.55:0/3456000077 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c0003520 con 0x7f79d80b9720 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.023+0000 7f79dd2be640 1 -- 172.21.15.55:0/3456000077 >> v2:172.21.15.167:3300/0 conn(0x7f79d80ceeb0 msgr2=0x7f79d80d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.023+0000 7f79dd2be640 1 --2- 172.21.15.55:0/3456000077 >> v2:172.21.15.167:3300/0 conn(0x7f79d80ceeb0 0x7f79d80d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.023+0000 7f79dd2be640 1 -- 172.21.15.55:0/3456000077 >> v1:172.21.15.55:6789/0 conn(0x7f79d80b9720 legacy=0x7f79d80ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.023+0000 7f79dd2be640 1 -- 172.21.15.55:0/3456000077 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d8162540 con 0x7f79d8161090 2024-04-25T09:04:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.023+0000 7f79ddabf640 1 --2- 172.21.15.55:0/3456000077 >> v2:172.21.15.167:3300/0 conn(0x7f79d80ceeb0 0x7f79d80d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.024+0000 7f79dd2be640 1 --2- 172.21.15.55:0/3456000077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d8161090 0x7f79d8161730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79d00097a0 tx=0x7f79d002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93335501d158fb1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.024+0000 7f79d7fff640 1 -- 172.21.15.55:0/3456000077 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0037070 con 0x7f79d8161090 2024-04-25T09:04:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.024+0000 7f79d7fff640 1 -- 172.21.15.55:0/3456000077 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0032440 con 0x7f79d8161090 2024-04-25T09:04:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.024+0000 7f79d7fff640 1 -- 172.21.15.55:0/3456000077 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0032810 con 0x7f79d8161090 2024-04-25T09:04:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.024+0000 7f79df522640 1 -- 172.21.15.55:0/3456000077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d8161090 msgr2=0x7f79d8161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.024+0000 7f79df522640 1 --2- 172.21.15.55:0/3456000077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d8161090 0x7f79d8161730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79d00097a0 tx=0x7f79d002a180 comp rx=0 tx=0).stop 2024-04-25T09:04:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.025+0000 7f79df522640 1 -- 172.21.15.55:0/3456000077 shutdown_connections 2024-04-25T09:04:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.025+0000 7f79df522640 1 --2- 172.21.15.55:0/3456000077 >> v2:172.21.15.167:3300/0 conn(0x7f79d80ceeb0 0x7f79d80d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.025+0000 7f79df522640 1 --2- 172.21.15.55:0/3456000077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d8161090 0x7f79d8161730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.025+0000 7f79df522640 1 -- 172.21.15.55:0/3456000077 >> 172.21.15.55:0/3456000077 conn(0x7f79d80b55e0 msgr2=0x7f79d80b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.025+0000 7f79df522640 1 -- 172.21.15.55:0/3456000077 shutdown_connections 2024-04-25T09:04:19.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.025+0000 7f79df522640 1 -- 172.21.15.55:0/3456000077 wait complete. 2024-04-25T09:04:19.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.026+0000 7f79df522640 1 Processor -- start 2024-04-25T09:04:19.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.026+0000 7f79df522640 1 -- start start 2024-04-25T09:04:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.026+0000 7f79df522640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d80b9720 0x7f79d8156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.026+0000 7f79df522640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d80ceeb0 0x7f79d81f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.026+0000 7f79df522640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79d8161090 0x7f79d815d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.026+0000 7f79df522640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8161c70 con 0x7f79d8161090 2024-04-25T09:04:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.026+0000 7f79df522640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8161470 con 0x7f79d80b9720 2024-04-25T09:04:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.026+0000 7f79df522640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d80d2b70 con 0x7f79d80ceeb0 2024-04-25T09:04:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79ddabf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79d8161090 0x7f79d815d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79ddabf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79d8161090 0x7f79d815d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57904/0 (socket says 172.21.15.55:57904) 2024-04-25T09:04:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79ddabf640 1 -- 172.21.15.55:0/3576039931 learned_addr learned my addr 172.21.15.55:0/3576039931 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79dd2be640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d80b9720 0x7f79d8156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79dcabd640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d80ceeb0 0x7f79d81f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79ddabf640 1 -- 172.21.15.55:0/3576039931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d80ceeb0 msgr2=0x7f79d81f48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79ddabf640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d80ceeb0 0x7f79d81f48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79ddabf640 1 -- 172.21.15.55:0/3576039931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d80b9720 msgr2=0x7f79d8156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79ddabf640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d80b9720 0x7f79d8156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79ddabf640 1 -- 172.21.15.55:0/3576039931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d80caba0 con 0x7f79d8161090 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79ddabf640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79d8161090 0x7f79d815d9c0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f79c800efb0 tx=0x7f79c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79d5ffb640 1 -- 172.21.15.55:0/3576039931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8018020 con 0x7f79d8161090 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79d5ffb640 1 -- 172.21.15.55:0/3576039931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c8014480 con 0x7f79d8161090 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79df522640 1 -- 172.21.15.55:0/3576039931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d80cae80 con 0x7f79d8161090 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.027+0000 7f79d5ffb640 1 -- 172.21.15.55:0/3576039931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8014850 con 0x7f79d8161090 2024-04-25T09:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.028+0000 7f79df522640 1 -- 172.21.15.55:0/3576039931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d80cb440 con 0x7f79d8161090 2024-04-25T09:04:19.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.028+0000 7f79df522640 1 -- 172.21.15.55:0/3576039931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79d80b5bf0 con 0x7f79d8161090 2024-04-25T09:04:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.029+0000 7f79d5ffb640 1 -- 172.21.15.55:0/3576039931 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f79c8005d10 con 0x7f79d8161090 2024-04-25T09:04:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.029+0000 7f79d5ffb640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f79c406b4d0 0x7f79c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.030+0000 7f79d5ffb640 1 -- 172.21.15.55:0/3576039931 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f79c808b510 con 0x7f79d8161090 2024-04-25T09:04:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.030+0000 7f79dd2be640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f79c406b4d0 0x7f79c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.030+0000 7f79d5ffb640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x7f79c40714d0 0x7f79c40738f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.030+0000 7f79d5ffb640 1 -- 172.21.15.55:0/3576039931 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79c4073fa0 con 0x7f79c40714d0 2024-04-25T09:04:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.030+0000 7f79d5ffb640 1 -- 172.21.15.55:0/3576039931 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79c808b9a0 con 0x7f79d8161090 2024-04-25T09:04:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.030+0000 7f79dcabd640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x7f79c40714d0 0x7f79c40738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.030+0000 7f79dd2be640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f79c406b4d0 0x7f79c406d990 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f79d0034000 tx=0x7f79d002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.030+0000 7f79dcabd640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x7f79c40714d0 0x7f79c40738f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.031+0000 7f79d5ffb640 1 -- 172.21.15.55:0/3576039931 <== osd.1 v2:172.21.15.55:6800/2726345870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f79c4073fa0 con 0x7f79c40714d0 2024-04-25T09:04:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.044+0000 7f79df522640 1 -- 172.21.15.55:0/3576039931 --> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f79d80750b0 con 0x7f79c40714d0 2024-04-25T09:04:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.044+0000 7f79d5ffb640 1 -- 172.21.15.55:0/3576039931 <== osd.1 v2:172.21.15.55:6800/2726345870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f79d80750b0 con 0x7f79c40714d0 2024-04-25T09:04:19.033 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:04:19.033 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:04:19.033 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:04:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.045+0000 7f79df522640 1 -- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x7f79c40714d0 msgr2=0x7f79c40738f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.045+0000 7f79df522640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:6800/2726345870,v1:172.21.15.55:6801/2726345870] conn(0x7f79c40714d0 0x7f79c40738f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.045+0000 7f79df522640 1 -- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f79c406b4d0 msgr2=0x7f79c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.045+0000 7f79df522640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f79c406b4d0 0x7f79c406d990 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f79d0034000 tx=0x7f79d002e000 comp rx=0 tx=0).stop 2024-04-25T09:04:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.045+0000 7f79df522640 1 -- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79d8161090 msgr2=0x7f79d815d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.045+0000 7f79df522640 1 --2- 172.21.15.55:0/3576039931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79d8161090 0x7f79d815d9c0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f79c800efb0 tx=0x7f79c800c490 comp rx=0 tx=0).stop 2024-04-25T09:04:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.045+0000 7f79ddabf640 1 -- 172.21.15.55:0/3576039931 reap_dead start 2024-04-25T09:04:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.045+0000 7f79df522640 1 -- 172.21.15.55:0/3576039931 shutdown_connections 2024-04-25T09:04:19.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.045+0000 7f79df522640 1 -- 172.21.15.55:0/3576039931 >> 172.21.15.55:0/3576039931 conn(0x7f79d80b55e0 msgr2=0x7f79d80b8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.045+0000 7f79df522640 1 -- 172.21.15.55:0/3576039931 shutdown_connections 2024-04-25T09:04:19.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.045+0000 7f79df522640 1 -- 172.21.15.55:0/3576039931 wait complete. 2024-04-25T09:04:19.043 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T09:04:19.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.157+0000 7f4501dcf640 1 Processor -- start 2024-04-25T09:04:19.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.157+0000 7f4501dcf640 1 -- start start 2024-04-25T09:04:19.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.157+0000 7f4501dcf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f44fc161090 0x7f44fc161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.157+0000 7f4501dcf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44fc0ceeb0 0x7f44fc0d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.157+0000 7f4501dcf640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc161f80 con 0x7f44fc0b9720 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.157+0000 7f4501dcf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc0d21a0 con 0x7f44fc0ceeb0 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.157+0000 7f4501dcf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc162260 con 0x7f44fc161090 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.158+0000 7f44fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44fc0ceeb0 0x7f44fc0d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.158+0000 7f44faffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f44fc0b9720 0x7f44fc0ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45838/0 (socket says 172.21.15.55:45838) 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.158+0000 7f44faffd640 1 -- 172.21.15.55:0/442322699 learned_addr learned my addr 172.21.15.55:0/442322699 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.158+0000 7f44fb7fe640 1 --2- 172.21.15.55:0/442322699 >> v2:172.21.15.167:3300/0 conn(0x7f44fc161090 0x7f44fc161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.158+0000 7f44fbfff640 1 -- 172.21.15.55:0/442322699 >> v2:172.21.15.167:3300/0 conn(0x7f44fc161090 msgr2=0x7f44fc161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.158+0000 7f44fbfff640 1 --2- 172.21.15.55:0/442322699 >> v2:172.21.15.167:3300/0 conn(0x7f44fc161090 0x7f44fc161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.158+0000 7f44fbfff640 1 -- 172.21.15.55:0/442322699 >> v1:172.21.15.55:6789/0 conn(0x7f44fc0b9720 legacy=0x7f44fc0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.158+0000 7f44fbfff640 1 -- 172.21.15.55:0/442322699 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc162540 con 0x7f44fc0ceeb0 2024-04-25T09:04:19.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.158+0000 7f44fa7fc640 1 -- 172.21.15.55:0/442322699 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133871913 0 0) 0x7f44fc161f80 con 0x7f44fc0b9720 2024-04-25T09:04:19.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f44fbfff640 1 --2- 172.21.15.55:0/442322699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0ceeb0 0x7f44fc0d2630 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0d1210 tx=0x7f44f402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f955dc47041569 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f44fa7fc640 1 -- 172.21.15.55:0/442322699 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4007740 con 0x7f44fc0ceeb0 2024-04-25T09:04:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f44fa7fc640 1 -- 172.21.15.55:0/442322699 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f40078e0 con 0x7f44fc0ceeb0 2024-04-25T09:04:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f44fa7fc640 1 -- 172.21.15.55:0/442322699 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4007cb0 con 0x7f44fc0ceeb0 2024-04-25T09:04:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f4501dcf640 1 -- 172.21.15.55:0/442322699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0ceeb0 msgr2=0x7f44fc0d2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f4501dcf640 1 --2- 172.21.15.55:0/442322699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0ceeb0 0x7f44fc0d2630 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0d1210 tx=0x7f44f402a5f0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f4501dcf640 1 -- 172.21.15.55:0/442322699 shutdown_connections 2024-04-25T09:04:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f4501dcf640 1 --2- 172.21.15.55:0/442322699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0ceeb0 0x7f44fc0d2630 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f4501dcf640 1 --2- 172.21.15.55:0/442322699 >> v2:172.21.15.167:3300/0 conn(0x7f44fc161090 0x7f44fc161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f4501dcf640 1 -- 172.21.15.55:0/442322699 >> 172.21.15.55:0/442322699 conn(0x7f44fc0b55e0 msgr2=0x7f44fc0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f4501dcf640 1 -- 172.21.15.55:0/442322699 shutdown_connections 2024-04-25T09:04:19.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.159+0000 7f4501dcf640 1 -- 172.21.15.55:0/442322699 wait complete. 2024-04-25T09:04:19.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.161+0000 7f4501dcf640 1 Processor -- start 2024-04-25T09:04:19.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.161+0000 7f4501dcf640 1 -- start start 2024-04-25T09:04:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.161+0000 7f4501dcf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44fc0b9720 0x7f44fc157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.161+0000 7f4501dcf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44fc0ceeb0 0x7f44fc1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.161+0000 7f4501dcf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc161090 0x7f44fc0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.161+0000 7f4501dcf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc161c70 con 0x7f44fc161090 2024-04-25T09:04:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.161+0000 7f4501dcf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc161470 con 0x7f44fc0b9720 2024-04-25T09:04:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.161+0000 7f4501dcf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0d2b70 con 0x7f44fc0ceeb0 2024-04-25T09:04:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc161090 0x7f44fc0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc161090 0x7f44fc0cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57920/0 (socket says 172.21.15.55:57920) 2024-04-25T09:04:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44fbfff640 1 -- 172.21.15.55:0/4205717391 learned_addr learned my addr 172.21.15.55:0/4205717391 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44fb7fe640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44fc0b9720 0x7f44fc157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44faffd640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44fc0ceeb0 0x7f44fc1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44fbfff640 1 -- 172.21.15.55:0/4205717391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44fc0ceeb0 msgr2=0x7f44fc1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44fbfff640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44fc0ceeb0 0x7f44fc1583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44fbfff640 1 -- 172.21.15.55:0/4205717391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44fc0b9720 msgr2=0x7f44fc157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44fbfff640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44fc0b9720 0x7f44fc157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44fbfff640 1 -- 172.21.15.55:0/4205717391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc0cdef0 con 0x7f44fc161090 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44fbfff640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc161090 0x7f44fc0cce70 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009e50 tx=0x7f44f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44e3fff640 1 -- 172.21.15.55:0/4205717391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4040070 con 0x7f44fc161090 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44e3fff640 1 -- 172.21.15.55:0/4205717391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f4031bf0 con 0x7f44fc161090 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f4501dcf640 1 -- 172.21.15.55:0/4205717391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc15d040 con 0x7f44fc161090 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f44e3fff640 1 -- 172.21.15.55:0/4205717391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4009450 con 0x7f44fc161090 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.162+0000 7f4501dcf640 1 -- 172.21.15.55:0/4205717391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc15d600 con 0x7f44fc161090 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.163+0000 7f4501dcf640 1 -- 172.21.15.55:0/4205717391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc15d800 con 0x7f44fc161090 2024-04-25T09:04:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.164+0000 7f44e3fff640 1 -- 172.21.15.55:0/4205717391 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f44f4039040 con 0x7f44fc161090 2024-04-25T09:04:19.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.164+0000 7f44e3fff640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f44e806b4d0 0x7f44e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.164+0000 7f44e3fff640 1 -- 172.21.15.55:0/4205717391 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f44f40ab630 con 0x7f44fc161090 2024-04-25T09:04:19.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.164+0000 7f44fb7fe640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f44e806b4d0 0x7f44e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.165+0000 7f44fb7fe640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f44e806b4d0 0x7f44e806d990 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009aa0 tx=0x7f44ec009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.169+0000 7f44e3fff640 1 -- 172.21.15.55:0/4205717391 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f44fc15d800 con 0x7f44fc161090 2024-04-25T09:04:19.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.348+0000 7f4501dcf640 1 -- 172.21.15.55:0/4205717391 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f44fc0750b0 con 0x7f44e806b4d0 2024-04-25T09:04:19.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.348+0000 7f44e3fff640 1 -- 172.21.15.55:0/4205717391 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f44fc0750b0 con 0x7f44e806b4d0 2024-04-25T09:04:19.336 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T09:04:19.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 -- 172.21.15.55:0/4205717391 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f44e806b4d0 msgr2=0x7f44e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f44e806b4d0 0x7f44e806d990 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009aa0 tx=0x7f44ec009190 comp rx=0 tx=0).stop 2024-04-25T09:04:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 -- 172.21.15.55:0/4205717391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc161090 msgr2=0x7f44fc0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc161090 0x7f44fc0cce70 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009e50 tx=0x7f44f4004a40 comp rx=0 tx=0).stop 2024-04-25T09:04:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 -- 172.21.15.55:0/4205717391 shutdown_connections 2024-04-25T09:04:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f44e806b4d0 0x7f44e806d990 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc161090 0x7f44fc0cce70 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44fc0ceeb0 0x7f44fc1583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 --2- 172.21.15.55:0/4205717391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44fc0b9720 0x7f44fc157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 -- 172.21.15.55:0/4205717391 >> 172.21.15.55:0/4205717391 conn(0x7f44fc0b55e0 msgr2=0x7f44fc0d3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 -- 172.21.15.55:0/4205717391 shutdown_connections 2024-04-25T09:04:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.350+0000 7f4501dcf640 1 -- 172.21.15.55:0/4205717391 wait complete. 2024-04-25T09:04:19.349 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T09:04:19.349 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:04:19.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.466+0000 7f79e436a640 1 Processor -- start 2024-04-25T09:04:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.466+0000 7f79e436a640 1 -- start start 2024-04-25T09:04:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.467+0000 7f79e436a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79dc1610b0 0x7f79dc0b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.467+0000 7f79e436a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f79dc0cef40 0x7f79dc0d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.467+0000 7f79e436a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc162040 con 0x7f79dc1618d0 2024-04-25T09:04:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.467+0000 7f79e436a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc0d1ea0 con 0x7f79dc0cef40 2024-04-25T09:04:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.467+0000 7f79e436a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc162320 con 0x7f79dc1610b0 2024-04-25T09:04:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.467+0000 7f79e2907640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f79dc0cef40 0x7f79dc0d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.467+0000 7f79e2907640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f79dc0cef40 0x7f79dc0d2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57934/0 (socket says 172.21.15.55:57934) 2024-04-25T09:04:19.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.467+0000 7f79e2907640 1 -- 172.21.15.55:0/630632327 learned_addr learned my addr 172.21.15.55:0/630632327 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:19.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.467+0000 7f79e2106640 1 --2- 172.21.15.55:0/630632327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79dc1610b0 0x7f79dc0b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.468+0000 7f79e2907640 1 -- 172.21.15.55:0/630632327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79dc1610b0 msgr2=0x7f79dc0b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.468+0000 7f79e2907640 1 --2- 172.21.15.55:0/630632327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79dc1610b0 0x7f79dc0b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.468+0000 7f79e2907640 1 -- 172.21.15.55:0/630632327 >> v1:172.21.15.167:6789/0 conn(0x7f79dc1618d0 legacy=0x7f79dc0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.468+0000 7f79e2907640 1 -- 172.21.15.55:0/630632327 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc162600 con 0x7f79dc0cef40 2024-04-25T09:04:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.468+0000 7f79e2907640 1 --2- 172.21.15.55:0/630632327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79dc0cef40 0x7f79dc0d2610 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009870 tx=0x7f79d402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f04638296497a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.468+0000 7f79e1104640 1 -- 172.21.15.55:0/630632327 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4037070 con 0x7f79dc0cef40 2024-04-25T09:04:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.469+0000 7f79e1104640 1 -- 172.21.15.55:0/630632327 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d4032440 con 0x7f79dc0cef40 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.469+0000 7f79e1104640 1 -- 172.21.15.55:0/630632327 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4032810 con 0x7f79dc0cef40 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.469+0000 7f79e436a640 1 -- 172.21.15.55:0/630632327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79dc0cef40 msgr2=0x7f79dc0d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.469+0000 7f79e436a640 1 --2- 172.21.15.55:0/630632327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79dc0cef40 0x7f79dc0d2610 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009870 tx=0x7f79d402a1c0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.469+0000 7f79e436a640 1 -- 172.21.15.55:0/630632327 shutdown_connections 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.469+0000 7f79e436a640 1 --2- 172.21.15.55:0/630632327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79dc0cef40 0x7f79dc0d2610 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.469+0000 7f79e436a640 1 --2- 172.21.15.55:0/630632327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79dc1610b0 0x7f79dc0b9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.469+0000 7f79e436a640 1 -- 172.21.15.55:0/630632327 >> 172.21.15.55:0/630632327 conn(0x7f79dc0b5570 msgr2=0x7f79dc0b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.469+0000 7f79e436a640 1 -- 172.21.15.55:0/630632327 shutdown_connections 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.469+0000 7f79e436a640 1 -- 172.21.15.55:0/630632327 wait complete. 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.470+0000 7f79e436a640 1 Processor -- start 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.470+0000 7f79e436a640 1 -- start start 2024-04-25T09:04:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e436a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79dc0cef40 0x7f79dc15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e436a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79dc1610b0 0x7f79dc1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e436a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79dc1618d0 0x7f79dc1f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e436a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc161d10 con 0x7f79dc1618d0 2024-04-25T09:04:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e436a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc0b6c00 con 0x7f79dc1610b0 2024-04-25T09:04:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e436a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc161490 con 0x7f79dc0cef40 2024-04-25T09:04:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e2907640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79dc1618d0 0x7f79dc1f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e2907640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79dc1618d0 0x7f79dc1f7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57936/0 (socket says 172.21.15.55:57936) 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e2907640 1 -- 172.21.15.55:0/205743157 learned_addr learned my addr 172.21.15.55:0/205743157 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e2106640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79dc0cef40 0x7f79dc15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e1905640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79dc1610b0 0x7f79dc1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e2907640 1 -- 172.21.15.55:0/205743157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79dc0cef40 msgr2=0x7f79dc15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e2907640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79dc0cef40 0x7f79dc15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e2907640 1 -- 172.21.15.55:0/205743157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79dc1610b0 msgr2=0x7f79dc1528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e2907640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79dc1610b0 0x7f79dc1528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e2907640 1 -- 172.21.15.55:0/205743157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc1f75a0 con 0x7f79dc1618d0 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e1905640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79dc1610b0 0x7f79dc1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.471+0000 7f79e2106640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79dc0cef40 0x7f79dc15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.472+0000 7f79e2907640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79dc1618d0 0x7f79dc1f7a80 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009870 tx=0x7f79d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.472+0000 7f79d2ffd640 1 -- 172.21.15.55:0/205743157 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4041020 con 0x7f79dc1618d0 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.472+0000 7f79d2ffd640 1 -- 172.21.15.55:0/205743157 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d403d640 con 0x7f79dc1618d0 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.472+0000 7f79e436a640 1 -- 172.21.15.55:0/205743157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc0cd3b0 con 0x7f79dc1618d0 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.472+0000 7f79d2ffd640 1 -- 172.21.15.55:0/205743157 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4037040 con 0x7f79dc1618d0 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.472+0000 7f79e436a640 1 -- 172.21.15.55:0/205743157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc0cd0d0 con 0x7f79dc1618d0 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.473+0000 7f79e436a640 1 -- 172.21.15.55:0/205743157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79dc0750b0 con 0x7f79dc1618d0 2024-04-25T09:04:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.473+0000 7f79d2ffd640 1 -- 172.21.15.55:0/205743157 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f79d4044020 con 0x7f79dc1618d0 2024-04-25T09:04:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.474+0000 7f79d2ffd640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f79c006b4d0 0x7f79c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.474+0000 7f79d2ffd640 1 -- 172.21.15.55:0/205743157 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f79d40aa440 con 0x7f79dc1618d0 2024-04-25T09:04:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.474+0000 7f79e2106640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f79c006b4d0 0x7f79c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.474+0000 7f79d2ffd640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x7f79c00714d0 0x7f79c00738f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.474+0000 7f79d2ffd640 1 -- 172.21.15.55:0/205743157 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79d4043e70 con 0x7f79c00714d0 2024-04-25T09:04:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.474+0000 7f79d2ffd640 1 -- 172.21.15.55:0/205743157 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79d40b1050 con 0x7f79dc1618d0 2024-04-25T09:04:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.474+0000 7f79e1905640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x7f79c00714d0 0x7f79c00738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.474+0000 7f79e2106640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f79c006b4d0 0x7f79c006d990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f79dc06cb70 tx=0x7f79d800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.474+0000 7f79e1905640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x7f79c00714d0 0x7f79c00738f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.475+0000 7f79d2ffd640 1 -- 172.21.15.55:0/205743157 <== osd.2 v2:172.21.15.55:6824/2942240833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f79d4043e70 con 0x7f79c00714d0 2024-04-25T09:04:19.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.488+0000 7f79e436a640 1 -- 172.21.15.55:0/205743157 --> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f79dc0d1770 con 0x7f79c00714d0 2024-04-25T09:04:19.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79d2ffd640 1 -- 172.21.15.55:0/205743157 <== osd.2 v2:172.21.15.55:6824/2942240833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f79dc0d1770 con 0x7f79c00714d0 2024-04-25T09:04:19.477 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:04:19.477 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:04:19.477 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:04:19.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79e436a640 1 -- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x7f79c00714d0 msgr2=0x7f79c00738f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79e436a640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:6824/2942240833,v1:172.21.15.55:6825/2942240833] conn(0x7f79c00714d0 0x7f79c00738f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79e436a640 1 -- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f79c006b4d0 msgr2=0x7f79c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79e436a640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f79c006b4d0 0x7f79c006d990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f79dc06cb70 tx=0x7f79d800b040 comp rx=0 tx=0).stop 2024-04-25T09:04:19.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79e436a640 1 -- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79dc1618d0 msgr2=0x7f79dc1f7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79e436a640 1 --2- 172.21.15.55:0/205743157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79dc1618d0 0x7f79dc1f7a80 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009870 tx=0x7f79d40046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79e2907640 1 -- 172.21.15.55:0/205743157 reap_dead start 2024-04-25T09:04:19.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79e436a640 1 -- 172.21.15.55:0/205743157 shutdown_connections 2024-04-25T09:04:19.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79e436a640 1 -- 172.21.15.55:0/205743157 >> 172.21.15.55:0/205743157 conn(0x7f79dc0b5570 msgr2=0x7f79dc0b7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79e436a640 1 -- 172.21.15.55:0/205743157 shutdown_connections 2024-04-25T09:04:19.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.489+0000 7f79e436a640 1 -- 172.21.15.55:0/205743157 wait complete. 2024-04-25T09:04:19.488 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T09:04:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.601+0000 7fb6c19c1640 1 Processor -- start 2024-04-25T09:04:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.601+0000 7fb6c19c1640 1 -- start start 2024-04-25T09:04:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.601+0000 7fb6c19c1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6bc1610b0 0x7fb6bc0b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6c19c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6bc0cef40 0x7fb6bc0d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6c19c1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc162040 con 0x7fb6bc1618d0 2024-04-25T09:04:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6c19c1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc0d1ea0 con 0x7fb6bc1610b0 2024-04-25T09:04:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6c19c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc162320 con 0x7fb6bc0cef40 2024-04-25T09:04:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6baffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6bc1610b0 0x7fb6bc0b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6baffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6bc1610b0 0x7fb6bc0b9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57950/0 (socket says 172.21.15.55:57950) 2024-04-25T09:04:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6baffd640 1 -- 172.21.15.55:0/3821142580 learned_addr learned my addr 172.21.15.55:0/3821142580 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6bb7fe640 1 --2- 172.21.15.55:0/3821142580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6bc0cef40 0x7fb6bc0d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6baffd640 1 -- 172.21.15.55:0/3821142580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6bc0cef40 msgr2=0x7fb6bc0d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6baffd640 1 --2- 172.21.15.55:0/3821142580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6bc0cef40 0x7fb6bc0d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6baffd640 1 -- 172.21.15.55:0/3821142580 >> v1:172.21.15.167:6789/0 conn(0x7fb6bc1618d0 legacy=0x7fb6bc0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.602+0000 7fb6baffd640 1 -- 172.21.15.55:0/3821142580 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc162600 con 0x7fb6bc1610b0 2024-04-25T09:04:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.603+0000 7fb6baffd640 1 --2- 172.21.15.55:0/3821142580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc1610b0 0x7fb6bc0b9580 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc08c410 tx=0x7fb6ac02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e5d56110a201ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.603+0000 7fb6b9ffb640 1 -- 172.21.15.55:0/3821142580 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac037070 con 0x7fb6bc1610b0 2024-04-25T09:04:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.603+0000 7fb6b9ffb640 1 -- 172.21.15.55:0/3821142580 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac02ae50 con 0x7fb6bc1610b0 2024-04-25T09:04:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.603+0000 7fb6b9ffb640 1 -- 172.21.15.55:0/3821142580 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac032660 con 0x7fb6bc1610b0 2024-04-25T09:04:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.603+0000 7fb6c19c1640 1 -- 172.21.15.55:0/3821142580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc1610b0 msgr2=0x7fb6bc0b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.603+0000 7fb6c19c1640 1 --2- 172.21.15.55:0/3821142580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc1610b0 0x7fb6bc0b9580 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc08c410 tx=0x7fb6ac02a140 comp rx=0 tx=0).stop 2024-04-25T09:04:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.603+0000 7fb6c19c1640 1 -- 172.21.15.55:0/3821142580 shutdown_connections 2024-04-25T09:04:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.603+0000 7fb6c19c1640 1 --2- 172.21.15.55:0/3821142580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6bc0cef40 0x7fb6bc0d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.603+0000 7fb6c19c1640 1 --2- 172.21.15.55:0/3821142580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc1610b0 0x7fb6bc0b9580 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.603+0000 7fb6c19c1640 1 -- 172.21.15.55:0/3821142580 >> 172.21.15.55:0/3821142580 conn(0x7fb6bc0b5570 msgr2=0x7fb6bc0b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.603+0000 7fb6c19c1640 1 -- 172.21.15.55:0/3821142580 shutdown_connections 2024-04-25T09:04:19.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.604+0000 7fb6c19c1640 1 -- 172.21.15.55:0/3821142580 wait complete. 2024-04-25T09:04:19.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.605+0000 7fb6c19c1640 1 Processor -- start 2024-04-25T09:04:19.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.605+0000 7fb6c19c1640 1 -- start start 2024-04-25T09:04:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.605+0000 7fb6c19c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc0cef40 0x7fb6bc1e8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.605+0000 7fb6c19c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6bc1610b0 0x7fb6bc152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6c19c1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6bc1618d0 0x7fb6bc155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6c19c1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc161d10 con 0x7fb6bc0cef40 2024-04-25T09:04:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6c19c1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0b6c00 con 0x7fb6bc1618d0 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6c19c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc161490 con 0x7fb6bc1610b0 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6baffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc0cef40 0x7fb6bc1e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6baffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc0cef40 0x7fb6bc1e8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57952/0 (socket says 172.21.15.55:57952) 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6baffd640 1 -- 172.21.15.55:0/2677475447 learned_addr learned my addr 172.21.15.55:0/2677475447 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6bb7fe640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6bc1618d0 0x7fb6bc155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6ba7fc640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6bc1610b0 0x7fb6bc152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6baffd640 1 -- 172.21.15.55:0/2677475447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6bc1610b0 msgr2=0x7fb6bc152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6baffd640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6bc1610b0 0x7fb6bc152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6baffd640 1 -- 172.21.15.55:0/2677475447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6bc1618d0 msgr2=0x7fb6bc155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6baffd640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6bc1618d0 0x7fb6bc155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6baffd640 1 -- 172.21.15.55:0/2677475447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc1f8280 con 0x7fb6bc0cef40 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6bb7fe640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6bc1618d0 0x7fb6bc155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6baffd640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc0cef40 0x7fb6bc1e8090 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac02a180 tx=0x7fb6ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6a3fff640 1 -- 172.21.15.55:0/2677475447 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac042070 con 0x7fb6bc0cef40 2024-04-25T09:04:19.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6a3fff640 1 -- 172.21.15.55:0/2677475447 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac03e670 con 0x7fb6bc0cef40 2024-04-25T09:04:19.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6c19c1640 1 -- 172.21.15.55:0/2677475447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc1f7700 con 0x7fb6bc0cef40 2024-04-25T09:04:19.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6a3fff640 1 -- 172.21.15.55:0/2677475447 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac037040 con 0x7fb6bc0cef40 2024-04-25T09:04:19.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.606+0000 7fb6c19c1640 1 -- 172.21.15.55:0/2677475447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc1f7cc0 con 0x7fb6bc0cef40 2024-04-25T09:04:19.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.608+0000 7fb6c19c1640 1 -- 172.21.15.55:0/2677475447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc0750b0 con 0x7fb6bc0cef40 2024-04-25T09:04:19.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.608+0000 7fb6a3fff640 1 -- 172.21.15.55:0/2677475447 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb6ac045070 con 0x7fb6bc0cef40 2024-04-25T09:04:19.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.608+0000 7fb6a3fff640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb6a806b4d0 0x7fb6a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.608+0000 7fb6a3fff640 1 -- 172.21.15.55:0/2677475447 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fb6ac0aa6e0 con 0x7fb6bc0cef40 2024-04-25T09:04:19.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.609+0000 7fb6ba7fc640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb6a806b4d0 0x7fb6a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.609+0000 7fb6ba7fc640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb6a806b4d0 0x7fb6a806d990 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0006fd0 tx=0x7fb6b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.613+0000 7fb6a3fff640 1 -- 172.21.15.55:0/2677475447 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6ac0797b0 con 0x7fb6bc0cef40 2024-04-25T09:04:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.797+0000 7fb6c19c1640 1 -- 172.21.15.55:0/2677475447 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6bc1f8060 con 0x7fb6a806b4d0 2024-04-25T09:04:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.797+0000 7fb6a3fff640 1 -- 172.21.15.55:0/2677475447 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb6bc1f8060 con 0x7fb6a806b4d0 2024-04-25T09:04:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T09:04:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 -- 172.21.15.55:0/2677475447 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb6a806b4d0 msgr2=0x7fb6a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb6a806b4d0 0x7fb6a806d990 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0006fd0 tx=0x7fb6b0008040 comp rx=0 tx=0).stop 2024-04-25T09:04:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 -- 172.21.15.55:0/2677475447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc0cef40 msgr2=0x7fb6bc1e8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc0cef40 0x7fb6bc1e8090 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac02a180 tx=0x7fb6ac0046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 -- 172.21.15.55:0/2677475447 shutdown_connections 2024-04-25T09:04:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb6a806b4d0 0x7fb6a806d990 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6bc1618d0 0x7fb6bc155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6bc1610b0 0x7fb6bc152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 --2- 172.21.15.55:0/2677475447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc0cef40 0x7fb6bc1e8090 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 -- 172.21.15.55:0/2677475447 >> 172.21.15.55:0/2677475447 conn(0x7fb6bc0b5570 msgr2=0x7fb6bc0ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 -- 172.21.15.55:0/2677475447 shutdown_connections 2024-04-25T09:04:19.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.799+0000 7fb6c19c1640 1 -- 172.21.15.55:0/2677475447 wait complete. 2024-04-25T09:04:19.799 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T09:04:19.799 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:04:19.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.915+0000 7f4295170640 1 Processor -- start 2024-04-25T09:04:19.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.915+0000 7f4295170640 1 -- start start 2024-04-25T09:04:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.916+0000 7f4295170640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42900b9720 0x7f42900ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.916+0000 7f4295170640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f42900cece0 0x7f42900d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.916+0000 7f4295170640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4290161f80 con 0x7f4290161090 2024-04-25T09:04:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.916+0000 7f4295170640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42900cf130 con 0x7f42900cece0 2024-04-25T09:04:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.916+0000 7f4295170640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42900d21a0 con 0x7f42900b9720 2024-04-25T09:04:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.916+0000 7f428ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4290161090 0x7f4290161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45840/0 (socket says 172.21.15.55:45840) 2024-04-25T09:04:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.916+0000 7f428ed9d640 1 -- 172.21.15.55:0/2274289678 learned_addr learned my addr 172.21.15.55:0/2274289678 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:19.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.917+0000 7f428f59e640 1 --2- 172.21.15.55:0/2274289678 >> v2:172.21.15.167:3300/0 conn(0x7f42900cece0 0x7f42900d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.917+0000 7f428e59c640 1 --2- 172.21.15.55:0/2274289678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42900b9720 0x7f42900ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.917+0000 7f428dd9b640 1 -- 172.21.15.55:0/2274289678 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914898619 0 0) 0x7f4290161f80 con 0x7f4290161090 2024-04-25T09:04:19.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.917+0000 7f428dd9b640 1 -- 172.21.15.55:0/2274289678 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f427c003520 con 0x7f4290161090 2024-04-25T09:04:19.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.917+0000 7f428e59c640 1 -- 172.21.15.55:0/2274289678 >> v2:172.21.15.167:3300/0 conn(0x7f42900cece0 msgr2=0x7f42900d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.917+0000 7f428e59c640 1 --2- 172.21.15.55:0/2274289678 >> v2:172.21.15.167:3300/0 conn(0x7f42900cece0 0x7f42900d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.917+0000 7f428e59c640 1 -- 172.21.15.55:0/2274289678 >> v1:172.21.15.55:6789/0 conn(0x7f4290161090 legacy=0x7f4290161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.917+0000 7f428e59c640 1 -- 172.21.15.55:0/2274289678 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4290162260 con 0x7f42900b9720 2024-04-25T09:04:19.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f428e59c640 1 --2- 172.21.15.55:0/2274289678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42900b9720 0x7f42900ce7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f42780097a0 tx=0x7f427802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a2fe584d44d2d06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f428dd9b640 1 -- 172.21.15.55:0/2274289678 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278037070 con 0x7f42900b9720 2024-04-25T09:04:19.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f428dd9b640 1 -- 172.21.15.55:0/2274289678 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278032440 con 0x7f42900b9720 2024-04-25T09:04:19.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f428dd9b640 1 -- 172.21.15.55:0/2274289678 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278032810 con 0x7f42900b9720 2024-04-25T09:04:19.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f4295170640 1 -- 172.21.15.55:0/2274289678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42900b9720 msgr2=0x7f42900ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f4295170640 1 --2- 172.21.15.55:0/2274289678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42900b9720 0x7f42900ce7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f42780097a0 tx=0x7f427802a180 comp rx=0 tx=0).stop 2024-04-25T09:04:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f4295170640 1 -- 172.21.15.55:0/2274289678 shutdown_connections 2024-04-25T09:04:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f4295170640 1 --2- 172.21.15.55:0/2274289678 >> v2:172.21.15.167:3300/0 conn(0x7f42900cece0 0x7f42900d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f4295170640 1 --2- 172.21.15.55:0/2274289678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42900b9720 0x7f42900ce7a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f4295170640 1 -- 172.21.15.55:0/2274289678 >> 172.21.15.55:0/2274289678 conn(0x7f42900b55e0 msgr2=0x7f42900b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f4295170640 1 -- 172.21.15.55:0/2274289678 shutdown_connections 2024-04-25T09:04:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.918+0000 7f4295170640 1 -- 172.21.15.55:0/2274289678 wait complete. 2024-04-25T09:04:19.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.920+0000 7f4295170640 1 Processor -- start 2024-04-25T09:04:19.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.920+0000 7f4295170640 1 -- start start 2024-04-25T09:04:19.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.920+0000 7f4295170640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42900b9720 0x7f42900cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f4295170640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42900cece0 0x7f42900aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f4295170640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4290161090 0x7f429015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f4295170640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4290161470 con 0x7f42900cece0 2024-04-25T09:04:19.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f4295170640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42900d1e30 con 0x7f42900b9720 2024-04-25T09:04:19.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f4295170640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42900d2b70 con 0x7f4290161090 2024-04-25T09:04:19.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f428e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42900cece0 0x7f42900aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f428e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42900cece0 0x7f42900aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57966/0 (socket says 172.21.15.55:57966) 2024-04-25T09:04:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f428e59c640 1 -- 172.21.15.55:0/1236840082 learned_addr learned my addr 172.21.15.55:0/1236840082 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f428f59e640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4290161090 0x7f429015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f428ed9d640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42900b9720 0x7f42900cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f428e59c640 1 -- 172.21.15.55:0/1236840082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4290161090 msgr2=0x7f429015f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f428e59c640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4290161090 0x7f429015f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f428e59c640 1 -- 172.21.15.55:0/1236840082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42900b9720 msgr2=0x7f42900cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f428e59c640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42900b9720 0x7f42900cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f428e59c640 1 -- 172.21.15.55:0/1236840082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42900ccd30 con 0x7f42900cece0 2024-04-25T09:04:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f428e59c640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42900cece0 0x7f42900aab10 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f4278035040 tx=0x7f42780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f42877fe640 1 -- 172.21.15.55:0/1236840082 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278041030 con 0x7f42900cece0 2024-04-25T09:04:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f42877fe640 1 -- 172.21.15.55:0/1236840082 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427803d4e0 con 0x7f42900cece0 2024-04-25T09:04:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f4295170640 1 -- 172.21.15.55:0/1236840082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42900cd010 con 0x7f42900cece0 2024-04-25T09:04:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f42877fe640 1 -- 172.21.15.55:0/1236840082 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278037040 con 0x7f42900cece0 2024-04-25T09:04:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.921+0000 7f4295170640 1 -- 172.21.15.55:0/1236840082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42900cd5d0 con 0x7f42900cece0 2024-04-25T09:04:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.922+0000 7f4295170640 1 -- 172.21.15.55:0/1236840082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42900750b0 con 0x7f42900cece0 2024-04-25T09:04:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.923+0000 7f42877fe640 1 -- 172.21.15.55:0/1236840082 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4278044070 con 0x7f42900cece0 2024-04-25T09:04:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.923+0000 7f42877fe640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f427006b4d0 0x7f427006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.923+0000 7f42877fe640 1 -- 172.21.15.55:0/1236840082 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f42780aafc0 con 0x7f42900cece0 2024-04-25T09:04:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.923+0000 7f428ed9d640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f427006b4d0 0x7f427006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.924+0000 7f42877fe640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x7f42700714d0 0x7f42700738f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.924+0000 7f42877fe640 1 -- 172.21.15.55:0/1236840082 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4278034e90 con 0x7f42700714d0 2024-04-25T09:04:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.924+0000 7f42877fe640 1 -- 172.21.15.55:0/1236840082 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42780ab370 con 0x7f42900cece0 2024-04-25T09:04:19.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.924+0000 7f428f59e640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x7f42700714d0 0x7f42700738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.924+0000 7f428ed9d640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f427006b4d0 0x7f427006d990 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4288005880 tx=0x7f4288009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.924+0000 7f428f59e640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x7f42700714d0 0x7f42700738f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.925+0000 7f42877fe640 1 -- 172.21.15.55:0/1236840082 <== osd.3 v2:172.21.15.55:6816/2016500802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4278034e90 con 0x7f42700714d0 2024-04-25T09:04:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.938+0000 7f4295170640 1 -- 172.21.15.55:0/1236840082 --> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f42900d1700 con 0x7f42700714d0 2024-04-25T09:04:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.938+0000 7f42877fe640 1 -- 172.21.15.55:0/1236840082 <== osd.3 v2:172.21.15.55:6816/2016500802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f42900d1700 con 0x7f42700714d0 2024-04-25T09:04:19.929 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:04:19.929 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:04:19.929 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:04:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.938+0000 7f4295170640 1 -- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x7f42700714d0 msgr2=0x7f42700738f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.938+0000 7f4295170640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:6816/2016500802,v1:172.21.15.55:6817/2016500802] conn(0x7f42700714d0 0x7f42700738f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.939+0000 7f4295170640 1 -- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f427006b4d0 msgr2=0x7f427006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.939+0000 7f4295170640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f427006b4d0 0x7f427006d990 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4288005880 tx=0x7f4288009040 comp rx=0 tx=0).stop 2024-04-25T09:04:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.939+0000 7f4295170640 1 -- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42900cece0 msgr2=0x7f42900aab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.939+0000 7f4295170640 1 --2- 172.21.15.55:0/1236840082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42900cece0 0x7f42900aab10 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f4278035040 tx=0x7f42780046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.939+0000 7f428f59e640 1 -- 172.21.15.55:0/1236840082 reap_dead start 2024-04-25T09:04:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.939+0000 7f4295170640 1 -- 172.21.15.55:0/1236840082 shutdown_connections 2024-04-25T09:04:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.939+0000 7f4295170640 1 -- 172.21.15.55:0/1236840082 >> 172.21.15.55:0/1236840082 conn(0x7f42900b55e0 msgr2=0x7f42900d2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.939+0000 7f4295170640 1 -- 172.21.15.55:0/1236840082 shutdown_connections 2024-04-25T09:04:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:19.939+0000 7f4295170640 1 -- 172.21.15.55:0/1236840082 wait complete. 2024-04-25T09:04:19.938 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T09:04:20.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.051+0000 7fb185e4a640 1 Processor -- start 2024-04-25T09:04:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.051+0000 7fb185e4a640 1 -- start start 2024-04-25T09:04:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.052+0000 7fb185e4a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1800cef40 0x7fb1800b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.052+0000 7fb185e4a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1801618d0 0x7fb1800d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.052+0000 7fb185e4a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb180161d80 con 0x7fb1801610b0 2024-04-25T09:04:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.052+0000 7fb185e4a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1800d1ea0 con 0x7fb1801618d0 2024-04-25T09:04:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.052+0000 7fb185e4a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb180162040 con 0x7fb1800cef40 2024-04-25T09:04:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.052+0000 7fb17effd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1800cef40 0x7fb1800b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.052+0000 7fb17ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1801618d0 0x7fb1800d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.052+0000 7fb17f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb1801610b0 0x7fb1800ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.55:47994/0 (socket says 172.21.15.55:47994) 2024-04-25T09:04:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.052+0000 7fb17f7fe640 1 -- 172.21.15.55:0/4214623460 learned_addr learned my addr 172.21.15.55:0/4214623460 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.052+0000 7fb17ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1801618d0 0x7fb1800d2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.55:60492/0 (socket says 172.21.15.55:60492) 2024-04-25T09:04:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.052+0000 7fb17effd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1800cef40 0x7fb1800b9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.55:60612/0 (socket says 172.21.15.55:60612) 2024-04-25T09:04:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.053+0000 7fb17ffff640 1 -- 172.21.15.55:0/4214623460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1800cef40 msgr2=0x7fb1800b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.053+0000 7fb17ffff640 1 --2- 172.21.15.55:0/4214623460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1800cef40 0x7fb1800b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.053+0000 7fb17ffff640 1 -- 172.21.15.55:0/4214623460 >> v1:172.21.15.167:6789/0 conn(0x7fb1801610b0 legacy=0x7fb1800ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.053+0000 7fb17e7fc640 1 -- 172.21.15.55:0/4214623460 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800057059 0 0) 0x7fb180161d80 con 0x7fb1801610b0 2024-04-25T09:04:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.053+0000 7fb17ffff640 1 -- 172.21.15.55:0/4214623460 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb180162320 con 0x7fb1801618d0 2024-04-25T09:04:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb17ffff640 1 --2- 172.21.15.55:0/4214623460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1801618d0 0x7fb1800d2610 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb178009d90 tx=0x7fb17802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d30b4e3bca710a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb17e7fc640 1 -- 172.21.15.55:0/4214623460 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178031600 con 0x7fb1801618d0 2024-04-25T09:04:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb17e7fc640 1 -- 172.21.15.55:0/4214623460 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1780317a0 con 0x7fb1801618d0 2024-04-25T09:04:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb17e7fc640 1 -- 172.21.15.55:0/4214623460 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178031b70 con 0x7fb1801618d0 2024-04-25T09:04:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb185e4a640 1 -- 172.21.15.55:0/4214623460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1801618d0 msgr2=0x7fb1800d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb185e4a640 1 --2- 172.21.15.55:0/4214623460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1801618d0 0x7fb1800d2610 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb178009d90 tx=0x7fb17802a5d0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb185e4a640 1 -- 172.21.15.55:0/4214623460 shutdown_connections 2024-04-25T09:04:20.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb185e4a640 1 --2- 172.21.15.55:0/4214623460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1801618d0 0x7fb1800d2610 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb185e4a640 1 --2- 172.21.15.55:0/4214623460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1800cef40 0x7fb1800b9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb185e4a640 1 -- 172.21.15.55:0/4214623460 >> 172.21.15.55:0/4214623460 conn(0x7fb1800b5570 msgr2=0x7fb1800b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb185e4a640 1 -- 172.21.15.55:0/4214623460 shutdown_connections 2024-04-25T09:04:20.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.054+0000 7fb185e4a640 1 -- 172.21.15.55:0/4214623460 wait complete. 2024-04-25T09:04:20.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.056+0000 7fb185e4a640 1 Processor -- start 2024-04-25T09:04:20.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.056+0000 7fb185e4a640 1 -- start start 2024-04-25T09:04:20.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.056+0000 7fb185e4a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1800cef40 0x7fb1800b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.056+0000 7fb185e4a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1801610b0 0x7fb1801f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.056+0000 7fb185e4a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1801618d0 0x7fb18015d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.056+0000 7fb185e4a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1800b6c00 con 0x7fb1800cef40 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.056+0000 7fb185e4a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1800d20f0 con 0x7fb1801610b0 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.056+0000 7fb185e4a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb180161490 con 0x7fb1801618d0 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb17f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1800cef40 0x7fb1800b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb17f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1800cef40 0x7fb1800b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57972/0 (socket says 172.21.15.55:57972) 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb17f7fe640 1 -- 172.21.15.55:0/2865517540 learned_addr learned my addr 172.21.15.55:0/2865517540 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb17effd640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1801610b0 0x7fb1801f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb17ffff640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1801618d0 0x7fb18015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb17f7fe640 1 -- 172.21.15.55:0/2865517540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1801618d0 msgr2=0x7fb18015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb17f7fe640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1801618d0 0x7fb18015d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb17f7fe640 1 -- 172.21.15.55:0/2865517540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1801610b0 msgr2=0x7fb1801f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb17f7fe640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1801610b0 0x7fb1801f4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb17f7fe640 1 -- 172.21.15.55:0/2865517540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18015d980 con 0x7fb1800cef40 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb17f7fe640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1800cef40 0x7fb1800b4fa0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fb17000c4d0 tx=0x7fb17000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb167fff640 1 -- 172.21.15.55:0/2865517540 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170018070 con 0x7fb1800cef40 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb167fff640 1 -- 172.21.15.55:0/2865517540 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb170007500 con 0x7fb1800cef40 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb185e4a640 1 -- 172.21.15.55:0/2865517540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1801f3740 con 0x7fb1800cef40 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb167fff640 1 -- 172.21.15.55:0/2865517540 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170004a20 con 0x7fb1800cef40 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.057+0000 7fb185e4a640 1 -- 172.21.15.55:0/2865517540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18015dee0 con 0x7fb1800cef40 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.058+0000 7fb185e4a640 1 -- 172.21.15.55:0/2865517540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1800750b0 con 0x7fb1800cef40 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.059+0000 7fb167fff640 1 -- 172.21.15.55:0/2865517540 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb17001b070 con 0x7fb1800cef40 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.059+0000 7fb167fff640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb16c06b4d0 0x7fb16c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.059+0000 7fb17effd640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb16c06b4d0 0x7fb16c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.059+0000 7fb167fff640 1 -- 172.21.15.55:0/2865517540 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fb170089170 con 0x7fb1800cef40 2024-04-25T09:04:20.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.060+0000 7fb17effd640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb16c06b4d0 0x7fb16c06d990 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb1800d3880 tx=0x7fb174009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.064+0000 7fb167fff640 1 -- 172.21.15.55:0/2865517540 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb18015d980 con 0x7fb1800cef40 2024-04-25T09:04:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.246+0000 7fb185e4a640 1 -- 172.21.15.55:0/2865517540 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1800d17a0 con 0x7fb16c06b4d0 2024-04-25T09:04:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.247+0000 7fb167fff640 1 -- 172.21.15.55:0/2865517540 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb1800d17a0 con 0x7fb16c06b4d0 2024-04-25T09:04:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T09:04:20.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 -- 172.21.15.55:0/2865517540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb16c06b4d0 msgr2=0x7fb16c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb16c06b4d0 0x7fb16c06d990 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb1800d3880 tx=0x7fb174009190 comp rx=0 tx=0).stop 2024-04-25T09:04:20.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 -- 172.21.15.55:0/2865517540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1800cef40 msgr2=0x7fb1800b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1800cef40 0x7fb1800b4fa0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fb17000c4d0 tx=0x7fb17000c990 comp rx=0 tx=0).stop 2024-04-25T09:04:20.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 -- 172.21.15.55:0/2865517540 shutdown_connections 2024-04-25T09:04:20.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fb16c06b4d0 0x7fb16c06d990 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1801618d0 0x7fb18015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1801610b0 0x7fb1801f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 --2- 172.21.15.55:0/2865517540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1800cef40 0x7fb1800b4fa0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 -- 172.21.15.55:0/2865517540 >> 172.21.15.55:0/2865517540 conn(0x7fb1800b5570 msgr2=0x7fb1800b7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 -- 172.21.15.55:0/2865517540 shutdown_connections 2024-04-25T09:04:20.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.249+0000 7fb185e4a640 1 -- 172.21.15.55:0/2865517540 wait complete. 2024-04-25T09:04:20.248 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T09:04:20.248 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:04:20.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.365+0000 7f1da395c640 1 Processor -- start 2024-04-25T09:04:20.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.365+0000 7f1da395c640 1 -- start start 2024-04-25T09:04:20.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da395c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1d9c0b9720 0x7f1d9c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da395c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d9c0cece0 0x7f1d9c0d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da395c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c0cf0f0 con 0x7f1d9c161090 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da395c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c0d21a0 con 0x7f1d9c0cece0 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da395c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c161f80 con 0x7f1d9c0b9720 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da16f8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1d9c161090 0x7f1d9c161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45848/0 (socket says 172.21.15.55:45848) 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da1ef9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d9c0cece0 0x7f1d9c0d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da16f8640 1 -- 172.21.15.55:0/1594814915 learned_addr learned my addr 172.21.15.55:0/1594814915 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da0ef7640 1 --2- 172.21.15.55:0/1594814915 >> v2:172.21.15.167:3300/0 conn(0x7f1d9c0b9720 0x7f1d9c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da1ef9640 1 -- 172.21.15.55:0/1594814915 >> v2:172.21.15.167:3300/0 conn(0x7f1d9c0b9720 msgr2=0x7f1d9c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da1ef9640 1 --2- 172.21.15.55:0/1594814915 >> v2:172.21.15.167:3300/0 conn(0x7f1d9c0b9720 0x7f1d9c0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da1ef9640 1 -- 172.21.15.55:0/1594814915 >> v1:172.21.15.55:6789/0 conn(0x7f1d9c161090 legacy=0x7f1d9c161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1d93fff640 1 -- 172.21.15.55:0/1594814915 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340181752 0 0) 0x7f1d98001110 con 0x7f1d9c161090 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.366+0000 7f1da1ef9640 1 -- 172.21.15.55:0/1594814915 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c162260 con 0x7f1d9c0cece0 2024-04-25T09:04:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.367+0000 7f1da1ef9640 1 --2- 172.21.15.55:0/1594814915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d9c0cece0 0x7f1d9c0d2630 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c08cf10 tx=0x7f1d9402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc480a49ca19a5b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.367+0000 7f1d93fff640 1 -- 172.21.15.55:0/1594814915 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94007740 con 0x7f1d9c0cece0 2024-04-25T09:04:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.367+0000 7f1d93fff640 1 -- 172.21.15.55:0/1594814915 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d940078e0 con 0x7f1d9c0cece0 2024-04-25T09:04:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.367+0000 7f1d93fff640 1 -- 172.21.15.55:0/1594814915 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94007cb0 con 0x7f1d9c0cece0 2024-04-25T09:04:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.367+0000 7f1da395c640 1 -- 172.21.15.55:0/1594814915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d9c0cece0 msgr2=0x7f1d9c0d2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.367+0000 7f1da395c640 1 --2- 172.21.15.55:0/1594814915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d9c0cece0 0x7f1d9c0d2630 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c08cf10 tx=0x7f1d9402a5f0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.368+0000 7f1da395c640 1 -- 172.21.15.55:0/1594814915 shutdown_connections 2024-04-25T09:04:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.368+0000 7f1da395c640 1 --2- 172.21.15.55:0/1594814915 >> v2:172.21.15.167:3300/0 conn(0x7f1d9c0b9720 0x7f1d9c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.368+0000 7f1da395c640 1 --2- 172.21.15.55:0/1594814915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d9c0cece0 0x7f1d9c0d2630 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.368+0000 7f1da395c640 1 -- 172.21.15.55:0/1594814915 >> 172.21.15.55:0/1594814915 conn(0x7f1d9c0b55e0 msgr2=0x7f1d9c0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.368+0000 7f1da395c640 1 -- 172.21.15.55:0/1594814915 shutdown_connections 2024-04-25T09:04:20.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.368+0000 7f1da395c640 1 -- 172.21.15.55:0/1594814915 wait complete. 2024-04-25T09:04:20.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.369+0000 7f1da395c640 1 Processor -- start 2024-04-25T09:04:20.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.369+0000 7f1da395c640 1 -- start start 2024-04-25T09:04:20.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.369+0000 7f1da395c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d9c0b9720 0x7f1d9c154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da395c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d9c0cece0 0x7f1d9c14af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da395c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d9c161090 0x7f1d9c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da395c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c161470 con 0x7f1d9c0b9720 2024-04-25T09:04:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da395c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0d1e30 con 0x7f1d9c161090 2024-04-25T09:04:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da395c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0d2b70 con 0x7f1d9c0cece0 2024-04-25T09:04:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da16f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d9c0b9720 0x7f1d9c154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da16f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d9c0b9720 0x7f1d9c154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57982/0 (socket says 172.21.15.55:57982) 2024-04-25T09:04:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da16f8640 1 -- 172.21.15.55:0/764374693 learned_addr learned my addr 172.21.15.55:0/764374693 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da1ef9640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d9c161090 0x7f1d9c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da0ef7640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d9c0cece0 0x7f1d9c14af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da16f8640 1 -- 172.21.15.55:0/764374693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d9c0cece0 msgr2=0x7f1d9c14af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da16f8640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d9c0cece0 0x7f1d9c14af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da16f8640 1 -- 172.21.15.55:0/764374693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d9c161090 msgr2=0x7f1d9c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da16f8640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d9c161090 0x7f1d9c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da16f8640 1 -- 172.21.15.55:0/764374693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c0cbb20 con 0x7f1d9c0b9720 2024-04-25T09:04:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da16f8640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d9c0b9720 0x7f1d9c154f90 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800c430 tx=0x7f1d9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1d91ffb640 1 -- 172.21.15.55:0/764374693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d980074e0 con 0x7f1d9c0b9720 2024-04-25T09:04:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1d91ffb640 1 -- 172.21.15.55:0/764374693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d980047e0 con 0x7f1d9c0b9720 2024-04-25T09:04:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1d91ffb640 1 -- 172.21.15.55:0/764374693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98004bd0 con 0x7f1d9c0b9720 2024-04-25T09:04:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.370+0000 7f1da395c640 1 -- 172.21.15.55:0/764374693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c0cbe00 con 0x7f1d9c0b9720 2024-04-25T09:04:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.371+0000 7f1da395c640 1 -- 172.21.15.55:0/764374693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c0cc3c0 con 0x7f1d9c0b9720 2024-04-25T09:04:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.371+0000 7f1da395c640 1 -- 172.21.15.55:0/764374693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d9c0750b0 con 0x7f1d9c0b9720 2024-04-25T09:04:20.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.372+0000 7f1d91ffb640 1 -- 172.21.15.55:0/764374693 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d98011070 con 0x7f1d9c0b9720 2024-04-25T09:04:20.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.372+0000 7f1d91ffb640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d8006b4d0 0x7f1d8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.372+0000 7f1d91ffb640 1 -- 172.21.15.55:0/764374693 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f1d98089ae0 con 0x7f1d9c0b9720 2024-04-25T09:04:20.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.373+0000 7f1da0ef7640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d8006b4d0 0x7f1d8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.373+0000 7f1d91ffb640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x7f1d800714d0 0x7f1d800738f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.373+0000 7f1d91ffb640 1 -- 172.21.15.55:0/764374693 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d9801ce80 con 0x7f1d800714d0 2024-04-25T09:04:20.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.373+0000 7f1d91ffb640 1 -- 172.21.15.55:0/764374693 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d9808e2c0 con 0x7f1d9c0b9720 2024-04-25T09:04:20.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.373+0000 7f1da0ef7640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d8006b4d0 0x7f1d8006d990 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c155870 tx=0x7f1d8c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.373+0000 7f1da1ef9640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x7f1d800714d0 0x7f1d800738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.373+0000 7f1da1ef9640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x7f1d800714d0 0x7f1d800738f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.374+0000 7f1d91ffb640 1 -- 172.21.15.55:0/764374693 <== osd.4 v2:172.21.15.167:6808/1392386852 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1d9801ce80 con 0x7f1d800714d0 2024-04-25T09:04:20.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.387+0000 7f1da395c640 1 -- 172.21.15.55:0/764374693 --> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1d9c0d1700 con 0x7f1d800714d0 2024-04-25T09:04:20.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1d91ffb640 1 -- 172.21.15.55:0/764374693 <== osd.4 v2:172.21.15.167:6808/1392386852 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1d9c0d1700 con 0x7f1d800714d0 2024-04-25T09:04:20.376 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:04:20.376 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:04:20.376 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:04:20.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1da395c640 1 -- 172.21.15.55:0/764374693 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x7f1d800714d0 msgr2=0x7f1d800738f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1da395c640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.167:6808/1392386852,v1:172.21.15.167:6809/1392386852] conn(0x7f1d800714d0 0x7f1d800738f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1da395c640 1 -- 172.21.15.55:0/764374693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d8006b4d0 msgr2=0x7f1d8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1da395c640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f1d8006b4d0 0x7f1d8006d990 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c155870 tx=0x7f1d8c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:20.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1da395c640 1 -- 172.21.15.55:0/764374693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d9c0b9720 msgr2=0x7f1d9c154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1da395c640 1 --2- 172.21.15.55:0/764374693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d9c0b9720 0x7f1d9c154f90 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800c430 tx=0x7f1d9800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1da1ef9640 1 -- 172.21.15.55:0/764374693 reap_dead start 2024-04-25T09:04:20.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1da395c640 1 -- 172.21.15.55:0/764374693 shutdown_connections 2024-04-25T09:04:20.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1da395c640 1 -- 172.21.15.55:0/764374693 >> 172.21.15.55:0/764374693 conn(0x7f1d9c0b55e0 msgr2=0x7f1d9c0cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1da395c640 1 -- 172.21.15.55:0/764374693 shutdown_connections 2024-04-25T09:04:20.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.388+0000 7f1da395c640 1 -- 172.21.15.55:0/764374693 wait complete. 2024-04-25T09:04:20.387 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T09:04:20.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.501+0000 7f6b0a8a3640 1 Processor -- start 2024-04-25T09:04:20.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.501+0000 7f6b0a8a3640 1 -- start start 2024-04-25T09:04:20.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.501+0000 7f6b0a8a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b041610b0 0x7f6b040b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b0a8a3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6b041618d0 0x7f6b040ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b0a8a3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b04162040 con 0x7f6b040ced70 2024-04-25T09:04:20.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b0a8a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b040cf1c0 con 0x7f6b041610b0 2024-04-25T09:04:20.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b0a8a3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b040d1ea0 con 0x7f6b041618d0 2024-04-25T09:04:20.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b03fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b041610b0 0x7f6b040b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b03fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b041610b0 0x7f6b040b9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57992/0 (socket says 172.21.15.55:57992) 2024-04-25T09:04:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b03fff640 1 -- 172.21.15.55:0/2101291357 learned_addr learned my addr 172.21.15.55:0/2101291357 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b037fe640 1 --2- 172.21.15.55:0/2101291357 >> v2:172.21.15.167:3300/0 conn(0x7f6b041618d0 0x7f6b040ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b03fff640 1 -- 172.21.15.55:0/2101291357 >> v2:172.21.15.167:3300/0 conn(0x7f6b041618d0 msgr2=0x7f6b040ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b03fff640 1 --2- 172.21.15.55:0/2101291357 >> v2:172.21.15.167:3300/0 conn(0x7f6b041618d0 0x7f6b040ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b03fff640 1 -- 172.21.15.55:0/2101291357 >> v1:172.21.15.167:6789/0 conn(0x7f6b040ced70 legacy=0x7f6b0406c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.502+0000 7f6b03fff640 1 -- 172.21.15.55:0/2101291357 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04162320 con 0x7f6b041610b0 2024-04-25T09:04:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.503+0000 7f6b03fff640 1 --2- 172.21.15.55:0/2101291357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b041610b0 0x7f6b040b9580 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f6b0406d320 tx=0x7f6af402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9825d058548deab1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.503+0000 7f6b02ffd640 1 -- 172.21.15.55:0/2101291357 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4037070 con 0x7f6b041610b0 2024-04-25T09:04:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.503+0000 7f6b02ffd640 1 -- 172.21.15.55:0/2101291357 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af4032440 con 0x7f6b041610b0 2024-04-25T09:04:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.503+0000 7f6b02ffd640 1 -- 172.21.15.55:0/2101291357 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4032810 con 0x7f6b041610b0 2024-04-25T09:04:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.503+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/2101291357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b041610b0 msgr2=0x7f6b040b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.503+0000 7f6b0a8a3640 1 --2- 172.21.15.55:0/2101291357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b041610b0 0x7f6b040b9580 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f6b0406d320 tx=0x7f6af402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.503+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/2101291357 shutdown_connections 2024-04-25T09:04:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.503+0000 7f6b0a8a3640 1 --2- 172.21.15.55:0/2101291357 >> v2:172.21.15.167:3300/0 conn(0x7f6b041618d0 0x7f6b040ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.503+0000 7f6b0a8a3640 1 --2- 172.21.15.55:0/2101291357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b041610b0 0x7f6b040b9580 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.503+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/2101291357 >> 172.21.15.55:0/2101291357 conn(0x7f6b040b5570 msgr2=0x7f6b040b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.504+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/2101291357 shutdown_connections 2024-04-25T09:04:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.504+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/2101291357 wait complete. 2024-04-25T09:04:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.505+0000 7f6b0a8a3640 1 Processor -- start 2024-04-25T09:04:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.505+0000 7f6b0a8a3640 1 -- start start 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b0a8a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b040ced70 0x7f6b0415e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b0a8a3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b041610b0 0x7f6b04148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b0a8a3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b041618d0 0x7f6b040cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b0a8a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b040b6c00 con 0x7f6b040ced70 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b0a8a3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b040d20f0 con 0x7f6b041618d0 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b0a8a3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b04161d10 con 0x7f6b041610b0 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b03fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b040ced70 0x7f6b0415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b03fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b040ced70 0x7f6b0415e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58006/0 (socket says 172.21.15.55:58006) 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b03fff640 1 -- 172.21.15.55:0/543633507 learned_addr learned my addr 172.21.15.55:0/543633507 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b037fe640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b041610b0 0x7f6b04148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b08e40640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b041618d0 0x7f6b040cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b03fff640 1 -- 172.21.15.55:0/543633507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b041610b0 msgr2=0x7f6b04148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b03fff640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b041610b0 0x7f6b04148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b03fff640 1 -- 172.21.15.55:0/543633507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b041618d0 msgr2=0x7f6b040cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b03fff640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b041618d0 0x7f6b040cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b03fff640 1 -- 172.21.15.55:0/543633507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0415ee00 con 0x7f6b040ced70 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b037fe640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b041610b0 0x7f6b04148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b08e40640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b041618d0 0x7f6b040cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b03fff640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b040ced70 0x7f6b0415e770 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f6af402a220 tx=0x7f6af40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b00ff9640 1 -- 172.21.15.55:0/543633507 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4037040 con 0x7f6b040ced70 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b00ff9640 1 -- 172.21.15.55:0/543633507 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af4042070 con 0x7f6b040ced70 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/543633507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0415f0e0 con 0x7f6b040ced70 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b00ff9640 1 -- 172.21.15.55:0/543633507 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4030880 con 0x7f6b040ced70 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.506+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/543633507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0415f6a0 con 0x7f6b040ced70 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.507+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/543633507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b04161490 con 0x7f6b040ced70 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.508+0000 7f6b00ff9640 1 -- 172.21.15.55:0/543633507 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6af4030a20 con 0x7f6b040ced70 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.508+0000 7f6b00ff9640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6af006b4d0 0x7f6af006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.508+0000 7f6b00ff9640 1 -- 172.21.15.55:0/543633507 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f6af40aa790 con 0x7f6b040ced70 2024-04-25T09:04:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.508+0000 7f6b037fe640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6af006b4d0 0x7f6af006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.509+0000 7f6b037fe640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6af006b4d0 0x7f6af006d990 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6b0415e1e0 tx=0x7f6af8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.512+0000 7f6b00ff9640 1 -- 172.21.15.55:0/543633507 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6b04161490 con 0x7f6b040ced70 2024-04-25T09:04:20.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.692+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/543633507 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b040750b0 con 0x7f6af006b4d0 2024-04-25T09:04:20.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.693+0000 7f6b00ff9640 1 -- 172.21.15.55:0/543633507 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6b040750b0 con 0x7f6af006b4d0 2024-04-25T09:04:20.681 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.694+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/543633507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6af006b4d0 msgr2=0x7f6af006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.694+0000 7f6b0a8a3640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6af006b4d0 0x7f6af006d990 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6b0415e1e0 tx=0x7f6af8008040 comp rx=0 tx=0).stop 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.694+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/543633507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b040ced70 msgr2=0x7f6b0415e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.694+0000 7f6b0a8a3640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b040ced70 0x7f6b0415e770 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f6af402a220 tx=0x7f6af40046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.694+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/543633507 shutdown_connections 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.694+0000 7f6b0a8a3640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6af006b4d0 0x7f6af006d990 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.694+0000 7f6b0a8a3640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b041618d0 0x7f6b040cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.694+0000 7f6b0a8a3640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b041610b0 0x7f6b04148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.694+0000 7f6b0a8a3640 1 --2- 172.21.15.55:0/543633507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b040ced70 0x7f6b0415e770 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.694+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/543633507 >> 172.21.15.55:0/543633507 conn(0x7f6b040b5570 msgr2=0x7f6b040b81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.695+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/543633507 shutdown_connections 2024-04-25T09:04:20.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.695+0000 7f6b0a8a3640 1 -- 172.21.15.55:0/543633507 wait complete. 2024-04-25T09:04:20.694 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T09:04:20.694 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:04:20.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.811+0000 7f19f58d2640 1 Processor -- start 2024-04-25T09:04:20.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.811+0000 7f19f58d2640 1 -- start start 2024-04-25T09:04:20.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.811+0000 7f19f58d2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19f00aedc0 0x7f19f015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.811+0000 7f19f58d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19f00b4900 0x7f19f015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.811+0000 7f19f58d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f006da40 con 0x7f19f006d260 2024-04-25T09:04:20.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.811+0000 7f19f58d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f015c050 con 0x7f19f00b4900 2024-04-25T09:04:20.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.811+0000 7f19f58d2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00af1a0 con 0x7f19f00aedc0 2024-04-25T09:04:20.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.812+0000 7f19ef7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19f00b4900 0x7f19f015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.812+0000 7f19ee7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f19f006d260 0x7f19f00b41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45860/0 (socket says 172.21.15.55:45860) 2024-04-25T09:04:20.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.812+0000 7f19ee7fc640 1 -- 172.21.15.55:0/3663914094 learned_addr learned my addr 172.21.15.55:0/3663914094 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:20.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.812+0000 7f19ef7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19f00b4900 0x7f19f015c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58020/0 (socket says 172.21.15.55:58020) 2024-04-25T09:04:20.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.812+0000 7f19ef7fe640 1 -- 172.21.15.55:0/3663914094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19f00aedc0 msgr2=0x7f19f015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.812+0000 7f19eeffd640 1 --2- 172.21.15.55:0/3663914094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19f00aedc0 0x7f19f015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.812+0000 7f19edffb640 1 -- 172.21.15.55:0/3663914094 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058368818 0 0) 0x7f19f006da40 con 0x7f19f006d260 2024-04-25T09:04:20.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.812+0000 7f19ef7fe640 1 --2- 172.21.15.55:0/3663914094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19f00aedc0 0x7f19f015ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.812+0000 7f19ef7fe640 1 -- 172.21.15.55:0/3663914094 >> v1:172.21.15.55:6789/0 conn(0x7f19f006d260 legacy=0x7f19f00b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.812+0000 7f19ef7fe640 1 -- 172.21.15.55:0/3663914094 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f006dd20 con 0x7f19f00b4900 2024-04-25T09:04:20.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19ef7fe640 1 --2- 172.21.15.55:0/3663914094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19f00b4900 0x7f19f015c7c0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f19e800ba40 tx=0x7f19e802c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a09178a8de149d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19edffb640 1 -- 172.21.15.55:0/3663914094 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8031710 con 0x7f19f00b4900 2024-04-25T09:04:20.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19edffb640 1 -- 172.21.15.55:0/3663914094 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e80318b0 con 0x7f19f00b4900 2024-04-25T09:04:20.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19edffb640 1 -- 172.21.15.55:0/3663914094 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8031c80 con 0x7f19f00b4900 2024-04-25T09:04:20.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19f58d2640 1 -- 172.21.15.55:0/3663914094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19f00b4900 msgr2=0x7f19f015c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19f58d2640 1 --2- 172.21.15.55:0/3663914094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19f00b4900 0x7f19f015c7c0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f19e800ba40 tx=0x7f19e802c7b0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19f58d2640 1 -- 172.21.15.55:0/3663914094 shutdown_connections 2024-04-25T09:04:20.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19f58d2640 1 --2- 172.21.15.55:0/3663914094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19f00b4900 0x7f19f015c7c0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19f58d2640 1 --2- 172.21.15.55:0/3663914094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19f00aedc0 0x7f19f015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19f58d2640 1 -- 172.21.15.55:0/3663914094 >> 172.21.15.55:0/3663914094 conn(0x7f19f006aba0 msgr2=0x7f19f006af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19f58d2640 1 -- 172.21.15.55:0/3663914094 shutdown_connections 2024-04-25T09:04:20.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.813+0000 7f19f58d2640 1 -- 172.21.15.55:0/3663914094 wait complete. 2024-04-25T09:04:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.814+0000 7f19f58d2640 1 Processor -- start 2024-04-25T09:04:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.815+0000 7f19f58d2640 1 -- start start 2024-04-25T09:04:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.815+0000 7f19f58d2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19f006d260 0x7f19f00aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.815+0000 7f19f58d2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f00aedc0 0x7f19f01efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.815+0000 7f19f58d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19f00b4900 0x7f19f01f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.815+0000 7f19f58d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f006d6c0 con 0x7f19f00b4900 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.815+0000 7f19f58d2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f015c2a0 con 0x7f19f00aedc0 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.815+0000 7f19f58d2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f015cd00 con 0x7f19f006d260 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.815+0000 7f19ef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19f00b4900 0x7f19f01f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19ef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19f00b4900 0x7f19f01f2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58036/0 (socket says 172.21.15.55:58036) 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19ef7fe640 1 -- 172.21.15.55:0/911669935 learned_addr learned my addr 172.21.15.55:0/911669935 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19eeffd640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19f006d260 0x7f19f00aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19ee7fc640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f00aedc0 0x7f19f01efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19ef7fe640 1 -- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19f006d260 msgr2=0x7f19f00aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19ef7fe640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19f006d260 0x7f19f00aaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19ef7fe640 1 -- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f00aedc0 msgr2=0x7f19f01efd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19ef7fe640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f00aedc0 0x7f19f01efd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19ef7fe640 1 -- 172.21.15.55:0/911669935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f01f0240 con 0x7f19f00b4900 2024-04-25T09:04:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19eeffd640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f19f006d260 0x7f19f00aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19ef7fe640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19f00b4900 0x7f19f01f2ae0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f19e800bb60 tx=0x7f19e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19e7fff640 1 -- 172.21.15.55:0/911669935 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8033c00 con 0x7f19f00b4900 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19e7fff640 1 -- 172.21.15.55:0/911669935 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e8033da0 con 0x7f19f00b4900 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19f58d2640 1 -- 172.21.15.55:0/911669935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f00a9a60 con 0x7f19f00b4900 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19e7fff640 1 -- 172.21.15.55:0/911669935 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e803d630 con 0x7f19f00b4900 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.816+0000 7f19f58d2640 1 -- 172.21.15.55:0/911669935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f00aa020 con 0x7f19f00b4900 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.817+0000 7f19f58d2640 1 -- 172.21.15.55:0/911669935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19f00b0330 con 0x7f19f00b4900 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.818+0000 7f19e7fff640 1 -- 172.21.15.55:0/911669935 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f19e803d7d0 con 0x7f19f00b4900 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.818+0000 7f19e7fff640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f19d006b4d0 0x7f19d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.818+0000 7f19e7fff640 1 -- 172.21.15.55:0/911669935 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f19e80ad670 con 0x7f19f00b4900 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.818+0000 7f19eeffd640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f19d006b4d0 0x7f19d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.818+0000 7f19e7fff640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x7f19d00714d0 0x7f19d00738f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.818+0000 7f19e7fff640 1 -- 172.21.15.55:0/911669935 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19e800b0c0 con 0x7f19d00714d0 2024-04-25T09:04:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.818+0000 7f19e7fff640 1 -- 172.21.15.55:0/911669935 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19e80b4050 con 0x7f19f00b4900 2024-04-25T09:04:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.819+0000 7f19ee7fc640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x7f19d00714d0 0x7f19d00738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.819+0000 7f19eeffd640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f19d006b4d0 0x7f19d006d990 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f19e000e4a0 tx=0x7f19e0007650 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.819+0000 7f19ee7fc640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x7f19d00714d0 0x7f19d00738f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.820+0000 7f19e7fff640 1 -- 172.21.15.55:0/911669935 <== osd.5 v2:172.21.15.167:6800/1337224202 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f19e800b0c0 con 0x7f19d00714d0 2024-04-25T09:04:20.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.833+0000 7f19f58d2640 1 -- 172.21.15.55:0/911669935 --> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f19f00721b0 con 0x7f19d00714d0 2024-04-25T09:04:20.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.833+0000 7f19e7fff640 1 -- 172.21.15.55:0/911669935 <== osd.5 v2:172.21.15.167:6800/1337224202 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f19f00721b0 con 0x7f19d00714d0 2024-04-25T09:04:20.822 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:04:20.822 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:04:20.822 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:04:20.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.834+0000 7f19f58d2640 1 -- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x7f19d00714d0 msgr2=0x7f19d00738f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.834+0000 7f19f58d2640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.167:6800/1337224202,v1:172.21.15.167:6801/1337224202] conn(0x7f19d00714d0 0x7f19d00738f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.834+0000 7f19f58d2640 1 -- 172.21.15.55:0/911669935 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f19d006b4d0 msgr2=0x7f19d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.834+0000 7f19f58d2640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f19d006b4d0 0x7f19d006d990 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f19e000e4a0 tx=0x7f19e0007650 comp rx=0 tx=0).stop 2024-04-25T09:04:20.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.834+0000 7f19f58d2640 1 -- 172.21.15.55:0/911669935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19f00b4900 msgr2=0x7f19f01f2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.834+0000 7f19f58d2640 1 --2- 172.21.15.55:0/911669935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19f00b4900 0x7f19f01f2ae0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f19e800bb60 tx=0x7f19e80046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.834+0000 7f19ef7fe640 1 -- 172.21.15.55:0/911669935 reap_dead start 2024-04-25T09:04:20.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.834+0000 7f19f58d2640 1 -- 172.21.15.55:0/911669935 shutdown_connections 2024-04-25T09:04:20.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.834+0000 7f19f58d2640 1 -- 172.21.15.55:0/911669935 >> 172.21.15.55:0/911669935 conn(0x7f19f006aba0 msgr2=0x7f19f006af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.834+0000 7f19f58d2640 1 -- 172.21.15.55:0/911669935 shutdown_connections 2024-04-25T09:04:20.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.834+0000 7f19f58d2640 1 -- 172.21.15.55:0/911669935 wait complete. 2024-04-25T09:04:20.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T09:04:20.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.946+0000 7fc6ef568640 1 Processor -- start 2024-04-25T09:04:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.946+0000 7fc6ef568640 1 -- start start 2024-04-25T09:04:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.947+0000 7fc6ef568640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc6e8161090 0x7fc6e8161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.947+0000 7fc6ef568640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80ceeb0 0x7fc6e80d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.947+0000 7fc6ef568640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e8161f80 con 0x7fc6e80b9720 2024-04-25T09:04:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.947+0000 7fc6ef568640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e80d21a0 con 0x7fc6e8161090 2024-04-25T09:04:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.947+0000 7fc6ef568640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8162260 con 0x7fc6e80ceeb0 2024-04-25T09:04:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.947+0000 7fc6ecb03640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc6e80b9720 0x7fc6e80ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45876/0 (socket says 172.21.15.55:45876) 2024-04-25T09:04:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.947+0000 7fc6ecb03640 1 -- 172.21.15.55:0/1338429767 learned_addr learned my addr 172.21.15.55:0/1338429767 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.947+0000 7fc6ed304640 1 --2- 172.21.15.55:0/1338429767 >> v2:172.21.15.167:3300/0 conn(0x7fc6e8161090 0x7fc6e8161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.947+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108913693 0 0) 0x7fc6e8161f80 con 0x7fc6e80b9720 2024-04-25T09:04:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.947+0000 7fc6edb05640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80ceeb0 0x7fc6e80d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.947+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d0003520 con 0x7fc6e80b9720 2024-04-25T09:04:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4089564917 0 0) 0x7fc6d0003520 con 0x7fc6e80b9720 2024-04-25T09:04:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80ceeb0 msgr2=0x7fc6e80d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80ceeb0 0x7fc6e80d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 >> v2:172.21.15.167:3300/0 conn(0x7fc6e8161090 msgr2=0x7fc6e8161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 --2- 172.21.15.55:0/1338429767 >> v2:172.21.15.167:3300/0 conn(0x7fc6e8161090 0x7fc6e8161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e8162540 con 0x7fc6e80b9720 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1712550467 0 0) 0x7fc6dc001690 con 0x7fc6e80b9720 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 >> v1:172.21.15.55:6789/0 conn(0x7fc6e80b9720 legacy=0x7fc6e80ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80ceeb0 0x7fc6d00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6d0003f30 0x7fc6d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6d0004d40 0x7fc6d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80d21a0 con 0x7fc6d0004d40 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8162260 con 0x7fc6d0003f30 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d000ba10 con 0x7fc6e80ceeb0 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6edb05640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6d0004d40 0x7fc6d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6ed304640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80ceeb0 0x7fc6d00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6ecb03640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6d0003f30 0x7fc6d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6edb05640 1 -- 172.21.15.55:0/1338429767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80ceeb0 msgr2=0x7fc6d00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6edb05640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80ceeb0 0x7fc6d00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6edb05640 1 -- 172.21.15.55:0/1338429767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6d0003f30 msgr2=0x7fc6d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6edb05640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6d0003f30 0x7fc6d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.948+0000 7fc6edb05640 1 -- 172.21.15.55:0/1338429767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d0003520 con 0x7fc6d0004d40 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.949+0000 7fc6edb05640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6d0004d40 0x7fc6d00051c0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009fc0 tx=0x7fc6d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c1743bea69b604 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.949+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8009c10 con 0x7fc6d0004d40 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.949+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8036070 con 0x7fc6d0004d40 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.949+0000 7fc6e7fff640 1 -- 172.21.15.55:0/1338429767 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8031880 con 0x7fc6d0004d40 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.950+0000 7fc6ef568640 1 -- 172.21.15.55:0/1338429767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6d0004d40 msgr2=0x7fc6d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.950+0000 7fc6ef568640 1 --2- 172.21.15.55:0/1338429767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6d0004d40 0x7fc6d00051c0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009fc0 tx=0x7fc6d0005830 comp rx=0 tx=0).stop 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.950+0000 7fc6edb05640 1 -- 172.21.15.55:0/1338429767 reap_dead start 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.950+0000 7fc6ef568640 1 -- 172.21.15.55:0/1338429767 shutdown_connections 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.950+0000 7fc6ef568640 1 -- 172.21.15.55:0/1338429767 >> 172.21.15.55:0/1338429767 conn(0x7fc6e80b55e0 msgr2=0x7fc6e80b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.950+0000 7fc6ef568640 1 -- 172.21.15.55:0/1338429767 shutdown_connections 2024-04-25T09:04:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.950+0000 7fc6ef568640 1 -- 172.21.15.55:0/1338429767 wait complete. 2024-04-25T09:04:20.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.951+0000 7fc6ef568640 1 Processor -- start 2024-04-25T09:04:20.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.951+0000 7fc6ef568640 1 -- start start 2024-04-25T09:04:20.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ef568640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6d0004d40 0x7fc6e8151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ef568640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e8154c30 0x7fc6e81550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ef568640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6e80cd0e0 0x7fc6e80cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ef568640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8161c70 con 0x7fc6e8154c30 2024-04-25T09:04:20.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ef568640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8161470 con 0x7fc6e80cd0e0 2024-04-25T09:04:20.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ef568640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80d2630 con 0x7fc6d0004d40 2024-04-25T09:04:20.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ecb03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e8154c30 0x7fc6e81550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ecb03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e8154c30 0x7fc6e81550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58054/0 (socket says 172.21.15.55:58054) 2024-04-25T09:04:20.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ecb03640 1 -- 172.21.15.55:0/2137558885 learned_addr learned my addr 172.21.15.55:0/2137558885 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:20.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ed304640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6d0004d40 0x7fc6e8151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6edb05640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6e80cd0e0 0x7fc6e80cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ecb03640 1 -- 172.21.15.55:0/2137558885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6d0004d40 msgr2=0x7fc6e8151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ecb03640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6d0004d40 0x7fc6e8151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ecb03640 1 -- 172.21.15.55:0/2137558885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6e80cd0e0 msgr2=0x7fc6e80cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ecb03640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6e80cd0e0 0x7fc6e80cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ecb03640 1 -- 172.21.15.55:0/2137558885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80cdad0 con 0x7fc6e8154c30 2024-04-25T09:04:20.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6edb05640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6e80cd0e0 0x7fc6e80cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:20.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.952+0000 7fc6ecb03640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e8154c30 0x7fc6e81550b0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc007310 tx=0x7fc6dc007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.953+0000 7fc6e5ffb640 1 -- 172.21.15.55:0/2137558885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc004e10 con 0x7fc6e8154c30 2024-04-25T09:04:20.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.953+0000 7fc6e5ffb640 1 -- 172.21.15.55:0/2137558885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc018070 con 0x7fc6e8154c30 2024-04-25T09:04:20.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.953+0000 7fc6ef568640 1 -- 172.21.15.55:0/2137558885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e80c76d0 con 0x7fc6e8154c30 2024-04-25T09:04:20.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.953+0000 7fc6e5ffb640 1 -- 172.21.15.55:0/2137558885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00fc20 con 0x7fc6e8154c30 2024-04-25T09:04:20.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.953+0000 7fc6ef568640 1 -- 172.21.15.55:0/2137558885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e80c7c90 con 0x7fc6e8154c30 2024-04-25T09:04:20.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.954+0000 7fc6ef568640 1 -- 172.21.15.55:0/2137558885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e80750b0 con 0x7fc6e8154c30 2024-04-25T09:04:20.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.954+0000 7fc6e5ffb640 1 -- 172.21.15.55:0/2137558885 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc6dc01d460 con 0x7fc6e8154c30 2024-04-25T09:04:20.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.955+0000 7fc6e5ffb640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6d406b4d0 0x7fc6d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.955+0000 7fc6ed304640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6d406b4d0 0x7fc6d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.955+0000 7fc6e5ffb640 1 -- 172.21.15.55:0/2137558885 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fc6dc08a100 con 0x7fc6e8154c30 2024-04-25T09:04:20.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.955+0000 7fc6ed304640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6d406b4d0 0x7fc6d406d990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80b81d0 tx=0x7fc6e0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:20.959+0000 7fc6e5ffb640 1 -- 172.21.15.55:0/2137558885 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc6dc0591c0 con 0x7fc6e8154c30 2024-04-25T09:04:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.142+0000 7fc6ef568640 1 -- 172.21.15.55:0/2137558885 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6e80d1700 con 0x7fc6d406b4d0 2024-04-25T09:04:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.142+0000 7fc6e5ffb640 1 -- 172.21.15.55:0/2137558885 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc6e80d1700 con 0x7fc6d406b4d0 2024-04-25T09:04:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T09:04:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 -- 172.21.15.55:0/2137558885 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6d406b4d0 msgr2=0x7fc6d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6d406b4d0 0x7fc6d406d990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80b81d0 tx=0x7fc6e0009190 comp rx=0 tx=0).stop 2024-04-25T09:04:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 -- 172.21.15.55:0/2137558885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e8154c30 msgr2=0x7fc6e81550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e8154c30 0x7fc6e81550b0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc007310 tx=0x7fc6dc007710 comp rx=0 tx=0).stop 2024-04-25T09:04:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 -- 172.21.15.55:0/2137558885 shutdown_connections 2024-04-25T09:04:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fc6d406b4d0 0x7fc6d406d990 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6e80cd0e0 0x7fc6e80cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e8154c30 0x7fc6e81550b0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 --2- 172.21.15.55:0/2137558885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6d0004d40 0x7fc6e8151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 -- 172.21.15.55:0/2137558885 >> 172.21.15.55:0/2137558885 conn(0x7fc6e80b55e0 msgr2=0x7fc6e80d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 -- 172.21.15.55:0/2137558885 shutdown_connections 2024-04-25T09:04:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.144+0000 7fc6ef568640 1 -- 172.21.15.55:0/2137558885 wait complete. 2024-04-25T09:04:21.143 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T09:04:21.143 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:04:21.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.260+0000 7f6464963640 1 Processor -- start 2024-04-25T09:04:21.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.260+0000 7f6464963640 1 -- start start 2024-04-25T09:04:21.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f6464963640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64600cef40 0x7f64600b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f6464963640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64601618d0 0x7f64600d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f6464963640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6460162040 con 0x7f64601610b0 2024-04-25T09:04:21.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f6464963640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64600d1ea0 con 0x7f64600cef40 2024-04-25T09:04:21.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f6464963640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6460162320 con 0x7f64601618d0 2024-04-25T09:04:21.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f645dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64600cef40 0x7f64600b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f645dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64600cef40 0x7f64600b9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58062/0 (socket says 172.21.15.55:58062) 2024-04-25T09:04:21.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f645dd9b640 1 -- 172.21.15.55:0/334643761 learned_addr learned my addr 172.21.15.55:0/334643761 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:21.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f645ed9d640 1 --2- 172.21.15.55:0/334643761 >> v2:172.21.15.167:3300/0 conn(0x7f64601618d0 0x7f64600d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f645dd9b640 1 -- 172.21.15.55:0/334643761 >> v2:172.21.15.167:3300/0 conn(0x7f64601618d0 msgr2=0x7f64600d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f645dd9b640 1 --2- 172.21.15.55:0/334643761 >> v2:172.21.15.167:3300/0 conn(0x7f64601618d0 0x7f64600d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f645dd9b640 1 -- 172.21.15.55:0/334643761 >> v1:172.21.15.167:6789/0 conn(0x7f64601610b0 legacy=0x7f64600ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.261+0000 7f645dd9b640 1 -- 172.21.15.55:0/334643761 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460162600 con 0x7f64600cef40 2024-04-25T09:04:21.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.262+0000 7f645dd9b640 1 --2- 172.21.15.55:0/334643761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64600cef40 0x7f64600b9580 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f64600b9190 tx=0x7f645402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583293786016ab66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.262+0000 7f645d59a640 1 -- 172.21.15.55:0/334643761 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454037070 con 0x7f64600cef40 2024-04-25T09:04:21.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.262+0000 7f645d59a640 1 -- 172.21.15.55:0/334643761 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454032440 con 0x7f64600cef40 2024-04-25T09:04:21.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.262+0000 7f645d59a640 1 -- 172.21.15.55:0/334643761 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454032810 con 0x7f64600cef40 2024-04-25T09:04:21.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.263+0000 7f6464963640 1 -- 172.21.15.55:0/334643761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64600cef40 msgr2=0x7f64600b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.263+0000 7f6464963640 1 --2- 172.21.15.55:0/334643761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64600cef40 0x7f64600b9580 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f64600b9190 tx=0x7f645402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.263+0000 7f6464963640 1 -- 172.21.15.55:0/334643761 shutdown_connections 2024-04-25T09:04:21.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.263+0000 7f6464963640 1 --2- 172.21.15.55:0/334643761 >> v2:172.21.15.167:3300/0 conn(0x7f64601618d0 0x7f64600d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.263+0000 7f6464963640 1 --2- 172.21.15.55:0/334643761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64600cef40 0x7f64600b9580 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.263+0000 7f6464963640 1 -- 172.21.15.55:0/334643761 >> 172.21.15.55:0/334643761 conn(0x7f64600b5570 msgr2=0x7f64600b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.263+0000 7f6464963640 1 -- 172.21.15.55:0/334643761 shutdown_connections 2024-04-25T09:04:21.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.263+0000 7f6464963640 1 -- 172.21.15.55:0/334643761 wait complete. 2024-04-25T09:04:21.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.264+0000 7f6464963640 1 Processor -- start 2024-04-25T09:04:21.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.264+0000 7f6464963640 1 -- start start 2024-04-25T09:04:21.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.265+0000 7f6464963640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64600cef40 0x7f64601539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.265+0000 7f6464963640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64601610b0 0x7f6460152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.265+0000 7f6464963640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64601618d0 0x7f64600cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.265+0000 7f6464963640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6460161d40 con 0x7f64601610b0 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.265+0000 7f6464963640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600b6c00 con 0x7f64601618d0 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.265+0000 7f6464963640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6460161490 con 0x7f64600cef40 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.265+0000 7f645dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64601610b0 0x7f6460152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.265+0000 7f645dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64601610b0 0x7f6460152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58068/0 (socket says 172.21.15.55:58068) 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.265+0000 7f645dd9b640 1 -- 172.21.15.55:0/2207814003 learned_addr learned my addr 172.21.15.55:0/2207814003 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.265+0000 7f645ed9d640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64601618d0 0x7f64600cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.265+0000 7f645e59c640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64600cef40 0x7f64601539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f645dd9b640 1 -- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64600cef40 msgr2=0x7f64601539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f645dd9b640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64600cef40 0x7f64601539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f645dd9b640 1 -- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64601618d0 msgr2=0x7f64600cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f645dd9b640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64601618d0 0x7f64600cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f645dd9b640 1 -- 172.21.15.55:0/2207814003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460154080 con 0x7f64601610b0 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f645e59c640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64600cef40 0x7f64601539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f645dd9b640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64601610b0 0x7f6460152870 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f645402a220 tx=0x7f64540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f644effd640 1 -- 172.21.15.55:0/2207814003 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454037040 con 0x7f64601610b0 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f644effd640 1 -- 172.21.15.55:0/2207814003 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454042070 con 0x7f64601610b0 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f644effd640 1 -- 172.21.15.55:0/2207814003 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454030880 con 0x7f64601610b0 2024-04-25T09:04:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f6464963640 1 -- 172.21.15.55:0/2207814003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6460154360 con 0x7f64601610b0 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.266+0000 7f6464963640 1 -- 172.21.15.55:0/2207814003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6460154920 con 0x7f64601610b0 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.267+0000 7f6464963640 1 -- 172.21.15.55:0/2207814003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64600750b0 con 0x7f64601610b0 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.267+0000 7f644effd640 1 -- 172.21.15.55:0/2207814003 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6454030a20 con 0x7f64601610b0 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.268+0000 7f644effd640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f644006b4d0 0x7f644006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.268+0000 7f644effd640 1 -- 172.21.15.55:0/2207814003 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f64540aa790 con 0x7f64601610b0 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.268+0000 7f645e59c640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f644006b4d0 0x7f644006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.268+0000 7f644effd640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x7f64400714d0 0x7f64400738f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.268+0000 7f644effd640 1 -- 172.21.15.55:0/2207814003 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f645402be50 con 0x7f64400714d0 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.268+0000 7f644effd640 1 -- 172.21.15.55:0/2207814003 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64540af2c0 con 0x7f64601610b0 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.268+0000 7f645e59c640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f644006b4d0 0x7f644006d990 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f64600d3810 tx=0x7f6450009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.268+0000 7f645ed9d640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x7f64400714d0 0x7f64400738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.269+0000 7f645ed9d640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x7f64400714d0 0x7f64400738f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.270+0000 7f644effd640 1 -- 172.21.15.55:0/2207814003 <== osd.6 v2:172.21.15.167:6820/1814554564 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f645402be50 con 0x7f64400714d0 2024-04-25T09:04:21.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.283+0000 7f6464963640 1 -- 172.21.15.55:0/2207814003 --> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f64600b7300 con 0x7f64400714d0 2024-04-25T09:04:21.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f644effd640 1 -- 172.21.15.55:0/2207814003 <== osd.6 v2:172.21.15.167:6820/1814554564 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f64600b7300 con 0x7f64400714d0 2024-04-25T09:04:21.272 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:04:21.272 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:04:21.272 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:04:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f6464963640 1 -- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x7f64400714d0 msgr2=0x7f64400738f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f6464963640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.167:6820/1814554564,v1:172.21.15.167:6823/1814554564] conn(0x7f64400714d0 0x7f64400738f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f6464963640 1 -- 172.21.15.55:0/2207814003 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f644006b4d0 msgr2=0x7f644006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f6464963640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f644006b4d0 0x7f644006d990 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f64600d3810 tx=0x7f6450009040 comp rx=0 tx=0).stop 2024-04-25T09:04:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f6464963640 1 -- 172.21.15.55:0/2207814003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64601610b0 msgr2=0x7f6460152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f6464963640 1 --2- 172.21.15.55:0/2207814003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64601610b0 0x7f6460152870 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f645402a220 tx=0x7f64540046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f645ed9d640 1 -- 172.21.15.55:0/2207814003 reap_dead start 2024-04-25T09:04:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f6464963640 1 -- 172.21.15.55:0/2207814003 shutdown_connections 2024-04-25T09:04:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f6464963640 1 -- 172.21.15.55:0/2207814003 >> 172.21.15.55:0/2207814003 conn(0x7f64600b5570 msgr2=0x7f64600b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f6464963640 1 -- 172.21.15.55:0/2207814003 shutdown_connections 2024-04-25T09:04:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.285+0000 7f6464963640 1 -- 172.21.15.55:0/2207814003 wait complete. 2024-04-25T09:04:21.283 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T09:04:21.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.397+0000 7fed3b038640 1 Processor -- start 2024-04-25T09:04:21.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.397+0000 7fed3b038640 1 -- start start 2024-04-25T09:04:21.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed3b038640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fed3406aba0 0x7fed3406af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed3b038640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed3406f980 0x7fed3406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed3b038640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed34070440 con 0x7fed340cc8c0 2024-04-25T09:04:21.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed3b038640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3415e280 con 0x7fed3406aba0 2024-04-25T09:04:21.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed3b038640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340caed0 con 0x7fed3406f980 2024-04-25T09:04:21.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed38dd4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fed3406aba0 0x7fed3406af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed395d5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fed340cc8c0 0x7fed3406e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45886/0 (socket says 172.21.15.55:45886) 2024-04-25T09:04:21.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed395d5640 1 -- 172.21.15.55:0/2455930678 learned_addr learned my addr 172.21.15.55:0/2455930678 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:21.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed337fe640 1 -- 172.21.15.55:0/2455930678 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829772037 0 0) 0x7fed34070440 con 0x7fed340cc8c0 2024-04-25T09:04:21.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed337fe640 1 -- 172.21.15.55:0/2455930678 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed1c003520 con 0x7fed340cc8c0 2024-04-25T09:04:21.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed33fff640 1 --2- 172.21.15.55:0/2455930678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed3406f980 0x7fed3406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed38dd4640 1 -- 172.21.15.55:0/2455930678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed3406f980 msgr2=0x7fed3406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed38dd4640 1 --2- 172.21.15.55:0/2455930678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed3406f980 0x7fed3406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed38dd4640 1 -- 172.21.15.55:0/2455930678 >> v1:172.21.15.55:6789/0 conn(0x7fed340cc8c0 legacy=0x7fed3406e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.398+0000 7fed38dd4640 1 -- 172.21.15.55:0/2455930678 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3406b4c0 con 0x7fed3406aba0 2024-04-25T09:04:21.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.399+0000 7fed38dd4640 1 --2- 172.21.15.55:0/2455930678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed3406aba0 0x7fed3406af80 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fed240097a0 tx=0x7fed2402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373dd1c91a393b10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.399+0000 7fed337fe640 1 -- 172.21.15.55:0/2455930678 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24037070 con 0x7fed3406aba0 2024-04-25T09:04:21.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.399+0000 7fed337fe640 1 -- 172.21.15.55:0/2455930678 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24032440 con 0x7fed3406aba0 2024-04-25T09:04:21.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.399+0000 7fed337fe640 1 -- 172.21.15.55:0/2455930678 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24032810 con 0x7fed3406aba0 2024-04-25T09:04:21.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.400+0000 7fed3b038640 1 -- 172.21.15.55:0/2455930678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed3406aba0 msgr2=0x7fed3406af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.400+0000 7fed3b038640 1 --2- 172.21.15.55:0/2455930678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed3406aba0 0x7fed3406af80 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fed240097a0 tx=0x7fed2402a180 comp rx=0 tx=0).stop 2024-04-25T09:04:21.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.400+0000 7fed3b038640 1 -- 172.21.15.55:0/2455930678 shutdown_connections 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.400+0000 7fed3b038640 1 --2- 172.21.15.55:0/2455930678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed3406f980 0x7fed3406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.400+0000 7fed3b038640 1 --2- 172.21.15.55:0/2455930678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed3406aba0 0x7fed3406af80 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.400+0000 7fed3b038640 1 -- 172.21.15.55:0/2455930678 >> 172.21.15.55:0/2455930678 conn(0x7fed340d0750 msgr2=0x7fed340d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.400+0000 7fed3b038640 1 -- 172.21.15.55:0/2455930678 shutdown_connections 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.400+0000 7fed3b038640 1 -- 172.21.15.55:0/2455930678 wait complete. 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.401+0000 7fed3b038640 1 Processor -- start 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.401+0000 7fed3b038640 1 -- start start 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed3b038640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed3406aba0 0x7fed3414ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed3b038640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed3406f980 0x7fed3414cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed3b038640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed340cc8c0 0x7fed340b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed3b038640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed340cb170 con 0x7fed3406f980 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed3b038640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed34070160 con 0x7fed3406aba0 2024-04-25T09:04:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed3b038640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3406b950 con 0x7fed340cc8c0 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed33fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed3406f980 0x7fed3414cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed33fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed3406f980 0x7fed3414cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58086/0 (socket says 172.21.15.55:58086) 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed33fff640 1 -- 172.21.15.55:0/1418159326 learned_addr learned my addr 172.21.15.55:0/1418159326 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed395d5640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed340cc8c0 0x7fed340b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed38dd4640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed3406aba0 0x7fed3414ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed33fff640 1 -- 172.21.15.55:0/1418159326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed340cc8c0 msgr2=0x7fed340b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed33fff640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed340cc8c0 0x7fed340b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.402+0000 7fed33fff640 1 -- 172.21.15.55:0/1418159326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed3406aba0 msgr2=0x7fed3414ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.403+0000 7fed33fff640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed3406aba0 0x7fed3414ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.403+0000 7fed33fff640 1 -- 172.21.15.55:0/1418159326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed34159700 con 0x7fed3406f980 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.403+0000 7fed395d5640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed340cc8c0 0x7fed340b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.403+0000 7fed38dd4640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed3406aba0 0x7fed3414ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.403+0000 7fed33fff640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed3406f980 0x7fed3414cb20 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fed2800c7f0 tx=0x7fed2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.403+0000 7fed317fa640 1 -- 172.21.15.55:0/1418159326 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28015070 con 0x7fed3406f980 2024-04-25T09:04:21.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.403+0000 7fed317fa640 1 -- 172.21.15.55:0/1418159326 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed28004240 con 0x7fed3406f980 2024-04-25T09:04:21.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.403+0000 7fed3b038640 1 -- 172.21.15.55:0/1418159326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed340b0d00 con 0x7fed3406f980 2024-04-25T09:04:21.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.403+0000 7fed317fa640 1 -- 172.21.15.55:0/1418159326 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28007620 con 0x7fed3406f980 2024-04-25T09:04:21.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.403+0000 7fed3b038640 1 -- 172.21.15.55:0/1418159326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3414f7e0 con 0x7fed3406f980 2024-04-25T09:04:21.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.404+0000 7fed3b038640 1 -- 172.21.15.55:0/1418159326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed340750b0 con 0x7fed3406f980 2024-04-25T09:04:21.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.404+0000 7fed317fa640 1 -- 172.21.15.55:0/1418159326 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed280077c0 con 0x7fed3406f980 2024-04-25T09:04:21.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.405+0000 7fed317fa640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed2006b4d0 0x7fed2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.405+0000 7fed317fa640 1 -- 172.21.15.55:0/1418159326 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fed2808a2b0 con 0x7fed3406f980 2024-04-25T09:04:21.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.405+0000 7fed38dd4640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed2006b4d0 0x7fed2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.405+0000 7fed38dd4640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed2006b4d0 0x7fed2006d990 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fed24034000 tx=0x7fed2402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.409+0000 7fed317fa640 1 -- 172.21.15.55:0/1418159326 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fed280592f0 con 0x7fed3406f980 2024-04-25T09:04:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.590+0000 7fed3b038640 1 -- 172.21.15.55:0/1418159326 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fed340aec70 con 0x7fed2006b4d0 2024-04-25T09:04:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.591+0000 7fed317fa640 1 -- 172.21.15.55:0/1418159326 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fed340aec70 con 0x7fed2006b4d0 2024-04-25T09:04:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T09:04:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 -- 172.21.15.55:0/1418159326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed2006b4d0 msgr2=0x7fed2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed2006b4d0 0x7fed2006d990 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fed24034000 tx=0x7fed2402e000 comp rx=0 tx=0).stop 2024-04-25T09:04:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 -- 172.21.15.55:0/1418159326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed3406f980 msgr2=0x7fed3414cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed3406f980 0x7fed3414cb20 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fed2800c7f0 tx=0x7fed2800ccb0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 -- 172.21.15.55:0/1418159326 shutdown_connections 2024-04-25T09:04:21.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7fed2006b4d0 0x7fed2006d990 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed340cc8c0 0x7fed340b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed3406f980 0x7fed3414cb20 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 --2- 172.21.15.55:0/1418159326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed3406aba0 0x7fed3414ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 -- 172.21.15.55:0/1418159326 >> 172.21.15.55:0/1418159326 conn(0x7fed340d0750 msgr2=0x7fed3415d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 -- 172.21.15.55:0/1418159326 shutdown_connections 2024-04-25T09:04:21.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.593+0000 7fed3b038640 1 -- 172.21.15.55:0/1418159326 wait complete. 2024-04-25T09:04:21.592 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T09:04:21.592 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:04:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.709+0000 7f6edb130640 1 Processor -- start 2024-04-25T09:04:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.709+0000 7f6edb130640 1 -- start start 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6edb130640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6ed40cef40 0x7f6ed40b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6edb130640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6ed41618d0 0x7f6ed40d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6edb130640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed4162040 con 0x7f6ed41610b0 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6edb130640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed40d1ea0 con 0x7f6ed41618d0 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6edb130640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed4162320 con 0x7f6ed40cef40 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6ed96cd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6ed41618d0 0x7f6ed40d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6ed96cd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6ed41618d0 0x7f6ed40d2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58090/0 (socket says 172.21.15.55:58090) 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6ed96cd640 1 -- 172.21.15.55:0/1125531676 learned_addr learned my addr 172.21.15.55:0/1125531676 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6ed3fff640 1 --2- 172.21.15.55:0/1125531676 >> v2:172.21.15.167:3300/0 conn(0x7f6ed40cef40 0x7f6ed40b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6ed96cd640 1 -- 172.21.15.55:0/1125531676 >> v2:172.21.15.167:3300/0 conn(0x7f6ed40cef40 msgr2=0x7f6ed40b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6ed96cd640 1 --2- 172.21.15.55:0/1125531676 >> v2:172.21.15.167:3300/0 conn(0x7f6ed40cef40 0x7f6ed40b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.710+0000 7f6ed96cd640 1 -- 172.21.15.55:0/1125531676 >> v1:172.21.15.167:6789/0 conn(0x7f6ed41610b0 legacy=0x7f6ed40ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.711+0000 7f6ed96cd640 1 -- 172.21.15.55:0/1125531676 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed4162600 con 0x7f6ed41618d0 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.711+0000 7f6ed96cd640 1 --2- 172.21.15.55:0/1125531676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ed41618d0 0x7f6ed40d2610 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f6ed406d320 tx=0x7f6ebc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773cc936928e66f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.711+0000 7f6ed37fe640 1 -- 172.21.15.55:0/1125531676 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc037070 con 0x7f6ed41618d0 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.711+0000 7f6ed37fe640 1 -- 172.21.15.55:0/1125531676 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc032440 con 0x7f6ed41618d0 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.711+0000 7f6ed37fe640 1 -- 172.21.15.55:0/1125531676 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc032810 con 0x7f6ed41618d0 2024-04-25T09:04:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.712+0000 7f6edb130640 1 -- 172.21.15.55:0/1125531676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ed41618d0 msgr2=0x7f6ed40d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.712+0000 7f6edb130640 1 --2- 172.21.15.55:0/1125531676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ed41618d0 0x7f6ed40d2610 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f6ed406d320 tx=0x7f6ebc02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.712+0000 7f6edb130640 1 -- 172.21.15.55:0/1125531676 shutdown_connections 2024-04-25T09:04:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.712+0000 7f6edb130640 1 --2- 172.21.15.55:0/1125531676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ed41618d0 0x7f6ed40d2610 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.712+0000 7f6edb130640 1 --2- 172.21.15.55:0/1125531676 >> v2:172.21.15.167:3300/0 conn(0x7f6ed40cef40 0x7f6ed40b9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.712+0000 7f6edb130640 1 -- 172.21.15.55:0/1125531676 >> 172.21.15.55:0/1125531676 conn(0x7f6ed40b5570 msgr2=0x7f6ed40b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.712+0000 7f6edb130640 1 -- 172.21.15.55:0/1125531676 shutdown_connections 2024-04-25T09:04:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.712+0000 7f6edb130640 1 -- 172.21.15.55:0/1125531676 wait complete. 2024-04-25T09:04:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.713+0000 7f6edb130640 1 Processor -- start 2024-04-25T09:04:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.713+0000 7f6edb130640 1 -- start start 2024-04-25T09:04:21.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6edb130640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ed40cef40 0x7f6ed4156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6edb130640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ed41610b0 0x7f6ed415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6edb130640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ed41618d0 0x7f6ed40b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6edb130640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed4161d40 con 0x7f6ed41618d0 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6edb130640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed40b6c00 con 0x7f6ed41610b0 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6edb130640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed4161490 con 0x7f6ed40cef40 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6ed96cd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ed41618d0 0x7f6ed40b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6ed96cd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ed41618d0 0x7f6ed40b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58104/0 (socket says 172.21.15.55:58104) 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6ed96cd640 1 -- 172.21.15.55:0/324407079 learned_addr learned my addr 172.21.15.55:0/324407079 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6ed3fff640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ed41610b0 0x7f6ed415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6ed96cd640 1 -- 172.21.15.55:0/324407079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ed40cef40 msgr2=0x7f6ed4156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6ed96cd640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ed40cef40 0x7f6ed4156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6ed96cd640 1 -- 172.21.15.55:0/324407079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ed41610b0 msgr2=0x7f6ed415bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6ed96cd640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ed41610b0 0x7f6ed415bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6ed96cd640 1 -- 172.21.15.55:0/324407079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed415c690 con 0x7f6ed41618d0 2024-04-25T09:04:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.714+0000 7f6ed3fff640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ed41610b0 0x7f6ed415bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.715+0000 7f6ed96cd640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ed41618d0 0x7f6ed40b6d80 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0090b0 tx=0x7f6ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.715+0000 7f6ed17fa640 1 -- 172.21.15.55:0/324407079 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc041020 con 0x7f6ed41618d0 2024-04-25T09:04:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.715+0000 7f6ed17fa640 1 -- 172.21.15.55:0/324407079 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc0306c0 con 0x7f6ed41618d0 2024-04-25T09:04:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.715+0000 7f6edb130640 1 -- 172.21.15.55:0/324407079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed415c970 con 0x7f6ed41618d0 2024-04-25T09:04:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.715+0000 7f6ed17fa640 1 -- 172.21.15.55:0/324407079 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc037040 con 0x7f6ed41618d0 2024-04-25T09:04:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.715+0000 7f6edb130640 1 -- 172.21.15.55:0/324407079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed415cf30 con 0x7f6ed41618d0 2024-04-25T09:04:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.716+0000 7f6edb130640 1 -- 172.21.15.55:0/324407079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ed415d310 con 0x7f6ed41618d0 2024-04-25T09:04:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.716+0000 7f6ed17fa640 1 -- 172.21.15.55:0/324407079 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6ebc044020 con 0x7f6ed41618d0 2024-04-25T09:04:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.717+0000 7f6ed17fa640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6eb406b4d0 0x7f6eb406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.717+0000 7f6ed17fa640 1 -- 172.21.15.55:0/324407079 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f6ebc0aa700 con 0x7f6ed41618d0 2024-04-25T09:04:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.717+0000 7f6ed8ecc640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6eb406b4d0 0x7f6eb406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.717+0000 7f6ed17fa640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x7f6eb40714d0 0x7f6eb40738f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.717+0000 7f6ed17fa640 1 -- 172.21.15.55:0/324407079 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ebc033e50 con 0x7f6eb40714d0 2024-04-25T09:04:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.717+0000 7f6ed17fa640 1 -- 172.21.15.55:0/324407079 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ebc0b1050 con 0x7f6ed41618d0 2024-04-25T09:04:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.717+0000 7f6ed8ecc640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6eb406b4d0 0x7f6eb406d990 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0043c0 tx=0x7f6ecc007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.717+0000 7f6ed3fff640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x7f6eb40714d0 0x7f6eb40738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.718+0000 7f6ed3fff640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x7f6eb40714d0 0x7f6eb40738f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.719+0000 7f6ed17fa640 1 -- 172.21.15.55:0/324407079 <== osd.7 v2:172.21.15.167:6816/2254116283 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6ebc033e50 con 0x7f6eb40714d0 2024-04-25T09:04:21.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.732+0000 7f6edb130640 1 -- 172.21.15.55:0/324407079 --> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6ed40750b0 con 0x7f6eb40714d0 2024-04-25T09:04:21.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.732+0000 7f6ed17fa640 1 -- 172.21.15.55:0/324407079 <== osd.7 v2:172.21.15.167:6816/2254116283 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6ed40750b0 con 0x7f6eb40714d0 2024-04-25T09:04:21.721 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-25T09:04:21.721 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:04:21.721 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-25T09:04:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.733+0000 7f6edb130640 1 -- 172.21.15.55:0/324407079 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x7f6eb40714d0 msgr2=0x7f6eb40738f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.733+0000 7f6edb130640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.167:6816/2254116283,v1:172.21.15.167:6817/2254116283] conn(0x7f6eb40714d0 0x7f6eb40738f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.733+0000 7f6edb130640 1 -- 172.21.15.55:0/324407079 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6eb406b4d0 msgr2=0x7f6eb406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.733+0000 7f6edb130640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f6eb406b4d0 0x7f6eb406d990 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0043c0 tx=0x7f6ecc007d30 comp rx=0 tx=0).stop 2024-04-25T09:04:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.733+0000 7f6edb130640 1 -- 172.21.15.55:0/324407079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ed41618d0 msgr2=0x7f6ed40b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.733+0000 7f6edb130640 1 --2- 172.21.15.55:0/324407079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ed41618d0 0x7f6ed40b6d80 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0090b0 tx=0x7f6ebc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.733+0000 7f6ed96cd640 1 -- 172.21.15.55:0/324407079 reap_dead start 2024-04-25T09:04:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.733+0000 7f6edb130640 1 -- 172.21.15.55:0/324407079 shutdown_connections 2024-04-25T09:04:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.733+0000 7f6edb130640 1 -- 172.21.15.55:0/324407079 >> 172.21.15.55:0/324407079 conn(0x7f6ed40b5570 msgr2=0x7f6ed415f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.733+0000 7f6edb130640 1 -- 172.21.15.55:0/324407079 shutdown_connections 2024-04-25T09:04:21.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.733+0000 7f6edb130640 1 -- 172.21.15.55:0/324407079 wait complete. 2024-04-25T09:04:21.732 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T09:04:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.845+0000 7f71df2f5640 1 Processor -- start 2024-04-25T09:04:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.845+0000 7f71df2f5640 1 -- start start 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71df2f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71d80cef40 0x7f71d80b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71df2f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d8162040 con 0x7f71d81618d0 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71df2f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d8162320 con 0x7f71d81610b0 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71df2f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d80d1ea0 con 0x7f71d80cef40 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71dc890640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71d80cef40 0x7f71d80b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71dd892640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f71d81618d0 0x7f71d80d2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45902/0 (socket says 172.21.15.55:45902) 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71dc890640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71d80cef40 0x7f71d80b9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58112/0 (socket says 172.21.15.55:58112) 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71dd892640 1 -- 172.21.15.55:0/3013773531 learned_addr learned my addr 172.21.15.55:0/3013773531 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71dc890640 1 -- 172.21.15.55:0/3013773531 >> v1:172.21.15.167:6789/0 conn(0x7f71d81610b0 legacy=0x7f71d80ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71dc890640 1 -- 172.21.15.55:0/3013773531 >> v1:172.21.15.55:6789/0 conn(0x7f71d81618d0 legacy=0x7f71d80d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71dc890640 1 -- 172.21.15.55:0/3013773531 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8162600 con 0x7f71d80cef40 2024-04-25T09:04:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.846+0000 7f71cffff640 1 -- 172.21.15.55:0/3013773531 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69991671 0 0) 0x7f71d8162040 con 0x7f71d81618d0 2024-04-25T09:04:21.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.847+0000 7f71dc890640 1 --2- 172.21.15.55:0/3013773531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71d80cef40 0x7f71d80b9580 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f71d80d2020 tx=0x7f71c802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91878992ec965e50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.847+0000 7f71cffff640 1 -- 172.21.15.55:0/3013773531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8037070 con 0x7f71d80cef40 2024-04-25T09:04:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.847+0000 7f71cffff640 1 -- 172.21.15.55:0/3013773531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c802ae40 con 0x7f71d80cef40 2024-04-25T09:04:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.847+0000 7f71cffff640 1 -- 172.21.15.55:0/3013773531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8032660 con 0x7f71d80cef40 2024-04-25T09:04:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.848+0000 7f71df2f5640 1 -- 172.21.15.55:0/3013773531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71d80cef40 msgr2=0x7f71d80b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.848+0000 7f71df2f5640 1 --2- 172.21.15.55:0/3013773531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71d80cef40 0x7f71d80b9580 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f71d80d2020 tx=0x7f71c802a130 comp rx=0 tx=0).stop 2024-04-25T09:04:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.848+0000 7f71df2f5640 1 -- 172.21.15.55:0/3013773531 shutdown_connections 2024-04-25T09:04:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.848+0000 7f71df2f5640 1 --2- 172.21.15.55:0/3013773531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71d80cef40 0x7f71d80b9580 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.848+0000 7f71df2f5640 1 -- 172.21.15.55:0/3013773531 >> 172.21.15.55:0/3013773531 conn(0x7f71d80b5570 msgr2=0x7f71d80b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.848+0000 7f71df2f5640 1 -- 172.21.15.55:0/3013773531 shutdown_connections 2024-04-25T09:04:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.848+0000 7f71df2f5640 1 -- 172.21.15.55:0/3013773531 wait complete. 2024-04-25T09:04:21.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.849+0000 7f71df2f5640 1 Processor -- start 2024-04-25T09:04:21.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.849+0000 7f71df2f5640 1 -- start start 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71df2f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d80cef40 0x7f71d80cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71df2f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71d81610b0 0x7f71d815a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71df2f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81618d0 0x7f71d8143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71df2f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8161d40 con 0x7f71d81610b0 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71df2f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80b6c00 con 0x7f71d81618d0 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71df2f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8161490 con 0x7f71d80cef40 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dc890640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71d81610b0 0x7f71d815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dc890640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71d81610b0 0x7f71d815a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58128/0 (socket says 172.21.15.55:58128) 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dc890640 1 -- 172.21.15.55:0/4014238326 learned_addr learned my addr 172.21.15.55:0/4014238326 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dd892640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81618d0 0x7f71d8143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dd091640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d80cef40 0x7f71d80cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dc890640 1 -- 172.21.15.55:0/4014238326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d80cef40 msgr2=0x7f71d80cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dc890640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d80cef40 0x7f71d80cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dc890640 1 -- 172.21.15.55:0/4014238326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81618d0 msgr2=0x7f71d8143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dc890640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81618d0 0x7f71d8143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dc890640 1 -- 172.21.15.55:0/4014238326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d80cc590 con 0x7f71d81610b0 2024-04-25T09:04:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dd892640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81618d0 0x7f71d8143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71dc890640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71d81610b0 0x7f71d815a410 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009890 tx=0x7f71c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71cdffb640 1 -- 172.21.15.55:0/4014238326 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8037040 con 0x7f71d81610b0 2024-04-25T09:04:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71cdffb640 1 -- 172.21.15.55:0/4014238326 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c8004030 con 0x7f71d81610b0 2024-04-25T09:04:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71df2f5640 1 -- 172.21.15.55:0/4014238326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d815dd70 con 0x7f71d81610b0 2024-04-25T09:04:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.850+0000 7f71cdffb640 1 -- 172.21.15.55:0/4014238326 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8006e10 con 0x7f71d81610b0 2024-04-25T09:04:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.851+0000 7f71df2f5640 1 -- 172.21.15.55:0/4014238326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d80cc830 con 0x7f71d81610b0 2024-04-25T09:04:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.852+0000 7f71df2f5640 1 -- 172.21.15.55:0/4014238326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d80750b0 con 0x7f71d81610b0 2024-04-25T09:04:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.852+0000 7f71cdffb640 1 -- 172.21.15.55:0/4014238326 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f71c803d650 con 0x7f71d81610b0 2024-04-25T09:04:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.853+0000 7f71cdffb640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71bc06b500 0x7f71bc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.853+0000 7f71cdffb640 1 -- 172.21.15.55:0/4014238326 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f71c80aa840 con 0x7f71d81610b0 2024-04-25T09:04:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.853+0000 7f71dd091640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71bc06b500 0x7f71bc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.853+0000 7f71dd091640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71bc06b500 0x7f71bc06d9c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f71d4004ea0 tx=0x7f71d4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:21.857+0000 7f71cdffb640 1 -- 172.21.15.55:0/4014238326 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f71c8042020 con 0x7f71d81610b0 2024-04-25T09:04:22.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.037+0000 7f71df2f5640 1 -- 172.21.15.55:0/4014238326 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f71d80d1770 con 0x7f71bc06b500 2024-04-25T09:04:22.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.037+0000 7f71cdffb640 1 -- 172.21.15.55:0/4014238326 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f71d80d1770 con 0x7f71bc06b500 2024-04-25T09:04:22.026 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 -- 172.21.15.55:0/4014238326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71bc06b500 msgr2=0x7f71bc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71bc06b500 0x7f71bc06d9c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f71d4004ea0 tx=0x7f71d4009040 comp rx=0 tx=0).stop 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 -- 172.21.15.55:0/4014238326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71d81610b0 msgr2=0x7f71d815a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71d81610b0 0x7f71d815a410 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009890 tx=0x7f71c80046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 -- 172.21.15.55:0/4014238326 shutdown_connections 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f71bc06b500 0x7f71bc06d9c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81618d0 0x7f71d8143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71d81610b0 0x7f71d815a410 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 --2- 172.21.15.55:0/4014238326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71d80cef40 0x7f71d80cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 -- 172.21.15.55:0/4014238326 >> 172.21.15.55:0/4014238326 conn(0x7f71d80b5570 msgr2=0x7f71d80b8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 -- 172.21.15.55:0/4014238326 shutdown_connections 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.039+0000 7f71df2f5640 1 -- 172.21.15.55:0/4014238326 wait complete. 2024-04-25T09:04:22.038 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.151+0000 7f81f962a640 1 Processor -- start 2024-04-25T09:04:22.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.151+0000 7f81f962a640 1 -- start start 2024-04-25T09:04:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.152+0000 7f81f962a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f81f415dce0 0x7f81f40d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.152+0000 7f81f962a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81f40d35b0 0x7f81f40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.152+0000 7f81f962a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f415e0c0 con 0x7f81f40d1f90 2024-04-25T09:04:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.152+0000 7f81f962a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f40b7b10 con 0x7f81f415dce0 2024-04-25T09:04:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.152+0000 7f81f962a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40d2510 con 0x7f81f40d35b0 2024-04-25T09:04:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.152+0000 7f81f37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f81f40d1f90 0x7f81f406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45904/0 (socket says 172.21.15.55:45904) 2024-04-25T09:04:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.152+0000 7f81f37fe640 1 -- 172.21.15.55:0/82336964 learned_addr learned my addr 172.21.15.55:0/82336964 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.152+0000 7f81f2ffd640 1 --2- 172.21.15.55:0/82336964 >> v2:172.21.15.167:3300/0 conn(0x7f81f415dce0 0x7f81f40d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.152+0000 7f81ebfff640 1 --2- 172.21.15.55:0/82336964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81f40d35b0 0x7f81f40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.152+0000 7f81f27fc640 1 -- 172.21.15.55:0/82336964 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019735756 0 0) 0x7f81f415e0c0 con 0x7f81f40d1f90 2024-04-25T09:04:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.152+0000 7f81f27fc640 1 -- 172.21.15.55:0/82336964 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e0003520 con 0x7f81f40d1f90 2024-04-25T09:04:22.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.153+0000 7f81f27fc640 1 -- 172.21.15.55:0/82336964 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1062516206 0 0) 0x7f81e0003520 con 0x7f81f40d1f90 2024-04-25T09:04:22.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.153+0000 7f81f2ffd640 1 -- 172.21.15.55:0/82336964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81f40d35b0 msgr2=0x7f81f40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.153+0000 7f81f2ffd640 1 --2- 172.21.15.55:0/82336964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81f40d35b0 0x7f81f40b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.153+0000 7f81f2ffd640 1 -- 172.21.15.55:0/82336964 >> v1:172.21.15.55:6789/0 conn(0x7f81f40d1f90 legacy=0x7f81f406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.153+0000 7f81f2ffd640 1 -- 172.21.15.55:0/82336964 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40d27f0 con 0x7f81f415dce0 2024-04-25T09:04:22.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.153+0000 7f81f2ffd640 1 --2- 172.21.15.55:0/82336964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f415dce0 0x7f81f40d1a50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f81e40097a0 tx=0x7f81e402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7326d157a65a0827 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.154+0000 7f81f27fc640 1 -- 172.21.15.55:0/82336964 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4037070 con 0x7f81f415dce0 2024-04-25T09:04:22.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.154+0000 7f81f27fc640 1 -- 172.21.15.55:0/82336964 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e402ab10 con 0x7f81f415dce0 2024-04-25T09:04:22.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.154+0000 7f81f27fc640 1 -- 172.21.15.55:0/82336964 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0019f0 con 0x7f81f415dce0 2024-04-25T09:04:22.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.154+0000 7f81f962a640 1 -- 172.21.15.55:0/82336964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f415dce0 msgr2=0x7f81f40d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.154+0000 7f81f962a640 1 --2- 172.21.15.55:0/82336964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f415dce0 0x7f81f40d1a50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f81e40097a0 tx=0x7f81e402a080 comp rx=0 tx=0).stop 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.154+0000 7f81f962a640 1 -- 172.21.15.55:0/82336964 shutdown_connections 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.154+0000 7f81f962a640 1 --2- 172.21.15.55:0/82336964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81f40d35b0 0x7f81f40b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.154+0000 7f81f962a640 1 --2- 172.21.15.55:0/82336964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f415dce0 0x7f81f40d1a50 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.154+0000 7f81f962a640 1 -- 172.21.15.55:0/82336964 >> 172.21.15.55:0/82336964 conn(0x7f81f4072900 msgr2=0x7f81f40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.154+0000 7f81f962a640 1 -- 172.21.15.55:0/82336964 shutdown_connections 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.154+0000 7f81f962a640 1 -- 172.21.15.55:0/82336964 wait complete. 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.155+0000 7f81f962a640 1 Processor -- start 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.155+0000 7f81f962a640 1 -- start start 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.156+0000 7f81f962a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81f40d1f90 0x7f81f4152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.156+0000 7f81f962a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f40d35b0 0x7f81f40ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.156+0000 7f81f962a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f415dce0 0x7f81f40cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.156+0000 7f81f962a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40d3090 con 0x7f81f40d35b0 2024-04-25T09:04:22.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.156+0000 7f81f962a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40d2db0 con 0x7f81f415dce0 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.156+0000 7f81f962a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40b9820 con 0x7f81f40d1f90 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.156+0000 7f81ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f40d35b0 0x7f81f40ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.156+0000 7f81ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f40d35b0 0x7f81f40ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58130/0 (socket says 172.21.15.55:58130) 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.156+0000 7f81ebfff640 1 -- 172.21.15.55:0/835181451 learned_addr learned my addr 172.21.15.55:0/835181451 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.156+0000 7f81f2ffd640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81f40d1f90 0x7f81f4152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.156+0000 7f81f37fe640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f415dce0 0x7f81f40cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.157+0000 7f81ebfff640 1 -- 172.21.15.55:0/835181451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81f40d1f90 msgr2=0x7f81f4152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.157+0000 7f81ebfff640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81f40d1f90 0x7f81f4152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.157+0000 7f81ebfff640 1 -- 172.21.15.55:0/835181451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f415dce0 msgr2=0x7f81f40cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.157+0000 7f81ebfff640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f415dce0 0x7f81f40cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.157+0000 7f81ebfff640 1 -- 172.21.15.55:0/835181451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f415eca0 con 0x7f81f40d35b0 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.157+0000 7f81ebfff640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f40d35b0 0x7f81f40ccbf0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00e9e0 tx=0x7f81dc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.157+0000 7f81eb7fe640 1 -- 172.21.15.55:0/835181451 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc017070 con 0x7f81f40d35b0 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.157+0000 7f81eb7fe640 1 -- 172.21.15.55:0/835181451 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc00c9d0 con 0x7f81f40d35b0 2024-04-25T09:04:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.157+0000 7f81f962a640 1 -- 172.21.15.55:0/835181451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f415ef80 con 0x7f81f40d35b0 2024-04-25T09:04:22.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.157+0000 7f81eb7fe640 1 -- 172.21.15.55:0/835181451 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00cdc0 con 0x7f81f40d35b0 2024-04-25T09:04:22.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.157+0000 7f81f962a640 1 -- 172.21.15.55:0/835181451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f415f540 con 0x7f81f40d35b0 2024-04-25T09:04:22.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.158+0000 7f81f962a640 1 -- 172.21.15.55:0/835181451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f40cf8d0 con 0x7f81f40d35b0 2024-04-25T09:04:22.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.158+0000 7f81eb7fe640 1 -- 172.21.15.55:0/835181451 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f81dc01a070 con 0x7f81f40d35b0 2024-04-25T09:04:22.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.159+0000 7f81eb7fe640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81d406b4d0 0x7f81d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.159+0000 7f81eb7fe640 1 -- 172.21.15.55:0/835181451 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f81dc08a340 con 0x7f81f40d35b0 2024-04-25T09:04:22.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.159+0000 7f81f2ffd640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81d406b4d0 0x7f81d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.159+0000 7f81f2ffd640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81d406b4d0 0x7f81d406d990 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f81e4034000 tx=0x7f81e402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.163+0000 7f81eb7fe640 1 -- 172.21.15.55:0/835181451 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81f40cf8d0 con 0x7f81f40d35b0 2024-04-25T09:04:22.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.341+0000 7f81f962a640 1 -- 172.21.15.55:0/835181451 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81f40749b0 con 0x7f81d406b4d0 2024-04-25T09:04:22.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.342+0000 7f81eb7fe640 1 -- 172.21.15.55:0/835181451 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13488 (secure 0 0 0) 0x7f81f40749b0 con 0x7f81d406b4d0 2024-04-25T09:04:22.330 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:22.331 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 -- 172.21.15.55:0/835181451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81d406b4d0 msgr2=0x7f81d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81d406b4d0 0x7f81d406d990 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f81e4034000 tx=0x7f81e402e000 comp rx=0 tx=0).stop 2024-04-25T09:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 -- 172.21.15.55:0/835181451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f40d35b0 msgr2=0x7f81f40ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f40d35b0 0x7f81f40ccbf0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00e9e0 tx=0x7f81dc00eea0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 -- 172.21.15.55:0/835181451 shutdown_connections 2024-04-25T09:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f81d406b4d0 0x7f81d406d990 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f415dce0 0x7f81f40cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f40d35b0 0x7f81f40ccbf0 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 --2- 172.21.15.55:0/835181451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81f40d1f90 0x7f81f4152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 -- 172.21.15.55:0/835181451 >> 172.21.15.55:0/835181451 conn(0x7f81f4072900 msgr2=0x7f81f40ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 -- 172.21.15.55:0/835181451 shutdown_connections 2024-04-25T09:04:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:22.344+0000 7f81f962a640 1 -- 172.21.15.55:0/835181451 wait complete. 2024-04-25T09:04:22.343 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":440,"stamp":"2024-04-25T09:04:20.697896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":278900,"kb_used_data":12808,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754695820,"statfs":{"total":773094113280,"available":772808519680,"internally_reserved":0,"allocated":13115392,"data_stored":6344352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-174,"num_write_kb":-8302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001156"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":350,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-04-25T09:04:14.846195+0000","last_change":"2024-04-25T08:53:32.637969+0000","last_active":"2024-04-25T09:04:14.846195+0000","last_peered":"2024-04-25T09:04:14.846195+0000","last_clean":"2024-04-25T09:04:14.846195+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:04:14.846195+0000","last_undegraded":"2024-04-25T09:04:14.846195+0000","last_fullsized":"2024-04-25T09:04:14.846195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:53:31.101165+0000","last_clean_scrub_stamp":"2024-04-25T08:53:31.101165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:14.138018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509574,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2084864,"data_stored":1235820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32640,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339200,"statfs":{"total":96636764160,"available":96603340800,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32640,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339200,"statfs":{"total":96636764160,"available":96603340800,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509573,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32636,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509573,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36796,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36796,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509573,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37376,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334464,"statfs":{"total":96636764160,"available":96598491136,"internally_reserved":0,"allocated":2084864,"data_stored":1235820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36796,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:22.346 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T08:53:31.101165+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=8, tm_min=53, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:04:22.347 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T09:04:41.383 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:41.386 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:42.348 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:42.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.473+0000 7f4d3661b640 1 Processor -- start 2024-04-25T09:04:42.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.473+0000 7f4d3661b640 1 -- start start 2024-04-25T09:04:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.474+0000 7f4d3661b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d3015ba10 0x7f4d30099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.474+0000 7f4d3661b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d30099f80 0x7f4d3006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.474+0000 7f4d3661b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3009a3a0 con 0x7f4d3006c1f0 2024-04-25T09:04:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.474+0000 7f4d3661b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d300cbe50 con 0x7f4d30099f80 2024-04-25T09:04:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.474+0000 7f4d3661b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300cfe80 con 0x7f4d3015ba10 2024-04-25T09:04:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.474+0000 7f4d2f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d30099f80 0x7f4d3006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.474+0000 7f4d34bb8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4d3006c1f0 0x7f4d300cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55588/0 (socket says 172.21.15.55:55588) 2024-04-25T09:04:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.474+0000 7f4d34bb8640 1 -- 172.21.15.55:0/109122294 learned_addr learned my addr 172.21.15.55:0/109122294 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:04:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.475+0000 7f4d2ffff640 1 --2- 172.21.15.55:0/109122294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d3015ba10 0x7f4d30099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.475+0000 7f4d2f7fe640 1 -- 172.21.15.55:0/109122294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d3015ba10 msgr2=0x7f4d30099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.475+0000 7f4d2f7fe640 1 --2- 172.21.15.55:0/109122294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d3015ba10 0x7f4d30099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.475+0000 7f4d2f7fe640 1 -- 172.21.15.55:0/109122294 >> v1:172.21.15.55:6789/0 conn(0x7f4d3006c1f0 legacy=0x7f4d300cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.475+0000 7f4d2f7fe640 1 -- 172.21.15.55:0/109122294 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3006c680 con 0x7f4d30099f80 2024-04-25T09:04:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.475+0000 7f4d2effd640 1 -- 172.21.15.55:0/109122294 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596819890 0 0) 0x7f4d3009a3a0 con 0x7f4d3006c1f0 2024-04-25T09:04:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.475+0000 7f4d2ffff640 1 --2- 172.21.15.55:0/109122294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d3015ba10 0x7f4d30099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.475+0000 7f4d2f7fe640 1 --2- 172.21.15.55:0/109122294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d30099f80 0x7f4d3006bcb0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f4d200097a0 tx=0x7f4d2002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e14ec1dc702061 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.476+0000 7f4d2effd640 1 -- 172.21.15.55:0/109122294 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20037070 con 0x7f4d30099f80 2024-04-25T09:04:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.476+0000 7f4d2effd640 1 -- 172.21.15.55:0/109122294 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20032440 con 0x7f4d30099f80 2024-04-25T09:04:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.476+0000 7f4d2effd640 1 -- 172.21.15.55:0/109122294 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20032810 con 0x7f4d30099f80 2024-04-25T09:04:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.476+0000 7f4d3661b640 1 -- 172.21.15.55:0/109122294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d30099f80 msgr2=0x7f4d3006bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.476+0000 7f4d3661b640 1 --2- 172.21.15.55:0/109122294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d30099f80 0x7f4d3006bcb0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f4d200097a0 tx=0x7f4d2002a180 comp rx=0 tx=0).stop 2024-04-25T09:04:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.476+0000 7f4d3661b640 1 -- 172.21.15.55:0/109122294 shutdown_connections 2024-04-25T09:04:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.476+0000 7f4d3661b640 1 --2- 172.21.15.55:0/109122294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d30099f80 0x7f4d3006bcb0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.476+0000 7f4d3661b640 1 --2- 172.21.15.55:0/109122294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d3015ba10 0x7f4d30099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.476+0000 7f4d3661b640 1 -- 172.21.15.55:0/109122294 >> 172.21.15.55:0/109122294 conn(0x7f4d300b32f0 msgr2=0x7f4d300b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.476+0000 7f4d3661b640 1 -- 172.21.15.55:0/109122294 shutdown_connections 2024-04-25T09:04:42.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.476+0000 7f4d3661b640 1 -- 172.21.15.55:0/109122294 wait complete. 2024-04-25T09:04:42.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.478+0000 7f4d3661b640 1 Processor -- start 2024-04-25T09:04:42.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.478+0000 7f4d3661b640 1 -- start start 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d3661b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d3006c1f0 0x7f4d3014eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d3661b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d30099f80 0x7f4d301f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d3661b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d3015ba10 0x7f4d301f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d3661b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3006cec0 con 0x7f4d30099f80 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d3661b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3006cbe0 con 0x7f4d3006c1f0 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d3661b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300cd930 con 0x7f4d3015ba10 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d30099f80 0x7f4d301f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d30099f80 0x7f4d301f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41670/0 (socket says 172.21.15.55:41670) 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2f7fe640 1 -- 172.21.15.55:0/1203617172 learned_addr learned my addr 172.21.15.55:0/1203617172 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2f7fe640 1 -- 172.21.15.55:0/1203617172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d3015ba10 msgr2=0x7f4d301f7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2f7fe640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d3015ba10 0x7f4d301f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2f7fe640 1 -- 172.21.15.55:0/1203617172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d3006c1f0 msgr2=0x7f4d3014eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2f7fe640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d3006c1f0 0x7f4d3014eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2f7fe640 1 -- 172.21.15.55:0/1203617172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300ae650 con 0x7f4d30099f80 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2f7fe640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d30099f80 0x7f4d301f7550 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f4d200097a0 tx=0x7f4d200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2cff9640 1 -- 172.21.15.55:0/1203617172 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20041070 con 0x7f4d30099f80 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2cff9640 1 -- 172.21.15.55:0/1203617172 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2003c930 con 0x7f4d30099f80 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d3661b640 1 -- 172.21.15.55:0/1203617172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d300cb370 con 0x7f4d30099f80 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d2cff9640 1 -- 172.21.15.55:0/1203617172 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20037040 con 0x7f4d30099f80 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.479+0000 7f4d3661b640 1 -- 172.21.15.55:0/1203617172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d300ae8f0 con 0x7f4d30099f80 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.480+0000 7f4d3661b640 1 -- 172.21.15.55:0/1203617172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d300749b0 con 0x7f4d30099f80 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.481+0000 7f4d2cff9640 1 -- 172.21.15.55:0/1203617172 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4d20044070 con 0x7f4d30099f80 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.481+0000 7f4d2cff9640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4d1006b4d0 0x7f4d1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.481+0000 7f4d2cff9640 1 -- 172.21.15.55:0/1203617172 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f4d200aace0 con 0x7f4d30099f80 2024-04-25T09:04:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.481+0000 7f4d2ffff640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4d1006b4d0 0x7f4d1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.482+0000 7f4d2ffff640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4d1006b4d0 0x7f4d1006d990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4d18006e80 tx=0x7f4d18008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.486+0000 7f4d2cff9640 1 -- 172.21.15.55:0/1203617172 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d3006c680 con 0x7f4d30099f80 2024-04-25T09:04:42.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.664+0000 7f4d3661b640 1 -- 172.21.15.55:0/1203617172 --> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d300cb890 con 0x7f4d1006b4d0 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.665+0000 7f4d2cff9640 1 -- 172.21.15.55:0/1203617172 <== mgr.4098 v2:172.21.15.55:6832/3452216423 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13379 (secure 0 0 0) 0x7f4d300cb890 con 0x7f4d1006b4d0 2024-04-25T09:04:42.653 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:42.654 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-25T09:04:42.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 -- 172.21.15.55:0/1203617172 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4d1006b4d0 msgr2=0x7f4d1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4d1006b4d0 0x7f4d1006d990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4d18006e80 tx=0x7f4d18008040 comp rx=0 tx=0).stop 2024-04-25T09:04:42.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 -- 172.21.15.55:0/1203617172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d30099f80 msgr2=0x7f4d301f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d30099f80 0x7f4d301f7550 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f4d200097a0 tx=0x7f4d200046c0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 -- 172.21.15.55:0/1203617172 shutdown_connections 2024-04-25T09:04:42.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f4d1006b4d0 0x7f4d1006d990 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d3015ba10 0x7f4d301f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d30099f80 0x7f4d301f7550 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 --2- 172.21.15.55:0/1203617172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d3006c1f0 0x7f4d3014eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 -- 172.21.15.55:0/1203617172 >> 172.21.15.55:0/1203617172 conn(0x7f4d300b32f0 msgr2=0x7f4d3015acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 -- 172.21.15.55:0/1203617172 shutdown_connections 2024-04-25T09:04:42.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.667+0000 7f4d3661b640 1 -- 172.21.15.55:0/1203617172 wait complete. 2024-04-25T09:04:42.666 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":450,"stamp":"2024-04-25T09:04:40.701746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":278888,"kb_used_data":12808,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754695832,"statfs":{"total":773094113280,"available":772808531968,"internally_reserved":0,"allocated":13115392,"data_stored":6344352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002301"},"pg_stats":[{"pgid":"1.0","version":"120'119","reported_seq":361,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-04-25T09:04:22.804331+0000","last_change":"2024-04-25T09:04:22.804376+0000","last_active":"2024-04-25T09:04:22.804331+0000","last_peered":"2024-04-25T09:04:22.804331+0000","last_clean":"2024-04-25T09:04:22.804331+0000","last_became_active":"2024-04-25T08:53:32.637019+0000","last_became_peered":"2024-04-25T08:53:32.637019+0000","last_unstale":"2024-04-25T09:04:22.804331+0000","last_undegraded":"2024-04-25T09:04:22.804331+0000","last_fullsized":"2024-04-25T09:04:22.804331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'119","last_scrub_stamp":"2024-04-25T09:04:22.804242+0000","last_deep_scrub":"120'119","last_deep_scrub_stamp":"2024-04-25T09:04:22.804242+0000","last_clean_scrub_stamp":"2024-04-25T09:04:22.804242+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:28.928575+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2084864,"data_stored":1235820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509576,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32640,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339200,"statfs":{"total":96636764160,"available":96603340800,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32640,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339200,"statfs":{"total":96636764160,"available":96603340800,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509577,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32636,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509577,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36796,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36796,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509577,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37372,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334468,"statfs":{"total":96636764160,"available":96598495232,"internally_reserved":0,"allocated":2084864,"data_stored":1235820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36796,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1490944,"data_stored":645452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:42.667 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T09:04:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.780+0000 7f2e7c1e7640 1 Processor -- start 2024-04-25T09:04:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.780+0000 7f2e7c1e7640 1 -- start start 2024-04-25T09:04:42.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.780+0000 7f2e7c1e7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2e7415dca0 0x7f2e740ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.780+0000 7f2e7c1e7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e740d3b90 0x7f2e740d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.780+0000 7f2e7c1e7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e740cee80 0x7f2e740d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e7c1e7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740b6b20 con 0x7f2e740d3b90 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e7c1e7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740d4090 con 0x7f2e7415dca0 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e7c1e7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740d4370 con 0x7f2e740cee80 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e79782640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e740d3b90 0x7f2e740d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e79782640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e740d3b90 0x7f2e740d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41686/0 (socket says 172.21.15.55:41686) 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e79782640 1 -- 172.21.15.55:0/2124997202 learned_addr learned my addr 172.21.15.55:0/2124997202 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e79f83640 1 --2- 172.21.15.55:0/2124997202 >> v2:172.21.15.167:3300/0 conn(0x7f2e7415dca0 0x7f2e740ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e7a784640 1 --2- 172.21.15.55:0/2124997202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e740cee80 0x7f2e740d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e79782640 1 -- 172.21.15.55:0/2124997202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e740cee80 msgr2=0x7f2e740d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e79782640 1 --2- 172.21.15.55:0/2124997202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e740cee80 0x7f2e740d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e79782640 1 -- 172.21.15.55:0/2124997202 >> v2:172.21.15.167:3300/0 conn(0x7f2e7415dca0 msgr2=0x7f2e740ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e79782640 1 --2- 172.21.15.55:0/2124997202 >> v2:172.21.15.167:3300/0 conn(0x7f2e7415dca0 0x7f2e740ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e79782640 1 -- 172.21.15.55:0/2124997202 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e740d4650 con 0x7f2e740d3b90 2024-04-25T09:04:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e79f83640 1 --2- 172.21.15.55:0/2124997202 >> v2:172.21.15.167:3300/0 conn(0x7f2e7415dca0 0x7f2e740ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.781+0000 7f2e7a784640 1 --2- 172.21.15.55:0/2124997202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e740cee80 0x7f2e740d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:42.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.782+0000 7f2e79782640 1 --2- 172.21.15.55:0/2124997202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e740d3b90 0x7f2e740d0a20 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f2e740b6340 tx=0x7f2e6802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02351c33d0fd15a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.782+0000 7f2e78f81640 1 -- 172.21.15.55:0/2124997202 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68037070 con 0x7f2e740d3b90 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.782+0000 7f2e78f81640 1 -- 172.21.15.55:0/2124997202 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68032440 con 0x7f2e740d3b90 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.782+0000 7f2e78f81640 1 -- 172.21.15.55:0/2124997202 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68032810 con 0x7f2e740d3b90 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.782+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/2124997202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e740d3b90 msgr2=0x7f2e740d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.782+0000 7f2e7c1e7640 1 --2- 172.21.15.55:0/2124997202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e740d3b90 0x7f2e740d0a20 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f2e740b6340 tx=0x7f2e6802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.782+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/2124997202 shutdown_connections 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.782+0000 7f2e7c1e7640 1 --2- 172.21.15.55:0/2124997202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e740cee80 0x7f2e740d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.782+0000 7f2e7c1e7640 1 --2- 172.21.15.55:0/2124997202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e740d3b90 0x7f2e740d0a20 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.782+0000 7f2e7c1e7640 1 --2- 172.21.15.55:0/2124997202 >> v2:172.21.15.167:3300/0 conn(0x7f2e7415dca0 0x7f2e740ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.782+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/2124997202 >> 172.21.15.55:0/2124997202 conn(0x7f2e740726c0 msgr2=0x7f2e74072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.783+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/2124997202 shutdown_connections 2024-04-25T09:04:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.783+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/2124997202 wait complete. 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.784+0000 7f2e7c1e7640 1 Processor -- start 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.784+0000 7f2e7c1e7640 1 -- start start 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.784+0000 7f2e7c1e7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e740cee80 0x7f2e7415f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.784+0000 7f2e7c1e7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e740d3b90 0x7f2e741f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.784+0000 7f2e7c1e7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7415dca0 0x7f2e741f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.784+0000 7f2e7c1e7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7415e200 con 0x7f2e7415dca0 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.784+0000 7f2e7c1e7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7415e080 con 0x7f2e740cee80 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.784+0000 7f2e7c1e7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740b2500 con 0x7f2e740d3b90 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.784+0000 7f2e7a784640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7415dca0 0x7f2e741f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e7a784640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7415dca0 0x7f2e741f4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41698/0 (socket says 172.21.15.55:41698) 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e7a784640 1 -- 172.21.15.55:0/4204106631 learned_addr learned my addr 172.21.15.55:0/4204106631 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e79782640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e740d3b90 0x7f2e741f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e7a784640 1 -- 172.21.15.55:0/4204106631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e740d3b90 msgr2=0x7f2e741f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e7a784640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e740d3b90 0x7f2e741f4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e7a784640 1 -- 172.21.15.55:0/4204106631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e740cee80 msgr2=0x7f2e7415f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e7a784640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e740cee80 0x7f2e7415f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e7a784640 1 -- 172.21.15.55:0/4204106631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7415e500 con 0x7f2e7415dca0 2024-04-25T09:04:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e7a784640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7415dca0 0x7f2e741f4c80 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400cef0 tx=0x7f2e6400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e727fc640 1 -- 172.21.15.55:0/4204106631 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6401a070 con 0x7f2e7415dca0 2024-04-25T09:04:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e727fc640 1 -- 172.21.15.55:0/4204106631 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6400d840 con 0x7f2e7415dca0 2024-04-25T09:04:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/4204106631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7415e7e0 con 0x7f2e7415dca0 2024-04-25T09:04:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e727fc640 1 -- 172.21.15.55:0/4204106631 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6400dc30 con 0x7f2e7415dca0 2024-04-25T09:04:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.785+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/4204106631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7415eda0 con 0x7f2e7415dca0 2024-04-25T09:04:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.786+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/4204106631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e740750b0 con 0x7f2e7415dca0 2024-04-25T09:04:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.787+0000 7f2e727fc640 1 -- 172.21.15.55:0/4204106631 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e6401d070 con 0x7f2e7415dca0 2024-04-25T09:04:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.787+0000 7f2e727fc640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e6006b4d0 0x7f2e6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.787+0000 7f2e727fc640 1 -- 172.21.15.55:0/4204106631 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f2e6408a7b0 con 0x7f2e7415dca0 2024-04-25T09:04:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.787+0000 7f2e79f83640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e6006b4d0 0x7f2e6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.788+0000 7f2e79f83640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e6006b4d0 0x7f2e6006d990 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c006fd0 tx=0x7f2e6c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.791+0000 7f2e727fc640 1 -- 172.21.15.55:0/4204106631 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e64059910 con 0x7f2e7415dca0 2024-04-25T09:04:42.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.971+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/4204106631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2e7406b1d0 con 0x7f2e7415dca0 2024-04-25T09:04:42.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.979+0000 7f2e727fc640 1 -- 172.21.15.55:0/4204106631 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2e64059210 con 0x7f2e7415dca0 2024-04-25T09:04:42.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.980+0000 7f2e727fc640 1 -- 172.21.15.55:0/4204106631 <== mon.0 v2:172.21.15.55:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2e6405d360 con 0x7f2e7415dca0 2024-04-25T09:04:42.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/4204106631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e6006b4d0 msgr2=0x7f2e6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e6006b4d0 0x7f2e6006d990 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c006fd0 tx=0x7f2e6c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/4204106631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7415dca0 msgr2=0x7f2e741f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7415dca0 0x7f2e741f4c80 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400cef0 tx=0x7f2e6400a710 comp rx=0 tx=0).stop 2024-04-25T09:04:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/4204106631 shutdown_connections 2024-04-25T09:04:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f2e6006b4d0 0x7f2e6006d990 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7415dca0 0x7f2e741f4c80 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e740d3b90 0x7f2e741f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 --2- 172.21.15.55:0/4204106631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e740cee80 0x7f2e7415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/4204106631 >> 172.21.15.55:0/4204106631 conn(0x7f2e740726c0 msgr2=0x7f2e740b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/4204106631 shutdown_connections 2024-04-25T09:04:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:42.982+0000 7f2e7c1e7640 1 -- 172.21.15.55:0/4204106631 wait complete. 2024-04-25T09:04:42.981 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:04:42.982 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:43.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.094+0000 7f6574d7e640 1 Processor -- start 2024-04-25T09:04:43.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.094+0000 7f6574d7e640 1 -- start start 2024-04-25T09:04:43.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.095+0000 7f6574d7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f657009a150 0x7f657006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.095+0000 7f6574d7e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f657006c1f0 0x7f65700cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.095+0000 7f6574d7e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657006c660 con 0x7f657015ba10 2024-04-25T09:04:43.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.095+0000 7f6574d7e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700cbe50 con 0x7f657009a150 2024-04-25T09:04:43.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.095+0000 7f6574d7e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700cfe80 con 0x7f657006c1f0 2024-04-25T09:04:43.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.095+0000 7f656dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f657009a150 0x7f657006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.095+0000 7f656dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f657009a150 0x7f657006bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41706/0 (socket says 172.21.15.55:41706) 2024-04-25T09:04:43.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.095+0000 7f656dd9b640 1 -- 172.21.15.55:0/3286553075 learned_addr learned my addr 172.21.15.55:0/3286553075 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:43.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.096+0000 7f656ed9d640 1 --2- 172.21.15.55:0/3286553075 >> v2:172.21.15.167:3300/0 conn(0x7f657006c1f0 0x7f65700cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.096+0000 7f656dd9b640 1 -- 172.21.15.55:0/3286553075 >> v2:172.21.15.167:3300/0 conn(0x7f657006c1f0 msgr2=0x7f65700cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.096+0000 7f656dd9b640 1 --2- 172.21.15.55:0/3286553075 >> v2:172.21.15.167:3300/0 conn(0x7f657006c1f0 0x7f65700cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.096+0000 7f656dd9b640 1 -- 172.21.15.55:0/3286553075 >> v1:172.21.15.167:6789/0 conn(0x7f657015ba10 legacy=0x7f6570099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.096+0000 7f656dd9b640 1 -- 172.21.15.55:0/3286553075 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657006c900 con 0x7f657009a150 2024-04-25T09:04:43.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.096+0000 7f656ed9d640 1 --2- 172.21.15.55:0/3286553075 >> v2:172.21.15.167:3300/0 conn(0x7f657006c1f0 0x7f65700cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:43.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.096+0000 7f656dd9b640 1 --2- 172.21.15.55:0/3286553075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657009a150 0x7f657006bcb0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f65700d17b0 tx=0x7f655802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2b2dcf26eee9a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.096+0000 7f656d59a640 1 -- 172.21.15.55:0/3286553075 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558037070 con 0x7f657009a150 2024-04-25T09:04:43.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.096+0000 7f656d59a640 1 -- 172.21.15.55:0/3286553075 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6558032440 con 0x7f657009a150 2024-04-25T09:04:43.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.096+0000 7f656d59a640 1 -- 172.21.15.55:0/3286553075 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558032830 con 0x7f657009a150 2024-04-25T09:04:43.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.097+0000 7f6574d7e640 1 -- 172.21.15.55:0/3286553075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657009a150 msgr2=0x7f657006bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.097+0000 7f6574d7e640 1 --2- 172.21.15.55:0/3286553075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657009a150 0x7f657006bcb0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f65700d17b0 tx=0x7f655802a230 comp rx=0 tx=0).stop 2024-04-25T09:04:43.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.097+0000 7f6574d7e640 1 -- 172.21.15.55:0/3286553075 shutdown_connections 2024-04-25T09:04:43.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.097+0000 7f6574d7e640 1 --2- 172.21.15.55:0/3286553075 >> v2:172.21.15.167:3300/0 conn(0x7f657006c1f0 0x7f65700cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.097+0000 7f6574d7e640 1 --2- 172.21.15.55:0/3286553075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657009a150 0x7f657006bcb0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.097+0000 7f6574d7e640 1 -- 172.21.15.55:0/3286553075 >> 172.21.15.55:0/3286553075 conn(0x7f65700b32f0 msgr2=0x7f65700b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.097+0000 7f6574d7e640 1 -- 172.21.15.55:0/3286553075 shutdown_connections 2024-04-25T09:04:43.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.097+0000 7f6574d7e640 1 -- 172.21.15.55:0/3286553075 wait complete. 2024-04-25T09:04:43.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.098+0000 7f6574d7e640 1 Processor -- start 2024-04-25T09:04:43.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.098+0000 7f6574d7e640 1 -- start start 2024-04-25T09:04:43.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.099+0000 7f6574d7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f657006c1f0 0x7f65700c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.099+0000 7f6574d7e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f657009a150 0x7f65700b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.099+0000 7f6574d7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657015ba10 0x7f65700b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.099+0000 7f6574d7e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700cd760 con 0x7f657015ba10 2024-04-25T09:04:43.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.099+0000 7f6574d7e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657006cec0 con 0x7f657006c1f0 2024-04-25T09:04:43.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.099+0000 7f6574d7e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700cd8e0 con 0x7f657009a150 2024-04-25T09:04:43.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.099+0000 7f656ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657015ba10 0x7f65700b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.099+0000 7f656ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657015ba10 0x7f65700b6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41708/0 (socket says 172.21.15.55:41708) 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.099+0000 7f656ed9d640 1 -- 172.21.15.55:0/244989017 learned_addr learned my addr 172.21.15.55:0/244989017 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f656e59c640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f657006c1f0 0x7f65700c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f656dd9b640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f657009a150 0x7f65700b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f656ed9d640 1 -- 172.21.15.55:0/244989017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f657009a150 msgr2=0x7f65700b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f656ed9d640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f657009a150 0x7f65700b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f656ed9d640 1 -- 172.21.15.55:0/244989017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f657006c1f0 msgr2=0x7f65700c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f656ed9d640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f657006c1f0 0x7f65700c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f656ed9d640 1 -- 172.21.15.55:0/244989017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700b7200 con 0x7f657015ba10 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f656ed9d640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657015ba10 0x7f65700b6b80 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f656800c820 tx=0x7f656800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f6566ffd640 1 -- 172.21.15.55:0/244989017 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568015070 con 0x7f657015ba10 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f6566ffd640 1 -- 172.21.15.55:0/244989017 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6568007a30 con 0x7f657015ba10 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f6574d7e640 1 -- 172.21.15.55:0/244989017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65700b44c0 con 0x7f657015ba10 2024-04-25T09:04:43.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f6566ffd640 1 -- 172.21.15.55:0/244989017 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568007e40 con 0x7f657015ba10 2024-04-25T09:04:43.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.100+0000 7f6574d7e640 1 -- 172.21.15.55:0/244989017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65700b4a80 con 0x7f657015ba10 2024-04-25T09:04:43.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.101+0000 7f6574d7e640 1 -- 172.21.15.55:0/244989017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6570067490 con 0x7f657015ba10 2024-04-25T09:04:43.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.102+0000 7f6566ffd640 1 -- 172.21.15.55:0/244989017 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6568018070 con 0x7f657015ba10 2024-04-25T09:04:43.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.102+0000 7f6566ffd640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f655006b4d0 0x7f655006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.102+0000 7f6566ffd640 1 -- 172.21.15.55:0/244989017 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f656808a100 con 0x7f657015ba10 2024-04-25T09:04:43.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.102+0000 7f656e59c640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f655006b4d0 0x7f655006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.103+0000 7f656e59c640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f655006b4d0 0x7f655006d990 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6560009f20 tx=0x7f65600094d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.106+0000 7f6566ffd640 1 -- 172.21.15.55:0/244989017 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6570067490 con 0x7f657015ba10 2024-04-25T09:04:43.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.324+0000 7f6574d7e640 1 -- 172.21.15.55:0/244989017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65700749b0 con 0x7f657015ba10 2024-04-25T09:04:43.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.325+0000 7f6566ffd640 1 -- 172.21.15.55:0/244989017 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+3704 (secure 0 0 0) 0x7f65680590a0 con 0x7f657015ba10 2024-04-25T09:04:43.313 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:04:43.313 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":101,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/540699664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":540699664},{"type":"v1","addr":"172.21.15.167:6834","nonce":540699664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1525730664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":1525730664},{"type":"v1","addr":"172.21.15.167:6835","nonce":1525730664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":8913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2212088833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2212088833},{"type":"v1","addr":"172.21.15.55:6836","nonce":2212088833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":9549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2666045110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2666045110},{"type":"v1","addr":"172.21.15.55:6837","nonce":2666045110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[]} 2024-04-25T09:04:43.313 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 101 2024-04-25T09:04:43.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.326+0000 7f6574d7e640 1 -- 172.21.15.55:0/244989017 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f655006b4d0 msgr2=0x7f655006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.326+0000 7f6574d7e640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f655006b4d0 0x7f655006d990 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6560009f20 tx=0x7f65600094d0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.326+0000 7f6574d7e640 1 -- 172.21.15.55:0/244989017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657015ba10 msgr2=0x7f65700b6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.326+0000 7f6574d7e640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657015ba10 0x7f65700b6b80 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f656800c820 tx=0x7f656800cce0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.326+0000 7f6574d7e640 1 -- 172.21.15.55:0/244989017 shutdown_connections 2024-04-25T09:04:43.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.326+0000 7f6574d7e640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.55:6832/3452216423,v1:172.21.15.55:6833/3452216423] conn(0x7f655006b4d0 0x7f655006d990 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.326+0000 7f6574d7e640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657015ba10 0x7f65700b6b80 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.326+0000 7f6574d7e640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f657009a150 0x7f65700b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.326+0000 7f6574d7e640 1 --2- 172.21.15.55:0/244989017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f657006c1f0 0x7f65700c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.326+0000 7f6574d7e640 1 -- 172.21.15.55:0/244989017 >> 172.21.15.55:0/244989017 conn(0x7f65700b32f0 msgr2=0x7f65700cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.327+0000 7f6574d7e640 1 -- 172.21.15.55:0/244989017 shutdown_connections 2024-04-25T09:04:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:04:43.327+0000 7f6574d7e640 1 -- 172.21.15.55:0/244989017 wait complete. 2024-04-25T09:04:43.326 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T09:04:43.326 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T09:04:43.326 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:04:43.326 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.335 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:04:43.335 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:04:43.335 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.385 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:04:43.385 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:04:43.385 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.397 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:04:43.397 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:04:43.397 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.449 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:04:43.449 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T09:04:43.449 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T09:04:43.449 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.478 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T09:04:43.478 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T09:04:43.478 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.547 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T09:04:43.548 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T09:04:43.548 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.614 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T09:04:43.615 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T09:04:43.615 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-25T09:04:43.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-04-25T09:04:43.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-25T09:04:43.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-25T09:04:43.689 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T09:04:43.689 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T09:04:43.690 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.725 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T09:04:43.725 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T09:04:43.725 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.792 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T09:04:43.793 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T09:04:43.793 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.871 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T09:04:43.871 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T09:04:43.871 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.943 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T09:04:43.943 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T09:04:43.944 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T09:04:43.944 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:43.970 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T09:04:43.970 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T09:04:43.970 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:44.009 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T09:04:44.009 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T09:04:44.009 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T09:04:44.010 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:44.021 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T09:04:44.021 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T09:04:44.021 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:44.061 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T09:04:44.062 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T09:04:44.062 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:44.113 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T09:04:44.113 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T09:04:44.114 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-25T09:04:44.151 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:04:44.151 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T09:04:44.400 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:04:44.400 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T09:04:44.473 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:04:44.473 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T09:04:44.527 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:04:44.527 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T09:04:44.573 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T09:04:44.573 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T09:04:44.723 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T09:04:44.723 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T09:04:44.810 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T09:04:44.811 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T09:04:44.851 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T09:04:44.852 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T09:04:44.927 INFO:tasks.ceph:Archiving mon data... 2024-04-25T09:04:44.928 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001/data/mon.a.tgz 2024-04-25T09:04:44.929 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2024-04-25T09:04:44.946 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.X3pLdDA1Dg 2024-04-25T09:04:44.946 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.X3pLdDA1Dg 2024-04-25T09:04:45.125 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.X3pLdDA1Dg 2024-04-25T09:04:45.208 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.X3pLdDA1Dg is 403KB 2024-04-25T09:04:45.304 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.X3pLdDA1Dg 2024-04-25T09:04:45.319 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001/data/mon.b.tgz 2024-04-25T09:04:45.320 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-04-25T09:04:45.336 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.eZpGcm2NV8 2024-04-25T09:04:45.337 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.eZpGcm2NV8 2024-04-25T09:04:45.490 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.eZpGcm2NV8 2024-04-25T09:04:45.570 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.eZpGcm2NV8 is 406KB 2024-04-25T09:04:45.665 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.eZpGcm2NV8 2024-04-25T09:04:45.679 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001/data/mon.c.tgz 2024-04-25T09:04:45.679 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-04-25T09:04:45.733 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.OqvuPuE2CE 2024-04-25T09:04:45.733 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.OqvuPuE2CE 2024-04-25T09:04:45.868 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.OqvuPuE2CE 2024-04-25T09:04:45.949 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.OqvuPuE2CE is 406KB 2024-04-25T09:04:46.045 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.OqvuPuE2CE 2024-04-25T09:04:46.059 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T09:04:46.060 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:04:46.062 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:04:46.142 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:04:46.177 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:04:46.178 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T09:04:46.179 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001/remote/smithi055/crash 2024-04-25T09:04:46.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:04:46.210 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001/remote/smithi167/crash 2024-04-25T09:04:46.211 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:04:46.240 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T09:04:46.241 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:46.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:46.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:46.368 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:46.391 INFO:tasks.ceph:Compressing logs... 2024-04-25T09:04:46.392 DEBUG:teuthology.orchestra.run.smithi055:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:04:46.411 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:04:46.479 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34652.log 2024-04-25T09:04:46.480 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:04:46.480 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.34652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41320.log 2024-04-25T09:04:46.480 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34612.log 2024-04-25T09:04:46.480 INFO:teuthology.orchestra.run.smithi167.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34652.log.gz 2024-04-25T09:04:46.480 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.3.41320.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T09:04:46.480 INFO:teuthology.orchestra.run.smithi167.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41320.log.gz 2024-04-25T09:04:46.480 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.34612.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T09:04:46.480 INFO:teuthology.orchestra.run.smithi167.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34612.log.gz 2024-04-25T09:04:46.480 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T09:04:46.480 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T09:04:46.480 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T09:04:46.481 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T09:04:46.481 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T09:04:46.481 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34572.log 2024-04-25T09:04:46.481 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.c.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:04:46.481 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T09:04:46.481 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40921.log 2024-04-25T09:04:46.481 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.34572.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T09:04:46.481 INFO:teuthology.orchestra.run.smithi167.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34572.log.gz 2024-04-25T09:04:46.481 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.1.40921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34532.log 2024-04-25T09:04:46.481 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.6.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40921.log.gz 2024-04-25T09:04:46.481 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34743.log 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.34532.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34532.log.gz 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34692.log 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.34743.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34743.log.gz 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41316.log 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.34692.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34692.log.gz 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40926.log 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.3.41316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41316.log.gz 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr: -- /var/log/ceph/ceph-client.admin.34823.log 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34783.log 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.34823.log: /var/log/ceph/ceph-client.1.40926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40926.log.gz 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34823.log.gz 2024-04-25T09:04:46.482 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.34783.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34783.log.gz 2024-04-25T09:04:46.483 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T09:04:46.511 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T09:04:46.518 INFO:teuthology.orchestra.run.smithi167.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T09:04:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64335.log 2024-04-25T09:04:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62000.log 2024-04-25T09:04:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78913.log 2024-04-25T09:04:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69403.log 2024-04-25T09:04:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78913.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62000.log.gz 2024-04-25T09:04:46.579 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.64335.log.gz 2024-04-25T09:04:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59605.log 2024-04-25T09:04:46.579 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78913.log.gz 2024-04-25T09:04:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55499.log 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55719.log 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69403.log.gz 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55499.log: gzip -5 88.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.59605.log.gz 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.71729.log 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55499.log.gz 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70648.log 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71729.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.55719.log.gz 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64703.log 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71729.log.gz 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42945.log 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70648.log.gz 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52177.log 2024-04-25T09:04:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41299.log 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52177.log: gzip -5 --verbose 91.1% -- -- replaced with /var/log/ceph/ceph-client.admin.64703.log.gz /var/log/ceph/ceph-client.admin.68156.log 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42945.log.gz 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52177.log.gz 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48044.log 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47433.log 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41299.log.gz 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68156.log.gz 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.48044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48044.log.gzgzip 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.76016.log 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57099.log 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.76016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75651.log 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47433.log.gz 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42303.log 2024-04-25T09:04:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75651.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57099.log.gz 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64089.log 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75651.log.gz 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47787.log 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.76016.log.gz 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.64089.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.58709.log 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.0.64089.log.gz 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42303.log.gz 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49259.log 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71813.log 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.47787.log.gz 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44799.log 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58709.log.gz 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71813.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49259.log.gz 2024-04-25T09:04:46.582 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77868.log 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53353.log 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71813.log.gz 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44799.log.gz 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74417.log 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77868.log.gz 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44994.log 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53353.log: /var/log/ceph/ceph-client.admin.74417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75805.log 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53353.log.gz 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44994.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74417.log.gz 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61238.log 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44994.log.gz 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56834.log 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41642.log 2024-04-25T09:04:46.583 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.75805.log.gz 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61238.log.gz 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71002.log 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56834.log.gz 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47307.log 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71002.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41642.log.gz 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48357.log 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63366.log 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.71002.log.gz 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48357.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47307.log.gz 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67025.log 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48357.log.gz 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61010.log 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46416.log 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63366.log.gz 2024-04-25T09:04:46.584 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67025.log.gz 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41043.log 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61010.log.gz 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68875.log 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41043.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46416.log.gz 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57183.log 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.68875.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41043.log.gz 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77784.log 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68875.log.gz 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76271.log 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77784.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.57183.log.gz --verbose 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.69895.log 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.76271.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77784.log.gz 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61178.log 2024-04-25T09:04:46.585 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76271.log.gz 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75861.log 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69895.log.gz 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44505.log 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61178.log: /var/log/ceph/ceph-client.admin.75861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52219.log 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61178.log.gz 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46702.log 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44505.log.gz 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41974.log 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.75861.log.gz 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46702.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52219.log.gz 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65403.log 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46702.log.gz 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44253.log 2024-04-25T09:04:46.586 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41974.log.gz 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60313.log 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44253.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65403.log.gz 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46122.log 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44253.log.gz 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.60313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61670.log 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60313.log.gz 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50056.log 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46122.log: /var/log/ceph/ceph-client.admin.61670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43983.log 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46122.log.gz 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61491.log 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50056.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61670.log.gz 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58123.log 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50056.log.gz 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61491.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43983.log.gz 2024-04-25T09:04:46.587 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63704.log 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61491.log.gz 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77243.log 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44841.log 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.58123.log.gz 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63704.log.gz 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62351.log 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65077.log 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44841.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77243.log.gz 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71086.log 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44841.log.gz 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53012.log 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62351.log.gz 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65077.log.gz 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72532.log 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52345.log 2024-04-25T09:04:46.588 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72532.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.71086.log.gz 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53012.log.gz 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77327.log 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72532.log.gz 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.52345.log: -- /var/log/ceph/ceph-client.admin.42765.log 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68408.log 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52345.log.gz 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42765.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.77327.log.gz 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66629.log 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42765.log.gz 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55583.log 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45744.log 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68408.log.gz 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66629.log.gz 2024-04-25T09:04:46.589 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65935.log 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55583.log.gz 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76465.log 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45744.log: /var/log/ceph/ceph-client.admin.65935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71175.log 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45744.log.gz 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.76465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75768.log 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.76465.log.gz 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71175.log: 90.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.65935.log.gz 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34808.log 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55038.log 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.71175.log.gz 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.34808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63240.log 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.75768.log.gz 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34808.log.gz 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64443.log 2024-04-25T09:04:46.590 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50269.log 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55038.log.gz 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64443.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63240.log.gz 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72490.log 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57563.log 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72490.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50269.log.gz 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58291.log 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64443.log.gz 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72490.log.gz 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49572.log 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57563.log.gz 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48782.log 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58291.log: /var/log/ceph/ceph-client.admin.49572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78871.log 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58291.log.gz 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48782.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49572.log.gz 2024-04-25T09:04:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53187.log 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67067.log 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78871.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48782.log.gz 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42555.log 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78871.log.gz 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53187.log.gz 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43728.log 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42555.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.67067.log.gz 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.75532.log 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42555.log.gz 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.2.43728.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.2.43728.log.gz -5 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73093.log 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73595.log 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75532.log: /var/log/ceph/ceph-client.admin.73093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45078.log 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75532.log.gz 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.73595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41977.log 2024-04-25T09:04:46.592 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73595.log.gz 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr: 91.1%/var/log/ceph/ceph-client.admin.45078.log: -- replaced with /var/log/ceph/ceph-client.admin.73093.log.gz 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70915.log 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71152.log 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45078.log.gz 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70915.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41977.log.gz 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59713.log 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.70915.log.gz 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40057.log 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71152.log.gz 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63000.log 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40057.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59713.log.gz 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51747.log 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40057.log.gz 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.63000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62705.log 2024-04-25T09:04:46.593 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63000.log.gz 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52700.log 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73697.log 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51747.log.gz 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62705.log: /var/log/ceph/ceph-client.admin.52700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79014.log 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62705.log.gz 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.73697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67127.log 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52700.log.gz 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.79014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59389.log 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73697.log.gz 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67127.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.79014.log.gz 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69059.log 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67127.log.gz 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49614.log 2024-04-25T09:04:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59389.log: /var/log/ceph/ceph-client.admin.69059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60388.log 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69059.log.gz 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49614.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59389.log.gz 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63282.log 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49614.log.gz 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.60388.log.gz 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49758.log 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74722.log 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44379.log 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63282.log.gz 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.74722.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49758.log.gz 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52597.log 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74722.log.gz 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5/var/log/ceph/ceph-client.admin.44379.log: --verbose -- /var/log/ceph/ceph-client.admin.73858.log 2024-04-25T09:04:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41302.log 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44379.log.gz 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52597.log.gz 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.73858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71392.log 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72065.log 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53395.log 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41302.log.gz 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.73858.log.gz 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71392.log.gz 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62181.log 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72065.log.gz 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.53395.log: /var/log/ceph/ceph-client.admin.78325.log 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72967.log 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53395.log.gz 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64551.log 2024-04-25T09:04:46.596 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62181.log.gz 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72967.log: gzip -5 87.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.78325.log.gz -- 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.70467.log 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64551.log: gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.72967.log.gz /var/log/ceph/ceph-client.admin.57437.log 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47179.log 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70467.log.gz 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65035.log 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.64551.log.gz 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57437.log.gz 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72620.log 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65035.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47179.log.gz 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44169.log 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72620.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65035.log.gz 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65217.log 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72620.log.gz 2024-04-25T09:04:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50660.log 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45240.log 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44169.log.gz 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74970.log 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65217.log.gz 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50660.log.gz 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49217.log 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.74970.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45240.log.gz 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49217.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74970.log.gz 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42177.log 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49217.log.gz 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53945.log 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54930.log 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53945.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.42177.log.gz 2024-04-25T09:04:46.598 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53945.log.gz 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50870.log 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.47493.log: /var/log/ceph/ceph-client.admin.62435.log 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54930.log.gz 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50870.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75161.log 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66367.log 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50870.log.gz 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62435.log: gzip -5 --verbose --/var/log/ceph/ceph-client.0.75161.log: /var/log/ceph/ceph-client.admin.57004.log 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62435.log.gz 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.75161.log.gz 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42261.log 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57004.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66367.log.gz 2024-04-25T09:04:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50534.log 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57004.log.gz 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42639.log 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55803.log 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42261.log.gz 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42639.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50534.log.gz 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55296.log 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42639.log.gz 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72883.log 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55803.log.gz 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65600.log 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72576.log 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72883.log.gz 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65600.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55296.log.gz 2024-04-25T09:04:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68324.log 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60884.log 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72576.log: /var/log/ceph/ceph-client.admin.68324.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.65600.log.gz 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61449.log 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72576.log.gz 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68324.log.gz 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42807.log 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61449.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.61407.log -- replaced with /var/log/ceph/ceph-client.admin.60884.log.gz 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42807.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61449.log.gz 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65342.log 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55541.log 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61407.log.gz 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42807.log.gz 2024-04-25T09:04:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76357.log 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77621.log 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55541.log: /var/log/ceph/ceph-client.admin.76357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63443.log 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55541.log.gz 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77621.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.76357.log.gz 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55362.log 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77621.log.gz 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.63443.log: /var/log/ceph/ceph-client.admin.51597.log 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.65342.log.gz 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58962.log 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63443.log.gz 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55362.log.gz 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44757.log 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75490.log 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.58962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58962.log.gz 2024-04-25T09:04:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40409.log 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51597.log.gz 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44757.log.gz 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55887.log 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75490.log.gz 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67254.log 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62519.log 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40409.log.gz 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67254.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55887.log.gz 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70592.log 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67254.log.gz 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65457.log 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54408.log 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62519.log.gz 2024-04-25T09:04:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72202.log 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.70592.log.gz 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.54408.log: gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.65457.log.gz --verbose 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph.audit.log 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54408.log.gz 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60581.log 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72202.log.gz 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66671.log 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65499.log 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66671.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60581.log.gz 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42471.log 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65499.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66671.log.gz 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54888.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65499.log.gz 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50183.log 2024-04-25T09:04:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79056.log 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42471.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50183.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42471.log.gz -5 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47619.log 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50183.log.gz 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64909.log 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.79056.log: /var/log/ceph/ceph-client.admin.47619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61873.log 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79056.log.gz 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47619.log.gz 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57269.log 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64909.log.gz 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60758.log 2024-04-25T09:04:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57269.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61873.log.gz 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48708.log 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57269.log.gz 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57647.log 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48708.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.60758.log.gz /var/log/ceph/ceph-client.admin.55929.log 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57647.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48708.log.gz 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57647.log.gz 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61958.log 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50225.log 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55929.log.gz 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74459.log 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61958.log.gz 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53903.log 2024-04-25T09:04:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.74459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41841.log 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50225.log.gz 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74459.log.gz 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40875.log 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53903.log.gz 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71687.log 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40875.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41841.log.gz 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66493.log 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40875.log.gz 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59312.log 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71687.log.gz 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47577.log 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45036.log 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66493.log.gz 2024-04-25T09:04:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47577.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59312.log.gz 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41981.log 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47577.log.gz 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52041.log 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34424.log 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45036.log.gz 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52041.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41981.log.gz 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69101.log 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52041.log.gz 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.34424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63898.log 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67212.log 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34424.log.gz 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63898.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69101.log.gz -5 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.70098.log 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63898.log.gz 2024-04-25T09:04:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77537.log 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70098.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67212.log.gz 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72406.log 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70098.log.gz 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56409.log 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78577.log 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77537.log.gz 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72406.log.gz 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72448.log 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56409.log.gz 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71561.log 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62393.log 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78577.log.gz 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72448.log.gz 2024-04-25T09:04:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69937.log 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71561.log.gz 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50448.log 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66797.log 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62393.log.gz 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69937.log.gz 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50448.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50448.log.gz 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43423.log 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44952.log 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66797.log.gz 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46872.log 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3%/var/log/ceph/ceph-client.admin.44952.log: -- replaced with /var/log/ceph/ceph-client.admin.43423.log.gz 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53651.log 2024-04-25T09:04:46.610 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44952.log.gz/var/log/ceph/ceph-client.admin.46872.log: 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51020.log 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46872.log.gz 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74904.log 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53651.log: /var/log/ceph/ceph-client.admin.51020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77826.log 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53651.log.gz 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.74904.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51020.log.gz 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65240.log 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41637.log 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77826.log: /var/log/ceph/ceph-client.admin.65240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64951.log 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr: 91.0% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77826.log.gz 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74904.log.gz 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.41637.log: -- /var/log/ceph/ceph-client.admin.73159.log 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49895.log 87.2% 2024-04-25T09:04:46.611 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41637.log.gz 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.65240.log.gz 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.73159.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64951.log.gz 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74291.log 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73159.log.gz 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49895.log: -- /var/log/ceph/ceph-client.admin.52303.log 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78283.log 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.74291.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49895.log.gz 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40497.log 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74291.log.gz 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.78283.log: /var/log/ceph/ceph-client.admin.48665.log 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52303.log.gz 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40497.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78283.log.gz 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60497.log 2024-04-25T09:04:46.612 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40497.log.gz 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52083.log 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48665.log: /var/log/ceph/ceph-client.admin.60497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55761.log 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48665.log.gz 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60497.log.gz 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66535.log 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50744.log 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7%/var/log/ceph/ceph-client.admin.55761.log: -- replaced with /var/log/ceph/ceph-client.admin.52083.log.gz 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62813.log 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55761.log.gz 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52555.log 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1%/var/log/ceph/ceph-client.admin.50744.log: -- replaced with /var/log/ceph/ceph-client.admin.66535.log.gz 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62813.log: gzip 89.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.50744.log.gz --verbose 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.68070.log 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75406.log 2024-04-25T09:04:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52555.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62813.log.gz 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57946.log 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52555.log.gz 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69017.log 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68070.log.gz 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.57946.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75406.log.gz 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44631.log 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57946.log.gz 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.69017.log: -- /var/log/ceph/ceph-client.admin.45498.log 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65857.log 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69017.log.gz 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44631.log.gz 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44067.log 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.65857.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45498.log.gz 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.65857.log.gz -5 --verbose 2024-04-25T09:04:46.614 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.64401.log 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68534.log 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44067.log: /var/log/ceph/ceph-client.admin.64401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67338.log 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44067.log.gz 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68534.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64401.log.gz 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47703.log 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68534.log.gz 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67338.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67338.log.gz 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40453.log 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47703.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57942.log 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47703.log.gz 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72713.log 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40453.log.gz 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.57942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44547.log 2024-04-25T09:04:46.615 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57942.log.gz 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68198.log 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72713.log.gz 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44547.log: /var/log/ceph/ceph-client.admin.68198.log: gzip -5 --verbose 88.6% -- /var/log/ceph/ceph-client.admin.51509.log -- replaced with /var/log/ceph/ceph-client.admin.44547.log.gz 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61750.log 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68198.log.gz 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41641.log 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62477.log 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51509.log.gz 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56013.log 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61750.log.gz 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41308.log 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62477.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41641.log.gz/var/log/ceph/ceph-client.admin.56013.log: 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71519.log 2024-04-25T09:04:46.616 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62477.log.gz 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41308.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56013.log.gz 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41307.log 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71519.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41308.log.gz 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58581.log 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71519.log.gz 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52471.log 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58581.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41307.log.gz 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr:gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.58581.log.gz --verbose 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.73655.log 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58249.log 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52471.log: /var/log/ceph/ceph-client.admin.73655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56918.log 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52471.log.gz 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73655.log.gz 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46458.log 2024-04-25T09:04:46.617 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56630.log 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58249.log.gz 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56918.log.gz 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45582.log 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51790.log 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56630.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46458.log.gz 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64249.log 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56630.log.gz 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67380.log 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45582.log.gz 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50618.log 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.51790.log.gz 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69185.log 2024-04-25T09:04:46.618 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67380.log.gz 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50618.log: 90.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62621.log 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64249.log.gz 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69185.log: gzip 88.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.50618.log.gz -- 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.46080.log 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69185.log.gz 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53269.log 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74818.log 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46080.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62621.log.gz 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53269.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46080.log.gz 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.74818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63505.log 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53269.log.gz 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.74818.log.gz 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.1.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62223.log 2024-04-25T09:04:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63505.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61915.log 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63505.log.gz 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60122.log 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62223.log.gz 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68366.log 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61915.log.gz -5 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67639.log 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60122.log: /var/log/ceph/ceph-client.admin.68366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61136.log 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60122.log.gz 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67639.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68366.log.gz 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40665.log 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67639.log.gz 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:gzip/var/log/ceph/ceph-client.admin.61136.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70299.log 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40665.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61136.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56097.log 2024-04-25T09:04:46.620 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40665.log.gz 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34689.log 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70299.log: /var/log/ceph/ceph-client.admin.56097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67847.log 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.34689.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56097.log.gz 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr: 90.9% 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34689.log.gz 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70299.log.gz 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54738.log 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.67847.log: -- /var/log/ceph/ceph-client.admin.48483.log 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58165.log 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67847.log.gz 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54113.log 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr: 91.1%/var/log/ceph/ceph-client.admin.58165.log: -- replaced with /var/log/ceph/ceph-client.admin.54738.log.gz 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48483.log.gz 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28351.log 2024-04-25T09:04:46.621 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58165.log.gz 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.54113.log: /var/log/ceph/ceph-client.admin.69853.log 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.tmp-client.admin.28351.log: 0.0% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54113.log.gz 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75950.log 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.28351.log.gz 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69853.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69853.log.gz 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77107.log 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75950.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53987.log 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77107.log: 88.7% 91.1% -- replaced with /var/log/ceph/ceph-client.admin.75950.log.gz 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77107.log.gz 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63528.log 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75574.log 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53987.log: /var/log/ceph/ceph-client.admin.63528.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53987.log.gz 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55971.log 2024-04-25T09:04:46.622 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63528.log.gz 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75574.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75574.log.gz 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48965.log 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55971.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55971.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52387.log 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53693.log 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48965.log: /var/log/ceph/ceph-client.admin.52387.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48965.log.gz 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52387.log.gz 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76399.log 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46914.log 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53693.log.gz 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.76399.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.76399.log.gz 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73051.log 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53567.log 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46914.log: /var/log/ceph/ceph-client.admin.73051.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46914.log.gz 2024-04-25T09:04:46.623 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73051.log.gz 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53567.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53567.log.gz 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47263.log 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43857.log 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46332.log: /var/log/ceph/ceph-client.admin.47263.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47263.log.gz 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66965.log 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43857.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43857.log.gz 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46206.log 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78829.log 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66965.log: /var/log/ceph/ceph-client.admin.46206.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66965.log.gz 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76656.log 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46206.log.gz 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78829.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78829.log.gz 2024-04-25T09:04:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50912.log 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74666.log 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.76656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.76656.log.gz 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40223.log 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50912.log.gz 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.74666.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.74666.log.gz 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65558.log 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54616.log 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40223.log: /var/log/ceph/ceph-client.admin.65558.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40223.log.gz 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.65558.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.42513.log 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54616.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.54616.log.gz 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68282.log 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60014.log 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42513.log: /var/log/ceph/ceph-client.admin.68282.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42513.log.gz 2024-04-25T09:04:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46998.log 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68282.log.gz 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60014.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60014.log.gz 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46788.log 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48603.log 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46998.log: /var/log/ceph/ceph-client.admin.46788.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46998.log.gz 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46248.log 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46788.log.gz 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48603.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48603.log.gz 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41640.log 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60926.log 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46248.log: /var/log/ceph/ceph-client.admin.41640.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46248.log.gz 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41640.log.gz 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68576.log 2024-04-25T09:04:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60926.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60926.log.gz 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58430.log 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52784.log 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68576.log: /var/log/ceph/ceph-client.admin.58430.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68576.log.gz 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56710.log 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58430.log.gz 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52784.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52784.log.gz 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73739.log 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65853.log 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56710.log: /var/log/ceph/ceph-client.admin.73739.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56710.log.gz 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70383.log 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73739.log.gz 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.65853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65853.log.gz 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69590.log 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39961.log 2024-04-25T09:04:46.627 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70383.log: /var/log/ceph/ceph-client.0.69590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69590.log.gz 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.70383.log.gz 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58453.log 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69979.log 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.39961.log: /var/log/ceph/ceph-client.admin.58453.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39961.log.gz 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63324.log 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58453.log.gz 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69979.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69979.log.gz 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41980.log 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67559.log 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63324.log: /var/log/ceph/ceph-client.admin.41980.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.63324.log.gz 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41980.log.gz 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51681.log 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67559.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67559.log.gz 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54996.log 2024-04-25T09:04:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71645.log 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51681.log: /var/log/ceph/ceph-client.admin.54996.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54996.log.gz 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51681.log.gz 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46538.log 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74115.log 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71645.log: /var/log/ceph/ceph-client.admin.46538.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71645.log.gz 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.46538.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.64509.log 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.74115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74115.log.gz 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40749.log 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52886.log 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64509.log: /var/log/ceph/ceph-client.admin.40749.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64509.log.gz 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40749.log.gz 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65300.log 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52886.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52886.log.gz 2024-04-25T09:04:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41645.log 2024-04-25T09:04:46.630 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50702.log 2024-04-25T09:04:46.630 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65300.log: /var/log/ceph/ceph-client.admin.41645.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41645.log.gz 2024-04-25T09:04:46.630 INFO:teuthology.orchestra.run.smithi055.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.65300.log.gz 2024-04-25T09:04:46.630 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59186.log 2024-04-25T09:04:46.630 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53735.log 2024-04-25T09:04:46.630 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50702.log: /var/log/ceph/ceph-client.admin.59186.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50702.log.gz 2024-04-25T09:04:46.630 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59186.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78661.log 2024-04-25T09:04:46.630 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.630 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53735.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53735.log.gz 2024-04-25T09:04:46.630 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66272.log 2024-04-25T09:04:46.630 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78703.log 2024-04-25T09:04:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78661.log: /var/log/ceph/ceph-client.admin.66272.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78661.log.gz 2024-04-25T09:04:46.713 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66272.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56960.log 2024-04-25T09:04:46.713 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78703.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78703.log.gz 2024-04-25T09:04:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70702.log 2024-04-25T09:04:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78787.log 2024-04-25T09:04:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56960.log: /var/log/ceph/ceph-client.admin.70702.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56960.log.gz 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70702.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45870.log 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78787.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78787.log.gz 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57311.log 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57689.log 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45870.log: /var/log/ceph/ceph-client.admin.57311.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45870.log.gz 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57311.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41627.log 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57689.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57689.log.gz 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55845.log 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41627.log: /var/log/ceph/ceph-client.admin.55845.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41627.log.gz 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52970.log 2024-04-25T09:04:46.714 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55845.log.gz 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53819.log 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52970.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52970.log.gz 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41306.log 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53819.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53819.log.gz 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67977.log 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41306.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41306.log.gz 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69347.log 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67977.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67977.log.gz 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48819.log 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69347.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.69347.log.gz 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78493.log 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48819.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.48819.log.gz 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46164.log 2024-04-25T09:04:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78493.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78493.log.gz 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73346.log 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46164.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46164.log.gz 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48040.log 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.73346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73346.log.gz 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66839.log 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.48040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48040.log.gz 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78367.log 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66839.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66839.log.gz 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45198.log 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78367.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78367.log.gz 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67170.log 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45198.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45198.log.gz 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53861.log 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67170.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67170.log.gz 2024-04-25T09:04:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57521.log 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53861.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53861.log.gz 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71603.log 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57521.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57521.log.gz 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40917.log 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71603.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71603.log.gz 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63832.log 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40917.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40917.log.gz 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68114.log 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63832.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63832.log.gz 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78188.log 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68114.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68114.log.gz 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58527.log 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78188.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78188.log.gz 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66881.log 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58527.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58527.log.gz 2024-04-25T09:04:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68450.log 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66881.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66881.log.gz 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77369.log 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68450.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68450.log.gz 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47221.log 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77369.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77369.log.gz 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60800.log 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47221.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47221.log.gz 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60309.log 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60800.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60800.log.gz 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78619.log 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.60309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60309.log.gz 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45366.log 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78619.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78619.log.gz 2024-04-25T09:04:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69324.log 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45366.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45366.log.gz 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58667.log 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69324.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69324.log.gz 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45456.log 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58667.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58667.log.gz 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74111.log 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45456.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45456.log.gz 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51435.log 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.74111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74111.log.gz 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56223.log 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51435.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51435.log.gz 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72799.log 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56223.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56223.log.gz 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46618.log 2024-04-25T09:04:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72799.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72799.log.gz 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42681.log 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46618.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46618.log.gz 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49488.log 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42681.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42681.log.gz 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63004.log 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49488.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49488.log.gz 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56535.log 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.63004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63004.log.gz 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62139.log 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56535.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56535.log.gz 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62309.log 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62139.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62139.log.gz 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49175.log 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62309.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62309.log.gz 2024-04-25T09:04:46.720 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65155.log 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49175.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49175.log.gz 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44295.log 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65155.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65155.log.gz 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70212.log 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44295.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44295.log.gz 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66001.log 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70212.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70212.log.gz 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68492.log 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66001.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.66001.log.gz 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76981.log 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68492.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68492.log.gz 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66923.log 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.76981.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76981.log.gz 2024-04-25T09:04:46.721 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72755.log 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66923.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66923.log.gz 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71477.log 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72755.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72755.log.gz 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49133.log 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71477.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71477.log.gz 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67720.log 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49133.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49133.log.gz 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49698.log 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67720.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67720.log.gz 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63790.log 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49698.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49698.log.gz 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56493.log 2024-04-25T09:04:46.722 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63790.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63790.log.gz 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49007.log 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56493.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56493.log.gz 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71897.log 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43941.log 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71897.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49007.log.gz 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71897.log.gz 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71435.log 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70788.log 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71435.log: /var/log/ceph/ceph-client.admin.43941.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43941.log.gz 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71435.log.gz 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72671.log 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.70788.log: /var/log/ceph/ceph-client.0.75157.log 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70788.log.gz 2024-04-25T09:04:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66164.log 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72671.log.gz 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.75157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43724.log 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.75157.log.gz 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60842.log 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0%/var/log/ceph/ceph-client.2.43724.log: -- replaced with /var/log/ceph/ceph-client.admin.66164.log.gz 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43724.log.gz 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56265.log 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54563.log 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60842.log.gz 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77742.log 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56265.log.gz 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54563.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54563.log.gz 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52429.log 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64811.log 2024-04-25T09:04:46.724 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77742.log.gz 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50786.log 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64811.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52429.log.gz 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48745.log 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.64811.log.gz 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78061.log 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48745.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50786.log.gz 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48745.log.gz 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71981.log 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78745.log 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78061.log: /var/log/ceph/ceph-client.admin.71981.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78061.log.gz 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71981.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59144.log 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78745.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78745.log.gz 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57141.log 2024-04-25T09:04:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67889.log 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59144.log: /var/log/ceph/ceph-client.admin.57141.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59144.log.gz 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57141.log.gz 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54672.log 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48399.log 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54672.log: /var/log/ceph/ceph-client.admin.67889.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67889.log.gz 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54672.log.gz 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61323.log 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78145.log 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48399.log: /var/log/ceph/ceph-client.admin.61323.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48399.log.gz 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61323.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41979.log 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51510.log 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78145.log: /var/log/ceph/ceph-client.admin.41979.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41979.log.gz 2024-04-25T09:04:46.726 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78145.log.gz 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49385.log 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46830.log 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51510.log.gz 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47661.log 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46830.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49385.log.gz 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40581.log 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46830.log.gz 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78241.log 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47661.log: /var/log/ceph/ceph-client.admin.40581.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40581.log.gz 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47661.log.gz 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56055.log 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73924.log 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78241.log.gz 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67762.log 2024-04-25T09:04:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.73924.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56055.log.gz 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73924.log.gz 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41001.log 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45996.log 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67762.log.gz 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78103.log 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45996.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41001.log.gz 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45996.log.gz 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49530.log 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41639.log 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78103.log: /var/log/ceph/ceph-client.admin.49530.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78103.log.gz 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45540.log 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49530.log.gz 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72925.log 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41639.log: /var/log/ceph/ceph-client.admin.45540.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45540.log.gz 2024-04-25T09:04:46.728 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41639.log.gz 2024-04-25T09:04:46.729 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45828.log 2024-04-25T09:04:46.729 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70550.log 2024-04-25T09:04:46.729 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72925.log: /var/log/ceph/ceph-client.admin.45828.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72925.log.gz 2024-04-25T09:04:46.729 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45828.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77411.log 2024-04-25T09:04:46.729 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.729 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70550.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.70550.log.gz 2024-04-25T09:04:46.729 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41127.log 2024-04-25T09:04:46.729 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69143.log 2024-04-25T09:04:46.729 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77411.log: /var/log/ceph/ceph-client.admin.41127.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77411.log.gz 2024-04-25T09:04:46.729 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41127.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45120.log 2024-04-25T09:04:46.729 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.736 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T09:04:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69143.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69143.log.gz 2024-04-25T09:04:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62267.log 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50492.log 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45120.log: /var/log/ceph/ceph-client.admin.62267.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45120.log.gz 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.62267.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.45324.log 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50492.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50492.log.gz 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77699.log 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71939.log 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45324.log: /var/log/ceph/ceph-client.admin.77699.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45324.log.gz 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51957.log 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77699.log.gz 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71939.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71939.log.gz 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63746.log 2024-04-25T09:04:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66206.log 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51957.log: /var/log/ceph/ceph-client.admin.63746.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51957.log.gz 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63746.log.gz 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56876.log 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66206.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66206.log.gz 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50954.log 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77579.log 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56876.log: /var/log/ceph/ceph-client.admin.50954.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56876.log.gz 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49800.log 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.50954.log.gz 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77579.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77579.log.gz 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53481.log 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47128.log 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49800.log: /var/log/ceph/ceph-client.admin.53481.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49800.log.gz 2024-04-25T09:04:46.748 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53481.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49656.log 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47128.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47128.log.gz 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40367.log 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47040.log 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49656.log: /var/log/ceph/ceph-client.admin.40367.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49656.log.gz 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40138.log 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47040.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47040.log.gz 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41303.log 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68618.log 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40138.log: /var/log/ceph/ceph-client.admin.41303.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40138.log.gz 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76652.log 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41303.log.gz 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68618.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.68618.log.gz 2024-04-25T09:04:46.749 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56325.log 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73350.log 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.76652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.76652.log.gz 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62044.log 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56325.log.gz 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.73350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73350.log.gz 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59972.log 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43287.log 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62044.log: /var/log/ceph/ceph-client.admin.59972.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62044.log.gz 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49049.log 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59972.log.gz 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.43287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43287.log.gz 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64993.log 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64617.log 2024-04-25T09:04:46.750 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49049.log: /var/log/ceph/ceph-client.admin.64993.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49049.log.gz 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64993.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75448.log 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64617.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64617.log.gz 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42345.log 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52742.log 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75448.log: /var/log/ceph/ceph-client.admin.42345.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75448.log.gz 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42345.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45282.log 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52742.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52742.log.gz 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52513.log 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77023.log 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45282.log: /var/log/ceph/ceph-client.admin.52513.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45282.log.gz 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52657.log 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52513.log.gz 2024-04-25T09:04:46.751 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77023.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77023.log.gz 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56792.log 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68240.log 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52657.log: /var/log/ceph/ceph-client.admin.56792.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52657.log.gz 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42429.log 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56792.log.gz 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68240.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68240.log.gz 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40959.log 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55188.log 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42429.log: /var/log/ceph/ceph-client.admin.40959.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42429.log.gz 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75731.log 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40959.log.gz 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55188.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55188.log.gz 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53437.log 2024-04-25T09:04:46.752 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76313.log 2024-04-25T09:04:46.760 INFO:teuthology.orchestra.run.smithi167.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T09:04:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75731.log: /var/log/ceph/ceph-client.admin.53437.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.75731.log.gz 2024-04-25T09:04:46.761 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53437.log.gz 2024-04-25T09:04:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40707.log 2024-04-25T09:04:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40791.log 2024-04-25T09:04:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.76313.log: /var/log/ceph/ceph-client.admin.40707.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76313.log.gz 2024-04-25T09:04:46.761 INFO:teuthology.orchestra.run.smithi055.stderr: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57395.log 2024-04-25T09:04:46.761 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40707.log.gz 2024-04-25T09:04:46.761 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40791.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40791.log.gz 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66755.log 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57479.log 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57395.log: /var/log/ceph/ceph-client.admin.66755.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57395.log.gz 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66755.log.gz 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62088.log 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57479.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57479.log.gz 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64183.log 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45912.log 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62088.log: /var/log/ceph/ceph-client.admin.64183.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62088.log.gz 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64085.log 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45912.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64183.log.gz 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45912.log.gz 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61094.log 2024-04-25T09:04:46.762 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63198.log 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.64085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64085.log.gz 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50364.log 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61094.log.gz 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63198.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63198.log.gz 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74776.log 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49091.log 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50364.log: /var/log/ceph/ceph-client.admin.74776.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50364.log.gz 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74776.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74569.log 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49091.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49091.log.gz 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71350.log 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50828.log 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.74569.log: /var/log/ceph/ceph-client.admin.71350.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74569.log.gz 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78974.log 2024-04-25T09:04:46.763 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71350.log.gz 2024-04-25T09:04:46.764 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50828.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50828.log.gz 2024-04-25T09:04:46.764 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59539.log 2024-04-25T09:04:46.764 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76058.log 2024-04-25T09:04:46.764 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78974.log: /var/log/ceph/ceph-client.admin.59539.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78974.log.gz 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53609.log 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.76058.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59539.log.gz 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.76058.log.gz 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49975.log 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57605.log 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53609.log.gz 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77495.log 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57605.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49975.log.gz 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57605.log.gz 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57048.log 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46746.log 2024-04-25T09:04:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57048.log: /var/log/ceph/ceph-client.admin.77495.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77495.log.gz 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57048.log.gz 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59270.log 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46660.log 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46746.log: /var/log/ceph/ceph-client.admin.59270.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46746.log.gz 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59270.log.gz 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54155.log 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76939.log 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46660.log.gz 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71308.log 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.76939.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.76939.log.gz 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54155.log.gz 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60968.log 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41638.log 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71308.log.gz 2024-04-25T09:04:46.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74375.log 2024-04-25T09:04:46.776 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60968.log.gz 2024-04-25T09:04:46.776 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53777.log 2024-04-25T09:04:46.776 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41638.log.gz/var/log/ceph/ceph-client.admin.74375.log: 2024-04-25T09:04:46.776 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.74375.log.gz 2024-04-25T09:04:46.776 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56139.log 2024-04-25T09:04:46.776 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60080.log 2024-04-25T09:04:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53777.log: /var/log/ceph/ceph-client.admin.56139.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53777.log.gz 2024-04-25T09:04:46.798 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47391.log 2024-04-25T09:04:46.798 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56139.log.gz 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74862.log 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47391.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60080.log.gz 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47391.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53107.log 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51382.log 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.74862.log: /var/log/ceph/ceph-client.admin.53107.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53107.log.gz 89.1% -- replaced with /var/log/ceph/ceph-client.admin.74862.log.gz 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56181.log 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.51382.log: -- /var/log/ceph/ceph-client.admin.53311.log 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51382.log.gz 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61281.log 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53311.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56181.log.gz 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53311.log.gz 2024-04-25T09:04:46.799 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78409.log 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58623.log 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61281.log: /var/log/ceph/ceph-client.admin.78409.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61281.log.gz 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78409.log.gz 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46290.log 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46956.log 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58623.log.gz 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44673.log 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46956.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46290.log.gz 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46956.log.gz 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55457.log 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40833.log 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55457.log: /var/log/ceph/ceph-client.admin.44673.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44673.log.gz 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55457.log.gz 2024-04-25T09:04:46.800 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41978.log 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70211.log 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40833.log: /var/log/ceph/ceph-client.admin.41978.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40833.log.gz 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67804.log 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41978.log.gz 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56451.log 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67804.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67804.log.gz 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45786.log 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56451.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.70211.log.gz 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42219.log 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56451.log.gz 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44109.log 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42219.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45786.log.gz 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42219.log.gz 2024-04-25T09:04:46.801 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77453.log 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72364.log 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44109.log: /var/log/ceph/ceph-client.admin.77453.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44109.log.gz 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.77453.log.gz 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50098.log 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42597.log 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72364.log: /var/log/ceph/ceph-client.admin.50098.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72364.log.gz 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57227.log 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50098.log.gz 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49343.log 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57227.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42597.log.gz 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57227.log.gz 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72282.log 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70830.log 2024-04-25T09:04:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49343.log: /var/log/ceph/ceph-client.admin.72282.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49343.log.gz 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54822.log 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72282.log.gz 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74333.log 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70830.log: /var/log/ceph/ceph-client.admin.54822.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54822.log.gz 91.1% -- replaced with /var/log/ceph/ceph-client.admin.70830.log.gz 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47535.log 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.74333.log: -- /var/log/ceph/ceph-client.admin.78451.log 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74333.log.gz 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77065.log 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78451.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47535.log.gz 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78451.log.gz 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56367.log 2024-04-25T09:04:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47745.log 2024-04-25T09:04:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77065.log: /var/log/ceph/ceph-client.admin.56367.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77065.log.gz 2024-04-25T09:04:46.836 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50140.log 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56367.log.gz 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48525.log 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47745.log: /var/log/ceph/ceph-client.admin.50140.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47745.log.gz 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:gzip 88.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.41305.log 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50140.log.gz 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48525.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48525.log.gz 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69262.log 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51211.log 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41305.log: /var/log/ceph/ceph-client.admin.69262.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41305.log.gz 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69262.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67464.log 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73781.log 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67464.log: /var/log/ceph/ceph-client.0.51211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51211.log.gz 2024-04-25T09:04:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63583.log 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67464.log.gz 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.73781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62561.log 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63583.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73781.log.gz 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67296.log 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.63583.log.gz/var/log/ceph/ceph-client.admin.62561.log: 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55104.log 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62561.log.gz/var/log/ceph/ceph-client.admin.67296.log: 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57353.log 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67296.log.gz 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67933.log 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57353.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57353.log.gz 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55104.log.gz 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70490.log 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40539.log 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67933.log.gz 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66713.log 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40539.log: 90.5% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40539.log.gz 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70490.log.gz 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71855.log 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.66713.log.gz 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41085.log 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71855.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71855.log.gz 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68871.log 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41085.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41085.log.gz 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75694.log 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.68871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68871.log.gz 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72841.log 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75694.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.75694.log.gz 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45702.log 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72841.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72841.log.gz 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78535.log 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45702.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45702.log.gz 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54071.log 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.78535.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78535.log.gz 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61575.log 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz/var/log/ceph/ceph-client.admin.54071.log: 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54071.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47349.log 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62663.log 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47349.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61575.log.gz 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61052.log 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47349.log.gz 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55254.log 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62663.log.gz 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42723.log 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55254.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61052.log.gz 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44463.log 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55254.log.gz 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60665.log 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7%/var/log/ceph/ceph-client.admin.44463.log: -- replaced with /var/log/ceph/ceph-client.admin.42723.log.gz 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40623.log 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44463.log.gz/var/log/ceph/ceph-client.admin.60665.log: 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60665.log.gz 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46374.log 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54221.log 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6%/var/log/ceph/ceph-client.admin.46374.log: -- replaced with /var/log/ceph/ceph-client.admin.40623.log.gz 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46374.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75927.log 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77201.log 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54221.log: gzip -5 --verbose -- 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54221.log.gz 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.49301.log 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.75927.log: /var/log/ceph/ceph-client.admin.77201.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75927.log.gz 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77201.log.gz 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58207.log 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72023.log 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58207.log: /var/log/ceph/ceph-client.admin.49301.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49301.log.gz 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58207.log.gz 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59647.log 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44421.log 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59647.log: /var/log/ceph/ceph-client.admin.72023.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72023.log.gz 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41975.log 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.59647.log.gz 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77285.log 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41975.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44421.log.gz 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41975.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76100.log 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46038.log 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.77285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48856.log 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77285.log.gz 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.76100.log: /var/log/ceph/ceph-client.admin.46038.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46038.log.gz 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44589.log 2024-04-25T09:04:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48856.log: 89.8% 92.3% -- replaced with /var/log/ceph/ceph-client.admin.48856.log.gz 2024-04-25T09:04:46.844 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76100.log.gz 2024-04-25T09:04:46.844 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59755.log 2024-04-25T09:04:46.844 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58966.log 2024-04-25T09:04:46.844 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44589.log.gz 2024-04-25T09:04:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62747.log 2024-04-25T09:04:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.58966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58966.log.gz 2024-04-25T09:04:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59755.log.gz 2024-04-25T09:04:46.884 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.57755.log 2024-04-25T09:04:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60623.log 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57755.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57755.log.gz 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.62747.log.gz 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67422.log 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66098.log 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60623.log: /var/log/ceph/ceph-client.admin.67422.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60623.log.gz 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67422.log.gz 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44715.log 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45954.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.66098.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48441.log 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44715.log: 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55625.log 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44715.log.gz 2024-04-25T09:04:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55625.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48441.log.gz 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55625.log.gz 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59455.log 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70914.log 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50313.log: /var/log/ceph/ceph-client.admin.59455.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51999.log 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70914.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.59455.log.gz 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59821.log 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51999.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.70914.log.gz 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51999.log.gz 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71771.log 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58368.log 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59821.log: /var/log/ceph/ceph-client.admin.71771.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71771.log.gz 2024-04-25T09:04:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:gzip 90.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.45624.log 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59821.log.gz 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73009.log 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45624.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58368.log.gz 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45624.log.gz 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52261.log 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.73009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59906.log 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73009.log.gz 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61533.log 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59906.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52261.log.gz 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65666.log 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61533.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59906.log.gz 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61533.log.gz 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52826.log 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76217.log 2024-04-25T09:04:46.887 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65666.log.gz 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47084.log 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.76217.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52826.log.gz 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76217.log.gz 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51915.log 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5/var/log/ceph/ceph-client.admin.47084.log: --verbose -- /var/log/ceph/ceph-client.admin.49445.log 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47084.log.gz 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70744.log 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51915.log.gz 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61831.log 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6%/var/log/ceph/ceph-client.admin.70744.log: -- replaced with /var/log/ceph/ceph-client.admin.49445.log.gz 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68028.log 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70744.log.gz/var/log/ceph/ceph-client.admin.61831.log: 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61831.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50406.log 2024-04-25T09:04:46.888 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58775.log 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68028.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68028.log.gz 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.66451.log 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50406.log: /var/log/ceph/ceph-client.admin.58775.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50406.log.gz 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58775.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39869.log 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66451.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66451.log.gz 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42387.log 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.39869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70021.log 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42387.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39869.log.gz 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42387.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.51207.log 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40325.log 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70021.log.gz 2024-04-25T09:04:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.51207.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50576.log 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.0.51207.log.gz/var/log/ceph/ceph-client.admin.40325.log: 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44337.log 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40325.log.gz 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63650.log 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44337.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50576.log.gz 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44337.log.gz 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40180.log 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44025.log 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63650.log.gz 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61365.log 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40180.log.gz 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40283.log 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5%/var/log/ceph/ceph-client.admin.61365.log: -- replaced with /var/log/ceph/ceph-client.admin.44025.log.gz 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60539.log 2024-04-25T09:04:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.40283.log: -- replaced with /var/log/ceph/ceph-client.admin.61365.log.gz 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72107.log 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40283.log.gz 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44211.log 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72107.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60539.log.gz 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72107.log.gz 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54540.log 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51339.log 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54540.log: /var/log/ceph/ceph-client.admin.44211.log: 88.1% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44211.log.gz 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54540.log.gz 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41309.log 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54029.log 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51339.log.gz 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68684.log 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41309.log.gz 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54412.log 2024-04-25T09:04:46.891 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1%/var/log/ceph/ceph-client.admin.68684.log: -- replaced with /var/log/ceph/ceph-client.admin.54029.log.gz 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68684.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66409.log 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.54412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54412.log.gz 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47853.log 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52928.log 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66409.log.gz 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69594.log 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52928.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47853.log.gz 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53525.log 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52928.log.gz 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.69594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43294.log 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69594.log.gz 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59228.log 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53525.log.gz 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.43294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43899.log 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43294.log.gz 2024-04-25T09:04:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64769.log 2024-04-25T09:04:46.893 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59228.log.gz 2024-04-25T09:04:46.893 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43899.log: /var/log/ceph/ceph-client.admin.64769.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43899.log.gz 2024-04-25T09:04:46.893 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64769.log.gz 2024-04-25T09:04:46.923 INFO:teuthology.orchestra.run.smithi055.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T09:04:46.932 INFO:teuthology.orchestra.run.smithi167.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T09:04:47.070 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T09:04:47.083 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T09:04:47.095 INFO:teuthology.orchestra.run.smithi055.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T09:04:47.109 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T09:04:47.111 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-04-25T09:04:47.111 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m0.666s 2024-04-25T09:04:47.111 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m2.941s 2024-04-25T09:04:47.111 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m0.133s 2024-04-25T09:04:47.184 INFO:teuthology.orchestra.run.smithi055.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T09:04:47.288 INFO:teuthology.orchestra.run.smithi055.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T09:04:47.343 INFO:teuthology.orchestra.run.smithi055.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T09:04:47.374 INFO:teuthology.orchestra.run.smithi055.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T09:04:47.376 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T09:04:47.376 INFO:teuthology.orchestra.run.smithi055.stderr:real 0m0.952s 2024-04-25T09:04:47.376 INFO:teuthology.orchestra.run.smithi055.stderr:user 0m4.473s 2024-04-25T09:04:47.376 INFO:teuthology.orchestra.run.smithi055.stderr:sys 0m0.554s 2024-04-25T09:04:47.376 INFO:tasks.ceph:Archiving logs... 2024-04-25T09:04:47.376 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001/remote/smithi055/log 2024-04-25T09:04:47.377 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:04:48.531 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001/remote/smithi167/log 2024-04-25T09:04:48.532 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:04:48.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-25T09:04:48.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-04-25T09:04:48.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-25T09:04:48.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-25T09:04:48.958 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T09:04:48.967 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T09:04:48.967 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:04:48.970 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:04:49.047 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T09:04:49.056 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T09:04:49.056 DEBUG:teuthology.orchestra.run.smithi055:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:04:49.059 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:04:49.074 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:04:49.074 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:04:49.078 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:04:49.078 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-04-25T09:04:49.078 INFO:teuthology.orchestra.run.smithi055.stdout:^- hv01.front.sepia.ceph.com 2 6 377 52 +1862us[+1865us] +/- 660ms 2024-04-25T09:04:49.078 INFO:teuthology.orchestra.run.smithi055.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -711us[ -708us] +/- 79ms 2024-04-25T09:04:49.079 INFO:teuthology.orchestra.run.smithi055.stdout:^* hv03.front.sepia.ceph.com 3 6 377 50 +657us[ +660us] +/- 76ms 2024-04-25T09:04:49.079 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:04:49.080 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:04:49.080 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-04-25T09:04:49.080 INFO:teuthology.orchestra.run.smithi167.stdout:^- hv01.front.sepia.ceph.com 2 6 377 49 +1880us[+1880us] +/- 660ms 2024-04-25T09:04:49.080 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -684us[ -682us] +/- 79ms 2024-04-25T09:04:49.080 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv03.front.sepia.ceph.com 3 6 377 51 +673us[ +675us] +/- 76ms 2024-04-25T09:04:49.080 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:04:49.081 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T09:04:49.124 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T09:04:49.125 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T09:04:49.149 DEBUG:teuthology.orchestra.run.smithi055:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T09:04:49.241 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T09:04:49.307 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T09:04:49.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:49.338 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T09:04:49.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:49.367 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T09:04:49.382 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T09:04:49.416 INFO:teuthology.task.internal:Duration was 1042.258821 seconds 2024-04-25T09:04:49.416 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T09:04:49.441 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T09:04:49.441 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:04:49.444 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:04:49.483 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:04:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:04:49.686 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T09:04:49.686 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:04:49.687 DEBUG:teuthology.orchestra.run.smithi055:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:04:49.708 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T09:04:49.708 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:04:49.752 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T09:04:49.752 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:04:49.755 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:04:49.817 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T09:04:49.817 DEBUG:teuthology.orchestra.run.smithi055:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:04:49.822 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:04:49.958 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T09:04:49.969 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T09:04:49.969 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:04:49.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:04:50.016 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T09:04:50.027 DEBUG:teuthology.orchestra.run.smithi055:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:04:50.035 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:04:50.055 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = core 2024-04-25T09:04:50.078 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-04-25T09:04:50.090 DEBUG:teuthology.orchestra.run.smithi055:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:04:50.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:50.127 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:04:50.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:50.144 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T09:04:50.155 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T09:04:50.155 DEBUG:teuthology.misc:Transferring archived files from smithi055:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001/remote/smithi055 2024-04-25T09:04:50.156 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:04:50.203 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673001/remote/smithi167 2024-04-25T09:04:50.203 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:04:50.235 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T09:04:50.235 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:04:50.238 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:04:50.284 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T09:04:50.295 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T09:04:50.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T09:04:50.317 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T09:04:50.317 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:04:50.319 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:04:50.332 INFO:teuthology.orchestra.run.smithi055.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:04 /home/ubuntu/cephtest 2024-04-25T09:04:50.338 INFO:teuthology.orchestra.run.smithi167.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:04 /home/ubuntu/cephtest 2024-04-25T09:04:50.339 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T09:04:50.350 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T09:04:50.394 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} duration: 1042.2588212490082 flavor: default owner: scheduled_neesingh@teuthology success: true 2024-04-25T09:04:50.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T09:04:50.475 INFO:teuthology.run:pass